List completed

This commit is contained in:
Christian Risi 2025-04-15 17:21:29 +02:00
parent e631797266
commit f614eaf565

View File

@ -14,7 +14,7 @@ their **derivate is near 0**
## List of Non-Saturating Activation Functions ## List of Non-Saturating Activation Functions
<!--TODO: Insert Graphics--> <!--TODO: Insert Graphs-->
### ReLU ### ReLU
@ -487,8 +487,6 @@ for `activation-functions`** and it is used to
**deal with numerical instabilities** and **deal with numerical instabilities** and
as a **component for other losses** as a **component for other losses**
<!-- TODO: Complete list -->
[^PReLU]: [Microsoft Paper | arXiv:1502.01852v1 [cs.CV] 6 Feb 2015](https://arxiv.org/pdf/1502.01852v1) [^PReLU]: [Microsoft Paper | arXiv:1502.01852v1 [cs.CV] 6 Feb 2015](https://arxiv.org/pdf/1502.01852v1)
[^RReLU]: [Empirical Evaluation of Rectified Activations in Convolution Network](https://arxiv.org/pdf/1505.00853v2) [^RReLU]: [Empirical Evaluation of Rectified Activations in Convolution Network](https://arxiv.org/pdf/1505.00853v2)