List completed
This commit is contained in:
parent
e631797266
commit
f614eaf565
@ -14,7 +14,7 @@ their **derivate is near 0**
|
|||||||
|
|
||||||
## List of Non-Saturating Activation Functions
|
## List of Non-Saturating Activation Functions
|
||||||
|
|
||||||
<!--TODO: Insert Graphics-->
|
<!--TODO: Insert Graphs-->
|
||||||
|
|
||||||
### ReLU
|
### ReLU
|
||||||
|
|
||||||
@ -487,8 +487,6 @@ for `activation-functions`** and it is used to
|
|||||||
**deal with numerical instabilities** and
|
**deal with numerical instabilities** and
|
||||||
as a **component for other losses**
|
as a **component for other losses**
|
||||||
|
|
||||||
<!-- TODO: Complete list -->
|
|
||||||
|
|
||||||
[^PReLU]: [Microsoft Paper | arXiv:1502.01852v1 [cs.CV] 6 Feb 2015](https://arxiv.org/pdf/1502.01852v1)
|
[^PReLU]: [Microsoft Paper | arXiv:1502.01852v1 [cs.CV] 6 Feb 2015](https://arxiv.org/pdf/1502.01852v1)
|
||||||
|
|
||||||
[^RReLU]: [Empirical Evaluation of Rectified Activations in Convolution Network](https://arxiv.org/pdf/1505.00853v2)
|
[^RReLU]: [Empirical Evaluation of Rectified Activations in Convolution Network](https://arxiv.org/pdf/1505.00853v2)
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user