Fixed latex math problem
This commit is contained in:
parent
934c08d4c0
commit
1a30dc6400
@ -281,12 +281,12 @@ small value, usually in the order of $10^{-8}$
|
||||
> instead of a vector. To make it easier to understand in matricial notation:
|
||||
>
|
||||
> $$
|
||||
> \begin{aligned}
|
||||
> \nabla L^{(k + 1)} &= \frac{d \, Loss^{(k)}}{d \, W^{(k)}} \\
|
||||
> G^{(k + 1)} &= G^{(k)} +(\nabla L^{(k+1)}) ^2 \\
|
||||
> W^{(k+1)} &= W^{(k)} - \eta \frac{\nabla L^{(k + 1)}}
|
||||
\begin{aligned}
|
||||
\nabla L^{(k + 1)} &= \frac{d \, Loss^{(k)}}{d \, W^{(k)}} \\
|
||||
G^{(k + 1)} &= G^{(k)} +(\nabla L^{(k+1)}) ^2 \\
|
||||
W^{(k+1)} &= W^{(k)} - \eta \frac{\nabla L^{(k + 1)}}
|
||||
{\sqrt{G^{(k+1)} + \epsilon}}
|
||||
> \end{aligned}
|
||||
\end{aligned}
|
||||
> $$
|
||||
>
|
||||
> In other words, compute the gradient and scale it for the sum of its squares
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user