Skip to content

Commit 644117d

Browse files
committed
Merge pull request lisa-lab#117 from Zmeos/patch-1
Added MSGD abbreviation introduction
2 parents fcb7081 + 7c1219d commit 644117d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

doc/gettingstarted.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -389,7 +389,7 @@ form, we estimate the gradient from just a single example at a time.
389389

390390
The variant that we recommend for deep learning is a further twist on
391391
stochastic gradient descent using so-called "minibatches".
392-
Minibatch SGD works identically to SGD, except that we use more than
392+
Minibatch SGD (MSGD) works identically to SGD, except that we use more than
393393
one training example to make each estimate of the gradient. This technique reduces
394394
variance in the estimate of the gradient, and often makes better use of the
395395
hierarchical memory organization in modern computers.

0 commit comments

Comments
 (0)