Skip to content

Commit 76b1bb2

Browse files
committed
Fix formatting, extend a bit.
1 parent a375cf4 commit 76b1bb2

File tree

1 file changed

+25
-4
lines changed

1 file changed

+25
-4
lines changed

doc/lenet.txt

Lines changed: 25 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -401,10 +401,31 @@ to be compatible with our previous MLP implementation.
401401

402402

403403
.. note::
404-
Note that the term convolution could corresponds to different mathematical operations.
405-
1. theano.tensor.nnet.conv2d which is the most common one in almost all of the recent published convolutional models. In this op for each output feature map, all the input feature maps are summed together after being convolved with the filter.
406-
2. Original LeNet model: In this work for each output feature map, only subset of input feature maps were selected.
407-
3. The convolution used in signal processing: theano.tensor.signal.conv.conv2d which works only on single channel inputs.
404+
Note that the term "convolution" could corresponds to different mathematical operations:
405+
406+
1. `theano.tensor.nnet.conv2d
407+
<http://deeplearning.net/software/theano/library/tensor/nnet/conv.html#theano.tensor.nnet.conv.conv2d>`_,
408+
which is the most common one in almost all of the recent published
409+
convolutional models.
410+
In this operation, each output feature map is connected to each
411+
input feature map by a different 2D filter, and its value is the sum of
412+
the individual convolution of all inputs through the corresponding filter.
413+
414+
2. The convolution used in the original LeNet model: In this work,
415+
each output feature map is only connected to a subset of input
416+
feature maps.
417+
418+
3. The convolution used in signal processing:
419+
`theano.tensor.signal.conv.conv2d
420+
<http://deeplearning.net/software/theano/library/tensor/signal/conv.html#theano.tensor.signal.conv.conv2d>`_,
421+
which works only on single channel inputs.
422+
423+
Here, we use the first operation, so this models differ slightly
424+
from the original LeNet paper. One reason to use 2. would be to
425+
reduce the amount of computation needed, but modern hardware makes
426+
it as fast to have the full connection pattern. Another reason would
427+
be to slightly reduce the number of free parameters, but we have
428+
other regularization techniques at our disposal.
408429

409430

410431

0 commit comments

Comments
 (0)