IntroductionDeepLearningMLP
IntroductionDeepLearningMLP
IntroductionDeepLearningMLP
Geena Kim
https://www.youtube.com/watch?v=EhcpGpFHCrw
Why Deep Learning?
Medical Imaging,
AI in Medicine
P. Rajpurkar et el.,
Why Deep Learning?
Shopping,
e-commerce
Computer vision in Robotics
Why Deep Learning?
Voice
Recog
Smar
t Dev nition,
ices
Deep learning in game playing
Deep learning face generation
Deep learning sound generation
https://ai.googleblog.com/2018/03/expressive-speech-synthesis-with.html
Deep learning explaining pictures
https://cs.stanford.edu/people/karpathy/deepimagesent/
The Deep Learning Age
Neurons in Biological Systems
Neurons in Biological Systems
What is Artificial Neuron (Perceptron)
History of neural networks
https://www.nytimes.com/2017/02/17/science/santiago-ramon-y-cajal-beautiful-brain.html
History of neural networks
“Connectionism”
Connectionism is an approach in the field of cognitive science that
hopes to explain mental phenomena using artificial neural networks.
-Wikipedia
Learning in perceptron
• Perceptron rule
• Delta rule (Gradient Descent)
Perceptron
Perceptron rule
Perceptron
Perceptron algorithm
Perceptron
Perceptron algorithm
Perceptron algorithm
Perceptron algorithm
Perceptron
Perceptron algorithm
Misclassified negative instance
Perceptron
Perceptron algorithm
Perceptron algorithm
Perceptron
w=1
X
OR X ˅Y
Y w=1 th=1
w=-1
X NOT ¬X
w=1
X 1
th=0
AND X ˄Y
Y w=1
th=2
Perceptron
X
XOR X Y
Y
Perceptron
States Actions
MLP
..
…
Multi-layer Perceptron (Neural network)
Design Parameters
- Architecture
- Number of layers
- Number of neurons in a layer
- Activation functions
Artificial Neural Network facts
Weights = parameters
(cf) Hyperparameters = design parameters
Next time: How Neural Network Training Works
hj = f(wij * Xi + bj)
j k
i
0
y_pred y_target
1
…
2