Scribd
Upload
182 views40 pages

Fundamentals of Deep Learning

This document provides an introduction and overview of a course on fundamentals of deep learning. It discusses the goals of getting students up and running quickly with deep learning projects while building a foundation. The course agenda covers the history of AI, how deep learning transformed the world, and an introduction to concepts like neural networks, machine learning versus programming. It also outlines hands-on exercises including classifying handwritten digits as the first example.

Uploaded by

Ankit Biswas
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
182 views40 pages

Fundamentals of Deep Learning

This document provides an introduction and overview of a course on fundamentals of deep learning. It discusses the goals of getting students up and running quickly with deep learning projects while building a foundation. The course agenda covers the history of AI, how deep learning transformed the world, and an introduction to concepts like neural networks, machine learning versus programming. It also outlines hands-on exercises including classifying handwritten digits as the first example.

Uploaded by

Ankit Biswas
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 40

FUNDAMENTALS OF

DEEP LEARNING
Part 1: An Introduction to Deep Learning

1
To see lecture notes, make full screen
and click the “notes” button

2
WELCOME!
3
THE GOALS OF THIS COURSE

• Get you up and on your feet quickly


• Build a foundation to tackle a deep learning project right away
• We won’t cover the whole field, but we’ll get a great head start
• Foundation from which to read articles, follow tutorials, take further
classes
Part 1: An Introduction to Deep Learning

Part 2: How a Neural Network Trains

AGENDA Part 3: Convolutional Neural Networks

Part 4: Data Augmentation and Deployment

Part 5: Pre-trained Models

Part 6: Advanced Architectures


AGENDA – PART 1
• History of AI
• The Deep Learning Revolution

• What is Deep Learning


• How Deep Learning is Transforming the World
• Overview of the Course

• First Exercise
HAVE FUN!
HUMAN VS MACHINE LEARNING
Relaxed Alertness

Human Machine

Rest and Digest Training

Fight-or-flight Prediction
LET’S GET STARTED

9
HISTORY OF AI
10
BEGINNING OF ARTIFICIAL INTELLIGENCE

COMPUTERS ARE MADE IN EARLY ON, GENERALIZED TURNED OUT TO BE HARDER


PART TO COMPLETE HUMAN INTELLIGENCE LOOKED THAN EXPECTED
TASKS POSSIBLE

11
EARLY NEURAL NETWORKS

Inspired by biology

Created in the 1950’s

Outclassed by Von
Neumann Architecture

12
EXPERT SYSTEMS

Highly complex

Programmed by hundreds of engineers

Rigorous programming of many rules


EXPERT SYSTEMS - LIMITATIONS

What are these three images?

14
HOW DO CHILDREN LEARN?

• Expose them to lots of data


• Give them the “correct
answer”
• They will pick up the
important patterns on their
own

15
THE DEEP LEARNING
REVOLUTION
16
DATA

- Networks need a lot of


information to learn from
- The digital era and the
internet has supplied that
data

17
COMPUTING POWER
Need a way for our artificial “brain” to observe lots of data
within a practical amount of time.

18
THE IMPORTANCE OF THE GPU

A Rendered Image A Neural Network

19
WHAT IS DEEP LEARNING?
20
DEEP LEARNING FLIPS TRADITIONAL
PROGRAMMING ON ITS HEAD

21
TRADITIONAL PROGRAMMING
Building a Classifier

1 2 3
Define a set of Program those Feed it examples,
rules for rules into the and the program
classification computer uses the rules to
classify
MACHINE LEARNING
Building a Classifier

1 2 3
Show model the Model takes Model learns to
examples with the guesses, we tell it correctly
answer of how to if it’s right or not categorize as it’s
classify training. The
system learns the
rules on its own
THIS IS A FUNDAMENTAL SHIFT
WHEN TO CHOOSE DEEP LEARNING

Classic Programming Deep Learning

If rules are clear


If rules are
and
nuanced, complex,
straightforward,
difficult to discern,
often better to just
use deep learning
program it
25
DEEP LEARNING COMPARED TO OTHER AI

Depth and complexity of networks

Up to billions of parameters (and growing)

Many layers in a model

Important for learning complex rules


HOW DEEP LEARNING IS
TRANSFORMING THE WORLD
27
COMPUTER VISION

ROBOTICS AND OBJECT SELF DRIVING


MANUFACTURING DETECTION CARS

28
NATURAL LANGUAGE PROCESSING

REAL TIME VOICE VIRTUAL


TRANSLATION RECOGNITION ASSISTANTS

29
RECOMMENDER SYSTEMS

CONTENT TARGETED SHOPPING


CURATION ADVERTISING RECOMMENDATIONS

30
REINFORCEMENT LEARNING

ALPHAGO BEATS AI BOTS BEAT STOCK TRADING


WORLD CHAMPION PROFESSIONAL ROBOTS
IN GO VIDEOGAMERS
31
OVERVIEW OF THE
COURSE
32
HANDS ON EXERCISES

• Get comfortable with the


process of deep learning
• Exposure to different models
and datatypes
• Get a jump-start to tackle
your own projects

33
STRUCTURE OF THE COURSE
“Hello World” of Deep Learning

Train a more complicated model

New architectures and techniques to improve


performance

Pre-trained models

Transfer learning
34
PLATFORM OF THE COURSE

GPU powered cloud server

JupyterLab platform

Jupyter notebooks for interactive coding


SOFTWARE OF THE COURSE

• Major deep learning platforms:


• TensorFlow + Keras (Google)
• Pytorch (Facebook)
• MXNet (Apache)
• We’ll be using TensorFlow and Keras
• Good idea to gain exposure to others
moving forward

36
FIRST EXERCISE:
CLASSIFY HANDWRITTEN
DIGITS
37
HELLO NEURAL NETWORKS

Train a network to • Historically important and


correctly classify
handwritten digits difficult task for computers

• Get exposed to the example, and


Try learning like a
Neural Network try to figure out the rules to how
it works

38
LET’S GO!

39
40

You might also like