Image Processing & Computer Vision: Textbook
Image Processing & Computer Vision: Textbook
Image Processing & Computer Vision: Textbook
Email: jns@eced.svnit.ac.in
5 6
1
General Information (Con’d)
Work Submission
• Working load:
- Homework and computer assignments ► Homework
- Mid-Sem Exam (30 Marks)
- END-SEM Exam (50 Marks)
Hard copy only (submit soft copy only if you
have obtained the permission from the
- Quiz/viva/Assignments/Mini-project (20 Marks)
instructor)
Mini- Project (3 person per team, MATLAB-based) Instructor will collect them before the class on
the due date
•Warnings:
Copying assignment is prohibited. ► Computer assignments
Delay of submission influences on marks and grades Soft copy only
7 8
2
12
of What is a Digital Image?
Tour Guide 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Acquisition Generation dimensional image as a finite set of digital
D.I.P. values, called picture elements or pixels
Theme Image
Park Compression
Image Image
Manipulation Analysis
Image Image
Display Perception
11
13 14
of What is a Digital Image? (cont…) of What is a Digital Image? (cont…)
36 36
Pixel values typically represent gray levels, Common image formats include:
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
1 pixel
3
15
of What is Digital Image Processing?
36
16
18
Representing Digital Images
of What is DIP? (cont…)
36
4
A Historical Overview of DIP A Historical Overview of DIP
Early 1920s: One of the first applications of
digital imaging was in the news-
paper industry
The Bartlane cable picture transmission service
Images were transferred by submarine cable
between London and New York
Newspaper industry used Bartlane cable picture
transmission system to send pictures by submarine Pictures were coded for cable transfer and
cable between London and New York in 1920s reconstructed at the receiving end on a
telegraph printer
19 20
5
Why do we need to Processing Human Perception
an image ?
► Image processing is a subclass of signal ► Employ methods capable of enhancing
processing concerned specifically with pictures. information for human interpretation and
► Improve image quality for human perception analysis
and/or computer interpretation. ► Typical applications
It is motivated by major applications - Noise Filtering
► Improvement of pictorial information for human - Content enhancement
perception
(Certain characteristics)
► Image processing for autonomous machine
applications
- Contrast enhancement
► Efficient storage and transmission
- Deblurring
- Remote Sensing
23 24
25 26
6
27 28
29 30
7
► In nuclear Medicine: Approach is to inject a
patient with a radioactive isotope that
emits gamma rays as it decays. Images are
produced from emissions collected by
gamma ray detectors
31 32
► Figure (a) shows a familiar chest X-ray generated simply by placing the patient
between an X-ray source and a film sensitive to X-ray energy.
► The intensity of the X-rays is modified by absorption as they pass through the
patient, and the resulting energy falling on the film develops it, much in the
same way that light develops photographic film.
► Figure (b) shows an example of an aortic angiogram. The catheter can be seen
being inserted into the large blood vessel.
33 34
8
► Applications of ultraviolet “light” are varied. They include lithography,
industrial inspection, microscopy, lasers, biological imaging, and
astronomical observations.
35 36
37 38
9
Examples: Visual and Infrared Imaging Examples: Visual and Infrared Imaging
39 40
2003
USA 1993 41 42
10
43 44
45 49
11
Fundamental Steps in DIP
Extracting image Light and EM Spectrum
components
Improving the
appearance Partition an image into
its constituent parts or
objects
Result is more
suitable than Represent image for
the original computer processing
c E h , h : Planck's constant.
50 51
e.g. green objects reflect light with wavelengths primarily ► Chromatic light bands: 0.43 to 0.79 um
in the 500 to 570 nm range while absorbing most of the
energy at other wavelength The quality of a chromatic light source:
Radiance: total amount of energy
Luminance (lm): the amount of energy an observer perceives
from a light source
Brightness: a subjective descriptor of light perception that is
impossible to measure. It embodies the achromatic notion of intensity
and one of the key factors in describing color sensation.
52 53
12
Image Acquisition A Simple Image Formation Model
f ( x, y ) i ( x , y ) r ( x , y )
54 58
► Illumination ► Reflectance
Lumen — A unit of light flow or luminous flux
Lumen per square meter (lm/m2) — The metric unit of measure 0.01 for black velvet
for illuminance of a surface
The typical illumination level in a commercial office is about 1000 lm/m2 0.93 for snow
59 60
13
61 62
63 64
14
65 66
67 68
15
69 70
71 72
16
The Born of Computer
Soar Into Outer Space
Tomography
The first picture of moon by US spacecraft Ranger 7 Sir Godfrey N. Housefield and Prof. Allan M. Cormack
on July 31, 1964 at 9:09AM EDT shared 1979 Nobel Prize in Medicine for the invention of CT
73 74
17
Visible (I): Photography Visible (II): Motion Pictures
77 78
18
Beyond Visible (I): Thermal
Visible (V): Remote Sensing
Images
Operate in infrared frequency
81 82
Beyond Visible (II): Radar Beyond Visible (III): MRI and Astronomy
Images Operate in radio frequency
Operate in microwave frequency
19
Beyond Visible (IV): Fluorescence
Microscopy Beyond Visible (V): Medical Diagnostics
Operate in ultraviolet frequency Operate in X-ray frequency
chest head
► Acoustic imaging
Translate “sound waves” into image signals
► Electron microscopy
Shine a beam of electrons through a speciman
► Synthetic images in Computer Graphics
Computer generated (non-existent in the real
Cygnus Loop in the world)
constellation of Cygnus
Positron Emission Tomography
87 88
20
Acoustic Imaging Electron Microscope
visible seismic
21
Representing Digital Images
An image may be defined as a
two-dimensional f(x ,y), where x
and y are spatial coordinates and
the amplitude of f at any pair of
coordinates (x,y) is called
intensity of the image at that
point.
93 94
Digital Image Types : Intensity Image Digital Image Types : RGB Image
22
Image Types : Binary Image Image Types : Index Image
99 100
23
Representing Digital Images Representing Digital Images
101 102
b=M×N×k
103 104
24
Spatial and Intensity Resolution
Spatial and Intensity Resolution
► Spatial resolution
— A measure of the smallest discernible detail in an image
— stated with line pairs per unit distance, dots (pixels) per
unit distance, dots per inch (dpi)
► Intensity resolution
— The smallest discernible change in intensity level
— stated with 8 bits, 12 bits, 16 bits, etc.
105 106
107 108
25
Reading an Image
109 110
111 112
26
113 114
115 116
27
118
of Introduction
36
119 120
of References of Contents
36 36
28
121 122
of What is a Digital Image? of What is a Digital Image? (cont…)
36 36
A digital image is a representation of a two- Pixel values typically represent gray levels,
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
dimensional image as a finite set of digital colours, heights, opacities etc
values, called picture elements or pixels Remember digitization implies that a digital
image is an approximation of a real scene
1 pixel
123 124
of What is a Digital Image? (cont…) of What is Digital Image Processing?
36 36
29
125 126
of What is DIP? (cont…) of History of Digital Image Processing
36 36
The continuum from image processing to computer Early 1920s: One of the first applications of
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
vision can be broken up into low-, mid- and high-level digital imaging was in the news-
processes paper industry
High Level Process – The Bartlane cable picture
Low Level Process Mid Level Process
Input: Attributes transmission service Early digital image
Input: Image Input: Image
Output: Image Output: Attributes
Output: – Images were transferred by submarine cable
Understanding between London and New York
Examples: Noise Examples: Object
removal, image recognition,
Examples: Scene – Pictures were coded for cable transfer and
understanding,
sharpening segmentation reconstructed at the receiving end on a
autonomous
navigation telegraph printer
In this course we
will stop here
127 128
of History of DIP (cont…) of History of DIP (cont…)
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Bartlane system resulted in higher quality technology and the onset of the space race
images led to a surge of work in digital image
– New reproduction processing
processes based – 1964: Computers used to
on photographic improve the quality of
techniques images of the moon taken
– Increased number by the Ranger 7 probe
of tones in Improved – Such techniques were used
reproduced images digital Early 15 tone digital A picture of the moon
image
in other space missions
image
including the Apollo landings taken by the Ranger 7
probe minutes before
landing
30
129 130
of History of DIP (cont…) of History of DIP (cont…)
36 36
1970s: Digital image processing begins to 1980s - Today: The use of digital image
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
131 132
of Examples: Image Enhancement of Examples: The Hubble Telescope
36 36
One of the most common uses of DIP Launched in 1990 the Hubble
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
31
133 134
of Examples: Artistic Effects of Examples: Medicine
36 36
Artistic effects are Take slice from MRI scan of canine heart,
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
used to make and find boundaries between types of tissue
images more – Image with gray levels representing tissue
visually appealing, density
to add special – Use a suitable filter to highlight edges
effects and to make
composite images
135 136
of Examples: GIS of Examples: GIS (cont…)
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
– Digital image processing techniques are used the World data set
extensively to manipulate satellite imagery – Global inventory of
– Terrain classification human settlement
– Meteorology – Not hard to imagine
the kind of analysis
that might be done
using this data
32
137 138
of Examples: Industrial Inspection of Examples: PCB Inspection
36 36
139 140
of Examples: Law Enforcement of Examples: HCI
36 36
33
141 142
Key Stages in Digital Image Processing:
of Key Stages in Digital Image Processing of
36 36 Image Aquisition
Morphologi Morphologi
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Image
cal cal
Restoration Restoration
Processing Processing
Image Image
Segmentati Segmentati
Enhanceme Enhanceme
on on
nt nt
Image Object Image Object
Acquisition Recognition Acquisition Recognition
Representation Representation
Problem Domain & Description Problem Domain & Description
Colour Image Colour Image
Image Compressio Image Compressio
Processing n Processing n
143 144
of
Key Stages in Digital Image Processing: of
Key Stages in Digital Image Processing:
36 Image Enhancement 36 Image Restoration
Morphologi Morphologi
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Image
cal cal
Restoration Restoration
Processing Processing
Image Image
Segmentati Segmentati
Enhanceme Enhanceme
on on
nt nt
Image Object Image Object
Acquisition Recognition Acquisition Recognition
Representation Representation
Problem Domain & Description Problem Domain & Description
Colour Image Colour Image
Image Compressio Image Compressio
Processing n Processing n
34
145 146
of
Key Stages in Digital Image Processing: of
Key Stages in Digital Image Processing:
36 Morphological Processing 36 Segmentation
Morphologi Morphologi
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Image
cal cal
Restoration Restoration
Processing Processing
Image Image
Segmentati Segmentati
Enhanceme Enhanceme
on on
nt nt
Image Object Image Object
Acquisition Recognition Acquisition Recognition
Representation Representation
Problem Domain & Description Problem Domain & Description
Colour Image Colour Image
Image Compressio Image Compressio
Processing n Processing n
147 148
of
Key Stages in Digital Image Processing: of
Key Stages in Digital Image Processing:
36 Object Recognition 36 Representation & Description
Morphologi Morphologi
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Image
cal cal
Restoration Restoration
Processing Processing
Image Image
Segmentati Segmentati
Enhanceme Enhanceme
on on
nt nt
Image Object Image Object
Acquisition Recognition Acquisition Recognition
Representation Representation
Problem Domain & Description Problem Domain & Description
Colour Image Colour Image
Image Compressio Image Compressio
Processing n Processing n
35
149 150
of
Key Stages in Digital Image Processing: of
Key Stages in Digital Image Processing:
36 Image Compression 36 Colour Image Processing
Morphologi Morphologi
Image Image
cal cal
Restoration Restoration
Processing Processing
Image Image
Segmentati Segmentati
Enhanceme Enhanceme
on on
nt nt
Image Object Image Object
Acquisition Recognition Acquisition Recognition
Representation Representation
Problem Domain & Description Problem Domain & Description
Colour Image Colour Image
Image Compressio Image Compressio
Processing n Processing n
151 152
of Summary of Sampling, Quantisation And Resolution
36 36
36
153 154
of Image Representation of Image Acquisition
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
that a digital image is composed of M rows illuminating a scene and absorbing the
and N columns of pixels energy reflected by the objects in that scene
each storing a value col
– Typical notions of
Pixel values are most illumination and scene
often grey levels in the can be way off:
range 0-255(black-white) • X-rays of a skeleton
We will see later on • Ultrasound of an
that images can easily unborn baby
be represented as • Electro-microscopic
f (row, col)
images of molecules
matrices row
155 156
of Image Sensing of Image Sensing
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Imaging Sensor
Line of Image Sensors Array of Image Sensors Using Sensor Strips and Rings
37
157 158
of Image Sampling And Quantisation of Image Sampling And Quantisation
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
number of samples at a discrete set of
energy levels
Quantisation is the process of converting a
continuous analogue signal into a digital
representation of this signal
159 160
Image Sampling And Quantisation
of Image Sampling And Quantisation of
(cont…)
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
38
Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)
of
of
36
36
163
161
Image Representation
Image Representation
Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)
of
of
36
36
164
162
Image Representation
Image Representation
39
165 166
of Spatial Resolution of Spatial Resolution (cont…)
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
determined by how sampling was carried out
Spatial resolution simply refers to the
smallest discernable detail in an image
– Vision specialists will
often talk about pixel
size
– Graphic designers will
talk about dots per
inch (DPI)
167 168
of Spatial Resolution (cont…) of Spatial Resolution (cont…)
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
40
Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)
of
of
36
36
171
169
Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)
of
of
36
36
172
170
41
173 174
of Intensity Level Resolution of Intensity Level Resolution (cont…)
36 36
256 grey levels (8 bits per pixel) 128 grey levels (7 bpp) 64 grey levels (6 bpp) 32 grey levels (5 bpp)
Intensity level resolution refers to the
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
number of intensity levels used to represent
the image
– The more intensity levels used, the finer the level of
detail discernable in an image
– Intensity level resolution is usually given in terms of
the number of bits used to store each intensity level
Number of Intensity
Number of Bits Examples
Levels
1 2 0, 1
2 4 00, 01, 10, 11
4 16 0000, 0101, 1111
8 256 00110011, 01010101
16 65,536 1010101010101010 16 grey levels (4 bpp) 8 grey levels (3 bpp) 4 grey levels (2 bpp) 2 grey levels (1 bpp)
175 176
of Intensity Level Resolution (cont…) of Intensity Level Resolution (cont…)
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
42
Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)
of
of
36
36
179
177
Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)
of
of
36
36
180
178
43
181 182
of Intensity Level Resolution (cont…) of Intensity Level Resolution (cont…)
36 36
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
183 184
Resolution: How Much Is Enough?
of Resolution: How Much Is Enough? of
(cont…)
36 36
44
Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)
of
of
36
36
187
185
Low Detail
Medium Detail
High Detail
Images taken from Gonzalez & Woods, Digital Image Processing (2002) Images taken from Gonzalez & Woods, Digital Image Processing (2002)
of
of
36
36
188
186
45
189
of Summary
36
46