Lect01- Introductions and Fundamentals
Lect01- Introductions and Fundamentals
Lecture 1
Introduction & Fundamentals
Dr. Pabitra Pal
Assistant Professor,
Department of Computer Applications,
School of Information Science & Technology
MAULANA ABUL KALAM AZAD UNIVERSITY OF
TECHNOLOGY
Introduction to the course
► Canvas: link
► Contact: email:
[email protected]
► Textbooks
Weeks 1 & 2 2
Introduction to the course
► Grading
Article Reading and Presentation: 15%
Homework: 20%
Exam: 15%
Project: 50%
Total: 100%
Extra Credits: 50%. If the method and
experimental results of your project achieve the
state of the art, you will earn the extra 50%
credits.
Weeks 1 & 2 3
Journals & Conferences
in Image Processing
► Journals:
— IEEE T IMAGE PROCESSING
— IEEE T MEDICAL IMAGING
— INTL J COMP. VISION
— IEEE T PATTERN ANALYSIS MACHINE INTELLIGENCE
— PATTERN RECOGNITION
— COMP. VISION AND IMAGE UNDERSTANDING
— IMAGE AND VISION COMPUTING
… …
► Conferences:
— CVPR: Comp. Vision and Pattern Recognition
— ICCV: Intl Conf on Computer Vision
— ACM Multimedia
— ICIP
— SPIE
— ECCV: European Conf on Computer Vision
— CAIP: Intl Conf on Comp. Analysis of Images and Patterns
… …
Weeks 1 & 2 4
Introduction
► What is Digital Image Processing?
Digital Image
— a two-dimensional function f ( x, y )
x and y are spatial coordinates
The amplitude of f is called intensity or gray level at the point (x, y)
Pixel
— the elements of a digital image
Weeks 1 & 2 5
Origins of Digital Image
Processing
One of the first applications of digital images was in the newspaper
industry, when pictures were first sent by submarine cable between
London and New York.
Introduction of the Bartlane cable picture transmission system in the
early 1920s reduced the time required to transport a picture across the
Atlantic from more than a week to less than three hours.
Specialized printing equipment coded pictures for cable transmission
and then reconstructed them at the receiving end.
Weeks 1 & 2 6
Origins of Digital Image
Processing
Figure was transmitted in this way
and reproduced on a telegraph printer
fitted with typefaces simulating a
halftone pattern.
Weeks 1 & 2 7
Origins of Digital Image
Processing
Weeks 1 & 2 8
Sources for Images
► Electromagnetic (EM) energy spectrum
► Acoustic
► Ultrasonic
► Electronic
► Synthetic images produced by computer
Weeks 1 & 2 9
Electromagnetic (EM) energy
spectrum
Major uses
Gamma-ray imaging: nuclear medicine and astronomical observations
X-rays: medical diagnostics, industry, and astronomy, etc.
Ultraviolet: lithography, industrial inspection, microscopy, lasers, biological imaging,
and astronomical observations
Visible and infrared bands: light microscopy, astronomy, remote sensing, industry,
and law enforcement
Microwave band: radar
Radio band: medicine (such as MRI) and astronomy
Weeks 1 & 2 10
Examples: Gama-Ray Imaging
Weeks 1 & 2 11
Examples: X-Ray Imaging
Weeks 1 & 2 12
Examples: Ultraviolet Imaging
Weeks 1 & 2 13
Examples: Light Microscopy Imaging
Weeks 1 & 2 14
Examples: Visual and Infrared Imaging
Weeks 1 & 2 15
Examples: Visual and Infrared Imaging
Weeks 1 & 2 16
Examples: Infrared Satellite Imaging
2003
USA 1993
Weeks 1 & 2 17
Examples: Infrared Satellite Imaging
Weeks 1 & 2 18
Examples: Automated Visual Inspection
Weeks 1 & 2 19
Examples: Automated Visual Inspection
Results of
automated
reading of the
plate content
by the system
The area in
which the
imaging
system
detected the
plate
Weeks 1 & 2 20
Example of Radar Image
Weeks 1 & 2 21
Examples: MRI (Radio Band)
Weeks 1 & 2 22
Examples: Ultrasound Imaging
Weeks 1 & 2 23
Applications of DIP
► Applications
The field of image processing has applications in medicine and the
space program.
Computer procedures are used to enhance the contrast or code the
intensity levels into color for easier interpretation of X-rays and
other
images used in industry, medicine, and the biological sciences.
Geographers use the same or similar techniques to study pollution
patterns from aerial and satellite imagery
Image enhancement and restoration procedures are used to
process degraded images of unrecoverable objects
Weeks 1 & 2 24
Fundamental Steps in DIP
Extracting
image
components
Improving
the Partition an image
appearance into its constituent
parts or objects
Result is
more Represent image for
suitable than computer
the original processing
Weeks 1 & 2 25
Image acquisition
► Applications
Image acquisition is the first process of DIP.
Weeks 1 & 2 26
Image enhancement
► Image enhancement is the process of manipulating
an image so the result is more suitable than the
original for a specific application.
► The word specific is important here, because it
establishes at the outset that enhancement
techniques are problem oriented.
► Thus, for example, a method that is quite useful for
enhancing X-ray images may not be the best
approach for enhancing satellite images taken in
the infrared band of the electromagnetic spectrum.
Weeks 1 & 2 27
Image Restoration
► Image restoration is an area that also deals
with improving the appearance of an image.
► However, unlike enhancement, which is
subjective, image restoration is objective, in
the sense that restoration techniques tend to
be based on mathematical or probabilistic
models of image degradation.
► Enhancement, on the other hand, is based on
human subjective preferences regarding what
constitutes a “good” enhancement result.
Weeks 1 & 2 28
Color image processing
► Color image processing is an area that has
been gaining in importance because of the
significant increase in the use of digital
images over the internet.
► In this chapter a number of fundamental
concepts in color models and basic color
processing in a digital domain.
► Color is used also as the basis for extracting
features of interest in an image.
Weeks 1 & 2 29
Wavelets and other image
transforms
Wavelets are the foundation for representing
images in various degrees of resolution.
Weeks 1 & 2 30
Compression and
watermarking
► Compression, as the name implies, deals with techniques
for reducing the storage required to save an image, or the
bandwidth required to transmit it.
► Although storage technology has improved significantly
over the past decade, the same cannot be said for
transmission capacity.
► This is true particularly in uses of the internet, which are
characterized by significant pictorial content.
► Image compression is familiar (perhaps inadvertently) to
most users of computers in the form of image file
extensions, such as the jpg file extension used in the JPEG
(Joint Photographic Experts Group) image compression
standard.
Weeks 1 & 2 31
Morphological processing
► Morphological processing deals with tools
for extracting image components that are
useful in the representation and description
of shape.
Weeks 1 & 2 32
Segmentation
► Segmentation partitions an image into its constituent
parts or objects.
► In general, autonomous segmentation is one of the most
difficult tasks in digital image processing.
► A rugged segmentation procedure brings the process a
long way toward successful solution of imaging problems
that require objects to be identified individually.
► On the other hand, weak or erratic segmentation
algorithms almost always guarantee eventual failure.
► In general, the more accurate the segmentation, the more
likely automated object classification is to succeed.
Weeks 1 & 2 33
Feature extraction
► Feature extraction almost always follows the output of a
segmentation stage, which usually is raw pixel data,
constituting either the boundary of a region (i.e., the set of
pixels separating one image region from another) or all the
points in the region itself.
► Feature extraction consists of feature detection and feature
description.
► Feature detection refers to finding the features in an image,
region, or boundary.
► Feature description assigns quantitative attributes to the
detected features. For example, we might detect corners in a
region, and describe those corners by their orientation and
location; both of these descriptors are quantitative attributes.
Weeks 1 & 2 34
Image pattern classification
► Image pattern classification is the process that
assigns a label (e.g., “vehicle”) to an object based
on its feature descriptors.
► Here, we will discuss methods of image pattern
classification ranging from “classical” approaches
such as minimum-distance, correlation, and Bayes
classifiers, to more modern approaches
implemented using deep neural networks.
► In particular, we will discuss in detail deep
convolutional neural networks, which are ideally
suited for image processing work.
Weeks 1 & 2 35
Light and EM Spectrum
Weeks 1 & 2 37
Light and EM Spectrum
► Monochromatic light: void of color
Intensity is the only attribute, from black to white
Monochromatic images are referred to as gray-
scale images
Transform
illumination
energy into
digital
images
Weeks 1 & 2 39
Image Acquisition Using a Single Sensor
Weeks 1 & 2 40
Image Acquisition Using Sensor Strips
Weeks 1 & 2 41
Image Acquisition Process
Weeks 1 & 2 42
A Simple Image Formation Model
f ( x, y ) i ( x, y )r ( x, y )
Weeks 1 & 2 43
Some Typical Ranges of illumination
► Illumination
Lumen — A unit of light flow or luminous flux
Lumen per square meter (lm/m2) — The metric unit of
measure for illuminance of a surface
On a cloudy day, the sun may produce less than 10,000 lm/m 2 of
illumination on the surface of the Earth
Weeks 1 & 2 44
Some Typical Ranges of Reflectance
► Reflectance
Digitizing
the
coordinate
values Digitizing
the
amplitude
values
Weeks 1 & 2 46
Image Sampling and Quantization
Weeks 1 & 2 47
Representing Digital Images
Weeks 1 & 2 48
Representing Digital Images
Weeks 1 & 2 49
Representing Digital Images
Weeks 1 & 2 50
Representing Digital Images
Weeks 1 & 2 51
Representing Digital Images
b=M×N×k
Weeks 1 & 2 52
Representing Digital Images
Weeks 1 & 2 53
Spatial and Intensity Resolution
► Spatial resolution
— A measure of the smallest discernible detail in an
image
— stated with line pairs per unit distance, dots
(pixels) per unit distance, dots per inch (dpi)
► Intensity resolution
— The smallest discernible change in intensity level
— stated with 8 bits, 12 bits, 16 bits, etc.
Weeks 1 & 2 54
Spatial and Intensity Resolution
Weeks 1 & 2 55
Spatial and Intensity Resolution
Weeks 1 & 2 56
Spatial and Intensity Resolution
Weeks 1 & 2 57
Image Interpolation
http://www.dpreview.com/learn/?/key=interpolation
Weeks 1 & 2 58
Image Interpolation:
Nearest Neighbor Interpolation
f1(x2,y2) = f(x1,y1)
f(round(x2),
round(y2))
=f(x1,y1)
f1(x3,y3) =
f(round(x3),
round(y3))
=f(x1,y1)
Weeks 1 & 2 59
Image Interpolation:
Bilinear Interpolation
(x,y)
f 2 ( x, y )
(1 a)(1 b) f (l , k ) a (1 b) f (l 1, k )
(1 a)b f (l , k 1) a b f (l 1, k 1)
l floor ( x), k floor ( y ), a x l , b y k .
Weeks 1 & 2 60
Image Interpolation:
Bicubic Interpolation
► The intensity value assigned to point (x,y) is
obtained by the following equation
3 3
f 3 ( x, y ) aij x y i j
i 0 j 0
Weeks 1 & 2 61
Examples: Interpolation
Weeks 1 & 2 62
Examples: Interpolation
Weeks 1 & 2 63
Examples: Interpolation
Weeks 1 & 2 64
Examples: Interpolation
Weeks 1 & 2 65
Examples: Interpolation
Weeks 1 & 2 66
Examples: Interpolation
Weeks 1 & 2 67
Examples: Interpolation
Weeks 1 & 2 68
Examples: Interpolation
Weeks 1 & 2 69