Digital Image Processing

(BCS 543)
Introduction
Dr. Muhammad Jehanzeb
[email protected]

Department of CS
Fatima Jinnah Women University
Rawalpindi

COURSE OBJECTIVES
Develop an Understanding of Basic Digital
Image Processing Techniques Through
Lecture, Study, and Exercises

Implement an Independent DIP Project

Which Demonstrates Your Ability to
Integrate the Mathematical Theory With the
Practical Issues
2

COURSE CONTENTS

Introduction to Digital Image Processing, Computer Vision and

Pattern Recognition
Image acquisition, image sampling and quantization
Image enhancement in the spatial domain: Gray level
transformations, histogram processing smoothing and
sharpening filters
Image enhancement in the frequency domain Fourier
transform, Frequency domain filtering
Image Segmentation: Detection of discontinuities, edges,
boundaries, thresholding, region-based segmentation
Morphological Image Processing: Image morphology, Dilation,
Erosion and derived operators and transforms
Color Image Processing
Image Compression
Pattern Recognition: Shape representation and description,
clustering and classification
3

GRADING POLICY
10%

10%

Quizzes
Assignment

50%

10%

Term Project
Mid Semester Exam
Final Exam

20%

Credit : 3
4

COURSE INFORMATION

Books

Digital Image Processing, Rafael C. Gonzalez &

Richard E. Woods, Addison-Wesley

Second Edition

Third Edition
5

COURSE INFORMATION

Books

Digital Image Processing using Matlab, Rafael C.

Gonzalez, Richard E. Woods and Steven L. Eddins.

Second Edition
6

Other reference books will be mentioned on the course web page.

COURSE PAGE

https://piazza.com/fatima_jinnah_women_univ
ersity/fall2015/bcs543

10

11

12

13

14

IMAGE PROCESSING & MACHINE VISION

Continuum from Image Processing to Machine
Vision:

low, mid and high-level processes

Low Level Process

Input: Image
Output: Image
Examples: Noise
removal, image
sharpening
15
Image Processing

EXAMPLE: LOW LEVEL

PROCESSING

16

EXAMPLE: LOW LEVEL

PROCESSING
Sharpening

Original Image

Processed Image
17

IMAGE PROCESSING & MACHINE VISION

Continuum from Image Processing to Machine
Vision:

low, mid and high-level processes

Low Level Process

Mid Level Process

Input: Image
Output: Image

Input: Image
Output: Attributes

Examples: Noise
removal, image
sharpening

Examples: Object
recognition,
segmentation
18

Image Processing

EXAMPLE: MID LEVEL

PROCESSING

19

Segmentation of image into regions

EXAMPLE: MID LEVEL

PROCESSING
Segmentation of image into edges

Original Image

Processed Image
20

IMAGE PROCESSING & MACHINE VISION

Continuum from Image Processing to Machine
Vision:

low, mid and high-level processes

Low Level Process

Mid Level Process

High Level Process

Input: Image
Output: Image

Input: Image
Output: Attributes

Input: Attributes/Image
Output: Understanding

Examples: Noise
removal, image
sharpening

Examples: Object
recognition,
segmentation

Examples: Scene
understanding,
autonomous navigation
21

Image Processing

Machine Vision

EXAMPLE: HIGH LEVEL

PROCESSING
Image Understanding

Original Image

Processed Image
22

EXAMPLE: HIGH LEVEL

PROCESSING

23

Robot Navigation

IMAGE PROCESSING & MACHINE VISION

Continuum from Image Processing to Machine
Vision:
In this course

low, mid and high-level processes

Low Level Process

Mid Level Process

High Level Process

Input: Image
Output: Image

Input: Image
Output: Attributes

Input: Attributes/Image
Output: Understanding

Examples: Noise
removal, image
sharpening

Examples: Object
recognition,
segmentation

Examples: Scene
understanding,
autonomous navigation
24

Image Processing

Machine Vision

PATTERN RECOGNITION
A pattern is the opposite of a chaos, it is an entity that
can be given a name

25

RECOGNITION
Identification

of a pattern as a member

of a category
Classification (Supervised: known
categories)
Clustering (Unsupervised: learning
categories)

26

CLASSIFICATION

27

CLASSIFICATION
You had some training example or
training data
The examples were labeled
You used those examples to make
the kid learn the difference
between an apple and an orange

28

CLASSIFICATION

29

CLUSTERING

There are two types of fruit in the basket, separate

them into two groups

30

CLUSTERING

The data was not labeled you did

not tell Nicolas which are apples
which are oranges
May be the kid used the idea that
things in the same group should
be similar to one another as
compared to things in the other
group
Groups - Clusters
31

CLASSIFICATION VS. CLUSTERING

Category A

Category B

Classification

Clustering

32

PATTERN CLASS
A

collection of similar (not necessarily identical)

objects

Intra-class

variability

Inter-class

similarity

33

PATTERN CLASS

Intra-class variability

The letter T in different typefaces

34
Same face under different expression, pose, illumination

PATTERN CLASS

Inter-class similarity

Characters that look similar

Identical twins

35

FEATURES
Features

are the individual measurable

properties of the signal being observed.
The set of features used for learning/recognition
is called feature vector.
The number of used features is the
dimensionality of the feature vector.
n-dimensional feature vectors can be
represented as points in n-dimensional feature
space
36

FEATURES

37

FEATURE EXTRACTION
Feature

extraction aims to create

discriminative features good for learning

Good Features
Objects from the same class have similar feature values.
Objects from different classes have different values.

38

Example Applications

39

EXAMPLES: IMAGE ENHANCEMENT

40

EXAMPLES: THE HUBBLE

TELESCOPE
Launched in 1990 the Hubble
telescope can take images of very
distant objects
However, an incorrect mirror made
many of Hubbles images useless
Image processing techniques were
used to fix this

41

EXAMPLES: THE HUBBLE

TELESCOPE

42

EXAMPLES: MEDICINE

Original Image of a Dog Heart

Separation of tissues

43

EXAMPLES: MEDICINE

Microscopic tissue data - Cancer Detection

44

EXAMPLES: GIS

Geographic Information Systems

Manipulation of Satellite Imagery

Terrain Classification, Meteorology

45

EXAMPLES: INDUSTRIAL INSPECTION

Human operators are

expensive & slow
Make machines do the
job instead

46

46

EXAMPLES: HCI

Try to make human computer

interfaces more natural

Gesture recognition
Facial Expression Recognition
Lip reading

47

EXAMPLES: SIGN
LANGUAGE/GESTURE
RECOGNITION

British Sign Language Alphabet

48

EXAMPLES: LIP READING

49

Find.

ee

oo

sh

EXAMPLES: LIP READING

50

EXAMPLES: FACIAL EXPRESSION

RECOGNITION

Implicit customer feedback

51

EXAMPLES: FACIAL EXPRESSION

RECOGNITION

Implicit customer feedback

52

EXAMPLES: FACIAL EXPRESSION

RECOGNITION

Implicit customer feedback

53

EXAMPLES: BIOMETRICS

Biometrics - Authentication
techniques
Physiological Biometrics

Face, IRIS, DNA, Finger Prints

Behavioral Biometrics

Typing Rhythm, Handwriting, Gait

54

EXAMPLES: BIOMETRICS FACE

RECOGNITION

55

FACES AND DIGITAL CAMERAS

Setting camera focus

via face detection

Camera waits for everyone to

smile to take a photo [Canon]

Automatic lighting
correction based
on face detection
56

EXAMPLES: BIOMETRICS FINGER

PRINT RECOGNITION

57

EXAMPLES: BIOMETRICS
SIGNATURE VERIFICATION

58

EXAMPLES: ROBOTICS

59

EXAMPLES: ROBOTICS

AIBO

60

EXAMPLES: OPTICAL CHARACTER

RECOGNITION
Convert document image into text

61

EXAMPLES: OPTICAL CHARACTER

RECOGNITION
Indexing and Retrieval

62

Image Source: CEDAR

EXAMPLES: OPTICAL CHARACTER

RECOGNITION
License Plate Recognition

63

EXAMPLES: OPTICAL CHARACTER

RECOGNITION
Automatic Mail Sorting

64

VISION FROM MOBILE PHONES

Situated search
Yeh et al., MIT

65

VISION FROM MOBILE PHONES

Commercial
services
coming out

~30000 movie
posters indexed
Query-by-image
from mobile phone
available in Germany
and Switzerland

66

BUSINESS CARD READERS

67

TRANSLATION FOR TRAVELLERS

68

SAFETY AND SECURITY

Autonomous robots

Driver assistance

Monitoring pools
(Poseidon)

Pedestrian detection
[MERL, Viola et al.]

Surveillance

69

Summary of Applications
Problem Domain

Application

Input Pattern

Output Class

Document Image
Analysis

Optical Character
Recognition

Document Image

Characters/words

Document
Classification

Internet search

Text Document

Semantic categories

Document
Classification

Junk mail filtering

Email

Junk/Non-Junk

Multimedia retrieval

Internet search

Video clip

Video genres

Speech Recognition

Telephone directory
assistance

Speech waveform

Spoken words

Natural Language
Processing

Information extraction

Sentence

Parts of Speech

Biometric Recognition

Personal identification

Face, finger print, Iris

Authorized users for

access control

Medical

Computer aided
diagnosis

Microscopic Image

Healthy/cancerous cell

Military

Automatic target
recognition

Infrared image

Target type

Industrial automation

Fruit sorting

Images taken on
conveyor belt

Grade of quality

Bioinformatics

Sequence analysis

DNA sequence

Known types of genes

70

KEY STAGES IN DIP

Image
Restoration

Morphological
Processing

Image
Enhancement

Segmentation

Image
Acquisition

Representation
& Description

Problem Domain

Object
Recognition
Colour Image
Processing

Image
Compression
71

KEY STAGES IN DIP

Image
Restoration

Morphological
Processing

Image
Enhancement

Segmentation

Image
Acquisition

Representation
& Description

Problem Domain

Object
Recognition
Colour Image
Processing

Image
Compression
72

KEY STAGES IN DIP

Image
Restoration

Morphological
Processing

Image
Enhancement

Segmentation

Image
Acquisition

Representation
& Description

Problem Domain

Object
Recognition
Colour Image
Processing

Image
Compression
73

KEY STAGES IN DIP

Image
Restoration

Morphological
Processing

Image
Enhancement

Segmentation

Image
Acquisition

Representation
& Description

Problem Domain

Object
Recognition
Colour Image
Processing

Image
Compression
74

KEY STAGES IN DIP

Image
Restoration

Morphological
Processing

Image
Enhancement

Segmentation

Image
Acquisition

Representation
& Description

Problem Domain

Object
Recognition
Colour Image
Processing

Image
Compression
75

KEY STAGES IN DIP

Image
Restoration

Morphological
Processing

Image
Enhancement

Segmentation

Image
Acquisition

Representation
& Description

Problem Domain

Object
Recognition
Colour Image
Processing

Image
Compression
76

KEY STAGES IN DIP

Image
Restoration

Morphological
Processing

Image
Enhancement

Segmentation

Image
Acquisition

Representation
& Description

Problem Domain

Object
Recognition
Colour Image
Processing

Image
Compression
77

KEY STAGES IN DIP

Image
Restoration

Morphological
Processing

Image
Enhancement

Segmentation

Image
Acquisition

Representation
& Description

Problem Domain

Object
Recognition
Colour Image
Processing

Image
Compression
78

KEY STAGES IN DIP

Image
Restoration

Morphological
Processing

Image
Enhancement

Segmentation

Image
Acquisition

Representation
& Description

Problem Domain

Object
Recognition
Colour Image
Processing

Image
Compression
79

KEY STAGES IN DIP

Image
Restoration

Morphological
Processing

Image
Enhancement

Segmentation

Image
Acquisition

Representation
& Description

Problem Domain

Object
Recognition
Colour Image
Processing

Image
Compression
80

Material in these slides has been taken from, the following resources

ACKNOWLEDGEMENTS

Statistical Pattern Recognition: A Review A.K Jain et al., PAMI (22) 2000
Pattern Recognition and Analysis Course A.K. Jain, MSU
Pattern Classification by Duda et al., John Wiley & Sons.
Digital Image Processing, Rafael C. Gonzalez & Richard E. Woods, Addison-Wesley, 2002
Machine Vision: Automated Visual Inspection and Robot Vision, David Vernon, Prentice Hall,
1991
www.eu.aibo.com/
Advances in Human Computer Interaction, Shane Pinder, InTech, Austria, October 2008

81