Digital Image Processing

Introduction

Thanh-Hai Tran

Telecommunications Engineering Faculty

School of Electronics and Electrical Engineering
Hanoi University of Science and Technology
1 Dai Co Viet - Hanoi - Vietnam
 Course syllabus
Week Lecture
1 Introduction to DIP
2-3 Image Processing Fundamental
4-5 Intensity Transformation and Spatial Filtering
6 Filtering in Frequency Domain
7 Color Image processing
8 Morphological operations
9 Mid-term vacancy
10 Image Segmentation
11-12 Representation and Description
13 Object detection
14 Object classification
15 Revision
16 Project Presentation
2020 2
 Outline

n What is Digital Image Procesing ?

n The origin of DIP
n Examples of Fields that uses DIP
n Fundamental Steps in DIP
n Components of a DIP system
n Image Formation
n Summary
n References

2020 3
 Imaging

Albrecht Dürer, 1525

n Image: a visual representation in form of a function f (x,y)

where f is related to the brightness (or color) at point (x,y)
n Most images are defined over a rectangle
n Continuous in amplitude and space

2020 4
 What is Digital Image Processing ?

n An image can be defined as a two-dimentional

function f(x,y)
u x, y are spatial coordinates
u f(x,y) is the value at (x,y), called intensity or grayscale value
n Digital Image: x, y, f(x,) are all finite and discrete
n Digital Image Processing: process image by mean of
digital computer

2020 5
 Examples of Fields that uses DIP

2020 6
 Gamma-ray imaging

2020
 X-ray & ultraviolet imaging

2020
 Applications of Digital Image Processing

n Image sharpening and restoration

n Medical field
n Remote sensing
n Transmission and encoding
n Machine/Robot vision
n Color processing
n Pattern recognition
n Video processing
n Microscopic Imaging
n Others

2020 9
 Image sharpening and restoration

2020 10
 Medical field

n Gamma ray imaging

n PET scan
n X Ray Imaging
n Medical CT
n Some medical datasets
by VinAI:
u https://vindr.ai/datasets/c
xr
u https://vindr.ai/datasets/ri
bcxr
u https://vindr.ai/datasets/s
pinexr

2020 11
 UAV imaging

n The extraction of edges

n Analysis and enhancement of various types of edges

2020
 Robot vision

2020 13
 Image morphing

2020
 Object recognition

2020 15
 Face detection

2020 16
 Style transfer

2020
 Why do we process images ?
n Acquire an image:
u Correct aperture and color balance
u Reconstruct image from projections
n Prepare for display or printing
u Adjust image size
u Color mapping, gamma-correction,
halftoning
n Facilitate picture storage and
transmission
u Efficiently store an image in a digital
camera
u Send an image from space
n Enhance and restore images
u Touch up personal photos
u Color enhancement for security
screening
n Extract information from images
u Read 2-d bar codes
u Character recognition – Depth
estimation
n Many more ... image processing is
ubiquitous

18
2020
 Related fields

2020 19
 Human vision

2020
 Fundamental steps in DIP

2020 21
 Components of a DIP system

2020 22
 Image formation

How an image
is created ?

2020 23
 Human visual system

2020 24
 Human visual system

2020 25
 … and with a camera ?

2020 26
 Visual human system and camera

2020
 A Brief History of Images
1544

Camera Obscura

2020
 A Brief History of Images
1558
1568

Lens Based Camera Obscura, 1568

2020
 A Brief History of Images
1558
1568

1837

Louis-Jacques-
Mandé Daguerre
18 November 1787
Cormeilles-en-
Parisis, Val-d'Oise,
France

Still life, Louis Jaques Mande Daguerre

2020
 A Brief History of Images
1558
Abraham Lincoln was the first American president to use 1568
photography for political purposes.

1840?

2020 Abraham Lincoln?

 First photo taken in Vietnam - 1845

2020 32
 The Camera
Cameras are very similar to eyes:

n Light sensitive area – film or

digital sensor
n Lenses – Instead of changing
shape, they move closer or
further away to the light sensor.
n Aperture in the lens controls the
amount of light reaching the light
sensor
n A shutter also opens and closes
to let the right amount of light fall
on the light sensor and get a
correctly exposed image

2020
 The Camera

2020 34
 Camera – pinhole model
n Pinhole camera - box with a small hole in it
n Image is upside down

35
2020
 Pinhole camera

n A simple camera without a lens, with a single small

aperture
n Light from the scene passes through this single point and
projects an inverted image on the opposite size of the box
n It is completely dark on all the other sides of the box
including the side where the point is created
n The smaller the hole, the sharper the image, but the
dimmer the projected image
n Because a pinhole camera requires a lengthy exposure,
its shutter may be manually operated, as with a flap made
of light-proof material to cover and uncover the pinhole.
n Typical exposures range from 5 seconds to several hours

2020 36
 Pinhole and the Perspective Projection
Is an image being formed
(x,y) on the screen?

YES! But, not a “clear” one

screen scene

image plane
r = ( x, y, z )
y

optical effective focal length, f’ z

axis
pinhole
x

r ' = ( x' , y ' , f ' )

r' r x' x y' y

= = =
f' z f' z f' z
2020
 Problems with pinhole model

n How to obtain “clear images” ?

2020 38
 Problems with pinhole model
n Pinhole size (aperture) must
be “very small” to obtain a
clear image
n However, as pinhole size is
made smaller, less light is
received by image plane.
n If pinhole is comparable to
wavelength of incoming light,
DIFFRACTION effects blur the
image!
n Sharpest image is obtained
when:
Pinhole diameter d =2 f 'l

Example: If f’ = 50mm,
l = 600nm (red),
d = 0.36mm
2020
 The reason for lenses
n To be precise, the pinhole has to be infinitively small. Otherwise,
image will be blurred
n To allow light to reach all image points, the pinhole needs to be
large

2020
 The reason for lenses

2020
 Basic elements of camera

2020 42
 Film

2020
 Sensor

CCD optical sensor

KAF-1600 - Kodak.

2020 44
 Exposure

2020 45
 Exposure / Shutter Speed

n The effect of varying shutter speed while keeping a

constant aperture:

The images start underexposed (too dark) with a

short exposure, are correctly exposed around 4s,
and become overexposed (too bright) at 15s+

2020
 Exposure / Shutter Speed

n A fast shutter speed

(creating a short
exposure of the
film/sensor) is required
to freeze motion
(e.g. 1/1000s)

n A slow shutter speed

(creating a long
exposure) can blur
motion for interesting
effects
(e.g. 1/15s )

2020
 Shutter Speed

n Very long exposures (30 seconds+) may be required

in low light, but this can produce nice effects – look at
the sea.

Dunstanburgh Castle, Northumberland by Lee Frost

(www.leefrost.co.uk)

2020
 Now the test
n Under or over exposure?

2020
 Now the test
n Under, or over
exposed?

2020
 Summary

n DIP
n Application of DIP
n Main components of DIP system
n Image formation

2020 51