Digital Image Processing:

Digital Imaging Fundamentals

Brian Mac Namee
[email protected]
Course Website: http://www.comp.dit.ie/bmacnamee

2
of
42

Contents
This lecture will cover:
The human visual system
Light and the electromagnetic spectrum
Image representation
Image sensing and acquisition
Sampling, quantisation and resolution

3
of
42

Human Visual System

The best vision model we have!
Knowledge of how images form in the eye
can help us with processing digital images
We will take just a whirlwind tour of the
human visual system

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

4
of
42

Structure Of The Human Eye

The lens focuses light from objects onto the
retina
The retina is covered with
light receptors called
cones (6-7 million) and
rods (75-150 million)
Cones are concentrated
around the fovea and are
very sensitive to colour
Rods are more spread out
and are sensitive to low levels of illumination

5
of
42

Blind-Spot Experiment
Draw an image similar to that below on a
piece of paper (the dot and cross are about
6 inches apart)

Close your right eye and focus on the cross

with your left eye
Hold the image about 20 inches away from
your face and move it slowly towards you
The dot should disappear!

6
of
42

7
of
42

Image Formation In The Eye

Muscles within the eye can be used to
change the shape of the lens allowing us
focus on objects that are near or far away
An image is focused onto the retina causing
rods and cones to become excited which
ultimately send signals to the brain

8
of
42

Brightness Adaptation & Discrimination

The human visual system can perceive
approximately 1010 different light intensity
levels
However, at any one time we can only
discriminate between a much smaller
number brightness adaptation
Similarly, the perceived intensity of a region
is related to the light intensities of the
regions surrounding it

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

9
of
42

Brightness Adaptation & Discrimination

(cont)

An example of Mach bands

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

10
of
42

Brightness Adaptation & Discrimination

(cont)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

11
of
42

Brightness Adaptation & Discrimination

(cont)

An example of simultaneous contrast

12
of
42

Brightness Adaptation & Discrimination

(cont)

For more great illusion examples take a look at: http://web.mit.edu/persci/gaz/

13
of
42

Available here: http://www.lottolab.org/Visual%20Demos/Demo%2015.html

14
of
42

Optical Illusions
Our visual
systems play lots
of interesting
tricks on us

15
of
42

Optical Illusions (cont)

16
of
42

Optical Illusions (cont)

Stare at the cross
in the middle of
the image and
think circles

17
of
42

Light And The Electromagnetic Spectrum

Light is just a particular part of the
electromagnetic spectrum that can be
sensed by the human eye
The electromagnetic spectrum is split up
according to the wavelengths of different
forms of energy

18
of
42

Reflected Light
The colours that we perceive are
determined by the nature of the light
reflected from an object
For example, if white
light is shone onto a
green object most
wavelengths are
absorbed, while green
light is reflected from
the object
Wh

ite L

ight

Light
Green

Colours
Absorbed

19
of
42

Sampling, Quantisation And Resolution

In the following slides we will consider what
is involved in capturing a digital image of a
real-world scene
Image sensing and representation
Sampling and quantisation
Resolution

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

20
of
42

Image Representation
Before we discuss image acquisition recall
that a digital image is composed of M rows
and N columns of pixels
col
each storing a value
Pixel values are most
often grey levels in the
range 0-255(black-white)
We will see later on
that images can easily
f (row, col)
be represented as
row
matrices

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

21
of
42

Image Acquisition
Images are typically generated by
illuminating a scene and absorbing the
energy reflected by the objects in that scene
Typical notions of
illumination and
scene can be way off:
X-rays of a skeleton
Ultrasound of an
unborn baby
Electro-microscopic
images of molecules

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

22
of
42

Image Sensing
Incoming energy lands on a sensor material
responsive to that type of energy and this
generates a voltage
Collections of sensors are arranged to
capture images

Imaging Sensor
Line of Image Sensors

Array of Image Sensors

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

23
of
42

Image Sensing

Using Sensor Strips and Rings

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

24
of
42

Image Sampling And Quantisation

A digital sensor can only measure a limited
number of samples at a discrete set of
energy levels
Quantisation is the process of converting a
continuous analogue signal into a digital
representation of this signal

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

25
of
42

Image Sampling And Quantisation

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

26
of
42

Image Sampling And Quantisation

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

27
of
42

Image Sampling And Quantisation

(cont)
Remember that a digital image is always
only an approximation of a real world
scene

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

28
of
42

Image Representation

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

29
of
42

Image Representation

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

30
of
42

Image Representation

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

31
of
42

Image Representation

32
of
42

Spatial Resolution
The spatial resolution of an image is
determined by how sampling was carried
out
Spatial resolution simply refers to the
smallest discernable detail in an image
Vision specialists will
often talk about pixel
size
Graphic designers will
talk about dots per
inch (DPI)

5.1
xel
i
p
a
Meg
s

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

33
of
42

Spatial Resolution (cont)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

34
of
42

Spatial Resolution (cont)

1024 * 1024

512 * 512

256 * 256

128 * 128

64 * 64

32 * 32

35
of
42

Intensity Level Resolution

Intensity level resolution refers to the
number of intensity levels used to represent
the image
The more intensity levels used, the finer the level of
detail discernable in an image
Intensity level resolution is usually given in terms of
the number of bits used to store each intensity level
Number of Bits

Number of Intensity
Levels

Examples

0, 1

00, 01, 10, 11

16

0000, 0101, 1111

256

00110011, 01010101

16

65,536

1010101010101010

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

36
of
42

Intensity Level Resolution (cont)

256 grey levels (8 bits per pixel)

128 grey levels (7 bpp)

64 grey levels (6 bpp)

32 grey levels (5 bpp)

16 grey levels (4 bpp)

8 grey levels (3 bpp)

4 grey levels (2 bpp)

2 grey levels (1 bpp)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

37
of
42

Saturation & Noise

38
of
42

Resolution: How Much Is Enough?

The big question with resolution is always
how much is enough?
This all depends on what is in the image and
what you would like to do with it
Key questions include
Does the image look aesthetically pleasing?
Can you see what you need to see within the
image?

39
of
42

Resolution: How Much Is Enough?

(cont)

The picture on the right is fine for counting

the number of cars, but not for reading the
number plate

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

40
of
42

Intensity Level Resolution (cont)

Low Detail

Medium Detail

High Detail

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

41
of
42

Intensity Level Resolution (cont)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

42
of
42

Intensity Level Resolution (cont)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

43
of
42

Intensity Level Resolution (cont)

44
of
42

Summary
We have looked at:
Human visual system
Light and the electromagnetic spectrum
Image representation
Image sensing and acquisition
Sampling, quantisation and resolution

Next time we start to look at techniques for

image enhancement