PENGOLAHAN CITRA DIGITAL

(TIK414)

Pertemuan 1
INTRODUCTION TO DIGITAL IMAGE
PROCESSING

Endina Putri Purwandari, ST., M.Kom.

Teknik Informatika
Universitas Bengkulu

1
Topics

1. Digital Image Processing

2. Image Transformation
3. Image Enhancement
4. Image Restoration
5. Image Compression
6. Image Segmentation
7. Image Classification

2
Marking Components

 WorkGroup : 15 %
 Mid Test (UTS) : 20 %
 Final Test (UAS) : 25 %
 Practicum : 20 %
 Literature Review (Individual) : 15 %
 Absent, Attitude, & Participation :5 %

3
Assignments
 Workgroup
◦ Collaborate in team  not tend to work
individually
◦ Each member have responsibility
◦ Group processing and reflection
 Minimum attendance in class : 75%
 No second Mid Test (UTS) & Final Test (UAS)

4
Rules

 No plagiarism and Copy paste answer

 Work Group:
◦ One group : 5-6 member
◦ No plagiarism from other group
◦ Everyone contribute in exercise, NO sucker
and NO free-reader
◦ Sanction: grades reduction

5
References
 Gonzalez, Rafael C. and Woods. R.E. 2007.
Digital Image Processing, 3rd edition. Prentice
Hall. ISBN 0-13-168728-8
 Gonzalez R. C., Woods, R. E. 2009. Digital
Image Processing with Matlab, 2nd edition.
Gatesmark Publishing. ISBN 0-98-208540-0
 Eko Prasetyo. 2012. Pengolahan Citra
Digital dan Aplikasinya Menggunakan Matlab.
Andi Yogyakarta. ISBN 978-979-29-2703-0

6
Introduction

“One picture is worth more than

ten thousand words”
Anonymous

7
Digital Cameras

8
Traditional Photography
 A chemical process, little
changed from 1826

 Taken in France on a pewter

plate
 … with 8-hour exposure

The world's first photograph

9
History of Digital Image Processing

Early 1920s: One of the first applications of

digital imaging was in the news-
paper industry
◦ The Bartlane cable picture
transmission service Early digital image

◦ Images were transferred by submarine cable

between London and New York
◦ Pictures were coded for cable transfer and
reconstructed at the receiving end on a
telegraph printer
10
Image Formation in a Pinhole Camera

 Light enters a darkened chamber through

pinhole opening and forms an image on the
further surface

11
Aperture

 Hole or opening where light enters

◦ Or, the diameter of that hole or opening
 Pupil of the human eye
◦ Bright light: 1.5 mm diameter
◦ Average light: 3-4 mm diameter
◦ Dim light: 8 mm diameter
 Camera
◦ Wider aperture admits more light
◦ Though leads to blurriness in the
objects away from point of focus
12
 Aperture and Light
Aperture: The size of the hole that
lets light into a device controlled
by shutter

- This is not made to be controlled

so it is important to know the
range of the shutter when
choosing

- The more light coming into a

sensor, the brighter the image can
be

13
http://loweryl.wordpress.com/2012/10/03/aperture-fstop-explained/
 From Light to Charge
- Light from the lens falls onto a sensor
array
- Light at a specific point on the array
passes through red, green, or blue filter
on photodiode.

http://digital.pho.to/

14
 Shutter Speed
 Time for light to enter camera
◦ Longer times lead to more light
◦ … though blurs moving subjects

• Exposure
–Total light entering
the camera
–Depends on aperture
and shutter speed
15
CCD: Charge Coupled Device

CCD sensor

 Common sensor array used in digital cameras

◦ Each capacitor accumulates charge in response to
light
 Responds to about 70% of the incident light
◦ In contrast, photographic film captures only about 2%
 Also widely used in astronomy telescopes
16
Separate Sensors Per Color

 Expensive cameras
◦ A prism to split the light into three colors
◦ Three CCD arrays, one per RGB color

17
Practical Color Sensing: Bayer Grid
 Place a small color filter
over each sensor
 Each cell captures intensity
of a single color
 More green pixels, since
human eye is better at
resolving green

18
 Practical Color Sensing: Interpolating

 Challenge: inferring what we can’t see

◦ Estimating pixels we do not know
 Solution: estimate based on neighboring
pixels
◦ E.g., red for non-red cell averaged from red
neighbors
◦ E.g., blue for non-blue cell averaged from blue
neighbors
Estimate “R” and “B” at the
“G” cells from neighboring
values
19
DIGITAL IMAGE PROCESSING

20
 What is a Digital Image?
A digital image is a representation of a two-
dimensional image as a finite set of digital values,
called picture elements or pixels

21
What is a Digital Image? (cont…)

Pixelvalues typically represent gray levels,

colours, heights, opacities etc
Remember digitization implies that a digital
image is an approximation of a real scene

1 pixel

22
 Sensor Array: Image Sampling

Pixel (Picture Element): single point in a graphic image

23
More Pixels Mean More Detail

1600 x 1400 1280 x 960

2.1 megapixels 1.1 megapixels

640 x 480
0.3 megapixels

24
The The
2272 x 1704 320 x 240
hand hand

25
Representing Color
 Light receptors in the human eye
◦ Rods: sensitive in low light, mostly at periphery of eye
◦ Cones: only at higher light levels, provide color vision
◦ Different types of cones for red, green, and blue
 RGB color model
◦ A color is some combination of red, green, and blue
◦ Intensity value for each color
 0 for no intensity
 1 for high intensity
◦ Examples
 Red: 1, 0, 0
 Green: 0, 1, 0
 Yellow: 1, 1, 0
26
Representing Image as a 3D Matrix

 In the lab this week…

◦ Matlab experiments with digital images
 Matrix storing color intensities per pixel
◦ Row: from top to bottom 1
2
◦ Column: from left to right 3
◦ Color: red, green, blue
 Examples 1 2

◦ M(3,2,1): third row, second column, red intensity

◦ M(4,3,2): fourth row, third column, green
intensity
27
Limited Granularity of Color
 Three intensities, one per color
◦ Any value between 0 and 1
 Storing all possible values take a lot of bits
◦ E.g., storing 0.368491029692069439604504560106
◦ Can a person really differentiate from 0.36849?
 Limiting the number of intensity settings
◦ Eight bits for each color
◦ From 00000000 to 11111111
◦ With 28 = 256 values
 Leading to 24 bits per pixel
 Red: 255, 0, 0
 Green: 0, 255, 0
 Yellow: 255, 255, 0

28
 Number of Bits Per Pixel
 Number of bits per pixel
◦ More bits can represent a wider range of colors
◦ 24 bits can capture 224 = 16,777,216 colors
◦ Most humans can distinguish around 10 million colors

8 bits / pixel / color 4 bits

29 / pixel / color
What is a Digital Image? (cont…)

Common image formats include:

◦ 1 sample per point (B&W or Grayscale)
◦ 3 samples per point (Red, Green, and Blue)
◦ 4 samples per point (Red, Green, Blue, and “Alpha”, a.k.a.
Opacity)

For most of this course we will focus on grey-scale

images 30
Are More Pixels Always Better?
 Generally more is better
◦ Better resolution of the picture
◦ Though at some point humans can’t tell the
difference
 But, other factors matter as well
◦ Sensor size
◦ Lens quality
◦ Whether Bayer grid is used
 Problem with too many pixels
◦ Very small sensors catch fewer photons
◦ Much higher signal-to-noise ratio
 Plus, more pixels means more storage…
31
Digital Images Require a Lot of Storage

 Three dimensional object

◦ Width (e.g., 640 pixels)
◦ Height (e.g., 480 pixels)
◦ Bits per pixel (e.g., 24-bit color)
 Storage is the product
◦ Pixel width * pixel height * bits/pixel
◦ Divided by 8 to convert from bits to bytes
 Example sizes
◦ 640 x 480: 1 Megabyte
◦ 800 x 600: 1.5 Megabytes
◦ 1600 x 1200: 6 Megabytes
32
Questions?

33
http://xkcd.com/1014/
What is Digital Image Processing?

Digitalimage processing focuses on two

major tasks
◦ Improvement of pictorial information for human
interpretation
◦ Processing of image data for storage,
transmission and representation for autonomous
machine perception
Some argument about where image
processing ends and fields such as image
analysis and computer vision start
34
Digital Image Processing:
ApplicationsDigital Applications
 Biomedical (Kedokteran);
 Remote Sensing (PenginderaanJarakJauh);
 Industry;
 Gesture Language (BahasaIsyarat);
 Character Recognition
(PengenalanKarakter);
 Digital Signature & Biometric Data (for e-
Commerce, Banking etc.)
 Security (Watermarking, Forgery)
35
Visual Scene Understanding

36
3D object insertion into video

37
Figure-ground segmentation

38
Machine Learning: Object recognition

 • General object class recognition

 • Learned visual dictionary
 - underlies image/video search
 - object sensitive image editing

39
Specific 3D Object Recognition

40
High-Fidelity Image-Based Modeling

41
Naming people in videos: A Buffy
example

42
Category-Level Object and Scene
Recognition

43
Flexible Models for 3D Object Detection

44
Change Detection for Environmental
Sciences

45
Computer Graphics

46
Graphics of heart phantom

 Image guidance for robotic minimally

invasive coronary artery bypass

47
Image Processing and Pattern Recognition

48
Image Retrieval System

 Berdasarkan metadata atau indexing

 Berdasarkan content

49
50
Content-Based Image Retrieval System
 An image is represented by a set of features
 We have a database of images with their
representation based on set of features, and
information about the image
 We have a query image, and would like to
know the characteristic of the image
 The query image features are compared to the
features of images in the database based on a
similarity measure
 Similar images are provided to the user with
their characteristic
51
Content-Based Image Retrieval System

52
 Key Stages in Digital Image Processing

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
53
 Key Stages in Digital Image Processing:
Image Aquisition
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
54
Data Aquisition

 Gamma Ray and X-Ray : Nuclear, Medical,

Astronomy
 Microwave band: Radar

55
Data Acquisition

56
 Key Stages in Digital Image Processing:
Image Enhancement
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
57
Image Enhancement

58
 Key Stages in Digital Image Processing:
Image Restoration
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
59
Image Restoration (Cloud Removal)

60
 Key Stages in Digital Image Processing:
Morphological Processing
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
61
 Key Stages in Digital Image Processing:
Segmentation
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
62
Image Segmentation

 Segmentasi citra: membagi suatu citra menjadi

wilayah-wilayah yang homogen

63
 Key Stages in Digital Image Processing:
Object Recognition
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
64
 Key Stages in Digital Image Processing:
Representation & Description
Images taken from Gonzalez & Woods, Digital Image Processing (2002)

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
65
Edge Detection

66
 Key Stages in Digital Image Processing:
Image Compression

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
67
 Key Stages in Digital Image Processing:
Colour Image Processing

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
68
WorkGroup Discussion
 Tugas setiap kelompok menyusun makalah mengenai
 Kelompok 1 : Image Enhancement in Spatial
Domain (gray level transformation, histogram
processing, arithmetic/logic operation, point and
mask processing), Convolution and Correlation
 Kelompok 2 : Image Enhancement in Spatial
Processing (Smoothing, and Sharpening, Median
Filter) and Frequency Domain Filter, High and Low
Pass Filter
 Kelompok 3 : Image Transformation, Fourier
Image Transformation, Discrete Cosine
Transformation, Hadamard-Walsh transformation,
Wavelet Transformation

69
Kelompok Praktikum

 1 kelompok : 4 – 5 orang
 Setiap kelompok membuat program aplikasi
pengolahan citra dengan MATLAB dan GUI
MATLAB
 Topik aplikasi  bebas dari buku atau dari
www.mathworks.com
 Laporan kelompok dikumpul di akhir
perkuliahan 31 Desember 2015
 Laporan program: jelaskan baris coding, dan
algoritma citra yang digunakan
70
WorkGroup Discussion

 Tugas dikumpulkan tanggal 18 September

2014, 2 Oktober 2014, 16 Oktober
 Setiap kelompok
1. membuat paper/makalah tentang topik
tersebut
2. Menyusun slide presentasi
3. Paper dilengkapi dengan contoh aplikasinya

71
Literature Review (Individual)
 Tugas Individu, memilih salah satu topik
 Topics:
1. CBIR (Content Based Image Retrieval)
2. Image Forensic (Pemalsuan Citra, Copy Move/Image
Splicing)
3. Image Classification/ Clustering
4. Image Object/Pattern Recognition
5. Remote Sensing Application
6. 3D Image Modelling
7. Image Restoration
8. Image Clustering
9. Image Compression
10. Image Watermarking
72
Literature Review (Individual)

 Cari sejumlah jurnal/conference

paper/skripsi dengan topik yang sama dan
saling berkaitan agar dapat
dianalisis/bandingkan
 2 paper internasional, bahasa inggris, dengan
topik yang sama
 1 paper nasional atau skripsi dengan topik
yang sama
 Dikumpulkan Sebelum UAS
End of Year (31 Desember 2014)
73
How to Review Literatures?

 Compare: try to find the similarities among

literatures
◦ Explain how each article similar to the others.
 Contrast: try to find the differences among
literatures
◦ Explain how each article differ to the others
 Criticize: put your own opinion on what is written in
the literatures
◦ Criticize the strength and weakness of the research
 Synthesize: combine several literatures into an idea
 Summarize: restate the articles with your own
words in a concise way
74