Lect 1 Computervision Student PPT 16-9-2017
Lect 1 Computervision Student PPT 16-9-2017
processing
• Computer Vision
Does not involve human in the visual loop.
Image analysis involves the examination of image data
to facilitate in solving a vision problem
Computer Vision
• Image analysis process involves two other
topics:
– Feature extraction: acquiring higher level
image info (shape and color)
– Pattern classification: using higher level
image information to identify objects within
image.
Computer Vision
• Examples of applications of computer
vision:
– Quality control (inspect circuit board).
– Hand-written character recognition.
– Biometrics verification (fingerprint, retina,
DNA, signature, etc).
– Satellite image processing.
– Skin tumor diagnosis.
Image Processing
• Processed images are to be used by
human.
• Among the major topics are:
– Image restoration.
– Image enhancement.
– Image compression.
Image Processing
• Image restoration:
– The process of taking an image with some
know, or estimated degradation, and restoring
it to its original appearance.
– Done by performing the reverse of the
degradation process to the image.
– Examples: correcting distortion in the optical
system of a telescope.
Image Processing
• Computer Vision
Does not involve human in the visual loop.
Image analysis involves the examination of image data
to facilitate in solving a vision problem
Computer Vision
• Image analysis process involves two other
topics:
– Feature extraction: acquiring higher level
image info (shape and color)
– Pattern classification: using higher level
image information to identify objects within
image.
Computer Vision
• Examples of applications of computer
vision:
– Quality control (inspect circuit board).
– Hand-written character recognition.
– Biometrics verification (fingerprint, retina,
DNA, signature, etc).
– Satellite image processing.
– Skin tumor diagnosis.
What is Computer Vision?
• Computer vision is the science and technology of
machines that see.
Lighting
Computer
Scene
Scene Interpretation
Srinivasa Narasimhan’s slide
Computer vision vs human
vision
• Image Enhancement
Image Processing (cont’d)
• Image Restoration(e.g., correcting out-focus
images)
Image Processing (cont’d)
• Image Compression
Computer Graphics
• Geometric modeling
Computer Vision
Computer Vision
Make computers understand images and
video.
What kind of scene?
…
Robotic Vision
• Application of computer vision in robotics.
• Some important applications include :
– Autonomous robot navigation
– Inspection and assembly
Pattern Recognition
• Has a very long history (research work in this field
started in the 60s).
• Concerned with the recognition and classification of 2D
objects mainly from 2D images.
• Many classic approaches only worked under very
constrained views (not suitable for 3D objects).
• It has triggered much of the research which led to
today’s field of computer vision.
• Many pattern recognition principles are used extensively
in computer vision.
Artificial Intelligence
• Concerned with designing systems that are intelligent
and with studying computational aspects of intelligence.
• It is used to analyze scenes by computing a symbolic
representation of the scene contents after the images
have been processed to obtain features.
• Many techniques from artificial intelligence play an
important role in many aspects of computer vision.
• Computer vision is considered a sub-field of artificial
intelligence.
Why is Computer Vision
Difficult?
• It is a many-to-one mapping
– A variety of surfaces with different material
and geometrical properties, possibly under
different lighting conditions, could lead to
identical images
– Inverse mapping has non unique solution (a
lot of information is lost in the transformation
from the 3D world to the 2D image)
• It is computationally intensive
• We do not understand the recognition
problem
Practical Considerations
• Impose constraints to recover the scene
– Gather more data (images)
– Make assumptions about the world
• Computability and robustness
– Is the solution computable using reasonable
resources?
– Is the solution robust?
• Industrial computer vision systems work very
well
– Make strong assumptions about lighting conditions
– Make strong assumptions about the position of
objects
– Make strong assumptions about the type of
objects
An Industrial Computer Vision System
The Three Stages of Computer Vision
• low-level
image image
• mid-level
image features
• high-level
features analysis
36
• Low-level processing
– Standard procedures are applied to improve image quality
– Procedures are required to have no intelligent capabilities.
Low-Level
sharpening
blurring
38
Spatial Frequency Resolution
• To understand the concept of spatial
frequency, we must first understand the
concept of resolution.
• Resolution: the ability to separate two
adjacent pixels.
– If we can see that two adjacent pixels as
being separate, then we can say that we can
resolve the two.
Spatial Frequency Resolution
• Spatial frequency: how rapidly the signal
changes in space.
Spatial Frequency Resolution
• If we increase the frequency, the stripes
get closer until they finally blend
together.
Brightness Adaptation
• If fewer gray levels are used, we will
observe false contours (bogus line).
• This resulted from gradually changing light
intensity not being accurately presented.
Brightness Adaptation
• An illustration of the
Mach Band Effect.
Pixel
— the elements of a digital image
Image Sampling and Quantization
Digitizing the
coordinate
values
Digitizing the
amplitude
values
Image Sampling and Quantization
Representing Digital Images
Representing Digital Images
b=M×N×k
Spatial and Intensity Resolution
• Spatial resolution
— A measure of the smallest discernible detail in an
image
— stated with line pairs per unit distance, dots (pixels) per
unit distance, dots per inch (dpi)
• Intensity resolution
— The smallest discernible change in intensity level
— stated with 8 bits, 12 bits, 16 bits, etc.
Spatial and Intensity Resolution
Spatial and Intensity Resolution
Spatial and Intensity Resolution
Basic Relationships Between Pixels
• Neighborhood
• Adjacency
• Connectivity
• Paths
• Distance
Basic Relationships Between Pixels
• Adjacency
Let V be the set of intensity values
• Adjacency
Let V be the set of intensity values
(ii) q is in the set ND(p) and the set N4(p) ∩ N4(q) has no pixels whose
values are from p.
Basic Relationships Between Pixels
• Path
A (digital) path (or curve) from pixel p with coordinates (x0, y0) to pixel q
with coordinates (xn, yn) is a sequence of distinct pixels with
coordinates
We can define 4-, 8-, and m-paths based on the type of adjacency
used.
Examples: Adjacency and Path
V = {1, 2}
0 1 1 0 1 1 0 1 1
0 2 0 0 2 0 0 2 0
0 0 1 0 0 1 0 0 1
Examples: Adjacency and Path
V = {1, 2}
0 1 1 0 1 1 0 1 1
0 2 0 0 2 0 0 2 0
0 0 1 0 0 1 0 0 1
8-adjacent
Examples: Adjacency and Path
V = {1, 2}
0 1 1 0 1 1 0 1 1
0 2 0 0 2 0 0 2 0
0 0 1 0 0 1 0 0 1
8-adjacent m-adjacent
Examples: Adjacency and Path
V = {1, 2}
0 1 1
1,1 1,2 1,3 0 1 1 0 1 1
0 2 0
2,1 2,2 2,3 0 2 0 0 2 0
0 0 1
3,1 3,2 3,3 0 0 1 0 0 1
8-adjacent m-adjacent
The 8-path from (1,3) to (3,3): The m-path from (1,3) to (3,3):
(i) (1,3), (1,2), (2,2), (3,3) (1,3), (1,2), (2,2), (3,3)
(ii) (1,3), (2,2), (3,3)
Basic Relationships Between Pixels
• Connected in S
Let S represent a subset of pixels in an image. Two pixels
p with coordinates (x0, y0) and q with coordinates (xn, yn)
are said to be connected in S if there exists a path
(a) (b)
Consider two image subsets S1 and S2 in fig 1.59(a)
and (b) V = {1}. As pixel p in sub image S1 and pixel
q in sub image S2 have a value 1 and are 8-adjacent,
thus S1 and S2 are 8-adjacent but not 4-
adjacent,because p and q are not 4-adjacent for V =
{1}.
Path
• A digital path between pixel p having co-ordinates (x, y)
to pixel q with (u, v) co-ordinates is a sequence of
connected pixels (x, y) (x0, y0) (x1, y1) (x2, y2) . . . . (u, v).
• Length of the path is the count of connected pixels.
• If first pixel is same as last pixel, that is (x, y) = (v, w) it is
called closed path.
• Path length between p and q is = 5.
Solution
4 path: The paths starts from p but does not reach q as no path exist
between q and previous pixel.
• 8 path is not unique. In the above figure, two paths are shown, one with
dotted arrows, shortest path is 4.
• m path is unique.
Q1. Let p and q be the pixels at coordinates
(10,15) &(15,25) respectively. Find out
which distance measure gives the
minimum distance between pixels.
Minkowski Distance
• The generalized metric distance.
•
• When
λ=1 it behaves City Block Distance.
λ=2 it behaves Euclidean Distance.
λ=∞ Chebyshev distance is a special
case of minkowski distance.
Basic Relationships Between Pixels
The boundary of the region R is the set of pixels in the region that
have one or more neighbors that are not in R.
If R happens to be an entire image, then its boundary is defined as the
set of pixels in the first and last rows and columns of the image.
1 1 1
Region 1
1 0 1
0 1 0
0 0 1 Region 2
1 1 1
1 1 1
Question 2
1 1 1
Part 1
1 0 1
0 1 0
0 0 1 Part 2
1 1 1
1 1 1
• In the following arrangement of pixels, the two regions
(of 1s) are disjoint (if 4-adjacency is used)
1 1 1
Region 1
1 0 1
0 1 0
0 0 1 Region 2
1 1 1
1 1 1
• In the following arrangement of pixels, the two regions
(of 1s) are disjoint (if 4-adjacency is used)
1 1 1
foreground
1 0 1
0 1 0
0 0 1 background
1 1 1
1 1 1
Question 3
0 0 0 0 0
0 1 1 0 0
0 1 1 0 0
0 1 1 1 0
0 1 1 1 0
0 0 0 0 0
Question 4
0 0 0 0 0
0 1 1 0 0
0 1 1 0 0
0 1 1 1 0
0 1 1 1 0
0 0 0 0 0
Distance Measures
b. D(p, q) = D(q, p)
a. Euclidean Distance :
De(p, q) = [(x-s)2 + (y-t)2]1/2
0 0 0 0 0
0 0 1 1 0
0 1 1 0 0
0 1 0 0 0
0 0 0 0 0
0 0 0 0 0
Question 6
0 0 0 0 0
0 0 1 1 0
0 1 1 0 0
0 1 0 0 0
0 0 0 0 0
0 0 0 0 0
Question 7
0 0 0 0 0
0 0 1 1 0
0 1 1 0 0
0 1 0 0 0
0 0 0 0 0
0 0 0 0 0
Question 8
0 0 0 0 0
0 0 1 1 0
0 0 1 0 0
0 1 0 0 0
0 0 0 0 0
0 0 0 0 0