Lecture6 PDF
Lecture6 PDF
Lecture6 PDF
Perception
Sensors
Vision
Uncertainties, Line extraction from laser scans
Typical sizes:
320 x 240 (QVGA)
640 x 480 (VGA)
1280 x 720 (HD)
Intensities sampled to 256 grey levels 8 bits
Useful
cues
Heavy
Processing
218 218 218 218 218 218 218 218 218 218 218
218 218 218 218 218 218 218 218 218 218 218
218 218 218 218 218 218 218 218 218 218 218
218 218 218 218 218 218 218 218 218 218 218
218 218 218 218 218 218 218 218 218 218 218
218 218 218 218 218 218 218 218 218 218 218
218 218 218 218 218 218 218 218 218 218 218
218 218 218 218 218 218 218 218 218 218 218
218 218 218 218 218 218 218 218 218 218 218
218 218 218 218 218 218 218 218 218 218 218
218 218 218 218 218 218 218 218 218 218 218
208 208 208 208 208 208 208 208 208 208 208
208 208 208 208 208 208 208 208 208 208 208
208 208 208 208 208 208 208 208 208 208 208
208 208 208 208 208 208 208 208 208 208 208
208 208 208 208 208 208 208 208 208 208 208
208 207 208 208 208 208 208 208 208 208 208
0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0
229 229 229 229 229 229 229 229 229 229 229
229 229 229 229 229 229 229 229 229 229 229
229 229 229 229 229 229 229 229 229 229 229
229 229 229 229 229 229 229 229 229 229 229
229 229 229 229 229 230 229 229 229 229 229
5 17 31 7 1 0 229 229 229 229 229
0 0 1 0 0 0 229 229 229 229 229
0 0 0 0 0 0 229 229 229 229 229
0 0 0 0 1 4 229 229 229 229 229
0 0 0 0 0 11 229 229 229 229 229
0 0 0 0 0 5 229 229 229 229 229
Image Filtering
Correlation
Convolution
Image Features
Harris corners
SIFT features
2N+1
Correlation
Convolution
Brief study of these filters in the simplest case of 1D images (i.e. row of pixels)
& their extension to 2D
… 5 4 2 3 7 4 6 3 6 6 …
× × ×
1/3 1/3 1/3
=
=
4/3 2/3 3/3
9/3
… 5 4 2 3 7 4 6 3 6 6 …
× × ×
1/3 1/3 1/3 Filter, kernel, mask, window
=
2/3 3/3 7/3
9/3 12/3
Formally, Correlation is
Other examples of
In this smoothing example
smoothing filters?
Near-by pixels have a bigger influence on the averaged value rather than
more distant ones
Near-by pixels have a bigger influence on the averaged value rather than
more distant ones
× × ×
-1/2 0 1/2
3 2 4 1 3 8 4 0 3 8 7 7
26 37 21 50 54 1 50 65 59 16 42 17
3 2 4 1 3 8 4 0 3 8 7 7
Correlation
26 37 21 50 54 1 50 65 59 16 42 17
3 2 4 1 3 8 4 0 3 8 7 7
0.919 0.759 0.988 0.628 0.655 0.994 0.691 0.464 0.620 0.860 0.876 0.859
3 2 4 1 3 8 4 0 3 8 7 7
where
In NCC and ZNCC we considering the unit vectors of F and Ix , hence we
measure their similarity based on the angle
CONVOLUTION So if
CORRELATION Then,
Very useful!
Example: smooth an image & take its derivative convolve the Derivative filter with the
Gaussian Filter & convolve the resulting filter with the image
: Edge strength
© R. Siegwart , D. Scaramuzza and M.Chli, ETH Zurich - ASL
Lecture 6 - Perception - Vision
Lec. 6
34
2D Edge detection: Example
Thresholding
© R. Siegwart , D. Scaramuzza and M.Chli, ETH Zurich - ASL
Lecture 6 - Perception - Vision
Lec. 6
35
2D Edge detection: Example
Image Feature
Extraction
• Edges (seen before)
• Points:
o Harris corners
o SIFT features
no chance to match!
3D reconstruction
Motion tracking
… other
No structure:
SSD is almost constant in all directions, so it’s a flat region
Last step of Harris corner detector: extract local maxima of the cornerness function
Rotation,
View-point,
Zoom,
Illumination?
Rotation invariance
image 1 image 2
Ellipse rotates but its shape (i.e. eigenvalues) remains the same
image 1 image 2
Repeatability:
Harris detector: probably the most widely used & known corner detector
aim: corresponding regions look the same in image space, when the
appropriate scale-change is applied
A “good” function for scale detection: has one clear, sharp peak
I I I Good !
bad bad
Sharp, local intensity changes in an image, are good regions to monitor for
identifying relative scale in usual images.
Kernels:
(Laplacian of Gaussian)
(Difference of Gaussians)
Note: These kernels are invariant to
scale and rotation
Repeatability:
# correspondences detected
# correspondences present
DoG: