Scribd
Upload
8 views31 pages

Mathematical Tools - Contd.

The document discusses various mathematical tools for image processing, focusing on point-wise and neighborhood processing techniques. It covers methods such as negative imaging, contrast stretching, thresholding, and image registration, emphasizing their applications in enhancing image quality and analyzing multiple data sources. Additionally, it outlines the steps involved in automatic image registration, including preprocessing, feature extraction, matching, and resampling.

Uploaded by

musiclovur
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
8 views31 pages

Mathematical Tools - Contd.

The document discusses various mathematical tools for image processing, focusing on point-wise and neighborhood processing techniques. It covers methods such as negative imaging, contrast stretching, thresholding, and image registration, emphasizing their applications in enhancing image quality and analyzing multiple data sources. Additionally, it outlines the steps involved in automatic image registration, including preprocessing, feature extraction, matching, and resampling.

Uploaded by

musiclovur
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 31

Mathematical Tools

Outline
• Point wise Processing
• Neighborhood Processing
Image and its pixel values
Single Pixel Operation –
Point Processing
Spatial Domain Methods
• Spatial domain methods are procedures that
operate directly on these pixels. Spatial domain
processes will be denoted by the expression:
g(x,y) = T [f(x,y)]

Where f(x,y) in the input image, g(x,y) is the


processed image and T is as operator on f,
defined over some neighborhood of (x,y)

• In addition, T can operate on a set of input


images.
Negative Image
•Negative images are useful for
enhancing white or grey detail
embedded in dark
s =regions
intensityof an image
max - r
– Note how much clearer the tissue is in
the negative image of the mammogram
below

Original Negative
s = 1.0 - r
Image Image
Contrast Stretching
If T(r) has the form as shown in the figure below, the effect of
applying the transformation to every pixel of f to generate the
corresponding pixels in g would:
Produce higher contrast than the original image, by:
• Darkening the levels below m in the original
image
• Brightening the levels above m in the
original image

So, Contrast Stretching: is a simple image


enhancement technique that improves the contrast
in an image by ‘stretching’ the range of intensity values it
contains to span a desired range of values. Typically, it uses a
linear function
• T=105
• If r<=T, s=r-50;
• Else s=r+50;
Contrast Stretching
Thresholding
•Thresholding transformations are
particularly useful for segmentation in
which we want to isolate an object of
interest from a background

1.0 r > threshold


s=
0.0 r <= threshold
Thresholding
Is a limited case of contrast stretching, it produces a two-
level (binary) image.

Some fairly simple, yet powerful, processing approaches can


be formulated with grey-level transformations. Because
enhancement at any point in an image depends only on the
gray level at that point, techniques in this category often are
referred to as point processing.
Neighbourhood Operations
• Neighbourhood operations simply
operate on a larger neighbourhood
of pixels than point operations
• Neighbourhoods are mostly a
rectangle around a central pixel
• Any size rectangle and any shape
filter are possible
Example
• Min: Set the pixel value to the
minimum in the neighbourhood
• Max: Set the pixel value to the
maximum in the neighbourhood
• Median: The median value of a set of
numbers is the midpoint value in that
set (e.g. from the set [1, 7, 15, 18, 24]
15 is the median). Sometimes the
median works better than the average
Example – Smoothing
Operation
Image Smoothing Example
Strange Things Along the
Edges
Possible Solutions
• Here are a few approaches to dealing with the missing
edge pixels:
• – Omit missing pixels
– Only works with some filters
– Can add extra code and slow down processing
• – Pad the image
– Typically with either all white or all black pixels
• – Replicate border pixels
• – Truncate the image
• – Allow pixels wrap around the image
– • Can cause some strange image artifacts
Zooming (over sampling)
images
Zoomed by
using nearest
neighbor

Zoomed by
using Bilinear
Zooming (over sampling)
images
Zooming requires 2 steps:

The creation of new pixel locations.


The assignment of gray levels to these new locations.

Techniques for zooming:

1. Nearest neighbor interpolation


2. Bilinear interpolation
3. Bicubic interpolation
Nearest neighbor
Example:
interpolation
Suppose A 2x2 pixels image will be enlarged 2 times by the nearest neighbor method:

1. Lay an imaginary 4*4 grid over the original image..


2. For any point in the overlay, look for the closest pixel in the original image, and assign its gray level to the
new pixel in the grid. (copy)
3. When all the new pixels are assigned values, expand the overlay grid to the original specified size to obtain
the zoomed image.

• Pixel replication (re sampling) is a special case that is applicable when the size of the image needs to be
increased an integer number of times (like 2 times not 1.5 for example).

+ ve : Nearest neighbor is fast


-ve: it produces a checkerboard effect like
this!
What is Image Registration / Alignment /
Matching?

The above image over Colorado Springs is


rotated and shifted with respect to the left
image.
Definition and Motivation
• Task of bringing together two or more
digital images into precise alignment
for analysis and comparison

• A crucial, fundamental step in image


analysis tasks, where final information
is obtained by the combination /
integration of multiple data sources.
Motivation / Applications
• Computer Vision (target localization, quality
control, stereo matching)

• Medical Imaging (combining CT and MRI


data, tumor growth monitoring, treatment
verification)

• Remote Sensing (classification,


environmental monitoring, change detection,
image mosaicing, weather forecasting,
integration into GIS)
Literature of Automatic
Image Registration
• Books:
– Medical Image Registration, J. Hajnal, D.J. Hawkes, and D. Hill (Eds.), CRC
2001
– Numerical Methods for Image Registration, J. Modersitzki, Oxford University
Press 2004
– 2-D and 3-D Image Registration, A. Goshtasby, Wiley 2005
– Image Registration for Remote Sensing, J. LeMoigne, N.S. Netanyahu, and
R.D. Eastman (Eds.), Cambridge University Press 2011

• Surveys:
– A Survey of Image Registration Techniques, ACM Comp. Surveys, L.G. Brown,
1992
– Registration Techniques for Multisensor Remotely Sensed Imagery, PE&RS,
L.M.G. Fonseca and B.S. Manjunath, 1996
– A Survey of Medical Image Registration, Medical Image Analysis, J.B.A.
Maintz and M.A. Viergever, 1998
– Image Registration Methods: A Survey, Image and Vision Computing, B.
Zitová and J. Flusser, 2003
– Mutual-Information-Based Registration of Medical Images: A Survey, IEEE-
TMI, J. Pluim, J.B.A. Maintz, and M.A. Viergever, 2003
Application
Examples
• Change Detection

1975 2000
Satellite images of Dead Sea, United Nations Environment Programme (UNEP) website
Change Detection (cont’d)

IKONOS images of Iran’s Bushehr nuclear plant, GlobalSecurity.org


Change Detection (cont’d)

Satellite imagery of Sendai Airport before and after the 2011 earthquake
Automatic Image Registration
Components
0. Preprocessing
– Image enhancement, cloud detection, region of interest masking

1. Feature extraction (control points)


– Corners, edges, wavelet coefficients, segments, regions, contours

2. Feature matching
– Spatial transformation (a priori knowledge)
– Similarity metric (correlation, mutual information, Hausdorff distance,
discrete Gaussian mismatch)
– Search strategy (global vs. local, multiresolution, optimization)

3. Resampling
I2
Tp

I1
Example of Image Registration
Steps

Feature extraction

Resampling Registered images after transformation

Zitová and Flusser, IVC Feature matching


2003

You might also like