Improving Spatial Resolution of Satellite Image Using Data Fusion Method

Muhsin and Mashee
Iraqi Journal of Science, December 2012, Vol. 53, No. 4, Pp. 943-949
Improving Spatial Resolution Of Satellite Image Using Data Fusion Method

Israa J. Muhsin & Foud,K. Mashee
Remote Sensing Unit, College of science, University of Baghdad, Baghdad, Iraq
[email protected]
Abstract
While many remote sensing and GIS applications require both the spatial
resolution and spectral resolution be high, image fusion, or in other words, image
sharpening, is a useful technique. To date, numerous image fusion techniques have
been developed to combine the clear geometric features of the panchromatic image
and the color information of the multispectral image. This paper compares the
results of four different pixel based fusion techniques, HLS, Brovey
transformation,GramSchmidt and HSV techniques used to merge the ETM+
multispectral image with (28.5 m)spatial resolution and panchromatic image
captured by SPOT satellite with (10m) spatial resolution, correlation coefficient ,
root mean square error and peak signal to noise ratio criteria have been used to
achieve the comparison among the using techniques.
Keyword: image fusion, HLS, Brovey, Gram-Schmidt.

"# $ % &'
!

(

! " # $ %
) *
&'

! " + "
'(
'( )& ,!
2!0 34 " 5 - . / !0 1%
! " -
) L ( M

" 5 N HLs, HSV ,Brovey, GramFSchmidt 6
. .( l0m ) " - ( 28.5m )
! ( ETM+
. . '( N_

( PSNR , RMSE,CC) 34
motivation for different image fusion

algorithms. Several situations in image
processing require high spatial and high spectral
resolution in a single image. Most of the
available equipments is not capable of providing
such data convincingly. The image fusion
techniques allow the integration of different
1. Introduction
Image fusion is the process of combining
relevant information from two or more images
into a single image. The resulting image will be
more informative than any of the input images.
In remote sensing applications; the increasing
availability of space borne sensors gives a
943
Muhsin and Mashee
information sources. The fused image can have

complementary spatial and spectral resolution
characteristics. However, the standard image
fusion techniques can distort the spectral
information of the multispectral data while
merging.
Satellites provide two types of image data:
panchromatic imagery with high-spatial (but low
spectral) resolution and multispectral images
with lower spatial (but higher spectral)
resolution. Image fusion techniques, as an
alternative solution can be used to integrate the
geometric detail of a high-resolution Pan image
and the color information of low-resolution MS
images to produce a high-resolution MS image,
[1,2]. The primary objective of this paper is to
apply four different fusion techniques on
enhance thematic mapper (ETM+) multispectral
with three band (red, green, blue) and

panchromatic image exposure by SPOT satellite.
The technique that have been used in this paper
include (HLS, Brovey, GramSchmidt and
HSV).
The comparison between the result fused image
three objective fidelity criteria RMSE (root
mean square error), PSNR (peak signal to noise
ratio), and CC (correlation coefficients).
2. Methodology
Four fusion techniques have been adopted to get
high resolution image combine from the
panchromatic and multispectral image of mousel
city lies in the north of Iraq, the image of the
studied area and its statistical properties can be
shown in the figure (1) and table (1)
respectively. The details of the adopted four
methods can be shown in the next section:
(a)
ETM+ multispectral image (b1,b2,b3)
Histogram of multispectral image
(b)
SPOT panchromatic image
Histogram of panchromatic image
Figure 1- A. Original Image With Spatial Resolution(28.5m) Consist Of Three Bands Captured By ETM+. B.
Panchromatic Image With High Resolution (10 M) .Captured By SPOT.
944
Muhsin and Mashee
Table 1- Statistic Properties Of The Original Images.
image
No.of
bands
Multispectral(ETM+) Band1
Band2
Band3
Min.
Max.
Mean
Stdev.
0
0
0
255
255
255
113.97763
124.42161
115.11013
58.86576
60.18855
56.87623
Panacromatic(SPOT)
255
129.134861
69.713729
Band1
image. Applying the inverse transform, we

obtain the fused RGB image, with the spatial
detail of the PAN image incorporated into it.
The geometry of HLS (Hue light saturation) can
be shown in figure (2), with hue, their angular
dimension, starting at the red primary at 0,
passing through the green primary at 120 and
the blue primary at 240, and then wrapping
back to red at 360. In each geometry, the
central vertical axis comprises the neutral,
achromatic, or gray colors, ranging from black
at lightness 0 or value 0, the bottom, to white at
lightness 1 or value 1.
2.1 Hls (Hue Light Saturation)

Transform.
The HIS transform is always applied to an RGB
composite. This implies that the fusion will be
applied to groups of three bands of the MS
image. As a result of this transformation, we
obtain the new intensity, hue, and saturation
components. The PAN image then replaces the
intensity image. Before doing this, and in order
to Minimize the modification of the spectral
information of the fused MS image with respect
to the original MS image, the histogram of the
PAN image is matched with that of the intensity
Figure 2- a. HLS Cylinder, b. HLS Lightness
1
R
G = 1

B 1
Many mathematical models of transformation to

convert RGB into the parameters of human color
perception and vice versa, [3,4]. These
transformations differ mainly depended on the
coordinates system (cylindrical or spherical
coordinates), the primary color use as the hue
references point, and the method used to
calculate the intensity component of the
transformation. To understand the color
distortion during the image fusion process, there
are two type of conversion linear transformation
which can be define as:
1
3
I
v1 = 2

6
v 2 1
2
3
2
1
2 I
v1 .......... .( 2 )
1
2
v 2
0
2
2
Where
: represent x, y, z in Cartesian
coordinates system respectively.
So hue (H) and saturation(S) can be defined as:
.(3)
...(4)
3 R
2 2 G .......... .......(1)
6
0 B
945
RGB cube can be rotated until the horizontal

plane is parallel to the Maxwell triangle and the
vertical axis lies on the gray line of the RGB
cube. As such, a nonlinear RGB-HIS conversion
system can be represented:
Muhsin and Mashee
2.4. Fusion image based on Brovey transform.

The Brovey transform is based on the
mathematical combination of the multispectral
images and high resolution Pan image. Each
multispectral image is normalized based on the
other spectral bands and multiplied by the Pan
image to add the spatial information to the
output image. The following equation shows the
mathematical algorithm for the Brovey method
[8].
.(5)
(6)
..(7)
2.2 HSV (Hue Saturation Value)
Transformation.
Fi =
a) RGB to HSV: Transforms an RGB image

into the HSV color space. The input RGB values
must be byte data in the range 0 to 255. You
must have either an input file with at least three
bands or a color display open to use this
function. The stretch that is applied in the color
display is applied to the input data. The hues
produced are in the range of 0 to 360 degrees
(where red is 0 degrees, green is 120 degrees,
and blue is 240 degrees) and saturation and
value in the range 0 to 1 (floating-point).
P .(8)
+ c
j =1
Fi: fused image

Mi: multispectral band to be fused
P: panachromatic band
: sum of all multispectral bands
In some cases there is an area with zero DN
values for all bands; therefore a constant C has
to be added in the denominator to produce
meaningful output digital numbers.
b) HSV to RGB: Transforms an HSV image

back to the RGB color space. The input H, S,
and V bands must have the following data
ranges: Hue = 0 to 360, where 0 and 360 = blue,
120 = green, and 240 = red; Saturation ranges
from 0 to 1.0 with higher numbers representing
more pure colors; Value ranges from
approximately 0 to 1.0 with higher numbers
representing brighter colors. The RGB values
produced are byte data in the range 0 to 255.[5]
3. Statistical Comparison
In this study evaluation method was employed
to assess the synthesis property of fused images.
The fused images are re-sampled to the
resolution of the original multispectral images,
the statistical criteria include:
Correlation Coefficient (CC): The correlation
coefficient measures the closeness or similarity
in small size structures between the original and
the fused images. It can vary between -1 and
+1.Values close to +1 indicate that they are
highly similar while the values close to -1
indicate that they are highly dissimilar, [9].
2.3. Fusion Image Based On The Gram

Schmidt Process.
The Gram Schmidt fusion simulates a
panchromatic band from the lower spatial
resolution spectral bands. In general, this is
achieved by averaging the multispectral bands.
As the next step, a Gram Schmidt
transformation is performed for the simulated
panchromatic band and the multispectral bands
with the emulated panchromatic band employed
as the first band. Then the high spatial resolution
panchromatic band replaces the first Gram
Schmidt band. Finally, an inverse Gram Schmidt
transform is applied to create the pan sharpened
multispectral bands [6,7]. This method usually
produces good results for fusion images from
one sensor as well as different sensors.
cc =
(MS
N
i =1
j =1
(MS
N
i =1
j =1
i, j
i, j
)(
MS Fi , j F
MS
) (F
2
i =1
(9)
F)
i, j
j =1
Where
CC is the Correlation Coefficient,
F is the fused image and i and j are pixels,
MS is the original data.
RMSE (Root Mean Square Error): consider
to be good criteria to achieve the evaluation
946
Muhsin and Mashee
between the original and process images. It can

be given as:
(10)
( L 1) 2
PSNR = 10 log 10
1
NM
(MS
N
(1) respectively. The result of fused image using

HLS and brovey can be shown in figure (3),
while fused images using GramSchmidt and
HSV can be shown in figure (4).
The Statistical comparison between the original
and fused image have been achieved using many
objective criteria such as RMSE (root mean
square error), PSNR (peak signal to nose ratio),
and CC (correlation coefficient), where the
result of the criteria prove that GramSchmidt
fusing technique have more correlation
coefficient than the other techniques, as well as
GramSchmidt have good value of PSNR
comparison with the other techniques. For more
information see table (2).
This study proves not only the importance of
evaluation methods that should be consistent
and the necessity of combined method for a
quantitative assessment of spatial improvement
and spectral preservation. The idea of image
fusion is to pan sharpen multispectral
information, which is not the case if the spatial
structures in the fused images are only slightly
improved when compared to the original. Then
the fused image looks very similar to the
original one and produces excellent results in the
statistical evaluations for color preservation.
four techniques of image fusion have been
achieved.
i, j
Fi , j )
i =1 j =1
PSNR (peak signal to nose ratio): is another

objective fidelity criteria has been used to
perform the comparison between the original
and fused image, and it can be defined as
follow:
2
1 N M
RMSE=
(MSi, j Fi, j ) .(11)
NM i=1 j =1
Where:
N,M=size of the image.
MS=original image.
F=fused image.
L=no.of the image gray levels, for 8bit, L=256.
4.
Result and Conclusions
The fusing techniques have been used to
enhance the spatial resolution of multispectral
image captured by ETM+ (28.5m) by combining
it with high resolution panchromatic image
exposure by SPOT with spatial resolution
(10m). the original image with its statistical
properties can be shown in figure(1) and table
HLS
histogram of three band
Brovey
Figure 2- Show The Results Of Fused Images Using Hls And Brovey Techniques.
947
Muhsin and Mashee
GramSchmidt
HSV
Figure 3- Show The Results Of Fused Images Using GramSchmidt And Hsv Techniques.
Table 2- Represent The Statistical Criteria Between The Original And Fused Image
Fusion methods
RMSE
PSNR
HLS
Brovy
GramSchmidt
HSV
5.3218
21.9762
CC(correlation
coefficient)
0.899
7.1280
0.7745
0.7502
16.1317
60.5232
17.2210
0.597
0.998
0.950
Table 3- Shows The Statistical Properties Of The Fusion Techniques.
Fused images
HLS
Brovey
Gram
Schmidt
HSV
Bands
Band1
Band2
Band3
Band1
Band2
Band3
Band1
Band2
Band3
Band1
Band2
Band3
Min
0
0
0
0
0
0
0
0
0
0
0
0
Max
255
255
255
255
255
255
255
252
234
255
255
255
948
Mean
107.285966
129.512371
63.04596
39.850346
43.311694
40.785969
113.948559
124.424131
115.101532
115.979
119.4807
114.5267
Std.dev.
90.085156
69.501956
57.012458
26.096062
27.448701
25.308641
58.130039
60.939461
57.371996
73.9182
76.76
74.726
Muhsin and Mashee
5. References
[1] Gooding M.J. et al. , 2010 Investigation into
the fusion of multiple 4-D fetal
echocardiography images to improve image
quality, Ultrasound in Medincine and
Biology,36(6), pp. 957-66.
[2] Zhang, Y., 2004 Highlight Article:
Understanding
Image
Fusion.
Photogrammetric Engineering & Remote
Sensing, 70(6), pp. 657-661.
[3] Gonzalez R.C., Wood R.E., 2002 digital
image processing,second edition,prenticehall,inc.
[4] Tu, T. M., Huang, P. S., Hung, C. L., et al.
2004,. A fast intensity-hue-saturation fusion
technique with spectral adjustment for
IKONOS imagery. IEEE Transactions on
Geoscience and Remote Sensing, 1(4), pp.
309-312.
[5] Vrabel, Jim, 1996 Multispectral Imagery
Band Sharpening Study, Photogrammetric
Engineering & Remote Sensing, Vol. 62,
No. 9, pp. 1075-1083.
[6] Sascha Klonus, Manfred Ehlers, 2009
Manfred
Ehlers
Performance
of
evaluation methods in image fusion 12th
International Conference on Information
Fusion Seattle, WA, USA, July 6-9.
[7] C.A. Laben, V. Bernard, and W. Brower,
2000 Process for enhancing the spatial
resolution of multispectral imagery using
pan-sharpening, US Patent 6,011,875.
[8] Zhang, Y., 2002 Problems in the fusion of
commercial highresolution satelitte images
as well as Landsat 7 images and Initial
solutions.
nternational
Archives
of
Photogrammetry and Remote Sensing
(IAPRS), Volume 34, Part 4, ISPRS, CIG,
SDH Joint International Symposium on
"GeoSpatial Theory, Processing and
Applications", Ottawa, Canada.
[9] Y. Zhang, 2008 Methods for image fusion
quality assessment - a review, comparison
and analysis, The International Archives of
the Photogrammetry, Remote Sensing and
Spatial Information Sciences, Volume
XXXVII, Part B7, Beijing, 1101-1109.
949

Improving Spatial Resolution of Satellite Image Using Data Fusion Method

Uploaded by

Copyright:

Available Formats

Improving Spatial Resolution of Satellite Image Using Data Fusion Method

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Improving Spatial Resolution of Satellite Image Using Data Fusion Method

Uploaded by

Copyright:

Available Formats

Muhsin and Mashee