A1
A1
A1
a r t i c l e
i n f o
Article history:
Received 15 December 2014
Accepted 4 September 2015
Keywords:
Gamma correction
Look-up-table method
Bad weather condition
a b s t r a c t
The bad weather conditions including fog, haze, rain and snow make the acquired image contrast lower.
This makes computer vision application fail to detect or recognize objects. In this paper, a fast and
better technique for deweathering the image and video is presented. Here, we proposed an approach
of gamma correction using look-up-table methods to obtain higher contrast images. The experimental
results demonstrated that this method could effectively remove the bad weather condition and enhance
the contrast of the input images and videos. The use of look-up-table (LUT) in these images makes our
approach appreciably faster in comparison to the recent reported approach of Tarel and Wang, respectively. Moreover, we extend the static image to real-time video deweathering. The main advantage of the
proposed approach compared with others is its higher speed which allows the reliable real-time video
processing.
2015 Elsevier GmbH. All rights reserved.
1. Introduction
Imaging in poor weather is often severely degraded by scattering due to suspended particles in the atmosphere such as haze,
fog, mist, rain and snow. Poor visibility in bad weather is a major
problem for many applications such as intelligent vehicles, outdoor
object recognition and remote sensing systems, etc. The real time
deweathering is very important for many such similar applications.
In our proposed method, image enhancement technique is used for
improving the contrast of the image. This method does not analyze
the physical causes of image degradation caused by bad weather
conditions, but it is a process that aims to improve the quality of
the image according to the visual experience, which is belonging to
the areas of the image enhancement. This method is important for
enhancing the contrast of the images as well as speed.
Recently, a lot of efforts have been made to develop efcient
deweathering algorithms. Several dehazing algorithms have been
proposed to estimate object depths using multiple images or additional information. Object depths are estimated from two images,
which are captured in different weather conditions [1,2] or with
different degrees of polarization [3,4]. But this approach is unsuitable for real-time image deweathering as it processes two images
taken under different weather conditions. Single image dehazing
algorithms have been developed to overcome the limitation of
1774
Fig. 1. (a) Original foggy images, (b) Tan result, (c) our result, (d) original image (e), He result, (f) our result, (g) original image, (h) Tarel result, (i) our result, (j) original image,
(k) GDCP, (l) our result.
found that the output of a guided lter could be approximate solution of the soft matting algorithm. This algorithm reduces the time
complexity. However, this may lead to image blurring because the
original foggy image was chosen as the reference image shown in
Fig. 1(k). Recently, Wang et al. [10] presents a new method for fast
single haze image enhancement without using any extra information. This approach simultaneously dehazes image and enhances
sharpness by means of individual treatment of the model component and the residual. This method requires an image enhancement
technique to remove the halo artifacts.
This work proposes the real time approach for enhancing the
contrast of the weather degraded images. The image enhancement
method appeals better results with less processing time. We will
discuss the proposed approach which is based on the enhancement method. This approach removes the haze and fog by simply
applying the gamma correction using look-up-table method. The
complexity of our approach is lower than most of the previous
strategies as the transmission map estimation is not required. The
proposed method is much faster than above discussed approaches
such as Tan [5], Fattal [6], He et al. [7], Tarel et al. [8], GDCP method
[9] and Wang et al. [10] as it is based on the look-up-table method
and improves the quality of the images. Proposed method, does not
require any pre/post processing steps.
The rest of the paper is organized as follows: Section 2 provides a
brief discussion of related techniques that deal with deweathering.
Section 3 presents our proposed method in detail for deweathering
the images. In Section 4, the effectiveness of the proposed method
is supported by comparing the experimental results obtained
through use of our method to those obtained via existing methods.
Finally, Section 5 concludes this work.
2. Previous works
Enhancing images represent a fundamental task in many image
processing and vision applications. As a particularly challenging
case, restoring the weather degraded images requires specic
strategies and therefore an important variety of methods have
emerged to solve this problem. Given the importance of dehazing
algorithms, many studies on dehazing have been conducted. Previous dehazing research can be divided into two categories: image
enhancement methods and image restoration methods. Although
the image restoration based algorithms can achieve better results,
but these methods are usually complex. As a result, the algorithms will cost much more running time and it is hard to apply
to the real time systems. In contrast with the image restoration
based algorithm, the image processing based algorithms simply
process the image and enhance the contrast. More importantly,
the running time, cost much less than the image restoration based
algorithms. Enhancing images represent a fundamental task in
many image processing and vision applications. As a particularly
challenging case, restoring the weather degraded images requires
specic strategies and therefore, a variety of methods have been
emerged to solve this problem. Image enhancement methods tend
to increase the dynamic range and contrast of images degraded by
haze. This method does not need any scene depth information and
avoid complicated atmospheric scattering model.
In image processing area, the most commonly used nonmodel-based methods are histogram equalization and its variations
[1114]. Though histogram equalization method is simple and suitable for almost all types of images, but it fails to enhance the local
features. The local histogram equalization algorithm can process
the local lights feature very well, but large calculation and uncontrolled image quality are great disadvantages to it. So a substantial
amount of research focused on the improvement of the local histogram equalization algorithm. There are already many methods
have been proposed to fulll this requirement. Wadud et al. [15]
has proposed dynamic histogram equalization (DHE) for used in
the image contrast enhancement. Zhiyuan Xu et al. [16] present a
Contrast Limited Adaptive Histogram Equalization (CLAHE) based
method to remove fog from video sequences. The Major drawback
of this method is that, often, noisy pixels also get enhanced along
with enhancement of the foggy pixels. They also proposed a fog
degraded image contrast enhancement method based on Bilinear
Interpolation Dynamic Histogram Equalization (BIDHE). For color
images, histogram equalization can be applied to R, G, B color
channels separately. But this leads to undesirable change in hue.
1775
[0 : max intensity]
max intensity
(1)
Fig. 2 shows the owchart of the proposed method for real time
deweathering of the images. In this approach the weather degraded
image is ltered using median lter. This lter is capable of reducing
noise and preserving the edges of the input image. The window size
of the median lter is used as 3 3 to have reduced processing time.
Edges are scaled by the constant gain factor of value 0.5.
Design procedure for the real time deweathering of the images
are carried out as below:
1. Take the weather degraded image.
2. Filtered weather images.
1776
Fig. 3. (a), (b) and (c) Weather degraded images. (d), (e) and (f) Restored images by the proposed algorithm.
1777
Fig. 5. (a) Original color image, (b) Tan algorithm [5], (c) Fattal algorithm [6], (d) He et al. algorithm [7], (e) Tarel et al. [8], and (f) the proposed algorithm (from top to bottom
image name ny17, y01).
Fig. 6. (a) Original gray image, (b) Tan algorithm [5], (c) He et al. algorithm [7], (d) Tarel et al. [9], and (e) the proposed method.
1778
Fig. 7. (a) Original color image, (b) Tarel et al. [8], and (c) Wang et al. method [10], (d) the proposed method.
method depends only the dark pixel values, the information loss is
more if bright pixels are present in images. Tarel et al. [8] method
cannot completely eliminate the halos which can be seen from
Figs. 8(e) and 9(e). Figs. 8(f) and 9(f) show the restored deweathering, video frame using the proposed method. The proposed method
provides more reliable deweathering performance than existing
work. Our method diminishes halo artifacts and gives more natural results as compared with existing methods. The deweathering
results are appreciably improved by using the method which we
proposed. The processing speed of the video which can validate
that the proposed method is more suitable for real time processing
is discussed next.
4.2. Quantitative evaluation
For the quantitative analysis, blind contrast restoration assessment proposed by Hautieren et al. and PSNR is used. The blind
contrast restoration assessment method denes the ratio e of the
number of sets of new visible edges of the original image and the
restored image, as well as the average gradient ratio r. They are
expressed as:
e=
nr no
no
(2)
gr
go
(3)
gr and go are the average gradient of the original image and the
restored image. For haze removal, the greater e and r, the better
the dehazing effect. To determine the overall quality of the images,
PSNR indicator is used.
PSNR is a statistical measurement used for image or video quality assessment. PSNR is dened as the mean square error (MSE) of
1779
Fig. 8. Video deweathering on the Riverside sequence. (a) Three frames in a foggy video, (b) The result using Tan method, (c) The result using Fattal method, (d) The result
using He et al. method, (e) The result using Tarel et al. method and (f) The result using the proposed method. From top to bottom, the frame numbers are 10, 12, and 14,
respectively.
(4)
2
1
xij xij ,
MN
M1 N1
MSE =
0 i M 1,
0j N1
i=0 j=0
(5)
Fig. 9. Video deweathering on the Road View sequence. (a) Three frames in a foggy video, (b) The result using Tan method, (c) The result using Fattal method, (d) The
result using He et al. method, (e) The result using Tarel et al. method and (f) The result using the proposed method. From top to bottom, the frame numbers are 7, 9, and 11,
respectively.
1780
Table 1
Quantitative and processing time comparison.
Image
Method
PSNR
Time/second
ny17
Tan
Fattal
He et al.
Tarel et al.
Proposed method
0.0356
0.0340
0.0155
0.0139
0.1056
2.0234
1.4094
1.5448
1.5311
1.1879
59.0426
69.2153
66.0207
59.1575
56.0229
19.79
2.92
28.79
2.80
0.88
y01
Tan
Fattal
He et al.
Tarel et al.
Proposed method
0.0190
0.0171
0.0141
0.0098
0.0264
2.2723
1.1682
1.3740
1.8463
1.1749
56.7941
66.5738
58.9532
63.9328
59.2802
19.79
2.92
28.79
2.80
0.73
Road image
Tan
He et al.
Tarel et al.
Proposed method
0.838
0.7060
0.5875
0.7604
1.8976
1.7915
2.7153
1.917
62.0133
58.4418
66.2975
59.0297
9.76
20.16
2.10
0.45
where xij is the original image, xij is the dehazed image, M and N
represent the image size, (2s 1) corresponds to the theoretical
maximum intensity value of the image and s is the depth of the
image (s = 8). Tables 1 and 2 show the comparison results of the
existing methods and proposed method in terms of e, r, PSNR value
and processing time. In Table 1 three standard images (i.e. ny17, y01
and Road image) and in Table 2 two standard videos (Riverside,
and Road View,) are considered. Here, our method is compared
with Tan [5], Fattal [6], He et al. [7] and Tarel et al. [8]. Generally,
a larger PSNR values implies a better visual quality of the images.
In our case, comparable PSNR results along with e and r show the
enhanced contrast deweathering image without losing any visual
appearance. The resultants are shown in Figs. 5(f), 6(e), 8(f) and 9(f),
respectively, where it is evident that the proposed approach is capable of enhancing the quality of the images. Here, Figs. 8(f) and 9(f)
show the video deweathering frames using our approach. Furthermore, our algorithm achieves higher PSNR values for these videos.
If the excessive contrast is present in the restored video frame by
Tan [5], the color of the fog free is often oversaturated and looks
unnatural, e and r value will be very high and artifacts are present
in the recovered images and video frames.
Next, based on processing time, we can analyze how much our
algorithm is faster than existing works. Analyzing the results of
Table 1, Tan [5] and He et al. [7] method need more than 10 and
20 second per image. Fattal [6] method needs more than 2 second
for processing the images. Tarel et al. [8] method takes 2 second
per image. It is clear that the computational complexity of the proposed method is very less along with enhance the contrast of the
restored image. Computational complexity plays an important role
for real time processing and this complexity varies with different
image sizes. On the basis of these results, we can conclude that the
proposed algorithm is faster than existing methods.
For obtaining average processing time, the same two standard
videos of 30 frames per second are taken. The existing methods as
well as our proposed approach are applied to both the videos. The
processing time obtained for both the videos of one second duration consisting of 30 frames are listed in Table 2. The result shows,
Tan [5] algorithm takes almost 1415 second for processing one
second duration video. So, this method is not suitable for real time
processing. Fattal [6] method also takes 810 second for processing
the average of 30 frames. He et al. [7] approach is computationally
expensive. Tarel et al. [8] method is computationally less complicated and a good candidate for the video application in future. But
in comparison with this method, our approach is taking almost
half the processing time. This results approves that the signicant
improvement in speed of the proposed algorithm. Thus, the proposed method is more suitable for real time implementation of the
fog and haze removal of restored videos without losing any visual
quality.
Finally, we have compared e, r, PSNR value and processing
time with the best reported dehazing algorithms such as Tarel
et al. [8] and Wang et al. [10] method by simulating all of them
Table 2
Quantitative estimation of video deweathering.
Weather degraded input
sequence
Tan
Fattal
PSNR
Time (Sec.Per
30 frames)
He et al.
PSNR
Time (Sec.Per
30 frames)
PSNR
Time (Sec.Per
30 frames)
River side
Frame no. 10
Frame no. 12
Frame no. 14
0.1051
0.1378
0.1652
2.1055
2.1052
2.1059
59.3692
59.3716
59.3627
14.4536
1.0954
0.0995
0.1302
1.2103
1.9499
1.9433
55.5941
55.5579
55.5454
8.18442
0.1308
1.5689
0.1239
1.4110
0.6947
1.4930
58.2038
55.9097
58.7705
740.662
Road view
Frame no. 7
Frame no. 9
Frame no. 11
1.3857
1.2680
1
1.4352
1.4364
1.4641
56.6065
56.6223
56.6105
15.9270
0.1096
0.0850
0.1616
1.2681
1.2895
1.2875
56.2881
57.8902
58.0679
10.6871
0.9967
0.9967
0.2195
1.0211
0.8449
0.9759
57.1285
58.2099
57.6657
852.713
Tarel et al.
Proposed method
PSNR
Time (Sec.Per
30 frames)
River side
Frame no. 10
Frame no. 12
Frame no. 14
0.0318
0.0587
0.0638
1.8352
1.8391
1.8464
61.5819
61.5809
61.5586
3.4220
Road view
Frame no. 7
Frame no. 9
Frame no. 11
0.8140
0.8268
0.6128
1.3918
1.4023
1.4075
56.1858
56.1966
56.2080
4.879
0.0857
0.0756
0.0700
1.4414
1.4114
1.3231
64.2456
64.3277
64.2390
1.775
0.3555
0.2876
0.0152
0.9679
0.9599
0.9606
60.2669
60.2392
60.2593
2.270
PSNR
Time (Sec.Per
30 frames)
1781
Table 3
Quantitative and processing time comparison (in sec) with Tarel [8] and Wang [10] for different image sizes.
Image sizes
Tarel
Wang
Our
PSNR
Time/
second
PSNR
Time/
second
PSNR
Time/
second
1.6309
1.7964
1.6490
58.4344
60.4633
59.4904
1.57
2.08
2.86
0.0387
0.0313
0.2854
1.9853
2.1797
1.704
58.0774
59.5027
58.6550
1.46
1.87
2.49
0.0752
0.0196
0.0244
1.3257
1.2436
1.3835
58.7848
57.6408
59.7815
0.659
0.997
1.159
% improvement
w.r.t. Tarel
% improvement
w.r.t. Wang
41.9
48.0
41
45.1
53.3
46.5
1.5
1
time
Processing
0.5
0
465 x 384
600 x 400
Image Sizes
1000 x 327
References
[1] Narasimhan S, Nayar S. Vision and the atmosphere. Int J Comput Vis
2002;48(3):23354.
[2] Narasimhan S, Nayar S. Contrast restoration of weather degraded images. IEEE
Trans Pattern Anal Mach 2003;25(6):71324.
[3] Shwartz S, Namer E, Schechner Y. Blind haze separation. In: Proc. IEEE CVPR.
2006. p. 198491.
[4] Schechner Y, Narasimhan S, Nayar S. Instant dehazing of images using polarization. In: Proc. IEEE CVPR. 2001. p. 32532.
[5] Tan R. Visibility in bad weather from a single image. In: Proc. IEEE CVPR. 2008.
p. 18.
[6] Fattal R. Single image dehazing. ACM Trans Graph 2008;27(3):19.
[7] He K, Sun J, Tang X. Single image haze removal using dark channel prior. IEEE
Trans Pattern Anal Mach 2011;33(12):195663.
[8] Tarel J, Hautire N. Fast visibility restoration from a single color or gray level
image. In: Proc. IEEE ICCV. 2009. p. 22018.
[9] He K, Sun J, Tang X. Guided image ltering. In: IEEE Trans. Pattern Anal. Mach.
Intell. 2013. p. 1397409.
[10] Wang Z, Feng Y. Fast Single Haze Image Enhancement. Computers and Electrical
Engineering; 2013.
[11] Pizer SM, Philip Amburn E, Austin JD, Cromartie R, Geselowitz A, Greer T, et al.
Adaptive histogram equalization and its variations. Comput Vis Graph Image
Process 1987;39:35568.
[12] Zuiderveld K. Contrast limited adaptive histogram equalization. In: Heckbert
P, editor. Graphics Gems IV. New York: Academic; 1994. p. 47485 [Chapter
VIII.5].
1782
[13] Stark JA. Adaptive image contrast enhancement using generalizations of histogram equalization. IEEE Trans Image Process 2000 May;9(5):88996.
[14] Rodriguez JJ, Yang CC. High-resolution histogram modication of color images.
Graph Models Image Process 1995 Sep;57(5):43240.
[15] A-Al-Wadud M, Hasanul Kabir Md, Ali Akber Dewan M, Chae O. A dynamic
histogram equalization for image contrast enhancement. IEEE Trans Consum
Electron 2007;53:593600.
[16] Xu Z, Liu X, Chen X. Fog removal from video sequences using contrast limited
adaptive histogram equalization. In: CISE, International Conference on, IEEE.
2009. p. 14.
[17] Rodriguez JJ, Yang CC. High-resolution histogram modication of color images.
Graph Models Image Process 1995 Sep;57(5):43240.
[18] Polesel A, Ramponi G, Mathews VJ. Image enhancement via adaptive unsharp
masking. IEEE Trans Image Process 2000;9(March (3)):50510.
[19] Jobson DJ, Rahman Z, Woodell GA. Properties and performance of a center/surround retinex. IEEE Trans Image Process 1997;6(March (3)):45162.
[20] Jobson DJ, Rahman Z, Woodell GA. A multi-scale retinex for bridging the gap
between color images and the human observation of scenes. IEEE Trans Image
Process 1997;6(July (7)):96576.
[21] Rahman Z, Jobson DJ, Woodell GA. Retinex processing for automatic image
enhancement. J Electron Imag 2004;13(January (1)):10010.
[22] Scheunders P. A multivalued image wavelet representation based on multiscale
fundamental forms. IEEE Trans Image Process 2002;10(May (5)):56875.
[23] Grewe L, Brooks RR. Atmospheric attenuation reduction through multi-sensor
fusion. Proc SPIE 1998;3376:1029.
[24] Yu B-N, Kim BS, Lee KH. Visibility enhancement based real-time retinex for
diverse environments. SITIS 2012.
[25] John Jisha, Wilscy M. Enhancement of weather degraded video sequences using
wavelet fusion. In: CIS, IEEE Conf. 2008. p. 16.
[26] Hautiere N, Tarel J-P, Aubert D, Dumont E. Blind contrast enhancement
assessment by gradient ratioing at visible edges. J Image Anal Stereol
2008;27(2):8795.