Research Article
Research Article
1155/2010/914564
Research Article Determining Neighborhoods of Image Pixels Automatically for Adaptive Image Denoising Using Nonlinear Time Series Analysis
Zhiwu Liao,1 Shaoxiang Hu,2 and Wufan Chen3
1
Key Laboratory of Land Resources Evaluation and Monitoring of Southwest, Sichuan Normal University, Ministry of Education, Chengdu 610068, Sichuan, China 2 School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu 610054, Sichuan, China 3 Institute of Medical Information and Technology, School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China Correspondence should be addressed to Zhiwu Liao, [email protected] Received 30 January 2010; Accepted 20 March 2010 Academic Editor: Ming Li Copyright q 2010 Zhiwu Liao et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. This paper presents a method determining neighborhoods of the image pixels automatically in adaptive denoising. The neighborhood is named stationary neighborhood SN . In this method, the noisy image is considered as an observation of a nonlinear time series NTS . Image denoising must recover the true state of the NTS from the observation. At rst, the false neighbors FNs in a neighborhood for each pixel are removed according to the context. After moving the FNs, we obtain an SN, where the NTS is stationary and the real state can be estimated using the theory of stationary time series STS . Since each SN of an image pixel consists of elements with similar context and nearby locations, the method proposed in this paper can not only adaptively nd neighbors and determine size of the SN according to the characteristics of a pixel, but also be able to denoise while eectively preserving edges. Finally, in order to show the superiority of this algorithm, we compare this method with the existing universal denoising algorithms.
1. Introduction
Image denoising is a very important image preprocessing step. In acquisition, images would be more or less aected by noise. Noise will make the image quality reduction, which will inuence the subsequent processing steps. In order to recover a real hidden image from a noisy image, a lot of eorts have been done for a long time. In 1949, Wiener proposed Wiener ltering using the theory of stationary random process 1 . In theory, Wieners lter meets the minimum mean-square errors MMSEs of
a linear lter. However, Wiener ltering is only applicable to stationary time series, which causes the edges to be blurred in denoising. The most eective way to address these problems is adaptive denoising 25 , which assumes that the image gray levels are piecewise constant or piecewise continuous. However, near the singular points, such as edges and textures, the assumption of being piecewise continuous and constant does not hold. It also makes the edges and textures oversmoothing. An improved form of adaptive denoising is called the bilateral ltering 611 . Bilateral ltering integrates range ltering gray level and domain ltering space together, which preserves edges while denoising. However, in noises, the real gray levels are polluted seriously, which makes the real levels unable to be correctly estimated from the noisy gray levels. In addition, two window parameters, the variances of range lters kernel and spatial lters kernel, must be selected by experience. Once it is xed, it cannot be changed. Some researchers suggested that the context able to be used for distinguishing the singular points from smooth points 12, 13 . Essentially, the context dened on the local gray level energy is a classier for image pixels. This makes smooth can be done only among the similar points, which can maintain the singularity in denoising. However, due to context dened in the whole image, it lacks spatial adaptation. Studies in 1417 propose dierent methods to improve it. Some algorithms combine space and context together 1416 . In these methods, a xed-size of sliding windows is chosen by experience rstly. Then the true value of each pixel is estimated from the points in the window with the similar context. These methods have better performance than the context. The challenge of these methods is that xed size sliding windows will make the window too small to obtain reliable estimate for singular points. Another well-known method is nonlocal denoising algorithm proposed recently 17 . Nonlocal approach determines the similarities through a big and a small window together. The small window is used to determine the nature of local gray energy while the large window is used to look for similarities. As the searching neighborhood is large, nonlocal approach can overcome the default for most of spatial methods in unreliable estimates near singular points, which can more eectively maintain the borders and textures. We think that nonlocal is the same as context in nding the similar points using local gray level energy. However, the context dened throughout the image lacks spatial adaptation, while nonlocal searches for similarities in a large window with better spatial adaptability. However, on smooth regions, nonlocal also lacks spatial adaption. Besides this, the nonlocal method is with high computational complexity and the sizes of two windows are also xed and chosen fully by experience. As can be seen from the above discussion, the neighborhood sizes of existing adaptive image denoising algorithms are selected by experience. Moreover, these neighborhoods can no longer be changed after being selected, which makes the edge-preserving image denoising a very dicult tradeo problem. That is, denoising needs a large neighborhood to eliminate noises while maintaining edges requires a small neighborhood to keep singularity. A xedsize neighborhood is impossible to satisfy these two requirements simultaneously. Nonlocal can overcome the shortcomings of the appeal by taking advantage of big and small windows. But its mechanism for the coexistence of two windows makes the computing complexity increase greatly. Besides this, it lacks of spatial adaptation to smooth regions. In this paper, we propose a method to adaptively determine the neighborhood of image pixels in denoising using the theory of NTS analysis.
Recently, with the development of the theory of time series analysis, NTS analysis becomes the focus in time series analysis 1831 . Two well-known NTSs include fractal time series and chaotic time series. However, the eld of image denoising, to date, almost do not use these NTSs. The reason for this phenomenon is that most of researchers believe that the image noise is random rather than chaos 29, 30 . In this paper, we are concerned about how to convert an NTS to a set of STS. The method rstly removes the false neighbors dynamically using context to obtain a SN. In a SN, since all of the pixels have similar local gray energy, the time series can be considered as stationary. Besides this, the SN is composed with close spatial locations, which guarantees its spatial adaptability. The motivation for SN is that the observation the noisy image of a NTS is the sampled data of an underlying high-dimensional manifold. Some projection points of these sampling points, which are not neighbors in the manifold, become neighbors in one-dimensional projection space. These neighbors are called FNs. To obtain SNs of an image pixel, rstly, we must remove these FNs out. The removing increases the embedding dimension gradually, which makes folding, wrapping, and twisting orbit open. Using this method, FNs can be found and removed 18, 24 . The original neighborhood without FNs becomes a SN. Thus, the real state of a NTS can be estimated from the noisy observation on SNs using the theory of STS. Note that the dierent image pixels have dierent SNs and sometimes SNs are irregular, for example, near the edges. In addition, the proposed method also maintains a nonlinearity for NTS, which is coincident with the same nature for manifolds. That is, local structures are simple while its global structure is very complex 3234 . The neighborhoods determined by proposed method are fully automatic and reliable in estimate, and they are also able to maintain the image edges with the variable sizes and irregular shapes. It nds a perfect solution to the existing challenges in adaptive image denoising. Section 2 in this article will discuss the NTS and SN, and Section 3 describes the denoising algorithm presented in this paper. Section 4 presents the experimental results and discussion. Section 5 gives conclusions, and nally the acknowledgment part is given.
2.1. Denitions
From the geometric point of view, an NTS is a projection from a high-dimensional phase space to a one, dimensional space. In this projection, some points, which are not adjacent in the phase space, become neighbors in one-dimensional projection space and are called FNs. To remove FNs, the most direct idea is to increase the embedding dimension for the phase space. As the embedding dimension is increasing, the folding, wrapping, and twisting orbit will gradually be open. Therefore, FNs can easily be removed from the original neighborhood. And then a SN, which is a neighborhood without FNs, is obtained. On this SN, the true state can be restored according to the theory of STS. In order to explain our approach better, the denitions of related terms are given as follows.
Denition 2.1. A vector of phase space for a time series is an m-dimension vector in the phase space, which is composed by a dierent time delay {0, , . . . , m 1 } of the time series {z t }: {z t , z t ,z t 2 , . . . , z t m 1 }, 2.1
where m is called embedding dimension for the phase space. The method deleting FNs is from the smallest embedding dimension, such as by m 1, and is gradually increasing embedding dimension m. As m is increasing, the wrapping and folding orbit of the nonlinear movement will be gradually opened up. When m increases to a denite value, which the number of FNs no further increases, the correct embedding dimension is found. Denition 2.2. A manifold is a topological space that is locally Euclidean i.e., around every point, there is a neighborhood that is topologically the same as the open unit ball in Rn . Manifold resembles the Euclidean space near each point, and its global structure may be very complicated. The nature of manifold, which is local simple and complex global, coincides with our method. That is, the global complex nonlinear can be parted into local STS. Denition 2.3. The Neighborhood of a pixel x is a collection N of pixels. The elements of this collection satisfy N {| x < d, / x}, where is the distance and d is a predened constant. The elements in N are called neighbors of x. Denition 2.4. Two points x and on the phase space of NTS are not neighbors but they are neighbors on the one-dimensional orbit, and is called a false neighbor FN for x. Note that, in our method, the size of the SN is determined by the number of FNs. Denition 2.5. A time series {z t } is stationary if, for all m, the joint probability distribution of z t , z t 1 , . . . , z t m1 is independent on the time index t. More specially, the expectation, variance, correlation coecients of a time series only are functions of time interval and are independent on the origin of the time; henc, the time series is then called weakly stationary. Denition 2.6. One neighborhood determined by the method presented in this paper is called a stationary neighborhood. Theorem 2.7. Pixels in a SN form an STS.
Mathematical Problems in Engineering Remark 2.9 Context and Embedding Dimension . Firstly, the denition of context is given. Denition 2.10. The context for an image pixel xij is dened as a length P vector Vij Vi,j,1 , Vi,j,2 , . . . , Vi,j,P formed as a multidimensional function of observations.
The context commonly used in image processing can be dened as the m-dimensional vector in phase space of NTS. Since the context in image coding is studied deeply, it can be used directly to construct the SNs. For example, if we follow a specic denition of context, the embedding dimension m can be determined immediately. From the above discussion, we know the following. Theorem 2.11. An m-dimensional vector in phase space is a special form of context. Remark 2.12 Size of Neighborhood . It should be explained that the neighborhood size and embedding dimension are two dierent concepts. Generally, neighborhood is a more global concept than the embedding dimension. It should satisfy two basic criteria simultaneously in choosing neighborhood size. That is, it must ne big enough to satisfy the reliability of estimates and be small enough to satisfy spatial adaptation of the singularity detection. As discussed in the previous section, a xedsize neighborhood cannot satisfy the above two requirements simultaneously. The method proposed in this paper meets these two requirements simultaneously by building dierent neighborhoods for dierent image points. In order to ensure the reliability of estimates, the least number of pixels should be given rstly. Here, we select 48. In other words, a neighborhood after deleting the FNs still has 48 pixels in it; it is a right SN. The reason why we should give the least number of neighbors is neighborhood on a smooth region is dierent for that near the singular points. In a smooth region, a 7 7 neighborhood is enough, while near a singular point there are few neighbors in 7 7 neighborhood, which cannot meet the reliable requirement. Thus, near singular points, it must increase the size of neighborhood in order to increase the number of neighbors. This is the reason why nonlocal method has two dierent windows.
Step 2 nding FNs in a neighborhood of a pixel . The FN is a pixel i , j in the neighborhood d dn dn and satises Vij Vi j > dV . Find all FNs in the neighborhood. Then record the index and the number fn of FNs. Step 3. If d fn 48, then dn dn 2, and repeat Steps 2-3; otherwise, deleting the FNs of the neighborhood, the SN is the remainder of the neighborhood.
where y, x, and n are realizations of random elds Y , X, and N, respectively. The X can be estimated under Minimum Mean Squared Error MMSE ; that is, x arg min x x 2 ,
X
3.2
where x represents the estimate value of X. An uppercase letter represents a random eld or a random variable while the lowercase letter represents one realization of the random eld or variable. Thus, the estimate of one pixel xij of X is conditioned on the observation y optimized 2 by MMSE. If N is a 0 mean and N variance Gaussian white noise GWN , the optimal estimate of xij is xij
2 X 2 X 2 N
EYij ,
3.3
2 where X is variance of the original image X and EYij is the mean of Yij . 2 Here, two parameters should be estimated in denoising: X and EYij . However, we only have one observation for Y. Thus we have to share data in a neighborhood, which assumes that the whole data in this neighborhood are independent identical distribution iid .
Step 3. Estimate xij using 3.3 . Step 4. For all image pixels, repeat Steps 13.
Figure 1: Noisy Lena a and denoised Lena using Wieners lter with 7 7 mask b .
y c , x s y , yx d,
4.1
where and x are two pixels. y and yx are gray levels of and x, respectively. k1 x is a normalized constant for two weighs and is dened as
k x
c , x s y , yx d,
4.2
where c , x and s y , yx are measures of the spatial and range closeness between the center pixel x and its neighbor , respectively. Usually, these two measures can be dened as two Gaussian Kernel functions: c , x s y , yx e 1/2 e 1/2
x /d
2
y yx /r 2 .
4.3
Figure 3: A noisy image a and denoised images using context when dV see Section 2.3 is 5 b , 10 c , and 20 d .
Bilateral lter integrates domain lter and range lter together. It also denes a space neighborhood using the variance of domain lter d . The range lter is used for selecting the points with similar gray levels to x. However, in denoising, the real gray level is hidden in the noisy data. Therefore, the range lter cannot work well. Besides this, two neighborhood sizes of bilateral lter also are xed after dening the two variances d and r . The program
Figure 4: A noisy image a and denoised images using nonlocal when dV see Section 2.3 is 10 b , 20 c , and 30 d .
of bilateral lter is designed on Matlab. Figure 2 gives one image and the image after bilateral ltering. Context. For an image, pixel Xi,j is dened as a length P vector Vi,j Vi,j,1 , Vi,j,2 , . . . , Vi,j,P formed as a function of observations. In order to ensure that the comparison is on the same benchmark, the context in our method, nonlocal, and context is dened as
k i 1 k i1 t j 1 t j1
vi,j
yk,t
4.4
where yk,t is the gray level of pixel k, t . Using the context dened by 4.4 , the image pixels can be classied to several groups according to their local energy. In this paper, we use a parameter dV see Section 2.3 to control the dierence for each of group. Figure 3 gives denoising results for dierent dV s for context. Although context has better denoising results than these Wieners lter and bilateral lter, it also lacks spatial adaptivity. We also design context denoising on Matlab.
10
Figure 5: A noisy image a and denoised images using SN dV see Section 2.3 is 10 b , 20 c , and 30 d .
Note that, designing more complex context or using tools like wavelet, FFT and so forth will undoubtedly obtain better denoising results. However, it is beyond the scope of paper. Nonlocal is a famous good denoising algorithm. The most important mechanism for nonlocal is using two windows simultaneously. At least, it improves the estimate near singular points. However, on smooth region, since it lacks spatial adaptation, it leads over smooth on these regions. The Nonlocal program is designed on Matlab, in which the size of small window is 3 3 context while the size of large window is 21 21. The points on the large window with similar context are used for estimating the real gray level of the center point. In Figure 4 denoised images using dierent dV s see Section 2.3 are shown. It is obvious that Figure 4 d is oversmooth on smooth regions but still has good performance in edge preserving. Stationary Neighborhood is nding a stationary neighborhood for each image pixel. The neighborhood has at least 48 pixels after deleting FNs. Since On smooth regions and near singular points, if two requirements of designing a neighborhood are satised, it has good performance on both type regions. That is, in theory analysis, the method proposed in this paper has the same performance near singular points while having better performance on smooth regions than the nonlocal. Figure 5 gives us denoised results of SN.
11
Figure 6: A noisy image a and denoised images using Wieners lter b , context c , bilateral lter d , nonlocal e , and SN f .
In order to compare the performance of above ve lters, we test some images in Matlab and some images in the image databases on the internet. These images include lena.jpg 256 256 and coins.png in Matlab . For coins, nonlocal and SN overmatch other three methods both on denoising and edge preserving; see Figure 6. Nonlocal also has very similar Visual Eects to SN! It shocks me much since I think that SN should have obviously better performance than nonlocal. After analysis, I think the reason is that the image coins is too simple to nd the dierence between nonlocal and SN. The most important dierence between these two methods should be the dierent neighborhoods on the smooth regions. Thus, Lena, a famous denoising test image with big smooth regions, becomes a test image for comparing nonlocal
12
and SN. In theory, SN has the same performance of nonlocal near singular points while having better performance on smooth regions. From Figure 7, we can see that SN has better performance than nonlocal on smooth regions. That is, SN preserves much more gray levels and details in smooth regions, especially for upper borderline of hat where SN preserves the borderline but nonlocal loses it! In addition, SN also provides us more good visual eects. Besides these, SN also has relatively low computation complexity. The computation of nonlocal is 9 441 N 2 17 . Since most of image pixels about 90% are smooth pixels 13 , SN reduces the computation complexity greatly. That is, the smooth points only need a 7 7 neighborhood for denoising. Thus the computation complexity is about 9 49 N 2 0.9 9 441 N 2 0.1, where 441 is an estimate mean for singular regions according to nonlocal. Its computation complexity is about 2% of nonlocal.
5. Conclusions
In this paper, we propose a new method to determine a neighborhood, named SN, for each image pixel in adaptive image denoising. The motivation for nding SN is based on the idea that an NTS can be convert to STS in some overlapped neighborhoods. An SN is a
13
neighborhood whose false neighbors are deleted and has at least 48 neighbors. SN satises two requirements for designing neighborhood on both smooth regions and singularity regions. It also has good performance on two type regions with about 2% computation complexity of nonlocal.
Acknowledgments
This paper is supported by the National Natural Science Foundation of China nos. 60873102, 60573125, 60973157, and 60873264 , National Key Basic Research Program Project of China no. 2010CB732501 , and Open Foundation of Key Laboratory of Land Resources Evaluation and Monitoring of Southwest, Ministry of Education, no. KLEM2009001 .
References
1 N. Weiner, Extrapolation, Interpolation, and Smoothing of Stationary Time Series, John Wiley & Sons, New York, NY, USA, 1949. 2 L. Sendur and I. W. Selesnick, Bivariate shrinkage with local variance estimation, IEEE Signal Processing Letters, vol. 9, no. 12, pp. 438441, 2002. 3 M. Mignotte, Image denoising by averaging of piecewise constant simulations of image partitions, IEEE Transactions on Image Processing, vol. 16, no. 2, pp. 523533, 2007. 4 Z. Dengwen and C. Wengang, Image denoising with an optimal threshold and neighbouring window, Pattern Recognition Letters, vol. 29, no. 11, pp. 16941697, 2008. 5 D. Coupier, A. Desolneux, and B. Ycart, Image denoising by statistical area thresholding, Journal of Mathematical Imaging and Vision, vol. 22, no. 2, pp. 183197, 2005. 6 C. Tomasi and R. Manduchi, Bilateral ltering for gray and color images, in Proceedings of the IEEE International Conference on Computer Vision, pp. 839846, Bombay, India, 1998. 7 M. Zhang and B. K. Gunturk, Multiresolution bilateral ltering for image denoising, IEEE Transactions on Image Processing, vol. 17, no. 12, pp. 23242333, 2008. 8 H. Yu, L. Zhao, and H. Wang, Image denoising using trivariate shrinkage lter in the wavelet domain and joint bilateral lter in the spatial domain, IEEE Transactions on Image Processing, vol. 18, no. 10, pp. 23642369, 2009. 9 Y.-L. Liu, J. Wang, X. Chen, Y.-W. Guo, and Q.-S. Peng, A robust and fast non-local means algorithm for image denoising, Journal of Computer Science and Technology, vol. 23, no. 2, pp. 270279, 2008. 10 Z. Ji, Q. Chen, Q.-S. Sun, and D.-S. Xia, A moment-based nonlocal-means algorithm for image denoising, Information Processing Letters, vol. 109, no. 23-24, pp. 12381244, 2009. 11 V. Katkovnik, A. Foi, K. Egiazarian, and J. Astola, From local kernel to nonlocal multiple-model image denoising, International Journal of Computer Vision, vol. 86, no. 1, pp. 132, 2010. 12 X. Wu and N. Memon, Context-based, adaptive, lossless image code, IEEE Transactions on Communications, vol. 45, no. 4, pp. 437444, 1997. 13 M. S. Crouse and R. G. Baraniuk, Contextual hidden Markov models for wavelet-domain signal processing, in Proceedings of the 31st Asilomar Conference on Signals, Systems and Computers, Pacic Grove, Calif, USA, November 1997. 14 G. Fan and X.-G. Xia, Image denoising using a local contextual hidden Markov model in the wavelet domain, IEEE Signal Processing Letters, vol. 8, no. 5, pp. 125128, 2001. 15 S. G. Chang, B. Yu, and M. Vetterli, Spatially adaptive wavelet thresholding with context modeling for image denoising, IEEE Transactions on Image Processing, vol. 9, no. 9, pp. 15221531, 2000. 16 Z. Liao and Y. Y. Tang, Signal denoising using wavelets and block hidden Markov model, International Journal of Pattern Recognition and Articial Intelligence, vol. 19, no. 5, pp. 681700, 2005. 17 A. Buades, B. Coll, and J.-M. Morel, Nonlocal image and movie denoising, International Journal of Computer Vision, vol. 76, no. 2, pp. 123139, 2008, special section: selection of papers for CVPR 2005, Guest Editors: C. Schmid, S. Soatto and C. Tomasi.
14
18 H. Kantz and T. Schreiber, Nonlinear Time Series Analysis, Cambridge University Press, Cambridge, UK, 2nd edition, 2004. 19 M. Li, W.-S. Chen, and L. Han, Correlation matching method for the weak stationarity test of LRD trac, Telecommunication Systems, vol. 43, no. 3-4, pp. 181195, 2010. 20 M. Li and J.-Y. Li, On the predictability of long-range dependent series, Mathematical Problems in Engineering, vol. 2010, Article ID 397454, 9 pages, 2010. 21 M. Li and W. Zhao, Representation of a stochastic trac bound, IEEE Transactions on Parallel and Distributed Systems. In press. 22 C. Cattani and A. Kudreyko, Application of periodized harmonic wavelets towards solution of eigenvalue problems for integral equations, Mathematical Problems in Engineering, vol. 2010, Article ID 570136, 8 pages, 2010. 23 E. G. Bakhoum and C. Toma, Mathematical transform of traveling-wave equations and phase aspects of quantum interaction, Mathematical Problems in Engineering, vol. 2010, Article ID 695208, 15 pages, 2010. 24 C. Keng and H. Bo-Tang, A survey of state space reconstruction of chaotic time series analysis, Computer Science, vol. 32, no. 4, pp. 6770, 2005. 25 S. Lin, J. Qiao, G. Wang, S. Zhang, and L. Zhi, Phase space reconstruction of nonlinear time series based on Kernel method, in Proceedings of the 6th World Congress on Intelligent Control and Automation (WCICA 06), vol. 1, pp. 43644368, Dalian, China, 2006. 26 M. Casdagli, S. Eubank, J. D. Farmer, and J. Gibson, State space reconstruction in the presence of noise, Physica D, vol. 51, no. 13, pp. 5298, 1991. 27 L. Wang, H. Zhang, H. Meng, and X. Wang, Nonlinear analysis of individual vehicle behavior in car following, in Proceedings of the 11th International IEEE Conference on Intelligent Transportation Systems (ITSC 08), pp. 265268, Beijing, China, October 2008. 28 J. B. Dingwell and J. P. Cusumano, Nonlinear time series analysis of normal and pathological human walking, Chaos, vol. 10, no. 4, pp. 848863, 2000. 29 B. Dennis, R. A. Desharnais, J. M. Cushing, S. M. Henson, and R. F. Costantino, Can noise induce chaos? Oikos, vol. 102, no. 2, pp. 329339, 2003. 30 R. Poole, Is it chaos, or is it just noise, Science, vol. 243, no. 4887, pp. 2528, 1989. 31 M. Li, Fractal time seriesa tutorial review, Mathematical Problems in Engineering, vol. 2010, Article ID 157264, 26 pages, 2010. 32 http://www.hudong.com/wiki/. 33 V. Guillemin and A. Pollack, Dierential Topology, Prentice-Hall, Englewood Clis, NJ, USA, 1974. 34 R. C. Kirby and L. C. Siebenmann, Foundational Essays on Topological Manifolds, Smoothings, and Triangulations, Princeton University Press, Princeton, NJ, USA, 1977. 35 Z. Liao, Image Denoising Based on Wavelet Domian Hidden Markov Models, UESTC Press, Chengdu, China, 2006.