Next Article in Journal
Human Activity Recognition via Score Level Fusion of Wi-Fi CSI Signals
Next Article in Special Issue
A Single-Shot Scattering Medium Imaging Method via Bispectrum Truncation
Previous Article in Journal
The Role of Ultrasound in Cancer and Cancer-Related Pain—A Bibliometric Analysis and Future Perspectives
Previous Article in Special Issue
Defects Prediction Method for Radiographic Images Based on Random PSO Using Regional Fluctuation Sensitivity
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Accurate Detection for Zirconium Sheet Surface Scratches Based on Visible Light Images

1
School of Mechanical Engineering, Sichuan University, Chengdu 610065, China
2
Nuclear Fuel and Material Institute, Nuclear Power Institute of China, Chengdu 610213, China
3
College of Electrical Engineering, Sichuan University, Chengdu 610065, China
*
Author to whom correspondence should be addressed.
Submission received: 12 July 2023 / Revised: 6 August 2023 / Accepted: 17 August 2023 / Published: 21 August 2023
(This article belongs to the Collection Computational Imaging and Sensing)

Abstract

:
Zirconium sheet has been widely used in various fields, e.g., chemistry and aerospace. The surface scratches on the zirconium sheets caused by complex processing environment have a negative impact on the performance, e.g., working life and fatigue fracture resistance. Therefore, it is necessary to detect the defect of zirconium sheets. However, it is difficult to detect such scratch images due to lots of scattered additive noise and complex interlaced structural texture. Hence, we propose a framework for adaptively detecting scratches on the surface images of zirconium sheets, including noise removing and texture suppressing. First, the noise removal algorithm, i.e., an optimized threshold function based on dual-tree complex wavelet transform, uses selected parameters to remove scattered and numerous noise. Second, the texture suppression algorithm, i.e., an optimized relative total variation enhancement model, employs selected parameters to suppress interlaced texture. Finally, by connecting disconnection based on two types of connection algorithms and replacing the Gaussian filter in the standard Canny edge detection algorithm with our proposed framework, we can more robustly detect the scratches. The experimental results show that the proposed framework is of higher accuracy.

1. Introduction

Zirconium and its compounds have unique physicochemical properties, e.g., amazing corrosion resistance, extremely high melting point, and ultrahigh hardness and strength, accounting for their applications in engineering and science [1,2]. As a relatively rare metal material, zirconium sheet plays a significant role in machinery manufacturing, aerospace, nuclear reactor, chemical industry, ceramic industry, and other fields [3,4,5,6,7,8]. However, in various production and processing processes, scratches will appear on the surface of zirconium sheets due to various factors. The surface quality of zirconium sheets will directly affect the performance and quality of final products; therefore, it is necessary to detect the location and shape of scratches. At present, the scratches on the surface of zirconium sheets are usually detected manually. However, manual detection has many shortcomings, such as high false detection rate and low efficiency. Therefore, we urgently need a method for scratch detection of zirconium sheets.
At the same time, with the development of modern industry and science and technology, nondestructive testing (NDT) is widely used in various fields, e.g., aerospace, machinery industry, shipbuilding, automobile, etc. [9,10,11,12,13]. NDT technology includes ultrasonic, machine vision, radiographic, eddy current, and other methods. Among them, compared with other methods, machine vision based on image processing technology has great advantages, e.g., automation, high precision, easy operation, etc. Therefore, we choose machine vision to detect scratches on the surface of zirconium sheets [14].
However, due to the interference of the surface features, which are noise and texture of zirconium sheets, it is difficult to use machine vision methods to detect scratches. In other words, noise will mask the details of images, resulting in breakpoints in the extracted scratch contour. In addition, texture will mistakenly become branches of the contour, destroying the size and shape of the contour [15,16,17]. Therefore, removing noise and suppressing texture before scratch detection are key to obtain the region of scratches. Traditional algorithms typically detect targets based on image features, e.g., gradient, color, and texture. Due to that the detection objects are in the complex texture background, the difference between the results obtained from color-based image segmentation and real value is significant [18,19,20]. Researchers from different countries have proposed the following noncolor methods to solve such problems [21,22,23].
Renuka et al. [24] presented an objective calculation method of denoising threshold based on dual-tree complex wavelet transform (DTCWT), which has good edge preservation and denoising ability. Liu et al. [25] presented a nonreference image denoising method based on enhanced DTCWT and bilateral filter. Compared with other algorithms, the results show that the denoising effect of this method is better than other methods. Li et al. [26] proposed a you only look once (YOLO)-attention based on YOLOv4 for complex defect types and noisy detection environments in wire and arc additive manufacturing (WAAM), achieving fast and accurate defect detection for WAAM. This method achieved an average accuracy of 94.5% in dynamic images. Kelishadrokhi et al. [27] proposed a new method based on the combination of color and texture features to solve the problem of finding more similar images from a large database. They proposed an extended version of local neighborhood difference pattern (ELNDP) to achieve discriminative features and optimized the color histogram features in the HSV color space to extract color features. This method has better retrieval performance compared to other methods. Xu et al. [28] proposed a new texture structure extraction system. Experimental results show that the algorithm is effective and does not need a priori condition. Zhou et al. [29] proposed a method to extract machine tool defects from high-speed milling workpiece surface images, which reduces the influence of workpiece surface background texture. The application example shows that this method can effectively extract machine tool defects. Su et al. [30] proposed a new edge-preserving texture suppression filter, which uses the joint bilateral filter as a bridge to achieve the dual purposes of texture smoothing and edge-preserving. Isar et al. [31] proposed a two-stage denoising system structure to separate threshold calculation and noise removal so as to improve the denoising performance. Tian et al. [32] designed a lighting method combining plane illumination mode with multiangle illumination mode to automatically detect five kinds of defects by different detection methods.
However, most of the above contour extraction methods have the disadvantages of nonadaptive denoising, a large number of datasets, and texture suppression without edge preservation. Therefore, it is necessary to propose a method that takes into account the weaknesses of the above methods. In order to remove noise and suppress texture simultaneously, while preserving as much detail as possible before scratch detection, we propose an adaptive scratch extraction algorithm framework for detecting scratches with a two-stage system, suppressing interference features. This method is able to detect scratches on the surface of zirconium sheets from the interference of background features effectively. The key of this method is to obtain wavelet decomposition level, threshold, and texture size.
The rest of this article is organized as follows. In Section 2, we first introduce the theoretical part. Then, the experiment and its results are introduced in Section 3. The conclusion and further work are shown in Section 4.

2. Methodology

Due to the interference of background features, we propose an adaptive scratch extraction framework for the surface of zirconium sheets to detect scratches. At first, this algorithm uses DTCWT function to decompose images with selected wavelet decomposition level, and then designs the optimized adaptive local threshold to improve the ability of removing noise. Secondly, it selects the texture size and then designs a relative total variation enhancement (RTVE) algorithm to suppress texture. Finally, it detects the scratches and quantitatively analyzes these defects from three aspects, e.g., area, length and position deviation. Therefore, this section provides theories related to noise removal and texture suppression, e.g., the objective function for calculating adaptive threshold, RTVE model, parameter selection formula, the evaluation function, etc. The flow chart of the algorithm is shown in Figure 1 and Algorithm 1. In Algorithm 1, D n represents the decomposition level and T p s represents the texture size. The first step is to input the original image and view the 3D grayscale image; the second step is to observe the 3D grayscale images of wavelet coefficients at all levels, select appropriate decomposition level, and remove noise; the third step is to test texture size and then suppress texture; the final step is to extract the region of interest (ROI) and compare it with the results to obtain accuracy.
Algorithm 1 Scratch extraction algorithm framework.
Input: f: scratch; region of interest (ROI): real value; D n and T p s : patameters;
Output:  f c : image after noise removal and texture suppression; comparison result
V , D , H , H + , D + , V + = DTCWT f
if  D n [ 1 , 4 ]   then
   W ^ S S T = SST V , D , H , H + , D + , V +
   N f = f IDTCWT W ^ S S T
   W ^ c B = BTS ( f )
   f d = IDTCWT W ^ c B
end if
if  T p s [ 1 , 6 ]   then
   f c = RTVE f d
end if
 Comparison of results and ROI
return  f c and comparison result

2.1. Adaptive Noise Removal in Wavelet Domain

Property 1. 
The two types of double hook functions are described as
y = a x + b x a b > 0 ,
where a and b are constants; a , b 0 . Normally, a = b = 1 .
y = a x + b x a b < 0 ,
where, normally, a = 1 , b = 1 . The double hook function has two asymptotes, one vertical asymptote and one oblique asymptote. Equation (1) has an oblique asymptote and has no intersection with the x axis. Equation (2) is different from Equation (1) because it intersects with the x axis. Equations (1) and (2) are shown in Figure 2.
Property 2. 
The hard threshold function and soft threshold function are described as [33,34]
W ^ H T = 0 , | W | λ W , | W | > λ ,
W ^ S T = s g n | W | λ + ,
where λ is threshold, W is wavelet coefficients, and HT and ST are hard threshold function and soft threshold function, respectively. Equations (3) and (4) are shown in Figure 2c.
We propose an improved threshold model according to Equation (2) of Property 1, which takes into account the advantages of both soft and hard threshold functions. The semisoft threshold formula is described as
W ^ S S T = 0 , | W | λ A s g n ( W ) | W | λ A 2 / | W | , | W | > λ A ,
where λ A is threshold, s g n represent step function, and W ^ S S T is the result of filtering. Furthermore, λ A is described as
λ A = 2 σ ^ n 2 σ ^ ,
where σ ^ n 2 is estimated variance for the noise component, and σ ^ is estimated variance for the noiseless component.
In the first stage of removing noise, the soft threshold function or hard threshold function is usually used to extract noise components of each sub-band. However, from Figure 2c, the wavelet coefficients processed by the hard threshold function generate jump points at ± λ A , do not have the smoothness of the original information, and oscillation occurs after reconstruction. Therefore, this disadvantage can lead to sudden changes in the pixels on the scratch image, i.e., there is a significant difference in the grayscale values of some adjacent pixels. The wavelet coefficients processed by the soft threshold function have a fixed deviation compared to the hard threshold function, i.e., it directly affects the similarity between the reconstructed coefficients and the real coefficients. Therefore, this disadvantage can cause the overall shift of pixel grayscale values on the scratch images, resulting in a blurry effect.
From Figure 2c, we can intuitively see the shapes and features of the hard threshold function and the soft threshold function. Among them, the red line represents the soft threshold function, the green line represents the hard threshold function, and the blue curve represents the semisoft threshold function. Based on the characteristics of Figure 2c, the common feature of both functions can be obtained, which is that they are parallel to the line W ^ S S T = W . Therefore, considering the drawbacks of both functions, we need an asymptotic semisoft threshold function to compensate for the discontinuity of the hard threshold function and the deviation of the soft threshold function, i.e., it can eliminate sudden changes in pixel grayscale values and weaken blurring effects. Since the line W ^ S S T = W belongs to the oblique asymptote, and Equation (2) has this feature, we construct the formula shown in Equation (5).
In order to verify that Equation (5) converges to a straight line W ^ S S T = W , we assume two scenarios. When W > λ A , i.e., W is also greater than 0, according to Equation (5), the transformed formula can be described as
W ^ S S T W = 1 λ A 2 W 2 ,
by applying the limit to Equation (7), the result can be obtained as
lim W + W ^ S S T W = 1 .
When W < λ A , i.e., W is also less than 0, according to Equation (5), the transformed formula can be described as
W ^ S S T W = 1 λ A 2 W 2 ,
by applying the limit to Equation (9), the result can be obtained as
lim W W ^ S S T W = 1 .
Therefore, based on the above results, we have the following conclusion:
lim W W ^ S S T W = 0 .
We can see that Equation (5) has only one oblique asymptote W ^ S S T = W . As | W | continues to increase, the value of λ A 2 / | W | gradually decreases and eventually approaches W, resulting in a gradual decrease in the deviation between the estimated wavelet coefficients and the actual wavelet coefficients, overcoming the shortcomings of the two threshold functions.
It is worth noting that, in the first stage, we use the square directional window to calculate the variance as we need to extract as much noise as possible from images; the square window can meet the requirements. In the second stage, we use elliptical directional windows to calculate the variance to preserve as much detail as possible while denoising. However, elliptical windows have poor directionality and are bulky in volume.
Therefore, in the second stage of removing noise, we use a parameters-adjusted elliptical direction window with smaller size and more monotonic direction for calculating local threshold based on the elliptical window prototype [35]. The formula is defined as
W ( θ ) = m , n m sin θ + n cos θ 2 / 3 2 + m cos θ n sin θ 2 / 1 . 5 2 1 ,
where θ π , π is the principal axis direction; when it is ± 15 , ± 45 or ± 75 , it corresponds to the elliptical window of six high-frequency sub-bands, and m and n are coordinates of pixels. Finally, the image of removing noise is obtained by inverse transformation.

2.2. Texture Suppression and Edge Preservation

We propose one RTVE model, which can maintain the defect contour while suppressing texture. Using RTVE to suppress texture of the image f d , the result f c is defined as
f c = min S 1 2 f d S 2 a + λ t p F R T V E ( p ) ,
where f d S 2 a enhances the contrast of the image f d and is defined as
f d S 2 a = P 1 % l o w e s t = minPixel P 1 % h i g h e s t = maxPixel ,
where P 1 % l o w e s t denotes the minimum 1% pixels set as the minimum pixel value and P 1 % h i g h e s t denotes the maximum 1% pixels set as the maximum pixel value. Furthermore, F R T V E ( p ) is described as
F R T V E ( p ) = D x E ( p ) / L x E ( p ) + ε + D y E ( p ) / L y E ( p ) + ε ,
where ε is a small positive number, avoiding zero denominator, D x E ( p ) and D y E ( p ) denote the total variations of the window for pixel p in the x and y directions, respectively, and L x E ( p ) and L y E ( p ) are the inherent variations of the window for pixel p in x and y directions, respectively.
All parameters of Equation (15) are described, and D x E ( p ) is described as
D x E ( p ) = 1 / W p q R ( p ) g p , q E · x S q ,
and D y E ( p ) is described as
D y E ( p ) = 1 / W p q R ( p ) g p , q E · y S q ,
L x E ( p ) is described as
L x E ( p ) = 1 / W p q R ( p ) g p , q E · x S q ,
and L y E ( p ) is described as
L y E ( p ) = 1 / W p q R ( p ) g p , q E · y S q ,
W p is described as
W p = q R g p , q E ,
g p , q E is described as
g p , q E e x p x p x q 2 + y p y q 2 / 2 σ 2 · e x p I i , j I m , n 2 / 2 σ r 2 ,
where i and j are the abscissa and ordinate of the central pixel, m and n are the abscissa and ordinate of the input pixel, I i , j is the value of the central pixel, and I m , n is the value of the input pixel. In addition, g p , q E denotes the product of two weights.
Usually, we use relative total variation ( RTV ) to suppress texture [28]. Furthermore, the objective function of RTV is defined as [28]
f c = min S 1 2 f d S 2 + λ t p F R T V ( p ) ,
where λ t is the weight of the regular item, and F R T V ( p ) is defined as
F R T V ( p ) = D x ( p ) / L x ( p ) + ε + D y ( p ) / L y ( p ) + ε .
When the RTV method is applied to the surface of metal materials with structural texture, it is difficult for RTV to completely suppress the texture background while ensuring that the small size defects are not lost, because RTV only considers the weight of spatial distance. Equation (15) reflects on the calculation of two weights to compensate for the shortcomings of RTV . Not only is the influence of spatial distance weight considered, but the gray difference between the central pixel and other pixels in the neighborhood is also taken as the basis for calculating another weight.
After the end of preprocessing, it is necessary to ensure the integrity of scratches based on the convex hull and close operation to connect the broken part. The principle of convex hull is shown in Figure 3a. The expansion and corrosion of close operation are shown in Figure 3b–e.
Compared with the manually extracted ROI, the scratch extraction of the real image is evaluated by area, length, and position deviation. The comprehensive accuracy is the arithmetic mean of the first two accuracy. Furthermore, it is described as
Total = 1 2 area + length .
The position deviation is expressed by the Euclidean distance between the centroids,
d e = x 1 x 2 2 + y 1 y 2 2 ,
where x 1 and y 1 represent the centroid of the real value, x 2 and y 2 represent the centroid of the actual value, and d e represents the distance difference between the two. As long as the distance difference is less than 100 pixels, we consider this distance to be qualified.

3. Experiments

As shown in Figure 4, the scratch images used in this paper are collected by the machine vision system, which is composed of a three-dimensional motion device and a pixel resolution of 4024 × 3036 industrial camera, a white light source, a computer, and a test piece. Three-dimensional space movement of the camera and light source is realized through control software to ensure the collection of scratch images.
The surface images of zirconium sheets are shown in Figure 4b. Among them, aluminum plate is used to replace zirconium sheet. There are four kinds of scratch images in this paper, including single scratch, multiple scratches, cross scratch, and other scratches, as shown in Figure 5. It is noteworthy that the size of these images is processed later due to the need of wavelet transform. Before collecting images, we use alcohol to wipe the surface of the sample due to interference from other things. In addition, before the experiment, we test the light intensity. Lighting has a significant impact on the imaging quality. Different lighting methods have different effects on the detection object; for example, diffuse light sources can cause the detection surface to emit light, requiring special light sources to solve the problem of reflection. Therefore, choosing the appropriate light source and appropriate lighting intensity is crucial for nondestructive testing technology based on machine vision. By analyzing the surface properties of the sample and investigating the types and application scenarios of light sources, we design a machine vision inspection system with a high-precision camera and a coaxial light source as the core due to the high reflectivity and complex texture on the surface of the detected object. Firstly, we use coaxial light sources to reduce the impact of reflected light due to the inability of ordinary light sources to suppress surface reflection. Secondly, we choose the appropriate lighting intensity through experiments to ensure the integrity of the scratch area while minimizing the texture as much as possible. We use the algorithm proposed in this article to test scratch images obtained from different lighting intensities and compare them with other algorithms. It is a good choice to increase the light intensity as much as possible while ensuring the integrity of scratches according to the data. Therefore, choosing a value within the appropriate range of light intensity is the correct choice.
Before the scratch detection, it is necessary for inputs to remove noise and suppress texture. The first half of Section 3 introduces the content of noise removal and texture suppression, respectively. From Figure 6, observing the change trend of wavelet coefficients at 45° from first level to fourth level and their 3D grayscale due to significant characteristics of diagonal coefficients, we can summarize the following conclusions. At first, from Figure 6a–d, the wavelet coefficients of the first and second levels cannot reflect detailed information. Second, from Figure 6g–h, the wavelet coefficients of the fourth level will be distorted due to the loss of pixels. Finally, from Figure 6e,f, the wavelet coefficients of the third level can retain rich scratch information while also reflecting necessary background interference. In the process of decomposing the levels from 1 to n, the details of scratches move from blurry to clear, and then to blurry. In addition, when the decomposition level is 3, the scratch details are most obvious. Therefore, we choose the third decomposition level, i.e., D n is 3.
As shown in Figure 7, the image pixels after hard thresholding appear abrupt, and the pixels after soft thresholding are blurry and smooth, while the pixels after semisoft thresholding are between the two thresholds, which not only weakens the sudden changes in pixel values but also maintains smoothness.
On the basis of removing noise, we need to suppress structural texture. Firstly, the parameter selection method is used to calculate the texture size. The texture size is determined by the height shown in Figure 8. By analyzing Figure 8, we estimate the texture size and select the parameter in 0–6. When the autocorrelation coefficient is greater than 0.01, the texture size is roughly between 3 and 6. Furthermore, when the autocorrelation coefficient is less than 0.01, the texture size is roughly between 0 and 3. Therefore, we can obtain T p s based on texture size.
The height difference between the yellow plane and the blue plane indicates the texture size; thus, it can be seen from Figure 8 that the autocorrelation coefficients are 0.0238, 0.0150, 0.0170, and 0.0187, respectively. Therefore, the texture size can be roughly determined to be over 3.
Then, the results obtained by using RTVE are compared with those obtained by RTV . Figure 9 shows the surface of the scratch images after suppressing texture. Figure 9a,c,e,g are processed by RTV . Furthermore, Figure 9b,d,f,h are processed by RTVE . By analyzing Figure 9, we can see that the integrity of the scratch edge is higher after being processed by the RTVE algorithm. On the contrary, the scratch area processed by RTV always loses some edges, indicating that the RTVE algorithm proposed in this paper has advantages that RTV does not have.
The proposed noise removal and texture suppression methods are used to process the real scratch images. Before detecting scratches, image preprocessing is required. In order to quantitatively evaluate the performance of the algorithm proposed in this paper, the error with the real value is calculated from three aspects of area, length, and position deviation, using the manually extracted region of interest as real value. The results are shown in Figure 10 and Table 1. The red boxes of Figure 11a–d are the area where the scratch is located.
From Table 1 and Figure 11, we know that there are four types of scratches, each with three types, totaling 17 scratches. The real value indicates ROI, and scratches are manually extracted from the scratch images. The actual value represents the results obtained by the framework proposed in this paper. By comparative analysis, we can see that the accuracy of this algorithm is greater than 85% and the algorithm has more advantages in terms of accuracy.
The framework proposed in this article is compared with current scratch detection algorithms, and the results are shown in Table 2. These algorithms are snake based on edge, fuzzy edge, log, K-means, fuzzy c-means, and method of combining superpixels with k-means (the original Canny is not included because using only Canny cannot remove texture) [36]. The results show that the algorithm proposed in this article has better performance, can obtain more complete scratches, and is superior to other gradient algorithms. Compared with log, the proposed algorithm is more accurate and stable. The edge-based snake algorithm requires masks, and the number of iterations is difficult to determine, resulting in a wide fluctuation range of results. Although the texture is suppressed, the fuzzy edge algorithm will still recognize the residual texture as an edge of scratches, resulting in incorrect results. Compared with image segmentation algorithms, the algorithm proposed in this article can accurately obtain complete scratch contours.

4. Conclusions

This study proposes a scratch detection framework for zirconium sheets with surface interference. As can be seen from the previous text, this framework includes two parts: noise removal and texture suppression. An adaptive threshold algorithm based on DTCWT is proposed for denoising. At the same time, an optimized texture suppression algorithm based on RTVE is proposed for suppressing texture. Finally, an optimized Canny algorithm is used to detect scratch contours, and the result is compared with the real value.
This surface scratch detection solution is able to remove noise and suppress texture, solving the problem of background interference. The experimental results show that the comprehensive accuracy is greater than 85%, and the framework can effectively improve the accuracy of scratch detection. This optimized scratch detection algorithm framework is equivalent to a semiadaptive local threshold method, which is not only suitable for metal parts but also for other materials with similar surface, such as tile scratches. In the future work, complete adaptive scratch detection can be realized through threshold calculation, morphological processing and image enhancement, so that defects of different degrees and types can be detected.

Author Contributions

Conceptualization, B.X., Y.S., J.L. and B.Z.; methodology, Y.S. and B.Z.; software, Y.S.; validation, B.X., Y.S. and B.Z.; formal analysis, B.X., Y.S. and B.Z.; investigation, Y.S. and B.Z.; resources, B.X., Z.D. and H.L.; data curation, Y.S.; writing—original draft preparation, Y.S.; writing—review and editing, Y.S., B.Z. and K.L.; visualization, Y.S.; supervision, B.X. and B.Z.; project administration, B.X. and B.Z.; funding acquisition, B.X. All authors have read and agreed to the published version of the manuscript.

Funding

This work is supported by the Innovation Center of Nuclear Power Technology for National Defense Industry (HDLCXZX-2022-ZH-014).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data are not publicly available due to personal privacy.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Takuda, H.; Kikuchi, S.; Hatta, N. Formability of a commercially pure zirconium sheet. J. Mater. Process. Technol. 1998, 84, 117–121. [Google Scholar] [CrossRef]
  2. Izumi, K.; Murakami, M.; Deguchi, T.; Morita, A.; Tohge, N.; Minami, T. Zirconia Coating on Stainless Steel Sheets from Organozirconium Compounds. J. Am. Ceram. Soc. 1989, 72, 1465–1468. [Google Scholar] [CrossRef]
  3. Hu, C.; Sun, J.; Long, C.; Wu, L.; Zhou, C.; Zhang, X. Synthesis of nano zirconium oxide and its application in dentistry. Nanotechnol. Rev. 2019, 8, 396–404. [Google Scholar] [CrossRef]
  4. Pechishcheva, N.V.; Shunyaev, K.Y.; Melchakova, O.V. Zirconium in modern analytical chemistry. Rev. Anal. Chem. 2018, 37, 20170016–20170041. [Google Scholar] [CrossRef]
  5. Nistico, R. Zirconium oxide and the crystallinity hallows. J. Aust. Ceram. Soc. 2021, 57, 225–236. [Google Scholar] [CrossRef]
  6. Arshad, H.M.; Shahzad, A.; Shahid, S.; Ali, S.; Rauf, A.; Sharif, S.; Ullah, M.E.; Ullah, M.I.; Ali, M.; Ahmad, H.I. Synthesis and Biomedical Applications of Zirconium Nanoparticles: Advanced Leaps and Bounds in the Recent Past. BioMed Res. Int. 2022, 2022, 4910777. [Google Scholar] [CrossRef]
  7. Mehjabeen, A.; Song, T.; Xu, W.; Tang, H.; Qian, M. Zirconium Alloys for Orthopaedic and Dental Applications. Adv. Eng. Mater. 2018, 20, 1800207–1800265. [Google Scholar] [CrossRef]
  8. Condliff, A.F. Applications for Zirconium and Columbium Alloys. JOM 1986, 38, 15–19. [Google Scholar] [CrossRef]
  9. Kumar, A.; Arnold, W. High resolution in non-destructive testing: A review. J. Appl. Phys. 2022, 132, 100901–100915. [Google Scholar] [CrossRef]
  10. Qu, Z.; Jiang, P.; Zhang, W. Development and Application of Infrared Thermography Non-Destructive Testing Techniques. Sensors 2020, 20, 3851. [Google Scholar] [CrossRef]
  11. Lopez, A.; Bacelar, R.; Pires, I.; Santos, T.G.; Sousa, J.P.; Quintino, L. Non-destructive testing application of radiography and ultrasound for wire and arc additive manufacturing. Addit. Manuf. 2018, 21, 298–306. [Google Scholar] [CrossRef]
  12. Du, W.; Zhao, Y.; Roy, R.; Addepalli, S.; Tinsley, L. A review of miniaturised Non-Destructive Testing technologies for in-situ inspections. Procedia Manuf. 2018, 16, 16–23. [Google Scholar] [CrossRef]
  13. Michihata, M.; Zheng, Z.; Funaiwa, D.; Murakami, S.; Kadoya, S.; Takahashi, S. In-Process Diameter Measurement Technique for Micro-Optical Fiber with Standing Wave Illumination. Nanomanuf. Metrol. 2021, 4, 28–36. [Google Scholar] [CrossRef]
  14. Smith, M.L.; Smith, L.N.; Hansen, M.F. The quiet revolution in machine vision—A state-of-the-art survey paper, including historical review, perspectives, and future directions. Comput. Ind. 2021, 130, 103472–103481. [Google Scholar] [CrossRef]
  15. Gong, T.; Liu, Z.; Xie, C.; Yang, Z. Property Investigation on the Additive White Gaussian Noise After Sub-Nyquist Sampling. IEEE Access 2019, 7, 122820–122826. [Google Scholar] [CrossRef]
  16. Sivaranjani, R.; Roomi, S.; MansoorSenthilarasi, M.M. Speckle noise removal in SAR images using Multi-Objective PSO (MOPSO) algorithm. Appl. Soft. Comput. 2019, 76, 671–681. [Google Scholar] [CrossRef]
  17. Kouediatouka, A.N.; Ma, Q.; Liu, Q.; Mawignon, F.J.; Rafique, F.; Dong, G. Design Methodology and Application of Surface Texture: A Review. Coatings 2022, 12, 1015. [Google Scholar] [CrossRef]
  18. Rela, M.; Rao, S.N.; Reddy, P.R. Liver Tumor Segmentation using Superpixel based Fast Fuzzy C Means Clustering. Int. J. Adv. Comput. Sci. Appl. 2020, 11, 380–387. [Google Scholar] [CrossRef]
  19. Wu, T.; Gu, X.; Shao, J.; Zhou, R.; Li, Z. Colour image segmentation based on a convex K-means approach. IET Image. Process 2021, 15, 1596–1606. [Google Scholar] [CrossRef]
  20. Li, Z.; Zheng, Y.; Cao, L.; Jiao, L.; Zhong, Y.; Zhang, C. A Student’s t-based density peaks clustering with superpixel segmentation (tDPCSS) method for image color clustering. Color Res. Appl. 2020, 45, 656–670. [Google Scholar] [CrossRef]
  21. Dang, T.; Surya, P.; Le, M. A Review on CT and X-Ray Images Denoising Methods. Informatica 2019, 43, 151–159. [Google Scholar] [CrossRef]
  22. Alkinani, M.H.; El-Sakka, M.R. Patch-based models and algorithms for image denoising: A comparative review between patch-based images denoising methods for additive noise reduction. EURASIP J. Image Video Process. 2017, 2017, 58. [Google Scholar] [CrossRef] [PubMed]
  23. Meng, Y.; Zhang, J. A Novel Gray Image Denoising Method Using Convolutional Neural Network. IEEE. Access 2022, 10, 49657–49676. [Google Scholar] [CrossRef]
  24. Renuka, S.V.; Edla, D.R. Adaptive shrinkage on dual-tree complex wavelet transform for denoising real-time MR images. Biocybern. Biomed. Eng 2019, 39, 133–147. [Google Scholar] [CrossRef]
  25. Liu, Y.; Wang, Z.; Si, L.; Zhang, L.; Tan, C.; Xu, J. A Non-Reference Image Denoising Method for Infrared Thermal Image Based on Enhanced Dual-Tree Complex Wavelet Optimized by Fruit Fly Algorithm and Bilateral Filter. Appl. Sci. 2017, 7, 1190. [Google Scholar] [CrossRef]
  26. Li, W.; Zhang, H.; Wang, G.; Xiong, G.; Zhao, M.; Li, G.; Li, R. Deep learning based online metallic surface defect detection method for wire and arc additive manufacturing. Robot. Comput. Manuf. 2023, 80, 102470–102481. [Google Scholar] [CrossRef]
  27. Kelishadrokhi, M.K.; Ghattaei, M.; Fekri-Ershad, S. Innovative local texture descriptor in joint of human-based color features for content-based image retrieval. Signal Image Video Process. 2023, 1–9. [Google Scholar] [CrossRef]
  28. Xu, L.; Yan, Q.; Xia, Y.; Jia, J. Structure extraction from texture via relative total variation. ACM Trans. Graph. 2012, 31, 139–148. [Google Scholar] [CrossRef]
  29. Zhou, Y.; Li, Y.; Shi, X.; Kong, T.; Liu, S. Background texture suppression and defect extraction of high-speed milling surface image. Int. J. Mech. Manuf. Syst. 2018, 11, 314–324. [Google Scholar] [CrossRef]
  30. Su, Z.; Luo, X.; Deng, Z.; Liang, Y.; Ji, Z. Edge-Preserving Texture Suppression Filter Based on Joint Filtering Schemes. IEEE Trans. Multimed. 2013, 15, 535–548. [Google Scholar] [CrossRef]
  31. Isar, A.; Nafornita, C. Sentinel 1 Stripmap GRDH image despeckling using two stages algorithms. In Proceedings of the 2016 12th IEEE International Symposium on Electronics and Telecommunications (ISETC), Timisoara, Romania, 27–28 October 2016; pp. 343–348. [Google Scholar] [CrossRef]
  32. Tian, H.; Wang, D.; Lin, J.; Chen, Q.; Liu, Z. Surface Defects Detection of Stamping and Grinding Flat Parts Based on Machine Vision. Sensors 2020, 20, 4531. [Google Scholar] [CrossRef] [PubMed]
  33. Marti, D.; Vidal-Pantaleoni, A. Comparison of different speckle-reduction techniques in SAR images using wavelet transform. Int. J. Remote. Sens. 2004, 25, 4915–4932. [Google Scholar] [CrossRef]
  34. Xia, J.; Wu, X.; Yuan, Y. Integration of wavelet transform with PCA and ANN for metabolomics data-mining. Metabolomics 2007, 3, 531–537. [Google Scholar] [CrossRef]
  35. Shui, P.L. Image denoising algorithm via doubly local Wiener filtering with directional windows in wavelet domain. IEEE Signal Process. Lett. 2005, 12, 681–684. [Google Scholar] [CrossRef]
  36. Jing, J.; Liu, S.; Wang, G.; Zhang, W.; Sun, C. Recent advances on image edge detection: A comprehensive review. Neurocomputing 2022, 503, 259–271. [Google Scholar] [CrossRef]
Figure 1. Scheme of algorithm (Six images represented by numbers are the results using different parameters in Texture suppression and the area of red box is scratch region).
Figure 1. Scheme of algorithm (Six images represented by numbers are the results using different parameters in Texture suppression and the area of red box is scratch region).
Sensors 23 07291 g001
Figure 2. Images of three functions. (a) Prototype I (The red line represents the asymptote, and the blue curve represents Equation (1)). (b) Prototype II (The red line represents the asymptote, and the blue curve represents Equation (2)). (c) Threshold functions.
Figure 2. Images of three functions. (a) Prototype I (The red line represents the asymptote, and the blue curve represents Equation (1)). (b) Prototype II (The red line represents the asymptote, and the blue curve represents Equation (2)). (c) Threshold functions.
Sensors 23 07291 g002
Figure 3. Two connection methods. (a) Convex hull of scratches (Points represented by numbers are different pixels). (b) Original image (The area of red box indicates the location of the fracture). (c) Binary image. (d) Expansion of scratches. (e) Corrosion of scratches.
Figure 3. Two connection methods. (a) Convex hull of scratches (Points represented by numbers are different pixels). (b) Original image (The area of red box indicates the location of the fracture). (c) Binary image. (d) Expansion of scratches. (e) Corrosion of scratches.
Sensors 23 07291 g003
Figure 4. System structure and test piece. (a) System structure. (b) Test piece.
Figure 4. System structure and test piece. (a) System structure. (b) Test piece.
Sensors 23 07291 g004
Figure 5. Different types of scratches. (a) Three types of single scratch. (b) Three types of multiple scratches. (c) Three types of cross scratch. (d) Three types of other scratches.
Figure 5. Different types of scratches. (a) Three types of single scratch. (b) Three types of multiple scratches. (c) Three types of cross scratch. (d) Three types of other scratches.
Sensors 23 07291 g005
Figure 6. Selection of decomposition level (cropped). (a,b) The wavelet coefficient of the first level at 45° and its 3D grayscale. (c,d) The wavelet coefficient of the second level at 45° and its 3D grayscale. (e,f) The wavelet coefficient of the third level at 45° and its 3D grayscale. (g,h) The wavelet coefficient of the fourth level at 45° and its 3D grayscale.
Figure 6. Selection of decomposition level (cropped). (a,b) The wavelet coefficient of the first level at 45° and its 3D grayscale. (c,d) The wavelet coefficient of the second level at 45° and its 3D grayscale. (e,f) The wavelet coefficient of the third level at 45° and its 3D grayscale. (g,h) The wavelet coefficient of the fourth level at 45° and its 3D grayscale.
Sensors 23 07291 g006
Figure 7. Comparison of denoising methods. (a) Noise added. (b) Hard threshold processing. (c) Soft threshold processing. (d) Semisoft threshold processing.
Figure 7. Comparison of denoising methods. (a) Noise added. (b) Hard threshold processing. (c) Soft threshold processing. (d) Semisoft threshold processing.
Sensors 23 07291 g007
Figure 8. Texture size. (a) Single scratch I. (b) Multiple scratches I. (c) Cross scratch I. (d) Other scratches I.
Figure 8. Texture size. (a) Single scratch I. (b) Multiple scratches I. (c) Cross scratch I. (d) Other scratches I.
Sensors 23 07291 g008
Figure 9. Comparison of texture suppression methods (The black image is an enlargement of the area in the red circle). (a,b) Single scratch I. (c,d) Multiple scratches III. (e,f) Cross scratch I. (g,h) Other scratches II.
Figure 9. Comparison of texture suppression methods (The black image is an enlargement of the area in the red circle). (a,b) Single scratch I. (c,d) Multiple scratches III. (e,f) Cross scratch I. (g,h) Other scratches II.
Sensors 23 07291 g009
Figure 10. Comparison of different scratches.
Figure 10. Comparison of different scratches.
Sensors 23 07291 g010
Figure 11. The contrast of extracted scratches (From left to right, they are ROI, real value, and actual value; The area of red box represents the scratch region). (a) Single scratch. (b) Multiple scratches. (c) Cross scratch. (d) Other scratches.
Figure 11. The contrast of extracted scratches (From left to right, they are ROI, real value, and actual value; The area of red box represents the scratch region). (a) Single scratch. (b) Multiple scratches. (c) Cross scratch. (d) Other scratches.
Sensors 23 07291 g011
Table 1. The results of scratches.
Table 1. The results of scratches.
ScratchesReal ValueActual ValueTotal
Area (pixel)Length (pixel)CentroidArea (pixel)Length (pixel)Centroid
1132,82254502189.5
1335.7
149,50050232206.2
1304.6
89.81%
286,84937901508.8
1479.7
96,92640191504.5
1482.7
91.18%
390,67443701754.9
1470.4
104,00041551762.0
1482.0
90.19%
441,85320261549.6
1532.2
49,13222681537.7
1501.2
85.34%
547,64225352858.0
1150.9
54,14627292848.9
1140.5
89.35%
653,17326081622.7
1445.0
54,89726221623.2
1449.3
98.12%
742,57520162363.8
736.8
45,47220312365.0
743.0
96.23%
841,08316631449.4
1204.0
45,19616471442.7
1203.0
94.52%
936,67514421602.8
1752.6
39,08415281601.6
1752.0
93.74%
1034,52817752226.1
1167.2
40,14616002217.0
1157.7
86.94%
11197,93675452047.4
1595.7
212,65079242039.0
1603.2
93.78%
12123,20656481657.4
1518.0
127,98349171678.9
1495.0
91.67%
13115,62146071732.4
1489.2
137,52047651735.0
1470.0
88.82%
1477,26435322234.3
1682.2
80,49431992240.3
1686.5
93.20%
15125,56761551952.5
1795.5
145,34758142013.1
1789.1
89.36%
1644,49419882198.6
1498.7
45,36720122196.7
1503.6
98.42%
1739,00515202390.4
1458.8
37,06216692403.5
1513.6
92.61%
Table 2. Comparison of methods.
Table 2. Comparison of methods.
SampleSingleMutiCrossOther
AreaLengthAreaLengthAreaLengthAreaLength
The proposed87.44%92.17%84.48%90.21%92.57%94.98%84.25%94.46%
Log72.33%90.50%69.53%82.03%87.21%98.69%70.15%92.46%
Snake-based on edge91.02%65.43%70.39%75.89%81.50%61.56%63.29%57.68%
Fuzzy edge78.77%98.06%71.64%73.75%86.50%97.16%63.59%96.88%
K-means93.11%92.72%97.39%79.85%62.96%88.69%77.22%94.88%
Fuzzy c-means93.83%81.85%98.21%84.65%84.10%77.84%97.52%80.00%
K-means and superpixels95.29%79.94%88.07%62.87%65.37%94.88%82.02%72.85%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Xu, B.; Sun, Y.; Li, J.; Deng, Z.; Li, H.; Zhang, B.; Liu, K. Accurate Detection for Zirconium Sheet Surface Scratches Based on Visible Light Images. Sensors 2023, 23, 7291. https://doi.org/10.3390/s23167291

AMA Style

Xu B, Sun Y, Li J, Deng Z, Li H, Zhang B, Liu K. Accurate Detection for Zirconium Sheet Surface Scratches Based on Visible Light Images. Sensors. 2023; 23(16):7291. https://doi.org/10.3390/s23167291

Chicago/Turabian Style

Xu, Bin, Yuanhaoji Sun, Jinhua Li, Zhiyong Deng, Hongyu Li, Bo Zhang, and Kai Liu. 2023. "Accurate Detection for Zirconium Sheet Surface Scratches Based on Visible Light Images" Sensors 23, no. 16: 7291. https://doi.org/10.3390/s23167291

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop