Image-Based Crack Detection Methods - A Review
Image-Based Crack Detection Methods - A Review
Review
Image-Based Crack Detection Methods: A Review
Hafiz Suliman Munawar 1 , Ahmed W. A. Hammad 1, *, Assed Haddad 2 , Carlos Alberto Pereira Soares 3
and S. Travis Waller 4
1 School of Built Environment, University of New South Wales, Kensington, Sydney, NSW 2052, Australia;
[email protected]
2 Programa de Engenharia Ambiental, PEA/POLI & EQ, Universidade Federal do Rio de Janeiro,
Rio de Janeiro 21941-909, Brazil; [email protected]
3 Pós-Graduação em Engenharia Civil, Universidade Federal Fluminense, Niterói 24210-240, Brazil;
[email protected]
4 School of Civil and Environmental Engineering, University of New South Wales, Kensington,
Sydney, NSW 2052, Australia; [email protected]
* Correspondence: [email protected]
Abstract: Annually, millions of dollars are spent to carry out defect detection in key infrastructure
including roads, bridges, and buildings. The aftermath of natural disasters like floods and earth-
quakes leads to severe damage to the urban infrastructure. Maintenance operations that follow for
the damaged infrastructure often involve a visual inspection and assessment of their state to ensure
their functional and physical integrity. Such damage may appear in the form of minor or major
cracks, which gradually spread, leading to ultimate collapse or destruction of the structure. Crack
detection is a very laborious task if performed via manual visual inspection. Many infrastructure
elements need to be checked regularly and it is therefore not feasible as it will require significant
human resources. This may also result in cases where cracks go undetected. A need, therefore, exists
for performing automatic defect detection in infrastructure to ensure its effectiveness and reliability.
Citation: Munawar, H.S.; Hammad,
A.W.A.; Haddad, A.; Soares, C.A.P.;
Using image processing techniques, the captured or scanned images of the infrastructure parts
Waller, S.T. Image-Based Crack can be analyzed to identify any possible defects. Apart from image processing, machine learning
Detection Methods: A Review. methods are being increasingly applied to ensure better performance outcomes and robustness in
Infrastructures 2021, 6, 115. https:// crack detection. This paper provides a review of image-based crack detection techniques which
doi.org/10.3390/infrastructures6080115 implement image processing and/or machine learning. A total of 30 research articles have been
collected for the review which is published in top tier journals and conferences in the past decade.
Academic Editor: A comprehensive analysis and comparison of these methods are performed to highlight the most
Kourosh Khoshelham promising automated approaches for crack detection.
who examine the component visually and the use of specific tools to identify any deficiency
tools
in thetocomponent
identify any [6].deficiency
However,in themethod
this component [6]. However,
is tedious, this method
labour extensive is tedious,
and prone to hu-
labour
man error.extensive and prone
Automatic crack to human deals
detection error.withAutomatic crack detection
using technologies deals with
to identify using
cracks from
technologies to identify cracks from infrastructures. The level
infrastructures. The level of degradation can be determined by analyzing the length, width, of degradation can be
determined by analyzing the length, width, depth and severity
depth and severity of a crack. These measures can be used to make decisions regarding the of a crack. These measures
can be used toofmake
classification decisions
the crack, regarding
durability of thethe classification
structure and itsof the crack,
usage durability
[7]. Using of the
the traditional
structure and its usage [7]. Using the traditional inspection
inspection procedures which involve manual inspection, it is very time-consuming to de- procedures which involve
manual
termine inspection, it is very
the crack measures time-consuming
which make it difficult to determine the crack
to make inference measures
regarding thewhich
level of
make it difficult to make inference regarding the level of degradation. Hence, for a quick,
degradation. Hence, for a quick, effective, and reliable damage assessment, the crack detec-
effective, and reliable damage assessment, the crack detection process must be automated
tion process must be automated to replace the manual defect inspection methods. Some
to replace the manual defect inspection methods. Some testing methods like laser, infrared,
testing methods like laser, infrared, thermal, radiographic, and thermal testing approaches
thermal, radiographic, and thermal testing approaches have been used in the past to
have been used in the past to automate the process of crack detection [8–10]. However, more
automate the process of crack detection [8–10]. However, more recently, there has been
recently, there has been an increasing trend of using image-based methods for detecting
an increasing trend of using image-based methods for detecting cracks. These methods
cracks. These methods involve capturing images of the target component and analyzing
involve capturing images of the target component and analyzing them programmatically
them programmatically to find and classify cracks. Such methods are fast, less expensive,
to find and classify cracks. Such methods are fast, less expensive, and robust. The methods
and robust. The methods can be categorized into two types namely as image processing and
can be categorized into two types namely as image processing and machine learning. The
machine learning. The image processing methods do not require a model training process
image processing methods do not require a model training process and involve the use
and involve the use of filters, morphological analysis, statistical methods, and percolation
of filters, morphological analysis, statistical methods, and percolation techniques for the
techniques
detection offor the [11,12].
crack detection Onofthecrack
other[11,12].
hand,On thethe other hand,
machine learning the process
machineinvolves
learningthe pro-
cess involves the collection of a dataset of images, which are
collection of a dataset of images, which are supplied to the selected machine learning supplied to the selected ma-
model for training. Such methods may involve image processing steps for preprocessingfor
chine learning model for training. Such methods may involve image processing steps
preprocessing
and noise removal, and noise
but the removal, but the crack
crack detection task isdetection
done by task is donemachine
the trained by the trained
learning ma-
chine learning
model [13]. model [13].
Figure 1 shows
Figure 1 shows the thebasic
basicarchitecture
architectureofofananimage imageprocessing-based
processing-based method
method forfor crack
crack
detection. First using a camera or any other imaging mechanism, high-resolution images of
detection. First using a camera or any other imaging mechanism, high-resolution images
thethe
of target
target component
component areare
collected.
collected.TheThe images
images are are
thenthenpreprocessed
preprocessed which involves
which involvesusing
filters, segmentation and other approaches to remove noise
using filters, segmentation and other approaches to remove noise and shadows from the and shadows from the image.
The image
image. may bemay
The image converted to grayscale
be converted or binary
to grayscale form form
or binary if required by the
if required by specific crack
the specific
detection
crack method
detection beingbeing
method used.used.
The resultant
The resultantimageimageis applied to thetocrack
is applied detection
the crack proce-
detection
dure whichwhich
procedure uses image processing
uses image techniques
processing like edge
techniques like detection, segmentation,
edge detection, or pixel
segmentation,
analysis to highlight or segment the cracked part in the image
or pixel analysis to highlight or segment the cracked part in the image [14]. Parameter [14]. Parameter estimation
involves calculating
estimation the specific the
involves calculating properties
specificof the detected
properties of thecrack such as
detected its length,
crack such as width,
its
depth and
length, width, density.
depthSuch measures
and density. Suchhelp in making
measures helpdecisions
in making regarding
decisionsthe severitythe
regarding of a
crack. of a crack.
severity
Figure 1. Image
Figure 1. Image Processing
Processing Methods
Methods for
for Crack
Crack Detection.
Detection.
The
The basic
basic steps
steps to
to build
build aa machine
machine learning model for
learning model for crack
crack detection
detection are
are depicted
depicted in
in Figure 2. In the first step, a dataset must be collected showing surface
Figure 2. In the first step, a dataset must be collected showing surface cracks, which cracks, which
are to
are
be detected using the machine learning model. Previously, a study led by Lin et al.etused
to be detected using the machine learning model. Previously, a study led by Lin al.
used 30,000 low-resolution images for training [15]. The images are preprocessed
30,000 low-resolution images for training [15]. The images are preprocessed using image using
image processing
processing techniques
techniques to reduce
to reduce noise, noise,
remove remove
shadowsshadows and adjust
and adjust other other properties
properties such as
such as size and brightness of images. The cracks in these images then undergo
size and brightness of images. The cracks in these images then undergo pixel-wise annota- pixel-wise
annotation or labelling, where the defected pixels are annotated in the image. This step
tion or labelling, where the defected pixels are annotated in the image. This step can be
can be performed manually or using a labelling tool. One such example of labelling is
performed manually or using a labelling tool. One such example of labelling is to set crack
to set crack pixels as white or “1” in the image while the remaining pixels will be set as
pixels as white or “1” in the image while the remaining pixels will be set as black or “0”.
black or “0”. After this step, a machine learning model needs to be selected, which is to be
After this step, a machine learning model needs to be selected, which is to be used for crack
used for crack detection. In past studies various machine learning models such as support
detection. In past studies various machine learning models such as support vector machines
vector machines (SVM), CNN, and decision trees have been used for crack detection [16]. A
(SVM), CNN, and decision trees have been used for crack detection [16]. A cost/loss
cost/loss optimization function is then formulated to minimize the loss or cost of training
Infrastructures 2021, 6, x FOR PEER REVIEW 3 of 22
optimization function is then formulated to minimize the loss or cost of training the model.
A weighted cross-entropy loss function can be used for this purpose [17–20]. The designed
model
the will A
model. then be trained
weighted using the set
cross-entropy of function
loss annotatedcanimages collected
be used for thisinpurpose
the dataset. After
[17–20].
training
The the model,
designed a new
model will setbeoftrained
then imagesusing
will the
be applied to the model
set of annotated images tocollected
see if theinmodel
the
successfully
dataset. Afterclassifies crackedaregions
training the model, new setin
ofthe image.
images will be applied to the model to see if
the model successfully classifies the cracked regions in the image.
Dataset Model
Preprocessing Labelling Model Testing
Collection Training
Thus, by filtering the articles based on these metrics, the most recent, applicable,
and unique research articles written in the English language were extracted. From the
1250 articles retrieved in the first phase, 94 articles passed all four selection criteria. Hence,
this review is based on these screened articles. The number of articles from each term
category i.e., image processing, artificial intelligence and integrated approach that passed
the screening phase is shown in Figure 1. The articles were screened for duplicates, non-
English articles, and review papers. Around 520 papers were removed for duplicates, 240
for non-English articles and 396 for review papers. Hence, overall, 94 papers were finally
collected as an output of the screening phase.
In this section, the method adopted to retrieve the data relevant to the study is
presented. The article retrieval and screening process are discussed in detail. Figure 3
shows the overall methodology followed for the study. To retrieve the articles most relevant
to the research questions proposed in the study, we define two categories of research articles.
These are:
• Cat-1
Infrastructures 2021, 6, x FOR PEER REVIEW Crack Detection using Machine Learning 5 of 22
• Cat-2: Crack Detection using Image Processing
Figure 3. Methodology
Figure 3. Methodology of
of article
article screening.
screening.
After defining the categories, we defined keywords related to each category. Figure 4
More precisely, the following assessment criteria for screening were outlined:
shows the keywords are search phrases that are to be entered in the search engines of a
1) Published
research between 2010
article repository. Thetoaim
2020
was to generate a maximum number of keywords for
2) category
each English Language
to retrieveonly
as many relevant research articles as possible. For this purpose, we
3) Websites
defined a basicmust
set ofbe: MDPI, Elsevier,
keywords IEEE
which are: Xplore,
{crack Arxiv,using
detection Science Directlearning, crack
machine
detection using image processing, crack detection, crack measurement,(letters,
4) Article type must be research article, review or book chapter abstracts and
crack classification}.
comments are excluded)
A keyword search process was conducted to find the most frequent keywords reported in
5) literature,
the No duplicates
relevant to the previous set of keywords. The retrieved keywords include:
“segmentation”,
The articles“support
meeting vector machine”,”
the specified technology”,
criteria ”computer
for screening vision” andA“classi-
were downloaded. total of
107 articles were retrieved at this stage. After this step, each article was carefully studied so
that only relevant articles were kept for the research. This involved reading the abstract,
methodology and results of each article. After the detailed content analysis, the articles not
found relevant to the defined categories were discarded. At the end of this process, a total
Infrastructures 2021, 6, 115 5 of 20
fier” as shown in Figure 4. The retrieved keywords illustrate that data that is to be gathered
Infrastructures 2021, 6, x FOR PEER REVIEW
for the
research must revolve around “crack detection technologies”. Keywords from 6 ofthis
22
set were used in combination with the base set of keywords, to completely exhaust the
database and retrieve a maximum number of articles relevant to the study.
Figure
Figure4.4.Keywords
Keywordsfor
forCrack
CrackDetection.
Detection.
The next step was to specify the resource from where the research articles are to be
retrieved. For this purpose, recent research articles from a wide range of journals and
conferences were retrieved. Search results were obtained for each specific search phrase
entered on the search engine. Screening criteria were selected based on the time frame
relevance to the topic of study, and authenticity of websites for article retrieval.
More precisely, the following assessment criteria for screening were outlined:
(1) Published between 2010 to 2020
(2) English Language only
(3) Websites must be: MDPI, Elsevier, IEEE Xplore, Arxiv, Science Direct
(4) Article type must be research article, review or book chapter (letters, abstracts and
comments are excluded)
(5) No duplicates
The articles meeting the specified criteria for screening were downloaded. A total of
107 articles were retrieved at this stage. After this step, each article was carefully studied
so that only relevant articles were kept for the research. This involved reading the abstract,
methodology and results of each article. After the detailed content analysis, the articles
Figure 5. Year-wise Distribution of Articles.
not found relevant to the defined categories were discarded. At the end of this process, a
total of 30 research articles were finally selected for the study. These articles met all the
3. Results
assessment criteria and were found relevant to the research questions posed in this study.
Figure 5 shows the year-wise distribution of the research articles which were selected
A total of 30 research papers were collected because of the article retrieval and
for the study. The graph shows a growing trend among studies that are moving towards
screening method. Figure
machine learning methods 6 shows the overall
for crack distribution
detection, especiallyofduring
these articles in the
the most image
recent pro-
years
cessing and machine learning domains. The pie chart shows that 67% of articles
(2016–2020). The use of image processing methods was common at the start of the decade proposed
crack detection
(2010), however,methods
with thethat
rapidemployed
advancementmachine learning
in the field ofmodels
artificialwhile 33% used
intelligence image
(AI), the
processing methods.
machine learning In this section,
methods took overa comprehensive
and gained rapid review of these
attention papers is
of various presented.
researchers
Comparative
who aimed toanalysis
introduceof automation
these techniques
in theiscrack
donedetection
in tabular forms. The performance out-
process.
comes, technique, dataset, imaging method and limitations of each method is presented to
make inference regarding the feasibility of the method and its applicability in real-time
crack detection tasks.
Infrastructures 2021, 6, 115 Figure 4. Keywords for Crack Detection. 6 of 20
3. Results
3. Results
A total of 30 research papers were collected because of the article retrieval and screen-
ing method. Figure
A total 6 shows
of 30 the papers
research overall distribution of these
were collected articles
because of in thearticle
the imageretrieval
processingand
and machine learning domains. The pie chart shows that 67% of articles proposed
screening method. Figure 6 shows the overall distribution of these articles in the image crack
pro-
detection
cessing andmethods
machine that employed
learning machine
domains. Thelearning
pie chartmodels
shows while 33%ofused
that 67% image
articles pro-
proposed
cessing methods. In this section, a comprehensive review of these papers
crack detection methods that employed machine learning models while 33% used image is presented.
Comparative analysis of these techniques is done in tabular forms. The performance
processing methods. In this section, a comprehensive review of these papers is presented.
outcomes, technique, dataset, imaging method and limitations of each method is 7presented
Infrastructures 2021, 6, x FOR PEER REVIEW of 22 out-
Comparative analysis of these techniques is done in tabular forms. The performance
to make inference regarding the feasibility of the method and its applicability in real-time
comes, technique, dataset, imaging method and limitations of each method is presented to
crack detection tasks.
make inference regarding the feasibility of the method and its applicability in real-time
crack detection tasks.
Figure
Figure 6. Distribution
6. Distribution of articles
of articles among
among machine
machine learning
learning andand image
image processing
processing domains
domains forfor crack
crack
detection.
detection.
3.1. Image Processing Based Crack Detection
3.1. Image Processing based Crack Detection
Table 1 summarizes the image processing-based methods reviewed in this paper for
Table 1 summarizes the image processing-based methods reviewed in this paper for
crack detection. Each of the methods has been discussed in the subsequent sections.
crack detection. Each of the methods has been discussed in the subsequent sections.
Imaging
Method Features Domain Image Details Results Limitations Ref.
Device/Source
Precision =
206
Recursive Tree 0.79&&&Recall = Increased runtime
Crack Detection Pavement images&&&800 - [4]
edge pruning 0.92&&&F- (up to 30 s)
× 600
Measure = 0.85
GP and Image 17&&&(varying
Crack Detection Concrete Digital Camera Accuracy = 80% - [10]
Infrastructures 2021, 6, 115 7 of 20
Imaging
Method Features Domain Image Details Device/Source Results Limitations Ref.
system, the DJI Mavic Pro was the best camera used in the UAS for enhancing crack
visibility [32–35].
Table 2. Cont.
Experimental results show an F-measure above 0.87. The method works well for pavement
images and did not show good results on input stone images.
Regular examination of the components in nuclear power plants is deemed necessary
to ensure the safety of the workers. A total of 20 videos were captured from components in
a nuclear power plant and integrated CNN and a naïve Bayesian (NB) classifier to fuse and
analyze the data acquired from each video frame. In this framework, CNN detects cracks
from each input frame while NB eliminates the false positives in the output [42]. The data
fusion approach preserves each crack’s spatiotemporal consistency. This system achieved a
hit rate of 98.3%.
CrackNet is a CNN-based model presented by Zhang et al. [3] for crack detection on
pavements. There are no pooling layers in the CrackNet architecture, unlike the traditional
CNN model. This architecture ensures accuracy up to the pixel level as the image length
and width remains unchanged in all layers. Convolutional and fully connected layers
are the hidden layers of this network [26]. Training of the model was done using 1800
three-dimensional (3D) images. A total of 200 3D pavement images were captured for
testing the model. The system achieved a precision, recall and F–measure of 90.13%, 87.63%
and 88.86%.
Yang et al. [15] used a variation of CNN called fully convolutional network (FCN)
for pixel-level segmentation of cracks on the images of walls and pavements. The FCN
model is trained using multiple kinds of crack images [15]. Pixel skeletons having a width
of only one pixel are used to represent the crack segments predicted by the FCN model.
The morphological features of these cracks, like length, width and topology are then
measured using these skeletons. For validation, the crack segments acquired by the model
are compared to ground truth and the results produced by FCN model crack detection
systems. The overall accuracy achieved by the crack segmentation system is 97.96%. This
method outperforms the CrackNet model in that it provides pixel-level segmentation and
reduces the training time. However, its performance is less than CrackNet in terms of
accuracy.
Bang et al. [31] worked on the detection of road cracks at the pixel level. A deep
convolutional encoder-decoder network was used for this purpose [31]. The encoder part
of this network consists of convolutional layers which extract the crack features while
the decoder part consists of de-convolutional layers which find the crack locations in
images. The model was trained using 427 black box images which were extracted from
black-box videos and was tested on 100 images. The system recorded a precision, recall
and intersection of a union of 77.68%, 71.98% and 59.65% respectively.
Pauly et al. [14] used CNN to detect cracks from pavement images . A total of
500 images were collected using smartphones from pavements across the United States
of America (USA). The resolution of each image was 3264 × 2448. Each image was then
partitioned into patches of 99 × 99 pixels. Next, these patches were labelled as either
cracked or non-cracked. The experimental results showed that by increasing the depth of
the neural network, better performance outcomes are achieved. A limitation of this method
is the location variance problem according to which, when the model is tested on pavement
images collected from a different location, the performance is reduced. An accuracy of
91.3% was recorded by this crack detection system.
Researchers have proposed several methods to calculate the dimensions and mea-
surements of the detected cracks such as length, width and depth along with the densities.
Dung and Anh have proposed a system that detects cracks from concrete images and
calculates their densities. They performed semantic segmentation of cracks on concrete
images [5]. The system uses an encoder-decoder FCN model. A total of 500 annotated
images were used to train the encoder based on VCG16. The average precision achieved by
the network is 90%. The system detects cracks and also calculates the densities of these
cracks with reasonable performance. To measure the density of a crack, the total number of
segmented crack pixels is divided by the total number of pixels in the image. This ratio is
referred to as the pixel density [40–43].
Infrastructures 2021, 6, 115 12 of 20
Differentiating between cracks and sealed cracks is another challenge that exists in the
literature. Zhang et al. [23] worked on crack detection on pavement images having complex
textures while focusing on the problem of distinguishing between cracks and sealed cracks
having identical width and brightness. A CNN model is trained for the classification of
a pavement image into crack/sealed crack and background sections [43]. A section-wise
thresholding process is applied to the output image for pixel-based segmentation of cracks
and sealed cracks. A curve identification method based on tensor voting is employed to
extract the crack or sealed crack. A total of 800 images are used to test the system. The
system showed a recall of 0.951 and a precision of 0.847.
Figure 7.
Figure Functionality based
7. Functionality based Analysis
Analysis of
of Crack
Crack Detection
Detection Methods.
Methods.
Thedomain
Figure9.9.The
Figure domainof
ofthe
theCrack
CrackDetection
DetectionTechniques.
Techniques.
developing methods to classify the detected crack so that the system can recognize the
type of the crack and the maintenance operations can be focused on dealing with the
specific type of crack. Image processing methods have given satisfactory performance on
the custom datasets built by the researchers. However, these methods are dependent on
the lighting conditions, resolution of the images and the level of the noise present in the
images [12,34,41]. Also, the surfaces of the concrete structures have varying textures as
they are exposed to external disturbances and may not have the same texture even if they
are built from the same material. Hence, they may not give as good results when a new
image having a different texture, brightness, resolution or noise level is given as input.
Furthermore, crack detection in transversal direction is not enough accurate as compared
to measurement carried out longitudinally. this difference in directional measurement
could be an issue when establishing a relationship between the width and longitude of the
crack. Hence, the practical applicability of using image processing-based methods is still
obscure [10,24,35].
On the other hand, machine learning methods also pose several limitations to the
researchers. Increased processing time has been observed in many methods [70]. Many
methods require manual parameter setting of the model which limits the full automation
of the crack detection method [24]. Reliance on GPU is another limitation as some methods
do not work as efficiently without it due to a large number of images in the dataset [17]. To
avoid overfitting of the model it becomes necessary to train the model using a large dataset.
These methods require extensive labelling of data images. In practical scenarios, a limited
option for labelling is also available, so the acquisition of labels can be a difficult task [26].
Due to the difference in surface conditions, a different algorithm may be needed to accu-
rately detect the cracks. In addition, crack detection is carried out offline so performance
in real-time detection is poor. Therefore, there is a need to improve the performance of
algorithms and detection accuracy in real-time. The method selected should be robust as
factors such as climatic conditions may impact crack detection. Limitations in terms of the
need for large datasets in order to train neural network can be overcome by empirically
decomposing the fitted networks into ensembles of low-bias sub-networks, thus making
use of small data sets. In addition, deep learning methods can be applied to unsupervised
tasks, using a small dataset that does not require extensive labelling of data, thus reducing
time and cost [48,50].
The presence of noise, shadows, blemishes and other disturbances in the images is
a problem commonly faced by researchers in using both image processing and machine
learning methods [5,30]. Hence, more research needs to be conducted to develop methods
that can remove noise and other irregularities from images [23,71].
6. Conclusions
The paper focuses on the domains of image processing and machine learning for crack
detection. It reviewed state-of-the-art crack detection methods that have been developed
in the past decade with results are published in top-tier journals and conferences. A
total of 30 research articles were reviewed that were screened after applying criteria and
performing a detailed examination of their content. These articles have been assessed
based on the method they have used, the dataset details, imaging method, performance
outcomes, features and limitations. From the analysis, it can be inferred that a wide range
of articles focuses on crack detection only. However, calculating the dimensions of the
crack was not performed in the majority of the studies. Measurements of the detected
crack such as its length, width, density and depth give important indications regarding the
state of the component and its durability and thus helps in making decisions regarding the
structure’s further usage. More research needs to be focused on crack measurement and the
system must be able to provide a final verdict regarding the severity of the detected crack
using different techniques and algorithms. Most methods showed excellent performance
outcomes as the precision values for crack detection ranged between 75% to 100%. Another
observation is that the researchers prefer using their custom-built dataset, which caters
Infrastructures 2021, 6, 115 18 of 20
to the specific requirements of the method used in the system. Most of the reviewed
crack detection techniques apply to civil infrastructure and concrete components. Overall
and specifically in recent years (2016 to 2020), most of the studies have focused on using
machine learning methods instead of image processing for crack detection. Among these
methods, CNN has been most frequently used for this problem. In the future, the research
can be extended to include assessment criteria to assess the performance such as the
runtime of the algorithm, its resource consumption and applicability in real-time scenarios.
References
1. Ni, F.; Zhang, J.; Chen, Z. Pixel level crack delineation in images with convolutional feature fusion. Struct. Control. Health Monit.
2019, 26, e2286. [CrossRef]
2. Liong, S.T.; Gan, Y.S.; Huang, Y.C.; Yuan, C.A.; Chang, H.C. Automatic defect segmentation on leather with deep learning. arXiv
2019, arXiv:1903.12139.
3. Zhang, L.; Yang, F.; Zhang, Y.D.; Zhu, Y.J. Road crack detection using a deep convolutional neural network. In Proceedings of the
International Conference on Image Processing (ICIP), Phoenix, AZ, USA, 25–28 September 2016; pp. 3708–3712.
4. Zou, Q.; Cao, Y.; Li, Q.; Mao, Q.; Wang, S. CrackTree: Automatic crack detection from pavement images. Pattern Recognit. Lett.
2012, 33, 227–238. [CrossRef]
5. Dung, C.V.; Anh, L.D. Autonomous concrete crack detection using deep fully convolutional neural network. Autom. Constr. 2019,
99, 52–58. [CrossRef]
6. Oliveira, H.; Correia, P.L. Automatic road cracks detection and characterization. IEEE Trans. Intell. Transp. Syst. 2012, 14, 155–168.
[CrossRef]
7. Prasanna, P.; Dana, K.J.; Gucunski, N.; Basily, B.B.; La, H.M.; Lim, R.S.; Parvardeh, H. Automated crack detection on concrete
bridges. IEEE Trans. Autom. Sci. Eng. 2014, 13, 591–599. [CrossRef]
8. Gavilán, M.; Balcones, D.; Marcos, O.; Llorca, D.F.; Sotelo, M.A.; Parra, I.; Ocaña, M.; Aliseda, P.; Yarza, P.; Amírola, A. Adaptive
road crack detection system by pavement classification. Sensors 2011, 11, 9628–9657. [CrossRef] [PubMed]
9. Zou, Q.; Zhang, Z.; Li, Q.; Qi, X.; Wang, Q.; Wang, S. Deepcrack: Learning hierarchical convolutional features for crack detection.
IEEE Trans. Image Process. 2018, 28, 1498–1512. [CrossRef] [PubMed]
10. Nishikawa, T.; Yoshida, J.; Sugiyama, T.; Fujino, Y. Concrete crack detection by multiple sequential image filtering. Comput. Civ.
Infrastruct. Eng. 2012, 27, 29–47. [CrossRef]
11. Adeli, H.; Cheng, N. Augmented Lagrangian genetic algorithm for structural optimization. J. Aerosp. Eng. 1994, 7, 104–118.
[CrossRef]
12. Lee, Y.; Wei, C.-H. A computerized feature selection using genetic algorithms to forecast freeway accident duration times. Comput.
Civ. Infrastruct. Eng. 2010, 25, 132–148. [CrossRef]
13. Liu, X.H.; Danczyk, A. Optimal sensor locations for freeway bottleneck identification. Comput. Aided Civ. Infrastruct. Eng. 2009,
24, 535–550. [CrossRef]
14. Pauly, L.; Peel, H.; Luo, S.; Hogg, D.; Fuentes, D.H.A.R. Deeper networks for pavement crack detection. In Proceedings of the
34th ISARC, Taipei, Taiwan, 28 June–1 July 2017; pp. 479–485.
15. Yang, X.; Li, H.; Yu, Y.; Luo, X.; Huang, T.; Yang, X. Automatic pixel-level crack detection and measurement using a fully
convolutional network. Comput. Aided Civ. Infrastruct. Eng. 2018, 33, 1090–1109. [CrossRef]
16. Salman, M.; Mathavan, S.; Kamal, K.; Rahman, M. Pavement crack detection using the Gabor filter. In Proceedings of the 16th
International IEEE Conference on Intelligent Transportation Systems (ITSC 2013), The Hague, The Netherlands, 6–9 October 2013;
pp. 2039–2044.
17. Lins, R.G.; Givigi, S. Automatic crack detection and measurement based on image analysis. IEEE Trans. Instrum. Meas. 2016, 65,
583–590. [CrossRef]
Infrastructures 2021, 6, 115 19 of 20
18. Shi, Y.; Cui, L.; Qi, Z.; Meng, F.; Chen, Z. Automatic road crack detection using random structured forests. IEEE Trans. Intell.
Transp. Syst. 2016, 17, 3434–3445. [CrossRef]
19. Wu, L.; Mokhtari, S.; Nazef, A.; Nam, B.; Yun, H.B. Improvement of crack detection accuracy using a novel crack defragmentation
technique in image-based road assessment. J. Comput. Civ. Eng. 2016, 30, 04014118. [CrossRef]
20. Chen, F.-C.; Jahanshahi, M.R. NB-CNN: Deep learning-based crack detection using convolutional neural network and Naïve
Bayes data fusion. IEEE Trans. Ind. Electron. 2017, 65, 4392–4400. [CrossRef]
21. Ying, L.; Salari, E. Beamlet transform-based technique for pavement crack detection and classification. Comput. Aided Civ.
Infrastruct. Eng. 2010, 25, 572–580. [CrossRef]
22. Landstrom, A.; Thurley, M. Morphology-based crack detection for steel slabs. IEEE J. Sel. Top. Signal Process. 2012, 6, 866–875.
[CrossRef]
23. Zhang, K.; Cheng, H.D.; Zhang, B. A unified approach to pavement crack and sealed crack detection using preclassification based
on transfer learning. J. Comput. Civ. Eng. 2018, 32, 04018001. [CrossRef]
24. Fujita, Y.; Hamamoto, Y. A robust automatic crack detection method from noisy concrete surfaces. Mach. Vis. Appl. 2011, 22,
245–254. [CrossRef]
25. Yang, F.; Zhang, L.; Yu, S.; Prokhorov, D.; Mei, X.; Ling, H. Feature pyramid and hierarchical boosting network for pavement
crack detection. IEEE Trans. Intell. Transp. Syst. 2019, 21, 1525–1535. [CrossRef]
26. Fernández, A.C.; Rodríguez-Lozano, F.J.; Villatoro, R.; Olivares, J.; Palomares, J.M. Efficient pavement crack detection and
classification. EURASIP J. Image Video Process. 2017, 2017, 1–11.
27. Zhang, W.; Zhang, Z.; Qi, D.; Liu, Y. Automatic crack detection and classification method for subway tunnel safety monitoring.
Sensors 2014, 14, 19307–19328. [CrossRef] [PubMed]
28. Yeum, C.M.; Dyke, S.J. Vision—Based automated crack detection for bridge inspection. Comput. Aided Civ. Infrastruct. Eng. 2015,
30, 759–770. [CrossRef]
29. Zhang, A.; Wang, K.C.P.; Li, B.; Yang, E.; Dai, X.; Peng, Y.; Fei, Y.; Liu, Y.; Li, J.Q.; Chen, C. Automated pixel-level pavement crack
detection on 3D asphalt surfaces using a deep-learning network. Comput. Aided Civ. Infrastruct. Eng. 2017, 32, 805–819. [CrossRef]
30. Jahanshahi, M.R.; Masri, S.F. Adaptive vision-based crack detection using 3D scene reconstruction for condition assessment of
structures. Autom. Constr. 2012, 22, 567–576. [CrossRef]
31. Bang, S.; Park, S.; Kim, H.; Kim, H. Encoder-decoder network for pixel-level road crack detection in black-box images. Comput.
Aided Civ. Infrastruct. Eng. 2019, 34, 713–727. [CrossRef]
32. Dorafshan, S.; Thomas, R.J.; Maguire, M. Fatigue crack detection using unmanned aerial systems in fracture critical inspection of
steel bridges. J. Bridge Eng. 2018, 23, 04018078. [CrossRef]
33. Dorafshan, S.; Maguire, M.; Hoffer, N.V.; Coopmans, C. Fatigue crack detection using unmanned aerial systems in under-bridge
inspection. Ida. Transp. Dep. 2017, 1, 1–120.
34. Dorafshan, S.; Thomas, R.J.; Maguire, M. Benchmarking image processing algorithms for unmanned aerial system-assisted crack
detection in concrete structures. Infrastructures 2019, 4, 19. [CrossRef]
35. Kim, I.H.; Jeon, H.; Baek, S.C.; Hong, W.H.; Jung, H.J. Application of crack identification techniques for an aging concrete bridge
inspection using an unmanned aerial vehicle. Sensors 2018, 18, 1881. [CrossRef] [PubMed]
36. Kong, X.; Li, J. Vision—Based fatigue crack detection of steel structures using video feature tracking. Comput. Aided Civ. Infrastruct.
Eng. 2018, 33, 783–799. [CrossRef]
37. Mstafa, R.J.; Younis, Y.M.; Hussein, H.I.; Atto, M. A new video steganography scheme based on Shi-Tomasi corner detector. IEEE
Access 2020, 8, 161825–161837. [CrossRef]
38. Zhu, J.; Ren, M.W.; Yang, Z.J.; Zhao, W. Fast matching algorithm based on corner detection. J. Nanjing Univ. Sci. Technol. 2011, 35,
755–758.
39. Bansal, M.; Kumar, M.; Kumar, M.; Kumar, K. An efficient technique for object recognition using Shi-Tomasi corner detection
algorithm. Soft Comput. 2021, 25, 4423–4432. [CrossRef]
40. Mohan, A.; Poobal, S. Crack detection using image processing: A critical review and analysis. Alex. Eng. J. 2018, 57, 787–798.
[CrossRef]
41. Budiansky, B.; O’connell, R.J. Elastic moduli of a cracked solid. Int. J. Solids Struct. 1976, 12, 81–87. [CrossRef]
42. Aboudi, J. Stiffness reduction of cracked solids. Eng. Fract. Mech. 1987, 26, 637–650. [CrossRef]
43. Dhital, D.; Lee, J.R. A fully non-contact ultrasonic propagation imaging system for closed surface crack evaluation. Exp. Mech.
2012, 52, 1111–1122. [CrossRef]
44. Shan, B.; Zheng, S.; Ou, J. A stereovision-based crack width detection approach for concrete surface assessment. KSCE J. Civ. Eng.
2016, 20, 803–812. [CrossRef]
45. Shan, Q.; Dewhurst, R.J. Surface—Breaking fatigue crack detection using laser ultrasound. Appl. Phys. Lett. 1993, 62, 2649–2651.
[CrossRef]
46. Wang, P.; Huang, H. Comparison analysis on present image-based crack detection methods in concrete structures. In Proceedings
of the 2010 3rd International Congress on Image and Signal Processing (CISP2010), Yantai, China, 16–18 October 2010; Volume 5,
pp. 2530–2533.
47. Koch, C.; Georgieva, K.; Kasireddy, V.; Akinci, B.; Fieguth, P. A review on computer vision based defect detection and condition
assessment of concrete and asphalt civil infrastructure. Adv. Eng. Inform. 2015, 29, 196–210. [CrossRef]
Infrastructures 2021, 6, 115 20 of 20
48. Feng, C.; Liu, M.Y.; Kao, C.C.; Lee, T.Y. Deep active learning for civil infrastructure defect detection and classification. In
Computing in Civil Engineering 2017; American Society of Civil Engineers (ASCE): Reston, VA, USA, 2017; pp. 298–306.
49. Lin, H.; Li, B.; Wang, X.; Shu, Y.; Niu, S. Automated defect inspection of LED chip using deep convolutional neural network. J.
Intell. Manuf. 2019, 30, 2525–2534. [CrossRef]
50. Olson, M.; Wyner, A.J.; Berk, R. Modern neural networks generalize on small data sets. In Proceedings of the 32nd International
Conference on Neural Information Processing Systems 2018; Curran Associates Inc.: Red Hook, NY, USA, 2018; pp. 3623–3632.
51. Huyan, J.; Li, W.; Tighe, S.; Deng, R.; Yan, S. Illumination compensation model with k-means algorithm for detection of pavement
surface cracks with shadow. J. Comput. Civ. Eng. 2020, 34, 04019049. [CrossRef]
52. Lei, B.; Wang, N.; Xu, P.; Song, G. New crack detection method for bridge inspection using UAV incorporating image processing.
J. Aerosp. Eng. 2018, 31, 04018058. [CrossRef]
53. Yoo, H.S.; Kim, Y.S. Development of a crack recognition algorithm from non-routed pavement images using artificial neural
network and binary logistic regression. KSCE J. Civ. Eng. 2016, 20, 1151–1162. [CrossRef]
54. Hoang, N.D.; Nguyen, Q.L.; Tran, X.L. Automatic detection of concrete spalling using piecewise linear stochastic gradient descent
logistic regression and image texture analysis. Complexity 2019, 2019, 5910625. [CrossRef]
55. Zhou, Q.; Qu, Z.; Cao, C. Mixed pooling and richer attention feature fusion for crack detection. Pattern Recognit. Lett. 2021, 145,
96–102. [CrossRef]
56. Wu, X.; Ma, J.; Sun, Y.; Zhao, C.; Basu, A. Multi-scale deep pixel distribution learning for concrete crack detection. In Proceedings
of the 2020 25th International Conference on Pattern Recognition (ICPR) 2021, Milan, Italy, 10–15 January 2021; pp. 6577–6583.
57. Sari, Y.; Prakoso, P.B.; Baskara, A.R. Road crack detection using support vector machine (SVM) and OTSU algorithm. In
Proceedings of the 2019 6th International Conference on Electric Vehicular Technology (ICEVT) 2019, Ungasan, Indonesia, 18–21
November 2019; pp. 349–354.
58. Hasni, H.; Alavi, A.H.; Jiao, P.; Lajnef, N. Detection of fatigue cracking in steel bridge girders: A support vector machine approach.
Arch. Civ. Mech. Eng. 2017, 17, 609–622. [CrossRef]
59. Han, T.; Jiang, D.; Zhao, Q.; Wang, L.; Yin, K. Comparison of random forest, artificial neural networks and support vector machine
for intelligent diagnosis of rotating machinery. Trans. Inst. Meas. Control. 2018, 40, 2681–2693. [CrossRef]
60. Sharma, M.; Anotaipaiboon, W.; Chaiyasarn, K. Concrete crack detection using the integration of convolutional neural network
and support vector machine. Sci. Technol. Asia 2018, 23, 19–28.
61. Noshad, Z.; Javaid, N.; Saba, T.; Wadud, Z.; Saleem, M.Q.; Alzahrani, M.E.; Sheta, O.E. Fault detection in wireless sensor networks
through the random forest classifier. Sensors 2019, 19, 1568. [CrossRef] [PubMed]
62. Saravanan, N.; Siddabattuni, V.K.; Ramachandran, K.I. Fault diagnosis of spur bevel gear box using artificial neural network
(ANN), and proximal support vector machine (PSVM). Appl. Soft Comput. 2010, 10, 344–360. [CrossRef]
63. Kankar, P.K.; Sharma, S.C.; Harsha, S.P. Vibration-based fault diagnosis of a rotor bearing system using artificial neural network
and support vector machine. Int. J. Model. Identif. Control. 2012, 15, 185–198. [CrossRef]
64. Hoang, N.D. An artificial intelligence method for asphalt pavement pothole detection using least squares support vector machine
and neural network with steerable filter-based feature extraction. Adv. Civ. Eng. 2018, 2018, 7419058. [CrossRef]
65. Wang, B.S.; He, Z.C. Crack detection of arch dam using statistical neural network based on the reductions of natural frequencies.
J. Sound Vib. 2007, 302, 1037–1047. [CrossRef]
66. Fan, R.; Bocus, M.J.; Zhu, Y.; Jiao, J.; Wang, L.; Ma, F.; Liu, M. Road crack detection using deep convolutional neural network and
adaptive thresholding. In Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV) 2019, Paris, France, 9–12 June 2019;
pp. 474–479.
67. Scholar, P.G. Review and analysis of crack detection and classification techniques based on crack types. Int. J. Appl. Eng. Res.
2018, 13, 6056–6062.
68. Palermo, F.; Konstantinova, J.; Althoefer, K.; Poslad, S.; Farkhatdinov, I. Implementing tactile and proximity sensing for crack
detection. In Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA) 2020, Paris, France,
31 May–31 August 2020; pp. 632–637.
69. Luo, Q.; Ge, B.; Tian, Q. A fast adaptive crack detection algorithm based on a double-edge extraction operator of FSM. Constr.
Build. Mater. 2019, 204, 244–254. [CrossRef]
70. Sheng, P.; Chen, L.; Tian, J. Learning-based road crack detection using gradient boost decision tree. In Proceedings of the 2018 13th
IEEE Conference on Industrial Electronics and Applications (ICIEA) 2018, Wuhan, China, 31 May–2 June 2018; pp. 1228–1232.
71. Bhat, S.; Naik, S.; Gaonkar, M.; Sawant, P.; Aswale, S.; Shetgaonkar, P. A survey on road crack detection techniques. In Proceedings
of the 2020 International Conference on Emerging Trends in Information Technology and Engineering (Ic-ETITE) 2020, Vellore,
India, 24–25 February 2020; pp. 1–6.