Determining Roads Asphalt Damage With Image Processing Algorithms in Matlab
Determining Roads Asphalt Damage With Image Processing Algorithms in Matlab
M.Sc., Computer Science, Software, Roshd Danesh Higher Education Institute, Semnan, Iran.
Abstract
In recent years, a new application making image processing so significant is the use of image processing techniques (IPTs) in urban planning
and road construction to facilitate work and enhance the rate of detecting asphalt damage on road surfaces using the identification of these
damages and bettering them prior to further damage to these important communication infrastructures. The paper tried to reduce the existing
challenges by properly training of the software and assigning tasks to the machine automatically on the one hand, and on the other tried to
extract better answers from machines compared to humans by reducing human interference in identifying and determining the extent of road
surface damage using extraction of various features by IPTs and proper analysis in MATLAB software. Regarding this, firstly, 824 images
were taken from various places with different conditions (sunny, cloudy, shady, and so on) using a high quality camera. Then the images
received in the previous step were stored in a database and the color images were converted to binary (black and white) ones. Then, after
edge detection, mean filter was done with Sobel default and the images were divided into some sub-blocks, and the features were examined
after applying k-means algorithm. Finally, 199 features of each image were examined and the final pattern was obtained after training the
software. The results indicated that the accuracy of the output in terms of percentage was more than 85%, which based on the previous studıes,
shows acceptable detection by the method presented in this study. The accuracy of the method presented in the classification output was much
higher than the percentage output and in almost more than 95% of cases were placed in the correct class that the experts have identified,
showing the high accuracy of the proposed method in the method in classification.
1. Data collection In this study, 578 images were used for software training, and
Firstly, 824 images were taken with a high quality camera 246 images were used for testing.
from various locations with different situations (sunny,
cloudy, shady, and so on). After that, by visiting five experts Data collection and storage steps were performed to detect
of the Iran Ministry of Roads & Urban Development, each of road asphalt damage and then the data size and characteristics
the images was reviewed by each of the experts. In the next of each image were reduced by reducing the volume of data
step, using previous experience and knowledge, each expert and applying pre-processing methods.
re-examined each of the images and considered a number for
each image as the value and severity of the damage in The application of various classification or clustering
percentage. In the last step, an average of the opinions of 5 algorithms in the paper was done to discover the pattern,
experts was taken for each image, each of them had assigned whose purpose in discovering the pattern was to create a
a number to the desired image, and finally that number was machine to show the whole training dataset.
recorded in the database as the asphalt damage in the desired
image. 3. Evaluation
Test dataset were used to compare the accuracy of the
2. Pre-processing proposed method. The number of data in test datasets was 246
The data collected in the study is 824 items, with 99 features images. To this end, after training the software by training
examined for pre-processing of each image. In image dataset, the desired output was received in the test section by
processing science, training and test datasets are needed to introducing the number of each image to the software.
apply algorithms related to pattern discovery. The According to the number of images that was 824 in the
development method in this study was to create training and database, each cluster or K-means will eventually be a
test datasets. collection of 199 features. In these 199 features, almost 100
were related to the centers themselves, and 99 to the
Training: To create a pattern of data in the study differences between the centers. We were looking for a
Test: To estimate the accuracy of predicting the pattern relationship between quality and the increased difference
created from training data between centers and higher numbers of centers.
Training samples are transferred to the network and the output of which will be classification, a pattern net network
output from the network is compared with the actual output. was used, which is used to identify the pattern in multi-group
This error is used to change the weight of the neurons so that class files.
the error gradually decreases. This is done using the
backpropagation algorithm, also called backprop. Normally, Accuracy percentage output:
data transmission over a network and weight update, so that Feed forward network is used for the second model based on
the error is reduced, is known as Stochastic Gradient Descent the accuracy percentage prediction. The features are a bit
(SGD). The rate of changes in weight is determined by a different, but for the prediction of the classification groups,
parameter called the learning rate. more wavelet features were used, and for the percentage
output, the gradient features provided a more appropriate
In this experiment, the programming environment used to answer. At the end of the output section, two programs must
implement and test the proposed algorithm is introduced. be executed, which for each image whose number is given by
MATLAB 2018 was used for programming. the user, the original image is found next to the edge detected
image and the category that the program recognizes is
RESULTS displayed simultaneously with the actual category, which in
Two types of output are provided by this proposed method. most cases are equal and this is an indication of the accuracy
In the first model, the outputs are classified and in classes 1 of the proposed method. In the percentage model, the original
to 4 and in the second model, it will make predictions based image is displayed next to the edge image, along with the
on accuracy percentage. correct percentage using the proposed detection method,
along with the number that actually existed (experts
Classification output: prediction).
As is see in Figure 3, in the classification model, after sorting
and preparing the information, the percentages that the Output analysis of the accuracy percentage
program predicts are in the range below 12 in group one, As Figure 1shows, in the percentage output, the task of the
between 12 and 20 in group two, between 48 and 20 in groups detection program with acceptable accuracy is the rate of
three and 48 and above are in group four. The reason for this asphalt damage using the training that has already been seen.
choice is that based on the samples given with this situation, Given the high accuracy of the method, the numbers detected
the test and training samples are almost the same, and about by the software for asphalt damage in each image are usually
200 images are placed in each group. For this model, the close to the damage reported by experts and recorded in the
80
60
40
واقعی درصد
Actual percentage 20
شده دادهpercentage
The درصد تشخیص 0
1 تصویر
2 تصویر
3 تصیور
4 تصویر
5 تصویر
6 تصویر
7 تصویر
8تصیور
9تصویر
10 تصویر
درصد واقعی
11 تصویر
12 تصویر
13 تصویر
14تصویر
15 تصویر
Actual percentage
16 تصویر
17 تصویر
18 تصویر
19 تصویر
20 تصویر
Classification output analysis four classes are seen at the output: Class One, Class Two,
As Chart 2 shows, images are classified into 4 groups in the Class Three, and Class Four.
classified output. In the classification program, after sorting
the information and preparing it, the percentages that the As Chart 2 shows, 20 images were randomly selected and the
program predicts are in the range below 12 are in group one, classification output was obtained from them according to the
between 12 and 20 in group two, between 48 and 20 in group method described above. The chart well illustrates the
three and 48 and above in group four. This means that there accuracy of the proposed method in the study in terms of
classification.
واقعی کالس
Actual class
0
شده تشخیص داده
Detected class کالس
1 تصویر
2 تصویر
3 تصویر
4 تصویر
5 تصویر
6 تصویر
7تصویر
8 تصویر
9 تصویر
10 تصویر
واقعیclass
کالس
11 تصویر
12 تصویر
13 تصویر
Actual
14 تصویر
15 تصویر
16 تصویر
17 تصویر
18 تصویر
19 تصویر
20 تصویر
After training and test, the program was designed so that each more practical and for everyone to be able to use it in various
user can enter the image in any situation with different situations.
qualities and receive the desired output to make the program
Figure 5: Output
DISCUSSION this end, the new proposed method in this paper was
Nowadays, the basic challenge in image processing is presented with MATLAB and the accuracy of the proposed
whether it can act like human eye or not. Human vision is so method was compared with other methods or programs for
complex that we have not yet fully understood our vision to evaluation. The accuracy of the output in terms of percentage
develop image processing. Image processing is on the verge is more than 85%, which shows acceptable detection by the
of making a fundamental difference in our world, and many method presented in this study according to previous studies.
studies are still needed to meet our expectation from image The accuracy of the method presented in this study in the
processing. Moreover, many operations have to be done to classification output is much higher than the percentage
process the visual information. Images usually contain noise output. Moreover, it is in the correct class the experts have
that distorts them. Although this problem is not considered identified in almost more than 95% of cases, which shows the
very serious for the human visual system, for machine vision high accuracy of the proposed method in the study in
systems these noises must be completely filtered and cleaned, classification method.
which is done using some algorithms.
REFERENCES
1. Sajjadi, H., Rashidi Baghi, M., Shir Alizadeh, M. Predicting the
CONCLUSION relationship between stock returns and information asymmetry using
Nowadays, different approaches have been proposed to artificial neural networks, Regional Conference on Accounting in the
identify damages in many areas, especially road construction, Information Technology Age, 2012.
but the methods described have to identify these damages in 2. Jadidi Osguyi, A. Investigation of the structure and function of SMA
asphalt for use in road paving, 4th International Congress of Civil
a timely and appropriate manner. One of the problems with Engineering, Architecture and Urban Development, 2016.
traditional approaches is the need for continuous monitoring 3. Beheshti Shirazi, A. Digital Image Processing Book, 2015.
of road construction experts at the road level and the 4. Ghanem, R., Romeo, F., A wavelet-based approach for the
experimental determination of the level of asphalt damage on identification of linear time-varying dynamical systems, J. Sound Vib.
200p; 234 (4): 555–576.
the road surface, which incurs high costs, and in many cases, 5. Shan, X., Burl, J.B., Continuous wavelet based linear time-varying
the damage and damage are not correctly identified. This is system identification, Signal Process. 2011; 91: 1476–1488.
less common in some developing countries. Sometimes a lot 6. Angreni, I., Adisasmita, S., Ramli, M., Evaluating the Road Damage of
of limitations are associated with going on long distances and Flexible Pavement Using Digital Image, International Journal of
Integrated Engineering, 2018.
sending experts to different axes on the roads. Efforts have 7. Shahabian Moghadam, R., Sahaf, M., Pourreza, H. Automatic
to be made to receive diagnostic data in the field of road diagnosis and classification of pavement damages based on image
construction, especially in Iran, with professional and tissue analysis in the field of location and conversion, Specialized
appropriate equipment, to reach an acceptable detection. To Letter of Transportation Engineering, 2017.