Artificial Intelligence Project

On
Traffic Sign Detection System
Bachelor Of Technology(B. tech IT)
Int-404(Artificial Intelligence)
By
Name- Kurra Aswini
Registration No.- 12103477 , Section -K21pk

Submitted To: Dipen Saini Sir

School of Computer Science and Engineering
LOVELY PROFESSIONAL UNIVERSITY(PUNJAB)
 WORK DONE BY EACH TEAMMATE:

Name-Pallavi Dey
Reg.no-12104783
Work done :-

Main part in the code main.py .

Gui part of the code.
Report and information gathering.

Name- Kurra Aswini

Reg.no-12103477
Work done :-

Css part of the code.

Information gathering.
Report
 Table Of Contents

1. Acknowledgement

2. Introduction

3. Methodology and Datasets

4. CNN Model

5. Haar cascades

6. Code

7. Results and discussions

8. Limitations

9. Future scopes

10.Conclusion

11.Reference
 Acknowledgement

I have taken efforts in this case study. However, it would not have been
without the kind support and help of many individuals . I would like to extend
my sincere thanks to all of them . I am highly indebted to Dipen sir for her
guidance and constant supervision as well as for providing necessary
information regarding the project & also for their support in completing the
project. I would like to express my gratitude towards my parents & friends for
their kind co-operation and encouragement which help me in completion of this
project.
 Introduction

Artificial Intelligence have gained importance nowadays. Spam filtering,

speech understanding, face recognition, road sign detection are only a few
examples where machine learning is deployed. In traffic zones, Traffic Sign
Recognition and classification can be used to automatically identify traffic
signs. This is done automatically by the system as the traffic sign is detected
and the sign name is displayed. So, even if any sign is missed by the driver or
has any lapse in concentration, it will be detected. This helps to accordingly
warn the drivers and forbid certain actions like over speeding. It also disburdens
the driver and hence, increases his/her comfort. Thus, ensuring and keeping a
check on the traffic signs and accordingly following them. Traffic signs, indeed,
provide us a multitude of information and guide us accordingly so that we can
move safely.
Traffic Sign Classification is very useful in Automatic Driver Assistance
Systems.
In today’s world, identification of traffic signs has become an important aspect
of our lives. Looking at the increasing traffic, to ensure safety of all and for
automatic driving in the future, traffic sign classification is utmost necessary.
Considerable research has been done around recognition of traffic and road
signs.
 METHODOLOGY and DATASET

Traffic Sign Dataset

Before moving on to detection or classification, the most important part is the

availability of a generalized dataset. A prediction model is trained using this
dataset and predictions are done for test dataset. Table I below shows sample
datasets:

TABLE I Dataset Information

Dataset Information

GTSRB Total traffic sign

images more than
50,000 and classes = 43

GTSDB Total traffic sign

images = 900

BTSCB Total traffic sign

images = 10,000 and
classes = 62

BTSDB Total traffic sign

images =

7000
https://www.kaggle.com/meowmeowmeowmeowmeow/gtsrb-german-traffic-
sign - Link for the dataset in kaggle

Among these, the most common dataset is the GTSRB (German Traffic Sign
Recognition Benchmark) dataset. The reason for its popularity is:

It consists of large number of images

1. The traffic signs are of different variety, background, and colour variation
which in turn will help the model to perform accurately.
As the GTSRB dataset can be used for both detection as well as classification,
the proposed system makes use of the same. The dataset is further split into
training, testing and validation dataset. The training dataset is the one which is
used to train the model. The validation dataset, in general, is used to evaluate
the model and update the hyper parameters. Hyper parameters are used to
control the learning process and improve the accuracy, for example, number of
epochs, the choice of activation function. The test dataset is only used once the
model is trained. It is used to check whether the model can make correct
predictions or not.
 CNN MODEL (Convolutional neural network)

It’s a type of artificial neural network used primarily for image recognition and
processing , due to its ability to recognize patterns in images.

HAAR Cascade xml file

Open CV – it’s a python library that allows us to perform image processing
and computer vision tasks. It provides a wide range of features including
object detection, face recognition etc.

Haar cascade is an algorithm that can detect objects in images, irrespective

of their scale in image and location. Haar cascades are XML files that can
be used in OpenCV to detect specified objects

Identifying a custom object in an image is known as object detection. This

task can be done using several techniques, but we will use the haar
cascade, the simplest method to perform object detection in this article.

Haar cascades were first introduced in 2001, and it was one of the most
popular object detection algorithms in OpenCV.

We can create haar cascades or we can download then from google also.

Code
RESULTS AND DISCUSSIONS
Traffic sign classification is the process of automatically recognizing traffic
signs (like speed limit, yield, and caution signs, etc.) and accordingly classifies
them as to which class they belong to. The project has two main functionalities:
Prediction on the newly generated dataset and live web cam traffic sign
detection.

The traffic sign when shown from the web cam, automatically classifies the
symbol and shows the corresponding class ID and the sign name.

classification purpose is very minimal as compared to other existing systems.

Thus, the hardware cost along with the maintenance is drastically reduced.
 LIMITATIONS

Although, there are many advantages of traffic sign classification, there are
certain difficulties as well. It may happen that the traffic sign is hidden behind
the trees or any board at the road side which may cause the inaccurate detection
and classification of traffic sign. Sometimes it may happen that the vehicle went
so fast, that it did not detect the traffic sign. This may be dangerous and can lead
to accidents. There is a need for further research to deal with these issues
 FUTURE SCOPE

Traffic Signs are useful to all the individuals who are driving a vehicle on the
road. Traffic Signs guide the drivers for following all the traffic rules and avoid
any disruption to the pedestrians. The environmental constraints including
lighting, shadow , distance (sign is quite far), air pollution, weather conditions
in addition to motion blur, and vehicle vibration which are common in any real
time system may affect the detection and thus the classification. Hence, there is
a need for further research and advancements to deal with these issues. Also,
there are certain traffic signs that may not be predicted accurately. For this,
augmentation and one hot encoding techniques can be used. Augmentation
involves shifting of the image, zoom in and rotate the images (if required).

This system helps the driver to observe the sign close to his / her eyes on the
screen. This saves the time and efforts in manually checking whether any traffic
sign board is there, identifying what type of sign it is and act accordingly.
Traffic Sign Classification, thus, has a wide application in building smarter cars
like automatic driving cars, where the system automatically detects, recognizes
a traffic sign and displays it.
 CONCLUSION

In this project, we created a CNN model to identify traffic signs and classify
them with 95% accuracy. We had observed the accuracy and loss changes over
a large dataset. GUI of this model makes it easy to understand how signs are
classified into several classes.
 REFERENCE

 Google
 Geeks for geeks
 Kaggle
 Github
 Youtube