Traffic Report
Traffic Report
Submitted By
AJAY P R [1JV20CS001]
MOHAMMED FARAZ ULLA [1JV20CS008]
SHARIFF
NITHYASHREE [1JV20CS010]
SHAIK FARDHIN AHAMAD [1JV20CS011]
CERTIFICATE
Certified that the Phase-1 Project work entitled “Vision-Based System Design and
Implementation for Accident Detection and Analysis via Traffic Surveillance Video” carried
out by AJAY P R [1JV20CS001], MOHAMMED FARAZ ULLA SHARIFF
[1JV20CS008], NITHYASHREE [1JV20CS010], SHAIK FARDHIN AHAMAD
[1JV20CS011] are bonafide students of Jnana Vikas Institute of Technology in partial
fulfilment for the award of the degree of Bachelor of Engineering in Computer Science and
Engineering of the Visvesvaraya Technological University, Belagavi during the year 2023-
24. It is certified that all corrections/suggestions indicated for Internal Assessment have been
incorporated in the report deposited in the department library. The project report has been
approved as it satisfies the academic requirement in respect of project work prescribed for the
said degree.
1. ________________ _________________
2. ________________ _________________
JNANAVIKAS INSTITUTE OF TECHNOLOGY
BIDADI-562109
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING
DECLARATION
We, AJAY P R [1JV20CS001], MOHAMMED FARAZ ULLA SHARIFF [1JV20CS008],
NITHYASHREE [1JV20CS010], SHAIK FARDHIN AHAMAD [1JV20CS011] students
of 7th semester B.E in Computer Science And Engineering, Jnana Vikas Institute of
Technology, Bidadi, hereby declare that the Phase-1 Project work entitled “Vision-Based
System Design and Implementation for Accident Detection and Analysis via Traffic
Surveillance Video” has been carried out by us and submitted in partial fulfilment of the course
requirements for the award of degree of Bachelor of Engineering, from Visvesvaraya
Technological University during 2023- 2024 is a record of an original work done by us under
the guidance of Prof. NIVEDITHA S, Assistant Professor in Department of Computer Science
and Engineering, JVIT, Bidadi. The results embodied in this work has not submitted to any
other University or Institute for the award of any degree.
AJAY P R
USN: 1JV20CS001
Department of Computer Science and Engineering,
Jnana Vikas Institute of Technology
Bengaluru-562109 Signature of the Student
NITHYASHREE
USN: 1JV20CS010
Department of Computer Science and Engineering,
Jnana Vikas Institute of Technology
Bengaluru-562109 Signature of the Student
A Project work is a job of great enormity and it cannot accomplish by an individual all by
them. Eventually I am grateful to a number of individuals whose professional guidance,
assistance and encouragement have made it a pleasant endeavour to undertake this seminar
work.
I have great pleasure in expressing my deep sense of gratitude to founder Sir C.M
Lingappa, Chairman for having provided us with a great infrastructure and well- furnished
labs.
I would like to express my heart full thanks to Prof. NIVEDITHA S, Head of the
Department, Computer Science and Engineering who has guided me in all aspects.
I would like to extend my thanks to my guide Asst. Prof. NIVEDITHA S, who has guided
me in all aspects. I am grateful for his unfailing encouragement and suggestion, given to
me in course of my project works.
I would like to thank to my Family and Friends for their unforgettable support and
encouragement.
AJAY P R
MOHAMMED FARAZ ULLA SHARIFF
NITHYASHREE
SHAIK FARDHIN AHAMAD
i
ABSTRACT
In this work, we aim to investigate the problem of detecting and analyzing traffic
accidents automatically and effectively through surveillance videos and implement the whole
framework on an AI demo board. First, the technique of motion interaction field (MIF) that has
the potential to detect crashes in a video is adopted to locate the crashed vehicles based on the
interactions between multiple moving objects. Second, the YOLO v3 model is employed to
identify the crashed vehicles within the appropriate location. In order to recover the vehicle
trajectories before the collision, a hierarchical clustering approach is used, and the
corresponding trajectories are obtained. Third, to facilitate the judgment of traffic police, the
trajectory is projected to a vertical view by using a perspective transformation. The vehicle
velocity is estimated accordingly with the unbiased finite impulse response (UFIR) approach
that does not require statistical knowledge of the external noise. Then, the estimated velocity
and the obtained collision angle from the vertical view can be utilized to analyze the traffic
accident. Finally, to show the effectiveness and implementation performance of the proposed
approach, an experiment is carried out based on a Huawei AI demo board named HiKey970
that is used for coding all the mentioned algorithms. Several accident surveillance videos act
as the input of the demo board. The accidents are detected successfully, and the corresponding
vehicle trajectories are recovered.
ii
TABLE OF CONTENTS
DETAILS Page No.
ACKNOWLEDGEMENT i
ABSTRACT ii
TABLE OF CONTENTS iii
LIST OF FIGURES iv
Chapter 1 INTRODUCTION 1
1.1 Introduction 1
1.2 Motivation 3
1.3 Problem Definition 3
REFERENCES
iii
LIST OF FIGURES
Figure No. Name of the Figure Page No.
1.1.1 Components of Traffic Management Centre 1
1.2.1 Scenarios depicting traffic accidents 3
1.3.1 Overview of the accident detection system 4
3.1.1 Block diagram of the proposed accident detection system 7
4.2.1 Architectural diagram of Accident Detection 10
4.3.1 Data Flow Diagram 11
4.4.1 Class Diagram 11
4.5.1 Use Case Diagram 12
4.6.1 Sequence Diagram 13
iv
Accident Detection and Analysis via Traffic Surveillance Video 2023-24
CHAPTER 1
INTRODUCTION
1.1 INTRODUCTION
Over the past few decades, the significance of utilizing technologies for traffic monitoring
has increased. Crash detection is heavily dependent on human oversight at the traffic
management centre (TMC). On the one hand, it is difficult for people to promptly recognize all
traffic accidents in the city, which means that the injured may not receive adequate treatment
in many instances. On the other hand, because it is difficult to obtain the trajectory and speed
from surveillance footage, manual investigation of the cause of a traffic accident occasionally
results in errors. Therefore, technologies that automatically recognize and analyse traffic
incidents are required. The below figure Vision-based collision detection systems have
advanced in three ways over the past two decades: modelling of vehicle interactions, vehicle
behaviour analysis, and patterns of traffic flow. To imitate regular traffic patterns, the first
strategy makes use of traffic restrictions derived from large data sets. When a vehicle's
trajectory departs from normal patterns, an accident occurs. However, the lack of collision
trajectory data in the real world makes it difficult to identify collisions. The second method
looks at vehicle motion metrics like speed, acceleration, and the distance between two vehicles
This suggests that all vehicles should be watched constantly. Consequently, processing
capacity typically limits the method's accuracy in a crowded traffic environment. In the third
approach, vehicle interactions are depicted using the intelligence driver model and the social
force model. The methods of vision-based accident detection in the past two decades have been
developed in three ways: modelling of traffic flow patterns, analysing vehicle activities, and
modelling of vehicle interactions.
In the first method, the typical traffic patterns are modelled based on traffic rules from
large data samples. If the trajectory of a vehicle is inconsistent with typical trajectory patterns,
it would be determined as an accident. However, it is difficult to detect collisions because the
trajectory data of collisions in the real world is limited. The second method detects accidents
by calculating vehicle motion characteristics, such as speed, acceleration, and distance between
two vehicles, which means that all vehicles need to be tracked continuously. As a result, the
accuracy of the method in a crowded traffic environment is usually limited by computational
capacity. In the third method, the interaction of vehicles is modelled with the application of the
social force model and the intelligence driver model.
This method requires a lot of training samples, and the performance is poor since it
detects collision based on the change of vehicle speed only. One of the widely used applications
of traffic surveillance systems is vehicle detection and tracking. By detecting and tracking
vehicles, we can detect vehicle’s velocity, trajectory, traffic density, etc. and if there is any
abnormality, the recorded information can be sent to the traffic authorities to take necessary
action. The main advantage of the video monitoring systems over the existing systems such as
physical detectors that uses magnetic loops is the cost efficiency involved in installing and
maintaining these video systems, and also the aspect of 2 video storage and transmission to
analyse the detected events. Thus video-based traffic surveillance systems have been preferred
all over the world. Video surveillance systems are been used for security monitoring, anomaly
detection, traffic monitoring and many other purposes. Video surveillance systems have
decreased the need of human presence to monitor activities captured by video cameras. And
also, one of the advantages of visual surveillance systems is videos can been stored and
analysed for future reference. One of the important applications of video surveillance systems
is traffic surveillance. Extensive research has been done in the field of video traffic
surveillance.
1.2 MOTIVATION
Several models based on deep learning have been presented for automatic traffic accident
detection. These methods require training with large amounts of data and use complex neural
networks to detect collisions in videos. However, limited by the amount of training data and
high computational costs, these frameworks are difficult to be implemented practically. In
addition, with the rise in the number of traffic surveillance videos, detecting and analysing
accidents throughout the whole city with a centralized system are difficult. It is necessary to
build a distributed architecture consisting of embedded devices deployed in every block of the
city. Therefore, a lightweight framework that can be implemented on embedded devices is
required.
balance between the speed of the system and the performance of the systems such as correctly
detecting accidents and also reducing false alarm rate.
For the last two decades researchers have spent quality time to develop different
methods that can be applied in the field of video-based traffic surveillance. Some of the
applications of video-based surveillance include vehicle tracking, counting the number of
vehicles, calculating vehicle velocity, finding vehicle trajectory, classifying the vehicles,
estimating the traffic density, finding the traffic flow, license plate recognition, etc. Of late the
focus of video-based traffic surveillance has shifted to detect incidents in roadways such as
vehicle accidents, traffic congestion, and unexpected traffic blocks. From researches and
surveys, it was found that there is more necessity to detect accidents in highways and roadway
intersections, as vehicle accidents causes huge loss to lives and property. Therefore, the
objective of video-based traffic surveillance of present is on accident detection in highways
and intersections such that necessary action can be taken promptly without losing any quality
time, so that lives of the injured can be saved. As discussed earlier another advantage of video-
based surveillance is that the incidents can be recorded and analysed for future reference and
also the videos can be sent to the traffic monitoring centre to clear traffic congestion and divert
the incoming traffic.
CHAPTER 2
LITERATURE SURVEY
The test for broadcasting, which is nearly identical to the free interpretation of events
in a program based on a certain number of cameras, has changed a lot in recent years. True
understanding structures have not been able to deconstruct complicated events on their own
until recently, and this research is still ongoing. TV handles from different comprehension
cameras all around the world are not checked predictably, delivering administration clumsy for
inconvenience, troubling attitude, or distraught hardship reprisal and help, which are all
troublesome issues in the affiliation. Consequently, this is a significant issue. These tracks help
students quickly understand real-world sciences related to post-occasion programs.
[2] Using the visual intervention influence of pavement marking for rutting mitigation—
Part II: Visual intervention timing based on the finite element simulation:
A colleague who was listening made the observation that the ability as seen with eyes
intervention has a strong tendency for propelling, that it reduces accomplishment wheel tracks,
stress from the group of concentration pushes, and push in slightly (Part I). This study presents
a secret bettering rate policy and supports an empty out prediction method in light of an
impelled part model. It also presents a three-stage mediation technique with expert ocular
arbitration assistance and a slight decrease in push in the create a space deformity rate twist is
used to evaluate the mediation times of three distinct known dirty-top procedures. The empty
important news is segmentally constant. SUPERPAVE's dull top has shown promise as a new
attack aid, but AC's ferocious top is actually well-taught. In a similar vein, the study found that
the confidence against shape change is inversely correlated with the amount of time it takes for
a form change to progress to the next stage (settled state). In a similar dark-top occurrence, the
invasion of the longitudinal grade slice occurs more quickly than the invasion of the level slant
fragment. The dark top angry-top's help history may also improve by 16-31% during a
negotiation phase.
[3] Synergies of electric urban transport systems and distributed energy resources in
smart cities:
In urban areas, transportation plans and foundations consume the most energy. These
frameworks are distinct enough to be noted (transportation and workplace environments).
However, their efforts to collaborate are frequently overlooked, preventing them from reaping
the anticipated rewards of organized cooperation and load-up. Taking into account energetic
private and public transit service forms like energetic automobiles and the subterranean
railway, this study presents a novel prioritized strategy for determining highest in rank shift
and systematizing distributed energy resources (DER) in a hidden domain. The valuable
advantages of this organized organization are the primary focus of this study, which is
appropriate. The belief is that the public transportation administration's lighting will delay the
terrible power that will be used in the batteries of electric vehicles (EVs) when it could have
been used for more trains or the actual EV. A few critical examinations in view of information
from a Madrid metro line and the confidential area have been introduced. According to the data
that were obtained, basic use conserves energy in a significant amount across the entire
construction, with the metro framework seeing the greatest reduction in power consumption.
[4] Motion interaction field for accident detection in traffic surveillance video
A novel approach to identifying vehicle accidents from their network of moving parts
is presented in this article. Since the expanded strategy for introducing item exchanges was
activated in one way, water waves found themselves in the position of one more exciting article
on the width experiences. Gaussian parts are used in a field design to depict the science of the
water surface utilizing the Motion Interaction Field (MIF). We can differentiate and limit traffic
occurrences without having to spend time testing vehicle following by utilizing the symmetric
components of the MIF. Our technology outperforms existing methods for identifying and
degrading traffic incidents, according to fundamental news.
[5] Bridging the past, present and future: Modelling scene activities from event
relationships and global rules:
The key factors that govern workouts over time and their discovery in complex
perceptual contexts are the focus of this study. As a result, we offer a novel topic model that
takes into account the two primary factors that influence these occurrences: 1) Which
occurrences may occur that are not entirely predetermined by global scene articulations'
openness; 2) Because of how close the environment is, decisions are made that mix growth
spurts that came before temporary postponements. These reciprocal bits are connected using a
matched unpredictable variable during the probabilistic age process to determine which of the
two norms is essential for each activity occurrence. Each model breaking point is Journal of
Survey in Fisheries Sciences 10(1) 2593-2600 2023 2595 obtained utilizing a fell Gibbs
assessment induction system. The ability of the model to differentiate brief cycles at various
scales is demonstrated by some of the datasets in the article: The setting-level initial appeal for
Markovian service and the new unions between practices that can be appropriated to predict
that venture will occur subsequent to another and the amount of respite that will accompany it
contribute to a complete awareness of the setting's vigorous element.
This test focuses on the mining of public spot program footage. A sophisticated Markov
Clustering Topic Model (MCTM) performs better than existing Unique Bayesian Association
models (like Well) and Bayesian subject models (like Dormant Dirichlet Part) in terms of
accuracy, content, and calculation competence. By purposefully separating visual times into
figures out, these exercises into global methods of dealing with acting, and then linking these
methods of dealing with acting across time, our method demonstrates important areas of power
for amazing.
CHAPTER 3
SYSTEM ANALYSIS
3.1 PROPOSED SYSTEM
The proposed system for Vision-Based System Design and Implementation aims to
enhance road safety through the utilization of advanced computer vision techniques for
accident detection and analysis. This innovative approach leverages traffic surveillance videos
to monitor and interpret the dynamics of vehicular movement. The system will employ state-
of-the-art image processing algorithms to identify potential accidents in real-time, such as
sudden collisions, erratic vehicle behaviour, or pedestrians in dangerous proximity to traffic.
Through the integration of machine learning models, the system will continuously learn and
adapt to diverse traffic scenarios, improving its accuracy over time. Upon detecting an incident,
the system will trigger immediate alerts to relevant authorities, emergency services, and even
nearby vehicles equipped with compatible communication systems. Furthermore, the system
will facilitate post-incident analysis by providing detailed reports, including the sequence of
events leading to the accident, contributing factors, and potential improvements to road
infrastructure or traffic management.
A Vision-Based System Design and Implementation for Accident Detection and Analysis via
Traffic Surveillance Video involves the utilization of advanced computer vision techniques to
enhance road safety and traffic management. This system integrates sophisticated algorithms
and machine learning models to analyse real-time video feeds from traffic surveillance
cameras, aiming to detect and assess road accidents promptly. The system typically employs
object detection and tracking algorithms to identify vehicles, pedestrians, and other relevant
entities in the video stream. By continuously monitoring the traffic scene, the system can detect
unusual patterns or events indicative of accidents, such as sudden changes in vehicle speed,
unexpected stops, or collisions.
Once an accident is identified, the system can trigger immediate alerts to relevant
authorities, emergency services, or traffic management centres. Additionally, the system may
capture and store footage surrounding the incident for further analysis and investigation. The
implementation of such a vision-based system requires a robust hardware infrastructure,
including high-resolution cameras, powerful processing units, and efficient storage solutions.
Furthermore, it necessitates the development and training of machine learning models tailored
to accurately recognize and classify various objects and behaviours within the traffic
environment.
The benefits of this system extend beyond accident detection, as it also facilitates post-
incident analysis. By examining the recorded video data, authorities can gain insights into the
factors contributing to accidents, such as traffic flow, weather conditions, and road
infrastructure. This information is invaluable for formulating targeted strategies to improve
road safety and mitigate the risk of future accidents. Overall, a Vision-Based System for
Accident Detection and Analysis via Traffic Surveillance Video represents a cutting-edge
approach to enhance road safety through the fusion of computer vision, machine learning, and
real-time monitoring technologies.
Designing a vision-based system for accident detection and analysis via traffic surveillance
video involves both hardware and software components. Here's a general outline of the
requirements for such a system
The specific requirements may vary based on the scale of the deployment, the complexity
of the environment, and any specific regulations or standards that need to be followed in the
targeted region.
CHAPTER 4
SYSTEM DESIGN
4.1 SYSTEM DESIGN
System architecture is a conceptual model that defines the structure and behaviour of the
system. It comprises of the system components and the relationships describing how they work
together to implement the overall system.
A DFD shows what kind of information will be input to and output from the system, how
the data will advance through the system, and where the data will be stored. It does not show
information about the timing of process or information about whether processes will operate in
sequence or in parallel unlike a flowchart which also shows this information.
Class diagram is a static diagram. It represents the static view of an application. Class
diagram is not only used for visualizing, describing, and documenting different aspects of a
system but also for constructing executable code of the software application. Class diagram
shows a collection of classes, interfaces, associations, collaborations, and constraints. It is also
as a structural diagram.
A use case diagram at its simplest is a representation of a user's interaction with the system
that shows the relationship between the user and the different use cases in which the user is
involved. A use case diagram can identify the different types of users of a system and the
different use cases and will often be accompanied by other types of diagrams as well.
While a use case itself might drill into a lot of detail about every possibility, a use case
diagram can help provide a higher-level view of the system. It has been said before that "Use
case diagrams are the blueprints for your system". They provide the simplified and graphical
representation of what the system must actually do.
A sequence diagram shows object interactions arranged in time sequence. It depicts the
objects and classes involved in the scenario and the sequence of messages exchanged between
the objects needed to carry out the functionality of the scenario. Sequence diagrams are
typically associated with use case realizations in the Logical View of the system under
development. Sequence diagrams are sometimes called event diagrams or event scenarios.
them, in the order in which they occur. This allows the specification of simple runtime scenarios
in a graphical manner.
[2] X. Zhu, Z. Dai, F. Chen, X. Pan, and M. Xu, “Using the visual intervention influence of pavement
marking for rutting mitigation— Part II: Visual intervention timing based on the finite element
simulation,” Int. J. Pavement Eng., vol. 20, no. 5, pp. 573–584, May 2019.
[3] C. F. Calvillo, A. Sánchez-Miralles, and J. Villar, “Synergies of electric urban transport systems
and distributed energy resources in smart cities,” IEEE Trans. Intell. Transp. Syst., vol. 19, no. 8,
pp. 2445–2453, Aug. 2018.
[4] K. Yun, H. Jeong, K. M. Yi, S. W. Kim, and J. Y. Choi, “Motion interaction field for accident
detection in traffic surveillance video,” in Proc. 22nd Int. Conf. Pattern Recognit., Aug. 2014, pp.
3062–3067.
[5] J. Varadarajan, R. Emonet, and J. Odobez, “Bridging the past, present and future: Modeling scene
activities from event relationships and global rules,” in Proc. IEEE Conf. Comput. Vis. Pattern
Recognit., Jun. 2012, pp. 2096–2103.
[6] T. Hospedales, S. Gong, and T. Xiang, “A Markov clustering topic model for mining behaviour in
video,” in Proc. IEEE 12th Int. Conf. Comput. Vis., Sep. 2009, pp. 1165–1172.
[7] W. Hu, X. Xiao, Z. Fu, D. Xie, T. Tan, and S. Maybank, “A system for learning statistical motion
patterns,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1450–1464, Sep. 2006.
[8] S. Sadeky, A. Al-Hamadiy, B. Michaelisy, and U. Sayed, “Real-time automatic traffic accident
recognition using HFG,” in Proc. 20th Int. Conf. Pattern Recognit., Aug. 2010, pp. 3348–3351.
Volume 12, Issue 01, Jan 2023 ISSN 2456 – 5083 Page 484.
[9] Y.-K. Ki, “Accident detection system using image processing and MDR,” Int. J. Comput. Sci. Netw.
Secur., vol. 7, no. 3, pp. 35–39, 2007.
[10] D. Zeng, J. Xu, and G. Xu, “Data fusion for traffic incident detector using D-S evidence theory
with probabilistic SVMs,” J. Comput., vol. 3, no. 10, pp. 36–43, Oct. 2008.
[11] R. Mehran, A. Oyama, and M. Shah, “Abnormal crowd behavior detection using social force
model,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 935–942.
[12] W. Sultani and J. Y. Choi, “Abnormal traffic detection using intelligent driver model,” in Proc.
20th Int. Conf. Pattern Recognit., Aug. 2010, pp. 324–327.
[13] H.-N. Hu et al., “Joint monocular 3D vehicle detection and tracking,” in Proc. IEEE/CVF Int.
Conf. Comput. Vis. (ICCV), Oct. 2019, pp. 5389–5398.
[15] H. Phat, D. Trong-Hop, and Y. Myungsik, “A probability-based algorithm using image sensors to
track the LED in a vehicle visible light communication system,” Sensors, vol. 17, no. 2, p. 347,
2017