Signal Traffic Optimization Using Control Algorithm in Urban Traffic Framework
Signal Traffic Optimization Using Control Algorithm in Urban Traffic Framework
02 (2022), 803-819
Research Article
a
PHD Student of Department of Electronic Engineering&Research Director of Department of Computer Engineering, Jeju
National University.
b
Assistant Professor of Department of Computer Engineering, Jeju National University, Jeju-si63243,Jeju,South Korea, (e-
mail: [email protected])
_____________________________________________________________________________________________________
Abstract: Increasing urbanization, rapid urban population growth and economic development are signs of society's rapid
development. There are increasing traffic problems in the city, which affect the city's normal function. This paper aims to
create a computational model to study vehicle queues on urban roads to control vehicle crashes, traffic volumes and average
vehicle delays. This model offers analysis at multiple intersections with traffic lights controlling vehicle queues based on fixed
time intervals. We defined our objective function as minimizing the queue length. We used the Matlab program to simulate the
proposed method. MPC-based traffic control can be implemented in any urban transportation network, but a modern traffic
controller and a proper measurement system are needed for that goal. Furthermore, we address this issue explicitly by
employing a sampled multi-agent system at the intersection. The intersections are considered independent agents, which share
information, and their stability is established independently. The simulations show the model predictive control in the
simulation results prove the effectiveness of the designed model predictive control based traffic control strategy and show that
the system can improve the network efficiency and cause reduces the lengths of cars.
Keywords: Traffic lights, multi-agent systems, urban traffic signal control,fixed time controller, model predictive control.
___________________________________________________________________________
1. Introduction
The congestion of traffic on roads is a well-known problem across the globe. On freeways, just as in urban
transportation networks, people face traffic jams every day. As rush hour approaches, the roads become saturated.
However, the traditional methods of controlling traffic flow are becoming less effective. Traffic in areas and
cities, particularly at intersections and roads connection, cause the formation of long queues of cars, leading to
expecting cars in line. However, metropolises have different programs to reduce traffic congestion, effective in
some cities. For example, bicycle can cause create traffic in an intersection, in urban areas where bicycle traffic is
increasing, the allocation of space for additional transportation methods is reevaluated. The goal is to quantify and
assess the potential impacts of developing an urban bicycle highway. This process presented bicycle highway
traffic quality thresholds that could be achieved by implementing bicycle traffic control measures, such as bicycle
coordination and passing time extension, described in official bicycle approaches (Grigoropoulos, G.et
al.,2021).The problem we consider here is the emergence of long queues behind traffic lights at intersections and
immoderate waiting for drivers to cross the intersections, leading to reduced safety, security health of people,
increased air pollution, society, and road accidents(Yen, C. C.et al. &Du, Y.2021) Modern transportation is
leading to increasing numbers of vehicles on the road. Although the number of cars is rising, the road capacity
cannot improve. Therefore, they have a limited capacity. For this reason, models need to be developed in which a
traffic control system is implemented and performing at the highest possible level while requiring the least
calculation time (Guilliard, I.et al.,2020 &Kuboth, S. et al.,2019).Indeed, an inappropriate control of traffic
lights which does not take into account the ongoing traffic situation surrounding the road intersection results in a
very poor traffic flow performance.The urban transportation system requires adequate solution methodologies.
The most exciting features of agents from a transportation point of view are cooperation, freedom, and
accountability. These features help in the implementation of intelligent traffic management and control systems
(Sankhyadhar, S.et al., (2020) &Zakharov, M.,et al (2020)).The expansion of urbanization, the increasing use
of private cars, and the lack of urban transportation infrastructure have increased urban travel time. This topic
causes people to be on the streets for a long time. Urban life has reduced clean air, noise pollution, and wasted
time these days. Queue length and fuel consumption increase are reasons for the weather becoming polluted. In
research related to traffic control, there has to be a correct understanding and realization of the traffic
system.Traffic control methods are primarily based on traditional control methods obtained by statistical and
experimental methods. The required parameters converted to a more specific control level in these studies. The
transmission system responsible for this high complexity of the structure includes parts that involve a large
amount of control, communication, computer, and operation and maintenance costs. Traffic control studies should
have a proper and complete understanding of the transmission system.Models and control methods are essential
for controlling dynamical systems to produce a preferred or optimal output while simultaneously demanding
minimal computing time. This work aims to develop an effective control modeling method to optimize traffic
network intersections. Research studies operating model predictive controllers have been conducted in many fields
(Ye, B. L.et al.,2019).The first study on the model predictive control (MPC) approached urban traffic control and
demonstrated that model predictive control was more effective in reducing the number of vehicles at
803
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
intersections.The model is dynamic and nonlinear, introducing an unconstrained model predictive control.
Additionally, model predictive control allows us to personalize parameters. A further benefit of predictive model
control is limiting green time and turning speeds for vehicles, providing secure intersection control
(Jamshidnejad, A.et al.,2016).To achieve the desired output, it is necessary to model the intersection traffic
system in more detail and design powerful controllers that allow the desired response, which reduces the number
of vehicles in the intersections. It has led to a lot of research on intersection traffic systems.As shown, Figure. 1
presents the proposed overview of the method. This multi-agent model has been used for eight intersections in
traffic control and reduces the queue length using predictive control. We used a dynamic model from a single
intersection in the first step in this figure. After that, we have proved stability with attention to the dynamic model
intersection. In the second step, to expand an intersection to 8 intersections, we proposed a multi-agent approach
in which intersections are connected. Ultimately, we want to reduce the queue length created at the intersections
by the offered model.
Figure.1 The suggested approach architecture.
This study suggests an urban traffic control method based on model predictive control. We aimed to optimize
vehicles traffic and reduce traffic jams at traffic lights. We introduce a computational model to study urban traffic
by model predictive control. The new system realizing control for traffic lights was designed for the test,
depending on the traffic condition and operating urban traffic control techniques to predict the green time. The
offered system is linear equations; first, we used a dynamic model linear an intersection, and condition evolution
equations for the system are linear. Thus, we offer a model predictive model for proofing stability. The MPC-
based strategy optimizes the traffic network by minimizing the number of vehicles. We consider a multi-agent
model in the combined multi intersection; then, we got a new equation with attention to a multi intersection.We
operate only linear dynamics as part of the presented model predictive control framework to achieve this result.A
model has been developed to predict queuing dynamics through links while maintaining the linearity of the state
evolution equations.The proposed MPC framework smartly provides a description and an efficient simulation of
traffic behavior using only linear dynamics.
2. Problem Statement
Developing an effective control system and simulating a physical process requires modelling a system.
According to the study, the following is its objective: the study proposes two-phase models of vehicle behaviour
at eight intersections during urban traffic, the intersection model is tested and simulated in traffic conditions, in
addition to reducing the number of cars waiting behind a red light, a predictive controller is designed to reduce
waiting times. The structure of the paper is organized as follows. First, discuss the related work in Section (i).
The details of the proposed method are presented in Section (ii). Then the stability analysis is mentioned in
Section (iii); we verify the effectiveness of our proposed method via simulations in Section (iv). We conclude the
paper and point out some future work remarks in Section (v).
804
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
3.Literature Review
The application of model predictive methods has recently become increasingly popular in traffic signal
optimization and control. Traffic situations are unexpected, so the method needs to model and adapt to the
environment. As a result, the traffic signal control model should enhance with predictive. Traffic signal
management with model predictive control is adjustable and dynamic and can be applied in unexpected
environments.
3.1. Model predictive control of urban traffic
Urban road networks with large traffic magnitudes stay a challenge to control. Aggregate dynamical
simulations of city-scale traffic allow the evolution of model-based perimeter control methods based on the
macroscopically fundamental diagram (MFD). A nonlinear model predictive perimeter control system has been
presented in this article to control and optimize economics using closed-loop stability by structure Sirmatel, I. I.,
&Geroliminis, N (2021).Control traffic signal coordination and control in urban traffic networks using
stochastic model predictive control (MPC); this essay presented a model predictive control framework. One of
the proposed stochastic model predictive control elements is that stochastic disturbances are considered and
uncertain traffic demands. The scheme aims to model uncertainty and avoid queue spillback in traffic networks.
As described above, this aims to minimize the queue length and the fluctuation of green time between any two
successive control steps Ye,Wu, Gao,Lu,Cao., &Zhu (2017)&Jafari, S., Shahbazi, Z., & Byun, Y. C.
(2021).The most effective way to use the available network capacity is to control traffic according to the traffic
conditions, including model-predictive control. They have demonstrated their computationally and performance-
wise efficiency in finding optimal solutions to optimization problems. A model-predictive control system
presented for an urban traffic network that solves the control optimization problem by utilizing a gradient-based
optimization approach Jamshidnejad, Papamichail, Papageorgiou., & De Schutter (2017).Traffic signals are
updated at regular intervals in most optimization-based traffic control systems. Based on the trade-off between
the control performance and the analysis efficiency, the length of the fixed update interval is decided. This article
suggested a distributed threshold-based event-triggered control strategy; due to independent triggers, traffic
signals are updated asynchronously by using model predictive control Wu, Li, Xi., & De Schutter (2020). In
Ye, Wu, Ruan, Li, Chen, Gao., & Chen (2019)has been presented a survey of predictive model control in urban
traffic. Over the past 20 years, model predictive control has been studied widely in traffic signal control since it
has a lot of benefits when modeling dynamic systems. The control of traffic signals by model predictive control-
based methods requires to be understood in depth. The presented article provides the rationale for using
predictive model control to control traffic signals. In addition, this article has been summarized recent
developments in model-predictive control-based traffic signal control systems for traffic coordination and control
within traffic networks. An application of coalitional model predictive control to freeway networks is discussed
in Chanfreut, P., Maestre, J. M., & Camacho, E. F. (2020). Using model predictive, a dynamic setting of
speed limits and ramp metering decreases the number of times drivers spend on the road. As a result of the
continued improvement of clustering techniques, their usefulness in controlling large-scale and spatially
dispersed systems discussed.
3.2. Urban traffic by Machine learning and other work
As a society, we face a growing problem of urban traffic congestion. This issue was resolved by building a
software-defined Internet of things with a proper traffic control scheme. Also, as a result, current traffic control
schemes fail to leverage the advances found in deep reinforcement learning with multi-agents. In Yang, J.,
Zhang, J., & Wang, H. (2020).proposed a software-defined internet of things via a multi-agent Deep
reinforcement learning approach algorithm for optimization, which has been presented traffic lights and vehicles
are controlled globally to enhance urban traffic control. InMao, Malaita., & Vu (2021) has been aimed to
identify the optimal traffic signal timing in signalized urban intersections under conditions with non-recurrent
traffic happenings. The challenge of optimizing control plans for severe experiences remains available. Control
plans are still not optimized when trying incidents happen; the problem is particularly acute when several lanes
or entire intersections are affected. The problem is particularly critical when several roads or complete
intersections are affected. A deep learning model presented to develop a traffic jam control system operating data
fusion for intelligent cities. Intelligent traffic flow predictions in smart cities have been created using the hybrid
model of convolutional neural networks and extended short-term memory architecturesKhan, S., Nazir, S.,
García-Magariño, I., & Hussain, A. (2021).Intersection security and efficiency depend on traffic signal control.
A novel adaptive multi-input and multi-output traffic signal control method has been proposed in this analysis.
Not only can this method decrease traffic delays and energy consumption, but it can also improve network-wide
traffic procedures Wang, Zhu, Hong, Wang, Tao., & Wang (2020).By utilizing cultured models, urban traffic
prediction can determine invisible patterns of traffic based on crucial historical mobility data and then predict
traffic situations in the future employing that knowledge. Deep learning emerges as a promising alternative to
traffic modelling due to its powerful representation learning and feature extraction abilities. This article presented
805
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
various traffic indicators predicted using deep learning Liu, Li, Wu., & Li (2018)&Shahbazi, Z., & Byun, Y.
C. (2022). For solving the urban traffic control, a deep reinforcement learning offered, which combines several
tricks to get a suitable control strategy within a reasonable amount of time utilizing the Deep reinforcement
learning algorithm. The subject has been fixed the traffic request design assumptionLin, Dai, Li., & Wang
(2018)&Jafari, S., Shahbazi, Z., Byun, Y. C., & Lee, S. J. (2022). The application of modern technologies
makes it possible for a transportation system to gather real-time data of specific traffic scenes, allowing traffic
control centres to enhance traffic efficiency. Based on such considerations, a variation of deep reinforcement
learning agents have been analysed, showing their performance in traffic conditions Zeng, J., Hu, J., & Zhang,
Y. (2018)&Khan, P. W., & Byun, Y. C. (2020). A set of variables from traffic characteristics has been used to
model traffic noise at intersections, traffic management, geometry, and pavement conditions. Regression models
were used to identify which factors contributed to modelling traffic noise at the urban trafficKhajehvand, M.,
Rassafi, A. A., &Mirbaha, B. (2021).This research used traffic signal scheduling and phase sequence control;
the algorithm techniques have been combined with general type-2 fuzzy logic sets at the urban traffic network.
The aim has been to minimize wait times and average queue lengths to enable smooth traffic flow. Furthermore,
state charts and object diagrams have shown the urban traffic network model Khooban, Vafamand, Liaghat,
&Dragicevic(2017).There has not been enough exploration of its potential application to advanced artificial
transportation systems. A traffic optimization system based on agent technology and fuzzy logic to manage road
traffic, prioritize emergency vehicles, and promote coordinated transportation methods in smart cities Ikidid, A.,
El Fazziki, A., &Sadgal, M. (2021).In Ramirez-Polo, Jimenez-Barros,Narvaez., &Daza(2022)signals and
traffic lights considered due to the number of vehicles in the streets and population in cities which increased and
directly has been impacted traffic on the roads. Thus to improve mobility in the intersections, are used an
optimization model that causes developed traffic lights for vehicles in high traffic areas. This technique has been
used to calculate the appropriate time of the traffic lights on one of the busiest and most congested roads to
reduce the time spent.Traffic models are applied to analyse historical and real-time traffic data to predict the
situation of urban traffic in the future. Traffic signal control has been a primary tool for urban traffic
management. This article is based on an urban traffic control system founded on traffic flow; the primary goal is
to minimize the number of vehicles for signalizing intersections in the road networkJiang, C. Y., Hu, X. M., &
Chen, W. N. (2021).
3.3.Urban traffic by multi agent
Urban traffic congestion, which has negatively affected the economy and environment for many decades, is a
global issue. The signal control system is a well-established but challenging engineering solution that decreases
traffic congestion by coordinating vehicle movements at intersections. Agent-based deep reinforcement learning
for large-scale traffic signal control checked the performance of congestion time and network delay presented
Wu, Wu, Shen, Telikani, Fahmideh& Liang (2022). A multi-agent system for optimizing urban traffic has
been presented, which; a hierarchical multi-agent system is used in managing an urban traffic system. However,
members are local agents representing intersections within the system. Attention to traffic accidents and morning
rush hour has been checkedFrance, J., &Ghorbani, A. A. (2003)&Shahbazi, Z., & Byun, Y. C. (2022). Recent
developments in multi-agent systems in the areas of consensus problems, formation control, flocking control,
among others which are based on the interaction level, find it challenging to perform intelligent collaboration due
to double rules of limited interaction abilities and systems Shi, P., & Yan, B. (2020).An interaction of dynamic
multi-agent systems at a macroscopic level presented. In a hybrid and scalable system, the agents can create
continuous-time networks, Petri Nets (PN) can create discrete-time networks, resulting in complex networks.
Several real-world streets and intersections have been used to evaluate the approach's performance Geronimo,
Martinez, Vazquez, Godoy., & Anaya (2021).
4. Traffic signal control based on multi-agent and model predictive control architecture
4.1.Multi-agent system (MAS) control
Multiple agents are coordinated to control complex systems through the multiple agent control system. The
term agent refers to an autonomous, cooperative, and initiative-oriented physical or abstract entity. Distributed
intelligent systems include multi-agent systems. Agents of the Multi-Agent Model can share information and
coordinate themselves to complete tasks. A Multi-Agent Model utilizes several agents with different functions
that coordinate and share information to accomplish a task.Multi-agent control system structure, see Figure.
2exhibit interactions between agents, in contrast to simple combinations of agents.
806
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
A modern city's traffic system is composed of hundreds of intersections, some of which are distant. Traffic
conditions in different network areas may significantly differ due to the huge urban network. The control of
traffic network signals uses multi-agent technology. According to the two frameworks of multi-agent systems,
there are two ways to construct the signal control system of a multi-agent urban traffic network Choy, M. C.,
Srinivasan, D., & Cheu, R. L. (2003). As shown in Figure. 3, an agent-controlled intersection described. At this
intersection of a road network, per agent chooses its actions autonomously or via another supervisory agent
system. The general goal of such distributed multi-agent architecture is to ensure that network-wide congestion is
reduced through coordinating signal control to predict traffic patterns in the future. When such agents constantly
control signals, the situation reaches an unlimited horizon. A distributed architecture that tries to approximate the
infinite horizon of traffic would be impossible due to the need to record every state of traffic going back in time
Recker, Ramanathan, Yu, & McNally (1995).
Figure.3The model of multi intersections based on multi-agent system.
807
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
5. Methodology
Model predictive control automates complex systems by using multivariable control and explicitly viewing
limitations. Traffic light cycles, we suppose time moves in discrete steps 𝑛 = 0, 1, 2, … .which based on a
discrete-time prediction model, the next state is defined as a function of the current state can be at time 𝑛 = 𝑛0 ,
current requests, and the current control vector are at time 𝑛 = 𝑛0 Each time model consists of a measured
current state to solve the optimal control issue and the predicted demand over a finite time horizon considered at
time 𝑛 = 𝑛0 , … , 𝑁 − 1 . Involving the system as a first control state can consider in the time 𝑛 = 𝑛0 .
Furthermore, for the next control state, the time can be 𝑛 = 𝑛 = 𝑛0 + 1. The optimization generates a sequence
of control vectors, though simply the first is used to the system. Following this, the optimal control issue is
solved similarly for the time horizons. The control vector is utilized as the only control vector to be applied to the
system information, as seen in Table. 1.
Table.1. Describe of discrete model.
Describe
Current state 𝑋 𝑘 , 𝑡𝑖𝑚𝑒: 𝑛 = 𝑛0
Control vector 𝑆 𝑘 , 𝑡𝑖𝑚𝑒: 𝑛 = 𝑛0 + 1
Prediction horizon 𝑁𝑃 , 𝑡𝑖𝑚𝑒: 𝑛 = 𝑛0 + 1
808
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
𝑋 𝑘 represents the network state vector, and 𝑆 𝑛 represents the control vector. According to the state of the
network, the number of vehicles is determined at different abstractions of locations based on two kinds of cars:
queue 𝑄 and signal traffic 𝑆 . Which each queue has the capacity 𝐾 𝜖 𝐾𝑄 , the highest number of cars in queue
𝑘, generally based on physical limitations.At first, we considered a single intersection that includes four roads.
(phase 1: legs 1 and 3, phase 2: legs 2 and 4). which the intersection dynamic system with attention an
intersection can be written as an Equation. 1 as input.
𝑋 𝑘 + 1 = 𝐴𝑋 𝑘 + 𝐵 𝑘 𝑆 𝑛 + 𝐶 𝑘 (1)
′
which X k = 𝑄1 , 𝑄2 , 𝑄3 , … , 𝑄𝑀 , n is the vector of variables of model. As an output of dynamic system
signal intersection can be written as an Equation. 2:
𝑌 𝑘 = 𝐶𝑋 𝑘 (2)
There are matrices𝐴, 𝐵, and 𝐶 coefficients and vectors, which as inputs in the single intersection. One of the
primary parameters in the flow traffic at an intersection is the length of cars in the queue, which is estimated with
Equation. 3:
𝑄𝑖 𝑘 + 1 = 𝑄𝑖 𝑘 + 𝑞𝑖 𝑛 − 𝑑𝑖 𝑛 𝑆𝑖 𝑛 (3)
Regarding enters of cars in the intersection, if the leg index isi = 1, 2,3, … , n. Additionally, the discrete intervals
are indexed byn = 0, 1. . . , N − 1. There is some information which we mentioned in the below Table.2.
Table.1. Explanation of signal intersection.
Explanation
𝑞𝑖 𝑛 The number of vehicles entering the queue.
𝑑𝑖 𝑛 The number of vehicles the queue.
Control signal:
𝑆𝑖 If 𝑆 = 1 refers to green.
If 𝑆 = 0 refers to red light.
With attention to a single intersection 𝑆(𝑛) = [𝑆1 (𝑛), 𝑆2 (𝑛), . . . , 𝑆𝑚 (𝑛)]𝑡 a control variables , the red light
𝑆1, 𝑆3 refers to in the first phase, and 𝑆2, 𝑆3 refers to green light in the second phase, as the states of signal
traffic (0,1,0,1). It also refers to the red light 𝑆2, 𝑆4 in the first phase, and 𝑆1, 𝑆3 refers to green light in the
second phase, as the states of signal traffic (1,0,1,0). The car's arrivals at every time interval can be assumed to
be consistent if 𝑇 is considered the discretized time interval and is short enough Azimirad, E.,et al.,(2010).
5.1.Modelization based on multi-agent intersections
This study assessed a regular traffic network with eight intersections, each signalized, to estimate the
evolutionary strategy. In the intersection, all approaches are two-way, and per link consists of three lanes.
Figure.3 shows a network diagram showing the entire network. As a link is built, the highest queue originated is
utilized as input data. Each intersection consists of the same parameters. The coefficient matrix is the same as the
intersection; the sole contrast is between the state-space equations, which contain the Kronecker effect. For the
further details about matrices of coefficients and vectors are equal 𝐴 = 𝐼𝑀 ⊗ 𝐴𝑖 𝑋 𝑘 and 𝐵 = 𝐼𝑀 ⊗
𝐵𝑖 𝑆𝑛 𝑋(𝑘) at the intersection. With using a multi-agent for linking multi-intersection, as input, a new state-
space equation can be written in the below Equation 4:
𝑋 𝑘 + 1 = 𝐼𝑀 ⊗ 𝐴𝑖 𝑋 𝑘 + 𝐵 = 𝐼𝑀 ⊗ 𝐵𝑖 𝑆 𝑛 + 1 (4)
The output of dynamic system multi intersection is given by Equation5:
𝑦 𝑘 = 𝐶𝑋 𝑘 (5)
Kronecker is displayed as ⊗ . This multiplication factor is on two matrices of optional size. Kronecker
multiplication can be expressed by multiplying matrix 𝐴 in all 𝐵 matrices. This multiplication has no displacement
property and is widely used in proving relationships in multi-factor systems. Kronecker multiplication is defined
as Equation 6:
𝐴 ⊗ 𝐵 = [ 𝑎𝑖,𝑗 𝐵] (6)
809
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
If the matrix 𝐴 is assumed to have dimensions 𝑚 × 𝑛 and the matrix 𝐵 is assumed to have dimensions 𝑝 × 𝑞
then the Kronecker 𝐴 ⊗ 𝐵 multiplication produces a matrix with dimensions 𝑚𝑝 × 𝑛𝑝 in Equation 7 :
𝑎11 𝐵 𝑎1𝑛
𝐴⊗𝐵 = (7)
𝑎𝑚1 𝐵 𝑎𝑚𝑚 𝐵
Suppose which define 𝐴 in Equation 8:
𝑎11 𝑎12 𝑎13
𝐴= 𝑎 𝑎22 𝑎23 (8)
21
𝐽 = 𝑚𝑖𝑛 𝑋 𝑡 𝑘 + 1 𝐴𝑋 𝑘 + 1 + △ 𝑆 𝑡 𝑛 𝐵 △ 𝑆 𝑛 (10)
𝑖=𝑛
A minimum cost function results in vehicles queuing at intersections waiting to cross. As a result, the green time
for the control signal compares to the state of the intersection.
Theorem:
A dynamic equation that fits the hypotheses presented in the preceding section. The main goal is to minimize the
cost function when the control input. With attention to Equation 1 and Equation 2 supply at the system's
dynamical makes all signals, including those formed in the closed-loop, uniformly bounded.
Proof:
On urban intersections, traffic lights are red. On green phases, the vehicles can enter or exit the intersection, which
state dynamic equation with matrices 𝐴 and 𝐵 are defined as follows in Equation 11:
∆𝑋𝑔,𝑟 (𝑘 + 1) 𝑞 ⊗ 𝐴𝑖 𝑞 ⊗ 𝐵𝑖 1
= 𝑖 ∆𝑋𝑔,𝑟 𝑘 + 1 + 𝑖 𝑆𝑔,𝑟 𝑛 + 11
𝑦𝑔,𝑟 (𝑘 + 1) 𝐶 0 0
The state feedback controller 𝑆(𝑛) is assumed to be a function of 𝑋(𝑘) with complete observations. With
attention to 𝑋(𝑘), the control needs to satisfy when in each time be n as follow in the Equation 12 :
𝑄𝑖 (𝑘)
≤0 (12)
𝑆𝑔,𝑟 (𝑛)
Now to prove optimal and stability introduced in this theorem that 𝑆(𝑛) to minimizes 𝐽 is found from the solution
of in Equation 13:
𝜕𝐽
=0 (13)
𝜕∆𝑆
Expand 𝐽 as in Equation 14:
𝑡
𝐽𝑚𝑖𝑛 = 𝜆Δ𝑋 𝑘 + 1 𝜆Δ𝑋 𝑘 + 1 +△ 𝑆 𝑛 𝑅 △ 𝑆 𝑛 = 0 (14)
To give in Equation 15:
810
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
𝜕𝐽𝑚𝑖𝑛
= Δ𝑋 𝑇 A𝑇 λ𝑇 𝜆𝐵 + Δ𝑆 𝑇 B 𝑇 λ𝑇 𝐵 + Δ𝑆 𝑇 𝑅Δ𝑆 = 0 (15)
𝜕∆𝑆
To obtain Equation 15 we substitute the above into Equation 16:
1
Δ𝑆 𝑇 = (16)
2(Δ𝑋 𝑇 Δ𝑋 𝑇 𝐼𝑀 ⊗ 𝐴𝑖 𝑇 𝜆𝑇 𝜆 𝐼𝑀 ⊗ 𝐵𝑖 + 𝐶𝑖𝑇 𝜆𝑇 𝜆
( 𝐼𝑀 ⊗ 𝐵𝑖 )( 𝐼𝑀 ⊗ 𝐵𝑖 𝑇 𝜆𝑇 𝜆 𝐼𝑀 ⊗ 𝐵𝑖 + 𝑅 + 𝑅𝑇
It completes the proof.
6. Simulation Results and Evaluation
The proposed traffic light control system was evaluated utilizing two traffic parameters in two different traffic
scenarios. MATLAB code was used to simulate the suggested model of predictive traffic control.A quadruple
length decrease standard is operated in simulation both in a fixed time frame and in a model predictive control
scenario as well as a sampling time of 𝑇 = 0.1 𝑠 is used. The following assumptions each intersection with four
legs and three lanes per leg, on the per road, vehicles reach unaided. Standard distribution is used to generate
arrivals based on the inter-arrival of cars. The values reflected traffic situations with additional times. With
attention to different traffic conditions, considered the position of traffic, non-saturation, saturation,
supersaturation, and in a stable. This predictive model uses random and distributed parameters 𝑞𝑖 and 𝑑𝑖 and the
value of 𝜆 is between 0 and 1. The below model is explained without a controller.
6.1.Constant time based on multi intersection
In this part, the model predictive control is compared to the fixed time control. The simulation results for the
number of vehicles in the queue without controller actions in fixed time control are followed. Figure. 5 shows
that car numbers have remained relatively constant during the initial phase. Compared to the adjacent second and
fourth legs, the number of vehicles in the third leg sees a higher traffic volume.
Figure.5Performance evaluation of the number of vehicles in the first intersection without controller.
As shown in the Figure.6, the length of the queue of vehicles in the first leg raised, then the number of cars in
the second leg utilized to fixed time control increased; in the third leg of the intersection, the number of vehicles
increased. As a result, in Figure. 6the length of the queue of vehicles in the fourth leg is more than with
comparing other legs in the intersection.
811
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
This Figure. 7shows the number of vehicles in the third intersection without model predictive control; the
number of cars on the first leg is that the queue of cars is increasing. However, the queue of cars in the second
and third leg has been fixed after a while. The traffic magnitude in the fourth leg is more than that of other legs in
the intersection.
Figure.7Analyze the number of cars without the controller in the third intersection.
The fourth intersection without controller shows in Figure. 8, as a result, at first, the queue numbers of cars at
the first leg in the fourth intersection is fixed and does not also fluctuate the second leg of the fourth intersection
is fixed and does not fluctuate. Then due to a decrease over time, the number of vehicles in the third leg will
stabilize. In the fourth leg of the fourth intersection, the traffic volume has been increased as shown in Figure. 8.
Figure.8Analyzing queue lengths with fixed-time controllers at the fourth intersection.
Here, the simulation showed that the fifth intersection that the number of vehicles has increased in the first
leg without using a predictive model controller; in the second leg, the queue of cars is fixed. Still, the queue of
many vehicles will be proved in the third leg after a while. The traffic volume on the fourth leg raised at the fifth
intersection is more increased than the other legs, as shown in Figure.9.
812
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
Figure.9The fixed-time controller performs the number of queue lengths at the fifth intersection.
The number of vehicles under traffic light in the sixth intersection without a predictive model controller at the
first line increased the number of cars under the traffic light. Still, as you see, the number of vehicles under
traffic light on the second leg and the third is fixed and does not fluctuate. The outcome showed that the number
of cars under traffic lights on the fourth line traffic dimensions reduced as shown in Figure. 10.
Figure.10The performance number of vehicles in the sixth intersection based on fix time controller.
Figure. 11shows the queue length in the seventh intersection without the predictive controller. During the
constant time, the number of vehicles is depicted. The simulation shows the queue length of cars fixed in the first
leg has been proven after a while. Furthermore, the number of cars in the second line has been established after a
period. While the volume of traffic in the fourth leg first increases and then decreases. Indeed, the fixed time
controller has been demonstrated a significant performance loss compared to model predictive control.
Figure.11The number of cars at the seventh intersection evaluate by using a fixed-time controller.
The eighth intersection in Figure. 12 has been shown. As seen in the first leg in the eighth intersection, there
is an increasing traffic trend. Which this trend of traffic is in the third leg too. As a result of using predictive
model control, we expect a decrease. Furthermore, the second and fourth legs still have traffic, but the number of
legs drops after a while.
813
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
Figure.12Utilizing a fixed-time controller, the analyze the performance of queue lengths at the eighth
intersection.
Control of variables is the output of a controller. The variables that determine whether traffic lights are green
or red. Variables controlled for intersections are shown in Figure. 13. A model predictive control has even been
used to enhance the length of vehicles' queues at additional intersections. A demonstration of the predictive
controller's output is 𝑆𝑖 as the traffic system's control variable.
Figure.13shows control variables indicating green or red traffic lights. Similarly, the vehicle's queue length has
been shown at other intersections, which has improved by using a predictive controller. The proposed controller is
designed based on equations. The output of the predictive controller as the control variable𝑆𝑖 of the traffic system
was demonstrated as follows. The proposed model we explained with using model predictive control in the below
figures:
6.2.Stable Model Predictive Control Design on Multi intersection
Here we explained with using predictive model control and the variable controller output 𝑆𝑖 is as follows:
Figure.14Analysis of the number of cars in the first intersection using model predictive control.
As shown in Figure. 14, we used model predictive control for designing a multi intersection. The number of
vehicles standing in a line exhibited in the first line in the first intersection compared to the case without a
controller, the first stop queue did not change. On the second leg from the first intersection, the number of
814
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
vehicles in traffic a reduced. There was a significant decrease in the number of vehicles in the third line
compared to without control. However, as predicted from the results, the queue length has been drastically
reduced on the fourth leg. The MPC controller (model predictive control) predicts that the behavior of the
waiting vehicles would improve compared to the previous example without a controller. As a result, by using
model predictive control in the second leg from the second intersection, as seen in Figure. 15 the queue length
trend traffic has decreased compared to other legs.
Figure.15Model predictive control to analyze the queue lengths at the second intersection.
As predicted from the results in Figure.16, the number of cars line in the first leg has not changed from the
previous one without a controller. In the second leg of this intersection queue, cars have been able to move faster
as the length of the queue has been reduced. The length of the queue increased then decreased in the fourth leg
for the cars at this intersection. Compared without a controller, the number of vehicles at the third intersection is
now fixed; with comparison, the other legs have improved.
Figure.16Model predictive control to examine queue lengths at the third intersection.
Figure.17 shows the fourth intersection which as vehicles queued in the first leg, their length was initially
constant and then it increased, eventually decreasing. The number of vehicles from the second leg reduced, while
there was a significant reduction in the number of cars in the third and fourth legs. Therefore, the predictive
model controller has been performing well at intersections.
Figure.17The performance of queue lengths at the fourth intersection with model predictive control.
815
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
The number of vehicles standing in line is represented in the line at traffic lights using predictive model
control. However, the number of cars on the first and third roads the proposed method decreased significantly in
the second and fourth roads dropped to zero in the fifth intersection, as shown in Figure.18.
Figure.18Analysis the number of vehicles in the fifth intersection based on the model predictive control.
The sixth intersection is shown in Figure.19 at the start, the number of vehicles as a result in the simulation
the queue length of cars has increased then have been decreased. However, the length of the queue for the third
leg did not change significantly. In the second leg, the number of cars has been decreased. As seen, the fourth leg
has been reduced too. While third-leg in the sixth intersection experienced increased traffic, the number of
vehicles increased.
Figure.19Result of performance by using model predictive control at the sixth intersection with queue
lengths.
The number of standing vehicles at traffic lights is represented with predictive model control. This Figure.20
illustrates the number of vehicles at the seventh intersection. The length of the car queue has reduced in the
second leg; furthermore, in the third leg, trend traffic encounters a decrease in the length of the car queue.
Attention to simulation result of traffic trend in the fourth legs queue has reduced. We have noticed a
considerably more satisfactory effect.
Figure.20Model predictive control performance at the seventh intersection with considering the number of
cars queue lengths.
816
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
Figure.21 shows the number of vehicles entering the eighth intersection. After using predictive model control,
reduced queue length in the first leg and the third leg also as you have seen traffic trend reduced queue length
more the second and fourth legs.
Figure.21Using model predictive control, an evaluation of queue lengths at the eighth crossroad.
To summarize, in this work, we examine several intersections in this chapter to construct a multi-factor
system. We demonstrated the dynamic stability of several intersections in diagrams demonstrating the
relationship between characteristics. Based on the simulation results, we can also state that compared with fixed-
time control, the queue length of cars in each leg was reduced utilizing a predictive controller.
7. Discussion
After traffic models became available, advanced model-based controllers were developed to conform to urban
networks. In optimal control, the cost function is optimized based on the network model for a specific future time
horizon to find the optimal control measures for the whole urban network in the future. An urban traffic network
can be coordinated centrally utilizing optimal control methods. In this part, we discussed the comparison of the
proposed method with a fuzzy and predictive model for a single intersection as a discussion. The fuzzy controller
is first applied in a single intersection in the fuzzy method. In fuzzy systems, the input information can be
inaccurate, which is inaccurate using a fuzzy rule database. There is no specific method in designing fuzzy
control, the performance of the fuzzy system is highly dependent on the experience of the expert. In Azimirad,
E., et al., 2010it has been used a fuzzy logic control for traffic flows under both normal and exceptional traffic
conditions, and the dynamic model is not stable. But in the model predictive control, in addition to having all the
advantages of all intelligent methods, the superiority of the model-based predictive control over the rest of the
fuzzy control is its inherent predictive property. It does not depend on anything. Model predictive control also
has the intrinsic ability to compensate for dead time. But in fuzzy, it depends on the expert. Here Jafari, S.,et al.,
2021 considered only one intersection; in the proposed model, we added several intersections to one intersection.
Additionally, the results show the excellent performance of the proposed model.
8.Conclusion and Future Work
An algorithm suggested determining the order of green signals at multiple intersections. There is a signal
control system to determine the order of green signals at multiple intersections. Model predictive control has
been first developed for developing and controlling traffic signals at multi-agent intersections. The model
predictive control is designed based on the theory of multi-functional systems, and the effect of adjacent
intersections on their behavior is considered. There are two primary parameters in each phase: the length of the
queue and traffic signal traffic to reduce the number of queues at intersections, with the use of the state space
equations to design the model predictive control, the queue of vehicles per phase reduced in comparison via the
constant time model. Traffic trend in the intersections based on model predictive control has been maximized.
Results showed that the intersections method is efficient according to simulations. Research reported herein is
multidisciplinary, encompassing multiple fields such as multi-agent technology, optimization, and urban traffic
control. We proposed a method for traffic signal control at multiple intersections, which calls for large-scale
studies, including those in urban areas, by extending the range of traffic signal control. Also, as for future work,
further improvements will be pursued along with the following directions:
I. Multi-agent model predictive control framework test numerically and simulate on extensive
networks.
II. The integration of constraints on state variables in the multi-agent framework.
III. Estimating the uncertainty of the current traffic prediction system for determining the predicted.
IV. Impose traffic restrictions on pedestrians, weather situations, etc.
817
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
V. A kind of future work can check the controller with attention to conditions the level of congestion in
urban traffic such as infrastructure, travel speed, parking, intersections in the model have side roads,
etc.
References
Grigoropoulos, G., Hosseini, S. A., Keler, A., Kaths, H., Spangler, M., Busch, F., &Bogenberger, K. (2021).
Traffic Simulation Analysis of Bicycle Highways in Urban Areas. Sustainability, 13(3), 1016.
Yen, C. C., Ghosal, D., Zhang, M., &Chuah, C. N. (2021). Security vulnerabilities and protection algorithms for
backpressure-based traffic signal control at an isolated intersection. IEEE Transactions on Intelligent
Transportation Systems.
Guilliard, I., Trevizan, F., &Sanner, S. (2020). Mitigating the impact of light rail on urban traffic networks using
mixed-integer linear programming. IET Intelligent Transport Systems, 14(6), 523-533.
Kuboth, S., Heberle, F., König-Haagen, A., &Brüggemann, D. (2019). Economic model predictive control of
combined thermal and electric residential building energy systems. Applied Energy, 240, 372-385.
Yadav, S. P., Mahato, D. P., &Linh, N. T. D. (Eds.). (2020). Distributed Artificial Intelligence: A Modern
Approach. CRC Press.
Zakharov, M., Kirichek, R., Khan, P. W., Muthanna, A., &Koucheryavy, A. (2020). Analysis of Traffic
Generated During Molecular Analysis Based on The Internet of Things. International Journal of Advanced
Science and Technology.
Ye, B. L., Gao, H., Li, L., Ruan, K., Wu, W., & Chen, T. (2019, November). A MILP-based MPC Method for
Traffic Signal Control of Urban Road Networks. In 2019 Chinese Automation Congress (CAC) (pp. 3820-
3825). IEEE.
Jamshidnejad, A., Papamichail, I., Papageorgiou, M., & De Schutter, B. (2016). A model-predictive urban traffic
control approach with a modified flow model and endpoint penalties. IFAC-PapersOnLine, 49(3), 147-152.
Sirmatel, I. I., &Geroliminis, N. (2021). Stabilization of city-scale road traffic networks via macroscopic
fundamental diagram-based model predictive perimeter control. Control Engineering Practice, 109, 104750.
Ye, B. L., Wu, W., Gao, H., Lu, Y., Cao, Q., & Zhu, L. (2017). Stochastic model predictive control for urban
traffic networks. Applied Sciences, 7(6), 588.
Jafari, S., Shahbazi, Z., & Byun, Y. C. (2021). Traffic Control Prediction Design Based on Fuzzy Logic and
Lyapunov Approaches to Improve the Performance of Road Intersection. Processes, 9(12), 2205.
Jamshidnejad, A., Papamichail, I., Papageorgiou, M., & De Schutter, B. (2017). Sustainable model-predictive
control in urban traffic networks: Efficient solution based on general smoothening methods. IEEE
Transactions on Control Systems Technology, 26(3), 813-827.
Wu, N., Li, D., Xi, Y., & De Schutter, B. (2020). Distributed event-triggered model predictive control for urban
traffic lights. IEEE Transactions on Intelligent Transportation Systems, 22(8), 4975-4985.
Ye, B. L., Wu, W., Ruan, K., Li, L., Chen, T., Gao, H., & Chen, Y. (2019). A survey of model predictive control
methods for traffic signal control. IEEE/CAA Journal of AutomaticaSinica, 6(3), 623-640.
Chanfreut, P., Maestre, J. M., & Camacho, E. F. (2020). Coalitional model predictive control on freeways traffic
networks. IEEE Transactions on Intelligent Transportation Systems, 22(11), 6772-6783.
Yang, J., Zhang, J., & Wang, H. (2020). Urban traffic control in software defined internet of things via a multi-
agent deep reinforcement learning approach. IEEE Transactions on Intelligent Transportation Systems, 22(6),
3742-3754.
Mao, T., Mihăită, A. S., Chen, F., & Vu, H. L. (2021). Boosted genetic algorithm using machine learning for
traffic control optimization. IEEE Transactions on Intelligent Transportation Systems.
Khan, S., Nazir, S., García-Magariño, I., & Hussain, A. (2021). Deep learning-based urban big data fusion in
smart cities: Towards traffic monitoring and flow-preserving fusion. Computers & Electrical Engineering, 89,
106906.
Wang, H., Zhu, M., Hong, W., Wang, C., Tao, G., & Wang, Y. (2020). Optimizing signal timing control for large
urban traffic networks using an adaptive linear quadratic regulator control strategy. IEEE Transactions on
Intelligent Transportation Systems, 23(1), 333-343.
Liu, Z., Li, Z., Wu, K., & Li, M. (2018). Urban traffic prediction from mobility data using deep learning. Ieee
network, 32(4), 40-46.
Shahbazi, Z., & Byun, Y. C. (2022). Machine Learning-Based Analysis of Cryptocurrency Market Financial Risk
Management. IEEE Access.
Lin, Y., Dai, X., Li, L., & Wang, F. Y. (2018). An efficient deep reinforcement learning model for urban traffic
control. arXiv preprint arXiv:1808.01876. Zeng, J., Hu, J., & Zhang, Y. (2018, June). Adaptive traffic signal
control with deep recurrent Q-learning. In 2018 IEEE Intelligent Vehicles Symposium (IV) (pp. 1215-1220).
IEEE.
Jafari, S., Shahbazi, Z., Byun, Y. C., & Lee, S. J. (2022). Lithium-Ion Battery Estimation in Online Framework
Using Extreme Gradient Boosting Machine Learning Approach. Mathematics, 10(6), 888.
818
Turkish Journal of Computer and Mathematics Education Vol.13 No.02 (2022), 803-819
Research Article
Khan, P. W., & Byun, Y. C. (2020). Smart contract centric inference engine for intelligent electric vehicle
transportation system. Sensors, 20(15), 4252.
Khajehvand, M., Rassafi, A. A., &Mirbaha, B. (2021). Modeling traffic noise level near at-grade junctions:
Roundabouts, T and cross intersections. Transportation Research Part D: Transport and Environment, 93,
102752.
Khooban, M. H., Vafamand, N., Liaghat, A., &Dragicevic, T. (2017). An optimal general type-2 fuzzy controller
for Urban Traffic Network. ISA transactions, 66, 335-343.
Ikidid, A., El Fazziki, A., &Sadgal, M. (2021). A Fuzzy Logic Supported Multi-Agent System For Urban Traffic
And Priority Link Control. Journal of Universal Computer Science, 27(10), 1026-1045.
Ramirez-Polo, L., Jimenez-Barros, M. A., Narváez, V. V., &Daza, C. P. (2022). Simulation and Optimization of
Traffic Lights For Vehicles Flow in High Traffic Areas. Procedia Computer Science, 198, 548-553.
Jiang, C. Y., Hu, X. M., & Chen, W. N. (2021, May). An Urban Traffic Signal Control System Based on Traffic
Flow Prediction. In 2021 13th International Conference on Advanced Computational Intelligence (ICACI)
(pp. 259-265). IEEE.
Wu, Q., Wu, J., Shen, J., Du, B., Telikani, A., Fahmideh, M., & Liang, C. (2022). Distributed agent-based deep
reinforcement learning for large scale traffic signal control. Knowledge-Based Systems, 241, 108304.
France, J., &Ghorbani, A. A. (2003, October). A multiagent system for optimizing urban traffic. In IEEE/WIC
International Conference on Intelligent Agent Technology, 2003. IAT 2003. (pp. 411-414). IEEE.
Shahbazi, Z., & Byun, Y. C. (2022). Agent-Based Recommendation in E-Learning Environment Using
Knowledge Discovery and Machine Learning Approaches. Mathematics, 10(7), 1192.
Shi, P., & Yan, B. (2020). A survey on intelligent control for multiagent systems. IEEE Transactions on Systems,
Man, and Cybernetics: Systems, 51(1), 161-175.
Geronimo, M. F., Martinez, E. G. H., Vazquez, E. D. F., Godoy, J. J. F., & Anaya, G. F. (2021). A multiagent
systems with Petri Net approach for simulation of urban traffic networks. Computers, Environment and
Urban Systems, 89, 101662.
Choy, M. C., Srinivasan, D., &Cheu, R. L. (2003). Cooperative, hybrid agent architecture for real-time traffic
signal control. IEEE Transactions on Systems, Man, and Cybernetics-Part A: systems and humans, 33(5),
597-607.
Recker, W. W., Ramanathan, B. V., Yu, X. H., & McNally, M. G. (1995). Markovian real-time adaptive control
of signal systems. Mathematical and computer modelling, 22(4-7), 355-375.
Zhou, Z., De Schutter, B., Lin, S., & Xi, Y. (2015). Multi-agent model-based predictive control for large-scale
urban traffic networks using a serial scheme. IET Control Theory & Applications, 9(3), 475-484.
Azimirad, E., Pariz, N., & Sistani, M. B. N. (2010). A novel fuzzy model and control of single intersection at
urban traffic network. IEEE Systems Journal, 4(1), 107-111.
Jafari, S., Shahbazi, Z., & Byun, Y. C. (2021). Improving the Performance of Single-Intersection Urban Traffic
Networks Based on a Model Predictive Controller. Sustainability, 13(10), 5630.
819