WIRELESS COMMUNICATION AND INTERNET OF THINGS

TABLE OF CONTENTS

CHAPTER TITLE PAGE

NO. NO.
1 INTRODUCTION
1.1 HISTORY OF WIRELESS COMMUNICATION.
1.2. ADVANTAGES OF WIRELESS COMMUNICATION.
2-7
1.3 INTRODUCTION TO INTERNET OF THINGS
1.4 APPLICATIONS OF INTERNET OF THINGS.
1.5 OBJECTIVE

2 LITERATURE SURVEY 8-17

3 PROBLEM IDENTIFICATION AND PROPOSED 18-21
SOLUTION
4 CONCLUSION 22
REFERENCES 23-24

DEPT OF ECE, SISTK Page1

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

CHAPTER 1

INTRODUCTION

INTRODUCTION

Internet of Things (IoT) is the networking of physical objects that contain electronics
embedded within their architecture in order to communicate and sense interactions amongst each other or
with respect to the external environment. In the upcoming years, IoT-based technology will offer
advanced levels of services and practically change the way people lead their daily lives. Advancements
in medicine, power, gene therapies, agriculture, smart cities, and smart homes are just a very few of the
categorical examples where IoT is strongly established.

Wireless Communication is the fastest growing and most vibrant technological areas in the
communication field. Wireless Communication is a method of transmitting information from one point to
other, without using any connection like wires, cables or any physical medium. Generally, in a
communication system, information is transmitted from transmitter to receiver that are placed over a
limited distance. With the help of Wireless Communication, the transmitter and receiver can be placed
anywhere between few meters (like a T.V. Remote Control) to few thousand kilo meters (Satellite
Communication). We live in a World of communication and Wireless Communication, in particular, is a
key part of our lives. Some of the commonly used Wireless Communication Systems in our day – to –
day life are: Mobile Phones, GPS Receivers, Remote Controls, Bluetooth Audio and Wi-Fi etc.

Communication Systems can be Wired or Wireless and the medium used for communication can be
Guided or Unguided. In Wired Communication, the medium is a physical path like Co-axial Cables,
Twisted Pair Cables and Optical Fibre Links etc. which guides the signal to propagate from one point to
other.

Such type of medium is called Guided Medium. On the other hand, Wireless Communication doesn’t
require any physical medium but propagates the signal through space. Since, space only allows for signal
transmission without any guidance, the medium used in Wireless Communication is called Unguided
Medium.

DEPT OF ECE, SISTK Page2

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

Figure 1.1

1.1 HISTORY OF WIRELESS COMMUNICATION

Pre historic people used sign languages, smoke signals or flashing mirrors for long range communication
without the use of any physical medium i.e. “wireless”. Since then this type of communication is
continuously evolving. Now electric signals and radio waves are used for wireless communication.

In 1897 Marconi was the first to detect radio waves and use them in Wireless Telegraphy. Since then
a rapid growth of wireless technology has been witnessed which have replaced many wired systems like
conventional Telephone communication and Television transmission.

1.2 ADVANTAGES OF WIRELESS COMMUNICATION

♦ Cost – Installation charges and hassles of handling bulky wires and cables can be
eliminated.
♦ Mobility – It is one of the biggest advantages of wireless communication which allows a device to be
connected and still allowing the freedom to move.

♦ Reliability – Any communication failure due to breaking of wires or damage to these cables due to
environmental conditions is completely eliminated. In case of any natural disaster the damage to wireless
infrastructure is minimum.

DEPT OF ECE, SISTK Page3

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

Working of a Wireless Communication

The system basically consists of three elements – Transmitter, Channel and Receiver.

1.3 INTRODUCTION TO INTERNET OF THINGS:

Internet of Things (IoT) is the networking of physical objects that contain electronics embedded
within their architecture in order to communicate and sense interactions amongst each other or with
respect to the external environment. In the upcoming years, IoT-based technology will offer advanced
levels of services and practically change the way people lead their daily lives. Advancements in
medicine, power, gene therapies, agriculture, smart cities, and smart homes are just a very few of the
categorical examples where IoT is strongly established.
IoT is network of interconnected computing devices which are embedded in everyday objects,
enabling them to send and receive data.
Over 9 billion ‘Things’ (physical objects) are currently connected to the Internet, as of now. In the near
future, this number is expected to rise to a whopping 20 billion.

Main components used in IoT:

• Low-power embedded systems: Less battery consumption, high performance are the
inverse factors that play a significant role during the design of electronic systems.
• Sensors : Sensors are the major part of any IoT applications. It is a physical device that
measures and detect certain physical quantity and convert it into signal which can be provide
as an input to processing or control unit for analysis purpose.
1. Different types of Sensors :
2. Temperature Sensors
3. Image Sensors

DEPT OF ECE, SISTK Page4

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

4. Gyro Sensors
5. Obstacle Sensors
6. RF Sensor
7. IR Sensor
8. MQ-02/05 Gas Sensor
9. LDR Sensor
10. Ultrasonic Distance Sensor
• Control Units : It is a unit of small computer on a single integrated circuit containing
microprocessor or processing core, memory and programmable input/output
devices/peripherals. It is responsible for major processing work of IoT devices and all logical
operations are carried out here.
• Cloud computing: Data collected through IoT devices is massive and this data has to be
stored on a reliable storage server. This is where cloud computing comes into play. The data
is processed and learned, giving more room for us to discover where things like electrical
faults/errors are within the system.
• Availability of big data: We know that IoT relies heavily on sensors, especially in real-
time. As these electronic devices spread throughout every field, their usage is going to trigger
a massive flux of big data.
• Networking connection: In order to communicate, internet connectivity is a must where
each physical object is represented by an IP address. However, there are only a limited number
of addresses available according to the IP naming. Due to the growing number of devices, this
naming system will not be feasible anymore. Therefore, researchers are looking for another
alternative naming system to represent each physical object.

DEPT OF ECE, SISTK Page5

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

Figure 1.2

1.4 APPLICATIONS OF INTERNET OF THINGS:

1. Creating better enterprise solutions

Large enterprises have dedicated IT staff to create, maintain, and monitor their technology infrastructure.

• An IoT-backed security solution uses real-time data to provide mitigation tactics and

prevent cybersecurity attacks. It can even prepare incident responses and security policies

based on network activity.

• Another obvious application of the Internet of Things is decision-making based

on customer analytics. Never before have enterprises had so much real-time data to work

with.

• Information technology infrastructure library (ITIL) refers to detailed practices for IT asset

and service management.

2. Integrating smarter homes

The most visible application of the Internet of Things is a smart home. A smart home uses sensors to
control and maintain lighting, resource management, and security systems. A smart home is a smaller,
independent version of a smart city.

DEPT OF ECE, SISTK Page6

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

3. Innovating agriculture

• Sensors are used to provide details of soil chemistry and fertilizer profiles. CO2 levels,

moisture, temperature, level of acidity, and the presence of appropriate nutrients all contribute

to how good a harvest turns out to be.

• Smart irrigation is an IoT application to regulate and efficiently use water for farming. The

IoT system only initiates the water flow when the soil reaches a certain dryness level. It also

stops the supply once a certain level of moisture is reached. This reduces wastage caused by

human errors.

• Livestock tracking involves the use of RFID chips to keep track of an animal’s vitals,

vaccination details, and location.

• A smart greenhouse uses microclimate to raise crops instead of relying on changing

weather patterns. Sensors monitor and control all parameters and have automated systems for

light and water.

• Predication farming is the practice of using information collected over time to hone and

implement agricultural practices. The data provided by these sensors allow farmers to decide

on the ideal growth parameters and suitable fertilizers.

1.5 OBJECTIVE:

The main objective of the project is to control the traffic in the peak hours and dominate the traffic jams
and accidents by clearing the traffic without using man power.

DEPT OF ECE, SISTK Page7

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

CHAPTER 2

LITERATURE SURVEY

2.1 OBSERVATIONS MADE FROM PAPER 1

L. Jiang ping - Adaptive Traffic Signal Control Model on Intersections Based on Deep

Reinforcement Learning, [2020].

According to the research paper in 2021 titled ‘Controlling traffic signals to alleviate
increasing traffic pressure is a concept that has received public attention for a long time. However, existing
systems and methodologies for controlling traffic signals are insufficient for addressing the problem. To
this end, we build a truly adaptive traffic signal control model in a traffic micro simulator, i.e., “Simulation
of Urban Mobility” (SUMO), using the technology of modern deep reinforcement learning. The model is
proposed based on a deep Q-network algorithm that precisely represents the elements associated with the
problem: agents, environments, and actions. The real-time state of traffic, including the number of vehicles
and the average speed, at one or more intersections is used as an input to the model. To reduce the average
waiting time, the agents provide an optimal traffic signal phase and duration that should be implemented in
both single-intersection cases and multi-intersection cases. The co-operation between agents enables the
model to achieve an improvement in overall performance in a large road network. By testing with data sets
pertaining to three different traffic conditions, we prove that the proposed model is better than other
methods (e.g., Q-learning method, longest queue first method, and Webster fixed timing control method)
for all cases. The proposed model reduces both the average waiting time and travel time, and it becomes
more advantageous as the traffic environment becomes more complex.

2.2 OBSERVATIONS MADE FROM PAPER 2

M. Alexopoulus - Application of Deep Reinforcement Learning in Traffic Signal Control: An

Overview and Impact of Open Traffic Data. [2020].

According to the research paper in 2020 titled ‘ Persistent congestions which are varying
in strength and duration in the dense traffic networks are the most prominent obstacle towards sustainable
mobility. Those types of congestions cannot be adequately resolved by the traditional Adaptive Traffic
Signal Control (ATSC). The introduction of Reinforcement Learning (RL) in ATSC as tackled those types
of congestions by using on-line learning, which is based on the trial and error approach. Furthermore, RL
is prone to the dimensionality curse related to the state–action space size based on which a non-linear quality

DEPT OF ECE, SISTK Page8

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

function is derived. The Deep Reinforcement Learning (DRL) framework uses Deep Neural Networks
(DNN) to digest raw traffic data to approximate the quality function of RL. This paper provides a
comprehensive analysis of the most recent DRL approaches used for the ATSC algorithm design. Special
emphasis is set to overview of the traffic state representation and multi-agent DRL frameworks applied for
the large traffic networks. Best practices are provided for choosing the adequate DRL model, hyper-
parameters tuning, and model architecture design. Finally, this paper provides a discussion about the
importance of the open traffic data concept for the extensive application of DRL in the real world ATSC.

2.3 OBSERVATIONS MADE FROM PAPER 3

J.Sohn - Reinforcement Learning for Joint Control of Traffic Signals in a Transportation Network
[2020].

According to the research paper in 2020 titled ‘Reinforcement learning (RL) approaches have recently
been spotlighted for use in adaptive traffic-signal control on an area-wide level. Most researchers have
employed multi-agent reinforcement learning (MARL) algorithms wherein each agent shares a holistic
traffic state and cooperates with other agents to reach a common goal. However, MARL algorithms cannot
guarantee a global optimal solution unless the actions of all agents are fully coordinated. The present study
employs a RL algorithm that recognizes an entire traffic state and jointly controls all the traffic signals of
multiple intersections. With this approach, a deep Q-network (DQN) that depends solely on traffic images
is extended to overcome the curse of dimensionality that is associated with a large state and action space.
Several front layers in a deep convolutional neural network (CNN) to approximate the true Q-function are
shared by each intersection approach. Weight parameters connecting the last hidden layer to the output
layer are fixed. The proposed methodology outperforms a fixed-signal operation, a fully actuated signal
operation, a multi-agent RL control without coordination, and a multi-agent RL control with partial
coordination.

2.4 OBSERVATION MADE FROM PAPER 4

B. Wan - An Edge -Traffic Flow Detection Scheme Based on Deep Learning in an Intellige

Transportation System, [2021].

The research paper in 2021, An intelligent transportation system (ITS) plays an important role in public
transport management, security and other issues. Traffic flow detection is an important part of the ITS’.
Based on the real-time acquisition of urban road traffic flow information, an ITS provides intelligent
guidance for relieving traffic jams and reducing environmental pollution. The traffic flow detection in an

DEPT OF ECE, SISTK Page9

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

ITS usually adopts the cloud computing mode. The edge of the network will transmit all the captured video
to the cloud computing centre. However, the increasing traffic monitoring has brought great challenges to
the storage, communication and processing of traditional transportation systems based on cloud computing.
To address this issue, a traffic flow detection scheme based on deep learning on the edge node is proposed
in this article. First, we propose a vehicle detection algorithm based on the YOLOv3 (You Only Look Once)
model trained with a great volume of traffic data. We pruned the model to ensure its efficiency on the edge
equipment. After that, the Disport (Deep Simple Online and Realtime Tracking) algorithm is optimized by
retraining the feature extractor for multi object vehicle tracking. Then, we propose a real-time vehicle
tracking counter for vehicles that combines the vehicle detection and vehicle tracking algorithms to realize
the detection of traffic flow. Finally, the vehicle detection network and multiple-object tracking network
are migrated and deployed on the edge device Jetson TX2 platform, and we verify the correctness and
efficiency of our framework. The test results indicate that our model can efficiently detect the traffic flow
with an average processing speed of 37.9 FPS (frames per second) and an average accuracy of 92.0% on
the edge device..

2.5 OBSERVATIONS MADE FROM PAPER 5

R. Kok-Lim - Deep reinforcement learning for traffic signal control under disturbances: A case
study on Sunway city, Malaysia, [2020].

The research paper in 2020, In most urban areas, traffic congestion is a vexing, complex and
growing issue day by day. Reinforcement learning (RL) enables a single decision maker (or an agent) to
learn and make optimal actions in an independent manner, while multi-agent reinforcement learning
(MARL) enables multiple agents to exchange knowledge, learn, and make optimal joint actions in a
collaborative manner. The integration of the newly emerging deep learning and the traditional RL approach
has created an advanced technique called deep Q-network (DQN) that has shown promising results in
solving high-dimensional and complex problems, including traffic congestion. In this paper, DQN is
embedded in traffic signal control to solve traffic congestion issue, which has been plagued with the curse
of dimensionality whereby the representation of the operating environment can be highly dimensional and
complex when the traditional RL approach is used. Most importantly, this paper proposes multi-agent DQN
(MADQN) and investigates its use to further address the curse of dimensionality under traffic network
scenarios with high traffic volume and disturbances. To investigate the effectiveness of our proposed
scheme, a case study based on an urban area, namely Sunway city in Malaysia, is conducted. We evaluate
our scheme via simulation using a traffic network simulator called simulation of urban mobility (SUMO)
and a simulation tool called MATLAB. Simulation results show that our proposed scheme reduces the total
travel time of the vehicles.

DEPT OF ECE, SISTK P a g e 10

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

2.6 OBSERVATIONS MADE FROM PAPER 6

MA Gokce - State-of-art review of traffic signal control methods: challenges and

opportunities. [2020].

The research paper in 2020, ‘Due to the menacing increase in the number of vehicles on a daily basis,
abating road congestion is becoming a key challenge these years. To cope-up with the prevailing traffic
scenarios and to meet the ever-increasing demand for traffic, the urban transportation system needs
effective solution methodologies. Changes made in the urban infrastructure will take years, sometimes may
not even be feasible. For this reason, traffic signal timing (TST) optimization is one of the fastest and most
economical ways to curtail congestion at the intersections and improve traffic flow in the urban network.

2.7 OBSERVATIONS MADE FROM PAPER 7

MA Gokce - The traffic signal control problem for intersections, [2021].

According to the research paper in 2020, ‘The objective of this review is to provide a survey of
problems, methods, and practices in the evaluation of the ITSCP. In this paper, a unified terminology for
the ITSCP and a citation network of the current body of relevant research are accordingly presented, and
various assumptions, constraints, and solution approaches are summarized. A review across the entire body
of knowledge throughout the history of the ITSCP is therefore provided. This review also highlights open
issues and challenges that remain to be addressed by future research.

2.8 OBSERVATIONS MADE FROM PAPER 8

V. Gayah - Recent Advances in Reinforcement Learning for Traffic Signal Control: A Survey of
Models and Evaluation, [2021].

A paper in 2021, ‘Traffic signal control is an important and challenging real-world problem
that has recently received a large amount of interest from both transportation and computer science
communities’. In this survey, we focus on investigating the recent advances in using reinforcement learning
(RL) techniques to solve the traffic signal control problem. We classify the known approaches based on the
RL techniques they use and provide a review of existing models with analysis on their advantages and
disadvantages. Moreover, we give an overview of the simulation environments and experimental settings
that have been developed to evaluate the traffic signal control methods. Finally, we explore future directions
in the area of RL based traffic signal control methods. We hope this survey could provide insights to
researchers dealing with real-world applications in intelligent transportation systems

DEPT OF ECE, SISTK P a g e 11

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

2.9 OBSERVATIONS MADE FROM PAPER 9

E.Oner State-of - art review of traffic signal control methods: challenges and opportunities, [2020].

According to the research paper in 2020,Due to the menacing increase in the number of vehicles on
a daily basis, abating road congestion is becoming a key challenge these years. To cope-up with the
prevailing traffic scenarios and to meet the ever-increasing demand for traffic, the urban transportation
system needs effective solution methodologies. Changes made in the urban infrastructure will take years,
sometimes may not even be feasible. For this reason, traffic signal timing (TST) optimization is one of the
fastest and most economical ways to curtail congestion at the intersections and improve traffic flow in the
urban network. Researchers have been working on using a variety of approaches along with the exploitation
of technology to improve TST. This article is intended to analyze the recent literature published between
January 2015 and January 2020 for the computational intelligence (CI) based simulation approaches and
CI-based approaches for optimizing TST and Traffic Signal Control (TSC) systems, provide insights,
research gaps and possible directions for future work for researchers interested in the field.

2.10 OBSERVATIONS MADE FROM PAPER 10

WH Lee - Design and Implementation of a Smart Traffic Signal Control System for Smart City
Applications. [2020].

Infrastructure supporting vehicular network (V2X) capability is the key factor to the success
of smart city because it enables many smart transportation services. In order to reduce the traffic congestion
and improve the public transport efficiency, many intelligent transportation systems (ITS) need to be
developed. In this paper, a smart traffic signal control (STSC) system is designed and implemented, it
supports several smart city transportation applications including emergency vehicle signal pre-emption
(EVSP), public transport signal priority (TSP), adaptive traffic signal control (ATSC), eco-driving
supporting, and message broadcasting. The roadside unit (RSU) controller is the core of the proposed STSC
system, where the system architecture, middleware, control algorithms, and peripheral modules are detailed
discussed in this paper. It is compatible with existed traffic signal controller so that it can be fast and
cost−effectively deployed. A new traffic signal scheme is specially designed for the EVSP scenario, it can
inform all the drivers near the intersection regarding which direction the emergency vehicle (EV) is
approaching, smoothing the traffic flow, and enhancing the safety. EVSP scenario and the related control
algorithms are implemented in this work; integration test and field test are performed to demonstrate the
STSC system.

DEPT OF ECE, SISTK P a g e 12

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

2.11 OBSERVATIONS MADE FROM PAPER 11

SA Celtek - Real-time traffic signal control with swarm optimization methods [2020].

Real-time traffic signal control is the control methods that control the traffic signal according to the
instant traffic situation. In this paper, it is suggested to optimize the traffic control problem with the
swarm-based heuristic optimization algorithms. The proposed methods are tested with the real traffic data
obtained from Kilis city in Turkey. The performance is evaluated in real-time via the SUMO traffic
simulator. The obtained results are compared with the actual traffic measurement data, and the success of
the proposed method is expressed numerically. Finally, it is proved that the particle swarm optimization
algorithm and its variance algorithm could be used successfully to optimize the traffic signals control in
real traffic. In this study, Social Learning-Particle Swarm Optimization is used as a traffic signal
optimizer for the first time in the known literature.

2.12 OBSERVATIONS MADE FROM PAPER 12

YC Low - Deep Reinforcement Learning for Traffic Signal Control, [2020].

According to a paper in 2020, Traffic congestion is a complex, vexing, and growing issue day by
day in most urban areas worldwide. The integration of the newly emerging deep learning approach and the
traditional reinforcement learning approach has created an advanced approach called deep reinforcement
learning (DRL) that has shown promising results in solving high-dimensional and complex problems,
including traffic congestion. This article presents a review of the attributes of traffic signal control (TSC),
as well as DRL architectures and methods applied to TSC, which helps to understand how DRL has been
applied to address traffic congestion and achieve performance enhancement. The review also covers
simulation platforms, a complexity analysis, as well as guidelines and design considerations for the
application of DRL to TSC. Finally, this article presents open issues and new research areas with the
objective to spark new interest in this research field. To the best of our knowledge, this is the first review
article that focuses on the application of DRL to TSC.

2.13 OBSERVATIONS MADE FROM PAPER 13

M. Eom - The traffic signal control problem for intersections [2020].
According to research paper in 2020, The objective of this review is to provide a survey of problems,
methods, and practices in the evaluation of the ITSCP. In this paper, a unified terminology for the ITSCP
and a citation network of the current body of relevant research are accordingly presented, and various
assumptions, constraints, and solution approaches are summarized. A review across the entire body of

DEPT OF ECE, SISTK P a g e 13

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

knowledge throughout the history of the ITSCP is therefore provided. This review also highlights open
issues and challenges that remain to be addressed by future research.

2.14 OBSERVATIONS MADE FROM PAPER 14

M. Yang - A Decentralized Reinforcement Learning Framework for Efficient Passage of

Emergency Vehicles, [2020].
According to the research paper in 2021, Emergency vehicles (EMVs) play a critical role in
a city's response to time-critical events such as medical emergencies and fire outbreaks. The existing
approaches to reduce EMV travel time employ route optimization and traffic signal pre-emption without
accounting for the coupling between route these two subproblems. As a result, the planned route often
becomes suboptimal. In addition, these approaches also do not focus on minimizing disruption to the overall
traffic flow. To address these issues, we introduce EMV Light in this paper. This is a decentralized
reinforcement learning (RL) framework for simultaneous dynamic routing and traffic signal control. EMV
Light extends Dijkstra's algorithm to efficiently update the optimal route for an EMV in real-time as it
travels through the traffic network. Consequently, the decentralized RL agents learn network-level
cooperative traffic signal phase strategies that reduce EMV travel time and the average travel time of non-
EMVs in the network. We have carried out comprehensive experiments with synthetic and real-world maps
to demonstrate this benefit. Our results show that EMV Light outperforms benchmark transportation
engineering techniques as well as existing RL-based traffic signal control methods.

2.15 OBERVATIONS MADE FROM PAPER 15

S.Tripathi - IoT-based traffic prediction and traffic signal control system for smart
city [2021].

According to the research paper in 2021, Because of the population increasing so high, and traffic density
remaining the same, traffic prediction has become a great challenge today. Creating a higher degree of
communication in automobiles results in the time wastage, fuel wastage, environmental damage, and even
death caused by citizens being trapped in the middle of traffic. Only a few researchers work in traffic
congestion prediction and control systems, but it may provide less accuracy. So, this paper proposed an
efficient IoT-based traffic prediction using OWENN algorithm and traffic signal control system using Intel
80,286 microprocessor for a smart city. The proposed system consists of ‘5’ phases, namely IoT data
collection, feature extraction, classification, optimized traffic IoT values, and traffic signal control system.

DEPT OF ECE, SISTK P a g e 14

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

Initially, the IoT traffic data are collected from the dataset. After that, traffic, weather, and direction
information are extracted, and these extracted features are given as input to the OWENN classifier, which
classifies which place has more traffic. Suppose one direction of the place has more traffic, it optimizes the
IoT values by using IBSO, and finally, the traffic is controlled by using Intel 80,286 microprocessor. An
efficient OWENN algorithm for traffic prediction and traffic signal control using a Intel 80,286
microprocessor for a smart city. After extracting the features, the classification is performed in this step.
Hereabout, the classification is done by using the optimized weight Elman neural network (OWENN)
algorithm that classifies which places have more traffic. OWENN attains 98.23% accuracy than existing
model also its achieved 96.69% F-score than existing model. The experimental results show that the
proposed system outperforms state-of-the-art methods.

2.16 OBSERVATIONS MADE FROM PAPER 16

M.Vujic - An Overview of Reinforcement Learning Methods for Variable Speed Limit Control.
[2020].
According to the research paper 2020, Variable Speed Limit (VSL) control systems are widely
studied as solutions for improving safety and throughput on urban motorways. Machine learning
techniques, specifically Reinforcement Learning (RL) methods, are a promising alternative for setting up
VSL since they can learn and react to different traffic situations without knowing the explicit model of the
motorway dynamics. However, the efficiency of combined RL-VSL is highly related to the class of the
used RL algorithm, and description of the managed motorway section in which the RL-VSL agent sets the
appropriate speed limits. Currently, there is no existing overview of RL algorithm applications in the
domain of VSL. Therefore, a comprehensive survey on the state of the art of RL-VSL is presented. Best
practices are summarized, and new viewpoints and future research directions, including an overview of
current open research questions are presented.
2.17 OBSERVATIONS MADE FROM PAPER 17

G. Zheng - Context-Based Meta Reinforcement Learning for Transferrable Architecture Search.

[2020].
According to the research paper in 2020, Neural Architecture Search (NAS) achieved many
breakthroughs in recent years. In spite of its remarkable progress, many algorithms are restricted to
particular search spaces. They also lack efficient mechanisms to reuse knowledge when confronting
multiple tasks. These challenges preclude their applicability, and motivate our proposal of CATCH, a novel
Context-based meta reinforcement learning (RL) algorithm for transferrable architecture search. The
combination of meta-learning and RL allows CATCH to efficiently adapt to new tasks while being agnostic

DEPT OF ECE, SISTK P a g e 15

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

to search spaces. CATCH utilizes a probabilistic encoder to encode task properties into latent context
variables, which then guide CATCH’s controller to quickly “catch” top-performing networks. The contexts
also assist a network evaluator in filtering inferior candidates and speed up learning. Extensive experiments
demonstrate CATCH’s universality and search efficiency over many other widely-recognized algorithms.
It is also capable of handling cross-domain architecture search as competitive networks on ImageNet,
COCO, and Cityscapes are identified. This is the first work to our knowledge that proposes an efficient
transferrable NAS solution while maintaining robustness across various settings.

2.18 OBSERVATIONS MADE FROM PAPER 18

SH. Ahmed - Traffic signal control for smart cities using reinforcement learning, [2020].
According to the research paper in 2020, Traffic congestion is increasing globally, and this problem
needs to be addressed by the traffic management system. Traffic signal control (TSC) is an effective method
among various traffic management systems. In a dynamically changing and interconnected traffic
environment, the currently model-based TSCs are not adaptive. In addition, with the rise of smart cities and
IoT, there is a need for efficient TSCs that can handle large and complex data. To address this issue, this
study proposes a TSC system to maximize the number of vehicles crossing an intersection and balances the
signals between roads by using Q-learning (QL). The proposed system has a flexible structure that can be
modified to suit the changes in the original structure of the intersection.
2.19 OBSERVATIONS MADE FROM PAPER 19

H.Joo - Traffic signal control for smart cities using reinforcement learning, [2020].

According to a paper in 2020,Traffic congestion is increasing globally, and this problem needs to be
addressed by the traffic management system. Traffic signal control (TSC) is an effective method among
various traffic management systems. In a dynamically changing and interconnected traffic environment,
the currently model-based TSCs are not adaptive. In addition, with the rise of smart cities and IoT, there is
a need for efficient TSCs that can handle large and complex data. To address this issue, this study proposes
a TSC system to maximize the number of vehicles crossing an intersection and balances the signals between
roads by using Q-learning (QL). The proposed system has a flexible structure that can be modified to suit
the changes in the original structure of the intersection.

DEPT OF ECE, SISTK P a g e 16

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

2.20 OBSERVATIONS MADE FROM PAPER 20

M. Nazari - Universal Attention-Based Reinforcement Learning Model for Traffic Signal Control
[2020].
According to a paper in 2020, they proposed Attend Light, an end-to-end Reinforcement Learning
(RL) algorithm for the problem of traffic signal control. Previous approaches for this problem have the
shortcoming that they require training for each new intersection with a different structure or traffic flow
distribution. Attend Light solves this issue by training a single, universal model for intersections with any
number of roads, lanes, phases (possible signals), and traffic flow. To this end, we propose a deep RL
model which incorporates two attention models. The first attention model is introduced to handle different
numbers of roads-lanes; and the second attention model is intended for enabling decision-making with
any number of phases in an intersection. As a result, our proposed model works for any intersection
configuration, as long as a similar configuration is represented in the training set. Experiments were
conducted with both synthetic and real-world standard benchmark datasets. Our numerical experiment
covers intersections with three or four approaching roads; one-directional/bi-directional roads with one,
two, and three lanes; different number of phases; and different traffic flows. We consider two regimes: (i)
single-environment training, single-deployment, and (ii) multi-environment training, multi-deployment.
Attend Light outperforms both classical and other RL-based approaches on all cases in both regimes.

DEPT OF ECE, SISTK P a g e 17

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

CHAPTER 3

PROBLEM IDENTIFICATION AND PROPOSED SOLUTION

3.1 PROBLEM IDENTIFICATION:
WIRELESS HAND HELD REMOTE OPERATION OF TRAFFIC SIGNALS
Road traffic in India is termed to be highly heterogeneous which comprises of different types of
vehicles like buses, trucks, auto-rickshaws, bikes, scooters, cycles etc. comprising of wide range of static
and dynamic characteristics. Due to the high variations in its dimensions at its physical levels and speeds,
itis tedious to make these vehicles to follow traffic lanes and the vehicles generally occupy any convenient
lateral position on the road depending on the road space that is available for a given instance of time. Hence,
expressing traffic volume as number of vehicles for a specified section of road or traffic lanes per unit time
those are available terms to be inappropriate for vehicles related to different types with its static and
dynamic characteristics comprising in traffic, which generally varies for large extent.

Capacity of roads plays a vital role in assuming better network characteristics and in providing good
performance of roads. Capacity values play an important role for further modifications of roads. Various
geometric measures like carriage way width, sidewalks, service roads, verge, medians, and road reserve
and traffic patterns related to different roads. Passenger car equivalent (PCE) and Passenger car Unit(PCU)
are typically used for road capacity analysis with heterogeneous traffic conditions. Capacity analysis is
fundamental to the planning, design and operation of roads, and provides, among other things, the basis for
determining the carriageway width to be provided at any point on a road network with respect to the volume
and composition of traffic. Due to this circumstance, will occur problem such as accident, traffic speed
reduction etc.

3.2 PROPOSED SOLUTION:

We are proposing a new system for wireless traffic light controller, it makes a traffic policeman easily
and effective control a road junction with a wireless remote control. The system has two modes, Manual
and Automatic. Manual mode provide the control of traffic light to change manually by the traffic
policeman, by just press the button related to the direction of the street to make a green light signal. The
remote will respond by checking the bearing of the pressed button on the remote using Hall effects sensor
regarding to the position and direction of the remote. Then send the control signal to the traffic light
controller board. In automatic mode, the traffic light controller board will change the light sequence
according to the pre-set patterns and time delay ,the traffic policeman be able to change the pattern at any
time using the remote. The propose system help the policeman to control the junction by himself and be
able to change conditions of the traffic flow dynamically.

DEPT OF ECE, SISTK P a g e 18

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

Figure 3.1. BLOCK DIAGRAM OF PROPOSED SYSTEM

DEPT OF ECE, SISTK P a g e 19

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

Figure 3.2

DEPT OF ECE, SISTK P a g e 20

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

Figure 3.3
3.3 SOFTWARE AND HARDWARE MODULES TO BE USED
Hardware Requirements:
➢ Arduinomega2560.
➢ LCD.
➢ NODE-MCU wi-fi Module.
➢ RFID reader.
➢ RFID cards-2.
Software Requirements:
➢ Arduino IDE.
➢ Python.

DEPT OF ECE, SISTK P a g e 21

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

CHAPTER 4
CONCLUSION

This project is based on a very effective way of optimizing traffic, with redefinition of threshold values for
a real time application.

➢ This works to control traffic on four way roads according to traffic control barricades.
➢ This proposed system will be able to build a developed country with less traffic jams and it will also
help the emergency vehicle to reach in time to the destination. So, this intelligent system will help
us to control traffic in more autonomous way.
➢ The traffic authorities can also broadcast messages on VIP visits, medical emergencies, accidents,
etc. to corresponding message units, which will assist the public in decision making and save their
time on roads.
➢ The proposed model can help citizens to save their time based on the early-warning messages
displayed in the message unit, especially during peak hours.

DEPT OF ECE, SISTK P a g e 22

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

REFERENCES
[1]. Duowei, L.; Jianping, W.; Ming, X.; Ziheng, W.; Kezhen, H. Adaptive Traffic Signal Control
Model on Intersections Based on Deep Reinforcement Learning. J. Adv. Transp. 2020, 2020,14

[2]. Gregurić, M.; Vujić, M.; Alexopoulos, C.; Miletić, M. Application of Deep Reinforcement Learning in
Traffic Signal Control: An Overview and Impact of Open Traffic Data. Appl. Sci. 2020, 10, 4011.

[3]. Lee, J.; Chung, J.; Sohn, K. Reinforcement Learning for Joint Control of Traffic Signals in a
Transportation Network. IEEE Trans. Veh. Technol. 2020, 69, 1375–1387.

[4]. Chen, C.; Liu, B.; Wan, S.; Qiao, P.; Pei, Q. An Edge Traffic Flow Detection Scheme Based on Deep
Learning in an Intelligent Transportation System. IEEE Trans. Intell. Transp. Syst. 2021, 22, 1840–
1852.

[5]. Faizan, R.; Kok-Lim, A.Y.; Yeh-Ching, L. Deep reinforcement learning for traffic signal control under
disturbances: A case study on Sunway city, Malaysia. Future Gener. Comput. Syst. 2020, 109, 431–
445

[6]. State-of-art review of traffic signal control methods: challenges and opportunities SSSM Qadri, MA
Gökçe, E Öner - European transport research review, 2020.

[7]. The traffic signal control problem for intersections: a review ,M Eom, BI Kim - European transport
research review.

[8]. H Wei, G Zheng, V Gayah, Z Li - ACM SIGKDD Explorations Newsletter, 2021 –dl.acm.org… (RL).

[9]. State-of-art review of traffic signal control methods: challenges and opportunities. SSSM Qadri, MA
Gökçe, E Öner - European transport research review, 2020.

[10]. Design and implementation of a smart traffic signal control system for smart city applications,WH
Lee, CY Chiu - Sensors, 2020.

[11]. Real-time traffic signal control with swarm optimization methods,SA Celtek, A Durdu, MEM Alı -
Measurement, 2020.

[12]. Deep reinforcement learning for traffic signal control;F Rasheed, KLA Yau, RM Noor, C Wu, YC
Low - IEEE Access, 2020.

[13]. The traffic signal control problem for intersections: a review ,M Eom, BI Kim - European transport
research review, 2020.

DEPT OF ECE, SISTK P a g e 23

 WIRELESS COMMUNICATION AND INTERNET OF THINGS

[14]. Decentralized deep reinforcement learning for large-scale traffic signal controlC Chen, H Wei, N Xu,
G Zheng, M Yang… - Proceedings of the …, 2020 - ojs.aaai.org… RL-based traffic signal control
method to enable city-level traffic signal control.

[15]. IoT-based traffic prediction and traffic signal control system for smart city ,S Neelakandan, MA
Berlin, S Tripathi, VB Devi… - Soft Computing, 2021.

[16]. Application of deep reinforcement learning in traffic signal control: An overview and impact of open
traffic data ;M Gregurić, M Vujić, C Alexopoulos, M Miletić - Applied Sciences, 2020.

[17]. Metalight: Value-based meta-reinforcement learning for traffic signal control ,X Zang, H Yao, G
Zheng, N Xu, K Xu, Z Li - Proceedings of the AAAI …, 2020.

[18]. Traffic signal control for smart cities using reinforcement learning,H Joo, SH Ahmed, Y Lim -
Computer Communications, 2020

[19]. Traffic signal control for smart cities using reinforcement learning H Joo, SH Ahmed, Y Lim -
Computer Communications, 2020.

[20]. Universal attention-based reinforcement learning model for traffic signal control A Oroojlooy, M
Nazari… - Advances in Neural …, 2020

DEPT OF ECE, SISTK P a g e 24