Tech Sem Report 557
Tech Sem Report 557
A Technical seminar report submitted in partial fulfillment of the requirement for the award
of the degree of
BACHELOR OF TECHNOLOGY
IN
COMPUTER SCIENCE AND ENGINEERING
Dr Radha Seelaboyina
Associate Professor
By
i
Geethanjali College of Engineering and Technology (Autonomous)
Accredited by NAAC with A+ Grade : B.Tech. CSE, EEE, ECE accredited by NBA Sy. No: 33 & 34,
Cheeryal (V), Keesara (M), Medchal District, Telangana – 501301
CERTIFICATE
This is to certify that the B.Tech Technical Seminar report entitled “ Edge AI: Real-
Time Decision-Making” is a bonafide work done by Alle Sai Shivanandha
(21R11A0557), in partial fulfillment of the requirement of the award for the degree of
Bachelor of Technology in “Computer Science and Engineering” from Jawaharlal
Nehru Technological University, Hyderabad during the year 2024-2025.
Coordinator
Examiner(s)
ii
ACKNOWLEDGEMENT
It is with profound gratitude and sincere appreciation that I extend my heartfelt thanks to all
those who have played a significant role in the successful completion of this technical
seminar.
First and foremost, I express my deep sense of respect and gratitude to our Honourable
Chairman, Mr. G. R. Ravinder Reddy, for his constant encouragement and for nurturing
a culture of academic excellence and innovation within the institution.
I would also like to express my sincere thanks to Dr. S. Udaya Kumar, Director, for his
visionary leadership and continued support, which have provided the ideal environment and
motivation for academic enrichment through activities such as this seminar.
My heartfelt appreciation goes to Dr. K. Sagar, Principal, for his steadfast guidance,
infrastructural support, and motivation that have facilitated the successful presentation of this
seminar.
A special note of gratitude is reserved for my project guide, Dr. S. Radha, Associate
Professor, whose expert supervision, insightful suggestions, and dedicated mentorship have
been instrumental in shaping the direction and outcome of this work.
Lastly, I am ever grateful to my parents and family for their unconditional love, support,
and motivation. Their belief in me has been a source of strength and inspiration throughout
this journey.
With genuine appreciation, I acknowledge every individual who, in one way or another,
contributed to the successful completion of this technical seminar.
iv
LIST OF ABBREVIATIONS
2 AI Artificial Intelligence
3 ML Machine Learning
4 DL Deep Learning
5 VR Virtual Reality
6 MR Mixed Reality
8 5G Fifth Generation
9 6G Sixth Generation
v
TABLE OF CONTENTS
1 Introduction 1
2 Literature Survey 2
3 Objectives 4
4 Methodology 5
5 System Architecture 6
6 Implementation 8
7 Usecase 10
9 Future Scope 16
10 Conclusion 17
11 Bibliography 18
vi
1. INTRODUCTION
Edge Artificial Intelligence (Edge AI) is transforming the way intelligent systems operate
by enabling AI processing directly on edge devices, such as sensors, smartphones,
microcontrollers, and embedded systems. Unlike traditional AI models that rely heavily on
centralized cloud computing, Edge AI processes data locally at the source. This decentralized
approach reduces the reliance on cloud infrastructure and significantly minimizes latency in
decision-making processes. As a result, systems powered by Edge AI can respond to real-world
stimuli in real time, which is essential for time-sensitive applications across various industries.
One of the key advantages of Edge AI is its ability to enhance bandwidth efficiency. In
conventional cloud-based models, massive amounts of raw data are transmitted from edge devices
to remote servers for processing, which consumes a significant portion of available network
bandwidth. Edge AI mitigates this issue by analyzing and filtering data locally, sending only
relevant or summarized information to the cloud if necessary. This not only conserves bandwidth
but also reduces overall operational costs. Additionally, Edge AI contributes to data privacy and
security, as sensitive data can be processed on-site without ever leaving the device, reducing
exposure to potential breaches or unauthorized access.
Edge AI plays a critical role in the success of Internet of Things (IoT) and autonomous
systems, which often require immediate decision-making capabilities. In the context of self-driving
vehicles, Edge AI enables the real-time analysis of sensor data—such as images, radar, and lidar—
allowing the vehicle to make split-second decisions that ensure passenger safety. Similarly, in
industrial automation, edge-enabled machines can detect anomalies, trigger alerts, and take
corrective action without waiting for instructions from a centralized system. In smart healthcare,
wearable devices equipped with Edge AI can monitor vital signs and issue real-time alerts in
response to abnormal conditions, providing immediate care to patients in critical situations.
1
2. LITERATURE SURVEY
Summary: This survey explores the integration of AI and edge computing, discussing
architectures, frameworks, and challenges. It emphasizes how processing at the edge
significantly reduces latency and supports real-time inference, especially in IoT and cyber-
physical systems.
Summary: This paper discusses edge computing as a key enabler for the IoT ecosystem.
It highlights how localized data processing improves responsiveness, reduces cloud
reliance, and supports latency-sensitive applications like autonomous vehicles and smart
cities.
Summary: This survey investigates how AI models can be optimized and deployed on
resource-constrained edge devices. It focuses on techniques for real-time decision-making
in autonomous systems and edge-based deep learning, including model compression and
hardware acceleration.
2
4. A Survey on Edge Computing Systems and Tools
Summary: This work explores platforms and tools supporting edge computing. It provides
an overview of real-world applications where low-latency decision-making is essential,
including smart manufacturing and autonomous control systems.
Summary: This paper outlines AI challenges and opportunities at the edge, especially for
real-time analytics in IoT environments. It details use cases in healthcare, transportation,
and industrial IoT, where AI-driven edge decisions are crucial.
Summary: This article reviews the technological evolution and impact of AI at the edge,
particularly for low-latency, energy-efficient inference in mobile and embedded systems.
It showcases applications in robotics and smart healthcare.
3
3. OBJECTIVES
• To explore the integration of Artificial Intelligence with Edge Computing for faster
and decentralized data processing in real-time applications.
• To analyze how Edge AI reduces latency by performing computation closer to the data
source, eliminating delays associated with cloud-based systems.
• To examine the role of Edge AI in enabling real-time decision-making for critical
applications such as autonomous vehicles, industrial automation, and smart healthcare.
• To investigate how Edge AI enhances data privacy and security by limiting the need to
transmit sensitive data to centralized cloud servers.
• To evaluate the impact of Edge AI on bandwidth efficiency, by processing and filtering
data locally before sending only essential information to the cloud.
• To identify hardware and software challenges involved in deploying AI models on
resource-constrained edge devices.
• To review current architectures and frameworks that support the implementation of
Edge AI in IoT ecosystems.
4
4. METHODOLOGY
1. Literature Review
Study existing research on Edge AI, IoT, and real-time systems to understand current
trends, technologies, and challenges.
2. Problem Identification
Define the specific real-time decision-making issue or scenario (e.g., autonomous vehicle
obstacle detection, industrial fault prediction).
3. System Architecture Design
Develop a suitable Edge AI architecture combining sensors, edge devices (e.g.,
Raspberry Pi, NVIDIA Jetson), and AI models.
4. Model Selection and Optimization
Choose lightweight AI models (e.g., MobileNet, TinyML) and optimize them for
deployment on edge devices using techniques like model pruning or quantization.
5. Implementation
Deploy the AI model on the edge device and integrate it with sensors or IoT modules for
real-time data collection and inference.
6. Testing and Evaluation
Measure system performance in terms of latency, accuracy, energy efficiency, and
decision response time under different conditions.
7. Result Analysis
Compare edge-based performance with cloud-based systems to highlight improvements
in real-time decision-making.
8. Conclusion and Future Work
Summarize findings and propose future improvements such as advanced edge hardware,
5G integration, or federated learning for collaborative intelligence.
5
5. SYSTEM ARCHITECTURE
1. Data Sources
• What it does: Captures real-world data in real time.
• Examples:
o Cameras (for video/image recognition)
o IoT sensors (temperature, humidity, motion)
o Microphones (for audio analysis)
• Purpose: Acts as the input for the AI system.
2. Data Preprocessing
• What it does: Cleans and formats raw data before inference.
• Techniques:
o Noise reduction (e.g., smoothing sensor data)
o Normalization/scaling (bringing values to a standard range)
o Image resizing, frame selection (for vision tasks)
• Purpose: Ensures data is usable by the AI model and reduces errors.
3. Edge AI Inference
• What it does: Performs real-time predictions at the edge.
• Tools & Frameworks:
o TensorFlow Lite, ONNX Runtime, OpenVINO, NVIDIA TensorRT
• Model Types:
o Lightweight ML/DL models (MobileNet, Tiny-YOLO, etc.)
• Purpose: Avoids sending all data to the cloud, reducing latency and bandwidth use.
6
4. Real-Time Decision Logic
• What it does: Analyzes the output of the AI model and decides on actions.
• Examples:
o If "person detected", then "sound alarm"
o If "temperature > threshold", then "shut down motor"
• Purpose: Converts AI output into actionable steps using business logic or embedded
rules.
7
6. IMPLEMENTATION
9
7. USECASE
2.Autonomous Vehicles
• Use Case: Real-time object detection, navigation, and decision-making.
• How Edge AI Helps: Processes sensor data (e.g., camera, radar, lidar) on-board to make
split-second driving decisions, crucial for safety and performance, as seen in Tesla’s
Autopilot system.
10
4.Smart Agriculture
• Use Case: Crop monitoring, soil health analysis, and pest detection using sensors and
drones.
• How Edge AI Helps: Enables on-site data processing to provide farmers with real-time
insights, optimizing irrigation, pesticide use, and harvest timing without relying on
constant internet access.
5.Smart Cities
• Use Case: Traffic management, energy optimization, and public safety monitoring.
• How Edge AI Helps: Local edge devices can analyze traffic flows, monitor air quality,
or detect accidents, helping city infrastructure respond dynamically and efficiently.
6.Healthcare Monitoring Devices
• Use Case: Real-time patient monitoring through wearables and medical sensors.
• How Edge AI Helps: Processes biometric data locally (heart rate, oxygen levels, etc.) to
detect abnormalities immediately and alert healthcare providers or emergency services
without latency.
Conclusion
Real-World Impact
Safety:
• Instant Threat Detection: Edge AI in cars, drones, and factories detects dangers (like
obstacles, system failures, or intrusions) in milliseconds, allowing immediate action and
preventing accidents.
• Medical Emergency Response: AI-powered devices at the edge (like wearable monitors)
can instantly spot critical health conditions (like heart failure) and trigger emergency
protocols without delay.
• Public Safety Systems: Smart surveillance cameras can autonomously recognize weapons,
fires, or unsafe crowd behavior in real time — improving emergency responses.
12
Trust:
• Data Privacy: Since data is processed locally on the device instead of being sent to a cloud
server, sensitive personal or corporate information stays private, building user confidence.
• Explainable Decisions: Localized AI models can be more transparent and easier to audit,
helping users and regulators trust AI-driven actions.
Sustainability:
• Reduced Energy Use: Processing at the edge minimizes the need for heavy, energy-
intensive cloud computing — saving bandwidth and cutting down on carbon footprint.
• Smarter Resource Management: In industries like agriculture and smart cities, Edge AI
enables real-time optimization of resources (like water, electricity, fuel) based on current
conditions.
• Longer Device Lifespans: On-device AI can monitor and predict equipment maintenance
needs, reducing waste by extending machine life and minimizing unnecessary
replacements.
13
8. ADVANTAGES AND LIMITATIONS
Advantages:
• Ultra-lowLatency
Decisions are made instantly without relying on distant servers.
• High Reliability
Works even without a stable internet connection.
• Energy Efficiency
Saves energy compared to constantly uploading and processing large datasets in
centralized clouds.
• Personalization
Edge AI can adapt in real time to the user's behavior and preferences locally.
• Scalability
Easier to deploy many devices across remote areas without needing huge backend
infrastructure.
Limitations:
14
• Model Size Constraints
Complex AI models must be compressed or optimized to fit into small devices, which
can reduce their accuracy.
• Hardware Costs
Specialized edge hardware (like AI chips) can be expensive to design and deploy at scale.
• Security Risks
Devices can still be physically tampered with or hacked if not properly secured.
• Data Fragmentation
Data is spread across many devices, making it harder to perform centralized analytics or
training without additional orchestration.
• Development Complexity
Building and optimizing AI models for edge deployment requires specialized skills and
tools.
15
9. FUTURE SCOPE
The future of Edge AI for real-time decision-making is incredibly promising and transformative
across industries. As devices become smarter and networks faster, Edge AI will enable
autonomous systems like self-driving cars, drones, and robots to operate safely and independently.
In healthcare, wearable devices will offer instant diagnostics and monitoring, improving patient
outcomes. Factories and smart cities will rely on Edge AI for predictive maintenance, traffic
control, and energy optimization, creating more efficient and sustainable environments. With 5G
and 6G networks, real-time collaboration between edge devices and the cloud will become
seamless. Privacy and security will also improve through decentralized learning methods like
federated learning. The growth of hyper-personalized services in retail, entertainment, and fitness
will be fueled by faster on-device intelligence. Additionally, Edge AI will help reduce carbon
footprints by minimizing reliance on massive cloud data centers. Critical fields like defense, space
exploration, and disaster response will benefit from rapid, local decision-making without latency.
Overall, Edge AI is shaping a future that is smarter, faster, greener, and more human-centric.
16
10. CONCLUSION
17
11. BIBLIOGRAPHY
1. Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016). "Edge Computing: Vision and
Challenges." IEEE Internet of Things Journal, 3(5), 637-646.
3. Zhang, C., Patras, P., & Haddadi, H. (2019). "Deep Learning in Mobile and Wireless
Networking: A Survey." IEEE Communications Surveys & Tutorials, 21(3), 2224-2287.
4. Li, Y., Ota, K., & Dong, M. (2018). "Deep Learning for Smart Industry: Efficient
Manufacture Inspection System with Fog Computing." IEEE Transactions on Industrial
Informatics, 14(10), 4665-4673.
5. Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019). "Edge Intelligence:
Paving the Last Mile of Artificial Intelligence with Edge Computing." Proceedings of the
IEEE, 107(8), 1738-1762.
6. Lin, J., Yu, W., Zhang, N., Yang, X., Zhang, H., & Zhao, W. (2017). "A Survey on Internet
of Things: Architecture, Enabling Technologies, Security and Privacy, and Applications."
IEEE Internet of Things Journal, 4(5), 1125-1142.
7. Wang, S., Zhang, X., Zhang, Y., Wang, L., Yang, J., & Wang, W. (2017). "A Survey on
Mobile Edge Networks: Convergence of Computing, Caching and Communications."
IEEE Access, 5, 6757-6779.
8. Abbas, N., Zhang, Y., Taherkordi, A., & Skeie, T. (2018). "Mobile Edge Computing: A
Survey." IEEE Internet of Things Journal, 5(1), 450-465.
9. Premsankar, G., Di Francesco, M., & Taleb, T. (2018). "Edge Computing for the Internet
of Things: A Case Study." IEEE Internet of Things Journal, 5(2), 1275-1284.
18
10. Mahmud, R., Kotagiri, R., & Buyya, R. (2018). "Fog Computing: A Taxonomy, Survey
and Future Directions." Internet of Everything, Springer, 103-130.
19