|| Jai Sri Gurudev ||

ADICHUNCHANAGIRI UNIVERSITY
BGS INSTITUTE OF TECHNOLOGY
BG Nagara – 571448, Nagamangala Taluk,
Mandya District, Karnataka (INDIA).

Project Work Phase-I

A REPORT
ON
“SMART SHOE FOR VISUALLY DISABLED
INDIVIDUALS WITH OBJECT DETECTION AND PIT
DETECTION”

Submitted in partial fulfillment for the academic year 2023-24

Bachelor of Engineering
In
ELECTRONICS AND COMMUNICATION ENGINEERING
Submitted by:

Chandan Gowda M S 21ECE029

Chandukumar L E 21ECE031
Dhakshath S 21ECE044
Sanjay T S 21ECE139

Under the guidance of:

Dr. Balaji B S, B.E, M.Tech,
Assistant Professor, Dept. of ECE,
BGSIT, BG Nagar, Mandya.

DEPARTMENT OF ELECTRONICS AND COMMUNICATION ENGINEERING

BGS INSTITUTE OF TECHNOLOGY

BG NAGARA – 571448
2023-2024
SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

CONTENTS

▪ Abstract
▪ Introduction
▪ Motivation
▪ Literature Survey
▪ Problem statement
▪ Objective
▪ Methodology (Block diagram)
▪ Hardware and Software Requirements
▪ Advantages
▪ Applications
▪ Conclusion
▪ Reference

DEPT.OF ECE, BGSIT Page 2

 SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

ABSTRACT

This project presents the design and development of smart assistive shoes aimed at enhancing
mobility and safety for visually and hearing-impaired individuals. The system utilizes an
Arduino Nano microcontroller integrated with ultrasonic sensors to detect obstacles and pits
in the user’s path. Alerts are provided through a buzzer and a vibrating motor, ensuring dual
feedback mechanisms for users with combined impairments.

The shoes are also equipped with a GPS-GSM module to track the user’s location and send
real-time updates to guardians or caretakers during emergencies. By incorporating pit
detection and terrain adaptability, the system addresses potential hazards in the user’s
environment. This innovation combines navigation assistance, environmental awareness, and
safety tracking, offering increased autonomy, reduced risk, and enhanced confidence for the
users.

DEPT.OF ECE, BGSIT Page 3

SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

INTRODUCTION

Mobility is a fundamental aspect of independence, yet it remains a significant challenge for

individuals with visual and hearing impairments. Navigating daily environments, especially in
unfamiliar or hazard-prone areas, poses risks that often compromise safety and confidence.
This project aims to address these challenges by developing Smart Assistive Shoes equipped
with advanced technologies to aid visually and hearing-impaired individuals.

The proposed system integrates an Arduino Nano microcontroller with ultrasonic sensors,
a GPS-GSM module, a buzzer, and a vibrating motor, offering a multifaceted solution for
navigation and safety. The ultrasonic sensors detect obstacles and pits in real-time, providing
feedback through auditory (buzzer) and tactile (vibration) alerts, ensuring accessibility for
users with dual impairments. The GPS-GSM module further enhances the system by enabling
location tracking, allowing users to send their live location to a guardian or caretaker during
emergencies.

Fig 1(a); Visually impaired individual

using stick

DEPT.OF ECE, BGSIT Page 4

SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

In addition to obstacle and pit detection, the smart shoes incorporate features to detect uneven
terrain or sudden changes in the environment caused by natural calamities. This capability
ensures adaptability and reliability across diverse terrains, making the shoes suitable for both
urban and rural settings.

By combining real-time navigation assistance, emergency tracking, and environmental

awareness, this project seeks to enhance the autonomy, confidence, and safety of individuals
with disabilities. The Smart Assistive Shoes represent a step forward in wearable
technology, offering a practical and innovative solution to improve the quality of life for
visually and hearing-impaired individuals.

Fig 1(b)

DEPT.OF ECE, BGSIT Page 5

 SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

MOTIVATION

Navigating safely and independently is a daily challenge for individuals with visual and
hearing impairments. Traditional tools like walking canes and guide dogs, while helpful, have
limitations in detecting obstacles, pits, or sudden environmental changes. Moreover,
emergencies such as getting lost or encountering hazardous terrain often leave individuals
vulnerable without immediate assistance.

This project is motivated by the desire to leverage modern technology to address these
challenges. By combining real-time obstacle and pit detection, tactile and auditory feedback,
and GPS-based tracking into a single wearable device, the Smart Assistive Shoes aim to
enhance mobility, safety, and confidence for differently abled individuals. This innovation
seeks to provide a reliable and accessible solution that significantly improves their quality of
life and fosters greater independence.

DEPT.OF ECE, BGSIT Page 6

SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

LITERATURE SURVEY

The development of assistive technologies has been a growing area of research aimed at
improving the quality of life for individuals with disabilities. In particular, assistive devices
for the visually and hearing impaired have gained significant attention, focusing on enhancing
mobility, safety, and independence. This literature survey explores prior works, existing
technologies, and their limitations to provide a foundation for the development of Smart
Assistive Shoes.

Assistive Technologies for Visually Impaired Individuals

Traditional tools such as white canes and guide dogs have long been used to aid visually
impaired individuals. While effective to some extent, these tools have significant limitations.
White canes can only detect obstacles within their reach, often failing to provide information
about obstacles at head height or pits in the path. Similarly, guide dogs, though helpful, require
extensive training and maintenance, making them less accessible to many individuals.

Modern advancements have introduced electronic travel aids (ETAs) that use sensors and
electronic components to assist navigation. A study by Bhatlawande et al. (2014) developed
a smart cane equipped with ultrasonic sensors to detect obstacles and provide haptic feedback.
Although effective in short-range obstacle detection, it was limited to handheld usage and
lacked features like GPS tracking for emergency scenarios.

Obstacle and Pit Detection Technologies

Obstacle detection using ultrasonic sensors is a well-explored area in assistive devices. A

system proposed by Dey et al. (2015) utilized ultrasonic sensors to detect obstacles within a
specific range and provided auditory feedback through headphones. However, auditory
feedback may not be effective for users with hearing impairments, necessitating the use of
vibration-based feedback mechanisms.

DEPT.OF ECE, BGSIT Page 7

SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

Pit detection, on the other hand, remains a relatively less-explored area. In a study by
Ramachandran et al. (2017), an advanced terrain mapping system was proposed using infrared
sensors.

While effective in detecting uneven surfaces, infrared sensors struggled in outdoor

environments under varying light conditions. This highlights the need for robust, reliable
systems for pit detection, particularly in outdoor settings.

Feedback Mechanisms: Auditory and Tactile

Feedback mechanisms play a critical role in assistive devices. Auditory feedback is commonly
used in devices for visually impaired individuals, as noted in studies by Meena et al. (2018).
However, auditory cues may go unnoticed by users with hearing impairments or in noisy
environments, reducing their effectiveness.

Tactile feedback, such as vibrations, offers a more inclusive solution. In research by Kumar
et al. (2019), a wearable glove with vibration motors was developed to alert users of obstacles.
The study demonstrated the effectiveness of tactile feedback in providing real-time alerts
without relying on auditory cues. This principle has been adopted in various assistive
technologies, including smart shoes, as it caters to a wider range of disabilities.

GPS and GSM Technologies for Emergency Assistance

GPS tracking systems have been widely used in assistive devices to enhance safety and
provide location-based services. A study by Sharma et al. (2020) introduced a wearable device
equipped with GPS and GSM modules to track the location of users and send alerts to
caretakers during emergencies. Although effective, the system was bulky and lacked
integration with navigation aids, limiting its practicality for daily use.

Other research, such as that by Patel et al. (2021), proposed integrating GPS systems into
wearable devices like smartwatches. While this approach improved portability, it did not
address mobility challenges such as obstacle detection or pit identification. This highlights the
need for a holistic solution that combines navigation assistance with safety tracking.

DEPT.OF ECE, BGSIT Page 8

SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

Terrain Adaptability and Natural Calamity Detection

Terrain adaptability is an emerging area in assistive technology. Devices capable of detecting

changes in terrain, such as slopes, stairs, or uneven surfaces, can significantly enhance
mobility for visually impaired individuals. In a study by Gupta et al. (2018), a terrain detection
system using accelerometers and gyroscopic sensors was proposed. While effective in
identifying slopes, it lacked real-time feedback for sudden changes in the environment, such
as pits or debris caused by natural calamities.

Natural calamity detection remains a largely unexplored area in assistive technologies.

However, its inclusion in assistive devices can play a vital role in ensuring safety during
emergencies.

Limitations of Existing Solutions

Despite the advancements in assistive technologies, existing solutions have notable

limitations:

1. Lack of Integration: Most devices focus on a single functionality, such as obstacle

detection or GPS tracking, without providing a comprehensive solution.

2. Accessibility Issues: High costs and complex designs often make these technologies
inaccessible to most users.

3. Limited Adaptability: Many devices are designed for specific environments, such as
urban areas, and struggle in rural or outdoor settings with uneven terrain.

4. Inadequate Feedback Mechanisms: Reliance on auditory feedback limits the usability

of devices for individuals with combined impairments.

Smart Assistive Shoes: Bridging the Gap

The Smart Assistive Shoes aim to address the limitations of existing solutions by integrating
multiple functionalities into a single wearable device. The system uses ultrasonic sensors for
obstacle and pit detection, providing both auditory and tactile feedback. A GPS-GSM module
is included for real-time location tracking, ensuring safety during emergencies.

DEPT.OF ECE, BGSIT Page 9

SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

Additionally, the shoes are designed to detect changes in terrain and alert users to potential
hazards caused by natural calamities. By combining navigation assistance, environmental
adaptability, and emergency tracking, the Smart Assistive Shoes provide a comprehensive and
inclusive solution for visually and hearing-impaired individuals.

DEPT.OF ECE, BGSIT Page 10

 SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

PROBLEM STATEMENT

Visually and hearing-impaired individuals face significant challenges in navigating their

surroundings safely and independently. Traditional tools like white canes and guide dogs are
limited in detecting obstacles, pits, or sudden changes in the terrain, leaving users vulnerable
to accidents. Additionally, in emergencies such as disorientation, injuries, or natural calamities,
these tools fail to provide real-time location tracking or immediate assistance.
Existing assistive technologies often address specific challenges in isolation, such as obstacle
detection or GPS tracking, but lack a comprehensive solution that caters to diverse needs.
Moreover, feedback mechanisms in many devices rely heavily on auditory cues, making them
inaccessible for users with combined impairments.
Thus, there is a pressing need for an inclusive, wearable device that integrates real-time obstacle
and pit detection, terrain adaptability, dual feedback mechanisms, and emergency location
tracking to ensure safety and autonomy for visually and hearing-impaired individuals.

OBJECTIVES

The main objective of this project is:

➢ Develop smart shoes with sensors for real-time obstacle and pit detection.
➢ Integrate auditory (buzzer) and tactile (vibration motor) feedback for accessibility.
➢ Implement GPS-GSM modules for location tracking and emergency alerts.
➢ Enhance terrain adaptability for diverse environments and natural calamities.
➢ Design a lightweight, cost-effective, and user-friendly wearable device.
➢ Ensure quick response mechanisms for emergencies like disorientation or accidents.

DEPT.OF ECE, BGSIT Page 11

 SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

BLOCK DIAGRAM

CAMERA
Stepper
motor

Relay Relay ULN

Relay
Driver

Fig 4; Block diagram of working methodology

Explanation of Block diagram

1. User Interaction: Feedback is provided to the user via a vibrating motor and buzzer for
obstacle alerts.
2. Battery: Supplies power to all components, ensuring system functionality.
3. Microcontroller: Processes input from the ultrasonic detector and controls the feedback
mechanisms.
4. Ultrasonic Detector: Detects obstacles by emitting and receiving ultrasonic waves, sending
data to the microcontroller.
5. Feedback Mechanisms: The vibrating motor gives tactile alerts, and the buzzer provides
auditory signals.
6. Shoes: Serve as the wearable platform for all components, ensuring portability.
7. Object Detection: Ensures the user is alerted to obstacles, enabling safer navigation.

DEPT.OF ECE, BGSIT Page 12

SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

METHODOLOGY
1. Select components: Arduino Nano, ultrasonic sensors, buzzer, vibration motor, GPS, and

GSM modules.

2. Use ultrasonic sensors for obstacle and pit detection.

3. Program Arduino to trigger buzzer and vibration motor as feedback for obstacles.

4. Integrate GPS module for location tracking and GSM module for emergency alerts.

5. Test the system in various environments for functionality.

DEPT.OF ECE, BGSIT Page 13

SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

WORKFLOW

Fig 5; Process flow diagram of the model

DEPT.OF ECE, BGSIT Page 14

SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

Requirements for Hardware and Software

Hardware

1. Microcontroller: Arduino Nano

2. Sensors: Ultrasonic sensors for obstacle and pit detection
3. Feedback Devices: Buzzer for auditory feedback, vibration motor for tactile feedback
4. Communication Modules: GPS module for location tracking, GSM module for sending
alerts
5. Power Supply: Rechargeable battery and charging circuit
6. Switch: Emergency button for sending location alerts
7. Wires and Connectors: For assembling components

8. Shoe: Base for mounting the system components

Software
1. Arduino IDE: For programming the Arduino Nano
2. Embedded C/C++: Programming language for microcontroller coding
3. Serial Communication Libraries: For interfacing GPS and GSM modules
4. Simulation Tools (Optional): For testing the design virtually
5. SMS Service Integration: To enable location alerts through GSM module
6. Version Control: Git or similar tools for managing code versions

DEPT.OF ECE, BGSIT Page 15

 SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

ADVANTAGES
1. Enhanced Mobility: Provides real-time obstacle and pit detection, enabling visually
impaired users to navigate safely.
2. Dual Feedback System: Combines auditory (buzzer) and tactile (vibration motor) feedback,
making it accessible for users with combined impairments.
3. Emergency Assistance: GPS-GSM integration allows users to send their live location to
guardians during emergencies.
4. Terrain Adaptability: Detects uneven surfaces and terrain changes, ensuring safe navigation
in diverse environments.
5. User Independence: Promotes self-reliance by reducing dependency on traditional tools like
canes or guide dogs.
6. Compact and Wearable: Designed as a shoe, it is lightweight, easy to use, and does not
require additional handheld devices.
7. Safety Assurance: Helps prevent accidents and injuries by alerting users to obstacles and
hazards in real time.
8. Cost-Effective: Offers an affordable assistive solution compared to existing advanced
navigation aids.
9. Customizable Features: Can be adapted for various user needs, including additional sensors
or functionality.
10. Improved Caregiver Support: Real-time tracking ensures quick response during
emergencies, providing peace of mind to guardians.

APPLICATIONS
1. Navigation assistance for visually impaired individuals.
2. Tactile feedback for hearing-impaired users.
3. Emergency location tracking for caregivers.
4. Detection of terrain changes and pits

DEPT.OF ECE, BGSIT Page 16

 SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

CONCLUSION
The smart shoe project is a comprehensive solution designed to address the mobility challenges
faced by visually and hearing-impaired individuals. By integrating advanced technologies like
ultrasonic sensors, Arduino microcontrollers, GPS, GSM modules, and dual feedback systems
(auditory and tactile), the shoe offers a reliable and accessible aid for safe navigation.

The inclusion of real-time obstacle and pit detection ensures enhanced safety, allowing users to
avoid potential hazards in their environment. The tactile feedback mechanism further caters to
users who might have hearing impairments, ensuring inclusivity. Additionally, the GPS-GSM
system enables caregivers to track the user's location and provide assistance during
emergencies, such as disorientation or accidents, thus adding a layer of security and
reassurance.

Designed to be lightweight, cost-effective, and user-friendly, this wearable technology

empowers users to achieve greater independence and confidence in their daily lives. The ability
to detect uneven terrain or changes due to natural calamities further highlights the robustness
and versatility of the design.

In conclusion, the smart shoe project is not just a technological innovation but a step toward
enhancing the quality of life for differently abled individuals, ensuring their safety, autonomy,
and dignity. It holds immense potential for real-world applications and future enhancements,
making it a vital contribution to assistive technology.

DEPT.OF ECE, BGSIT Page 17

 SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

REFERENCES
[1] Bhawana D. Parate and Jagruti J. Shah, “Design and Development of Multifunctional Robot for
Military Purpose Application,” International Journal of Engineering Research and Applications,
IJERA, ISSN: 2248-9622, International Conference on Industrial Automation and Computing
ICIAC, April 2014.
[2] G. R. Kanagaraj et al., “IoT Enabled Smart Shoe for Visually Impaired with Voice Assistance,”
IEEE International Conference on IoT and Applications, 2023. Available here.
[3] R. Anand et al., “Computer Vision and IoT-Based Smart System for Visually Impaired People,”
IEEE Conference on Computational Intelligence, 2020. Available here.
[4] A.B. S. Prasad et al., “IoT-Based Smart Shoes for Blind People,” IEEE International Conference
on IoT and Cloud Computing, 2022. Available here.
[5] M. A. Rahman et al., “Smart Footwear for Navigation Assistance of Visually Impaired Persons,”
IEEE Sensors Applications Symposium (SAS), 2021.
[6] S. K. Ghosh et al., “Navigation Aid System with Obstacle Detection for Visually Impaired,” IEEE
Transactions on Human-Machine Systems, 2019.
[7] N. K. Sharma and K. V. Jayaprakash, “A Wearable Technology for the Blind: Smart Shoes,”
IEEE Consumer Electronics Magazine, 2018.
[8] P. W. Lee and T. R. Zhang, “Ultrasonic-Based Guidance System in Footwear for the Blind,” IEEE
International Symposium on Robotics and Automation, 2017.
[9] R. Singh et al., “A Cost-Effective Smart Shoe with Embedded Sensors for Real-Time Obstacle
Detection,” IEEE Sensors Journal, 2018.
[10] V. Iyer et al., “IoT-Based Wearable for Real-Time Assistance to the Blind,” IEEE International
Conference on Wearable and Implantable Body Sensor Networks, 2021.
[11] J. Y. Choi and S. H. Lee, “Footstep Navigation System Using Smart Shoes for the Visually
Impaired,” IEEE Transactions on Biomedical Circuits and Systems, 2017.
[12] A Gupta et al., “GPS and GSM Enabled Smart Shoes for Location Tracking and Emergency
Alert,” IEEE Region 10 Conference (TENCON), 2020.
[13] H. Singh et al., “Integrated Smart Footwear for Visually Impaired Navigation and Safety,” IEEE
International Symposium on Assistive Technology, 2022.

DEPT.OF ECE, BGSIT Page 18

 SMART SHOE FOR VISUALLY DISABLED INDIVIDUALS WITH OBJECT
DETECTION AND PIT DETECTION 2024-25

[14] K. S. Lakhani et al., “Developing Smart Shoes Using Edge Computing for Enhanced Mobility of
Blind People,” IEEE Access Journal, 2020.
[15] S. K. Bhardwaj and A. Dutta, “Designing a Portable Ultrasonic Sensor-Based Guidance System
for Visually Impaired,” IEEE Design & Test of Computers, 2019.

Signature of Guide Signature of Project Coordinators Signature of HOD

DEPT.OF ECE, BGSIT Page 19