Scribd
Upload
11 views12 pages

First Review 1MS21LVS06

The document presents an assistive device designed for visually impaired individuals, utilizing technologies such as Optical Character Recognition (OCR), Text-to-Speech (TTS), and object detection to enhance navigation and reading capabilities. It discusses various literature contributions and methodologies for implementing these technologies, including real-time object detection using OpenCV on a Raspberry Pi. The project timeline outlines the completion objectives for OCR, TTS, and object detection functionalities.

Uploaded by

KarthikMB Faulkner
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
11 views12 pages

First Review 1MS21LVS06

The document presents an assistive device designed for visually impaired individuals, utilizing technologies such as Optical Character Recognition (OCR), Text-to-Speech (TTS), and object detection to enhance navigation and reading capabilities. It discusses various literature contributions and methodologies for implementing these technologies, including real-time object detection using OpenCV on a Raspberry Pi. The project timeline outlines the completion objectives for OCR, TTS, and object detection functionalities.

Uploaded by

KarthikMB Faulkner
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 12

ASSISTIVE DEVICE FOR

VISUALLY IMPAIRED
P R E S E N T E D BY: G A G A N A T S
1 M S 2 1 LV S 0 6

Under the Guidance


Of:
SARA MOHAN GORGE
Asst. Professor
INTRODUCTION
There are currently more than 285
million visually impaired people in
the world, a number that is
expected to triple in the next 30
years.

A device that helps them to read


as normal people do.

The device contains of Text


recognition through OCR, TTS,
Door Detection through canny
edge detector, Object Detection
through Open CV DNN.
(Navigation)
LITERATURE • Megha P Arakeri[1], proposed a
system makes use of a Raspberry
SURVEY Pi with a compatible camera to
capture the content around the
MEGHA P ARAKERI,
ET AL “ASSISTIVE visually impaired or blind person
TECHNOLOGY FOR and reads it out to them in a
THE VISUALLY regional language.
IMPAIRED USING
COMPUTER •A sensor is also incorporated to
VISION”, notify the user of the distance to
INTERNATIONAL the nearest object at his eye level
CONFERENCE ON and the device enumerates
ADVANCES IN
COMPUTING, various objects in its sight.
COMMUNICATIONS •The system is based on the
AND INFORMATICS
(ICACCI), combination of image processing,
DECEMBER 2018, machine learning and speech
PP. 1725-1730. synthesis techniques.
DARSHINI RAJ,
ET AL “AN • Darshini Raj[2] proposed a
ASSISTIVE
READING device, The main objective of
SYSTEM FOR this paper is to develop a
VISUALLY cost effective and user-
IMPAIRED AND
BLINDS USING friendly optical character
OCR AND TTS recognition-based speech
TECHNIQUES synthesis.
ON LABVIEW”,
INTERNATIONAL • This paper integrates the
JOURNAL OF text and speech synthesizer
ENGINEERING
RESEARCH & which is performed using
TECHNOLOGY Laboratory virtual
(IJERT), 2019, instruments engineering
VOL. 7, ISSUE workbench.
10, PP. 1-4.
• Maagha S N[3], proposed a
assistive device whose framework
comprises a webcam interfaced
MAAGHA S N, ET with raspberry pi which
AL “DESIGN & acknowledges a page of printed
DEVELOPMENT OF text.
LEARNING
ASSISTANCE •In the Raspberry Pi module we
DEVICE FOR have introduced the OCR (Optical
VISUALLY Character Recognition) checks it
IMPAIRED into an advanced record which is
PEOPLE”, then exposed to slant revision,
INTERNATIONAL division, before highlight extraction
JOURNAL OF to perform classification.
ENGINEERING
RESEARCH & •After classifying, the text is readout
TECHNOLOGY a text to speech conversion unit
(IJERT), 2020, VOL. (TTS engine) installed in raspberry
8, ISSUE 11, PP. pi. The output will be of preferred
264-269. language.
BLOCK DIAGRAM

Character
Recognition(O
CR)
Recognized
character to
Microcontroller speech
Image (Raspberry Pi)
format(TTS)
Capturing Object
Detection

Door
Detection
METHODOLOGY
1. Text recognition: OCR(Optical Character Recognition)
The technology of optical character recognition (OCR)
enable the recognition of texts from image data.
2. TTS: Text-to-speech (TTS) is a type of assistive
technology that reads digital text aloud. It’s sometimes
called “read aloud” technology. TTS can take words on a
computer or other digital device and convert them into
audio.
3. Door Detection: Using Canny edge detector, edges in
the image can be detected. Even if there is any hidden
surface the four corners of the door-frame is detected.
Thus, on detection of a door the blind is provided with an
audio alert.
METHODOLOGY
4. Object Detection: OpenCV DNN module . The best
use case of OpenCV DNN is performing real-time
object detection on a Raspberry Pi. This process
can run in any environment where OpenCV can be
installed and doesn't depend on the hassle of
installing deep learning libraries . OpenCV itself
includes a deep neural network module, known as
OpenCV DNN.
CURRENT PROGRESS
(OCR)

Image Captured Output


TIMELINE OF THE PROJECT

Month of
Objective
Completion
OCR and TTS February
Object Detection March
Door Detection April
REFERENCE
1. Megha P Arakeri, Keerthana N S, Madhura M, Anusha Sankar, Tazeen
Munnavar, “Assistive Technology for the Visually Impaired Using Computer
Vision”, International Conference on Advances in Computing,
Communications and Informatics (ICACCI), December 2018, pp. 1725-1730.
2. Darshini Raj, Hiba Fathima Tazeen, Varsha Ravish, Anupama H.N, Nagashree
R.N, “An Assistive Reading System for Visually Impaired and Blinds using
OCR and TTS Techniques on LabVIEW”, International Journal of Engineering
Research & Technology (IJERT), 2019, vol. 7, issue 10, pp. 1-4.
3. Maagha S N, Srusti H K, Bilvashree V, Shireen Mariyam, Basavanna. M,
“Design & Development of Learning Assistance device for Visually Impaired
People”, International Journal of Engineering Research & Technology (IJERT),
2020, vol. 8, issue 11, pp. 264-269.
4. Shankar Sivan, Gopu Darsan, “Computer Vision based Assistive Technology
For Blind and Visually Impaired People”, International Conference on
Computing Communication and Networking Technologies, July 2016, pp. 1-8.
5. N.K. Srivastava, Satyam Singh, “Netra: Smart Hand Gloves Comprises
Obstacle Detection, Object Identification & Ocr Text To Speech Converter For
Blinds”, 5th IEEE Uttar Pradesh Section International Conference on
Electrical,
Electronics and Computer Engineering (UPCON), 2019, pp. 1-4.
Thank
You

You might also like