Real Time Braille To Speech Using Python
Real Time Braille To Speech Using Python
Submission Information
Result Information
Similarity 23 %
1 10 20 30 40 50 60 70 80 90
Ref/Bib
Journal/ 7.87%
Publicatio
n 20.48%
Exclude Information
Quotes Excluded
References/Bibliography Excluded
Sources: Less than 14 Words Similarity Excluded
Excluded Source 0%
Excluded Phrases Excluded
A-Satisfactory (0-10%)
B-Upgrade (11-40%)
23 10 B C-Poor (41-60%)
D-Unacceptable (61-100%)
SIMILARITY % MATCHED SOURCES GRADE
2 www.dx.doi.org Publication
6
5 www.dx.doi.org Publication
1
9 ijircce.com Publication
<1
EXCLUDED PHRASES
1 mitmysore
2 dept. e&ce
Real Time Braille to Speech Conversion using
Python
Mrs.Renuka.C Maanav.S.K Jeevan.T.V
7 Associate Professor Student Student
Department of Electronics and Department of Electronics and Department of Electronics and
Communication Engineering, Communication Engineering, Communication Engineering,
Maharaja Institute of Technology Maharaja Institute of Technology Maharaja Institute of Technology
Mysore, India Mysore, India Mysore, India
email: [email protected] email: [email protected] email: [email protected]
Mohith.S Vidyashree
Student Student
Department of Electronics and Department of Electronics and
Communication Engineering, Communication Engineering,
Maharaja Institute of Technology Maharaja Institute of Technology
Mysore, India Mysore, India
email:[email protected] email: [email protected]
10
Abstract— There are around 314 million visually challenged Braille, originally developed by the French military for
people in the world. One way for people with visual nighttime communication, was later adapted by Louis
impairments to read and write is using Braille, which is a text- Braille in 1829 specifically for the blind. It is a code
based format. However, braille text communication is a time- consisting of dots embossed on paper, representing letters,
consuming and difficult task. Hard-copy Braille is bulky and numbers, and symbols. Blind individuals can perceive these
takes up a lot of room to store and maintain. Old Braille books dots with their fingers to read. Each Braille letter is
and documents must be preserved because of their importance. composed of six dots arranged in a cell. Braille is widely
Automation of the Braille reading and digitization processes
used in cell phone keypads, computer keyboards, display
will aid in the preservation, network distribution, and demand-
driven hard copy reproduction of Braille. The requirement to
boards, ATMs, and currency notes.
digitize Braille has prompted numerous researchers to devise In the case of contracted blindness, individuals lose their
and put optical Braille recognition systems into practice. vision later in life as a result of an illness or an accident. In
This paper aims to solve these issues. The system which these situations, learning Braille on one's own becomes
consists of a camera, captures an image of any page in a book, challenging, and teaching such a person the Braille script
detects the braille text and converts this text into audio. The might be tough. To help with this, there are numerous
goal of braille text recognition is to convert the recognized programs and applications. There is still a lacuna in a
braille text from hardcopy into desired format (audio). The
process involves several steps like pre- processing,
medium for the blind to put forth their thoughts in Braille,
segmentation, feature extraction, post- processing. This system since the code is not universally understood.
basically would be used by visually challenged people as well as Optical Braille recognition (OBR) makes it possible to
students to learn Braille. extract Braille letters from written text, translate them into
Keywords—Braille, digitization, recognition, extraction images, and then translate the images back into natural
language. Documents are reproduced using this method in
I. INTRODUCTION order to preserve them for future use. OBR presents certain
Worldwide, there are 314 million visually challenged difficulties because no ink is used to produce the documents,
people. Out of these, 45 million are blind, 124 million have making it difficult to distinguish between raised dots 3 and
low vision and 145 million have uncorrected refractive flat surfaces. Several image enhancing techniques are used
errors. 1.4 million children under the age of 15 are blind. to enhance the quality of the image.
2
More than 90% of the world’s visually impaired people live Speech synthesis is the production of human voice or
in low income countries[1]. The most severe sensory speech by a machine. It used to convert written textual
impairment, which impairs human experience in all senses content into audible speech content for convenience. A text-
by about 90%, is vision loss which has an impact on almost to-speech (TTS) system performs this function. One form of
all of the visually challenged person’s activities. For reading speech synthesis is concatenation, which involves
and writing visually challenged persons always use Braille rearranging of voice samples spoken by humans into words
representation of different alphabets, digits, symbols etc. and sentences.
Braille is the only source for visually impaired person to read
and write[2]. Figure 1 shows Braille character representation. This paper presents the implementation and analysis of
real-time braille text-to-speech conversion. It aims to bridge
the gap between normal and visually challenged person.
Audiobooks are more preferred over physical books as they
are user-friendly and portability. A similar system for braille
books will help the visually challenged people enjoy the
experience of reading a book virtually.2This system will also
help normal people with sight to understand the braille
script without any prior knowledge about braille.
(5)
Figure 5 Before and after applying Erosion G.2 Finding Average Coordinates of Row and column
9 The average rows and column are detected because in
Dilation, on the other hand,
2 is a morphological operation one row or in one column, it is not necessary to have the
8
that expands or enlarges the boundaries of objects within an
image. It involves scanning the image with a structuring same x and y coordinates. So it is necessary to find the
element and determining the maximum pixel value within average value of the coordinate values. To compute average
that neighbourhood. Each pixel in the resulting image is coordinate values Eq. 6 and Eq.7 are used as shown below.
replaced with the maximum value found in its
neighbourhood. As shown in Figure 6, dilation results in
black dot enlarged.
1
TABLE I. DATA VALUE OF BRAILLE CHARACTER COMBINATION
(6)
(7)
5
Where aXk, aYb are the average x and y coordinates of
each row, k is1column value, b is the row value and n is the
count of dot in each row and column. The results of finding
the average x-y coordinates of each row and column are
shown in Figure 9.
Figure 9 Result of finding average x-y coordinates of each row and column
3
3 15 cm 3 0
mm
VI. RESULTS
A. Lighting conditions 2 15 cm 3 2 33
mm
A few test cases of Braille dot extraction for various
lighting conditions have been shown in TABLE IV.
It was observed that for the larger dimensions of the dot,
TABLE IV. BRAILLE DOT EXTRACTION FOR VARIOUS the percentage of error of character detection was less. For 2
LIGHTING CONDITIONS mm diameter, there was a high percentage of error for
Lighting Image of Braille Detection of Braille character recognition and some characters were not
condition Character Character detected. Since the standard Braille dimensions are greater
Dark than 2.5mm, the proposed project can recognize characters
intensity in original Braille documents.
Medium C. Resolution of the camera
intensity The resolution of the camera effects the quality of image
taken. To compute the accuracy of braille detection based on
High resolution, we have used 10 braille images of different
intensity
Braille cell lengths. Three cameras were used to capture the
images and the accuracy of braille character detection for
each word was computed and their average was taken.
TABLE VI shows the observed values.
TABLE VI. COMPARISION OF ACCURACY BASED ON for VivoY8li mobile. The accuracy was much high for
RESOLUTION OF DIFFERENT CAMERAS
Redmi Note 8 pro which was 89.7%.
The accuracy level increases with the resolution of the
Name of Accuracy of character detection per each Braille Cell camera. These results demonstrate that this system can
Camera (%) effectively recognize Braille characters with high accuracy
levels.
Length of cell (mm)
1 mm 2 mm 3 mm 4 mm 5 mm VII. CONCLUSION
Logitech 100% 66% 50% 20% 0% The Real-time Braille to Speech Conversion system
Webcam using Python is a valuable contribution to assistive
C170
technology for 5 visually challenged individuals. By
recognizing Braille characters and translating them into
Vivo 100% 87.5% 67.2% 66% 66% alphanumeric text and speech, this system aids in reading
Y91i and learning. It utilizes a webcam to capture Braille images
Redmi 100% 87.5% 80% 75% 66%
Note 8 and employs image processing techniques such as
Pro thresholding, erosion, dilation, and contour detection to
identify the positions of the embossed dots. The system
A graph is plotted based on the values given in Figure 14. experienced a high error rate and failed to detect certain
characters when using a 2 mm diameter for Braille.
However, since standard Braille dimensions are larger than
2.5 mm, the proposed system successfully recognized
characters in original Braille documents. The system
achieves 89.7% accuracy with a 64MP camera, although
accuracy decreases with lower resolutions. Consistent
illumination is crucial to minimize noise and ensure accurate
dot detection. This technology has diverse applications in
education, communication, and navigation. It enables
visually impaired students to access Braille materials swiftly
and assists teachers in preparing resources. Additionally, it
facilitates the conversion of Braille messages into text
messages or emails, enhancing communication for visually
impaired individuals. Future research can explore further
potential and advancements in this system.
REFERENCES
Figure 14 Comparison of Accuracy based on Resolution [1] P. Kaur, S. Ramu, S. Panchakshari and N. Krupa, "Conversion of
Hindi Braille to Speech using Image and Speech Processing," 2020
IEEE 7th Uttar Pradesh Section International Conference on
From the graph, it is observed that the accuracy of Redmi Electrical, Electronics and Computer Engineering (UPCON), 2020,
pp. 1-6, doi:10.1109/UPCON50219.2020.9376566
note 8 Pro camera with 64 MP resolution is high. The
[2] J. Tri Ardiansah and Y. Okazaki, "The Design and Prototyping of
algorithm works well for different Braille cell lengths. Braille to Speech Application as a Self-Learning Support Media for
Visually Impaired Person," 2020 4th International Conference on
Based on the calculation of accuracy for the three cameras, Vocational Education and Training (ICOVET), 2020, pp. 224-
the accuracy percentage of character detection is computed 228,doi:10.1109/ICOVET50258.2020.9230060
and shown in graph shown in Figure 15 below. [3] S. R. Rupanagudi, S. Huddar, V. G. Bhat, S. S. Patil and Bhaskar M.
K., "Novel methodology for Kannada Braille to speech translation
using image processing on FPGA," 2014 International Conference on
Advances in Electrical Engineering (ICAEE), 2014, pp. 1-6,
doi:10.1109/ICAEE.2014.6838445
[4] M. Hanumanthappa and V. V. Murthy, "Optical Braille recognition
and its correspondence in the conversion of Braille script to text — A
literature review," 2016 International Conference on Computation
System and Information Technology for Sustainable Solutions
(CSITSS), 2016, pp. 297-301, doi: 10.1109/CSITSS.2016.7779374
[5] J. Subur, T. A. Sardjono and R. Mardiyanto, "Braille character
recognition using find contour method," 2015 International
Conference on Electrical Engineering and Informatics (ICEEI), 2015,
pp. 699-703,doi:10.1109/ICEEI.2015.7352588