Projectcse Smartglass

Download as pdf or txt
Download as pdf or txt
You are on page 1of 26

BIODATA

Dr. DEVI DEVAPAL

Assistant Professor, College of Engineering Muttathara, TVM 9446503136,


[email protected]

PhD Computer Science and Engineering, Noorul Islam Centre for Higher Education, 2018.
M.E Network and Internet Engineering, Karunya Deemed University, 2006. B.E Computer Science
and Engineering, MS University, 2004.

Research Interests

Machine learning, Artificial Intelligence, Deep Learning, Computer Vision.

Publications

1. “Discontinuity Adaptive SAR Image Despeckling using Curvelet Based BM3D Technique”,
International Journal of Wavelets Multiresolution and Information Processing, Jan 2019.
2. “A Novel Approach Of Despeckling SAR Images Using Nonlocal Means Filtering ”, Journal Of
Indian Society Of remote Sensing (Springer), Vol. 45,Issue 3 ,Springer , 2017, pg 443-450.
3. “Comprehensive Survey On SAR Despeckling Techniques”, Indian Journal Of Science And
Technology, Vol 8(24),September 2015.
4. “Comparison Of Transform Domain Based SAR Despeckling Techniques”, Indian Journal Of
Science And Technology, Vol 9(13), April 2016.
5. “Comprehensive Survey On SAR Image Segmentation And Classification”, International
Journal Of Control Theory And Application,10(3),2017, pp 21-27.
6. “Smart Agro Farm-Solar Powered Soil and Weather Monitoring System”, Elseiver-Materials
Today, April 2019.

Papers Presented

1. ‘Survey on Recent CAD System for Liver Disease Diagnosis”, Department of Electronics and
Instrumentation Engineering, International Conference on Control, Instrumentation,
Communication and Computational Technologies (ICCICCT)(10th,11th July2014) at
NoorulIslamCentre for Higher Education.
2. “Comprehensive survey on SAR Despeckling Techniques”, Department of Electronics and
Instrumentation Engineering, International Conference on Soft Computing in Applied
Sciences and Engineering (23rd and 24th July 2015) at Noorul Islam Centre for Higher
Education.
3. “Comprehensive Survey on Computer Aided SAR Image Segmentation and Classification
Methods”, Department of Computer Science and Engineering, International Conference onNovel
issues and Challenges in Science and Engineering (28th and 29th July 2016) at Noorul Islam
Centre for Higher Education.
4. “High Throughput Multicast Routing in WMN using Rate guard combining Scheduling Scheme”,
National Conference on Management Initiatives and IT Interventions for EmergingAvenues (3rd
February 2016) at MarThoma Institute of Information Technology.
5. “Intelligent Document Scanner”, International Conference on Computing, Communication,
Nanophotonics, Nanoscience, Nanomaterials and Nanotechnology 7th and 8th
April 2016 at Holy Grace Academy of Engineering.
6. Women Safety App using Android enabled Watch”, International Conference on Computing,
Communication, Nanophotonics, Nanoscience, Nanomaterials and Nanotechnology 7th and 8th
April 2016 at Holy Grace Academy of Engineering.
7. “Object Detection from SAR images based on Curvelet Despeckling”, International multi-
conference on Computing, Communication, Electrical & Nanotechnology 26th and
27th April 2018 at Mangalam College of Engineering.
8 .“Smart Agro Farm Solar Powered Soil and Weather Monitoring System for Farmers”,
International multi-conference on Computing, Communication, Electrical & Nanotechnology25th
and 26th April 2019 at Mangalam College of Engineering.
9. “Digital Camera Authorization”, National Conference on Innovations in Computing andNetworks
on 7th May 2019 at Younus College of Engineering and Technology.
FACULTY PROFILE
1 Name: Dr. Soumya T.
Assistant Professor in CSE
Designation:
2 College of Engineering Muttathara

3. Qualification Ph.D. ( Computer Science and Engineering )


Computer Vision, Machine Learning,
Areas of Interest
4. Artificial Neural Networks
5 Professional Experience 17 Years
6 Email [email protected]
7 Mobile 9446178245
8. Educational Qualifications:
Examination Specialization College / Institute University Year
Ph.D. Computer Science College of Engineering University 2018
and Engineering Trivandrum of Kerala

M. Tech Digital Image Department of Computer University 2008


Computing Science,University of of Kerala
Kerala
B. Tech Computer Science PET Engineering MS University 2002
and Engineering College,Valliyoor Tirunelveli

9. Professional Experience
Organisation Designation Period Duration
College of Engineering Muttathara Assistant 2020-till date 2 years
Professor

College of Engineering Perumon Assistant 2010-2020 10 years 3


Professor months
College of Engineering Kidangoor Lecturer 2009-2010 7 months
University College Of Engineering Lecturer 2003-2009 4 years 4 months
Kariavattom, TVM
10. Training Programmes / FDPs / Short term courses / Workshops attended:

Name of the Course / Programme Venue & dates Duration in


FDP-Pedagogical Training IIT Madras,10-11- 3 days
2016,13-10-2016
Neural Networks IIITMK,26-08-16 1 day
Machine Learning College of Engineering 5 days
Perumon,16-11-15 to
20-11-15

Image Sensing, Medical Imaging and Satellite March 20-21, 2015, 2 days
Image Processing IIITM-K, Trivandrum

Image and Video Processing February 10-14,2015, 5 days


IIITM-K, Trivandrum

Challenging role of teachers in higher education Dec 5-10,2016,CET 6 days

11. Seminars/Symposia/Conferences Attended :

Name of the Seminar/Symposia/Conference ICACCI 2016, ACM EVENT 2016, SPICES 2015,
ICACCI 2015, COCONET 2015, SIRS 2014, RS DAY
2013

12. Served as a Reviewer


Name of the Seminar/Symposia/Conference ICACCI 2016, IEEE SPICES 2017, ICACCI 2014,
IEEE SPICES 2015, ICACCI 2015, COCONET 2015
Name of the Journals Journal of Electronic Imaging (SPIE)
Multimedia Tools and Applications(Springer)
13. Papers presented in Seminars/Symposia/Workshops/Conferences:

Title of the paper Name of S / S / W / C Venue &Dates National /


International
Day colour transfer based night video SPICES 2015 NIT Calicut International
enhancement for surveillance system
Video Enhancement for surveillance Research Scholars IIST,TVM, National
system Day 2013 Dec 16 -17, 2013

Intelligent Video Surveillance System SNDS 2014, March IIITMK International


14-16

14. Journal Publications :

International Journals 1. Soumya, T., and Sabu M. Thampi. ”Self-organized night


video enhancement for surveillance systems.” Signal, Image and
(SCI Expanded) Video Processing, Springer, 11(1) (2017): 57-64, SCI Indexed, Impact
Factor 2.157.

2. Soumya, T., and Sabu M. Thampi. ”Recolorizing dark regions


to enhance night surveillancevideo.” Multimedia Tools and
Applications (2017), Springer, Volume 76, Issue 22, pp 2447724493,
SCI Indexed, Impact Factor 2.757.

3. Soumya, T., and Sabu M. Thampi. ”A fuzzy fusion approach


to enlighten the illuminated regions of night surveillance videos.”
Journal of Intelligent Fuzzy Systems 32(4) (2017): 3143-3149 , IOS
Press, SCI Indexed, Impact Factor 1.739

4. Soumya, T., and Sabu M. Thampi. ”Nighttime Visual


Refinement Techniques for SurveillanceVideo: A Review” Multimedia
Tools and Applications ,SCI Indexed, Impact factor 2.757 .
15. Details of Programmes co-ordinated:

Name of the Course / Programme Venue Duration in Sponsoring Agency


days
Refresher Course on Data structures College of Engineering 2 days TEQIP
Perumon
(2012)
Image Processing Tools (2017) College of Engineering 3 days TEQIP
Perumon
National conference(2018) College of Engineering 2 days TEQIP
Perumon
BIODATA
PERSONAL DETAILS
NAME: ABHAY A.V
FATHER'S NAME: AUGUSTIAN S
MOTHER'S NAME: VASANTHA KUMARI R
DATE OF BIRTH: 01/02/2001
AGE: 22
GENDER: MALE
NATIONALITY: INDIAN
LANGUAGES KNOWN: Malayalam, English
MOBILE NUMBER: 8086643314
EMAIL ID: [email protected]
RESIDENTIAL ADDRESS: ABHAY BHAVAN, Malappanamcode, Vilappil PO
PINCODE: 695573
EDUCATIONAL QUALIFICATION
⦁ 10th Grade
St.Philip's SSK Nellikad,Maranalloor
Board: STATE
Percentage:98%
Year of passing:2017
⦁ 12th Grade
St Joseph's Higher secondary school,Trivandrum
Board: state
Percentage:85 %
Year of passing: 2019
⦁ Btech Degree
College Of Engineering Muttathara, TVPM
University: APJ Abdul Kalam Technological University
cgpa : 1.82
Year of passing:2024
PROJECT DETAILS
• AUTOMATIC PARKING SPACE COUNTER USING OPEN CV
• Software used: Python
• Project completion: 2023
BIODATA
PERSONAL DETAILS
NAME: ADITHYAN P B
FATHER'S NAME: K S PRASANNAKUMAR
MOTHER'S NAME: BINDHUMOL S N
DATE OF BIRTH: 28/12/2002
AGE: 21
GENDER:MALE
NATIONALITY: INDIAN
LANGUAGES KNOWN: Malayalam,English
MOBILE NUMBER: 7012644961
EMAIL ID: [email protected]
RESIDENTIAL ADDRESS: Aswathy PRWA B1 Highschool Junction Kachani Nettayam P.O, Tvm
PINCODE: 695013
EDUCATIONAL QUALIFICATION
⦁ 10th Grade
St.Shantal English Medium School Malamukal
Board: CBSE
Percentage: 79%
Year of passing:2018
⦁ 12th Grade
St Thomas Higher secondary school Mukkolackal
Board: state
Percentage: 89%
Year of passing: 2020
⦁ B-tech degree
College Of Engineering Muttathara, TVPM
University: APJ Abdul Kalam Technological University
Cgpa : 6.37
Year of passing:2024
PROJECT DETAILS
• AUTOMATIC PARKING SPACE COUNTER USING OPEN CV
• Software used: Python
• Project completion: 2023
BIODATA
PERSONAL DETAILS
NAME: AKSHAY S NAIR
FATHER'S NAME: SUDHAKARAN NAIR R
MOTHER'S NAME: RAJESWARI.O
DATE OF BIRTH:06-06-2001
AGE: 22
GENDER: Male
NATIONALITY: INDIAN
LANGUAGES KNOWN: Malayalam,English,Tamil,Hindi
MOBILE NUMBER: 8139887445
EMAIL ID: [email protected]
RESIDENTIAL ADDRESS: RAJASUDHA thandiyoor veedu vazhayila kudappanakunnu P.O
PINCODE: 695043
EDUCATIONAL QUALIFICATION
⦁ 10th Grade
St.marys HSS Pattom
Board: State
Percentage: 91%
Year of passing:2017
⦁ 12th Grade
St Joseph's Higher secondary school,Trivandrum
Board: state
Percentage: 80%
Year of passing: 2019
⦁ Btech Degree
College Of Engineering Muttathara, TVPM
University: APJ Abdul Kalam Technological University
Cgpa : 6.66
Year of passing: 2024
PROJECT DETAILS
• AUTOMATIC PARKING SPACE COUNTER USING OPEN CV
• Software used: Python
• Project completion: 2023
BIODATA
PERSONAL DETAILS
NAME: KRISHNARAJ R
FATHER'S NAME: RAJAN R
MOTHER'S NAME: Kavitha B
DATE OF BIRTH:20-05-2003
AGE: 20
GENDER: Male
NATIONALITY: INDIAN
LANGUAGES KNOWN: Malayalam,English,Tamil,Hindi
MOBILE NUMBER: 8592969409
EMAIL ID: [email protected]
RESIDENTIAL ADDRESS: Niketham PURA-171 Manikandeswaram P.O
PINCODE: 695013
EDUCATIONAL QUALIFICATION
⦁ 10th Grade
St.Aloysius HSS Thangassery
Board: State
Percentage: 95%
Year of passing:2018
⦁ 12th Grade
Govt Model Boys Higher secondary school Thevally
Board: state
Percentage: 86.6%
Year of passing: 2020
⦁ Btech Degree
College Of Engineering Muttathara, TVPM
University: APJ Abdul Kalam Technological University
Cgpa : 8.5
Year of passing: 2024
PROJECT DETAILS
• AUTOMATIC PARKING SPACE COUNTER USING OPEN CV
• Software used: Python
• Project completion: 2023
SMART SPECTACLES: VOICE ASSISTED SMART SPECTACLES
FOR VISUALLY IMPAIRED

OBJECTIVES

❖ Real-time Information: Delivering immediate and relevant information through voice


assistance to keep visually impaired individuals informed about their surroundings.

❖ Navigation Support: Providing audio cues and guidance to assist in safe and efficient
navigation, both indoors and outdoors.

❖ Object Recognition: Enabling the identification of objects, people, and obstacles through
smart spectacles' integrated technology, enhancing users' awareness.

❖ Text-to-Speech Functionality: Converting written text into spoken words, allowing users
to access printed information such as signs, menus, or documents.

❖ Facial Recognition: Helping users recognize familiar faces by using facial recognition
technology, enhancing social interactions.

❖ Obstacle Detection: Alerting users to potential obstacles or hazards in their path,


contributing to safer mobility.
ABSTRACT

These “Smart Glasses” are designed to help the blind people to read and translate the typed text
which is written in the English language. These kinds of inventions consider a solution to motivate
blind students to complete their education despite all their difficulties. Its main objective is to
develop a new way of reading texts for blind people and facilitate their communication. The first
task of the glasses is to scan any text image and convert it into audio text, so the person will listen
to the audio through a headphone that’s connected to the Glasses.
.All the computing and processing operations were done using the Raspberry pi 4 model B.The
Smart Spectacles are equipped with a compact camera module connected to a Raspberry Pi 4,
utilizing advanced image processing algorithms. The device employs computer vision techniques to
analyze the surroundings, identify obstacles, and convey vital information to the user in real-time.
A text-to-speech (TTS) system is integrated to convert visual information into audible cues,
facilitating a more intuitive and accessible interaction .This project aims to empower the visually
impaired community by leveraging the capabilities of Raspberry Pi 4 to create an affordable,
accessible, and versatile assistive technology solution. The Smart Spectacles demonstrate the
potential of combining hardware and software advancements to enhance the independence and
mobility of individuals with visual impairments.
As a future plan, it is possible to support many languages and enhance the design to make it smaller
and more comfortable to wear.
METHODOLOGY

Our system's camera network is ingeniously designed, with a camera strategically placed on the
blind user's glasses. This positioning allows the cameras to capture a comprehensive view of the
user's surroundings, focusing on faces of people and objects. This visual information serves as the
foundation for our innovative system, empowering blind users with a detailed understanding of the
environment in front of them.

Camera Integration In Smart Glasses

The integration of a high-quality camera into smart glasses enables real-time environmental
interpretation through advanced computer vision. This empowers the glasses to detect obstacles,
recognize objects, and provide crucial information, fostering independence for visually impaired
individuals. With a focus solely on the camera, the solution remains discreet and lightweight,
offering a seamless and intuitive user experience without additional sensors. This innovation
highlights the transformative potential of technology in enhancing accessibility and spatial
awareness for the visually impaired

Object Detection

By leveraging sophisticated algorithms, these glasses can swiftly recognize and categorize objects in
the wearer's surroundings. This capability extends beyond mere visual identification, enabling the
glasses to provide users with context-specific information, fostering a more informed and accessible
environment. Whether aiding in the identification of everyday objects or assisting with navigation
by recognizing obstacles, object detection significantly enriches the utility of smart glasses for a
diverse range of applications.

Face Recognition

Unlock the potential of facial recognition effortlessly with the world's simplest face recognition
library, designed to operate seamlessly from Python or the command line.Leveraging the cutting-
edge capabilities of dlib's face recognition built with deeplearning, this library boasts an impressive
accuracy of 99.38% on the challenging Labeled Faces in the Wild benchmark, ensuring robust and
reliable performance.

Text-to-speech

Text-to-speech (TTS) technology is a transformative feature in smart glasses, converting written text
into spoken words. This capability enables seamless auditory communication, allowing users to
access information without relying on traditional visual displays. In the context of smart spectacles
for visually impaired individuals, TTS serves as a vital tool for relaying textual information, such as
signs or documents, directly to the user through clear and natural-sounding speech. This not only
enhances accessibility but also contributes to a more inclusive and efficient user experience,
bridging gaps created by visual impairments and opening up new avenues for communication and
independence.

Audio Output

Audio output is a fundamental component of smart glasses, providing users with a crucial channel
for receiving information. In the context of smart spectacles for visually impaired individuals, the
importance of clear and effective audio output cannot be overstated. Whether conveying
navigation instructions, object recognition details, or text-to-speech responses, the quality of the
auditory experience significantly influences the device's usability. The integration of high-fidelity
speakers ensures that users receive information in a manner that is both comprehensible and
contextually relevant, contributing to a more seamless and enriching interaction with the
surrounding environment

Algorithm

I. Boot up the system with the Raspberry Pi microcontroller as the central processing unit.
Ii. Receive user commands through voice input, buttons, or gestures. Process the user
commands for initiating subsequent actions.
iii. Activate the Pi Camera Module integrated into the smart glasses to capture realtime visual
data.
iv. Process the captured visual data using advanced facial recognition software. Analyze facial
attributes, emotions, gender, and age of individuals in the user's vicinity.
v. Relay the recognized information through an intelligently designed Text-toSpeech (TTS)
system. Convert the information into auditory feedback delivered through earbuds.
vi.Utilize the integrated ultrasonic sensor for distance measurement and object detection.
Enhance navigation capabilities and support obstacle avoidance.
vii.Deliver auditory feedback to the visually impaired user, providing meaningful insights into
their environment.
viii.Continuously monitor the surroundings and update the user with real-time information.
ix. Utilize the ultrasonic sensor data to ensure safe navigation by detecting obstacles and
providing alerts.
x. Implement adaptability to varying environmental conditions for reliable performance.
xi. Optimize power consumption for prolonged usage, considering the limitations of wearable
devices.
xii.Allow users to customize settings based on individual preferences for a personalized
experience.
BLOCK DIGRAM
DESIGN

Circuit Diagram
Expected Outcome
APPLICATIONS

❖ Employment Opportunities: Smart spectacles can enhance employability for visually


impaired individuals by providing assistance in job-related tasks, facilitating access to
information, and improving workplace navigation.

❖ Education Accessibility: Enabling visually impaired students to access educational materials,


navigate campuses, and engage in classroom activities independently, fostering inclusive
learning environments.

❖ Social Inclusion: Promoting social interactions by aiding in recognizing faces, reading social
cues, and accessing information in various social settings, contributing to enhanced social
inclusion.

❖ Independent Living: Supporting daily activities such as shopping, cooking, and personal
tasks, empowering visually impaired individuals to live more independently.

❖ Public Transportation: Assisting in navigating public transportation systems, identifying


stops, and ensuring safer and more convenient travel for visually impaired commuters.

❖ Access to Information: Facilitating access to printed information, such as books, menus, or


labels, thereby reducing barriers and promoting information equality.

❖ Healthcare Assistance: Providing assistance in healthcare settings, including reading


medication labels, navigating healthcare facilities, and accessing health information.

❖ Emergency Situations: Enhancing safety during emergencies by providing real-time


information, guiding evacuation routes, and facilitating communication with emergency
services.

❖ Cultural and Recreational Participation: Enabling visually impaired individuals to engage in


cultural events, visit museums, and enjoy recreational activities with the assistance of
augmented information and navigation.
COMPONENTS

➢ Raspberry pi 4 model B (1)

➢ Samsung micro-SD EVO plus 32 GB (1)

➢ Webcam C310 (1)

➢ Spectacle (1)

➢ Female to female jumpers (4)

➢ Power bank battery 20000 mAH (1)

➢ Earbuds (1)

➢ SanDisk 64 GB memory card (1)

➢ Wire (2m)

➢ Raspberry pi model 3 B
COST ESTIMATION

Component Quantity Specification Cost (₹) Total cost (₹)

Raspberry Pi 4 model B 1 Broadcom BCM2711, Quad-core


Cortex-A72 (ARMv8) 64-bit SoC@ 10000 10000
1.5GHz Processor,
4GB LPDDR4-3200 SDRAM
Samsung micro-SD EVO 130MB/s transfer speed
plus 32 GB 1 Full HD 4k UHD 1200 1200

resolution of 720p, maximum


Webcam C310 1 resolution of 1280 x 720 pixels. 2531 2531

Frame made of plastic, metal, or a


Spectacle 1 combination of both. 1000 1000

Female to female Material :copper


jumpers 4 Weight: 168 g 266 1064
Type: Female to Female
2 Lithium Polymer Batteries
Lipo Battery 2200 mAH 1 Voltage : 11.1 V 3000 3000
Rechargeable Battery

Voltage:230 V
Earbuds 1 42 hr battery 2500 2500
Fast charging

Broadcom BCM2837 quad-core


Raspberry pi model 3 B 1 ARM Cortex-A53 processor 3800 3800
running at 1.2GHz.

Sand disk 64 GB 1 140 MB/sec transfer speed 980 980


memory card 64 GB storage

wire 1 Pvc insulated copper wire 200 200

TOTAL ₹26275
Planning

You might also like