MAHARASHTRA STATE BOARD OF TECHNICAL

EDUCATION

Certificate
This is to certify that Mr & Ms Sahil Dalvi, Pranali Dharme, Rutuja Kurhade, Sahil
Pahuja Roll No: 45, 46, 47, 48 of 6th Semester of diploma in Computer
Engineering of Institute VES POLYTECHNIC (Code: 0004) has attained
predefined practical outcomes (PROs) satisfactorily in course Capstone Project
Execution (22060) for the academic year 2019- 2020 as prescribed in the
curriculum.

Place: CHEMBUR, MUMBAI Enrollment No: 1700040207

1700040208
1700040209
1700040210

Date: …………………… Exam Seat No: ………………………….

Subject Teacher Head of the Department Principal

Seal of
Institution
 INDEX
Name: Sahil D, Pranali D, Rutuja K, Sahil P Name of faculty: Ms. Asavari Salve.
Program code: CO6I Course & course code: CPE (22060)
Academic year: 2019-20 Roll no. 45, 46, 47, 48
Enrollment no: 1700040207, 1700040208, 1700040209, 1700040210

SR
NO TITLE OF EXP DOP DOS MARKS
09/12/19 23/12/19
1 Project Proposal
23/12/19 06/01/20
2 Punctuality and Overall Contribution
09/12/19 23/03/20
3 Project Diary
06/01/20 03/02/20
4 Execution plan of project in sixth semester
03/02/20 16/03/20
5 Project report including Documentation
23/03/20 23/03/20
6 Presentation

TOTAL
VES POLYTECHNIC CAPSTONE PROJECT – EXECUTION 22060

EXPERIMENT NO. 1

Title: - Project Proposal

D.O.P: - 09/12/19

D.O.S: - 23/12/19

MARKS: -

Marks Obtained Dated signature of

Teacher
Process Related Product Related Total (50)
(35) (15)

CO6I
 Project Proposal

Hand gesture recognition system is used for interfacing between computer and human using
hand gesture. We wish to make a windows-based application for live motion gesture recognition
using webcam input in Java/Python/OpenCV. This project is a combination of live motion
detection and gesture identification. This application uses the webcam to detect gesture made by
the user and perform basic operations accordingly. The user has to perform a particular gesture.

The webcam captures this and identifies the gesture, recognizes it (against a set of known
gestures) and performs the action corresponding to it. This application can be made to run in the
background while the user runs other programs and applications. This is very useful for a hands-
free approach. While it may not be of great use for browsing the web or writing a text
document, it is useful in media player and while reading documents or files.

Our Application is for Dumb and Deaf people. Normal people cannot understand the sign
language used by Dumb and Deaf people, so for communicating with these kinds of people ,Our
Application will be useful as it will provide an interface for communication.

If he /she wants to convey a message they need to use standardized sign language and the
application smartly recognizes it and prints it ,making our job simpler. The application
recognizes the language and displays the message which the user wants to convey.

It makes it easier for Dumb and Deaf people to get forth their message without facing any
difficulties. It also saves a lot of time for the user as well as the person who is trying to
understand the message.
VES POLYTECHNIC CAPSTONE PROJECT – EXECUTION 22060

EXPERIMENT NO. 2

Title: - Punctuality and Overall Contribution

D.O.P: - 23/12/19

D.O.S: - 06/01/2020

MARKS: -

Marks Obtained Dated signature of

Teacher
Process Related Product Related Total (50)
(35) (15)

CO6I
 Punctuality and Overall Contribution

 The work between all the team members was distributed equally by keeping in
mind the capabilities and capacities of each member. This project gave us the
opportunity to learn how to work in team and how to distribute the work.

 There were total four members in our group – Sahil Dalvi, Pranali Dharme,
Rutuja Kurhade, Sahil Pahuja.

 Firstly, we all studied OpenCV – python, trenserflow and Kairos. OpenCV is used
for image processing with the help of OpenCV we can manipulate pixels and
make them work according to us.

 TenserFlow is a library for Neural Network. Neural networks, as the name

suggests, are modeled on neurons in the brain. They use artificial intelligence to
untangle and break down extremely complex relationships. What sets neural
networks apart from other machine-learning algorithms is that they make use of
an architecture inspired by the neurons in the brain

 Kairos is a wrapper over TenserFlow. Kairos is a minimalist Python library

for deep learning that can run on top of Theano or TensorFlow. It was developed
to make implementing deep learning models as fast and easy as possible for
research and development.

 After reading about these libraries we decided to start the project with CNN
(Convolution Neural Network) using kairos

 Sahil Dalvi and Sahil Pahuja started with CNN File and Rutuja Kurhade and
Pranali Dharme started with image capturing file.

 Later on Rutuja Kurhade and Sahil Pahuja completed the image reorganization
file.Sahil Dalvi and Pranali Dharme created the data i.e. all the signs pictures.

 Later on we all trained the Model and created test Model file and Trained Model
File.
 Towards the end of the process all the modules were integrated and the errors
encountered during the integration were solved by everyone together. We understood
that testing played a very important role in application, website and software
development.
VES POLYTECHNIC CAPSTONE PROJECT – EXECUTION 22060

EXPERIMENT NO. 3

Title: - Project Diary (Fortnight Reports)

D.O.P: - 09/12/2019

D.O.S: - 23/03/2020

MARKS: -

Marks Obtained Dated signature of

Teacher
Process Related Product Related Total (50)
(35) (15)

CO6I
 Project Diary

Fortnight Report 1

In the first week of July all the students were instructed about how we have to decide and
implement our major project. We all had to decide an individual topic for our major project. We
were told that in the previous semester we had to decide the topics and scope of our project and
in this semester we have to implement the same.

The first topic we decided to go with was IoT based Automatic room light controller, which
could help to save electricity in malls schools washrooms labs collages etc. We decided the
scope of the project. We would design the application in such a way that as a person enters a
room, lights will turn ON and when the person leaves, lights will turn OFF.

The next topic was a Matrimonial website which will help people to find their idea match
Online Matrimonial Application Systemis in the process of interconnecting allthe branches and
to develop a custommade software which covers functionslike matrimonial management
andprocessing of a matrimonial agency.The system not only takes careof registration but also
contemplate onworkflow, customer service, customer history, employee history (both work
history and payment history) andnearpaperless operation.

Thefinaltopicwhichwasselectedas our majorprojectwasHandGestureRecognition for Dumb and

Deaf people. This Project will help Dumb and Deaf people to communicate with Normal
Humans. The gestures will be displayed according to the American Standard Sign Language.
Dumb and Deaf people can show gestures using their hand and we can interpreter that sign with
the help of text displayed on the Screen.

The project proposal, requirements, scope and all were discussed and a proper documented
report on the same was presented.

The synopsis for each topic presented is given below:

 TITLE OF THE PROJECT: Automatic Room Light Controller

ABSTRACT

When we enter a room, as a habitual tendency, we often search for a switch to turn the light on,
and if we are new to the room, we often find it difficult to locate the switch. Most of the times,
many of us forget to switch off the lights while leaving the room in which we stay most of the
time. This results in unnecessary power wastage. Therefore, an automatic room-light controller
automatically turns on the lights when a person enters into a room, and turns off the lights when
the person leaves the room. This automatic room controller can be implemented by using
sensors.

SYSTEM REQUIREMENTS

HARDWARE

Sr. No. Name of the Equipment Specification Quantity

1 Computer System 1GB RAM or above 1
2 Sensor As required 1
3 Net Connection 612 Mbps

SOFTWARE

Sr. No. Name of the Software Specification Quantity

1 Windows Windows 7 or above 1
2 Python - 1
3 NetBeans 8.1 1
4 MySql - 1
MODULE FLOWCHART
TITLE OF THE PROJECT: Rewamp of VESP website

ABSTRACT

A web page is a selection of Websites, pictures, video clips and other electronic resources that
is organized on one or several Web hosting server, usually available via the Internet, Mobile
phone or a LAN.

SYSTEM REQUIREMENTS

HARDWARE

Sr.No Name Of The Equipment Specification Quantity

1 Computer System 4 GB RAM 1

2 LAN Connection -

3 Hard disk 100 MB 1

SOFTWARE

Sr.No Name Of The Software Specification Quantity

1 HTML - 1

2 JS - 1
3 PHP - 1
FLOWCHART :
TITLE OF THE PROJECT: Hand Gesture Recognition for Dumb and Deaf people

ABSTRACT

Our Application is for Dumb and Deaf people. Normal people cannot understand the sign
language used by Dumb and Deaf people, so for communicating with these kinds of people
our application will be useful as it will provide an interface for communication.

If he /she wants to convey a message they need to use standardized sign language and the
application smartly recognizes it and prints it,making our job simpler. The application
recognizes the language and displays the message which the user wants to convey.

It makes it easier for Dumb and Deaf people to get forth their message without facing any
difficulties. It also saves a lot of time for the user as well as the person who is trying to
understand the message.

SYSTEM REQUIREMENTS

HARDWARE

Sr. No. Name of the Equipment Specification Quantity

1 Computer System 1GB RAM or above 1

Laptop’s Integrated
2 Camera 1
Webcam

SOFTWARE

Sr. No. Name of the Software Specification Quantity

1 Windows Windows 7 or above 1

-
2 Python 1
MODULE FLOWCHART
Fortnight Report 2

Detailed Synopsis

Problem Statement:

Special People like dumb and deaf people communicate using sign language, but
people(normal) like us cannot understand their language .To make a proper communication
between special people and normal people this application has been developed.

Problem Description:

The application named Hand Gesture Recognition for Dumb and Deaf people resolves
problems experienced by people while communicating .Some of the problems are listed
below:
1. Special people like Dumb and Deaf people have to repeat the message which they
want to convey again and again.
2. Special person health can be affected.

To cater the needs and requirements of people this system is being developed. This system is
easy to use and effective. It will help a lot of customers to save their value time. A
communication gap and a bridge between Special people and Deaf people can be built using
this system.

Working:

Our Application is for Dumb and Deaf people who communicate with each other using sign
language, but what if they want to communicate with normal person. Normal person doesn’t
understand sign language, so for Dumb and Deaf people and normal person to communicate
we proposed this Project as Application. In our Application if a person wants to communicate
with a normal person, then by using American Standard Sign Language they can
communicate. By using this Application a normal person can understand the Sign language
used by special people, our application will display Sign Language in text format which a
normal person can read or listen by clicking on speak button.
Usage:

Since the program searches for the brightest pixel in the camera's field of view, the lighting
conditions of your room can affect its performance. So, adjust the brightness threshold and
lighting conditions so that nothing (except user’s hand) exceeds the brightness threshold.

Gestures are recognized according to American standard language.

Advantages:

 Secured communication.
 Ensure data accuracy’s.
 Minimize manual data entry
 Minimum time needed for the various processing.
 Greater efficiency.
 Better service.
 User friendliness and interactive.
 Minimum time require

Conclusion:
 We have done this project to utilize our technical skills. Through this project we have
introduce an application for Dumb and Deaf people which will help them to interact with
the world conveniently without hesitation.

 This system is basically to be used in business meetings or informal chat between Dumb
or Deaf person and a normal person. With some modifications and updates, we can use
this for physically challenged people
Fortnight Report 3

Project Design

Block Diagram:

Figure 1: Block diagram

Data Flow Diagram:

Figure 2: Data Flow Diagram

Use Case Diagram:

Figure 4: Use Case Diagram

Workflow Diagram:

Figure 5: Workflow diagram

Fortnight Report 4

Implementation

Our Application is for Dumb and Deaf people. Normal people cannot understand the sign
language used by Dumb and Deaf people, so for communicating with these kinds of people,
Our Application will be useful as it will provide an interface for communication. If he /she
wants to convey a message they need to use standardized sign language and the application
smartly recognizes it and prints it, making our job simpler. The application recognizes the
language and displays the message which the user wants to convey. It makes it easier for
Dumb and Deaf people to get forth their message without facing any difficulties. It also saves
a lot of time for the user as well as the person who is trying to understand the message.

Proposed System
Our Application is for Dumb and Deaf people who communicate with each other using sign
language, but what if they want to communicate with normal person. Normal person doesn’t
understand sign language, so for Dumb and Deaf people and normal person to communicate
we proposed this Project as Application. In our Application if a person wants to communicate
with a normal person, then by using American Standard Sign Language they can
communicate.By using this application a normal person can understand the Sign language
used by special people, our application will display Sign Language in text format which a
normal person can read or listen by clicking on speak button.
Advantages of Proposed System

This Application is very useful for Special people like Dumb and Deaf people. By using this
application Special people will gain importance as much as a normal person in every field.

 Secured communication.
 Ensure data accuracy’s.
 Minimize manual data entry.
 Minimum time needed for the various processing.
 Greater efficiency.
 Better service.
 User friendliness and interactive.
 Minimum time required.
Fortnight Report 5

GUI Design

Fig – Standard Sign Language

Fig – List of Languages

Fig – Masking Image

 Fig – Model Set

Fig – Image to Recognize

VES POLYTECHNIC CAPSTONE PROJECT - EXECUTION 22060

EXPERIMENT NO. 4

Title: - Execution plan of project in

sixth semester

D.O.P: - 06/01/2020

D.O.S: - 03/02/2020

MARKS: -

Marks Obtained Dated signature of

Teacher
Process Related Product Related Total (50)
(35) (15)

CO6I
 Execution of Plan during the Sixth Semester

Step 1: Analysis the flow of Project which was to develop an application named Hand Gesture
Recognition. Our motive was to analyze the flow on paper so that we could get a clear idea which
we could explain to our mentor.

Step 2: The next step was to learn new libraries which was very necessary to complete this Project.
This was an important part or a phase because on the basis of this our application.

Step 3: We explore OpenCV and just because we were using Python Language for our Application
we explored OpenCV – Python.

Step 4:Then after learning OpenCV and we were able to fetch frames from video, organize the
images and pass it to the predict method of our Neural Network Model.

Step 5: Next, we started exploring TensorFlow and Kairos and the difference between both of
them.

Step 6: Then we came to know that for simple image reorganization Kairos is more convenient and
user-friendly. So we decided to use Kairos as our model.

Step 7: First we trained the model with less number of images to make the process faster for
testing.

Step 8: After the test was successful, we again trained the model with greater number of images,
surely it is time consuming but more the number of images more the accuracy.

Step9: After high priority requirements were sufficed, we tested the actual application to ensure
that our application was user friendly .We asked some of our friends to use it and then review it.
We then made necessary changes according to the reviews.

Step 10: Last but not the least, we presented the project to our mentor and to the Head Of
Department to get a final review.
VES POLYTECHNIC CAPSTONE PROJECT - EXECUTION 22060

EXPERIMENT NO. 5

Title: - Report Writing including

Documentation

D.O.P: - 03/02/2020

D.O.S: - 16/03/2020

MARKS: -

Marks Obtained Dated signature of

Teacher
Process Related Product Related Total (50)
(35) (15)

CO6I
 ABSTRACT

• A hand gesture recognition system was developed to capture the hand gestures being performed
by the user and to control a computer system based on the incoming information. Many of the
existing systems in literature have implemented gesture recognition using only spatial modeling
i.e. recognition of a single gesture and not temporal modeling i.e. recognition of motion of
gestures. Also, the existing systems have not been implemented in real time, they use a pre-
captured image as an input for gesture recognition.

• To overcome these existing problems a new architecture has been developed which aims to
design a vision-based hand gesture recognition system with a high correct detection rate along
with a high-performance criterion, which can work in a real time HCI system without having any
of the mentioned strict limitations (gloves, uniform background etc.) on the user environment.

• Our Application is for Dumb and Deaf people. Normal people cannot understand the sign
language used by Dumb and Deaf people, so for communicating with these kinds of people, Our
Application will be useful as it will provide an interface for communication. If he /she wants to
convey a message they need to use standardized sign language and the application smartly
recognizes it and prints it, making our job simpler.

• The application recognizes the language and displays the message which the user wants to
convey. It makes it easier for Dumb and Deaf people to get forth their message without facing
any difficulties. It also saves a lot of time for the user as well as the person who is atrying to
understand the message.
 GANTT CHART

Fig – GANTT CHART 1

Fig – GANTT CHART 2

Fig – GANTT CHART 3

Fig – GANTT CHART 4

Fig – GANTT CHART 5

VES POLYTECHNIC CAPSTONE PROJECT - EXECUTION 22060

EXPERIMENT NO. 6

Title: - Presentation

D.O.P: - 23/03/2020

D.O.S: - 23/03/2020

MARKS: -

Marks Obtained Dated signature of

Teacher
Process Related Product Related Total (50)
(35) (15)

CO6I
Presentation