Batch 7
Batch 7
Batch 7
ABSTRACT
Communication for a person who cannot hear is visual, not auditory. Generally dumb
people use sign language for communication, but they find difficulty in
communicating with others who don’t understand sign language. So, there is a barrier
in communication between these two communities. Smart Glove for Sign Language
Translation is a work that aims to provide a cost-effective system which can give
voice to voiceless person with the help of Smart Gloves. This work consists of a glove
equipped with switches which gives different information’s, these information data are
fed to Node MCU and transfer data to android phone via Wi-Fi module, a common
android phone is used in this work for show location, call and data. In real life, the
sign language users mostly use both hands. Thus, this is a prototype work attempts to
bridge the communication gap between normal ones and the disabled by designing a
portable glove that captures the users gestures and outputs the translated text on an
android phone. It means that using smart gloves lowers the barrier in the means of
communication.
This project uses regulated 5V, 500mA power supply. Unregulated 12V DC is used
for relay. 7805 three terminal voltage regulator is used for voltage regulation. Bridge
type full wave rectifier is used to rectify the ac output of secondary of 230/12V step
down transformer.
CHAPTER 1
INTRODUCTION TO EMBEDDED SYSTEMS
1.1 INTRODUCTION:
1.3 CHARACTERISTICS:
Serial
CPU COM
General RAM ROM I/O Port Timer Port
MICROCONTR
OLLERS (MC)-
Purpose
Embedded Systems talk with the outside world via peripherals, such as
Serial Communication Interfaces (SCI): RS-232, RS-422, RS-
485etc
Synchronous Serial Communication Interface: I2C, JTAG, SPI,
SSC and ESSI
Universal Serial Bus (USB)
Networks: Ethernet, Controller Area Network, LAN networks,
etc.
Timers: PLL(s), Capture/Compare and Time Processing Units
Discrete IO: aka General Purpose Input/output (GPIO)
Ana log to Digital/Digital to Analog (ADC/DAC)
Tools:
2.1 INTRODUCTION
It is hard to understand every text and sensibility voice for the user.
It is Not reliable to operations performed.
RPS
IOT
SW1 MOBILE
NODE MCU APP
SW2
ESP8266
SW3
SW4 LCD
SW5
SW6
Fig 2.1 Block Diagram
Power Supply
Node MCU ESP8266
Switches
LCD
IOT TECHNOLOGY
Event driven
Ambient intelligence
Flexible structure
Semantic sharing
When I'll be ready to leave the house, the smart refrigerator will
tell me that there is milk and fruits for my breakfast and I shouldn’t eat
cheese today because I didn’t exercise yesterday. It is so smart that if any
food item has finished or expired- it will connect to the supermarket on
the internet, order my groceries and I would be able to pay sitting from
anywhere anytime through my mobile wallet.
These devices are so smart that they would be collecting data from my
physical movements and will monitor my activities and behavior to
do predictive analysis of my routine and preferences. You would be
amazed at how many such smart devices already exist or are going to be
available in the near future to make up a powerful Internet of Things.
Application Layer
3.9APPLICATIONS:
Sensors have always been an integral part of the factory setup for
security, automation, climate control, etc. This will eventually be
replaced by a wireless system giving the flexibility to make changes to
the setup whenever required. This is nothing but an IoT subnet dedicated
to factory maintenance.
3.9.4 MOBILE:
Smart transportation and smart logistics are placed in a separate
domain due to the nature of data sharing and backbone implementation
required. Urban traffic is the main contributor to traffic noise pollution
and a major contributor to urban air quality degradation and greenhouse
gas emissions. Traffic congestion directly imposes significant costs on
economic and social activities in most cities. Supply chain efficiencies
and productivity, including just-in-time operations, are severely
impacted by this congestion causing freight delays and delivery schedule
failures. Dynamic traffic information will affect freight movement, allow
better planning and improved scheduling. The transport IoT will enable
the use of large scale WSNs for online monitoring of travel times,
origin– destination (O–D) route choice behavior, queue lengths and air
pollutant and noise emissions. The IoT is likely to replace the traffic
information provided by the existing sensor networks of inductive loop
vehicle detectors employed at the intersections of existing traffic control
systems. They will also underpin the development of scenario-based
models for the planning and design of mitigation and alleviation plans,
as well as improved algorithms for urban traffic control, including multi-
objective control systems. Combined with information gathered from the
urban traffic control system, valid and relevant information on traffic
conditions can be presented to travelers. The prevalence of Bluetooth
technology (BT) devices reflects the current IoT penetration in a number
of digital products such as mobile phones, car hands-free sets, navigation
systems, etc. BT devices emit signals with a unique Media Access
Identification (MAC-ID) number that can be read by BT sensors within
the coverage area.
Economic growth
Better environment
Improved competitiveness
3.10.1 SMARTWATCHES
3.10.4CONNECTED RETAIL
Traditional retailer store is struggling to keep up with the
growing e-commerce. Thanks to the Internet Of Things, innovators have
started to breathe new life into the retail experience- offering connected
point of sale systems, NFC payments solutions and supply chain
software’s.
3.10.5VIRTUAL AUGMENTED
REALITY
Last year Oculus Rift and Google glass made headline in both the
virtual and augmented Reality worlds. Oculus was acquired by Facebook
for $2.3 Billion earlier this year and Google glass recently rolled out a
one-day sale of its “Explorer Edition”.
Some open challenges are discussed based on the IoT elements presented
earlier. The challenges include IoT specific challenges such as privacy,
participatory sensing, data analytics, GIS based visualization and
Cloud computing apart from the standard WSN challenges including
architecture, energy efficiency, security, protocols, and Quality of
Service.
3.11.1 ARCHITECTURE
Overall architecture followed at the initial stages of IoT research
will have a severe bearing on the field itself and needs to be investigated.
Most of the works relating to IoT architecture have been from the
wireless sensor networks perspective.
3.11.3 SECURE
REPROGRAMMABLE NETWORKS
AND PRIVACY
Security will be a major concern wherever networks are deployed
at large scale. There can be many ways the system could be attacked—
disabling the network availability; pushing erroneous data into the
network; accessing personal information; etc.
CHAPTER 4
HARDWARE COMPONENTS
Power Supply
Node MCU ESP8266
Switch
LCD
In this project we have power supplies with +5V & -5V option
normally +5V is enough for total circuit. Another (-5V) supply is used in
case of OP amp circuit.
TRANSFORMER
RECTIFIERS
The purpose of a rectifier is to convert an AC wave form into a
DC wave form (OR) Rectifier converts AC current or voltages into DC
current or voltage. There are two different rectification circuits, known as
'half-wave' and 'full-wave' rectifiers. Both use components called diodes
to convert AC into DC.
FILTERS
A filter circuit is a device which removes the ac component of
rectifier output but allows the dc component to the load. The most
commonly used filter circuits are capacitor filter, choke input filter and
capacitor input filter or pi-filter. We used capacitor filter here.
Rectifier O/PCRL
With its USB-TTL, the node MCU Dev board supports directly flashing
from USB port. It combines features of WIFI access point and station +
microcontroller. These features make the Node MCU extremely
powerful tool for Wi-Fi networking. It can be used as access point and/or
station, host a web server or connect to internet to fetch or upload data.
Node MCU Pin out is having labels D0 to D8 and RX-TX but when
programming it using Arduino IDE we observe that its labels are not
matching with IO connections. Let’s see actual connections of Node-MCU
with ESP8266 i.e. ESP-12.
PCB antenna.
Low cost
POWER PINS
There are four power pins viz. one VIN pin & three 3.3V pins. The
VIN pin can be used to directly supply the ESP8266 and its peripherals, if
you have a regulated 5V voltage source. The 3.3V pins are the output of an
on- board voltage regulator. These pins can be used to supply power to
external components.
GND
It is a ground pin of ESP8266 Node MCU development board.
12C
These are used to hook up all sorts of I2C sensors and peripherals in
your project. Both I2C Master and I2C Slave are supported. I2C interface
functionality can be realized programmatically, and the clock frequency is
100 kHz at a maximum. It should be noted that I2C clock frequency should
be higher than the slowest clock frequency of the slave device.
GPIO PINS
ESP8266 Node MCU has 17 GPIO pins which can be assigned to
various functions such as I2C, I2S, UART, PWM, IR Remote Control,
LED Light and Button programmatically. Each digital enabled GPIO can
be configured to internal pull-up or pull-down or set to high impedance.
When configured as an input, it can also be set to edge-trigger or level-
trigger to generate CPU interruptions.
ADC PINS
The Node MCU is embedded with a 10-bit precision SAR ADC.
The two functions can be implemented using ADC viz. Testing power
supply voltage of VDD3P3 pin and testing input voltage of TOUT pin.
However, they cannot be implemented at the same time.
UART PINS
ESP8266 Node MCU has 2 UART interfaces, i.e. UART0 and
UART1, which provide asynchronous communication (RS232 and RS485),
and can communicate at up to 4.5 Mbps. UART0 (TXD0, RXD0, RST0 &
CTS0 pins) can be used for communication. It supports fluid control.
However, UART1 (TXD1 pin) features only data transmit signal so, it is
usually used for printing log.
SPI PINS
ESP8266 features two SPIs (SPI and HSPI) in slave and master
modes.
These SPIs also support the following general-purpose SPI features:
Up to 64-Byte FIFO
SDIO PINS
PWM PINS
CONTROL PINS
INTRODUCTION TO ESP8266
There’s also 128 KB RAM and 4MB of Flash memory (for program
and data storage) just enough to cope with the large strings that make up
web pages, JSON/XML data, and everything we throw at IoT devices
nowadays.
1 Ground - Connected to -
the ground of
the circuit
no PWM
no High at boot used to
GPIO16 or I2C
interrupt wake up from deep sleep
D0 support
connected to FLASH
pulled
D3 GPIO0 OK button, boot fails if
up
pulled LOW
D5 GPIO14 OK OK SPI(SCLK)
SPI(MISO)
D6 GPIO12 OK OK
D7 GPIO13 OK OK SPI(MOSI)
SPI(CS)
pulled to
D8 GPIO15 OK Boot fails if pulled
GND
HIGH
ADVANTAGES OF ESP8266
1. 1.Inexpensive
2. Do different.
7. Incentive program
4.3 SWITCHES
FEATURES
802.11 b/g/n
Integrated low power 32-bit MCU
Integrated 10-bit ADC
Integrated TCP/IP protocol stack
Integrated TR switch, balun, LNA, power amplifier and matching
network
Integrated PLL, regulators, and power management units
Supports antenna diversity
Wi-Fi 2.4 GHz, support WPA/WPA2
Support STA/AP/STA+AP operation modes
Support Smart Link Function for both Android and iOS devices
Support Smart Link Function for both Android and iOS devices
SDIO 2.0, (H) SPI, UART, I2C, I2S, IRDA, PWM, GPIO
STBC, 1x1 MIMO, 2x1 MIMO
A-MPDU & A-MSDU aggregation and 0.4s guard interval
Deep sleep power < 5Ua
Wake up and transmit packets in < 2ms
Standby power consumption of < 1.0mW (DTIM3)
+20dBm output power in 802.11b mode.
Operating temperature range -40C ~ 125C
4.5 BUZZER
SOFTWARE COMPONENTS
In Node MCU Boards the first thing you need is to install the Firmware
to the board the following method works for all Node MCU Boards
1. Open the Node MCU flasher master folder than open the
win32/win64 folder as your computer. Now open the folder Release than
double click ESP8266Flasher.
3. Go to configure tab.
4. Click on the small gear and open up the firmware which you have
downloaded.
After installing the firmware you are ready to do the programming with
the ESP8266
5. Go to Tools>Borads>Boards Manager
Step 3: Code...
Now we can do whatever you want with your Node MCU board
Following is an example for led blinking with Node MCU board via web
server
In arduino IDE go to tools>Boards>select NODEMCU 1.0
(ESP - 12E Module)
Again go to tools and select port.
Change the Wi-Fi name and password from the following code.
Now click on Upload button to upload the following code.
Connect the led's positive leg on D9 pin of board and negative to
the ground of the code.
Power up the board and open the serial monitor from arduino IDE
After connecting to the Wi-Fi it will show you the IP address.
Type that IP address on the web browser (Edge, Chrome,
Firefox etc.,)
A webpage will open you can change the status of LED by
turning it ON or OFF.
Application Example:
The input is read from switch pin. If switch is closed, it will read a low.
The LED output pin is set to the opposite of the switch pin. If the switch
is closed, the output pin will be set to a high. A high will turn on the LED.
5.2PROTEUS
5.2.1 INTRODUCTION:
What is the main difference between the dotted PCB and layout PCB?
After completion of designing save with some mane and debug it.
This is virtual simulation means without making circuit we can see the
result in virtually through this software and we can design the PCB layout
to our required circuit with this software.
5.3MIT APP INVENTER
Log in to App Inventor with a Gmail (or google) user name and
password.
Use an existing gmail account or school-based google account to log in
to ai2.appinventor.mit.edu
Type in the project name (underscores are allowed, spaces are not) and
click OK.
You are now in the Designer, where you lay out the "user interface" of your
app.
The Design Window or simply "Designer" is where you lay out
the look and feel of your app, and specify what functionalities it should
have. You choose things for the user interface things like Buttons, Images,
and Text boxes, and functionalities like Text-to-Speech, Sensors, and GPS.
Add a Button
Our project needs a button. Click and hold on the word "Button" in
the palette. Drag your mouse over to the Viewer. Drop the button and a
new button will appear on the Viewer.
If for some reason you cannot connect to the Google Play store, you can
download the AI2 Companion as described here.
First, you will need to go into your phone's settings (#1), choose "Security",
then scroll down to allow "Unknown Sources", which allows apps that are
not from the Play Store to be installed on the phone.
On your phone or tablet, click the icon for the MIT AI Companion to start
the app. NOTE: Your phone and computer must both be on the same
wireless network. Make sure your phones Wi-Fi is on and that you are
connected to the local wireless network. If you cannot connect over Wi-Fi,
go to the Setup Instructions on the App Inventor Website to find out how to
connect with a USB cable.
Get the Connection Code from App Inventor and scan or type it into
Companion app
On the Connect menu, choose "AI Companion". You can connect by:
You will know that your connection is successful when you see your app on
the connected device. So far, our app only has a button, so that is what you
will see. As you add more to the project, you will see your app change on
your phone.
CHAPTER 6
7.1 ADVANTAGES
7.2 APPLICATIONS
CHAPTER 8
Sign language is one of the useful tools to ease the communication between
the deaf and mute communities and normal society. Though sign language
can be implemented to communicate, the target person must have an idea of
the sign language which is not always possible. Hence our project lowers
such barriers. The glove is capable of translating their sign language
gestures into speech through android phone. Smart glove focuses on the
translation of gestures of the alphabet. Compared with other approaches,
smart glove uses Principal Component Analysis to classify the real time
input data for feature extraction. Disabled use these gloves to convert sign
performed by them into speech and text. This paper is a useful tool for
speech impaired and partially paralyzed patients which fills the
communication gap between patients, doctors, and relatives.
From the convenience of simple accelerometers, a user can interact
with others in a more comfortable and easier manner.
This makes it possible for the user to not only interact with their
community but with others also and they can also live a normal life.
It is portable to use and is cost effective.
This project will give dumb a voice to speak for their needs and to
express their gestures.
Hence this project is an attempt to make it easy to understand the
actions of dumb people by getting the output in the form of text and
voice.
The text is also forwarded as SMS via Wi-Fi or modem for better
convenience and for security purposes.
The product will have a cheap and simplistic design making it easy
for users to interact easily.
The system is capable of recognizing signs more quickly.
Furthermore, real time recognition ratio of nearly 99% can be easily
achieved.
Thus the gesture recognition system designed using sensor fusion and
gesture recognition techniques in this venture has a lot of future aspects that
has to be taken into consideration in order to support the help for this
differently abled people more. This smart glove readily banishes the
required interpretation between a speech impaired and a normal person.
Future implementation can be made by enhancing the quality of the mobile
application which can be used to produce a lot of technical quality research
as in what is to be implemented to assist them more. We developed for
Android OS, In future we can also develop an application so that it can
work on any platform. We can also reduce the number of connecting wires
to make it simple to wear. It can be implemented in various fields like in
airport and railway stations to assist the speech impaired. One more
technical issue can be handled is to assist multi gesture at a higher speed in
which at times this device accuracy fails to reach the peak. Keeping in mind
the end goal to enhance and encourage the more signal acknowledgment,
movement handling unit can be introduced.
CHAPTER 9
REFERENCE