Smart Home Speech Recognition System

Shubham Borade, Krushna Chaudhai, Manish Borkar, Prof. A. M. Shah

Department of Electronics and Telecommunication Engineering
Government College Of Engineering, Amravati, Maharashtra, India

Abstract - Innovation has carried all that to occur in the hand. We are utilizing innovations to
controlling also, observing electrical machines utilizing voice control app with the assistance of web
association. So it gives a more space at a home, college and modern controlling electrical apparatuses
anyplace on the planet. By utilizing Web of Things we have some control over numerous devices such
as light, power plug, Fan, PC, security framework and so on. It will decrease human exertion and power
effectiveness. A home machine is a gadget or instrument intended to play out explicit capacity,
particularly an electrical gadget, like a cooler, for family use. The words apparatus also, gadgets are
utilized conversely. Mechanization is the present truth, where things are being controlled
consequently, normally the fundamental errands of turning ON/OFF specific gadgets and then some,
either from a distance or right up front vicinity. In any case, the truth of the matter is checking less
gadgets and wellbeing is less. More power utilization. So we have use mechanization with less power
here we proposed a framework That comprise of a computer server with web association, an IOT
Ethernet safeguard used to associating the server to the outside organization, There. An Arduino
microcontroller with a designed application associated with the gadgets. The model framework
upholds two-level gadgets that in particular should be turned on or off. An IOT put together home
mechanization framework centres with respect to controlling home electronic gadgets whether you
are inside or outside your home. Save the electric power and human energy.

Introduction
The savvy home computerization framework utilizing voice control assists with controlling
electrical apparatuses by utilizing voice orders. The framework EsP8266 module for
communicating information for controlling working of electrical loads. The module get input
signal from any a gadget which have voice directing and with blynk application. Similarity, for
example, cell phone. The shrewd home computerization is generally gainful for debilitation
or matured individuals. The framework tackle the issue of switching on/off electrical
apparatuses in light of the fact that when client simply need to give voice order to control the
machine or electrical burdens. The framework is planned in such a manner client have some
control over all machine immediately or have some control over each independently. The
framework works by communicating the on/off switches of electrical apparatus or burdens
by utilizing hand-off or strong state replay, subsequent to interfacing transfers in framework
the electrical switch functions as two way switch. The voice order is sent by utilizing a blynk
application for controlling the framework, a underlying receiver and voice acknowledgment
framework carried out, for example, AMAZON alexa. A miniature regulator (Arduino Uno) is
carried out in framework, the miniature regulator gets input signal from client gadget and
sent sign to separate hand-off for turning on/off electrical machines associated with
framework like bulbs, fan, air conditioner unit and so on. The framework chips away at 12V
DC power which is changed over from 220V AC power by utilizing stepdown transformer,
rectifier for changing over AC into DC and capacitive channel making fluctuating DC into
unadulterated DC power. This paper centre around the advancement of voice controlled
based upon discourse acknowledgment framework. The frameworks UI gadget is a cell phone
and programming which interact with Arduino Uno to execute orders of client.

Literature Survey
As per our survey, there exist many systems that can control home appliances using android
based phones/tablets. Each system has its unique features. Currently certain companies are
officially registered and are working to provide better home automation system features.
Following models describes the work being performed by others. N. Sriskanthan explained
the model for home automation using bluetooth via PC. But unfortunately the system lacks
to support mobile technology. Muhammad Izhar Ramli designed a prototype electrical device
control system using Web. They also set the server with auto restart if the server condition is
currently down.
Amul Jadhav developed an application in a universal XML format which can be easily ported
to any other mobile devices rather than targeting a single platform. Each of these system has
their own unique features and on comparison to one another lacks some advancement. Our
designed system has application layer prototype. The application is able to synthesize the
speech data with the help of Google Voice Reorganization. The synthesized data are analyzed
and further processing is carried out. In layman words, our design system provides features
of controlling the home appliances using voice commands. The use of socket programming is
performed to connect the android application with the raspberry pi. This further adds security
to our system. The data are received only by the server at the specified port and data are
further analyzed. Our project is different in a sense it has its own software level application
to control the home appliances.

Devices
Here we see around 1)devices we have utilized 2) voice control application 3) controlling
electrical apparatus application(Blynk) 4)how we control the gadget
Devices we have used:
1) Node MCU 2) relay
1)ESP 8266(NodeMCU)
The ESP8266 WiFi Module is a free SOC with integrated TCP/IP show stack that can give any
microcontroller induction to your WiFi association. The ESP8266 is ready to do either working
with an application then again offloading all Wi-Fi sorting out limits from another application
processor. Each ESP8266 module comes pre-adjusted with an AT request set firmware,
meaning, you can simply interface this to your Arduino contraption and get likely as much
WiFi-limit as a WiFi Shield offers (and that is scarcely out of the compartment)! The ESP8266
module is a very sharp board with a gigantic, and consistently creating, neighbourhood. This
module has a sufficient prepared dealing with and amassing capacity that grants it to be
facilitated with the sensors and other application express contraptions through its GPIOs with
inconsequential development direct front and immaterial stacking during runtime. Its not
kidding level of on-chip mix considers immaterial outside equipment, including the front-end
module, is expected to occupy minimal PCB area. TheESP8266 maintains APSD for VoIP
applications and Bluetooth co-existance interfaces, it contains a self-adjusted RF allowing it
to work under each functioning condition, and requires no outside RF parts.
2)Relay Module

The hand-off have capacity for going about as switch for turning on and off electrical burdens.
They Woks basically by providing little electrical power in type of electrical sign. This permit
high power loads constrained by Using small measure of force. The mechanical hand-off
utilizes electromechanical loop to open and close the circuit. Whenever limited quantity of
current passes through curl it invigorates the loop and produces attractive field and either
pull the
bar or delivery the bar which is utilized for opening and shutting the circuit, here opening and
shutting implies limits stream of current as well as the other way around.
3) Image of relay APP used blynk
Blynk is a Platform with IOS and Android apps to control Arduino, Raspberry Pi and the likes
over the Internet. It's a digital dashboard where you can build a graphic interface for your
project by simply dragging and dropping widgets.The most popular IoT platform to connect
your devices to the cloud, design apps to control them, and manage your deployed products
at scale.
4) IFTTT
IFTTT derives it’s name from the programming conditional statement “if this then that”. What
we get is a software platform that connects apps, devices and services from different
developers in order to trigger ine or mora automations involving those apps, devices and
services. The automations are accomplished via applets which are sort of like macros that
connect multiple apps to run automated tasks. You can turn on or off an applet using IFTTT
website or mobile app. You can also create your own applet or make variations of ones via
IFTTT’s interface.

Objectives
1) To learn about Node MCU and it’s features.
2) To learn about blynk Dtat Transmission.
3) To learn about how does blynk works.
4) Function of voice control.
5) To study how we can connect home appliances with blynk.
6) How blynk is advantageous and different from Bluetooth.

Proposed System
 A home machine is a gadget or instrument intended to fill a particular role, particularly
an electrical device, like a fridge, for family use. The words machine and gadgets are utilized
reciprocally. Robotization is the present reality, where things are being controlled
consequently, generally the essential assignments of turning ON/OFF specific gadgets and
then some, either from a distance or in close proximity. But the truth of the matter is checking
less gadgets and security is less. more power utilization. So we have use robotization with less
power here we proposed a system. That comprise of a computer server with web association,
an IOT Ethernet safeguard utilized to interfacing the server to the outer organization, There
an Arduino microcontroller with a designed application associated with the gadgets. The
model framework upholds two-level gadgets that main should be turned on or off. An IOT put
together home computerization framework centres with respect to controlling home
electronic gadgets whether you are inside or outside your home. Save the electric power and
human energy.

Proposed Model:
Working Description:
The framework is planned by utilizing two primary parts, first is is wifi module ESP8266 and
second is mechanical transfer. Client, first and foremost, provides the order to
microcontroller by utilizing discourse acknowledgment arrangement of cell phone and
framework programming application by means of esp8266 associated with blynk. The
microcontroller acts in like manner to the order give client and control the usefulness of
mechanical transfer. The Arduino Uno is customized utilizing Arduino IDE which is
programming, we need to associate the google voice acknowledgment for reaction our
command. To add comments we have add applet in google collaborator program chief.

Voice ESP 8266

User Recognitio WiFi
n
IFTTT Module

Relay Blynk
Load
Module Applicatio
n

The steps involved in the working are explained as follows

 1) Voice gets recognised through the mobile app.
2) The NodeMcU gets connected to the WiFi of which we have mentioned in the code.
3) After Blynk app gets connected to internet connection and switches on relay.
4) There are two states i.e. high and low.

While we give the voice remark as off the gadget are set from on to off working flow
in framework the electrical switch functions as two way switch. The voice order is sent by
utilizing a voice acknowledgment application, an implicit microphone and voice
acknowledgment framework carried out in gadget, for example, google voice partner. A
miniature regulator (Arduino Uno) is executed in framework, the miniature regulator gets
input signal from client gadget and sent sign to individual transfer for turning on/off electrical
machines associated with framework like bulbs, fan, air conditioner unit and so forth. The
framework deals with 5V DC power which is changed over from 220V AC power by utilizing
stepdown transformer[4],rectifier for changing over AC into DC and capacitive channel
making fluctuating DC into unadulterated DC power. This paper centre around the
improvement of voice controlled in light of discourse acknowledgment framework. The
frameworks UI gadget is a cell phone and programming which interact with Arduino Uno to
execute orders of client.

HARDWARE USED
1) Esp8266 wifi module
2) Relay Module

This little module permits microcontrollers to interface with a Wi-Fi organization and
simplify TCP/IP associations utilizing Hayes-style orders. Notwithstanding, at first there was
basically no English-language documentation on the chip and the orders it accepted. The very
low price and the way that there were not very many outside parts on the module, which
recommended that it could ultimately be extremely economical in volume, drawn in
numerous programmers to investigate the module, the chip, and the product on it, as well as
to interpret the Chinese documentation.

Procedure:
1) Install Blynk mobile app. It is available on ios as well as android.
2) Create a account in Blynk app.
3) Create a new project and you will receive Auth Token in an email which is needed later
in project.
4) Set device to NodeMCU and connection type to WiFi.
5) Drag as many buttons you needed from the widget box to project.
6) Configure the buttons and below is given screenshot for information.
7) Associate ESP8266 and with your Laptop through Micro-USB link.
8) Open Arduino IDE, set the board to NodeMCU ans set baud rate as well.
9) Write your code.
10) Provide the Auth Code sent to you in mail.
11) Provide correct WiFi credentials in code.
12) Upload the code and see whether the NodeMCU is connected to WiFi or not.

Theory:
This IoT project uses Relays to turn electrical machines on and off when the ESP8266
triggers it to switch. Microcontrollers are a touchy piece of equipment that can't deal with
220 Voltsso we can't simply control our home apparatuses straightforwardly with the
microcontroller and Relays are the ideal answer for that. A transfer is fundamentally a
switch what is set off with a little electrical sign. It comprises of a switch and a centre with
a copper wire folded over it, known as the Armature. Relay consists of two states which is
normally closed (NC) and Normally Opened (NO). The machines are associated among NO
and Ground as the transfers are at first in the NC state. At the point when the
Microcontroller gives the trigger capacity, the armature turns into an electromagnet and
pulls the switch to NO end the circuit subsequently. As the Relay utilized in our undertaking
is 2 channel, it implies we have some control over two apparatuses with it. The trigger pins
of the Relay for example IN1 and IN2 are associated with the advanced pins of the
NodeMCU. We use Blynk_Write() capacity to get esteem from Blynk at virtual pins V1 and
V2 utilizing param.asInt(). Whenever the button is squeezed in Blynk, a string with a
number "1" meaning HIGH is shipped off NodeMCU and the switch is turned on. When the
button is squeezed again in Blynk, it sends one more string with a number "0" meaning
ESP8266 and the switch is switched off.

Result
This study presented the plan, creation, and execution of a convenient, easy to use, and
minimal expense mechanization framework for SHs in light of IoT. The created IoT Home
framework can be effectively carried out in a genuine house to permit constant checking
of home circumstances and control of home machines. A few sensors and actuators were
associated with the NodeMCU regulator, which refreshed the information to the IoT
server. The acquired information from the sensors (temperature, dampness, movement,
gas, and RFID) can be checked through MQTT Dash portable application and Adafruit IO
Web through PCs/PC Control of home machines can be effectively and proficiently directed
by utilizing MQTT/Adafruit IO GUI or through voice orders utilizing Google Assistant. The
consequences of this study are promising, and the created framework can build the
wellbeing, security, knowledge, and solace of clients.
 References

[1]. Wan-Ki Park, Chang-Sic Choi, Jinsoo Han and Intark Han, "Design and Implementation of ZigBee
based URC Applicable to Legacy Home Appliances", IEEE International Symposium onConsumer
Electronics(ISCE 2007), Irving,TX,June 20-23, 2007, pp.1- 6.

[2]. 4. Jinsoo Han, Haeryong Lee and Kwang-Roh Park, " Remote-controllable and energy-saving room
architecture based on ZigBee communication", IEEE Transactions on Consumer Electronics, Vol.55,
No.1, Feb. 2009, pp.264-268.

[3]. M. Spencer et al., “Demonstration of integrated micro-electromechanical relay circuits for VLSI
applications,” in IEEE Journal of Solid-State Circuits, 2011

[4]. A. Paul, M. Panja, M. Bagchi, N. Das, R. M. Mazumder, and S. Ghosh, “Voice recognition based
wireless room automation system,” in 2016 International Conference on Intelligent Control, Power
and Instrumentation, ICICPI 2016, 2017

[5]. H. A. Shu’eili, G. Sen Gupta, S. Mukhopadhyay, "Voice Recognition based Wireless Home
Automation System", Proc. 4th IEEE International Conference on Mechatronics (ICOM), May 2011

[6]. A. Ghosh, R. Mitra, S. Mohalanobish, S. De, S. Bhattacharjee, S. Bardhan, "Wireless Irrigation

System", Proc. 2018 IEEE International Conference on Recent Innovation In Electrical, Electronics
&CommunicationEngineeringICRIEECE-2018,2018