MATEC Web of Conferences 392, 01058 (2024) https://doi.org/10.

1051/matecconf/202439201058
ICMED 2024

Home Automation using Artificial Intelligent &

Internet of Things
Vijaya Bhasker Reddy1*, Dinesh Balk1 Manikyam.B1, Gayatri1,and Shravan Kumar1, P.
Surekha2, Sami Anand3
1Department of Electronics and Communication Engineering, K G Reddy College of Engineering and
Technology
2Department of CSE, GRIET, Hyderabad, Telangana, India
3Lovely Professional University, Phagwara, Punjab, India.

Abstract.Nowadays home automation is based on the automation process

or else the Internet of Things. This paper presents combination of artificial
intelligence and the Internet of things-based automation system. Here we
develop some fundamental algorithms of artificial intelligence and then
integrate them with electronic sensors. The main part of the Internet of
Things is a Controller, we are using an Arduino based controller module
here. All the sensors used in home automation are in turn connect to this
Arduino controller. These Sensors will read the data based on the
specifications, then that data will send to the microcontroller to analyze
and process and later the Artificial Intelligence starts working as per the
data received. Our home appliances start acting depending on the sensor's
values obtained. For suppose, if the climate is too cool it will automatically
switch OFF the FAN (or) AC. Using AI based face recognition system will
operate the doors to close and open, also it can give alerts. By using a
water level sensor, we will come to know the water level of the tank, with
the help of this ta the motor pump will be ON or OFF according to the
values of the water level sensor. And using an MQ-08 sensor the smoke
value will be measured in the house, if the smoke value will be HIGH, it
may give an alert.

Keywords: Artificial Intelligence, Internet of Things, Home Automation, Microcontroller, Sensors.

1. Introduction

Home Automation with Artificial Intelligence (AI) aims to use a domestic purpose where
the devices are connected and the system can communicate effectively. This is possible
through Artificial Intelligence (AI) algorithms that understand, adapt, and personalize
themselves based on the performance and behavior of the sensors. The interfacing of AI,
into appliances like lights, Fans, security cameras, kitchen gadgets.[9] Homes are converted
into automation that can understand and save the routines of their daily habitats. By

*Corresponding author :[email protected]

© The Authors, published by EDP Sciences. This is an open access article distributed under the terms of the Creative
Commons Attribution License 4.0 (https://creativecommons.org/licenses/by/4.0/).
MATEC Web of Conferences 392, 01058 (2024) https://doi.org/10.1051/matecconf/202439201058
ICMED 2024

analyzing patterns through AI-equipped sensors these systems can determine when owners
are present or absent so that enabling them to adjust the sensors such as temperature
control, lighting changes, and security activation. These things not only help conserve
energy but also optimize resource utilization [1].

The overall process will be working on Artificial intelligence algorithms that continuously
read the data and start working on the automation.[1] The AI system indicates the daily
tracking activities, and behavioral patterns in order to proactively adjust settings
accordingly. For example, an AI-powered home might anticipate the need for dimmed
lighting during evenings and also set the rising temperature based on the owner's
requirement[9].
As the sun rises in the morning a coffee maker has an advanced technology-driven element
that driven element makes the indication to wake up[9]. When it makes the alarm turn off.
The integration of AI has taken security to heights, where cameras, doors, and alarms work
together seamlessly [9]. The AI system has the ability to differentiate between faces and
potential threats [4].If something unusual happens a notification is immediately sent to the
homeowner's smartphone allowing them to monitor their home remotely [9]. Additionally,
we prioritize the well-being and safety of individuals. We integrate devices and health
sensors into the home network ensuring that caregivers are alerted in case of emergencies
or any irregularities, in health conditions [8].

2. Background Work
In homes, IoT technology is used to design the smart and secure for old age people and
physically challenged persons. The wireless communication and AI based on the voice
commands can control the home appliances easily.[3] Home Automation using Smart
Mirror is used to create Magic Mirror. The magic mirror can offer natural modes of
interaction by which people can able to control their home appliances and also it as feature
like AI chart commands like Google Assistance, WhatsApp (Chatbot). In this we cannot
connect any sensors or Microcontrollers directly. It can run uniquely and independently. By
using smart mirror provides security and fire alert system.[4] In daily life there is a high
demand for electricity if each person can use electricity at homes more effectively and there
is a chance to change in climate. By using AI algorithms, we can monitor the ON/OFF
status of Home Appliances and also, we can monitor the energy consumption of each
appliance at Home.[1] Through the voice assistance we can control the home appliances
with IoT and NLP (Natural Language Processing). Best way to interface the IoT and NLP
Technology which can control home appliances efficiently. In market there are many smart
home appliances which are semi-automated. By using IoT and NLP we can fully automate
the home, we can control these appliances like FAN, LIGHT, COFFEE MACHINE and
DOOR ALARM etc. [9]

An IoT Based Home Automation system that can monitor home appliances and gadgets.
The appliances will connect to the internet through the ESP 8266(Wi-Fi Module). With
that, we can monitor the various home appliances like lights, temperature, Humidity, and
Fans by using the different sensors [16]. In this Automation, a smartphone controls the
different appliances using the panoramic image of the home or which location wants to
control with the panoramic image. Panoramic image means 360 0 of our home [17]. With
this, we observe that to perform comfort and full security in the owners of a home. This
system uses a PIR sensor and vibration sensor to detect the anonymous things going to
happen within the house. Also, this sensor network can provide full security from thefts
[18]. To design a chatbot with AI and IoT to control home appliances. Raspberry Pi is the

2
MATEC Web of Conferences 392, 01058 (2024) https://doi.org/10.1051/matecconf/202439201058
ICMED 2024

brain of the chatbot with the interface a sensors like PIR, Gas, and Pi cam. A Pi cam will
communicate the Telegram cloud that is connected to the home appliances. With the AI
commands the home appliances will operate [19].

3. Methodology
The bellow figure explains the overall working of Home Automation. From that, the
main microcontroller (Arduino UNO) will control the connected sensors with the inputs
taken from the sensors that all will be controlled with Artificial Intelligence. Firstly, the
Temperature sensor is connected to Arduino UNO.

Figure 1: Block Diagram of the Home Automation using AI

The temperature sensor will collect the temperature input within the home. Then the
Arduino UNO will start working with the AI Commands. For example, if the Temperature
is High then the AI will start interacting with the owner. With the owner's response the
Controller will operate the AC or FAN within the home and the appliances will be in the
ON mode. Otherwise, the owner will not respond with the AI then it automatically turns
ON or OFF with the recent data stored in memory. This working operation will handle
Arduino UNO with the commands of Artificial Intelligence.

In the kitchen there is a chance to get flame. With that there is a chance of damaging the
property. So that we can keep the Flame sensor that detects the flame values. If any Flame
is detected with that sensor, then the AI starts to initialize. Later AI will give Alerts and
also send the notification to the owner of the home.

In the home major thing is to switch ON the Lights which is the main task for all owners.
That will be going to stop after implementing this project. The LDR sensor will detect the
level of light within the home that sensor is interfaced with an Arduino UNO. If the LDR

3
MATEC Web of Conferences 392, 01058 (2024) https://doi.org/10.1051/matecconf/202439201058
ICMED 2024

sensor does not detect any light in the home then the AI will start asking the commands if
the owner will react with those commands, then the lights in the home will turn ON. If the
sensor detects the light in the home, then again AI starts asking the commands so that we
cannot react to those commands then it automatically turns OFF with the past data and that
will be stored in the memory.

Nowadays security is a major issue. If any unknown person comes and enters the home
without our permission, we can identify with a notification and also give some type of
sound like “Hello Welcome to My Home” This will happen after the implementation of this
project. The camera module will be placed entrance of the home. At initial implementation,
we train the AI and ML with family members data like various facial expressions and finger
prints etc. So that the controller will recognize the known and unknown persons those who
are going to enter the home. If any unknown person is trying to enter the home, the system
will directly say “Sorry You Are Not Family Member So I Don’t Give Any Way to Go
Inside the Home” and the doors will not open.

4. Workflow
The below diagram shows the overall workflow of Home Automation using AI. First of all
the process will start with a given power supply then the system will start initializing (i.e.
Artificial Intelligence will initialize)

Figure 2: The process flow diagram of Home Automation System.

After the system is initialized, the sensors will start reading the data with respect to sensor
specifications. If the system receives the data with the sensors, then it will be sent to the

4
MATEC Web of Conferences 392, 01058 (2024) https://doi.org/10.1051/matecconf/202439201058
ICMED 2024

cloud. Otherwise, again the sensors will start reading the data with these processes will
come under the IoT part.

Figure 3: Schematic Diagram of Home Automation Using ARDUINO controller integrated with
Sensor’s

5. Experimental Results
Home Automation is interfaced with Artificial Intelligence makes advanced Technology
in our day-to-day lives. By interconnecting the home appliances with sensors that give
efficiency and accurate outcomes. This system can sense and observe daily behaviors and
activities, automating appliances, like Lighting Climate control, and Security. In the future
AI and home automation promise is one in which our living environments will naturally
adapt to our needs, and enhancing our quality of life with never-before-seen levels of
comfort and customization.
In this paper we are focusing on the 3 Home Appliances
1. Temperature level
2. Smoke level
3. Water level in Tank

Temperature level:

5
MATEC Web of Conferences 392, 01058 (2024) https://doi.org/10.1051/matecconf/202439201058
ICMED 2024

Figure 4: Graphical representation of Temperature values measured through DHT11 sensor by Home
Automation System.

Here, the value of the temperature is medium. Later the values of temperature will be
increased are shown in the graph. This graphical representation will be taken from the
DHT11 sensor will be connected to the Arduino UNO (controller). The sensor will be
connected the Temperature will reach the Threshold value then automatically turns ON the
FAN in our home.

Figure 5: Serial Monitor output of Temperature sensor.

When the Temperature value is 270 C and above, then the Controller will automatically
turn ON the fan. Else the temperature value is Less than 27 o C it turns OFF the fan.

Smoke level:
Smoke level is under 2 levels
A. Low Smoke level
B. High Smoke level
Low Smoke level:
At this stage the smoke level is normal in home. The below graph is showing normal
gas level in home.

6
MATEC Web of Conferences 392, 01058 (2024) https://doi.org/10.1051/matecconf/202439201058
ICMED 2024

Figure 6: Representation of Normal Smoke level in Home during the system process.

High Smoke level:

When the Smoke is High then the Arduino UNO (Controller) will automatically turns
ON the Exhaust fan and also sends the notification in mobile. So that the owner of the
home can know the information of the smoke.

Figure 7: Graphical representation of High Smoke level

Figure 8: High Smoke Range in Home

When the smoke value reaches 200 then it gives an alert in homes like a beep sound.The
smoke value reaches the threshold value (300) then it Turns ON the exhaust fan and also
sends the notification to the owner.

7
MATEC Web of Conferences 392, 01058 (2024) https://doi.org/10.1051/matecconf/202439201058
ICMED 2024

Water level:
From the below figure 9 graph shows the normal water level in the tank. When the
water level is Too LOW then it automatically turns ON the water pump.

Figure 9: Graphical Representation of water level in Tank

Figure 10: Graphical Representation of water level is High in tank

When a water level sensor is in high state, it shows that the tank is full to its maximum
capacity (725) in a tank. Then it automatically turns OFF the water pump

Figure 11: Water tank level indication through serial monitor

AI Recognising the Voice Commands:

8
MATEC Web of Conferences 392, 01058 (2024) https://doi.org/10.1051/matecconf/202439201058
ICMED 2024

Figure 12: Testing of thevoice commandsrecognition through AI.

IoT with Artificial Intelligence technologies enables real-time monitoring of the

Temperature, Smoke, and Water levels in our homes. The sensors will collect the data then
it is processed with AI algorithms which is user-friendly

Conclusion
Artificial intelligence (AI)-based home automation is the process of incorporating AI
technology into the administration and control of different home appliances and systems.
Home owners can experience a more effective, practical, and responsive living space by
utilizing AI. AI-driven home automation systems monitor, assess, and adjust to the
preferences and needs of the occupants via a network of linked devices and sensors. This
makes it possible to automate and optimize processes like altering the lights, thermostats,
security cameras, appliances, and entertainment systems.Data analysis and collecting are
essential to AI-powered home automation. The home is equipped with sensors that collect
data on temperature, humidity, occupancy, and energy usage. Then, using the habits and
preferences of the occupants, this data are fed into AI algorithms, which identify patterns
and come to wise judgments.Natural language commands can be used by consumers to
communicate with their smart devices through voice assistants, a popular AI use in home
automation. This makes physical interfaces unnecessary and streamlines the control
procedure. Integration with services like as Google Assistant, Apple Siri, and Amazon
Alexa allows homeowners to do a variety of functions, such as playing music, setting
timers, and turning off lights.

References
1. N. C. Noruwana, P. A. Owolawi and T. Mapayi, "Interactive IoT-based Speech-
Controlled Home Automation System," 2020 2nd International Multidisciplinary
Information Technology and Engineering Conference (IMITEC), Kimberley, South
Africa, 2020, pp. 1-8, doi: 10.1109/IMITEC50163.2020.9334081.

9
MATEC Web of Conferences 392, 01058 (2024) https://doi.org/10.1051/matecconf/202439201058
ICMED 2024

2. Y. -H. Lin, H. -S. Tang, T. -Y. Shen and C. -H. Hsia, "A Smart Home Energy
Management System Utilizing Neurocomputing-Based Time-Series Load Modeling
and Forecasting Facilitated by Energy Decomposition for Smart Home Automation," in
IEEE Access, vol. 10, pp. 116747-116765, 2022, doi:
10.1109/ACCESS.2022.3219068.
3. B. Setz, S. Graef, D. Ivanova, A. Tiessen and M. Aiello, "A Comparison of Open-
Source Home Automation Systems," in IEEE Access, vol. 9, pp. 167332-167352,
2021, doi: 10.1109/ACCESS.2021.3136025.
4. M. J. Iqbal et al., "Smart Home Automation Using Intelligent Electricity Dispatch," in
IEEE Access, vol. 9, pp. 118077-118086, 2021, doi: 10.1109/ACCESS.2021.3106541.
5. N. M. Allifah and I. A. Zualkernan, "Ranking Security of IoT-Based Smart Home
Consumer Devices," in IEEE Access, vol. 10, pp. 18352-18369, 2022, doi:
10.1109/ACCESS.2022.3148140.
6. M. Khan, J. Seo and D. Kim, "Real-Time Scheduling of Operational Time for Smart
Home Appliances Based on Reinforcement Learning," in IEEE Access, vol. 8, pp.
116520-116534, 2020, doi: 10.1109/ACCESS.2020.3004151.
7. S. Yu, N. Jho and Y. Park, "Lightweight Three-Factor-Based Privacy- Preserving
Authentication Scheme for IoT-Enabled Smart Homes," in IEEE Access, vol. 9, pp.
126186-126197, 2021, doi: 10.1109/ACCESS.2021.3111443.
8. M. Nasr, M. M. Islam, S. Shehata, F. Karray and Y. Quintana, "Smart Healthcare in the
Age of AI: Recent Advances, Challenges, and Future Prospects," in IEEE Access, vol.
9, pp. 145248-145270, 2021, doi: 10.1109/ACCESS.2021.3118960.
9. P. J. Rani, J. Bakthakumar, B. P. Kumaar, U. P. Kumaar and S. Kumar, "Voice
controlled home automation system using Natural Language Processing (NLP) and
Internet of Things (IoT)," 2017 Third International Conference on Science Technology
Engineering & Management (ICONSTEM), Chennai, India, 2017, pp. 368-373, doi:
10.1109/ICONSTEM.2017.8261311.
10. P. Mathivanan, G. Anbarasan, A. Sakthivel and G. Selvam, "Home Automation Using
Smart Mirror," 2019 IEEE International Conference on System, Computation,
Automation and Networking (ICSCAN), Pondicherry, India, 2019, pp. 1-4, doi:
10.1109/ICSCAN.2019.8878799.
11. S. K. Sooraj, E. Sundaravel, B. Shreesh and K. Sireesha, "IoT Smart Home Assistant
for Physically Challenged and Elderly People," 2020 International Conference on
Smart Electronics and Communication (ICOSEC), Trichy, India, 2020, pp. 809-814,
doi: 10.1109/ICOSEC49089.2020.9215389.
12. A. Sanchez and R. Tercero, "Smart Home Technologies: Uses and Abuses," 2010
Ninth Mexican International Conference on Artificial Intelligence, Pachuca, Mexico,
2010, pp. 97-102, doi: 10.1109/MICAI.2010.10.
13. L. Ciabattoni, G. Comodi, F. Ferracuti and G. Foresi, "AI-Powered Home Electrical
Appliances as Enabler of Demand-Side Flexibility," in IEEE Consumer Electronics
Magazine, vol. 9, no. 3, pp. 72-78, 1 May 2020, doi: 10.1109/MCE.2019.2956197.
14. H. Kong, L. Lu, J. Yu, Y. Chen and F. Tang, "Continuous Authentication Through
Finger Gesture Interaction for Smart Homes Using WiFi," in IEEE Transactions on
Mobile Computing, vol. 20, no. 11, pp. 3148-3162, 1 Nov. 2021, doi:
10.1109/TMC.2020.2994955.
15. V. H. Duong and N. H. Nguyen, "AI System for Monitoring States and Power
Consumption of Household Appliances," 2020 IEEE Eighth International Conference
on Communications and Electronics (ICCE), Phu Quoc Island, Vietnam, 2021, pp.
527-532, doi: 10.1109/ICCE48956.2021.9352110
16. N. Rathour, Monika, V. Kumar, S. S. Kundu, Y. Gehlot and A. Gurung, "Sigma Home:
An IoT-Based Home Automation Using Node MCU," 2023 2nd International

10
MATEC Web of Conferences 392, 01058 (2024) https://doi.org/10.1051/matecconf/202439201058
ICMED 2024

Conference on Edge Computing and Applications (ICECAA), Namakkal, India, 2023,

pp. 1317-1322, doi: 10.1109/ICECAA58104.2023.10212124.
17. N. Giri, C. Gupta, M. Choithwani, P. Biswas and P. Gidwani, "Home Automation
Using Panoramic Image Using IoT," 2018 International Conference on Recent
Innovations in Electrical, Electronics & Communication Engineering (ICRIEECE),
Bhubaneswar, India, 2018, pp. 1750-1755, doi:
10.1109/ICRIEECE44171.2018.9008688.
18. M. Ghai and R. Gupta, "Structure of an Arduino Based Home Security Automation
System," 2023 International Conference on Computational Intelligence,
Communication Technology and Networking (CICTN), Ghaziabad, India, 2023, pp.
225-227, doi: 10.1109/CICTN57981.2023.10141037.
19. B. K and N. S. B, "AI Based Chabot for Appliance Control," 2021 6th International
Conference on Communication and Electronics Systems (ICCES), Coimbatre, India,
2021, pp. 1529-1533, doi: 10.1109/ICCES51350.2021.9489183.

11