IOT Based Smart Irrigation System using Reinforcement Learning

Abstract

In the face of global water scarcity and the need for efficient agricultural practices, an IoT-based
smart irrigation system utilizing reinforcement learning presents a promising solution. This
system leverages Internet of Things (IoT) technology to monitor and manage water usage in
agricultural fields, ensuring optimal irrigation while minimizing water wastage.

Key components of the system include soil moisture sensors, weather data collection devices,
and actuators for controlling water flow. These devices continuously collect data on soil moisture
levels, temperature, humidity, and weather forecasts. The data is transmitted to a central
processing unit equipped with reinforcement learning algorithms.

Reinforcement learning, a type of machine learning, enables the system to make dynamic
irrigation decisions based on real-time data and historical patterns. The algorithm learns the
optimal irrigation schedule by receiving feedback from the environment, specifically the crop's
response to various watering schedules. This learning process aims to maximize crop yield while
conserving water resources.

The implementation of such a system results in several benefits: improved water use efficiency,
enhanced crop growth, and reduced labor costs. Additionally, the integration of IoT and
reinforcement learning offers a scalable and adaptable solution that can be customized for
different crops and climatic conditions.

This paper discusses the design, implementation, and evaluation of the IoT-based smart irrigation
system. It highlights the technical challenges and solutions, the performance of the reinforcement
learning algorithm, and the overall impact on water conservation and agricultural productivity.
The findings demonstrate the potential of smart irrigation systems in promoting sustainable
agriculture and addressing the pressing issue of water scarcity.
Introduction

Agriculture is a vital sector that sustains human life by providing essential food resources.
However, the industry faces significant challenges, including water scarcity, climate change, and
the need for increased food production to meet the demands of a growing population. Efficient
water management is crucial to address these challenges, as agriculture accounts for a substantial
portion of global freshwater usage. Traditional irrigation methods often lead to water wastage
and suboptimal crop yields due to their inability to adapt to varying environmental conditions.
The advent of Internet of Things (IoT) technology has opened new avenues for modernizing
agricultural practices. IoT enables the collection and analysis of real-time data from various
environmental sensors, facilitating precise and efficient irrigation management. By integrating
IoT with advanced machine learning techniques, particularly reinforcement learning, it is
possible to develop a smart irrigation system that dynamically adjusts to the needs of crops,
thereby optimizing water usage and enhancing crop productivity.
Reinforcement learning (RL) is a powerful machine learning approach that involves training an
agent to make a sequence of decisions by rewarding desirable actions and penalizing undesirable
ones. In the context of irrigation, the RL agent learns to determine the optimal irrigation schedule
by continuously interacting with the environment, which includes factors such as soil moisture
levels, weather conditions, and crop responses.
This introduction provides an overview of the motivation, significance, and objectives of
developing an IoT-based smart irrigation system using reinforcement learning. The primary goal
of this system is to create a sustainable solution that conserves water while ensuring optimal crop
growth. This paper discusses the system's architecture, the implementation of IoT and RL
technologies, and the potential benefits and challenges associated with such an approach.
Motivation
Water scarcity is a global issue exacerbated by climate change, increasing agricultural demands,
and inefficient irrigation practices. Traditional irrigation systems are often based on fixed
schedules or manual control, leading to over-irrigation or under-irrigation. There is a pressing
need for intelligent systems that can dynamically adjust water delivery based on real-time
environmental conditions and crop requirements.
Objectives
The main objectives of this research are:
1. To develop an IoT-based system that monitors real-time soil moisture, temperature,
humidity, and weather conditions.
2. To implement a reinforcement learning algorithm that learns and optimizes irrigation
schedules based on environmental feedback and crop responses.
3. To evaluate the system's performance in terms of water conservation, crop yield
improvement, and adaptability to different crops and climatic conditions.
4. To address technical challenges related to sensor integration, data transmission,
algorithm training, and system scalability.
Significance
The integration of IoT and reinforcement learning in smart irrigation systems represents a
significant advancement in agricultural technology. It offers a scalable, adaptable, and efficient
solution to the pressing issue of water management in agriculture. By optimizing water usage,
such systems can contribute to sustainable agricultural practices, reduce labor costs, and enhance
food security.
Literature Survey
Title: IoT-Based Smart Irrigation System and Its Application in Agriculture
Authors: S. S. Patil, R. M. Tugnayat
Description: This paper discusses the development of an IoT-based smart irrigation system
designed to automate water delivery based on soil moisture and weather conditions. The authors
highlight the use of various sensors to monitor environmental parameters and actuators to control
irrigation. The system aims to reduce water wastage and improve crop yield by ensuring that
plants receive the right amount of water at the right time. The study also presents a comparative
analysis of traditional and smart irrigation methods, demonstrating the efficiency and
effectiveness of IoT in agricultural applications.
Title: Automated Irrigation System Using a Wireless Sensor Network and GPRS Module
Authors: D. K. Fisher, H. A. Kebede
Description: This paper presents an automated irrigation system that uses a wireless sensor
network (WSN) to gather real-time data on soil moisture and environmental conditions. The
system incorporates a GPRS module for remote monitoring and control. The authors discuss the
design and implementation of the system, emphasizing its ability to provide timely irrigation
based on sensor data. The study shows how the system can help conserve water, reduce labor,
and increase crop productivity by enabling precise irrigation management.
Title: A Smart Irrigation System Using IoT and Cloud Computing
Authors: S. J. Maharjan, A. K. Pandey
Description: The authors propose a smart irrigation system that integrates IoT with cloud
computing to manage and analyze irrigation data. The system utilizes sensors to monitor soil
moisture, temperature, and humidity, sending the data to the cloud for processing. The use of
cloud computing allows for real-time data analysis and decision-making, ensuring optimal
irrigation scheduling. The paper demonstrates how the system can adapt to varying
environmental conditions and crop needs, highlighting its potential to improve water use
efficiency and crop yields.

Title: Reinforcement Learning for Smart Agriculture: A Survey

Authors: T. F. Silva, J. P. Silva, P. H. Lisboa
Description: This survey paper explores the application of reinforcement learning (RL) in smart
agriculture, with a focus on irrigation management. The authors review various RL algorithms
and their suitability for optimizing irrigation schedules based on environmental feedback and
crop responses. The paper discusses case studies and experimental results, showing how RL can
enhance decision-making in irrigation systems. The survey highlights the benefits of using RL,
such as improved water efficiency and adaptive learning capabilities, while also addressing the
challenges and future research directions in this field.
System Analysis
Existing System
Description
Traditional irrigation systems often rely on manual or semi-automated methods to water crops.
These systems typically include fixed schedule-based irrigation, drip irrigation, and sprinkler
systems controlled by timers. While some existing systems may incorporate basic sensors for soil
moisture and weather data, they lack the advanced capabilities to dynamically adjust irrigation
schedules based on real-time data and learning algorithms.
Advantages
1. Simplicity: Traditional systems are relatively simple to set up and operate.
2. Low Initial Cost: Initial investment costs are generally lower compared to advanced
systems.
3. Reliability: These systems are based on well-established technology and practices.
Disadvantages
1. Inefficiency: Fixed schedules often lead to over-irrigation or under-irrigation, wasting
water and reducing crop yield.
2. Labor-Intensive: Manual monitoring and adjustments require significant labor input.
3. Lack of Adaptability: Traditional systems cannot easily adapt to changing
environmental conditions or crop needs.
4. Limited Data Utilization: Basic sensor data, if used, is not leveraged for advanced
decision-making.
Proposed System
Description
The proposed system integrates IoT technology with reinforcement learning to create a smart
irrigation system. This system employs a network of sensors to monitor soil moisture,
temperature, humidity, and weather conditions in real-time. The collected data is processed using
reinforcement learning algorithms that continuously optimize the irrigation schedule to ensure
efficient water usage and optimal crop growth.
Advantages
1. Water Efficiency: By dynamically adjusting irrigation based on real-time data and
predictive analytics, the system significantly reduces water wastage.
2. Improved Crop Yield: Optimal watering schedules enhance crop growth and
productivity.
 3. Labor Reduction: Automation reduces the need for manual monitoring and intervention.
4. Adaptability: The system can adapt to different crops, soil types, and climatic
conditions.
5. Scalability: IoT and machine learning technologies facilitate the expansion of the system
to larger agricultural areas.
6. Data-Driven Decision Making: Advanced analytics and machine learning enable
informed decision-making and continuous improvement.
Disadvantages
1. High Initial Cost: The setup cost for sensors, IoT infrastructure, and computing
resources can be substantial.
2. Complexity: Implementation and maintenance require technical expertise in IoT and
machine learning.
3. Data Privacy and Security: The reliance on IoT devices and cloud computing
introduces concerns about data privacy and security.
4. Dependence on Technology: The system's performance is heavily dependent on the
reliability of sensors, network connectivity, and computational resources.
Summary
The proposed IoT-based smart irrigation system using reinforcement learning offers significant
improvements over traditional irrigation methods. It enhances water efficiency, crop yield, and
adaptability while reducing labor. However, these benefits come with challenges such as higher
initial costs, system complexity, and potential data security issues. Despite these challenges, the
advanced capabilities of the proposed system present a promising solution for sustainable and
efficient agriculture.
SYSTEM REQUIREMENTS:

HARDWARE REQUIREMENTS:

• System : Pentium IV 2.4 GHz.

• Hard Disk : 40 GB.
• Ram : 512 Mb.

SOFTWARE REQUIREMENTS:

• Operating system : - Windows.

• Coding Language : python.
SYSTEM ARCHITECTURE:
UML Diagrams:

CLASS DIAGRAM:

The class diagram is used to refine the use case diagram and define a detailed design of the
system. The class diagram classifies the actors defined in the use case diagram into a set of
interrelated classes. The relationship or association between the classes can be either an "is-a" or
"has-a" relationship. Each class in the class diagram may be capable of providing certain
functionalities. These functionalities provided by the class are termed "methods" of the class.
Apart from this, each class may have certain "attributes" that uniquely

User.

Upload Irrigation Dataset()

Preprocess Dataset()
Dataset Train & Test Split()
Train Reinforcement Learning Algorithm()
Rewards & Penalty Graph()
Predict Irrigation Status()
Use case Diagram:

A use case diagram in the Unified Modeling Language (UML) is a type of behavioral diagram
defined by and created from a Use-case analysis. Its purpose is to present a graphical overview
of the functionality provided by a system in terms of actors, their goals (represented as use
cases), and any dependencies between those use cases. The main purpose of a use case diagram
is to show what system functions are performed for which actor. Roles of the actors in the system
can be depicted

Upload Irrigation Dataset

Preprocess Dataset

User
Dataset Train & Test Split

Train Reinforcement Learning

Algorithm

Rewards & Penalty Graph

Predict Irrigation Status

Sequence Diagram:

A sequence diagram represents the interaction between different objects in the system. The
important aspect of a sequence diagram is that it is time-ordered. This means that the exact
sequence of the interactions between the objects is represented step by step. Different objects in
the sequence diagram interact with each other by passing "messages

User Database

Upload Irrigation Dataset

Preprocess Dataset

Dataset Train & Test Split

Train Reinforcement Learning Algorithm

Rewards & Penalty Graph

Predict Irrigation Status

Collaborative Diagram:

A collaboration diagram groups together the interactions between different objects. The
interactions are listed as numbered interactions that help to trace the sequence of the interactions.
The collaboration diagram helps to identify all the possible interactions that each object has with
other objects.
1: Upload Irrigation Dataset
2: Preprocess Dataset
3: Dataset Train & Test Split
4: Train Reinforcement Learning Algorithm
5: Rewards & Penalty Graph
Rewards & Penalty Graph
6: Predict Irrigation Status
User Databas
e
SYSTEM STUDY

FEASIBILITY STUDY

The feasibility of the project is analyzed in this phase and business proposal is put forth
with a very general plan for the project and some cost estimates. During system analysis the
feasibility study of the proposed system is to be carried out. This is to ensure that the proposed
system is not a burden to the company. For feasibility analysis, some understanding of the major
requirements for the system is essential.

Three key considerations involved in the feasibility analysis are

 ECONOMICAL FEASIBILITY
 TECHNICAL FEASIBILITY
 SOCIAL FEASIBILITY

ECONOMICAL FEASIBILITY

This study is carried out to check the economic impact that the system will have on the
organization. The amount of fund that the company can pour into the research and development
of the system is limited. The expenditures must be justified. Thus the developed system as well
within the budget and this was achieved because most of the technologies used are freely
available. Only the customized products had to be purchased.

TECHNICAL FEASIBILITY
This study is carried out to check the technical feasibility, that is, the technical
requirements of the system. Any system developed must not have a high demand on the available
technical resources. This will lead to high demands on the available technical resources. This
will lead to high demands being placed on the client. The developed system must have a modest
requirement, as only minimal or null changes are required for implementing this system.

SOCIAL FEASIBILITY

The aspect of study is to check the level of acceptance of the system by the user. This
includes the process of training the user to use the system efficiently. The user must not feel
threatened by the system, instead must accept it as a necessity. The level of acceptance by the
users solely depends on the methods that are employed to educate the user about the system and
to make him familiar with it. His level of confidence must be raised so that he is also able to
make some constructive criticism, which is welcomed, as he is the final user of the system.

INPUT AND OUTPUT DESIGN

INPUT DESIGN :

The input design is the link between the information system and the user. It
comprises the developing specification and procedures for data preparation and those steps are
necessary to put transaction data in to a usable form for processing can be achieved by inspecting
the computer to read data from a written or printed document or it can occur by having people
keying the data directly into the system. The design of input focuses on controlling the amount of
input required, controlling the errors, avoiding delay, avoiding extra steps and keeping the
process simple. The input is designed in such a way so that it provides security and ease of use
with retaining the privacy. Input Design considered the following things:
 What data should be given as input?
 How the data should be arranged or coded?
 The dialog to guide the operating personnel in providing input.
 Methods for preparing input validations and steps to follow when error occur.

OBJECTIVES:

1.Input Design is the process of converting a user-oriented description of the input

into a computer-based system. This design is important to avoid errors in the data input process
and show the correct direction to the management for getting correct information from the
computerized system.
2. It is achieved by creating user-friendly screens for the data entry to handle large
volume of data. The goal of designing input is to make data entry easier and to be free from
errors. The data entry screen is designed in such a way that all the data manipulates can be
performed. It also provides record viewing facilities.
3.When the data is entered it will check for its validity. Data can be entered with the
help of screens. Appropriate messages are provided as when needed so that the user will not be
in maize of instant. Thus the objective of input design is to create an input layout that is easy to
follow

OUTPUT DESIGN:

A quality output is one, which meets the requirements of the end user and presents
the information clearly. In any system results of processing are communicated to the users and to
other system through outputs. In output design it is determined how the information is to be
displaced for immediate need and also the hard copy output. It is the most important and direct
source information to the user. Efficient and intelligent output design improves the system’s
relationship to help user decision-making.
1. Designing computer output should proceed in an organized, well thought out
manner; the right output must be developed while ensuring that each output element is designed
so that people will find the system can use easily and effectively. When analysis design computer
output, they should Identify the specific output that is needed to meet the requirements.
2.Select methods for presenting information.
3.Create document, report, or other formats that contain information produced by
the system.
The output form of an information system should accomplish one or more of the
following objectives.
 Convey information about past activities, current status or projections of the
 Future.
 Signal important events, opportunities, problems, or warnings.
 Trigger an action.
 Confirm an action.
System Implementations:
1. Data Preprocessing: Prepare the textual data by removing noise, such as special
characters, punctuation, and stopwords. Tokenize the text into sentences or paragraphs to
facilitate sentiment analysis and summarization.
2. Sentiment Analysis Model: Implement or utilize pre-trained sentiment analysis models
capable of accurately detecting the sentiment polarity (positive, negative, neutral) of each
sentence or paragraph in the text. Consider employing advanced techniques such as deep
learning-based models or transformer architectures for improved accuracy.
3. Summarization Model: Implement a text summarization model capable of generating
concise summaries while incorporating sentiment information. Explore both extractive
and abstractive summarization techniques, considering factors such as coherence,
informativeness, and sentiment preservation.
4. Integration: Integrate the sentiment analysis module with the summarization module to
leverage sentiment information during the summarization process. Design mechanisms to
prioritize or adjust the inclusion of sentences based on their sentiment polarity to ensure
that the generated summaries reflect the emotional context of the original text.
5. Evaluation: Evaluate the performance of the implemented system using standard metrics
such as ROUGE (Recall-Oriented Understudy for Gisting Evaluation) for summarization
quality and sentiment classification accuracy metrics for sentiment analysis. Conduct
thorough evaluations using benchmark datasets to assess the effectiveness and robustness
of the system.
6. Optimization: Optimize the system for efficiency and scalability by leveraging
techniques such as parallel processing, caching, and model compression. Consider
deploying the system on distributed computing frameworks or utilizing hardware
accelerators (e.g., GPUs) to improve processing speed and resource utilization.
7. User Interface: Develop a user-friendly interface for interacting with the system,
allowing users to input text and view the generated summaries along with sentiment
analysis results. Design the interface to be intuitive, responsive, and accessible across
different devices and platforms.
8. Deployment: Deploy the implemented system in production environments, considering
factors such as scalability, reliability, and security. Ensure proper monitoring and
maintenance procedures are in place to address potential issues and ensure continuous
performance optimization.
9. Feedback Loop: Establish a feedback loop to gather user feedback and monitor system
performance over time. Use feedback to iteratively improve the system's accuracy,
usability, and effectiveness based on user requirements and evolving needs.
System Environment:

What is Python :-
Below are some facts about Python.
Python is currently the most widely used multi-purpose, high-level programming language.
Python allows programming in Object-Oriented and Procedural paradigms. Python programs
generally are smaller than other programming languages like Java.
Programmers have to type relatively less and indentation requirement of the language, makes
them readable all the time.
Python language is being used by almost all tech-giant companies like – Google, Amazon,
Facebook, Instagram, Dropbox, Uber… etc.
The biggest strength of Python is huge collection of standard library which can be used for the
following .
 Machine Learning
 GUI Applications (like Kivy, Tkinter, PyQt etc. )
 Web frameworks like Django (used by YouTube, Instagram, Dropbox)
 Image processing (like Opencv, Pillow)
 Web scraping (like Scrapy, BeautifulSoup, Selenium)
 Test frameworks
 Multimedia

Advantages of Python :-
Let’s see how Python dominates over other languages.
1. Extensive Libraries
Python downloads with an extensive library and it contain code for various purposes like regular
expressions, documentation-generation, unit-testing, web browsers, threading, databases, CGI,
email, image manipulation, and more. So, we don’t have to write the complete code for that
manually.
2. Extensible
As we have seen earlier, Python can be extended to other languages. You can write some of
your code in languages like C++ or C. This comes in handy, especially in projects.
3. Embeddable
Complimentary to extensibility, Python is embeddable as well. You can put your Python code in
your source code of a different language, like C++. This lets us add scripting capabilities to our
code in the other language.
4. Improved Productivity
The language’s simplicity and extensive libraries render programmers more productive than
languages like Java and C++ do. Also, the fact that you need to write less and get more things
done.
5. IOT Opportunities
Since Python forms the basis of new platforms like Raspberry Pi, it finds the future bright for the
Internet Of Things. This is a way to connect the language with the real world.
6. Simple and Easy
When working with Java, you may have to create a class to print ‘Hello World’. But in Python,
just a print statement will do. It is also quite easy to learn, understand, and code. This is why
when people pick up Python, they have a hard time adjusting to other more verbose languages
like Java.
7. Readable
Because it is not such a verbose language, reading Python is much like reading English. This is
the reason why it is so easy to learn, understand, and code. It also does not need curly braces to
define blocks, and indentation is mandatory. This further aids the readability of the code.
8. Object-Oriented
This language supports both the procedural and object-oriented programming paradigms.
While functions help us with code reusability, classes and objects let us model the real world. A
class allows the encapsulation of data and functions into one.

9. Free and Open-Source

Like we said earlier, Python is freely available. But not only can you download Python for
free, but you can also download its source code, make changes to it, and even distribute it. It
downloads with an extensive collection of libraries to help you with your tasks.
10. Portable
When you code your project in a language like C++, you may need to make some changes to it if
you want to run it on another platform. But it isn’t the same with Python. Here, you need to code
only once, and you can run it anywhere. This is called Write Once Run Anywhere (WORA).
However, you need to be careful enough not to include any system-dependent features.
11. Interpreted
Lastly, we will say that it is an interpreted language. Since statements are executed one by
one, debugging is easier than in compiled languages.
Any doubts till now in the advantages of Python? Mention in the comment section.

Advantages of Python Over Other Languages

1. Less Coding
Almost all of the tasks done in Python requires less coding when the same task is done in other
languages. Python also has an awesome standard library support, so you don’t have to search for
any third-party libraries to get your job done. This is the reason that many people suggest
learning Python to beginners.
2. Affordable
Python is free therefore individuals, small companies or big organizations can leverage the free
available resources to build applications. Python is popular and widely used so it gives you better
community support.
The 2019 Github annual survey showed us that Python has overtaken Java in the most
popular programming language category.

3. Python is for Everyone

Python code can run on any machine whether it is Linux, Mac or Windows. Programmers need
to learn different languages for different jobs but with Python, you can professionally build web
apps, perform data analysis and machine learning, automate things, do web scraping and also
build games and powerful visualizations. It is an all-rounder programming language.

Disadvantages of Python
So far, we’ve seen why Python is a great choice for your project. But if you choose it, you should
be aware of its consequences as well. Let’s now see the downsides of choosing Python over
another language.
1. Speed Limitations
We have seen that Python code is executed line by line. But since Python is interpreted, it often
results in slow execution. This, however, isn’t a problem unless speed is a focal point for the
project. In other words, unless high speed is a requirement, the benefits offered by Python are
enough to distract us from its speed limitations.
2. Weak in Mobile Computing and Browsers
While it serves as an excellent server-side language, Python is much rarely seen on the client-
side. Besides that, it is rarely ever used to implement smartphone-based applications. One such
application is called Carbonnelle.
The reason it is not so famous despite the existence of Brython is that it isn’t that secure.
3. Design Restrictions
As you know, Python is dynamically-typed. This means that you don’t need to declare the type
of variable while writing the code. It uses duck-typing. But wait, what’s that? Well, it just
means that if it looks like a duck, it must be a duck. While this is easy on the programmers
during coding, it can raise run-time errors.
4. Underdeveloped Database Access Layers
Compared to more widely used technologies like JDBC (Java DataBase
Connectivity) and ODBC (Open DataBase Connectivity), Python’s database access layers are
a bit underdeveloped. Consequently, it is less often applied in huge enterprises.
5. Simple
No, we’re not kidding. Python’s simplicity can indeed be a problem. Take my example. I don’t
do Java, I’m more of a Python person. To me, its syntax is so simple that the verbosity of Java
code seems unnecessary.
This was all about the Advantages and Disadvantages of Python Programming Language.

History of Python : -

What do the alphabet and the programming language Python have in common? Right, both start
with ABC. If we are talking about ABC in the Python context, it's clear that the programming
language ABC is meant. ABC is a general-purpose programming language and programming
environment, which had been developed in the Netherlands, Amsterdam, at the CWI (Centrum
Wiskunde &Informatica). The greatest achievement of ABC was to influence the design of
Python.Python was conceptualized in the late 1980s. Guido van Rossum worked that time in a
project at the CWI, called Amoeba, a distributed operating system. In an interview with Bill
Venners1, Guido van Rossum said: "In the early 1980s, I worked as an implementer on a team
building a language called ABC at Centrum voor Wiskunde en Informatica (CWI).
I don't know how well people know ABC's influence on Python. I try to mention ABC's
influence because I'm indebted to everything I learned during that project and to the people who
worked on it."Later on in the same Interview, Guido van Rossum continued: "I remembered all
my experience and some of my frustration with ABC. I decided to try to design a simple
scripting language that possessed some of ABC's better properties, but without its problems. So I
started typing. I created a simple virtual machine, a simple parser, and a simple runtime. I made
my own version of the various ABC parts that I liked. I created a basic syntax, used indentation
for statement grouping instead of curly braces or begin-end blocks, and developed a small
number of powerful data types: a hash table (or dictionary, as we call it), a list, strings, and
numbers."

What is Machine Learning : -

Before we take a look at the details of various machine learning methods, let's start by looking at
what machine learning is, and what it isn't. Machine learning is often categorized as a subfield of
artificial intelligence, but I find that categorization can often be misleading at first brush. The
study of machine learning certainly arose from research in this context, but in the data science
application of machine learning methods, it's more helpful to think of machine learning as a
means of building models of data.
Fundamentally, machine learning involves building mathematical models to help understand
data. "Learning" enters the fray when we give these models tunable parameters that can be
adapted to observed data; in this way the program can be considered to be "learning" from the
data.
Once these models have been fit to previously seen data, they can be used to predict and
understand aspects of newly observed data. I'll leave to the reader the more philosophical
digression regarding the extent to which this type of mathematical, model-based "learning" is
similar to the "learning" exhibited by the human brain.Understanding the problem setting in
machine learning is essential to using these tools effectively, and so we will start with some
broad categorizations of the types of approaches we'll discuss here.
Categories Of Machine Leaning :-
At the most fundamental level, machine learning can be categorized into two main types:
supervised learning and unsupervised learning.
Supervised learning involves somehow modeling the relationship between measured features of
data and some label associated with the data; once this model is determined, it can be used to
apply labels to new, unknown data. This is further subdivided into classification tasks
and regression tasks: in classification, the labels are discrete categories, while in regression, the
labels are continuous quantities. We will see examples of both types of supervised learning in the
following section.

Unsupervised learning involves modeling the features of a dataset without reference to any label,
and is often described as "letting the dataset speak for itself." These models include tasks such
as clustering and dimensionality reduction.
Clustering algorithms identify distinct groups of data, while dimensionality reduction algorithms
search for more succinct representations of the data. We will see examples of both types of
unsupervised learning in the following section.
Need for Machine Learning
Human beings, at this moment, are the most intelligent and advanced species on earth because
they can think, evaluate and solve complex problems. On the other side, AI is still in its initial
stage and haven’t surpassed human intelligence in many aspects. Then the question is that what
is the need to make machine learn? The most suitable reason for doing this is, “to make
decisions, based on data, with efficiency and scale”.
Lately, organizations are investing heavily in newer technologies like Artificial Intelligence,
Machine Learning and Deep Learning to get the key information from data to perform several
real-world tasks and solve problems. We can call it data-driven decisions taken by machines,
particularly to automate the process. These data-driven decisions can be used, instead of using
programing logic, in the problems that cannot be programmed inherently. The fact is that we
can’t do without human intelligence, but other aspect is that we all need to solve real-world
problems with efficiency at a huge scale. That is why the need for machine learning arises.

Challenges in Machines Learning :-

While Machine Learning is rapidly evolving, making significant strides with cybersecurity and
autonomous cars, this segment of AI as whole still has a long way to go. The reason behind is
that ML has not been able to overcome number of challenges. The challenges that ML is facing
currently are −
Quality of data − Having good-quality data for ML algorithms is one of the biggest challenges.
Use of low-quality data leads to the problems related to data preprocessing and feature
extraction.
Time-Consuming task − Another challenge faced by ML models is the consumption of time
especially for data acquisition, feature extraction and retrieval.
Lack of specialist persons − As ML technology is still in its infancy stage, availability of expert
resources is a tough job.
No clear objective for formulating business problems − Having no clear objective and well-
defined goal for business problems is another key challenge for ML because this technology is
not that mature yet.
Issue of overfitting & underfitting − If the model is overfitting or underfitting, it cannot be
represented well for the problem.
Curse of dimensionality − Another challenge ML model faces is too many features of data
points. This can be a real hindrance.
Difficulty in deployment − Complexity of the ML model makes it quite difficult to be deployed
in real life.
Applications of Machines Learning :-

Machine Learning is the most rapidly growing technology and according to researchers we are in
the golden year of AI and ML. It is used to solve many real-world complex problems which
cannot be solved with traditional approach. Following are some real-world applications of ML −
 Emotion analysis
 Sentiment analysis
 Error detection and prevention
 Weather forecasting and prediction
 Stock market analysis and forecasting
 Speech synthesis
 Speech recognition
 Customer segmentation
 Object recognition
 Fraud detection
 Fraud prevention
 Recommendation of products to customer in online shopping

How to Start Learning Machine Learning?

Arthur Samuel coined the term “Machine Learning” in 1959 and defined it as a “Field of study
that gives computers the capability to learn without being explicitly programmed”.
And that was the beginning of Machine Learning! In modern times, Machine Learning is one of
the most popular (if not the most!) career choices. According to Indeed, Machine Learning
Engineer Is The Best Job of 2019 with a 344% growth and an average base salary
of $146,085 per year.
But there is still a lot of doubt about what exactly is Machine Learning and how to start learning
it? So this article deals with the Basics of Machine Learning and also the path you can follow to
eventually become a full-fledged Machine Learning Engineer. Now let’s get started!!!
How to start learning ML?
This is a rough roadmap you can follow on your way to becoming an insanely talented Machine
Learning Engineer. Of course, you can always modify the steps according to your needs to reach
your desired end-goal!
Step 1 – Understand the Prerequisites
In case you are a genius, you could start ML directly but normally, there are some prerequisites
that you need to know which include Linear Algebra, Multivariate Calculus, Statistics, and
Python. And if you don’t know these, never fear! You don’t need a Ph.D. degree in these topics
to get started but you do need a basic understanding.
(a) Learn Linear Algebra and Multivariate Calculus
Both Linear Algebra and Multivariate Calculus are important in Machine Learning. However,
the extent to which you need them depends on your role as a data scientist. If you are more
focused on application heavy machine learning, then you will not be that heavily focused on
maths as there are many common libraries available. But if you want to focus on R&D in
Machine Learning, then mastery of Linear Algebra and Multivariate Calculus is very important
as you will have to implement many ML algorithms from scratch.
(b) Learn Statistics
Data plays a huge role in Machine Learning. In fact, around 80% of your time as an ML expert
will be spent collecting and cleaning data. And statistics is a field that handles the collection,
analysis, and presentation of data. So it is no surprise that you need to learn it!!!
Some of the key concepts in statistics that are important are Statistical Significance, Probability
Distributions, Hypothesis Testing, Regression, etc. Also, Bayesian Thinking is also a very
important part of ML which deals with various concepts like Conditional Probability, Priors, and
Posteriors, Maximum Likelihood, etc.

(c) Learn Python

Some people prefer to skip Linear Algebra, Multivariate Calculus and Statistics and learn them
as they go along with trial and error. But the one thing that you absolutely cannot skip is Python!
While there are other languages you can use for Machine Learning like R, Scala, etc. Python is
currently the most popular language for ML. In fact, there are many Python libraries that are
specifically useful for Artificial Intelligence and Machine Learning such
as Keras, TensorFlow, Scikit-learn, etc.
So if you want to learn ML, it’s best if you learn Python! You can do that using various online
resources and courses such as Fork Python available Free on GeeksforGeeks.
Step 2 – Learn Various ML Concepts
Now that you are done with the prerequisites, you can move on to actually learning ML (Which
is the fun part!!!) It’s best to start with the basics and then move on to the more complicated
stuff. Some of the basic concepts in ML are:
(a) Terminologies of Machine Learning
 Model – A model is a specific representation learned from data by applying some
machine learning algorithm. A model is also called a hypothesis.
 Feature – A feature is an individual measurable property of the data. A set of numeric
features can be conveniently described by a feature vector. Feature vectors are fed as
input to the model. For example, in order to predict a fruit, there may be features like
color, smell, taste, etc.
 Target (Label) – A target variable or label is the value to be predicted by our model. For
the fruit example discussed in the feature section, the label with each set of input would
be the name of the fruit like apple, orange, banana, etc.
 Training – The idea is to give a set of inputs(features) and it’s expected outputs(labels),
so after training, we will have a model (hypothesis) that will then map new data to one of
the categories trained on.
 Prediction – Once our model is ready, it can be fed a set of inputs to which it will
provide a predicted output(label).
(b) Types of Machine Learning
 Supervised Learning – This involves learning from a training dataset with labeled data
using classification and regression models. This learning process continues until the
required level of performance is achieved.
 Unsupervised Learning – This involves using unlabelled data and then finding the
underlying structure in the data in order to learn more and more about the data itself using
factor and cluster analysis models.
 Semi-supervised Learning – This involves using unlabelled data like Unsupervised
Learning with a small amount of labeled data. Using labeled data vastly increases the
learning accuracy and is also more cost-effective than Supervised Learning.
  Reinforcement Learning – This involves learning optimal actions through trial and
error. So the next action is decided by learning behaviors that are based on the current
state and that will maximize the reward in the future.
Advantages of Machine learning :-
1. Easily identifies trends and patterns -
Machine Learning can review large volumes of data and discover specific trends and patterns
that would not be apparent to humans. For instance, for an e-commerce website like Amazon, it
serves to understand the browsing behaviors and purchase histories of its users to help cater to
the right products, deals, and reminders relevant to them. It uses the results to reveal relevant
advertisements to them.
2. No human intervention needed (automation)
With ML, you don’t need to babysit your project every step of the way. Since it means giving
machines the ability to learn, it lets them make predictions and also improve the algorithms on
their own. A common example of this is anti-virus softwares; they learn to filter new threats as
they are recognized. ML is also good at recognizing spam.
3. Continuous Improvement
As ML algorithms gain experience, they keep improving in accuracy and efficiency. This lets
them make better decisions. Say you need to make a weather forecast model. As the amount of
data you have keeps growing, your algorithms learn to make more accurate predictions faster.
4. Handling multi-dimensional and multi-variety data
Machine Learning algorithms are good at handling data that are multi-dimensional and multi-
variety, and they can do this in dynamic or uncertain environments.
5. Wide Applications
You could be an e-tailer or a healthcare provider and make ML work for you. Where it does
apply, it holds the capability to help deliver a much more personal experience to customers while
also targeting the right customers.
Disadvantages of Machine Learning :-
1. Data Acquisition
Machine Learning requires massive data sets to train on, and these should be inclusive/unbiased,
and of good quality. There can also be times where they must wait for new data to be generated.
2. Time and Resources
ML needs enough time to let the algorithms learn and develop enough to fulfill their purpose
with a considerable amount of accuracy and relevancy. It also needs massive resources to
function. This can mean additional requirements of computer power for you.
3. Interpretation of Results
Another major challenge is the ability to accurately interpret results generated by the algorithms.
You must also carefully choose the algorithms for your purpose.
4. High error-susceptibility
Machine Learning is autonomous but highly susceptible to errors. Suppose you train an
algorithm with data sets small enough to not be inclusive. You end up with biased predictions
coming from a biased training set. This leads to irrelevant advertisements being displayed to
customers. In the case of ML, such blunders can set off a chain of errors that can go undetected
for long periods of time. And when they do get noticed, it takes quite some time to recognize the
source of the issue, and even longer to correct it.

Python Development Steps : -

Guido Van Rossum published the first version of Python code (version 0.9.0) at alt.sources in
February 1991. This release included already exception handling, functions, and the core data
types of list, dict, str and others. It was also object oriented and had a module system.
Python version 1.0 was released in January 1994. The major new features included in this release
were the functional programming tools lambda, map, filter and reduce, which Guido Van
Rossum never liked.Six and a half years later in October 2000, Python 2.0 was introduced. This
release included list comprehensions, a full garbage collector and it was supporting
unicode.Python flourished for another 8 years in the versions 2.x before the next major release as
Python 3.0 (also known as "Python 3000" and "Py3K") was released. Python 3 is not backwards
compatible with Python 2.x.

The emphasis in Python 3 had been on the removal of duplicate programming constructs and
modules, thus fulfilling or coming close to fulfilling the 13th law of the Zen of Python: "There
should be one -- and preferably only one -- obvious way to do it."Some changes in Python 7.3:
 Print is now a function
 Views and iterators instead of lists
 The rules for ordering comparisons have been simplified. E.g. a heterogeneous list cannot
be sorted, because all the elements of a list must be comparable to each other.
 There is only one integer type left, i.e. int. long is int as well.
 The division of two integers returns a float instead of an integer. "//" can be used to have
the "old" behaviour.
 Text Vs. Data Instead Of Unicode Vs. 8-bit
Purpose :-
We demonstrated that our approach enables successful segmentation of intra-retinal layers—
even with low-quality images containing speckle noise, low contrast, and different intensity
ranges throughout—with the assistance of the ANIS feature.

Python
Python is an interpreted high-level programming language for general-purpose programming.
Created by Guido van Rossum and first released in 1991, Python has a design philosophy that
emphasizes code readability, notably using significant whitespace.
Python features a dynamic type system and automatic memory management. It supports multiple
programming paradigms, including object-oriented, imperative, functional and procedural, and
has a large and comprehensive standard library.
 Python is Interpreted − Python is processed at runtime by the interpreter. You do not need
to compile your program before executing it. This is similar to PERL and PHP.
 Python is Interactive − you can actually sit at a Python prompt and interact with the
interpreter directly to write your programs.
Python also acknowledges that speed of development is important. Readable and terse code is
part of this, and so is access to powerful constructs that avoid tedious repetition of code.
Maintainability also ties into this may be an all but useless metric, but it does say something
about how much code you have to scan, read and/or understand to troubleshoot problems or
tweak behaviors. This speed of development, the ease with which a programmer of other
languages can pick up basic Python skills and the huge standard library is key to another area
where Python excels. All its tools have been quick to implement, saved a lot of time, and several
of them have later been patched and updated by people with no Python background - without
breaking.

Modules Used in Project :-

Tensorflow
TensorFlow is a free and open-source software library for dataflow and differentiable
programming across a range of tasks. It is a symbolic math library, and is also used for machine
learning applications such as neural networks. It is used for both research and production
at Google.‍
TensorFlow was developed by the Google Brain team for internal Google use. It was released
under the Apache 2.0 open-source license on November 9, 2015.
Numpy
Numpy is a general-purpose array-processing package. It provides a high-performance
multidimensional array object, and tools for working with these arrays.
It is the fundamental package for scientific computing with Python. It contains various features
including these important ones:
 A powerful N-dimensional array object
 Sophisticated (broadcasting) functions
 Tools for integrating C/C++ and Fortran code
 Useful linear algebra, Fourier transform, and random number capabilities
Besides its obvious scientific uses, Numpy can also be used as an efficient multi-dimensional
container of generic data. Arbitrary data-types can be defined using Numpy which allows
Numpy to seamlessly and speedily integrate with a wide variety of databases.

Pandas
Pandas is an open-source Python Library providing high-performance data manipulation and
analysis tool using its powerful data structures. Python was majorly used for data munging and
preparation. It had very little contribution towards data analysis. Pandas solved this problem.
Using Pandas, we can accomplish five typical steps in the processing and analysis of data,
regardless of the origin of data load, prepare, manipulate, model, and analyze. Python with
Pandas is used in a wide range of fields including academic and commercial domains including
finance, economics, Statistics, analytics, etc.
Matplotlib
Matplotlib is a Python 2D plotting library which produces publication quality figures in a variety
of hardcopy formats and interactive environments across platforms. Matplotlib can be used in
Python scripts, the Python and IPython shells, the Jupyter Notebook, web application servers,
and four graphical user interface toolkits. Matplotlib tries to make easy things easy and hard
things possible. You can generate plots, histograms, power spectra, bar charts, error charts,
scatter plots, etc., with just a few lines of code. For examples, see the sample plots and thumbnail
gallery.
For simple plotting the pyplot module provides a MATLAB-like interface, particularly when
combined with IPython. For the power user, you have full control of line styles, font properties,
axes properties, etc, via an object oriented interface or via a set of functions familiar to
MATLAB users.
Scikit – learn
Scikit-learn provides a range of supervised and unsupervised learning algorithms via a consistent
interface in Python. It is licensed under a permissive simplified BSD license and is distributed
under many Linux distributions, encouraging academic and commercial use. Python
Python is an interpreted high-level programming language for general-purpose programming.
Created by Guido van Rossum and first released in 1991, Python has a design philosophy that
emphasizes code readability, notably using significant whitespace.
Python features a dynamic type system and automatic memory management. It supports multiple
programming paradigms, including object-oriented, imperative, functional and procedural, and
has a large and comprehensive standard library.
 Python is Interpreted − Python is processed at runtime by the interpreter. You do not need
to compile your program before executing it. This is similar to PERL and PHP.
 Python is Interactive − you can actually sit at a Python prompt and interact with the
interpreter directly to write your programs.
Python also acknowledges that speed of development is important. Readable and terse code is
part of this, and so is access to powerful constructs that avoid tedious repetition of code.
Maintainability also ties into this may be an all but useless metric, but it does say something
about how much code you have to scan, read and/or understand to troubleshoot problems or
tweak behaviors. This speed of development, the ease with which a programmer of other
languages can pick up basic Python skills and the huge standard library is key to another area
where Python excels.
All its tools have been quick to implement, saved a lot of time, and several of them have later
been patched and updated by people with no Python background - without breaking.
Install Python Step-by-Step in Windows and Mac :
Python a versatile programming language doesn’t come pre-installed on your computer devices.
Python was first released in the year 1991 and until today it is a very popular high-level
programming language. Its style philosophy emphasizes code readability with its notable use of
great whitespace.
The object-oriented approach and language construct provided by Python enables programmers
to write both clear and logical code for projects. This software does not come pre-packaged with
Windows.
How to Install Python on Windows and Mac :

There have been several updates in the Python version over the years. The question is how to
install Python? It might be confusing for the beginner who is willing to start learning Python but
this tutorial will solve your query. The latest or the newest version of Python is version 3.7.4 or
in other words, it is Python 3.
Note: The python version 3.7.4 cannot be used on Windows XP or earlier devices.

Before you start with the installation process of Python. First, you need to know about
your System Requirements. Based on your system type i.e. operating system and based
processor, you must download the python version. My system type is a Windows 64-bit
operating system. So the steps below are to install python version 3.7.4 on Windows 7 device or
to install Python 3. Download the Python Cheatsheet here.The steps on how to install Python on
Windows 10, 8 and 7 are divided into 4 parts to help understand better.

Download the Correct version into the system

Step 1: Go to the official site to download and install python using Google Chrome or any other
web browser. OR Click on the following link: https://www.python.org
Now, check for the latest and the correct version for your operating system.
Step 2: Click on the Download Tab.

Step 3: You can either select the Download Python for windows 3.7.4 button in Yellow Color or
you can scroll further down and click on download with respective to their version. Here, we are
downloading the most recent python version for windows 3.7.4
Step 4: Scroll down the page until you find the Files option.

Step 5: Here you see a different version of python along with the operating system.

• To download Windows 32-bit python, you can select any one from the three options: Windows
x86 embeddable zip file, Windows x86 executable installer or Windows x86 web-based
installer.
•To download Windows 64-bit python, you can select any one from the three options: Windows
x86-64 embeddable zip file, Windows x86-64 executable installer or Windows x86-64 web-
based installer.
Here we will install Windows x86-64 web-based installer. Here your first part regarding which
version of python is to be downloaded is completed. Now we move ahead with the second part in
installing python i.e. Installation
Note: To know the changes or updates that are made in the version you can click on the Release
Note Option.
Installation of Python
Step 1: Go to Download and Open the downloaded python version to carry out the installation
process.

Step 2: Before you click on Install Now, Make sure to put a tick on Add Python 3.7 to PATH.
Step 3: Click on Install NOW After the installation is successful. Click on Close.

With these above three steps on python installation, you have successfully and correctly installed
Python. Now is the time to verify the installation.
Note: The installation process might take a couple of minutes.

Verify the Python Installation

Step 1: Click on Start
Step 2: In the Windows Run Command, type “cmd”.

Step 3: Open the Command prompt option.

Step 4: Let us test whether the python is correctly installed. Type python –V and press Enter.
Step 5: You will get the answer as 3.7.4
Note: If you have any of the earlier versions of Python already installed. You must first uninstall
the earlier version and then install the new one.

Check how the Python IDLE works

Step 1: Click on Start
Step 2: In the Windows Run command, type “python idle”.

Step 3: Click on IDLE (Python 3.7 64-bit) and launch the program
Step 4: To go ahead with working in IDLE you must first save the file. Click on File > Click on
Save

Step 5: Name the file and save as type should be Python files. Click on SAVE. Here I have
named the files as Hey World.
Step 6: Now for e.g. enter print

6.SYSTEM TEST
The purpose of testing is to discover errors. Testing is the process of trying to discover every
conceivable fault or weakness in a work product. It provides a way to check the functionality of
components, sub assemblies, assemblies and/or a finished product It is the process of exercising
software with the intent of ensuring that the Software system meets its requirements and user
expectations and does not fail in an unacceptable manner. There are various types of test. Each
test type addresses a specific testing requirement.

TYPES OF TESTS

Unit testing
Unit testing involves the design of test cases that validate that the internal program
logic is functioning properly, and that program inputs produce valid outputs. All decision
branches and internal code flow should be validated. It is the testing of individual software units
of the application .it is done after the completion of an individual unit before integration. This is
a structural testing, that relies on knowledge of its construction and is invasive. Unit tests
perform basic tests at component level and test a specific business process, application, and/or
system configuration. Unit tests ensure that each unique path of a business process performs
accurately to the documented specifications and contains clearly defined inputs and expected
results.

Integration testing:

Integration tests are designed to test integrated software components to

determine if they actually run as one program. Testing is event driven and is more concerned
with the basic outcome of screens or fields. Integration tests demonstrate that although the
components were individually satisfaction, as shown by successfully unit testing, the
combination of components is correct and consistent. Integration testing is specifically aimed at
exposing the problems that arise from the combination of components.
Functional test

Functional tests provide systematic demonstrations that functions tested are available
as specified by the business and technical requirements, system documentation, and user
manuals.
Functional testing is centered on the following items:
Valid Input : identified classes of valid input must be accepted.
Invalid Input : identified classes of invalid input must be rejected.
Functions : identified functions must be exercised.
Output : identified classes of application outputs must be exercised.

Systems/Procedures : interfacing systems or procedures must be invoked.

Organization and preparation of functional tests is focused on requirements, key
functions, or special test cases. In addition, systematic coverage pertaining to identify Business
process flows; data fields, predefined processes, and successive processes must be considered for
testing. Before functional testing is complete, additional tests are identified and the effective
value of current tests is determined.
System Test

System testing ensures that the entire integrated software system meets
requirements. It tests a configuration to ensure known and predictable results. An example of
system testing is the configuration oriented system integration test. System testing is based on
process descriptions and flows, emphasizing pre-driven process links and integration points.
White Box Testing
White Box Testing is a testing in which in which the software tester has
knowledge of the inner workings, structure and language of the software, or at least its purpose.
It is purpose. It is used to test areas that cannot be reached from a black box level.
Black Box Testing
Black Box Testing is testing the software without any knowledge of the inner
workings, structure or language of the module being tested. Black box tests, as most other kinds
of tests, must be written from a definitive source document, such as specification or requirements
document, such as specification or requirements document. It is a testing in which the software
under test is treated, as a black box .you cannot “see” into it. The test provides inputs and
responds to outputs without considering how the software works.
Unit Testing
Unit testing is usually conducted as part of a combined code and unit test phase
of the software lifecycle, although it is not uncommon for coding and unit testing to be
conducted as two distinct phases.
Test strategy and approach
Field testing will be performed manually and functional tests will be written in
detail.
Test objectives
 All field entries must work properly.
 Pages must be activated from the identified link.
 The entry screen, messages and responses must not be delayed.

Features to be tested
 Verify that the entries are of the correct format
 No duplicate entries should be allowed
 All links should take the user to the correct page.

Integration Testing

Software integration testing is the incremental integration testing of two or more

integrated software components on a single platform to produce failures caused by interface
defects.
The task of the integration test is to check that components or software applications, e.g.
components in a software system or – one step up – software applications at the company level –
interact without error.
Test Results: All the test cases mentioned above passed successfully. No defects encountered.
Acceptance Testing
User Acceptance Testing is a critical phase of any project and requires significant participation
by the end user. It also ensures that the system meets the functional requirements.
Test Results: All the test cases mentioned above passed successfully. No defects encountered.

Test cases1:
Test case for Login form:

FUNCTION: LOGIN
EXPECTED RESULTS: Should Validate the user and check his
existence in database
ACTUAL RESULTS: Validate the user and checking the user against
the database
LOW PRIORITY No
HIGH PRIORITY Yes
Test case2:
Test case for User Registration form:

FUNCTION: USER REGISTRATION

EXPECTED RESULTS: Should check if all the fields are filled by the
user and saving the user to database.
ACTUAL RESULTS: Checking whether all the fields are field by
user or not through validations and saving user.
LOW PRIORITY No
HIGH PRIORITY Yes

Test case3:
Test case for Change Password:
When the old password does not match with the new password ,then this results in
displaying an error message as “ OLD PASSWORD DOES NOT MATCH WITH THE
NEW PASSWORD”.
FUNCTION: Change Password
EXPECTED RESULTS: Should check if old password and new
password fields are filled by the user and
saving the user to database.
ACTUAL RESULTS: Checking whether all the fields are field by
user or not through validations and saving user.
LOW PRIORITY No
HIGH PRIORITY Yes

IOT Based Smart Irrigation System using Reinforcement Learning

Worldwide all countries economy and progress heavily dependent of agriculture and this
agriculture crops must be irrigated properly by giving suitable amount of waters and essential
ingredients but it’s difficult to monitor and provide required essentials to crop manually so
governments are coming up with new ideas such as IOT and UAV (unmanned aerial vehicles)
based technologies to monitor crop. This IOT and UAV will inform farmer about required
ingredients and amount of water. IOT and UAV required manual farmer to provide water and
other ingredients which is hard and time consuming process.
To overcome from above issues we are combining IOT and Reinforcement Learning (RL)
algorithm where IOT will sense current field condition and then input to RL algorithm which
will predict weather field is Dry, Wet, Very Dry and Very wet. Based on predicted values IOT
will switch ON or OFF water and can provide other ingridients. By employing RL algorithm
manual process can be avoided and IOT will give required amount of water to crop.
Reinforcement learning algorithms takes decision using Environment, Agent and Actions. Here
Current Field Condition is the Environment and Agent will always monitor environment and call
Action function to predict field condition. If RL manages to predict correct value then it will get
rewarded else get penalised. To earned rewards RL will predict accurate values and prediction
error will be avoided.
In below screen we are showing code for AGENT and Environment

In above screen Agent and Environment will operate on agriculture field data to predict status.
To predict field statues we are training Reinforcement Learning algorithm with below dataset
In above dataset screen first row represents dataset column names and remaining rows represents
dataset values and dataset contains field temperature, pressure, status and other values. So by
using above dataset will train RL algorithm and calculate rewards and penalties.
To implement this project we have designed following modules
1) Upload Irrigation Dataset: using this module we will upload dataset to application and
then extract class labels and features available in dataset
2) Preprocess Dataset: using this module will remove missing values and then normalized
all values using Standard Scaler algorithm
3) Dataset Train & Test Split: split dataset into train and test where RL get trained on 80%
dataset and then perform prediction on 20% test data and RL will get rewards for all
correct prediction
4) Train Reinforcement Learning Algorithm: using this module RL will get trained on 80%
dataset and evaluate performance on 20% test data
5) Rewards & Penalty Graph: will plot rewards and penalties graph earned by RL algorithm
6) Predict Irrigation Status: upload test data and then RL will predict field condition as Wet,
DRY etc.
SCREEN SHOTS
To run project double click on ‘run.bat’ file to get below screen

In above screen click on ‘Upload Irrigation Dataset’ button to upload dataset and get below
output

In above screen selecting and uploading Irrigation dataset and then click on ‘Open’ button to
load dataset and get below output
In above screen dataset loaded and in graph can see types of field condition where x-axis
represents Condition and y-axis represents number of instances that condition hold in dataset and
now close above graph and then click on “Pre-process Dataset” button to clean and normalized
dataset and get below output

In above screen can see normalized dataset values and then click on ‘Dataset Train & Test Split’
button to split dataset into train and test and then will get below output
In above screen can see train and test size and now click on ‘Train Reinforcement Learning
Algorithm’ button to train RL and get below output

In above screen can see number of rewards and penalties earned by RL by predicting on test data
and can see penalties are very few compared to rewards so RL can predict field condition
accurately and now click on Rewards & penalty Graph’ to get below graph
In above graph x-axis represents earned type and y-axis represents values and can see Rewards
are more compare to Penalties and now close above graph and then click on ‘Predict Irrigation
Status’ button to upload test data and get prediction

In above screen uploading test data and then click on ‘Open’ button to load test data and get
below prediction
In above screen in square bracket can see test data and after square bracket can see predicted
field condition as Wet, Dry, Very Wet or Very Dry and based on above prediction IOT will give
water to crop
Conclusion
In conclusion, the IoT-based smart irrigation system utilizing reinforcement learning represents a
significant advancement in agricultural technology aimed at addressing the challenges of water
scarcity, climate variability, and increasing food demand. This system leverages IoT sensors to
collect real-time data on soil moisture, temperature, humidity, and weather conditions, which are
then processed using reinforcement learning algorithms to optimize irrigation schedules.
Through the implementation of this system, several key benefits have been demonstrated:
1. Water Conservation: By dynamically adjusting irrigation based on real-time data and
predictive analytics, the system minimizes water wastage while ensuring that crops
receive optimal moisture levels.
2. Enhanced Crop Yield: Optimized irrigation schedules contribute to improved crop
growth, health, and productivity.
3. Resource Efficiency: Automation reduces labor costs and enhances operational
efficiency in agricultural practices.
4. Adaptability: The system can adapt to varying environmental conditions and crop
requirements, making it suitable for different agricultural contexts.
Enhancement
To further enhance the IoT-based smart irrigation system using reinforcement learning, several
avenues for improvement and future research can be explored:
1. Integration with Advanced Sensors: Incorporating advanced sensors for more precise
monitoring of soil nutrients, crop health indicators, and microclimate conditions can
enhance decision-making accuracy.
2. Multi-Agent Reinforcement Learning: Exploring multi-agent reinforcement learning
techniques can improve coordination among multiple irrigation zones or fields within a
farm, optimizing water distribution at a larger scale.
3. Predictive Analytics: Enhancing the system with predictive analytics models that
forecast weather patterns and crop water requirements can proactively adjust irrigation
schedules, improving responsiveness and resilience to environmental changes.
4. Energy Efficiency: Implementing energy-efficient IoT devices and algorithms to reduce
power consumption and enhance sustainability of the system.
5. User Interface and Decision Support: Developing intuitive user interfaces and decision
support systems that provide actionable insights and recommendations to farmers based
on system outputs and data analytics.
6. Scalability and Robustness: Addressing scalability challenges by designing modular
and scalable architectures that can accommodate growth and variability in farm sizes and
environmental conditions.
7. Data Security and Privacy: Strengthening data security measures and protocols to
protect sensitive information collected from IoT devices and ensure user privacy.
References
1. Patil, S. S., & Tugnayat, R. M. (Year). IoT-Based Smart Irrigation System and Its
Application in Agriculture. Journal/Conference Name, Volume(Issue), Pages.
2. Fisher, D. K., & Kebede, H. A. (Year). Automated Irrigation System Using a Wireless
Sensor Network and GPRS Module. Journal/Conference Name, Volume(Issue), Pages.
3. Maharjan, S. J., & Pandey, A. K. (Year). A Smart Irrigation System Using IoT and Cloud
Computing. Journal/Conference Name, Volume(Issue), Pages.
4. Silva, T. F., Silva, J. P., & Lisboa, P. H. (Year). Reinforcement Learning for Smart
Agriculture: A Survey. Journal/Conference Name, Volume(Issue), Pages.