Machine Learning for Beginners

Preface

Welcome to Mastering Deep Learning: Comprehensive Study Guide with Online Test Papers and Exercises. In the rapidly evolving field of artificial intelligence, deep learning has emerged as a transformative technology, driving advancements across various sectors such as healthcare, finance, autonomous vehicles, and more. As deep learning continues to shape the future, mastering its concepts and applications becomes crucial for both aspiring and seasoned professionals.

This book is designed to be more than just a traditional textbook; it is a complete learning resource tailored to meet the needs of learners at all levels. Whether you are a student embarking on your first journey into deep learning or an experienced professional seeking to deepen your knowledge and skills, this guide provides the tools and resources necessary to achieve your goals.

Purpose of the Book

The primary objective of this book is to offer a holistic learning experience by combining theoretical knowledge with practical applications. Understanding the complexities of deep learning requires more than just reading; it involves engaging with the material through various interactive methods. To this end, we have integrated a variety of learning aids to enhance your understanding and retention of deep learning concepts.

Key Features

1. Extensive Theoretical Content: The book covers the full spectrum of deep learning topics, from fundamental concepts to advanced techniques. Each chapter is designed to build on the previous one, ensuring a logical progression and deep comprehension of the subject matter.

2. Online Test Papers: To reinforce your learning, we provide a series of online test papers that mimic real-world scenarios and challenges. These tests are designed to evaluate your understanding and help you identify areas that need further study.

3. Interactive Exercises: The book includes a wide range of exercises, such as multiple-choice questions (MCQs), true/false statements, and problem-solving tasks. These exercises are strategically placed throughout the chapters to reinforce key concepts and test your knowledge.

4. Video Tutorials: Understanding deep learning concepts can sometimes be challenging through text alone. Our book includes links to a series of video tutorials that provide visual and auditory explanations of complex topics. These videos are created by experts and are intended to complement the written material, offering a more immersive learning experience.

5. Practical Applications: Each chapter includes real-world examples and case studies that illustrate how deep learning is applied across different industries. These examples help bridge the gap between theory and practice, demonstrating the practical relevance of deep learning skills.

6. Self-Assessment Tools: At the end of each chapter, self-assessment questions and exercises allow you to test your understanding and track your progress. These tools are invaluable in helping you gauge your readiness and build confidence as you move forward.

Conclusion

Mastering Deep Learning: Comprehensive Study Guide with Online Test Papers and Exercises is designed to be your definitive guide to mastering deep learning. By combining detailed theoretical content with interactive and practical learning aids, this book provides a comprehensive and engaging learning experience. Whether you are preparing for academic exams, professional certifications, or industry interviews, this book will equip you with the knowledge and skills you need to succeed.

Table Of Contents

Preface

Chapter 1: Introduction to Machine Learning

Chapter-2: Supervised learning

Chapter 3: Unsupervised learning

Chapter 4: Probabilistic Graphical Models

Chapter 5: Advanced learning

Chapter- 6: Programming Languages that are used in Machine Learning

Chapter 7: Model Evaluation and Selection

Chapter 8: Ensemble Learning

Chapter 9: Neural Networks and Deep Learning

Chapter 10: Natural Language Processing (NLP)

Chapter 11: Reinforcement Learning

Chapter 12: Model Deployment and Production

Chapter 13: Ethical and Fair Machine Learning

Chapter 14: Viva Voce Questions

Chapter 1: Introduction to Machine Learning

1.1 Machine Learning

Machine Learning is a field of artificial intelligence that allows systems to learn and improve from experience without being explicitly programmed. It has become an increasingly popular topic in recent years due to the many practical applications it has in a variety of industries. In chapter 1, we will explore the basics of Machine Learning, delve into more advanced topics, and discuss how it is being used to solve real-world problems. Whether you are a beginner looking to

learn about Machine Learning or an experienced data scientist seeking to stay up-to-date on the latest developments,.

1.1.1 What is Machine Learning?

Machine Learning is an application of artificial intelligence that uses statistical techniques to enable computers to learn and make decisions without being explicitly programmed. It is predicated on the notion that computers can learn from data, spot patterns, and make judgments with little assistance from humans.

It is a subset of Artificial Intelligence. It is the study of making machines more human-like in their behaviour and decisions by giving them the ability to learn and develop their own programs. This is done with minimum human intervention, i.e., no explicit programming. The learning process is automated and improved based on the experiences of the machines throughout the process. Good quality data is fed to the machines, and different algorithms are used to build ML models to train the machines on this data. The choice of algorithm depends on the type of data at hand and the type of activity that needs to be automated. Now you may wonder, how is it different from traditional programming? Well, in traditional programming, we would feed the input data and a well-written and tested program into a machine to generate output. When it comes to Machine Learning, input data, along with the output, is fed into the machine during the learning phase, and it works out a program for itself.

1.1.2 History of Machine Learning

This section discusses the development of Machine Learning over the years. Today we are witnessing some astounding applications like self-driving cars, natural language processing and facial recognition systems making use of ML techniques for their processing. All this began in the year 1943, when Warren McCulloch a neurophysiologist along with a mathematician named Walter Pitts authored a paper that threw a light on neurons and its working. They created a model with electrical circuits and thus neural network was born. 

The famous Turing Test was created in 1950 by Alan Turing, which would ascertain whether computers had real intelligence. It must make a human believe that it is not a computer but a human instead, to get through the test. Arthur Samuel developed the first computer program that could learn as it played the game of checkers in the year 1952. The first neural network, called the perceptron was designed by Frank Rosenblatt in the year 1957. 

The big shift happened in the 1990s when Machine Learning moved from being knowledge-driven to a data-driven technique due to the availability of huge volumes of data. IBM’s Deep Blue, developed in 1997 was the first machine to defeat the world champion in the game of chess. Businesses have recognized that the potential for complex calculations could be increased through Machine Learning. Some of the latest projects include Google Brain, which was developed in 2012, was a deep neural network that focused on pattern recognition in images and videos. It was later employed to detect objects in YouTube videos. In 2014, Facebook created Deep Face, which can recognize people just like how humans do. In 2014, Deep Mind created a computer program called Alpha Go a board game that defeated a professional Go player. Due to its complexity, the game is said to be a very challenging yet classical game for artificial intelligence. Scientists Stephen Hawking and Stuart Russel have felt that if AI gains the power to redesign itself at an intensifying rate, then an unbeatable intelligence explosion may lead to human extinction. Musk characterizes AI as humanity’s biggest existential threat. Open AI is an organization created by Elon Musk in 2015 to develop safe and friendly AI that could benefit humanity. Recently, some of the breakthrough areas in AI are Computer Vision, Natural Language Processing and Reinforcement Learning.

1.1.3 Why Should We Learn Machine Learning?

Machine Learning is a powerful tool that can be used to solve a wide range of problems. It allows computers to learn from data, without being explicitly programmed. This makes it possible to build systems that can automatically improve their performance over time by learning from their experiences.

There are many reasons why learning Machine Learning is important:

- Machine Learning is widely used in many industries, including healthcare, finance, and e-commerce. By learning Machine Learning, you can open a wide range of career opportunities in these fields.

- Machine Learning can be used to build intelligent systems that can make decisions and predictions based on data. This can help organizations make better decisions, improve their operations, and create new products and services.

- Machine Learning is an important tool for data analysis and visualization. It allows you to extract insights and patterns from large datasets, which can be used to understand complex systems and make informed decisions.

- Machine Learning is a rapidly growing field with many exciting developments and research opportunities. By learning Machine Learning, you can stay up to date with the latest research and developments in the field.

1.2 Overview

Arthur Samuel, an early American leader in the field of computer gaming and artificial intelligence, coined the term Machine Learning in 1959 while at IBM. He defined Machine Learning as the field of study that gives computers the ability to learn without being explicitly programmed . However, there is no universally accepted definition for Machine Learning. Different authors define the term differently. We give below two more definitions.

- Machine Learning is programming computers to optimize a performance criterion using example data or experience. We have a model defined up to some parameters, and learning is the execution of a computer program to optimize the parameters of the model using the training data or experience. The model may be predictive to make predictions in the future, or descriptive to gain knowledge from data.

- The field of study known as Machine Learning is concerned with the question of how to construct computer programs that automatically improve with experience.

Machine Learning is a subfield of artificial intelligence that involves the development of algorithms and statistical models that enable computers to improve their performance in tasks through experience. These algorithms and models are designed to learn from data and make predictions or decisions without explicit instructions. There are several types of Machine Learning, including supervised learning, unsupervised learning, and reinforcement learning. Supervised learning involves training a model on labelled data, while unsupervised learning involves training a model on unlabelled data. Reinforcement learning involves training a model through trial and error. Machine Learning is used in a wide variety of applications, including image and speech recognition, natural language processing, and recommender systems.

Definition of learning:

A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks T, as measured by P, improves with experience E. 

Examples

- Handwriting recognition learning problem.

- Task T:  Recognizing and classifying handwritten words within images.

- Performance P: Percent of words correctly classified

- Training experience E: A dataset of handwritten words with given classifications

- A robot driving learning problem.

- Task T: Driving on highways using vision sensors.

- Performance P: Average distance travelled before an error.

- Training experience E: A sequence of images and steering commands recorded while observing a human driver.

Definition: A computer program which learns from experience is called a Machine Learning program or simply a learning program. 

1.3 Types of Machines

Traditional ML developed in the earlier stages carried out all the desired tasks in the past. The technology wasn’t as advanced as today, so it was enough to complete some simple tasks. A traditional ML model has quite a simple structure, but even without it, advanced models wouldn’t be available now. So, it involves two channels – one for training and one for prediction.

The training channel’s task is to collect and group all the necessary data. The prediction channel then goes through collected and grouped data and analyses it for different purposes – to establish patterns, forecast, or aid in making effective decisions.

However, the traditional ML model cannot always meet the demands because of its two-channel structure. The process can take way too long, and the analysis of data is not detailed enough. Besides that, serious errors in functioning can occur if some slight changes are added into the system, such as:

- Changing the system’s operational surrounding

- Changing the system’s input

- Changing the desired outcomes or results

Each of these alterations can significantly disrupt the system, and the functionality, efficiency, and precision of a system using ML are greatly affected. That’s the most important disadvantage of traditional Machine Learning.

In today’s pace of living, large amounts of data need to be transferred quickly, but sometimes they need to change in the same timely manner. Considering companies and enterprises majorly use ML, they call for the reliability of their systems at all times.

That’s where traditional ML lacks, as it requires more time to adapt to the changes, thereby proving that it’s incapable of quickly adapting to the newly acquired information.

What Is Adaptive Machine Learning?

With modern times, computers, systems, programs, and technology, in general, are becoming more used, advanced, flexible, and therefore powerful. With its widespread use, it goes through numerous advances even daily.

Also, with modern times comes a fast-paced life. This way of living requires our systems to act similarly. Adaptive ML, as its name says, can do something that traditional ML can’t. It can quickly adapt to new information and gain insight into how important that new information is.

Because of its single-channelled structure, adaptive Machine Learning employs different data collection methods, grouping, and analysis. It collects and analyses the data while also learning from it.

That’s why it’s adaptive – the system is learning and updating as long as the new information is provided. This single-channelled system follows up on every feedback provided to make future predictions and outcomes even better.

In addition to that, the whole process is happening in real-time, so it can adapt to new behaviour instantly. Some of the essential advantages that the adaptive ML provides are high performance and immaculate precision. Because it continually runs in real-time, the system is prevented from getting outdated or obsolete.

So, what describes adaptive ML the best is combining the three main principles: agility, strength, and efficiency. With agility, the systems can act immediately, without any delays. With strength, the systems achieve new standards of high proficiency and accuracy, and with efficiency, the systems can find new ways to perform immaculately but with lower costs.

How Are Adaptive ML and Traditional ML Different?

So, here we will draw some conclusions and summarize the differences between traditional ML and adaptive ML. Even though adaptive ML is quite advanced compared to traditional ML, it’s important to state that it probably wouldn’t be the way we know it today if the main disadvantages of conventional ML weren’t pointed out and addressed.

So, firstly, the main difference is that traditional ML is a system with two channels. Consequently, all data is divided into two parts, as previously mentioned. Even though traditional ML finds a way to deal with this, the results can take a long time and often even become outdated by the time they arrive.

Therefore, the adaptive ML works on a single channel, providing a more efficient way of functioning, relating to the resources used and the speed of solutions. Thereby, this system proves to be a more sustainable and better option overall.

Secondly, as traditional ML goes through fewer data in more time, it’s mainly based on static and permanent data. It takes quite a lot of time to change the behaviour in the system, so numerous urgent and important matters are missed.

That’s why adaptive ML isn’t based on any permanent data but on the ability to continuously adapt and change the behaviour when necessary, making sure that the system doesn’t operate on any outdated data.

Finally, adaptive ML has the unique ability to learn from the past. In that way, it resembles feeding someone – the more information you feed to the system, the bigger and smarter it gets. It even learns from previous mistakes and lowers the chances of repeating them. So, the longer they operate, the more accurate they get.

1.4 Applications

Machine Learning is a buzzword for today's technology, and it is growing very rapidly day by day. We are using Machine Learning in our daily life even without knowing it such as Google Maps, Google assistant, Alexa, etc. Below are some most trending real-world applications of Machine Learning:

1. Image Recognition:

Image recognition is one of the most common applications of Machine Learning. It is used to identify objects, persons, places, digital images, etc. The popular use case of image recognition and face detection is Automatic friend tagging suggestion: Facebook provides us a feature of auto friend tagging suggestion. Whenever we upload a photo with our Facebook friends, then we automatically get a tagging suggestion with name, and the technology behind this is Machine Learning's face detection and recognition algorithm. It is based on the Facebook project named "Deep Face," which is responsible for face recognition and person identification in the picture.

2. Speech Recognition

While using Google, we get an option of "Search by voice, it comes under speech recognition, and it's a popular application of Machine Learning. Speech recognition is a process of converting voice instructions into text, and it is also known as Speech to text, or Computer speech recognition." At present, Machine Learning algorithms are widely used by various applications of speech recognition. Google assistant, Siri, Cortana, and Alexa are using speech recognition technology to follow the voice instructions.

3. Traffic prediction:

If we want to visit a new place, we take help of Google Maps, which shows us the correct path with the shortest route and predicts the traffic conditions. It predicts the traffic conditions such as whether traffic is cleared, slow-moving, or heavily congested with the help of two ways:

- Real Time location of the vehicle form Google Map app and sensors

- Average time has taken on past days at the same time.

Everyone who is using Google Map is helping this app to make it better. It takes information from the user and sends back to its database to improve the performance.

4. Product recommendations:

Machine Learning is widely used by various e-commerce and entertainment companies such as Amazon, Netflix, etc., for product recommendation to the user. Whenever we search for some product on Amazon, then we started getting an advertisement for the same product while internet surfing on the same browser and this is because of Machine Learning. Google understands the user interest using various Machine Learning algorithms and suggests the product as per customer interest. As similar, when we use Netflix, we find some recommendations for entertainment series, movies, etc., and this is also done with the help of Machine Learning.

5. Self-driving cars:

One of the most exciting applications of Machine Learning is self-driving cars. Machine Learning plays a significant role in self-driving cars. Tesla, the most popular car manufacturing company is working on self-driving car. It is using unsupervised learning method to train the car models to detect people and objects while driving.

6. Email Spam and Malware Filtering:

Whenever we receive a new email, it is filtered automatically as important, normal, and spam. We always receive an important mail in our inbox with the important symbol and spam emails in our spam box, and the technology behind this is Machine Learning. Below are some spam filters used by Gmail:

- Content Filter

- Header filter

- General blacklists filter

- Rules-based filters

- Permission filters

Some Machine Learning algorithms such as Multi-Layer Perceptron, Decision tree, and Naïve Bayes classifier are used for email spam filtering and malware detection.

7. Virtual Personal Assistant:

We have various virtual personal assistants such as Google assistant, Alexa, Cortana, Siri. As the name suggests, they help us in finding the information using our voice instruction. These assistants can help us in various ways just by our voice instructions such as Play music, call someone, open an email, Scheduling an appointment, etc. These virtual assistants use Machine Learning algorithms as an important part. These assistants record our voice instructions, send it over the server on a cloud, and decode it using ML algorithms and act accordingly.

8. Online Fraud Detection:

Machine Learning is making our online transaction safe and secure by detecting fraud transaction. Whenever we perform some online transaction, there may be various ways that a fraudulent transaction can take place such as fake accounts, fake ids, and steal money in the middle of a transaction. So, to detect this, Feed Forward Neural network helps us by checking whether it is a genuine transaction or a fraud transaction. For each genuine transaction, the output is converted into some hash values, and these values become the input for the next round. For each genuine transaction, there is a specific pattern which gets change for the fraud transaction hence, it detects it and makes our online transactions more secure.

9. Stock Market trading:

Machine Learning is widely used in stock market trading. In the stock market, there is always a risk of up and downs in shares, so for this Machine Learning's long short-term memory neural network is used for the prediction of stock market trends.

10. Medical Diagnosis:

In medical science, Machine Learning is used for diseases diagnoses. With this, medical technology is growing very fast and able to build 3D models that can predict the exact position of lesions in the brain. It helps in finding brain tumours and other brain-related diseases easily.

11. Automatic Language Translation:

Nowadays, if we visit a new place and we are not aware of the language then it is not a problem at all, as for this also Machine Learning helps us by converting the text into our known languages. Google's GNMT (Google Neural Machine Translation) provide this feature, which is a Neural Machine Learning that translates the text into our familiar language, and it called as automatic translation. The technology behind the automatic translation is a sequence-to-sequence learning algorithm, which is used with image recognition and translates the text from one language to another language.

1.4 Types of Machine Learning

Machine Learning is a subset of AI, which enables the machine to automatically learn from data, improve performance from past experiences, and make predictions. Machine Learning contains a set of algorithms that work on a huge amount of data. Data is fed to these algorithms to train them, and on the basis of training, they build the model & perform a specific task. These ML algorithms help to solve different business problems like Regression, Classification, Forecasting, Clustering, and Associations, etc. Based on the methods and way of learning, Machine Learning is divided into mainly four types, which are:

1. Supervised Machine Learning

2. Unsupervised Machine Learning

3. Semi-Supervised Machine Learning

4. Reinforcement Learning

In this topic, we will provide a detailed description of the types of Machine Learning along with their respective algorithms:

1. Supervised Machine Learning - As its name suggests, Supervised Machine Learning is based on supervision. It means in the supervised learning technique, we train the machines using the labelled dataset, and based on the training, the machine predicts the output. Here, the labelled data specifies that some of the inputs are already mapped to the output. More preciously, we can say; first, we train the machine with the input and corresponding output, and then we ask the machine to predict the output using the test dataset. Let's understand supervised learning with an example. Suppose we have an input dataset of cats and dog images. So, first, we will provide the training to the machine to understand the images, such as the shape & size of the tail of cat and dog, Shape of eyes, colour, height (dogs are taller, cats are smaller), etc. After completion of training, we input the picture of a cat and ask the machine to identify the object and predict the output. Now, the machine is well trained, so it will check all the features of the object, such as height, shape, colour, eyes, ears, tail, etc., and find that it's a cat. So, it will put it in the Cat category. This is the process of how the machine identifies the objects in Supervised Learning.

The main goal of the supervised learning technique is to map the input variable(x) with the output variable(y). Some real-world applications of supervised learning are Risk Assessment, Fraud Detection, Spam filtering, etc.

Categories of Supervised Machine Learning

Supervised Machine Learning can be classified into two types of problems, which are given below:

- Classification

- Regression

a) Classification

Classification algorithms are used to solve the classification problems in which the output variable is categorical, such as "Yes" or No, Male or Female, Red or Blue, etc. The classification algorithms predict the categories present in the dataset. Some real-world examples of classification algorithms are Spam Detection, Email filtering, etc.

Some popular classification algorithms are given below:

- Random Forest Algorithm

- Decision Tree Algorithm

- Logistic Regression Algorithm

- Support Vector Machine Algorithm

b) Regression

Regression algorithms are used to solve regression problems in which there is a linear relationship between input and output variables. These are used to predict continuous output variables, such as market trends, weather prediction, etc.

Some popular Regression algorithms are given below:

- Simple Linear Regression Algorithm

- Multivariate Regression Algorithm

- Decision Tree Algorithm

- Lasso Regression

Advantages and Disadvantages of Supervised Learning

Advantages:

- Since supervised learning work with the labelled dataset so we can have an exact idea about the classes of objects.

- These algorithms are helpful in predicting the output on the basis of prior experience.

Disadvantages:

- These algorithms are not able to solve complex tasks.

- It may predict the wrong output if the test data is different from the training data.

- It requires lots of computational time to train the algorithm.

Applications of Supervised Learning

Some common applications of Supervised Learning are given below:

- Image Segmentation:

Supervised Learning algorithms are used in image segmentation. In this process, image classification is performed on different image data with pre-defined labels.

- Medical Diagnosis:

Supervised algorithms are also used in the medical field for diagnosis purposes. It is done by using medical images and past labelled data with labels for disease conditions. With such a process, the machine can identify a disease for the new patients.

- Fraud Detection - Supervised Learning classification algorithms are used for identifying fraud transactions, fraud customers, etc. It is done by using historic data to identify the patterns that can lead to possible fraud.

- Spam detection - In spam detection & filtering, classification algorithms are used. These algorithms classify an email as spam or not spam. The spam emails are sent to the spam folder.

- Speech Recognition - Supervised learning algorithms are also used in speech recognition. The algorithm is trained with voice data, and various identifications can be done using the same, such as voice-activated passwords, voice commands, etc.

2. Unsupervised Machine Learning

Unsupervised learning is different from the Supervised learning technique; as its name suggests, there is no need for supervision. It means, in unsupervised Machine Learning, the machine is trained using the unlabelled dataset, and the machine predicts the output without any supervision.

In unsupervised learning, the models are trained with the data that is neither classified nor labelled, and the model acts on that data without any supervision.

The main aim of the unsupervised learning algorithm is to group or categories the unsorted dataset according to the similarities, patterns, and differences. Machines are instructed to find the hidden patterns from the input dataset.

Let's take an example to understand it more preciously; suppose there is a basket of fruit images, and we input it into the Machine Learning model. The images are totally unknown to the model, and the task of the machine is to find the patterns and categories of the objects.

So, now the machine will discover its patterns and differences, such as colour difference, shape difference, and predict the output when it is tested with the test dataset.

Categories of Unsupervised Machine Learning

Unsupervised Learning can be further classified into two types, which are given below:

- Clustering

- Association

1) Clustering

The clustering technique is used when we want to find the inherent groups from the data. It is a way to group the objects into a cluster such that the objects with the most similarities remain in one group and have fewer or no similarities with the objects of other groups. An example of the clustering algorithm is grouping the customers by their purchasing behaviour.

Some of the popular clustering algorithms are given below:

- K-Means Clustering algorithm.

- Mean-shift algorithm.

- DBSCAN Algorithm

- Principal Component Analysis

- Independent Component Analysis

2) Association

Association rule learning is an unsupervised learning technique, which finds interesting relations among variables within a large dataset. The main aim of this learning algorithm is to find the dependency of one data item on another data item and map those variables accordingly so that it can generate maximum profit. This algorithm is mainly applied in Market Basket analysis, Web usage mining, continuous production, etc.

Some popular algorithms of Association rule learning are Apriori Algorithm, Eclat, FP-growth algorithm.

Advantages and Disadvantages of Unsupervised Learning Algorithm

Advantages:

- These algorithms can be used for complicated tasks compared to the supervised ones because these algorithms work on the unlabelled dataset.

- Unsupervised algorithms are preferable for various tasks as getting the unlabelled dataset is easier as compared to the labelled dataset.

- Disadvantages:

- The output of an unsupervised algorithm can be less accurate as the dataset is not labelled, and algorithms are not trained with the exact output in prior.

- Working with Unsupervised learning is more difficult as it works with the unlabelled dataset that does not map with the output.

- Applications of Unsupervised Learning

- Network Analysis: Unsupervised learning is used for identifying plagiarism and copyright in document network analysis of text data for scholarly articles.

- Recommendation Systems: Recommendation systems widely use unsupervised learning techniques for building recommendation applications for different web applications and e-commerce websites.

- Anomaly Detection: Anomaly detection is a popular application of unsupervised learning, which can identify unusual data points within the dataset. It is used to discover fraudulent transactions.

- Singular Value Decomposition: Singular Value Decomposition or SVD is used to extract particular information from the database. For example, extracting information of each user located at a particular location.

3. Semi-Supervised Learning

Semi-Supervised learning is a type of Machine Learning algorithm that lies between Supervised and Unsupervised Machine Learning. It represents the intermediate ground between Supervised (With Labelled training data) and Unsupervised learning (with no labelled training data) algorithms and uses the combination of labelled and unlabelled datasets during the training period.

Although Semi-supervised learning is the middle ground between supervised and unsupervised learning and operates on the data that consists of a few labels, it mostly consists of unlabelled data. As labels are costly, but for corporate purposes, they may have few labels. It is completely different from supervised and unsupervised learning as they are based on the presence & absence of labels.

To overcome the drawbacks of supervised learning and unsupervised learning algorithms, the concept of Semi-supervised learning is introduced. The main aim of semi-supervised learning is to effectively use all the available data, rather than only labelled data like in supervised learning. Initially, similar data is clustered along with an unsupervised learning algorithm, and further, it helps to label the unlabelled data into labelled data. It is because labelled data is a comparatively more expensive acquisition than unlabelled data.

We can imagine these algorithms with an example. Supervised learning is where a student is under the supervision of an instructor at home and college. Further, if that student is self-analysing the same concept without any help from the instructor, it comes under unsupervised learning. Under semi-supervised learning, the student has to revise himself after analysing the same concept under the guidance of an instructor at college.

Advantages and disadvantages of Semi-supervised Learning

Advantages:

- It is simple and easy to understand the algorithm.

- It is highly efficient.

- It is used to solve drawbacks of Supervised and Unsupervised Learning algorithms.

- Disadvantages:

- Iterations results may not be stable.

- We cannot apply these algorithms to network-level data.

- Accuracy is low.

4. Reinforcement Learning

Reinforcement learning works on a feedback-based process, in which an AI agent (A software component) automatically explore its surrounding by hitting & trail, taking action, learning from experiences, and improving its performance. Agent gets rewarded for each good action and get punished for each bad action; hence the goal of reinforcement learning agent is to maximize the rewards.

In reinforcement learning, there is no labelled data like supervised learning, and agents learn from their experiences only.

The reinforcement learning process is similar to a human being; for example, a child learns various things by experiences in his day-to-day life. An example of reinforcement learning is to play a game, where the Game is the environment, moves of an agent at each step define states, and the goal of the agent is to get a high score. Agent receives feedback in terms of punishment and rewards.

Due to its way of working, reinforcement learning is employed in different fields such as Game theory, Operation Research, Information theory, multi-agent systems. A reinforcement learning problem can be formalized using Markov Decision Process (MDP). In MDP, the agent constantly interacts with the environment and performs actions; at each action, the environment responds and generates a new state. Categories of Reinforcement Learning

Reinforcement learning is categorized mainly into two types of methods/algorithms:

- Positive Reinforcement Learning: Positive reinforcement learning specifies increasing the tendency that the required behaviour would occur again by adding something. It enhances the strength of the behaviour of the agent and positively impacts it.

- Negative Reinforcement Learning: Negative reinforcement learning works exactly opposite to the positive RL. It increases the tendency that the specific behaviour would occur again by avoiding the negative condition.

Real-world Use cases of Reinforcement Learning

- Video Games: RL algorithms are much popular in gaming applications. It is used to gain super-human performance. Some popular games that use RL algorithms are AlphaGo and AlphaGo Zero.

- Resource Management: The Resource Management with Deep Reinforcement Learning paper showed that how to use RL in computer to automatically learn and schedule resources to wait for different jobs in order to minimize average job slowdown.

- Robotics: RL is widely being used in Robotics applications. Robots are used in the industrial and manufacturing area, and these robots are made more powerful with reinforcement learning. There are different industries that have their vision of building intelligent robots using AI and Machine Learning technology.

- Text Mining: Text-mining, one of the great applications of NLP, is now being implemented with the help of Reinforcement Learning by Salesforce company.

Advantages and Disadvantages of Reinforcement Learning

Advantages

- It helps in solving complex real-world problems which are difficult to be solved by general techniques.

- The learning model of RL is similar to the learning of human beings; hence most accurate results can be found.

- Helps in achieving long term results.

Disadvantage

- RL algorithms are not preferred for simple problems.

- RL algorithms require huge data and computations.

- Too much reinforcement learning can lead to an overload of states which can weaken the results.

The curse of dimensionality limits reinforcement learning for real physical systems.

1.5 Examples of Machine Learning

When the average person thinks about Machine Learning, it may feel overwhelming, complicated, and perhaps intangible, conjuring up images of futuristic robots taking over the world. As more organizations and people rely on Machine Learning models to manage growing volumes of data, instances of Machine Learning are occurring in front of and around us daily—whether we notice or not. What’s exciting to see is how it’s improving our quality of life, supporting quicker and more effective execution of some business operations and industries, and uncovering patterns that humans are likely to miss. Here are examples of Machine Learning at work in our daily life that provide value in many ways—some large and some small.

1. Facial recognition

Facial recognition is one of the more obvious applications of Machine Learning. People previously received name suggestions for their mobile photos and Facebook tagging, but now someone is immediately tagged and verified by comparing and analysing patterns through facial contours. And facial recognition paired with deep learning has become highly useful in healthcare to help detect genetic diseases or track a patient’s use of medication more accurately. It’s also used to combat important social issues such as child sex trafficking or sexual exploitation of children. The list of applications and industries influenced by it is steadily on the rise.

2.Product recommendations

Do you wonder how Amazon or other retailers frequently know what you might like to purchase? Or have they gotten it wildly wrong, and you wonder how they came up with the recommendation? Thank Machine Learning. Targeted marketing with retail uses Machine Learning to group customers based on buying habits or demographic similarities, and by extrapolating what one person may want from someone else’s purchases. While some suggested purchase pairings are obvious, Machine Learning can get eerily accurate by finding hidden relationships in data and predicting what you want before you know you want it. If the data is incomplete, sometimes you may end up with an off-base recommendation—but don’t worry, because not buying it is another data point to learn from.

3.Email automation and spam filtering

While your inbox seems relatively boring, Machine Learning influences its function behind the scenes. Email automation is a direct result of successful Machine Learning, and one function that goes most unnoticed is spam filtering. Successful spam filtering adapts and finds patterns in email content that is undesirable. This includes data from email domains, a sender’s physical location message text and structure, and IP addresses. It also requires help from users as they mark emails when they’re mistakenly filed. With each marked email, a new data reference is added that helps with future accuracy.

4.Financial accuracy

Machine Learning has created a boon for the financial industry as most systems go digital. Abundant financial transactions that can’t be monitored by human eyes are easily analysed thanks to Machine Learning, which helps find fraudulent transactions. One of the newest banking features is the ability to deposit a check straight from your phone by using handwriting and image recognition to read checks and convert them to digital text. Credit scores and lending decisions are also powered by Machine Learning as it both influences a score and analyses financial risk. Additionally, combining data analytics with artificial intelligence, Machine Learning, and natural language processing is changing