0% found this document useful (0 votes)
13 views

INtroduction to AdvancedMachine Learning2019

Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
13 views

INtroduction to AdvancedMachine Learning2019

Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 69

Machine Learning: Current Trends &

Future Prospects
Man vs Machine

Video: Table Tennis


AI and Machine Learning
• AI traditionally refers to an
artificial creation of human-like
intelligence that can learn, reason,
plan, perceive, or process natural
language.
• Narrow AI vs. General AI
• Narrow AI: focuses on the
development of new algorithms
& models in a field of computer
science referred to as machine
learning.
Machine learning – Algorithms that
generate Algorithms
• Algorithms are a sequence of instructions used to solve a
problem.
• Algorithms, developed by programmers to instruct
computers in new tasks, are the building blocks of the
advanced digital world we see today.
• Computer algorithms organize enormous amounts of
data into information and services, based on certain
instructions and rules.
• Important concept to understand, because in machine
learning, learning algorithms – not computer
programmers – create the rules.
• Instead of programming the computer every step
of the way, ML gives the computer instructions
that allow it to learn from data without new
step-by-step instructions by the programmer.
• This means computers can be used for new,
complicated tasks that could not be manually
programmed.
• Photo recognition applications for the visually
impaired, or translating pictures into speech
• The basic process of ML is to give training data to a learning
algorithm.
• The learning algorithm then generates a new set of rules,
based on inferences from the data.
• This is in essence generating a new algorithm, formally
referred to as the machine learning model.
• By using different training data, the same learning algorithm
could be used to generate different models.
• For example, the same type of learning algorithm could be
used to teach the computer how to translate languages or
predict the stock market
• Inferring new instructions from data is the
core strength of machine learning.

• It also highlights the critical role of data: the


more data available to train the algorithm, the
more it learns.
How machines learn
 3 Ways
• Supervised learning: The learning algorithm is
given labeled data & the desired output.
• For example, pictures of dogs labeled “dog”
will help the algorithm identify the rules to
classify pictures of dogs.
• Unsupervised learning: The data given to the
learning algorithm is unlabeled, & the
algorithm is asked to identify patterns in the
input data.
• For example, the recommendation system of
an e-commerce website where the learning
algorithm discovers similar items often bought
together.
• Reinforcement learning: The algorithm
interacts with a dynamic environment that
provides feedback in terms of rewards &
punishments.
• For example, self-driving cars being rewarded
to stay on the road.1
Why now?
 Data availability: Just over 3 billion people are online with an
estimated 17 billion connected devices or sensors.
• That generates a large amount of data which, combined with
decreasing costs of data storage, is easily available for use.
• Machine learning can use this as training data for learning algorithms,
developing new rules to perform increasingly complex tasks.
 Computing power: Powerful computers and the ability to connect
remote processing power through the Internet make it possible for
machine-learning techniques that process enormous amounts of data.
 Algorithmic innovation: New machine learning techniques, specifically
in layered neural networks – also known as “deep learning” – have
inspired new services, but is also spurring investments and research in
other parts of the field.
Key Considerations
 Socio-economic impacts. The new functions and services of
AI are expected to have significant socio-economic impacts.
• The ability of machines to exhibit advanced cognitive skills
to process natural language, to learn, to plan and to
perceive, makes it possible for new tasks to be performed
by intelligent systems, sometimes with more success than
humans.
• New applications of AI could open up exciting opportunities
for more effective medical care, safer industries and
services, and boost productivity on a massive scale.
Transparency, bias and accountability. AI-
made decisions can have serious impacts in
people’s lives.
 AI may discriminate against some individuals
or make errors due to biased training data.
 How a decision is made by AI is often hard to
understand, making problems of bias harder
to solve and ensuring accountability much
more difficult.
 New uses for data. Machine learning algorithms have proved
efficient in analyzing & identifying patterns in large amounts of
data, commonly referred to as “Big Data”.
• Big Data is used to train learning algorithms to increase their
performance.
• This generates an increasing demand for data, encouraging
data collection & raising risks of oversharing of information at
the expense of user privacy.
 Security and safety. Advancements in AI & its use will also
create new security/safety challenges.
• These include unpredictable and harmful behavior of the AI
agent, but also adversarial learning by malicious actors.
 Ethics. AI may make choices that could be deemed
unethical, yet also be a logical outcome of the
algorithm, emphasizing the importance to build in
ethical considerations into AI systems and algorithms.
 New ecosystems. Like the impact of mobile Internet,
AI makes new applications, services, & new means of
interacting with the network possible.
• For example, through speech and smart agents,
which may create new challenges to how open or
accessible the Internet becomes.
Dream to Reality……

Videos (Table Lamp)


Other Notable Examples..
Chess (Deep Blue, 1997)

“I could feel –
I could smell –
a new kind of
intelligence
across the
table”
-Gary
Kasparov
Speech Recognition

Automated call
centers

Navigation Systems
Museum Tour-Guide Robots

Minerva, 1998
Rhino, 1997
Mars Rovers (2003-now)
Europa Mission ~ 2018?
Humanoid Robots
Brain-Computer Interfaces
Singing, Dancing, Bride, …..
How it would be Possible?

Use Machine Learning


Machine Learning
Learning = Improving performance with experience at
some task
Study of algorithms that
• improve their performance P
• at some task T
• with experience E

well-defined learning task: <P,T,E>


Machine learning systems automatically learn programs
from data
Machine Learning
LEARNING = REPRESENTATION + EVALUATION +
OPTIMIZATION
• Representation: classifier must be represented in
some formal language that the computer can
handle.
• Evaluation: evaluation function (objective/ or
scoring function) is needed to distinguish good
classifiers from bad ones.
• Optimization: method to search among the
classifiers for the highest-scoring one.
03 components of learning algorithms
Representation Evaluation Optimization
Instances Accuracy/Error rate Combinatorial optimization
K-nearest neighbor Precision and recall Greedy search
Support vector machines Squared error Beam search
Hyperplanes Likelihood Branch-and-bound
Naive Bayes Posterior Continuous optimization
Logistic regression probability Unconstrained
Information gain
Decision trees K-L divergence
Gradient descent
Sets of rules Conjugate gradiant
Margin Quasi-Newton methods
Propositional rules
Logic programs Constrained
Neural networks Linear programming
Quadratic programming
Graphical models
Bayesian networks
Conditional random fields
Why Machine Learning?
• Some tasks cannot be defined well, except by
examples (e.g., recognizing people).
• Relationships & correlations can be hidden
within large amounts of data
ML may be able to find these relationships.
• Human designers often produce machines
that do not work as well as desired in the
environments in which they are used.
Why Machine Learning?
• The amount of knowledge available about
certain tasks might be too large for explicit
encoding by humans (e.g., medical diagnostic).
• Environments change over time.
• New knowledge about tasks is constantly being
discovered by humans (e.g. autonomous
driving)
 It may be difficult to continuously re-design
systems “by hand”.
Pros & Cons
 Pros:
 often much more accurate than human-crafted rules (since data
driven)
 humans often incapable of expressing what they know (e.g., rules of
English, or how to recognize letters), but can easily classify examples
 don’t need a human expert or programmer
 automatic method to search for hypotheses explaining data
 cheap & flexible — can apply to any learning task

 Cons:
 need a lot of labeled data
 error prone — usually impossible to get perfect accuracy
Machine Learning Applications
Countless………..
• Machine perception •Sequence mining
• Computer vision, •Speech and handwriting recognition
including object recognition •Game playing
• Natural language processing •Software engineering
• Syntactic pattern recognition •Adaptive websites
• Search engines •Robot locomotion
• Medical diagnosis •Computational advertising
• Bioinformatics •Computational finance
• Brain-machine interfaces •Structural health monitoring
• Cheminformatics •Sentiment analysis (or opinion mining)
• Detecting credit card fraud •Affective computing
• Stock market analysis •Information retrieval
• Classifying DNA sequences •Recommender systems
•Optimization and Metaheuristic
Few Examples
Learning to Predict Emergency C-Sections
 Data

Given:
9714 patient records, each describing a pregnancy & birth
Each patient record contains 215 features
Learn to predict:
Classes of future patients at high risk for Emergency Cesarean Section
Learning to Predict Emergency C-Sections

One of 18
learned rules
Credit Risk Analysis
• Data

Rules learned
from synthesized
data
Learning to detect objects in images

Example training images


for each orientation
Learning to classify text documents
Company home page
vs.
Personal home page
vs.
University home page
vs

ALVINN drives 70 mph on highways
Learning prosthetic control from neural implant
R. Kass, L. Castlellanos, A. Schwartz
Machine Learning - Practice

• Supervised learning
• Bayesian networks
• Hidden Markov models
• Unsupervised clustering
• Reinforcement learning
• ....
Related Disciplines

Computer
science Animal
Economics learning
& (Cognitive
Organizational science,
Behavior Psychology,
Machine Neuroscience)
learning

Evolution
Adaptive
Control theory

Statistics
ML niche is growing (Why)?

Improved machine learning algorithms


Increased data capture, networking, new
sensors
Software too complex to write by hand
Demand for self-customization to user,
environment
ML: Current Trends
• Over the years, ML has made possible the concept
of
 self-driving cars, effective web search, spam free emails,
practical speech recognition software, personalized marketing
and so on.
• Today, machine learning is increasingly being
deployed in
 credit card purchase fraud detection, personalized advertising
though pattern identification, personalized
shopping/entertainment recommendations, to determine cab
arrival times, pick-up locations, and finding routes on maps.
Top 5 ML trends of 2018
Data Scientist Jobs Will be Up for Grabs
 Data scientist tops the job chart with the huge
gap in demand and supply of resources.
New Approaches to Cybersecurity
 Machine learning in cybersecurity works both
ways, if used by potential hackers it can result
in stronger attacks while if deployed by
cybersecurity firms it can increase the level of
security
Robotic Process Automation Will Rule the
World
 The deployment of robotic process
automation extends to finance, health and
even manufacturing processes where robots
make the task easier.
 Improved IT Operations
 There is huge data being generated through hardware
components, software components, server applications, and
operating systems.
 Not all the data is fit as inputs to machine learning models.
 ML captures, cleans data and generates intelligent business
insights to make an IT enterprise become proactive instead of
reactive.
 Models built on ML operate on clean data for training and testing
phases.
 ML algorithms assist IT operations teams to find the root cause of
issues, supported by predictive analytics for improved operations.
Transparency in Decision-Making
• ML through predictive models brings
transparency in decision-making in the multitude
of domains.
• ML is an effective tool in transparent decision-
making where laws and regulations (for example
in HR operations treating job applications equally
without consideration of age, gender, religion,
caste, creed, color, etc.) come into the picture.
ML: Future Trends
• It seems that we’ve already seen more than
we were ready to VR in video games, IoT in
medicine and smart cities being brought to
life.
Healthcare sector: too much going on and
everything is amazing
• Biggest & most crucial industries in the world
so no wonder it’s the one that is heavily using
the latest technologies — because it’s the
matter of life and death.
Financial sector: fewer risks,
more accuracy
Personal assistants and better experience
for the customers
Rise of Robotics
Prospects & Career Opportunities
• ML is one of the hottest career
choices today.
• Create 2.3 million ML jobs by 2020
[Gartner]
• 9.8 times more ML Engineers working
2.3 millions ML Jobs
today than five years ago with 1,829
open positions listed on their site as
of early 2018 [LinkedIn’s]
• Both Data Science and ML are
generating more jobs than candidates
right now, making these two areas the
fastest growing tech employment
areas today
ML Companies recruit for positions:
• Machine Learning Engineer
• Machine Learning Analyst
• NLP Data Scientist
• Data Sciences Lead
• Machine Learning Scientist
• Salary: RS. 699,807- 891,326
• $114,826/year
Essential skill sets to become a ML
professional
Computer Science Fundamentals and
Programming:
• Having a Computer Science background is very important to
have a rewarding career in Machine Learning.
• Engineers looking for Machine Learning Jobs in India should
have in-depth knowledge of
• data structures (stacks, queues, multi-dimensional arrays, trees,
graphs, etc.), algorithms (searching, sorting, optimization,
dynamic programming, etc.), computability and complexity (P
vs. NP, NP-complete problems, big-O notation, approximate
algorithms, etc.), and computer architecture (memory, cache,
bandwidth, deadlocks, distributed processing, etc.).
• One must be able to apply, implement, adapt or address them
when programming.
Machine Learning Algorithms and
Libraries:
• Candidates looking forward to Machine
Learning jobs in India should be well
acquainted with standard implementations of
Machine Learning algorithms, most of which
are widely available through
libraries/packages/APIs.
• One should also be aware of the relative
advantages and disadvantages of different
approaches.
Probability and Statistics:
• If you are looking for a career in Machine
Learning, you should possess strong
knowledge of formal characterization of
probability and techniques derived from it
(Bayes Nets, Markov Decision Processes,
Hidden Markov Models, etc.).
• Also, knowledge of analysis methods (ANOVA,
hypothesis testing) is necessary for building
and validating models from observed data.
Software Engineering and System Design:

• Having a strong base in software engineering and


system design is required for a promising career in
Machine Learning and data science.
• You should be able to build appropriate interfaces for
your component.
• Having a good knowledge of Software engineering
best practices (including requirements analysis,
system design, modularity, version control, testing,
documentation, etc.) are invaluable for productivity,
collaboration, quality, and maintainability.
Summing up
• AI + ML are dedicated to simplifying our lives/
work processes and improving certain
industries to our benefit.
• The changes brought by ML will bring amazing
outcomes that will redefine our way of living
in times to come.
Thanks

You might also like