Scribd Logo
Upload

Welcome to Scribd!

  • 59 views

    Welcome: Machine Learning

    Uploaded by

    Bùi Hữu Thịnh
    This document discusses machine learning and provides examples of supervised and unsupervised learning problems. It defines machine learning as a field that gives computers the ability to learn without being explicitly programmed. Supervised learning involves predicting an output based on labeled examples, and can be used for regression (predicting continuous values) or classification (predicting discrete categories). Unsupervised learning finds hidden patterns in unlabeled data through clustering or dimensionality reduction. It provides examples of using unsupervised learning for tasks like grouping news articles, discovering market segments in customer data, and separating speech from a cocktail party.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd

    Welcome: Machine Learning

    Uploaded by

    Bùi Hữu Thịnh
    59 views31 pages
    This document discusses machine learning and provides examples of supervised and unsupervised learning problems. It defines machine learning as a field that gives computers the ability to learn without being explicitly programmed. Supervised learning involves predicting an output based on labeled examples, and can be used for regression (predicting continuous values) or classification (predicting discrete categories). Unsupervised learning finds hidden patterns in unlabeled data through clustering or dimensionality reduction. It provides examples of using unsupervised learning for tasks like grouping news articles, discovering market segments in customer data, and separating speech from a cocktail party.

    Original Title

    docs_slides_Lecture1

    Copyright

    © © All Rights Reserved

    Available Formats

    PPTX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document discusses machine learning and provides examples of supervised and unsupervised learning problems. It defines machine learning as a field that gives computers the ability to learn without being explicitly programmed. Supervised learning involves predicting an output based on labeled examples, and can be used for regression (predicting continuous values) or classification (predicting discrete categories). Unsupervised learning finds hidden patterns in unlabeled data through clustering or dimensionality reduction. It provides examples of using unsupervised learning for tasks like grouping news articles, discovering market segments in customer data, and separating speech from a cocktail party.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Download as pptx, pdf, or txt
    59 views31 pages

    Welcome: Machine Learning

    Uploaded by

    Bùi Hữu Thịnh
    This document discusses machine learning and provides examples of supervised and unsupervised learning problems. It defines machine learning as a field that gives computers the ability to learn without being explicitly programmed. Supervised learning involves predicting an output based on labeled examples, and can be used for regression (predicting continuous values) or classification (predicting discrete categories). Unsupervised learning finds hidden patterns in unlabeled data through clustering or dimensionality reduction. It provides examples of using unsupervised learning for tasks like grouping news articles, discovering market segments in customer data, and separating speech from a cocktail party.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Download as pptx, pdf, or txt
    of 31

    Introduction

    Welcome
    Machine Learning
    Andrew Ng
    Andrew Ng
    SPAM
    Andrew Ng
    Machine Learning
    - Grew out of work in AI
    - New capability for computers
    Examples:
    - Database mining
    Large datasets from growth of automation/web.
    E.g., Web click data, medical records, biology, engineering
    - Applications can’t program by hand.
    E.g., Autonomous helicopter, handwriting recognition, most of
    Natural Language Processing (NLP), Computer Vision.

    Andrew Ng
    Machine Learning
    - Grew out of work in AI
    - New capability for computers
    Examples:
    - Database mining
    Large datasets from growth of automation/web.
    E.g., Web click data, medical records, biology, engineering
    - Applications can’t program by hand.
    E.g., Autonomous helicopter, handwriting recognition, most of
    Natural Language Processing (NLP), Computer Vision.
    - Self-customizing programs
    E.g., Amazon, Netflix product recommendations
    - Understanding human learning (brain, real AI).
    Andrew Ng
    Andrew Ng
    Introduction
    What is machine
    learning
    Machine Learning

    Andrew Ng
    Machine Learning definition
    • Arthur Samuel (1959). Machine Learning: Field of
    study that gives computers the ability to learn
    without being explicitly programmed.
    • Tom Mitchell (1998) Well-posed Learning Problem:
    A computer program is said to learn from
    experience E with respect to some task T and some
    performance measure P, if its performance on T, as
    measured by P, improves with experience E.

    Andrew Ng
    “A computer program is said to learn from experience E with respect to
    some task T and some performance measure P, if its performance on T,
    as measured by P, improves with experience E.”
    Suppose your email program watches which emails you do or do
    not mark as spam, and based on that learns how to better filter
    spam. What is the task T in this setting?

    Classifying emails as spam or not spam.

    Watching you label emails as spam or not spam.

    The number (or fraction) of emails correctly classified as spam/not spam.

    None of the above—this is not a machine learning problem.


    Machine learning algorithms:
    - Supervised learning
    - Unsupervised learning
    Others: Reinforcement learning, recommender
    systems.

    Also talk about: Practical advice for applying


    learning algorithms.
    Andrew Ng
    Andrew Ng
    Introduction
    Supervised
    Learning
    Machine Learning

    Andrew Ng
    Housing price prediction.
    400

    300
    Price ($)
    200
    in 1000’s
    100

    0
    0 500 1000 1500 2000 2500

    Size in feet2

    Supervised Learning Regression: Predict continuous


    “right answers” given valued output (price)
    Andrew Ng
    Breast cancer (malignant, benign)
    1(Y)
    Classification
    Discrete valued
    Malignant?
    output (0 or 1)
    0(N)
    Tumor Size

    Tumor Size

    Andrew Ng
    - Clump Thickness
    - Uniformity of Cell Size
    Age - Uniformity of Cell Shape
    …

    Tumor Size

    Andrew Ng
    You’re running a company, and you want to develop learning algorithms to address each
    of two problems.

    Problem 1: You have a large inventory of identical items. You want to predict how many
    of these items will sell over the next 3 months.
    Problem 2: You’d like software to examine individual customer accounts, and for each
    account decide if it has been hacked/compromised.

    Should you treat these as classification or as regression problems?


    Treat both as classification problems.

    Treat problem 1 as a classification problem, problem 2 as a regression problem.

    Treat problem 1 as a regression problem, problem 2 as a classification problem.

    Treat both as regression problems.


    Andrew Ng
    Introduction
    Unsupervised
    Learning
    Machine Learning

    Andrew Ng
    Supervised Learning

    x2

    x1
    Andrew Ng
    Unsupervised Learning

    x2

    x1
    Andrew Ng
    Andrew Ng
    Andrew Ng
    Genes

    Individuals

    [Source: Daphne Koller] Andrew Ng


    Genes

    Individuals

    [Source: Daphne Koller] Andrew Ng


    Organize computing clusters Social network analysis

    Image credit: NASA/JPL-Caltech/E. Churchwell (Univ. of Wisconsin, Madison)

    Market segmentation Astronomical data analysis


    Andrew Ng
    Cocktail party problem

    Speaker #1 Microphone #1

    Speaker #2 Microphone #2

    Andrew Ng
    Microphone #1: Output #1:

    Microphone #2: Output #2:

    Microphone #1: Output #1:

    Microphone #2: Output #2:

    [Audio clips courtesy of Te-Won Lee.] Andrew Ng


    Cocktail party problem algorithm

    [W,s,v] = svd((repmat(sum(x.*x,1),size(x,1),1).*x)*x');

    [Source: Sam Roweis, Yair Weiss & Eero Simoncelli] Andrew Ng


    Of the following examples, which would you address using an
    unsupervised learning algorithm? (Check all that apply.)

    Given email labeled as spam/not spam, learn a spam filter.

    Given a set of news articles found on the web, group them into
    set of articles about the same story.
    Given a database of customer data, automatically discover market
    segments and group customers into different market segments.
    Given a dataset of patients diagnosed as either having diabetes or
    not, learn to classify new patients as having diabetes or not.
    Andrew Ng

    You might also like