Scribd
Upload
26 views3 pages

Big Data Analytics Chap 12

Chapter 12 discusses automated data discovery and Topological Data Analysis (TDA), which helps identify patterns in datasets without direct observation. It contrasts traditional machine learning with deep learning, highlighting deep learning's ability to learn complex patterns through multi-layer neural networks. The chapter also outlines the benefits and challenges of deep learning, including the need for large datasets and significant computational resources.

Uploaded by

Muhammad Ayaz
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
26 views3 pages

Big Data Analytics Chap 12

Chapter 12 discusses automated data discovery and Topological Data Analysis (TDA), which helps identify patterns in datasets without direct observation. It contrasts traditional machine learning with deep learning, highlighting deep learning's ability to learn complex patterns through multi-layer neural networks. The chapter also outlines the benefits and challenges of deep learning, including the need for large datasets and significant computational resources.

Uploaded by

Muhammad Ayaz
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

Chapter 12 Data Science with Hadoop—The Next Frontier

Automated Data Discovery


• Imagine you have a huge box full of different colored balls.
• You want to know what's inside the box, but you can't look inside.

Automated data discovery is like a tool that helps you figure out what's inside the box without
opening it.

Topological Data Analysis (TDA)

• TDA is a way to analyze data by looking at its shape.


• Think of it like a map that shows you the different regions of a country.
How TDA Works

Let's say you have a dataset of patients with diabetes. You want to know if there are any
patterns in the data.

• Identify shapes: TDA looks at the data and identifies patterns, like clusters or loops.
• Analyze patterns: TDA analyzes these patterns to see if they mean anything.
• Get insights: TDA gives you insights into the data, like which patients are most likely to
have a certain type of diabetes.
Example
Let's say you're a basketball coach,

• and you want to know which players are most similar.


• You collect data on each player's performance,
• like points scored, rebounds, and assists.

TDA analyzes the data

• and identifies patterns, like clusters of players who are similar.


• You can then use these patterns to decide which players to put on the court together.
Benefits of TDA

• Finds hidden patterns: TDA can find patterns in data that you might not have noticed
otherwise.
• Saves time: TDA can analyze large datasets quickly, saving you time and effort.
• Gives insights: TDA gives you insights into the data, helping you make better decisions.
Deep Learning
Deep learning is a type of machine learning that uses multi-layer neural networks to learn
complex patterns in data.
Traditional Machine Learning vs. Deep Learning

• Traditional machine learning uses a "shallow" architecture,


• where data is fed into a single layer of algorithms to make predictions.
• Deep learning, on the other hand, uses a "deep" architecture,
• where data is fed into multiple layers of algorithms to make predictions.

How Deep Learning Works


Deep learning works by using multiple layers of algorithms to learn complex patterns in data.
Each layer learns a different level of abstraction, allowing the network to learn hierarchical
representations of the data.

Example

• Imagine you're trying to recognize images of dogs and cats.


• A traditional machine learning algorithm might use a single layer of algorithms to look
for specific features, such as ears or whiskers.
• A deep learning algorithm, on the other hand, might use multiple layers of algorithms
• to learn more abstract features, such as the shape of the face or the texture of the fur.

Benefits of Deep Learning


1. Automatic feature learning:
• Deep learning algorithms can automatically learn features from the data,
• rather than relying on manual feature engineering.
2. Improved accuracy:
• Deep learning algorithms can achieve state-of-the-art performance on a wide
range of tasks,
• including image recognition, speech recognition, and natural language
processing.
3. Scalability: Deep learning algorithms can be trained on large datasets and can scale to meet
the needs of big data applications.

Challenges of Deep Learning


1. Requires large amounts of data:
• Deep learning algorithms require large amounts of data to train,
• which can be a challenge for applications where data is scarce.
2. Requires significant computational resources:
• Deep learning algorithms require significant computational resources to train,
• which can be a challenge for applications where computational resources are
limited.

You might also like