Data Science with Python

Data Science Overview

 Learning Objectives

By the end of this lesson, you will be able to:

Define Data Science

Discuss the roles and responsibilities of a Data Scientist

List various applications of Data Science

Explain Data Science importance

Describe Python and its importance

Data Science
 What Is Data Science?

Some common definitions of Data Science are:

A powerful new approach to An automated way to analyze

make discoveries from data enormous amounts of data and
extract information

Data Science

A new discipline that combines the aspects of statistics, mathematics,

programming, and visualization to turn data into information
 Components of Data Science

When you combine domain expertise and scientific methods with technology, you get Data Science.

Domain Expertise and Scientific Technology

Methods Operating
Systems
Analysis Python Application
Mathematical Scientific Language Design
and Statistical Tools and
Models Methods

Data
Science
Data Processing Library
Tools
 Domain Expertise and Scientific Methods

Data Scientists collect, explore, analyze, and visualize data. They apply mathematical and statistical models
to find patterns and solutions in the data.

Data analysis can be:

Analysis
• Descriptive: Study a dataset to decipher the
details
• Predictive: Create a model based on existing
Mathematical Scientific
and Statistical Tools and information to predict outcome and behavior
Models Methods
• Prescriptive: Suggest actions for a given
situation using the collected information
 Data Processing and Analytics

Modern tools and technologies have made data processing and analytics faster and efficient.

These technologies help Data Scientists to: Technology

• Build and train machine learning models
Operating System
• Manipulate data with technology
Python
• Build data tools, applications, and services Language Application
Design
• Extract information from data

Library
Data Processing
Tools

Data analysis that uses only technology and domain knowledge without mathematical and
!
statistical knowledge often leads to incorrect patterns and wrong interpretations.
This can cause serious damage to businesses.
Roles and Responsibilities of a Data Scientist
Role of a Data Scientist
 Basic Skills of a Data Scientist

A Data Scientist should be able to:

• Ask the right questions
• Understand data structure
• Interpret and wrangle data
• Apply statistical and mathematical methods
• Visualize data and communicate with stakeholders
• Work as a team player
 Sources of Big Data

Data Scientists work with different types of datasets for various purposes. Now that Big Data is generated every
second through different media, the role of Data Science has become more important.
 3 Vs of Big Data

Volume Enormous amount of data generated from various sources

Large amount of data streaming in at great speeds, which requires quick

Velocity
data processing

Variety Different formats of data: Structured, Semi-structured, and Unstructured

Big Data is a huge collection of data stored on distributed systems/machines popularly referred
to as Hadoop clusters.
Data Science helps extract information from the data and build information-driven enterprises.
Applications of Data Science
 Different Sectors Using Data Science

Various sectors use Data Science to extract the information they need to create different services and products.
 Using Data Science: Social Network Platforms

LinkedIn uses data points from its users to provide them with relevant digital services and data products.

Profil
e

Groups

Locatio
n
Digital

Information
Data Points
Services
Connections

Data
Products

Post

Likes
 Using Data Science: Search Engines

Google uses Data Science to provide relevant search recommendations as the user types a query.

Search keyword

Autocomplete feature is fed by data models (Machine Learning)

Fast and real-time analytics is made Influencing Factors

possible by modern and advanced 1. Query Volume – Unique and verifiable users
infrastructure, tools, and technologies 2. Geographical locations
3. Keyword/phrase matches on the web
4. Some scrubbing for inappropriate content
 Using Data Science: Healthcare

Wearable devices use Data Science to analyze data gathered by their biometric sensors.

Biometric data IoT Gateway Data transfer to Enterprise

transfer Servers Infrastructure
Wearable device

Make informed Data Analytics

decisions Engagement
Dashboard
 Using Data Science: Finance

A loan manager can easily access and sift through a loan applicant’s financial details using Data Science.

Data transfer to Enterprise

Loan Application Servers Infrastructure
Portal
Loan Applicant

Credit report, Credit history,

Approved amount, Risk etc.
Make informed
decisions Data Analytics
Engagement
Dashboard
 Using Data Science: Public Sector

The governments in different countries share large datasets from various domains with the public.
Data.gov is a website hosted and maintained by the U.S. government.

Large collection of datasets

Sectors/Domains
 The Real Challenge

Some of the challenges Data Scientists face in the real

world are:
• Data quality doesn’t conform to the set standards
• Data integration is a complex task
• Data is distributed into large clusters in HDFS, which is
difficult to integrate and analyze
• Unstructured and semi-structured data are harder to
analyze
Python
 Data Analytics and Python

Python deals with each stage of data analytics efficiently by applying different libraries and packages.

Acquire

Wrangle

Explore

Model

Data
Analytics Visualize
Bokeh
 Python Tools and Technologies

Python is a general purpose, open source programming language that lets you work quickly and integrate
systems more effectively.
Benefits of Python

Easy to learn

Open source

Efficient and multi-platform

multi platform
support
Huge collection of libraries,
functions,
functions and
and modules
modules

Big open source community

Integrates well with enterprise

apps and systems

Great vendor and product support

 Big Data Platforms and Processing Frameworks for Python

Python is supported by well-established data platforms and processing frameworks that help analyze data in a
simple and efficient way.

Data Scientist

Python Tool for data analysis and processing

Big Data Processing Framework

Enterprise Big Data Platform

Big Data
Knowledge Check
Knowledge
Check
A Data Scientist _____.
1

a. Asks the right questions

b. Acquires data

c. Performs data wrangling and data visualization

d. All of the above

 Knowledge
Check
A Data Scientist _____.
1

a. Asks the right questions

b. Acquires data

c. Performs data wrangling and data visualization

d. All of the above

The correct answer is d

A Data Scientist asks the right questions to the stakeholders, acquires data from various sources and data points,
performs data wrangling that makes the data available for analysis, and creates reports and plots for data
visualization.
Knowledge
Check
The search engine’s autocomplete feature identifies unique and verifiable users who
search for a particular keyword or phrase to_____. Select all that apply.
2

a. Scrub inappropriate content

b. Build a query volume

c. Tag the location to a query

d. Find similar instances on the web

 Knowledge
Check
The search engine’s autocomplete feature identifies unique and verifiable users who
search for a particular keyword or phrase to_____. Select all that apply.
2

a. Scrub inappropriate content

b. Build a query volume

c. Tag the location to a query

d. Find similar instances on the web

The correct answer is b, c

The search engine’s autocomplete feature identifies unique and verifiable users who search for a particular
keyword or phrase to build a query volume. It also helps identify the users’ locations and tag them to the query,
enabling it to be location-specific.
Knowledge
Check What is the sequential flow of Data Analytics?
3

a. Data wrangling, exploration, modeling, acquisition, and visualization

b. Data exploration, acquisition, modeling, wrangling, and visualization

c. Data acquisition, wrangling, exploration, modeling, and visualization

d. Data modeling, acquisition, exploration, wrangling, and visualization

 Knowledge
Check What is the sequential flow of Data Analytics?
3

a. Data wrangling, exploration, modeling, acquisition, and visualization

b. Data exploration, acquisition, modeling, wrangling, and visualization

c. Data acquisition, wrangling, exploration, modeling, and visualization

d. Data modeling, acquisition, exploration, wrangling, and visualization

The correct answer is c

In Data Analytics, the data is acquired from various sources and is then wrangled to ease its analysis. This is
followed by data exploration and data modeling. The final stage is data visualization, where the data is presented
and the patterns are identified.
 Key Takeaways

You are now able to:

Define Data Science

Discuss the roles and responsibilities of a Data Scientist

List various applications of Data Science

Explain Data Science importance

Describe Python and its importance

Thank You