What Is Data Science - Data Science Explained - AWS
What Is Data Science - Data Science Explained - AWS
Artificial intelligence and machine learning innovations have made data processing faster and more
efficient. Industry demand has created an ecosystem of courses, degrees, and job positions within
the field of data science. Because of the cross-functional skillset and expertise required, data
science shows strong projected
Get Started for Free growth over the coming decades. Contact Us
1. Descriptive analysis
Descriptive analysis examines data to gain insights into what happened or what is happening in
the data environment. It is characterized by data visualizations such as pie charts, bar charts, line
graphs, tables, or generated narratives. For example, a flight booking service may record data like
the number of tickets booked each day. Descriptive analysis will reveal booking spikes, booking
slumps, and high-performing months for this service.
2. Diagnostic analysis
3. Predictive analysis
Predictive analysis uses historical data to make accurate forecasts about data patterns that may
occur in the future. It is characterized by techniques such as machine learning, forecasting, pattern
matching, and predictive modeling. In each of these techniques, computers are trained to reverse
engineer causality connections in the data.For example, the flight service team might use data
science to predict flight booking patterns for the coming year at the start of each year. The
computer program or algorithm may look at past data and predict booking spikes for certain
destinations in May. Having anticipated their customer’s future travel requirements, the company
could start targeted advertising for those cities from February.
4. Prescriptive analysis
Prescriptive analytics takes predictive data to the next level. It not only predicts what is likely to
happen but also suggests an optimum response to that outcome. It can analyze the potential
implications of different choices and recommend the best course of action. It uses graph analysis,
simulation, complex event processing, neural networks, and recommendation engines from
machine learning.
Back to theGet
flight booking
Started example, prescriptive analysis could look at historical
for Free Contact marketing
Us
campaigns to maximize the advantage of the upcoming booking spike. A data scientist could
project booking outcomes for different levels of marketing spend on various marketing channels.
These data forecasts would give the flight booking company greater confidence in their marketing
decisions.
Data science allows businesses to uncover new patterns and relationships that have the potential to
transform the organization. It can reveal low-cost changes to resource management for maximum
impact on profit margins.For example, an e-commerce company uses data science to discover that
too many customer queries are being generated after business hours. Investigations reveal that
customers are more likely to purchase if they receive a prompt response instead of an answer the
next business day. By implementing 24/7 customer service, the business grows its revenue by 30%.
Data science can reveal gaps and problems that would otherwise go unnoticed. Greater insight
about purchase decisions, customer feedback, and business processes can drive innovation
in internal operations and external solutions.For example, an online payment solution uses data
science to collate and analyze customer comments about the company on social media. Analysis
reveals that customers forget passwords during peak purchase periods and are unhappy with the
current password retrieval system. The company can innovate a better solution and see a
significant increase in customer satisfaction.
Real-time optimization
It’s very challenging for businesses, especially large-scale enterprises, to respond to changing
conditions in real-time. This can cause significant losses or disruptions in business activity. Data
science can help companies predict change and react optimally to different circumstances.For
example, a truck-based shipping company uses data science to reduce downtime when trucks break
down. They identify the routes and shift patterns that lead to faster breakdowns and tweak truck
schedules. They also set up an inventory of common spare parts that need frequent replacement so
trucks can be repaired faster.
What is the data science process?
Get Started for Free Contact Us
A business problem typically initiates the data science process. A data scientist will work with
business stakeholders to understand what business needs. Once the problem has been defined, the
data scientist may solve it using the OSEMN data science process:
O – Obtain data
Data can be pre-existing, newly acquired, or a data repository downloadable from the internet.
Data scientists can extract data from internal or external databases, company CRM software, web
server logs, social media or purchase it from trusted third-party sources.
S – Scrub data
Data scrubbing, or data cleaning, is the process of standardizing the data according to a
predetermined format. It includes handling missing data, fixing data errors, and removing any data
outliers. Some examples of data scrubbing are:·
E – Explore data
Data exploration is preliminary data analysis that is used for planning further data modeling
strategies. Data scientists gain an initial understanding of the data using descriptive statistics and
data visualization tools. Then they explore the data to identify interesting patterns that can be
studied or actioned.
M – Model data
Software and machine learning algorithms are used to gain deeper insights, predict outcomes, and
prescribe the best course of action. Machine learning techniques like association, classification, and
clustering are applied to the training data set. The model might be tested against predetermined
test data to assess result accuracy. The data model can be fine-tuned many times to improve result
outcomes.
N – Interpret results
Data scientists work together with analysts and businesses to convert data insights into action.
They make diagrams, graphs, and charts to represent trends and predictions. Data summarization
helps stakeholders understand and implement results effectively.
Classification
Classification is the sorting of data into specific groups or categories. Computers are trained to
identify and sort data. Known data sets are used to build decision algorithms in a computer that
quickly processes and categorizes the data. For example:·
Data science professionals use computing systems to follow the data science process.
Regression
Regression is the method of finding a relationship between two seemingly unrelated data points.
The connection is usually modeled around a mathematical formula and represented as a graph or
curves. When the value of one data point is known, regression is used to predict the other data
point. For example:·
The relationship between the number of fire stations and the number of injuries due to fire in a
particular location.
Clustering
Clustering is the method of grouping closely related data together to look for patterns and
anomalies. Clustering is different from sorting because the data cannot be accurately classified into
fixed categories. Hence the data is grouped into most likely relationships. New patterns and
Getcan
relationships Started for Free with clustering. For example: ·
be discovered Contact Us
Group customers with similar purchase behavior for improved customer service.·
Group network traffic to identify daily usage patterns and identify a network attack faster.
Cluster articles into multiple different news categories and use this information to find fake
news content.
While the details vary, the underlying principles behind these techniques are:
Teach a machine how to sort data based on a known data set. For example, sample keywords
are given to the computer with their sort value. “Happy” is positive, while “Hate” is negative.
Give unknown data to the machine and allow the device to sort the dataset independently.
Allow for result inaccuracies and handle the probability factor of the result.
1. Artificial intelligence: Machine learning models and related software are used for predictive
and prescriptive analysis.
2. Cloud computing: Cloud technologies have given data scientists the flexibility and processing
power required for advanced data analytics.
3. Internet of things: IoT refers to various devices that can automatically connect to the internet.
These devices collect data for data science initiatives. They generate massive data which can be
used for data mining and data extraction.
4. Quantum computing: Quantum computers can perform complex calculations at high speed.
Skilled data scientists use them for building complex quantitative algorithms.
Data science is an all-encompassing term for other data-related roles and fields. Let’s look at some
of them here:
What is the
Get difference
Started for between
Free data science and data analytics?Contact Us
While the terms may be used interchangeably, data analytics is a subset of data science. Data
science is an umbrella term for all aspects of data processing—from the collection to modeling to
insights. On the other hand, data analytics is mainly concerned with statistics, mathematics, and
statistical analysis. It focuses on only data analysis, while data science is related to the bigger
picture around organizational data.In most workplaces, data scientists and data analysts work
together towards common business goals. A data analyst may spend more time on routine analysis,
providing regular reports. A data scientist may design the way data is stored, manipulated, and
analyzed. Simply put, a data analyst makes sense out of existing data, whereas a data scientist
creates new methods and tools to process data for use by analysts.
While there is an overlap between data science and business analytics, the key difference is the use
of technology in each field. Data scientists work more closely with data technology than business
analysts.Business analysts bridge the gap between business and IT. They define business cases,
collect information from stakeholders, or validate solutions. Data scientists, on the other hand, use
technology to work with business data. They may write programs, apply machine learning
techniques to create models, and develop new algorithms. Data scientists not only understand the
problem but can also build a tool that provides solutions to the problem.It’s not unusual to find
business analysts and data scientists working on the same team. Business analysts take the output
from data scientists and use it to tell a story that the broader business can understand.
Data engineers build and maintain the systems that allow data scientists to access and interpret
data. They work more closely with underlying technology than a data scientist. The role generally
involves creating data models, building data pipelines, and overseeing extract, transform, load
(ETL). Depending on organization setup and size, the data engineer may also manage related
infrastructure like big-data storage, streaming, and processing platforms like Amazon S3.Data
scientists use the data that data engineers have processed to build and train predictive models.
Data scientists may then hand over the results to the analysts for further decision making.
learning?Machine learning is the science of training machines to analyze and learn from data the
way humans do. It is one of the methods used in data science projects to gain automated insights
from data. Machine learning engineers specialize in computing, algorithms, and coding skills
specific to machine learning methods. Data scientists might use machine learning methods as a
tool or work closely with other machine learning engineers to process data.
Data storage
For data warehousing, Amazon Redshift can run complex queries against structured or
unstructured data. Analysts and data scientists can use AWS Glue to manage and search for data.
AWS Glue automatically creates a unified catalog of all data in the data lake, with metadata
attached to make it discoverable.
Machine learning
Amazon SageMaker is a fully-managed machine learning service that runs on the Amazon Elastic
Compute Cloud (EC2). It allows users to organize data, build, train and deploy machine learning
models, and scale operations.
Analytics
Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon
S3 or Glacier. It is fast, serverless, and works using standard SQL queries.
Amazon Elastic MapReduce (EMR) processes big data using servers like Spark and Hadoop.
Amazon Kinesis allows aggregation and processing of streaming data in real-time. It uses
website clickstreams, application logs, and telemetry data from IoT devices.
A data scientist’s role and day-to-day work vary depending on the size and requirements of the
organization. While they typically follow the data science process, the details may vary. In larger
data science teams, a data scientist may work with other analysts, engineers, machine learning
Getstatisticians
experts, and Started fortoFree Contact Us
ensure the data science process is followed end-to-end and business
goals are achieved.
However, in smaller teams, a data scientist may wear several hats. Based on experience, skills, and
educational background, they may perform multiple roles or overlapping roles. In this case, their
daily responsibilities might include engineering, analysis, and machine learning along with core
data science methodologies.
Different types of apps and tools generate data in various formats. Data scientists have to clean
and prepare data to make it consistent. This can be tedious and time-consuming.
Data scientists have to work with multiple stakeholders and business managers to define the
problem to be solved. This can be challenging—especially in large companies with multiple teams
that have varying requirements.
Elimination of bias
Machine learning tools are not completely accurate, and some uncertainty or bias can exist as a
result. Biases are imbalances in the training data or prediction behavior of the model across
different groups, such as age or income bracket. For instance, if the tool is trained primarily on data
from middle-aged individuals, it may be less accurate when making predictions involving younger
and older people. The field of machine learning provides an opportunity to address biases by
detecting them and measuring them in the data and model.
1. Earn a bachelor's degree in IT, computer science, math, physics, or another related field.
Help
Contact Us
Get Expert Help
File a Support Ticket
AWS re:Post
Knowledge Center
AWS Support Overview
Legal
AWS Careers
Amazon is an Equal Opportunity Employer: Minority / Women / Disability / Veteran / Gender Identity / Sexual
Orientation / Age.
Language
| عربي
Bahasa Indonesia |
Deutsch |
English |
Español |
Français |
Italiano |
Português |
Tiế ng Việt |
Türkçe |
Ρусский |
ไทย |
https://aws.amazon.com/what-is/data-science/#:~:text=Data science is the study,analyze large amounts of data. 12/13
2/20/24, 2:52 PM What is Data Science? - Data Science Explained - AWS
日本語 |
한국어 |
中文 (简体) |
中文 (繁體) Get Started for Free Contact Us
Privacy
|
Site Terms
|
Cookie Preferences
|
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.