UNIT IV Data Science

• Basic introduction to Data Science

• Various Applications of data Science
• Importance of Data Science in Future
• Data Analysis, techniques, Programming paradigm & algorithms,
data structures

Basic introduction to Data Science

Data science is the study of data. Like biological sciences is a study of
biology, physical sciences, it’s the study of physical reactions. Data is real,
data has real properties, and we need to study them if we’re going to work on
them. Data Science involves data and some signs.
It is a process, not an event. It is the process of using data to understand
too many different things, to understand the world. Let Suppose when you
have a model or proposed explanation of a problem, and you try to validate
that proposed explanation or model with your data.
What is Data science?
Data Science is an interdisciplinary field that focuses on extracting
knowledge from data sets which are typically huge in amount. The field
encompasses analysis, preparing data for analysis, and presenting
findings to inform high-level decisions in an organization. It is a field
containing many elements like mathematics, statistics, computer science,
information visualization, graphics, business etc. Those who are good at these
respective fields with enough knowledge of the domain in which you are
willing to work can call themselves as Data Scientist. It’s not an easy thing
to do but not impossible too. You need to start from data, it’s visualization,
programming, formulation, development, and deployment of your model. In
the future, there will be great hype for data scientist jobs. Taking in that
mind, be ready to prepare yourself to fit in this world.
Applications of Data Science:

Following are some of the applications that makes use of Data Science for it’s
services:
• Internet Search Results (Google)
• Recommendation Engine (Spotify)
• Intelligent Digital Assistants (Google Assistant)
• Autonomous Driving Vehicle (Waymo)
• Spam Filter (Gmail)
• Abusive Content and Hate Speech Filter (Facebook)
• Robotics (Boston Dynamics)
• Automatic Piracy Detection (YouTube)

Various Application of data science

Following are some of the applications that makes use of Data Science
for it’s services:
1. In Search Engines
The most useful application of Data Science is Search Engines. As we
know when we want to search for something on the internet, we mostly used
Search engines like Google, Yahoo, Safari, Firefox, etc. So Data Science is
used to get Searches faster.
For example, when we search something suppose “python courses” then
at the time on the internet explorer we get first link of most visited website.
So this analysis is done using data science and we get topmost visited links.
2. In Transport
Data Science also entered into the Transport field like Driverless Cars.
With the help of Driverless Cars, it is easy to reduce the number of
Accidents.
For Example, In Driverless Cars the training data is fed into the
algorithm and with the help of Data Science techniques, the Data is
analyzed like what is the speed limit in Highway, Busy Streets, Narrow
Roads, etc. And how to handle different situations while driving etc.

3. In Finance
 Data Science plays a key role in Financial Industries. Financial
Industries always have an issue of fraud and risk of losses. Thus,
Financial Industries needs to automate risk of loss analysis in order to
carry out strategic decisions for the company. Also, Financial Industries
uses Data Science Analytics tools in order to predict the future. It allows the
companies to predict customer lifetime value and their stock market moves.
For Example, In Stock Market, Data Science is the main part. In the
Stock Market, Data Science is used to examine past behavior with past data
and their goal is to examine the future outcome. Data is analyzed in such a
way that it makes it possible to predict future stock prices over a set
timetable.

4. In E-Commerce
E-Commerce Websites like Amazon, Flipkart, etc. uses data Science
to make a better user experience with personalized recommendations.
For Example, When we search for something on the E-commerce
websites we get suggestions similar to choices according to our past data
and also we get recommendations according to most buy the product, most
rated, most searched, etc. This is all done with the help of Data Science.
5. In Health Care
In the Healthcare Industry data science act as a boon. Data Science is used
for:
• Detecting Tumor.
• Drug discoveries.

• Medical Image Analysis.

• Virtual Medical Bots.

• Genetics and Genomics.

• Predictive Modeling for Diagnosis etc.

6. Image Recognition
Currently, Data Science is also used in Image Recognition.
For Example, When we upload our image with our friend on Facebook,
Facebook gives suggestions Tagging who is in the picture. This is done with
the help of machine learning and Data Science. When an Image is
Recognized, the data analysis is done on one’s Facebook friends and after
analysis, if the faces which are present in the picture matched with someone
else profile then Facebook suggests us auto-tagging.

7. Targeting Recommendation
Targeting Recommendation is the most important application of
Data Science. Whatever the user searches on the Internet, he/she will see
numerous posts everywhere. This can be explained properly with an example:
Suppose I want a mobile phone, so I just Google search it and after that, I
changed my mind to buy offline. Data Science helps those companies who
are paying for Advertisements for their mobile. So everywhere on the
internet in the social media, in the websites, in the apps everywhere I will see
the recommendation of that mobile phone which I searched for. So this will
force me to buy online.
8. Data Science in Gaming
In most of the games where a user will play with an opponent i.e. a
Computer Opponent, data science concepts are used with machine learning
where with the help of past data the Computer will improve its performance.
There are many games like Chess, EA Sports, etc. will use Data Science
concepts.
9. Autocomplete
AutoComplete feature is an important part of Data Science where the
user will get the facility to just type a few letters or words, and he will get
the feature of auto-completing the line.
For example, In Google Mail, when we are writing formal mail to
someone so at that time data science concept of Autocomplete feature is used
where he/she is an efficient choice to auto-complete the whole line. Also in
Search Engines in social media, in various apps, AutoComplete feature is
widely used.

Importance of Data science in future

Programming paradigm & algorithms, data structure
Programming paradigm
Paradigm can also be termed as method to solve some problem or do
some task. Programming paradigm is an approach to solve problem using
some programming language or also we can say it is a method to solve a
problem using tools and techniques that are available to us following some
approach. There are lots for programming language that are known but all of
them need to follow some strategy when they are implemented and this
methodology/strategy is paradigms. Apart from varieties of programming
language there are lots of paradigms to fulfill each and every demand.
Algorithm
The word Algorithm means ” A set of rules to be followed in calculations or other
problem-solving operations ” Or ” A procedure for solving a mathematical
problem in a finite number of steps that frequently by recursive operations “.
Therefore Algorithm refers to a sequence of finite steps to solve a particular
problem.
Types of Algorithms:
There are several types of algorithms available. Some important algorithms
are:
1. Brute Force Algorithm: It is the simplest approach for a problem. A brute
force algorithm is the first approach that comes to finding when we see a
problem.
2. Recursive Algorithm: A recursive algorithm is based on recursion. In this
case, a problem is broken into several sub-parts and called the same function
again and again.
3. Backtracking Algorithm: The backtracking algorithm basically builds the
solution by searching among all possible solutions. Using this algorithm, we
keep on building the solution following criteria. Whenever a solution fails we
trace back to the failure point and build on the next solution and continue this
process till we find the solution or all possible solutions are looked after.
4. Searching Algorithm: Searching algorithms are the ones that are used for
searching elements or groups of elements from a particular data structure.
They can be of different types based on their approach or the data structure in
which the element should be found.
5. Sorting Algorithm: Sorting is arranging a group of data in a particular
manner according to the requirement. The algorithms which help in
performing this function are called sorting algorithms. Generally sorting
algorithms are used to sort groups of data in an increasing or decreasing
manner.
6. Hashing Algorithm: Hashing algorithms work similarly to the searching
algorithm. But they contain an index with a key ID. In hashing, a key is
assigned to specific data.
. Divide and Conquer Algorithm: This algorithm breaks a problem into sub-
problems, solves a single sub-problem and merges the solutions together to get
the final solution. It consists of the following three steps:
• Divide

• Solve

• Combine

8. Greedy Algorithm: In this type of algorithm the solution is built part by

part. The solution of the next part is built based on the immediate benefit of the
next part. The one solution giving the most benefit will be chosen as the
solution for the next part.
9. Dynamic Programming Algorithm: This algorithm uses the concept of
using the already found solution to avoid repetitive calculation of the same
part of the problem. It divides the problem into smaller overlapping subproblems
and solves them.
10. Randomized Algorithm: In the randomized algorithm we use a random
number so it gives immediate benefit. The random number helps in deciding
the expected outcome.

Data structure
A data structure is a storage that is used to store and organize data. It is a way
of arranging data on a computer so that it can be accessed and updated
efficiently.
A data structure is not only used for organizing the data. It is also used for
processing, retrieving, and storing data. There are different basic and advanced
types of data structures that are used in almost every program or software
system that has been developed. So we must have good knowledge about data
structures.
• Linear data structure: Data structure in which data elements are
arranged sequentially or linearly, where each element is attached to its
previous and next adjacent elements, is called a linear data structure.
Examples of linear data structures are array, stack, queue, linked list,
etc.
• Static data structure: Static data structure has a fixed memory size.
It is easier to access the elements in a static data structure.
An example of this data structure is an array.
• Dynamic data structure: In dynamic data structure, the size is not
fixed. It can be randomly updated during the runtime which may be
considered efficient concerning the memory (space) complexity of the
code.
Examples of this data structure are queue, stack, etc.
• Non-linear data structure: Data structures where data elements are not
placed sequentially or linearly are called non-linear data structures. In a
non-linear data structure, we can’t traverse all the elements in a single
run only.
Examples of non-linear data structures are trees and graphs.