BIG DATA

Made by :
Harshita Salian 17038
Syed Khadija Rizvi 17049
Sayyed Alfiya 17041
Rahul Masam 17028
Deepak Pal 17033
 Introduction
• Big data is a collection of data sets so large and complex that it
becomes difficult to process using on-hand database management
tools or traditional data processing applications.
• The challenges include capture, curation, storage, search, sharing,
transfer, analysis, and visualization.
• Any amount of data that’s too big to be handled by one computer.
• Big data is a popular term used to describe the exponential growth,
availability and use of information, both structured and unstructured.
 What is Big Data?
• We are starting to hear a lot of discussion about Big Data. But what
does that really mean? The truth is that it is hard to comprehend,
really.
• It all starts with the explosion in the amount of data we have
generated since the dawn of the digital age.
• This is largely due to the rise of computers, the Internet and
technology capable of capturing data from the world we live in. Data
in itself isn’t a new invention.
• Going back even before computers and databases, we had paper
transaction records, customer records and archive files – all of which
are data.
 Characteristics Of 'Big Data’ The 4 v’s
(i) Volume – The name 'Big Data' itself is related to a size which is enormous. Size of data plays very
crucial role in determining value out of data .
Whether a particular data can actually be considered as a Big Data or not, is dependent upon volume of
data. In simple words, volume is the dimensions of big data related to it’s size and it’s exponential
growth.
(ii) Variety –Variety refers to heterogeneous sources and the nature of data, both structured and
unstructured. During earlier days, spreadsheets and databases were the only sources of data
considered . Nowadays, data in the form of emails, photos, videos, PDFs, audio, etc. is also being
considered in the analysis applications.
Structured data is that which can be organized neatly within the columns of a database. This type of
data is relatively easy to enter, store, and analyze. Unstructured data is more difficult to sort and
extract value from. The variety of unstructured data poses certain issues for storage and analyzing data.
(iii) Velocity – The term 'velocity' refers to the speed of generation of data. How fast the data is
generated and processed to meet the demands, determines real potential in the data. Big Data Velocity
deals with the speed at which data flows in from sources like business processes, networks and social
media sites, Mobile devices, etc. The flow of data is massive and continuous. The challenge for data
scientists is to find ways to collect, process, and make use of huge amounts of data as it comes in.
(iv) Veracity: It refers to the biases, noises and abnormality in data. This is where we need to be able to
identify the relevance of data and ensure data cleansing is done to only store valuable data. Verify that
the data is suitable for its intended purpose and usable within the analytic model. The data is to be
tested against a set of defined criteria.
 How big data works?
• Big data gives you new insights that open up new opportunities and business models.
Getting started involves three key actions:
• Integrate
Big data brings together data from many sources and applications. Traditional data integration
mechanisms, such as ETL (extract, transform, and load) generally aren’t up to the task. It
requires new strategies and technologies to analyze big data sets at terabyte, or even
petabyte, scale. During integration, you need to bring in the data, process it, and make sure it’s
formatted and available in a form that your business analysts can get started with.
• Manage
Big data requires storage. Your storage solution can be in the cloud, on premises, or both. You
can store your data in any form you want and bring your desired processing requirements and
necessary process engines to those data sets on an on-demand basis. Many people choose
their storage solution according to where their data is currently residing. The cloud is gradually
gaining popularity because it supports your current compute requirements and enables you to
spin up resources as needed.
• Analyze
Your investment in big data pays off when you analyze and act on your data. Get new clarity
with a visual analysis of your varied data sets. Explore the data further to make new
discoveries. Share your findings with others. Build data models with machine learning and
artificial intelligence. Put your data to work.
 Big Data – The Opportunity is Now
• In the past, technology platforms were built to address either
structured OR unstructured data.
• Today’s organizations, however, are utilizing, sharing and storing more
information in varying formats, including:
 e-mail and Instant Messaging.
Collaborative Intranets and Extranets
Public websites, wikis, and blogs
Social media channels
Video and audio files
 Who are the ones who use the Big Data
Technology?
• Banking
Large amounts of data streaming in from countless sources, banks
have to find out unique and innovative ways to manage big data.
It’s important to analyze customers needs and provide them service as
per their requirements, and minimize risk and fraud while maintaining
regulatory compliance.
• Government
When government agencies are harnessing and applying analytics to their
big data, they have improvised a lot in terms of managing utilities, running
agencies, dealing with traffic congestion or preventing the affects crime.
• Education
Educator regarding Big Data provides a significant impact on school systems,
students and curriculums.
By analyzing big data, they can identify at-risk students, ensuring student’s
progress, and can implement an improvised system for evaluation and support of
teachers and principals in their teachings.
• Health Care
When it comes to health care in terms of Patient records. Treatment plans.
Prescription information etc.
Everything needs to be done quickly and accurately and some aspects enough
transparency to satisfy stringent industry regulations.
Effective management results in good health care to uncover hidden insights
that improve patient care.
 Impact on I.T. industry
• Big Data is a buzzword amongst businessmen nowadays. Regardless of
industry or company size, it manages to squeeze into every nook and
cranny.
• There are at least three ways that Big Data has been impacting companies
that everyone should understand moving forward.
• It has revolutionized old-school industries.
• Big Data has had a tremendous impact on businesses from customer
relations to supply chain operations and will continue to do so” says Edwin
Miller, CEO of 9Lenses.
• While many may not be aware of it, Big Data has indeed made a significant
impact on many traditional businesses.
• It has given birth to a new industry.
• Historically, data was used as an ancillary to core business and was
gathered for specific purposes. Retailers recorded sales for
accounting.
• It improves business regardless of company size.
• It is obvious that big companies have advantages over smaller ones.
By the word “big”, I mean companies that generate an enormous
amount of data.
 Future of big data
• $15 billion on software firms only specialising in data
• management and analytics.this industry on its own is worth more
than $100 billion and growing at almost 10% a year which is roughly
twice as fast as the software business as a whole.
• In february 2012, the open source analyst firm wikibon realise the
first market forecast for big data , listing $5.1 billion revenue in 2012
with growth to $53.4 billion in 2017
• The Mckinsey global institute estimate the data volume is growing 4%
per year, and will grow 44 x between 2019 and 2020.
THANK YOU