Module 1 (III)
Module 1 (III)
Virtualization
Virtualization
23
Big Data Definition
No single standard definition…
“Big Data” is data whose scale, diversity, and
complexity require new architecture, techniques,
algorithms, and analytics to manage it and
extract value and hidden knowledge from it…
Or
Big data is the term for collection of data sets so
large and complex that it becomes difficult to
process using on-hand database system tools or
traditional data processing applications
24
Characteristics of Big Data:
1-Scale (Volume)
Data Volume
44x increase from 2009 2020
From 0.8 zettabytes to 35zb
Data volume is increasing exponentially
Exponential increase in
collected/generated data
26
Volume
Challenges in Handling Big Data
29
Variety
Characteristics of Big Data:
3-Speed (Velocity)
33
Value
Some Make it 5V’s
35
Veracity
Big Data as an Opportunity
Who’s Generating Big Data
Mobile devices
(tracking all objects all the time
38
The Model Has Changed…
d Model: Few companies are generating data, all others are consuming data
39
Solution to Electric Grids
Solution
HDFS
Storing Solution
How to process our data @faster
rate
Answer : Sending Process to Data