BG Dta

You might also like

Download as pptx, pdf, or txt
Download as pptx, pdf, or txt
You are on page 1of 30

AGENDA

1. Evolution of data
2. What is big data
3. Big data as an opportunity
4. Problems in encasing opportunity
5. Hadoop as a solution
6. Hadoop ecosystem
1. Evolution of data

Evolution of
Technology

IOT

Social Media
Big Data
Data Evolved to
Evolution of data

Evolution of
Technology

IOT

Social Media
Big Data
Data Evolved to
Evolution of data

Evolution of
Technology

IOT

Social Media
Big Data
Data Evolved to
Evolution of data

Evolution of
Technology

IOT

Social Media
Big Data
Data Evolved to
Big data is the term for collection of datasets so large and complex that it
becomes difficult to process using on-hand database system tools or traditional
data processing applications
2. What is big data ?
Volume
Variety
Velocity
Value
Veracity
Big data as an
opportunity
Other opportunities Other opportunities
Problems
with big data
• Data generated in past 2 years is more
Storing than the previous history in total
exponentially • By 2020, total digital data will grow to
44 Zettabytes approximately
growing huge • By 2020, about 1.7 MB of new info will
datasets be created every second for every
person
Processing data having complex
structure
Processing data faster
Hadoop is a framework that allows us to store and process large datasets
in parallel and distributed fashion
Hadoop has two components

•Name Node: that contains


metadata about data stored.

•Datanodes: Data is stored on


datanodes which are
commodity hardware in the
distributed environment.
Solution for Storing
Data

• It is a Distributed File
System
• Divides files (input data)
into smaller chunks and
stores it across the cluster
• Scalable as per requirement
Store different kinds
of data

• Allows to store any kind of


data
• Follows (Write once read
many)
•Hadoop MapReduce:
Processing data faster • Provides parallel processing of data present in HDFS
• Each node works with a part of data stored on it
Hadoop Ecosystem
Thankyou!

You might also like