Professional Documents
Culture Documents
Why Is Big Data Processing Different?
Why Is Big Data Processing Different?
Processing Different?
After this video you will be able to..
• Summarize the requirements of programming
models for big data and why you should care
about them
Batch
Processing
Scalability
Complexity
Network
Data-parallel
Rack
scalability
Data
1 2 3 4 5
Compute
2 5
Rack
1
3 4
Programming Model = abstractions
Runtime Libraries Programming Languages
Data
1 2 3 4 5
Compute
2 5
Rack
1
3 4
Requirements for Big Data Systems
1. Support Big Data Operations
Data 3
1 2 3 4 5
Compute
3
2 5
Rack
Rack
1
3 4 3
4. Optimized and extensible
for many data types
Document Table
Graph
Key-value
Multimedia Stream
5. Enable both streaming
and batch processing
Accurate processing
of all available data
Volume Scalable batch
processing