Big Data Applications & Analytics - Chapter - 2c PDF

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 34

@natishalom

About GigaSpaces

2
Big Data In The Cloud
2.7 ZB
Global Digital Data

0.5
Petabytes
43% think that data

analytics could be improved in their


Two years tweets
organization if data analytics was part of

cloud services
66% Will or plan to use Big
Data in the cloud

3
Large ISV Case Study
• Application
– Call Center surveillance
• Background
– Previously – voice data
• Goal for a new system
– Monitor data & voice
– Multiple data sources
– Advanced correlations
Ever Growing Data

Deeper Correlation

Tight Performance
A Classic Case for..
A Typical Big Data System…
Business
Cost
Impact
Big Data
in the Cloud
Big Data in the Cloud- 3 Reasons
• Skills
– Do you really need/want this all in-
house?
• Huge amounts of external data.
Holger Kisker – Does it make sense to move and
manage all this data behind your
firewall?
• Focus on the value of your data
– Instead of big data management.
• Auto start VMs
• Install and configure
app components
• Monitor
• Repair
• (Auto) Scale
• Burst…
Running Bare-Metal for
high I/O workloads, Public
cloud for sporadic
workloads ..
• Consistent
Management
• Automation Through
the Entire Stack
http://code.zynga.com/2012/02/the-evolution-of-zcloud/
http://code.mixpanel.com/2010/11/08/amazon-vs-rackspace/
Realization:
What You
Really Care
about Is
App
Portability
Consistent Management
Recipes consistent description for running any app:
▪ What middleware services to run
▪ Dependencies between services
▪ How to install services
▪ Where application and service binaries are
▪ When to spawn or terminate instances
▪ How to monitor each of the services.

® Copyright 2012 GigaSpaces Ltd. All Rights


25
Reserved
Choosing the Right Cloud for the Job
compute {
template "SMALL_LINUX"
}

SMALL_LINUX : template{ SMALL_LINUX : template


imageId "1234" imageId "us-east-1/ami-76f0061f“
machineMemoryMB 3200 remoteDirectory "/home/ec2-user/gs-files“
hardwareId "103" machineMemoryMB 1600
remoteDirectory "/root/gs-files" hardwareId "m1.small"
localDirectory "upload" locationId "us-east-1"
keyFile "gigaPGHP.pem" localDirectory "upload"
options ([ keyFile "myKeyFile.pem"
"openstack.securityGroup" : "default",
"openstack.keyPair" : "gigaPGHP" options ([
]) "securityGroups" : ["default"]as
privileged true String[],
} "keyPair" : "myKeyFile"
])
overrides (["jclouds.ec2.ami-query":"",
"jclouds.ec2.cc-ami-query":""])
privileged true
}

® Copyright 2012 GigaSpaces Ltd. All Rights


27
Reserved
Automation across the stack
1 Upload your recipe.

2 Cloudify creates VM’s & installs agents

3 Agents install and manage your app

4 Cloudify automate the scaling


Demo Time..
Try a simple demo yourself

launch.cloudifysource.org/d
Large ISV Case Study
• Application
– Call Center surveillance system
• Background
– Previously – voice data
• Goal for a new system
✓Monitor data & voice
✓Multiple data sources
✓Advanced correlations Mission
Accomplished
Additional Benefits
• True Cloud Economics

• One product -> any


Customer Environment

• Increased Agility
http://www.cloudifysource.org
http://github.com/CloudifySource

You might also like