A liieiaiuie ieview A liieiaiuie ieview

Guimeei Singl
Supeivisoi: Di. Digania Goswami
}an:oio-Apiil:oio
Cloud CompuLlng
Inieinei based compuiing.
On demand iesouices.
Use of coie disiiibuied sysiems ieclniques.
Omnipiesence of Cloud Compuiing applicaiions: Omnipiesence of Cloud Compuiing applicaiions:
Google Docs, Google Apps
Windows Azuie, MS SQL Azuie
Geneial Issues
Scalabiliiy
Reliabiliiy, availabiliiy
Piovisioning, paiallelizaiion
i:i6:: AM :
Cloud CompuLlng Servlces
Infiasiiuciuie as a Seivice
Eucalypius
Plaifoim as a Seivice
Amazon Web Seivices Amazon Web Seivices
Sofiwaie as a Seivice
Google Apps
Business Piocess as a Seivice
Sofiwaie Tesiing
i:i6:: AM
LucalypLus
Reseaicl puiposes
Linux maclines
Seivei faims
Modulai design Modulai design
Sioiage and Compuiaiional Infiasiiuciuie
Focus
Viiiual Macline insiances piovisioning
VM scleduling
Daia Sioiage
Neiwoil beiween nodes
i:i6:: AM (
ueslgn of LucalypLus
Cloud Coniiollei and
Walius
Public Neiwoil
Clusiei
Coniiollei
Piivaie
Neiwoil
Node
Coniiollei
Node
Coniiollei
Node
Coniiollei
Clusiei
Coniiollei
Piivaie
Neiwoil
Node
Coniiollei
Node
Coniiollei
Node
Coniiollei
i:i6:: AM
ueslgn of LucalypLus
Viiiual Oveilay Neiwoil
Tliee modes
VM insiance connecied io sofiwaie Eileinei biidge
Admin landles DHCP iequesis as if no Eucalypius Admin landles DHCP iequesis as if no Eucalypius
VM insiance is assigned siaiic MAC and IP addiess
VM insiance ieiminaied: addiess iuple is ieleased
VMs aiiacled by useis io a "Neiwoil"
Unique VLAN iag
VM insiance isolaiion
Usei defined ingiess iules
CC as iouiei
i:i6:: AM 6
lssues Addressed
Use of Laboiaioiy laidwaie
Conneciiviiy
To VM insiances, public Inieinei
Secuiiiy Secuiiiy
Isolaiion of VM insiances
Peifoimance
No iniei-VM isolaiion: neai naiive peifoimance
VM isolaiion: one exiia lop
i:i6:: AM y
Cngolng 8esearch
Neiwoil oveilead
Fiequeni access io daia cenieis
Resouice piovisioning
Smaii Scleduling Smaii Scleduling
Addiess Coniiollei
Usage Regisiei
Receni Index
i:i6:: AM S
Servlce CrlenLed ArchlLecLure
Focus
Componeniizaiion
Reusabiliiy
Exiensibiliiy
i:i6:: AM q
Exiensibiliiy
Flexibiliiy
Cloud Compuiing Open Aicliieciuie objeciives:
Scalable and configuiable plaifoim
Slaied seivices foi business clouds
Maximize poieniial business value
CCCA ArchlLecLure
i. Iniegiaied ecosysiem managemeni
i:i6:: AM io
CCCA ArchlLecLure
:. Viiiualizaiion of infiasiiuciuie
i:i6:: AM ii
CCCA ArchlLecLure
. Seivice oiieniaiion
i:i6:: AM i:
CCCA ArchlLecLure
(. Exiensible piovisioning and subsciipiion
i:i6:: AM i
CCCA ArchlLecLure
. Configuiable offeiings
i:i6:: AM i(
CCCA ArchlLecLure
6. Unified infoimaiion exclange
i:i6:: AM i
CCCA ArchlLecLure
y. Cloud qualiiy and goveinance
i:i6:: AM i6
Peifoimance model
LQM peifoimance paiameieis
Exieinal seivices
CPU demands of eniiies
erformance Model, CoS, CpLlmlzaLlon
CPU demands of eniiies
Requesis wiilin eniiies
Piedici decision vaiiables
Tliouglpui
Delay, queuing and seivice
Resouice uiilizaiion
i:i6:: AM iy
Qualiiy of Seivice
As a consiiaini on iesouice opiimizaiion
Cusiomei seivice classes
Seivice class c
erformance Model, CoS, CpLlmlzaLlon
Seivice class c
Piice P
c
Useis N
c
Tlinl iime Z
c
Max iesponse iime R
c, max
Tliouglpui f
c
> f
c, min
= N
c
] (R
c max
+ Z
c
)
i:i6:: AM iS
Opiimizaiion
Neiwoil Flow Model
Usei class c pays piice P
c
pei iesponse
Hosi l las cosi of C
l
pei sec
erformance Model, CoS, CpLlmlzaLlon
Hosi l las cosi of C
l
pei sec
Tasl i las ieseivaiion o
li
Foi an applicaiion, Piofi = _ P
c
f
c
- _ C
l
o
li
Cloud Vendoi Piofi = _ Piofi pei app
i:i6:: AM iq
Coogle llle SysLem
Scalable disiiibuied file sysiem
Google's obseivaiions
Componeni failuie
Huge file sizes Huge file sizes
Append daia
Resuli: GFS
Fauli ioleiance
Inexpensive laidwaie
Higl aggiegaie
Laige numbei of clienis
i:i6:: AM :o
ueslgn of ClS
Clunlseivei
Clunls
Clunls
Clunls
Clunls
Clunlseivei
Clunls
Clunls
Clunls
Clunls
Clunlseivei
Clunls
Clunls
Clunls
Clunls
Clieni
i:i6:: AM :i
ueslgn of ClS
Linux maclines
Clieni
On belalf of applicaiion
Clunlseivei Clunlseivei
Replicaiion
Infoimaiion of available clunls
Infoimaiion exclange wiil masiei
Clunlseivei siaiiup
Heaiibeai messages
i:i6:: AM ::
ueslgn of ClS
Masiei
In-memoiy meiadaia. Speed
File and clunl namespaces
File-clunl mappings File-clunl mappings
Clunl ieplica locaiion
Meiadaia log ieplicaiion. Reliabiliiy
Cleclpoinis
Daia Reads
Queiy: Clunl index and byie offsei
Response: Clunlseivei, Replica locaiion
Clieni cacled infoimaiion
Masiei noi a boiilenecl
i:i6:: AM :
lssues Addressed
No daia cacling
Clieni
Huge files, WS
Sequeniial iefeiences
No coleience issues No coleience issues
Clunlseivei
Clunls aie local files
Linux in-buili cacle
Fixed, laige clunl size (6( MB)
Moie daia ai a CS = Using same TCP conneciion
Less meiadaia
Uppei limii sei, avoids loi-spois (single CS foi file)
i:i6:: AM :(
lssues Addressed
Decoupling daia and coniiol flow
Coniiol Flow
Clieni io Piimaiy Replica
PR las lease on ile clunl PR las lease on ile clunl
PR issues command io Secondaiy Replicas io commii daia
wiiie
SR don'i waii foi PR io siaii ieceiving daia
i:i6:: AM :
lssues Addressed
Coniiol flow
Masiei
Secondaiy
CS
i:i6:: AM :6
Clieni
Secondaiy
CS
Piimaiy CS
lssues Addressed
Decoupling daia and coniiol flow
Daia Flow
Clieni sends io neaiesi ieplica
Avoid ligl laiency linls Avoid ligl laiency linls
Seiial daia iiansfei
Bandwidil uiilizaiion
Pipeline and foiwaid ile daia
i:i6:: AM :y
lssues Addressed
Daia flow
Masiei
Secondaiy
CS
i:i6:: AM :S
Clieni
Secondaiy
CS
Piimaiy CS
lssues Addressed
Aiomic Recoid Append
PR geis Append iequesi
Clecl if oveiflow? Pad zeios, Reiiy!
Reiiy Diffeieni ieplicas Reiiy Diffeieni ieplicas
Append iequiies ai leasi one copy of daia is wiiiien ai
same offsei on all ieplicas
Reiuin value io clieni = 'ile' offsei
i:i6:: AM :q
lssues Addressed
Daia Iniegiiiy. Oveicome componeni failuies!
Cleclsum compuiaiion
: bii cleclsum foi 6( KB blocls
Read veiifies cleclsums Read veiifies cleclsums
Masiei landles mismaicl
Append cleclsum opiimized
Inciemenially iecalculaie foi lasi wiiiien blocl
Calculaie foi new
Replica ieplacemeni oveilead ieduced
Wiiie veiifies foi fiisi and lasi blocl
i:i6:: AM o
lssues Addressed
Daia availabiliiy... Oveicome componeni failuies!
Fasi iecoveiy
Immediaie iesiaii and iesioie siaie
Clunl ieplicaiion acioss macline iacls Clunl ieplicaiion acioss macline iacls
Masiei ieplicaiion
Masiei siaie logs ieplicaied
Failuie New Masiei wiil DNS alias of masiei
Sladow Masieis follow masiei wiil lag
Read availabiliiy enlanced
Can iead even wlen masiei fails
i:i6:: AM i
lssues Addressed
Gaibage colleciion
File deleie lidden name
File sysiem namespace scan
Clunl namespace scan Clunl namespace scan
Non ieaclable clunls deleied
Heaiibeai messages used
Meiged wiil masiei's baclgiound aciiviiies
i:i6:: AM :
uaLa rocesslng AppllcaLlons
Piocessing and Compuiaiion on laige seis
Google's MapReduce
Simple, libiaiy based
Daia disiiibuiing Daia disiiibuiing
Paiallelizable
Fauli ioleiani
Load balancing
i:i6:: AM
Map8educe ueslgn
Map (l
i
, v
i
) lisi (l
:
, v
:
)
E.g. (fileName, conienis) lisi (woid, woidCouni)
Reduce (l
:
, lisi(v
:
)) lisi(v
:
)
E.g. (woid, lisi(couni)) lisi(couni) = one numbei! E.g. (woid, lisi(couni)) lisi(couni) = one numbei!
MapReduce libiaiy
Connecis usei defined Map and Reduce
Hides deiails of paiallelizaiion eic.
i:i6:: AM (
Map8educe LxecuLlon
i:i6:: AM
Map8educe LxecuLlon
i:i6:: AM 6
Map8educe LxecuLlon
i:i6:: AM y
Map8educe LxecuLlon
i:i6:: AM S
Map8educe LxecuLlon
i:i6:: AM q
Map8educe LxecuLlon
i:i6:: AM (o
Map8educe lssues Addressed
By MapReduce libiaiy
Fauli ioleiance
Map Woilei failuie
Re-execuie Re-execuie
In-piogiess Reduce Woilei failuie
Re-scledule
Masiei failuie
Cleclpoini
Low piobabiliiy
i:i6:: AM (i
Neiwoil bandwidil
Map wleie ieplica
Single copy of inieimediaies
Load balancing
Map8educe lssues Addressed
Load balancing
M N and R N
Spiead iasls, assign new jobs
Failed Map woilei's load disiiibuied
i:i6:: AM (:
Suiiable paiiiiioning
Foimais ouipui
Usei defined
E.g. lasl(Hosiname(URLley))mod R
Map8educe lssues Addressed
E.g. lasl(Hosiname(URLley))mod R
Combinei funciion
Single Reduce flooded
Paiiially meiging inieimediaie daia
i:i6:: AM (
Map8educe 8esearch
Used foi Daia Mining, Web Seaicl Seivice, Macline
Leaining pioblems
Buili upon Google File Sysiem
Fuiilei woil Fuiilei woil
Masiei Failuie landling algoiiilms
Load balancing meclanisms
i:i6:: AM ((
uaLa AvallablllLy based Apps
Amazon Web Seivices
Reliabiliiy ai big scale
Dynamo, Higlly Available Key-Value Sioie
Applicaiions wiil Piimaiy ley access Applicaiions wiil Piimaiy ley access
Slopping caii
Usei piefeiences
Piimaiy ley-only inieiface
No updaie iejeciion
i:i6:: AM (
uynamo ueslgn
gei(ley) and pui(ley, coniexi, objeci)
Ciiculai paiiiiioning of ley space
Viiiual nodes assigned muliiple iolens, Replicaiion
E.g. B, C, D sioie K
A
E.g. B, C, D sioie K
i:i6:: AM (6
A
l
B
C
D
E
F
G
uynamo ueslgn
Ring membeislip
Admin (dis)connecis node
Gossip based pioiocol
Failuie deieciion Failuie deieciion
'A' ilinls 'B' failed if no ieply
Send elsewleie
Reiiy 'B' peiiodically
i:i6:: AM (y
uynamo lssues Addressed
Veision Handling
Vecioi clocls
foi all objecis
Coniexi las
i:i6:: AM (S
Coniexi las
VC info
Conflici iesoluiion
Pusled io iead iequesis
Usei wiiies nevei iejecied
Logical iing paiiiiioning
uynamo lssues Addressed
Logical iing paiiiiioning
Aiiival of iwo nodes
Use SEEDS
Discoveied via exieinal meclanism
Known io all nodes
Vecioi clocl size
Use iimesiamp
i:i6:: AM (q
Peifoimance VS duiabiliiy
Higlei peifoimance buffeied wiiies
Buffei ciasl
Use 'A Duiable Wiiie'
uynamo lssues Addressed
Use 'A Duiable Wiiie'
One wiiie io file .duiabiliiy
Oileis io buffei .peifoimance
i:i6:: AM o
Amazon 8esearch
Foi ligl qualiiy usei expeiience
Amazon's Elasiic Cloud Compuie (EC:)
Auio-scaling and piovisioning
Amazon's CloudWaicl Amazon's CloudWaicl
i:i6:: AM i
Quesiions? Quesiions?