BasicConcepts

Prof.AnanthanarayanaV.S.
Dept.ofInformationTechnology
N.I.T.K.,Surathkal
 ObjectivesofThisModule
ThismodulegivesevolutionofDistributed
ComputingSystems(DCS)fromhardwareand
softwareinfrastructurepointofview.
Thismodulealsodiscusseswhatarethe
designgoals,transparenciesandfundamental
issuesinDCS
ComparisonofvariousOperatingSystems
fromhistoricalpointofviewisdiscussed
 RoadMap
GenericComponent(H/W)ofDistributed
ComputingSystem:
Computersystem
Networking

Evolutionofoperatingsystems

Introductiontodistributedcomputingsystems
(DCS)
 GenericComponents(H/W)ofaDCS
(1)ComputerSystem
CISC
Complexinstructionsetcomputer
Asingleinstructionperformsmultipleactions(hencecomplexin
operation)
Ex:VAX,IntelX86,IBM360/370
RISC
Reducedinstructionsetcomputer
Eachinstructionperformsonlyasimpleoperation
Ex:MIPS,DECAlpha,SUNSparc,IBM801
MultiCore
Moreprocessorsonchip,somultipleinstructionscanrunatthesame
time
IntelCoreDuo,Inteli3,i5,i7,AMDPhenom IIX4
 FlynnsClassificationofComputer
System
SISD(SingleInstructionSingleData)
Generalpurposecomputer
Main
CU PU MM Memory
IS DS
IS IS Instructionstream
DS Datastream
SIMD(SingleInstructionMultipleData)
Vectorprocessingcomputer
Processing
PU1 DS1 Unit
CU IS Main
Memory
ControlUnit DSn
PUn
 FlynnsClassificationContd
MISD(Multiple InstructionSingle Data)

IS1 DS IS1
CU1 PU1
MainMemory
ISn
CUn PUn
DS ISn
 FlynnsClassificationContd
MIMD(MultipleInstructionMultipleData)
MultiProcessorwithsharedMemory

IS1 DS1 IS1

CU1 PU1
MainMemory
ISn
CUn PUn
DSn ISn
 MIMD(MultipleInstructionMultipleData)
MultiProcessorwithnonsharedmemory
Communicationisbypassingmessagesbetweenthemvianetwork

CU1 PU1 MM1

Computer
NETWORK CU2 PU2 MM2 Systems

CUn PUn MMn
 GenericComponents(H/W)ofaDCS
(2)Networking
Interconnectedheterogeneouscomputer
systemwhichcanexchangeinformation.
LAN:connectscomputersatsinglelocation
andnormallyownedbysingleorganization.
INTERNET: aworldwidecollectionof
thousandsofinterconnectedcomputersand
nooneownit.
DCSisnetworkedcomputersproviding
singlecomputerviewtotheuser.
 EvolutionofModernOS
FirstgenerationOS
System:
CentralizedOS
Characteristics:
ProcessManagement
MemoryManagement
I/OManagement
FileManagement.
Goals:
ResourceManagement
 CentralizedOS

M F1
T1 P1

P2
F2
P3

T2 P4 D1 D3
D2

Managementofprocesses,P1,P2,P3,P4
T3 Managementofmemory,M
Managementofdisks,D1,D2,D3
CentralizedOS Managementoffiles,F1,F2
Managementofterminals,T1,T2,T3
 EvolutionofModernOS
SecondgenerationOS
System:
NetworkOS
Characteristics:
Remoteaccess
Informationexchange
Networkbrowsing
Goals:
Interoperability sharingofresourcesbetweenthe
systems.
 NetworkOS(NOS)
T1 T2
S3
T1$>loginT1@S2 T4
T1$>passwd:*******
S1 T1$>MATLAB

Network
NetworkOS
T3

S4

MATLAB
S2
T1
Accessingofremoteservers,remotehighspeedprintersovernetwork
 EvolutionofModernOS
ThirdgenerationOS
System:
DistributedOS
Characteristics:
Globalviewofcomputationalpower,filesystems,name
space,etc.
Goals:
Singlecomputerviewofmultipleheterogeneous
computersystems
 Distributed OS(DOS)
T1

MATLAB
T4

S3
S1

Network

DistributedOS
S2 S4
T2

T2$>MATLAB

T3
Singlecomputerviewofmultipleheterogeneouscomputersystems
DifferencesbetweenNOSandDOS
NOS DOS
User need to login
explicitly to access the
remote resources
User need to know
whereabouts of the
resources
No implicit sharing of
loads
Full local autonomy at
each system
No explicit login to the
system to access any
resources
Gives the illusion of
having all the resources
locally available
Sharing of loads
between nodes (load
balancing)
Availability & Reliability
is more
 EvolutionofModernOS
FourthgenerationOS
System:
Cooperativeautonomoussystem CAS
Characteristic:
Cooperativedistributedapplications
Goals:
Cooperativework
DifferencesbetweenDOSandCAS

DOS CAS
Top down design Design approach is
approach bottom up
Top level services are Existing services are
specified. It is then integrated in possible
decomposed and way to form new
implemented as low services.
level services. Objective here is to
No legacy system is develop the distributed
involved. system involving legacy
system
 DistributedComputingSystem

Multiprocessorsystem

Processorsaregeographicallyapart

Communicationisbymessagepassing

Coordinationamongtheprocessorsto
performthespecifictask.
 AdvantagesofDCSoverCentralized
System
Speed:100CPUswillhave100timesthespeedofsingleprocessorideally.

Inherentdistributionofapplications:Someapplicationsareinherently
distributed.

Forexample,abankmayhavemanybrancheswiththecomputingsystems
distributedacrossthegeographicalregiontocaterthelocalneed.However,
theyneedtocoordinateforglobalneedlikeaccountingacrossthebanks.
Robustness:Itisviewedwithfollowingmetrics:

Availability:Probabilitythatsystemisupatanygiventimeinterval.
Reliability:Probabilitythatsystemisupatanypointoftime.
BothAvailabilityandReliabilityarehighinDCS

Incrementalgrowth:Incrementallyaddingofresourceswillbegradually
visualizedperformancewise.
DisadvantagesofDCSoverCentralized
System
Software:
Wouldbecomplex
Networkproblem:
Networksaturation
Malfunctioningofnetwork
Security:
Possibilityofsecurityviolationsincetheprivate
dataarevisibletoothersoverthenetwork.
 DesignGoalsofDCS
Efficiency:
Bottleneck:Communicationdelay,loadbalancing,numberof
messagesfordistributedalgorithms
Flexibility:
Thisreferstothefriendlinessofthesystem.Fromthesystems
pointofview,itincludesmodularity,scalability,portabilityand
interoperability.
Consistency:
Computationshouldgivecorrectresultsirrespectiveoftimeat
whichthecomputationisdoneforthesameinputconditions.
Robustness:
Thesystemshouldperformeffectivelyandconsistentlyinspite
offailuresandattemptedsecurityviolations.
 DesignGoalsofDCS
Scalability:
Thisreferstotheissuethatthegrowthofthesystem
shouldnotresultindegradedperformanceor
unavailability.
Scalableresourcesare bandwidth,storage,processing
poweretc.
Compatibility:Threelevelsofcompatibilityarepossible
Binarylevel:samebinarycodecanbeexecutedatall
nodes.
Executionlevel:samesourcecodecanbecompiledand
linked,andexecutedonanysystem
Protocollevel:Itachievesinteroperabilitybyacquiring
systemcomponentstosupportcommonsetofprotocol.
 TransparenciesinDCS
Accesstransparency:
Localandremoteobjectsshouldbeaccessedinauniformway.Usershouldnotfindany
differenceinaccessinglocalandremoteobjects.

Locationtransparency:
Objectsarereferredbylogicalnameswhichhidethephysicallocationoftheobjects.For
example,anetworkprinterconnectedtoaserverS1 onLANL1isreferredbythename
associatedwiththatprinterandtheexactlocationoftheprinterisinvisibletotheuser.

Migrationtransparency:
Movementofobject(migration)fromonesystemtootherisinvisibletouser.Loadbalancing
isoneamongmanyreasonformigrationofobjects.

Concurrencytransparency:
Sharingofobjectswithoutinterference.Thesamedatamaybereferredbydifferent
applications.Performingofconcurrencycontroltoensuretheconsistencyofdatashouldbe
invisibletotheuser.
 TransparenciesinDCS
Replicationtransparency:
Replicaoffilesanddataaretransparenttotheuser.Oneofthereason
forreplicationistoensurerobustnessdesigngoal.
Parallelismtransparency:
Ausertaskmaybescheduledforexecutionatdifferentnode/system
whichisinvisibletotheuser.Thereasonforschedulingdifferentnode
istoensureefficiencydesigngoal.
Failuretransparency:
Gracefuldegradationintheperformancewhenevertherearesystem
failures.
Sizetransparency:
Addition/deletionofresourcesshouldnoteffecttheexecutionoftask.
Revisiontransparency:
Softwarerevisionsinthesystemarenotvisibletotheuser.
 RelationshipbetweenDesignGoals
andTransparencies
DesignGoals Transparencies
Efficiency

Concurrency
Parallelism

Access
Location
Flexibility

Migration
Size
Revision

Access
Consistency

Replication
Performance

Failure
Replication
Robustness

Size
Revision
 FundamentalIssuesinDCS
Globalstatedetection
ItisimpossibletogettheglobaluptodateinformationaboutDCSdue
to
Lackofglobalmemory
Lackofglobalclock
Unpredictablemessagedelays
GlobalstateofDCSisimportantfortheconsistencycheck
Orderingofevents
Duetolackofglobalclock,orderingofeventsacrossthesystemsin
DCSisanissue
Naming
Aserverneedstobeidentifiedinordertouseitsservice.
Aservercanbeidentifiedusingname,physicaladdressoritsservice.
Tohandlethetransparencyissuesneedtomapthephysicalnameto
thelogicalname.
 FundamentalIssuesinDCS
Interprocesscommunication
Messagepassingcommunication
Request replycommunication
Transactioncommunication
Groupcommunication
Interprocesssynchronization
Distributedmutualexclusion
Leaderelection
Agreementproblems
Resourcemanagement
Datamigration
Distributedfilesystem
Distributedsharedmemory
Computationmigration
Distributedscheduling
RemoteProcedureCall
 FundamentalIssuesinDCS
Faulttolerance
Atomicexecutionoftransactions
Replicationmanagement
Checkpointingandrecovery
Security
Secrecyofdata(Cryptography):Unauthorizedaccess
prevention
Authentication:Whoareyou?
Verificationofsender(Digitalsignature):Message
sentbyXhasreallybeensentbyX.
 Summary
Definition,BasicsofDistributedComputingis
discussed.
DifferencesbetweenDistributedOSand
NetworkOSisoutlined.
Requirementsintermsofdesigngoals,
transparenciesandfundamentalissuesina
DistributedComputingSystemisdiscussed.
 References
AdvancedOperatingSystems
MSinghal andNGShivarathri,McGrawHill,International

DistributedOperatingSystemsandAlgorithms
RandyChawandTJohnson,AddisonWesley

DistributedOperatingSystems
ASTanenbaum,PrenticeHall

DistributedAlgorithms
NancyALynch,MorganKaufman

DistributedSystemsConceptsandDesign
GCoulouris andJDollimore,AddisonWesley