PAGE:

DATE:.

MOdute -4
data
cOpare i) Structured u Unstr uctured
|H) Data in mOton VS Dat a at Ost

Unstructre Data
Structures Data

mode)
Does not confosm tO a
Drganrzed foamatt;
Ex-Spreadshaets, Databoses Ex: TO tras, Vdeo, Speach
Qualtatue
Quanttattue
tess SHOrOe
NOt flekte
flexbe

- ID cokes foT Dtaba ses

Data warehouses, Retattona) Sata lokes,
Non- Relatt onal Dataases .
Satabace

Data at ret

Data beinq actvel Data that e sored

ttansmetBed o proaCe noi octtvely bexng proosca
8Fttc, fermans unchanged
28late Dyrame, contnuousi untl accesce or modifu,
Chorgng
Sireamung udeo, Roal Data baser, ples soed on a
Exomple tLme sensa data hardde
 requresa pssin prou
batchNaCHC dtdata (Streamtng
& motiOn
cun'
techomultpe data datna bot
Storaçe rOsin
4 colechan sOvolves
taks use îoT mang Buppoet nftasBTuckune
to data oaelemens Key
rch1hectane Kanbda Aeplain
Ples.archteucd
necords, Batabace Fxampia
nstant Rmak,
devcec
tnple Kwethaen
emanE ypucalby
rancSSLN
Pessetnt transient
Abort-lve
de
buffeae hemory
ar
eeal
retne Requres proessng
Siogcal 3 e lates
analyae procaseing
or
fL
Stored Iypicaly
mmedtals fOs Used espose
dejendetccecs-tMe ttme
real ten fast,
op
Spead
rivec d
loca)uarehouseR
OL les HransL
dB,data StiD
ored Locatto Storege
PAGE:
DATE:
 DATE: PAGE:

Stoom
stroamia
Kafka Real-+1roe
Vieu
Merged sexun?
pre- corOpute
Loye
Vleus

-Had oop
HDFSMapReduce
batch layte
Stream kaer :
This NOsponsuble f6 hear- noal- tume pro
layes proceceung g evenis
Bath layer
Sernglaues
La data store B meciator that decder ashich tngest agee o
baced on the oected narwlt ss iew no data.

plan edge strcanung analytCg 2-Aunctone dge dnalatcs

untt

Rcducng data at edge2

he aggreqate dara geLOte genasaley
deyices. he scale d thece deuices s
quantty e} data teyqeAA
 DATE:. PAGE:

edqe The
at the edqe
at data s best anal,y
The data
9ono data uceJ
upon where tt IS generated.
R Qcted
Time serstvy :
alloust tmmadicte resercer oCherqngc
cendong,
Edq: .anayttce atlout
core Punct:
Raw ts data!
This s raw data comng
from gensO io analyHes processina
ntO

&halytce prodescng unt (APU): ttme wudoue

The AfU tcas combneg data strearMS a tem b

3" utput dtreams:

The data that S VsqhttuJ &treams & is uSed to
erflu ence behaut Cn e smavt cbets passed on for. storaqe
n cloud.
Procossing¡
detou) formnal rek StructIre
5. Eplan analegie

Skp:Esob1sh

OCTAUE:

opaatona y creHea thyeat,Aet 3 utnerabl Fvatott on, has.

urdergone multtple teratt ong Inendad
The vesLOn ths Sectton oCuses on s OCTAVE
Alero, ushch
40 be a ughtweqht lesS burdensome. proasg to Lmp lemot
sepl EStablsh
SteP2: Aevelcp steP4: Jdenhy steP 6: Tdottty
info aset
ntkMeAsunemnt RisKS
Con con
Crta

Gtep 7: 4naty z0
StepB:dentty Step5: Tdenttu RSKS
LNfo asset Threa

contaners ScenaLOS Stcp 8: Mitqtion

tppDach

fsablish prOfle Aentig

Drves -ASsets Toreate tttqve RISK.

tofo-fOcusedpOCOSS.
OCave Sa balanced
fAIR Cator Analyss oF Infoxmaton RISK):
1ts a technicol stan dard tO sISK deD Arom the oPen Goup
but
t alloaf for n00- MaliciOus actons as a potenttal cause tos hQrm,

tt qoes to qroate knqtbs to emphasi20 pont

Eplaun Dtf types of, data arale necutts weth X

Hiels ycu cobat LS happenenq, ether De) e2 n past

EVey secnd you ap
Tbernontes In a ttuck ergune repozts terop ualue
Pus this data at ang moroent to uto eurent eondttcn
tfuck
enqine
Diagpstic a'uhyquastions
why tsuck eng tno faled
ine you mght uondes
7he
foled.
 DATE: PAGE:

B Psredicive:
It aimst0 foreteu probes isSues befoe OCUr
E we husrogical values o temperatres fos truck engino
predicttuo analy
coutd proud Lte

Ponescup tves
gos a Shep beyood praditié recomenk so fos upeomung problen:
Prescripttve analysis tenp data Arom truck eratne might caleclata lUOLE
Qteratues to Coct - Afectruely mantarn oes truck.

-8bxplan Klermertt o HdooP. wthdiagam.

DiSIS button
Swrtcb

Rack
8wtth
ameNOte
Datan odel

Rack Rack
Rack RacK
Eenerts:
HDAS : Asyste mfos stos ing data acroee attple noder
MapRedute} t dstrbued pr us g ergne that &plerr a larqe tack nto
Smale,Onco tht eon be run n parallel.
A NameNGdes:

These are a irttcal plece in data adds, oNer, delete., f reads m HOS
 DATE:
PAGE:
They CoOrdinae ahene data K stored & ataOa oap wheAO eOh block p dala
Stored ahese t IS
oplicatd.
2:ataNCer:
These aie servens whene data (S stored at dlretion
mang DUaNodoc in ttadop cluster to store data

MOduue-5

bwlste otcs o0 (æ) Arduino UNO Ci Raspbex

t: )Arduno:
RS mCTDCONMoUer platformdesgred fo be ms 2 profecstoak
Cfeate nteNatVe electrontc ebjets
hysica) promamga ble Cireuut boand developmenr
enttzDNNent

SencOrs, aclteatORS,

Heochig 4 bastc conpus

Sngle- boamd Conmputs deuelaped to picmate

rodtena desttop comut

puns t a t allow tt t0 Lnteact wth
I has GpIO
obeoHCs
Kuutade fos DIY Pnojets, ToT 3
P: models va capabul
Raspbeiy
vesns
(1Ke
feateoung
 DATE: PAGE:

klth a pet diaqram Bxplatn Wireless tenf" monteung

gydem usng Rasplony Pi:

3 DXplan TOT Srate9 for Smartea cittec

Thfrasructure Bevetopmelt :
R3Bablishu a Robust etRK Inftastructuye, guch asa Heqb- Speed
baoadband cellulat alw, oconnect aaueer l transnt dafa effecAuala
|2 Senso1 Deployment:
Aplcyng sensoMt boughout cuts +o qaths heaj-tune dakag
3- Baka collecton &Tnteetaton
COUecing4 ntqratog dta fromdwerse bourcee tbtO a Centtal1zed
Platfosrn for anatysts DecsOh- MaKIng
l4 Nata AnatyttcSI
Lltilung adanced onattcs tehniquec OCludung MA ard AL,49
derive gqhts from collected deta
F: Gma9t mobll1g
oplemontng nteligent ttansponta Hon systems to manage traftc
congeston optmzo pablc trasportaton Toutes
Q Energy efficenc
mplemntng kmat energy qrids to 0oNo &SpHDLZe engy

Neplounq ToT áFog effi4ent usacte cellecton f recycln

CHIen Engagenment for decisipo mating
pDereL
 DATE: PAGE:

L. wth neat sani Cttec Layred rch°echure diagqtam, xplaun snant Cety
10T A1chitecture.

s0) architecture pelvery nmOdels Tianstomae Cuko

(onste New qoveSNANG modes
Seruice Parking lughtirg |sofela Dashboayd
mgteaesty| clouds
layer

Rot

Data
SInteznet
cente
NISuation
Unfyng plaufesm
Tayest (Locaton yth ROI tn loyrs
provider SOruico
n WreleCS eompue -Egne (Pantan
Contro ler SDLth Storase Clouds
serlex IOE eabler foi3

bISHbthon |DIStrbuhop
SwiHh
Layer
New Smart rveee
fer cuHes
Cuttzons

Street cloud
iaycr
CaMieAS ecbile
FR,LFR Devteo
Smart

odes tafgc-flom
Senso.s

tased Gn
Conpos 4 deyICos &encors tbat colech data & take acHon
Instructons frorn overau so{.
SesoY tSa data Source that qenerates data requured 5
ndonstand
hysical worlde
 ct Iayer
This layer aggreqates all dato Cslected by sensoss end-node olu
nto a Snge ttanstno
Data cener laer
Data coltected from sensors e Sent-o a dta cente, ohere t can be
pocass ed orelated.

sorvlce ayer:
The collecd data should te Visahxod acnrding to sec1he nead of ech
Consuner l that data

6. ExplatD fououng wst Arduno proqtam1ng

æ) Strucres ci)functons (i) Vanabl es (ivy-flous controt Skartt
(U) Data-type wts xam.

Votd seupc)
StatemenS) wsed to set pDS fer eeyas

StatemontcC)
tnggrg ep ela

2unctions stademo

CXeCUKd 9hen th c cale

+4pe tunctton Name (parameren

Statement (J2
 Vaue) Cvan
?? Obe whue
expueLoD conczatton; Cthttal fOS
Statt
c)
else
Stmtc
==Value) IfVa else tf.
&tatemnonts)
Valuo) Vanabb
==
Stetemes
tro} 5.flow
con
,20,30 myaYay nt rrays
flot
Long
200e y nt
=l00 byte ByleLnt
type Data typer Data
Var ttn t
floot lorA, tnt,
Vattabes
PAGE: DATE:.
 DATE:
PAGE:
Explain Stps to tnsta os tn SD card q Rospbny PI, waa a python
D t o blnk on LE.

Steps to tnstall os n sD ard!

Go to raspberry pi foundatton wcbeLte R cltck cn douoteod
click on Noo BS, hen Dounlead p urdy Nooes,&save 2upfe
Ha all fles fron xp.
once sD card has beon forrnated, draq all fuer tn exttackd NOOBs todo
thcrn onto sD caral drive.
Nece ssar tler wwill be tansfeNAOd to SD Card.
6
hen ths pacoorc hac fenshed, safely nemoKe SD card f tnsertttnio
Raspbemy Pi.
* Python tode

GPIO, cetmode ( PJO BCM)

ted_PD=17
GPIO Setup (led_pn, GPRO OUT)

wble True .
Gpro. output (led-pin, QPIO HIGH)
-Hrne sleap(1)
GPLO. outputC ted- PLn, PîoLow)
Atnnesteep (1)
except KeyboardInterrupt2
GPrO. cleonup )
 OATE: PAGE:

Temperatuno Rosphorv P: Rotnet

SensoY cloud

Raspberry
Pi
CReceve)
MATT

Python Sopt
MaT Subsouber
Database

Temp sensor :
mepUTer temp &taSmts it
Raspbery i receven)
hcts as a ecetues &e equepped th a wIfA Modute 40 coDnect to
Loca! N
o Raspbery p? Subsctbe 0 MATT
întanot Cloud)
Reprarents normot serves wohero data s stoned acarsed
Data base :
Tt stores ternp"data received frorn Raspbemny p