Unit-04

EC600OE: Fundamentals of Internet Of Things

Dr. Mohammad Fayazur Rahaman

Associate Professor, mfrahaman_ece@mgit.ac.in

Dept. of Electronics and Communications Engineering,

Mahatma Gandhi Institute of Technology, Gandipet, Hyderabad-75

B.Tech. ECE III Year II Semester (R18)

2022 - 2023
1 / 65
Unit-04 [1, 2]

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server
4. Data Handling
1.4 Data Processing
4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network
4.2 Data Handling Technologies
(SDN)
4.3 Flow of Data
2.1 Conventional Network Architecture
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

2 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

3 / 65
IoT: Remote Data Logging

IoT: sensor connected with Raspberry Pi

• Creating an interactive environment • Read data from the sensor
• Network of devices connected together • Send it to a Server
IOT: Remote Data Logging • Save the data in the server
• Collect data from the devices in the net- • Data Splitting
work • Plot the data
• Send the data to a server/remote ma- Requirements:
chine • DHT Sensor
• Processing the data • 4.7K ohm resistor
• Respond to the network • Jumper wires
System Overview: • Raspberry Pi - 2 in number (Client and
• A network of Temperature and humidity Server)
4 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

5 / 65
DHT Sensor:
• Digital Humidity and Temperature Sen-
sor (DHT)
• PIN1,2,3,4(from left to right)
◦ PIN1-3.3V-5VPower supply
◦ PIN2-Data
◦ PIN3-Null
◦ PIN4-Ground

6 / 65
Sensor interface with Raspberry Pi: • Use the function
• Connect pin 1 of DHT sensor to the 3.3V Adafruit_DHT.read_retry() to read
pin of Raspberry Pi data from the sensor
• Connect pin 2 of DHT sensor to any in-
put pins of Raspberry Pi, here we have
used pin 11
• Connect pin 4 of DHT sensor to the
ground pin of the Raspberry Pi
Read Data from the Sensor
• Adafruit provides a library to work with
the DHT22 sensor
• Install the library in Raspberry Pi

7 / 65
1 import RPi.GPIO as GPIO
2 from time import sleep
3 import Adafruit_DHT
4

5 GPIO.setmode(GPIO.BOARD)
6

7 sensor = Adafruit_DHT.AM2302
8 print("Getting data from the sensor")
9

0 humidity, temp = Adafruit_DHT.read_retry(sensor, 17)

1 print ('Temp={0:0.1f}*C humidity={1:0.1f}%'.format(temp, humidity))

8 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

9 / 65
Sending Data to a Server

Using network protocols: • Server performs the task/service re-

• Create a server and client quested by the client
• Establish connection between the server Creating a socket:
and the client • s = socket.socket (SocketFamily,
• Send data from the client to the server SocketType)
Socket Programming: • SocketFamily can be AF_UNIX or
• Creates a two-way communication be- AF_INET
tween two nodes in a network • SocketType can be SOCK_STREAM or
• The nodes are termed as Server and SOCK_DGRAM
Client

10 / 65
 Client Code: Obtain readings from the sensor and send the data to the server
1 import Adafruit_DHT, time, socket
2 def sensordata():
3 GPIO.setmode(GPIO.BOARD)
4 sensor = Adafruit_DHT.AM2302
5 return Adafruit_DHT.read_retry(sensor,17)
6

7 sock = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)

8 server_address = ('10.14.3.194', 10001)
9 try:
0 while True:
1 h,t = sensordata()
2 message = str(h)+':'+str(t)
3 print('sending ', message)
4 sent = sock.sendto(message.encode('utf-8'), server_address)
5 time.sleep(1)
6 finally:
7 sock.close()
11 / 65
 Server Code: Receive data from client and save it

1 import matplotlib.pyplot as plt

2

3 plt.ion()
4 plt.style.use("seaborn-v0_8-poster")
5 fig, (ax1, ax2) = plt.subplots(2,1)
6

7 def coverage_plot(data, cnt):

8 t = data.split(":")[0]
9 h = data.split(":")[1]
0 ax1.plot(cnt, t, "C0o")
1 ax2.plot(cnt, h, "C2v")
2 plt.show()
3 plt.pause(0.5)

12 / 65
1 import socket
2 s_addr = ('127.0.0.1', 10001)
3 s = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)
4 s.bind(s_addr)
5

6 try:
7 cnt = 0
8 while True:
9 data, c_addr = s.recvfrom(4096)
0 with open("DataLog.txt", "a") as f:
1 msg = data.decode('utf-8')
2 print("From:",c_addr, " Received: ", msg)
3 coverage_plot(msg, cnt)
4 f.write(msg+'\n')
5 cnt +=1
6 finally:
7 s.close() 13 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

14 / 65
Data Processing
Data from the client needs to be processed before it can be used further
I. Data splitting / filtering:
• Data from the client is saved in a text file
• The values are separated by a colon (‘:’)
message = str(h)+’:’+str(t)
• Split() function can be used to split a string
into multiple strings depending on the type
of separator/delimiter specified. Example:
1 Data = 'sunday:monday:tuesday'
2 print( Data.split(":") )
3 # ['sunday','monday','tuesday']
II. Data plotting:
• MATPLOTLIB is a python library used to
plot in 2D
• plot(x,y): plots the values x and y
• xlabel(‘X Axis’): Labels the x-axis
• ylabel(‘Y Axis’): Labels the y-axis
• title("Simple Plot"): Adds title to the
plot
15 / 65
 Plotting the data: • close(): Close the current figure window
• scatter(): make a scatter plot of the
1 import matplotlib.pyplot as plt given points
2 plt.plot([1,2,3,4])
3 plt.ylabel('Y-Axis')
4 plt.show()

By default the values are taken for y-axis,

values for x-axis are generated automatically
starting from 0
Some other common functions used in
plotting:
• figure(): Creates a new figure
• grid(): Enable or disable axis grids in the
plot
• ion(): turns on the interactive mode
• subplot(): Adds subplot in a figure
16 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

17 / 65
Client Output:

18 / 65
Server Output:

19 / 65
20 / 65
21 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

22 / 65
Conventional Network Architecture
• The figure below shows the conventional network architecture built with specialised
hardware i.e., switches, routers etc

23 / 65
• Network devices in conventional network ar- that carries the payload data traffic
chitectures are getting exceedingly com-
plex with the
◦ with the increasing number of dis-
tributed protocols being implemented
and
◦ with the use of proprietary hardware
and interfaces
• In the conventional network architecture,
the control plane and data plane are cou-
pled
• Control plane is the part of the network
that carries the signalling and routing mes-
sage traffic
• The data plane is the part of the network
24 / 65
Limitations of Conventional networks
The limitations of conventional networks are as follows:
I. Complex Network Devices:
• Conventional networks are getting in-
creasingly complex with more and
more protocol is being implemented
to improve link speeds and reliability
• Interoperability is limited due to the
lack of standard and open interfaces
• Network devices use proprietary
hardware and software and have slow
product life-cycle and has limiting in-
novations
• Making changes in the networks to
meet the dynamic traffic patterns of
IOT has become increasingly diffi-
cult
II. Management Overhead:
• Conventional networks involve signif-
icant management overhead
• Network managers find it increasingly
difficult to manage multiple network
devices and interfaces from multiple
vendors
• Upgradation of network requires
configuration changes in multiple
devices (switches, routers, firewalls,
etc)
25 / 65
III. Limited Scalability:
• The virtualisation technologies
used in cloud computing environment
has increased the number of virtual
hosts requiring network access
• IOT applications hosted in the cloud
are distributed across multiple virtual
machines that require exchange of
traffic
• The analytics components of IOT
applications run distributed algo-
rithms on a large number of virtual
machines that require huge amounts
of data exchange
• Such computing environments re-
quire highly scalable and easy to
manage network architectures with
minimal manual configurations,
which is becoming increasingly diffi-
cult with conventional networks.
26 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

27 / 65
28 / 65
Origin of SDN

• 2006: At Stanford university, a team proposes a clean-slate security architecture

(SANE) to control security policies in a centralized manner instead of doing it at
edges.
• 2008: The idea of software-defined network is originated from OpenFlow project
(ACM SIGCOMM 2008).
• 2009: Stanford publishes OpenFlow V1.0.0 specs.
• June 2009: Nicira network is founded.
• March 2011: Open Networking Foundation is formed.
• Oct 2011: First Open Networking Summit. Many Industries (Juniper, Cisco
announced to incorporate.

29 / 65
SDN Network Architecture
SDN attempts to create network architectures that are simple, in-expensive, scalable,
agile and easy to manage

30 / 65
• In the SDN architecture • Network devices received instructions
◦ The SDN layers i.e., the control and from the SDN controller on how to for-
data planes are decoupled and ward the packets
◦ the network controller is centralised • These devices can be simpler and cost less
• Software-based SDN controllers maintain as they can be built from standard hardware
a unified view of the network and make and software components
configurations, management and provision-
ing simpler
• The underlying infrastructure in SDN uses
simple packet forwarding hardware as
opposed to specialise hardware in conven-
tional networks
• The underlying network infrastructure is ab-
stracted from the applications
• Network devices become simple with
SDN as they do not require implementa-
tion of a large number of protocols
31 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

32 / 65
Key Elements of SDN
Key elements of SDN are as follows: grammable open APIs for interface
I. Centralized Network Controller: between the SDN application and
• With decoupled control / data planes control layers (Northbound inter-
and centralised network controller, the face)
network administrators can rapidly • With these open APIs, various net-
configure the network work services can be implemented,
• SDN applications can be deployed such as routing, quality of service
through programmable open APIs (QoS), access control etc
• This speeds up innovation as the
network administrators no longer need
to wait for the device vendors to em-
bed new features in their proprietary
hardware
II. Programmable Open APIs:
• SDN architecture supports pro-
33 / 65
III. Standard Communication Interface
(OpenFlow):
• SDN architecture uses a standard
communication interface between
the control and infrastructure layers
(Southbound interface)
• OpenFlow, which is defined by
the Open Networking Foundation
(ONF) is the broadly accepted SDN
protocol for the southbound inter-
face
• With OpenFlow, the forwarding
plane of the network devices can be
directly accessed and manipulated
• Flows (match rules) can be pro-
grammed, statically or dynamically by
the SDN control software
• OpenFlow protocol is implemented
on both sides of the interface between
the controller and the network devices
◦ The controler can add, update,
and delete flow entries in the flow
tables
• Each flow table contains a set of flow
entries
◦ Each flow entry consist of match
fields, counters, and set of instruc-
tions to apply to matching packets
34 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

35 / 65
Network Function Virtualization (NFV)

• NFV is a technology that leverages vir-

tualisation to consolidate the heteroge-
neous network devices onto industry stan-
dard high-volume servers, switches and
storage
• NFV is complementary to SDN as NFV
can provide the infrastructure on which
SDN can run
• NFV and SDN are mutually beneficial to
each other, but not dependent

36 / 65
Key elements of the NFV architecture are
as follows
I. Virtualized Network Function
(VNF):
• VNF is a software implementation
of a Network function which is capa-
ble of running over the NFV infras-
tructure (NFVI)
II. NFV Infrastructure (NFVI):
• NFVI includes compute, network
and storage resources that are virtu-
alised
III. NFV Mangament and Orchestration:
• NFV management and orchestration
focuses on all the virtualisation spe-
cific management tasks and covers
the life-cycle management of phys-
ical and software resources that sup-
port the infrastructure virtualisation
37 / 65
Example: Virtualized Home Gateway

i. NFV comprises of network functions im- • Network address translation (NAT),

plemented in software that can run on i.e, translate the private IP addresses
virtualised resources in the cloud to one public address
ii. NFV enables separation of network • Application specific Gateway and fire-
functions which are implemented in soft- wall
ware from the underlying hardware
iii. Visualising network functions reduces
the equipment cost and also reduces
power consumption
iv. The virtualised home gateway can per-
form various functions, including
• Dynamic host configuration protocol
(DHCP) server,
38 / 65
SDN versus NFV

39 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

40 / 65
41 / 65
Benefits of Integrating SDN in IoT

i. Intelligent routing decisions can be deployed using SDN

ii. Simplification of information collection, analysis and decision making
iii. Visibility of network resources – network management is simplified based on
user, device and application-specific requirements
iv. Intelligent traffic pattern analysis and coordinated decisions

42 / 65
 I. Constrained Node Networks → Control of end-devices, such as sensors and actuators
II. Intelligent Aggregation → Rule - placement at access devices, while considering
mobility and heterogeneity of end-users
III. Transport Network → Rule - placement and traffic engineering at backbone networks
IV. IoT Cloud → Flow classification and enhanced security at data center networks
43 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

44 / 65
Introduction

• Data handling
◦ Ensures that research data is stored, archived or disposed off in a safe and
secure manner during and after the conclusion of a research project
◦ Includes the development of policies and procedures to manage data
handling electronically as well as through non-electronic means.
• Big Data
◦ Due to heavy traffic generated by IoT devices
◦ Huge amount of data generated by the deployed sensors

45 / 65
Big Data

• “Big data technologies describe a new generation of technologies and

architectures, designed to economically extract value from very large volumes
of a wide variety of data, by enabling the high-velocity capture, discovery,
and/or analysis.”
• “Big data shall mean the data of which the data volume, acquisition speed, or
data representation limits the capacity of using traditional relational methods
to conduct effective analysis or the data which may be effectively processed with
important horizontal zoom technologies.”

46 / 65
Types of Data

I. Structured data
◦ Data that can be easily organized.
◦ Usually stored in relational databases.
◦ Structured Query Language (SQL) manages structured data in databases.
◦ It accounts for only 20% of the total available data today in the world.
II. Unstructured data
◦ Information that do not possess any pre-defined model.
◦ Traditional RDBMSs are unable to process unstructured data.
◦ Enhances the ability to provide better insight to huge datasets.
◦ It accounts for 80% of the total data available today in the world.

47 / 65
Characteristics of Big Data
I. Volume: Quantity of data that is gen-
erated
• Sources of data are added continu-
ously
• Example of volume: 500 Hours of
video content is uploaded to YouTube
every minute
II. Velocity: Refers to the speed of gen-
eration of data
• Data processing time decreasing
day-by-day in order to provide real-
time services
• Older batch processing technology
is unable to handle high velocity of
data
• Example of velocity : 140 million
tweets per day on average
III. Variety: Refers to the category to
which the data belongs
• No restriction over the input data
formats
• Data mostly unstructured or semi-
structured
• Example of variety : Pure text, im-
ages, audio, video, sensor data, etc.
IV. Variability: Refers to data whose
meaning is constantly changing.
• Meaning of the data depends on the
context.
• Data appear as an indecipherable
mass without structure
• Example: Language processing, Hash-
tags, Geo-spatial data, Multimedia,
Sensor event 48 / 65
V. Veracity: Veracity refers to the biases,
noise and abnormality in data.
• It is important in programs that in-
volve automated decision-making,
or feeding the data into an unsuper-
vised machine learning algorithm.
• Veracity isn’t just about data quality,
it’s about data understandability.
VI. Visualization: Presentation of data
in a pictorial or graphical format
• Enables decision makers to see ana-
lytics presented visually
• Identify new patterns
VII. Value: It means extracting useful
business information from scattered
data.
• Includes a large volume and variety of
data
• Easy to access and delivers quality an-
alytics that enables informed deci-
sions
49 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

50 / 65
Data Handling Technologies
I. Cloud computing:
• Essential characteristics
◦ On-demand self service
◦ Broad network access
◦ Resource pooling
◦ Rapid elasticity
◦ Measured service
• Basic service models provided by
cloud computing
◦ Infrastructure-as-a-Service (IaaS)
◦ Platform-as-a-Service (PaaS)
◦ Software-as-a-Service (SaaS)
II. Internet of Things (IoT):
• According to Techopedia, IoT
“describes a future where
every day physical objects
will be connected to the
internet and will be able to
identify themselves to other
devices.”
• Sensors embedded into various de-
vices and machines and deployed
into fields.
• Sensors transmit sensed data to re-
mote servers via Internet.
• Continuous data acquisition from
mobile equipment, transportation fa-
cilities, public facilities, and home ap-
pliances
51 / 65
III. Data handling at data centers:
• Storing, managing, and organizing
data.
• Estimates and provides necessary
processing capacity.
• Provides sufficient network infras-
tructure.
• Effectively manages energy con-
sumption.
• Replicates data to keep backup.
• Develop business oriented strategic
solutions from big data.
• Helps business personnel to analyze
existing data.
• Discovers problems in business op-
erations.
52 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

53 / 65
Flow of Data

54 / 65
I. Data Sources
i. Enterprise data families.
◦ Online trading and analysis data. iii. Bio-medical data
◦ Production and inventory data. ◦ Masses of data generated by gene se-
◦ Sales and other financial data quencing.
ii. IoT data ◦ Data from medical clinics and medi-
◦ Data from industry, agriculture, traf- cal R&Ds.
fic, transportation iv. Other fields
◦ Medical-care data, ◦ Fields such as – computational biol-
◦ Data from public departments, and ogy, astronomy, nuclear research etc

55 / 65
II. Data Acquisition
i. Data collection
◦ Log files or record files that are au-
tomatically generated by data sources
to record activities for further analysis.
◦ Sensory data such as sound wave,
voice, vibration, automobile, chemical,
current, weather, pressure, tempera-
ture etc.
◦ Complex and variety of data collec-
tion through mobile devices. E.g. – ge-
ographical location, 2D barcodes, pic-
tures, videos etc
ii. Data transmission
◦ After collecting data, it will be trans-
ferred to storage system for further
processing and analysis of the data.
56 / 65
iii. Data pre-processing
◦ Collected datasets suffer from noise,
redundancy, inconsistency etc.,
thus, pre-processing of data is nec-
essary.
◦ Pre-processing of relational data
mainly follows – integration, clean-
ing, and redundancy mitigation
• Integration is combining data from
various sources and provides users
with a uniform view of data.
• Cleaning is identifying inaccurate,
incomplete, or unreasonable data,
and then modifying or deleting such
data.
• Redundancy mitigation is eliminat-
ing data repetition through detec-
tion, filtering and compression of
data to avoid unnecessary trans-
mission.
57 / 65
III. Data Storage
i. File system
◦ Distributed file systems that store
massive data and ensure – consis-
tency, availability, and fault tolerance
of data.
◦ GFS is a notable example of dis-
tributed file system that supports
large-scale file system, though it’s
performance is limited in case of small
files
◦ Hadoop Distributed File System
(HDFS) and Kosmosfs are other no-
table file systems, derived from the
open source codes of GFS
ii. Databases
◦ Emergence of non-traditional relational
databases (NoSQL) in order to deal
with the characteristics that big data
possess.
◦ Three main NoSQL databases – Key-
value databases, column-oriented
databases, and document-oriented
databases.
58 / 65
Where are we ?

1. Implementation of IoT with Raspberry Pi 2.3 Key Elements of SDN

1.1 IoT: Remote Data Logging 2.4 Network Function Virtualization (NFV)
1.2 Sensor - Raspberry Pi Interface 3. SDN for IoT
1.2.1 DHT Sensor 3.1 Benefits of Integrating SDN in IoT
1.3 Sending Data to a Server 4. Data Handling
1.4 Data Processing 4.1 Introduction
1.5 Output 4.1.1 Characteristics of Big Data
2. Introduction to Software Defined Network (SDN) 4.2 Data Handling Technologies
2.1 Conventional Network Architecture 4.3 Flow of Data
2.1.1 Limitations of Conventional networks 5. Data Analytics
2.2 SDN Network Architecture 5.1 Introduction

59 / 65
Introduction

What is Data Analytics

“Data analytics (DA) is the process of examining data sets in order to draw conclusions
about the information they contain, increasingly with the aid of specialized systems and
software. Data analytics technologies and techniques are widely used in commercial
industries to enable organizations to make more- informed business decisions and by
scientists and researchers to verify or disprove scientific models, theories and hypotheses"

Types of Data Analysis

I. Qualitative Analysis : Deals with the analysis of data that is categorical in nature
II. Quantitative Analysis : Quantitative analysis refers to the process by which numerical
data is analyzed

60 / 65
Qualitative Analysis
i. Data is not described through numerical v. The grouping of data into identifiable
values themes
ii. Described by some sort of descriptive vi. Qualitative analysis can be summarized
context such as text by three basic principles (Seidel, 1998):
iii. Data can be gathered by many meth- • Notice things
ods such as interviews, videos and au- • Collect things
dio recordings, field notes • Think about things
iv. Data needs to be interpreted

61 / 65
Quantitative Analysis
i. Quantitative analysis refers to the process • Data dispersion
by which numerical data is analyzed • Analysis of relationships between vari-
ii. Involves descriptive statistics such as ables
mean, median, standard deviation • Contingence and correlation
iii. The following are often involved with • Regression analysis
quantitative analysis: • Statistical significance
• Statistical models • Precision
• Analysis of variables • Error limits

62 / 65
Comparison

Advantages
• Allows for the identification of important (and often mission-critical) trends
• Helps businesses identify performance problems that require some sort of action
• Can be viewed in a visual manner, which leads to faster and better decisions
• Better awareness regarding the habits of potential customers
• It can provide a company with an edge over their competitors
63 / 65
Text Books

[1] P. S. Misra, “Nptel: Introduction to internet of things,” 2019.

https://www.youtube.com/@introductiontointernetofth4217/featured
[Accessed: Feb 2023].
[2] A. Bahga and V. Madisetti, Internet of Things: A Hands-on Approach.
[3] OpenAI.com, “chatgpt - an openai based language models for dialogue,” 2023.
https://openai.com/blog/chatgpt/ [Accessed: Feb 2023].

64 / 65
Thank you

65 / 65