Professional Documents
Culture Documents
OPNET Full Presentation
OPNET Full Presentation
Session 1813
Traffic Behavior and
Queuing in a QoS Environment
Networking Tutorials
Objectives
Outline
• Basic concepts
• Source models
• Service models (demo)
• Single-queue systems
• Priority/shared service systems
• Networks of queues
• Hybrid simulation (demo)
Outline
• Basic concepts
– Performance measures
– Solution methodologies
– Queuing system concepts
– Stability and steady-state
– Causes of delay and bottlenecks
• Source models
• Service models (demo)
• Single-queue systems
• Priority/shared service systems
• Networks of queues
• Hybrid simulation (demo)
Performance Measures
• Delay
• Delay variation (jitter)
• Packet loss
• Efficient sharing of bandwidth
• Relative importance depends on traffic type (audio/video,
file transfer, interactive)
• Challenge: Provide adequate performance for (possibly)
heterogeneous traffic
Solution Methodologies
Examples of Applications
Analytical Modeling Discrete-Event Simulation
Hybrid DES
M/G/./. & M/G/./. & Decomposition
Analysis Scenarios with Explicit
G/G/./. G/G/./. with Kleinrock DES only with
and
FIFO Priority Independence Explicit Traffic
Background
Analysis Analysis Assumption
Traffic
Single Link with FIFO Service
Best Effort Service for Standard Data Traffic Yes N/A N/A Yes Yes
Best Effort Service for LRD/Self-Similar
Yes N/A N/A Yes Yes
Behavior Traffic
"Chancing It" with Best Effort Service for
Yes N/A N/A Yes Yes
Voice, Video and Data
Single Link with QoS-Based Queueing
Using QoS to differentiate service levels for Yes (loss of
N/A N/A Yes Yes
the same type of traffic accuracy)
Using QoS to support different requirements
for different application types given as a Highly
N/A N/A Yes Yes
detailed study of setting Cisco Router approximate
queueing parameters
Network of Queues
Hop-by-hop Yes (some loss of Yes (Run time a Yes [Fast with
General network model extending the
N/A Analysis (loss accuracy - e.g., traffic function of network minimal loss of
previous QoS queueing model
of accuacy) shaping) complexity) accuracy]
Little’s Law
Regular Traffic
Irregular but
Spaced Apart Traffic
Burstiness Example
Different Burstiness Levels at Same Packet Rate
Source: Fei Xue and S. J. Ben Yoo, UCDavis, “On the Generation and Shaping Self-similar Traffic in Optical Packet-switched Networks”, OPNETWORK 2002
Copyright © 2002 OPNET Technologies, Inc. 14
Traffic Behavior and Queuing in a QoS Environment
Time
Queuing Delays
Bottlenecks
• Types of bottlenecks
– At access points (flow control, prioritization, QoS enforcement needed)
– At points within the network core
– Isolated (can be analyzed in isolation)
– Interrelated (network or chain analysis needed)
• Bottlenecks result from overloads caused by:
– High load sessions, or
– Convergence of sufficient number of moderate load sessions at the same
queue
Exponential
inter-arrivals
gap
Bottleneck
90% utilization
Small
Medium
Bottleneck
90% utilization
Large
Copyright © 2002 OPNET Technologies, Inc. 20
Traffic Behavior and Queuing in a QoS Environment
Packet Trains
# of packets
Variable packet sizes
Peaks smeared
sec
Outline
• Basic concepts
• Source models
– Poisson traffic
– Batch arrivals
– Example applications – voice, video, file transfer
• Service models (demo)
• Single-queue systems
• Priority/shared service systems
• Networks of queues
• Hybrid simulation (demo)
Batch Arrivals
State 0 State 1
OFF ON
Source Types
• Voice sources
• Video sources
• File transfers
• Web traffic
• Interactive traffic
• Different application types have different QoS requirements,
e.g., delay, jitter, loss, throughput, etc.
Interactive * Poisson type Zero or near-sero Poisson, Poisson with batch arrivals,
* Sometimes batch- packet loss Two-state MMRP
FTP
arrivals, or bursty, Delay may be
telnet important
web or sometimes on-off
Diagram Source: Mark W. Garrett and Walter Willinger, “Analysis, Modeling, and Generation of Self-Similar VBR Video Traffic, BELLCORE, 1994
Copyright © 2002 OPNET Technologies, Inc. 30
Traffic Behavior and Queuing in a QoS Environment
Outline
• Basic concepts
• Source models
• Service models
– Single vs. multiple-servers
– FIFO, priority, and shared servers
– Demo
• Single-queue systems
• Priority/shared service systems
• Networks of queues
• Hybrid simulation (demo)
Transmission
Line
Arrivals
FIFO Queue
• Packets are placed on outbound link to egress device in FIFO order
– Device (router, switch) multiplexes different flows arriving on various ingress
ports onto an output buffer forming a FIFO queue
Multiple Servers
Priority Servers
Priority Queuing
• Packets are classified into separate queues
– E.g., based on source/destination IP address, source/destination TCP port, etc.
• All packets in a higher priority queue are served before a lower priority
queue is served
– Typically in routers, if a higher priority packet arrives while a lower priority
packet is being transmitted, it waits until the lower priority packet completes
Shared Servers
Round-Robin/Cyclic Service
Fair Queuing
• This scheduling method is inspired by the “most fair” of methods:
– Transmit one bit from each queue in cyclic order (bit-by-bit round robin)
– Skip queues that are empty
• To approximate the bit-by-bit processing behavior, for each packet
– We calculate upon arrival its “finish time under bit-by-bit round robin”
assuming all other queues are continuously busy, and we transmit by FIFO
within each queue
– Transmit next the packet with the minimum finish time
• Important properties:
– Priority is given to short packets
– Equal bandwidth is allocated to all queues that are continuously busy
Demo: FIFO
FIFO
Bottleneck
90% utilization
PQ
Bottleneck
90% utilization
PQ FTP
FIFO
PQ Video
WFQ
Bottleneck
90% utilization
PQ FTP
WFQ FTP
FIFO
WFQ/PQ Video
Outline
• Basic concepts
• Source models
• Service models (demo)
• Single-queue systems
– M/M/1……M/M/m/k
– M/G/1……G/G/1
– Demo: Analytics vs. simulation
• Priority/shared service systems
• Networks of queues
• Hybrid simulation (demo)
M/M/1 System
Delay Calculation
• Let
Q = Average time spent waiting in queue
T = Average packet delay (transmission plus queuing)
• Note that T = 1/m + Q
• Also by Little’s law
N = T and Nq = Q
where
Nq = Average number waiting in queue
• These quantities can be calculated with formulas derived by
Markov chain analysis (see references)
M/M/1 Results
M/G/1 System
G/G/1 System
Demo: M/G/1
Packet size
1250 bytes Packet size distribution:
(10000 bits) exponential
constant
lognormal
What is the average delay and queue size ?
Packet Size
Delay T (sec) Queue Size (packets)
Distribution
Exponential
mean = 10000 0.02 1.0
variance = 1.0 *108
Constant
mean = 10000 0.015 0.75
variance = N/A
Lognormal
mean = 10000 0.06 3.0
variance = 9.0 *108
• Video
» constant packet inter-arrivals
• Http
» bursty traffic
Delay
P-K formula
Simulation
Outline
• Basic concepts
• Source models
• Service models (demo)
• Single-queue systems
• Priority/shared service systems
– Preemptive vs. non-preemptive
– Cyclic, WFQ, PQ systems
– Demo: Simulation results
• Networks of queues
• Hybrid simulation (demo)
Outline
• Basic concepts
• Source models
• Service models (demo)
• Single-queue systems
• Priority/shared service systems
• Networks of queues
– Violation of M/M/. assumptions
– Effects on delays and traffic shaping
– Analytical approximations
• Hybrid simulation (demo)
Exponential
inter-arrivals
Bottleneck Bottleneck
No queuing
Delay delay
Approximations
Outline
• Basic concepts
• Source models
• Service models (demo)
• Single-queue systems
• Priority/shared service systems
• Networks of queues
• Hybrid simulation
– Explicit vs. aggregated traffic
– Conceptual Framework
– Demo: PQ and WFQ with aggregated traffic
Explicit Traffic
• Modeled in detail, including the effects of various protocols
• Each packet’s arrival and departure times are recorded (together
with other data of interest, e.g., loss, etc.) along each link that it
traverses
• Departure times at a link are the arrival times at the next link (plus
propagation delay)
• Objective: At each link, given the arrival times (and the packet
lengths), determine the departure times
Aggregated Traffic
• Simplified modeling
– We don’t keep track of individual packets, only workload counts
(number of packets or bytes)
– We “generate” workload counts
» by probabilistic/analytical modeling, or
» by simplified simulation
• Aggregated (or background) traffic is local (per link)
• Shaping effects are complex to incorporate
• Some dependences between explicit and background traffic
along a chain of links are complicated and are ignored
aK wK a K+1 w K+1
Time
Background Background
Explicit Explicit
d K = aK + wK + sK
DEPARTURE TIMES 77
Copyright © 2002 OPNET Technologies, Inc.
Traffic Behavior and Queuing in a QoS Environment
a1 w1 a2 w2 a3 w
. . .
3
. . . Time
d1 = a1 + w1 + s1 d2 = a2 + w2 + s2 d3 = a3 + w3 + s3
Departure times
• Note: wk+1 consists of wk and two more terms:
– Background arrivals in interval ak+1 - ak
– (Minus) transmitted workload in interval ak+1 - ak
• Must calculate/simulate the two terms
• The first term is simulated based on the traffic descriptor of the background traffic
• The second term is easily calculated if the queue is continuously busy in ak+1 - ak
Copyright © 2002 OPNET Technologies, Inc. 79
Traffic Behavior and Queuing in a QoS Environment
a k w k a k+1 w k+1
.. . Time
dk d k+1
Copyright © 2002 OPNET Technologies, Inc. 80
Traffic Behavior and Queuing in a QoS Environment
ak ak+1 wk+1
wk
dk
. .d .
k+1
Time
Idle Periods
Busy Periods
Copyright © 2002 OPNET Technologies, Inc. 81
Traffic Behavior and Queuing in a QoS Environment
Examples of Applications
Analytical Modeling Discrete-Event Simulation
Hybrid DES
M/G/./. & M/G/./. & Decomposition
Analysis Scenarios with Explicit
G/G/./. G/G/./. with Kleinrock DES only with
and
FIFO Priority Independence Explicit Traffic
Background
Analysis Analysis Assumption
Traffic
Single Link with FIFO Service
Best Effort Service for Standard Data Traffic Yes N/A N/A Yes Yes
Best Effort Service for LRD/Self-Similar
Yes N/A N/A Yes Yes
Behavior Traffic
"Chancing It" with Best Effort Service for
Yes N/A N/A Yes Yes
Voice, Video and Data
Single Link with QoS-Based Queueing
Using QoS to differentiate service levels for Yes (loss of
N/A N/A Yes Yes
the same type of traffic accuracy)
Using QoS to support different requirements
for different application types given as a Highly
N/A N/A Yes Yes
detailed study of setting Cisco Router approximate
queueing parameters
Network of Queues
Hop-by-hop Yes (some loss of Yes (Run time a Yes [Fast with
General network model extending the
N/A Analysis (loss accuracy - e.g., traffic function of network minimal loss of
previous QoS queueing model
of accuacy) shaping) complexity) accuracy]
Traffic modeled as
1) Explicit traffic
2) Background traffic
References
• Networking
– Bertsekas and Gallager, Data Networks, Prentice-Hall, 1992
• Device Queuing Implementations
– Vegesna, IP Quality of Service, Ciscopress.com, 2001
– http://www.juniper.net/techcenter/techpapers/200020.pdf
• Probability and Queuing Models
– Bertsekas and Tsitsiklis, Introduction to Probability, Athena Scientific, 2002,
http://www.athenasc.com/probbook.html
– Cohen, The Single Server Queue, North-Holland, 1992
– Takagi, Queuing Analysis: A Foundation of Performance Evaluation. (3
Volumes), North-Holland, 1991
– Gross and Harris, Fundamentals of Queuing Theory, Wiley, 1985
– Cooper, Introduction to Queuing Theory, CEEPress, 1981
• OPNET Hybrid Simulation and Micro Simulation
– See Case Studies papers in
http://secure.opnet.com/services/muc/mtdlogis_cse_stdies_81.html