Professional Documents
Culture Documents
Generation and Validation of Empirically-Derived TCP Application Workloads
Generation and Validation of Empirically-Derived TCP Application Workloads
Felix Hernandez-Campos
W
IE
A dissertation submitted to the fa ulty of the University of North Carolina at Chapel Hill in
partial ful llment of the requirements for the degree of Do tor of Philosophy in the Department
of Computer S ien e.
EV
PR
Chapel Hill
2006
Approved by:
Advisor: Kevin Je ay
Reader: F. Donelson Smith
Reader: Ketan Mayer-Patel
Reader: J. Steve Marron
Reader: Andrew Nobel
Reader: Jan Prins
UMI Number: 3207338
Copyright 2006 by
Hernandez-Campos, Felix
W
All rights reserved.
IE
EV
PR
2006
Felix Hernandez-Campos
ALL RIGHTS RESERVED
ii
ABSTRACT
FELIX
HERNANDEZ-CAMPOS: Generation and Validation of
Empiri ally-Derived TCP Appli ation Workloads.
(Under the dire tion of Kevin Je ay)
This dissertation proposes and evaluates a new approa h for generating realisti traÆ
in networking experiments. The main problem solved by our approa h is generating losed-
W
loop traÆ onsistent with the behavior of the entire set of appli ations in modern traÆ
mixes. Unlike earlier approa hes, whi h des ribed individual appli ations in terms of the spe i
IE
semanti s of ea h appli ation, we des ribe the sour e behavior driving ea h onne tion in a
generi manner using the a-b-t model. This model provides an intuitive but detailed way of
EV
des ribing sour e behavior in terms of onne tion ve tors that apture the sizes and ordering of
appli ation data units, the quiet times between them, and whether data ex hange is sequential
or on urrent. This is onsistent with the view of traÆ from TCP, whi h does not on ern
PR
iii
metri s. Su h omparison requires the areful measurement of network parameters for ea h
onne tion, and their reprodu tion together with the orresponding sour e behavior. Our nal
ontribution onsists of two resampling methods for introdu ing ontrolled variability in network
experiments and for generating losed-loop traÆ that a urately mat hes a target o ered load.
W
IE
EV
PR
iv
ACKNOWLEDGMENTS
First of all, I must thank Kevin Je ay and Don Smith for their guidan e and en ouragement
throughout my do toral program. Their patien e and friendship have been invaluable all these
years. I also thank them, together with other fa ulty and student members of the Distributed
and Real-Time Systems group (DiRT), for building a phenomenal infrastru ture for Internet
measurement and experimental networking resear h. DiRT students have greatly ontributed
to my do toral experien e, most espe ially Jay Aikat and David Ott.
W
My ommittee members and other ollaborators have ontributed tremendously to my ef-
forts. I am spe ially in debt with Steve Marron and Andrew Nobel, who have greatly enri hed
IE
the statisti al side of my work. In this regard, being part of SAMSI's \Network Modeling for
the Internet" program and of the inter-dis iplinary Internet study group at UNC gave me su-
EV
perb opportunities to widen my understanding of Internet resear h. I must also thank UNC's
Department of Computer S ien e as whole, in luding fa ulty, students and sta , for reating an
outstanding resear h and tea hing environment. Overall, my years at UNC were an in redible
PR
positive experien e.
I thank the National S ien e Foundation, IBM, Cis o, Intel, Sun Mi rosystems and others
for supporting this work. I am spe ially grateful to the Computer Measurement Group (CMG)
for their do toral fellowship.
Finally, I thank my family for their support. Their onstant example of hard-work, and
their respe t for intelle tual endeavors has motivated me during my entire life. My wife's help
with the editing of this manus ript was invaluable, as was her onstant en ouragement during
my graduate studies. More than anybody else, my parents gave me my passion for knowledge,
and it is to them that I dedi ate this do toral dissertation.
v
TABLE OF CONTENTS
LIST OF TABLES x
LIST OF FIGURES xi
LIST OF ABBREVIATIONS xxiii
1 Introdu tion 1
W
1.1 Abstra t Sour e-Level Modeling . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.2 Sour e-Level Tra e Replay . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
IE
1.3 Tra e Resampling and Load S aling . . . . . . . . . . . . . . . . . . . . . . . . . 15
1.4 Thesis Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
EV
1.5 Contributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
1.6 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
2 Related Work 22
PR
vi
3.1.1 Client/Server Appli ations . . . . . . . . . . . . . . . . . . . . . . . . . . 47
3.1.2 Beyond Client/Server Appli ations . . . . . . . . . . . . . . . . . . . . . . 57
3.2 The Con urrent a-b-t Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
3.3 Abstra t Sour e-Level Measurement . . . . . . . . . . . . . . . . . . . . . . . . . 63
3.3.1 From TCP Sequen e Numbers to Appli ation Data Units . . . . . . . . . 63
3.3.2 Logi al Order of Data Segments . . . . . . . . . . . . . . . . . . . . . . . 67
3.3.3 Data Analysis Algorithm . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
3.4 Validation using Syntheti Appli ations . . . . . . . . . . . . . . . . . . . . . . . 77
3.5 Analysis Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82
3.5.1 Variability A ross Sites . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86
W
3.5.2 Time-of-Day Variability and Workload Dire tionality . . . . . . . . . . . . 95
3.6 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99
vii
5.2 Validation of Sour e-level Tra e Replay . . . . . . . . . . . . . . . . . . . . . . . 173
5.2.1 Leipzig-II . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 174
5.2.2 UNC 1 PM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 182
5.2.3 Abilene-I . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 187
5.3 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192
W
6.2.3 Marginal Distributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206
6.2.4 Long-Range Dependen e . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
IE
6.2.5 Time Series of A tive Conne tions . . . . . . . . . . . . . . . . . . . . . . 214
6.3 Sour e-level Replay of UNC 1 PM . . . . . . . . . . . . . . . . . . . . . . . . . . 217
EV
6.3.1 Time Series of Byte Throughput . . . . . . . . . . . . . . . . . . . . . . . 217
6.3.2 Time Series of Pa ket Throughput . . . . . . . . . . . . . . . . . . . . . . 220
6.3.3 Marginal Distributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221
PR
viii
6.5.5 Time Series of A tive Conne tions . . . . . . . . . . . . . . . . . . . . . . 242
6.6 Sour e-level Replay of UNC 7:30 PM . . . . . . . . . . . . . . . . . . . . . . . . . 243
6.6.1 Time Series of Byte Throughput . . . . . . . . . . . . . . . . . . . . . . . 243
6.6.2 Time Series of Pa ket Throughput . . . . . . . . . . . . . . . . . . . . . . 244
6.6.3 Marginal Distributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 245
6.6.4 Long-Range Dependen e . . . . . . . . . . . . . . . . . . . . . . . . . . . . 249
6.6.5 Time Series of A tive Conne tions . . . . . . . . . . . . . . . . . . . . . . 251
6.7 Sour e-level Replay of Abilene-I . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252
6.7.1 Time Series of Byte Throughput . . . . . . . . . . . . . . . . . . . . . . . 252
6.7.2 Time Series of Pa ket Throughput . . . . . . . . . . . . . . . . . . . . . . 253
W
6.7.3 Marginal Distributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254
6.7.4 Long-Range Dependen e . . . . . . . . . . . . . . . . . . . . . . . . . . . . 256
IE
6.7.5 Time Series of A tive Conne tions . . . . . . . . . . . . . . . . . . . . . . 259
6.8 Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 260
EV
7 Tra e Resampling and Load S aling 261
7.1 Poisson Resampling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 265
7.1.1 Basi Poisson Resampling . . . . . . . . . . . . . . . . . . . . . . . . . . . 265
PR
BIBLIOGRAPHY 300
ix
LIST OF TABLES
3.1 Breakdown of the TCP onne tions found in ve tra es. . . . . . . . . . . . . . . 82
4.1 Estimated Hurst parameters and their on den e intervals for the pa ket through-
put time series of ve tra es. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156
4.2 Estimated Hurst parameters and their on den e intervals for the byte through-
put time series of ve tra es. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156
6.1 Estimated Hurst parameters and their on den e intervals for the byte through-
put time series of Leipzig-II and its four types of sour e-level tra e replay. . . . . 212
W
6.2 Estimated Hurst parameters and their on den e intervals for the pa ket through-
put time series of Leipzig-II and its four types of sour e-level tra e replay. . . . . 215
6.3 Estimated Hurst parameters and their on den e intervals for the byte through-
IE
put time series of UNC 1 PM and its four types of sour e-level tra e replay. . . . 225
6.4 Estimated Hurst parameters and their on den e intervals for the pa ket through-
put time series of UNC 1 PM and its four types of sour e-level tra e replay. . . . 228
EV
6.5 Estimated Hurst parameters and their on den e intervals for the byte through-
put time series of UNC 1 AM and its four types of sour e-level tra e replay. . . . 240
6.6 Estimated Hurst parameters and their on den e intervals for the pa ket through-
PR
put time series of UNC 1 AM and its four types of sour e-level tra e replay. . . . 241
6.7 Estimated Hurst parameters and their on den e intervals for the byte through-
put time series of UNC 7:30 PM and its four types of sour e-level tra e replay. . 248
6.8 Estimated Hurst parameters and their on den e intervals for the pa ket through-
put time series of UNC 7:30 PM and its four types of sour e-level tra e replay. . 250
6.9 Estimated Hurst parameters and their on den e intervals for the byte through-
put time series of Abilene-I and its four types of sour e-level tra e replay. . . . . 257
6.10 Estimated Hurst parameters and their on den e intervals for the pa ket through-
put time series of Abilene-I and its four types of sour e-level tra e replay. . . . . 258
7.1 Estimated Hurst parameters and their on den e intervals for the onne tion
arrival time series of UNC 1 PM and UNC 1 AM, and their Poisson arrival ts. . 275
7.2 Estimated Hurst parameters and their on den e intervals for ve subsamplings
obtained from the onne tion arrival time series of UNC 1 PM and UNC 1 AM . 284
x
LIST OF FIGURES
1.1 Network traÆ seen from di erent levels. . . . . . . . . . . . . . . . . . . . . . . 4
1.2 An a-b-t diagram illustrating a persistent HTTP onne tion. . . . . . . . . . . . 8
1.3 A diagram illustrating the intera tion between two BitTorrent peers. . . . . . . . 10
1.4 Overview of Sour e-level Tra e Replay. . . . . . . . . . . . . . . . . . . . . . . . . 12
3.1 An a-b-t diagram representing a typi al ADU ex hange in HTTP version 1.0. . . 48
3.2 An a-b-t diagram illustrating a persistent HTTP onne tion. . . . . . . . . . . . 49
W
3.3 An a-b-t diagram illustrating an SMTP onne tion. . . . . . . . . . . . . . . . . . 53
3.4 Three a-b-t diagrams representing three di erent types of NNTP intera tions. . . 54
3.5 An a-b-t diagram illustrating a server push from a web am using a persistent
IE
HTTP onne tion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
3.6 An a-b-t diagram illustrating I e ast audio streaming in a TCP onne tion. . . . 58
EV
3.7 Three a-b-t diagrams of onne tions taking part in the intera tion between an
FTP lient and an FTP server. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
3.8 An a-b-t diagram illustrating an NNTP onne tion in \stream-mode", whi h
exhibits data ex hange on urren y. . . . . . . . . . . . . . . . . . . . . . . . . . 60
PR
3.9 An a-b-t diagram illustrating the intera tion between two BitTorrent peers. . . . 60
3.10 A rst set of TCP segments for the onne tion ve tor in Figure 3.1: lossless
example. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
3.11 A se ond set of TCP segments for the onne tion ve tor in Figure 3.1: lossy
example. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
3.12 Distributions of ADU sizes for the testbed experiments with syntheti appli ations. 79
3.13 Distributions of quiet time durations for the testbed experiments with syntheti
appli ations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
3.14 Distributions of ADU sizes for the testbed experiments with syntheti appli ations. 81
3.15 Distributions of quiet time durations for the testbed experiments with syntheti
appli ations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
3.16 Bodies of the A and B distributions for Abilene-I, Leipzig-II and UNC 1 PM. . . 86
xi
3.17 Tails of the A and B distributions for Abilene-I, Leipzig-II and UNC 1 PM. . . . 86
3.18 Bodies of the A and B distributions with per-byte probabilities for Abilene-I,
Leipzig-II and UNC 1 PM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88
3.19 Bodies of the E distributions for Abilene-I, Leipzig-II and UNC 1 PM. . . . . . . 88
3.20 Bodies of the E distributions with per-byte probabilities for Abilene-I, Leipzig-II
and UNC 1 PM. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
3.21 Tails of the E distributions for Abilene-I, Leipzig-II and UNC 1 PM. . . . . . . . 89
3.22 Average size of the epo hs in ea h onne tion ve tor as a fun tion of the number
of epo hs for Abilene-I, Leipzig-II and UNC 1 PM. . . . . . . . . . . . . . . . . . 90
3.23 Average of the median size of the ADUs in ea h onne tion ve tor as a fun tion
of the number of epo hs for Abilene-I, Leipzig-II and UNC 1 PM. . . . . . . . . . 90
W
3.24 Average of the median size of the ADUs in ea h onne tion ve tor as a fun tion
of the number of epo hs, for Leipzig-II. . . . . . . . . . . . . . . . . . . . . . . . . 91
3.25 Average of the median size of the ADUs in ea h onne tion ve tor as a fun tion
IE
of the number of epo hs for Abilene-I. . . . . . . . . . . . . . . . . . . . . . . . . 91
3.26 Bodies of the TA and TB distributions for Abilene-I, Leipzig-II and UNC 1 PM. 92
EV
3.27 Tails of the TA and TB distributions for Abilene-I, Leipzig-II and UNC 1 PM. . 92
3.28 Distribution of the durations of the quiet times between the nal ADU and
onne tion termination. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
3.29 Bodies of the A and B distributions for the on urrent onne tions in Abilene-I,
PR
xii
3.38 Tails of the TA distributions for three UNC tra es. . . . . . . . . . . . . . . . . . 98
4.1 A set of TCP segments illustrating RTT estimation from onne tion establishment.109
4.2 Two sets of TCP segments illustrating RTT estimation ambiguities in the pres-
en e of loss and early retransmission in onne tion establishment. . . . . . . . . . 110
4.3 A set of TCP segments illustrating RTT estimation using the sum of two OSTTs.111
4.4 A set of TCP segments illustrating the impa t of delayed a knowledgments on
OSTTs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
4.5 Comparison of RTT estimators for a syntheti tra e: no loss and enabled delayed
a knowledgments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
4.6 Comparison of RTT estimators for a syntheti tra e: no loss and disabled delayed
a knowledgments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
W
4.7 Comparison of RTT estimators for a syntheti tra e: xed loss rate of 1% for all
onne tions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117
IE
4.8 Comparison of RTT estimators for a syntheti tra e: loss rates uniformly dis-
tributed between 0% and 10%. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117
4.9 A set of TCP segments illustrating an invalid OSTT sample due to the intera tion
EV
between loss and umulative a knowledgments. . . . . . . . . . . . . . . . . . . . 118
4.10 Comparison of RTT estimators for a syntheti tra e: loss rates uniformly dis-
tributed between 0% and 10%. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119
4.11 Comparison of RTT estimators for syntheti tra es: xed loss rate of 1%; real
PR
xiii
4.20 Bodies of the distributions of loss rates with per-byte probabilities for the ve
tra es. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
4.21 Breakdown of the byte throughput time series for Leipzig-II inbound. . . . . . . 131
4.22 Breakdown of the pa ket throughput time series for Leipzig-II inbound. . . . . . 131
4.23 Breakdown of the byte throughput time series for Leipzig-II outbound. . . . . . 133
4.24 Breakdown of the pa ket throughput time series for Leipzig-II outbound. . . . . 133
4.25 Breakdown of the byte throughput time series for Leipzig-II outbound. . . . . . 134
4.26 Breakdown of the pa ket throughput time series for Leipzig-II outbound. . . . . 134
4.27 Breakdown of the byte throughput time series for Abilene-I Ipls/Clev. . . . . . . 135
4.28 Breakdown of the pa ket throughput time series for Abilene-I Ipls/Clev. . . . . 135
W
4.29 Breakdown of the byte throughput time series for Abilene-I Clev/Ipls. . . . . . . 137
4.30 Breakdown of the pa ket throughput time series for Abilene-I Clev/Ipls. . . . . 137
IE
4.31 Breakdown of the byte throughput time series for UNC 1 PM inbound. . . . . . 138
4.32 Breakdown of the pa ket throughput time series for UNC 1 PM inbound. . . . . 138
EV
4.33 Breakdown of the byte throughput time series for UNC 1 PM outbound. . . . . 138
4.34 Breakdown of the pa ket throughput time series for UNC 1 PM outbound. . . . 138
4.35 Breakdown of the byte throughput time series for the three UNC tra es. . . . . 140
PR
4.36 Breakdown of the pa ket throughput time series for the three UNC tra es. . . . 140
4.37 Byte throughput marginals of Leipzig-II inbound, its normal distribution t, the
marginal distribution of its Poisson arrival t, and the normal distribution t of
this Poisson arrival t. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141
4.38 Pa ket throughput marginals of Leipzig-II inbound, its normal distribution t,
the marginal distribution of its Poisson arrival t, and the normal distribution
t of this Poisson arrival t. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 142
4.39 Byte throughput marginals of UNC 1 PM outbound, its normal distribution t,
the marginal distribution of its Poisson arrival t, and the normal distribution
t of this Poisson arrival t. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143
4.40 Pa ket throughput marginals of UNC 1 PM outbound, its normal distribution t,
the marginal distribution of its Poisson arrival t, and the normal distribution
t of this Poisson arrival t. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 144
xiv
4.41 Quantile-quantile plots with simulation envelops for the marginal distribution of
Leipzig-II inbound. The top four plots show byte throughput, while the four
bottom plots show pa ket throughput. . . . . . . . . . . . . . . . . . . . . . . . 146
4.42 Quantile-quantile plots with simulation envelops for the marginal distribution of
UNC 1 PM outbound. The top four plots show byte throughput, while the four
bottom plots show pa ket throughput. . . . . . . . . . . . . . . . . . . . . . . . 147
4.43 Wavelet spe tra of the pa ket throughput time series for Leipzig-II inbound and
its Poisson arrival t. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
4.44 Wavelet spe tra of the byte throughput time series for Leipzig-II inbound and
its Poisson arrival t. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
4.45 Wavelet spe tra of the pa ket throughput time series for Abilene-I. . . . . . . . 154
4.46 Wavelet spe tra of the byte throughput time series for Abilene-I. . . . . . . . . . 154
W
4.47 Wavelet spe tra of the pa ket throughput time series for UNC 1 PM. . . . . . . 155
4.48 Wavelet spe tra of the byte throughput time series for UNC 1 PM. . . . . . . . 155
IE
4.49 Breakdown of the a tive onne tions time series for Leipzig-II. . . . . . . . . . . 157
4.50 Impa t of the de nition of a tive onne tion on Leipzig-II. . . . . . . . . . . . . 157
EV
4.51 Breakdown of the a tive onne tions time series for Abilene-I. . . . . . . . . . . 158
4.52 Impa t of the de nition of a tive onne tion on Abilene-I. . . . . . . . . . . . . . 158
4.53 Breakdown of a tive onne tions time series for UNC 1 PM using both de nitions
of a tive onne tion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159
PR
4.54 Impa t of the time-of-day on the a tive onne tions time series for the three UNC
tra es. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159
xv
5.7 Bodies and tails of the TA distributions for Leipzig-II and its sour e-level tra e
replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 177
5.8 Bodies and tails of the TB distributions for Leipzig-II and its sour e-level tra e
replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 179
5.9 Bodies of the round-trip time and re eiver window size distributions for Leipzig-II
and its sour e-level tra e replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . 180
5.10 Bodies the loss rate distributions for Leipzig-II and its sour e-level tra e replays,
with probabilities omputed per onne tion (left) and per byte (right). . . . . . . 181
5.11 Bodies and tails of the A distributions for UNC 1 PM and its sour e-level tra e
replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183
5.12 Bodies and tails of the B distributions for UNC 1 PM and its sour e-level tra e
replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184
W
5.13 Bodies and tails of the E distributions for UNC 1 PM and its sour e-level tra e
replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184
5.14 Bodies and tails of the TA distributions for UNC 1 PM and its sour e-level tra e
IE
replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 185
5.15 Bodies and tails of the TB distributions for UNC 1 PM and its sour e-level tra e
replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 185
EV
5.16 Bodies of the round-trip time and re eiver window size distributions for UNC 1
PM and its sour e-level tra e replays. . . . . . . . . . . . . . . . . . . . . . . . . 186
5.17 Bodies of the loss rate distributions for UNC 1 PM and its sour e-level tra e
PR
replays, with probabilities omputed per onne tion (left) and per byte (right). . 187
5.18 Bodies and tails of the A distributions for Abilene-I and its sour e-level tra e
replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188
5.19 Bodies and tails of the B distributions for Abilene-I and its sour e-level tra e
replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188
5.20 Bodies and tails of the E distributions for Abilene-I and its sour e-level tra e
replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188
5.21 Bodies and tails of the TA distributions for Abilene-I and its sour e-level tra e
replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189
5.22 Bodies and tails of the TB distributions for Abilene-I and its sour e-level tra e
replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 190
5.23 Bodies of the round-trip time and re eiver window size distributions for Abilene-I
and its sour e-level tra e replays. . . . . . . . . . . . . . . . . . . . . . . . . . . . 191
xvi
5.24 Bodies of the loss rate distributions for Abilene-I and its sour e-level tra e re-
plays, with probabilities omputed per onne tion (left) and per byte (right). . . 191
6.1 Byte throughput time series for Leipzig-II inbound and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201
6.2 Byte throughput time series for Leipzig-II outbound and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202
6.3 Pa ket throughput time series for Leipzig-II inbound and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203
6.4 Pa ket throughput time series for Leipzig-II outbound and its four types of
sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205
6.5 Byte throughput marginals for Leipzig-II inbound and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206
W
6.6 Byte throughput marginals for Leipzig-II outbound and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 209
IE
6.7 Pa ket throughput marginals for Leipzig-II inbound and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 209
6.8 Pa ket throughput marginals for Leipzig-II outbound and its four types of sour e-
EV
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210
6.9 Wavelet spe tra of the byte throughput time series for Leipzig-II inbound and
its four types of sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . 212
6.10 Wavelet spe tra of the byte throughput time series for Leipzig-II outbound and
PR
xvii
6.17 Pa ket throughput time series for UNC 1 PM outbound and its four types of
sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221
6.18 Byte throughput marginals for UNC 1 PM inbound and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221
6.19 Byte throughput marginals for UNC 1 PM outbound and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222
6.20 Pa ket throughput marginals for UNC 1 PM inbound and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 223
6.21 Pa ket throughput marginals for UNC 1 PM outbound and its four types of
sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224
6.22 Wavelet spe tra of the byte throughput time series for UNC 1 PM inbound and
its four types of sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . 225
W
6.23 Wavelet spe tra of the byte throughput time series for UNC 1 PM outbound and
its four types of sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . 225
6.24 Wavelet spe tra of the pa ket throughput time series for UNC 1 PM inbound
IE
and its four types of sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . 228
6.25 Wavelet spe tra of the pa ket throughput time series for UNC 1 PM outbound
and its four types of sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . 228
EV
6.26 A tive onne tion time series for UNC 1 PM and its four types of sour e-level
tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 229
6.27 Byte throughput time series for UNC 1 AM inbound and its four types of sour e-
PR
xviii
6.34 Pa ket throughput marginals for UNC 1 AM outbound and its four types of
sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 238
6.35 Wavelet spe tra of the byte throughput time series for UNC 1 AM inbound and
its four types of sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . 240
6.36 Wavelet spe tra of the byte throughput time series for UNC 1 AM outbound and
its four types of sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . 240
6.37 Wavelet spe tra of the pa ket throughput time series for UNC 1 AM inbound
and its four types of sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . 241
6.38 Wavelet spe tra of the pa ket throughput time series for UNC 1 AM outbound
and its four types of sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . 241
6.39 A tive onne tion time series for UNC 1 AM and its four types of sour e-level
tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242
W
6.40 Byte throughput time series for UNC 7:30 PM inbound and its four types of
sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 243
6.41 Byte throughput time series for UNC 7:30 PM outbound and its four types of
IE
sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 243
6.42 Pa ket throughput time series for UNC 7:30 PM inbound and its four types of
sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 244
EV
6.43 Pa ket throughput time series for UNC 7:30 PM outbound and its four types of
sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 245
6.44 Byte throughput marginals for UNC 7:30 PM inbound and its four types of
PR
xix
6.51 Wavelet spe tra of the pa ket throughput time series for UNC 7:30 PM outbound
and its four types of sour e-level tra e replay. . . . . . . . . . . . . . . . . . . . . 250
6.52 A tive onne tion time series for UNC 7:30 PM and its four types of sour e-level
tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 251
6.53 Byte throughput time series for Abilene-I Clev/Ipls and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252
6.54 Byte throughput time series for Abilene-I Ipls/Clev and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252
6.55 Pa ket throughput time series for Abilene-I Clev/Ipls and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 253
6.56 Pa ket throughput time series for Abilene-I Ipls/Clev and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254
W
6.57 Byte throughput marginals for Abilene-I Clev/Ipls and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254
6.58 Byte throughput marginals for Abilene-I Ipls/Clev and its four types of sour e-
IE
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 255
6.59 Pa ket throughput marginals for Abilene-I Clev/Ipls and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 255
EV
6.60 Pa ket throughput marginals for Abilene-I Ipls/Clev and its four types of sour e-
level tra e replay. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 256
6.61 Wavelet spe tra of the byte throughput time series for Abilene-I Clev/Ipls and
PR
7.1 Bodies of the distributions of onne tion inter-arrivals for UNC 1 PM and 1 AM,
and their exponential ts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266
7.2 Tails of the distributions of onne tion inter-arrivals for UNC 1 PM and 1 AM,
and their exponential ts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266
xx
7.3 Bodies of the distributions of onne tion inter-arrivals for Abilene-I and Leipzig-
II, and their exponential ts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266
7.4 Tails of the distributions of onne tion inter-arrivals for Abilene-I and Leipzig-II,
and their exponential ts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266
7.5 Average o ered load vs. number of onne tions for 1,000 Poisson resamplings of
UNC 1 PM. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268
7.6 Histogram of the average o ered loads in 1,000 Poisson resamplings of UNC 1 PM.268
7.7 Tails of the distributions of onne tion sizes for UNC 1 PM. . . . . . . . . . . . . 270
7.8 Analysis of the a ura y of onne tion-driven Poisson Resampling from 6,000
resamplings of UNC 1 PM (1,000 for ea h target o ered load). . . . . . . . . . . 270
7.9 Comparison of average o ered load vs. number of onne tions for 1,000 onne tion-
driven Poisson resamplings and 1,000 byte-driven Poisson resamplings of UNC 1
W
PM. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271
7.10 Histogram of the average o ered loads in 1,000 byte-driven Poisson resamplings
of UNC 1 PM. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271
IE
7.11 Analysis of the a ura y of byte-driven Poisson Resampling from 4,000 resam-
plings of UNC 1 PM (1,000 for ea h target o ered load). . . . . . . . . . . . . . . 273
EV
7.12 Analysis of the a ura y of byte-driven Poisson Resampling using sour e-level
tra es replay: replays of three separate resamplings of UNC 1 PM for ea h target
o ered load, illustrating the s aling down of load from the original 177.36 Mbps. 274
7.13 Analysis of the a ura y of byte-driven Poisson Resampling using testbed ex-
PR
xxi
7.20 Blo k resamplings of UNC 1 PM: average o ered load vs. number of onne tion
ve tors (left) and orresponding histograms of average o ered loads (right) in
3,000 resamplings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282
7.21 Wavelet spe tra of several random subsamplings of the onne tion ve tors in
UNC 1 PM (left) and 1 AM (right) . . . . . . . . . . . . . . . . . . . . . . . . . . 283
7.22 Analysis of the a ura y of byte-driven Blo k Resampling using sour e-level tra e
replay: replays of two separate resamplings of UNC 1 PM for ea h target o ered
load, illustrating the s aling down of load from the original 177.36 Mbps. . . . . 285
7.23 Analysis of the a ura y of byte-driven Blo k Resampling using sour e-level tra e
replay: replay of one resampling of UNC 1 AM for ea h target o ered load,
illustrating the s aling up of load from the original 91.65 Mbps. . . . . . . . . . . 285
7.24 Wavelet spe tra of the pa ket arrival time series for UNC 1 PM and the sour e-
level tra e replays of two blo k resamplings of this tra e. . . . . . . . . . . . . . . 286
W
7.25 Wavelet spe tra of the pa ket arrival time series for UNC 1 PM and the sour e-
level tra e replays of three Poisson resamplings of this tra e. . . . . . . . . . . . . 286
IE
EV
PR
xxii
LIST OF ABBREVIATIONS
W
Complementary Cumulative Distribution Fun tion
CDF Cumulative Distribution Fun tion
DAG
IE
Data A quisition and Generation
FIFO First-In First-Out
FIN TCP ontrol ag indi ating \no more data from sender".
EV
xxiii