Professional Documents
Culture Documents
Deterministic Quality of Service Guarantee For Dynamic Service Chaining in Software Defined Networking
Deterministic Quality of Service Guarantee For Dynamic Service Chaining in Software Defined Networking
Deterministic Quality of Service Guarantee For Dynamic Service Chaining in Software Defined Networking
Abstract—In this paper, we present a systemic approach to The key to the success of dynamic service chaining in SDN
provide deterministic delay guarantee for dynamic service chain- is to satisfy the quality of service (QoS) requirements for each
ing in software defined networking (SDN). The delay performance individual customer. To achieve this goal, three challenges
of service chaining in SDN is affected by signaling message
exchange in control plane and packet transmissions in data plane, must be overcome:
respectively. First, we develop an analytical method to charac- • Accurate VM workload estimation [3];
terize the delay performance of control plane when handling • Flow-based QoS evaluation for multiple data flows shar-
traffic with different priorities according to network calculus ing the same physical links and nodes [4];
(NC) and queuing theory. Second, taking into account the esti- • Adaptation for rapid network topology changes [5].
mated delay in control plane, we propose a novel service traversal
mechanism to calculate the optimal traversal path for the service The aforementioned challenges in providing QoS guarantees
chain. We demonstrate that NC delay analysis can provide deter- require joint modeling and analysis of both control and data
ministic quality of service (QoS)-guaranteed service chaining for plane. To our best knowledge, how to provide end-to-end
any specified delay requirements, whereas theoretical queueing deterministic delay grantee in service chaining simultaneously
delay analysis can only provide statistical QoS guarantee. In sum- taking into account of both control and data planes is still an
mary, the proposed NC delay analysis can help to understand
the network design for a future delay sensitive Internet in which open issue.
deterministic latency must be guaranteed. In this paper, we aim to propose a systematic design
methodology to provide QoS-guaranteed service chaining
Index Terms—Service chaining, software defined networking,
quality of service. in SDN, considering the effects of both signaling message
exchange in the control plane and packet transmissions in the
data plane. The importance of including delay performance
I. I NTRODUCTION in the control plane lies in the fact that unexpected bursts or
OFTWARE defined networking (SDN) is shifting the
S paradigm of information service networks to automate
resource provision with more flexibility and to optimize
collapsed VM-based network functions may request the con-
trol plane to recreate a service chaining process for deciding a
new service traversal. We suggest an analytical service chain-
network performance more effectively and without geograph- ing performance model for SDN meeting deterministic QoS
ical limitation. To obtain such advantages, SDN separates requirements. The proposed systematic analysis methodology
data and control planes by utilizing a centralized controller contains the following two key elements.
to manage the dynamic behavior of the entire network. • Delay Performance Evaluation in SDN Control Plane:
Service chaining is one of the key features for SDN. With We apply queuing theory and network calculus (NC)
this feature, SDN can dynamically connect virtual machines to calculate the delay performance of the SDN con-
(VMs) with various functions to establish new services based troller in supporting various traffic types with different
on user requirements and network conditions [1]. For example, priorities. Queuing theory and NC can estimate the aver-
an advanced security service chaining can request the firewall age delay and the deterministic delay bound of service
and intrusion detection functions to inspect data sequentially, chaining, respectively. The derived average and deter-
whereas a regular security service chaining process can only ministic delay performances can be used to specify the
use the firewall server. Versatile service chaining processes delay constraints of service chain traversal in the data
have the great potential for creating new cloud services [2]. plane of SDN.
• Path determination with Delay Constraints in SDN Data
Manuscript received March 18, 2017; revised July 4, 2017, September 8,
2017, and September 19, 2017; accepted September 27, 2017. Date of publi- Plane: We develop an optimal path determination algo-
cation September 29, 2017; date of current version December 8, 2017. This rithm for service chaining with minimum workload of
work was supported by the Ministry of Science and Technology, Taiwan, network functions subject to the delay constraint of
under Contract MOST 106-2221-E-009-027. The associate editor coordinat-
ing the review of this paper and approving it for publication was W. Kellerer. service chain traversal.
(Corresponding author: Li-Chun Wang.) With the designed systematic methodology, we can explic-
The authors are with the Department of Electrical and Computer itly determine the service chaining sequence and its routing
Engineering, National Chiao Tung University, Hsinchu 300, Taiwan (e-mail:
lichun@g2.nctu.edu.tw). path under different traffic loads and network sizes. Our exper-
Digital Object Identifier 10.1109/TNSM.2017.2758328 iments show that the proposed methodology can result in
1932-4537 c 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
Authorized licensed use limited to: Universidade Estadual de Ponta Grossa. Downloaded on March 18,2020 at 02:34:25 UTC from IEEE Xplore. Restrictions apply.
992 IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, VOL. 14, NO. 4, DECEMBER 2017
Authorized licensed use limited to: Universidade Estadual de Ponta Grossa. Downloaded on March 18,2020 at 02:34:25 UTC from IEEE Xplore. Restrictions apply.
CHEN et al.: DETERMINISTIC QUALITY OF SERVICE GUARANTEE FOR DYNAMIC SERVICE CHAINING IN SDN 993
Authorized licensed use limited to: Universidade Estadual de Ponta Grossa. Downloaded on March 18,2020 at 02:34:25 UTC from IEEE Xplore. Restrictions apply.
994 IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, VOL. 14, NO. 4, DECEMBER 2017
TABLE I
N OTATIONS IN T HIS PAPER
IV. S YSTEM M ODEL AND P ROBLEM F ORMULATION We now formulate the path determination problem of ser-
We now discuss the system model of the service chain- vice chaining. Consider a network represented by a directed
ing in SDN. The service chaining scenario considered in this simple graph G(M, L), where M is the set of all VM-based
paper consists of several distributed VM-based network func- network functions and L is the set of all links. We denote an
tions and a centralized OpenFlow controller. To achieve delay ordered pair outgoing from node i and incoming to node j by
guarantee TDelay , both the service chaining decision delay TC link (i, j). Let Rst be the set of all the paths from source node
and the service chain traversal delay TD should be considered s to destination node t. For a path r ∈ Rst , we define the load
as shown in Fig. 3. When data flows arrive at the OpenFlow function fC and the delay function fD as
switches, the OpenFlow controller decides the optimal setting
of the service chaining, including the network function selec-
fC (r) = max {ck } (5)
tion and the traversal path decision. This kind of operation 1≤k≤m(r)
delay is called the service chaining decision delay TC . Then,
the data flows traverse the corresponding VMs with the speci- and
fied network functions. The total service chain traversal delay
is denoted as TD . As a result, the relation of the user’s delay
m(r)
requirement and the service chaining delay is written as fD (r) = dk , (6)
k=1
TDelay = TC + TD . (3)
To achieve the deterministic delay requirement, we adopt where ck is the load of the kth VM-based network function,
the upper bound of the service chaining decision delay m(r) is the number of VM-based network functions on path
TC_upperbound in determining the delay constraint on the data r, and dk is the delay metric for the kth VM-based network
plane function. The path determination problem in service chain-
ing is to find a routing path r∗ with the minimum VM-based
TD_constraint = TDelay − TC_upperbound , (4)
network function loading fC subject to the delay constraint
where TD_constraint will be the constraint for the optimal path fD (r∗ ) ≤ TD_constraint . Table I summarizes the notations used
determination problem of the service chaining. in this paper.
Authorized licensed use limited to: Universidade Estadual de Ponta Grossa. Downloaded on March 18,2020 at 02:34:25 UTC from IEEE Xplore. Restrictions apply.
CHEN et al.: DETERMINISTIC QUALITY OF SERVICE GUARANTEE FOR DYNAMIC SERVICE CHAINING IN SDN 995
Authorized licensed use limited to: Universidade Estadual de Ponta Grossa. Downloaded on March 18,2020 at 02:34:25 UTC from IEEE Xplore. Restrictions apply.
996 IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, VOL. 14, NO. 4, DECEMBER 2017
flow arrives. In this case, the incoming data flow must proposed scheme. The LARAC algorithm can solve the dual
wait for the low priority data flow in the controller. After problem of the CSP problem. It follows that
this low priority data flows leave the controller, the high
priority data flows can be served, which can be reduced maximize min{fλ (r) − λDmax |r ∈ Rst }
to the first case. Thus, the delay bound consists of the subject to λ ≥ 0, (22)
service time of a low priority data flow and the delay
where λ is the Lagrangian multiplier and
bound of the first case.
lmaxL fλ (r) = (ck + λdk ). (23)
c (t) ≤
Dh2 c ,
+ Dh1 (18) k∈m
c
L
where lmax is the maximum data size of the low priority Note that fλ (r) represents the aggregated cost for path r ∈
flow and Dh1 Rst . The lower bound for the optimal solution of (20) can be
c is the delay bound for the first case.
• For the low priority traffic, the worst case is that it must obtained by finding {fλ (r)|r ∈ Rst } with Dijkstra’s shortest path
wait until all the other low priority traffic leaves the algorithm because
system. Hence, the low priority data flows are guaranteed min{fλ (r) − λDmax |r ∈ Rst } = {fλ (r)|r ∈ Rst } − λDmax . (24)
by a service rate of curve c − α h and the delay bound is
written as Algorithm 1 shows the LARAC algorithm, where c is the
b vector of network function loading fC , d is the vector of delay
Dlc (t) ≤ , (19) coefficients fD , and fλ is the vector of aggregated loading
c − αh
coefficients fλ . The procedures of Algorithm 1 are described
where b is the maximum buffer size of the system. as follows.
1) The algorithm calculates the shortest path with network
VI. O PTIMAL PATH D ETERMINATION function loading, which is denoted by pC . If a path meets
IN S ERVICE C HAINING the delay constraint TD_constraint , it is the optimal path
Now we show how to determine the optimal path of ser- with minimum loading. Otherwise, the algorithm stores
vice chaining in the OpenFlow controller. Because a data flow the path as the best path that does not satisfy TD_constraint
traverses a set of VM-based network functions sequentially in and computes the shortest path with delay coefficients,
the service chaining, the delay performance of service chain- which is denoted by pD . If pD still cannot meet the delay
ing is also affected by the VM-based network functions in requirement, there is no solution to this problem.
the data plane. Hence, referring to the load function defined 2) With λ = ffDC (p C )−fC (pD )
(pD )−fD (pC ) , we can find a new shortest
in (5), the path determination problem in service chaining can path r with aggregated cost fλ given in equation (23).
be defined to find a routing path with the minimum load of If fλ (r) = fλ (pC ), the optimal λ is obtained as proved
these network functions. Based on the aforementioned worst in [32]. Otherwise, either pD or pC is replaced with r
case delay performance of the OpenFlow controller, we can according to whether the delay constraint is satisfied
obtain the constraint TD_constraint for service chain traversal or not.
delay as in (4). This constraint gives the maximum amount The complexity of the LARAC algorithm is O([m + n log n]2 ),
of time that can be spent in all the network functions on a where m and n are the total number of network functions and
service chaining path. links, respectively [31].
We model the path determination problem as a constrained
shortest path (CSP) problem. The CSP problem can be VII. P ROVIDING D ETERMINISTIC Q O S-G UARANTEED
formally stated as follows: S ERVICE C HAINING IN SDN
Now we discuss how the delay analysis in Sections V and VI
r∗ = arg min fC (r)|fD (r) ≤ TD_constraint , fG (r) = 0 , (20)
r∈Rst can be applied to provide deterministic QoS-guaranteed ser-
vice chaining. According to (4), TD_constraint can be obtained
where fG (r) = (i,j)∈r gij is the network congestion measure
by subtracting the derived TC_upperbound from a given delay
for the traffic on path r. In practice, a link is congested if link
requirement TDelay . Next, we solve the shortest path determi-
utilization exceeds 70% [29]. Here we define gij as
nation problem for service chaining subject to the constraint
Tij −0.7×Bij fD (r) ≤ TD_constraint .
, 0.7 × Bij < Tij
gij = Tij , (21) Figure 5 illustrates the system flow of the proposed deter-
0, 0.7 × Bij ≥ Tij
ministic QoS-guaranteed service chaining. First, a service
where Tij is the total measured traffic amount in bps and Bij is chain is defined by the requested network functions and its
the max achievable bandwidth in bps on link (i, j). With this delay requirement. Then the system dynamically monitors the
network congestion constraint, we can avoid link overloading traffic load of each link and the CPU usage of the VM-based
for a large number of paths with the same Rst . network functions, which affect the delay performance in the
In (20), we find the minimum load service chaining path control plane. After that, LARAC algorithm can be used to
r∗ satisfying a specified delay requirement. Since the CSP solve a path determination problem. If we cannot find a ser-
problem is NP-complete [30], we apply the Lagrangian relax- vice chain satisfying the delay requirement, some VM-based
ation based aggregated cost (LARAC) algorithm [31] in our network functions are added to reduce the delay performance.
Authorized licensed use limited to: Universidade Estadual de Ponta Grossa. Downloaded on March 18,2020 at 02:34:25 UTC from IEEE Xplore. Restrictions apply.
CHEN et al.: DETERMINISTIC QUALITY OF SERVICE GUARANTEE FOR DYNAMIC SERVICE CHAINING IN SDN 997
Authorized licensed use limited to: Universidade Estadual de Ponta Grossa. Downloaded on March 18,2020 at 02:34:25 UTC from IEEE Xplore. Restrictions apply.
998 IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, VOL. 14, NO. 4, DECEMBER 2017
Authorized licensed use limited to: Universidade Estadual de Ponta Grossa. Downloaded on March 18,2020 at 02:34:25 UTC from IEEE Xplore. Restrictions apply.
CHEN et al.: DETERMINISTIC QUALITY OF SERVICE GUARANTEE FOR DYNAMIC SERVICE CHAINING IN SDN 999
Fig. 8. Delay performance of OpenFlow controller with different VM scales Fig. 10. Instantaneous delay performance of the service chaining paths with
and traffic generation rate. different delay requirements.
Fig. 9. Experiment scenario of security service chaining. Fig. 11. Statistical delay performance of the service chaining paths with
different delay requirements.
Authorized licensed use limited to: Universidade Estadual de Ponta Grossa. Downloaded on March 18,2020 at 02:34:25 UTC from IEEE Xplore. Restrictions apply.
1000 IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, VOL. 14, NO. 4, DECEMBER 2017
TABLE IV
C OMPARISON OF THE D ELAY V IOLATION FOR D IFFERENT R E -T RAVERSAL P ERIODS W ITHIN 60 U NIT T IME
Fig. 12. Instantaneous delay performance of the four service chaining paths Fig. 14. Statistical delay performance of the service chaining paths with
and the proposed dynamic service chaining scheme with re-traversal period different re-traversal periods.
equal to one unit time.
Authorized licensed use limited to: Universidade Estadual de Ponta Grossa. Downloaded on March 18,2020 at 02:34:25 UTC from IEEE Xplore. Restrictions apply.
CHEN et al.: DETERMINISTIC QUALITY OF SERVICE GUARANTEE FOR DYNAMIC SERVICE CHAINING IN SDN 1001
Authorized licensed use limited to: Universidade Estadual de Ponta Grossa. Downloaded on March 18,2020 at 02:34:25 UTC from IEEE Xplore. Restrictions apply.
1002 IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, VOL. 14, NO. 4, DECEMBER 2017
Li-Chun Wang (M’96–SM’06–F’11) received the Feng-Yi Lin was born in Taiwan, in 1989. He
B.S. degree from National Chiao Tung University, received the B.S. degree in computer science from
Taiwan, in 1986, the M.S. degree from National National Chiayi University in 2011 and the M.S.
Taiwan University in 1988, and the Ms.Sci. degree from National Chiao Tung University in
and Ph.D. degrees from the Georgia Institute of 2014. His current research interests include software
Technology, Atlanta, in 1995, and 1996, respec- defined networking and network security.
tively, all in electrical engineering.
From 1990 to 1992, he was with the
Telecommunications Laboratories, Chunghwa
Telecom Company. In 1995, he was affiliated with
Bell Northern Research of Northern Telecom,
Inc., Richardson, TX, USA. From 1996 to 2000, he was with AT&T
Laboratories, where he was a Senior Technical Staff Member with the
Wireless Communications Research Department. Since 2000, he has been
with the Department of Electrical and Computer Engineering, National
Chiao Tung University, where he is currently the Chairman. His current
research interests are in the areas of radio resource management and
cross-layer optimization techniques for wireless systems, heterogeneous
wireless network design, and cloud computing for mobile applications. Bao-Shuh Paul Lin received the Ph.D. degree in
Dr. Wang has published over 200 journal and international conference computer science from the University of Illinois
papers. He holds 10 U.S. patents. He was a recipient of the Distinguished at Chicago, IL, USA. He has been a Chair
Research Award of National Science Council, Taiwan, in 2012, and was Professor with the Department of Computer Science
elected to the IEEE Fellow Grade in 2011 for his contributions to cellular and the Chief Director of Microelectronics and
architectures and radio resource management in wireless networks. He was Information Systems Research Center, National
a co-recipient (with G. L. Stuber and C.-T. Lea) of the 1997 IEEE Jack Chiao Tung University, Hsinchu, Taiwan, since
Neubauer Best Paper Award for his paper “Architecture Design, Frequency 2009. He has also been the Director of Committee
Planning, and Performance Analysis for a Microcell/Macrocell Overlaying of Communication Industry Development, Ministry
System,” in IEEE T RANSACTIONS ON V EHICULAR T ECHNOLOGY. He of Economic Affairs since 2001. He was the Vice
served as an Associate Editor for the IEEE T RANSACTIONS ON W IRELESS President of Industrial Technology Research Institute
C OMMUNICATIONS from 2001 to 2005 and the Guest Editor of Special (ITRI) from 2001 to 2009 and the General Director of the Information and
Issue on “Mobile Computing and Networking” for the IEEE J OURNAL Communications Research Laboratories (ICL), ITRI from 2001 to 2009. From
ON S ELECTED A REAS IN C OMMUNICATIONS in 2005, “Radio Resource 1979 to 1991, he was with Bell Labs of Lucent Technologies, Boeing, and
Management and Protocol Engineering in Future Broadband Networks” for two other high-tech firms before coming back to Taiwan in 1991. From
the IEEE Wireless Communications Magazine in 2006, and “Networking 1991 to 1998, he worked for ITRI and served as the Director of Computer
Challenges in Cloud Computing Systems and Applications,” for the IEEE Communications Research Division in CCL (the forerunner of ICL) and was
J OURNAL ON S ELECTED A REAS IN C OMMUNICATIONS in 2013. later promoted to its Deputy General Director.
Authorized licensed use limited to: Universidade Estadual de Ponta Grossa. Downloaded on March 18,2020 at 02:34:25 UTC from IEEE Xplore. Restrictions apply.