Professional Documents
Culture Documents
Optimization of Cache-Enabled Opportunistic Interference Alignment Wireless Networks: A Big Data Deep Reinforcement Learning Approach
Optimization of Cache-Enabled Opportunistic Interference Alignment Wireless Networks: A Big Data Deep Reinforcement Learning Approach
Abstract: With the increase of network ments and services, the complexity of network
complexity, the flexibility of network control control and management has risen sharply
and management becomes a nontrivial in recent years. The QoS management is an
problem. Both Software Defined Network important part of network management. Var-
(SDN) and Autonomic Network technologies ious QoS models and mechanisms have been
are sophisticated technologies for the proposed, but there is no one-fit-all algorithm.
network control and management. These two The advantages and disadvantages of the dif-
technologies could be combined together to ferent combinations of queue management and
construct a software defined self-managing scheduling, which works at different context
solution for the future network. An autonomic conditions (various workloads or transmission
QoS management mechanism in Software mediums), are analyzed [1]. Currently, differ-
Defined Network (AQSDN) is proposed ent services or applications want to obtain the
in this paper. In AQSDN, the various QoS different network resource for fulfilling their
features can be configured autonomically in requirements. So the self-configurable QoS
an OpenFlow switch through extending the models and mechanisms based on the con-
OpenFlow and OF-Config protocols. Based text-aware are highly expected.
on AQSDN, a novel packet context-aware In order to reduce the network management
QoS model (PCaQoS) is also introduced for cost and the probability of network failure,
improving the network QoS. PCaQoS takes autonomic network technologies is introduced
packet context into account when packet in network control and management, and self-
is marked and managed into forwarding * attributions with the MAPE-K [2] or similar
queues. The implementation of a video model are defined. The self-* attributions
application’s prototype which evaluates the include self-configuration, self-protecting,
self-configuration feature of the AQSDN and self-healing and self-optimization/adjusting
the enhancement ability of the PCaQoS is [3]. The autonomic function is also considered
presented in order to validate this design. as an important component in many projects
Keywords: software defined network; [4-8] which focused on future network archi-
autonomic management; context aware; tecture.
quality of service (QoS) Software Defined Network (SDN) separates
the control plane and the data plane, some
I. INTRODUCTION network control and management functions
could be implemented through the software
As the increment of various network equip- instead of updating huge numbers of network
The existing OpenFlow protocol defines the 3.2.2 The enforcement of the QoS rules
message about the configuration of the flow OF-Config is transported using NetConf pro-
table, the group table and meter table. The en- tocol. Through choosing suitable operation
queue/set-queue action specifies which queue (e.g. <get-config>, <edit-config>), we can
attached to a port should be entered by a flow. achieve and set the configuration of the re-
And the meter table and meter band provide
the meter operation for flow. However, the
existing remarking bands, which only lower Band
Rate Counters
Spec_arg #1 Spec_arg #1
Type Type Length
the drop precedence level of the packet, does
Spec_arg #1 Value
not satisfy various QoS requirement. So it is
necessary to extend OpenFlow protocol so that
...
CIR
packets of a service present three kinds of pri-
ority (high, middle and low) and the mapping
relationships from meter result to remarking EBS
color are listed in Table I. CBS
management
...
The PCaQM coordinates closely with the mapping
Precedence level
PCaPM. If an integrated flow is marked k col- Packet
header
relationship
ES 1 S3 D1
II. These videos are coded and encoded by
S1 ES
D2 H.264/AVC JM 18.5 [24]. The video format is
……
S10
Db6 Common Intermediate Format (CIF, 352x288
ES
S2 D11
S19
CS 1 CS 2
solution, 30fps). The packet semantic prece-
……
S20
ES 4
dence level of video flow is known as: PI>P-
P>PB, where PI, PP and PB are the priority of I
D20
Sb6 Medeia flow Background flow
(a) Coastguard
40
VI. CONCLUSIONS
PCaQoS_Pairs DiffServ_Pairs
20
zation improvement and network QoS guar-
anteeing are very complicated for network
10
operators. For solving this problem, research
0 communities propose lot of ideas on it. One
0 50 100 150 200 250Frame ID of them is to upgrade the network nodes with
autonomic abilities. In addition, Software
(b) Paris
Defined Network provides the capability
50 to implement network control and manage-
PCaQoS_Foreman DiffServ_Foreman
40 ment functions by software. In this paper, the
AQSDN architecture, which combines the
PSNR(dB)
30
advantages of the autonomic network manage-
20
ment and the SDN technologies, is proposed.
10 A novel QoS model which is called Packet
0 Context-aware QoS (PCaQoS) model is also
Frame ID
0 50 100 150 200 250 presented based on the AQSDN architecture.
(c) Foreman At the end, the self-configuration feature of
the AQSDN and t he enhancement of video
quality of the PCaQoS model are verified.
Fig.9 The PSNR comparisons of 300 continuous frames of three pairs videos across Although our algorithms have shown the
PCaQoS and DiffServ basded network respectively
feasibility in a simple network environment,
further verification research in more complicat-
as shown in Table III, and the configurations ed network environments and the extendibility
of the WRED and PCaQM are set as shown in evaluation of PCaQoS model in AQSDN ar-
Table IV. chitecture are our future research works.
No.2013AA013303, No.2013AA013301and
National Natural science foundation of China
No. 61370197 & 61271041.
References
original_Paris DiffServ_Paris PCAQoS_Paris
[1] Sivaraman, Anirudh, et al. No silver bullet: ex-
tending SDN to the data plane. Proceedings of
the Twelfth ACM Workshop on Hot Topics in
Networks. ACM, 2013.
[2] Kephart J O, Chess D M. The vision of autonom-
ic computing[J]. Computer, 2003, 36(1): 41-50.
original_Foreman DiffServ_Foreman PCAQoS_Foreman
[3] Miller. B. The autonomic computing edge: Can
you CHOP up autonomic computing? Technical
report, IBM, 2008. http://www.ibm.com/devel-
operworks/autonomic/library/ac-edge4. Fig.10 The screenshot comparisons of the 155th frame of three sets of videos
[4] EFIPSANS project. http://www.efipsans.org/. across PCaQoS and DiffServ based network respectively and their original images
[5] ANA (Autonomic Network Architecture) Project.
http://www.ana-project.org/.
[6] HAGGLE Project. http://www.haggleproject.org/
WREN 10 (2010): 1-1.
[7] CASCADAS project. http://www.cascadas-proj-
[15] Ishimori, Airton, et al. Control of Multiple Pack-
ect.org/.
et Schedulers for Improving QoS on OpenFlow/
[8] BIONETS project. http://www.bionets.eu/.
SDN Networking. Software Defined Networks
[9] OpenFlow Specification 1.3.0. https://www.
(EWSDN), 2013 Second European Workshop
opennetworking.org/images/stories/down-
on. IEEE, 2013.
loads/sdn-resources/onf-specifications/open-
[16] Tong ZHOU, GONG Xiangyang, Yannan HU, et
flow/openflow-spec-v1.3.0.pdf.
al. PindSwitch: A SDN-based Protocol-indepen-
[10] OpenFlow Management and Configuration
dent Autonomic Flow Processing Platform. Glo-
Protocol 1.1.1. https://www.opennetworking.
becom Workshops (GC Wkshps),2013:842-847.
org/images/stories/downloads/sdn-resources/
[17] Abowd G D, Dey A K, Brown P J, et al. Towards
onf-specifications/openflow-config/of-con-
a better understanding of context and con-
fig-1-1-1.pdf.
text-awareness[C]//Handheld and ubiquitous
[11] Civanlar S., Parlakisik M., Murat Tekalp et al,
computing. Springer Berlin Heidelberg, 1999:
A QoS-enabled OpenFlow environment for
304-307.
scalable video streaming[C]. in Proc. IEEE GLO-
[18] Xiangyang, Gong, Wang Wendong, and Li Yan.
BECOM Workshops (GC Workshops), 2010:
“A Novel Packet Marking Algorithm in Con-
351–356.
text-aware Autonomic QoS Framework.” CHINA
[12] Egilmez H E, Dane S T, Bagci K T, et al. Open-
COMMUNICATIONS, 2009: 98-107.
QoS: An OpenFlow controller design for mul-
[19] M. Allalouf, Y. Shavitt, A simulation study of
timedia delivery with end-to-end Quality of
multi-color marking of TCP aggregates, in Proc.
Service over Software-Defined Networks[C]//
of 32nd IEEE Conference on Local Computer
Signal & Information Processing Association
Networks (LCN 2007),. 2007:.376-386
Annual Summit and Conference (APSIPA ASC),
[20] Z. Cao, Z. Wang, and E. Zegura, Rainbow fair
2012: 1-8.
queuing: Fair bandwidth sharing without per-
[13] Bari M F, Chowdhury S R, Ahmed R, et al. Poli-
flow state, in Proc. of INFOCOM 2000, the 19th
cyCop: An Autonomic QoS Policy Enforcement
Annual Joint Conference of the IEEE Computer
Framework for Software Defined Networks[C].
and Communications Societies, 2000(2):922-
Software Defined Networks for Future Networks
931
and Services Conference (SDN4FNS), 2013,
[21] M. Allalouf, Y. Shavitt, A comparison of to-
Trento, Italy.
ken-bucket based multi-color marking tech-
[14] Kim, Wonho, et al. Automated and scalable QoS
niques, in Proc. of the 2006 ACM CoNEXT Con-
control for network convergence. Proc. INM/
ference, 2006:1-2