Professional Documents
Culture Documents
Performance Indicator of Telecommunication Service: January 2016
Performance Indicator of Telecommunication Service: January 2016
net/publication/313101244
CITATIONS READS
0 2,159
1 author:
Sigit Haryadi
Bandung Institute of Technology
111 PUBLICATIONS 224 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Sigit Haryadi on 31 January 2017.
Basically, the performance parameters of telecommunications services are very many, refer to
Chapter 1 of this study, how to categorize the performance parameters can also vary. Thus,
there needs a guidance to composing a performance indicator groups are considered the most
important to have become a KPI (Key Performance Indicator).
1
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service - Chapter 2. Institut Teknologi Bandung. ISBN 978-602-18578-6-1
Providers should develop a KPI (Key Performance Indicator). KPI arranged on several
considerations.
2) the company's performance standards to be wider than the standards set by the
National Regulatory Body, for that provider must learn and referring to the international
standards and Recommendations of the ITU-T, ETSI, IEEE, ANSI and others. Pengertian
lebih luas di sini, dalam arti performance parameter lebih lengkap dan target value harus
lebih baik.
as the key parameter, for its task is necessary to do the benchmarking with the
standards of various world class telecom operators and National Regulatory Bodies in
the world. All performance parameters each of which is accompanied by a target value
2
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service - Chapter 2. Institut Teknologi Bandung. ISBN 978-602-18578-6-1
is selected to be the key parameters. The key parameters must be ensured included in
4) The final consideration is the SLA (service level agreement) between providers and
customers.
ITU-T is an agency under the United Nations, thus being the most fair of reference materials, all
member countries, should pay attention to the recommendations they make. But the ITU-T
Recommendations are so many, thus every provider should have some staff, which specifically
follows the development of the recommendations issued by the ITU, particularly with respect
The telecommunications regulatory body in each country has different qualities, when the
regulator is good, then they were able to formulate the rules of good performance of
telecommunications services and must be obeyed by every provider. A good rule is, able to be
met by the provider while satisfying customers. It's also not an easy job. Customer satisfaction
is also influenced by the rates they pay. For example, customers will complain the service
providers when they pay more expensive than other provider’s rates, whereas at other
providers who charge less, the performance is worse, and no one complained.
SLA is one of the reasons that the provider should monitor traffic at every moment, in every
place and at every service. Through SLA, the provider promises to serve customers by meeting
3
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service - Chapter 2. Institut Teknologi Bandung. ISBN 978-602-18578-6-1
specific performance requirements, and they get paid, if the SLA is not met, the payment cannot
parameter. Determination of target values is a thing that is certainly needed a long time. Often
happen that the target values should be changed, adapted to the circumstances that occurred.
1) The target value of the KPI provider parameters should be higher than the target value
set by the regulatory body. For example, regulators set a target for 90% of the Chats and
the target of endto-end delay is not allowed to exceed 1 minute, then the provider
2) Each period, about 6 months to 1 year, the target values should be evaluated.
a. The target value should be increased, if the target is too easy to be reached by
b. The target value may be derived, for example, if inflation rises, the income per
4
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service - Chapter 2. Institut Teknologi Bandung. ISBN 978-602-18578-6-1
Regulators will probably set a target value for a particular provider, which is different than any
other provider. The target value should be higher, if the tariff is more expensive.
5
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service - Chapter 2. Institut Teknologi Bandung. ISBN 978-602-18578-6-1
VALUE
Performance
Indicator
6
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service - Chapter 2. Institut Teknologi Bandung. ISBN 978-602-18578-6-1
1000 subscriber
• Network availability
• Connection Establishment
(Accessibility)
• Connection Maintenance
(Retainability)
• Point Of Interconnection
• Metering and Billing
• Response time to the
customer for assistance of
Termination services
7
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service - Chapter 2. Institut Teknologi Bandung. ISBN 978-602-18578-6-1
8
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
Association etc. referring to the international standard, each national regulatory bodies
• Each international standard bodies may have different definition of QoS parameters.
Contrary, there are the same standards, but rewritten, such as: ITU-T
Recommendation E.802 is the same as ETSI Standard EG 202 057.
Service Number ETSI ETSI ETSI ITU T 3GPP GSMA ITU-T 3GPP
Category of KPI EG EG TS E.800 TS 32 PRD E.771 52 402
202 202 102 410 IR.42
009 057 250
Telephony & 78 7 9 22 0 36 12 4 0
Video
Telephony
SMS & MMS 15 0 3 12 0 0 4 0 0
Internet 119 19 10 77 0 0 6 0 0
Customer 26 13 14 0 0 0 0 0 0
Support &
Maintenance
Total 238 39 39 111 0 36 22 4 0
Summary of our studies, described below
In the ITU-T RecommendationE.800, quality of service terms have been classified into three
broad areas; service, network and management.
9
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
10
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
Table 5, provides an indication of suitable performance targets for audio and video
applications.
Table 5 the ITU-T Performance targets for audio and video applications [5], [6]
16-128
High quality
Primarily kbit/s
Audio streaming <10 ms <<1 ms <1% PLR
one-way (Note
audio
3)
<150 ms Lipsynch:
16-384 preferred <80 ms
Video Videophone Twoway <1% PLR
kbit/s (Note 4)
<400 ms limit
One- 16-384
Video One-Way <10 s <1% PLR
Way Kbit/s
NOTE 1: Assumes adequate echo control
NOTE 2 – Exact values depend on specific codec, but assumes use of a packet loss concealment
algorithm to minimize effect of packet loss.
NOTE 3 – Quality is very dependent on codec type and bit-rate.
NOTE 4 – These values are to be considered as long-term target values which may not be met by
current technology.
11
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
Table 6 provides a target values for data applications.
Table 6 the ITU-T Performance targets for data applications [5], [6]
12
Acceptable
< 60 s
Sigit Haryadi.Transaction
(2016). “Performance Indicator of Telecommunication Service”. Network Performance
Preferred <
and Quality ofservices
Service–Lecture
high Notes Chapter 2. Institut Teknologi Bandung.
priority e.g. 2s
Data Two-way < 10 KB N.A. Zero
Acceptable
e-commerce,
<4s
ATM
Data Command/control Two-way ~ 1 KB < 250 ms N.A. Zero
Preferred <
< 100 15 s
Data Still image One-way N.A. Zero
KB Acceptable
< 60 s
Data Interactive games Two-way < 1 KB < 200 ms N.A. Zero
Two-way
Data Telnet < 1 KB < 200 ms N.A. Zero
(asymmetric)
Preferred <
E-mail (server Primarily one- 2s
Data < 10 KB N.A. Zero
access) way Acceptable
<4s
E-mail server to Primarily one- several
Data < 10 KB N.A. Zero
server transfer way Minutes
Primarily one-
Data Fax ("real-time") ~ 10 KB < 30 s/page N.A. <10-6 BER
way
Fax (store & Primarily one- several
Data ~ 10 KB N.A. <10-6 BER
forward) way Minutes
Low priority Primarily one-
Data < 10 KB < 30 s N.A. Zero
Transactions way
> =1
Primarily one- several
Data Usenet MB N.A. Zero
way Minutes
NOTE – In some cases, it may be more appropriate to consider these values as response times.
2.5.2. ETSI- QoS Parameters
The objective of the criteria list is to have an agreed set of QoS criteria. They should allow
easier external and internal benchmarking. The services chosen are considered to be of a high
relevance to the customer in a national and international market and are common for most of
the network operators. There is the need to specify independent QoS criteria for each service.
Thus the relevant prerequisites may be required.
Based on the target performance requirements identified in table 7 and 8, the various
applications can be mapped onto axes of packet loss and oneway delay as shown in figure 16 .
13
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
Table 8. ETSI Direct Services QoS Criteria for FTP, PoC, Video Telephony and Mobile Broadcast[2]
File Transfer Push to talk over Cellular
Video Telephony Mobile Broadcast
(FTP) (PoC)
Service Non- Service Non-
Registration Failure Ratio Network Non-Availability
Accessibility Accessibility
Service Discovery Failure
Setup Time Registration Time Service Access Time
Ratio
IP-Service Audio/Video Setup
3 Publish Failure Ratio Service Discovery Time
14
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
Table 9 ETSI Direct Services QoS Criteria for streaming, telephony, web browsing and Ping [2]
Streaming Telephony Web Browsing (HTTP) Ping
Network Non- Round Trip
Service Non-Accessibility Service Non-Accessibility
Availability Time
Service Discovery
Setup Time Setup Time
Failure Ratio
Service Discovery IP-Service Access Failure
Speech Quality on Call Basis
Time Ratio
Bootstrapping Failure Speech Quality on Sample
IP-Service Setup Time
Ratio Basis
Bootstrapping Time Cut-off Call Ratio Session Failure Ratio
ESG Retrieval Failure
Session Time
Ratio & time
Content Non- Data Transfer Cut-off
Accessibility Ratio
Content Access Time
Interactivity Response
Failure Ratio &
Response time
2.5.2.2. ETSI Store-and-Forward (S&F) Services QoS Criteria
15
Ratio
IP-Service Audio/Video Setup Bootstrapping Failure
Sigit Haryadi. Publish
(2016). Time
“Performance Indicator of Telecommunication Service”. Network Performance
Setup Time Time Ratio
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
Session Failure Registration Failure Ratio
Cut-off Call Ratio Bootstrapping Time
Ratio (long)
Speech Quality on Call
Session Time Registration Time (long) ESG Retrieval Failure Ratio
Basis
Mean Data Session Initiation Failure Speech Quality on
ESG Retrieval Time
Rate Ratio (on-demand) Sample Basis
Data Transfer Session Initiation Time
Video Quality Content Non-Accessibility
Cut-off Ratio (ondemand)
Pre-established Session End-To-End Mean
Media Parameters One-Way Content Access Time
Negotiation Failure Ratio Transmission Time
Pre-established Session
Audio/Video Interactivity Response
Media Parameters
Synchronization Failure Ratio
Negotiation Time
Session Initiation Failure Interactivity Response
Ratio (pre-established) Time
Session Initiation Time
(preestablished)
Session Setup Failure Ratio
(on-demand)
Session Setup Failure Ratio
(pre-established)
Session Setup Time
Push to Speech Failure Ratio
Push to Speech Time
Session Leaving Failure Ratio
(on-demand)
Session Leaving Time
(ondemand)
Session Leaving Failure Ratio
(pre-established)
Session Leaving Time
(preestablished)
Deregistration Failure Ratio
Deregistration Time
Busy Floor Response Failure
Ratio
Ratio
16
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
networks are assessed by Network Performance (NP) parameters rather than QoS parameters.
While QoS and NP parameters are different in nature and serve different purposes, it is clear
that there exist intrinsic relationships between QoS and NP parameters, one having a direct or
indirect, and sometimes even inverse, influence on the other. It should be noted that the
The following table provides a conceptual categorization of Quality of Service (QoS) and
Network Performance (NP) metrics.
17
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
18
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
19
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
Table 16. GSMA QoS Parameters for service independent, SMS and GPRS[6]
Short Message Packet Switched Data Service
Service Independent
Service (General Packet Radio Service)
Network Accessibility Service Accessibility Rate –
Service Accessibility SMS MO
Circuit Switched Packet Switched Data
Network Accessibility Set-up Time – Packet Switched
Access Delay SMS MO
Packet Switched Data
End-to-End Delivery Time SMS Data Quality (DQ-PSD)
Completion Rate SMS Circuit
Completed Session Ratio
switched
Table 17. GSMA QoS Parameters for Telephony, CSDS and Data Service [4]
Circuit Switched Data Data Service Class Definitions and
Telephony
Service Measurements
Service Accessibility Telephony Service Accessibility ,
Conversational Class Data
(SA-T) Circuit Switched Data
Setup Time Telephony (ST-T) Set-up Time Streaming Class
CSSR (Call Setup Success Ratio) Data Quality (DQ-CSD) Interactive Class
REL (ISUPv2 Signaling Completion Rate
Background class
transparency) Circuit Switched Data
OCN & RDN (ISUPv2 Signaling
transparency)
Call Completion Rate Circuit
Switched telephony (CCR-CS-T)
ALOC (Average Length of a Call)
CLI Transparency
Speech Quality (SpQ)
20
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
[1] Haryadi, Sigit (2013) Telecommunication Traffic. 310 pp. Lantip Safari Media.
[2] ETSI Standard TS 102 250-2 v2.2.1 (2011): Speech and multimedia Transmission
Quality (STQ); QoS aspects for popular services in mobile networks; Part 2: Definition
[3] ITU-T Recommendation G.1010 (2011): End-user multimedia QoS categories. 2011
[4] GSM Association Standard PRD IR 42. (2001): Definition of quality of service
quality of service.
and definitions.
[7] 3GPP Standard TS 23.207 V5.10.0 (2005): Technical Specification. 3rd Generation
[8] ETSI Standard EG 202-057 V1.3.1 (2008): Speech Processing, Transmission and
21
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
Management; Key Performance Indicators (KPI) for UMTS and GSM.
2012.
[10] Strohmeier, Felix; Dörken, Heinz; Hechenleitner, Bernhard.
Transmission Quality (STQ), QoS aspects for popular services in mobile networks;
Part 1. Assessment of Quality of Service, ETSI TS 102 250-1 V2.2.1 (2011-04), April
2011
Telecommunications Quality of Service. John Wiley & Sons, Ltd. Baffins Lane,
[18] ITU-T Recommendation G.107: The E-Model, a computational model for use in
transmission planning.
23
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
List of Notation
FTP File Transfer Protocol
3G Third-generation technologies
TS Technical Specification
24
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
CDG CDMA Development Group
UE User Equipment
ME Mobile Equipment
25
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
IP Internet Protocol Internet Protocol
TCP Transfer Control Protocol
PI Protocol Interpreter
26
Sigit Haryadi. (2016). “Performance Indicator of Telecommunication Service”. Network Performance
and Quality of Service Lecture Notes Chapter 2. Institut Teknologi Bandung.
Biography
Sigit Haryadi is lecturer in ITB (Bandung Institute of Technology), Indonesia, since 1984 and
became associate professor in the institution since 2001.
27