Professional Documents
Culture Documents
Ahmedabad Report - May 16 - 20160721
Ahmedabad Report - May 16 - 20160721
- May’16
Ahmedabad
Key performance indicators for most of the operators: Most of the operators meet the Call Setup
Success Rate (CSSR) where as most of the operators fall below the 2% CDR threshold
Methodology:
Independent Drive test was conducted in Ahmedabad & surrounding areas from 9:00 AM to 9:PM from 18th to 20th of May 2016. The total drive
test covered in Ahmedabad area was approximately 350 km over a period of 3 days. A total of ~5998 calls were made for seven 2G networks,
five 3G networks and one CDMA networks covering eight operators
1 2 3 4 5
City-Level Area-Level Analysis Summary Appendix
Performance Performance and I. Methodology
II. Benchmarking KPIs
Highlights III. Coverage
IV. Receive (Rx) Quality
V. City-Level Ranking
VI. City-Level KPI
The independent drive test has been carried out by M/s IMRB International on behalf of TRAI
1. City-Level Performance
City-Level Details
Operator Performance against Key Performance Indicators :
1. Call Setup Success Rate, 2. Blocked Call Rate, 3. Call Drop Rate, 4. Rx Quality
95%
Most of the operators have met the 97.6% 99.3%
96.5% 97.1% 97.9% 96.4% 97.1% 97.7% 96.6% 97.9%
95.7% 95.2%
Call Setup Success Rate 90.7%
benchmark of >=95% except
BSNL 2G
BSNL 3G
Airtel 2G
Airtel 3G
Telenor 2G
Aircel 2G
IDEA 2G
Reliance 2G
Vodafone 2G
IDEA 3G
TATA 3G
Vodafone 3G
Reliance CDMA
Reliance CDMA.
Refer. Fig 1
BSNL 3G
Aircel 2G
Airtel 2G
Airtel 3G
Telenor 2G
Reliance 2G
TATA 3G
Vodafone 2G
Vodafone 3G
IDEA 2G
IDEA 3G
Reliance CDMA
& 3G, Reliance 2G & CDMA and
Vodafone 2G.
Refer. Fig 2
Airtel 2G
Airtel 3G
Telenor 2G
Reliance 2G
Reliance
TATA 3G
Vodafone 2G
Vodafone 3G
IDEA 2G
IDEA 3G
CDMA
Refer. Fig 3
3G.
BSNL 3G
Aircel 2G
Airtel 2G
Airtel 3G
BSNL 2G
Reliance 2G
Reliance
Telenor 2G
TATA 3G
IDEA 2G
IDEA 3G
Vodafone 2G
Vodafone 3G
Refer. Fig 4
CDMA
2
2. Area-Level Performance
Area-Level Details
Fig 5. Area Level CSSR KPI Performance ( all operators inclusive)
Most of the areas of Ahmedabad met the Call Setup Success Rate benchmark of >=95% except
Manin Nagar
Call Setup Success Rate Aircel Airtel BSNL Idea RCOM TATA Telenor Vodafone
Ahmedabad Central 95.8% 97.1% 99.1% 97.8% 97.6% 97.1% 96.7% 98.4%
Manin nagar 93.5% 98.0% 87.5% 93.6% 87.5% 85.0% 100.0% 95.7%
Prahlad nagar 96.9% 98.2% 94.8% 97.4% 92.6% 100.0% 98.5% 97.3%
3
2. Area-Level Performance
Area-Level Details
Fig 6. Area Level Blocked Call Rate KPI performance ( all operators inclusive)
Most of the areas of Ahmedabad failed to meet the benchmark for Blocked Call Rate of <=3%
except Ahmedabad Central and Chandola
Call Blocked Rate Aircel Airtel BSNL Idea RCOM TATA Telenor Vodafone
Ahmedabad Central 4.2% 2.9% 0.9% 2.2% 2.4% 2.9% 3.3% 1.6%
Manin nagar 6.5% 2.0% 12.5% 6.4% 12.5% 15.0% 0.0% 4.3%
Prahlad nagar 3.1% 1.8% 5.2% 2.6% 7.4% 0.0% 1.5% 2.7%
4
2. Area-Level Performance
Area-Level Details
Fig 7. Area Level Call Drop Rate KPI Performance ( all operators inclusive)
All areas of Ahmedabad failed to meet the Call Drop Rate benchmark of <=2%.
Call Drop Rate Aircel Airtel BSNL Idea RCOM TATA Telenor Vodafone
Ahmedabad Central 2.8% 1.0% 5.0% 8.2% 2.8% 1.5% 3.4% 4.9%
Manin nagar 6.9% 6.1% 14.3% 13.6% 9.5% 0.0% 13.6% 0.0%
Prahlad nagar 3.2% 3.7% 22.0% 8.1% 3.6% 2.0% 3.0% 1.9%
5
2. Area-Level Performance
Area-Level Details
Fig 8. Area Level Rx Quality KPI performance (all operators inclusive)
Ahmedabad Central 91.79% 97.23% 95.58% 90.55% 93.54% 97.72% 90.96% 95.51%
Manin nagr 92.15% 94.56% 91.53% 88.42% 83.90% 93.05% 89.21% 93.17%
Prahlad nagar 99.41% 97.35% 86.83% 94.63% 95.14% 95.54% 93.15% 94.76%
6
3. Analysis
Detailed Analysis of
Operators
• If Radio Link Timeout of > 40 is considered for Aircel & Idea 12.73% 87.27% 11.36% 11.59%
Idea. Call Drop Rate would be higher than the present BSNL 72.91% 27.09% 5.63% 5.63%
call drop rate. Telenor 77.39% 22.61% 3.91% 3.91%
RCOM 90.40% 9.60% 3.27% 3.27%
Highlighted
Idea 2G areas(Ahmedabad Rest of
(CDR : 11.36%, Signal Quality : 87.86%) Parameter
Central, Charodi & Ahmedabad
Hebatpur)
# call drops 30 20
• Ahmedabad Central, Charodi and Hebatpur are the key
Rx Quality %( Good
contributed areas (as shown in highlighted map) to dropped call. sample)
87.30% 88.41%
• Dropped calls in these three areas are 60% of total dropped calls
in all areas.
• Poor quality of network is clear indication of high call drop rate.
Idea 3G
(CDR : 11.40%) Parameter 3G network 2G network
• The observation shows almost 75% of calls which started on 3G # call Attempt 330 109
network switched to 2G network, even signal Quality of 2G network # call Drop 12 37
is poor than 3G network. # call ended 125 265
• The observation shows 75% of dropped calls on 3G enabled SIM % Technology
43.4% 56.6%
card, dropped on 2G network which make overall 3G performance distribution
poor.
BSNL 3G
(CDR : 15.21%) Parameter 3G network 2G network
• The observation shows 44% calls were attempted on 3G # call Attempt 165 208
network only, due to this most of the calls were initiated on # call Drop 14 40
2G network. # call ended 99 225
• This scenario could be a reason who would not be able to
% Technology
avail 3G services for a long period 39.1% 60.9%
distribution
• Most of the calls dropped just after compressed mode (IRAT
Handover). Need to check the related parameter.
Reliance CDMA
(CDR : 7.37%, BCR : 9.31%) Parameter Value(%)
• Signal quality of Reliance CDMA is Very poor and not meeting
benchmark of >=95%. Signal Quality(Good sample <=4% of total
88.90%
FER sample)
• Poor signal quality is the clear indication of high call drop in
network.
7
4. Summary & Highlights
15.2%
11.4% 11.4%
7.4%
5.6%
4.5% 3.5% 3.9%
2.3% 3.3% 2.4% 3.1%
1.9%
BSNL 2G
BSNL 3G
Reliance 2G
Airtel 2G
Airtel 3G
Telenor 2G
Aircel 2G
IDEA 2G
IDEA 3G
TATA 3G
Vodafone 2G
Vodafone 3G
Reliance CDMA
Key Highlights
• Only Airtel 2G met the Call Drop Rate benchmark of <=2% in 2G networks.
• Most of the operators failed to meet the benchmark by a wide margin. Except Airtel 2G & 3G and Vodafone 2G, most
of the operators have Call Drop rate of >3%
• Idea 2G & 3G and BSNL 3G have Call Drop Rates in the range of above 10%. These are exceptionally high and it
clearly indicate for urgent need of improvement in order to deliver reasonable levels of services.
• A big gap between the performances of Airtel (2G & 3G) and Vodafone (2G) compared to the poor performances of
other operators are clearly showing in the areas driven, it is possible for other operators to offer a much better Quality
of service than is currently being provided.
8
5. Appendix
Ancillary Details
Table of Contents in Appendix
9
Appendix
Ancillary Details
1. Methodology & Other Details
Overview:
Telecom Regulatory Authority of India has been entrusted with the task of laying down the standards of quality of service to be provided
by the service providers and ensuring that the quality of service is provided as per norms; and also TRAI is responsible for conducting
the periodical audit of such services provided by the service providers so as to protect the interest of the consumers of
telecommunications service
TRAI is regularly monitoring the performance of Telecom Service Providers (TSP) against the benchmarks for the various Quality of
Service (QoS) parameters laid down by the Authority. TSPs submit Performance Monitoring Reports to TRAI every quarter. TRAI also
undertakes audit and assessment of Quality of Service through independent agencies to verify the Quality of Service claimed. The Audit
agencies conduct sample ‘Drive tests’ across various cities all over the country as part of audit and assessment of the TSPs’
performance
In view of complaints on call drops and other network issues, on behalf of TRAI, an Independent Drive Test (IDT) was conducted from
18th May 2016 to 20th May 2016 covering various locations in North Ahmedabad, South Ahmedabad, Central Ahmedabad and West
Ahmedabad. The performance of Aircel, Airtel, BSNL, Idea, Vodafone, Reliance, Tata, Telenor was monitored across various
technologies (2G, 3G and CDMA). The drive test route was defined on the basis of several factors that include - areas from where call
drop complaints are commonly received; areas of heavy usage; residential areas away from arterial roads; office areas; areas where
previous Drive tests showed network issues; etc.
For the purpose of these tests, 2G + 3G Mode (Auto) was used. The test results obtained from these drive tests were conducted to
assess the network condition more specifically in terms of Radio Frequency (RF) Coverage; Rx Quality; Call Setup Success Rate; Call
Drop Rate; Blocked Calls and Carrier to Interference ratio
10
Appendix
Ancillary Details
2. Benchmarking KPI Details
RF Coverage
RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data
session. Coverage rate of an operator is calculated basis of % of samples in which the Rx level is better than -85 dBm
Accessibility
Accessibility is the ability of a service to be obtained within specific tolerances and other given conditions, when requested by the user.
In other words, the ability of a user to obtain the requested service from the system. Accessibility is monitored by measuring Call Setup
Success Rate (CSSR) which is defined as the ratio of Established Calls to Call Attempts
Retainability
Retainability is “The ability of a service, once obtained, to continue to be provided under given conditions for a requested duration.” For
determining the Retainability the regulation prescribes three important parameters namely Call Drop Rate (CDR), Worst affected Cells
having more than 3% TCH drop and Connection with good voice quality. Drop Call and Connection with good voice quality were
monitored by the drive test
Mobility
In a cellular system a base station has only a limited coverage area. Hence it is possible for a moving subscriber to be out of range of a
base station while making a call. The process by which a mobile telephone call is transferred from one base station to another as the
subscriber passes the boundary of a cell is called a handover. The Handover success rate (HOSR) more than 95% is considered to be
good
Rx Quality
For measuring voice quality, RxQual samples on a scale from 0 to 7 for GSM operators, EcNo from 0 to -30 dBm and Frame Error Rate
(FERs) for CDMA service providers are measured. As per the QoS norms, RxQual between 0- 5 for GSM operators, EcNo >= -15 dBm and
between 0-4% FER value for CDMA operators FERs is considered to be good, where as RxQual beyond this benchmark is considered to
be bad
KPI Distribution
100.00%
75.00%
50.00%
25.00%
0.00%
Coverage % Accessibility % Retainability % Mobility % Rx Quality %
Aircel 2G 75.29% 95.72% 95.53% 89.66% 91.27%
Airtel 2G 93.34% 97.58% 98.14% 96.34% 96.05%
Airtel 3G 90.81% 99.30% 97.66% 99.93% 98.50%
BSNL 2G 90.98% 96.50% 94.37% 97.07% 90.86%
BSNL 3G 37.06% 95.17% 84.79% 99.82% 94.58%
IDEA 2G 98.80% 97.13% 88.64% 90.14% 87.86%
IDEA 3G 87.26% 97.95% 88.60% 99.67% 96.33%
Reliance 2G 83.85% 96.43% 96.73% 97.97% 92.40%
Reliance CDMA 95.86% 90.69% 92.63% 100.00% 88.90%
TATA 3G 50.67% 97.14% 96.51% 100.00% 93.97%
Telenor 2G 91.77% 97.71% 96.09% 90.63% 91.64%
Vodafone 2G 94.84% 96.56% 97.55% 95.23% 90.45%
Vodafone 3G 89.45% 97.93% 96.95% 100.00% 97.98%
11
Appendix
Ancillary Details
3. Coverage Details
RF Coverage relates to the geographical footprint within the system that has sufficient RF signal strength to provide for a call/data
session. The Coverage rate of an operator is calculated basis of % of samples in which the Rx level is better than -85 dBm. The details
are as follows.
Operators Coverage Rate
Aircel 2G 75.29% Coverage Distribution
Airtel 2G 93.34%
Airtel 3G 90.81% 100.00%
BSNL 2G 90.98% 75.00%
BSNL 3G 37.06%
IDEA 2G 98.80%
50.00%
IDEA 3G 87.26% 25.00%
Reliance 2G 83.85%
0.00%
Reliance CDMA 95.86%
BSNL 2G
BSNL 3G
Telenor 2G
Aircel 2G
Airtel 2G
Airtel 3G
Reliance 2G
Vodafone 3G
IDEA 2G
IDEA 3G
TATA 3G
Vodafone 2G
Reliance CDMA
TATA 3G 50.67%
Telenor 2G 91.77%
Vodafone 2G 94.84%
Vodafone 3G 89.45%
Operators not meeting benchmark -95 to -120 dBm -85 to -95 dBm -75 to -85 dBm 0 to -75 dBm
BSNL 2G IDEA 2G
BSNL 3G
12
Appendix
Ancillary Details
3. Coverage Details
IDEA 3G RCOM 2G RCOM CDMA
Telenor 2G Vodafone 2G
Tata 3G
Vodafone 3G
13
Appendix
Ancillary Details
4. Receive (Rx) Quality Details
For measuring voice quality, RxQual samples on a scale from 0 to 7 for GSM operators, EcNo for 3G operators on a scale of 0 to -30
dBm and Frame Error Rate (FERs) for CDMA service providers are measured. As per the QoS norms, Rx Qual between 0- 5 for GSM
operators, EcNo >= -15 dBm and between 0-4% FER value for CDMA operators FERs is considered to be good, where as quality beyond
this benchmark is considered to be bad. The benchmark should usually be > =95%.
Operator Rx Quality
Aircel 2G 91.27% Rx Quality Distribution
Airtel 2G 96.05%
100.00%
Airtel 3G 98.50%
BSNL 2G 90.86% 75.00%
BSNL 3G 94.58%
50.00%
IDEA 2G 87.86%
IDEA 3G 96.33% 25.00%
Reliance 2G 92.40%
0.00%
Reliance CDMA 88.90% Airtel 2G
Airtel 3G
BSNL 2G
BSNL 3G
Telenor 2G
Reliance 2G
Aircel 2G
Vodafone 2G
Vodafone 3G
IDEA 2G
IDEA 3G
TATA 3G
Reliance CDMA
TATA 3G 93.97%
Telenor 2G 91.64%
Vodafone 2G 90.45%
Vodafone 3G 97.98%
Operators not meeting benchmark RxQual 6 to 7, EcNo <-15 dBm, FER <= 4% RxQual 0 to 5, EcNo >=-15 dBm, FER > 4%
14
Appendix
Ancillary Details
4. Receive (Rx) Quality Details
IDEA 3G RCOM 2G RCOM CDMA
Telenor 2G Videocon 2G
Tata 3G
Vodafone 3G
15
Appendix
Ancillary Details
5. City-Level Ranking and KPI details
Accessibility is the ability of a service to be obtained within specific tolerances and other given conditions, when requested by the user.
In other words, the ability of a user to obtain the requested service from the system. Accessibility is monitored by measuring Call Setup
Success Rate (CSSR) which is defined as the ratio of Established Calls to Call Attempts. The benchmark is >=95%. The details are as
follows: *In case of multiple call failure in similar geo location in given period of 60sec has been counted as one call failure
Operator Total Call Attempt Blocked Calls Blocked Call Rate* CSSR
Aircel 2G 514 22 4.28% 95.72%
Airtel 2G 496 12 2.42% 97.58%
Airtel 3G 431 3 0.70% 99.30%
BSNL 2G 515 18 3.50% 96.50%
BSNL 3G 373 18 4.83% 95.17%
IDEA 2G 453 13 2.87% 97.13%
IDEA 3G 439 9 2.05% 97.95%
Reliance 2G 476 17 3.57% 96.43%
Reliance CDMA 494 46 9.31% 90.69%
TATA 3G 384 11 2.86% 97.14%
Telenor 2G 523 12 2.29% 97.71%
Vodafone 2G 465 16 3.44% 96.56%
Vodafone 3G 435 9 2.07% 97.93%
Retainability is “the ability of a service, once obtained, to continue to be provided under given conditions for a requested duration.” For
determining the Retainability, the regulation prescribes three important parameters namely Call drop rate (CDR), Worst affected Cells
having more than 3% TCH drop and Connection with good voice quality. The call drop and connection with good voice quality were
monitored by the drive test
Call Drop Rate (CDR): The parameter gives a reliable measurement of the mobile network used by the service provider for maintaining a
call once it has been correctly established
Operator Total Call Established Total Call Drop CDR CCSR
Aircel 2G 492 22 4.47% 95.53%
Airtel 2G 484 9 1.86% 98.14%
Airtel 3G 428 10 2.34% 97.66%
BSNL 2G 497 28 5.63% 94.37%
BSNL 3G 355 54 15.21% 84.79%
IDEA 2G 440 50 11.36% 88.64%
IDEA 3G 430 49 11.40% 88.60%
Reliance 2G 459 15 3.27% 96.73%
Reliance CDMA 448 33 7.37% 92.63%
TATA 3G 373 13 3.49% 96.51%
Telenor 2G 511 20 3.91% 96.09%
Vodafone 2G 449 11 2.45% 97.55%
Vodafone 3G 426 13 3.05% 96.95%
Mobility: In a cellular system a base station has only a limited coverage area. Hence it is possible for a moving subscriber to get out of
reach of a base station while making a call. The process by which a mobile telephone call is transferred from one base station to
another as the subscriber passes the boundary of a cell is called a handover. The Handover Ssuccess Rate (HOSR) more than 95% is
considered to be good
Operators Total HO Attempt HO Failure HO Success HO Failure Rate HO Success Rate
Aircel 2G 1180 122 1058 10.34% 89.66%
Airtel 2G 1448 53 1395 3.66% 96.34%
Airtel 3G 6021 4 6017 0.07% 99.93%
BSNL 2G 1059 31 1028 2.93% 97.07%
BSNL 3G 1120 2 1118 0.18% 99.82%
IDEA 2G 1572 155 1417 9.86% 90.14%
IDEA 3G 3949 13 3936 0.33% 99.67%
Reliance 2G 1378 28 1350 2.03% 97.97%
Reliance CDMA 3730 0 3730 0.00% 100.00%
TATA 3G 5781 0 5781 0.00% 100.00%
Telenor 2G 1388 130 1258 9.37% 90.63%
Vodafone 2G 1131 54 1077 4.77% 95.23%
Vodafone 3G 7347 0 7347 0.00% 100.00%
Operators not meeting benchmark
16
Appendix
Ancillary Details
Operators (Summary)
Call Events Aircel Airtel BSNL IDEA RCOM TATA Telenor Vodafone
2G 2G 3G 2G 3G 2G 3G 2G CDMA 3G 2G 2G 3G
Call Attempt (May-16) 514 496 431 515 373 453 439 476 494 384 523 465 435
Blocked Call Rate (May-16) 4.28% 2.42% 0.70% 3.50% 4.83% 2.87% 2.05% 3.57% 9.31% 2.86% 2.29% 3.44% 2.07%
CSSR (Accessibility) (May-16) 95.72% 97.58% 99.30% 96.50% 95.17% 97.13% 97.95% 96.43% 90.69% 97.14% 97.71% 96.56% 97.93%
Dropped Call Rate (May-16) 4.47% 1.86% 2.34% 5.63% 15.21% 11.36% 11.40% 3.27% 7.37% 3.49% 3.91% 2.45% 3.05%
Mobility HOSR (May-16) 89.66% 96.34% 99.93% 97.07% 99.82% 90.14% 99.67% 97.97% 100.00% 100.00% 90.63% 95.23% 100.00%
Rx Quality (May-16) 91.27% 96.05% 98.50% 90.86% 94.58% 87.86% 96.33% 92.40% 88.90% 93.97% 91.64% 90.45% 97.98%
Operators are not meeting benchmark Operator are meeting the benchmark
17