Rohde & Schwarz

IOT/PQA

Clark Lin

Rohde-Schwarz Taiwan
 Agenda
1) Terminal Acceptance Testing - IOT
2) Lab Based IOT
3) Performance Quality Analysis (PQA)
4) R&S IOT Packages
5) Summary

| R&S IOT/PQA Seminar | 2

Terminal Acceptance Testing
Solutions for Operators Network

Process Description
Device Testing in Lab and Field
Assessment of the different methods for terminal handset testing

GCF / PTCRB Lab Operator IOT

Conformance Testing Lab Testing Field Test

§ Based open standards for § Values performance § Close to real user

testing
§ Industry recognized
committees
§ Scalable due to Industry
consensus
§ Consensus driven
approach hampering
progress
§ Focus on conformance
equal to conformance experience
§ Tailored to specific § Limited test coverage, e.g.
operator needs - difficult to test failure
§ Flexible and fast delivery cases
of test solutions suitable - bound to network feature
for new technology support
introduction § Requires significant
resources and planning
§ Limited scalability
§ Limited reproducibility

GCF / PTCRB conformance, Operator IOT and Field Test complement each
other. They need to be balanced depending on requirements and particular
business models of operators

| R&S IOT/PQA Seminar | 4

How IOT is achieved? – On the field test

Objective of Field Test:

• Check signaling performance of UE
• Let operator understand how UE
behaves in a “LIVE” network

Field Test

| R&S IOT/PQA Seminar | 5

Lab IOT Process – Initial Phase

T&M partner implements

test solution Operator publish UE
Test cases are verified in testing requirements
Operator is specifying test
requirements for terminal cooperation with UE T&M partner makes
testing vendor release

Test Review & Implementation

Acceptance Roll out
specification Discussion and verification

T&M Partner reviews Operator runs

Test Plan from operator acceptance test
procedure with T&M
Discussion about
detailed collaboration partner to approve
model Test solution

| R&S IOT/PQA Seminar | 6

How IOT is achieved? – Lab Based IOT

Why Lab based IOT?

l Test in a controlled environment
l Allow testing of new technologies (Rel 8/9/10…)
l Discover UE issues early and perform rectification
l Cost effective solution

| R&S IOT/PQA Seminar | 7

Motivation of IOT: Growth of Mobile Manufacturers

Number of UE manufacturers have grown tremendously in the past 10 years

| R&S IOT/PQA Seminar | 8

Motivation of IOT: Growth of Mobile Manufacturers
Increasing sales of Smart Phones/Handy Pads
l Handy Pads are usually a handheld tablet (expanded smartphone: example:
Ipad/Galaxy tab)
l Smartphones and Handy Pads sales will outsell conventional PC by next year

Observation by Operators:
l Might not be able to provide required data for subscribers due to increasing
smartphone/device sales
l Both local and Overseas subscribers are hogging their network
l Operators putting on “Data cap” on subscriber mobile plan

| R&S IOT/PQA Seminar | 9

Motivation of IOT: Network Implementation
changes
l Operator need to deal with multiple technology growth (HSPA, HSPA+, LTE)
l InterRAT handover between different technologies (GSM=>UMTS/HSPA=>LTE)
l Network/Mobility management due to different implementation

| R&S IOT/PQA Seminar | 10

Lab based IOT
 CMW500 – IOT (Signaling Protocol Performance)
Basic Features/Functions
l Production Test
l RF Test (Callbox)
l Protocol Conformance Test (GCF Protocol conformance)
l Interoperability Test (IOT) – (Operator Specific)

Objective of IOT test system

l Design Operator specific test plan
l Network simulation will analyze UE signaling state
l Record potential signaling impact of device
l Analyze if applications run on the real-life mobile network.

Target Customers
l Chipset Design/R&D
l Mobile Manufacturers
l Network Operators

| R&S IOT/PQA Seminar | 12

CMW500 – PQA (Data Throughput Performance)
Data Throughput Measurements
l This setup can be extended to consider fading simulation
l Ability to simulate mobile network environment in an even more realistic fashion
l Mobile applications can be tested by connecting the system to internal or external data
servers
l Data Throughput measurements are therefore possible
l Using a network simulator, different smart devices can be evaluated and their behavior
in terms of signaling measured as part of comprehensive device performance or
comparison tests.

Target Customer
l Manufactures
l Test House
l Network Operators

| R&S IOT/PQA Seminar | 13

Performance Quality Analysis
(PQA)
Why Throughput testing is important

l HSPA/HSPA+/LTE network promises high data rate

l Revenue comes mainly from data instead of circuit services like SMS
l Voice over IP will be commonly used in LTE network (VoLTE)
l Next wave will be “Video over LTE”
l Throughput testing provides confidence to UE & Chipset manufacturer
(during R&D stage)
l Throughput testing based on network operators environment adds
confidence to network operators

| R&S IOT/PQA Seminar | 15

Why does Lab Performance Testing makes sense?
Example: Throughput Comparison of two Mobiles
Throughput Throughput

l Test Configuration:
l FTP Downlink
l EVA 5Hz fading
l 12.9 dB SNR
UE #1 UE #2

UE#1:
- UE is perfectly able to cope with specific radio environment
UE#2:
- UE starts with higher data rate than UE#1 but looses connection and goes out of
sync under same RF conditions.

LAB controlled KPI tests are an important quality gateway

| R&S IOT/PQA Seminar | 16

CMW-PQA: Throughput
Supported Parameters and Services
l Network and cell parameters
l Call parameter
l Powers
- Ior, Ior/Ioc (S/N), Power Sweep
l Fading
- All 3GPP fading profiles are supported
- User defined fading profiles (future release)
l Data Sources
- IPERF, FTP, HTTP, PING
- External data applications (Only on external PC)

| R&S IOT/PQA Seminar | 17

CONTEST Test Case Preparation (Will be
shown during Demo)

| R&S IOT/PQA Seminar | 18

CMW-PQA parameter settings: HSPA+

| R&S IOT/PQA Seminar | 19

Example LTE: LTE Scheduling

| R&S IOT/PQA Seminar | 20

Test Reporting
Test Case: CMW Throughput Performance
CMW Scenario started up
*** Test step 1 started ***

Result : Step #1 test result summary:

Data recording started 385.585 seconds after sync
Data recording ended 505.585 seconds after sync
IP Throughput, Downlink, Average as reported: 2273.55 kBit/s
IP Throughput, Downlink, Average as calculated over measurement window: 2273.10 kBit/s
*** Test step 1 finished ***

| R&S IOT/PQA Seminar | 21

Testing R&S IOT Packages
Operator IOT Testing - Summary

§ WCDMA: +500 test case for WCDMA, HSDPA, HSUPA, HSPA+

§ LTE: +230 test case for basic procedures, LTE mobility, iRAT, CSFB
data throughput and suppl. RF test cases

§ Full provider for LTE testing

§ Suppl. RF test cases
§ LTE protocol tests (Data Retry, Suppl. Signaling)
§ IMS (basic procedures, SMS over IMS, VoLTE)

§ Suppl. RF test testing based on Sprint RCT Supplemental RF Test Plan

§ LTE & 1xEVDO Data Throughput tests
§ InterRAT protocol tests

§ Suppl. RF test cases

§ 15 TC based on U.S. Cellular LTE Compliance Test Plan
§ Support of FDD Band 2, 4, 5 & 12

| R&S IOT/PQA Seminar | 23

Operator IOT Testing - Summary

§ In cooperation with R&S +230 3G/HSPA+ test cases have been specified
§ First test cases will be released in Q3/2012
§ Protocol testing incl. Cell Selection, InterRAT and 3G functional tests
§ Performance testing (Data Throughput) - Planned

§ Approx 100 TCs specified

§ LTE (Basic Procedures, QoS, Intra LTE Mobility, multiple PDNs)
§ eHRPD (Basic Procedures, eHRPD – LTE Mobility)
§ e1xCSFB (mobile originated/terminated, mobile capability)

| R&S IOT/PQA Seminar | 24

Operator IOT Testing - Summary

§ Deutsche Telekom uses PQA for LTE data throughput testing

§ Agreement with R&S to implement LTE protocol test cases
§ Test case requirements are under discussion

§ Approx 630 TCs specified

§ LTE (Cell Barred, Reselection, HO re-direction, etc)
§ UMTS (Cell Barred, Handover, SMS, Tx diversity, etc)
§ Emergency Call (SUPL, AGPS)

| R&S IOT/PQA Seminar | 25

Customer References & Still growing….

| R&S IOT/PQA Seminar | 26

Summary for
IOT/PQA
Our Statement – Moving a step forward

Our Statement
l IOT Test is essential to help ensure device performance and
subscribers satisfaction
l Time & cost to bring HSPA/LTE devices to market with traditional
methods is excessive as HSPA/LTE mobile devices are becoming more
complex
l PQA ensures reliable throughput performance to the operators and
subsribers

Solution
l A “Tailor-made” test standard process to certify HSPA/LTE mobile
devices to work in your network environment!

| R&S IOT/PQA Seminar | 28

 Thank you

| R&S IOT/PQA Seminar | 29