WHITE PAPER

Cisco Code-Division

Multiple Access
Performance Management

Introduction
This document denes a performance-management (PM) architecture that will allow service providers (SPs) deploying code-division multiple access (CDMA) data services to track the ongoing performance of their network from end to end. The solution should provide visibility not only into the Cisco domain, including IP platforms such as the Packet Data Service Node (PDSN) and Layer 2 switches, but also into the radio domain of the wireless infrastructure.
Scope

The PM architecture focuses on the interactions between Cisco and third-party network-management systems and Cisco network elements (NEs). The managed Cisco NEs in a typical packet service CDMA network include: Cisco Catalyst Ethernet Switches (Catalyst 6509) Cisco Packet Data Serving Node (PDSN) Cisco routers (Cisco 3662, 7xxx, and so on) Cisco MGX 8850 Edge Concentrator Other NEs in the future The following topics are covered in this document: Cisco CDMA Operations Administration Maintenance and Provisioning (OAM&P) architecture Performance management Performance monitoring Performance analysis
Customer Benefits

The Cisco Performance Management philosophy provides the following benets to CDMA SPs: Assessment of quality of service (QoS) as experienced by customers Ability to offer key differentiators based on service-level agreement (SLA) monitoring Comprehensive network performance analysis Cost savings with elimination of overprovisioning Sharp decline in unplanned network outages

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 1 of 15

The Cisco CDMA OAM&P Architecture

End-to-End Network View

Cisco CDMA NEs, including the PDSN and its neighbor Catalyst Switches, are managed through the CiscoWorks2000 for Mobile Wireless bundle (CW4MW), which is a suite of EMS applications that enhances the delivery of wireless next-generation services leveraging Cisco mobility platforms such as the PDSN. It includes: Mobile Wireless Fault Mediator This Telco-grade fault solution provides intelligent device discovery, alarm ltering and correlation of the PDSN and GGSN and their neighboring Catalyst switches. In addition, MWFM seamlessly integrates with Network and Service-layer Fault OSS to provide a complete network monitoring solution. CiscoWorks2000The CiscoWorks2000 line of products provide solutions targeted at the wide-area and local-area operations of communications networks. A description is available at: http://www.cisco.com/warp/customer/cc/pd/wr2k/ Cisco MGX 8850 platforms switch the trafc between the radio network and Cisco PDSNs. They are managed by the Cisco WAN Manager solution. A description of this application is available at: http://www.cisco.com/univercd/cc/td/doc/pcat/wnmn.htm Figure 1 shows a typical Cisco PDSN network alongside the radio infrastructure. The service-layer PM application is located in the Network Operations Center (NOC) area and is provided by Cisco ecosystem partners.
Figure 1
CDMA OAM&P View

Network Operations Center (NOC)

Service Provider's OSS APIs DB SNMP Traps

CW4MW OMC-R/G
DB

CWM
DB CiscoWorks 2000 DB MWFM Frame Relay SNMP/Syslog

Statistics MGX

RXCDR BSS/PCF

Cisco IP Network

PDSN

Catalyst 6509

Internet

Intranet

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 2 of 15

Cisco Mobile Wireless PM Architecture

A Telecommunications Management Network (TMN)-based network diagram is presented in Figure 2. Network and service-level PM solutions such as Metrica/(NPR) collect performance statistics either from the element-management system (EMS) or directly from NEs and provide monitoring and analysis functions. As described in the following sections, CiscoWorks2000 also provides PM and troubleshooting capabilities with CiscoView, Cisco Internetwork Performance Monitor (IPM) and nGenius Real-Time Monitor applications. Initially, the different PM solutions collect statistics directly from the Cisco devices. The dotted lines indicate future interfaces between management systems.
Figure 2
TMN-Based Performance Management Diagram

Customer DB Inventory DB

Cisco Info Center SML

ADC Metrica (PM Solution)

Radio NMS

NML

OMC-R

CWM WingZ

CW4MW

CiscoView IPM nGenius RTM

EML

Radio Devices

Cisco MGX-8850

Cisco PDSN, Catalyst Switches, Routers

The PM process involves several steps: Gather performance data on those variables of interest to network administrators Analyze the data to determine baseline levels Determine appropriate performance thresholds for each important variable such that crossing of these thresholds indicates a network problem worthy of attention Management entities continually monitor performance variables. When a performance threshold is exceeded, an alert is generated and sent to higher-level management systems such as the Cisco Info Center for further processing.

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 3 of 15

Table 1 shows the types of statistics that are available from Cisco devices and the applications that provide the overall PM functionality.
Table 1 Performance Metrics from platforms and applications

Statistics Layer
Platforms Cisco MGX 8850 Cisco Catalyst Switches Cisco Routers (RPM-PR), Cisco 3xxx, 7xxx) Cisco PDSN Applications PM Monitoring Application: CiscoWorks2000, CiscoView CiscoWorks2000, Internetwork Performance Monitor CiscoWorks2000, nGenius Real -Time Monitor, CiscoWorks2000 PM Monitoring/Analysis Application: Cisco WAN Manager ADC Metrica/NPR X X X X X X X

ATMFR
X

Generic IP

Wireless (PDSN)

X X

The ATM/Frame Relay, IP, and wireless statistics that can be collected from Cisco devices are discussed in the next chapter.

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 4 of 15

Performance Monitoring and Reporting

Performance monitoring is used for observing and collecting data on a specied set of attributes associated with network resources to measure network performance. This section denes the statistics that can be collected from the Cisco devices in the mobile wireless environment and then describes Cisco PM solutions at the element-management layer.
Cisco Performance Statistics
Cisco MGX-8850 Statistical Data

The ATM performance statistics available from Cisco devices in a typical CDMA environment are given in Table 2. This statistical data is stored in the NE Management Information Base (MIB) table; it can be retrieved via MIB variable polling of the Simple Network Management Protocol (SNMP) agent.
Table 2 Cisco MGX-8850 Statistical Data Provided by WingZ Application

PM Categories
Trunk/Port Utilization

Statistics Description
Percentage of received/transmitted cells Percentage of trunks unavailable

Connection Utilization

Percentage of bytes received/transmitted Percentage of time in service

Node Utilization

Number of trunks Number of ports Number of connections Number of incomplete connections Total committed information rate (CIR) on node

Connection Trafc Dropped Topmost Utilization

Percentage of received/transmit bytes dropped Top 1025 list of most utilized PVCs Trunks Ports

Cisco WAN Manager collects the data directly from the MGX 8850, while WingZ aggregates it in summary reports and provides the statistics given table 2. Additional information on WingZ is provided later in the document.

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 5 of 15

Generic IP Statistical Data

The standard IP statistics for Cisco platforms are dened in various MIBs, such as RFC 1213, CISCO-ENTITY-MIB, and so on. Table 3 provides a sample of statistics available from MIB groups such as IF, IP, ICMP, and TCP. Performance-monitoring applications retrieve them from the SNMP agent.
Table 3 Generic IP Statistical Data

PM Categories
Congestion and Resource Utilization

Statistics Description
Number of received/outbound packets discarded even though no error in packet (for example, out of buffers) Number of times an interface is internally reset Number of received/outbound IP datagrams discarded because of lack of buffer space Maximum number of seconds that received fragments are held while awaiting reassembly

Errors

Number of received/outbound packets discarded because of errors in packet or unsupported protocol Number of times the interface needed to be completely restarted Number of IP datagrams that have been discarded (for example, incorrect destination address, invalid protocol eld, and so on) Number of received Internet Control Message Protocol (ICMP) messages with errors

Throughput

Total number bytes transmitted/received Number of packets in output queue Number of packets transmitted/received to higher layers Number of IP datagrams delivered to appropriate protocol module Total number of received/output ICMP messages

Cisco PDSN-Specic Statistical Data

In addition to IP generic statistics, Cisco PDSNs also provide CDMA operating data to allow PM applications to periodically read throughput and trafc volumetrics. Tables 4 through 6 describe statistics available from the CISCO-CDMA-PDSN-MIB. This MIB is implemented within Cisco PDSN Releases 1.0.1 and 1.0.2. A new MIB (and variables) will be introduced with PDSN Release 1.1 and later.

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 6 of 15

Table 4 PDSN System and Data Session Statistics

PM Categories
Throughput

Statistics Description
Total number of ows currently using simple IP, MoIP, or proxy MoIP service Total number of data packets (or octets) sent/received to/from mobile user Number of existing IP ows for an established session Average data rate per session1

Errors Congestion/Resource Utilization

Total number of A10/A11 session failures occurring since PDSN agent restarted Total number of incoming/outgoing data packets dropped by PDSN Number of seconds granted/remaining before registration is considered expired

Resource Utilization

The current number of sessions established in the system Average duration of data session1

1. Future implementation

Table 5 Packet Control Function Statistics

PM Categories
Resource Utilization

Statistics Description
Total number of sessions currently established with a (PCF) Historical maximum number of connections that were established for a PCF Total number of PCFs currently interacting with a system

Errors

Total number of session errors for a PCF

Table 6 R-P Registration Statistics

The following table lists the statistics for the RAN PDSN Interface (R-P) registration, which are similar to those for the R-P registration update. PM Categories
Resource Utilization Errors

Statistics Description
Total number of valid registration requests received/accepted Total number of registration requests failed for unspecied reasons Total number of registration requests failed for external reasons (mobile node [MN] authentication failure, ID mismatch, request format, home agent (HA) address, RTU error, T bit not set)

Congestion/Resource Utilization

Total number of registration requests failed due to insufcient resources

When the performance data is available from the Cisco platforms, the following applications can provide IP PM functionality at the element-management layer, as represented in Figure 2 earlier in the paper. CiscoWorks2000 applications will provide visibility into IP and wireless metrics, while the Cisco WAN Manager solution offers ATM/Frame Relay statistics monitoring and analysis.

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 7 of 15

Cisco Performance Monitoring Solutions for IP and Wireless

CiscoView

CiscoView is a Web-based device-management application that provides dynamic status, monitoring, and conguration information for the broad range of Cisco internetworking products. CiscoView displays a physical view of a device chassis, with color-coding of modules and ports for at-a-glance status. It provides real-time monitoring of key information that relates to device performance, trafc, and usage, with metrics such as utilization percentage, frames transmitted and received, errors, and a variety of other device-specic indicators.
Figure 3
Figure 3: CiscoView

Specic to the CDMA context, CiscoView will display in charts PDSN performance metrics such as: Current sessions ratio Current PCF ratio Simple IP ows Mobile IP ows Proxy MoIP ows Session failures count The user has the option to set polling rate at which the statistics are retrieved. For additional information on CiscoView, refer to: http://www.cisco.com/warp/public/cc/pd/wr2k/view/

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 8 of 15

Cisco Internetwork Performance Monitor

Cisco Internetwork Performance Monitor (IPM) is a network response time and availability troubleshooting application. (See Figure 4.) This application empowers network engineers to proactively troubleshoot network-wide performance to diagnose congestion and latency problems utilizing real-time and historical statistics.
Figure 4
Cisco IPM

With Cisco IPM, network managers have the tool they need to identify performance problems, locate performance bottlenecks, diagnose latency and jitter, and identify performance trends in the network. Cisco IPM enables network managers to perform path and hop performance analysis, thereby simplifying the identication of network devices that are contributing to network-performance problems. Cisco IPM can determine the possible network paths used between two network devices and display the response time for each of the router hops in each path. Cisco IPM measures network performance based on the synthetic trafc generation technology within the Cisco IOS Software, which is known as the Service Assurance agent (SA agent). The use of synthetic trafc by Cisco IPM gives the network manager a high degree of exibility in selecting the end points in a network between which network performance will be measured. This exibility makes Cisco IPM a highly effective performance troubleshooting tool Additional information on Cisco IPM can be found on the following Web page: http://www.cisco.com/warp/public/cc/pd/wr2k/nemo/index.shtml

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 9 of 15

Cisco nGenius Real-Time Monitor

The Cisco nGenius Real-Time Monitor (RTM) is a new Web-enabled system that delivers multiuser Web access to network-wide, real-time Remote Monitoring (RMON) information for monitoring, troubleshooting, and maintaining network availability. (See Figure 5.)
Figure 5
Cisco nGenius Real-Time Monitor

The RTM Trafc Monitor and Packet Analyzer applications graphically report and analyze device-, link-, and port-level RMON collected trafc data from the following RMON-enabled devices: Catalyst Switches (Catalyst 5000 and 6000) Internal network analysis modules External Cisco SwitchProbes The powerful graphic capabilities within this application offer both real-time analysis of trafc behaviors and network usage information as well as proactive trending data for network planners and managers. Additional information can be found on the following Web page: http://www.cisco.com/warp/customer/cc/pd/wr2k/lnmn/ngenius/

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 10 of 15

Cisco Performance Monitoring/Analysis Solutions for ATM

Cisco WAN Manager

The Cisco WAN Manager (CWM) manages the Layer 2 switch infrastructure of the Cisco MGX 8850. CWM is an element-management system with WAN network visibility that enables operations, maintenance, and management of multiservice WAN networks. CWM provides comprehensive conguration, connection, fault, performance, and security management through graphical user interfaces (GUIs) and ow-through interfaces.
Performance and Capacity Management

CWM Statistics Agent software collects comprehensive network statistics for cost allocation, performance management, and capacity planning. The Statistics Agent uses Trivial File Transfer Protocol (TFTP), which is optimized for bulk data transfer, and can upload in excess of three million usage statistics per hour per agent. The data is then stored in a standard Sequenced Query Language (SQL) database for historical reporting and trend analysis.
Statistics Collection Manager

The Statistics Collection Manager (SCM) provides a forms-based interface to establish and modify statistics collection policies for the network. You can congure statistics collection policies such as which statistics to collect, and collection interval periods for a node, port, or private virtual circuit (PVC). SCM provides extensive error-handling and logging capabilities that enable reliable collection of statistics for performance or billing applications. (See Figure 6.)
Figure 6
Statistics Collection Manager

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 11 of 15

WingZ Report and Summary Report

CWM Statistics Reports are generated through a graphical reporting package based on the Informix WingZ Report application. CWM also provides node utilization reports not based on WingZ. These reports are obtained through the Summary Report application. Both the WingZ Report and the Summary Report applications provide a point-and-click GUI to generate reports based on information collected by the statistics agents. For each report, the user identies certain criteria, such as network object, type of statistics, granularity, report interval, and graphical format, depending on the report application selected. For the WingZ Report, the report agent queries the Informix database and generates a report in the desired format, such as line, bar, three-dimensional (3-D), or tabular chart, thus scalability of statistics collection is an important differentiator of CWM. For additional information on the Cisco WAN Manager solution, refer to the following Web page: http://www.cisco.com/warp/public/cc/pd/nemnsw/wnmn/

Performance Analysis
The second phase of PM is performance analysis, an analysis of the performance data collected during the performance-monitoring stage. This analysis provides information on whether network congestion is occurring and helps the management system to determine if performance is adequate for existing services and planned new services. Cisco recommends that wireless service providers take advantage of the breadth of feature-rich PM applications available from the Cisco ecosystem partners. The philosophy behind this approach is described below.
Ecosystem Approach

Cisco Systems, Inc. has worked with best-of-breed application vendors and systems integrators to dene and deliver integrated solutions that will help wireless service providers speed time to market and revenue for Internet Protocol (IP)-based New World networks and services. Cisco and its partners are dedicated to dening and delivering solutions and business processes for New World Operations Support Systems (OSSs) deployed in the mobile wireless environment. The partnership brings together product and implementation services from alliance partners with best-in-class application software from third-party vendors to complete the integrated, end-to-end OSS offerings. The partners will also offer postimplementation support and testing to help service providers measure the effectiveness of their New World communications infrastructures. Cisco ecosystem partners have developed performance systems with analysis that include real-time historical plotting of the following data: Inventory Resource utilization PDSN, link, and path availability Throughput, congestion, and errors
ADC Metrica

ADC Metrica is an ecosystem partner that has developed a PM solution specically for CDMA networks. The solution will monitor, analyze, and control performance management of the radio domain, the CDMA data portion, the Layer 2 switch infrastructure, and the IP cloud.

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 12 of 15

Metrica/NPR, which is part of the Metrica Service Assurance family of products, consists of a set of equipment interfaces, a database, and reporting modules. Interfaces are available for major equipment suppliers, including facilities for mapping each vendor's counters onto a generic network-wide data model. Other NPR components allow for calculation of daily, weekly, and monthly summary data based on a rich set of analysis functions. Standard reporting modules are provided to allow textual and graphical reporting of raw and summary data. Included are modules for trafc forecasting and an ad hoc point-and-click query interface. For additional information on the ADC Metrica/NPR solution, refer to the following Web page: http://www.adc-oss.com/products/npr.htm

Conclusion
This white paper documents how Cisco Systems meets the key requirements of New World mobile wireless service providers for their performance-management needs by providing: TMN-based open management architecture Relevant performance statistics available from Cisco CDMA platforms Off-the-shelf CiscoWorks2000 applications to monitor the generic IP performance Best-of-breed approach that takes advantage of the Cisco ecosystem philosophy PM solution to support CDMA multivendor and multitechnology networks Most importantly, Cisco wireless operations solutions have been developed and designed based on the unique insights, experience, and technical prowess of the leading practitioner of IP networking. The solutions are integrated with, and complemented by, the industry's most acclaimed infrastructure technology solutions, as well as by a comprehensive portfolio of support services.

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 13 of 15

Glossary
ATM CWM CW4MW Datagram DB EML ICMP IP MIB MN MoIP MWFM NE NML NOC OMC PCF PDN PDP PDSN PDU PM QoS RFC RMON R-P RTU SLA SML SNMP SP TCP TMN UDP Asynchronous Transfer Mode Cisco WAN Manager CiscoWorks2000 for Mobile Wireless A unit of information that travels from a sender to a receiver using protocols, such as TCP/IP protocol suites Database Element-management layer Internet Control Message Protocol Internet Protocol Management Information Base Mobile node Mobile IP Cisco Mobile Wireless Fault Manager Network element Network-management layer Network Operations Center Operations management console Packet control function Packet data network Protocol Data Packet Packet Data Service Node Protocol data unit Performance management Quality of service Request for Comments Remote Monitoring Radio-access network (RAN) PDSN Interface Reverse tunnel unavailable Service-level agreement Service-management layer Simple Network Management Protocol Service provider Transmission Control Protocol Telecommunications Management Network User Datagram Protocol

Cisco Systems, Inc. All contents are Copyright 19922001 Cisco Systems, Inc. All rights reserved. Important Notices and Privacy Statement. Page 14 of 15

Reference
Rayes, A., and K. Sage. Integrated Management Architecture for IP-Based Networks. IEEE Communications, April 2000. For a complete list of Cisco device MIBs, refer to: http://www.cisco.com/public/sw-center/netmgmt/cmtk/mibs.shtml

Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100

European Headquarters Cisco Systems Europe 11, Rue Camille Desmoulins 92782 Issy-les-Moulineaux Cedex 9 France www-europe.cisco.com Tel: 33 1 58 04 60 00 Fax: 33 1 58 04 61 00

Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA www.cisco.com Tel: 408 526-7660 Fax: 408 527-0883

Asia Pacic Headquarters Cisco Systems Australia, Pty., Ltd Level 9, 80 Pacic Highway P.O. Box 469 North Sydney NSW 2060 Australia www.cisco.com Tel: +61 2 8448 7100 Fax: +61 2 9957 4350

Cisco Systems has more than 200 ofces in the following countries and regions. Addresses, phone numbers, and fax numbers are listed on the

C i s c o We b s i t e a t w w w. c i s c o . c o m / g o / o f f i c e s
Argentina Australia Austria Belgium Brazil Bulgaria Canada Chile China PRC Colombia Costa Rica Croatia Czech Republic Denmark Dubai, UAE Finland France Germany Greece Hong Kong SAR Hungary India Indonesia Ireland Israel Italy Japan Korea Luxembourg Malaysia Mexico The Netherlands New Zealand Norway Peru Philippines Poland Portugal Puerto Rico Romania Russia Saudi Arabia Scotland Singapore Slovakia Slovenia South Africa Spain Sweden Switzerland Taiwan Thailand Turkey Ukraine United Kingdom United States Venezuela Vietnam Zimbabwe
Copyright 2001, Cisco Systems, Inc. All rights reserved. MGX is a trademark; and Catalyst, Cisco, Cisco IOS, Cisco Systems, and the Cisco Systems logo are registered trademarks of Cisco Systems, Inc. and/or its affiliates in the U.S. and certain other countries. All other trademarks mentioned in this document or Web site are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (0108R) Printed in the USA 09/01 BW7571