SAP Enterprise Support

Move Smoothly into Production After Software Maintenance and Upgrades

Leverage Test Management Services from SAP Enterprise Support

Move Smoothly into Production After Software Maintenance and Upgrades

Table of Contents
4
Start with SAP Solution Manager and SAP Enterprise Support Looking to SAP Enterprise Support Services

5 Guiding Manual Testing

Using Screens from SAP Solution Manager

Automating Tests Building Automated Tests with the Test Automation Framework Facilitating Test Creation for Business Analysts Supplying Test Data Analyzing the Impact of Change and Optimizing Test Scope

12

Adding Up the Benefits Examining Specific Approaches to Test Management Realizing Increased Efficiencies Exploring Related SAP Enterprise Support Services Summarizing SAP Enterprise Support Services Learning More

Deploy Smart Unit, Integration, and User-Acceptance Testing

Start with SAP Solution Manager and SAP Enterprise Support

You often implement changes to your SAP solutions to reflect maintenance and innovation. To minimize disruption to operations, you must carefully test those changes before moving them to production systems. To verify that business processes operate as expected after you upgrade functionality, your test team must understand those processes and how they interact. Then it must transfer that knowhow to rigorous test systems as time frames for testing continue to narrow in our quickly changing economy.
Looking to SAP Enterprise Support Services SAP Enterprise Support services help you implement and maintain a careful test management program that meets your needs for accuracy, completeness, and efficiency. As a first step, we recommend enabling transparency by documenting your software landscape and business processes using functionality in the SAP Solution Manager application management solution as illustrated in Figure 1. You can document your business processes in SAP Solution Manager in a number of ways: Using a service from the SAP Active Global Support organization for reverse business process documentation that populates the solution documentation assistant with content from your SAP solutions Selecting the business processes as provided by your SAP Business Suite software from the business process content repository Uploading business process content already documented in other tools such as Microsoft Excel Setting up business process documentation manually

Figure 1: Software Landscape and Business Process Documentation

Software landscape documentation SAP CRM Development Test Production SAP ERP Development Test Production Non-SAP business applications SAP Solution Manager providing the single source of truth

Business process documentation

Outlining Step-by-Step Execution and Expected Results

Guiding Manual Testing

If you havent yet automated your regression tests and rely on manual test execution instead, you should: Include explicit guidance in all scripts on how to execute single steps of the business transaction, with expected results for each Assign the relevant manual tests directly to the business transaction for convenient test execution Sequence business scenario tests to support a testing plan in which multiple testers perform multiple roles Using Screens from SAP Solution Manager Figure 2 shows a page from a well-designed manual script, with columns for step, activity, expected results, and actual results. The tester opens SAP Solution Manager, displays a tester work list, and views a list of test cases assigned to him or her (see Figure 3). After opening the test case and reading the steps to be performed, the tester starts the business transaction in the first test with a single click (see Figure 4). With this approach, testers have all functions available at their fingertips. They can: View assigned tests Read the test script Launch the business transaction in the assigned test Set the test status after test execution Create an incident in the integrated incident management function Document test results, including screenshots

Figure 2: Clear Steps and Results in Manual Test Scripts

SAP Enterprise Support services help you implement and maintain a careful test management program that meets your needs for accuracy, completeness, and efficiency.

Move Smoothly into Production After Software Maintenance and Upgrades

Figure 3: Easy Access to Test Scripts in SAP Solution Manager for Manual Testers

Figure 4: Streamlined Execution of Manual Tests with SAP Solution Manager

Managing Tests for Speed and Efficiency

Automating Tests
Automation of functional testing brings you significant savings in cost and time while reducing the risk of human error inherent in manual testing. SAP and its partners offer a variety of test automation applications for the functional testing of business processes. The test automation framework in the current release of SAP Solution Manager provides an infrastructure that allows you to integrate the test automation application of your choice. See Figure 5 for examples.

Figure 5: Capabilities of SAP Solution Manager for Test Management

SAP Solution Manager 7.1 Test planning Test case assignment Business blueprint Work center test management Test plan generation Tester assignment Test data provisioning SAP Test Data Migration Server Test execution Work center test management Manual tests Automated tests Test status reporting Work center test management Test workbench Reports from SAP NetWeaver BW Partner logs and reports

Test scope optimization Business process change analyzer

Test automation framework Test script creation Test system assignment Test data assignment Component-based test automation (CBTA) HP QTP Worksoft Certify Extended computer-aided test tool (eCATT) Other third-party test automation tools

Automation of functional testing brings you significant savings in cost and time while reducing the risk of human error i nherent in manual testing.

Move Smoothly into Production After Software Maintenance and Upgrades

Building Automated Tests with the Test Automation Framework The test automation framework in SAP Solution Manager currently supports integration of the SAP and third-party applications listed in Table 1. Additional vendors of test automation tools are currently certifying their applications with the test automation frame work in SAP Solution Manager. See http:/ /service.sap.com /testing on the SAP Support Portal destination for details on the testing tools listed in the table.

You can choose a combination of SAP and partner test automation applications to cover business processes from start to finish in software landscapes that include both SAP and non-SAP solutions. For example, you can use component based test automation (CBTA) to automate transactions that use the SAP GUI and the Web client user interface of SAP CRM. And you can use HP QTP to automate testing for other steps in your business process that are based on non-SAP solutions, applications you developed in-house, or SAP solutions with user interfaces other than SAP Solution Manager. Figure 6 shows a typical integrated approach to test automation.

Table 1: SAP and Third-Party Applications eCATT The extended computer-aided test tool (eCATT) from SAP covers the SAP GUI user interface and applications developed in the Web Dynpro development environment and ABAP programming language. This tool is appropriate for technical experts and requires no extra license with an SAP Enterprise Support agreement. Component-based test automation (CBTA) functionality provided by SAP Solution Manager covers the SAP GUI as well as the Web client user interface for the SAP Customer Relationship Management (SAP CRM) application. This tool is appropriate for business analysts and technical experts and requires no extra license with an SAP Enterprise Support agreement. HP Quick Test Professional (HP QTP) covers SAP and non-SAP user interface technologies. This tool is appropriate for business analysts and technical experts. Two licenses are included with an SAP Enterprise Support agreement. This test automation application from Worksoft covers SAP and non-SAP user interface technologies. This tool is appro priate for business analysts and technical experts. The SAP Enterprise Support agreement does not include licenses.

CBTA

HP QTP Worksoft Certify

Figure 6: Integrated Solution to Build Automated Tests

SAP Solution Manager Test configuration Test script Test data System data

HP QTP

Test system SAP software Non-SAP software 2 Test script recording during business process execution

1 Start of HP QTP recorder 4 Test script with parameters stored in SAP Solution Manager 3 Automatic parameter creation for input fields of the business transaction

Facilitating Test Creation for Business Analysts No matter which tool you choose, SAP Enterprise Support can help keep the creation of an automated test a straightforward task well within reach of a business analyst. The process begins with SAP Solution Manager in its work center for test management. The user first selects a step from the business process to be tested. After providing a few attributes, he or she launches the test automation software to create the test script. The user typically executes the business process directly in the assigned test system. The test software then records the steps performed and data entered and creates the test scripts auto matically. SAP Solution Manager provides the repository for all test scripts. Modern test tools can even generate input parameters for fields of the business transaction that require data input. These parameters help the test engineer assign appropriate test data later. You can assign test scripts, along with suitable test data and information about the software being tested, to the appropriate business process or step in SAP Solution Manager (see Figure 7). This approach helps spotlight required test scripts when a testing manager defines the test scope using standard or risk-based approaches.

Supplying Test Data Selecting and delivering suitable test data have traditionally been complex and time-consuming tasks. SAP Solution Manager helps you address these major challenges in the preparation of automated regression tests. Selecting Appropriate Data The first step is updating the test system with suitable master data and configuration data. Then you must select appropriate transactional data. SAP Test Data Migration Server software helps you refresh data quickly from selected source systems, such as your production or quality assurance systems. You can also update the test system manually with required data. Either way, your test system stays lean and efficient. Provisioning Data in Configurations with Automated Tests For test configurations that include automated test scripts, you must assign test data according to specified input param eters. Test data containers (TDCs) in SAP Solution Manager help your test engineers structure the data properly. Business analysts can plan or upload test data into TDCs to satisfy the input parameters of your automated test scripts.

Figure 7: Automated Tests Assigned to a Business Process or Process Step

Business process Test script CBTA, eCATT HP QTP Other third-party test automation tools Test data Test data container

Test configuration System under test Test system

SAP Business Suite SAP ERP Other SAP software

Move Smoothly into Production After Software Maintenance and Upgrades

A centralized approach using TDCs, as illustrated in Figure 8, offers a high degree of reuse, since multiple test configurations can consume test data from the same TDC. This approach also facilitates efficient change management, since you adjust data only once centrally and the software propagates the change to all occurrences of the affected records.

Executing Tests The tester can launch an automated test directly from the tester work list in SAP Solution Manager. As shown in Figure 9, test configuration functionality selects the test data and transmits it to the test automation application. The test script then runs, logging on to the test system and starting the business process controlled by the test script. Test results and logs are stored in SAP Solution Manager.

Figure 8: Use of Test Data Containers

1Test data container (TDC): Data structure

2TDC: Test data planning Test data entry Test data upload

Who: Test engineer How:  Create TDC parameter for all input fields of your business process used in test script

Who: Business analysts How:  Use test data stored in a TDC for multiple test configurations

Figure 9: Execution of Automated Tests with SAP Solution Manager

Tester work list in SAP Solution Manager 5Test results and logs

Test script / HP QTP 4 Logon and automated business process execution

System under test

1User starts test execution Test configuration Test script Test data System data

SAP software

Non-SAP software

2Test data selection Test data container (TDC)

3 Test execution: handover of test script, test data, system under test (SUT) info

SAP and its partners offer a variety of test automation applications for functional testing of business processes.

Analyzing the Impact of Change and Optimizing Test Scope The effort for regression testing rises significantly when you deploy large software changes, as with a major custom development or an SAP support or enhancement package. Such a change can impact virtually all your critical business processes. The business process change analyzer (BPCA) in SAP Solution Manager provides a risk-based approach to identifying test scope, helping your test managers control resource usage efficiently to provide full coverage. An initial change impact analysis helps you trace the potential effect of the change on your core processes. Then the business process change analyzer illustrated in Figure 10 helps you

ptimize test scope by ranking process steps according to o their impact. The BPCA also recommends a sequence of steps that reduces the amount of testing effort while enabling coverage of critical processes. Instead of testing all impacted business processes, the test manager can narrow the scope to test all changed SAP soft ware objects at least once. The manager can also select lower test coverage, for example 99%, which significantly reduces the testing effort. To mitigate risk, the manager can rely on a procedure that forces all critical business processes and assigned tests that are identified in the must-include area into the test scope. The BPCA in SAP Solution Manager automatically generates a test plan that includes the reduced set of test cases. Figure 10 outlines this approach.

Figure 10: Test Scope Optimization with the Business Process Change Analyzer

Move Smoothly into Production After Software Maintenance and Upgrades

11

Sampling Use Cases and Finding Further Information

Adding Up the Benefits

Examining Specific Approaches to Test Management The following suggestions explain how to handle specific requirements of your test management processes. Testing User Interfaces Not Covered by Test Automation Tools from SAP If you have user interface technologies not covered by CBTA or eCATT, you can use a test automation framework with HP QTP to avoid delays in testing schedules. You can typically achieve good results that way without the special intervention of SAP Enterprise Support. Minimizing Involvement of Business Process Experts After deploying multiple support and enhancement packages since your last test run, you may need to reduce the time required of business process experts when you revise testing plans. You can use the business process change analyzer to test scenarios involving key processes and investigate how to keep testing scope lean. Running Hundreds of Test Scripts Manually If your global enterprise is running manual testing with a library of hundreds of test scripts, you can reduce testing time and effort using SAP Solution Manager. It lets you create a central data repository for all scripts and establish a standardized structure for all worldwide testing. Adding the CBTA or HP QTP automatic test tool can expand your testing footprint to include new scenarios formerly not possible due to staffing limitations. Realizing Increased Efficiencies When you organize your test management processes using SAP Solution Manager and methodologies and services provided by SAP Enterprise Support, you gain: A central test management tool for tracking all testing activities Support for test management processes that meet the highest audit standards Optimal structuring of manual and automated tests rigorously assigned to business processes or process steps Analysis and ranking of change impact when adjusting scope to reduce testing effort More accurate documentation of your software landscape and business processes Significant reduction in costs due to lower resource usage when executing regression tests Significant decrease in numbers of defects found in each testing pass through the software landscape Greater resource availability for testing mission-critical functionality Ability to perform weekly or even daily validations of your entire production system, reducing the bulk of each transmission of updates Shorter time frames for acceptance and regression testing Implementation of an open infrastructure for inte grating solutions from SAP partners and outsource providers Ability to jump-start proof-of-concept projects for test automation using HP QTP or CBTA Exploring Related SAP Enterprise Support Services With an SAP Enterprise Support agreement, you are also entitled to additional services related to the test management process. First, you can select from the following set of classes we call expert-guided Implementation sessions: Solution Documentation I helps you understand options and adopt a solution for documenting business processes. Solution Documentation II presents reverse business process development functionality that takes into account the usage of standard objects during initial documentation. Test Management I shows you how to configure and use the test workbench included in SAP Solution Manager to generate, execute, and track test plans. Test Management II helps you record test bills of materials and execute analysis, optimize test scope, and generate appropriate test plans. Test Management III introduces the HP QTP test automation tool and helps you learn to manage it from SAP Solution Manager, which stores data and scripts. Recordings available through your SAP representative present the test automation concepts of HP QTP, the SAP Quality Center application by HP, and the SAP Test Acceleration and Optimization application.

Summarizing SAP Enterprise Support Services SAP Enterprise Support services for test management include: Methodologies for test management Applications for test planning, management of manual and automated tests, test data management, and test execution Applications for status analysis and reporting, as well as change impact analysis and test-scope optimization Services for road-map identification, knowledge transfer, and accelerated application setup and configuration Reference information For a list of online Meet the Expert sessions and guided implementations, please log on to SAP Support Portal at http:/ /service.sap.com/esacademy. Learning More For more information, contact your SAP representative, visit SAP Support Portal at http:/ /service.sap.com/support, or download these documents: Best Practice/Next Practice: Regression Testing of SAP-centric Business Processes containing five customer use cases and nine best-practice recommendations at www.sdn.sap.com/irj/sdn/alm-testmanagement on SAP Community Network Application Lifecycle Management at http:/ /service.sap.com/alm on SAP Support Portal Test Management at http:/ /service.sap.com/testing on SAP Support Portal SAP Enterprise Support Overview under SAP Enterprise Support on the SAP Service Marketplace extranet

Best Practices for Regression Testing Design a more effective test management program by integrating the following best practices: Lean documentation of important business processes Creation of lean test systems Automation of tests for critical business processes Comprehensive test data for automated regression tests Creation of step-by-step manual tests Change impact analysis and risk-based test-scope determination Unattended execution of automated regression tests Manual test execution with guidance for business users Orderly change management

You can choose a combination of SAP and partner test automation applications to cover business processes from start to finish in software landscapes that include both SAP and non-SAP solutions.

Move Smoothly into Production After Software Maintenance and Upgrades

13

www.sap.com/contactsap

CMP21828 (12/10) 2012 SAP AG. All rights reserved.

SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer, StreamWork, SAP HANA, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries. Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects Software Ltd. Business Objects is an SAP company. Sybase and Adaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and other Sybase products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Sybase Inc. Sybase is an SAP company. Crossgate, m@gic EDDY, B2B 360, and B2B 360 Services are registered trademarks of Crossgate AG in Germany and other countries. Crossgate is an SAP company. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary. These materials are subject to change without notice. These materials are provided by SAP AG and its affiliated companies (SAP Group) for informational purposes only, without representation or warranty of any kind, and SAP Group shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP Group products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty.