IBM Rational Software

Development Conference

2008

KOBCA Getting ROI on Automation

Pankaj Goel Sr. Technical Consultant, Crestech Software Systems pgoel@crestech.in Mario Anthony Pereira Chief manager, Testing MaxNewYorkLife Limited mario.pereira@maxnewyorklife.com

2007 IBM Corporation

IBM Rational Software Development Conference 2008

Agenda
Challenges faced in testing complex, Insurance domain applications Role of Test Automation in testing complex, Business Driven application. KOBCA Introduction and Motivation Demo of the KOBCA A keyword driven framework over IBM RFT Case study How KOBCA helped a major insurance giant increase their test coverage and reduce the testing cycles by more than 40%

IBM Rational Software Development Conference 2008

Insurance Applications - Spectrum

Insurance Applications

IBM Rational Software Development Conference 2008

Insurance Testing : Business Challenges

Faster Time-To-Market for New products
Refers to the ability to launch the new products faster

Changes in the existing system to meet the new requirements

Refers to the flexibility of customizing existing product based on market dynamics

Ensuring the Quality of products and End user Experience

Technology has to keep pace with Market

IBM Rational Software Development Conference 2008

Insurance Testing : Technical Challenges

Permutations and combinations allowed with product
Multiple variants of same plan Each plan to be tested with different data combinations (eg. Age, terms, sum assured, finds, Premium, Billing mode) Bottom line: Testing is highly Data-Intensive

Long term scope of business application

Regression testing assumes a never before proportion

Test Environment Setup

Test data System dates
5

IBM Rational Software Development Conference 2008

Whats the solution

Given the challenges, How can I test
More effectively (Lesser Defect Leakages) More efficiently (In reduces time) More exhaustively (Increased test coverage)

Answer : Test Automation

IBM Rational Software Development Conference 2008

Automation Approach
Conventional Automation Approach
Record\PlayBack DataDriven Framework Functional Decomposition

Challenges
Dependency on Automation Expert Reduced Role of Business Tester Dependency on Application Availability Risk involved with change of Automation Tool

IBM Rational Software Development Conference 2008

Our Solution: KOBCA

Stands for Keyword Oriented Business Component Automation Prescribes a flexible framework allowing testers to define test scenario in English Automation Scripts are generated automatically based on configured test scenarios

IBM Rational Software Development Conference 2008

KOBCA : Motivators
Empowerment of Business Experts in test Automation Expedite through Re-Use Tool Agnostic Approach meaning flexibility Effective Test Data Management Intuitive Reporting Facility- Lesser time to debug

IBM Rational Software Development Conference 2008

KOBCA :Elements

10

IBM Rational Software Development Conference 2008

KOBCA - Elements

Test Automation Tool External Function Libraries Object Repositories Data-pool Business Components Test Scripts

11

IBM Rational Software Development Conference 2008

Automation Tool
Tool of choice : IBM Rational Functional Tester Advantages
Validate dynamic data with dynamic data validation wizard Ensure playback resilient to application changes with ScriptAssure technology Test script version control for parallel development Powerful test editing language Java Native Java and Visual Basic .NET editor and debugger for advanced testers

12

IBM Rational Software Development Conference 2008

Test Automation Process

Automation Architecture Design Automation Engineer Create Function Libraries Create Object Repositories Create Business Components Create Test Cases in Spread-Sheet Test Engineer Configure Input parameters in data-pool Add tests to test suite

Subject Matter Expert

or

13

IBM Rational Software Development Conference 2008

DEMO

14

IBM Rational Software Development Conference 2008

Case Study
KOBCA implementation helps Max New York Life in Cutting Regression testing Costs by more than 40%

15

IBM Rational Software Development Conference 2008

MNYL : Pre-Automation situation

In Pre-Automation Phase functional testing activities in MNYL could be classified in three broad activities Test Data Preparation Test Step Execution and Conditional Validation Test Reporting and Defect Tracking

16

IBM Rational Software Development Conference 2008

MNYL : Pre-Automation situation

Challenges Wide spectrum of product offerings This means high regression testing effort to ensure top quality IT systems Parallel development tracks for multiple releases means higher pressure on testing team Dependency on Data Entry team to create policies for testing

17

IBM Rational Software Development Conference 2008

Test Automation - Approach

MNYL Partnered with Crestech Software Systems, an Independent testing vendor to study the system and come up with Automation strategy Joint Automation Group Set up to validate the strategy and devise the plan Study was conducted for Automation tool and IBM Rational Functional Tester was selected for its ease of use and power packed features

18

IBM Rational Software Development Conference 2008

On Demand Automation through KOBCA

Implementation
implemented by building a highly scalable and modular keyword driven framework automates the testing process while taking care of maintainability and scalability of the testing processes.

Key Features
Presenting a easy to use interface (Generally spreadsheet based) instead of eclipse based RFT interface to the automation end users to create their test cases Integration of automation framework with Bug Reporting interface (SEVA) Preparation of centralized test reporting interface

19

IBM Rational Software Development Conference 2008

Automation Plan
Four Phased Approach
Phase-1 Phase-2 Phase-3 Phase-4

Test Planning and Data Entry Automation

Creation of Regression Test Pack for the Core Systems

Integration of RT Pack with Satellite Systems

Preparation of Keyword Driven Framework

20

IBM Rational Software Development Conference 2008

MNYL : Post-Automation situation

KOBCA helped bring the power of automation to the Business analyst and development team Ensured a better testing of developed components and their integration early in development life cycle A better Test planning beginning from very early in SDLC helped MNYL IT department deliver releases on time and with highest quality. Reduction of regression testing cost by 40%. Increase in acceptance of products among business users

21

IBM Rational Software Development Conference 2008

QUESTIONS

22

IBM Rational Software Development Conference 2008

Learn more at: IBM Rational software IBM Rational Software Delivery Platform Process and portfolio management Change and release management Quality management Architecture management

THANK YOU
Rational trial downloads Leading Innovation Web site developerWorks Rational IBM Rational TV IBM Rational Business Partners

Copyright IBM Corporation 2008. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBMs sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, the ondemand business logo, Rational, the Rational logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.

23