<Insert Picture Here>

PeopleSoft Test Framework: Simplifying Upgrade and Maintenance

scott.hirni@oracle.com

Application Technology
Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied
upon in making purchasing decisions. The development, release, and timing of any
features or functionality described for Oracles products remains at the sole
discretion of Oracle.

2
Agenda

<Insert Picture Here>

What is the PeopleSoft Test Framework ?

Installation and Configuration

Creating Tests and Test Cases

Developing Tests
Manual Steps, Debugging , Optimizing

Changes Impact Upgrades / Maintenance

Resources and New Features

3
Agenda

<Insert Picture Here>

What is PTF Purpose and Architecture

Installation and Configuration

Creating Tests and Test Cases

Developing Tests
Manual Steps, Debugging , Optimizing

Changes Impact Upgrades / Maintenance

Resources and New Features

4
PeopleSoft Test Framework

Are you looking for your company to execute better testing

for PeopleSoft with greater accuracy during a shorter period <Insert Picture Here>

of time?

Many IT shops report that the single largest cost of

upgrading is testing.

The PeopleSoft Test Framework (PTF) test maintenance

process drastically reduces the expense and risk in testing
upgrades.

PTF streamlines the testing process with intelligent reporting

capabilities comparing new upgrade features with your
testing scenarios.

5
PeopleSoft Test Framework What is it?

Record and Playback testing tool AND MORE!

Integrated with PeopleTools
Integrated with Lifecycle Management, Upgrades and
Change Management
Provides durable record of test
Provides documentation of processes

6
PeopleSoft Test Framework What is it?

Tests and Test Cases are PeopleTools Managed Objects

Comparable
Copyable
Stores references to all Records, Fields, Pages, Menus,
Components used in a test in the database
Stores playback log information in the database
Client program connects to database via web services

7
PeopleSoft Test Framework Architecture

8
Agenda

<Insert Picture Here>

What is PTF Purpose and Architecture

Installation and Configuration

Creating Tests and Test Cases

Developing Tests
Manual Steps, Debugging , Optimizing

Changes Impact Upgrades / Maintenance

Resources and New Features

9
Installing the PTF Client
Requirements:
Microsoft Windows
Supports only Microsoft Internet Explorer.
Microsoft .NET 3.5 or above
Read/write access to the PTF Home Directory
C:\Program Files\PeopleSoft\PeopleSoft Test Framework
Runtime access to the PTF Data Directory
C:\Documents and Settings\<User>\Application
Data\PeopleSoft\PeopleSoft Test Framework (by default)
Configure the Client Browser
Security settings to accept the test application URL.
Add *.mydomain.com to zone (trusted, internal, etc.)
Run the PTF Setup Wizard to install the PTF client

10
Installing the PTF Client
Run the PTF Setup Wizard to install the PTF Client
:

Setup.exe is located in the directory

PS_HOME>\setup\PsTestFramework
11
Configuring PTF
Connect to Database
Set Execution Options
Set Local Options

12
Agenda

<Insert Picture Here>

What is PTF Purpose and Architecture

Installation and Configuration

Creating Tests and Test Cases

Developing Tests
Manual Steps, Debugging , Optimizing

Changes Impact Upgrades / Maintenance

Resources and New Features

13
PTF Tightly Integrated with PeopleTools

14
PTF Components
PTF Client Features
Explorer
Test Editor
Test Recorder
PTF Web Features
Configuration
Administration
Test Reporting
Usage Monitor

15
PTF Client PTF Explorer

16
PTF Client - PTF Explorer
Create, Copy and Delete tests and folders.
Navigate to and open test assets

17
PTF Test Structure
Test level
Save as
Message recognition
Properties
Comments
Test Case level
Save as (new)
Properties
Comments
Step level
Field label (new available as tooltip or distinct column)
Prompt to select test for Test.Exec step (new)
Comments

18
PTF Client - Test Editor
A PTF Test consists of a Test Case and a series of Steps
When recording a test, PTF creates one step for each
action you take against the target application

19
PTF Client - PTF Log
When running a test, PTF creates an execution log entry
The log is located in PTF Explorer under the test name,
in the log folder specified in Execution Options

20
PTF Explorer - Shell Tests

A type of test that is used primarily to call other tests

Shell Tests support the following options:

Test.Exec - calling other tests
DataMover.Exec calling data mover scripts
Query.Exec running queries
Variable.Set_Value manipulating variablesu

21
PTF Client - PTF Log
Log entries in the Logs folder of PTF Explorer

22
PTF Client Record and Playback

23
PTF Recorder

Recording and activation features

Log actions (messages, screen shots, etc.)
Get Property action
Exists action
Conditional actions
Variable handling
Scroll keys and scroll actions
GetLabel action
Pause / review / edit / add comments to steps during recording
Modify default recording modes (for a given recording session)
Page prompting
Message recognition

24
PTF Recorder

Additional info for the tester can now be defined as part of a PTF Test
Formatted comments
CaptureScreen shots

25
PTF - Interface with Other PeopleTools

26
PTF Enhanced PeopleTools Functionality
Data Mover
Parameters for script input / output / working path
Queries
Query.Exec_Private action
Define expected number of rows returned
Secondary pages
Page.SecPage_Open and .SecPage_Close actions
Functionality for new PeopleTools objects and features
Modal frames
[Browser.FrameSet Recognition ptModFrame_##]
LongText.SetValue_InModal action
Scroll.ModalGrid_Open and .ModalGrid_Close actions
Mouse right-clicks
Image.RightClick action

27
PTF Administration Information in PIA
Set default recording options
Page prompting
Message recognition
Define process server list (for execution options)
Define execution options
Test compare report
Test details report

28
Agenda

<Insert Picture Here>

What is PTF Purpose and Architecture

Installation and Configuration

Creating Tests and Test Cases

Developing Tests
Manual Steps, Debugging , Optimizing

Changes Impact Upgrades / Maintenance

Resources and New Features

29
PTF Explorer Test Optimization

When you record a test you often record unecessary steps

You might need to correct typos that might appear in your test

30
PTF Test Level Automation
Change execution options during execution
Execution.Set_Options
Override specific execution option settings during execution
Skip login Execution.Skip_Login
Skip run request Execution.Skip_RunRequest
Skip page save Execution.Skip_PageSave
Stop on error Execution.Skip_On_Error
Manipulate URL during execution
Browser.Set_URL - works with Page.Prompt, not entire URL
Call log actions from a shell
Pass values to library tests as true parameters

31
 PTF Step Level Automation
Add additional logic to tests with
Loop.Do, .For, and .While actions
Conditional.Else action
AND and OR operations
Manipulate strings with string functions
Substr, Trim, Replace, Concat, etc.
Manipulate and calculate numeric values with math functions
Add, Multiply, Round, Now, etc.
Reference system values with system variables
last process instance, current test name, etc.
Add pauses with Wait.For_Seconds and For_Value actions
Verify field labels with .GetLabel action
Call multiple test cases in one step
Supply comma-separated list in Value field
Skip Test.Exec steps for certain test cases with #IGNORE
32
PTF Explorer Test Optimization
- Modify steps within a test
- These four steps log you into the PeopleSoft application

Using Test Optimization you can replace these four steps listed above with
one step using Browser.Start_Login.

This action opens the browser instance where the test will be executed and
logs into the PeopleSoft application using the URL, user ID, and password
from the selected execution option.

33
 PTF Explorer Test Optimization

Variables
Store a value for a variable in a parameter in the Recognition field on the
step

Refer to the values stored in a variable in two ways:

Use a Conditional.If_Then step
Use the variable in the value field of a step that sets or verifies the value

34
 PTF Explorer Test Optimization
- Reserved Words provide access to data available from the PTF program when a
test is executed
- Reserved Words are useful when data is not known before the test is executed

35
PTF Explorer Test Optimization
#PREFIX#

Reserved word substitutes the text in the Prefix field for the string in the
Value field

Run the test again with a different value, only needing to change the value
in the Prefix field

36
PTF Explorer Test Optimization

#LIST#

Reserved word LIST will check for the values of a ComboBox. It works
either on full text entries or translation values.

37
PTF Explorer Quick Open

Quick Open allows for easy sharing of tests

Leverages Copy Link to Clipboard Feature

PTF enables you to send links to test, test cases, and logs to other user
This feature is available in PTF Explorer, Test Editor, and Log Viewer
The system automatically copies the link for the asset to the Quick Open
dialog box
Recipient opens the test asset and is able to work with that asset

38
PTF Explorer Test Optimization
Application Error management
You can use the Error Handling feature to indicate that PTF should
click OK if an expected error occurs.

39
PTF Explorer Test Optimization
Application Error Management
Enter the button that PTF should select when it encounters the
message. Select the action that should be taken.

40
 PTF Explorer Test Optimization
Reserved Words enable you to access data available from the PTF program
when a test is executed.
Reserved Words are useful when data is not known before the test is executed

Example of step that requires a conditional construct

41
PTF Explorer Test Optimization
Optimizing Scroll testing

PeopleSoft Test Framework (PTF) references a field in a scroll by the field

name and the row number.

You can use the Scroll.Key_Set action and a Scroll.Action step to locate a
row by key and generate a dynamic position index variable.

You can use the dynamic position index variable to reference a row or a
field reliably and repeatably because the variable is regenerated each time
the test is run.

42
PTF Explorer - Test Optimization
Easily leverage testing ofPeopleSoft scrolling function
Data in a PeopleSoft component is organized hierarchically using rowsets,
or scrolls, and rows

43
 PTF Explorer Test Optimization

Test that needs to kick off a Process Scheduler execution

Optimize Test by replacing above test with steps below using

Process.Run

44
Agenda

<Insert Picture Here>

What is PTF Purpose and Architecture

Installation and Configuration

Creating Tests and Test Cases

Developing Tests
Manual Steps, Debugging , Optimizing

Changes Impact Upgrades / Maintenance

Resources and New Features

45
 PeopleSoft Test Framework

Test data & Impact data stored in tables

Analyze with Query, Pivot Grid or any BI Tool

46
 PeopleSoft Change Management

Change Awareness and Risk Mitigation Application Designer

Change Assistant

PeopleSoft Test Framework

Compare Reports

Usage Monitor

Change Impact Analyzer

Application Data Sets

47
 Testing - Without PeopleSoft Test Framework

Process Duration

Download Impact Analysis Development System Test

IT

Apply or
Business System Test
ignore

Manual effort Decision based Unit test System test by

on manual business owners
Review Compare Review and fix
impact analysis customizations
Reports Test majority of
as needed application
Manually check
application
functionality
Estimate level of
effort

48
 Testing with PeopleSoft Test Framework

Process Duration

System
Download Impact Analysis Development
IT Test

Apply or System
Business ignore
Test

Automated Decision based Fix impacted System test by

Run compare on automated customization impacted
reports to db impact as needed business
information owners
Run test case Unit test with
maintenance business Sign-off for
report developed move to
test cases production
Review test case
impacts
Estimate level of
effort

49
Usage Monitor

Enhancement to Performance Monitor

Captures Pattern of Usage
Completely Detailed
every object touched (page, menu, field, PeopleCode, etc.)
Stored in Database
Should be run over fixed period of time
30 days, Typical Business Process Cycle
Turn off after data is captured
Usage Monitor Aggegator
App Engine Program that aggregates raw data for analysis

50
Compare Report Output Option

Extends impact analysis

Stores compare data in database tables

Compare data available via PS Query

51
Leveraging Business MetaData
Application Features and Functions

Your Usage

Your Tests

ooo x
ooo xxxx
ooo xxxxx
oo xxxxx
Compare oo xxxx
Data oo xx

52
 PTF - Impact Analysis Process

1. Run usage 3. Apply maintenance 5. Impact Analysis

monitor or upgrade
PS APPS Test cases
PS Maintenance Pack or
System usage
Change Package
Changed objects

2. Create PTF test cases 4. Run the compare report

for each business process with data written to tables

Why PeopleSoft Test Framework?

Reduce fear and uncertainty of change
Understand scope of impact
Reduce time, complexity and cost of system testing

53
 Upgrades And Maintenance - Today

Discovery Manually Intensive

Development

Manually Review Compare Reports System Testing

Check application functionality for
potential impact
Estimate level of effort
Migration
Decisions often based on partial or
incomplete analysis
Review and fix customizations as needed
Developers complete unit testing
Business Owners complete system test
Scope of test usually very broad, often
majority of application

54
 Upgrades And Maintenance - Today

Discovery Manually Intensive

Development

Manually Review Compare Reports System Testing

Check application functionality for
potential impact
Estimate level of effort Business Process
Adoption
Decisions often based on partial or
incomplete analysis
Review and fix customizations as needed
Developers complete unit testing
Business Owners complete system test
Scope of test usually very broad, often
majority of application

55
 Upgrades And Maintenance - Today

Discovery Manually Intensive

Development

Manually Review Compare Reports System Testing

Check application functionality for
potential impact
Estimate level of effort Business Process
Adoption
Decisions often based on partial or
incomplete analysis
Review and fix customizations as needed
Developers complete unit testing
Business Owners complete system test
Scope of test usually very broad, often
majority of application

56
 Upgrades And Maintenance - with PTF

Discovery

Development

Automated process System Testing

Coverage Report
Decision to apply change based on
impact analysis Migration

Review and fix impacted customizations as

needed
Developers complete unit testing using PTF
test cases
Business Owners complete system test
against impacted processes
57
 Upgrades And Maintenance with PTF

Discovery

Development

Automated process System Testing

Coverage Report
Decision to apply maintenance based
on impact analysis Business Process
Adoption

Review and fix impacted customizations as

needed
Developers complete unit testing using PTF
test cases
Business Owners complete system test
against impacted processes
58
 Upgrades And Maintenance with PTF

Discovery

Development

Automated process System Testing

Coverage Report
Decision to apply maintenance based
on impact analysis Business Process
Adoption

Review and fix impacted customizations as

needed
Developers complete unit testing using PTF
test cases
Business Owners complete system test
against impacted processes
59
 PeopleSoft Test Framework Test Reporting

Test Maintenance Reports

- Correlates PeopleTools Compare Report data with PTF Test metadata
- Helps identify certain changes to Menus, Components, Pages,
Records, and Fields that may impact the PTF tests
Test Coverage Reports
- Correlates PeopleTools Project data with PTF Test metadata
- Helps identify menus, components, pages, records, and fields that are
referenced in PTF tests
- A Test Coverage Report identifies which objects included in the change
project are referenced by which PTF test
- Any object included in the change project that is not referenced in the
PTF test metadata appears in the report identified as a coverage gap

63
PTF Test Maintenance Reports

64
PTF Test Coverage Reports

65
 <Insert Picture Here>

More Information

66
 More Information

Oracle University Training Documentation

education.oracle.com docs.oracle.com

67
 PeopleTools Viewlets Now Available
http://download.oracle.com/peopletools/viewlets.html

Helpful insights into many PeopleTools features

Topic Areas
Web Services & Integration Broker
Life cycle Management
Enterprise 2.0 and User Interface
Platforms
Reporting
Security
PeopleTools for the Developer
General PeopleTools
PeopleSoft Test Framework

68
69