Test Automation Tool For SAP S4HANA Cloud

Powering
the customer journey

to the intelligent enterprise
Test Automation Tool for SAP S/4HANA Cloud
PUBLIC
Legal Disclaimer
The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission
of SAP. This presentation is not subject to your license agreement or any other service or subscription agreement with SAP.
SAP has no obligation to pursue any course of business outlined in this document or any related presentation, or to develop
or release any functionality mentioned therein. This document, or any related presentation and SAP’s strategy and possible
future developments, products and or platforms directions and functionality are all subject to change and may be changed
by SAP at any time for any reason without notice. The information in this document is not a commitment, promise or legal
obligation to deliver any material, code, or functionality. This document is provided without a warranty of any kind, either
express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or
noninfringement.
This document is for informational purposes and may not be incorporated into a contract. SAP assumes no responsibility for
errors or omissions in this document, except if such damages were caused by SAP’s willful misconduct or gross negligence.
All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which
speak only
as of their dates, and they should not be relied upon in making purchasing decisions.
© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 2

Purpose
The purpose of this accelerator is to provide information on how to use the test
automation tool for SAP S/4HANA Cloud within your SAP S/4HANA Cloud
implementation project, or for regression testing during the run phase.
Purpose of this accelerator is as follows:

➢ To understand how to create/copy and edit new Test processes in
MANAGE YOUR TEST PROCESS app
➢ To understand how to set-up Test Automation Tool in
TEST YOUR PROCESSES app
➢ To understand how to create/copy/edit & execute TEST plans in
TEST YOUR PROCESSES app
➢ To understand how to analyze the test results in
ANALYZE YOUR TEST RESULTS app
➢ To understand where to find further information

Content
▪ Test Automation Tool for SAP S/4HANA Overview
▪ Set up Test Automation Tool
▪ Manage Your Test Processes
▪ Test Your Processes
▪ Analyze Your Test Processes
▪ Post Upgrade Test for Live Customers
▪ Test Data Container
▪ Further Information

Usage Areas of the Test Automation Tool
Test Automation tool is integral part of S/4HANA Cloud and can be used to automate business process
testing within S/4HANA Cloud.
Discover Prepare Explore Realize Deploy Run
Continuous Innovation
Discovery Fit-to-Standard Scope and Migrate, Integrate, Onboard Operate, Test

Access Analysis Configure Extend, Test and Deploy Monitor, Support
1 2 3
Implementation End user Regression test
Priority areas of test tool test acceptance test – Test of
customer owned
1 3 Test cycles test cases after
upgrades or
© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC
scope changes 5
Usage Scenarios
Explore Realize Deploy Run
TEST TEST
SELF TEST TEST
EXECUTION – EXECUTION –
ENABLEMENT PLANNING PREPERATION
Implementation test Regression test
Executed after Q-system upgrade and prior to P-

Accelerators: Inputs: Inputs: Inputs: system upgrade
• Test Your Process • Solution Scope • Automated standard test scripts • Test Data/Data Variants
user guide
• Project Plan • SAP Best Practices process • Prepared test plans & cases Inputs:
• Manage Your • Standard and Customer specific test process
• Configuration backlog
Processes user Outputs: Outputs:
guide • Test Plan/Schedule • What’s new document from Accelerators section in
• Agreed test strategy • Status of test plan execution the SAP Best Practices Explorer
• Analyze automated • Project Plan, Test Strategy
• Test Plan/Test • Corrected and re-executed test plans • Manual test script release change information
test results user
Schedule
guide Outputs: • Test Execution monitoring – Reports
Outputs:
• Note 2129147 Accelerators: • Test Scenarios/test cases or test scripts • Test execution analysis – New app
• Validated functionality
• Customer specific test cases/scripts
• Test Strategy Accelerators: • Corrected and re-executed test plans
Template SAP • Configure test automation tool
• Analyze automated test results user • Defect handling by raising tickets in support portal
S/4HANA Cloud
guide
document Accelerators: • Test Execution analysis & reporting
• Detailed test • Test Your Processes user guide
• Available automated test scripts
schedule template
• Manage your processes user guide
• Detailed test schedule template Accelerators:
document document
• SAP Jam Group - Discussions with experts, more
• Test your processes user guide
• Support Portal details about test automation tool. For access,
• SAP Best Practices Explorer contact: saps4hanacloudtesttool@sap.com
• Support Portal
• Manual test script release change information
• What´s new in testing
Business Benefits
The Test Automation Tool is integral part of SAP S/4HANA Cloud. With pre-delivered test scripts you can automate your
business process tests. In addition, you can change existing or create new test cases via a recording functionality.
Business Benefits:
Acceleration: Accelerate business process and
regression tests
Accurate: Reach a high test coverage even
during short test cycles like upgrade tests
Configurable: Create or adapt test scripts via
recording functionality
Documentation: Documents all automated test
activities with screenshots
Analysis: Results dashboard with drill down
functionality

Test automation tool for S/4HANA Cloud
Lifecycle of test scripts
Automated test scripts, delivered by SAP, are being updated in quarterly

release updates to react on release dependent software, and configuration
changes. This helps you to reduce your efforts for quarterly release testing
essentially. 2111
Process steps, created or adapted by the customer are not being updated. Quarterly release upgrades
Adaptations to release dependent changes are in the responsibility of the
customer.
Avoid unnecessary effort during regression test

by leveraging standard artefacts as much as possible!

Manual Test Scripts And Automated Test Scripts
• Manual Test Scripts are available for SAP Best

Practice processes. Some of these manual test
scripts are available as pre-built test automation
scripts in the Test Automation Tool for SAP
S/4HANA Cloud.
• All available SAP S/4HANA Best Practice
processes are listed in SAP Best Practice
Explorer – Solution scope.
• Manual test scripts can be found in the “Details”
section of the SAP Best Practice Processes.
• The pre-delivered automated test scripts for test
automation tool, can be seen in “manage your
test processes” app, or in “Automated Test
Script Index” accelerator in SAP Roadmap
Viewer
• Please note: Not all manual test scripts (and process steps) can be automated (e.g. no automation available for output
management, analytics, download/upload steps, integration scenarios).
Test Approach Using SAP Activate Methodology for SAP S/4HANA Cloud
No matter if you are doing manual testing, or testing via test automation, each testing cycle should always have a test planning phase, a
test preparation phase, as well as the actual execution, and analysis phase.
This should be done in each project test cycle, such as:
Individual Test Phase
Iteration/Sprint
Regression test
In the Roadmap Viewer, there are template documents to assist with this test approach:
➢ Plan:
➢ Test Strategy (created once per project)
➢ Prepare:
➢ Detailed Test Schedule (per individual test phase or iteration)
➢ Execute and Analyze:
➢ Test Kick Off Presentation (per individual test phase or iteration)

Define your test cases (before start to test)
Define what needs to be tested

1) Identify implemented / used business processes, e.g. via
1) Standard testing scenarios : Input from project team/key user/ business user/ Statement of work
2) Custom testing scenarios: Input from Confirmed backlog from the F2S (relevant are those backlog items, that have been completed before the test cycle)
2) In addition, for regression testing

1) Release dependent changes of business processes in S/4HC in “What´s new viewer” in help portal ;
2) Release dependent changes in test script documents (Automated Test Scripts Change History)
3) Release dependent changes in test automats & test tool (accessible via icon “release change history” on bottom left in “manage your test processes” app)
Review existing SAP Best Practices for Test Automates

1) Identify available test automats for your business processes & countries (Test Cycle Overview Document in JAM Group, see above)
2) Define what shall be tested with test automation tool, and what shall be tested manually. Test scripts for manual tests can be found in SAP Best Practice Explorer at each
Business Process
3) Check for the relevant business processes the detailed test automat documentation. Identify if all process steps are supported, and the needed pre-requisites.
Documentation is within JAM Group (see above)
4) Via “manage your test processes” app in SAP S/4H Cloud, and via the test automat documentation per business process – is the process flow of the test automat fitting to
your implementation? Does it need to be adapted?
Define needed test data for the Test Processes

1) Typically, business users are defining the test data that should be used for the business processes
2) For automated testing, the test data sets needed for a business process are being maintained in data variants in “test your processes” app

Test automation tool
Process flow
Create test
Set up user
Set test
Manage Review SAP
Adapt standard test automate “visible in
your test Best Practice
automate if needed test your
processes test automates
processes” app
Define data
Test your variants and if Execute or Analyze, correct,
Create test plan and re-run
processes needed data schedule test plan
binding parameters

Content
▪ Set up Test Automation Tool

Configure Test User to allow test execution
Configure Test User to allow test execution (Contd.)
Configure Test User to allow test execution (Contd.)
Content
▪ Set Up test automation tool

Manage Test your processes – How to Access
The test automation tool for SAP S/4HANA Cloud can be accessed as follows.
Access Path:
Catalog Role: SAP_BR_ADMIN_TEST_AUTOMATION
Open “Manage Your Test Processes” App

Manage Your Test Processes - Functionalities
General Functionalities of the Manage Your Test Process app:
• View standard test process

• If required, copy a standard automate test process or create custom test process
• Convert standard process step to custom, create new custom process, or add from existing one.
• Edit actions in custom process step
• Check release compatibility of custom process step
• Change visibility of test plan

Step 1A: Manage Your Test Processes
View Standard Automate Test Processes
Search all available test processes
Test process specific functionalities.

Change history*, Download list, Filter, Create New For custom processes, also “change visibility”**
• The change history shows changes at standard automated test scripts compared to previous release.
• **Change visibility needs to be set, if a custom test process shall be visible in test your processes app
Step 1B: Manage Your Test Processes
Create Custom Test Process
If needed, custom test processes can be created.
1. Reasons to create custom test processes

2. Option 1 – create custom test process by copying from a standard/custom test process
3. Option 2 – create custom test process by creating a new custom test process from scratch via
I. Uploading a new test process and
II. Adding a new test process.

Reasons to adapt standard automats
Process flow Create Test Plan
! Leverage standard process steps as much as possible to avoid efforts after release upgrades!
Reasons to adapt
standard automate
Select the standard
Add standard /custom test script
SAP Best fields/custom fields
Practice test Make standard Custom Scripts
automates fields optional in Define data variants
actions
Merge, delete, or
add standard Execute the test plan
process steps
Add a new custom
step to existing If errors, resolve
issues and re-execute
standard process
Create completely
Testing is
new process successful
Creation of Custom Test Process
Option1- By copying from a standard/custom test process
1. Choose a standard or custom test

process from the left pane.
2. Click on Copy. A new custom test
process will be created.
3. Enter test process name and click
Save.

Option2 (I)- By creating a new custom test process from scratch via Uploading a new test process
1. Choose Plus icon.

2. And select Upload new test process
option.
3. Select a file from you PC and click on
submit.
4. A new custom test process will get
created.

Option2(II)- By Creating a new custom test process from scratch via Adding a new test process
1. Choose Plus icon.

2. And create test process option and
define Test process name and
Application scope.
3. Click on save.
4. A new custom test process will get
created.

Step 1C: Manage Your Test Processes
Convert standard process step to custom/ Create new custom process or add from existing one
A new custom process step is created in following way-

1. Converting standard process step to custom.
2. Creating a new custom process step from scratch
3. Creating a custom process step by adding from existing process step (Standard/ custom)

Option1- Converting standard process step to custom
1. Select Standard
process step which
needs some
modification
2. Click on ‘Change
Type’ to make
process step
custom.
3. Adjust business
role as required.*
4. Click on save.
Note - Customer needs
to validate compatibility
of custom process step
in each new releases.
*Since 1905, business roles
can be adapted in process
type „standard“
Option2- Creating a new custom process step from scratch
1. Click on Edit.
2. Select a process step
where a new process step
needs to be created
3. Click on ‘Add above’/ ‘Add
below’
4. A new process step will get
added accordingly.
5. Define a name of process
step and Business role &
save it.
Adding actions to new process
steps is described on step 1D.
Note - Customer needs to
validate compatibility of custom
process step in each new
releases
Option3- Creating a new process step by adding from existing process step (Standard/ custom)
1. Click on Edit.
2. Select a process step
where a new process step
needs to be created
3. Click on ‘Add above/ Add
below’.
4. A new process step will get
added accordingly.
5. Click on F4 icon and select
an existing Standard/
custom process as required
from existing test
processes.
Note - Customer needs to
validate compatibility of custom
process step in each new
releases
Step 1D: Manage Your Test Processes
Edit action in Custom process step
Following updates can be done by editing an action step-

1. Add a new action steps via a recording
2. Add a new action steps from an existing test processes.
3. Add action manually and Move action steps sequence.
4. Edit action Label, value and data binding

1. Add a new action steps via a recording
1. Select a new process step, and click on Edit
and then select Open recoding. Note- a
new action can also be added to an existing
process step by clicking on ‘Add below/ Add
after’.
2. Choose an application name (via a F4 icon)
for which recording is required and click
Submit.
3. A new ‘application’ window will be opened.
4. Click on Record.
5. Starting perform the steps on a new
application window and click on stop
recording icon after performing all required
steps.
6. On clicking the stop icon, the application
window will be closed and all the actions will
be added to the process steps.
Note- be aware of some important information
in the SAP Note
• Always use Chrome Browser
• Keyboard actions are not recorded. E.g. do
not navigate with the “tab” key, always click
into the field that you want to record.
2. Add a new action steps from an existing test processes.
1. Select an action step where a new
action step needs to be added.
2. Click on ‘Copy Action’.
3. An existing test process window
will get opened, and then choose
an action step from existing test
processes.
4. Click on Copy Action.
5. A new action step will get added
to be process step.

3. Add action manually and Move action steps sequence.
Add action manually-
1. Select an action step where a new
action needs to be added.
2. Click on Add Action.
3. An Add action pop-up will get
opened and then select an action
key and click on Submit.
4. A new action will get added to be
process step.
Move action steps sequence-

1. Select an action step which needs
to moved in a process step.
2. Click on Move Action.
3. A Move action pop-up will get
opened and then define a
sequence number where an action
step needs to be moved and click
on OK.

4. Edit action Label, value and data binding.
1. Every action in a process step has

Action No., option to make action
step Optional, Action Type, Label,
Value, Data Binding Details.
2. While Editing an action step, you

can make action step optional,
edit Label, Value, Data Binding of
actions of a custom test process.
3. Can also delete actions in

process step.

Step 1E: Manage Your Test Processes
Check for release compatibility of Custom process step in a test process
• SAP Updates the standard test process steps with new features and UI Changes after every quarterly upgrade.
However, Customer specific process steps have to be manually updated by customers after each upgrade.
• Hence, checking the compatibity of custom process step is vital and it helps customers to know if test cases are
compatible with new release and can be run without failure.

Step 1F: Manage Your Test Processes
Change Visibility of Test Process
• By clicking on “Change visibility”, a

custom test process can be made
available testing (for test plan
creation) in “Test your process” app.
• The visibility can also be reverted
back to “Not visible in Test Plan”, if
clicked again.

Content
▪ Set up test automation tool

Test Your Processes – How to Access
The test automation tool for S/4HANA Cloud can be accessed as follows.
Access Path:
Catalog Role: SAP_BR_ADMIN_TEST_AUTOMATION
Open “Test Your Process” App

Test Your Processes - Functionalities
General Functionalities of Test Your Process app:
• 2 A: Test plan hierachy

• 2B: Create a test plan
• 2C: Edit test plan
• 2D: Create/ Edit data variant
• 2E: Execute test plan/
Schedule for later
• 2F: View logs/ Print report

2A Test Your Processes – Test Plan Hierarchy
The Test Plan represents an end-to-end Business flow and can consist of several test processes. If you need
to hand over information from one test process to another, you need to have them in one test plan.
A Test Process represents a business process and is a set of one or more process steps.
• Standard Test Process: Standard processes are owned and updated by SAP. You can't edit a standard
test process.
• Custom Test Process: Custom test process can be created by either copying from Standard process or
by creating a new one according to your business needs. They can include standard and custom process
steps.
A Process Step is a series of actions.

• Standard Process Step: Standard process steps are owned, and if needed updated by SAP to reflect to
quarterly release changes. You should leverage as much as standard test processes to avoid
unnecessary effort during regression testing.
• Custom Process Step: Custom process steps can be created by either copying from standard process
step or by creating a new one. They are not updated by SAP. Customer needs to update them if needed.
An action is a user action performed on the application under test. Possible actions are Input, Click, Select,
Search and so on.
2B: Test Your Processes
Create a test plan
A new test plan can be created in following two ways-

1. By creating a new test plan.
2. By copying an existing test plan.

Create a test plan
1. Create a new test plan
1. Click on Plus (+) icon to create

a new test plan.
2. Define Test plan name.
3. Select test processes. Multiple
test processes can be selected.
4. Click on Save.

Create a test plan
2. Create a new test plan by copying an existing test plan
1. Select an existing test plan

which needs to be copied.
2. Click on Copy.
3. Define Test plan name and
select ‘Copy all variant’ if all
variants from an existing test
plan needs to be copied.
4. Click on Save.

2C: Test Your Processes
Edit a Test Plan
For an already executed test plan, following updates can be done by editing a Test plan-
1. Change Test plan name
2. Delete a Test Plan
For a Non-executed test plan, following updates can be done by editing a Test plan-
1. Change Test plan name
2. Add/delete test processes
3. Delete a Test Plan

Edit a Test Plan
1. An already executed test plan-
1. Click on Edit to change

Test plan name.
2. Update test plan name.
3. Delete Test plan if not
required.

Edit a Test Plan
2. A Non-executed test plan-
1. Click on Edit to change

Test plan name, add/
delete test processes.
2. Update test plan name.
3. Add/ delete test processes
by clicking on add/ delete
icon.
4. If you select add (+) icon,
select the test processes
from the pop-up window.
5. Delete Test plan if not
required.

2D: Test Your Processes
Create/ Edit data variant
DATA VARIANTS - Overview
A data variant stores the test data that is used to run the test process.
The combination of a test process and a data variant/test data is a test case.
On creation of a test plan a default data variant is created.
For standard test processes, this default data variant always
needs to be adapted.
Additional data variant can be created for a test plan as
required. For example, different data variant can be created
for a different Company code, countries etc.
In a Data Variants, the following data can be added/ update:

• Value
• System variables (e.g. date = today +1)
• Data Binding variables
NOTE: Instead of exchanging the test data in “manage your test processes”, we recommend to use the data variant on test
plan level (on test your processes).
Create new Data variant-
• On creation of test plan a
default variant is created by
default.
• On clicking the add new icon, a
new variant can be created.
• On clicking the copy icon, a
copy of an existing variant can
be created.
• On clicking the delete icon, a
variant can be deleted.
• On clicking the download/
upload icon, a data variant can
be download/ uploaded.
A data variant can be edited in an
offline excel and then uploaded
back to the system.

Edit Data variant-
A data variant can be edited either
offline (in an excel sheet) using
Download/ upload feature or online on
Manage variant tab.
To edit a data variant online-
1. Select Variant (on variant tab)
2. And then on edit data variant
screen, data variant description,
action step values, System
variables (e.g. date = today +1)
and Data binding can be added/
updated.
DATA BINDING is a connection
between value in one test process step
to value in another test process step
Example – An order number after
creation of purchase order can be
bound to the next process step as
input.

2E: Test Your Processes
Execute test plan/ Schedule for later
A Test plan can be executed

immediately or can be scheduled for
later time.
To execute a Test plan-
1. Select a test plan.
2. And click on Execute.
3. A Test plan can be executed
independently and parallelly for
each variant by selecting “Execute
with variants option’.
4. And then by selecting the
variants.
A test plan can also be re-executed
after every run.
On tab Logs, the details of each
execution run is maintained.

2E: Test Your Processes
Execute test plan/ Schedule for later
A Test plan can also be

executed via scheduling feature.
A test plan is scheduled as
follows-
1. Click on ‘Schedule test plan’
icon
2. Click on Plus icon.
3. On the Schedule Test plan
pop-up window- select test
plan, schedule day and end
date.
4. Click on save.
5. A Test plan can also be
edited using edit icon.

2F: Test Your Processes
View logs/Print report
1. Detailed logs of all the

execution can accessed
on Logs tab.
2. For each logs there is an
option to print
screenshots of all the
action steps and also to
download a report.
3. On clicking the
respective execution log,
You can drill down
further to each action
steps log and view
screenshot.
4. You can also Resume
Test plan from log tab.

Content
▪ Manage your Test Processes

Analyze Your Process – How to Access
With Catalog Role ‘SAP_BR_ADMIN_TEST_AUTOMATION’ all four test automation tool apps are accessible.
Open “Analyze Automated Test Results” App.

Analyze Automated Test Results
• Analyze automated Test result app

shows a dashboard of all test
executions.
• Test results can be filtered per

Releases
• Test results can also be analyzed

for
– Customer Test Plans
– Total test processes Executed
– Post Upgrade Test Plans (if
applicable)
• Drill down to executed test process

can also be done by clicking on the
graphs.

Failure Category and Failure Help

Content

Quality check via Post Upgrade test
Post Upgrade test (PUT) is a quality check after release upgrade. It is performed only for live customers, and only if the
customers provide their consent. It is an optional service from SAP that might be stopped any time. This post upgrade test
does not replace the regression test, that is in responsibility of the customer.
SAP owned process test (PUT) Customer owned process test

All functionality
described in
previous slides
▪ Standard* or custom test automates**

▪ Standard test automates* (single apps or
(end-to end business process or single
smaller processes)
apps)
▪ Master data automatically fetched from
▪ Master data defined by customer
customer system
(multiple data variants possible)
▪ Test plan created and executed by SAP
▪ Test plan created and executed (or
▪ Customer has to agree that SAP scheduled) by customer.
performs testing after the upgrade.
*Standard test automat - SAP delivered, preconfigured test script.

**Custom test automat - Customer specific test script.
SAP owned test after the upgrade
Provide Consent
Live customers who want the SAP owned tests to be executed after the upgrade, need to provide their CONSENT from the
“Test Your Process” app in the tool. Once consent is provided the tool allows you to WITHDRAW to inform SAP that in the
next upgrade cycle, no testing of SAP owned tests shall be executed.
1. Go to Post-upgrade
Tests tab (under test
your processes app).
2. Click on ‘Consent for
Post upgrade test’
icon.
3. And then click on
confirm if you want
SAP owned tests to be
executed after the
upgrade.
4. After consent, if you
want to withdraw from
SAP owned tests then
again click on
‘Consent for Post
upgrade test’ icon and
click Withdraw.
SAP owned tests – Where to Find Test Results
• Test results of SAP owned

tests are visible in “Test your
processes” app, on “Post
Upgrade Tests” tab.

Post-Upgrade Tests for Live Customers

Post-Upgrade Tests for Live Customers (Contd.)
• Start Time and End Time of each step
• Progress indicator
• Stop and Re-Trigger option

Content

Test Data Container
With Catalog Role ‘SAP_BR_ADMIN_TEST_AUTOMATION’ all four test automation tool apps are
accessible.
Open “Test Data Container” App.
For more information on Test Data Container, see the blog page and help portal page.

Test Data Container (Contd.)
• Template to create a test data container is available for various business areas, such as
Finance, Sales, Sourcing and Procurement, and Manufacturing.
• Changes made to the standard test data container and its fields are now visible in the Change
History window.
• Customers can download the test data container in the Microsoft Excel format.
• The downloaded test data container can also be uploaded in the Test Data Container app to
create or modify a test data container.
• In addition to tracking down the related test plan and test process, customers can navigate to the
respective test plans and test processes through the hyperlinks provided in the Where-Used
List.
• Rename the duplicate aliases of the functional fields while creating or editing a test data
container.

Content
Post Upgrade Test for Live Customers
▪ Test Data Containers

Test automation tool for S/4HANA Cloud
More Information
• Manage Your Test • SAP Best Practice • Test Automation Tool Set • Podcast
Guides
Blogs
Recordings
Other Links
Process User guide Automates Up
• Test Your Process User • SAP Note • BP Automated Testing
Guide • JAM Page Access Part 1
• Analyze Automated Test • SAP Best Practice • BP Automated Testing
Result User Explorer Part 2
• SAP S/4HANA Cloud • Frequently Asked • Regression Testing
Tutorials (SAP Customer) Questions Needed What How
• Test Your SAP S4HANA
Cloud Software
• Test Automation Still Too
Much Effort For
Regression Testing in
SAP S4HANA Cloud

Troubleshooting 1
Issue – Test plan execution stays “in process”
Test case in “Test your process” app has been executed, but keep showing as “in process” without any progress.
Test run does not seem to start.
Possible root cause
Test User is not maintained or not maintained correctly.
• Please maintain user via “test your processes” app (manage user functionality) described in testing tool admin guide.
• Check if you are using another Identity Provider than supported by test automation tool for S/4HANA Cloud (current list of supported Identity
Providers in SAP Note 2129147). If your Identity Provider is not in the list, please raise a support ticket under component CA-CTT-S4C.
Issue – Test process fails “could not open app”

Test process in “Test your process” app has been executed, “Enter Application” (first step) fails with message “Could not open
app”.
Possible root cause
Roles are not maintained sufficiently for SCP destination user. Role is missing or has no read and write access.
If you need to raise a support ticket, please use component CA-CTT-S4C.

Troubleshooting 2
Issue – Test case not visible in “Test your processes”
Test case is available in “Manage your processes” but I cannot find it in “Test your processes” app.
Possible root cause
Visibility of test process is set to “not visible in test plan”.
• Please go to “Manage your test processes” app, select the relevant test case and change the visibility.
Issue – All test cases seem to deliver errors (relevant for first time usage)
All test cases that I want to run deliver errors. Most errors are “master data not found”. This might happen, if you want to run a
standard use case without having done any changes yet. This happens only during first time usage of a test process.
Possible root cause
The standard test automats are delivered with demo data (organizational data, accounts, etc.). This demo data is not available in customer
systems.
• The demo data needs to be adapted to customer specific master data. We recommend to exchange the data via own data variants in “Test
your processes” application.
Issue – Manage your test processes or recording functionality does not work properly
Possible root cause
You are using another browser than Chrome. Please be aware that currently, only Chrome Browser is fully supported.
You did not click into the fields that you want to record, the recording functionality does not capture keyboard entries.

Troubleshooting 3
Issue – Recording of a new process step – I can´t find the application
I want to record a new process step. I enter an application name, but can´t find it.
Possible root cause
Missing authorizations. Only those applications that are available in the business roles assigned to the user will be shown.
• Please contact your system administrator, or the one who is assigning roles to users.
Application is not used in standard test automats yet.
• You still can try if the recording of your process step works. For this, you need to enter in the field “application name” the technical app name
that is displayed after the “#” sign in your browser. E.g. “CloudSolution-manage” like in this browser line:
https://myxxxxxx.s4hana.ondemand.com/ui#CloudSolution-manage
For more information, see Troubleshooting in Help portal.

Follow all of SAP
www.sap.com/contactsap
© 2021 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of
SAP SE or an SAP affiliate company.
The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its
distributors contain proprietary software components of other software vendors. National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or
warranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials.
The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty
statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional
warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or
any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation,
and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, and
functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason
without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or
functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ
materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they
should not be relied upon in making purchasing decisions.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered
trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names
mentioned are the trademarks of their respective companies.
See www.sap.com/corporate-en/legal/copyright/index.epx for additional trademark information and notices.

Test Automation Tool For SAP S4HANA Cloud

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Test Automation Tool For SAP S4HANA Cloud

Uploaded by

Copyright:

Available Formats

Powering

the customer journey

Test Automation Tool for SAP S/4HANA Cloud

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 2

Purpose of this accelerator is as follows:

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 3

▪ Test Automation Tool for SAP S/4HANA Overview

▪ Set up Test Automation Tool

▪ Manage Your Test Processes

▪ Test Your Processes

▪ Analyze Your Test Processes

▪ Post Upgrade Test for Live Customers

▪ Test Data Container

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 4

Discover Prepare Explore Realize Deploy Run

Discovery Fit-to-Standard Scope and Migrate, Integrate, Onboard Operate, Test

Explore Realize Deploy Run

Executed after Q-system upgrade and prior to P-

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 7

Automated test scripts, delivered by SAP, are being updated in quarterly

Avoid unnecessary effort during regression test

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 8

• Manual Test Scripts are available for SAP Best

➢ Test Strategy (created once per project)

➢ Detailed Test Schedule (per individual test phase or iteration)

➢ Execute and Analyze:

➢ Test Kick Off Presentation (per individual test phase or iteration)

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 10

Define what needs to be tested

2) In addition, for regression testing

Review existing SAP Best Practices for Test Automates

Define needed test data for the Test Processes

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 11

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 12

▪ Test Automation Tool for SAP S/4HANA Overview

▪ Set up Test Automation Tool

▪ Manage Your Test Processes

▪ Test Your Processes

▪ Analyze Your Test Processes

▪ Post Upgrade Test for Live Customers

▪ Test Data Container

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 13

▪ Test Automation Tool for SAP S/4HANA Overview

▪ Set Up test automation tool

▪ Manage Your Test Processes

▪ Test Your Processes

▪ Analyze Your Test Processes

▪ Post Upgrade Test for Live Customers

▪ Test Data Container

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 17

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 18

General Functionalities of the Manage Your Test Process app:

• View standard test process

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 19

Search all available test processes

Test process specific functionalities.

If needed, custom test processes can be created.

1. Reasons to create custom test processes

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 21

Option1- By copying from a standard/custom test process

1. Choose a standard or custom test

© 2021 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC 23