Where Value & Innovation co-exist

Automated regression testing

 Where Value & Innovation co-exist

Agenda

 Automation Process
 Automation Logical Flow
 Automation Framework Overview
 Automation Coverage
 Execution Method
 Result Tracking
 Automation Metrics

July 5, 2022 2
 Where Value & Innovation co-exist

Automation Process:

 List of Features to be Identified for Automation

 Preparing Automation Plan

 Scripting

 Reviewing of Scripts

 Execution of Scripts

 Exploring the Results

 Preparing Test Reports

July 5, 2022 3
 Where Value & Innovation co-exist

Automation Logical Flow

Framework Include Files

July 5, 2022 4
 Where Value & Innovation co-exist

Automation Framework
 Framework is the development of application friendly environment which includes Window
declaration, Methods declarations, Property declarations, Class declaration, Class objects
declaration, Functions declarations, data function declarations, result logging function
declaration.

 Snapfish Automation Framework Files:

 Include Files
 Global Functions.inc
 Functions.inc file providing smart and powerful functions for Snapfish application.
 This include file consists of all global functions used for the project.
 Window.inc
 Windows.inc consists of declarations of all the windows in Snapfish. Some of
windows having methods related with the functionality.
 Constant.inc
 Constants.inc file consists of all the constants used for the Snapfish automation
project like staging Urls, silktest shortcut keys, common text, common captions of
the objects etc.
 Classes.inc
 Existing silktest classes overriding, New class definition, Methods and properties
definitions, common objects definition is are defined in this file.
 Include.inc
 Which includes all the framework inc files.

July 5, 2022 5
 Where Value & Innovation co-exist

Cont…
 Script Files
 For each module, we will maintain separate script files which includes Data Driven
TestCases.
 Each Data Driven Testcase is derived by Test Driver File.

 Test Driver File

 Using External Flat File (like .xls)
 Which includes TestData for the corresponding TestCase.

 Master Plan Files

 Automated test cases/scripts are further organized into master test plans and suite files to
ensure priority-based test execution.

July 5, 2022 6
 Where Value & Innovation co-exist

Automation Coverage for Snapfish (Some

Part of Plans)
# Total TestCases # Automated # Not Automation
Automated Coverage
(%)
# Project/Feature

1 Fwd Prod to a Friend 167 40 128 24%

2 Web2Mobile on UK site 128 107 21 84%

3 Home Printing integration 925 415 510 45%

4 International registraiton 434 260 174 60%

5 Registration 242 130 112 54%

6 Card Store 1172 905 268 77%

July 5, 2022 7
 Where Value & Innovation co-exist

Execution Process & Results Tracking

 Scripts are automatically run using scheduling mechanism.
 Sanity test suite is scheduled to run after build deploy to make
sure build is ready for further tests.
 Automated test cases/scripts are further organized into master
test plans and suite files to ensure priority-based test execution
 Plan for executing the scripts is for every release as part of
regression
 Execute specific scripts based on the requests from Testing
team.
 Send Results files to testing team
 Analyse the results and report any errors found
 Re-run scripts for any errors found on next builds
 Result files are kept in perforce
 Metrics report prepared based on the results
 Failed cases will be re-executed in order to identify whether it’s a
bug or script error.

July 5, 2022 8
 Where Value & Innovation co-exist

Automation Metrics for Snapfish

 No. of Regression Test cases automated: 40000+ (Approx.)

testcases
 Regression person-hours covered by Automation suite: 3000+
(Approx.) hours.

July 5, 2022 9
 Where Value & Innovation co-exist

Thank you!

July 5, 2022 10