Deployment Testing

22-Apr-2013
Definitions: Verification and Validation

• The International Software Testing Qualifications Board

(ISTQB) has the following definitions:
– Verification – Confirmation by examination and through the
provision of objective evidence that the specified requirements have
been fulfilled. i.e. Is the system correct to the specification?
– Validation – Confirmation by examination and through the provision
of objective evidence that the requirements for a specific intended
use or application have been fulfilled. i.e. Is this the right
specification or, is this what the customer wanted?

© 2012 Unisys Corporation. All rights reserved. 2

Mapping VVT to the full Deployment Cycle

Test
Cust’ Requirements
Requirements
Deploy Service CAT

Test
User Specifications
Specifications
Build Service UAT

Tech Design Test Design Build Systems FAT

Foundation
Analyst Configure Data
Validation

© 2012 Unisys Corporation. All rights reserved. 3

Deployment Testing: Goals & Challenges

• Goals
– Ensure the best possible Customer Experience at Go Live
– Ensure the “Go Live System” meets the business needs of both
Unisys & the Customer
– Ensure the Go Live system is identical to the system as tested
– Minimise the time gap between final testing & Go Live
• Challenges
– UAT & PROD not functionally identical
– UAT to PROD data transfer not error free
– Time taken to transfer from UAT to PROD

© 2012 Unisys Corporation. All rights reserved. 4

 Deployment Testing

Legend: Environment: UAT Environment: PROD

Verification Validation
Can be combined
if necessary. Customer
Acceptance
Test
Customer & Unisys
Delivery Team

User
Acceptance
Test
Factory
Unisys Delivery Acceptance
Team Test

Deployment Foundation Foundation

Analyst Data Validation Data Validation

© 2012 Unisys Corporation. All rights reserved. 5

Full Test Lifecycle

© 2012 Unisys Corporation. All rights reserved. 6

Backup Slides
Dictionary:
Term/Acr. Description
BAU Business As Usual
Customer Acceptance Testing this is where the customer will
CAT perform their own service level testing to confirm readiness to
accept the service into Steady State.
Is a failure in the tool or configuration that means the
Defect
requirements are not met.
Dynamic Testing that involves the execution of software or a component of
Testing a system.
Factory Acceptance Testing is where the delivery teams execute
FAT internal service level test scenarios to confirm readiness for
delivery.
Foundation Data Validation is where the account and project
FDV team check the data that has been loaded into the tool against
the templates and operational procedures/structure.

© 2012 Unisys Corporation. All rights reserved. 8

 Term/Acr. Description
Integration Integration Testing is; testing that each component integrates and
Testing works with each other. E.g. SLM and IM work together.
A potential defect. That has yet to be confirmed as a defect. This
Issue may turn out to be ‘User Error’, ‘By Design’, Query for
clarification, etc.
ISTQB International Software Testing Qualifications Board
ITSM IT Service Management
A potential defect that has yet to be confirmed as a defect. This
Issue
may be user error, ‘By Design’, Query for clarification, etc.
International Software Testing Qualifications Board a governing
ISTQB board in the Software Testing industry set up to define a common
language and standards.
Scenario A Test Scenario is a complete story based on a process.
Is the steps, input and expected output required to test a feature
Script or function. There may be more than one script to complete a
scenario. However currently we use one script per scenario.

© 2012 Unisys Corporation. All rights reserved. 9

Term/Acr. Description
Testing of a component or system at specification or
Static
implementation level without execution of that software. E.g.
Testing
review of static code or designs.
System In our context a system can be considered ITSM, SRMS, Portal
Testing etc.
System of
System of Systems Testing is when all components and systems
System
come together to form the service to be delivered.
Testing
Unit testing is when the Engineers test their components in
Unit Testing isolation from the whole service. In our context a unit would be
SLM, IM, CM etc.
Unisys User Acceptance Testing, AKA Operations Testing, is
UAT where the Account Teams run scenarios to confirm readiness to
accept the service into Steady State
VVT Verification and Validation Testing

© 2012 Unisys Corporation. All rights reserved. 10