Download as pptx, pdf, or txt
Download as pptx, pdf, or txt
You are on page 1of 20

TA - TietoEVRY

Monthly Status Report

August 2021
EXECUTIVE SUMMARY – TRANSAMERICA QE
TRANSAMERICA QE HIGHLIGHTS – OCT’21
Supported testing for 5 major programs and delivered 12 RTS & 15 BAU initiatives

1.0 KEY PROGRAM HIGHLIGHTS 3.0 EXECUTION SUMMARY


 35 of 36 planned sprints are completed, Testing completed for App submit
Sep 2021 
PowerApps enhancements, BOB stories execution is in progress
(Go-Live)
 SIT: 70% completed, tracking a target completion date of 9/13

 
Cloud  Testing completed for Annuity Policy API changes, Policy Issue for NewARK
(In-Sprint
Migration and Transaction History API update part of 8/31 AX/IX Quick Hits 1 Release
end)

Compass 9/13/2021   QE E2E testing for Dry Run 2 is complete and Q2 results under review with
Modernization (SIT end) Business 

PowerApps Wave  QE E2E testing for Dry Run 2 is complete and Q2 results under review with
10/25/2021
2 Business 
PowerApps Tan  Day 2 activities tested and moved to production.
10/25/2021
Leads

2.0 RESOURCING HIGHLIGHTS 4.0 AUTOMATION & INNOVATION


Onboarded 5 resources, Offboarded 2 resources
• Registration – Autaomtion suite is used to test for Cloud Migration

Offshore Onshore • PowerApps- POC and Framework demoed on Oct 28 th. Working on Smoke Suite for Engage App.
150

100

50
12 13 14 14 14 16
6 6 6* 6* 6 6
0
May-21 Jun-21 Jul-21 Aug-21 Sep-21 Oct-21

For internal use only.


KEY QE METRICS – OCT’21
Automated TC Execution % (including Regression) Automated Regression Suite %
Savings Through Automation in October 2021
100% 100%
Targets Targets Total Test Cases executed using Automation : 195
80% 80%
71% 70%

60% 60%
60% 173 390
50%
Manual Effort Required Automation Efforts
195* 40% (hours) Used (hours)
40% 40% 33%
30%

20% 20% 4865 10602 Saving including


Regression 126 hrs.
0%
0% 0%
Aug-21 Oct-21 Nov-21 Jul-21 Aug-21 Sep-21 Dec-21

*For August 2021


• Total Test Cases Executed = 10777 , out of which 7846 (Refer Slide #55) were executed using automation
• Out of 7846 Automated Test Cases, 6458 Test Cases are Regression and 1388 are Functional Test Cases
• Additional 1326 Automated Regression Test Cases in AX/IX which were executed 20 times in Aug’21
• Targeted Regression Suite Size ~ 15000 by end of this year

Average from
QE Metric Oct 2021 Target for Nov 2021 Comments
last 3 months

Defect Leakage UAT - 6% (True leakage – 2%) UAT – 7% Defect leakage to production • This data is from PowerApps and In sprint activities of each application
Defects found in UAT/Prod Prod – 3% (True leakage – 3%) Prod – 3% should be less than 10% • Reason for high defect leakage for PowerApps is because of Data specific.

Defect Aging (in days)


• Cloud Migration defects are having more resolution as they have not been still looked
Time taken for a defect from the date it is logged till it is 9 days 32 days NA
into and not updated by Dev
being worked upon

Defect Density Identify maximum number


• This data excludes 197 automated regression test case run 5 times in Oct and 7
0.03 0.03 of defects with minimum
Total identified TA defects / Total test cases executed defects logged in Registration
number of test cases

For internal use only.


KEY METRICS
Performance
Ref # Service Level Name Objective Aug’21 HIGH MEDIUM LOW
Category

Placed Personnel On- To measure Service Provider’s ability to on-board Placed Personnel in a
Staff Aug. 1.1 3   x  
boarding timely manner
Staff Aug. 1.2 Placed Personnel Turnover To measure Placed Personnel Turnover 2 days   x  
Ratio of Manual vs. Automation – 67%
 Staff Aug. 1.3         
Automation Testers Manual – 33%
Automated vs. Manual Test To measure amount of testing done through automated testing versus
qTest 2.1 67% x    
Execution manual
Test Automation Coverage – To measure the percentage of total regression test  cases executed
qTest 2.2 67 % (75% by Q4) x    
Regression Suite through automation

qTest 2.3 Requirements Coverage To measure the percent of requirements with a test case mapped 100%   x  
UAT - 6% (True
To measure the number of defects found in UAT and Production that leakage – 0%)
qTest 2.4 Defect Leakage x    
are replicable in QA environment and attributable to QA Prod – 3% (True
leakage – 3%)
In-Sprint Test Automation To measure the percentage of in-sprint test cases executed through
qTest 2.5 x    
Coverage automation
To measure the time period from Defect discovery to the date the 30 days (Cloud
qTest 2.6 Defect Aging   x  
Defect is worked on by Service Provider Migration)

qTest 2.7 Defect Density To measure the defect density for the Change and Run initiatives 0.03 (efects) x    

qTest 2.8 Testing Cost of Defect To measure the time spent by Placed Personnel on re-testing Defects     x
To measure the time period from Defect discovery to the date the
qTest 2.9 Defect Find to Fix Ratio   x  
Defect is fixed.
To measure the number of story points or user story tested within a
qTest 2.10 Testing Velocity   x  
sprint test.
Planned – $ XK
Financial 3.1 Monthly Spend To measure the planned versus actual spend for a month x    
Actual - $ XK

To measure the forecasted versus actual number of productive hours Planned – X


Financial 3.2 Productive Hours   x  
PROGRAMS & STATUS
QE PROGRAM STATUS SUMMARY Last Week

Delivery Delivery RAG Status RAG Status


Program Name  Status Update (As of 10/31)
Lead (ON) Lead (OFF) for Sept 21 for Oct’21

• Testing completed for sprint activities.


Vamshi
myWFG Avinash KJ GREEN AMBER • Cloud Migration- Multiple test cycles have been executed in Test and Model. Environment stable from
Bandi
11/04

Archana Ankita
Workflow GREEN GREEN • Test progress for
Gururajan Bhatnagar

Ankita
Registration Pallabi C GREEN AMBER
Bhatnagar

Testing completed for Gen14 data till GDQ for 8 domains


Dylan Parveen
Individual Salesforce GREEN GREEN Testing is in progress for Activity domain in GDQ layer
McDonald Kumar
Unit testing for Automation script is completed

• Test Strategy review completed


• Test plan creation for individual pods is in progress
• Automation of EA process (Policy application creation process) is completed
• Delay in requirements finalization might impact QE timelines
PowerApps Vamshi B Avinash KJ AMBER AMBER
• Requirement Gathering for Day2 is In-Progress
• Identifying test cases for Automation smoke and regression suit is completed
• Automation Framework is finalized and automation for Smoke suit is kick started
• Derived tests for CANADA OBA

• Testing completed for e-app End to End flow (except MRAS decision), pizza tracker stories, Book of
Business API enhancements, Customer validation orchestration enhancements and Get policy details API.
Compass TBD Shweta Singh GREEN GREEN • JSIT-Quotes flow completed with intermittent issues. e-application, GIACT and Token X validation in
progress.
• API Automation started actively for all the 8 PODS and SIT – Unqork automation planned to be used.

Srinivasan
Cloud Migration Sushma AMBER AMBER
Kannan

For internal use only.


Last Month Current Month

M Y W FG – R T S # 9 1 5 5 4 & R T S # 8 3 1 3 2 , P R O D U C T I O N Status
As of 10/29 GREEN GREEN

SUPPORT Status
Status
Asofof11/06/18
As 11/06/18
Project Overview

 Completed FINRA 2022, & Production support tickets, Project Start


 RTS 91554 -Fee Realignment and Consolidation Production movement in progress, End Date Go Live Date # of Resources
Date
 RTS-83132 Cloud migration is in progress.

10/1/21 10/31/21 TBD 6

Description Current RAG Status Planned Release Key Accomplishments Upcoming Milestones

FINRA 2022 – Testing completed for


TTITFMW-3806 • MyWFG Lifeline Notification - FINRA 2022
TTITFMW-3832 GREEN 10/4/2021 • Testing completed for Internal Reports
TTITFMW-3836 • MyWFG Agent facing Reports
TTITFMW-3855 • Payment Central - Access FINRA Renewal Information
TTITFMW-4113
Production Support Testing complete for
10/5/2021
TTITFMW-3963 • Outstanding Balance Reminder Notification
10/5/2021 • INC0481938 - WFG Agent - MyWFG Team Chart Issue
TTITFMW-3964
GREEN 10/14/2021 • RightBridge SSO - Update URL
TTITFMW-4136
10/6/2021 • Cashbal Payment Missing
TTITFMW-4152
10/7/2021
TTITFMW-4179 • Emergency - Getting MyWFG up and running
TTITFMW-4228 • October recurring payment - US and CA jobs erred out
RTS 9 1 5 5 4
TTITFMW-4100
TTITFMW-4101 GREEN 1/11/2021 • Testing completed in model and Deploying to Production.
TTITFMW-4102
TTITFMW-4103
RTS-83132
• MyWFG Testing in-progress in Model.
Cloud migration GREEN 12/31/2021
• Docu sign, payment central integrations working fine.
Overall Status

MY WFG
Status
Status
Test Cases
Asofof11/06/18
As 11/06/18
User Stories Defects Defect Leakage Defect Ageing
Description Current Status Completed Automation Defect Density
Manual Execution Logged to UAT/Prod (days)
Execution

My WFG GREEN 16 78 35 6 0% 0.0 5

For internal use only.


Last Month Current Month

R E G I S T R A T I O N – R T S # 9 1 5 5 4 & R T S # 83 1 3 2 Status
As of 01/11 GREEN GREEN
NewARK BAU Production Support along with Day 2 activities are In Progress Status
Status
Asofof11/06/18
As 11/06/18
Project Overview

RTS-91554 Summary: As a part of RTS initiative for Fee realignment, we have made changes to the fee charged during Project Start
End Date Go Live Date # of Resources
registration and reinstatement of agents, associates and direct deps.  Date

RTS-83132 Summary- AWS cloud migration of entire registration application 09/28/2021 10/29/2021 11/01/2021 4

Planned
Description Current RAG Status Key Accomplishments Upcoming Milestones
Release

• Update fee implementation is been done


• Testing has been completed on time before CAB review deadline
11/29

RTS-91554 Updated fee


GREEN 01/11/2021
Re-alignment • RTS development (Dev/QA) does include 14 user stories including 2
production defects which makes in total 16 user stories
• In total 5 defects been found out and all are in closed status
• Respective release ticket been moved “release candidate” status, for
which we have planned to move to live on 01/11

RTS-83132 Cloud • Registration application testing is in progress in MODEL


GREEN 12/31/2021 environment
migration
• Docusign and compass integrations are working fine
Overall Status

REGISTRATION
Status
Status
Test Cases
Asofof11/06/18
As 11/06/18
User Stories Defects Defect Leakage Defect Ageing
Description Current Status Completed Automation Defect Density
Manual Execution Logged to UAT/Prod (days)
Execution

RTS-91554 Updated ^UAT – 100%


fee Re-alignment GREEN 16 245 195 5 0.0 6
^^Prod – 0%

^Defects not implemented in Day1 functionality and now being tracked as part of Day 2 scope
^^ Environment specific issues in Production which cannot be reproduced in lower environments

Testing Velocity Test Case Execution – Automation Coverage

300 300
245
250 250
245

Test Cases Manual/Au-


200 195
163 200
150
150

tomation
100 85
97%
54 62 100
50
1* 50
0
Apr-21 May-21 Jun-21 Jul-21 Aug-21 Oct-21 0 3%
Manual Automation
Test cases per person per month

* Team executed higher count of Automation Regression test cases for this release
and thus slight reduction in velocity compared to last month

For internal use only.


C O M P A S S – R T S # P R O D U C T I O N S U P P O R T & F I X ES . B AU B R EA K F I X E S ,
I N - 8 9 7 2 2 7 - T F A M O D I F I C A T I O N S T O C O M P AS S
Project Overview
Compass maintenance, production support & fixes. BAU Break Fixes , IN-897227 - TFA Modifications to COMPASS

Current RAG
Description Planned Release Key Accomplishments Upcoming Milestones
Status

• Test execution for US ACH is completed.


• Test execution for M&T Bank file format with effective date updated is completed
TTI-4770 GREEN 10/18/2021 NA
• ACH file transmit to M&T testing completed
• Released to Production Completed

• Test case preparation Completed and linked to Qtest


• Test execution for M&T Bank file format is completed
10/18/2021
TTI-4912 GREEN • Released to Production Completed NA

• Test execution for Duplicate Group delete completed


TTI-4992 GREEN 10/28/2021 • Test execution for adding missing receipts to the Groups completed NA
• Test execution for adding batches to the correct group completed

TTI-4914 GREEN • Verification of Section tables design completed Data Load


TTI-5094 GREEN 10/28/2021 • Creation of Manual T Error return file for CANADA is completed NA
Overall Status

COMPASS
Test Cases
Status
Status
User Stories Defects Defect Leakage Defect Ageing
Description Current Status Asofof11/06/18
As 11/06/18
Defect Density
Completed Automation Logged to UAT/Prod (days)
Manual Execution
Execution

COMPASS GREEN 5 10 0 0 0% 0 0

Testing Velocity Test Case Execution – Automation Coverage

12 310
10
10 290
270

Test Cases Manual/Au-


8
250
6
230

tomation
4 210 54% 46%
2 190
0 170
Apr-21 May-21 Jun-21 Jul-21 Aug-21 Oct-21 150
Manual Automation
Test cases per person per month
*Testing Velocity reduced by half because in IFRS17, Dry and Trial Run testing was not performed.
** For MJE?AAH Upgrade, only UAT testing was carried out in Jul’21. For Dry Run 2, testing to start in Aug’21.

For internal use only.


Last Month Current Month

P O W ER A P P S # 2 82 1 Status
As of 10/29 AMBER AMBER

Validating migration of Salesforce functionalities to PowerApps Status


Status
Asofof11/06/18
As 11/06/18
Project Overview
 Transamerica is migrating from the existing salesforce platform to Microsoft PowerApps platform. The migration Project Start
End Date Go Live Date # of Resources
involves : Date
SERVICE: Seeks to provide improved customer experience for agents. Application will leverage native features including
case routing, service level agreements, and interactive dashboards
05/01/2021 10/22/2021 10/25/2021 6

Description Current RAG Status Planned Release Key Accomplishments Upcoming Milestones

Smoke testing for Customer Service is Completed


SERVICE GREEN 10/29/2021 Defects validation completed Canada OBA & Tenfold release
WAVE2 Release completed
Planning session in progress
ENGAGE AMBER TBD Complete timelines and requirement TBD
-

Wave2 Release Completed.


LAUNCH AMBER TBD Complete timelines and requirement TBD
Planning session in progress

Tan Leads Day 1 and Day 2 release successfully


TAN LEADS GREEN TBD Change requests and Production tickets
delivered.

Key Risk/Issue/Decision Owner Mitigation Plan Impact ETA Status

Catchup on test execution for


Service : Emails are not triggering Dev Testing Timelines 10/29/2021 In-progress
delayed data delivery time
Overall Status

POWERAPPS
Test Cases
Status
Status
User Stories ^ Defects Defect Leakage to Defect Ageing
Description Current Status AsofofDefect
As 11/06/18
11/06/18
Density
Completed Automation Logged UAT/Prod (days)
Manual Execution
Execution

LAUNCH AMBER 47 216 0 5 0%

SERVICE GREEN 4 160 7 2 0%

ENGAGE AMBER 75 90 10 5 0%

TAN LEADS GREEN 10 72 0 3 1%

Testing Velocity Test Case Execution – Automation Coverage

250
216 600
200 480
164 500

Test Cases Manual/Au-


150 400
100 300

tomation
41 200
50

0 100
Jul-21 Aug-21 Oct-21 0
0
Manual Automation
Test cases per person per month

For internal use only.


Last Month Current Month
WORKFLOW – RTS # Status
GREEN AMBER
As of 08/31
Validating Boron files for CDB ,EPN and SDM downstream systems Status
Status
Asofof11/06/18
As 11/06/18
Project Overview

• RILA - Registered Index Linked Annuity, can be described as a cross between a fixed indexed annuity and a Project Start
End Date Go Live Date # of Resources
variable annuity. RILA limits customer's downside exposure, if they are willing to accept some market risk Date
in exchange for more growth potential
• RILA products are also known in the industry as Structured, Hybrid, Indexed Variable, or Buffer annuities 1/1/2021 5/15/2022 5/1/2022 TBD
• TA will offer 2 versions of the product, (1) Standard commission version and (2) Advisory Fee-based version

Project Highlights
Key Milestones % Milestone Date RAG • QE resource identification is in progress for Vantage scope of work. 100% Resources
available for non-vantage support
• Execution phase expected mid of  Sep’21
QE Kick-off meeting 100% 5/7/2021 GREEN • Scope and dependencies are being analyzed with P65 as the source system
•  2/18/22 - Product Readiness for friends and Family 
•  5/1/22   - Go live date
Test Strategy Preparation 100% 8/13/2021 GREEN

Test Strategy Walk through 100% 8/26/2021 GREEN

Test Strategy sign-off 90% 09/17/2021 GREEN

Key Risk/Issue/Decision Owner Mitigation Plan Impact ETA Status

Product Owners across QE to work closely with QE timelines might shift


Delayed requirements finalization stakeholders and determine the right and impacting 9/15/2021 In-Progress
pods
path to green overall delivery date
Expediting the process with Might not have planned
Vantage QE resource identification Vamshi Bandi resources onboarded by 10/1/2021 In-progress
contract to hire approach
9/15
Overall Status

WORKFLOW
Test Cases
Status
Status
User Stories ^ Defects Defect Leakage to Defect Ageing
Description Current Status AsofofDefect
As 11/06/18
11/06/18
Density
Completed Automation Logged UAT/Prod (days)
Manual Execution
Execution

IDL/IDW/IDA AMBER 6 216 0 11 0% 0.1 16

Finance CDE AMBER 75 175 0 24 0% 0.1 13

^ Additional 54 defects logged on LTCG

Testing Velocity Test Case Execution – Automation Coverage

200 450
391
164 400
150 350

Test Cases Manual/Au-


300
100 250

tomation
200
100%
41 150
50
100
50 0
0
Jul-21 Aug-21 0
Manual Automation
Test cases per person per month

For internal use only.


Last Month Current Month

I N D I V I D U A L S A L ES F O R C E Status
As of 10/29 GREEN GREEN
Validating the APIs in different In-Sprint Dolphin teams which is created as part of Pod #5, to perform functionalities across 8 business capabilities.
Status
Project Overview As of 11/06/18
# of
Completed test plan of 6 user stories and testing has been completed for 2 user storied and moved to production this Product Start Date Go-Live Date
Resources
month.
UI and DB Changes 10/01/2021 Nov’ 21
10

Project Highlights & Accomplishments (API ,JSIT and Data team updates)
Current RAG Planned
Description Key Accomplishments​ Upcoming Milestones​
Status​ Release
TTDSF – 5659 GREEN 03/11/2021 Test plan completed and awaiting deployment in QA
TTDSF – 5764 GREEN 10/11/2021 Test plan completed and awaiting deployment in QA
TTDSF – 6085 GREEN 03/11/2021 Test plan completed and awaiting deployment in QA
TTDSF – 6297 GREEN 10/11/2021 Test plan completed and awaiting deployment in QA
TTDSF - 7848 GREEN 03/11/2021 Test plan completed and awaiting deployment in QA
TTDSF - 8436 GREEN 10/11/2021 Test plan completed and awaiting deployment in QA
TTDSF - 8673 GREEN 20/10/2021 Testing completed and moved to production
TTDSF - 8675 GREEN 25/10/2021 Testing completed and moved to production
Overall Status

INDIVIDUAL SALESFORCE
Test Cases
User Stories Defect
Current Defects Defect Ageing
Team Description Completed Automation Leakage to Defect Density
Status Manual Execution Logged (days)
Execution UAT/Prod

UI and DB Changes GREEN 8 58 0 4 0% 0.0 0

Testing Velocity Test Case Execution – Automation Coverage

80 70
58* 58
60 60
44
50

Manual/Automa-
40
40

Test Cases
20
30

tion
0 20
Aug-21 Oct-21
10
0
Test cases per person per month 0
Manual Automation

75% 25%

*Velocity reduction on account of Product team not working on Automation execution in Jun’21.
** Velocity reduction due to multiple stories being started in July but their execution completion scheduled to happen in Aug

For internal use only.


Overall Status

CLOUD [AWS] MIGRATION


Test Cases
Status
Status
User Stories Defects Defect Leakage Defect Ageing
Description Current Status Automation Asofof11/06/18
As 11/06/18
Defect Density
Completed Manual Execution Logged to UAT/Prod (days)
Execution

My WFG AMBER 1 304 0 9 0% 0.17 7

REGISTRATION GREEN 1 490 195 4 0% 0.13 9

COMPASS GREEN 0 301 0 5 0% 0 0

WORKFLOW GREEN 4 41 0 9 0% 0.11 5

Testing Velocity Test Case Execution – Automation Coverage

160
141
140
120
545

Test Cases Manual/Au-


100
Test Cases per person per 80

tomation
month 97%
60
40
20 5
3%
0
Manual Automation

For internal use only.

You might also like