2023

delivering quality @ speed and scale

Icertis-Weekly Status Report

2023/05/11 to 2023/05/17

© Confidential. All Rights Reserved. 2023

 Weekly Highlights

Business Apps – Global Cause Upgrades-

Platform Integration AI/ML Hyper Care Team
Sourcing & SRM Library-GCL Functional Team

For 8.4 Feature For 8.4 Feature PBI’s Verified -- 3 Attended Govcon Performed upgrade Performed post Work Flow Testing –
testing details please testing details please Performed Sanity syncup meeting testing on upgrade verification activities for 12 CT’s (Humana,
refer Execution refer Execution testing on SRM, MM Analyse proposal instances Rebate & MM Apps Masstech, Sysco &
summary in Slide#3 Test case cleanup – App’s & MtTest9– 4 workflow Performed testing of Triggered automation Dell)
Patch Bug Analysis— 20/20 completed TC’s Updated Scenarios for New development of for Rebate-QA instance Sanity Testing – 2
97/97 and designed 44- 8.4 Regression Pass Working on API proposal Govcon feature and Monitoring Automation
(Masstech & Humana)
TC’s –22/22 Testing & CRUD ES Records Deletion
Created CVT test case reported 8-observations summary Dashboard
Bug Triaging and Performed Customer operations -- 50
in Postman Executed Regression Completed the Post
Prioritization—72/72 Regression Suite Verified issue which Analyzed Customer
Test Case execution – 3/3 reproducing on Completed Testing of failed test case– 1 TC Clean Deployment
reported Bugs – 5
Optimization—12/12 completed multiapp insance for User Story – 5 TC’s Updated 4 Govcon configuration for (MassTech)
Performed 8.4 Performed 8.4 MMApp Bugs Retested – 3 Test Cases as per new mmapp-rel81 instance Bugs Reported –11
Aspose testing – 32 Lambda Mac Browser Completed non-seed (Solicitation) design Performed basic sanity (Humana, Masstech&
TC’s & reverification of Testing configuration on 12 Bugs Retested – 7 on mmapp-rel81 MBUSA)
failed TC’s –15 Supported below instance for MMApp Completed Core instance – 1TC Bugs Retesting -- 3
Test case Clean up – release testing sanity Concepts -- Phishing Reported 2--issues on (Sysco, Humana,
10/10 completed activities: Performed certification. mmapp-rel81 instance Masstech & MBUSA)
8.4 Regression Pass •Completed retesting of Regression Testing – 8 Gone through ICI Updated changes in
–13/13 4/4 bugs for 8.3 GA TC’s course modules TC and triggered
Performed 8.4 Jumbo Hot Fix Executed BVT Test automation and
Lambda Mac Browser •Completed retesting of cases – 3 TC’s performed failure
Testing 3/3 bugs for 8.3 P1 Worked on E2E flow analysis – 1 TC
Performed RC2 Jumbo Hot Fix for opdev instance &
8.4.0.83 Sanity •Completed retesting of sourcing as part of
Performed Customer 4/4 bugs for 8.2 MP2 VAPT Testing
Regression Suite Hot Fix Worked on 'Upgrade'
execution – 3/8 •Completed retesting of Testing for sourcing 8.4
completed 7/7 bugs for 8.2 P4 Hot Involved in below
Performed Sanity and Fix discussions & sessions:
regression testing for •'Awarding' feature
Hotfix’s, MP2 & MP3 queries
and detail complete •Deployment activities
summary is cited in
(slide#3)
 Executive Summary
Test Execution Summary from 11-05-2023 to 17-05-2023
Total Test Cases Total
Completed/ In NA/ Execution
Team Activity # of Resources or Executed Fail On-Hold Comments
Pass Progress Out of Scope %
Count /Analysed
Patch Bug Analysis 97 97 97 - - - - 100%
Patch Bug Analysis -- Test cases designed 44 - - - - - - -
Customer Regression Suite execution 8 3 3 - - - - 36%
8.2.1 Jumbo Hotfix -- Sanity Suite Execution 17 17 17 - - - - 100%
8.2.3.0 Hotfix -- Regression Test Execution 4 4 4 - - - - 100%
8.2.4.0 -- Regression Test Execution 30 30 30 - - - - 100% 1-Bug Retested
8.3 MP2 -- Regression Test Execution 8 8 8 - - - - 100%
1-Bug reported
8.3 MP2 -- Sanity Test Execution 18 18 18 - - - - 100%
8.3.2.1 Hotfix-- Sanity Execution 18 18 18 - - - - 100% 1-Bug reported
8.3.3.2 Hotfix-- Regression Execution 1 1 1 - - - - 100%
8.3.2.3 Hotfix-- Regression Execution 4 4 4 - - - - 100% 2-Bugs Reported
8.3.2.4 Hotfix-- Regression Execution 3 3 3 - - - - 100%
8.3 MP3 Release -- Regression Execution 7 7 7 - - - - 100% 1-Bug reported
PLATFORM Bug Triaging and Prioritization 72 72 72 - - - - 100%
3
TEAM Test Case Optimization 12 - - - - - - -
8.4 Aspose upgrade 23.3 Testing 32 32 32 - - - - 100% 4-Bugs reported
8.4 Aspose Reverification of Failed TC's 15 15 15 - - - - 100%
8.4 Regression Pass 13 13 13 - - - - 100% 1-Bug reported
Test Cases Cleanup 10 10 10 - - - - 100%
1558131-PBI's status 15 15 15 - - - - 100%
Feature#1554822-PBI's status 35 35 35 - - - - 100% 4-Bugs reported
Feature#1661231 WOPI -- Created Test Scenerios 19 - - - - - - - On-Hold
Aspose upgrade testing 14 14 14 - - - - 100%
Feature#1577630-PBI's status 16 16 16 - - - - 100% 24-Bugs reported
Feature#1519835-PBI's status 13 13 13 - - - - 100% 5-Bugs reported
8.3 P2 Sanity testing on Accessibility features 20 20 20 - - - - 100%
8.3 P3 Sanity testing on Accessibility features 15 15 15 - - - - 100%
8.4 General Bugs reported 19 - - - - - - -
Feature#1554035-PBI's status 19 19 19 - - - - 100% 1- Bug Reported
Feature#869410-PBI's status 17 17 17 - - - - 100%
- - - - - 1/3 PBI's tested later marked as Out
Feature#1347376-PBI's status (Out of Scope) 3 3 -
of Scope
- - - - - 3/5 PBI's tested later marked as Out
Feature#1380253-PBI's status (Out of Scope) 5 5 -
of Scope
Feature#1661203-PBI's status 6 6 6 - - - - 100%
INTEGRATION 1
Test Cases Cleanup 20 20 - - - - - -
8.4 Regression Pass 22 22 22 - - - - 100%
Customer Regression Suite execution 3 3 3 - - - - 100%
Bug Retesting -- 8.3 GA Jumbo Hot Fix 4 4 4 - - - - 100%
Bug Retesting -- 8.3 P1 Jumbo Hot Fix 3 3 3 - - - - 100%
Bug Retesting -- 8.2 MP2 Hot Fix 4 4 4 - - - - 100%
Bug Retesting -- 8.2 P4 Hot Fix 7 7 7 - - - - 100%
GRAND TOTAL 4 692 585 565 - - - 8 -
© Confidential. All Rights Reserved. 2023
 Executive Summary

Test Execution Summary from 04-05-2023 to 10-05-2023

Total Test
Total
# of Cases Completed/P On- In NA/Out
Team Activity Executed/Analy Fail Execution % Comments
Resources or ass Hold Progress of Scope
zed
Count
Basic Sanity on MMApp-rel81 instance 1 1 1 - - - - 100%

HYPER CARE TEAM Reported Issues MMApp-rel81 1 2 - - - - - - -

instance
Automation Failure Analysis 1 1 1 - - - - 100%
Faile Regression Test Cases Executed 1 1 1 - - - - 100%
AIML Updated Govcon Test cases 1 4 - - - - - - -
Bugs Retested 7 7 7 - - - - 100%
PBI's Verified 3 3 3 - - - - 100%
Sanity Testing on SRM, MM App’s &
4 4 4 - - - - 100%
MtTest9
SOURCING & SRM Regression Testing 2 8 8 8 - - - - 100%
Executed BVT Test cases 3 3 3 - - - - 100%
E2E testing on opdev instance &
2 2 2 - - - - 100%
sourcing as part of VAPT Testing
Testing of User Story 5 5 5 - - - - 100%
GCL 1
Bugs Retesting (Solicitation) 3 3 3 - - - - 100%
Sanity Testing -- (Masstech &
2 2 2 - - - - 100%
Humana)
Work Flow Testing of CT’s -- (Humana,
12 12 12 - - - - 100%
Masstech, Sysco & Dell)
ES Records Deletion 50 - - - - - - -
UPGRADES-FUNCTIONAL Analyzed Customer reported Bugs -- 2
5 5 5 - - - - 100%
(Masstech)
Bugs Reported -- (Humana,
11 - - - - - - -
Masstech& MBUSA)
Bugs Retesting -- (Sysco, Humana,
3 3 3 - - - - 100%
Masstech & MBUSA)
GRAND TOTAL 7 127 60 60 - - - - -

© Confidential. All Rights Reserved. 2023

 Initiatives & Improvements

1. To do a refresher & gain Product Knowledge on Icertis Applications. From Qaptiol QA we took Initiative of completing the attached “3” assessment by all QA Team
members based on their Bandwidth.

Attached is the KT plan and assessments

attached for reference

2. From Platform team we have Identified below some areas we have dependency on Icertis FE’s . Hence, to reduce the dependency of Icertis FE’s we took initiative to
take KT of those and will be owing those going forward.

Dependency on Icerits FE's Benefits Comments Action Items for Qapitol Team Status

Config Key Update Effort saving of FE's 8 Hrs. per Release Stick with given env (opqa6,opqa2) Will work with FE's to take the KT Completed
(Total 8 days during Regression runs on Config Key updates
and 1 Hrs. consumed per day to
update config changes (8*1=8 Hrs per
Release).

KT on how to setup Env Will remove the team from blockers Need to connect with dev ops/Prachi Qapitol QA team connected In Progress
with Prachi and she gave
Demo on Docusign and KT is
pending for Adobe.

Hangfire, Trigger task Always done by dev ops - deployment NA NA

Env stability for Qapitol Work will be more efficient. opqa6, opqa2 - Creating env is costlier. NA NA

3. Conducting Cross Functional Trainings across teams

© Confidential. All Rights Reserved. 2023