Scribd
Upload
515 views

Software Testing Metrics Formulas

The document defines 17 metrics for measuring quality in software testing. The metrics include: Requirement Stability Index, Test Design Coverage, Test Execution Coverage, Test Effectiveness, Defect Re-open Rate, Defect Discovery Rate, Defect Aging by Priority, Test Design Productivity, Test Execution Productivity, Production Defect Leakage, Test Plan Coverage on Functionality, Test Case defect density, Defect Slippage Ratio, Requirement Volatility, Review Efficiency, Defect Removal Effectiveness, and ROI. Formulas for calculating each metric are provided along with examples for some metrics.

Uploaded by

saim_123
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
515 views

Software Testing Metrics Formulas

The document defines 17 metrics for measuring quality in software testing. The metrics include: Requirement Stability Index, Test Design Coverage, Test Execution Coverage, Test Effectiveness, Defect Re-open Rate, Defect Discovery Rate, Defect Aging by Priority, Test Design Productivity, Test Execution Productivity, Production Defect Leakage, Test Plan Coverage on Functionality, Test Case defect density, Defect Slippage Ratio, Requirement Volatility, Review Efficiency, Defect Removal Effectiveness, and ROI. Formulas for calculating each metric are provided along with examples for some metrics.

Uploaded by

saim_123
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 4

Sl No Metric Formula

1 Requirement Stability Index (Number of Original Baseline Requirements + Number of Baseline Requirements
changed + Number of New Requirements added to Baseline Requirements +
number of baseline requirements deleted) / (Number of Original Baseline
Requirements)
2 Test Design Coverage ((# of requirements covered in test design by QA/Scope of the Requirements to
be covered as mentioned in Test plan (after finalizing any Risk Based approach))
* 100)
3 Test Execution Coverage ((Total Number of test cases or scenarios executed (Pass + Fail)/ Total Number
of test cases or scenarios planned to execute)*100)
4 Test Effectiveness ((Number of defects identified during QA testing phase - Number of invalid
defects) / (Number of defects identified during testing phase + Number of
Critical and High Severity defects found in Production))*100
5 Defect Re-open Rate ((Number of Defects Reopened after fix / Total Number of Defects Fixed ) *
100)
6 Defect Discovery Rate ((Total number of defects found / Number of Test Cases executed) * 100)
7 Defect Aging by Priority ((Detected on Date- Closing date of Defects with status as Closed, Rejected,
Duplicate & Deferred) or (Detected On Date- Current date for any other status))
8 Test Design Productivity (Number of Test Cases prepared) / (Effort spent for Test Case Preparation)
9 Test Execution Productivity (No of Test Cases executed) / (Effort spent for Test Case Execution)

10 Production Defect Leakage Critical Severity Production Defect Leakage: ((number of Critical Severity
defects unidentified during testing phase but found in production/ (number of
defects unidentified during testing phase but found in production + total number
of valid defects identified during testing phase))*100
11 Test Plan Coverage on
Functionality
(No of requirements covered / total number of requirements) * 100
Example: Total number of requirements estimated are 46, total number of
requirements tested 39, and uncovered 7
12 Test Case defect density

(Defective Test Scripts/Total Test Scripts) * 100
Example: Total test script developed 1360, total test script executed 1280, total
test script passed 1065, and total test script failed 215.

So, test case defect density is
215 X 100
---------------------------- = 16.8%
1280
13 Defect Slippage Ratio

Number of Defects Slipped (i.e. reported from production) / (Number of
Defects Raised - Number of Defects Withdrawn) * 100
Example: Customer filed defects are 21, total defect found while testing are
267, total number of invalid defects are 17.
So, Slippage Ratio is [21/ (267-17)] X 100 = 8.4%

14 Requirement Volatility

(Number of Requirements Added + Deleted + Modified) *100 / Number of
Original Requirements.

Ensure that the requirements are normalized or defined properly while estimating
Example: AO Auto claims v1.3 release had total 67 requirements initially, later
they added another 7 new requirements and removed 3 from initial requirements
and modified 11 requirements.

So, requirement Volatility is (7 + 3 + 11) * 100/67 = 31.34%
Means almost 1/3 of the requirement changed after initial identification.
15 Review Efficiency The Review Efficiency is a metric that offers insight on the review quality and
testing.
Some organization also use this term as Static Testing efficiency and they
are aiming to get min of 30% defects in static testing.
Review efficiency=(Total number of defects found by reviews/Total number
of project defects) * 100
Example: A project found total 269 defects in different reviews, which were
fixed and test team got 476 defects which were reported and valid.
So, Review efficiency is [269/(269+476)] * 100 = 36.1%
16 Defect Removal Effectiveness DRE= (Defects removed during development phase/ Defects latent in the
product) * 100


Where defects latent in the product = Defects removed during development
Phase+ defects found later by user


17 ROI
(Consider acquisition costs,
hardware costs, labour costs,
training costs)
(Gains Investment costs)/ Investment costs

You might also like