Test Design
Specifications
Automated Teller Machine System
(ATMS)
Independent Verification and Validation
Version : 1.0.0
Date : 20/04/2013
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
Document Control
Document Name ATMS Test Design Specification (Iteration 1)
Reference Number ATMS_TDS_1
Version 1.0.0
Project Code XYZ_ATMS
Status In-use
Date Released 20th of April, 2013
Name Position Signature
Prepared By: Test Analyst
Tester 3 ABC Test-Co
Reviewed By: Test Lead
Tester 2 ABC Test-Co
Verified By: Test Manager
Tester 1 ABC Test-Co
TEST DESIGN SPECIFICATION i
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
Version History
Version Release Date Section Amendments
1.0.0 20/04/2013 All Original document
Distribution List
Release Controlled Recipient
Version Department Issue Date Return Date
Date Copy No Name
ABC Test-Co
1.0.0 20/04/2013 01 20/04/2013
QA Dept.
ABC Test-Co
1.0.0 20/04/2013 02 20/04/2013
Test Team
1.0.0 20/04/2013 03 XYZ Bank 20/04/2013
TEST DESIGN SPECIFICATION ii
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
Table of Contents
Document Control ........................................................................................................................ i
Version History............................................................................................................................ ii
Distribution List ........................................................................................................................... ii
Table of Contents....................................................................................................................... iii
1.0 Introduction .......................................................................................................................... 1
1.1 Purpose ............................................................................................................................ 1
1.2 Scope ............................................................................................................................... 1
1.3 References ....................................................................................................................... 1
2.0 Test Design .......................................................................................................................... 3
2.1 Features to Be Tested ...................................................................................................... 3
2.2 Approach Refinements ..................................................................................................... 3
2.2.3 F003 Session Verification........................................................................................... 4
2.3 Test Identification ............................................................................................................11
2.3.3 Session Verification ...................................................................................................11
2.4 Feature Pass/Fail Criteria ................................................................................................13
2.5 Test Deliverables .............................................................................................................13
TEST DESIGN SPECIFICATION iii
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
1.0 Introduction
1.1 Purpose
This test design specification support the following objectives:
i. To identify the test items covered
ii. To further refine the test approach from Test Plan
iii. To define the sources of the information used to prepare the plan
iv. To identify the general cases of test to be executed
1.2 Scope
This test design specification covers Session Verification features developed in ATMS.
1.3 References
The following IEEE standards have been referenced in preparation of this document:
i. IEEE 829-2008 Standard for Software and System Test Documentation
The following documents provide the test basis for this test design:
i. ATMS Software Requirement Specifications (ATMS_SRS_1.0)
ii. ATMS System Design Specifications (ATMS_SDS_1.0)
TEST DESIGN SPECIFICATION 1
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
This page is intentionally left blank
TEST DESIGN SPECIFICATION 2
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
2.0 Test Design
2.1 Features to Be Tested
The following table contains the features to be tested based on ATMS Software Requirement
Specifications (SRS) for this iteration. Listed together are the function ID and its corresponding
functions and estimated risk level.
Function ID Functions Risk Level
F003 Session Verification High
NOTE: All other functions will be tested in iteration 2.
Table 2.1 Features To Be Tested
2.2 Approach Refinements
As discussed in Test Plan (ATMS_TP_1.0.0), test cases for ATMS will be designed using five
techniques which are covered in this section. Techniques are applied based on suitability of
techniques according to nature of features.
The techniques that will be applied are as follows:
i. Equivalence Partitioning
ii. Boundary Value Analysis
iii. Decision Table Testing
iv. State Transition Testing (0-switch: Only valid transitions are tested.)
v. Use Case Testing
Nature of feature as below:
• F003 Session Verification – Transaction Menu is shown after PIN verification.
TEST DESIGN SPECIFICATION 3
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
2.2.3 F003 Session Verification
Five techniques are identified for designing test for this feature, including:
i. Equivalence Partitioning
ii. Boundary Value Analysis
iii. Decision Table Testing
iv. State Transition Testing
v. Use Case Testing
Equivalence partitioning is used to split PIN verification into possible partitions for test.
Boundary value analysis will test the boundary values of the PIN input. Decision table is used to
cover major branches of decision. State transition testing will test for major states of ATMS.
2.2.3.1 Equivalence Partitioning
Equivalence Partitioning Boundary Value Analysis
INPUT
Valid
Valid
PIN 6 = digits
Input Invalid
PIN < 6 digits
Invalid
Invalid
PIN > 6 digits
OUTPUT
0 5
Valid
Valid
PIN = 6 digits
6 6
Output Invalid
PIN < 6 digits
Invalid
(2147483647)
6 10
Invalid
PIN > 6 digits
Figure 2.2.3.1a PIN Equivalence Partition & Boundary Value Analysis
TEST DESIGN SPECIFICATION 4
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
0 Invalid
6 Valid
6 Invalid
10
PIN < 6 digits PIN 6 = digits PIN > 6 digits
Figure 2.2.3.1b PIN Equivalence Partitions
Example
Test Condition Test Coverage
Test Condition Test Coverage of Test
ID ID
Data
0 <= PIN < 6 digits
TCON-03-001 0 <= PIN < 6 digits TCOV-03-001 0 digit
(Invalid)
PIN = 6 digits
TCON-03-002 PIN = 6 digits TCOV-03-002 123456
(Valid)
6 < PIN >= 10 digits
TCON-03-003 6 < PIN <= 10 digits TCOV-03-003 7654321
(Invalid)
Valid pin (valid
TCON-03-004 Valid pin TCOV-03-004 123456
output)
Invalid pin (Invalid
TCON-03-005 Invalid pin TCOV-03-005 654321
output)
Table 2.2.3.1 PIN Equivalence Partitioning Test Conditions & Coverage
2.2.3.2 Boundary Value Analysis
(2147483647)
0 5 6 6 7 10
Invalid Valid Invalid
PIN < 6 digits PIN = 6 digits PIN > 6 digits
2.2.3.2 PIN Boundary Value Analysis
EP1: PIN = 6 digits
EP2: 0 <= PIN <= 5 digits
EP3: 7 <= PIN <= 10 digits
TEST DESIGN SPECIFICATION 5
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
Test Test Coverage Example of
Test Condition Test Coverage
Condition ID ID Test Data
TCON-03-006 PIN = 0 digits TCOV-03-006 PIN = 0 digits (Invalid) No input
TCON-03-007 PIN = 5 digits TCOV-03-007 PIN = 5 digits (Invalid) 12345
TCON-03-002 PIN = 6 digits TCOV-03-002 PIN = 6 digits (Valid) 123456
TCON-03-008 PIN = 7 digits TCOV-03-008 PIN = 7 digits (Invalid) 7654321
TCON-03-009 PIN = 10 digits TCOV-03-009 PIN = 10 digits (Invalid) 9876543210
TCON-03-004 Valid pin TCOV-03-004 Valid pin (valid output) 123456
TCON-03-005 Invalid pin TCOV-03-005 Invalid pin (Invalid output) 654321
Table 2.2.3.2 PIN Boundary Value Analysis Test Conditions & Coverage
2.2.3.3 Decision Table Testing
Test Condition ID Test Condition
TCON-03-010 Valid Card
TCON-03-011 First PIN Valid
TCON-03-012 3 Invalid PIN
TCON-03-013 1-2 Invalid PIN
TCON-03-014 Reject Card
TCON-03-015 Try Again
TCON-03-016 Retain Card
Table 2.2.3.3a Session Verification Decision Table Test Conditions
Condition TCOV-03-010 TCOV-03-011 TCOV-03-012 TCOV-03-013
Valid Card N Y Y Y
First PIN Valid - N Y N
3 Invalid PIN - N N Y
1-2 Invalid PIN - Y N Y
Output
Reject Card Y N N N
Try Again N Y N Y
Retain Card N N N Y
Display
N Y Y N
Transaction
Table 2.2.3.3b Session Verification Decision Table
TEST DESIGN SPECIFICATION 6
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
2.2.3.4 State Transition Testing
__Invalid Card (IC)___
Reading Card (S1) Display Message (DM)
_3 Invalid PIN (3IP)
Retain Card (RC)
_Valid Card (VC)
_Invalid PIN (IP)_
Read Pin (RP)
Display Message (DM)
__Cancel (C)__
Eject Card (EC)
Reading Pin (S2)
___Valid PIN (VP)___
Display Transaction (DT)
Choose Transaction (CT)
__Cancel (C)__
______Yes (Y)_____
Choosing Transaction (S3) Eject Card (EC)
_Transaction Type (TT)_
Perform Transaction (PT)
Performing Transaction (S4)
____No (N)___
Eject Card (EC)
Ejecting Card (S5)
Figure 2.2.3.4 Session Verification State Transition Diagram
TEST DESIGN SPECIFICATION 7
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
The test condition for state transition testing is as follows:
i. TCON-03-017 Session Verification State Transition
3 Invalid PIN
Invalid Card
Transaction
Invalid PIN
Valid Card
Cancel (C)
Type (TT)
Valid PIN
Input
Yes (Y)
No (N)
(3IP)
(VC)
(VP)
(IC)
(IP)
State
S2/RP S5/DM
Reading
TCOV- TCOV- S1/- S1/- S1/- S1/- S1/- S1/- S1/-
Card (S1) 03-014 03-015
S3/DT S2/DM S1/RC S5/EC
Reading
S2/- S2/- TCOV- TCOV- TCOV- TCOV- S2/- S2/- S2/-
PIN (S2) 03-016 03-017 03-018 03-019
Choosing S5/EC S4/PT
Transaction S3/- S3/- S3/- S3/- S3/- TCOV- TCOV- S3/- S3/-
(S3) 03-020 03-021
Performing S3/CT S5/EC
Transaction S4/- S4/- S4/- S4/- S4/- S4/- S4/- TCOV- TCOV-
(S4) 03-022 03-023
Table 2.2.3.4a Session Verification State Table
Test Coverage ID Test Coverage
TCOV-03-014 S1 to S2 with input VC
TCOV-03-015 S1 to S5 with input IC
TCOV-03-016 S2 to S3 with input VP
TCOV-03-017 S2 to S2 with input IP
TCOV-03-018 S2 to S1 with input 3IP
TCOV-03-019 S2 to S5 with input C
TCOV-03-020 S3 to S5 with input C
TCOV-03-021 S3 to S4 with input TT
TCOV-03-022 S4 to S3 with input Y
TCOV-03-023 S4 to S5 with input N
Table 2.2.3.4b Session Verification State Coverage
TEST DESIGN SPECIFICATION 8
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
2.2.3.5 Use Case Testing
Use Case ID UC003
Use Case F003 Session Verification
Purpose To allow users to start a session and use the ATM services.
Actor User
Trigger User inserts an ATM card.
Precondition ATMS is in “On” and “Idle” state.
Scenario Name Step Action
Main Flow 1 User inserts a valid ATM card into the ATM.
2 System starts a session and verifies the ATM card.
3 System requests for input of PIN.
4 User inputs the correct PIN.
5 System verifies the PIN
System displays the transaction menu and waits for user’s
6
transaction request.
7 User chooses a transaction.
8 System performs transaction.
9 User ends session.
10 System terminates session and ejects card.
System enters “Idle” state and displays message “Please insert
11
your card”.
Alternate Flow – 1.1 User inserts an invalid ATM card into the ATM.
Invalid ATM Card
1.2 System displays error message “Invalid card”.
1.3 Back to Main Flow Step 11.
Alternate Flow – 4.1.1 User inputs an incorrect PIN.
Invalid PIN (1 or 2
times) 4.1.2 System verifies that this is not the third time invalid PIN is entered.
System displays error message “Invalid PIN” and request for user
4.1.3
to re-enter password.
Alternate Flow – 4.2.1 User inputs an incorrect PIN.
Invalid PIN (3 times)
4.2.2 System verifies that this is the third time invalid PIN is entered.
4.2.3 System terminates session and retains ATM card.
System displays error message “Your card has been retained.
4.2.4
Please contact the bank.”
TEST DESIGN SPECIFICATION 9
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
4.2.5 Back to Main Flow Step 11.
Alternate Flow – 4.3.1 User presses “Cancel” button.
Cancel During PIN
Input 4.3.2 Back to Main Flow Step 10.
Alternate Flow – 7.1 User presses “Cancel” button.
Cancel During
Transaction Menu 7.2 Back to Main Flow Step 10.
Rules i. 3 times invalid PIN causes card retention.
Transaction is further split into Withdrawal, Deposit, Transfer and Inquiry will
Note be covered in other use case.
Table 2.2.3.5a Session Verification Use Case
Test Test
Condition Test Condition Coverage Test Coverage Test Data
ID ID
Valid card
PIN = 123456,
TCON-03- TCOV-03- Transaction Type = 4
Main flow Main flow
018 024 Account Type = 1,
Continue Transaction =
2.
TCON-03- Alternate Flow – TCOV-03- Alternate Flow –
Invalid card
019 Invalid ATM Card 025 Invalid ATM Card
Alternate Flow – Alternate Flow –
TCON-03- TCOV-03- Invalid PIN 1 = 12345
Invalid PIN (1 or 2 Invalid PIN (1 or 2
020 026 Invalid PIN 2 = 54321
times) times)
Invalid PIN 1 = 12345
TCON-03- Alternate Flow – TCOV-03- Alternate Flow –
Invalid PIN 2 = 54321
021 Invalid PIN (3 times) 027 Invalid PIN (3 times)
Invalid PIN 1 = 543211
Alternate Flow – Alternate Flow –
TCON-03- TCOV-03-
Cancel During PIN Cancel During PIN Press “Cancel”
022 028
Input Input
Alternate Flow – Alternate Flow –
TCON-03- TCOV-03-
Cancel During Cancel During Press “Cancel”
023 029
Transaction Menu Transaction Menu
Table 2.2.3.5b Session Verification Use Case Test Conditions & Coverage
TEST DESIGN SPECIFICATION 10
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
2.3 Test Identification
2.3.3 Session Verification
Test Case Test Condition
Description Test Coverage ID
ID ID
TCOV-03-001 TCON-03-001
TC-03-001 Verify PIN (0 digits) TCOV-03-005 TCON-03-005
TCOV-03-006 TCON-03-006
TCOV-03-001 TCON-03-001
TC-03-002 Verify PIN (5 digits) TCOV-03-005 TCON-03-005
TCOV-03-007 TCON-03-007
TCOV-03-002 TCON-03-002
TC-03-003 Verify PIN (6 digits)
TCOV-03-004 TCON-03-004
TCOV-03-003 TCON-03-003
TC-03-004 Verify PIN (7 digits) TCOV-03-005 TCON-03-005
TCOV-03-008 TCON-03-008
TCOV-03-003 TCON-03-003
TC-03-005 Verify PIN (10 digits) TCOV-03-005 TCON-03-005
TCOV-03-009 TCON-03-009
TCON-03-010
TCOV-03-012 TCON-03-011
TCON-03-024
TCOV-03-014
TC-03-006 Session Verification Main Flow
TCOV-03-016
TCON-03-017
TCOV-03-021
TCOV-03-023
TCOV-03-024 TCON-03-018
TCOV-03-010 TCON-03-014
Session Verification Alternate Flow –
TC-03-007 TCOV-03-015 TCON-03-017
Invalid ATM Card
TCOV-03-025 TCON-03-019
TEST DESIGN SPECIFICATION 11
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
TCON-03-010
TCON-03-013
TCOV-03-011
Session Verification Alternate Flow – TCON-03-015
TC-03-008
Invalid PIN (1 or 2 times) TCON-03-024
TCOV-03-017 TCON-03-017
TCOV-03-026 TCON-03-020
TCOV-03-010 TCON-03-014
TCON-03-010
TCON-03-012
Session Verification Alternate Flow – TCOV-03-013
TC-03-009 TCON-03-015
Invalid PIN (3 times)
TCON-03-016
TCOV-03-018 TCON-03-017
TCOV-03-027 TCON-03-021
Session Verification Alternate Flow – TCOV-03-019 TCON-03-017
TC-03-010
Cancel During PIN Input TCOV-03-028 TCON-03-022
Session Verification Alternate Flow – TCOV-03-020 TCON-03-017
TC-03-011
Cancel During Transaction Menu TCOV-03-029 TCON-03-023
Session Verification Perform Another
TC-03-012 TCOV-03-022 TCON-03-017
Transaction
Table 2.3.3 Session Verification Test Identification
TEST DESIGN SPECIFICATION 12
Project Title: ATMS Independent Verification and
Validation
ABC Test-Co
Test Design Specification ID:
Date: 20/04/2013
ATMS_TDS_1_1.0.0
2.4 Feature Pass/Fail Criteria
Each feature must satisfy the following criteria in order to pass:
i. Pass all its test cases
ii. 0% calculation error if the feature involves monetary transaction
iii. No deadlock
iv. Fulfil its requirement
2.5 Test Deliverables
The following documents will be generated by the system test group and will be delivered after
test completion.
Test documentation:
i. Test Plan
ii. Test Item Transmittal Report
iii. Test Design Specifications
iv. Test Case Specifications
v. Test Procedure Specifications
vi. Test Logs
vii. Test Incident Reports
viii. Test Summary Report
ix. Test Completion Report
TEST DESIGN SPECIFICATION 13