ST Unit - II
ST Unit - II
TESTING:
TRANSACTION FLOWS:
o INTRODUCTION:
A transaction is a unit of work seen from a system user's point of view.
A transaction consists of a sequence of operations, some of which are
performed by a system, persons or devices that are outside of the system.
Transaction begin with Birth-that is they are created as a result of some
external act.
At the conclusion of the transaction's processing, the transaction is no longer in
the system.
Example of a transaction: A transaction for an online
information retrieval system might consist of the following steps
or tasks:
Accept input (tentative birth)
Validate input (birth)
Transmit acknowledgement to requester
Do input processing
Search file
Request directions from user
Accept input
Validate input
Process request
Update file
Transmit output
Record transaction in log and clean up (death)
TRANSACTION FLOW GRAPHS:
Transaction flows are introduced as a representation of a system's processing.
The methods that were applied to control flow graphs are then used for
functional testing.
Transaction flows and transaction flow testing are to the independent system
tester what control flows are path testing are to the programmer.
The transaction flow graph is to create a behavioral model of the program that
leads to functional testing.
The transaction flowgraph is a model of the structure of the system's behavior
(functionality).
An example of a Transaction Flow is as follows:
USAGE:
o Transaction flows are indispensable for specifying requirements of complicated
systems, especially online systems.
o A big system such as an air traffic control or airline reservation system, has not
hundreds, but thousands of different transaction flows.
o The flows are represented by relatively simple flowgraphs, many of which have a
single straight-through path.
o Loops are infrequent compared to control flowgraphs.
o The most common loop is used to request a retry after user input errors. An ATM
system, for example, allows the user to try, say three times, and will take the card
away the fourth time.
1
COMPLICATIONS:
o In simple cases, the transactions have a unique identity from the time they're
created to the time they're completed.
o In many systems the transactions can give birth to others, and transactions can
also merge.
o Births:There are three different possible interpretations of the decision symbol, or
nodes with two or more out links. It can be a Decision, Biosis or a Mitosis.
1. Decision:Here the transaction will take one alternative or the other
alternative but not both. (See Figure 3.2 (a))
2. Biosis:Here the incoming transaction gives birth to a new transaction,
and both transaction continue on their separate paths, and the parent
retains it identity. (See Figure 3.2 (b))
3. Mitosis:Here the parent transaction is destroyed and two new
transactions are created.(See Figure 3.2 (c))
We have no problem with ordinary decisions and junctions. Births, absorptions, and
conjugations are as problematic for the software designer as they are for the software
modeler and the test designer; as a consequence, such points have more than their share of
bugs. The common problems are: lost daughters, wrongful deaths, and illegitimate births.
2
TRANSACTION FLOW TESTING TECHNIQUES:
3
BASICS OF DATA FLOW TESTING:
DATA FLOW TESTING:
o Data flow testing is the name given to a family of test strategies based on
selecting paths through the program's control flow in order to explore sequences
of events related to the status of data objects.
o For example, pick enough paths to assure that every data object has been
initialized prior to use or that all defined objects have been used for something.
o Motivation:
it is our belief that, just as one would not feel confident about a
program without executing every statement in it as part of some test,
one should not feel confident about a program without having seen
the effect of using the value produced by each and every
computation.
We will use an control graph to show what happens to data objects of interest at that moment.
Our objective is to expose deviations between the data flows we have and the data flows we
want.
4
Data Object State and Usage:
o Data Objects can be created, killed and used.
o They can be used in two distinct ways: (1) In a Calculation (2) As a part of
a Control Flow Predicate.
o The following symbols denote these possibilities:
1. Defined: d - defined, created, initialized etc
2. Killed or undefined: k - killed, undefined, released etc
3. Usage: u - used for something (c - used in Calculations, p -
used in a predicate)
o 1. Defined (d):
5
ku :- a bug. the object doesnot exist.
ud :- usually not a bug because the language permits
reassignment at almost any time.
uk :- normal situation.
uu :- normal situation.
In addition to the two letter situations, there are six single letter situations.
We will use a leading dash to mean that nothing of interest (d,k,u) occurs
prior to the action noted along the entry-exit path of interest.
A trailing dash to mean that nothing happens after the point of interest to
the exit.
They possible anomalies are:
-k :- possibly anomalous because from the entrance to this point
on the path, the variable had not been defined. We are killing a
variable that does not exist.
-d :- okay. This is just the first definition along this path.
-u :- possibly anomalous. Not anomalous if the variable is global
and has been previously defined.
k- :- not anomalous. The last thing done on this path was to kill
the variable.
d- :- possibly anomalous. The variable was defined and not
used on this path. But this could be a global definition.
u- :- not anomalous. The variable was used but not killed on this
path. Although this sequence is not anomalous, it signals a
frequent kind of bug. If d and k mean dynamic storage allocation
and return respectively, this could be an instance in which a
dynamically allocated object was not returned to the pool after
use.
DATA FLOW ANOMALY STATE GRAPH:
Data flow anomaly model prescribes that an object can be in one of four
distinct states:
K :- undefined, previously killed, doesnot exist
D :- defined but not yet used for anything
U :- has been used for computation or in predicate
A :- anomalous
These capital letters (K,D,U,A) denote the state of the variable and should
not be confused with the program action, denoted by lower case letters.
Unforgiving Data - Flow Anomaly Flow Graph:Unforgiving model, in
which once a variable becomes anomalous it can never return to a state of
grace.
Assume that the variable starts in the K state - that is, it has not been defined or does
not exist. If an attempt is made to use it or to kill it (e.g., say that we're talking about
opening, closing, and using files and that 'killing' means closing), the object's state
6
becomes anomalous (state A) and, once it is anomalous, no action can return the
variable to a working state. If it is defined (d), it goes into the D, or defined but not yet
used, state. If it has been defined (D) and redefined (d) or killed without use (k), it
becomes anomalous, while usage (u) brings it to the U state. If in U, redefinition (d)
brings it to D, u keeps it in U, and k kills it.
Forgiving Data - Flow Anomaly Flow Graph:Forgiving model is an alternate model where redemption
(recover) from the anomalous state is possible.
This graph has three normal and three anomalous states and he considers the kk sequence not
to be anomalous. The difference between this state graph and Figure 3.5 is that redemption is
possible. A proper action from any of the three anomalous states returns the variable to a useful
workingstate.
The point of showing you this alternative anomaly state graph is to demonstrate that the
specifics of an anomaly depends on such things as language, application, context, or even your
frame of mind. In principle, you must create a new definition of data flow anomaly (e.g., a new
state graph) in each situation. You must at least verify that the anomaly definition behind the
theory or imbedded in a data flow anomaly test tool is appropriate to your situation.
7
Dead Variables:Although it is often possible to prove that a
variable is dead or alive at a given point in the program, the
general problem is unsolvable.
Arrays:Arrays are problematic in that the array is defined or
killed as a single object, but reference is to specific locations
within the array. Array pointers are usually dynamically
calculated, so there's no way to do a static analysis to validate
the pointer value. In many languages, dynamically allocated
arrays contain garbage unless explicitly initialized and therefore,
-u anomalies are possible.
Records and Pointers:The array problem and the difficulty with
pointers is a special case of multipart data structures. We have
the same problem with records and the pointers to them. Also,
in many applications we create files and their names
dynamically and there's no way to determine, without execution,
whether such objects are in the proper state on a given path or,
for that matter, whether they exist at all.
Dynamic Subroutine and Function Names in a
Call:subroutine or function name is a dynamic variable in a call.
What is passed, or a combination of subroutine names and data
objects, is constructed on a specific path. There's no way,
without executing the path, to determine whether the call is
correct or not.
False Anomalies:Anomalies are specific to paths. Even a "clear
bug" such as ku may not be a bug if the path along which the
anomaly exist is unachievable. Such "anomalies" are false
anomalies. Unfortunately, the problem of determining whether a
path is or is not achievable is unsolvable.
Recoverable Anomalies and Alternate State Graphs:What
constitutes an anomaly depends on context, application, and
semantics. How does the compiler know which model I have in
mind? It can't because the definition of "anomaly" is not
fundamental. The language processor must have a built-in
anomaly definition with which you may or may not (with good
reason) agree.
Concurrency, Interrupts, System Issues:As soon as we get
away from the simple single-task uniprocessor environment and
start thinking in terms of systems, most anomaly issues become
vastly more complicated. How often do we define or create data
objects at an interrupt level so that they can be processed by a
lower-priority routine? Interrupts can make the "correct"
anomalous and the "anomalous" correct. True concurrency (as
in an MIMD machine) and pseudoconcurrency (as in
multiprocessing) systems can do the same to us. Much of
integration and system testing is aimed at detecting data-flow
anomalies that cannot be detected in the context of a single
routine.
o Although static analysis methods have limits, they are worth using and a
continuing trend in language processor design has been better static
analysis methods, especially for data flow anomaly detection. That's good
because it means there's less for us to do as testers and we have far too
much to do as it is.
8
o The data flow model is based on the program's control flow graph - Don't
confuse that with the program's data flowgraph..
o Here we annotate each link with symbols (for example, d, k, u, c, p) or
sequences of symbols (for example, dd, du, ddd) that denote the sequence
of data operations on that link with respect to the variable of interest. Such
annotations are called link weights.
o The control flow graph structure is same for every variable: it is the weights
that change.
o Components of the model:
9
Figure 3.8: Unannotated flowgraph for example program in Figure 3.7
10
Figure 3.10: Control flowgraph annotated for Z data flow.
11
(1,3) and again on (4,5). For practice, try finding all the definition-clear
subpaths for this routine (i.e., for all variables).
2. Loop-Free Path Segment is a path segment for which every node in it is
visited atmost once. For Example, path (4,5,6,7,8,10) in Figure 3.10 is loop
free, but path (10,11,4,5,6,7,8,10,11,12) is not because nodes 10 and 11
are each visited twice.
3. Simple path segment is a path segment in which at most one node is
visited twice. For example, in Figure 3.10, (7,4,5,6,7) is a simple path
segment. A simple path segment is either loop-free or if there is a loop,
only one node is involved.
4. A du path from node i to k is a path segment such that if the last link has a
computational use of X, then the path is simple and definition-clear; if the
penultimate (last but one) node is j - that is, the path is (i,p,q,...,r,s,t,j,k) and
link (j,k) has a predicate use - then the path from i to j is both loop-free and
definition-clear.
STRATEGIES: The structural test strategies discussed below are based on the
program's control flowgraph. They differ in the extent to which predicate uses and/or
computational uses of variables are included in the test set. Various types of data
flow testing strategies in decreasing order of their effectiveness are:
For variable X and Y:In Figure 3.9, because variables X and Y are used
only on link (1,3), any test that starts at the entry satisfies this criterion (for
variables X and Y, but not for all variables as required by the strategy).
For variable V: Variable V (Figure 3.11) is defined only once on link (1,3).
Because V has a predicate use at node 12 and the subsequent path to the
end must be forced for both directions at node 12, the all-du-paths strategy
for this variable requires that we exercise all loop-free entry/exit paths and
at least one path that includes the loop caused by (11,4). Note that we
must test paths that include both subpaths (3,4,5) and (3,5) even though
neither of these has V definitions. They must be included because they
provide alternate du paths to the V use on link (5,6). Although (7,4) is not
used in the test set for variable V, it will be included in the test set that
covers the predicate uses of array variable V() and U.
The all-du-paths strategy is a strong criterion, but it does not take as many
tests as it might seem at first because any one test simultaneously
satisfies the criterion for several definitions and uses of several different
variables.
2. All Uses Startegy (AU):The all uses strategy is that at least one definition
clear path from every definition of every variable to every use of that
12
definition be exercised under some test. Just as we reduced our ambitions
by stepping down from all paths (P) to branch coverage (C2), say, we can
reduce the number of test cases by asking that the test set should include
at least one path segment from every definition to every use that can be
reached by that definition.
3. All p-uses/some c-uses strategy (APU+C) : For every variable and every
definition of that variable, include at least one definition free path from the
definition to every predicate use; if there are definitions of the variables
that are not covered by the above prescription, then add computational use
test cases as required to cover every definition.
For variable Z:In Figure 3.10, for APU+C we can select paths that all take
the upper link (12,13) and therefore we do not cover the c-use of Z: but
that's okay according to the strategy's definition because every definition is
covered. Links (1,3), (4,5), (5,6), and (7,8) must be included because they
contain definitions for variable Z. Links (3,4), (3,5), (8,9), (8,10), (9,6), and
(9,10) must be included because they contain predicate uses of Z. Find a
covering set of test cases under APU+C for all variables in this example - it
only takes two tests.
5. All Definitions Strategy (AD) : The all definitions strategy asks only every
definition of every variable be covered by atleast one use of that variable,
be that use a computational use or a predicate use.
13
For variable Z: Path (1,3,4,5,6,7,8, . . .) satisfies this criterion for variable
Z, whereas any entry/exit path satisfies it for variable V.
Figure 3.12 compares path-flow and data-flow testing strategies. The arrows denote
that the strategy at the arrow's tail is stronger than the strategy at the arrow's head.
o The right-hand side of this graph, along the path from "all paths" to "all
statements" is the more interesting hierarchy for practical applications.
o Note that although ACU+P is stronger than ACU, both are incomparable to
the predicate-biased strategies. Note also that "all definitions" is not
comparable to ACU or APU.
SLICING AND DICING:
o A (static) program slice is a part of a program (e.g., a selected set of
statements) defined with respect to a given variable X (where X is a simple
variable or a data vector) and a statement i: it is the set of all statements
14
that could (potentially, under static analysis) affect the value of X at
statement i - where the influence of a faulty statement could result from an
improper computational use or predicate use of some other variables at
prior statements.
o If X is incorrect at statement i, it follows that the bug must be in the
program slice for X with respect to i
o A program dice is a part of a slice in which all statements which are known
to be correct have been removed.
o In other words, a dice is obtained from a slice by incorporating information
obtained through testing or experiment (e.g., debugging).
o The debugger first limits her scope to those prior statements that could
have caused the faulty value at statement i (the slice) and then eliminates
from further consideration those statements that testing has shown to be
correct.
o Debugging can be modeled as an iterative procedure in which slices are
further refined by dicing, where the dicing information is obtained from ad
hoc tests aimed primarily at eliminating possibilities. Debugging ends when
the dice has been reduced to the one faulty statement.
o Dynamic slicing is a refinement of static slicing in which only statements
on achievable paths to the statement in question are included.
15