ST Unit Ii
ST Unit Ii
Path Testing is a process which involves all the available paths in a program from an entry to an exit in such a way
that the entire path is thoroughly tested. Path testing implementation and applications can be categorized as follows.
The technique of path testing is mainly employed in unit testing. Classical unit testing mainly involves the use of
stubs for replacement of all called and corequisite components there by testing the new component individually.
Path testing process which is carried out at the phase is to control flow errors rather than focusing on bugs is called
and corequisite components.
Concentrating on interfaces, we collaborate the new component with stubs as a result, we will be able to discover
all interface related issues. After collaborating we then retest the conjoined component with called and corequisite,
replacing the stubs, this conjoined component can now be integrated again with some other component this process
is known as bottom up integration.
Coverage issue arises since, subroutines and corequisite components are considered to be part of the component and
hence, increasing the complexity as large code need to be processed which makes path sensitization much difficult.
The main intention behind path testing is that testing each level at any time increases the effectiveness of the test but
the drawback associated with this approach is that it results in predicate coverage and blindness i.e., outcome of one
level may not be compatible with the outcome of other consecutive levels.
New Code:
The new code has to be given higher priority for testing then the old trusted components.
Paths within the low level components are also tested so that there should not be any unachievable path at higher
level.
We must consider the following aspects for selecting a path at any higher level
1. Select the small path available.
2. give the last priority for loop selection.
3. They to get rid of lower level complexity.
Unit testing must be automated in such a way that it must perform the testing at each level of integration.
Maintenance:
Path testing will be carried out on the integration of modified components but called and corequisite components
will be kept changed.
Automated unit testing will retest the integration of modified components with corequisite and called components
mean while stores their adaptation.
As the maintenance methods are studied further a new methodology will be discovered which will help us to
achieve the desired coverage.
Rehosting:
Rehosting is a process of transforming the old software environment into a new more friendly environment in which
rehosted software can run cost effectively. Path testing along with the structural test generators will produce a
powerful, efficient and an effective rehosting process. You cannot rehost the software while performing changes in
its environment i.e., the two things cant be done simultaneously. Rehosting can be done in following ways.
Step 1: creation and testing of interpreter between new and old environment is the first step. If there are any bugs,
rehosting process will capture them.
Step 2: complete path testing is done for old software in old environment mean while outcomes of everything
integration are recorded.
These outcomes series as a guideline for rehosted software. The outcomes and testcase are adapted by the new
environment with the help of another interpreter. These adapted environment and software are integrated and
retested.
This approach might be even more costlier than building the new software, but it provides us with an environment
which suites the requirement of a software thereby providing stable and reliable software base with out bothering
about the issues pertaining to software security.
UNIT II
TRANSACTION FLOW TESTING AND DATA FLOW TESTING
INTRODUCTION:
USAGE:
O Transaction flows are indispensable for specifying requirements of complicated
systems, especially online systems.
O A big system such as an air traffic control or airline reservation system, has not
hundreds, but thousands of different transaction flows.
O The flows are represented by relatively simple flowgraphs, many of which have a
single straight-through path.
O Loops are infrequent compared to control flowgraphs.
O The most common loop is used to request a retry after user input errors. An ATM
system, for example, allows the user to try, say three times, and will take the card
away the fourth time.
IMPLEMENTATIONS OF TRANSACTION FLOWS :
Transaction flow has an implicit representation of system control structure. That is there is no direct relation
between the process and decisions. A transaction flow is represented by a path where each transaction is passed
from routine to routine. These transactions present in that block are processed account to their flows.
Each transaction is represented by a token and the transaction flow graph shows a pictorial representation of these
tokens. The transaction flowgraph is not the control structure of the program.
It explained as follows
1. the transaction goes through input processing and then passes through passes A.
2. the result of A passes through B followed by process B.
3. the transaction then passes through either D or E for output process.
The above diagram represents a system control structure. This system control structure is controlled either by an
executive or scheduler or dispatcher operating system. The links in the structure either presents process queues or a
dispatcher queue. The transaction is created by placing a token on an input queue. The scheduler operating system
examines the transaction and places it on the process queue. Process 2 will not be activated immediately for a new
transaction until an existing transaction present in process is complexity executed.
After the completion of that transaction, the transaction control block is done based on the information stored. The
transaction control block is examined and the scheduler route it to the next process. The information in the block is
stored in tables rather than explicit code. Alternatively, the dispatcher operating system does not contain data
related to transaction control. Therefore the information can be implemented as a code in each of the processing
modules.
The above figure shows a simplified representation of transaction flow. The processing order of transaction flow is
A,B,C,D,E, processes are invoked regardless of their order.
But in case of fixed processing order, different transactions are processed according to their priorities.
In multiprocessing systems, there is no direct correspondence between the process and transactions flows. A
transaction will however receive attention from the processing modules in the static order. But there could be many
other things going on between the instances of these transactions.
The above figure scheduler invokes module A, which cleans up all of its task. The disk reads are performed and
the scheduler again invokes module A for processing any additional work that has been assigned to it. After the
disk writes are performed, module C is invoked to clean up all the tasks of transactions waiting for
Module C. this process continues further and the whole loop starts again.
The processing modules of this structure should not be invoked in fixed order. Therefore the length of the queues
for those modules can be determined by
1. priority of tasks
2. priority of active modules and
3. state of system with respect to input and output operations.
COMPLICATIONS:
O In simple cases, the transactions have a unique identity from the time they're
created to the time they're completed.
O In many systems the transactions can give birth to others, and transactions can
also merge.
O Births: There are three different possible interpretations of the decision symbol,
or nodes with two or more out links. It can be a Decision, Biosis or a Mitosis.
1. Decision: Here the transaction will take one alternative or the other
alternative but not both. (See Figure 3.2 (a))
2. Biosis: Here the incoming transaction gives birth to a new transaction, and
both transaction continue on their separate paths, and the parent retains it
identity. (See Figure 3.2 (b))
3. Mitosis: Here the parent transaction is destroyed and two new transactions
are created.(See Figure 3.2 (c))
Biosis: the parent flow is followed from beginning of a transaction flow to the end of a
transaction flow. A new birth is treated as a new flow either to end or to absorb that birth.
Mitosis: It begins from the parent is flow to the Mitosis point. From Mitosis point, an additional
flow starts and get destroyed at their respective ends.
Absorption: In this situation, the parents flow is treated as the primary flow. The primary flow is
modelled from its absorption point to the point at which it gets destroyed.
Conjugation: This situation is the opposite of mitosis situation. Each parent flow is modelled
from its birth to the conjugation point and from the conjugation point, the result child starts and
gets destroyed.
Biosis, Mitosis, absorption and conjugation are problematic for software designers. Illegal births,
wrongful deaths and lost children are some of the common problems. Although the transaction
flow is modelled by simple flowgraphs they recognize bugs where transactions are created,
absorbed and conjugated.
1. It is not just code, it’s a model of a process. Sometimes programmers may be involved in loops, decisions and so
on. We can’t bind users behaviour to software structure rules no matter how frequently we might wish it.
2. parts of the flows may incorporate the behaviour of other systems over which we have no control.
3. No small part of the totality of transaction flows exists to model error conditions, failures, malfunctions and
subsequent recovery actions.
4. The complexity of individual transactions and the number of transactions may grows over time as features are
added and enhanced.
5. Some times systems are built out of modular and the transaction flows results from the interaction of those
modules. The designers of good system suggests that change or modifying the modules.
6. in some cases the results of attempting to structure, the transaction flows could be inefficient processing, poor
response times, lost transactions integrity and so on.
TRANSACTION FLOW TESTING TECHNIQUES:
INSPECTIONS :
Inspections are the most cost effective quality process that holds for testing. The
process include different phases such as “ design phase, coding, testing, disk
checking and debugging”.
An inspection is a technique to detect errors by reading by group of code. This is
often done by the developers or the programmers. A check list has been compared
with the code to check errors. The duties of the programmer include
1. Distributing the requirements, scheduling and inspecting the modules.
2. loading the session or module.
3. Detecting the errors.
4. Confirming that errors are corrected.
Inspection is a methodology that humans can do and the computers can’t. some of
the examples are:
CHECKING THE SYNTAX ERRORS: These would n’t be any syntax errors
after inspections if humans do syntax checking.
6. REVIEW SCHEDULING: if the results of the first review was not acceptable,
then another review has been assigned by the review manager to correct the
defects.
Depending on the review object, reviews can be classified as follows.
7. FEASIBILITY REVIEW: This review depends upon the logical flow of the
document. Here every unit in the document is feasible to test.
In the review meeting, scenarios are walked through i.e., the reviewers try to
reveal defects and problems by asking questions. Walk through is a technique or a
set of procedures to detect errors by reading a group of code. It is often used as a
part of testing cycle. Walkthroughs has a team similar to that of a reviewer team
and consists of there people.
During the meeting the tester comes with a set of inputs to walked through the
logic flow of the program. Each test case is individually executed and must be
simple because the errors found in the process of questioning the programmer are
more than the errors found by the test cases.
• PATH SELECTION:
O Select a set of covering paths (c1+c2) using the analogous criteria you used for
structural path testing.
O Select a covering set of paths based on functionally sensible transactions as you
would for control flow graphs.
O Try to find the most tortuous, longest, strangest path from the entry to the exit of
the transaction flow.
• PATH SENSITIZATION:
O Most of the normal paths are very easy to sensitize-80% - 95% transaction flow
coverage (c1+c2) is usually easy to achieve.
O The remaining small percentage is often very difficult.
O Sensitization is the act of defining the transaction. If there are sensitization
problems on the easy paths, then bet on either a bug in transaction flows or a
design bug.
• PATH INSTRUMENTATION:
O Instrumentation plays a bigger role in transaction flow testing than in unit path
testing.
O The information of the path taken for a given transaction must be kept with that
transaction and can be recorded by a central transaction dispatcher or by the
individual processing modules.
O In some systems, such traces are provided by the operating systems or a running
log.
PATH SELECTION AND ITS ADVANTEGES AND DISADVANTES IN TRANSACTION FLOW
The path selection the system testing is a based on transaction flows from the other unit, tests that are
based on transaction flows from the other unit, tests that are based on control flowgraphs. A longest path
is taken to find the bugs in the module. The path is reviewed and the bugs are removed from all the
interfaces of the module after reviewing process is completed.
1. the transaction flow uses structural path testing for selecting a path.
2. the covering set of paths in transaction flows belong to the features of system test.
3. many bugs don’t occur in this path selection.
4. the weird paths in transaction flow solve many problems like missing interlocks, duplicated interlocks,
interface problems, duplicated processing and programs working at cross purposes.
5. the cost is paid only on some well known transactions.
6. the path selection is effective.
1. ACT OF SENSITIZATION : The simplest paths are easy to sensitize in transaction flows. It is the act
of defining transaction. Some paths are difficult to sensitize and therefore these paths results in bug
transaction flows.
2. MEASUREMENT: during processing of modules, the information of the path taken for a transaction
must be kept. Since it plays an important role in the transaction flow testing.
3. TRANSACTION FLOW DATABASES: Every tester or programmer design his own unique
databases. The test databases in transaction flows are configuration sensitive.
4. EXECUTION : From starting, the transaction flows testing is committed to test the execution part
automatically.
TRANSACTION CONTROL BLOCK: There’s an explicit transaction control block associated with
every live transaction. The block contains, among other things, the transaction type, identity and
processing state.
CENTRALIZED, COMMON PROCESSING QUEUES: Transactions are not passed directly from one
process to another but are transferred from process to process by means of centralized explicit processing
queues.
SELF TEST SUPPORT: The transaction control tables have privileged modes that can be used for test
and diagnostic purposes. There are special transaction types and states for normal transactions whose sole
purposes is to facilitate testing.
BUG ASSUMPTION:
The bug assumption for data-flow testing strategies is that control flow is generally
correct and that something has gone wrong with the software so that data objects are not
available when they should be, or silly things are being done to data objects.
O Also, if there is a control-flow problem, we expect it to have symptoms that
can be detected by data-flow analysis.
O Although we'll be doing data-flow testing, we won't be using data flow graphs as
such. Rather, we'll use an ordinary control flow graph annotated to show what
happens to the data objects of interest at the moment.
DATA FLOW GRAPHS:
O The data flow graph is a graph consisting of nodes and directed links.
O We will use a control graph to show what happens to data objects of interest
at that moment.
O Our objective is to expose deviations between the data flows we have and the
data flows we want.
1 dd :- probably harmless but suspicious. Why define the object twice without an
intervening usage?
2 dk :- probably a bug. Why define the object without using it?
3 du :- the normal case. The object is defined and then used.
4 kd :- normal situation. An object is killed and then redefined.
5 kk :- harmless but probably buggy. Did you want to be sure it was really killed?
6 ku :- a bug. the object doesnot exist.
7 ud :- usually not a bug because the language permits reassignment at almost any time.
8 uk :- normal situation.
9 uu :- normal situation.
In addition to the two letter situations, there are six single letter situations.We will use a leading
dash to mean that nothing of interest (d,k,u) occurs prior to the action noted along the entry-exit
path of interest.
A trailing dash to mean that nothing happens after the point of interest to the exit.
They possible anomalies are:
1 -k :- possibly anomalous because from the entrance to this point on the path, the
variable had not been defined. We are killing a variable that does not exist.
2 -d :- okay. This is just the first definition along this path.
3 -u :- possibly anomalous. Not anomalous if the variable is global and has
been previously defined.
4 k- :- not anomalous. The last thing done on this path was to kill the variable.
5 d- :- possibly anomalous. The variable was defined and not used on this path. But
this could be a global definition.
6 u- :- not anomalous. The variable was used but not killed on this path. Although this
sequence is not anomalous, it signals a frequent kind of bug. If d and k mean
dynamic storage allocation and return respectively, this could be an instance in
which a dynamically allocated object was not returned to the pool after use.
1. UR ANOMALY: During data flow analysis if the undefined value of a variable (u) is read (r) then it is known as
a UR-anomaly.
2. DU ANOMALY: A defined (d) variable becomes invalid or undefined (u) variable, when a variable is not used
with in a particular time.
3. DD ANOMALY: This anomaly occurs when the variable accepts a value at the second assignment and the first
assignment value had not been used (d). this situation occurs in dd anomaly.
UR anomaly : In above example, the variable get is used on the right side of an assignment. The variable
get has an undefined value because it is not initialized where it is declared. This undefined variable is
being read or referred to and hence it results in UR Anomaly.
DD anomaly : The variable B is used twice on the left side of an assignment. The first assignment value
becomes invalid or unused and the second assignment value is taken or used.
DU anomaly : The variable get has a defined value in the last assignment. The defined variables cannot be
used any where in the function because only those variables are valid which are inside the function.
Therefore, the unused variable results in DU anomaly.
In the above example, anomalies occur due to some particular statements. These anomalies can be
avoided by adding an arbitrary number of other statements in the function. Anomalies would not occur. If
a manual check such as “Review” is done. Review is a tool for detecting errors in the flow of data
analysis.
Not every anomaly leads to inconsistency and cannot directly effect the flow of data. As we see in DU
anomaly, a defined variable is not used in the program. But still the program seen properly with out
affecting the flow of data.
Data flow anomaly model prescribes that an object can be in one of four distinct states:
1. K :- undefined, previously killed, doesnot exist
2. D :- defined but not yet used for anything
3. U :- has been used for computation or in predicate
4. A :- anomalous
These capital letters (K, D, U, A) denote the state of the variable and should not be confused
with the program action, denoted by lower case letters.
Unforgiving Data - Flow Anomaly Flow Graph: Unforgiving model, in which once a variable
becomes anomalous it can never return to a state of grace.
Assume that the variable starts in the K state - that is, it has not been defined or does not exist. If
an attempt is made to use it or to kill it (e.g., say that we're talking about opening, closing, and
using files and that 'killing' means closing), the object's state becomes anomalous (state A) and,
once it is anomalous, no action can return the variable to a working state.
If it is defined (d), it goes into the D, or defined but not yet used, state. If it has been defined (D)
and redefined (d) or killed without use (k), it becomes anomalous, while usage (u) brings it to the
U state. If in U, redefinition (d) brings it to D, u keeps it in U, and k kills it.
Forgiving Data - Flow Anomaly Flow Graph: Forgiving model is an alternate model where
redemption (recover) from the anomalous state is possible
The point of showing you this alternative anomaly state graph is to demonstrate that the specifics
of an anomaly depends on such things as language, application, context, or even your frame of
mind. In principle, you must create a new definition of data flow anomaly (e.g., a new state
graph) in each situation. You must at least verify that the anomaly definition behind the theory or
imbedded in a data flow anomaly test tool is appropriate to your situation.
Static analysis is analysis done on source code without actually executing it. For example: source
code syntax error detection is the static analysis result.
Dynamic analysis is done on the fly as the program is being executed and is based on
intermediate values that result from the program's execution. For example: a division by zero
warning is the dynamic result.
If a problem, such as a data flow anomaly, can be detected by static analysis methods, then it
doesn’t belongs in testing - it belongs in the language processor.
There is actually a lot more static analysis for data flow analysis for data flow anomalies
going on in current language processors.
For example, language processors which force variable declarations can detect (-u) and (ku)
anomalies.But still there are many things for which current notions of static analysis are
INADEQUATE.
Why Static Analysis isn't enough? There are many things for which current notions of
static analysis are inadequate. They are:
Dead Variables: Although it is often possible to prove that a variable is dead or alive at a
given point in the program, the general problem is unsolvable.
Arrays: Arrays are problematic in that the array is defined or killed as a single object, but
reference is to specific locations within the array. Array pointers are usually dynamically
calculated, so there's no way to do a static analysis to validate the pointer value. In many
languages, dynamically allocated arrays contain garbage unless explicitly initialized and
therefore, -u anomalies are possible.
Records and Pointers: The array problem and the difficulty with pointers is a special case
of multipart data structures. We have the same problem with records and the pointers to
them. Also, in many applications we create files and their names dynamically and there's no
way to determine, without execution, whether such objects are in the proper state on a given
path or, for that matter, whether they exist at all.
False Anomalies: Anomalies are specific to paths. Even a "clear bug" such as ku may not be
a bug if the path along which the anomaly exist is unachievable. Such "anomalies" are false
anomalies. Unfortunately, the problem of determining whether a path is or is not achievable
is unsolvable.
Concurrency, Interrupts, System Issues: As soon as we get away from the simple single-
task uniprocessor environment and start thinking in terms of systems, most anomaly issues
become vastly more complicated.
How often do we define or create data objects at an interrupt level so that they can be
processed by a lower-priority routine? Interrupts can make the "correct" anomalous and the
"anomalous" correct. True concurrency (as in an MIMD machine) and pseudo concurrency
(as in multiprocessing) systems can do the same to us. Much of integration and system
testing is aimed at detecting data-flow anomalies that cannot be detected in the context of a
single routine.
Although static analysis methods have limits, they are worth using and a continuing trend in
language processor design has been better static analysis methods, especially for data flow
anomaly detection. That's good because it means there's less for us to do as testers and we
have far too much to do as it is.
Differences between static and dynamic data flow anomalies:
The data flow model is based on the program's control flow graph - Don't confuse that with the
program's data flow graph.
Here we annotate each link with symbols (for example, d, k, u, c, and p) or sequences of symbols
(for example, dd, du, ddd) that denote the sequence of data operations on that link with respect to
the variable of interest. Such annotations are called link weights.
The control flow graph structure is same for every variable: it is the weights that change.
Figure 3.9: Control flow graph annotated for X and Y data flows.
• INTRODUCTION:
STRATEGIES: The structural test strategies discussed below are based on the program's
control flow graph. They differ in the extent to which predicate uses and/or computational uses
of variables are included in the test set. Various types of data flow testing strategies in decreasing
order of their effectiveness are:
All - du Paths (ADUP): The all-du-paths (ADUP) strategy is the strongest data-flow testing
strategy discussed here. It requires that every du path from every definition of every variable to
every some test.
FOR VARIABLE X AND Y:In Figure 3.9, because variables X and Y are used only on link (1,3), any
test that starts at the entry satisfies this criterion (for variables X and Y, but not for all variables
as required by the strategy).
For variable Z: The situation for variable Z (Figure 3.10) is more complicated because the
variable is redefined in many places. For the definition on link (1,3) we must exercise paths that
include subpaths (1,3,4) and (1,3,5). The definition on link (4,5) is covered by any path that
includes (5,6), such as subpath (1,3,4,5,6, ...). The (5,6) definition requires paths that include
subpaths (5,6,7,4) and (5,6,7,8).
For variable V: Variable V (Figure 3.11) is defined only once on link (1,3). Because V has a
predicate use at node 12 and the subsequent path to the end must be forced for both directions at
node 12, the all-du-paths strategy for this variable requires that we exercise all loop-free
entry/exit paths and at least one path that includes the loop caused by (11,4).
Note that we must test paths that include both subpaths (3,4,5) and (3,5) even though neither of
these has V definitions. They must be included because they provide alternate du paths to the V
use on link (5,6). Although (7,4) is not used in the test set for variable V, it will be included in
the test set that covers the predicate uses of array variable V() and U.
The all-du-paths strategy is a strong criterion, but it does not take as many tests as it might seem
at first because any one test simultaneously satisfies the criterion for several definitions and
uses of several different variables.
All Uses Startegy (AU):The all uses strategy is that at least one definition clear path from
every definition of every variable to every use of that definition be exercised under some test.
Just as we reduced our ambitions by stepping down from all paths (P) to branch coverage (C2),
say, we can reduce the number of test cases by asking that the test set should include at least
one path segment from every definition to every use that can be reached by that definition.
For variable V: In Figure 3.11, ADUP requires that we include subpaths (3,4,5) and (3,5) in
some test because subsequent uses of V, such as on link (5,6), can be reached by either
alternative. In AU either (3,4,5) or (3,5) can be used to start paths, but we don't have to use both.
Similarly, we can skip the (8,10) link if we've included the (8,9,10) subpath.
Note the hole. We must include (8,9,10) in some test cases because that's the only way to reach
the c use at link (9,10) - but suppose our bug for variable V is on link (8,10) after all? Find a
covering set of paths under AU for Figure 3.11.
All p-uses/some c-uses strategy (APU+C) : For every variable and every definition of that
variable, include at least one definition free path from the definition to every predicate use;
if there are definitions of the variables that are not covered by the above prescription, then
add computational use test cases as required to cover every definition.
For variable Z:In Figure 3.10, for APU+C we can select paths that all take the upper link
(12,13) and therefore we do not cover the c-use of Z: but that's okay according to the strategy's
definition because every definition is covered.
Links (1,3), (4,5), (5,6), and (7,8) must be included because they contain definitions for
variable Z. Links (3,4), (3,5), (8,9), (8,10), (9,6), and (9,10) must be included because they
contain predicate uses of Z. Find a covering set of test cases under APU+C for all variables in
this example - it only takes two tests.
All c-uses/some p-uses strategy (ACU+P) : The all c-uses/some p-uses strategy (ACU+P) is to
first ensure coverage by computational use cases and if any definition is not covered by the
previously selected paths, add such predicate use cases as are needed to assure that every
definition is included in some test.
The above examples imply that APU+C is stronger than branch coverage but ACU+P may
be weaker than, or incomparable to, branch coverage.
All Definitions Strategy (AD) : The all definitions strategy asks only every definition of every
variable be covered by atleast one use of that variable, be that use a computational use or a
predicate use.
FOR VARIABLE Z: Path (1,3,4,5,6,7,8, . . .) satisfies this criterion for variable Z, whereas any entry/exit
path satisfies it for variable V.
From the definition of this strategy we would expect it to be weaker than both ACU+P
and APU+C.
1. All Predicate Uses (APU), All Computational Uses (ACU) Strategies : The all predicate
uses strategy is derived from APU+C strategy by dropping the requirement that we include a c-
use for the variable if there are no p-uses for the variable. The all computational uses strategy is
derived from ACU+P strategy by dropping the requirement that we include a p-use for the
variable if there are no c-uses for the variable.
It is intuitively obvious that ACU should be weaker than ACU+P and that APU should
be weaker than APU+C.
ORDERING THE STRATEGIES:
Figure 3.12compares path-flow and data-flow testing strategies. The arrows denote that
the strategy at the arrow's tail is stronger than the strategy at the arrow's head
O The right-hand side of this graph, along the path from "all paths" to "all
statements" is the more interesting hierarchy for practical applications.
O Note that although ACU+P is stronger than ACU, both are incomparable to the
predicate-biased strategies. Note also that "all definitions" is not comparable to
ACU or APU.
1. It is used to detect the different abnormalities that may arise due to data flow anomalies.
2. It shows the relationship between data objects that represents data.
3. It helps in determining the usage of variables that are included in test set.
4. It is cost effective.