1
Chapter 5
TESTING TOOLS AND MEASUREMENTS
12 Marks LESP, Kupwad
Syllabus
2
Unit 5
Testing Tools and Measurements
1 Manual Testing and Need for Automated Testing Tools
2 Advantages and Disadvantages of Using Tools
3 Selecting a Testing Tool
4 When to Use Automated Test Tools Testing Using Automated Tools.
5 Metrics and Measurement: Types of Metrics, Product Metrics and Process Metrics,
Object oriented metrics in testing
CO- Test software for performance measures using automated
testing tools. 3
What is Manual Testing ?
Manual testing is the type of software testing in which
test use every module of application from login
module
to logout module to check the application behaviour
according to the requirement.
In Manual Testing tester manually Run all the test
cases without help of any Automation Testing tool
For performing manual testing we do not need
knowledge of any testing tool.
Manual Testing 4
The main purpose of performing manual testing is to
give Assurance that our software product does not
contain any defect and it fulfil all the functional
requirements of end users.
It give Assurance that reported defects are fixed by the
developer and tester perform every test on it after
fixing the defect.
List of manual testing is
unit testing
integration testing
system testing
acceptance testing
Automation testing 5
Automation Testing refers to use of automation tool to
execute your test cases using the automation
software.
It is possible to enter test data into the system
compare the expected results and actual results and
create a test report in detail.
The main objective of automation is to decrease the
number of test cases to execute manually.
Automation testing 6
The following criteria are used to select the test cases to be
automated
1) The test cases that contain high risk
2) The test cases which need repetitive execution
3) test which are very complicated for manual testing
4) The test cases which take a lot of time for execution
The following criteria which is not suitable for automation testing
1) Newly designed test cases which have not been executed
manually
2) The test cases in which changes in a requirement
Advantages of using tool 7
1) Reliable:- test perform the same operations each time they
are run, thereby eliminating human errors.
2) Repeatable:- you can test how the software react under
repeated execution of same operation.
3) Reusable:- you can reuse test on the different versions of an
application.
4) Better quality software:- because you can run more test in
less time with your resources.
5) Fast automated tool run Test significantly faster than human
users.
6) Cost reduction:- as the number of resources for regression
test are reduces so cost will be reduced
Disadvantages of using tools 8
1) Well trained expert are needed to write the test script
2) The data files are difficult to maintain
3) The test automation will be more expensive rather
than manual testing due to higher licence fee for the
tool
9
Difference Between Manual & 10
Automation
Manual Testing Automation Testing
It is carried out manually where the It is carried out with the help of various
tester in self execute all the steps automation tools
Without carrying out manual testing we Automation Testing is continuous part of
cannot proceed towards automation the manual testing
testing
Time consumed is more Time consumed is less
Programming is not involved Programming is involved
Manual testing considered to be of low Automation Testing considered to be
quality higher quality
Manual testing is less reliable Automation testing is more reliable
Selecting a Testing Tool 11
Select automated testing tool is a important step in a testing
there
are several key issues which should be considered when
selecting an
application
Features for selecting a Test tool 12
1) Easy to use: while moving from Excel to standard test
through it has to be made that the tool is very easy to
use and it's training is very nice
2) The tool which cover all the requirements of project of
system
3) Identification of the areas within the organisation fair
tool support will help to improve the testing process
Factors considered for selecting 13
testing toola right tool following criteria need to be
while selecting
considered
1)Support different types of environment
2)Easy to use
3)Ability to test database
4)Ability to error recovery testing
6)Support for various testing framework
7)Support for multiple types of test
8)Simple to develop the automation tool
9)Less training cost
10)Ability to make tester report and result
Automation Testing Tools 14
1) Selenium
2) QTP
3) SILK TEST
When to use automated testing 15
tool
1) To optimise the speed and efficiency
2) To increase the quality and decrease the cost
3) When there is a reputation for any new to run the test cases
a number of time in a test cycle
4) When there are number of test cases under the one test
script
5) When there is a requirement of running the test cases in the
defined order
6) Increase the test coverage
7) When you need to run the same test case on different
machine at the same time
8) When we need to test a single function with multiple data set
Metrics and Measurement 16
Measure: A measure provide quantitative indication of
amount, dimension, capacity or size of some attributes of
product or the process
example:-A measure is a number of failure which has been
detected during testing process.
Measurement: it is a process by which numbers or symbols
are assigned to attribute. it is considered as a way of recording
the attribute
example:- we measure number of failure in one or in a single
system
Matrix: The continuous application of measurement based
technique to software development process and its product. it
is used to improve the process and its product.
example:-a software metrics may be average number of
Types of Metrics 17
Metrics are necessary to provide measurements of such
qualities. Metrics can also be used to gauge the size and
complexity of software and hence are employed in
project management and cost estimation.
Types of Metrics
1) Product Metrics
2) Process Metrics
3) Project Metrics
1.Product Metrics 18
describe the characteristics of the product
it include measurement of
Size
Complexity
design features
Performance
quality level
Reliability
Functionality
2.Process Metrics 19
Process metrics can be used to improve software
development
Process metrics are collected across all projects and over
long periods of time.
The Metrics are generally developed for the purpose of
monitoring the progress of the testing, status of test cases,
development of test case and execution of test cases.
They are used for making strategic decisions.
We use tools and technology for process improvement.
The intent is to provide a set of process indicators that lead
to long-term software process improvement.
3. Project Metrics 20
describe the project characteristics and execution
Examples include the
number of software developers
the staffing pattern over the life cycle of the software
Cost
Schedule
productivity.
Assignment 5 21
1) State various advantages and disadvantages
of using manual testing tools.
2) Explain criteria to select testing tool.
3) Explain the need of automated testing.
4) Difference between manual testing and
automated testing.
5) What are metrics ? Explain any one in detail.
