Unit 1: Fundamentals of Software Testing
Unit 1: Fundamentals of Software Testing
UNIT 1
Testing
Testing involves operation of a system or application under controlled conditions & evaluating the results. The controlled conditions should include both normal & abnormal conditions. Testing should intentionally attempt to make things go wrong to determine if things happen when they shouldnt or things dont happen when they should.
Testing Terminology
Errors Faults/Defects Failures Test Cases Test Test oracle Test Bed Software Quality
What is a Bug ?
A flaw in a system or system component that causes the system or component to fail to perform its required function. Most are simple, subtle failures, with many being so small that its not always clear which ones are true failures, and which ones arent.
Tend to imply a condition thats really severe, may be even dangerous. It doesnt sound right to call an incorrectly colored icon a fault. These words also tend to imply blame: its his fault that the s/w failed.
Dont sound quite so negative and infer more unintended operation than an all-out failure.
Miscommunication or no communication (requirements) Software complexity Programming errors Changing requirements Time pressures Poorly documented code Software development tools Egos
Fig: Bugs are caused for numerous reasons, but the main cause can be traced to the specification.
Others Code
Specifica tion
Design
What is Verification ?
Verification ensures the product is designed to deliver all functionality to the customer. Typically involves reviews and meetings to evaluate documents, plans, code, requirements, and specifications.
Verification
This can be done with checklists, issues lists, walkthroughs, and inspection meetings. Verification takes place before validation.
What is Validation ?
Validation typically involves actual testing and evaluates the product itself. The process of executing something to see how it behaves. The output of validation is a nearly perfect, actual product.
Black Box Testing White Box Testing Unit Testing Incremental Integration Testing Integration Testing Functional Testing System Testing End-to-End Testing
Sanity or Smoke Testing Regression Testing Acceptance Testing Load Testing Stress Testing Performance Testing Usability Testing Install / Uninstall Testing
Contd.
Recovery Testing Failure Testing Security Testing Compatibility Testing Exploratory Testing Ad-hoc Testing User Acceptance Testing Comparison Testing
Unit Testing
Process of testing the individual component of a program. Discover discrepancies between the modules interface specification & its actual behavior. Verify the control flow and data flow. Requires the knowledge of the code hence done by the developers.
Integration Testing
Testing of combined parts of an application to determine if they function together correctly. To discover errors in the interface between the components, verify communication between units. Done by developers / QA teams.
Functional Testing
Black box type testing. Detect discrepancies between a programs functional specification and actual behavior. Verifies that the software provides expected services. Done by testers.
System Testing
Black box type testing. Attempting to demonstrate that a program Or system does not meet its original requirements & objectives, as stated in the requirements specification. Done by testing group before the product is made available to customer.
Usability Testing Performance Testing Load Testing Stress Testing Volume Testing Security Testing Configuration Testing
Install ability Testing Recovery Testing Service ability Testing Reliability / Availability Testing
Usability Testing
Performance Testing
Evaluate the compliance of a system or components with specified performance requirements. Often used interchangeably with stress and load testing. Ideally performance testing is defined in requirements documentation.
Load Testing
Testing an application under heavy loads, such as testing of a website under a range of loads to determine at what point the systems response time degrades or fails.
Stress Testing
Used interchangeably with load & performance testing. Testing conducted to evaluate a system or component at or beyond the limits of its specified requirements. System functional testing while under unusually heavy loads, heavy repetition of certain actions or inputs, etc..
Configuration Testing
To determine whether the program operates properly when the software or hardware is configured in a required manner
Compatibility Testing
To determine whether the compatibility objectives of the program have been met. Testing how well application performs in a particular hardware / software / operating system / network etc environment.
Installability Testing
Testing of full, partial, or upgrade install / uninstall processes. To identify the ways in which the installation procedures lead to incorrect results installation option
Recovery Testing
Testing how well a system recovers from crashes, hardware failures, or other catastrophic problems.
Typically used interchangeably with fail-over testing.
Regression Testing
Re-testing after fixes or modifications of the software or its environment. Verify that changes fixes have not introduced new problems. It can be difficult to determine how much re-testing is needed, especially near the end of development cycle.
Acceptance Testing
Final testing based on specifications of the end-user or customer, or based on use by end-user / customer over some limited period of time. Determine whether the software is ready for final deployment. Done after the testing group has satisfactorily completed usability, function, & testing.
Contd