Scribd
Upload
118 views

Exploratory Testing Using Heuristics

This document introduces exploratory testing and provides heuristics to guide exploratory testing. Exploratory testing involves simultaneous test design, execution, and learning. It is more flexible than scripted testing and allows testers to focus on important areas. Some advantages are less preparation time and a focus on actual testing. Disadvantages include requiring testing expertise and difficulty reproducing steps. Heuristics help guide exploratory testing and include techniques for testing domains, users, functions, flows, risks, and more. Various mnemonics are provided to help remember different heuristics for test design, elements to test, quality criteria, environments, oracles, and more.

Uploaded by

Michelle Chua Lagare
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
118 views

Exploratory Testing Using Heuristics

This document introduces exploratory testing and provides heuristics to guide exploratory testing. Exploratory testing involves simultaneous test design, execution, and learning. It is more flexible than scripted testing and allows testers to focus on important areas. Some advantages are less preparation time and a focus on actual testing. Disadvantages include requiring testing expertise and difficulty reproducing steps. Heuristics help guide exploratory testing and include techniques for testing domains, users, functions, flows, risks, and more. Various mnemonics are provided to help remember different heuristics for test design, elements to test, quality criteria, environments, oracles, and more.

Uploaded by

Michelle Chua Lagare
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 40

Intro To

Exploratory Testing
Exploratory Testing
Using Heuristics
Michelle Lagare

QE-360 FOUNDER
QE Transition Coach / QE Is the New QA
CSM
Agile Evangelist
Exploratory
testing, anyone?
Simultaneous learning,
test design and test
execution
- James Bach
Why Exploratory Testing?

✓ Keep up with dev’t. pace


✓ Tester is an integral part of test process
✓ Core of Agile Testing
Advantages

✓ Less time on prep, more time on actual testing


✓ Flexible - high level / low level details of tests
✓ Focus of the testing is within the context of what is
needed
✓ Increase chances of finding new errors
✓ Tests are less prone to being immune to tired, old
test cases
Disadvantages

– Demands testing expertise


– Tester should have system’s domain knowledge
– Difficult to reproduce steps
– Harder to spot conflicting requirements
“
HEURISTIC is a fallible
method of solving a
problem or making a
decision
- James Bach & Cem Kaner
Test Design Thru
HEURISTICS
“
There are different heuristics and
we can come up with our own
heuristic sets to make it more
suitable to the project we’re
testing
Test Heuristics in
Mnemonics
General Test
Techniques Heuristics -
DUFFSSCRA
Domain
Divide and conquer data
Inputs and Outputs
- Boundary values
- Typical values
- Convenient values
- Invalid values
- Best representatives
User
Involve the users
- Categories and roles of users
- What do each user do?
- Real user data or real user to test
- Simulate a real user
Function
What can it do?
What isn’t supposed to do?
Flow
Do one thing after another
- End-to-end
- Don’t reset the system between actions
- Vary timing and sequencing
- Parallel threads
Stress
Overwhelm the product
- Sub-systems to be overloaded or “broken”
- Challenging data
- Large or complex data structures
- High loads
- Long test runs
- Low memory conditions
‘ ‘‘ ‘ ‘ ‘
‘ ‘ ‘
Scenario
Compelling story
- Meaningful and complex interactions
- Someone who matters might do something that matters with
the product
Claims
Challenge every claim
- SLA
- EULA
- Ads
- Specs
- Manuals
\
Risk
Imagine a problem
- Problems the products could have
- Which ones matters most?
- How do you detect them?
- List of problems and how to reveal them
- Consult experts, docs and past bugs
Automatic Checking
Check a million different facts
- Look/develop tools that can perform lots of actions and
check lots of things
- Partially automate test coverage
- Partially automate oracles
- Change detector
- Test data generator
- What can make human testing more powerful
Product Element
Heuristics - SFDIPOT
Structure
Everything that comprises the physical product

Code Non-executable files

Hardware Collateral
Function
Everything that the product does

Application Transformation Error-handling

Calculation Startup / Shutdown Interactions

Time-related Multimedia Testability


Data
Everything that the product processes

Input Persistent Big / Little

Sequences /
Output Noise
Combinations

Preset Cardinality Lifecycle


Interfaces
Every conduit by which the product is accessed or expressed

User Interfaces API / SDK

System Interfaces Import / Export


Platform
Everything on which the product depends (and is outside
your project)

External External Internal


Hardware Software Components
Operations
How will the product be used

Users Common Use

Environment Disfavored Use

Extreme Use
Time
Any relationship between product and time

Input / Output Changing Rates

Fast / Slow Concurrency


Quality Criteria Heuristics -
CRUSSPICSTMPL
● Capability ● Installability
● Reliability ● Compatibility
● Usability ● Supportability
● Security ● Testability
● Scalability ● Maintainability
● Performance ● Portability
● Localizability
Project Environment - CIDTEST
● Customer
● Information
● Developer Relations
● Test Team
● Equipment & Tools
● Schedule
● Test Items
● Deliverables
Test Oracles - MB & JB
FEW HICCUPPS
● Familiarity ● History
● Explainability ● Image
● World ● Comparable Products
● Claims
● User’s expectations
● Product
● Purpose
● Statutes &
Standards
Regression Testing - Karen Johnson
RCRCRC
● Recent
● Core
● Risk
● Configuration
● Repaired
● Chronic
Data Type Attacks -
Elisabeth Hendrickson
● Paths / Files
● Time and Date
● Numbers
● Strings
● General
Web Test -
Elisabeth Hendrickson
● Navigation
● Input
● Syntax
● Preferences
SMS Test - Karen Johnson
RSTLLL
● Reply
● Sender
● Timestamp
● List
● Links
● Language
● Length
Mobile App Testing - Jonathan Kohl
I SLICED UP FUN
● Inputs
● Data
● Store
● Usability
● Location
● Platform
● Interactions/Interruptions
● Function
● Communications
● User Scenarios
● Ergonomics
● Network
Create your own Test
Heuristics Mnemonics!
Q&A
Michelle Chua - Lagare
[email protected]
@qeisthenewqa
@prew18

You might also like