What is Design of Experiment?

Why study Design of Experiment?

The Basic Principles of Experimental Design
Guidelines for Designing Experiments

Design and Analysis of Experiments

Strategy and Principles of Experimental Design
and Analysis

Department of Mechanical and Industrial Engineering

Texas A&M University-Kingsville

Design and Analysis of Experiments 1 of 21

 What is Design of Experiment?
Why study Design of Experiment?
The Basic Principles of Experimental Design
Guidelines for Designing Experiments

Outline

1 What is Design of Experiment?

2 Why study Design of Experiment?

3 The Basic Principles of Experimental Design

General model of a process or system
The Basic Principles
Factorial Designs

4 Guidelines for Designing Experiments

Guidelines
An example
Cause-and-effect diagram
Planning, Conducting & Analyzing an Experiment

Design and Analysis of Experiments 2 of 21

 What is Design of Experiment?
Why study Design of Experiment?
The Basic Principles of Experimental Design
Guidelines for Designing Experiments

What is Design of Experiment?

An experiment is a test or a series of tests

Experiments are used widely in the engineering world
All experiments are designed experiments, some are poorly
designed, some are well-designed

Design and Analysis of Experiments 3 of 21

 What is Design of Experiment?
Why study Design of Experiment?
The Basic Principles of Experimental Design
Guidelines for Designing Experiments

Generation of new knowledge

Data (facts, phenomena)

… Deduction Induction Deduction Induction

…

Idea (model, hypothesis, theory, conjecture)

Iterative learning process

Design and Analysis of Experiments 4 of 21

 What is Design of Experiment?
Why study Design of Experiment?
The Basic Principles of Experimental Design
Guidelines for Designing Experiments

An integral part of learning how systems and processes work

Reduce time to design/develop new products & processes
Improve performance of existing processes
Improve reliability and performance of products
Achieve product & process robustness
Evaluation of materials, design alternatives, setting component
& system tolerances, etc.

Design and Analysis of Experiments 5 of 21

 What is Design of Experiment?
General model of a process or system
Why study Design of Experiment?
The Basic Principles
The Basic Principles of Experimental Design
Factorial Designs
Guidelines for Designing Experiments

General model of a process or system

Design and Analysis of Experiments 6 of 21

 What is Design of Experiment?
General model of a process or system
Why study Design of Experiment?
The Basic Principles
The Basic Principles of Experimental Design
Factorial Designs
Guidelines for Designing Experiments

General model of a process or system

Which variables are most influential on the response variables?

Where to set the influential x’s, so that y is almost always the
desired nominal value? variability in y is minimal? the effects
of uncontrollable variables are minimized?
Design and Analysis of Experiments 7 of 21
 What is Design of Experiment?
General model of a process or system
Why study Design of Experiment?
The Basic Principles
The Basic Principles of Experimental Design
Factorial Designs
Guidelines for Designing Experiments

The Basic Principles of Experimental Design

Randomization
Running the trials in an experiment in random order
Notion of balancing out effects of “lurking” variables
Replication
An independent repeat run of each factor combination
Sample size (improving precision of effect estimation,
estimation of error or background noise)
Replication versus repeat measurements?
Blocking
A design technique used to improve the precision with which
comparisons among the factors of interest are made
Dealing with nuisance factors

Design and Analysis of Experiments 8 of 21

 What is Design of Experiment?
General model of a process or system
Why study Design of Experiment?
The Basic Principles
The Basic Principles of Experimental Design
Factorial Designs
Guidelines for Designing Experiments

Strategy of Experimental Design

“Best-guess” experiments
One-factor-at-a-time (OFAT) experiments
Statistically designed experiments
Factorial experimental design: 2k factorial design

Design and Analysis of Experiments 9 of 21

 What is Design of Experiment?
General model of a process or system
Why study Design of Experiment?
The Basic Principles
The Basic Principles of Experimental Design
Factorial Designs
Guidelines for Designing Experiments

Factorial Designs

In a factorial experiment, all possible combinations of factor

levels are tested
A golf experiment
Type of driver (Oversized or regular sized)
Type of ball (balata or three piece)
Walking vs. riding
Type of beverage
Time of round
Weather
Type of golf spike

Design and Analysis of Experiments 10 of 21

 What is Design of Experiment?
General model of a process or system
Why study Design of Experiment?
The Basic Principles
The Basic Principles of Experimental Design
Factorial Designs
Guidelines for Designing Experiments

A golf experiment

A two-factor factorial experiment involving type of driver and type of ball

Design and Analysis of Experiments 11 of 21

 What is Design of Experiment?
General model of a process or system
Why study Design of Experiment?
The Basic Principles
The Basic Principles of Experimental Design
Factorial Designs
Guidelines for Designing Experiments

A golf experiment

Design and Analysis of Experiments 12 of 21

 What is Design of Experiment?
General model of a process or system
Why study Design of Experiment?
The Basic Principles
The Basic Principles of Experimental Design
Factorial Designs
Guidelines for Designing Experiments

A golf experiment

Driver effect:
92+94+93+91 88+91+88+90
4 − 4 = 3.25
Ball effect:
88+91+92+94
4 − 88+90+93+91
4 = 0.75
Ball-driver interaction effect:
92+94+88+90
4 − 88+91+93+91
4 = 0.25

Design and Analysis of Experiments 13 of 21

 What is Design of Experiment?
General model of a process or system
Why study Design of Experiment?
The Basic Principles
The Basic Principles of Experimental Design
Factorial Designs
Guidelines for Designing Experiments

Factorial design with several factors

A three-factor factorial experiment

Design and Analysis of Experiments 14 of 21

 What is Design of Experiment?
General model of a process or system
Why study Design of Experiment?
The Basic Principles
The Basic Principles of Experimental Design
Factorial Designs
Guidelines for Designing Experiments

Factorial design with several factors

A four-factor factorial experiment

Design and Analysis of Experiments 15 of 21

 What is Design of Experiment?
General model of a process or system
Why study Design of Experiment?
The Basic Principles
The Basic Principles of Experimental Design
Factorial Designs
Guidelines for Designing Experiments

A four-factor fractional factorial experiment

A four-factor factorial experiment

Design and Analysis of Experiments 16 of 21

 What is Design of Experiment? Guidelines
Why study Design of Experiment? An example
The Basic Principles of Experimental Design Cause-and-effect diagram
Guidelines for Designing Experiments Planning, Conducting & Analyzing an Experiment

Guidelines for Designing Experiments

Recognition of and statement of the problem
– Factor screening, optimization, confirmation, discovery,
robustness Pre-experimental
planning
Selection of the response variable
Choice of factors, levels, and range
– design factors, held-constant factor, allowed-to-vary factors
Choice of experimental design
– Empirical model: a quantitative equation between the
response and the important design factors

y = β0 + β1 x1 + β2 x2 + 
y = β0 + β1 x1 + β2 x2 + β12 x1 x2 + 
2 2
y = β0 + β1 x1 + β2 x2 + β12 x1 x2 + β11 x11 + β22 x22 +

Design and Analysis of Experiments 17 of 21

 What is Design of Experiment? Guidelines
Why study Design of Experiment? An example
The Basic Principles of Experimental Design Cause-and-effect diagram
Guidelines for Designing Experiments Planning, Conducting & Analyzing an Experiment

Guidelines for Designing Experiments

...
...
...
...

Performing the experiment

Statistical analysis of the data
Conclusions and recommendations

Design and Analysis of Experiments 18 of 21

 What is Design of Experiment? Guidelines
Why study Design of Experiment? An example
The Basic Principles of Experimental Design Cause-and-effect diagram
Guidelines for Designing Experiments Planning, Conducting & Analyzing an Experiment

An example of manufacturing impellers on a CNC-machine

Response variables
Control variables
“Held constant” factors
Nuisance factors
Interactions

Design and Analysis of Experiments 19 of 21

 What is Design of Experiment? Guidelines
Why study Design of Experiment? An example
The Basic Principles of Experimental Design Cause-and-effect diagram
Guidelines for Designing Experiments Planning, Conducting & Analyzing an Experiment

Cause-and-effect diagram

A Cause-and-Effect Diagram for an Experiment in a Videodisk Manufac-

turing Process
Design and Analysis of Experiments 20 of 21
 What is Design of Experiment? Guidelines
Why study Design of Experiment? An example
The Basic Principles of Experimental Design Cause-and-effect diagram
Guidelines for Designing Experiments Planning, Conducting & Analyzing an Experiment

Planning, Conducting & Analyzing an Experiment

Get statistical thinking involved early

Your non-statistical knowledge is crucial to success
Pre-experimental planning (steps 1-3) vital
Think and experiment sequentially (use the KISS principle)

Design and Analysis of Experiments 21 of 21