ACCURATE

Components of Variation
Y

Repeatability
 Components of Variation

Whenever you measure anything the variation you observe can be

segmented into the following components…

Observed Variation

Unit-to-unit (true) Variation Measurement System Error

Precision Accuracy

Repeatability Reproducibility Stability Bias Linearity

All measurement systems have error. If you do not know how much of the variation
you observe is contributed by measurement system error you cannot make confident
decisions.

If you were one speeding ticket away from losing your license how fast
would you be willing to drive on your local freeway?
13 © Open Source Six Sigma, LLC
 Precision

A precise metric is one that returns the same value of a given

attribute every time an estimate is made.

Precise data are independent of who measures them or when the

measurement is made.

Precision can be partitioned into two components:

– Repeatability
– Reproducibility

Repeatability and Reproducibility = Gage R+R

14 © Open Source Six Sigma, LLC
 Repeatability

Repeatability is the variation in measurements obtained with one

measurement instrument used several times by one appraiser while
measuring the identical characteristic on the same part.

Repeatability

For example:
– Manufacturing: One person measures the purity of multiple samples of
the same vial and gets different purity measures.
– Transactional: One person evaluates a contract multiple times (over a
period of time) and makes different determinations of errors.

15 © Open Source Six Sigma, LLC

 Reproducibility

Reproducibility is the variation in the average of the measurements made

by different appraisers using the same measuring instrument when
measuring the identical characteristic on the same part.

Reproducibility

Y Operator A
Operator B

For example:
– Manufacturing: Different people perform purity test on samples from the
same vial and get different results.
– Transactional: Different people evaluate the same contract and make
different determinations.

16 © Open Source Six Sigma, LLC

 Accuracy

An accurate measurement is the difference between the observed average of the

measurement and a reference value.
– When a metric or measurement system consistently over or under estimates the
value of an attribute it is said to be “inaccurate”
Accuracy can be assessed in several ways:
– Measurement of a known standard
– Comparison with another known measurement method
– Prediction of a theoretical value
What happens if we do not have standards, comparisons or theories?
True
Average

Accuracy
Warning, on a cross country trip do not
assume your gasoline gage is gospel.

Measurement

17 © Open Source Six Sigma, LLC

 Accuracy Against a Known Standard

In Transactional processes the measurement system can consist of a

database query.
– For example, you may be interested in measuring product returns
where you will want to analyze the details of the returns over
some time period.
– The query will provide you all the transaction details.

However, before you invest a lot of time analyzing the data you must
ensure the data has integrity.
– The analysis should include a comparison with known reference
points.
– For the example of product returns the transaction details should
add up to the same number that appears on financial reports,
such as the income statement.

18 © Open Source Six Sigma, LLC

 Accuracy vs. Precision

ACCURATE PRECISE BOTH

+ =

Accuracy relates to how close the

average of the shots are to the
Master or bull's-eye.

Precision relates to the spread of the

shots or Variance.
NEITHER

19 © Open Source Six Sigma, LLC

 Bias

Bias is defined as the deviation of the measured value from the actual value.

Calibration procedures can minimize and control bias within acceptable limits.
Ideally Bias can never be eliminated due to material wear and tear!

Bias Bias

20 © Open Source Six Sigma, LLC

 Stability

Stability of a gage is defined as error (measured in terms of Standard

Deviation) as a function of time. Environmental conditions such as cleanliness,
noise, vibration, lighting, chemical, wear and tear or other factors usually
influence gage instability. Ideally gages can be maintained to give a high
degree of Stability but the issue can never be eliminated… unlike
Reproducibility. Gage Stability studies should be the first exercise after
calibration procedures.
Control Charts are commonly used to track the Stability of a measurement
system over time.

Drift

Stability is Bias characterized as a

function of time!

21 © Open Source Six Sigma, LLC

 Linearity

Linearity is defined as the difference in Bias values throughout the measurement range
in which the gauge is intended to be used. This tells you how accurate your
measurements are through the expected range of the measurements. It answers the
question "Does my gage have the same accuracy for all sizes of objects being
measured?"

Linearity = |Slope| * Process Variation

Low Nominal High

+e
% Linearity = |Slope| * 100

B i a s (y)
0.00
*
-e
*
*
Reference Value (x)
y = a + b.x
y: Bias, x: Ref. Value
a: Slope, b: Intercept

22 © Open Source Six Sigma, LLC