UNCERTAINTY OF MEASUREMENT

National Institute of Standards

Fire and Explosion Protection Lab

 KEY WORDS

 METROLOGY – Science of Measurement

 TRACEABILITY – Unbroken Chain of Comparisons
 CALIBRATION – Comparison
 UNCERTAINTITY – Error in Measurement
 Uncertainty calculations – Us- Uc- Ue
 WHAT IS METROLOGY

SCIENCE OF MEASUREMENTS

Experiment CAN BE SEEN

EVERYWHERE
or test
Everything has
to do with
measurement
Designing
Allowing people
Conducting to plan their lives
and make
Analyzing commercial
Results exchange with
confidence
within the Metrology realm
4
 Metrological Traceability

”property of a measurement result whereby the

result can be related to a reference through a
documented unbroken chain of calibrations, each
contributing to the measurement uncertainty”
or

“HOW TO ENSURE THAT TWO MEASUREMENTS OF THE

SAME QUANTITIES ARE COMPATIBLE”

6
 HIERACHY OF MEASUREMENT STANDARDS

HIERARCHY OF MEASUREMENTS

Primary Standards
Traceable to BIPM

Secondary
Standards

Working
Standards

Instruments
Used in Lab/
Industry
 SI base units

Base quantity Name Symbol

SI base unit SI base unit

length meter m

mass kilogram kg

time second s

electric current ampere A

thermodynamic temperature kelvin K

amount of substance mole mol

luminous intensity candela cd
 EXAMPLE
MASS COMPARATOR Traceable to

BIPM Prototype 1kg

USE

Transfer

Prototype 1kg

Traceable
Calibrate
to
SI Units

Analytical Balance Set of Classes E2, F1, F2, and M1

9
 Calibration
“Operation that, under specified conditions, in a first step, establishes a
relation between the quantity values with measurement uncertainties
provided by measurement standards and corresponding indications
with associated measurement uncertainties, and in a second step, uses this
information to establish a relation for obtaining a measurement result from
an indication ” International Vocabulary of Metrology )
( JCGM 200:2012 – International Vocabulary of Metrology )
 Uncertainty in Measurement

Why do we need Uncertainties?

 good measurement and test results

 Accreditation requirements according to ISO/IEC 17025
- Section 5.4.6,Estimation of Uncertainty of
measurement
 Measurement Uncertainty
“ non-negative parameter characterizing the dispersion
of the quantity values being attributed to a measurand,
based on the information used”

5 (+/-1mm)

It arises due to the imperfections in the measurement

system

No measurement system is perfect !!!!!

12
 Uncertainty
An estimate of the possible error in a measurement

Type A evaluation
A series of repeated observations is obtained to
determine the standard deviation of the measurement
result.
Type B evaluation
The evaluation is carried out using available information
found in calibration reports, certificates, specifications etc.

13
 Basic Terms

 True value  Measurement

 Conventional true value  Measurement Error
 Repeatability
 Reproducibility
 Trueness
 Accuracy
 Precision
 True Value

True value has been defined as the value that is perfectly

consistent with the definition of a given specific quantity.

It can be obtained by ideal measurement system.

 Conventional True Value

It is defined as the value accepted by consensus among

people knowledgeable on the subject. It is also referred to

as assigned value, best estimate of the value, conventional

value, accepted value, and reference value

 Repeatability
Measurement precision under a set of repeatability
conditions of measurement

Repeatability Condition
Condition of measurement, out of a set of conditions
that includes the same measurement procedure, same
operators, same measuring system, same operating
conditions and same location, and replicate
measurements on the same or similar objects.
 Reproducibility
Measurement precision under reproducibility
conditions of measurement

Reproducibility condition of measurement

Condition of measurement, out of a set of conditions
that include different measurement procedure,
operators, measuring system, operating conditions,
location, and replicate measurements on the same or
similar objects.
 Trueness

Closeness of agreement between the average

of an infinite number of replicate measured
quantity values and a reference quantity

value
 Accuracy

Closeness of agreement between a measured

quantity values and true quantity value of
measurand
 Precision
The closeness of agreement between repeated measurements of the same
quantity under the same conditions”

 Precision depends only on the distribution of random errors and does not relate to
the true value or accepted reference value.
 The precision of a measurement process is linked with the dispersion of repeat
observations among themselves.
 The most widely used measure of dispersion of statistical data is the standard
deviation of the data.
 The lower the standard deviation, the more the measurement data are clustered
among themselves and more precise the measurement process is.
 So standard deviation of the measurement data is a measure of its precision.
Error: the difference between observed
value and reference value

1. Single value
2. Applied as correction of result
Uncertainty :
1. Take the form of range
2. Can not be used to correct measurement
result
 Measurement Error

Systematic error
Component of measurement error that in replicate
measurements remain constant or varies in a a
predictable manner
Random error
Component of measurement error that in replicate
measurements varies in an unpredictable manner
Can be reduced by increasing number of observations.
 Sources of uncertainty
measurement
 calibration certificates
 Drift
 Environmental condition
 Resolution
 Sample preparation
 Repeatability
 Types of Uncertainty
 Type A uncertainty
Method of evaluation of uncertainty by the
statistical analysis of series observation
 Type B uncertainty
Method of evaluation of uncertainty by means
other than the statistical analysis of series
observation (given for me)
 Standard uncertainty
Measurement uncertainty expressed as a standard
deviation

 Combined standard uncertainty (Uc)

Standard measurement uncertainty that is obtained using the
individual standard measurement
Expanded uncertainty
Product of a combined standard measurement
uncertainty and a factor larger than the number
one
 Coverage Factor (K)
Number larger than one by which a combined
standard measurement uncertainty is multiplied
to obtain an expanded measurement uncertainty

A numerical factor used as a multiplier of the standard

uncertainty of measurement in order to obtain an expanded
uncertainty of measurement
Confidence Level : 68.27 90 95 95.5 99 99.73
Coverage Factor : 1.0 1.645 1.960 2.00 2.562 3.00
 Confidence
Level

Gaussian probability distribution

-kσ  +kσ
68% Within 1σ of mean
95% Within 2σ of mean
99% Within 3σ of mean

29
 Confidence level

The probability that the value of the measurand lies

within the quoted range of uncertainty
 The Uncertainty
Estimation Process
Specified measurand

Identify uncertainty
Sources

Quantify standard
uncertainty component

Calculate combined
standard uncertainty

Calculate the expanded

uncertainty
 Statistical terms

Arithmetic mean
Arithmetic mean value of a sample of n results

Sample Standard Deviation

An estimate of the population standard deviation S from a
sample of n results
Standard Uncertainty
The standard uncertainty resulting from the repeatability of
measurements is obtained by dividing the standard deviation
(s) by the square root of the n number of measurements n
How to Reduce Uncertainty in Measurement
Uncertainty evaluation is best done by personnel who are

thoroughly familiar with the Test & calibration and

understand the limitations of the measuring equipment and

the influences of external factor.

The lower uncertainty is usually attained by using better

equipment, better control of environment and ensuring
consistent performance of the test.
 MEASUREMENT OF UNCERTAINTY
Common Parameters

 Mass 2gm
 Volume 20ml
 Purity of Reference Materials
 Based on Calibration Uncertainty If Uncertainty mentioned by the Calibration
agency in the calibration certificate used for Uncertainty calculation then
Uncertainty to be calculated

as Example :
Mass
1-Accuracy of the balance 0.0002g
2-Resolution of the balance 0.0001g
3-Uncertainty from calibration certificate 0.0006g
- Accuracy is triangle hence U a =0.0002/√6 = 0.0001154g
-Resolution is rectangular hence U r = 0.0001/ √3 = 0.0000577g
-Uncertainty from calibration certificate =0.0006g
k factor =2 hence U c = 0.0006/2 =0.0003g
 Then Uncertainty is √ (U a ) 2 + (U r ) 2
+(U c ) 2
 Then Uncertainty is √(0.0001154) 2 +
(0.0000577) 2 + (0.0003) 2 = 0.00033 g
Volume
To calculate Uncertainty associated with
volume Pipette
Pipette details :
5 ml pipette
Uncertainty Value Distribution Uncertainty
Component

Calibration ± 0.015 triangular 0.015/sq6=

accuracy 0.00061

Repeatability 0.0004

Temperature 5x 3 x 2.1 x rectangular 0.0032/Sq3

Variation 10 -4 = =0.0018
0.0032
 Combined Uncertainty = Sqrt(0.00061 2 + + 0.0004 2 +
0.0018 2 ) = 0.017ml
 Note : is ±3 co-efficient of expansion of water is 2.1 x 10 -4 /
deg C.Hence formula for TV = Volume capacity x 2.1 x 10 -4
x3
 Volumetric Flask, 100 ml Volumetric

Uncertainty Value Distribution Uncertainty

Component

Calibration ± 0.1Max triangular 0.1/sqrt6=

accuracy 0.041
Repeatability 0.002

Temperature 100x 3 x 2.1 rectangular 0.064/sqrt3

Variation x 10 -4 = =0.037
0.064
 Combined Uncertainty = Sqrt (0.041 2 + + 0.002 2 +
0.037 2 ) = 0.055ml
Note : Temperature Variation is ±3 co-efficient of
expansion of water is 2.1 x 10 -4 / deg C. Hence
formula for TV = Volume capacity x 2.1 x 10 -4 x 3
Example
A pH meter was used to measure the pH of sample solution at
25 °C. The results of 5 measurements were 4.1, 4.15, 4.18, 4
and 4.12 pH units. The resolution of the pH meter was 0.01
and the drift from the last calibration was0.02.The calibration
certificate of showed ± 0.03 pH units uncertainty at 95 %
confidence level when the pH meter was calibrated t 25 °C.
Calculate the expanded uncertainty of the pH determination
process.
Type A
1- Calculate average = X =4.11

2- Standard deviation =
s
 ( Xi  X ) 2

=0.068557 n 1

s
3- Urep 
n

= 0.030659
Type B
1- Drift = UD = 0.02 / 3^0.05 = 0.011547

2- Resolution= UR = 0.01/ 2/ 3^0.5 =

3- Uncertainty= Ucer = 0.02/2 =0.01=0.002887

Combined uncertainty= Uc

Uc  U R2  U D2  U R2  U C2

Uexp= Uc x 2
Fishbone Diagrams
Practice:
The reading of H2S gas monitor at gas pipe outlet was
48,49, 50, 51, 48 ppm, calculate the uncertainty
accompanied with this measurement process where
The resolution of the monitor was 0.01
The drift in the monitor reading was 0.02
The uncertainty in from monitor calibration certificate was
+/- 1 ppm
The uncertainty of MFC certificate was +/-2 liter/min
Uncertainty sources in our work?

(Type A)
 Repeatability
Type B
 Device : accuracy, resolution, drift,
 MFC : accuracy, calibration certificate,
resolution
 Reference cylinder: certificate
Device :
Uncertainty value distribution Devisor uncertainty
component
Resolution

Drift

Certificate
Mass flow controller
Uncertainty value distribution Devisor uncertainty
component
Resolution

Calibration
certificate
Accuracy
Uncer. Cal.
Step one:
- ---- - ---------------------------------------------------
-------------------------------------------------------
------------------------------------------------------
Step two:
-----------------------------------------------------------
-------------------------------------------------------
Step three:
-------------------------------------------------------------------
------------------------------------------------
Step four:
-------------------------------------------------------------------
--------------------
Step five:
Uex=-------------------
Thank you