The Basics of Calibration Procedure and Estimation of Uncertainty
The Basics of Calibration Procedure and Estimation of Uncertainty
The Basics of Calibration Procedure and Estimation of Uncertainty
ABSTRACT: The primary aim of this study was to develop the basic principles for calibration of meteorological temperature
sensors. The sensors commonly used in the meteorological community were calibrated using a comparison method in the
temperature range from −40 to +50 ∘ C. Measurements were carried out using a typical liquid thermostatic bath and a climatic
chamber. The experiments allowed the identification of characteristics for each calibration system and the definition of
metrological parameters for sensors used in weather stations. Components of uncertainty budget were identified and estimated,
and the total uncertainty was calculated. The calibration procedure allowed to reach the uncertainty of calibration in a liquid–air
equipment U < 0.10 ∘ C and in a climatic chamber: 0.27 ∘ C ≤ U ≤ 0.99 ∘ C. Presented outcomes were obtained as a result of the
project MeteoMet – Metrology for Meteorology.
have been corrected or the necessary corrections have been intro- automatically (using program MINI 32) after completed mea-
duced as separate input quantities. The correction is equal to the surements. In this study, sensors connected to converter ADAM
negative of the systematic error: are named a ‘thermometer’ with the symbol indicated in Table 1.
U = k · u (y) Both sensors, the reference PRT and the tested one, were placed
in the air chamber along its vertical axis. The entire length
The assigned expanded uncertainty corresponds to a coverage of the sensors was inside the chamber together with a pair of
probability of ∼95%. In case of a normal distribution of the electrical wires. Active elements of both sensors were placed at
measurand, the standard coverage factor k = 2 shall be used. the same height within a short distance (1–2 cm) from each other.
The numerical value of U shall be given up to, at most, two Sensors were protected from thermal contact between them and
significant figures (ILAC, 2013). In reporting the final results, it the chamber wall (Figure 1).
may sometimes be appropriate to round up uncertainties rather The system included a computer for data acquisition. A pro-
than to the nearest digit (BIPM, 2008). The numerical value of gram using LabView package allowed to set up the characteristic
the measurement result in the final statement shall be rounded co-efficients (specified by the manufacturer) and the sampling
up to the least significant figure in the value of the expanded time for each sensor.
uncertainty assigned to the measurement result (ILAC, 2013). Properly made measurement required stable thermal conditions
in the measurement system. The liquid–air equipment achieved
the stable state after 1.5–2.5 h, because heat exchange in the
3. Experiment in the laboratory conditions air chamber was caused by convection only, without forced
air flow.
3.1. Selection of tested sensors
The system required a preliminary observation to check
Appropriate preparation of measurements needs an adequate whether the tested thermometers generate any heat just after
selection of sensors for tests and calibration. In this study, the turning on, disrupting the thermal conditions in the chamber.
selected sensors are commonly used by the meteorological ser- Such an effect was observed for the Minikin thermometers,
vices and represent not only different models but also different which affected the time of achieving thermal equilibrium in the
operating times. One of these sensors was new, and the remain- system, and thus the duration of the calibration process.
ing had been previously used by a meteorological service. Table 1
3.2.2. Climatic chamber
summarizes the basic information about the selected sensors. It
contains the measurement uncertainties – at room temperature The climatic chamber used in the experiments allowed the tem-
and at extreme temperatures of scope – provided by the manu- perature value to be changed from −40 to +50 ∘ C and the relative
facturers. Operating time means the working period in the mete- humidity from 20 to 90% above 10 ∘ C. The temperature stability
orological service. in the chamber was ±0.050 ∘ C.
During measurements, the sensors were connected to an exter- During the tests, the difference between the reference and
nal analog digital converter Advantech ADAM-4017. Minikin tested sensor positions in the vertical plane was 3 cm, and in the
thermometers were an exception as their construction allows to horizontal plane it was determined by the thickness of the sensors
collect data independently, they consist of both a sensor and (maximum 5 cm). Only the part of the wires needed to mount the
a logger. The Minikin temperature registration was performed converter was pulled outside the chamber.
60
40
20
tx (°C)
0
–60 –40 –20 0 20 40 60
–20
–40
–60
tw (°C)
0.2
0
0
Δt (°C)
Δt (°C)
–0.1
–0.2
–0.2 –0.4
–0.3 –0.6
–60 –40 –20 0 20 40 60 –60 –40 –20 0 20 40 60
tW (°C) tW (°C)
Figure 3. Characteristics Δt = f (tw ) of the chosen meteorological thermometers: (a) HMP 155 and (b) RT.
Components derived from Components derived from Components derived from the
the reference thermometer the measurement system meteorological thermometer
• u(𝛿twdev ) – standard deviation of tw • u(𝛿tstab ) – temperature stability • u(𝛿tx dev ) – repeatibility of tx results
results • u(𝛿tgradH ) – temperature gradient in the • u(𝛿tx resol ) – resolution
• u(𝛿tw scat ) – scattering of tw value horizontal plane of the air chamber • u(𝛿tx rep ) – reproducibility
• u(𝛿tw std ) – uncertainty of PRT according • u(𝛿tgradV ) – temperature gradient in the • u(𝛿tx hist ) – hysteresis
to its Calibration certificate vertical plane of the air chamber • u(𝛿tx hom ) – homogeneity
• u(𝛿tw drift ) – drift of PRT • u(𝛿tx rad ) – radiation effect (in climatic
• u(𝛿tb std ) – uncertainty of resistance chamber only)
bridge according to its Calibration
certificate
• u(𝛿tb drift ) – drift of resistance bridge
As an example, the HMP 155 uncertainty budget for calibra- the expanded uncertainty. This is particularly evident in the case
tion at about −10 ∘ C is presented in detail in Table 3. The budget of the RT with a parabolic characteristic (Figure 3(b)).
includes the estimates and standard uncertainties of all known The WMO suggests that the expanded uncertainty U obtained
quantities that influenced the calibration results. Drift of a resis- in laboratory conditions during calibration by the comparison
tance meter was set to zero, since it was unknown (it was a new method should be ∼0.1 ∘ C at the 95% confidence level (WMO,
resistance bridge). The last line of the right column shows the 2010). This uncertainty mentioned in the document does not con-
calculated total uncertainty u (k = 1). On the same row (second tain effects due to non-linearity, drift, repeatability and repro-
column from the left), the estimated correction is presented. The ducibility of the meteorological sensor and its transducer. All
table gives an idea about the orders of magnitude of the u(xi ) the results presented above prove the accuracy of the performed
components. The expanded uncertainty in the presented example calibration and the adequacy of the thermometers used for mete-
is U = 0.074 ∘ C (the coverage factor k = 2, which corresponds to orological measurements (Table 5, values U 1 ).
the coverage probability of ∼95%).
The results of the HMP 155’s calibration are presented in 3.5.2. Uncertainty budget of calibration in the climatic
Table 4, which shows the measured values tx and calculated Δtcor chamber
for all calibrations performed in the temperature range from −50 The measurement uncertainty obtained in the climatic chamber is
to +50 ∘ C. The expanded uncertainty, given to one significant much larger than that obtained in the liquid–air equipment. The
digit, did not change for all calibrations at reference tempera- main components affecting this difference are:
tures tw . A similar situation occurred for other meteorological
thermometers with two exceptions: HMP 45B and M5, where the • the radiation effect;
value of the uncertainty strongly depended on the standard devi- • the temperature stability in the climatic chamber;
ation of tx results – u(𝛿tx dev ). Among all the investigated Vaisala • the temperature gradient in the climatic chamber;
sensors (Table 1), the smallest uncertainty values were obtained • the dispersion of the values tx .
for thermometers with the longest history of work.
The measurement results presented in the form of a linear The smallest impact on the calibration uncertainty u (k = 1) in
equation require the addition of a real thermometer characteristic the climatic chamber was derived from the reference thermome-
to the uncertainty budget of a component arising from lineariza- ter (∼0.005 ∘ C). This value has not changed significantly in com-
tion. Table 5 presents the uncertainties obtained for all ther- parison with the measurements in the liquid–air equipment. The
mometers, at temperature ∼20 ∘ C, where U 1 is an uncertainty value of the uncertainty associated with the measurement system
containing components derived from the reference thermometer, ranged between 0.13 and 0.47 ∘ C. The contribution of the uncer-
the measurement system and the calibrated thermometer, and U 2 tainty derived from the calibrated thermometer ranged between
is the uncertainty with an additional component derived from the 0.02 and 0.14 ∘ C. The expanded uncertainty of the measurement
linearization of the characteristic. The results show that the addi- U (k = 2) varied with the temperature and humidity condition and
tion of the linearization component caused significant increase of ranged between 0.27 and 0.99 ∘ C.
Quantity, Estimate, Standard uncertainty, Sensitivity Contribution to the total standard uncertainty,
xi (∘ C) xi (∘ C) u(xi ) (∘ C) co-efficient, ci ci u(xi ) (∘ C)
tw –10.0157
𝛿tw dev 0 2.58 × 10 –04 1 2.58 × 10 –04
𝛿tw scat 0 4.55 × 10 –04 1 4.55 × 10 –04
𝛿tw std 0 3.15 × 10 –04 1 3.15 × 10 –04
𝛿tw drift 0 1.07 × 10 –03 1 1.07 × 10 –03
𝛿tb std 0.00015 3.50 × 10 –04 1 3.50 × 10 –04
𝛿tb drift 0 0.00 × 10+00 1 0.00 × 10+00
𝛿tstab 0 1.03 × 10 –04 1 –1.03 × 10 –04
𝛿tgradH 0 9.67 × 10 –03 1 9.67 × 10 –03
𝛿tgradV 0 7.74 × 10 –03 1 7.74 × 10 –03
tx –10.1008
𝛿tx dev 0 3.22 × 10 –02 1 3.22 × 10 –02
𝛿tx resol 0 4.04 × 10 –03 1 4.04 × 10 –03
𝛿tx rep 0 1.04 × 10 –02 1 1.04 × 10 –02
𝛿tx hist 0 9.51 × 10 –03 1 9.51 × 10 –03
Δtcor 0.0853 0.037
HMP 155
Reference temperature Measured temperature Correction Uncertainty (k = 2)
tw (∘ C) tx (∘ C) Δtcorr (∘ C) U (∘ C)
Table 5. Comparison of the uncertainty values, U 1 and U 2 of tested calibration in the climatic chamber is less accurate than in the
meteorological thermometers at temperature ∼20 ∘ C. liquid–air equipment, it allows to evaluate the influence of the
parameters as a whole.
U 1 (∘ C) U 2 (∘ C)
3.5.3. Study of humidity influence on meteorological
HMP 155 0.08 0.15 thermometer parameters
RT 0.04 0.72
HMP 45A 0.05 0.09 The temperature sensors in the meteorological equipment used
HMP 45B 0.05 0.10 for this study were integrated with a humidity sensor (the M5
M5 0.08 0.15 thermometer is an exception) and in practice they were never
M9 0.06 0.12 protected from the effects of humidity. It was the main reason
why the meteorological sensors were tested in the climatic
chamber. Our measurements allowed to examine the influence
of humidity on the readings of the meteorological thermometers
It can be seen that the largest contribution to the total uncer-
as well. There was no strict relation of the humidity and the
tainty depended on the measurement system. Reduction of the
recorded temperature. Furthermore, there was no difference in
calibration uncertainty can be achieved by reducing the calibra-
the behaviour of the new thermometers and those previously used
tion area in the chamber (reduced gradients) or by using an addi-
in weather stations for a long time. It is also worth noting that
tional container for the thermometer (Lopardo et al., 2012). the tests in the climatic chamber have not changed the metro-
Large dispersion of the values indicated by the investigated logical characteristics of the thermometers, as confirmed by
thermometer (tx ) results from the fact that the sensors in the subsequent measurements carried out in the liquid thermostatic
climatic chambers are influenced by additional external fac- bath (Grykałowska et al., 2014; Wełna et al., 2014).
tors (e.g. variable air speed, radiation). Commercial climatic
chambers are not able to carry out controlled change of these
4. In situ tests
parameters, which would allow for an accurate analysis of their
impact. Therefore, it is impossible to estimate the contribution In situ tests were performed in a Stevenson screen to check the
of these factors to the uncertainty budget. However, although the accuracy of temperature measurement in typical conditions for
Acknowledgements
Figure 4. The comparison of the M9 thermometer results obtained in the
Stevenson screen and in the liquid–air equipment. This study was performed within the frame of the European
Metrology Research Program (EMRP) joint research project
meteorological measurements. The sensors were hanged verti- ‘METEOMET’. The EMRP is jointly funded by the EMRP
cally during the experiment without pulling and moving them. participating countries within the EURAMET and the European
The distance between the active elements of the sensors – the Union.
tested and the PRT ones – was ∼4 cm. The procedure used The present study was done under the project of Ministry of
allowed to perform measurements without opening the screen Science and Higher Education 2373/GRANT KE/2012/2.
door and did not interfere with the sensors’ location. The resis-
tance bridge was located outside the Stevenson screen. The air References
temperature during the test changed in the range of 15–35 ∘ C.
The tests indicated that the discrepancy of the results can be sig- BIPM. 1999. Mutual recognition arrangement. http://www.bipm.org/en/
cipm-mra/participation/signatories.html (accessed 29 September
nificantly larger (even 10 times) than the expanded uncertainties
2014).
determined in the liquid–air equipment (Figure 4). The criterion BIPM. 2008. JCGM 100:2008 GUM 1995 with minor corrections, evalu-
of the achievable measurement uncertainty (i.e. based on sensor ation of measurement data – guide to the expression of uncertainty in
performance under nominal and recommended exposure that can measurement. http://www.BIPM.org (accessed 29 September 2014).
be achieved in operational practice) (WMO, 2010), U ≤ 0.2 ∘ C, EA-4/02 M. 2013. Evaluation of the uncertainty of measurement in cal-
ibration. September 2013 rev01. http://www.european-accreditation.
was not met. This result indicates that sources of error, which org/publication/ea-4-02-m (accessed 29 September 2014).
are not taken into account during calibration, are quite impor- Grykałowska A, Kowal A, Szmyrka-Grzebyk A. 2014. INTiBS partic-
tant. It should be emphasized that the two types of the sensors, ipation in the MeteoMet project. In Proceedings of Polish Nation-
the PRT and the meteorological ones, were of different construc- wide Seminar: Measurement Problems in Meteorology, 24 June 2014.
Wrocław, Poland.
tion, and therefore they may have responded in a different way ILAC. 2013. ILAC-P14:01/2013 ILAC Policy for uncertainty in cal-
to wind speed, solar radiation, salinity of the environment and ibration. http://ilac.org/publications-and-resources/ilac-documents/
atmospheric pressure. procedural-series (accessed 29 September 2014
Additional contributions to the calibration uncertainty need Lopardo G, Marengo D, Meda A, Merlone A, Moro F, Pennecchi FR,
to be taken into account for in situ measurements. The Guide et al. 2012. Traceability and online publication of weather station mea-
surements of temperature, pressure, and humidity. Int. J. Thermophys.
(WMO, 2010) lists some of these sources: 33: 1633.
Merlone A, Bell S, Benyon R, Bergerud AR, Bertigia F, Boese N,
• the effectiveness of the heat transfer between the thermometer Brunet M, Buee B, del Campo D, Dahl J, Deboli R, Dobre M,
element and the air in the thermometer shelter, which should Ebert V, Emardsson R, Garcia Izquierdo C, Georgin E, Gilabert A,
Grudniewicz E, Heinonen M, Hermandez S, Hogstrom R, Holm-
ensure that the element is at thermal equilibrium with the air;
sten M, Holstein-Rathlou C, Hudoklin D, Jarlemark P, Jahans-
• the effectiveness of the thermometer shelter, which should son J, Kajastie H, Kaykisisli H, Klason P, Knorova R, Lakka A,
ensure that the air in the shelter is at the same temperature Lau P, Lopardo G, Melvad C, Merrison J, Migała K, Mokdad S,
as the air surrounding it; Piccato A, Pitre L, Roggero R, Ruiz S, Saathoff H, Sairanen H,
• the exposure, which should ensure that the shelter is at a tem- Sanna F, Saxholm S, Smorgon D, Sparasci F, Spazzini P, Stein-
metz E, Strnad R, Szmyrka-Grzebyk A, Verge A, Vidal V, Vuiller-
perature, which is representative of the region to be monitored. moz E. 2013. The “MeteoMet” project – Metrology for Meteorol-
ogy: challenges and results. In XII Symposium on Temperature and
The results of our measurements as well as those presented by Thermal Measurements in Industry and Science TEMPMEKO 2013:
other partners of the MeteoMet project (Merlone et al., 2013) 14–18 October 2013. Funchal.
strongly indicate that the development of a reliable uncertainty Preston-Thomas H. 1990. The international temperature scale of 1990.
Metrologia 28: 3–10.
budget for measurements in operating conditions is currently of Wełna A, Wiśniewska B, Kozicki M, Grudniewicz E. 2014. Procedures
great importance. Further joint research will be focused on this of maintaining and calibrating of Automatic Weather Stations. In
issue. Proceedings of Polish Nationwide Seminar: Measurement Problems
in Meteorology, 24 June 2014. Wrocław, Poland.
WMO. 2010. Guide to meteorological instruments and methods of
observation. http://library.wmo.int/pmb_ged/wmo_8_en-2012.pdf
5. Summary (accessed 29 September 2014).
WMO and BIPM. 2010. Report on the WMO-BIPM Workshop on
The results presented in this study showed a good reproducibility measurement challenges for global observation systems for climate
of metrological parameters of the sensors used in meteorology for change monitoring. Traceability, stability and uncertainty. WMO:
temperature measurements. The calibration procedure applied Geneva.