The Universal Validation Algorithm
The Universal Validation Algorithm
3. SELECTION OF VALIDATION PARAMETERS [1] 4.1. Comparison with the validated method
multi-position method with the substitution method
In the case of coordinate measurements, validation parameters are Virtual CMM method with the substitution method
expanded uncertainties U calculated for the following methods:
4.2. Interlaboratory comparison
Multi-position method Interlaboratory comparison with a reference laboratory in
expanded measurement uncertainty U accordance with the requirements specified by the standard ISO
17043 [N4] and the documents of the accreditation body. In the
case of calibration laboratories, the reference laboratory should
= ∙ + + + + (1) be selected in accordance with the criterion of independence and
accuracy, which means the choice of a laboratory with
appropriate scope of accreditation and calibration and
where:
measurement capability CMC.
- expanded uncertainty of the measurement,
- coverage factor,
5. SELECTION OF THE MEASURING CHECK
- standard uncertainty contribution originating from
repeatability of the CMM,
- standard uncertainty contribution related to the
geometrical errors of the CMM,
- standard uncertainty of the correction that is applied to
the average measurement result on the basis of the average
distance proportional error of length measurement,
- uncertainty related to the measurement of diameter,
- uncertainty connected to thermal influences.
Fig. 2. EUMETRON Multi feature check
Substitution Method
expanded measurement uncertainty U
Multi feature check - complex measuring standard for the
purposes of measurement accuracy assessment and the
= ∙ + + + (2) determination of measurement uncertainty for nearly all features
and dimensions applicable to the coordinate measuring
technique.
where: Due to the nature of the validation process and the accuracy of
- expanded uncertainty of the measurement coordinate systems, this standard is suitable for performing lots
- coverage factor of measuring tasks on CMMs thanks to the diversity of its
- standard uncertainty of the parameter of the calibrated geometric structure, which includes e.g. cylindrical holes of
workpiece or measurement standard various diameters and depths, circle hole, flat, stepped and end
up - standard uncertainty of the measurement procedure surfaces, short and long tapers with various opening angles.
ub - standard uncertainty of the systematic error
uw - standard uncertainty associated with the variations in the 6. SELECTION OF VALIDATION CRITERIA –
uncalibrated workpieces MATEMATICAL MODELS [2- 10]
e.g. external, internal, mixed and intermediate, all geometrical mathematical analysis of the estimation of the results and their
features, such as: shape, direction, position, and even radial and uncertainty according to numerous global publications and
axial runout were taken into account in the measurements. metrological studies. These models are confirmed by the validation
Measurements should be made by laboratory staff with proven of two – developed and improved in the Laboratory of Coordinate
measurement proficiency, selected from accredited personnel, Metrology (LCM) methods: Multi-position method based on
who meet, specified by the management, eligibility criteria for repeated measurements of an uncalibrated object and the matrix
performing calibration, results authorization and operation of the method used to build the system of virtual measuring machine to
specified coordinate system. assess the accuracy of the measurement on Line. The results of
Measurements should be taken under normal laboratory work validation of the mentioned above method using the model of
with appropriate supervision of environmental conditions. All statistical consistency control are described in details in [10].
the intermediate data associated with the preparation, The presented algorithm and the developed models of validation
measurements and analysis of the results must be protected in of measurement methods in calibration laboratories are the
order to ensure full traceability of the validation process. response to current market requirements and the designation of
a new, broad research area. The recipients of the model can be
accredited calibration laboratories, research institutions and
national conformity assessment bodies. The model may also be, in
the future, used in the validation of measurement methods in
production conditions, because the calculation of measurement
uncertainty, as the basis for judgments on the conformity with the
specifications of the product geometry, will become the standard.
3. Conclusions
The presented algorithm is purposely developed for the
validation of coordinate measuring methods. It can be used to
meet the requirements of the standard ISO 17025 (point 5.4) with
the rational choice of a validation model. These presented models
of validation are the proposition of methodology that may be used
for validating the new methods that have recently been developed,
internal laboratory procedures and methods that are rarely used in
practice and cannot be considered as validated. Fulfilling the
criterion presented in this paper is the necessary condition for
Fig. 3. Multi-feature check mounted in the measuring space of PMM 12106
assuming the considered method to be a validated one. The works
on improvement of the models are now carried out in LCM.
9. STATISTICAL DEVELOPMENT OF VALIDATION With small amendments, the presented validation algorithm and
PARAMETERS models may also be used in other fields of science and may
contribute to significant facilitation in demonstrating that the used
Calculations of measuring uncertainties in accordance with methods are validated and produce correct results.
Section 3.
10. APPLICATION OF VALIDATION MODELS This work was partially funded by the Polish National Center for Research and
Development No: LIDER/024/559/L-4/12/NCBR/2013.
Calculation of the mathematical models in accordance with
Section 6. 4. References
Presentation of the results in tabular form and graphically.
If the calculated validation parameters, uncertainties, do not [1] Sładek J.: Accuracy of coordinate measurements. Publishing House of
meet the conditions specified in the established models, a Cracow University of Technology, ISBN 978-83-7242-643-7, Cracow
detailed analysis of the validation and measuring process and 2011.
possible change of parameters from Sections 3 to 6 are required. [2] Kacker RN, Kessel R, Sommer KD, Bian X: Comparison of statistical
11. ACCEPTANCE OR REJECTION OF COORDINATE consistency and metrological compatibility. XIX IMEKO World
MEASURING METHOD Congress Fundamental and Applied Metrology, 6-11, 2009, Lisbon,
Portugal.
The decision on acceptance or rejection of the results obtained [3] Kacker RN, Kessel R, Sommer KD: Assessing differences between
from the measurements using methods to be validated. results determined according to the Guide of Expression of
The results of the validation (positive or negative) should be Uncertainty in Measurement. Journal of research of the national
included in a detailed report. This report, in addition to the main institute of Standards and Technology, 115, 453-459, 2010.
decisions, should include the data from the various stages of [4] Kacker RN, Kessel R, Sommer KD: Metrological compatibility and
validation according to the present algorithm. statistical consistency. 10th International Symposium on Measurement
This report, since its approval, becomes a part of the supervised and Quality Control 2010, September 5-9.
document in the management system in the laboratory and, [5] Cox M.G.: The evaluation of key comparison data. Metrologia 39 (6)
therefore, is a subject to the verification by the Polish Centre for 2002 587-8.
Accreditation. [6] Kacker RN, Forbes A, Kessel R, Sommer KD: Bayesian posterior
predictive p-value of statistical consistency in interlaboratory
evaluations. Metrologia 45 (5) 2008 512-23.
[7] Kacker RN, Forbes A, Kessel R, Sommer KD: Classical and Bayesian
2. Model of validation of coordinate interpretation of the Birge test of consistency and its generalized
measuring methods version for correlated results from interlaboratory evaluations.
Metrologia 45 (3) 2008 257-64.
As a part of the presented algorithm, the validation models were [8] Sładek J., Gawlik K.: Looking for uncertainty of measurement -
also developed. They are the basis for accepting or rejecting Virtual Machines based on the Matrix Method using artificial neural
new/changed measuring methods and are the innovation in the field networks. IV International Congress on Precision Machining 2007,
of coordinate metrology. They are universal models that contain the Sandomierz-Kielce, 2007.
124 Measurement Automation Monitoring, Apr. 2016, no. 04, vol. 62, ISSN 2450-2855
[9] Delčev, S., Gučević, J., Ogrizović, V.: Necessity of involvement of Ksenia OSTROWSKA, PhD, eng.
calibration laboratories in proficiency testing schemes. 11th IMEKO
Adjunct in Laboratory of Coordinate Metrology in
TC14 International Symposium on Measurement and Quality Control, Cracow University of Technology. Participant of many
ISMQC 2013 173-6. research projects. Head of the project financed by
[10] Gromczak K., Gąska A., Ostrowska K., Sładek J., Harmatys W., Gąska NCBiR within the LIDER program. Area of research:
P., Gruza M., Kowalski M.: Validation model for coordinate measuring accuracy assessment of measurements using redundant
coordinate measuring systems, calibration of the optical
methods based on the concept of statistical consistency control. systems used for measurement of 3D objects.
Precision Engineering, doi:10.1016/j.precisioneng.2016.03.021.
[N1] EN ISO/IEC 17025:2005 -General requirements for the competence
of testing and calibration laboratories.
[N2] ISO 15530-3:2011 -- Geometrical product specifications (GPS) -- e-mail: [email protected]
Coordinate measuring machines (CMM): Technique for
determining the uncertainty of measurement -- Part 3: Use of
Adam GĄSKA, PhD, eng.
calibrated workpieces or measurement standards.
[N3] ISO/CD TS 15530-2 GPS – Use of multiple measurement strategies. Adjunct in Laboratory of Coordinate Metrology.
[N4] ISO/IEC 17043:2010 - Conformity assessment -- General Participant of many research projects. Now he is a head
requirements for proficiency testing. of the project financed by the NCN regarding modeling
of 5-axis kinematic systems (SONATA program). He
[N5] International Vocabulary of Metrology – Basic and General was the head of the project financed by NCBiR within
Concepts and Associated Terms (VIM 3rd edition) JCGM the LIDER program, regarding usage of Virtual CMM
200:2012. models in industrial conditions. He is also interested in
mobile measuring systems like AACMMs or Laser
_____________________________________________________ Tracking systems.
Received: 07.01.2016 Paper reviewed Accepted: 02.03.2016
e-mail: [email protected]