Report on EURAMET.M.M-S9

Similar documents
A bilateral comparison of a 1 kg platinum standard

A comparison of primary platinum-iridium kilogram mass standards among eighteen European NMIs

National Physical Laboratory Hampton Road Teddington Middlesex United Kingdom TW11 0LW

National Physical Laboratory Hampton Road Teddington Middlesex United Kingdom TW11 0LW

NPL REPORT ENG 13. Report on EUROMET key comparison of multiples and submultiples of the kilogram (EUROMET.M.M-K2) M Perkin NOT RESTRICTED

Final Report on APMP.M.M-K4.1 - Bilateral Comparison of 1 kg Stainless Steel Mass Standards between KRISS and A*STAR

Supplementary Comparison EURAMET.EM-S19 EURAMET Project No. 688

Euramet project 1187 Comparison of Instrument Current Transformers up to 10 ka. Technical protocol (March 2012)

RECENT ILC ACTIVITY IN ROMANIAN MASS MEASUREMENTS

EURAMET Project no Inter-comparison of a 1000 L proving tank

A Collaboration Between Ten National Measurement Institutes To Measure The Mass Of Two One Kilogram Mass Standards

Force Key Comparison EUROMET.M.F-K2. (50 kn and 100 kn) EURAMET Project No 518. Final Report. 14 July Pilot: NPL, United Kingdom

Final Report on CIPM key comparison of multiples and submultiples of the kilogram (CCM.M-K2)

ASIA PACIFIC METROLOGY PROGRAME

Comparison protocol EURAMET project

AFRIMETS. Supplementary Comparison Programme. Calibration of Gauge Blocks. by Mechanical Comparison Method AFRIMETS.L S3.

CCM short note on the dissemination process after the proposed redefinition of the kilogram

Technical Protocol of the CIPM Key Comparison CCAUV.V-K5

Final report on CCQM-K36.1 with erratum

FINAL REPORT OF THE BILATERAL COMPARISON OF THE CALIBRATIONS OF STANDARD WEIGHTS BETWEEN CENAM-MEXICO AND INEN-ECUADOR SIM.M.M-S4 (SIM.7.

PROTOCOL OF MASS AND VOLUME COMPARISONS BETWEEN SIM NMIs

Supplementary comparison SIM.M.FF-S12. Final Report for Volume of Liquids at 20 L

INTERNATIONAL COMPARISON OF PLATINUM RESISTANCE THERMOMETERS BETWEEN CHILE AND ECUADOR

Calibration of long gauge blocks. Technical protocol (Issue 1)

MASS AND VOLUME COMPARISONS AT MIKES

Physikalisch Technische Bundesanstalt

ANNEXE 8. Technical protocols for the interlaboratory comparisons

COOMET.M.V-S2 (587/RU-a/12) COOMET SUPPLEMENTARY COMPARISON IN THE FIELD OF MEASUREMENTS OF LIQUIDS KINEMATIC VISCOSITY

Report on Key Comparison COOMET.AUV.A-K5: Pressure calibration of laboratory standard microphones in the frequency range 2 Hz to 10 khz

STUDY OF THE EFFECT OF LASER MARKING FOR STANDARD WEIGHTS

SAMPLE. Accuracy Calibration Certificate. Instrument Type: EURAMET cg-18 v. 4.0 Sample ACC ISO17025 WI v.1.0

SAMPLE. Accuracy Calibration Certificate. Mettler Toledo 1900 Polaris Parkway Contact: Instrument Type: EURAMET cg-18 v. 4.0 Sample ACC WI v.1.

Final Report on the EURAMET.PR-K1.a-2009 Comparison of Spectral Irradiance 250 nm nm

OA03 UNCERTAINTY OF MEASUREMENT IN CHEMICAL TESTING IN ACCORDANCE WITH THE STANDARD SIST EN ISO/IEC Table of contents

Technical Protocol of the Bilateral Comparison in Primary Angular Vibration Calibration CCAUV.V-S1

Comparison of measurement uncertainty budgets for calibration of sound calibrators: Euromet project 576

FINAL REPORT ON THE KEY COMPARISON EUROMET.AUV.A-K3

Final Report EUROMET PROJECT 818 CALIBRATION FACTOR OF THERMISTOR MOUNTS. Jan P.M. de Vreede

Appendix B1. Reports of SMU

Final Report on COOMET Supplementary Comparison of Capacitance at 100 pf (COOMET.EM-S4)

Supplementary Comparison EUROMET.EM-S23 EURAMET PROJECT No 815 FINAL REPORT

SIM AUV.A-K1.prev Microphone Intercomparison

Introduction to the evaluation of uncertainty

Accuracy Calibration Certificate

Report on CCM Pilot Study CCM.R-kg-P1. Comparison of future realizations of the kilogram. Final Report

Final Report August 2010

EMRP JRP SIB-05. NewKILO. Developing a practical means of disseminating the redefined kilogram (June 2012 May 2015) Stuart Davidson, NPL, UK

Centre for Metrology and Accreditation, MIKES

PC TOOL FOR DATA ANALYSIS IN CALIBRATION OF SPECIAL WEIGHTS

Euromet.M.D.K1 (Euromet Project n 339) Intercomparison of volume standards by hydrostatic weighing

Metrology Principles for Earth Observation: the NMI view. Emma Woolliams 17 th October 2017

Final Report on COOMET Key Comparison of Capacitance at 10 pf (COOMET.EM-K4)

Traceable Mass Determination and Uncertainty Calculation

APPENDIX G EVALUATION OF MEASUREMENT UNCERTAINTY

Document No: TR 12 Issue No: 1

OIML D 28 DOCUMENT. Edition 2004 (E) ORGANISATION INTERNATIONALE INTERNATIONAL ORGANIZATION. Conventional value of the result of weighing in air

LINKING SIM MASS COMPARISONS TO THE KCRV ON 1 kg. Luis O. Becerra CENAM Querétaro, Qro., Mexico,

A guide to expression of uncertainty of measurements QA4EO-QAEO-GEN-DQK-006

Physikalisch-Technische Bundesanstalt

Portuguese Institute for Quality. Contents

EURAMET Project 1056

DRAFT B, Final Report on CIPM key comparison of 1 kg standards in stainless steel (CCM.M-K1)

Force Key Comparison CCM.F-K1.a and CCM.F-K1.b 5 kn and 10 kn. Aimo Pusa MIKES Finland

Loadcell Calibration - Evaluation of Uncertainties

GULF ASSOCIATION FOR METROLOGY. Calibration of Gauge Blocks by Mechanical Comparison Method GULFMET.L-S1

APPENDIX G ESTIMATION OF UNCERTAINTY OF MEASUREMENT

This document is a preview generated by EVS

EUROMET Project 702 EUROMET.M.D-K4

Revision of the Guide to the expression of uncertainty in measurement impact on national metrology institutes and industry

R SANAS Page 1 of 7

MOY/SCMI/36 SPECIFICATION OF ACCURACY FOR A PRECISION CLINOMETER

COMPARISON OF HUMIDITY MEASUREMENTS USING A DEW POINT METER AS A TRANSFER STANDARD APMP-IC-1-97 REPORT

Schedule of Accreditation issued by United Kingdom Accreditation Service 2 Pine Trees, Chertsey Lane, Staines-upon-Thames, TW18 3HR, UK

High pressure comparisons between seven European National Laboratories

DESIGN, DEVELOPMENT, AND COMMISSIONING OF A 120 kn DEADWEIGHT FORCE STANDARD MACHINE

Final Report 06 July 2006 Frank Wilkinson, Gan Xu, and Yuanjie Liu

INTERLABORATORY MASS COMPARISON BETWEEN LABORATORIES BELONGING TO SIM SUB-REGIONS COORDINATED BY CENAM (SIM.7.31a & SIM.7.31b)

Guidelines on the Calibration of Automatic Instruments for Weighing Road Vehicles in Motion and Measuring Axle Loads AWICal WIM Guide May 2018

Kilogram: new definition, selected mises-en-pratique and direct link with SMD activities

Calibration, traceability, uncertainty and comparing measurement results. Workshop 16 March 2015 VSL, Delft The Netherlands

EVALUATION OF ADSORPTION EFFECT BY USING SILICON SPHERE AND SILICON SURFACE ARTEFACTS

Comparison Euramet 898

TC Thermometry Graham Machin

SIM SIM.M.D-K3. provide. SIM.M.M-K5 for. A set of. Institute LACOMET LATU INTI. Country Costa Rica Uruguay Argentina Chile México Canada Brazil

FINAL REPORT. RMO Key Comparison EUROMET.EM-K2 Comparison of Resistance Standards at 10 M and 1 G. Beat Jeckelmann and Markus Zeier

EA Guidelines on the Calibration of Temperature Indicators and Simulators by Electrical Simulation and Measurement

VNA error models: Comments on EURAMET/cg-12/v.01

PRIMARY STANDARD AND TRACEABILITY CHAIN FOR MICROFLOW OF LIQUIDS

Final Report. SIM / ANDIMET Supplementary Comparison for Volume of Liquids at 100 ml and 100 µl SIM.M.FF-S7

Key comparison CCQM-K34 Assay of potassium hydrogen phthalate

Project PAJ2 Dynamic Performance of Adhesively Bonded Joints. Report No. 3 August Proposed Draft for the Revision of ISO

H1: Metrological support. Milena Horvat, Polona Vreča, Tea Zuliani, Radojko Jaćimović, Radmila Milačič

In-vacuum realisation of the new definition of the kilogram. Stuart Davidson, National Physical Laboratory, UK JRP Coordinator - NewKILO

THE UNCERTAINTY OF MEASUREMENT IN CALIBRATION USING A COMPARISON FORCE STANDARD MACHINE

Comparison of V and 10 V DC Voltage References

High pressure comparison among seven European national laboratories

Guidelines on the Calibration of Static Torque Measuring Devices

Final Report On RMO VICKERS KEY COMPARISON COOMET M.H-K1

SIM FORCE STANDARDS COMPARISON UP TO 10 kn

Version 4.0 (09/2017) Version 3.0 (02/2015) Version 2.0 (03/2011) Version 1.0 (07/2007) EURAMET e.v. Bundesallee 100 D Braunschweig Germany

Transcription:

FINAL REPORT Report on EURAMET.M.M-S9 Supplementary comparison of 500 microgram, 200 microgram, 100 microgram and 50 microgram weights (EURAMET project number 1310) Stuart DAVIDSON 1, Adriana VALCU 2, Nieves MEDINA 3, Jaroslav ZUDA 4, Laurenc SNOPKO 5, Irena KOLOZINSKA 6 1 National Physical Laboratory, Hampton Road, Teddington, TW11 0LW, United Kingdom. 2 National Institute of Metrology, Sos. Vitan Barzesti nr. 11, sect. 4, 042122, Bucharest, Romania Romania 3 Centro Español de Metrología, Calle del Alfar nº 2, 28760 Tres Cantos Madrid, Spain 4 Czech metrology institute, Okruzní 31, 638 00 Brno, Czech Republic 5 Slovak Institute of Metrology, Karloveská 63, 842 55 Bratislava, Slovakia 6 National Scientific Centre "Institute of Metrology", 61002 Ukraine, Kharkiv. Str. Mironositska 42, Ukraine

Abstract... 1 1 Introduction... 2 2 Description of the Transfer Standards... 2 3 Comparison Schedule... 5 4 Procedures and Equipment... 5 4.1 Procedures... 5 4.1.1 NPL... 5 4.1.2 INM... 6 4.1.3 CEM... 6 4.1.4 CMI... 7 4.1.5 SMU... 7 4.2 Equipment... 8 5 Results of the Comparison... 8 6 Calculation of Reference Values and Data Analysis... 9 7 Results... 10 7.1 0.5 milligrams... 10 7.2 0.2 milligrams... 12 7.3 0.2D milligrams... 13 7.4 0.1 milligrams... 14 7.5 0.05 milligrams... 15 8 Interpretation of the Results... 16 9 Conclusions... 17 10 References... 18

Abstract A comparison of sub-milligram mass standards was undertaken within EURAMET between NPL (as the pilot laboratory), INM (Romania), CEM (Spain), CMI (Czech Republic), SMU (Slovakia) and NSC IM (Ukraine). The weights circulated had nominal values 500 micrograms, 200 micrograms (2 weights), 100 micrograms and 50 micrograms. 1

1 Introduction The lower limit of the mass scale for calibration by comparison with standard weights has traditionally been 1 milligram. Recently NMIs and weight manufacturers have seen a demand, for example from the pharmaceutical industry, for the provision of mass standards with values of less than 1 milligram. Additionally requirements exist for the traceable measurement of small forces, for example for atomic force microscope (AFM) probing force measurements. A supplementary comparison of sub-milligram mass standards was undertaken between the NMIs of the United Kingdom, Romania, Spain, the Czech Republic, Slovakia and the Ukraine in order to demonstrate capability in this area. The comparison also had the aim of investigating the stability of such small weights when used as transfer standards. Details of the participating laboratories are listed in Table 1. Table 1: List of Participating Laboratories Laboratory Country Contact National Physical Laboratory NPL United Kingdom Stuart DAVIDSON National Institute of Metrology INM Romania Adriana VALCU Centro Español de Metrología CEM Spain Nieves MEDINA Czech Metrology Institute CMI Czech Republic Jaroslav ZUDA Slovenský metrologický ústav SMU Slovakia Laurenc SNOPKO National Scientific Centre "Institute of Metrology" NSC IM Ukraine Irena KOLOZINSKA 2 Description of the Transfer Standards The transfer standards were provided by Mettler-Toledo. Five transfer standards were used for this comparison with the following values; 0.5 milligrams 0.2 milligrams 0.2D milligrams 0.1 milligrams 0.05 milligrams The weights were made from aluminium wire. Figures 1 to 3 show the transfer standards travelling case and the 0.5 mg weight in its container. 2

Figure 1: Mettler-Toledo transport case Figure 2: Weight box 3

Figure 3a: 0.5 mg standard in container Figure 3b: Detail of 0.5 mg standard Full details of the transfer standards and the measurement protocol are given in Appendix 1. 4

3 Comparison Schedule The weights were circulated among the participants during the period April 2015 to February 2016. The dates on which the measurements were undertaken are given in Table 2. Transportation was undertaken by courier, with the weights being transported in purpose-built boxes. Table 2: Measurement Schedule Laboratory NPL INM CEM CMI SMU NPL NSC IM NPL Date of Measurements Jan-15 Apr-15 May-15 Jul-15 Oct-15 Dec-15 Feb-16 Apr-16 4 Procedures and Equipment Each participant calibrated the transfer standards according to their normal calibration procedure using appropriate mass comparators. Details of the procedures and equipment used by the six participating laboratories are given in this section of the report. 4.1 Procedures The procedures used by the participants are given below. 4.1.1 NPL For this first set of measurements NPL performed a subdivision from two 2 milligram standards and incorporating NPL s own sub-milligram mass set. The scheme involved 19 weights (including the five transfer standards) and consisted of 69 comparisons. For the two subsequent calibrations NPL performed a subdivision from two 1 milligram standards using the five transfer standards and one additional NPL check standard (at 0.000 5 mg). The scheme consisted of 21 comparisons. 5

4.1.2 INM INM used a subdivision calibration from a 1 mg standard mass using check masses at each nominal value. The subdivision scheme is shown in Figure 4. Figure 4: Sub-division scheme used by INM 1 1* 0,5 0,5 * 0,2 0,2D 0,1 0,1* -1 1 0 0 0 0 0 0-1 0 1 1 0 0 0 0 0-1 1 1 0 0 0 0 0 0-1 1 0 0 0 0 0 0-1 0 1 1 1 0 X1= 0 0 0-1 1 1 0 1 0 0 0 0 1-1 0 0 0 0 0 0 1-1 0 0 0 0 0 0 1 0-1 -1 0 0 0 0 0 1-1 -1 0 0 0 0 0 0 1-1 0 0 0 0 0 0 1-1 0,1 0,1* 0,05 0,05* 1-1 0 0 1 0-1 -1 X2= 0 0 1-1 1-1 0 0 0 0 1-1 0 1-1 -1 0 0 1-1 4.1.3 CEM CEM used the method of subdivision having a 1 mg weight as the reference standard and another 1 mg weight as the check standard. The participants own sub-milligram weights were also included in the measurement as a check. The system has been solved by Gauss Markov method. 6

4.1.4 CMI CMI used a subdivision method with an added 70 µg Pt wire to end the decade for subdivision purposes. The subdivision scheme employed is shown in Figure 5. Figure 5: Sub-division scheme used by CMI 1 mg 0,5 mg 0,2 mg 0,2 mg* 0,1 mg 0,05 mg 0,07 mg Pt 1-1 -1-1 -1 0 0 1-1 -1-1 0-1 -1 0 1-1 -1-1 0 0 0 1-1 -1 0-1 -1 0 0 1-1 0 0 0 0 0 1 0-1 -1-1 0 0 0 1-1 -1-1 0 0 0 0 1-1 -1 0 0 0 0 0 1-1 4.1.5 SMU At SMU the measurement was made by least square calibration with semi-automatic device. Measurement scheme was 5,2,2*,1,1*, 14 - equations measured four times. Compared against standard 1 mg without defined volume is one measured cycle. One cycle for measurement and one for confirmation of results. 4.1.6 NSC IM NSC IM used the subdivision scheme shown in Figure 6. Figure 6: Sub-division scheme used by NSC IM 1mg_IM 0.5NPL 0.5IM 0.2NPL 0.2*NPL 0.2IM 0.1NPL 0.05NPL 1-1 0-1 -1 0-1 0 0 1 0-1 -1 0-1 0 0 0 0 1-1 0 0 0 0 0 0 1 0 0-1 -1 0 0 0 0 0 0 1-1 0 0 0 0 1 0-1 -1 1-1 -1 0 0 0 0 0 0-1 1 0 0 0 0 0 0 0 1-1 -1 0-1 0 0 0 0-1 0 1 0 0 0 0 0 0-1 1 0 0 0 0 0 0 0 1-1 -1 7

4.2 Equipment The balances used by the participants are detailed in Table. 3. Table 3: Balances used by the participants Participant Manufacturer Type Capacity Resolution Standard deviation NPL Sartorius C5S 5.0 g 0.1 µg 0.2 µg INM Mettler-Toledo UMX 5 5.1 g 0.1 µg 0.3 µg CEM Mettler-Toledo UMX 5 5.1 g 0.1 µg < 0.15 µg Mettler-Toledo A5 5.1 g 0.1 µg < 0.1 µg CMI Mettler-Toledo UMT 5 5.1 g 0.1 µg 0.3 µg SMU Sartorius CC20 20 g 1 µg - NSC IM Mettler-Toledo UP6U 6.1 g 0.1 µg 0.3 µg 5 Results of the Comparison Each participant reported the measured true mass together with an associated uncertainty for each of the five transfer standards, calculated according to the Guide to the Expression of Uncertainty in Measurement (GUM) [1]. The results of the participants together with their associated standard uncertainties are reported in Table 4. Table 4: Results of the comparison for the five transfer standards 0.5 mg 0.2 mg 0.2D mg 0.1 mg 0.05 mg Participant Measured mass / mg Uncertainty Measured mass / mg Uncertainty Measured mass / mg Uncertainty Measured mass / mg Uncertainty Measured mass / mg Uncertainty NPL (1) 0.501 05 0.15 0.200 62 0.12 0.200 24 0.15 0.100 40 0.11 0.050 80 0.15 INM 0.500 49 0.30 0.200 67 0.25 0.200 07 0.25 0.100 44 0.20 0.050 77 0.15 CEM 0.500 70 0.40 0.200 70 0.30 0.200 20 0.30 0.100 40 0.30 0.050 70 0.30 CMI 0.500 33 0.27 0.200 59 0.16 0.200 26 0.16 0.100 28 0.13 0.050 09 0.12 SMU 0.499 45 0.20 0.200 12 0.10 0.199 56 0.10 0.099 48 0.10 0.049 87 0.10 NPL (2) 0.500 56 0.10 0.200 58 0.08 0.200 24 0.11 0.100 52 0.10 0.050 39 0.10 NSC IM 0.500 80 0.26 0.200 68 0.11 0.200 38 0.11 0.100 55 0.05 0.050 53 0.05 NPL (3) 0.500 54 0.11 0.200 68 0.10 0.200 32 0.12 0.100 29 0.12 0.050 21 0.11 8

6 Calculation of Reference Values and Data Analysis Initially a reference value was calculated based on all eight measurements (three measurements by NPL and one by each of the other five participants) at each nominal value using a least squares analysis of the measurement data [2]. There has been assumed to be no correlation between the results of the six participants. Additionally there was assumed to be no correlation between the NPL results, this was regarded a reasonable assumption since the majority of the uncertainty in the NPL results was due to (independent) type A contributions. The reference mass (mref), taking into account any change in value during the period of the comparison, was modelled by the equation; m ref 2 a1 a t m (1) Where t is the time of measurement, a1 and a2 are constants and δm is a time dependant variable with expectation 0 and variance σ 2 which describes random changes in the mass of the transfer standards with time. For the 0.2 milligram, 0.2D milligram and 0.1 milligram weights, chi-square analysis of a least squares fit of the data showed that the measurement data was consistent with a model with zero deterministic drift and no random change in the values of the standards (i.e. values of a2 = 0 and σ 2 = 0). A chi-square test of the data for the 0.5 milligram and 0.05 milligram weights failed for a reference value based on a model without a deterministic drift. Since the results of the participants indicated that the value of the weight had drifted during the period of the comparison the evaluations were repeated for each model with constant temporal drift (a2 0). Reference values were calculated for the five transfer standards by least squares analysis of the measurement results taking into account the uncertainties of the measured values reported by the participants. Normalised deviations from the reference value for each result were calculated from the difference between the measured value and the reference value divided by the standards uncertainty of the difference. d ( m mref ) (2) u( m m ) ref The normalised deviations were used to identify results which are discrepant compared with the reference value. Results are considered discrepant (at a 5% level of significance) where the normalised deviation is greater than 2. 9

7 Results The participants results, reference values and normalised deviations for the transfer standards are given below. The uncertainties given in the tables and figures represent standard uncertainties (k = 1). 7.1 0.5 milligrams Table 5 gives the results of the least squares analysis calculation of the reference value for the 0.5 milligram transfer standard taking into account the calculated drift in the weight during the period of the participants measurements (mref) together with the participants data (m) and their associated standard uncertainties. Normalised deviations have been calculated for each result. The results are plotted in Figure 7 and show the changing reference value due to the drift in the mass of the transfer standard. Table 5: Results, reference values and normalised deviations for the 0.5 milligram transfer standard. Participant Date of meas. Result Reference value Normalised deviation* m u(m) m ref u(m ref) d NPL (1) Jan-15 501.050 0.15 500.893 0.12 2.1 INM Apr-15 500.490 0.30 500.816 0.10-1.1 CEM May-15 500.700 0.40 500.790 0.09-0.2 CMI Jul-15 500.330 0.27 500.738 0.07-1.6 SMU Oct-15 499.450 0.20 500.659 0.06-5.8 NPL (2) Dec-15 500.561 0.10 500.607 0.06-0.6 NSC IM Feb-16 500.800 0.26 500.554 0.07 1.0 NPL (3) Apr-16 500.542 0.11 500.502 0.08 0.6 *Where the normalised deviations are shown in red (> 2 ) the results have not been included when calculating the reference value. 10

Figure 7: Results of the comparison for the 0.5 milligram standard (results have been included where a normalised deviation of <2 has been calculated). 11

7.2 0.2 milligrams Table 6 gives the reference value for the 0.2 milligram weight together with the participants results and the associated standard uncertainties. The results are plotted in Figure 8. Table 6: Results, reference values and normalised deviations for the 0.2 milligram transfer standard. Participant Date of meas. Result Reference value Normalised deviation* m u(m) m ref u(m ref) d NPL (1) Jan-15 200.615 0.12 200.630 0.05-0.1 INM Apr-15 200.670 0.25 200.630 0.05 0.2 CEM May-15 200.700 0.30 200.630 0.05 0.2 CMI Jul-15 200.590 0.16 200.630 0.05-0.3 SMU Oct-15 200.120 0.10 200.630 0.05-4.6 NPL (2) Dec-15 200.578 0.08 200.630 0.05-0.8 NSC IM Feb-16 200.680 0.11 200.630 0.05 0.5 NPL (3) Apr-16 200.684 0.10 200.630 0.05 0.6 *Where the normalised deviations are shown in red (> 2 ) the results have not been included when calculating the reference value. Figure 8: Results of the comparison for the 0.2 milligram standard (results have been included where a normalised deviation of <2 has been calculated) 12

7.3 0.2D milligrams Table 7 gives the reference value for the 0.2D milligram weight together with the participants results and the associated standard uncertainties. The results are plotted in Figure 9. Table 7: Results, reference values and normalised deviations for the 0.2 milligram transfer standard. Participant Date of meas. Result Reference value Normalised deviation* m u(m) m ref u(m ref) d NPL (1) Jan-15 200.243 0.15 200.283 0.05-0.3 INM Apr-15 200.070 0.25 200.283 0.05-0.9 CEM May-15 200.200 0.30 200.283 0.05-0.3 CMI Jul-15 200.260 0.16 200.283 0.05-0.2 SMU Oct-15 199.560 0.10 200.283 0.05-6.4 NPL (2) Dec-15 200.244 0.11 200.283 0.05-0.4 NSC IM Feb-16 200.380 0.11 200.283 0.05 1.0 NPL (3) Apr-16 200.317 0.12 200.283 0.05 0.3 *Where the normalised deviations are shown in red (> 2 ) the results have not been included when calculating the reference value. Figure 9: Results of the comparison for the 0.2D milligram standard (results have been included where a normalised deviation of <2 has been calculated) 13

7.4 0.1 milligrams Table 8 gives the reference value for the 0.2D milligram weight together with the participants results and the associated standard uncertainties. The results are plotted in Figure 10. Table 8: Results, reference values and normalised deviations for the 0.1 milligram transfer standard. Participant Date of meas. Result Reference value Normalised deviation* m u(m) m ref u(m ref) d NPL (1) Jan-15 100.397 0.11 100.395 0.05 0.0 INM Apr-15 100.440 0.20 100.395 0.05 0.2 CEM May-15 100.400 0.30 100.395 0.05 0.0 CMI Jul-15 100.280 0.13 100.395 0.05-1.0 SMU Oct-15 99.480 0.10 100.395 0.05-8.1 NPL (2) Dec-15 100.523 0.10 100.395 0.05 1.5 NSC IM Feb-16 100.550 0.05 100.395 0.05 2.1 NPL (3) Apr-16 100.289 0.12 100.395 0.05-1.0 *Where the normalised deviations are shown in red (> 2 ) the results have not been included when calculating the reference value. Figure 10: Results of the comparison for the 0.1 milligram standard (results have been included where a normalised deviation of <2 has been calculated) 14

7.5 0.05 milligrams Table 9 gives the reference value for the 0.05 milligram transfer standard, taking into account the calculated drift in the weight, and the participants results and the associated standard uncertainties. The results are plotted in Figure 11. Table 9: Results, reference values and normalised deviations for the 0.05 milligram transfer standard. Participant Date of meas. Result Reference value Normalised deviation* m u(m) m ref u(m ref) d NPL (1) Jan-15 50.796 0.15 50.842 0.11-0.5 INM Apr-15 50.770 0.15 50.720 0.09 0.4 CEM May-15 50.700 0.30 50.680 0.08 0.1 CMI Jul-15 50.090 0.12 50.597 0.07-3.7 SMU Oct-15 49.870 0.10 50.472 0.06-5.2 NPL (2) Dec-15 50.394 0.10 50.389 0.06 0.1 NSC IM Feb-16 50.530 0.05 50.305 0.07 2.5 NPL (3) Apr-16 50.214 0.11 50.224 0.09-0.2 *Where the normalised deviations are shown in red (> 2 ) the results have not been included when calculating the reference value. Figure 11: Results of the comparison for the 0.05 milligram standard (results have been included where a normalised deviation of <2 has been calculated) 15

8 Interpretation of the Results The majority of the measurement results of the participants are consistent with the calculated reference values for the five transfer standards. The reference values for the remaining transfer standards (0.2 milligram 0.2D milligram and 0.1 milligram) were calculated to have zero drift during the period of the comparison based on a least squares analysis of the measurement data. The 0.5 milligram and 0.05 milligram transfer standards exhibited a linear drift in their values during the period of the comparison which was taken into account when calculating the reference values for the weight. The validity of this linear drift model for the 0.05 milligram standard may be in question as three of the six participants showed non-consistent results for this weight. It could also be argued that, because of the sub-division schemes used by all the participants, assigning a value to the 0.05 milligram weight, as the last weight in the sub-division, presented additional issues for some of the participants, particularly where no additional 0.05 milligram check-weight was used. As an additional exercise the measurement results for the 0.05 milligram weight were fitted with a step change model rather than the linear drift used for the comparison (Table 10 and Figure 12). While the number of excluded results is reduced from 3 to 2 using this model, the overall fit of the data is worse (χ 2 = 1.55 for the step-change vs. χ 2 = 0.22 for the linear drift when using the same set of included data) and thus the linear drift model has been retained for the analysis of the comparison data. Table 10: Results, reference values and normalised deviations for the 0.05 milligram transfer standard using a step-change model to calculate the reference value. Participant Date of meas. Result Reference value Normalised deviation* m u(m) m ref u(m ref) d NPL (1) Jan-15 50.796 0.15 50.774 0.10 0.2 INM Apr-15 50.770 0.15 50.774 0.10 0.0 CEM May-15 50.700 0.30 50.774 0.10-0.3 CMI Jul-15 50.090 0.12 50.313 0.074-1.6 SMU Oct-15 49.870 0.10 50.313 0.074-3.6 NPL (2) Dec-15 50.394 0.10 50.313 0.074 1.2 NSC IM Feb-16 50.530 0.05 50.313 0.074 2.4 NPL (3) Apr-16 50.214 0.11 50.313 0.074-1.2 16

Figure 11: Results of the comparison for the 0.05 milligram standard using a stepchange model to calculate the reference value 9 Conclusions The majority of participants have demonstrated their capability of measuring the transfer standards to their stated level of uncertainty. The stability of the transfer standards proved adequate for the purposes of the comparison with the possible exception of the 0.05 mg weight which had a high drift value and the largest number of discrepant results among the participants. It may well be that modelling the mass change of this transfer standard as a linear drift does not reflect the real situation and that the transfer standard eone or more step changes in its value during the period of the comparison due to its handling or transport. However, statistically the linear drift model represents the best fit to the data reported. In terms of the (sub-division) weighing schemes used, the assignment of a value to the smallest weight in the set, particularly where no check-weight of similar value was available is also more problematic. Given the small uncertainties likely to be claimed by participants in a sub-milligram comparison (less than 0.2 micrograms in most cases for this comparison), the stability of the transfer standards is likely to be a significant factor in the consistency of the results. Care must be taken with the storage, transfer and handling of such standards for the success of future comparisons at the sub-milligram level. 17

10 References [1] Guide to the Expression of Uncertainty in Measurement, BIPM, IEC, IFCC, ISO, IUPAC, IUPAP, OIML, JCGM 100:2008 [2] Nielsen, L. Evaluation of measurement intercomparisons by the method of least squares, DFM-99-R39 (2000) [3] Tanguy Madec, et al, Micro-mass standards to calibrate the sensitivity of mass comparators, Metrologia 44 (2007) 266 274 Acknowledgements The authors would like to acknowledge the support of Mettler-Toledo in providing the transfer standards for this comparison and of Lars Nielsen of the Danish Fundamental Metrology institute for assistance with the analysis of the comparison data. 18

APPENDIX 1: COMPARISON PROTOCOL FOR EURAMET.M.M-S9 (Sub-milligram mass standards) 1 OUTLINE of SUPPLEMENTARY comparison This is a comparison of sub-milligram mass standards. NPL is the pilot laboratory and will analyse the data and produce the final report. 2 Purpose of this document The purpose of this document is to define the organisation of the comparison and to provide instructions for the participants on the transport and handling of the transfer standards and on the reporting of the measurement results. It is defined by applying the guidelines for CIPM key comparisons (appendix F to the MRA). 3 Organisation of the comparison Five transfer standards will be circulated between the participants. NPL will make interim measurements between transfers to the participants to monitor the stability of the transfer standards. 4 Description of the STANDARDS The transfer standards were manufactured by Mettler-Toledo from aluminium wire. The characteristics of the standards are as follows: Nominal value 0.5 mg, 0.2 mg, 0.2D mg, 0.1 mg and 0.05 mg Identification The 0.2D mass is the weight with the extra bend Serial number - Shape Material Method of density calibration Wire weights Aluminium alloy Assumed value Density at 20 C (kg m -3 ) 2700 Uncertainty of density (kg m -3 ) [k = 2] Cubic coefficient of thermal expansion ( C -1 ) ± 140 6.9 x 10-5 1

5 TRANSPORTATION 5.1 Organisation Each laboratory is responsible for the organisation of the transportation to the next participant according to the circulation timetable, and for making proper arrangements for local customs formalities. Each participating laboratory is responsible for its own costs for the transportation to the next participating laboratory and any custom charges within its own country. Each participating laboratory shall have insurance for any damage or loss within its own country or during the travel to the next laboratory. Before dispatching the package, the participating laboratory shall inform the pilot, giving transportation details. Each laboratory shall be informed of the incoming package at least one week in advance. Any circumstances to which the standard is subjected during transit, which might affect the results of the comparison, shall be reported to the pilot laboratory at the earliest opportunity. 6 Receipt of the travelling standard 6.1 Receipt of the package Please email the pilot laboratory of any damage to the package and if possible attach a photograph. 6.2 Opening the package At the arrival of the standard, special care shall be taken for opening the package. 7 Measurement 7.1 Cleaning No cleaning is applied to the standards. 7.2 Handling Suitable devices should be used to handle the transfer standards. 7.3 Ambient conditions The measurements shall be made under ambient conditions of air. The parameters contributing to air density may be recorded for each weighing and the air density shall be calculated using the CIPM -2007 formula 7.4 Weighing procedure The laboratory applies its own weighing procedure. 2

8 Reporting of data 8.1 Measurements results The following information shall be reported to the pilot laboratory using the appropriate form given in appendix B: - B1 : movement of travelling standard and period of weighing - Table R2 : record of the dates - Record of unusual environmental conditions (if appropriate) - B2 : results of measurement - Table R3 : measured mass - Table R4 : ambient conditions during measurement of the travelling standard - B3 : calibration means - Table R5 : details of participant s mass standards used for measurement - Table R6: details of the weighing scheme used - Table R7 : mass comparator used The participating laboratory shall send the pilot laboratory its report within four weeks after the end of measurements. 8.2 Uncertainty of measurement All uncertainty shall be computed and reported according to ISO guide to the expression of uncertainty in measurement. They should be expressed as standarduncertainty with the effective number of degrees of freedom specified. 9 Departure of the standards After measurement return the standards to the transfer box. After departure, the participating laboratory must email the pilot laboratory and the recipient laboratory informing them that the standards have been despatched. 11 Annexed paper and forms - Appendix A : Participants, timetable and address - Appendix B : Results form 3

A1: COMPARISON SCHEDULE Table R1: Measurement schedule Laboratory Date of measurements NPL January 2015 INM April 2015 CEM May 2015 CMI June 2015 SMU July 2015 NPL August 2015 NSC IM February 2016 NPL April 2016 1. participating laboratory contact person UNITED KINGDOM NPL (pilot laboratory) mail address and address for deliveries: National Physical Laboratory Hampton Road Teddington, Middx. TW11 0LW, UNITED KINGDOM Stuart DAVIDSON E-Mail: stuart.davidson@npl.co.uk Phone: +44 (0)208 943 6224 2. participating laboratory contact person ROMANIA INM mail address and address for deliveries: National Institute of Metrology Mass laboratory Sos. Vitan-Barzesti No. 11 Sector 4, 042122, Bucharest ROMANIA Adriana VALCU E-Mail: adriana.valcu@inm.ro Phone: +021 310 21 10 3. participating laboratory contact person SPAIN CEM mail address and address for deliveries: Centro Espanol de Metrologia C/ del Alfar, 2 28760 Tres Cantos Madrid SPAIN Nieves MEDINA E-Mail: mnmedina@cem.mityc.es Phone: +34 918074789 4

4. participating laboratory contact person CZECH REPUBLIC CMI mail address and address for deliveries: Dpt. of Primary mass metrology Okruzni 31 63800 Brno CZECH REPUBLIC Jaroslav ZUDA E-Mail: jzuda@cmi.cz Phone: +420 545 555 230 5. participating laboratory contact person SLOVAKIA SMU mail address and address for deliveries: Slovenský metrologický ústav Karloveská 63 SK-84255 Bratislava SLOVAKIA Laurenc SNOPKO E-Mail: snopko@smu.gov.sk Phone: 6. participating laboratory contact person UKRAINE - NSC IM mail address and address for deliveries: Myronosytska Str. 42 Kharkiv 61002 UKRAINE Irena KOLOZINSKA E-Mail: iren_kolozinsky@ukr.net Phone: 5

B1: MOVEMENT OF THE TRAVELLING STANDARD AND PERIOD OF WEIGHING Table R2: record of the dates Date of arrival of the travelling standard Date of departure of the travelling standard Date started measurement Date finished measurement Unusual environmental conditions experienced during transit or weighing: (if appropriate) 6

B2: RESULTS OF MEASUREMENT Table R3: Measured mass Mass of travelling standard Standard uncertainty number of measurements 1 number of degrees of freedom 0.5 mg + µg µg 0.2 mg + µg µg 0.2D mg + µg µg 0.1 mg + µg µg 0.05 mg + µg µg Table R4: Ambient conditions during the measurements 1 Parameter Average value during measurements air density (kg.m -3 ) Temperature ( C) Pressure (kpa) Dp ( C) or H (%) CO 2 (x10-6 ) 1 Enter the average value for each parameter measured during the calibration process 7

B3: CALIBRATION MEANS Table R5: Details of participant's mass standards used for the measurement including additional weights nominal mass (mg) + correction (µg) and volume or density Standard uncertainty Mass of standard mg µg µg Volume or density Mass of standard mg µg µg Volume or density Mass of standard mg µg µg Volume or density Mass of standard mg µg µg Volume or density Mass of standard mg µg µg Volume or density Mass of standard mg µg µg Volume or density Mass of standard mg µg µg Volume or density Mass of standard mg µg µg Volume or density Table R6: Enter details of the weighing scheme used (i.e. direct comparison or subdivision) 8

Table R7: Mass comparator(s) used Manufacturer Type Resolution Standard deviation of repeatability/reproducibility of the result of one comparison process mg degrees of freedom: Manufacturer Type Resolution Standard deviation of repeatability/reproducibility of the result of one comparison process mg degrees of freedom: Manufacturer Type Resolution Standard deviation of repeatability/reproducibility of the result of one comparison process mg degrees of freedom: 9