7 th FSCC Interlaboratory Comparison Nathalie Cools Meeting heads of the laboratories September 2013, Zadar, Croatia

Transcription

1 7 th FSCC Interlaboratory Comparison Nathalie Cools Meeting heads of the laboratories September 2013, Zadar, Croatia 1

2 Presentation outline Main messages Introduction Background Time schedule Participation degree Financial overview Materials and methods Samples and homogeneity test Evaluation by the median value and tolerable limits Dealing with values below LOQ Results Overview successes/failures by i) variables ii) labs Comparison with RT6 Results of selected set of variables Requalification Discussion Improvements made? What are the problem variables? Lessons learned? Potential for improvement? Recommendations 2

3 Main messages 7 th FSCC ring test RT7(2012): 60% of participation degree compared to the past because of budgetary reasons To cover costs at least 34 labs are needed. RT7 only 30 labs. The comparability of ring test results did not improve compared to RT6. A number of problems which were already identified in the past persist: A number of labs do not use reference methods Too high LOQ values Reporting of 0 values Labs with poor results: New labs to interlaboratory comparison programme BUT also labs that already participated in many FSCC ring tests Or labs that participated in helping programme of WG on QAQC in the labs 3

4 7 th FSCC RT 2012: Background Originally planned in EC Life+ EnForMon project in th FSCC RT foreseen in 2015 EnForMon not granted so RT funded by registration fees of labs (650 /lab) Evaluation method: based on the median value (cfr. foliar & water ring tests) and its tolerable ranges (same as 6 th FSCC RT) Agreed at FSEPM: 1 sample with CaCO 3 content between 10 20% => sample B CaCO 3 content of 6.3 % 1 mineral topsoil sample with OC of few percentages => sample B OC content of 5.2 %

5 Time schedule Task Informing the participating labs by & ICP Forests website Deadline June, 15 th 2012 Online registration of the participants September,7 th 2012 Distribution of test samples & invoice for registration fee Payment of registration fee September, 14 th 2012 Before data submission Data submission by the labs October - December 2012 Deadline of data submission (cfr. Foliar) December 31 st, 2012 First results January 2013 Re-qualification process starts February 2013 Discussion of the results Ljubljana, April 2013 Zadar, September 2013 Re-qualification process finishes October 1 st,

6 Response: participating laboratories N of labs N countries Registered by 7 th of September Late registration (1 FI, 1 DE) 2 2 Cancellations before sending of sample (LV, CY) Cancellations after receiving the samples (DE) Payments Results in the evaluation of the median value Compared to previous FSCC RTs very lower degree of participation: previously always 7 50 labs N countries: Note that only ICP Forests labs were given access to this ring test! 1 6

7 Reasons for no participation Labs did not participate because: Restricted lab budget (Norway, Cyprus, Portugal) No national budget for monitoring (Latvia, Hungarian Forest Research Institute) Lack of co-funding at international level (Hungary) No possibility to apply the required reference methods (Croatia) If soil samples are to be analysed, it will be contracted to other labs (Greece) One lab cancelled because of movement/reorganisation of the lab (Germany) No sufficient qualified staff to conduct analysis (Turkey) 7

8 Financial overview Income Registration fees (30 * 650 euro) Expenses Homogeneity tests 9100 Web interface & evaluation of median by BFW, Austria Balance Conclusions: To cover costs: registration fees of 34 lab required though only 30 Personnel costs cover preparation, evaluation, communication, presentation of results, no travel costs to meeting 1900 Packing material for the samples 330 Distribution of the samples by air mail 1200 Personnel cost of scientist (22 days * 320 ) 7040 Personnel cost of technician (10 days * )

9 Sample Matrix Location Textur e Samples Depth/ horizon Tree species Soil type A Min. Germany SiL cm Spruce Podsolige Parabraunerde Podzolic Luvisol B Min. Austria SiC Calcareous C Min. Belgium S Ap Scots pine Albic Hypoluvic Arenosol D Peat Ireland Peat E Forest floor Belgium OL & OF Oak Dredged land-fill E C 9

10 Homogeneity tests 5 ring test samples (A, B, C, D and E) 8 subsamples (1 subsamples = 300 g) 4 measurements on each subsample Aqua regia extractable elements Total N, Total C (either TOC or LOI) Variation between subsamples and within subsamples was compared Total Modified N (g kg -1 ): Sampl e Mean St.dev. Min Max CV (%) % within subsampl e % between subsample s A B C D E

11 Dealing with values < LOQ Important for exchangeable elements, CaCO 3, Cd, Hg, If value < LOQ lab => labs report < LOQ lab The LOQ lab was checked against: max. allowable LOQ (LOQ max ) If LOQ lab > LOQ max => reject results If LOQ lab < LOQ max => result accepted if LOQ lab within tolerable range of median value If median value LOQ gen the variable could not be quantified reliably no tolerable range could be calculated results were accepted 11

12 Maximum LOQ values Parameter Method Unit Max. LOQ ph(cacl2), ph(h2o) CaCl2 - Organic carbon - g/kg 2 Total N - 1 (Org.); 0.2 (Min.) CaCO3 HCl 5 Particle size: clay, silt, sand - %wt 1 Extractable P, Al, Fe, S 50 Extracted Ca, K, Na 100 Extracted Mg 70 Extracted Mn 8 Extracted Cu Aqua regia mg/kg 2 Extracted Cd 1 Extracted Pb 5 Extracted Zn 4 Extracted Cr, Ni 3 Extracted Hg 0.1 Free H+, exchangeable acidity cmol+/ 0.25 Exchangeable Ca, Mg, K, Na, Al, BaCl2 kg soil Fe, Mn 0.1 Total Al, Fe 50 Total Ca, K, Na HF or Lithium 100 Total Mg metaborate 70 mg/kg Total Mn 8 Reactive Al, Fe Acid ammonium oxalate

13 Variable Clay 26 Sand 26 Silt 26 ph-cacl 2 30 ph-h 2 O 26 CaCO 3 27 OC, TotN 29 Exchangeable elements (M) Acidity, Na 29 Al 29 Ca 30 Fe 29 K 29 Mg 30 Mn 29 Free H+ 27 Total elements (O) Al, Mg 8 Ca 8 Fe 9 with results in 7 th FSCC RT If K, response Mn, Na is less, 9 usually optional variables. Variable Aqua regia extractable macronutrients (mandatory in mineral soil) P 26 Ca 28 K 27 Mg 28 Mn 28 Heavy metals (mandatory in min and org samples) Cu 28 Pb 26 Cd 26 Zn 28 Metals - micronutrients (optional) Al 24 Fe 25 Cr 24 Ni 25 S 22 Hg 13 Na 22 Acid oxalate extractable Al and Fe (M) Al 23 Fe 24 Of the mandatory variables, acid oxalate extractable Fe and Al is still the least popular 13

14 with successful/failed results in 7 th FSCC RT 14

15 with successful/failed results in 7 th FSCC RT M (mineral) M (mineral and organic) Optional Aqua regia extractable Reactive 15

16 Number of successful/failed variables for each lab 16

17 Results RT RT6 2009! Evaluation method changed (General cleaned mean compared to Median) Tolerable limits remained the same ph, OC, Tot N: +/- similar Clay: lower % of labs excluded Sand and silt: +/- similar CaCO 3 : more failures 17

18 ph-cacl 2 Quantifiable in all samples Range: +/- 5 % Sample reported successful % labs failed CV (%) A B C D E Conclusions 1 lab did not measure ph-cacl 2 on both organic samples (although M) 1 lab failed on 3 of 5 samples, so has to requalify for ph-cacl 2 Note: Sample E: ph-cacl 2 = 5.5 & CaCO 3 analyses necessary >

19 ph-h 2 O Quantifiable in all samples Range: +/- 5 % Sample reported successful % labs failed CV (%) A B C D E Optional parameter: not reported by 4 6 labs 1 lab failed on 4 out of 5 samples and has to requalify 19

20 Particle size distribution Conc. low range Conc. high range Silt > > Sand > > Clay > > Max. LOQ = 1 %, all LOQs above reported successful % labs failed CV (%) A Silt B Silt C Silt A Sand B Sand C Sand A Clay B Clay C Clay

21 Carbonates Quantifiable in sample B and E (LOQ gen = 3 g.kg -1 ) 70% labs successful on 1 sample ranges (%): CaCO Sampl 3 e Conc. low rang e reported Conc. high range > > successful LOQ > 5 % labs failed A B C D E Conclusions: 3 labs did not conduct Man. analysis and 16 did not analyse the org. sample with ph-cacl 2 = labs with LOQ above LOQ max 5 labs between 5 15 % recovery: reported in % instead of g.kg -1? Other conversion errors e.g. C-CaCO 3? 21

22 Methodological differences in texture analysis Removal of compounds Determination Answers from 26 labs: 10 labs did not remove the OC/carbonates before texture analysis 3 labs were obviously not using the reference method 4 labs might have used hydrometer or pipette (gravimetry) 4 labs did not report the determination method 22

23 Organic carbon Quantifiable in all samples N o labs LOQ > LOQ max = 2 ranges (%): Conc. low Sampl e rang e Conc. high reported range OC > > successful % labs failed CV (%) A B C D E Sample A and C in low concentration range but more failures in Sample C => Due to sandy nature of sample C juxtaposition Though also high number of failures on sample B One lab failed on 4 of 5 samples => requalification needed 23

24 Total N All quantifiable; 2 in low range and 3 in high range ranges (%): Sampl e Conc. low rang e reported Conc. high range N > > successful More failures for organic compared to mineral samples % labs failed CV (%) A B C D E Tolerable limit for high conc. range (so for the organic samples) is ambitious but should be feasible 24

25 RT7 not better than RT6 Exchangeable elements Exch. Mn: 3 of 5 samples LOQ general so no reliable median value could be calculated 25

26 Exchangeable acidity Present in quantifiable amounts in 4 samples (LOQ = 0.1 cmol (+).kg -1 ) 83 % labs successful on at least 3 of 5 samples Sampl e Conc. low range reported Conc. high successful Range Acidity > > LOQ > 0.25 % labs failed CV (%) A B C D E Conclusions: Most labs face problems in forest floor sample High CV in calcareous samples B and E 26

27 Free H + sample B close to LOQ =0.1 cmol (+).kg % labs successful on at least 3 of 5 samples range +/- 100 % Sample Conclusions reported successful 3 5 labs did not report free H + < LOQ LOQ > 0.25 % labs failed CV (%) A B C D E Report of conc. < LOQ: provide your LOQ in stead of reporting nothing or 0 Extremely high CVs! 27

28 Reported methods for Exchangeable Acidity and free H + in RT7 29 labs reported exchangeable acidity and 27 Free H + Unclear reporting of methods. It should be: Pretreatment = single BaCl 2 extraction Determination: Either potentiometric titration (ISO 14254, 1994 though single extraction) Either German method by calculation (König et al. 2005) Not accepted! Not accepted! The same? 28 Or could it also refer to the titration?

29 Exchangeable Al Quantifiable in 3 of 5 samples 93 % labs successful on at least 3 of 5 samples Samp le Conc. low Conclusions: rang e reported Conc. high range Al > > successful below LOQ LOQ > 0.1 % labs failed CV (%) A B C D E Report of conc. < LOQ: provide your LOQ in stead of reporting nothing or 0 values Very high CV in calcareous sample and forest floor sample: close to LOQ 29

30 Exchangeable Fe Not quantifiable in 2 samples (LOQ = 0.02 cmol (+).kg -1 ) 93 % labs successful on at least 3 of 5 samples rang e Sampl e Conc. low limit reported Conc. high limit Fe > > successful < LOQ LOQ > 0.1 Extremely large CV in calcareous sample and forest floor % labs failed CV (%) A B C D E

31 Exchangeable Mn Not quantifiable in mineral samples when reporting up to two decimals (LOQ = 0.02 cmol (+).kg -1 ) 100 % labs successful on at least 3 of 5 samples rang e Sampl e Conc. low limit reported Conc. high limit Mn > > successful below LOQ % labs failed CV (%) A B C D E Conclusions: High CV in mineral samples (close to or below LOQ) High number of failures in organic samples Additional problem: only requested to report up to two decimals Recommendation: increase reporting requirement to 3 decimal places 31

32 Exchangeable Ca Quantifiable in all samples; close to LOQ = 0.03 cmol (+).kg -1 in sample A 67 % labs successful on at least 3 of 5 samples Sampl e Conc. low rang e reported Conc. high range Ca > > successful < LOQ High number of labs excluded in organic samples (high CVs) ranges too narrow for the organic matrix? % labs failed CV (%) A B C D E Method suitable for organic samples? E.g. recommended sample weight now equal for min. as for org. samples (2.5 g). In literature only 0.5 g for org. 32

33 Exchangeable K Quantifiable in all samples Close to LOQ = 0.03 in sample A & C 90 % labs successful on at least 3 of 5 samples Sampl e Conc. low rang e reported Conc. high range K > > successfu l < LOQ High number of labs excluded in organic samples (CV = %) ranges too narrow for organic samples? LOQ > 0.1 % labs failed CV (%) A B C D E Method suitable for organic samples? E.g. recommended sample weight now equal for min. as for org. samples (2.5 g). In literature only 0.5 g for org. 33

34 Exchangeable Mg Quantifiable in all samples Close to LOQ = 0.03 in sample A 77 % labs successful (on at least 3 of 5 samples) Sample Conc. low rang e reported Conc. high range Mg > > successful < LOQ LOQ > 0.1 High number of labs excluded in organic samples (CV = %) ranges too narrow for high range in organic samples % labs failed CV (%) A B C D E Method suitable for organic samples? E.g. recommended sample weight now equal for min. as for org. samples (2.5 g). In literature only 0.5 g for org. 34

35 Exchangeable Na Quantifiable in Org. sample but close or LOQ = 0.03 in min. samples 83 % labs successful on at least 3 of 5 samples Range: +/- 80 % Sampl e reported successful below LOQ LOQ > 0.1 % labs failed CV (%) A B C D E Conclusions: CVs remain all high 1 lab with too high LOQ for both organic and mineral samples Other labs failed because of too high recovery (> 200 %) 35

36 Exchangeable basic cations Ca, Mg, K and Na Quantifiable in all samples though Na close to LOQ in samples A and C CV s range from 13 till 52% in order K < Mg < Ca < Na CV s (except for Na) higher in organic compared to mineral samples % of failed labs (except for Na) higher in organic sample compared to mineral Tolerable limits (20% for K and Mg and 30% for Ca) too severe for the high concentration ranges in the organic samples? 1 lab reported LOQ lab > LOQ gen 36

37 Aqua regia extractable elements Most elements: improvement compared to RT6 K, Mg and Cd: results are worse compared to RT6 Mandatory in organic Optional Mandatory 37

38 Aqua regia extractable macronutrients Concentration (g.kg -1 ) Sample C: poor sandy soil with few nutrients but still above LOQ Often higher CVs when concentration was low Phosphorus: 6 labs failed on peat sample (D) A B C E D 38

39 Aqua regia extractable heavy metals Cu, Cd, Pb, Zn Results are better compared to RT6 Except Cd: 3 sample below LOQ gen (0.5 ppm) 2 samples slightly above LOQ gen So due to nature of samples Sample A: highest CV of all aqua regia extractable elements A B C D E 39

40 Aqua regia optional variables A B C D E 40

41 Total and reactive elements Total elements: difficult to compare with previous ring tests due to low number of labs that reported results 41

42 Reactive Al & Fe Quantifiable in all samples Conc. low range Conc. high range Al > > Fe > Sampl e reported successful 1 lab failed for all samples (both Al & Fe) LOQ > 100 % labs failed CV (%) Al Fe Al Fe Al Fe Al Fe Al Fe A B C D E Many labs too high recovery in sample B (calcareous) 42

43 Discussion: Improvements made? Distribution of labs according to percentage of failed variables in 2009 vs In RT7 there are less successful labs (no failed variables) compared to RT6 % of labs with 10 % failed variables and classes > 20% increased and % labs between % decreased Overall 11.4 % of the lab/variable combinations failed in RT7 compared to 11.2% in RT6 So no improvement compared to previous ring test 43

44 Evolution of CVs between Time FSCC Interlaboratory Comparison Evolution of coefficients of variation (%) 44

45 Requalification Requalification between Feb and Sept 2013 (so still on-going) In total 113 failed lab-parameter combinations By received answers for 46 failed combinations (41 %) Date Lab ID N failed variables N variables feedback N variables requalified Requalification report ready for download S H S open S H F H F No requalification needed A OC & N missing F Exch. Acidity missing F07 4 (+ 2) 6 6 H S H F H A H 45

46 Reasons for failures 46

47 Recommendations to improve results Carbonates Report in correct units g.kg -1 Make sure carbonates are reported (not Carbon)! Analyse carbonates when ph-cacl 2 > 5.5 Otherwise report < LOQ (but never 0 values) If not analysed: leave data field empty Particle size distribution Use reference method = pipette Do pretreatment properly: remove OC, carbonates, salts Correct for inorganic carbon in calcareous samples Exchangeable elements Use single BaCl 2 extraction Can the method be improved, especially in organic samples? e.g. lower sample weight in organic samples (0.5 g in stead of 2.5 g) Do not report Free H +, exch. Acidity, acid exch. cations (Al, Fe, Mn) on calcareous samples (report < LOQ value) Organic carbon in non-homogeneous natural samples (e.g. sandy Sample C) Increase homogeneity by further grinding Increase sample weight if instrument allows Increase number of replicates to obtain more reliable estimate 47

48 Recommendations to improve results Aqua regia (HCl/HNO 3 ) extractable elements: Still some labs used different extracts Reference = reflux no microwave digestion Labs with too high LOQ need to look for reasons for this high LOQ to lower it. Please take care of reporting the applied methods properly. FSCC can help by providing the correct codes for the reference methods described in the manual. FSCC is aware that success/failure or progress/poor results can be due to the nature of the sample. In this regard, a ring tests with less samples is not an option. One lab recommended to provide more sample material. For sake of comparability, FSCC prefers not to change the tolerable limits for the moment. Further we do not see the need as % of failed labs did not improve. The exchangeable Mn needs to be reported with 3 decimals (cmol +.kg -1 ) in order calculate reliable median value 48

49 How to report results of FSCC Interlaboratory comparison in LQA form? Part of LQA form contains information from the qualification report Column Description Format Ref_Ta Item # b 74 Participated at Ring Test (yes = 1, no = 0) I 1 (180) ICP Forests Ring Test Number C 3 (180) ID of laboratory (e.g. H45, B78, etc.) C 3 (180) Percentage [%] of the results of the ring I 3 (180) tests within tolerable limits for each ring test NC1 88 Requalification information (yes = 1, no = 0) I 1 (180) Percentage [%] of the results of the ring tests within tolerable limits for each ring test I 3 (180) Download QA report from ring in test requalification website: 49

50 Folie 49 NC1 Should become an integer "I1" COOLS, Nathalie;

51 Exchangeable cations Based on ph values, Carbonate content, texture, matrix Expect that exchangeable acidity, free H + and acid cations will be low in sample B = calcareous sample But what do we expect in Sample E = forest floor sample? Are we able to measure these characteristics according to our needs? Is what we measure ecological relevant and necessary? 50