Report #1 i-stat ctni Performance Verification vs. J&J Vitros ECi i-stat Corporation - 1 -
Summary of Evaluation Study Results Correlation Slope Note 1 with comparative assay for [ctni]<3.0 ng/ml 1.19 Critical Decision Levels (Cut-offs): Current hospital [ctni] cutoffs for myocardial infarction: Cut-off at hospital, using the Vitros ECI Equivalent cut-off on the i-stat System 0.4 ng/ml 0.5 ng/ml Concordance Note 2 with comparative assay Vitros ECI 96% at current hospital cut-off and equivalent i-stat cut-off Imprecision Note3 in control fluids observed at hospital 5.7% Note 1-3 Please see Notes 1 through 3, on pages 4 and 5. The reader is encouraged to review the attached documentation carefully as it contains important information concerning the interpretation, relevance, and use of the results summarized above. i-stat Corporation - 2 -
Method Comparison Data Correlation results for [ctni] <3.0 ng/ml (based on the Vitros ECI values) are plotted below. Regression statistics are summarised in the following table. Corresponding data for the entire data set are summarised on the following page. Discordant points (open circles) were not included in calculation of slopes so as not to distort the inherent correlation representing the bulk of samples. Discordant points may be due to samples that were obtained >48 hours after patient presentation and that contained degradation products 1 and/or differences in antibody specificity between the two assays. Only the first replicates for each data pair were used in the plots and calculations. i-stat vs Vitros ECI All results [ctni] < 3.0 ng/ml 4.00 3.50 3.00 i-stat ctni 2.50 2.00 1.50 1.00 0.50 0.00 0.00 1.00 2.00 3.00 4.00 Vitros ECI ctni n Sxx Syy Slope Deming Intercept r 45 0.013 0.095 1.19 0.048 0.96 i-stat Corporation - 3 -
25 i-stat vs Vitros ECI All results 20 i-stat ctni 15 10 5 0 0 5 10 15 20 25 Vitros ECI ctni n Sxx Syy Slope Deming Intercept r 57 0.031 0.310 0.99 0.118 0.98 i-stat Corporation - 4 -
Interpretation and Relevance of Reported Statistics 1. Correlation slopes for troponin assays from different manufacturers are rarely unity; this stems from the lack of a gold standard reference material and consequent differences in calibration from one manufacturer to another. Consequently, differences in result do not imply that one assay is correct and another errant. (Note: See the listed references 2,3 for typical inter-assay correlations.) The correlation slope reported here is that calculated for [ctni] < 3.0 ng/ml; this range was chosen so as to provide the best estimate of the slope in the range where critical decision levels are established by clinicians. Each clinical environment should confirm the reference range and the suitable critical decision levels in their specific setting. 5,6 Where the user wishes to establish i-stat ctni concentrations equivalent to existing comparative assay decision levels, these may be estimated by multiplying the latter by the correlation slope: [i-stat ctni] = Slope * [Comparative Assay ctni] 2. Concordance is defined as the frequency with which two assays agree in answering the question: Is the analyte concentration above or below a specific decision level? for a specific set of data (generally comprised of a specimen population typical of ED presentations with chest pain). Typical values of concordance in commercial ctni assays are 91 to 95%. 2,3 The concordance reported here was calculated from the method comparison data acquired during this study utilizing the current hospital cut-off for [ctni] abnormality and the equivalent cut-off value for the i-stat System. [See Critical Decision Levels (Cut-offs) on page 1 and the 2 2 Contingency Table below.] 2 2 Contingency Table (Concordance Table) Comparative Assay (Cut-off = 0.4 ng/ml) Positive Negative i-stat ctni (Equiv. Cut-off = 0.5 ng/ml) Positive 53 4 Negative 1 54 Concordance (%) = [53] + [54] 100 = 96% [53] + [4] + [1] + [54] i-stat Corporation - 5 -
3. Low-End Imprecision was established for the i-stat ctni test cartridge via in-house experiments. The plot of [ctni] vs. %CV was included in the 510(k) submission (see plot below). Each of 12 low level spiked samples (ITC, HyTest TM, Finland) were prepared and assayed by running simultaneously with three lots of i-stat ctni test cartridges on 18 i-stat 1 handheld analyzers. Whole blood employed in the experiment was drawn from 4 healthy donors. The imprecision (%CV) as a function of ctni concentration is illustrated in the following figure. i-stat Method Imprecision vs ctni Level 35 30 25 20 %CV 15 10 5 0 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 [ctni] (ng/ml) The efficient execution of site evaluation studies necessitates the stockpiling of patient samples as frozen plasmas for method correlation. Samples comprised of freeze-thawed plasmas are subject to artifactual changes that may affect absolute results 4 and precision in various ctni assays. Imprecision estimated from measurements in these sample types is therefore not expected to be representative of imprecision observed in the intended sample type, i.e. freshly drawn whole blood as used in the plot above. If on-site measurement of whole blood imprecision is desired, a whole blood protocol similar to the one used in the 510(k) analytical studies will be required. i-stat Corporation - 6 -
Reliable estimates of the i-stat ctni assay imprecision may be had in the following sources: Control fluids at hospital (i-stat) 5.7% Control fluids, factory lot calibration (i-stat) a 6.0% Fresh Whole Blood/Plasma, factory lot calibration (i-stat) b 6.9% Fresh Whole Blood/Plasma, previous clinical studies (i-stat) c 6.9% a Control fluids, factory lot calibration (i-stat) this is the total imprecision of a minimum of 24 cartridges per lot for 14 lots of i-stat ctni test cartridges pooled over 3 control levels and spanning 42 i-stat-1 handheld analyzers. b Fresh Whole Blood/Plasma, factory lot calibration (i-stat) this is the pooled withinsample imprecision of whole bloods and plasmas spiked with ctni (as ITC, HyTest TM, Finland). The calculated value spans 196 spiked whole bloods and plasmas (0.05 ng/ml < [ctni] < 45 ng/ml, N = 6 i-stat ctni test cartridges per fluid), 14 lots of i-stat ctni test cartridges, and 42 i-stat-1 handheld analyzers. c Fresh Whole Blood/Plasma, previous clinical studies (i-stat) this is the pooled within-sample imprecision for patient specimens exhibiting [ctni] > 0.2 ng/ml and being comprised of 189 whole blood samples and 189 plasma samples (N = 6 i-stat ctni test cartridges per fluid); results were generated using 6 lots of i-stat ctni test cartridges and 18 i-stat-1 handheld analyzers at 3 clinical sites at which data for the 510(k) submission were acquired. Imprecision associated with frozen-thawed plasma samples at the evaluation site (see discussion page 5) were estimated as: Frozen-thawed plasma, d (i-stat) 14.3% Frozen-thawed plasma, d (Vitros ECI) 2.3% d Frozen-thawed sample imprecision from method comparison in the current evaluation The imprecision reported here is pooled over all pairwise points for which [ctni] > 0.08 ng/ml (upper 99 th percentile of reference range for the i-stat ctni assay). i-stat Lot Numbers ctni Test Cartridges: S03281 Controls & Cal. Ver. Level 1: M30381 Level 2: M30382 Level 3: M30383 Software: JAMS113/CLEW G93 i-stat Corporation - 7 -
References 1. D. Atar, L.H. Madsen, R. Labugger, J.E. VanEyk. Molecular modifications of troponin I and T detected in serum from patients with acute myocardial infarction [Article in Danish]; Ugeskr Laeger, 165:2, 116-120 (2003) 2. D. Uettwiller-Geiger et al. Multicenter Evaluation of an Automated Assay for Troponin I; Clinical Chemistry, 48:6, 869-876 (2002). 3. F.A. Apple et al. Multicenter Clinical and Analytical Evaluation of the AsSYM Troponin-I Immunoassay to Assist in the Diagnosis of Myocardial Infarction; Clinical Chemistry, 45:2, 206-212 (1999). 4. P.O. Collinson et al., Measurement of cardiac troponins, Ann. Clin. Biochem. 38, 423-449 (2001). 5. The Joint European Society of Cardiology/American College of Cardiology Committee; Myocardial infarction redefined - A consensus document of The Joint European Society of Cardiology/American College of Cardiology Committee for the Redefinition of Myocardial Infarction, Eur. Heart J., 21:18, 1502-1513 (2000). 6. i-stat ctni Cartridge and Test Information Sheet (copy attached). i-stat Corporation - 8 -
Raw Data Method Comparison Sample Compara Compara tive #1 tive # 2 i-stat #1 i-stat #2 1 0.27 0.28 0.42 0.40 2 8.38 8.36 9.67 10.29 3 6.12 6.25 6.39 8.09 4 1.20 1.21 0.91 0.81 5 0.59 0.60 0.81 0.76 6 0.00 0.00 0.00 0.00 7 0.00 0.00 0.00 0.00 8 0.03 0.02 0.00 0.00 9 0.00 0.00 0.00 0.00 10 0.00 0.00 0.00 0.00 11 0.00 0.00 0.05 0.00 12 0.00 0.00 0.00 0.00 13 0.00 0.00 0.00 0.03 14 0.00 0.00 0.01 0.00 15 9.23 9.26 6.10 5.61 16 23.00 22.80 19.92 20.54 17 0.47 0.45 0.54 0.69 18 1.70 1.71 1.68 1.60 19 0.00 0.01 0.00 0.00 20 0.01 0.01 0.00 0.00 21 0.00 0.00 0.00 0.00 22 0.48 0.48 0.74 0.65 23 3.19 3.11 3.15 2.39 24 0.33 0.36 0.00 0.00 25 0.01 0.00 0.00 0.00 26 0.25 0.27 0.12 0.29 27 0.04 0.05 0.08 0.08 28 0.82 0.80 1.12 1.04 29 1.12 1.03 1.69 2.05 30 0.49 0.46 0.47 0.71 31 2.42 2.37 2.53 2.39 32 1.64 1.64 2.16 2.10 33 0.52 0.51 0.57 0.65 34 0.02 0.02 0.00 0.00 35 0.04 0.05 0.19 0.18 36 0.00 0.00 0.00 0.00 37 4.62 4.67 4.68 5.05 38 2.91 2.92 3.78 3.46 39 11.50 11.50 12.63 40 3.23 3.17 3.15 3.44 41 21.90 21.90 23.69 21.67 42 8.87 8.74 11.06 12.05 43 NR NR 7.48 7.05 44 3.71 3.64 7.76 7.75 45 0.00 0.00 0.00 0.00 46 NR NR 0.01 0.00 47 NR NR 0.00 0.00 48 NR NR 21.66 20.35 49 NR NR 10.28 11.34 50 1.20 1.24 1.32 1.36 51 0.45 0.43 1.10 1.02 52 0.27 0.27 1.38 1.45 i-stat Corporation - 9 -
53 0.16 0.14 0.96 0.85 54 0.48 0.48 1.05 1.01 55 5.10 5.05 7.50 56 2.71 2.71 3.30 2.69 57 0.00 0.00 0.00 0.00 58 0.00 0.00 0.00 0.00 59 0.00 0.00 0.00 0.00 60 0.02 0.03 0.00 0.00 61 0.00 0.00 0.00 0.00 62 0.00 0.00 0.00 0.00 Raw Data Imprecision Sample ID Level 1 Level 2 Level 3 1 0.62 2.75 31.42 2 0.60 2.75 34.19 3 0.58 2.64 33.51 4 0.59 2.64 30.71 5 0.59 2.54 33.12 6 0.63 2.46 31.01 7 0.61 2.30 35.99 8 0.54 2.59 32.97 9 0.54 2.49 35.58 10 0.57 2.51 32.53 11 0.57 2.88 32.79 12 0.59 2.25 33.20 13 0.60 2.46 34.24 14 0.62 2.35 31.21 15 0.56 2.40 32.43 16 0.64 2.70 32.16 17 0.64 2.64 30.54 18 0.60 2.62 33.98 19 0.60 2.61 36.42 20 0.57 2.27 31.55 n 20 20 20 mean 0.59 2.54 32.98 sd 0.03 0.17 1.71 %CV 4.9% 6.7% 5.2% Calibration Verification Run Level 1 Level 2 Level 3 1 0.57 2.53 37.39 2 0.65 2.58 33.88 3 0.56 2.54 39.11 mean 0.59 2.55 36.79 target range 0.41-0.75 1.75-3.25 21.4-40.0 i-stat Corporation - 10 -