Long and Analysis Reports

Transcription

1 LONG REPORT FORMAT AND GRADING RUBRIC Long and Analysis Reports 8 Long and Analysis Report Format and Grading Rubrics Analsis Reports will be collected for the HPLC and Long Reports for the FAAS experiments. At instructor discretion, FAAS Reports will have 8 sections with the following weights: 1 Cover page 02 2 Abstract 13 3 Introduction 10 4 Experimental 10 5 Analysis, Results and Discussion 20 6 References and Scholarship 10 7 Figures and Tables 20 8 Appendix with calculations 15 Total 100 points Use this format for both reports. HPLC and FAAS Reports will have 4 sections with the following weights. See below for more detailed explanation of the sections. 1 Cover page 02 2 Abstract (reporting quant and qual results) 13 3 Analysis and Results Section 20 4 Figures and Tables 20 Calibration curves Retention maps Table of results 5 Appendix with calculations 15 Total 70 points 50

2 LONG REPORT FORMAT AND GRADING RUBRIC Each section will be scored according to both written expression and scientific content. The following criteria will be applied to the evaluation of written expression: Grade Level A B C D F English Composition Quality / per paragraph Clear, concise, and reflecting excellent understanding of subject. Clear, few superfluous words, reflecting good understanding of subject. Basic point is understandable, but reader must work to figure it out. Paragraphs makes at least one point amid superfluous words/sentences. Point very unclear or wording illogical. Grade Grammar Mistakes / Page or Section if section shorter than 1 page. A 0-1 B 2-4 C 5-7 D 8-11 F

3 LONG REPORT FORMAT AND GRADING RUBRIC Scientific content and format are summarized below: General remarks: 1. Standard deviations and confidence intervals based on small data sets have two significant figures not more. The last sig fig in the std dev is the last sig fig reported in the average or calculated answer. Example: 12.23±0.55 = correct 12.23±1.23 = incorrect! should be 12.2±1.2 (last digit = 0.1) 12.2±0.23 = incorrect! should be 12.23±0.23 (last digit = 0.01) 1. Cover page: 1.1. Title 1.2. Your name 1.3. Your partner s name 1.4. Course 1.5. Professor Terrill 1.6. Date Submitted The boxes below contain some key report elements that I use to score the reports! 2. Abstract: Very, very brief and clear summary of the experiments and results. In a few short sentences convey (a) what was done (measured) and (b) using what method (HPLC or FAAS) and (c) with what crucial conditions and (d) sample preparation and (d) the final results w/ estimated errors (σ and 95% CI) (c). If they were not included in the above, give those few crucial details (λ, stationary phase, mobile phase) that are critical to reproducing the work by an expert and (d) conclusions regarding null hypothesis and bias if possible Length: Approximately words Concise description of what was measured and how (method name) Results clearly summarized Zn amt ± error Fe amt ± error units of mg/can or mg/pill 2.4. If data quality support conclusions: Evidence of bias wrt validation? Evidence of bias wrt expected value? Evidence of bias from sample to sample? 2.5. Concise description of how measurements made w crucial details only: HPLC mobile / stationary phases detection limit / wavelength FAAS flame type (air / C 2 H 2 ) detection limit / wavelength 2.6. Negatives: Too much detail (raw signals, dilutions, etc.) Conversational tone or unnecessary words or phrases Speculation about results 52

4 LONG REPORT FORMAT AND GRADING RUBRIC 3. Introduction: The tone of an analytical chemistry report where the instrumental method is being developed to solve a particular problem is typically like this: Compound x is of interest because The instrumental method yyy is appropriate to this analysis because In these experiments x was measured (diet Coke / Centrum Silver ) with a vvv instrument using zzz conditions. The results were excellent/good/fair/poor (perhaps why) Length: Approximately words Very short description of the analytes what they are why they are there and why it is important to quantify them 3.3. Discussion of the instrumental method how the method works, focusing on the principles of the detection and/or separation e.g. the absorption of light by gas phase atomic analytes or the partitioning of analytes from a solution (mobile phase) to a stationary phase why it is appropriate to the problem of measuring this analyte in this matrix what aspects of this instrumental method make it sensitive or selective for the analytes of interest possible interferences / problems and how they are controlled or not description of experimental parameters that are important to this particular analysis, influence the performance of the instrument and why e.g. flame stoichiometry or mobile phase composition, wavelength etc. 4. Experimental Methods 4.1. Length: Approximately words Instruments and Materials: List the name and manufacturer of the instruments you used, e.g. Unicam 929 AA spectrometer Include the important instrument specific parameters column type (stationary phase) flame type, wavelengths etc Reagents used, including the water. It is acceptable to indicate that these were obtained from the SJSU Chemistry Service Center, but indicate the manufacturer and the purity where available (e.g. with the concentrated acids since they contain trace metal impurities). 5. Procedure: Sample, standard, validation, 5.1. Length: Approximately preparations. words. Keep it short. I don t need to know every step! Use tables! UV-Vis experiment (HPLC) 5.2. In this section, describe what you Implementation of HPLC flow rate, did in such a way that another pressure, injection volume, injection chemist could look at it and time, sample vials, injection order. reproduce your work. It is not a set of step-by-step instructions but rather a concise description of what you 53

5 LONG REPORT FORMAT AND GRADING RUBRIC actually did. For example: The calibration primary standard ( PPM) was prepared by dissolving g of Co metal in yy ml of HNO 3 (conc.), and diluting to L with distilled water. Validation standards were similarly prepared to yield two, 500mL solutions of qq and zz PPM The working standards were prepared by serial dilution of the standards in the following way The concentrations are listed in Table 1. The standard concentrations and signals will be tabulated in the results section see the below for details. Important experimental parameters used should be mentioned here. For example For the FAAS analysis, an Air-acetylene flame source, hollow cathode lamp radiation source and a wavelength of xxx.x nm were employed. A common mistake is to claim that your standards are 10 ppm when they are actually 10.1 because the primary calibration standard was based on 101 mg instead of Analysis, Results and Discussion: Describe the results of your measurements in words and figures Length: Approximately words Refer to the various numbered figures (spectra, chromatograms or graphs) and tables in turn and discuss the results. Where possible, you explain (a) why the results are what they are and (b) what they mean and (c) how you used them Note UV absorbance spectra of CF and BA and relevance to HPLC detection Note retention times for the HPLC experiment. UV-Vis results, calibration, linear regression and error calculations, problems in chromatogram or with spectrometer, Sample-sample variation versus standard deviation estimate based on calibration curve. Agreement with expectation is difference between expected value and measured value larger than the standard deviation (sample and validation results)? What does this mean? Comments on chromatogram elution order, resolution etc Make a table, following the below format, of absorbance and concentration values including the appropriate uncertainties for all of your samples, calibration and validation standards. I include an example for the FAAS experiment below: 54

6 LONG REPORT FORMAT AND GRADING RUBRIC For HPLC these are the peak integrals. Table 1: Absorbance Data: Fe concentrations and amounts. Abs ± std dev PPM prepared Blank ± Std ± Std ± Std ± Std ± Std ± There is usually no std dev on this number except for PE FAAS.. For the HPLC there is no validation (QC) standard, so skip this. Abs ± std dev PPM expected PPM calculated Validation ± ± ± Yes Validation ± ± ± No Δ% bias * For the HPLC you may have only one sample so thiese last two lines can be skipped.. mg. tab -1 expected mg. tab -1 calculated Sample ± ± ±2-16 Yes Sample ± ± ±3-22 Yes Smpl 1 to ± ± ±2 6 No For the HPLC did not do any spike recovery so this can be skipped.. mg from sample mg from spike total mg expected total mg found Spike Rec % Spike Rec. Fe 0.202± ± Yes Spike Rec. Zn 0.124± ± No Significant? I define bias here as the likelihood that the difference is too large to be due to random fluctuation i.e. the likelihood that the difference is real. To get this number, one calculates the t-value and uses the t-table to find the corresponding confidence interval. Please note that the bias * result is either yes or no. If the t CALC is > than the t TABLE at the specified (95%) confidence level, then there is evidence of bias. Distinguish here between expected concentrations, based on the vitamin pill label or the Diet Coke manufacturer specification, measured concentrations, based on your calibration curve and the instrument signal, and standard or prepared concentrations based on mass and dilution of standards that you prepared. Note in this section if any of the calibration data were thrown out! Note whether the validation data were in agreement with the calibration or not. According to the validation standards, how accurate are the results? 55

7 LONG REPORT FORMAT AND GRADING RUBRIC 6.6. Make a calibration graph from your analyte absorbance values as illustrated below Preferably on a separate page All the points are shown, including: the regression line, validations, the sample absorbance is indicated with a horizontal line intersecting the calibration line the uncertainty of the sample absorbance (if known) is indicated by two parallel lines drawn at the sample absorbance plus and minus the standard deviation in the sample absorbance. Your experimental uncertainty may be too small to do this graphically, but it illustrates nicely the way that the uncertainty in the sample absorbance propagates into an uncertainty in the sample concentration. You may be able to address the question of whether this instrumental method is suitable in terms of detection limit for the given analysis 6.7. [Not required for Analysis Format] Discuss the least-squares (linear regression) analysis. Note that this implies that you are fitting the data to a model, e.g. A = m*c[ppm] + Sb. Report the best-fit sensitivity, m, and blank signal, Sb and their respective uncertainties. Put the actual regression and propagation of error calculations in the appendix [If validation and sample data are available] Discuss the tests for bias between validation and expectation, sample and expectation and samplesample. This is a simple conversation Do not forget to list the final results of the analysis here. This means the amount of the analyte that is in a meaningful amount (e.g. a serving) of the original sample, e.g. 4 grams of spinach or 12 ounces of diet coke. Compare this value to what is expected for this product Make it clear that you understand the results. Discuss the relative value of the validation versus random errors. Do sample-to-sample variations swamp the calculated standard deviations and if so, what does this mean? For the HPLC report, discuss the gradient separations as indicated on the printout References: List the references here that correspond to the numbered citations in the text. Just like you were taught in 100W. References must be archival sources, that is, no web URL s without my explicit permission. NIST may be the only exception I make. 56

8 LONG REPORT FORMAT AND GRADING RUBRIC 7. List of References: Cite the source(s) of information (total citations anticipated: 4-8 and may include your textbook. Use the ACS Analytical Chemistry format the analytical method (FAAS or HPLC) and 7.2. the importance of measuring, e.g. caffeine content and 7.3. articles or book information on how to measure, e.g. Fe using FAAS All references included should be cited in the paper One web URL, if I let you use it, must be archival in quality, reputable and cited according to ACS guidelines (see 100W format). 8. Tables and Figures: Put the titled and numbered tables and figures together, in order immediately following the references. Figures should have a numbered figure caption. Mainly, this is a place to summarize the results. Please only put here the figures and tables that you produce, not the ones that the instrument makes. Finally, every figure that you put here should be referred to in the text. All figures must be clearly labeled. Avoid dark backgrounds and unnecessary information. Neat hand work on figures is perfectly acceptable Primary Calibration Standards First Validation Standard Second Validation Standard Digested Spinach Sample Absorbance Mg Concentration [PPM] Figure 2. Calibration plot for FAAS absorbance of magnesium vs. standard concentration in ppm. Sample absorbance and standard deviaton is noted as a horizontal line with dashed lines at ±1 standard deviatons. Validation points (triangle and square) are plotted versus their prepared concentrations. Vertical displacement from the calibration line indicates systematic error. 57

9 LONG REPORT FORMAT AND GRADING RUBRIC 9. Appendix: Put your calculations here. Neat handwork is fine but I expect to see samples of all the important calculations that you performed. If you used a computer program (e.g. Microsoft Excel ) please print out a report from the program illustrating the results. I do not expect anyone to do the linear regression by hand! Some students like to use MathCad for this, and it is extremely efficient and transparent for this goal. 58

10 LONG REPORT FORMAT AND GRADING RUBRIC Diet coke injections: Reverse phase C18 column. Questions: 1. What elutes first, hydrophobic or hydrophilic components. 2. How many peaks can be fully resolved for each gradient? Why do they differ? 3. Which gradient resolves more components? 4. Which gradient elutes fastest? and why? Notes: Water phase is 0.1% H 3 PO 4 From bottom to top this water methanol gradient has increasing amounts of acetonitrile. HPLC 2 3/9/09 4:31:31 PM Roger Terrill Page 1 of 1 59

11 Math 9 Guide to Data Analysis: Long and Analysis Format Reports A major learning objective for this course is the successful and complete analysis of the data from a linear regression analysis. Our graduates consistently report that this skill, working with Excel in this way, was one of the most important things they learned in

12 THE OVERALL FLOW OF YOUR DATA ANALYSIS WILL BE THIS: 1. Plot calibration data in Excel or equivalent. 2. Get regression coefficients (slope and intercept of best fit calibration line). Use spreadsheet to calculate sums, products etc. 3. Calculate the concentrations of your samples and validations. 4. Calculate the standard deviation estimates of your sample and validation concentrations (details on that in the supplement Guidance for Using Excel for Regression Analysis in Report uses Skoog appendix a1c, equation a1-37) 5. Use the sample preparation procedure to calculate the amount (in mg) of analyte in your sample specimen (vitamin tablet or can of coke, details below). 6. Use the error propagation rules to calculate the standard deviations in mg of analyte in your sample specimen. See Skoog appendix a1b Use the t-test to evaluate the difference between the expected and measured values. See guidance below. The following two pages contain printouts of a calibration curve analysis of the HPLC data from a previous lab. The first page displays the numbers, with experimental data in the gray, shaded area. The second page displays the formulae used to calculate the results. Please use this as an example for the creation of a spreadsheet of your own that you will use to analyze the data in your homework sets (as applicable) as well as your two principle lab reports (HPLC and FAAS) analyses. While Excel will perform linear regression and give you the slope and intercept of the line that best fits your data, it will not give you the errors in the coefficients or sufficient data to do an error analysis of a predicted value that you may derive from using the (linear) calibration curve coefficients. The worksheet uses formulae identical to those found in Skoog Appendix A, and these have been shown to work with one exception! In the 5 th edition, there is a mistake in In Appendix 1, A- 19: The least squares slope of a line is incorrectly given as: m = S xx / S yy This should read: m = S xy / S xx 61

13 NOTES ON USING EXCEL: If you want a cell to contain a formula that is, the result of a calculation based on other cell s data then you must enter the formula starting with =. It you use the Excel toolbar button, for example, to enter a sum (Σ), then the = will be entered for you. If the result that you get is important, and will be used in other calculations, you can name that cell, and it s result. So, in doing this spreadsheet, I named the calculations the same way that Skoog did in appendix A, with names like S XX and S XY etc. That way, I can enter the name of the cell in later calculations, rather than the cell itself (e.g. C4). The advantage of this is twofold. First, the formulas are much clearer if they contain names as opposed to cell addresses like C4. Second, if the S XY cell moves (for example if you insert a row to add data), then C4 changes, but S XY does not! So your formula does not need to be changed if you reference a named cell. To name a cell, simply single-click on the cell (so that the focus is on the cell, not to be editing in the cell, the result of a double-click on the cell). Then click on Insert Name Define and give the cell a name (like Sxy or m or slope or answer or concentration or whatever you prefer). 62

14 Benzoic Acid x - PPM y - Abs x-squared x-xavg y-yavg x-xavgsqr y-yavgsqr xy x-xavg*y-yavg yfit Experimental E E E E E E E E Data E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E sums => E E E E E E E E+01 averages => E E+01 N = 11 M = 1 Y_abs_unk E-01 Number of Calibration Pts Repetitions of Unknown Measurement Signal for Analyte Sxx E+02 Syy E+00 Sxy E+01 sr E-02 Numbers used to calculate slope, intercept and standard deviations. Slope = E-01 Sigmam E-03 Intercept = E-02 Sigmab E-02 Answers C = 5.74 ± sc = 1.37 Concentration of the unknown Estimate of the uncertainty in the concentration of the unknown propagation of errors: sc = 1.09 Estimate of the uncertainty in the concentration by error propagation 63

15 Benzoic Acid x - PPM y - Abs x-squared x-xavg y-yavg x-xavgsqr y-yavgsqr xy x-xavg*y-yavg Experimental0 0 =C4*C4 =C4-xavg =D4-yavg =F4*F4 =G4*G4 =C4*D4 =F4*G4 Data =C5*C5 =C5-xavg =D5-yavg =F5*F5 =G5*G5 =C5*D5 =F5*G =C6*C6 =C6-xavg =D6-yavg =F6*F6 =G6*G6 =C6*D6 =F6*G =C7*C7 =C7-xavg =D7-yavg =F7*F7 =G7*G7 =C7*D7 =F7*G7 sums => =SUM(C4:C7) =SUM(D4:D7) =SUM(E4:E7) =SUM(F4:F7) =SUM(G4:G7) =SUM(H4:H7) =SUM(I4:I7) =SUM(J4:J7) =SUM(K4:K7) averages => =AVERAGE(C4:C7) =AVERAGE(D4:D7) =AVERAGE(E4:E7) N = 4 M = 1 Y_abs_unk Number of Calibr Repetitions of U Signal for Ana Sxx =Sxx Syy =Syy Sxy =Sxy sr =SQRT((Syy-(m*m*Sxx))/N-2) Numbers used to Slope = =Sxy/Sxx Sigmam =sy/sqrt(sxx) Intercept = =yavg-m*xavg Sigmab =sy/(sqrt(1/(n-(sumx*sumx/sumxsqr)))) Answers C = =(Y_abs_unk-b)/m ± sc = =sy/m*(sqrt((1/m)+(1/n)+(y_abs_unk-yavg)^2/(m*m*sxx))) Concentration of Estimate of 8.0E+06 Signal / Arbitrary Units 6.0E E E E Concentration / ppm s c s r m 1 M + 1 N + ( ) y c y m 2 Sxx This gives us the standard deviation estimate for results derived from a calibration curve. This can be turned into a CI using N-2 degrees of freedom. Sxx s r ( x x i avg ) 2 i i y i ( ) mx + b i 2 N 2 N is the number of calibration standards M is the number of times you averaged the sample to get the average signal y (often this is 1) y is the signal (e.g. absorbance) of the sample yc is the average of the signals of the calibration standards m is the slope Sxx is defined below sr (also sometimes called sy) is the standard error of the regression. 64

16 COMPARING YOUR ANSWER WITH WHAT YOU THINK THE ANSWER SHOULD BE. Use the following example to help you to compare your answer to the known answer. Case I is for comparing your value to some known or ideal value such as the label on the bottle of the vitamin tablet or the reported exact value for something. Case II is for comparing, for example, your two results for the mg of Fe. This could be a comparison between two tablets or cans of soda for example. For comparing: mg caffeine in a Diet Coke can to expectation (45 mg as of Spring 08) and validation measurements to their expected values For comparing: mg caffeine in a Diet Coke can 1 to mg caffeine in a Diet Coke can 2. and mg benzoic acid in a Diet Coke 1 to mg benzoic acid in a Diet Coke 2. Case 1. Comparing a Measured Result with a Known Value: t calc x avg x known s N x avg = average of N measurements x known = exact known or true value degrees of freedom = N - 1 If t_calc is greater than t_table, then you can conclude that there is a difference between the known and measured value - if you use the 95% confidence interval to find t_calc you will be wrong in your assertion that the true population mean is within this interval only once every twenty times. You cannot however conclude that the measured and true values are equal. =================================================================== Case 2. Comparing Two Measured Results: ( ) ( ) 2 2 x 1 x 2 N 1 N 2 s 1 N1 1 + s 2 N2 1 t calc s s pooled N 1 + N pooled 2 N 1 + N 2 2 x 1 and x 2 = the averages of N 1 and N 2 measurements degrees of freedom for two averages = N TOTAL - 2 = N 1 +N 2-2 degrees of freedom for two cal curve results = N TOTAL = N STD1 +N STD2-4 e.g. N TOTAL = for two, five-standard results like caffeine from cans 1 and 2 65

17 Table of Student s t-values. The value of t in the above is derived from the following table: Confidence Level: of Freedom 50% 90% 95% 98% 99% 99.50% 99.90%

18 Once you get your concentration of Fe for example, it needs to be converted into and amount per tablet (or per can in HPLC). This gives an example of how this is done, but you must use your procedure to work this out for your sample. For calculating the amount in mg/tablet of Fe: Assuming the measured concentration was: 15.3 ppm Tablet preparation was: dissolved acid and diluted to ml, then 20.0 ml of this was diluted to ml It is also perfectly valid to change the units on the 95% confidence interval before you propagate the error mg L 100 ml 0.250L = 19.1mg 20 ml per tablet (because all Fe comes from one tablet) For calculating the standard deviation estimate of this value: Standard deviation in concentration was: 0.83 ppm Using multiplication rule: x s x x ab c s a a 2 + s b b 2 + s c c 2 If this is a standard deviation, it can be converted into a 95% CI using the N-2 degrees of freedom from the calibration curve. And volumetric glassware tolerances (tables below): 0.83 ppm 15.3 ppm ml 100 ml ml 25 ml ml mg = 1.0 mg 250 ml tablet tablet Note that in this case none of the dilutions are expected to contribute any random error to the final result. 67

19 For dilutions, error is anticipated to accumulate (i.e. propagate) according to these approximate values: Vol flask tolerances: Flask Capacity / ml Tolerance / ±ml Pipet tolerances: Pipet Capacity / ml Tolerance / ±ml

20 Use the t-test to evaluate the difference between the expected and measured values using the Case 1 and Case 2 formulas on the following page. Note that you will be doing three t-tests: Does the validation standard concentration agree with expectation? (Case 1. Caffeine and benzoic acid) Does the average of the 2 samples agree with expectation? (Case 1., caffeine only) Does sample 1 agree with sample 2? (Case 2. Caffeine and benzoic acid) These tests may answer the questions Are the samples different from the label? and Are the two samples the same? Use the confidence tests as described in class and summarized below. Note that if you are comparing two measured values, then you use a modified form of the t-test shown below. Degrees of freedom for computing CI in final results: In computing t (or CI), for results from the cal curve: The degrees of freedom = N-2 where N is the the number of standards. 69

21 Once you have conducted t-tests for your two samples and your validation, consider the following truth table: Validation agreement w expectation at 95% confidence level. Sample 1 agreement w sample 2 at 95% confidence level. Average of samples agree w/ expectation at 95% confidence level. Evidence that sample is not as labeled? Evidence that the two samples differ from each other? Yes Yes Yes No No Yes Yes No Yes No Yes No Yes No Yes Yes No No Yes Yes No Yes Yes No No No Yes No No No No No Yes No Yes No No No No Yes Evaluate your experiments against the above matrix to test for systematic error and possible conclusions. 70