ESTIMATING UNCERTAINTIES in ANTENNA MEASUREMENTS
|
|
- Abner Davidson
- 5 years ago
- Views:
Transcription
1 ESTIMATING UNCERTAINTIES i ANTENNA MEASUREMENTS EuCAP April 013 Gotheburg, Swede Michael H. Fracis Natioal Istitute of Stadards ad Techology 35 Broadway Boulder, CO USA fracis@boulder/ist.gov M. H. Fracis U.S. Natl. Ist. Stad. Tech. 1
2 OUTLINE 1. Itroductio. Sources of Ucertaity 3. Distributig Errors 4. Type A & Type B Ucertaities 5. Systematic ad Radom Errors 6. Methods of Estimatig Ucertaities 7. Example: ULSA Array Patter Ucertaities 8. Coclusio M. H. Fracis U.S. Natl. Ist. Stad. Tech.
3 INTRODUCTION Why do ucertaity aalysis? M. H. Fracis U.S. Natl. Ist. Stad. Tech. 3
4 I geeral, the result of a measuremet is oly a estimate of the value of the quatity subject to measuremet (the measurad) ad the result is complete oly whe it is accompaied by a quatitative statemet of its ucertaity. A A A 0, where A 0 is the best estimate ad ΔA is the ucertaity. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 4
5 The error is the differece betwee the true value ad the measured value. The true value is ukowable so the error is ukowable. Error A A 0 t The ucertaity is the spread of values i which the true value may reasoably be expected to lie. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 5
6 SOURCES of UNCERTAINTY i ANTENNA A good ucertaity aalysis requires that all major sources of ucertaity be idetified. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 6
7 Probe/referece atea properties Aligmet/positioig Receive system Drift Impedace mismatch Leakage ad crosstalk Flexig cables Multipath Normalizatio No-uiform illumiatio M. H. Fracis U.S. Natl. Ist. Stad. Tech. 7
8 Aliasig Measuremet area trucatio Atea-atea multiple reflectios Radom errors (e.g., oise) M. H. Fracis U.S. Natl. Ist. Stad. Tech. 8
9 DISTRIBUTING ERRORS (ISO) The ISO approach is to assume that by some meas we have kowledge of how the errors are distributed. Let us ote some properties of distributio fuctios. 1. The variables x 1, x,..., x are idepedet oly if the distributio fuctio is separable, i.e., f ( x) f ( x, x,..., x ) f ( x ) f ( x )... f ( x ) f ( x ) i i i1. The expectatio value E of ay fuctio g(x) = g(x 1,x,...,x ) is E( g( x))... g( x) f ( x ) f ( x )... f ( x ) dxdx... dx M. H. Fracis U.S. Natl. Ist. Stad. Tech. 9
10 Mea ad Variace The mea ad variace of a liear fuctio y xi are ad y i i1 y i i1 i1 (1) () M. H. Fracis U.S. Natl. Ist. Stad. Tech. 10
11 To make use of (1) ad () for cases where y caot be writte as a sum of other fuctios, we must liearize the problem by usig the first two terms of the Taylor series expasio. This will give us the familiar form for g y xi i1 xi x (3) where the subscript x implies the derivative is evaluated at x, x,..., x. 1 x1 x x M. H. Fracis U.S. Natl. Ist. Stad. Tech. 11
12 If the errors are large, oe might be tempted to use the ext term i the Taylor series. This is ofte problematic sice the ext term i the Taylor series requires higher momets (see Appedix C), which may ot be well kow, especially type B ucertaities. I such cases, it usually makes sese to work directly with y rather tha its Taylor series expasio. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 1
13 Cetral Limit Theorem It is ofte mistakely asserted that if the umber of error sources the the distributio fuctio approaches a ormal distributio. The followig examples show that this is ot a sufficiet coditio. First, cosider the fuctio y 101 x i1 i with distributio fuctios f 1 (x 1 )...f 101 (x 101 ), with f 1 =...=f 100 = the ormal distributio with μ 1 =...=μ 100 =0 ad σ 1 =...=σ 100 =σ a. f 101 = the rectagular distributio with μ 101 =0, ad σ 101 =10σ a. As expected, 101 y i 00 a i1 but the resultig distributio (see graph) is ot a ormal distributio. Secod, cosider σ 101 =0σ a with 500. We have plotted these curves plus a ormal distributio y a agaist y/σ y so they have the same ormalized area ad variace. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 13
14 1 0.8 Relative Probability ormal + rectagular ormal ormal + wide rect. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 14
15 What is the problem? We have ot satisfied the full set of criteria required for the cetral limit theorem to be valid! These criteria are 1. y x, i1 i. x i are radom idepedet variables with distributios f i (x i ), 3. for all x i, var(x i ) is bouded, 4. 64, 5. limvar(y)64, M. H. Fracis U.S. Natl. Ist. Stad. Tech. 15
16 y y the the limitig distributio of f is the stadard ormal y distributio. Criteria 3, 4, ad 5 imply that var(y) >> var(x i ) for all x i. It is this requiremet that is ot satisfied i the above examples. Aother example that does ot satisfy the above criteria is: Why? 0 y = x, ad var(x i ) =, i1 i i The secod order Taylor series also does ot satisfy the requiremets. Why? M. H. Fracis U.S. Natl. Ist. Stad. Tech. 16
17 Oe cosequece of these requiremets: If there is a domiat source of ucertaity that is ot ormally distributed, the it is difficult to associate a cofidece level with the value of σ. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 17
18 TYPE A ad TYPE B UNCERTAINTIES Type A ucertaities are those that ca be estimated usig statistics (large umber of measuremets). Type B ucertaities are those that are estimated i ay other way. The ISO guide idicates that cofidece levels should ot be associated with the overall ucertaity i the presece of type B ucertaities. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 18
19 ISO Method of Combiig Ucertaities We combie ucertaities as follows. For type A ucertaities the overall ucertaity is u A 1 where u i is the stadard deviatio of the i th compoet. i1 u i, (4) For type B ucertaities u B where u j is a estimate of the stadard deviatio for the distributio fuctio for the j th compoet. j1 u j, (5) M. H. Fracis U.S. Natl. Ist. Stad. Tech. 19
20 The overall ucertaity is u u u. c A B (6) The expaded ucertaity is U Ku, c (7) where K is a coverage factor typically with a value of or 3. K = is the value ormally used i iteratioal itercompariso measuremets. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 0
21 Geometric Motivatio for Combiig Ucertaities I the real world, we sometimes have large errors but poor iformatio about the distributio of the errors ad we ca sometimes oly estimate a approximate upperboud error. If the errors are idepedet, the we ca visualize that they are orthogoal vectors i -space. The resultat vector is the root sum square (RSS) of the idividual compoets. We would ot associate a cofidece level with this result (or ay type B ucertaity). M. H. Fracis U.S. Natl. Ist. Stad. Tech. 1
22 Systematic ad Radom Errors Radom error ISO defiitio: The result of a measuremet mius the mea that would result from a ifiite umber of measuremets of the same measurad carried out uder repeatability coditios. [Compare this to a commo defiitio of: ucorrelated from measuremet to measuremet. ] Systematic error The mea that would result from a ifiite umber of measuremets of the same measurad carried out uder repeatability coditios mius the true value of the measurad. M. H. Fracis U.S. Natl. Ist. Stad. Tech.
23 M. H. Fracis U.S. Natl. Ist. Stad. Tech. 3
24 Corrected Measuremet Result The corrected (for systematic error) result of the measuremet gives the followig estimate of the measurad V M V M e s, (8) where e s is the best estimate of the systematic error. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 4
25 METHODS OF ESTIMATING UNCERTAINTIES 1. Aalytical Method. Simulatio Method 3. Self-Compariso Method (Measuremet) M. H. Fracis U.S. Natl. Ist. Stad. Tech. 5
26 We wat to estimate the idividual u i ad u j i (4) ad (5). We do ot ecessarily eed to kow or i (3) to do this. Istead, we may be able to estimate directly usig oe of the methods above. y x j x j y xi x i M. H. Fracis U.S. Natl. Ist. Stad. Tech. 6
27 ANALYTICAL METHOD We use our kowledge of the theory to develop equatios to provide estimates of ucertaity. Advatages: More geerally apply; Valid for may situatios; Ca idetify upper-boud ucertaities. Limitatio: Some estimates, particularly worst-case estimates, of ucertaity are urealistically high. Example: I plaar ear-field measuremets, we assume a periodic probepositio error to obtai a equatio to estimate the ucertaity due to probepositio errors. This provides a upper-boud error. Periodic positio errors cause larger (tha o-periodic) errors i the patter but are cocetrated i two directios. Other types of positio errors give smaller patter errors but spread them out over more of the patter (see Yaghjia). M. H. Fracis U.S. Natl. Ist. Stad. Tech. 7
28 Fe (, ) F(, ) db z 13.5 cos B g(, ), where F e ad F are the patter with ad without errors respectively, g(θ,φ) is the ratio of the peak far-field patter to the patter value i the θ,φ directio ad is greater tha 1. Θ B is the directio of the peak far-field patter, ad δ z is the maximum z-positio error. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 8
29 SIMULATION METHOD We use a simulatio to model a error ad estimate its effect o the result. Advatage: Study idividual errors; Use measured or ideal data; Ca study may cases. Limitatio: Must assume the form of the error; Results are ot geeral. Example: We model a receiver o-liearity effect by assumig the receiver output has additioal terms tha the liear term such as Output = c 1 *iput + c *(iput), ad the see how this affects the result. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 9
30 M. H. Fracis U.S. Natl. Ist. Stad. Tech. 30
31 SELF-COMPARISON METHOD We chage the measuremet system i a cotrolled maer to chage the error i some kow way. Advatages: Directly measure some ucertaities; Ca verify simulatio ad theory; Applies to actual measuremet system. Limitatio: Time cosumig; Results are ot geeral. Example: Multiple reflectios betwee the atea uder test ad the probe have period of λ/ i the separatio distace. By chagig the separatio distace by λ/4 we ca chage the multiple reflectios from i phase to out of phase. By comparig the patter ad gai results from both measuremets we ca estimate the ucertaity due to multiple reflectios. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 31
32 M. H. Fracis U.S. Natl. Ist. Stad. Tech. 3
33 M. H. Fracis U.S. Natl. Ist. Stad. Tech. 33
34 EXAMPLE ULSA ARRAY PATTERN UNCERTAINTIES UNCERTAINTY SOURCE UNCERTAINTY LEVEL (Relative to peak) Atea-atea multiple reflectios.8e-04 Multipath (room scatterig) 1.6e-04 Flexig cables 1.6e-04 Aligmet / positioig errors 9.0e-05 Leakage 9.0e-05 Noise / Radom errors 9.0e-05 Measuremet area trucatio 1.6e-05 Aliasig 1.6e-05 Receive system o-liearity 5.0e-06 ROOT SUM SQUARE Expaded ucertaity (K=) 4.0e e-04 M. H. Fracis U.S. Natl. Ist. Stad. Tech. 34
35 SIDELOBE LEVEL Expaded Ucertaity i db -30 db ±. -45 db db db db M. H. Fracis U.S. Natl. Ist. Stad. Tech. 35
36 Measuremet Itercompariso Sice there ca be much subjectivity i evaluatig type B ucertaities, some itercompariso measuremets are ecessary as a reality check! Measuremets from differet rages should agree to withi the combied ucertaities. That is, the ucertaity bars should overlap. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 36
37 M. H. Fracis U.S. Natl. Ist. Stad. Tech. 37
38 CONCLUSION C Rigorous ucertaity aalysis is a oxymoro! If it were rigorous, it would ot be ucertai. C A measuremet is icomplete without a ucertaity aalysis. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 38
39 Refereces 1. Iteratioal Orgaizatio for Stadards, "Guide to the Expressio of Ucertaity i Measuremet," revised Taylor, B.N. ad Kuyatt, C.E., Guidelies for Evaluatig ad Expressig the Ucertaity of NIST Measuremet Results, NIST Tech. Note 197, Miller, I ad Miller, M. Joh E. Freud s Mathematical Statistics, 6 th ed., Pretice Hall, Newell, A.C., "Error Aalysis Techiques for Plaar Near-Field Measuremets," IEEE Tras. Atea Propagat., AP-36, pp , Jue M. H. Fracis U.S. Natl. Ist. Stad. Tech. 39
40 5. IEEE Stadard , Recommeded Practice for Near- Field Atea Measuremets, Clause 9, December Fracis, M.H.; Newell, A.C.; Grimm, K.R.; Hoffma, J.; ad Schrak, H.E., Compariso of Ultralow Sidelobe Atea Far- Field Patters Usig the Plaar Near-Field Method ad the Far- Field Method, IEEE Atea Propagat. Mag., vol. 37, pp. 7-15, Dec Wittma, R.C.; Alpert, B.K. ad Fracis, M.H., Near-Field Atea Measuremets Usig Noideal Measuremet Locatios, IEEE Tras. Atea Propagat., vol. AP-46, pp.716-7, May M. H. Fracis U.S. Natl. Ist. Stad. Tech. 40
41 8. Yaghjia, A.D., Upper-Boud Errors i Far-Field Atea Parameters Determied from Plaar Near-Field Measuremets Part 1: Aalysis, Natl. Bur. Stad. Tech. Note 667, October Joy, E.B., Near-Field Rage Qualificatio Methodology, IEEE Tras. Atea Propagat., vol. AP-36, pp , Jue Wittma, R.C.; Fracis, M.H.; Muth, L.A. ad Lewis, R.L., Proposed Ucertaity Aalysis for RCS Measuremets, US Natl. Ist. Stad. Tech. It. Rep. NISTIR 5019, Ja M. H. Fracis U.S. Natl. Ist. Stad. Tech. 41
42 APPENDICES M. H. Fracis U.S. Natl. Ist. Stad. Tech. 4
43 APPENDIX A Liear Sums of Radom Variables y a x 1 1 If with distributio fuctios f ( x ), f ( x ),..., f ( x ) the the i1 i i mea ad the variace. y i i1 y i i1 M. H. Fracis U.S. Natl. Ist. Stad. Tech. 43
44 axf( x) dx y i i i i i i1 i1 ax 1 1f1( x1) dx1 fi( xi) dxi i1 axf ( x) dx fi( xi) dxi... i y i i1 y ax i i x f( ) i i xi dxi i1 i1 i1 M. H. Fracis U.S. Natl. Ist. Stad. Tech. 44
45 y ax i i i ax i i i ajxj j fi( xi) dxi i1 i1 ji i1 The secod term i the square brackets is zero whe x i ad x j are idepedet. Thus, ( ) y ax i i i fi xi dxi i i1 i1 i1 M. H. Fracis U.S. Natl. Ist. Stad. Tech. 45
46 APPENDIX B Taylor Series to First Order If y g( x1,..., x ), x,..., 1 xare idepedet radom variables with distributio fuctios f ( x ),..., f ( x ) ad we expad g i a Taylor series to 1 1 g first order, the y g( x,..., ) ad. 1 x y xi 1 x i i x First, we expad g i a Taylor series about the mea values of x 1,..., x, the g yx ( 1,..., x) g( x,..., ) 1 x x i x i 1 x i i x M. H. Fracis U.S. Natl. Ist. Stad. Tech. 46
47 The g y g( ) xi x f ( ) i i xi dxi i1 x i x i1 Sice Ex ( ) 0, it follows i x i g( ) y g y E g x y x i x f ( ) i i xi dxi i1 x i x i1 M. H. Fracis U.S. Natl. Ist. Stad. Tech. 47
48 g y xi i1 xi x M. H. Fracis U.S. Natl. Ist. Stad. Tech. 48
49 APPENDIX C Taylor Series to Secod Order Cosider the case of Appedix B but expadig to secod order i the Taylor series. Fid ad. y y 1 g y g( ) xi x i x g i1 j1 i j i1 i x x i x xj x i j x x x. M. H. Fracis U.S. Natl. Ist. Stad. Tech. 49
50 y i x i x j x i i i i xi i j xi x x j i1 x. g 1 g g( ) x x x f ( x ) dx i i j Sice Ex ( ) 0 ad E(( x ) ) the the secod term i the i x i i x x i square brackets is zero ad oly those terms with j=i cotribute i the third term. Thus, 1 g y g( ) xi 1 x y i i x g 1 g 1 g xi x x ( ) i i x x i j x j x f i i xi dxi i xi i j xi x j x i 1 x i x i 1 x i M. H. Fracis U.S. Natl. Ist. Stad. Tech. 50
51 g g y xi x x... i j x j i j x i x x j x g g g g... xi x x... i j x x j k x k x x i j x j i j k x k x x i x j i j x x i x j 1 g g... xi x x... i j x x j k x x k x 4 i j k xi x j x x kx x 1 g g x x k i x x i j x j x i j k ix j x x k x 1 g g... ( ) x i x f j i xi dxi 4 x i j i x j i1 x x M. H. Fracis U.S. Natl. Ist. Stad. Tech. 51
52 Sice Ex ( ) 0 ad E(( x ) ) the the first term is zero i x i i x x i uless i=j, the secod term is zero uless i=j=k, the third term is zero, the fourth term is zero uless k=i (j), R=j (i) ad the fifth term is zero uless i=j. Thus i g g g 3 1 g y x Exi i x x i1 xi i xi x i x x i 1 j i xi x j x i i j 1 4 g x i i x E x 4 4 i x x i i M. H. Fracis U.S. Natl. Ist. Stad. Tech. 5
53 Note that there are third order Taylor series terms of the form 3 g g which are of the same order as terms i the x i x j x i x x i x j above equatio. x M. H. Fracis U.S. Natl. Ist. Stad. Tech. 53
54 Normal distributio APPENDIX D Mea ad Variace for Selected Distributios f( x) e x x 1 x M. H. Fracis U.S. Natl. Ist. Stad. Tech. 54
55 Expoetial distributio 1 f ( x) x x x e M. H. Fracis U.S. Natl. Ist. Stad. Tech. 55
56 Biomial distributio f( x;, ) x (1 ) x x! (1 ) x!( x)! x M. H. Fracis U.S. Natl. Ist. Stad. Tech. 56
57 M. H. Fracis U.S. Natl. Ist. Stad. Tech. 57 Chi-squared distributio with ν degrees of freedom ( ) x x x x e f x
58 Rectagular distributio 1 f x a a xa 0 otherwise x x 0 a 3 M. H. Fracis U.S. Natl. Ist. Stad. Tech. 58
59 U distributio 1 x f x a xa; a iteger greater tha 0 a a 0 otherwise x 0 1 a 3 x M. H. Fracis U.S. Natl. Ist. Stad. Tech. 59
Measurement uncertainty of the sound absorption
Measuremet ucertaity of the soud absorptio coefficiet Aa Izewska Buildig Research Istitute, Filtrowa Str., 00-6 Warsaw, Polad a.izewska@itb.pl 6887 The stadard ISO/IEC 705:005 o the competece of testig
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationThe variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.
SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationLecture 1 Probability and Statistics
Wikipedia: Lecture 1 Probability ad Statistics Bejami Disraeli, British statesma ad literary figure (1804 1881): There are three kids of lies: lies, damed lies, ad statistics. popularized i US by Mark
More informationPH 425 Quantum Measurement and Spin Winter SPINS Lab 1
PH 425 Quatum Measuremet ad Spi Witer 23 SPIS Lab Measure the spi projectio S z alog the z-axis This is the experimet that is ready to go whe you start the program, as show below Each atom is measured
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationProvläsningsexemplar / Preview TECHNICAL REPORT INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE
TECHNICAL REPORT CISPR 16-4-3 2004 AMENDMENT 1 2006-10 INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE Amedmet 1 Specificatio for radio disturbace ad immuity measurig apparatus ad methods Part 4-3:
More informationDirection: This test is worth 250 points. You are required to complete this test within 50 minutes.
Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely
More informationStatistical Analysis on Uncertainty for Autocorrelated Measurements and its Applications to Key Comparisons
Statistical Aalysis o Ucertaity for Autocorrelated Measuremets ad its Applicatios to Key Comparisos Nie Fa Zhag Natioal Istitute of Stadards ad Techology Gaithersburg, MD 0899, USA Outlies. Itroductio.
More informationSample Size Determination (Two or More Samples)
Sample Sie Determiatio (Two or More Samples) STATGRAPHICS Rev. 963 Summary... Data Iput... Aalysis Summary... 5 Power Curve... 5 Calculatios... 6 Summary This procedure determies a suitable sample sie
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationAnalysis of Experimental Data
Aalysis of Experimetal Data 6544597.0479 ± 0.000005 g Quatitative Ucertaity Accuracy vs. Precisio Whe we make a measuremet i the laboratory, we eed to kow how good it is. We wat our measuremets to be both
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLecture 1 Probability and Statistics
Wikipedia: Lecture 1 Probability ad Statistics Bejami Disraeli, British statesma ad literary figure (1804 1881): There are three kids of lies: lies, damed lies, ad statistics. popularized i US by Mark
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationENGI 4421 Confidence Intervals (Two Samples) Page 12-01
ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly
More informationTHE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS
R775 Philips Res. Repts 26,414-423, 1971' THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS by H. W. HANNEMAN Abstract Usig the law of propagatio of errors, approximated
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More informationANALYSIS OF EXPERIMENTAL ERRORS
ANALYSIS OF EXPERIMENTAL ERRORS All physical measuremets ecoutered i the verificatio of physics theories ad cocepts are subject to ucertaities that deped o the measurig istrumets used ad the coditios uder
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationLecture 2: Concentration Bounds
CSE 52: Desig ad Aalysis of Algorithms I Sprig 206 Lecture 2: Cocetratio Bouds Lecturer: Shaya Oveis Ghara March 30th Scribe: Syuzaa Sargsya Disclaimer: These otes have ot bee subjected to the usual scrutiy
More informationChapter 10: Power Series
Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because
More informationError & Uncertainty. Error. More on errors. Uncertainty. Page # The error is the difference between a TRUE value, x, and a MEASURED value, x i :
Error Error & Ucertaity The error is the differece betwee a TRUE value,, ad a MEASURED value, i : E = i There is o error-free measuremet. The sigificace of a measuremet caot be judged uless the associate
More informationLesson 10: Limits and Continuity
www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals
More informationChapter 2 The Monte Carlo Method
Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationn outcome is (+1,+1, 1,..., 1). Let the r.v. X denote our position (relative to our starting point 0) after n moves. Thus X = X 1 + X 2 + +X n,
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 9 Variace Questio: At each time step, I flip a fair coi. If it comes up Heads, I walk oe step to the right; if it comes up Tails, I walk oe
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationExam II Covers. STA 291 Lecture 19. Exam II Next Tuesday 5-7pm Memorial Hall (Same place as exam I) Makeup Exam 7:15pm 9:15pm Location CB 234
STA 291 Lecture 19 Exam II Next Tuesday 5-7pm Memorial Hall (Same place as exam I) Makeup Exam 7:15pm 9:15pm Locatio CB 234 STA 291 - Lecture 19 1 Exam II Covers Chapter 9 10.1; 10.2; 10.3; 10.4; 10.6
More informationChapter If n is odd, the median is the exact middle number If n is even, the median is the average of the two middle numbers
Chapter 4 4-1 orth Seattle Commuity College BUS10 Busiess Statistics Chapter 4 Descriptive Statistics Summary Defiitios Cetral tedecy: The extet to which the data values group aroud a cetral value. Variatio:
More informationUnderstanding Samples
1 Will Moroe CS 109 Samplig ad Bootstrappig Lecture Notes #17 August 2, 2017 Based o a hadout by Chris Piech I this chapter we are goig to talk about statistics calculated o samples from a populatio. We
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More informationTABLES AND FORMULAS FOR MOORE Basic Practice of Statistics
TABLES AND FORMULAS FOR MOORE Basic Practice of Statistics Explorig Data: Distributios Look for overall patter (shape, ceter, spread) ad deviatios (outliers). Mea (use a calculator): x = x 1 + x 2 + +
More informationChapter 8: Estimating with Confidence
Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationSeries Review. a i converges if lim. i=1. a i. lim S n = lim i=1. 2 k(k + 2) converges. k=1. k=1
Defiitio: We say that the series S = Series Review i= a i is the sum of the first terms. i= a i coverges if lim S exists ad is fiite, where The above is the defiitio of covergece for series. order to see
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More informationLinear Regression Demystified
Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationSNAP Centre Workshop. Basic Algebraic Manipulation
SNAP Cetre Workshop Basic Algebraic Maipulatio 8 Simplifyig Algebraic Expressios Whe a expressio is writte i the most compact maer possible, it is cosidered to be simplified. Not Simplified: x(x + 4x)
More informationStatistical Fundamentals and Control Charts
Statistical Fudametals ad Cotrol Charts 1. Statistical Process Cotrol Basics Chace causes of variatio uavoidable causes of variatios Assigable causes of variatio large variatios related to machies, materials,
More informationCHAPTER 10 INFINITE SEQUENCES AND SERIES
CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece
More informationModule 1 Fundamentals in statistics
Normal Distributio Repeated observatios that differ because of experimetal error ofte vary about some cetral value i a roughly symmetrical distributio i which small deviatios occur much more frequetly
More informationConfidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation
Cofidece Iterval for tadard Deviatio of Normal Distributio with Kow Coefficiets of Variatio uparat Niwitpog Departmet of Applied tatistics, Faculty of Applied ciece Kig Mogkut s Uiversity of Techology
More informationMATH/STAT 352: Lecture 15
MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet
More informationAnalysis of Experimental Measurements
Aalysis of Experimetal Measuremets Thik carefully about the process of makig a measuremet. A measuremet is a compariso betwee some ukow physical quatity ad a stadard of that physical quatity. As a example,
More informationChapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities
Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More informationStat 319 Theory of Statistics (2) Exercises
Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.
More informationx a x a Lecture 2 Series (See Chapter 1 in Boas)
Lecture Series (See Chapter i Boas) A basic ad very powerful (if pedestria, recall we are lazy AD smart) way to solve ay differetial (or itegral) equatio is via a series expasio of the correspodig solutio
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationt distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference
EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationSection 11.8: Power Series
Sectio 11.8: Power Series 1. Power Series I this sectio, we cosider geeralizig the cocept of a series. Recall that a series is a ifiite sum of umbers a. We ca talk about whether or ot it coverges ad i
More informationEstimation of the Mean and the ACVF
Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators
More informationChapter 6. Sampling and Estimation
Samplig ad Estimatio - 34 Chapter 6. Samplig ad Estimatio 6.. Itroductio Frequetly the egieer is uable to completely characterize the etire populatio. She/he must be satisfied with examiig some subset
More informationProbability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].
Probability 2 - Notes 0 Some Useful Iequalities. Lemma. If X is a radom variable ad g(x 0 for all x i the support of f X, the P(g(X E[g(X]. Proof. (cotiuous case P(g(X Corollaries x:g(x f X (xdx x:g(x
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationParameter, Statistic and Random Samples
Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,
More information1.010 Uncertainty in Engineering Fall 2008
MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval
More information3/21/2017. Commuting and Non-commuting Operators Chapter 17. A a
Commutig ad No-commutig Operators Chapter 17 Postulate 3. I ay measuremet of the observable associated with a operator A the oly values that will ever be observed are the eige values, a, which satisfy
More informationConfidence Intervals
Cofidece Itervals Berli Che Deartmet of Comuter Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Referece: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chater 5 & Teachig Material Itroductio
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationTests of Hypotheses Based on a Single Sample (Devore Chapter Eight)
Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationSequences. Notation. Convergence of a Sequence
Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 9 Multicolliearity Dr Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Multicolliearity diagostics A importat questio that
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER / Statistics
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER 1 018/019 DR. ANTHONY BROWN 8. Statistics 8.1. Measures of Cetre: Mea, Media ad Mode. If we have a series of umbers the
More informationOverview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions
Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples
More informationR is a scalar defined as follows:
Math 8. Notes o Dot Product, Cross Product, Plaes, Area, ad Volumes This lecture focuses primarily o the dot product ad its may applicatios, especially i the measuremet of agles ad scalar projectio ad
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationLecture 3. Properties of Summary Statistics: Sampling Distribution
Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary
More informationLast time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object
6.3 Stochastic Estimatio ad Cotrol, Fall 004 Lecture 7 Last time: Momets of the Poisso distributio from its geeratig fuctio. Gs () e dg µ e ds dg µ ( s) µ ( s) µ ( s) µ e ds dg X µ ds X s dg dg + ds ds
More informationMedian and IQR The median is the value which divides the ordered data values in half.
STA 666 Fall 2007 Web-based Course Notes 4: Describig Distributios Numerically Numerical summaries for quatitative variables media ad iterquartile rage (IQR) 5-umber summary mea ad stadard deviatio Media
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More information