ENGI 4421 Central Limit Theorem Page Central Limit Theorem [Navidi, section 4.11; Devore sections ]
|
|
- Baldwin McLaughlin
- 6 years ago
- Views:
Transcription
1 ENGI 441 Cetral Limit Therem Page Cetral Limit Therem [Navidi, secti 4.11; Devre sectis ] If X i is t rmally distributed, but E X i, V X i ad is large (apprximately 30 r mre), the, t a gd apprximati, X ~ N, At " is a demstrati web prgram t illustrate hw the sample mea appraches a rmal distributi eve fr highly -rmal discrete distributis f X. Csider the expetial distributi, whse p.d.f. (prbability desity fucti) is x 1 1 f x; e, x 0, 0 E X, VX It ca be shw that the exact p.d.f. f the sample mea fr sample size is 1 x x e f x;,, x 0, 0, X 1! 1 1 with mea ad variace E X, V X. [A -examiable derivati f this p.d.f. is available at " ".] Fr illustrati, settig = 1, the p.d.f. fr the sample mea fr sample sizes = 1,, 4 ad 8 are: 1: f x e x x : f x 4xe 3 4x 44x e 4: 8: f x f x X 3! X X 7 8 x e 88 7! x The ppulati mea = E[X] = 1 fr all sample sizes. The variace ad the psitive skew bth dimiish with icreasig sample size. The mde ad the media apprach the mea frm the left.
2 ENGI 441 Cetral Limit Therem Page 11-0 Fr a sample size f = 16, the sample mea X has the p.d.f. f X x x e x ad parameters E X 1 ad V X 15!. 16 A plt f the exact p.d.f is draw here, tgether with the rmal distributi that has the same mea ad variace. The apprach t rmality is clear. Beyd = 40 r s, the differece betwee the exact p.d.f. ad the Nrmal apprximati is egligible. It is geerally the case that, whatever the prbability distributi f a radm quatity may be, the prbability distributi f the sample mea X appraches rmality as the sample size icreases. Fr mst prbability distributis f practical iterest, the rmal apprximati becmes very gd beyd a sample size f 30. Example A radm sample f 100 items is draw frm a expetial distributi with parameter = Fid the prbabilities that (a) a sigle item has a value f mre tha 30; (b) the sample mea has a value f mre tha 30. (a)
3 ENGI 441 Cetral Limit Therem Page Example (ctiued) (b)
4 ENGI 441 Cetral Limit Therem Page Sample Prprtis A Berulli radm quatity has tw pssible utcmes: x = 0 (= failure ) with prbability q1 p ad x = 1 (= success ) with prbability p. Suppse that all elemets f the set X 1, X, X 3,, X are idepedet Berulli radm quatities, (s that the set frms a radm sample). Let T X 1 X X 3 X umber f successes i the radm sample ad Pˆ T = prprti f successes i the radm sample, the T is
5 ENGI 441 Cetral Limit Therem Page Example % f all custmers prefer brad A. Fid the prbability that a majrity i a radm sample f 100 custmers des t prefer brad A.
6 ENGI 441 Cfidece Itervals (Oe Sample) Page Cfidece Itervals (Oe Sample) [Navidi, sectis ; Devre chapter 7] S far we have cstructed prbability statemets hw likely certai sample values are, give kwledge f the ppulati frm which the radm sample came. Nw we shall reverse that situati: we have a kw sample i frt f us, frm which we ca ifer the values f the parameters f the ppulati frm which the sample was draw. This is the realm f iferetial statistics. If the radm quatity X is such that ~ N, X, the it is highly ulikely that X will be mre tha three stadard deviatis away frm its mea: P X 3 PX 3 PZ Mre tha 99.7% f the time, X will be clser tha three stadard deviatis t its mea. Fr a sufficietly large radm sample, the cetral limit therem assures us that the sample mea X ~ N, (either exactly r t a excellet apprximati). Therefre we have 99.7% cfidece that a bserved sample mea x is withi three stadard errrs f the ppulati mea. This lie f reasig allws us t replace a pit estimate by a rage f plausible values f a ukw parameter a cfidece iterval. Mre geerally, whe X ~ N,, P z/ X z/ 1
7 ENGI 441 Cfidece Itervals (Oe Sample) Page The cfidece iterval estimatr fr (at a level f cfidece f 1 ) is X z X z The 1 cfidece iterval estimatr fr is a radm iterval X z, X z The prbability is (1 ) that the abve radm iterval icludes the true value f cfidece f all radm samples will prduce a iequality, (the iterval estimate fr ) x z x z that is true. Nte that the cfidece iterval estimate ctais radm quatities at all! The statemet is either abslutely certai t be true r abslutely certai t be false, (depedig the values f,, x, ad ). Iterpretati f a cfidece iterval [ = cfidece iterval estimate ] Oly 5% f all 95% cfidece iterval estimates fr fail t iclude.
8 ENGI 441 Cfidece Itervals (Oe Sample) Page A ccise expressi fr the C.I. (cfidece iterval estimate fr ) is x z A Bayesia view f iterval estimati: If the ly quatity amg {,, x, ad } that we d t kw is, the represet the ukw by the radm quatity A. The A te abut the stadard rmal distributi ad the t distributi Let Z ~ N(0, 1) (stadard rmal distributi), s that P Z z z (cumulative distributi fucti fr the stadard rmal distributi). th The the percetile f the stadard rmal distributi is z, which satisfies PZ z. It als fllws that 1 z z. 1 z The t distributi with ν degrees f freedm is als a bell shaped curve, with a mea, media ad mde at t 0, but with a greater variace tha the stadard rmal distributi. As the umber f degrees f freedm icreases, the t distributi appraches the z (stadard rmal) distributi. The graphs f t 1 ad t 5 are shw here, tgether with z, which is idistiguishable t the eye frm t fr abve 30 r s. Therefre lim t, t, z. Use the t distributi ly if the true ppulati variace is ukw.
9 ENGI 441 Cfidece Itervals (Oe Sample) Page percetile z, use the fial rw i the table f critical values T fid the th f the t distributi ( page 17-0 r the iside back cver f the textbk): z t., The fial rw f the t tables is Therefre PZ r equivaletly z ; P Z r equivaletly z ; etc. Example The rate f eergy lss X (watt) i a mtr is kw t be a rmally distributed radm quatity with stadard deviati 3.0 W. A radm sample f 100 such mtrs prduces a sample mea rate f eergy lss f 58.3 W. Fid a 99% cfidece iterval estimate fr the true mea rate f eergy lss.
10 ENGI 441 Cfidece Itervals (Oe Sample) Page Example (ctiued) Hw large must be fr the width f the 99% cfidece iterval estimate fr t be less tha 1.0? Chice f sample size The width f the cfidece iterval x z, x z is w z z w The sample size is iversely related t the square f the desired width. Edpits f a (1 ) CI fr : (a) kw: (b) ukw, large: (c) ukw, small: Whe is small, X must be early (r exactly) rmal.
11 ENGI 441 Cfidece Itervals (Oe Sample) Page Example The lifetime X f a particular brad f filamets is kw t be rmally distributed. A radm sample f six filamets is tested t destructi ad they are fud t last fr a average f 1,008 hurs with a sample stadard deviati f 6. hurs. (a) Fid a 95% cfidece iterval estimate fr the ppulati mea lifetime. (b) Is the evidece csistet with 1000? (c) Is the evidece csistet with > 1000?
12 ENGI 441 Cfidece Itervals (Oe Sample) Page 11-1 Prperties f a cfidece iterval If we thik f the width f the cfidece iterval as specifyig its precisi, the the cfidece level (r reliability) f the iterval is iversely related t its precisi. Estimati f Ppulati Prprti Whe a radm sample f size is draw frm a ppulati i which a prprti p f the items are successes, the, as we saw page 11.04, pq P ˆ ~ N p, fr sufficietly large p ad q, (amely, p > 10 ad q > 10 ). Cmpare this with X ~ N,, fr which the crrespdig cfidece iterval has edpits x z / s. Hwever, the variace pq is ukw because p ad q are ukw. A bvius remedy is t replace the ukw parameters p ad q by their pit estimates ˆp ad ˆq.
13 ENGI 441 Cfidece Itervals (Oe Sample) Page Therefre, a simple 100(1 )% cfidece iterval estimatr fr p is P z / PQ ad the 100(1 )% cfidece iterval estimate fr p is pˆ z / pq ˆˆ Hwever, these cfidece itervals ca exhibit sigificat errrs whe either p r q is much less tha 100. Durig the 1990 s, mre reliable cfidece itervals fr p were develped. Oe f them is (Devre, sixth editi, secti 7., page 66) : z pq ˆˆ z pˆ 4 z / 1 / / z / Ather iterval, frm the Navidi textbk (page 339), is the Agresti-Cull iterval. If x is the bserved umber f successes i a radm sample f idepedet Berulli trials, the defie x* x ad * 4 s that p* x* x * 4 ad q* 1 p* The the 100(1 )% cfidece iterval estimate fr p is p* z / p* q* * It turs ut that the Bayesia pit estimate fr p is p*, t ˆp.
14 ENGI 441 Cfidece Itervals (Oe Sample) Page Example Frm a radm sample f e thusad silic wafers, 750 pass a quality ctrl test. Fid a 99% cfidece iterval estimate fr p (the true prprti f wafers i the ppulati that are gd). = 1000 ad x = 750 x p ˆ q ˆ 1 pˆ z.005 t.005,.576 Edpits f the C.I.: pq ˆˆ.75.5 pˆ z = Therefre the 99% cfidece iterval estimate fr p is crrect t three sigificat figures. 71.5% p 78.5% Usig the mre precise Agresti-Cull versi f the cfidece iterval yields x* = = 75, * = = 1004 p* x* 75 * p* q* * The 99% CI is therefre p* q* p* z * % p 78.4%
15 ENGI 441 Cfidece Itervals (Oe Sample) Page (1)100% Bayesia Cfidece Iterval fr [t i the Navidi r Devre textbks] Suppse that previus evidece leads us t believe that. The stregth f this belief is represeted by the variace (lwer variace crrespds t strger belief). We wish t update that estimate after a radm sample f size has bee examied. Assume that 30 (s that the Cetral Limit Therem will apply). Prir distributi: New evidece: X ~ N, Sample size = Sample mea = x Sample stadard deviati = s Calculate where wd, w x d w d w w 1, w w w are the weights f the data ad rigial ifrmati respectively, give by wd 1 1, w s d Psterir distributi: X ~ N, 1 100% Bayesia iterval fr : z / Cmpare with the classical 1 100% cfidece iterval fr : s x z / ( 30) r x z / I may applicatis, the Bayesia iterval is fte arrwer tha the classical cfidece iterval, because the Bayesia iterval icrprates mre ifrmati (previus evidece r belief abut the true value f ). [Nte: it is easy t shw that as (r if x the), * = x ad that as, * s, which are the classical expressis.]
16 ENGI 441 Cfidece Itervals (Oe Sample) Page Examples f Bayesia Cfidece Itervals These examples are mdificatis f the previus examples f classical cfidece itervals fr. Example (mdificati f Example 11.03) The rate f eergy lss X (watt) i a mtr is kw t be a rmally distributed radm quatity ad prir experiece suggests that the mea is 60 W with stadard deviati 3.0 W. A radm sample f 100 such mtrs prduces a sample mea rate f eergy lss f 58.3 W with sample stadard deviati.8 W. Fid a 99% cfidece iterval estimate fr the true mea rate f eergy lss.
17 ENGI 441 Cfidece Itervals (Oe Sample) Page Example (mdificati f Example 11.04) The lifetime X f a particular brad f filamets is kw t be rmally distributed. Prir experiece suggests that 1000 ad 6.0. A radm sample f six filamets is tested t destructi ad they are fud t last fr a average f 1,008 hurs with a sample stadard deviati f 6. hurs. (a) Fid a 95% cfidece iterval estimate fr the ppulati mea lifetime. (b) Is the evidece csistet with 1000? [Ed f Chapter 11]
18 ENGI 441 Cfidece Itervals (Oe Sample) Page [Space fr Additial Ntes]
ENGI 4421 Central Limit Theorem Page Central Limit Theorem [Navidi, section 4.11; Devore sections ]
ENGI 441 Cetral Limit Therem Page 11-01 Cetral Limit Therem [Navidi, secti 4.11; Devre sectis 5.3-5.4] If X i is t rmally distributed, but E X i, V X i ad is large (apprximately 30 r mre), the, t a gd
More information5.1 Two-Step Conditional Density Estimator
5.1 Tw-Step Cditial Desity Estimatr We ca write y = g(x) + e where g(x) is the cditial mea fucti ad e is the regressi errr. Let f e (e j x) be the cditial desity f e give X = x: The the cditial desity
More informationD.S.G. POLLOCK: TOPICS IN TIME-SERIES ANALYSIS STATISTICAL FOURIER ANALYSIS
STATISTICAL FOURIER ANALYSIS The Furier Represetati f a Sequece Accrdig t the basic result f Furier aalysis, it is always pssible t apprximate a arbitrary aalytic fucti defied ver a fiite iterval f the
More information, the random variable. and a sample size over the y-values 0:1:10.
Lecture 3 (4//9) 000 HW PROBLEM 3(5pts) The estimatr i (c) f PROBLEM, p 000, where { } ~ iid bimial(,, is 000 e f the mst ppular statistics It is the estimatr f the ppulati prprti I PROBLEM we used simulatis
More informationChapter 3.1: Polynomial Functions
Ntes 3.1: Ply Fucs Chapter 3.1: Plymial Fuctis I Algebra I ad Algebra II, yu ecutered sme very famus plymial fuctis. I this secti, yu will meet may ther members f the plymial family, what sets them apart
More informationENGI 4421 Confidence Intervals (Two Samples) Page 12-01
ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly
More informationAP Statistics Notes Unit Eight: Introduction to Inference
AP Statistics Ntes Uit Eight: Itrducti t Iferece Syllabus Objectives: 4.1 The studet will estimate ppulati parameters ad margis f errrs fr meas. 4.2 The studet will discuss the prperties f pit estimatrs,
More informationCh. 1 Introduction to Estimation 1/15
Ch. Itrducti t stimati /5 ample stimati Prblem: DSB R S f M f s f f f ; f, φ m tcsπf t + φ t f lectrics dds ise wt usually white BPF & mp t s t + w t st. lg. f & φ X udi mp cs π f + φ t Oscillatr w/ f
More informationBIO752: Advanced Methods in Biostatistics, II TERM 2, 2010 T. A. Louis. BIO 752: MIDTERM EXAMINATION: ANSWERS 30 November 2010
BIO752: Advaced Methds i Bistatistics, II TERM 2, 2010 T. A. Luis BIO 752: MIDTERM EXAMINATION: ANSWERS 30 Nvember 2010 Questi #1 (15 pits): Let X ad Y be radm variables with a jit distributi ad assume
More informationQuantum Mechanics for Scientists and Engineers. David Miller
Quatum Mechaics fr Scietists ad Egieers David Miller Time-depedet perturbati thery Time-depedet perturbati thery Time-depedet perturbati basics Time-depedet perturbati thery Fr time-depedet prblems csider
More informationSolutions. Definitions pertaining to solutions
Slutis Defiitis pertaiig t slutis Slute is the substace that is disslved. It is usually preset i the smaller amut. Slvet is the substace that des the disslvig. It is usually preset i the larger amut. Slubility
More informationIntermediate Division Solutions
Itermediate Divisi Slutis 1. Cmpute the largest 4-digit umber f the frm ABBA which is exactly divisible by 7. Sluti ABBA 1000A + 100B +10B+A 1001A + 110B 1001 is divisible by 7 (1001 7 143), s 1001A is
More informationA Study on Estimation of Lifetime Distribution with Covariates Under Misspecification
Prceedigs f the Wrld Cgress Egieerig ad Cmputer Sciece 2015 Vl II, Octber 21-23, 2015, Sa Fracisc, USA A Study Estimati f Lifetime Distributi with Cvariates Uder Misspecificati Masahir Ykyama, Member,
More informationMATH/STAT 352: Lecture 15
MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet
More informationBootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) >
Btstrap Methd > # Purpse: understand hw btstrap methd wrks > bs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(bs) > mean(bs) [1] 21.64625 > # estimate f lambda > lambda = 1/mean(bs);
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationMATH Midterm Examination Victor Matveev October 26, 2016
MATH 33- Midterm Examiati Victr Matveev Octber 6, 6. (5pts, mi) Suppse f(x) equals si x the iterval < x < (=), ad is a eve peridic extesi f this fucti t the rest f the real lie. Fid the csie series fr
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationComparative analysis of bayesian control chart estimation and conventional multivariate control chart
America Jural f Theretical ad Applied Statistics 3; ( : 7- ublished lie Jauary, 3 (http://www.sciecepublishiggrup.cm//atas di:.648/.atas.3. Cmparative aalysis f bayesia ctrl chart estimati ad cvetial multivariate
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationIf σis unknown. Properties of t distribution. 6.3 One and Two Sample Inferences for Means. What is the correct multiplier? t
/8/009 6.3 Oe a Tw Samle Iferece fr Mea If i kw a 95% Cfiece Iterval i 96 ±.96 96.96 ± But i ever kw. If i ukw Etimate by amle taar eviati The etimate taar errr f the mea will be / Uig the etimate taar
More information1036: Probability & Statistics
036: Probability & Statistics Lecture 0 Oe- ad Two-Sample Tests of Hypotheses 0- Statistical Hypotheses Decisio based o experimetal evidece whether Coffee drikig icreases the risk of cacer i humas. A perso
More information5.80 Small-Molecule Spectroscopy and Dynamics
MIT OpeCurseWare http://cw.mit.edu 5.8 Small-Mlecule Spectrscpy ad Dyamics Fall 8 Fr ifrmati abut citig these materials r ur Terms f Use, visit: http://cw.mit.edu/terms. 5.8 Lecture #33 Fall, 8 Page f
More informationRecall the study where we estimated the difference between mean systolic blood pressure levels of users of oral contraceptives and non-users, x - y.
Testig Statistical Hypotheses Recall the study where we estimated the differece betwee mea systolic blood pressure levels of users of oral cotraceptives ad o-users, x - y. Such studies are sometimes viewed
More informationMATHEMATICS 9740/01 Paper 1 14 Sep hours
Cadidate Name: Class: JC PRELIMINARY EXAM Higher MATHEMATICS 9740/0 Paper 4 Sep 06 3 hurs Additial Materials: Cver page Aswer papers List f Frmulae (MF5) READ THESE INSTRUCTIONS FIRST Write yur full ame
More information(6) Fundamental Sampling Distribution and Data Discription
34 Stat Lecture Notes (6) Fudametal Samplig Distributio ad Data Discriptio ( Book*: Chapter 8,pg5) Probability& Statistics for Egieers & Scietists By Walpole, Myers, Myers, Ye 8.1 Radom Samplig: Populatio:
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationParameter, Statistic and Random Samples
Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,
More informationThe Simple Linear Regression Model: Theory
Chapter 3 The mple Lear Regress Mdel: Ther 3. The mdel 3.. The data bservats respse varable eplaatr varable : : Plttg the data.. Fgure 3.: Dsplag the cable data csdered b Che at al (993). There are 79
More informationAuthor. Introduction. Author. o Asmir Tobudic. ISE 599 Computational Modeling of Expressive Performance
ISE 599 Cmputatial Mdelig f Expressive Perfrmace Playig Mzart by Aalgy: Learig Multi-level Timig ad Dyamics Strategies by Gerhard Widmer ad Asmir Tbudic Preseted by Tsug-Ha (Rbert) Chiag April 5, 2006
More informationALE 26. Equilibria for Cell Reactions. What happens to the cell potential as the reaction proceeds over time?
Name Chem 163 Secti: Team Number: AL 26. quilibria fr Cell Reactis (Referece: 21.4 Silberberg 5 th editi) What happes t the ptetial as the reacti prceeds ver time? The Mdel: Basis fr the Nerst quati Previusly,
More informationProbability and statistics: basic terms
Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample
More informationBIOS 4110: Introduction to Biostatistics. Breheny. Lab #9
BIOS 4110: Itroductio to Biostatistics Brehey Lab #9 The Cetral Limit Theorem is very importat i the realm of statistics, ad today's lab will explore the applicatio of it i both categorical ad cotiuous
More informationA quick activity - Central Limit Theorem and Proportions. Lecture 21: Testing Proportions. Results from the GSS. Statistics and the General Population
A quick activity - Cetral Limit Theorem ad Proportios Lecture 21: Testig Proportios Statistics 10 Coli Rudel Flip a coi 30 times this is goig to get loud! Record the umber of heads you obtaied ad calculate
More informationReview for cumulative test
Hrs Math 3 review prblems Jauary, 01 cumulative: Chapters 1- page 1 Review fr cumulative test O Mday, Jauary 7, Hrs Math 3 will have a curse-wide cumulative test cverig Chapters 1-. Yu ca expect the test
More informationMarkov processes and the Kolmogorov equations
Chapter 6 Markv prcesses ad the Klmgrv equatis 6. Stchastic Differetial Equatis Csider the stchastic differetial equati: dx(t) =a(t X(t)) dt + (t X(t)) db(t): (SDE) Here a(t x) ad (t x) are give fuctis,
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationChapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo
More informationThe Excel FFT Function v1.1 P. T. Debevec February 12, The discrete Fourier transform may be used to identify periodic structures in time ht.
The Excel FFT Fucti v P T Debevec February 2, 26 The discrete Furier trasfrm may be used t idetify peridic structures i time ht series data Suppse that a physical prcess is represeted by the fucti f time,
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More informationParameter, Statistic and Random Samples
Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,
More informationBinomial Distribution
0.0 0.5 1.0 1.5 2.0 2.5 3.0 0 1 2 3 4 5 6 7 0.0 0.5 1.0 1.5 2.0 2.5 3.0 Overview Example: coi tossed three times Defiitio Formula Recall that a r.v. is discrete if there are either a fiite umber of possible
More informationCHAPTER 2. Mean This is the usual arithmetic mean or average and is equal to the sum of the measurements divided by number of measurements.
CHAPTER 2 umerical Measures Graphical method may ot always be sufficiet for describig data. You ca use the data to calculate a set of umbers that will covey a good metal picture of the frequecy distributio.
More informationChapter 22. Comparing Two Proportions. Copyright 2010 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010 Pearso Educatio, Ic. Comparig Two Proportios Comparisos betwee two percetages are much more commo tha questios about isolated percetages. Ad they are more
More informationIntroduction to Econometrics (3 rd Updated Edition) Solutions to Odd- Numbered End- of- Chapter Exercises: Chapter 3
Itroductio to Ecoometrics (3 rd Updated Editio) by James H. Stock ad Mark W. Watso Solutios to Odd- Numbered Ed- of- Chapter Exercises: Chapter 3 (This versio August 17, 014) 015 Pearso Educatio, Ic. Stock/Watso
More informationActive redundancy allocation in systems. R. Romera; J. Valdés; R. Zequeira*
Wrkig Paper -6 (3) Statistics ad Ecmetrics Series March Departamet de Estadística y Ecmetría Uiversidad Carls III de Madrid Calle Madrid, 6 893 Getafe (Spai) Fax (34) 9 64-98-49 Active redudacy allcati
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More information, which yields. where z1. and z2
The Gaussian r Nrmal PDF, Page 1 The Gaussian r Nrmal Prbability Density Functin Authr: Jhn M Cimbala, Penn State University Latest revisin: 11 September 13 The Gaussian r Nrmal Prbability Density Functin
More informationGrade 3 Mathematics Course Syllabus Prince George s County Public Schools
Ctet Grade 3 Mathematics Curse Syllabus Price Gerge s Cuty Public Schls Prerequisites: Ne Curse Descripti: I Grade 3, istructial time shuld fcus fur critical areas: (1) develpig uderstadig f multiplicati
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationOutline Map Activity. Regional Atlas Activity A. Name Date Class
Name Date Class Outlie Map Activity Regial Atlas Activity A Directis: O the map belw, draw the crrect brders f Russia. Label Russia ad the ctiets that are shw. The clr Russia red, the water blue, ad the
More informationMulti-objective Programming Approach for. Fuzzy Linear Programming Problems
Applied Mathematical Scieces Vl. 7 03. 37 8-87 HIKARI Ltd www.m-hikari.cm Multi-bective Prgrammig Apprach fr Fuzzy Liear Prgrammig Prblems P. Padia Departmet f Mathematics Schl f Advaced Scieces VIT Uiversity
More informationFinal Review for MATH 3510
Fial Review for MATH 50 Calculatio 5 Give a fairly simple probability mass fuctio or probability desity fuctio of a radom variable, you should be able to compute the expected value ad variace of the variable
More informationA Hartree-Fock Calculation of the Water Molecule
Chemistry 460 Fall 2017 Dr. Jea M. Stadard Nvember 29, 2017 A Hartree-Fck Calculati f the Water Mlecule Itrducti A example Hartree-Fck calculati f the water mlecule will be preseted. I this case, the water
More information[1 & α(t & T 1. ' ρ 1
NAME 89.304 - IGNEOUS & METAMORPHIC PETROLOGY DENSITY & VISCOSITY OF MAGMAS I. Desity The desity (mass/vlume) f a magma is a imprtat parameter which plays a rle i a umber f aspects f magma behavir ad evluti.
More informationAP Statistics Notes Unit Two: The Normal Distributions
AP Statistics Ntes Unit Tw: The Nrmal Distributins Syllabus Objectives: 1.5 The student will summarize distributins f data measuring the psitin using quartiles, percentiles, and standardized scres (z-scres).
More informationModule 1 Fundamentals in statistics
Normal Distributio Repeated observatios that differ because of experimetal error ofte vary about some cetral value i a roughly symmetrical distributio i which small deviatios occur much more frequetly
More informationApril 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE
April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE TERRY SOO Abstract These otes are adapted from whe I taught Math 526 ad meat to give a quick itroductio to cofidece
More informationIdentical Particles. We would like to move from the quantum theory of hydrogen to that for the rest of the periodic table
We wuld like t ve fr the quatu thery f hydrge t that fr the rest f the peridic table Oe electr at t ultielectr ats This is cplicated by the iteracti f the electrs with each ther ad by the fact that the
More informationEco411 Lab: Central Limit Theorem, Normal Distribution, and Journey to Girl State
Eco411 Lab: Cetral Limit Theorem, Normal Distributio, ad Jourey to Girl State 1. Some studets may woder why the magic umber 1.96 or 2 (called critical values) is so importat i statistics. Where do they
More information2 1. The r.s., of size n2, from population 2 will be. 2 and 2. 2) The two populations are independent. This implies that all of the n1 n2
Chapter 8 Comparig Two Treatmets Iferece about Two Populatio Meas We wat to compare the meas of two populatios to see whether they differ. There are two situatios to cosider, as show i the followig examples:
More informationClass 23. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700
Class 23 Daiel B. Rowe, Ph.D. Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 2017 by D.B. Rowe 1 Ageda: Recap Chapter 9.1 Lecture Chapter 9.2 Review Exam 6 Problem Solvig Sessio. 2
More informationStatistical Intervals for a Single Sample
3/5/06 Applied Statistics ad Probability for Egieers Sixth Editio Douglas C. Motgomery George C. Ruger Chapter 8 Statistical Itervals for a Sigle Sample 8 CHAPTER OUTLINE 8- Cofidece Iterval o the Mea
More informationChapter 6. Sampling and Estimation
Samplig ad Estimatio - 34 Chapter 6. Samplig ad Estimatio 6.. Itroductio Frequetly the egieer is uable to completely characterize the etire populatio. She/he must be satisfied with examiig some subset
More informationDirection: This test is worth 150 points. You are required to complete this test within 55 minutes.
Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem
More informationConfidence Intervals
Cofidece Itervals Berli Che Deartmet of Comuter Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Referece: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chater 5 & Teachig Material Itroductio
More informationSTA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to:
STA 2023 Module 10 Comparig Two Proportios Learig Objectives Upo completig this module, you should be able to: 1. Perform large-sample ifereces (hypothesis test ad cofidece itervals) to compare two populatio
More informationPhysical Chemistry Laboratory I CHEM 445 Experiment 2 Partial Molar Volume (Revised, 01/13/03)
Physical Chemistry Labratry I CHEM 445 Experimet Partial Mlar lume (Revised, 0/3/03) lume is, t a gd apprximati, a additive prperty. Certaily this apprximati is used i preparig slutis whse ccetratis are
More information(7 One- and Two-Sample Estimation Problem )
34 Stat Lecture Notes (7 Oe- ad Two-Sample Estimatio Problem ) ( Book*: Chapter 8,pg65) Probability& Statistics for Egieers & Scietists By Walpole, Myers, Myers, Ye Estimatio 1 ) ( ˆ S P i i Poit estimate:
More informationCentral Limit Theorem the Meaning and the Usage
Cetral Limit Theorem the Meaig ad the Usage Covetio about otatio. N, We are usig otatio X is variable with mea ad stadard deviatio. i lieu of sayig that X is a ormal radom Assume a sample of measuremets
More informationSTAT 515 fa 2016 Lec Sampling distribution of the mean, part 2 (central limit theorem)
STAT 515 fa 2016 Lec 15-16 Samplig distributio of the mea, part 2 cetral limit theorem Karl B. Gregory Moday, Sep 26th Cotets 1 The cetral limit theorem 1 1.1 The most importat theorem i statistics.............
More informationAn Investigation of Stratified Jackknife Estimators Using Simulated Establishment Data Under an Unequal Probability Sample Design
Secti Survey Research Methds SM 9 A Ivestigati f Stratified ackkife Estimatrs Usig Simulated Establishmet Data Uder a Uequal Prbability Sample Desig Abstract Plip Steel, Victria McNerey, h Slata Csiderig
More informationAgreement of CI and HT. Lecture 13 - Tests of Proportions. Example - Waiting Times
Sigificace level vs. cofidece level Agreemet of CI ad HT Lecture 13 - Tests of Proportios Sta102 / BME102 Coli Rudel October 15, 2014 Cofidece itervals ad hypothesis tests (almost) always agree, as log
More informationEvery gas consists of a large number of small particles called molecules moving with very high velocities in all possible directions.
Kietic thery f gases ( Kietic thery was develped by Berlli, Jle, Clasis, axwell ad Bltzma etc. ad represets dyamic particle r micrscpic mdel fr differet gases sice it thrws light the behir f the particles
More informationUNIVERSITY OF TECHNOLOGY. Department of Mathematics PROBABILITY THEORY, STATISTICS AND OPERATIONS RESEARCH GROUP. Memorandum COSOR 76-10
EI~~HOVEN UNIVERSITY OF TECHNOLOGY Departmet f Mathematics PROBABILITY THEORY, STATISTICS AND OPERATIONS RESEARCH GROUP Memradum COSOR 76-10 O a class f embedded Markv prcesses ad recurrece by F.H. Sims
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationChapter 4. Problem Solutions
Chapter 4. Prblem Slutis. The great majrity f alpha particles pass thrugh gases ad thi metal fils with deflectis. T what cclusi abut atmic structure des this bservati lead? The fact that mst particles
More informationSTAT431 Review. X = n. n )
STAT43 Review I. Results related to ormal distributio Expected value ad variace. (a) E(aXbY) = aex bey, Var(aXbY) = a VarX b VarY provided X ad Y are idepedet. Normal distributios: (a) Z N(, ) (b) X N(µ,
More informationOctober 25, 2018 BIM 105 Probability and Statistics for Biomedical Engineers 1
October 25, 2018 BIM 105 Probability ad Statistics for Biomedical Egieers 1 Populatio parameters ad Sample Statistics October 25, 2018 BIM 105 Probability ad Statistics for Biomedical Egieers 2 Ifereces
More informationSTAT 203 Chapter 18 Sampling Distribution Models
STAT 203 Chapter 18 Samplig Distributio Models Populatio vs. sample, parameter vs. statistic Recall that a populatio cotais the etire collectio of idividuals that oe wats to study, ad a sample is a subset
More informationExample: Find the SD of the set {x j } = {2, 4, 5, 8, 5, 11, 7}.
1 (*) If a lot of the data is far from the mea, the may of the (x j x) 2 terms will be quite large, so the mea of these terms will be large ad the SD of the data will be large. (*) I particular, outliers
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationKLMED8004 Medical statistics. Part I, autumn Estimation. We have previously learned: Population and sample. New questions
We have previously leared: KLMED8004 Medical statistics Part I, autum 00 How kow probability distributios (e.g. biomial distributio, ormal distributio) with kow populatio parameters (mea, variace) ca give
More informationStatistical inference: example 1. Inferential Statistics
Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either
More informationPH 425 Quantum Measurement and Spin Winter SPINS Lab 1
PH 425 Quatum Measuremet ad Spi Witer 23 SPIS Lab Measure the spi projectio S z alog the z-axis This is the experimet that is ready to go whe you start the program, as show below Each atom is measured
More informationStatistics 20: Final Exam Solutions Summer Session 2007
1. 20 poits Testig for Diabetes. Statistics 20: Fial Exam Solutios Summer Sessio 2007 (a) 3 poits Give estimates for the sesitivity of Test I ad of Test II. Solutio: 156 patiets out of total 223 patiets
More informationLecture 21: Signal Subspaces and Sparsity
ECE 830 Fall 00 Statistical Sigal Prcessig istructr: R. Nwak Lecture : Sigal Subspaces ad Sparsity Sigal Subspaces ad Sparsity Recall the classical liear sigal mdel: X = H + w, w N(0, where S = H, is a
More informationLesson 10: Limits and Continuity
www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationInternal vs. external validity. External validity. Internal validity
Secti 7 Mdel Assessmet Iteral vs. exteral validity Iteral validity refers t whether the aalysis is valid fr the pplati ad sample beig stdied. Exteral validity refers t whether these reslts ca be geeralized
More informationWorking with Two Populations. Comparing Two Means
Workig with Two Populatios Comparig Two Meas Coditios for Two-Sample Iferece The data are from two radom samples from two distict idepedet populatios. Normality. Two sample t procedures are more robust
More informationInferential Statistics. Inference Process. Inferential Statistics and Probability a Holistic Approach. Inference Process.
Iferetial Statistics ad Probability a Holistic Approach Iferece Process Chapter 8 Poit Estimatio ad Cofidece Itervals This Course Material by Maurice Geraghty is licesed uder a Creative Commos Attributio-ShareAlike
More informationOverview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions
Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples
More informationENGI 4421 Probability and Statistics Faculty of Engineering and Applied Science Problem Set 1 Solutions Descriptive Statistics. None at all!
ENGI 44 Probability ad Statistics Faculty of Egieerig ad Applied Sciece Problem Set Solutios Descriptive Statistics. If, i the set of values {,, 3, 4, 5, 6, 7 } a error causes the value 5 to be replaced
More informationSUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical model for microarray data analysis
SUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical mdel fr micrarray data analysis David Rssell Department f Bistatistics M.D. Andersn Cancer Center, Hustn, TX 77030, USA rsselldavid@gmail.cm
More informationLecture 5. Materials Covered: Chapter 6 Suggested Exercises: 6.7, 6.9, 6.17, 6.20, 6.21, 6.41, 6.49, 6.52, 6.53, 6.62, 6.63.
STT 315, Summer 006 Lecture 5 Materials Covered: Chapter 6 Suggested Exercises: 67, 69, 617, 60, 61, 641, 649, 65, 653, 66, 663 1 Defiitios Cofidece Iterval: A cofidece iterval is a iterval believed to
More information