Joint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { }
|
|
- Sabina Harrison
- 6 years ago
- Views:
Transcription
1 UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig 4 Chapter 5 Joit Probability Distributios ad Radom Samples Slide Slide 5. Joitly Distributed Radom Variables Slide Joit Probability Mass Fuctio Let ad Y be two discrete rv s defied o the sample space of a eperimet. The joit probability mass fuctio p(, is defied for each pair of umbers (, by p( y, ) = P ( = ad Y= Let A be the set cosistig of pairs of (, values, the P (, Y) A = p(, ( y, ) A Slide 4 Margial Probability Mass Fuctios The margial probability mass fuctios of ad Y, deoted p () ad p Y ( are give by p ( ) = p(, p ( = p(, y Slide 5 Y Joit Probability Desity Fuctio Let ad Y be cotiuous rv s. The f (, is a joit probability desity fuctio for ad Y if for ay two-dimesioal set A ( ) P, Y A = f(, ddy If A is the two-dimesioal rectagle ( y, ): a bc, y d, { } ( ) P, Y A = f(, dyd A bd ac Slide 6
2 (, ) P Y A f ( y, ) A = shaded rectagle = Volume uder desity surface above A Margial Probability Desity Fuctios The margial probability desity fuctios of ad Y, deoted f () ad f Y (, are give by f ( ) = f(, dy for < < f ( = f(, d for < y< Y Slide 7 Slide 8 Idepedet Radom Variables Two radom variables ad Y are said to be idepedet if for every pair of ad y values p( y, ) = p( ) py( whe ad Y are discrete or f ( y, ) = f( ) fy( whe ad Y are cotiuous. If the coditios are ot satisfied for all (, the ad Y are depedet. Slide 9 More Tha Two Radom Variables If,,, are all discrete radom variables, the joit pmf of the variables is the fuctio p(,..., ) = P( =,..., = ) If the variables are cotiuous, the joit pdf is the fuctio f such that for ay itervals [a,b ],,[a,b ], Pa ( b,..., a b) b a b =... f(,..., ) d... d a Slide Idepedece More Tha Two Radom Variables The radom variables,,, are idepedet if for every subset,,..., of the variables, the joit pmf or pdf of the subset is equal to the product of the margial pmf s or pdf s. i i i Coditioal Probability Fuctio Let ad Y be two cotiuous rv s with joit pdf f (, ad margial pdf f (). The for ay value for which f () >, the coditioal probability desity fuctio of Y give that = is f(, fy ( y ) = y f ( ) < < If ad Y are discrete, replacig pdf s by pmf s gives the coditioal probability mass fuctio of Y whe =. Slide Slide
3 Margial probability distributios (Cot.) If ad Y are discrete radom variables with joit probability mass fuctio f Y (,, the the margial probability mass fuctio of ad Y are f ( ) = P( = ) = f Y (, Y ) f Y ( = P( Y = = f Y (, Y ) where R deotes the set of all poits i the rage of (, Y) for which = ad Ry deotes the set of all poits i the rage of (, Y) for which Y = y R Ry Mea ad Variace If the margial probability distributio of has the probability fuctio f(), the E ( ) = µ = = f ( ) f Y (, = f Y (, R R V ( = = R ) = σ R f (, Y = ( µ ) f ( µ ) (, = R = Set of all poits i the rage of (,Y). Eample 5-4. Y f ( ) = R ( µ ) ( µ ) f Y R (, f Y (, Slide Slide 4 Joit probability mass fuctio eample The joit desity, P{,Y}, of the umber of miutes waitig to catch the first fish,, ad the umber of miutes waitig to catch the secod fish, Y, is give below. P { = i,y = k } k Row Sum P{ = i }...8. i Colum Sum P {Y =k } The (joit) chace of waitig miutes to catch the first fish ad miutes to catch the secod fish is: The (margial) chace of waitig miutes to catch the first fish is: The (margial) chace of waitig miutes to catch the first fish is (circle all that are correct): The chace of waitig at least two miutes to catch the first fish is (circle oe, oe or more): The chace of waitig at most two miutes to catch the first fish ad at most two miutes to catch the secod fish is (circle oe, oe or more): Slide 5 Coditioal probability Give discrete radom variables ad Y with joit probability mass fuctio f Y (,Y), the coditioal probability mass fuctio of Y give = is f Y (y ) = f Y ( = f Y (,/f () for f () > Slide 6 Coditioal probability (Cot.) Because a coditioal probability mass fuctio f Y ( is a probability mass fuctio for all y i R, the followig properties are satisfied: () f Y ( () f Y ( = R () P(Y=y =) = f Y ( Slide 7 Slide 8
4 Coditioal probability (Cot.) Let R deote the set of all poits i the rage of (,Y) for which =. The coditioal mea of Y give =, deoted as E(Y ) or µ Y, is E ( Y ) = yf Y ( R Ad the coditioal variace of Y give =, deoted as V(Y ) or σ Y is V ( Y ) = ( y µ ) f ( = y f ( y µ Y Y Y ) R R Y Idepedece For discrete radom variables ad Y, if ay oe of the followig properties is true, the others are also true, ad ad Y are idepedet. () f Y (, = f () f Y ( for all ad y () f Y ( = f Y ( for all ad y with f () > () f y ( = f () for all ad y with f Y ( > (4) P( A, Y B) = P( A)P(Y B) for ay sets A ad B i the rage of ad Y respectively. Slide 9 Slide Epected Value 5. Epected Values, Covariace, ad Correlatio Slide Let ad Y be joitly distributed rv s with pmf p(, or pdf f (, accordig to whether the variables are discrete or cotiuous. The the epected value of a fuctio h(, Y), deoted E[h(, Y)] or µ h (, Y ) is hy (, ) py (, ) discrete y = h(, f (, ddy cotiuous Slide Covariace The covariace betwee two rv s ad Y is ( Y) = E ( µ )( Y µ ) Cov, Y ( µ )( y µ Y) p(, discrete y = ( µ )( y µ Y) f(, ddy cotiuous Short-cut Formula for Covariace ( ) ( ) Cov Y, = E Y µ µ Y Slide Slide 4 4
5 Correlatio The correlatio coefficiet of ad Y, deoted by Corr(, Y), ρy,, or just ρ, is defied by Cov (, Y ) ρ Y, = σ σ Y Correlatio Propositio. If a ad c are either both positive or both egative, Corr(a + b, cy + d) = Corr(, Y). For ay two rv s ad Y, Corr( Y, ). Slide 5 Slide 6 Correlatio Propositio. If ad Y are idepedet, the ρ =, but ρ = does ot imply idepedece.. ρ = or iff Y = a + b for some umbers a ad b with a. 5. Statistics ad their Distributios Slide 7 Slide 8 Statistic A statistic is ay quatity whose value ca be calculated from sample data. Prior to obtaiig data, there is ucertaity as to what value of ay particular statistic will result. A statistic is a radom variable deoted by a uppercase letter; a lowercase letter is used to represet the calculated or observed value of the statistic. Radom Samples The rv s,, are said to form a (simple radom sample of size if. The i s are idepedet rv s.. Every i has the same probability distributio. Slide 9 Slide 5
6 Simulatio Eperimets The followig characteristics must be specified:. The statistic of iterest.. The populatio distributio.. The sample size. 4. The umber of replicatios k. 5.4 The Distributio of the Sample Mea Slide Slide Usig the Sample Mea Let,, be a radom sample from a distributio with mea value µ ad stadard deviatio σ. The ( ) ( ). E. V = µ = µ = σ = σ Normal Populatio Distributio Let,, be a radom sample from a ormal distributio with mea value µ ad stadard deviatio σ. The for ay, is ormally distributed, as is T o. I additio, with T o = + +, E T = µ, V T = σ,ad σ = σ. ( ) ( ) o o T o Slide Slide 4 The Cetral Limit Theorem Let,, be a radom sample from a distributio with mea value µ ad variace σ. The if sufficietly large, has approimately a ormal distributio with µ = µ ad σ = σ, ad T o also has approimately a ormal distributio with µ T = µ, σ. o T = σ The larger the value of o, the better the approimatio. Populatio distributio The Cetral Limit Theorem small to moderate µ large Slide 5 Slide 6 6
7 Rule of Thumb If >, the Cetral Limit Theorem ca be used. Approimate Logormal Distributio Let,, be a radom sample from a distributio for which oly positive values are possible [P(i > ) = ]. The if is sufficietly large, the product Y = has approimately a logormal distributio. Slide 7 Slide The Distributio of a Liear Combiatio Liear Combiatio Give a collectio of radom variables,, ad umerical costats a,,a, the rv Y = a a = aii i= is called a liear combiatio of the i s. Slide 9 Slide 4 Epected Value of a Liear Combiatio Let,, have mea values µ, µ,..., µ ad variaces of σ, σ,..., σ, respectively Whether or ot the i s are idepedet, ( ) = ( ) ( ) E a a ae ae = a µ + + a µ... Variace of a Liear Combiatio If,, are idepedet, ( ) = ( ) ( ) V a a a V a V ad σ... aσ = a + + a a = a a σ σ σ Slide 4 Slide 4 7
8 Variace of a Liear Combiatio For ay,,, V a... a aa Cov, ( + + ) = i j ( i j) i= j= Differece Betwee Two Radom Variables ( ) = ( ) ( ) E E E ad, if ad are idepedet, ( ) = ( ) + ( ) V V V Slide 4 Slide 44 Differece Betwee Normal Radom Variables If,, are idepedet, ormally distributed rv s, the ay liear combiatio of the i s also has a ormal distributio. The differece betwee two idepedet, ormally distributed variables is itself ormally distributed. Cetral Limit Theorem heuristic formulatio Cetral Limit Theorem: Whe samplig from almost ay distributio, is approimately Normally distributed i large samples. Show Samplig Distributio Simulatio Applet: file:///c:/ivo.dir/ucla_classes/witer/additioalistructoraids/ SampligDistributioApplet.html Slide 45 Slide 46 Idepedece For discrete radom variables ad Y, if ay oe of the followig properties is true, the others are also true, ad ad Y are idepedet. () f Y (, = f () f Y ( for all ad y () f Y ( = f Y ( for all ad y with f () > () f y ( = f () for all ad y with f Y ( > (4) P( A, Y B) = P( A)P(Y B) for ay sets A ad B i the rage of ad Y respectively. Slide 47 Slide 48 8
9 Recall we looked at the samplig distributio of Cetral Limit Effect Histograms of sample meas Triagular Distributio For the sample mea calculated from a radom sample, E( ) = µ ad SD( ) = σ, provided = ( )/, ad k ~N(µ, σ). The σ ~ N(µ, ). Ad variability from sample to sample i the sample-meas is give by the variability of the idividual observatios divided by the square root of the sample-size. I a way, averagig decreases variability. Slide 49 = Y= Area = = Sample meas from sample size =, =, 5 samples Slide 5 Cetral Limit Effect -- Histograms of sample meas = Triagular Distributio Sample sizes =4, = Slide 5 = Cetral Limit Effect Histograms of sample meas = Sample meas from sample size =, =, 5 samples Uiform Distributio = Y = Area = Slide 5 Stat A, UCLA, Diov Ivo Cetral Limit Effect -- Histograms of sample meas = Uiform Distributio Sample sizes =4, = 4 Slide 5 = Cetral Limit Effect Histograms of sample meas = Sample meas from sample size =, =, 5 samples Slide Epoetial Distributio e, [, ) =. 4 Area = 9
10 Cetral Limit Effect -- Histograms of sample meas = 4 Epoetial Distributio Sample sizes =4, = Slide 55 =. Cetral Limit Effect Histograms of sample meas = Sample meas from sample size =, =, 5 samples Slide 56 Quadratic U Distributio = ( ), [, ] Y = Area = Cetral Limit Effect -- Histograms of sample meas = 4 Quadratic U Distributio Sample sizes =4, = = Cetral Limit Theorem heuristic formulatio Cetral Limit Theorem: Whe samplig from almost ay distributio, is approimately Normally distributed i large samples. Show Samplig Distributio Simulatio Applet: file:///c:/ivo.dir/ucla_classes/witer/additioalistructoraids/ SampligDistributioApplet.html Slide 57 Slide 58 Cetral Limit Theorem theoretical formulatio { } Let,,...,,... be a sequece of idepedet k observatios from oe specific radom process. Let ad E( ) = µ ad SD( ) = σ ad both be fiite ( < σ < ; µ < ). If =, sample-avg, k = k The has a distributio which approaches N(µ, σ /), as. Slide 59
CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More information4. Basic probability theory
Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio
More informationDiscrete Random Variables and Probability Distributions. Random Variables. Discrete Models
UCLA STAT 35 Applied Computatioal ad Iteractive Probability Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Chris Barr Uiversity of Califoria, Los Ageles, Witer 006 http://www.stat.ucla.edu/~diov/
More informationProbability and statistics: basic terms
Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationBackground Information
Egieerig 33 Gayheart 5-63 1 Beautif ul Homework 5-63 Suppose t h a t whe t h e ph of a c e r t a i c h e m i c a l compoud i s 5.00, t h e ph measured by a radomly s e l e c t e d begiig chemistry studet
More informationSTATISTICAL METHODS FOR BUSINESS
STATISTICAL METHODS FOR BUSINESS UNIT 5. Joit aalysis ad limit theorems. 5.1.- -dimesio distributios. Margial ad coditioal distributios 5.2.- Sequeces of idepedet radom variables. Properties 5.3.- Sums
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationProbability and Distributions. A Brief Introduction
Probability ad Distributios A Brief Itroductio Radom Variables Radom Variable (RV): A umeric outcome that results from a experimet For each elemet of a experimet s sample space, the radom variable ca take
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationEcon 325: Introduction to Empirical Economics
Eco 35: Itroductio to Empirical Ecoomics Lecture 3 Discrete Radom Variables ad Probability Distributios Copyright 010 Pearso Educatio, Ic. Publishig as Pretice Hall Ch. 4-1 4.1 Itroductio to Probability
More informationSome Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables
Some Basic Probability Cocepts 2. Experimets, Outcomes ad Radom Variables A radom variable is a variable whose value is ukow util it is observed. The value of a radom variable results from a experimet;
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. Comments:
Recall: STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Commets:. So far we have estimates of the parameters! 0 ad!, but have o idea how good these estimates are. Assumptio: E(Y x)! 0 +! x (liear coditioal
More informationIE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes.
Closed book ad otes. No calculators. 120 miutes. Cover page, five pages of exam, ad tables for discrete ad cotiuous distributios. Score X i =1 X i / S X 2 i =1 (X i X ) 2 / ( 1) = [i =1 X i 2 X 2 ] / (
More informationNotation List. For Cambridge International Mathematics Qualifications. For use from 2020
Notatio List For Cambridge Iteratioal Mathematics Qualificatios For use from 2020 Notatio List for Cambridge Iteratioal Mathematics Qualificatios (For use from 2020) Mathematical otatio Eamiatios for CIE
More informationBHW #13 1/ Cooper. ENGR 323 Probabilistic Analysis Beautiful Homework # 13
BHW # /5 ENGR Probabilistic Aalysis Beautiful Homework # Three differet roads feed ito a particular freeway etrace. Suppose that durig a fixed time period, the umber of cars comig from each road oto the
More informationUCLA STAT 110B Applied Statistics for Engineering and the Sciences
UCLA STAT 110B Applied Statistics for Egieerig ad the Scieces Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistats: Bria Ng, UCLA Statistics Uiversity of Califoria, Los Ageles,
More informationCH5. Discrete Probability Distributions
CH5. Discrete Probabilit Distributios Radom Variables A radom variable is a fuctio or rule that assigs a umerical value to each outcome i the sample space of a radom eperimet. Nomeclature: - Capital letters:
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationModeling and Performance Analysis with Discrete-Event Simulation
Simulatio Modelig ad Performace Aalysis with Discrete-Evet Simulatio Chapter 5 Statistical Models i Simulatio Cotets Basic Probability Theory Cocepts Useful Statistical Models Discrete Distributios Cotiuous
More informationLecture 18: Sampling distributions
Lecture 18: Samplig distributios I may applicatios, the populatio is oe or several ormal distributios (or approximately). We ow study properties of some importat statistics based o a radom sample from
More informationStat 200 -Testing Summary Page 1
Stat 00 -Testig Summary Page 1 Mathematicias are like Frechme; whatever you say to them, they traslate it ito their ow laguage ad forthwith it is somethig etirely differet Goethe 1 Large Sample Cofidece
More informationNOTES ON DISTRIBUTIONS
NOTES ON DISTRIBUTIONS MICHAEL N KATEHAKIS Radom Variables Radom variables represet outcomes from radom pheomea They are specified by two objects The rage R of possible values ad the frequecy fx with which
More informationSampling Error. Chapter 6 Student Lecture Notes 6-1. Business Statistics: A Decision-Making Approach, 6e. Chapter Goals
Chapter 6 Studet Lecture Notes 6-1 Busiess Statistics: A Decisio-Makig Approach 6 th Editio Chapter 6 Itroductio to Samplig Distributios Chap 6-1 Chapter Goals After completig this chapter, you should
More informationNANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS
NANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS STRUCTURE OF EXAMINATION PAPER. There will be oe 2-hour paper cosistig of 4 questios.
More informationLast time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object
6.3 Stochastic Estimatio ad Cotrol, Fall 004 Lecture 7 Last time: Momets of the Poisso distributio from its geeratig fuctio. Gs () e dg µ e ds dg µ ( s) µ ( s) µ ( s) µ e ds dg X µ ds X s dg dg + ds ds
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More informationAdvanced Engineering Mathematics Exercises on Module 4: Probability and Statistics
Advaced Egieerig Mathematics Eercises o Module 4: Probability ad Statistics. A survey of people i give regio showed that 5% drak regularly. The probability of death due to liver disease, give that a perso
More informationLecture 3. Properties of Summary Statistics: Sampling Distribution
Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary
More informationModule 1 Fundamentals in statistics
Normal Distributio Repeated observatios that differ because of experimetal error ofte vary about some cetral value i a roughly symmetrical distributio i which small deviatios occur much more frequetly
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationz is the upper tail critical value from the normal distribution
Statistical Iferece drawig coclusios about a populatio parameter, based o a sample estimate. Populatio: GRE results for a ew eam format o the quatitative sectio Sample: =30 test scores Populatio Samplig
More informationThe variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.
SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample
More informationProbability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].
Probability 2 - Notes 0 Some Useful Iequalities. Lemma. If X is a radom variable ad g(x 0 for all x i the support of f X, the P(g(X E[g(X]. Proof. (cotiuous case P(g(X Corollaries x:g(x f X (xdx x:g(x
More informationBinomial Distribution
0.0 0.5 1.0 1.5 2.0 2.5 3.0 0 1 2 3 4 5 6 7 0.0 0.5 1.0 1.5 2.0 2.5 3.0 Overview Example: coi tossed three times Defiitio Formula Recall that a r.v. is discrete if there are either a fiite umber of possible
More informationParameter, Statistic and Random Samples
Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,
More informationTest of Statistics - Prof. M. Romanazzi
1 Uiversità di Veezia - Corso di Laurea Ecoomics & Maagemet Test of Statistics - Prof. M. Romaazzi 19 Jauary, 2011 Full Name Matricola Total (omial) score: 30/30 (2 scores for each questio). Pass score:
More information17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15
17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More information(6) Fundamental Sampling Distribution and Data Discription
34 Stat Lecture Notes (6) Fudametal Samplig Distributio ad Data Discriptio ( Book*: Chapter 8,pg5) Probability& Statistics for Egieers & Scietists By Walpole, Myers, Myers, Ye 8.1 Radom Samplig: Populatio:
More informationBasis for simulation techniques
Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios
More informationCHAPTER 8 FUNDAMENTAL SAMPLING DISTRIBUTIONS AND DATA DESCRIPTIONS. 8.1 Random Sampling. 8.2 Some Important Statistics
CHAPTER 8 FUNDAMENTAL SAMPLING DISTRIBUTIONS AND DATA DESCRIPTIONS 8.1 Radom Samplig The basic idea of the statistical iferece is that we are allowed to draw ifereces or coclusios about a populatio based
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationPROBABILITY DISTRIBUTION RELATIONSHIPS. Y.H. Abdelkader, Z.A. Al-Marzouq 1. INTRODUCTION
STATISTICA, ao LXX,., 00 PROBABILITY DISTRIBUTION RELATIONSHIPS. INTRODUCTION I spite of the variety of the probability distributios, may of them are related to each other by differet kids of relatioship.
More informationChapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation
Chapter Output Aalysis for a Sigle Model Baks, Carso, Nelso & Nicol Discrete-Evet System Simulatio Error Estimatio If {,, } are ot statistically idepedet, the S / is a biased estimator of the true variace.
More informationEE 4TM4: Digital Communications II Probability Theory
1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationSTA 4032 Final Exam Formula Sheet
Chapter 2. Probability STA 4032 Fial Eam Formula Sheet Some Baic Probability Formula: (1) P (A B) = P (A) + P (B) P (A B). (2) P (A ) = 1 P (A) ( A i the complemet of A). (3) If S i a fiite ample pace
More informationLecture 11 and 12: Basic estimation theory
Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis
More informationStat 319 Theory of Statistics (2) Exercises
Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.
More informationIE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes.
IE 230 Seat # Name < KEY > Please read these directios. Closed book ad otes. 60 miutes. Covers through the ormal distributio, Sectio 4.7 of Motgomery ad Ruger, fourth editio. Cover page ad four pages of
More informationComparing Two Populations. Topic 15 - Two Sample Inference I. Comparing Two Means. Comparing Two Pop Means. Background Reading
Topic 15 - Two Sample Iferece I STAT 511 Professor Bruce Craig Comparig Two Populatios Research ofte ivolves the compariso of two or more samples from differet populatios Graphical summaries provide visual
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More information1 The Haar functions and the Brownian motion
1 The Haar fuctios ad the Browia motio 1.1 The Haar fuctios ad their completeess The Haar fuctios The basic Haar fuctio is 1 if x < 1/2, ψx) = 1 if 1/2 x < 1, otherwise. 1.1) It has mea zero 1 ψx)dx =,
More informationHOMEWORK I: PREREQUISITES FROM MATH 727
HOMEWORK I: PREREQUISITES FROM MATH 727 Questio. Let X, X 2,... be idepedet expoetial radom variables with mea µ. (a) Show that for Z +, we have EX µ!. (b) Show that almost surely, X + + X (c) Fid the
More informationBayesian Methods: Introduction to Multi-parameter Models
Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested
More informationLecture 23: Minimal sufficiency
Lecture 23: Miimal sufficiecy Maximal reductio without loss of iformatio There are may sufficiet statistics for a give problem. I fact, X (the whole data set) is sufficiet. If T is a sufficiet statistic
More informationCastiel, Supernatural, Season 6, Episode 18
13 Differetial Equatios the aswer to your questio ca best be epressed as a series of partial differetial equatios... Castiel, Superatural, Seaso 6, Episode 18 A differetial equatio is a mathematical equatio
More informationMathematical Statistics - MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More informationElements of Statistical Methods Lots of Data or Large Samples (Ch 8)
Elemets of Statistical Methods Lots of Data or Large Samples (Ch 8) Fritz Scholz Sprig Quarter 2010 February 26, 2010 x ad X We itroduced the sample mea x as the average of the observed sample values x
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationChapter 2 The Monte Carlo Method
Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationClosed book and notes. No calculators. 60 minutes, but essentially unlimited time.
IE 230 Seat # Closed book ad otes. No calculators. 60 miutes, but essetially ulimited time. Cover page, four pages of exam, ad Pages 8 ad 12 of the Cocise Notes. This test covers through Sectio 4.7 of
More informationLecture 5. Random variable and distribution of probability
Itroductio to theory of probability ad statistics Lecture 5. Radom variable ad distributio of probability prof. dr hab.iż. Katarzya Zarzewsa Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe
More informationUCLA STAT 110B Applied Statistics for Engineering and the Sciences
UCLA SA 0B Applied Statistics for Egieerig ad the Scieces Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology eachig Assistats: Bria Ng, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig
More informationLinear Differential Equations of Higher Order Basic Theory: Initial-Value Problems d y d y dy
Liear Differetial Equatios of Higher Order Basic Theory: Iitial-Value Problems d y d y dy Solve: a( ) + a ( )... a ( ) a0( ) y g( ) + + + = d d d ( ) Subject to: y( 0) = y0, y ( 0) = y,..., y ( 0) = y
More informationhttp://www.xelca.l/articles/ufo_ladigsbaa_houte.aspx imulatio Output aalysis 3/4/06 This lecture Output: A simulatio determies the value of some performace measures, e.g. productio per hour, average queue
More informationAMS570 Lecture Notes #2
AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationBIOSTATISTICS. Lecture 5 Interval Estimations for Mean and Proportion. dr. Petr Nazarov
Microarray Ceter BIOSTATISTICS Lecture 5 Iterval Estimatios for Mea ad Proportio dr. Petr Nazarov 15-03-013 petr.azarov@crp-sate.lu Lecture 5. Iterval estimatio for mea ad proportio OUTLINE Iterval estimatios
More informationDirection: This test is worth 150 points. You are required to complete this test within 55 minutes.
Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationProbability and Statistics
Probability ad Statistics Cotets. Multi-dimesioal Gaussia radom variable. Gaussia radom process 3. Wieer process Why we eed to discuss Gaussia Process The most commo Accordig to the cetral limit theorem,
More informationSTAT 350 Handout 19 Sampling Distribution, Central Limit Theorem (6.6)
STAT 350 Hadout 9 Samplig Distributio, Cetral Limit Theorem (6.6) A radom sample is a sequece of radom variables X, X 2,, X that are idepedet ad idetically distributed. o This property is ofte abbreviated
More informationAppendix to: Hypothesis Testing for Multiple Mean and Correlation Curves with Functional Data
Appedix to: Hypothesis Testig for Multiple Mea ad Correlatio Curves with Fuctioal Data Ao Yua 1, Hog-Bi Fag 1, Haiou Li 1, Coli O. Wu, Mig T. Ta 1, 1 Departmet of Biostatistics, Bioiformatics ad Biomathematics,
More informationProbability and MLE.
10-701 Probability ad MLE http://www.cs.cmu.edu/~pradeepr/701 (brief) itro to probability Basic otatios Radom variable - referrig to a elemet / evet whose status is ukow: A = it will rai tomorrow Domai
More informationA PROBABILITY PRIMER
CARLETON COLLEGE A ROBABILITY RIMER SCOTT BIERMAN (Do ot quote without permissio) A robability rimer INTRODUCTION The field of probability ad statistics provides a orgaizig framework for systematically
More informationFormula Sheet. December 8, 2011
Formula Sheet December 8, 2011 Abtract I type thi for your coveice. There may be error. Ue at your ow rik. It i your repoible to check it i correct or ot before uig it. 1 Decriptive Statitic 1.1 Cetral
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationSection 14. Simple linear regression.
Sectio 14 Simple liear regressio. Let us look at the cigarette dataset from [1] (available to dowload from joural s website) ad []. The cigarette dataset cotais measuremets of tar, icotie, weight ad carbo
More informationSTAT 203 Chapter 18 Sampling Distribution Models
STAT 203 Chapter 18 Samplig Distributio Models Populatio vs. sample, parameter vs. statistic Recall that a populatio cotais the etire collectio of idividuals that oe wats to study, ad a sample is a subset
More informationSampling, Sampling Distribution and Normality
4/17/11 Tools of Busiess Statistics Samplig, Samplig Distributio ad ormality Preseted by: Mahedra Adhi ugroho, M.Sc Descriptive statistics Collectig, presetig, ad describig data Iferetial statistics Drawig
More informationSample Correlation. Mathematics 47: Lecture 5. Dan Sloughter. Furman University. March 10, 2006
Sample Correlatio Mathematics 47: Lecture 5 Da Sloughter Furma Uiversity March 10, 2006 Da Sloughter (Furma Uiversity) Sample Correlatio March 10, 2006 1 / 8 Defiitio If X ad Y are radom variables with
More informationLecture 20: Multivariate convergence and the Central Limit Theorem
Lecture 20: Multivariate covergece ad the Cetral Limit Theorem Covergece i distributio for radom vectors Let Z,Z 1,Z 2,... be radom vectors o R k. If the cdf of Z is cotiuous, the we ca defie covergece
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationof the matrix is =-85, so it is not positive definite. Thus, the first
BOSTON COLLEGE Departmet of Ecoomics EC771: Ecoometrics Sprig 4 Prof. Baum, Ms. Uysal Solutio Key for Problem Set 1 1. Are the followig quadratic forms positive for all values of x? (a) y = x 1 8x 1 x
More information