CH5. Discrete Probability Distributions
|
|
- Ilene Blair
- 5 years ago
- Views:
Transcription
1 CH5. Discrete Probabilit Distributios Radom Variables A radom variable is a fuctio or rule that assigs a umerical value to each outcome i the sample space of a radom eperimet. Nomeclature: - Capital letters: radom variables (e.g.,, ). - Lower case letters: values of the radom variable (e.g.,, ). A discrete radom variable has a coutable umber of distict values. Probabilit Distributios A discrete probabilit distributio assigs a probabilit to each value of a discrete radom variable. To be a valid probabilit, each probabilit must be betwee P ( i ) The sum of all the probabilities for the values of must be equal to uit. i = P ( ) = i or P ( ) = all E) Flip a Coi Three Times If is the umber of heads, the is a radom variable whose probabilit distributio is as follows: Possible Evets P() TTT /8 HTT, THT, TTH 3/8 HHT, HTH, THH 3/8 HHH 3 /8 Total What is a PDF (PMF) & CDF? A probabilit distributio (mass) fuctio (PDF/PMF) is a mathematical fuctio that shows the probabilit of each -value. P( ) = P( = ) A cumulative distributio fuctio (CDF) is a mathematical fuctio that shows the cumulative sum of probabilities, addig from the smallest to the largest -value, graduall approachig uit.
2 The cumulative distributio fuctio, F( ) of a radom variable epresses the probabilit that does ot eceed the value, as a fuctio of. Let be a discrete radom variable with probabilit fuctio P() ad cumulative probabilit fuctio F( ). The it ca be show that where the otatio implies that summatio is over all possible values that are less tha or equal to. Let be a discrete radom variable with a cumulative probabilit fuctio, F( ). The we ca show that F ( ) = P( ) F( ) = P( ) ) F( ) for ever umber ) If ad are two umbers with <, the F( ) F( ) E) roll of a fair sigle die (: the umber of dots o the roll of a die) P() / <Probabilit mass fuctio (pmf) plot> E) Let be a radom variable defied o the sample space resulted from flippig a fair coi. outcome P() F() Tail.5.5 Head.5 Epected Value The epected value E() of a discrete radom variable is the sum of all - values weighted b their respective probabilities.
3 If there are distict values of, i i i= all E ( ) =µ= P ( ) = P ( ) The E() is a measure of cetral tedec. Let be a discrete radom variable with probabilit fuctio P() ad let g() be some fuctio of. The the epected value, E[g()], of that fuctio is defied as Eg [ ( )] = gp ( ) ( ) Variace If there are distict values of, the the variace of a discrete radom variable is: ( ) = σ = [ i µ ] ( i) i= V P The stadard deviatio is the square root of the variace ad is deoted σ. σ= σ = V( ) The variace of a discrete radom variable ca be epressed as Proof σ = E ( ) µ = P ( ) µ E p ( µ ) = ( µ ) ( ) all = + p all ( µ µ ) ( ) = E( ) µ + µ = E( ) [ E( )] ) For a costat a : E( a) = a ad Var( a) = If a radom variable alwas takes the value a, it will have a mea a ad a variace. ) For a costat b ad a radom variable : E( b) = bµ ad Var( b) = b σ Let be a radom variable with mea µ, ad variace σ ; ad let a 3
4 ad b be a costat. Defie the radom variable = a +b. The, the mea ad variace of are µ = Ea ( + b) = a+ bµ σ = Var( a + b ) = b σ so that the stadard deviatio of is Epected Value Fuctio of Joitl Distributed Radom Variables Let ad be a pair of discrete radom variables with joit probabilit fuctio P(, ). The epectatio of a fuctio g(, ) of these radom variables is defied as: E [ g(, )] g(, ) P(, ) Covariace Let be a radom variable with mea µ, ad let be a radom variable with mea, µ. The epected value of ( - µ )( - µ ) is called the covariace betwee ad, deoted Cov (, ). For discrete radom variables A equivalet epressio is σ = bσ = Cov (, ) = E[( µ )( µ )] = ( µ )( µ ) P(, ) Cov (, ) = E( ) µ µ = P(, ) µ µ Proof Cov(, ) = ( µ )( µ ) P(, ) = ( µ µ + µ µ ) P(, ) = P (, ) µ P (, ) µ P (, ) + µ µ P (, ) = P(, ) µµ = E ( ) µµ P (, ) = p ( ) P( ) = µ P (, ) = 4
5 Correlatio Let ad be joitl distributed radom variables. The correlatio betwee ad is: Cov (, ) ρ = Corr (, ) = ( ρ ) σ σ ρ =: ρ = : ρ = : ad have a perfect positive liear relatioship. ad have a perfect egative liear relatioship. ad have o liear relatioship. <correlatio=?> <correlatio=?> <correlatio=?> It is possible for there to be a strog relatioship betwee two variables ad still have correlatio. 5
6 Questio) Corr(a+b, c+d)=? Cov( a + b, c + d) = (( a + b) ( aµ + b))(( c + d) ( cµ + d)) P(, ) = ac ( µ )( µ ) P(, ) = accov(, ) V a b a V ( + ) = ( ) Vc d cv ( + ) = ( ) ( +, + ) = (, )/ ( ) ( ) = accorr(, )/ ac Corr a b c d accov a V c V Covariace & Idepedece If two radom variables are statisticall idepedet, the covariace betwee them is (ucorrelated). However, the coverse is ot ecessaril true. Idepedece: P ( ) = PP ( ) ( ) Ucorrelated: E ( ) EE ( ) ( ) = Idepedece Ucorrelated E( ) = P( ) = P( ) P( ) = P( ) P ( ) = E ( ) E ( ) Ucorrelated, but depedet case
7 P(= ad =-)=/4, P(=)=/, P(=-)=/4 E()=, E()=, E()= Portfolio Aalsis The radom variable is the price for stock A ad the radom variable is the price for stock B. The market value, W, for the portfolio is give b the liear fuctio, W=a+b where, a, is the umber of shares of stock A ad, b, is the umber of shares of stock B. The mea value for W is, µ W = E[ W ] = E[ a + b ] = a + b proof The variace for W is, or usig the correlatio, σ E ) Cosider the prices of two stocks A ad B ( ad are Prices of stocks A ad B, respectivel). $ µ µ W = a σ + b σ + W = a σ + b σ Ea ( + b) = ap (, ) + bp (, ) = a P(, ) + b P(, ) = a P( ) + b P( ) = aµ + bµ abcov(, ) σ + abcorr(, ) σ σ σ = V ( a + b ) = E[( a + b ) ( aµ + bµ )] w = E a + b a + b a + b + a + b [( ) ( )( µ µ ) ( µ µ ) ] = a { E( ) µ } + b { E( ) µ } + ab{ E( ) µ µ } = a σ + b σ + abcov(, ) 7
8 () If ou bu 5 of A ad 4 of B, what is the epected value of this portfolio? E(5+4)= 3 3 = = (5 + 4 P ) (, ) = (5 + 4 ). + (5 + 4 ).5 + L+ ( ). () Calculate the covariace betwee two stocks. Cov(, ) = E( ) µ µ 3 µ = P( ) = (.7) + (.5) + 3(.33) =.6 = 3 µ = P( ) = (.3) + (.5) + 3(.7) =.4 = 3 3 E ( ) P (, ) = = = = ()(.) + ()(.5) + L+ 3(3)(.) = 4.65 (3) Calculate the correlatio betwee two stocks. Cov(, ) σ ( ) ρ = = E µ σ = E ( ) µ σσ 3 E ( ) = P ( ) = (.7) + (.5) + 3 (.33) = 3 E ( ) = P( ) = (.3) + (.5) + 3 (.7) = Uiform Distributio The uiform distributio describes a radom variable with a fiite umber of iteger values from a to b (the ol two parameters). P ( ) = b a +, = aa, +,... b Each value of the radom variable is equall likel to occur. E) The umber of dots o the roll of a die form a uiform radom variable with si equall likel iteger values:,, 3, 4, 5, 6 Questios: Rage of? PMF? Parameters? E()? V()? Beroulli Distributio A radom eperimet with ol outcomes is a Beroulli eperimet. Oe outcome is arbitraril labeled a success ( = ) ad the other a 8
9 failure ( = ). Psuccess ( ) = π, P( fail) = π ( ) =, =, P ( ) π ( π) Note that P() + P() = ad π For eample, toss a die, the give if the umber of dots o the roll of a die is odd. Otherwise give. The epected value (mea) of a Beroulli eperimet is calculated as: E ( ) = P ( ) = ()( π ) + ()( π) = π i= The variace of a Beroulli eperimet is calculated as: [ i ] i= i i V( ) = E( ) P( ) = ( π )( π) + ( π)( π) = π( π) i Biomial Distributio The biomial distributio arises whe a Beroulli eperimet is repeated times. Each Beroulli trial is idepedet so the probabilit of success p remais costat o each trial. I a biomial eperimet, we are iterested i = umber of successes i (fied umber of ) trials. So, = ! P ( ) = ( )!( )! π π, =,,,..., E ) Build the distributio of umber of heads i flippig a coi three times 3 P() P() /8 3/8 3/8 /8 E ) What is the probabilit that eactl of the et = cars serviced are late (P ( = ))? P (car is late)=., P (car ot late)=.9! P= = =!( )! ( ). (.).937 E 3) O average, % of the emergec room patiets at Greewood Geeral Hospital lack health isurace. I a radom sample of 4 patiets, aswer 9
10 to the followig questio? = umber of uisured patiets ( success ) P (uisured)=., P (isured)=.8, = 4 patiets The rage is =,,, 3, 4 patiets. () The probabilit that the sample of 4 patiets will cotai at least uisured patiets is P( ) = P() + P(3) + P(4) () The probabilit that the sample of 4 patiets will cotai at most uisured patiets is P( ) = P() + P() (3) What is the probabilit that fewer tha patiets are uisured? P( < ) = P() + P() (4) What is the probabilit that o more tha patiets are uisured? P( ) = P() + P() + P() Sequeces of Successes i Trials The umber of sequeces with successes i idepedet trials is: C! =!( )! where! = ( ) ( )... ad! =. Sum of Radom Sample Radom variables,,..., are called a Radom Sample if,,..., are mutuall idepedet radom variables ad the PMF (PDF) of each i is the same distributio with same parameter values (idetical). Let,,..., be a radom sample from a populatio, the E( i) = E( i) ad V( i) = V( i). i= i= Mea ad variace The mea of a biomial distributio is foud b addig the meas for each of the Beroulli idepedet evets: π + π π = π The variace of a biomial distributio is foud b addig the variaces for each of the Beroulli idepedet evets: π ( π)+ π( π) π( π) = π( π) The stadard deviatio is
11 π ( π ) Biomial shape A biomial distributio is skewed right if π <.5, skewed left if π >.5, ad smmetric if π =.5 Skewess decreases as icreases, regardless of the value of π. Hpergeometric Distributio The hpergeometric distributio is similar to the biomial distributio. However, ulike the biomial, samplig is without replacemet from a fiite populatio of N items. Parameters: N = umber of items i the populatio = sample size s = umber of successes i populatio Rage: = ma(, -N+s) mi(s, ) The hpergeometric PMF uses the formula for combiatios: s N s P ( ) = N E ) Suppose that a ur cotais s red chips ad W white chips. (s+w=n). If chips are draw out at radom, without replacemet, ad deotes the total umber of red chipd selected, the is said to have a Hpergeometric distributio: ~Hpergeometric (, s, N) = sample size s =umber of successes i the populatio N =populatio size E ) A committee of size 5 is to be selected at radom from 3 probabilitists ad 5 statisticias. Defie the radom variable to be the umber of probabilitists o the committee. What is the probabilit distributio for? ~Hpergeometric (, s, N), where = 5, s = 3, N = 8. 3
12 p() /56 5/56 3/56 /56 E 3) Damaged ipods. I a shipmet of ipods, were damaged ad 8 are good. The receivig departmet at Best Bu tests a sample of 3 ipods at radom to see if the are defective. Let the radom variable be the umber of damaged ipods i the sample. Now describe the problem: N = (umber of ipods i the shipmet) = 3 (sample size draw from the shipmet) s = (umber of damaged ipods i the shipmet ( successes i populatio)) N s = 8 (umber of o-damaged ipods i the shipmet) = umber of damaged ipods i the sample ( successes i sample) = umber of o-damaged ipods i the sample This is ot a biomial problem because p is ot costat. What is the probabilit of gettig a damaged ipod o the first draw from the sample? π = / Now, what is the probabilit of gettig a damaged ipod o the secod draw? π = /9 (if the first ipod was damaged) or = /9 (if the first ipod was udamaged) What about o the third draw? π 3 = /8 or = /8 or = /8 depedig o what happeed i the first two draws. Poisso Distributio The Poisso distributio describes the umber of occurreces withi a radoml chose uit of time or space. Called the model of arrivals, most Poisso applicatios model arrivals per uit of time. The evets occur radoml ad idepedetl over a cotiuum of time or space: Let = the umber of evets per uit of time. e λ λ P ( ) =! =,,, E) Suppose the umber of radioactive particles passig through a couter i a
13 give time follows a Poiiso distributio. The average umber of radioactive particles passig through a couter durig millisecod i a laborator eperimet is four. () What is the probabilit that the umber of particles that will eter the couter is at most 5 i a give millisecod? () What is the probabilit that the umber of particles that will eter the couter is at most 5 ad greater tha i a give millisecod? 3
Econ 325: Introduction to Empirical Economics
Eco 35: Itroductio to Empirical Ecoomics Lecture 3 Discrete Radom Variables ad Probability Distributios Copyright 010 Pearso Educatio, Ic. Publishig as Pretice Hall Ch. 4-1 4.1 Itroductio to Probability
More information4. Basic probability theory
Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio
More informationProbability and statistics: basic terms
Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationDiscrete probability distributions
Discrete probability distributios I the chapter o probability we used the classical method to calculate the probability of various values of a radom variable. I some cases, however, we may be able to develop
More informationJoint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { }
UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig
More informationf X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probablity that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c} Pr(X c) = Pr({s S X(s)
More informationTopic 8: Expected Values
Topic 8: Jue 6, 20 The simplest summary of quatitative data is the sample mea. Give a radom variable, the correspodig cocept is called the distributioal mea, the epectatio or the epected value. We begi
More informationIntroduction to Probability and Statistics Twelfth Edition
Itroductio to Probability ad Statistics Twelfth Editio Robert J. Beaver Barbara M. Beaver William Medehall Presetatio desiged ad writte by: Barbara M. Beaver Itroductio to Probability ad Statistics Twelfth
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig
More informationHandout #5. Discrete Random Variables and Probability Distributions
Hadout #5 Title: Foudatios of Ecoometrics Course: Eco 367 Fall/015 Istructor: Dr. I-Mig Chiu Discrete Radom Variables ad Probability Distributios Radom Variable (RV) Cosider the followig experimet: Toss
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationf X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probability that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c}) Pr(X c) = Pr({s S X(s)
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationParameter, Statistic and Random Samples
Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,
More informationNOTES ON DISTRIBUTIONS
NOTES ON DISTRIBUTIONS MICHAEL N KATEHAKIS Radom Variables Radom variables represet outcomes from radom pheomea They are specified by two objects The rage R of possible values ad the frequecy fx with which
More informationSome discrete distribution
Some discrete distributio p. 2-13 Defiitio (Beroulli distributio B(p)) A Beroulli distributio takes o oly two values: 0 ad 1, with probabilities 1 p ad p, respectively. pmf: p() = p (1 p) (1 ), if =0or
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More informationDiscrete Random Variables and Probability Distributions. Random Variables. Discrete Models
UCLA STAT 35 Applied Computatioal ad Iteractive Probability Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Chris Barr Uiversity of Califoria, Los Ageles, Witer 006 http://www.stat.ucla.edu/~diov/
More informationAMS570 Lecture Notes #2
AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)
More informationEE 4TM4: Digital Communications II Probability Theory
1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair
More informationIE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes.
Closed book ad otes. No calculators. 120 miutes. Cover page, five pages of exam, ad tables for discrete ad cotiuous distributios. Score X i =1 X i / S X 2 i =1 (X i X ) 2 / ( 1) = [i =1 X i 2 X 2 ] / (
More information[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is:
PROBABILITY FUNCTIONS A radom variable X has a probabilit associated with each of its possible values. The probabilit is termed a discrete probabilit if X ca assume ol discrete values, or X = x, x, x 3,,
More informationLecture 5. Random variable and distribution of probability
Itroductio to theory of probability ad statistics Lecture 5. Radom variable ad distributio of probability prof. dr hab.iż. Katarzya Zarzewsa Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationStat 198 for 134 Instructor: Mike Leong
Chapter 2: Repeated Trials ad Samplig Sectio 2.1 Biomial Distributio 2.2 Normal Approximatio: Method 2.3 Normal Approximatios: Derivatio (Skip) 2.4 Poisso Approximatio 2.5 Radom Samplig Chapter 2 Table
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLecture Chapter 6: Convergence of Random Sequences
ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite
More informationStat 400: Georgios Fellouris Homework 5 Due: Friday 24 th, 2017
Stat 400: Georgios Fellouris Homework 5 Due: Friday 4 th, 017 1. A exam has multiple choice questios ad each of them has 4 possible aswers, oly oe of which is correct. A studet will aswer all questios
More informationProbability and Statistics
robability ad Statistics rof. Zheg Zheg Radom Variable A fiite sigle valued fuctio.) that maps the set of all eperimetal outcomes ito the set of real umbers R is a r.v., if the set ) is a evet F ) for
More informationIE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes.
IE 230 Seat # Name < KEY > Please read these directios. Closed book ad otes. 60 miutes. Covers through the ormal distributio, Sectio 4.7 of Motgomery ad Ruger, fourth editio. Cover page ad four pages of
More informationSome Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables
Some Basic Probability Cocepts 2. Experimets, Outcomes ad Radom Variables A radom variable is a variable whose value is ukow util it is observed. The value of a radom variable results from a experimet;
More informationFinal Review for MATH 3510
Fial Review for MATH 50 Calculatio 5 Give a fairly simple probability mass fuctio or probability desity fuctio of a radom variable, you should be able to compute the expected value ad variace of the variable
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationChapter If n is odd, the median is the exact middle number If n is even, the median is the average of the two middle numbers
Chapter 4 4-1 orth Seattle Commuity College BUS10 Busiess Statistics Chapter 4 Descriptive Statistics Summary Defiitios Cetral tedecy: The extet to which the data values group aroud a cetral value. Variatio:
More informationMathematical Statistics - MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More informationModeling and Performance Analysis with Discrete-Event Simulation
Simulatio Modelig ad Performace Aalysis with Discrete-Evet Simulatio Chapter 5 Statistical Models i Simulatio Cotets Basic Probability Theory Cocepts Useful Statistical Models Discrete Distributios Cotiuous
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationThe variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.
SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationChapter 2 The Monte Carlo Method
Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful
More informationStochastic Processes
Stochastic Processes Review o Elemetar Probabilit Lecture I Hamid R. Rabiee Fall 20 Ali Jalali Outlie Histor/Philosoph Radom Variables Desit/Distributio Fuctios Joit/Coditioal Distributios Correlatio Importat
More informationAdvanced Engineering Mathematics Exercises on Module 4: Probability and Statistics
Advaced Egieerig Mathematics Eercises o Module 4: Probability ad Statistics. A survey of people i give regio showed that 5% drak regularly. The probability of death due to liver disease, give that a perso
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationA PROBABILITY PRIMER
CARLETON COLLEGE A ROBABILITY RIMER SCOTT BIERMAN (Do ot quote without permissio) A robability rimer INTRODUCTION The field of probability ad statistics provides a orgaizig framework for systematically
More informationCentral Limit Theorem the Meaning and the Usage
Cetral Limit Theorem the Meaig ad the Usage Covetio about otatio. N, We are usig otatio X is variable with mea ad stadard deviatio. i lieu of sayig that X is a ormal radom Assume a sample of measuremets
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationSTAT 350 Handout 19 Sampling Distribution, Central Limit Theorem (6.6)
STAT 350 Hadout 9 Samplig Distributio, Cetral Limit Theorem (6.6) A radom sample is a sequece of radom variables X, X 2,, X that are idepedet ad idetically distributed. o This property is ofte abbreviated
More informationThe Binomial Theorem
The Biomial Theorem Lecture 47 Sectio 9.7 Robb T. Koether Hampde-Sydey College Fri, Apr 8, 204 Robb T. Koether (Hampde-Sydey College The Biomial Theorem Fri, Apr 8, 204 / 25 Combiatios 2 Pascal s Triagle
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationDiscrete Probability Functions
Discrete Probability Fuctios Daiel B. Rowe, Ph.D. Professor Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 017 by 1 Outlie Discrete RVs, PMFs, CDFs Discrete Expectatios Discrete Momets
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationStatisticians use the word population to refer the total number of (potential) observations under consideration
6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More informationAMS 216 Stochastic Differential Equations Lecture 02 Copyright by Hongyun Wang, UCSC ( ( )) 2 = E X 2 ( ( )) 2
AMS 216 Stochastic Differetial Equatios Lecture 02 Copyright by Hogyu Wag, UCSC Review of probability theory (Cotiued) Variace: var X We obtai: = E X E( X ) 2 = E( X 2 ) 2E ( X )E X var( X ) = E X 2 Stadard
More informationLast time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object
6.3 Stochastic Estimatio ad Cotrol, Fall 004 Lecture 7 Last time: Momets of the Poisso distributio from its geeratig fuctio. Gs () e dg µ e ds dg µ ( s) µ ( s) µ ( s) µ e ds dg X µ ds X s dg dg + ds ds
More information0, otherwise. EX = E(X 1 + X n ) = EX j = np and. Var(X j ) = np(1 p). Var(X) = Var(X X n ) =
PROBABILITY MODELS 35 10. Discrete probability distributios I this sectio, we discuss several well-ow discrete probability distributios ad study some of their properties. Some of these distributios, lie
More informationSampling Error. Chapter 6 Student Lecture Notes 6-1. Business Statistics: A Decision-Making Approach, 6e. Chapter Goals
Chapter 6 Studet Lecture Notes 6-1 Busiess Statistics: A Decisio-Makig Approach 6 th Editio Chapter 6 Itroductio to Samplig Distributios Chap 6-1 Chapter Goals After completig this chapter, you should
More informationSampling Distributions, Z-Tests, Power
Samplig Distributios, Z-Tests, Power We draw ifereces about populatio parameters from sample statistics Sample proportio approximates populatio proportio Sample mea approximates populatio mea Sample variace
More informationReview on Probability Distributions
Discrete Probability Distributios: Biomial Probability Distributio ourse: MAT, Istructor: Md. Saifuddi Khalid Review o Probability Distributios Radom Variable. A radom variable is a variable which takes
More informationCS 330 Discussion - Probability
CS 330 Discussio - Probability March 24 2017 1 Fudametals of Probability 11 Radom Variables ad Evets A radom variable X is oe whose value is o-determiistic For example, suppose we flip a coi ad set X =
More information10/31/2018 CentralLimitTheorem
10/31/2018 CetralLimitTheorem http://127.0.0.1:8888/bcovert/html/cs237/web/homeworks%2c%20labs%2c%20ad%20code/cetrallimittheorem.ipyb?dowload=false 1/10 10/31/2018 CetralLimitTheorem Cetral Limit Theorem
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationDownloaded from
ocepts ad importat formulae o probability Key cocept: *coditioal probability *properties of coditioal probability *Multiplicatio Theorem o Probablity *idepedet evets *Theorem of Total Probablity *Bayes
More informationSTAT 515 fa 2016 Lec Sampling distribution of the mean, part 2 (central limit theorem)
STAT 515 fa 2016 Lec 15-16 Samplig distributio of the mea, part 2 cetral limit theorem Karl B. Gregory Moday, Sep 26th Cotets 1 The cetral limit theorem 1 1.1 The most importat theorem i statistics.............
More informationParameter, Statistic and Random Samples
Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,
More information( ) = p and P( i = b) = q.
MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of
More informationModule 1 Fundamentals in statistics
Normal Distributio Repeated observatios that differ because of experimetal error ofte vary about some cetral value i a roughly symmetrical distributio i which small deviatios occur much more frequetly
More informationContinuous Data that can take on any real number (time/length) based on sample data. Categorical data can only be named or categorised
Questio 1. (Topics 1-3) A populatio cosists of all the members of a group about which you wat to draw a coclusio (Greek letters (μ, σ, Ν) are used) A sample is the portio of the populatio selected for
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationBHW #13 1/ Cooper. ENGR 323 Probabilistic Analysis Beautiful Homework # 13
BHW # /5 ENGR Probabilistic Aalysis Beautiful Homework # Three differet roads feed ito a particular freeway etrace. Suppose that durig a fixed time period, the umber of cars comig from each road oto the
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19
CS 70 Discrete Mathematics ad Probability Theory Sprig 2016 Rao ad Walrad Note 19 Some Importat Distributios Recall our basic probabilistic experimet of tossig a biased coi times. This is a very simple
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationPH 425 Quantum Measurement and Spin Winter SPINS Lab 1
PH 425 Quatum Measuremet ad Spi Witer 23 SPIS Lab Measure the spi projectio S z alog the z-axis This is the experimet that is ready to go whe you start the program, as show below Each atom is measured
More informationClosed book and notes. No calculators. 60 minutes, but essentially unlimited time.
IE 230 Seat # Closed book ad otes. No calculators. 60 miutes, but essetially ulimited time. Cover page, four pages of exam, ad Pages 8 ad 12 of the Cocise Notes. This test covers through Sectio 4.7 of
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Math 36Q Fall 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2 to
More informationLecture 4. Random variable and distribution of probability
Itroductio to theory of probability ad statistics Lecture. Radom variable ad distributio of probability dr hab.iż. Katarzya Zarzewsa, prof.agh Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za
More information(6) Fundamental Sampling Distribution and Data Discription
34 Stat Lecture Notes (6) Fudametal Samplig Distributio ad Data Discriptio ( Book*: Chapter 8,pg5) Probability& Statistics for Egieers & Scietists By Walpole, Myers, Myers, Ye 8.1 Radom Samplig: Populatio:
More informationKLMED8004 Medical statistics. Part I, autumn Estimation. We have previously learned: Population and sample. New questions
We have previously leared: KLMED8004 Medical statistics Part I, autum 00 How kow probability distributios (e.g. biomial distributio, ormal distributio) with kow populatio parameters (mea, variace) ca give
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationChapter 2 Transformations and Expectations
Chapter Trasformatios a Epectatios Chapter Distributios of Fuctios of a Raom Variable Problem: Let be a raom variable with cf F ( ) If we efie ay fuctio of, say g( ) g( ) is also a raom variable whose
More informationBinomial Distribution
0.0 0.5 1.0 1.5 2.0 2.5 3.0 0 1 2 3 4 5 6 7 0.0 0.5 1.0 1.5 2.0 2.5 3.0 Overview Example: coi tossed three times Defiitio Formula Recall that a r.v. is discrete if there are either a fiite umber of possible
More informationSTATISTICAL METHODS FOR BUSINESS
STATISTICAL METHODS FOR BUSINESS UNIT 5. Joit aalysis ad limit theorems. 5.1.- -dimesio distributios. Margial ad coditioal distributios 5.2.- Sequeces of idepedet radom variables. Properties 5.3.- Sums
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationApril 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE
April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE TERRY SOO Abstract These otes are adapted from whe I taught Math 526 ad meat to give a quick itroductio to cofidece
More informationProbability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].
Probability 2 - Notes 0 Some Useful Iequalities. Lemma. If X is a radom variable ad g(x 0 for all x i the support of f X, the P(g(X E[g(X]. Proof. (cotiuous case P(g(X Corollaries x:g(x f X (xdx x:g(x
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationLOGO. Chapter 2 Discrete Random Variables(R.V) Part1. iugaza2010.blogspot.com
1 LOGO Chapter 2 Discrete Radom Variables(R.V) Part1 iugaza2010.blogspot.com 2.1 Radom Variables A radom variable over a sample space is a fuctio that maps every sample poit (i.e. outcome) to a real umber.
More informationSTA 4032 Final Exam Formula Sheet
Chapter 2. Probability STA 4032 Fial Eam Formula Sheet Some Baic Probability Formula: (1) P (A B) = P (A) + P (B) P (A B). (2) P (A ) = 1 P (A) ( A i the complemet of A). (3) If S i a fiite ample pace
More informationStatistical Equations
Statitical Equatio You are permitted to ue the iformatio o thee page durig your eam. Thee page are ot guarateed to cotai all the iformatio you will eed. If you fid iformatio which you believe hould be
More informationLecture 20: Multivariate convergence and the Central Limit Theorem
Lecture 20: Multivariate covergece ad the Cetral Limit Theorem Covergece i distributio for radom vectors Let Z,Z 1,Z 2,... be radom vectors o R k. If the cdf of Z is cotiuous, the we ca defie covergece
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More informationAs stated by Laplace, Probability is common sense reduced to calculation.
Note: Hadouts DO NOT replace the book. I most cases, they oly provide a guidelie o topics ad a ituitive feel. The math details will be covered i class, so it is importat to atted class ad also you MUST
More information