Discrete Random Variables and Probability Distributions. Random Variables. Discrete Models
|
|
- Abigayle Dixon
- 5 years ago
- Views:
Transcription
1 UCLA STAT 35 Applied Computatioal ad Iteractive Probability Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Chris Barr Uiversity of Califoria, Los Ageles, Witer Discrete Models Discrete Radom Variables ad Probability Distributios Slide Slide Radom Variables Radom Variable For a give sample space S of some eperimet, a radom variable is ay rule that associates a umber with each outcome i S. Slide 3 Slide 4 Beroulli Radom Variable Ay radom variable whose oly possible values are 0 ad is called a Beroulli radom variable. RedBlackGame Types of Radom Variables A discrete radom variable is a rv whose possible values either costitute a fiite set or else ca listed i a ifiite sequece. A radom variable is cotiuous if its set of possible values cosists of a etire iterval o a umber lie. Slide 5 Slide 6
2 Probability Distributios for Discrete Radom Variables Probability Distributio The probability distributio or probability mass fuctio (pmf) of a discrete rv is defied for every umber by p() = P(all s S : X(s) = ) Slide 7 Slide 8 Parameter of a Probability Distributio Suppose that p() depeds o a quatity that ca be assiged ay oe of a umber of possible values, each with differet value determiig a differet probability distributio. Such a quatity is called a parameter of the distributio. The collectio of all distributios for all differet parameters is called a family of distributios. Slide 9 Cumulative Distributio Fuctio The cumulative distributio fuctio (cdf) F() of a discrete rv variable X with pmf p() is defied for every umber by F( ) = P( X ) = p( y) Slide 0 yy : For ay umber, F() is the probability that the observed value of X will be at most. Propositio For ay two umbers a ad b with a b, Pa ( X b) = Fb ( ) Fa ( ) a represets the largest possible X value that is strictly less tha (<) a. Note: For itegers Pa ( X b) = Fb ( ) Fa ( ) Probability Distributio for the Radom Variable X A probability distributio for a radom variable X: P(X = ) Fid a. P( X 0 ) 0.65 b. P 3 X 0.67 ( ) Slide Slide
3 Epected Values of Discrete Radom Variables The Epected Value of X Let X be a discrete rv with set of possible values D ad pmf p(). The epected value or mea value of X, deoted EX ( ) or µ X, is E( X) = µ = p( ) X D Slide 3 Slide 4 Eample I the at least oe of each or at most 3 childre eample, where X ={umber of Girls} we have: X 0 3 pr( ) Slide 5 8 E( X ) = P( ) 5 = =.5 8 E. Use the data below to fid out the epected umber of the umber of credit cards that a studet will possess. = # credit cards P( =X) E ( X) = p+ p p = 0(.08) + (.8) + (.38) + 3(.6) + 4(.06) + 5(.03) + 6(.0) =.97 About credit cards Slide 6 The Epected Value of a Fuctio If the rv X has the set of possible values D ad pmf p(), the the epected value of ay fuctio h(), deoted EhX [ ( )] or µ h ( X ), is E[ hx ( )] = h ( ) p ( ) D Rules of the Epected Value E( ax + b) = a E( X ) + b This leads to the followig:. For ay costat a, E( ax ) = a E( X ).. For ay costat b, E( X + b) = E( X) + b. Slide 7 Slide 8 3
4 The Variace ad Stadard Deviatio Let X have pmf p(), ad epected value µ The the variace of X, deoted V(X) (or σ or σ ), is X V( X) = ( µ ) p( ) = E[( X µ ) ] D The stadard deviatio (SD) of X is σ X = σ X E. The quiz scores for a particular studet are give below:, 5, 0, 8,, 0, 4, 0, 0, 5, 4, 5, 8 Fid the variace ad stadard deviatio. Value Frequecy Probability µ = ( µ ) ( µ ) ( µ ) V( X) = p + p p σ = V( X) Slide 9 Slide 0 V( X ) = ( ) ( ) ( ) ( ) ( ) ( ) V( X ) = 3.5 σ = V( X) = Shortcut Formula for Variace V( X) = σ = p( ) µ D ( ) E( X) = E X Slide Slide Rules of Variace + σ V( ax + b) = σax b = a X ad σ + = a σ ax b X This leads to the followig:. σax = a σx, σax = a σx. σx+ b = σx Liear Scalig (affie trasformatios) ax + b For ay costats a ad b, the epectatio of the RV ax + b is equal to the sum of the product of a ad the epectatio of the RV X ad the costat b. E(aX + b) = a E(X) +b Ad similarly for the stadard deviatio (b, a additive factor, does ot affect the SD). SD(aX +b) = a SD(X) Slide 3 Slide 4 4
5 Liear Scalig (affie trasformatios) ax + b Liear Scalig (affie trasformatios) ax + b Why is that so? E(aX + b) = a E(X) +b SD(aX +b) = a SD(X) E(aX + b) = (a + b) P(X = ) = = 0 a P(X = ) + b P(X = ) = = 0 = 0 a P(X = ) + b P(X = ) = = 0 = 0 ae(x) + b = ae(x) + b. Slide 5 Eample: E(aX + b) = a E(X) +b SD(aX +b) = a SD(X). X={-,, 0, 3, 4, 0, -, }; P(X=)=/8, for each. Y = X-5 = {-7, -, -5,, 3, -5, -9, -3} 3. E(X)= 4. E(Y)= 5. Does E(X) = E(X) 5? 6. Compute SD(X), SD(Y). Does SD(Y) = SD(X)? Slide 6 Liear Scalig (affie trasformatios) ax + b Ad why do we care? E(aX + b) = a E(X) +b SD(aX +b) = a SD(X) -completely geeral strategy for computig the distributios of RV s which are obtaied from other RV s with kow distributio. E.g., X~N(0,), ad Y=aX+b, the we eed ot calculate the mea ad the SD of Y. We kow from the above formulas that E(Y) = b ad SD(Y) = a. -These formulas hold for all distributios, ot oly for Biomial ad Normal. Slide 7 Liear Scalig (affie trasformatios) ax + b Ad why do we care? E(aX + b) = a E(X) +b SD(aX +b) = a SD(X) -E.g., say the rules for the game of chace we saw before chage ad the ew pay-off is as follows: {$0, $.50, $3}, with probabilities of {0.6, 0.3, 0.}, as before. What is the ewly epected retur of the game? Remember the old epectatio was equal to the etrace fee of $.50, ad the game was fair! Y = 3(X-)/ {$, $, $3} {$0, $.50, $3}, E(Y) = 3/ E(X) 3/ = 3 / 4 = $0.75 Ad the game became clearly biased. Note how easy it is to compute E(Y). Slide 8 Meas ad Variaces for (i)depedet Variables! Meas: Idepedet/Depedet Variables {X, X, X3,, X0} E(X + X + X3 + + X0) = E(X)+ E(X)+ E(X3)+ + E(X0) Variaces: Idepedet Variables {X, X, X3,, X0}, variaces add-up Var(X +X + X3 + + X0) = Var(X)+Var(X)+Var(X3)+ +Var(X) Depedet Variables {X, X} Variace cotiget o the variable depedeces, E.g., If X = X + 5, Var(X +X) =Var (X + X +5) = Var(3X +5) =Var(3X) = 9Var(X) Slide 9 The Biomial Probability Distributio Slide 30 5
6 Biomial Eperimet A eperimet for which the followig four coditios are satisfied is called a biomial eperimet.. The eperimet cosists of a sequece of trials, where is fied i advace of the eperimet.. The trials are idetical, ad each trial ca result i oe of the same two possible outcomes, which are deoted by success (S) or failure (F). 3. The trials are idepedet. 4. The probability of success is costat from trial to trial: deoted by p. Slide 3 Slide 3 Biomial Eperimet Suppose each trial of a eperimet ca result i S or F, but the samplig is without replacemet from a populatio of size N. If the sample size is at most 5% of the populatio size, the eperimet ca be aalyzed as though it were eactly a biomial eperimet. Biomial Radom Variable Give a biomial eperimet cosistig of trials, the biomial radom variable X associated with this eperimet is defied as X = the umber of S s amog trials Slide 33 Slide 34 Notatio for the pmf of a Biomial rv Because the pmf of a biomial rv X depeds o the two parameters ad p, we deote the pmf by B(;,p). Computatio of a Biomial pmf b( ;, p) = p ( 0 p) BiomialCoiEperimet UrEperimet Ball ad Ur Eperimet Slide 35 Slide 36 6
7 E. A card is draw from a stadard 5-card deck. If drawig a club is cosidered a success, fid the probability of a. eactly oe success i 4 draws (with replacemet). p = ¼; q = ¼ = ¾ b. o successes i 5 draws (with replacemet) Notatio for cdf For X ~ Bi(, p), the cdf will be deoted by PX ( ) = Bp ( ;, ) = byp ( ;, ) y= 0 = 0,,, Slide 37 Slide 38 Mea ad Variace For X ~ Bi(, p), the E(X) = p, V(X) = p( p) = pq, σ X = pq (where q = p). E. 5 cards are draw, with replacemet, from a stadard 5-card deck. If drawig a club is cosidered a success, fid the mea, variace, ad stadard deviatio of X (where X is the umber of successes). p = ¼; q = ¼ = ¾ µ = p = 5 = V ( X ) = pq = 5 = σ = pq = X Slide 39 Slide 40 E. If the probability of a studet successfully passig this course (C or better) is 0.8, fid the probability that give 8 studets 8 a. all 8 pass b. oe pass c. at least 6 pass. 8 0 ( ) ( ) 0 8 ( ) ( ) Hypergeometric ad Negative Biomial Distributios ( 0.8) ( 0.8) + ( 0.8) ( 0.8) + ( 0.8) ( 0.8) = Slide 4 Slide 4 7
8 The Hypergeometric Distributio The three assumptios that lead to a hypergeometric distributio:. The populatio or set to be sampled cosists of N idividuals, objects, or elemets (a fiite populatio).. Each idividual ca be characterized as a success (S) or failure (F), ad there are M successes i the populatio. 3. A sample of idividuals is selected without replacemet i such a way that each subset of size is equally likely to be chose. Slide 43 Slide 44 Hypergeometric Distributio If X is the umber of S s i a completely radom sample of size draw from a populatio cosistig of M S s ad (N M) F s, the the probability distributio of X, called the hypergeometric distributio, is give by M N M PX ( = ) = hmn ( ;,, ) = ma(0, N + M) mi(, M) N Hypergeometric Mea ad Variace M N M M EX ( ) = VX ( ) = N N N N Ball_ad_Ur_Eperimet HyperGeometric Distributio & Biomial Approimatio to HyperGeometric Slide 45 Slide 46 The Negative Biomial Distributio The egative biomial rv ad distributio are based o a eperimet satisfyig the followig four coditios:. The eperimet cosists of a sequece of idepedet trials.. Each trial ca result i a success (S) or a failure (F). 3. The probability of success is costat from trial to trial, so P(S o trial i) = p for i =,, 3, 4. The eperimet cotiues util a total of r successes have bee observed, where r is a specified positive iteger. Slide 47 Slide 48 8
9 pmf of a Negative Biomial The pmf of the egative biomial rv X with parameters r = umber of S s ad p = P(S) is r NB ( ; r, p) = + p p r r ( ) = 0,,, Negative Biomial Mea ad Variace ( ) ( ) ( ) r p ( ) r EX = VX = p p p NegativeBiomialEperimet Slide 49 Slide 50 Hypergeometric Distributio & Biomial Biomial approimatio to Hypergeometric M is small (usually < 0.), the p N N approaches HyperGeom( ; N,, M ) Bi( ;, p) M / N = p E: 4,000 out of 0,000 residets are agaist a ew ta. 5 residets are selected at radom. P(at most 7 favor the ew ta) =? Geometric, Hypergeometric, Negative Biomial Negative biomial pmf [X ~ NegBi(r, p), if r= Geometric (p)] P( X = ) = ( p) p Number of trials () util the r th success (egative, sice umber of successes (r) is fied & umber of trials (X) is radom) ( ) ( ) p p r r r P X = = + r( p) r( p) E( X ) = ; Var( X ) = p p Slide 5 Slide 5 The Poisso Probability Distributio Poisso Distributio A radom variable X is said to have a Poisso distributio with parameter ( > 0, ) if the pmf of X is e p ( ; ) = = 0,,...! Slide 53 Slide 54 9
10 The Poisso Distributio as a Limit Suppose that i the biomial pmf b(;, p), we let ad p 0 i such a way that p approaches a value > 0. The bp ( ;, ) p ( ; ). Poisso Distributio Mea ad Variace If X has a Poisso distributio with parameter, the EX ( ) = VX ( ) = PoissoEperimet PoissoDEperimet Slide 55 Slide 56 Poisso Process 3 Assumptios:. There eists a parameter α > 0 such that for ay short time iterval of legth t, the probability that eactly oe evet is received is α t+ o( t).. The probability of more tha oe evet durig t is o( t). 3. The umber of evets durig the time iterval t is idepedet of the umber that occurred prior to this time iterval. Slide 57 Slide 58 Poisso Distributio αt k Pk () t = e ( αt) / k!, so that the umber of pulses (evets) durig a time iterval of legth t is a Poisso rv with parameter = αt. The epected umber of pulses (evets) durig ay such time iterval is αt, so the epected umber durig a uit time iterval is α. PoissoEperimet Poisso Distributio Defiitio Used to model couts umber of arrivals (k) o a give iterval The Poisso distributio is also sometimes referred to as the distributio of rare evets. Eamples of Poisso distributed variables are umber of accidets per perso, umber of sweepstakes wo per perso, or the umber of catastrophic defects foud i a productio process. Slide 59 Slide 60 0
11 Fuctioal Brai Imagig Positro Emissio Tomography (PET) Fuctioal Brai Imagig - Positro Emissio Tomography (PET) Slide 6 Slide 6 Fuctioal Brai Imagig Positro Emissio Tomography (PET) Fuctioal Brai Imagig Positro Emissio Tomography (PET) Isotope Eergy (MeV) Rage(mm) /-life Appl. C mi receptors 5O.7.5 mi stroke/activatio 8 F mi eurology 4I ~ days ocology Slide 63 Slide 64 Hypergeometric Distributio & Biomial Biomial approimatio to Hyperheometric M is small (usually < 0.), the p N N approaches HyperGeom( ; N,, M ) Bi( ;, p) M / N = p E: 4,000 out of 0,000 residets are agaist a ew ta. 5 residets are selected at radom. P(at most 7 favor the ew ta) =? Poisso Distributio Mea Used to model couts umber of arrivals (k) o a give iterval k e Y~Poisso( ), the P(Y=k) =, k = 0,,, k! Mea of Y, µ Y =, sice k k k e k E( Y ) = k = e = e = k! k! ( k )! = e k = 0 k = k = e ( k )! k = 0 k = 0 k = e k! k = e = Slide 65 Slide 66
12 Poisso Distributio - Variace k Y~Poisso( ), the P(Y=k) = e Variace of Y, σ Y = ½ k!, sice σ = = Y Var( Y ) = k 0 ( k ) k e k!, k = 0,,, For eample, suppose that Y deotes the umber of blocked shots (arrivals) i a radomly sampled game for the UCLA Bruis me's basketball team. The a Poisso distributio with mea=4 may be used to model Y. =... = Poisso Distributio - Eample For eample, suppose that Y deotes the umber of blocked shots i a radomly sampled game for the UCLA Bruis me's basketball team. Poisso distributio with mea=4 may be used to model Y Slide 67 Slide 68 Poisso as a approimatio to Biomial Suppose we have a sequece of Biomial(, p ) models, with lim( p ), as ifiity. For each 0<=y<=, if Y ~ Biomial(, p ), the y y P(Y =y)= p p y ( ) But this coverges to: y WHY? y y e p ( p ) y p y! Thus, Biomial(, p ) Poisso() Poisso as a approimatio to Biomial Rule of thumb is that approimatio is good if: >=00 p<=0.0 = p <=0 The, Biomial(, p ) Poisso() Slide 69 Slide 70 Eample usig Poisso appro to Biomial Suppose P(defective chip) = 0.000=0-4. Fid the probability that a lot of 5,000 chips has > defective! Y~ Biomial(5,000, 0.000), fid P(Y>). Note that Z~Poisso( = p =5, =.5) P( Z > ) = P( Z ) = 0.5 e 0! e!.5 Slide 7 z= e! z.5 e z!.5 = =
Joint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { }
UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig
More informationDiscrete probability distributions
Discrete probability distributios I the chapter o probability we used the classical method to calculate the probability of various values of a radom variable. I some cases, however, we may be able to develop
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationAMS570 Lecture Notes #2
AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)
More informationCH.25 Discrete Random Variables
CH.25 Discrete Radom Variables 25B PG.784-785 #1, 3, 4, 6 25C PG.788-789 #1, 3, 5, 8, 10, 11 25D PG.791-792 #1, 3, 6 25E PG.794-795 #1, 2, 3, 7, 10 25F.1 PG.798-799 #2, 3, 5 25F.2 PG. 800-802 #2, 4, 7,
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationIntroduction to Probability and Statistics Twelfth Edition
Itroductio to Probability ad Statistics Twelfth Editio Robert J. Beaver Barbara M. Beaver William Medehall Presetatio desiged ad writte by: Barbara M. Beaver Itroductio to Probability ad Statistics Twelfth
More informationUCLA STAT 110 A Applied Probability & Statistics for Engineers
UCLA STAT 0 A Alied Probabilit & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad eurolog Teachig Assistat: Maria Chag, UCLA Statistics Uiversit of Califoria, Los Ageles, Srig 003
More informationz is the upper tail critical value from the normal distribution
Statistical Iferece drawig coclusios about a populatio parameter, based o a sample estimate. Populatio: GRE results for a ew eam format o the quatitative sectio Sample: =30 test scores Populatio Samplig
More informationStat 400: Georgios Fellouris Homework 5 Due: Friday 24 th, 2017
Stat 400: Georgios Fellouris Homework 5 Due: Friday 4 th, 017 1. A exam has multiple choice questios ad each of them has 4 possible aswers, oly oe of which is correct. A studet will aswer all questios
More informationIE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes.
IE 230 Seat # Name < KEY > Please read these directios. Closed book ad otes. 60 miutes. Covers through the ormal distributio, Sectio 4.7 of Motgomery ad Ruger, fourth editio. Cover page ad four pages of
More informationf X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probablity that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c} Pr(X c) = Pr({s S X(s)
More informationTopic 8: Expected Values
Topic 8: Jue 6, 20 The simplest summary of quatitative data is the sample mea. Give a radom variable, the correspodig cocept is called the distributioal mea, the epectatio or the epected value. We begi
More informationCH5. Discrete Probability Distributions
CH5. Discrete Probabilit Distributios Radom Variables A radom variable is a fuctio or rule that assigs a umerical value to each outcome i the sample space of a radom eperimet. Nomeclature: - Capital letters:
More informationLecture 5. Random variable and distribution of probability
Itroductio to theory of probability ad statistics Lecture 5. Radom variable ad distributio of probability prof. dr hab.iż. Katarzya Zarzewsa Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationParameter, Statistic and Random Samples
Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,
More informationModeling and Performance Analysis with Discrete-Event Simulation
Simulatio Modelig ad Performace Aalysis with Discrete-Evet Simulatio Chapter 5 Statistical Models i Simulatio Cotets Basic Probability Theory Cocepts Useful Statistical Models Discrete Distributios Cotiuous
More information0, otherwise. EX = E(X 1 + X n ) = EX j = np and. Var(X j ) = np(1 p). Var(X) = Var(X X n ) =
PROBABILITY MODELS 35 10. Discrete probability distributios I this sectio, we discuss several well-ow discrete probability distributios ad study some of their properties. Some of these distributios, lie
More informationFinal Review for MATH 3510
Fial Review for MATH 50 Calculatio 5 Give a fairly simple probability mass fuctio or probability desity fuctio of a radom variable, you should be able to compute the expected value ad variace of the variable
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationSome discrete distribution
Some discrete distributio p. 2-13 Defiitio (Beroulli distributio B(p)) A Beroulli distributio takes o oly two values: 0 ad 1, with probabilities 1 p ad p, respectively. pmf: p() = p (1 p) (1 ), if =0or
More informationProbability and statistics: basic terms
Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample
More informationBinomial Distribution
0.0 0.5 1.0 1.5 2.0 2.5 3.0 0 1 2 3 4 5 6 7 0.0 0.5 1.0 1.5 2.0 2.5 3.0 Overview Example: coi tossed three times Defiitio Formula Recall that a r.v. is discrete if there are either a fiite umber of possible
More informationProbability and Statistics
robability ad Statistics rof. Zheg Zheg Radom Variable A fiite sigle valued fuctio.) that maps the set of all eperimetal outcomes ito the set of real umbers R is a r.v., if the set ) is a evet F ) for
More informationIE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes.
Closed book ad otes. No calculators. 120 miutes. Cover page, five pages of exam, ad tables for discrete ad cotiuous distributios. Score X i =1 X i / S X 2 i =1 (X i X ) 2 / ( 1) = [i =1 X i 2 X 2 ] / (
More informationVariance of Discrete Random Variables Class 5, Jeremy Orloff and Jonathan Bloom
Variace of Discrete Radom Variables Class 5, 18.05 Jeremy Orloff ad Joatha Bloom 1 Learig Goals 1. Be able to compute the variace ad stadard deviatio of a radom variable.. Uderstad that stadard deviatio
More information4. Basic probability theory
Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationHandout #5. Discrete Random Variables and Probability Distributions
Hadout #5 Title: Foudatios of Ecoometrics Course: Eco 367 Fall/015 Istructor: Dr. I-Mig Chiu Discrete Radom Variables ad Probability Distributios Radom Variable (RV) Cosider the followig experimet: Toss
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationLecture 12: November 13, 2018
Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationBHW #13 1/ Cooper. ENGR 323 Probabilistic Analysis Beautiful Homework # 13
BHW # /5 ENGR Probabilistic Aalysis Beautiful Homework # Three differet roads feed ito a particular freeway etrace. Suppose that durig a fixed time period, the umber of cars comig from each road oto the
More informationLecture 2: Poisson Sta*s*cs Probability Density Func*ons Expecta*on and Variance Es*mators
Lecture 2: Poisso Sta*s*cs Probability Desity Fuc*os Expecta*o ad Variace Es*mators Biomial Distribu*o: P (k successes i attempts) =! k!( k)! p k s( p s ) k prob of each success Poisso Distributio Note
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More information( ) = p and P( i = b) = q.
MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of
More informationf X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probability that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c}) Pr(X c) = Pr({s S X(s)
More informationNOTES ON DISTRIBUTIONS
NOTES ON DISTRIBUTIONS MICHAEL N KATEHAKIS Radom Variables Radom variables represet outcomes from radom pheomea They are specified by two objects The rage R of possible values ad the frequecy fx with which
More informationStatistical Methods. Sample spaces and events. Axioms of Probability. UCLA M284 Principles of Neuroimaging A
UCL M84 riciples of euroimagig Statistical Methods Istructor: : Ivo Diov, sst. rof. I Statistics ad eurology Uiversity of Califoria, Los geles, Witer 007 http://www.stat.ucla.edu/~diov/ http://www.braimappig.org
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19
CS 70 Discrete Mathematics ad Probability Theory Sprig 2016 Rao ad Walrad Note 19 Some Importat Distributios Recall our basic probabilistic experimet of tossig a biased coi times. This is a very simple
More informationLecture 4. Random variable and distribution of probability
Itroductio to theory of probability ad statistics Lecture. Radom variable ad distributio of probability dr hab.iż. Katarzya Zarzewsa, prof.agh Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za
More informationEE 4TM4: Digital Communications II Probability Theory
1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig
More informationKLMED8004 Medical statistics. Part I, autumn Estimation. We have previously learned: Population and sample. New questions
We have previously leared: KLMED8004 Medical statistics Part I, autum 00 How kow probability distributios (e.g. biomial distributio, ormal distributio) with kow populatio parameters (mea, variace) ca give
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationProblems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:
Math 224 Fall 2017 Homework 4 Drew Armstrog Problems from 9th editio of Probability ad Statistical Iferece by Hogg, Tais ad Zimmerma: Sectio 2.3, Exercises 16(a,d),18. Sectio 2.4, Exercises 13, 14. Sectio
More informationReview on Probability Distributions
Discrete Probability Distributios: Biomial Probability Distributio ourse: MAT, Istructor: Md. Saifuddi Khalid Review o Probability Distributios Radom Variable. A radom variable is a variable which takes
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More informationUCLA STAT 110B Applied Statistics for Engineering and the Sciences
UCLA STAT 110B Applied Statistics for Egieerig ad the Scieces Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistats: Bria Ng, UCLA Statistics Uiversity of Califoria, Los Ageles,
More informationEcon 325: Introduction to Empirical Economics
Eco 35: Itroductio to Empirical Ecoomics Lecture 3 Discrete Radom Variables ad Probability Distributios Copyright 010 Pearso Educatio, Ic. Publishig as Pretice Hall Ch. 4-1 4.1 Itroductio to Probability
More informationLast time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object
6.3 Stochastic Estimatio ad Cotrol, Fall 004 Lecture 7 Last time: Momets of the Poisso distributio from its geeratig fuctio. Gs () e dg µ e ds dg µ ( s) µ ( s) µ ( s) µ e ds dg X µ ds X s dg dg + ds ds
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationMath 525: Lecture 5. January 18, 2018
Math 525: Lecture 5 Jauary 18, 2018 1 Series (review) Defiitio 1.1. A sequece (a ) R coverges to a poit L R (writte a L or lim a = L) if for each ǫ > 0, we ca fid N such that a L < ǫ for all N. If the
More informationModule 1 Fundamentals in statistics
Normal Distributio Repeated observatios that differ because of experimetal error ofte vary about some cetral value i a roughly symmetrical distributio i which small deviatios occur much more frequetly
More informationON POINTWISE BINOMIAL APPROXIMATION
Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece
More informationThe Poisson Distribution
MATH 382 The Poisso Distributio Dr. Neal, WKU Oe of the importat distributios i probabilistic modelig is the Poisso Process X t that couts the umber of occurreces over a period of t uits of time. This
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Math 36Q Fall 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2 to
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationIIT JAM Mathematical Statistics (MS) 2006 SECTION A
IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim
More informationSample questions. 8. Let X denote a continuous random variable with probability density function f(x) = 4x 3 /15 for
Sample questios Suppose that humas ca have oe of three bloodtypes: A, B, O Assume that 40% of the populatio has Type A, 50% has type B, ad 0% has Type O If a perso has type A, the probability that they
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationMassachusetts Institute of Technology
Solutios to Quiz : Sprig 006 Problem : Each of the followig statemets is either True or False. There will be o partial credit give for the True False questios, thus ay explaatios will ot be graded. Please
More informationLecture Chapter 6: Convergence of Random Sequences
ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite
More informationLecture 6: Coupon Collector s problem
Radomized Algorithms Lecture 6: Coupo Collector s problem Sotiris Nikoletseas Professor CEID - ETY Course 2017-2018 Sotiris Nikoletseas, Professor Radomized Algorithms - Lecture 6 1 / 16 Variace: key features
More informationThe variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.
SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample
More informationHOMEWORK I: PREREQUISITES FROM MATH 727
HOMEWORK I: PREREQUISITES FROM MATH 727 Questio. Let X, X 2,... be idepedet expoetial radom variables with mea µ. (a) Show that for Z +, we have EX µ!. (b) Show that almost surely, X + + X (c) Fid the
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationLecture 20: Multivariate convergence and the Central Limit Theorem
Lecture 20: Multivariate covergece ad the Cetral Limit Theorem Covergece i distributio for radom vectors Let Z,Z 1,Z 2,... be radom vectors o R k. If the cdf of Z is cotiuous, the we ca defie covergece
More informationDownloaded from
ocepts ad importat formulae o probability Key cocept: *coditioal probability *properties of coditioal probability *Multiplicatio Theorem o Probablity *idepedet evets *Theorem of Total Probablity *Bayes
More informationDiscrete Probability Functions
Discrete Probability Fuctios Daiel B. Rowe, Ph.D. Professor Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 017 by 1 Outlie Discrete RVs, PMFs, CDFs Discrete Expectatios Discrete Momets
More informationSTAT 350 Handout 19 Sampling Distribution, Central Limit Theorem (6.6)
STAT 350 Hadout 9 Samplig Distributio, Cetral Limit Theorem (6.6) A radom sample is a sequece of radom variables X, X 2,, X that are idepedet ad idetically distributed. o This property is ofte abbreviated
More informationLimit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p).
Limit Theorems Covergece i Probability Let X be the umber of heads observed i tosses. The, E[X] = p ad Var[X] = p(-p). L O This P x p NM QP P x p should be close to uity for large if our ituitio is correct.
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationProbability review (week 2) Solutions
Probability review (week 2) Solutios A. Biomial distributio. BERNOULLI, BINOMIAL, POISSON AND NORMAL DISTRIBUTIONS. X is a biomial RV with parameters,p. Let u i be a Beroulli RV with probability of success
More informationNotation List. For Cambridge International Mathematics Qualifications. For use from 2020
Notatio List For Cambridge Iteratioal Mathematics Qualificatios For use from 2020 Notatio List for Cambridge Iteratioal Mathematics Qualificatios (For use from 2020) Mathematical otatio Eamiatios for CIE
More informationReview of Discrete-time Signals. ELEC 635 Prof. Siripong Potisuk
Review of Discrete-time Sigals ELEC 635 Prof. Siripog Potisuk 1 Discrete-time Sigals Discrete-time, cotiuous-valued amplitude (sampled-data sigal) Discrete-time, discrete-valued amplitude (digital sigal)
More informationAMS 216 Stochastic Differential Equations Lecture 02 Copyright by Hongyun Wang, UCSC ( ( )) 2 = E X 2 ( ( )) 2
AMS 216 Stochastic Differetial Equatios Lecture 02 Copyright by Hogyu Wag, UCSC Review of probability theory (Cotiued) Variace: var X We obtai: = E X E( X ) 2 = E( X 2 ) 2E ( X )E X var( X ) = E X 2 Stadard
More informationDirection: This test is worth 150 points. You are required to complete this test within 55 minutes.
Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem
More informationUNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY
UNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY Structure 2.1 Itroductio Objectives 2.2 Relative Frequecy Approach ad Statistical Probability 2. Problems Based o Relative Frequecy 2.4 Subjective Approach
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationProbability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].
Probability 2 - Notes 0 Some Useful Iequalities. Lemma. If X is a radom variable ad g(x 0 for all x i the support of f X, the P(g(X E[g(X]. Proof. (cotiuous case P(g(X Corollaries x:g(x f X (xdx x:g(x
More informationAdvanced Engineering Mathematics Exercises on Module 4: Probability and Statistics
Advaced Egieerig Mathematics Eercises o Module 4: Probability ad Statistics. A survey of people i give regio showed that 5% drak regularly. The probability of death due to liver disease, give that a perso
More informationDiscrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22
CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first
More informationMATHEMATICAL SCIENCES
SET7-Math.Sc.-II-D Roll No. 57 (Write Roll Number from left side exactly as i the Admit Card) Subject Code : 5 PAPER II Sigature of Ivigilators.. Questio Booklet Series Questio Booklet No. (Idetical with
More informationMath 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency
Math 152. Rumbos Fall 2009 1 Solutios to Review Problems for Exam #2 1. I the book Experimetatio ad Measuremet, by W. J. Youde ad published by the by the Natioal Sciece Teachers Associatio i 1962, the
More informationClosed book and notes. No calculators. 60 minutes, but essentially unlimited time.
IE 230 Seat # Closed book ad otes. No calculators. 60 miutes, but essetially ulimited time. Cover page, four pages of exam, ad Pages 8 ad 12 of the Cocise Notes. This test covers through Sectio 4.7 of
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationSTAT 515 fa 2016 Lec Sampling distribution of the mean, part 2 (central limit theorem)
STAT 515 fa 2016 Lec 15-16 Samplig distributio of the mea, part 2 cetral limit theorem Karl B. Gregory Moday, Sep 26th Cotets 1 The cetral limit theorem 1 1.1 The most importat theorem i statistics.............
More informationDiscrete Mathematics for CS Spring 2005 Clancy/Wagner Notes 21. Some Important Distributions
CS 70 Discrete Mathematics for CS Sprig 2005 Clacy/Wager Notes 21 Some Importat Distributios Questio: A biased coi with Heads probability p is tossed repeatedly util the first Head appears. What is the
More information