Problems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:
|
|
- Kellie Webster
- 6 years ago
- Views:
Transcription
1 Math 224 Fall 2017 Homework 4 Drew Armstrog Problems from 9th editio of Probability ad Statistical Iferece by Hogg, Tais ad Zimmerma: Sectio 2.3, Exercises 16(a,d),18. Sectio 2.4, Exercises 13, 14. Sectio 4.1, Exercises 3, 4. Sectio 4.2, Exercises 3(a). Sectio 5.3, Exercises 2, 5. Solutios to Book Problems Let X be the umber of flips of a fair coi that are required to observe the same face o cosecutive flips. (a) Fid the pmf of X. Solutio: The evet X 1 is empty, so that P (X 1) 0. The evet X 2 cosists of the sequeces T T ad HH so that X 2 {T T, HH} P (X 2) P (T T ) + P (HH) 1/4 + 1/4 1/2. The evet X 3 cosists of the sequeces HT T ad T HH so that X 3 {HT T, T HH} P (X 3) P (HT T ) + P (T HH) 1/8 + 1/8 1/4. The evet X 4 cosists of the sequeces T HT T ad HT HH so that X 4 {T HT T, HT HH} P (X 4) P (T HT T ) + P (HT HH) 1/16 + 1/16 1/8. I geeral, the evet X k cosists of exactly two sequeces: } HT {{ H} T T ad } T{{ HT} HH. k 2 flips k 2 flips Sice the coi is fair, each of these sequeces has probability 1/2 k, so that P (X k) 1 2 k k 2 2 k 1 2 k 1. The geometric series guaratees that this is, ideed, a probability mass fuctio: P (X 2) k2 1 2 k
2 2 (d) Fid the values of P (X 3), P (X 5) ad P (X 3). Solutio: We already saw that P (X 3) 1/4. To fid P (X 3) we add up all the ways this ca happe: P (X 3) k 3 P (X k) P (X 2) + P (X 3) We ca compute P (X 5) by summig a geometric series: P (X 5) k5 1/2 k 1 1/ / / / /2 4 [1 + 1/2 + 1/4 + 1/8 + ] 1/ /2 3 1/8. Alteratively, we ca compute the probability of the complemet: P (X 5) 1 P (X 4) 1 [P (X 2) + P (X 3) + P (X 4)] 1 [1/2 + 1/4 + 1/8] 1 7/8 1/8. /// Remark: I did t ask you to solve (b) ad (c) because we did t talk eough about momet geeratig fuctios i class. Here are the solutios ayway. To compute the mgf of X we use aother geometric series: M X (t) E[e tx ] e tk P (X k) k2 e tk 1/2 k 1 k2 e t (e t /2) k 1 k2 e t [e t /2 + (e t /2) 2 + (e t /2) 3 + ] e t (e t /2) [1 + (e t /2) 1 + (e 2 /2) 2 + ] e t (e t /2) e2t 2 e t. 1 1 e t /2
3 Now we ca use this to compute the mea ad variace. The oly trick is to remember the quotiet rule for derivatives: µ E[X] d dt M X(t) t0 d ( ) e 2t dt 2 e t0 t (2 et )(e 2t ) (e 2t )(2 e t ) (2 e t ) 2 (2 et )(2e 2t ) (e 2t )( e t ) (2 e t ) 2 (2 e0 )(2e 0 ) (e 0 )( e 0 ) (2 e 0 ) 2 (2 1)(2) (1)( 1) (2 1) 2 3. t0 t0 Alright, that was eough fu. My computer did the rest of the work: E[X 2 ] d2 dt 2 M X(t) 11, t0 σ 2 Var(X) E[X 2 ] E[X] 2 11 (3) 2 2 σ Here is a picture summarizig the results of Exercise : Let X have a geometric distributio, i.e., P (X k) p(1 p) k 1. Show that for ay o-egative itegers j ad k we have P (X > k + j X > k) P (X > j).
4 4 Proof: We recall from HW3 that for all o-egative itegers l we have P (X > l) p(1 p) l 1 kl+1 p(1 p) l + p(1 p) l+1 + p(1 p) l+2 + p(1 p) l [1 + (1 p) 1 + (1 p) 2 + ] p(1 p) l (1 p) l. 1 1 (1 p) Next we ote that the evet X > k + j ad X > k is the same as X > k + j. Fially, we use the defiitio of coditioal probability: P (X > k + j X > k) P (X > k + j ad X > k)/p (X > k) P (X > k + j)/p (X > k) (1 p) k+j /(1 p) k (1 p) j P (X > j). What does it mea? A geometric radom variable meas we are waitig for somethig to happe. The umber P (X > j) is the probability that it will take at least j uits of time for the thig to happe. Now suppose that we have bee waitig for k uits of time ad the thig still has t happeed. What is the chace that we will have to wait at least j more uits of time? Aswer: P (X > j). Reaso: A geometric radom variable does t kow how log we ve bee waitig because it has o memory. This is why we model it with a coi flip It is claimed that i a particular lottery, 1/10 of the 50 millio tickets will wi a prize. What is the probability of wiig at least oe prize if you purchase (a) 10 tickets? Solutio: Let X i be the evet defied by { 1 if your ith ticket wis a prize, X i 0 if your ith ticket does ot wi a prize. These evets are ot idepedet. (For example, if your first ticket wis a prize, the your secod ticket is slightly less likely to wi a prize.) However, they are approximately idepedet because the umber 50, 000, 000 is so big. Therefore we will assume that P (X i 1) 1/10 ad P (X i 0) 9/10 for all i. Uder these assumptios, the total umber of prizes X X 1 + X X 10 is approximately biomial with 10 ad p 1/10. Therefore the probability of wiig at least oe prize is P (X 1) 1 P (X 0) 1 (1 p) 10 1 (9/10) %. (b) 15 tickets? Solutio: Usig the same simplifyig assumptios, the umber of prizes X that we wi is approximately biomial with 15 ad p 1/10. Therefore the probability of wiig at least oe prize is P (X 1) 1 (1 p) 15 1 (9/10) %. ///
5 Cotiuig from the previous problem, suppose that we buy tickets. The the umber of prizes X that we wi is approximately biomial with p 1/10. (I reality it is hypergeometric.) Therefore the probability of wiig at least oe prize is approximately P (X 1) 1 (1 p) 1 (9/10). Here is a plot of the probability P (X 1) for values of from 1 to 50: 5 It looks like the probability crosses 0.5 betwee 6 ad 7, ad the probability crosses 0.95 whe is aroud 30. To be precise, we have 6 P (X 1) 46.86% 7 P (X 1) 52.17% 28 P (X 1) 94.77% 29 P (X 1) 95.29%. Remark: I the previous two exercises we approximated the umber of prizes X by a biomial distributio where is the umber of tickets we buy ad p 1/10 is the proportio of tickets that are wiers. I reality X has a hypergeometric distributio. To see this, ote that there are 5, 000, 000 wiig tickets ad 45, 000, 000 losig tickets i a ur. We reach i ad grab tickets at radom. The probability of gettig exactly k wiig tickets is ( )( ) ( ) 5, 000, , 000, , 000, 000 P (X k) /, k k ad the probability of gettig at least oe wiig ticket is ( ) ( 45, 000, , 000, 000 P (X 1) 1 P (X 0) 1 / ). ///
6 6 Therefore we are assumig for simplicity that ( ) ( ) 45, 000, , 000, 000 / (9/10). It turs out that this approximatio 1 is quite good for small values of. Ideed, I ra all the calculatios agai with the exact formula ad I got the same aswers up to several decimal places Let X ad Y be radom variables with S X {1, 2} ad S Y {1, 2, 3, 4} ad with joit pmf give by the formula f XY (x, y) x + y 32. Solutio: For (a) ad (b) we draw the joit pmf as a table ad the we sum the rows ad colums to get the margial pmfs: For (c) through (f) we add the probabilities i the relevat cells of the table: P (X > Y ) 3/32 P (Y 2X) 3/32 + 6/32 9/32 P (X + Y 3) 3/32 + 3/32 6/32 P (X + Y 3) P (X 3 Y ) 2/32 + 3/32 + 3/32 8/32. (g): We ote that X ad Y are ot idepedet because, for example, the joit probability P (X 1, Y 1) 2/32 is ot equal to the product of the margial probabilities P (X 1)P (Y 1) (14/32)(5/32). (h): We use tables to compute the 1st ad 2d momets of X ad Y. Here is the table for X: P (X k) 14/32 18/32 k 1 2 k E[X] 1(14/32) + 2(18/32) 25/16 E[X 2 ] 1(14/32) + 4(18/32) 43/16 1 We ll talk more about these ideas after Exam2.
7 7 Ad here is the table for Y : 5 7 P (Y l) l l Fially, we compute the variaces: E[Y ] /16 E[Y 2 ] /16 Var(X) E[X 2 ] E[X] 2 (43/16) (25/16) 2 63/256, Var(Y ) E[Y 2 ] E[Y ] 2 (145/16) (45/16) 2 295/ Let X be a radom umber from the set {0, 2, 4, 6, 8} ad let Z be a radom umber from the set {0, 1, 2, 3, 4}. We obseve that X ad Z are idepedet ad that each possible pair of umbers has equal probability 1/5 2 1/25. Now let Y X + Z. We expect that X ad Y are ot idepedet. To verify this we will compute the joit pmf of X ad Y. First ote that S Y {0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}. We observe that each possible value of Y either has probability 0 (because it is impossible) or 1/25 (because there is exactly oe way it ca happe). Thus we obtai the followig table showig the joit ad margial pmfs of X ad Y (to save space we write P 1/25): x \ y P P P P P P P P P P P P P P P P P P P P P P P 0 0 5P P P P P P 5P P P 2P 2P 3P 2P 3P 2P 3P 2P 2P P P To see that X ad Y are ot idepedet, we oly eed to observe, for example, that the joit probability P (X 2, Y 0) 0 is ot equal to the product of the margial probabilities: P (X 2)P (Y 0) (5/25)(1/25) (a). Roll a fair 4-sided die twice. Let X equal the outcome o the first roll ad let Y equal the sum of the two rolls. Here is a table showig the margial ad joit pmfs of X ad Y (to save space we write P 1/16): x \ y P P P P P 2 0 P P P P 0 0 4P P P P P 0 4P P P P P 4P P 2P 3P 4P 3P 2P P To compute µ X ad σ 2 x we use the margial distributio of X: E[X] 1(4P ) + 2(4P ) + 3(4P ) + 4(4P ) 5/2,
8 8 To compute µ Y ad σ 2 Y E[X 2 ] 1 2 (4P ) (4P ) (4P ) (4P ) 15/2, σ 2 X E[X 2 ] E[X] 2 (15/2) (5/2) 2 5/4. we use the margial distributio of Y : E[Y ] 2(P ) + 3(2P ) + 4(3P ) + 5(4P ) + 6(3P ) + 7(2P ) + 8(P ) 5, E[Y 2 ] 2 2 (P ) (2P ) (3P ) (4P ) (3P ) (2P ) (P ) 55/2 σ 2 Y E[Y 2 ] E[Y ] 2 (55/2) (5) 2 5/2. To compute Cov(X, Y ) we could use the joit pmf table to fid E[XY ] ad the compute Cov(X, Y ) E[XY ] µ X µ Y, but there s a better way: We will use the fact that Y X + Z where X is the umber that shows up o the first roll ad Z is the umber that shows up o the secod roll. Sice Z is idetically distributed with X we kow that Var(Z) Var(X) σx 2 5/4, as show above. The we ca use the fact that X ad Z are idepedet to compute It follows that ad hece Var(X + Y ) Var(X + X + Z) Var(2X + Z) Var(2X) + Var(Z) 2 2 Var(X) + Var(Z) 4(5/4) + (5/4) 25/4. Var(X + Y ) Var(X) + Var(Y ) + 2 Cov(X, Y ) 25/4 5/4 + 5/2 + 2 Cov(X, Y ) 10/4 2 Cov(X, Y ) 5/4 Cov(X, Y ), ρ XY Cov(X, Y ) σ X σ Y 5/4 2 5/4 5/ /// What does it mea? If you flip the pmf table upside-dow (so it looks like a typical x, y- plae) the the diagoal cluster of P s is reasoably close to a straight lie with positive slope. That s why the correlatio ρ XY is reasoably close to Let X 1 ad X 2 be idepedet radom variables with biomial distributios b(3, 1/2) ad b(5, 1/2), respectively. Determie (a) P (X 1 2, X 2 4). Aswer: Sice X 1 ad X 2 are idepedet we have P (X 1 2, X 2 4) P (X 1 2)P (X 2 4) ( ) ( ) 3 5 (1/2) 2 (1/2) 1 (1/2) 4 (1/2) (3/2 3 )(5/2 3 ) 15/ %.
9 9 (b) P (X 1 +X 2 7). Aswer: For this oe it s helpful to draw the full pmf table. Sice X 1 ad X 2 are idepedet we compute their margial distributios ad the multiply them as follows: The evet X 1 + X 2 7 correspods to the two circled etries, so that P (X 1 + X 2 7) Let X 1 ad X 2 be observatios of a radom sample of size 2 from a distributio with pmf f(x) x/6 ad support x 1, 2, 3. Fid the pmf of Y X 1 + X 2. Determie the mea ad variace of Y i two differet ways. Solutio: We assume that X 1 ad X 2 are idepedet ad that each has the margial distributio x P (X i x) 1/6 2/6 3/6 Thus their joit pmf is give by the followig table:
10 10 To compute the pmf of Y X 1 + X 2 we circle the evet Y y for each possible value of y: Ad them we add up the probabilities i each blob to obtai: Thus we have P (Y y) 1/36 4/36 10/36 12/36 9/36 y y E[Y ] E[Y 2 ] Var(Y ) E[Y 2 ] E[Y ] 2 (206/9) (14/3) Alteratively, we ca first compute the mea ad variace of X 1 ad X 2 : E[X i ] , E[X 2 i ] , Var(X i ) E[X 2 i ] E[X i ] 2 6 (7/3) Ad the we ca use the algebraic properties of mea ad variace to obtai E[Y ] E[X 1 + X 2 ] E[X 1 ] + E[X 2 ] , Var(Y ) Var(X 1 + X 2 ) Var(X 1 ) + Var(X 2 )
11 I the secod equatio we used the fact that X 1, X 2 are idepedet, which implies that Cov(X 1, X 2 ) 0. The fact that we got the same aswer both times meas that our aswer is correct. Also, it agrees with the aswer i the back of the book. Additioal Problems. 1. Collectig Coupos. Each box of a certai brad of cereal comes with a toy. If there are possible toys ad if they are distributed radomly, how may boxes of cereal do you expect to buy before you get them all? (a) Let X be a geometric radom variable with pmf P (X k) p(1 p) k 1. Use a geometric series to compute the momet geeratig fuctio: M(t) E[e tx ] e tk p(1 p) k 1 e t [ p e t (1 p) ] k 1? k1 (b) Compute the derivative of M(t) to fid the expected value of X: E[X] M (0)? (b) Assumig that you already have l of the toys, let X l be the umber of boxes of cereal that you buy util you get a ew toy. Observe that X l is geometric ad use this fact to compute E[X l ]. (d) Let X be the umber of boxes that you buy util you see all toys. The we have k1 X X 0 + X X 1. Use this to compute the expected value E[X]. [Hit: See Example i the textbook for the case 6.] Solutio: Suppose X has pmf P (X k) p(1 p) k 1 for k 1. The the mgf is M X (t) E[e tx ] k 1 kp (X k) e tk p(1 p) k 1 k1 e t p [ e t (1 p) ] k 1 k1 e t p [1 + e t (1 p) + (e t (1 p)) 2 + ] [ ] e t 1 p 1 e t (1 p) e t p 1 e t (1 p). To compute the expected value, we use the quotiet rule to differetiate the mgf ad the we substitute t 0: E[X] d dt M X(t) d ( e t p t0 dt 1 e t (1 p)) t0 (1 et (1 p))(e t p) (e t p)(1 e t (1 p)) (1 e t (1 p)) 2 t0 11
12 12 (1 et (1 p))(e t p) (e t p)( e t (1 p)) (1 e t (1 p)) 2 (1 e0 (1 p))(e 0 p) (e 0 p)( e 0 (1 p)) (1 e 0 (1 p)) 2 (1 1(1 p))(1p) (1p)( 1(1 p)) (1 1(1 p)) 2 (p)(p) p(p 1) (p) 2 p(p (p 1)) p 2 p/p 2 1/p. What does it mea? Suppose you have a coi with P (H) p. If you cotiue to flip the coi the you are most likely to see the first head o the (1/p)-th flip. Now suppose you are collectig radom toys from cereal boxes ad you already have l of the toys. Let X l be the umber of boxes you buy before you see a ew toy. I this situatio we ca thik of each cereal box as a coi flip with H ew toy ad T old toy. Sice the toys are radomly distributed this meas that P (H) ( l)/ ad P (T ) l/. Thus X l is a geometric radom variable with p ( l)/ ad we coclude that E[X l ] 1 p l. Fially, let X be the umber of cereal boxes we buy before we see all toys. This radom variable is ot geometric, but it is a sum of geometric radom variables. Sice X is the total umber of boxes ad sice X l is the umber of boxes from the l-th toy to the (l + 1)-st toy we coclude that X X 0 + X 1 + X X 1 E[X] E[X 0 ] + E[X 1 ] + E[X 2 ] + + E[X 1 ] ( 1) For example, suppose we cotiue to roll a fair 6 sided die ad let X be the umber of rolls util we see all six faces. The o average we will perform t0 That was a fu problem. E[X] rolls.
AMS570 Lecture Notes #2
AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)
More informationDiscrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22
CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first
More informationDiscrete Mathematics for CS Spring 2005 Clancy/Wagner Notes 21. Some Important Distributions
CS 70 Discrete Mathematics for CS Sprig 2005 Clacy/Wager Notes 21 Some Importat Distributios Questio: A biased coi with Heads probability p is tossed repeatedly util the first Head appears. What is the
More informationFinal Review for MATH 3510
Fial Review for MATH 50 Calculatio 5 Give a fairly simple probability mass fuctio or probability desity fuctio of a radom variable, you should be able to compute the expected value ad variace of the variable
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19
CS 70 Discrete Mathematics ad Probability Theory Sprig 2016 Rao ad Walrad Note 19 Some Importat Distributios Recall our basic probabilistic experimet of tossig a biased coi times. This is a very simple
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationDiscrete Mathematics and Probability Theory Summer 2014 James Cook Note 15
CS 70 Discrete Mathematics ad Probability Theory Summer 2014 James Cook Note 15 Some Importat Distributios I this ote we will itroduce three importat probability distributios that are widely used to model
More informationRandomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)
Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Math 36Q Fall 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2 to
More informationRandom Models. Tusheng Zhang. February 14, 2013
Radom Models Tusheg Zhag February 14, 013 1 Radom Walks Let me describe the model. Radom walks are used to describe the motio of a movig particle (object). Suppose that a particle (object) moves alog the
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More information0, otherwise. EX = E(X 1 + X n ) = EX j = np and. Var(X j ) = np(1 p). Var(X) = Var(X X n ) =
PROBABILITY MODELS 35 10. Discrete probability distributios I this sectio, we discuss several well-ow discrete probability distributios ad study some of their properties. Some of these distributios, lie
More informationDiscrete Mathematics and Probability Theory Spring 2012 Alistair Sinclair Note 15
CS 70 Discrete Mathematics ad Probability Theory Sprig 2012 Alistair Siclair Note 15 Some Importat Distributios The first importat distributio we leared about i the last Lecture Note is the biomial distributio
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Math 36Q Sprig 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2
More informationThe Random Walk For Dummies
The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli
More informationHomework 5 Solutions
Homework 5 Solutios p329 # 12 No. To estimate the chace you eed the expected value ad stadard error. To do get the expected value you eed the average of the box ad to get the stadard error you eed the
More information2 Definition of Variance and the obvious guess
1 Estimatig Variace Statistics - Math 410, 11/7/011 Oe of the mai themes of this course is to estimate the mea µ of some variable X of a populatio. We typically do this by collectig a sample of idividuals
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationf X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probablity that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c} Pr(X c) = Pr({s S X(s)
More informationEE 4TM4: Digital Communications II Probability Theory
1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair
More informationSTAT Homework 2 - Solutions
STAT-36700 Homework - Solutios Fall 08 September 4, 08 This cotais solutios for Homework. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better isight.
More informationMath 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency
Math 152. Rumbos Fall 2009 1 Solutios to Review Problems for Exam #2 1. I the book Experimetatio ad Measuremet, by W. J. Youde ad published by the by the Natioal Sciece Teachers Associatio i 1962, the
More informationChapter 23: Inferences About Means
Chapter 23: Ifereces About Meas Eough Proportios! We ve spet the last two uits workig with proportios (or qualitative variables, at least) ow it s time to tur our attetios to quatitative variables. For
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationParameter, Statistic and Random Samples
Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,
More informationDiscrete Mathematics and Probability Theory Fall 2016 Walrand Probability: An Overview
CS 70 Discrete Mathematics ad Probability Theory Fall 2016 Walrad Probability: A Overview Probability is a fasciatig theory. It provides a precise, clea, ad useful model of ucertaity. The successes of
More informationCS 330 Discussion - Probability
CS 330 Discussio - Probability March 24 2017 1 Fudametals of Probability 11 Radom Variables ad Evets A radom variable X is oe whose value is o-determiistic For example, suppose we flip a coi ad set X =
More informationLecture 2: April 3, 2013
TTIC/CMSC 350 Mathematical Toolkit Sprig 203 Madhur Tulsiai Lecture 2: April 3, 203 Scribe: Shubhedu Trivedi Coi tosses cotiued We retur to the coi tossig example from the last lecture agai: Example. Give,
More informationBertrand s Postulate
Bertrad s Postulate Lola Thompso Ross Program July 3, 2009 Lola Thompso (Ross Program Bertrad s Postulate July 3, 2009 1 / 33 Bertrad s Postulate I ve said it oce ad I ll say it agai: There s always a
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig
More informationSTAT 516 Answers Homework 6 April 2, 2008 Solutions by Mark Daniel Ward PROBLEMS
STAT 56 Aswers Homework 6 April 2, 28 Solutios by Mark Daiel Ward PROBLEMS Chapter 6 Problems 2a. The mass p(, correspods to either o the irst two balls beig white, so p(, 8 7 4/39. The mass p(, correspods
More informationn outcome is (+1,+1, 1,..., 1). Let the r.v. X denote our position (relative to our starting point 0) after n moves. Thus X = X 1 + X 2 + +X n,
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 9 Variace Questio: At each time step, I flip a fair coi. If it comes up Heads, I walk oe step to the right; if it comes up Tails, I walk oe
More information4.3 Growth Rates of Solutions to Recurrences
4.3. GROWTH RATES OF SOLUTIONS TO RECURRENCES 81 4.3 Growth Rates of Solutios to Recurreces 4.3.1 Divide ad Coquer Algorithms Oe of the most basic ad powerful algorithmic techiques is divide ad coquer.
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationCHAPTER I: Vector Spaces
CHAPTER I: Vector Spaces Sectio 1: Itroductio ad Examples This first chapter is largely a review of topics you probably saw i your liear algebra course. So why cover it? (1) Not everyoe remembers everythig
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationTopic 8: Expected Values
Topic 8: Jue 6, 20 The simplest summary of quatitative data is the sample mea. Give a radom variable, the correspodig cocept is called the distributioal mea, the epectatio or the epected value. We begi
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationLearning Theory: Lecture Notes
Learig Theory: Lecture Notes Kamalika Chaudhuri October 4, 0 Cocetratio of Averages Cocetratio of measure is very useful i showig bouds o the errors of machie-learig algorithms. We will begi with a basic
More informationStat 400: Georgios Fellouris Homework 5 Due: Friday 24 th, 2017
Stat 400: Georgios Fellouris Homework 5 Due: Friday 4 th, 017 1. A exam has multiple choice questios ad each of them has 4 possible aswers, oly oe of which is correct. A studet will aswer all questios
More informationChapter 18 Summary Sampling Distribution Models
Uit 5 Itroductio to Iferece Chapter 18 Summary Samplig Distributio Models What have we leared? Sample proportios ad meas will vary from sample to sample that s samplig error (samplig variability). Samplig
More informationDiscrete Probability Functions
Discrete Probability Fuctios Daiel B. Rowe, Ph.D. Professor Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 017 by 1 Outlie Discrete RVs, PMFs, CDFs Discrete Expectatios Discrete Momets
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationProbability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].
Probability 2 - Notes 0 Some Useful Iequalities. Lemma. If X is a radom variable ad g(x 0 for all x i the support of f X, the P(g(X E[g(X]. Proof. (cotiuous case P(g(X Corollaries x:g(x f X (xdx x:g(x
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationApril 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE
April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE TERRY SOO Abstract These otes are adapted from whe I taught Math 526 ad meat to give a quick itroductio to cofidece
More informationProblem Set 2 Solutions
CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER / Statistics
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER 1 018/019 DR. ANTHONY BROWN 8. Statistics 8.1. Measures of Cetre: Mea, Media ad Mode. If we have a series of umbers the
More informationKurskod: TAMS11 Provkod: TENB 21 March 2015, 14:00-18:00. English Version (no Swedish Version)
Kurskod: TAMS Provkod: TENB 2 March 205, 4:00-8:00 Examier: Xiagfeg Yag (Tel: 070 2234765). Please aswer i ENGLISH if you ca. a. You are allowed to use: a calculator; formel -och tabellsamlig i matematisk
More informationZeros of Polynomials
Math 160 www.timetodare.com 4.5 4.6 Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered with fidig the solutios of polyomial equatios of ay degree
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationPUTNAM TRAINING PROBABILITY
PUTNAM TRAINING PROBABILITY (Last udated: December, 207) Remark. This is a list of exercises o robability. Miguel A. Lerma Exercises. Prove that the umber of subsets of {, 2,..., } with odd cardiality
More informationHOMEWORK I: PREREQUISITES FROM MATH 727
HOMEWORK I: PREREQUISITES FROM MATH 727 Questio. Let X, X 2,... be idepedet expoetial radom variables with mea µ. (a) Show that for Z +, we have EX µ!. (b) Show that almost surely, X + + X (c) Fid the
More informationP1 Chapter 8 :: Binomial Expansion
P Chapter 8 :: Biomial Expasio jfrost@tiffi.kigsto.sch.uk www.drfrostmaths.com @DrFrostMaths Last modified: 6 th August 7 Use of DrFrostMaths for practice Register for free at: www.drfrostmaths.com/homework
More informationBHW #13 1/ Cooper. ENGR 323 Probabilistic Analysis Beautiful Homework # 13
BHW # /5 ENGR Probabilistic Aalysis Beautiful Homework # Three differet roads feed ito a particular freeway etrace. Suppose that durig a fixed time period, the umber of cars comig from each road oto the
More informationConfidence Intervals for the Population Proportion p
Cofidece Itervals for the Populatio Proportio p The cocept of cofidece itervals for the populatio proportio p is the same as the oe for, the samplig distributio of the mea, x. The structure is idetical:
More informationMathematics 170B Selected HW Solutions.
Mathematics 17B Selected HW Solutios. F 4. Suppose X is B(,p). (a)fidthemometgeeratigfuctiom (s)of(x p)/ p(1 p). Write q = 1 p. The MGF of X is (pe s + q), sice X ca be writte as the sum of idepedet Beroulli
More informationExercise 4.3 Use the Continuity Theorem to prove the Cramér-Wold Theorem, Theorem. (1) φ a X(1).
Assigmet 7 Exercise 4.3 Use the Cotiuity Theorem to prove the Cramér-Wold Theorem, Theorem 4.12. Hit: a X d a X implies that φ a X (1) φ a X(1). Sketch of solutio: As we poited out i class, the oly tricky
More informationUNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY
UNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY Structure 2.1 Itroductio Objectives 2.2 Relative Frequecy Approach ad Statistical Probability 2. Problems Based o Relative Frequecy 2.4 Subjective Approach
More informationUnbiased Estimation. February 7-12, 2008
Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom
More informationBinomial Distribution
0.0 0.5 1.0 1.5 2.0 2.5 3.0 0 1 2 3 4 5 6 7 0.0 0.5 1.0 1.5 2.0 2.5 3.0 Overview Example: coi tossed three times Defiitio Formula Recall that a r.v. is discrete if there are either a fiite umber of possible
More informationMath 10A final exam, December 16, 2016
Please put away all books, calculators, cell phoes ad other devices. You may cosult a sigle two-sided sheet of otes. Please write carefully ad clearly, USING WORDS (ot just symbols). Remember that the
More informationIntroduction to Probability and Statistics Twelfth Edition
Itroductio to Probability ad Statistics Twelfth Editio Robert J. Beaver Barbara M. Beaver William Medehall Presetatio desiged ad writte by: Barbara M. Beaver Itroductio to Probability ad Statistics Twelfth
More informationMath 155 (Lecture 3)
Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,
More information1. By using truth tables prove that, for all statements P and Q, the statement
Author: Satiago Salazar Problems I: Mathematical Statemets ad Proofs. By usig truth tables prove that, for all statemets P ad Q, the statemet P Q ad its cotrapositive ot Q (ot P) are equivalet. I example.2.3
More informationMassachusetts Institute of Technology
Solutios to Quiz : Sprig 006 Problem : Each of the followig statemets is either True or False. There will be o partial credit give for the True False questios, thus ay explaatios will ot be graded. Please
More informationRandom Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices
Radom Matrices with Blocks of Itermediate Scale Strogly Correlated Bad Matrices Jiayi Tog Advisor: Dr. Todd Kemp May 30, 07 Departmet of Mathematics Uiversity of Califoria, Sa Diego Cotets Itroductio Notatio
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More informationSTA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to:
STA 2023 Module 10 Comparig Two Proportios Learig Objectives Upo completig this module, you should be able to: 1. Perform large-sample ifereces (hypothesis test ad cofidece itervals) to compare two populatio
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationTheorem: Let A n n. In this case that A does reduce to I, we search for A 1 as the solution matrix X to the matrix equation A X = I i.e.
Theorem: Let A be a square matrix The A has a iverse matrix if ad oly if its reduced row echelo form is the idetity I this case the algorithm illustrated o the previous page will always yield the iverse
More informationInverse Matrix. A meaning that matrix B is an inverse of matrix A.
Iverse Matrix Two square matrices A ad B of dimesios are called iverses to oe aother if the followig holds, AB BA I (11) The otio is dual but we ofte write 1 B A meaig that matrix B is a iverse of matrix
More informationChapter 8: Estimating with Confidence
Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationPH 425 Quantum Measurement and Spin Winter SPINS Lab 1
PH 425 Quatum Measuremet ad Spi Witer 23 SPIS Lab Measure the spi projectio S z alog the z-axis This is the experimet that is ready to go whe you start the program, as show below Each atom is measured
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More informationChapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities
Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other
More informationMath 113 Exam 3 Practice
Math Exam Practice Exam will cover.-.9. This sheet has three sectios. The first sectio will remid you about techiques ad formulas that you should kow. The secod gives a umber of practice questios for you
More informationMathematical Statistics - MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More informationLecture 12: November 13, 2018
Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,
More informationLecture 18: Sampling distributions
Lecture 18: Samplig distributios I may applicatios, the populatio is oe or several ormal distributios (or approximately). We ow study properties of some importat statistics based o a radom sample from
More information1 Generating functions for balls in boxes
Math 566 Fall 05 Some otes o geeratig fuctios Give a sequece a 0, a, a,..., a,..., a geeratig fuctio some way of represetig the sequece as a fuctio. There are may ways to do this, with the most commo ways
More informationMath 475, Problem Set #12: Answers
Math 475, Problem Set #12: Aswers A. Chapter 8, problem 12, parts (b) ad (d). (b) S # (, 2) = 2 2, sice, from amog the 2 ways of puttig elemets ito 2 distiguishable boxes, exactly 2 of them result i oe
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationLecture 6: Integration and the Mean Value Theorem. slope =
Math 8 Istructor: Padraic Bartlett Lecture 6: Itegratio ad the Mea Value Theorem Week 6 Caltech 202 The Mea Value Theorem The Mea Value Theorem abbreviated MVT is the followig result: Theorem. Suppose
More information