MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 6 9/24/2008 DISCRETE RANDOM VARIABLES AND THEIR EXPECTATIONS
|
|
- Felicity McDonald
- 6 years ago
- Views:
Transcription
1 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 6 9/24/2008 DISCRETE RANDOM VARIABLES AND THEIR EXPECTATIONS Cotets 1. A few useful discrete radom variables 2. Joit, margial, ad coditioal PMFs 3. Idepedece of radom variables 4. Expected values 1 A FEW USEFUL RANDOM VARIABLES Recall that a radom variable X : Ω R is called discrete if its rage (i.e., the set of values that it ca take) is a coutable set. The PMF of X is a fuctio p X : R [0, 1], defied by p X (x) = P(X = x), ad completely determies the probability law of X. The followig are some importat PMFs. (a) Discrete uiform with parameters a ad b, where a ad b are itegers with a < b. Here, p X (k) = 1/(b a + 1), k = a, a + 1,..., b, ad p X (k) = 0, otherwise. 1 (b) Beroulli with parameter p, where 0 p 1. Here, p X (0) = p, p X (1) = 1 p. (c) Biomial with parameters ad p, where N ad p [0, 1]. Here, ( ) p X (k) = p k (1 p) k, k = 0, 1,...,. k 1 I the remaiig examples, the qualificatio p X (k) = 0, otherwise, will be omitted for brevity. 1
2 A biomial radom variable with parameters ad p represets the umber of heads observed i idepedet tosses of a coi if the probability of heads at each toss is p. (d) Geometric with parameter p, where 0 < p 1. Here, p X (k) = (1 p) k 1 p, k = 1, 2,...,. A geometric radom variable with parameter p represets the umber of idepedet tosses of a coi util heads are observed for the first time, if the probability of heads at each toss is p. (e) Poisso with parameter λ, where λ > 0. Here, p X (k) = e λ λk, k = 0, 1,.... k! As will be see shortly, a Poisso radom variable ca be thought of as a limitig case of a biomial radom variable. Note that this is a legitimate PMF (i.e., it sums to oe), because of the series expasio of the expoetial fuctio, e λ = k=0 λk /k!. (f) Power law with parameter α, where α > 0. Here, 1 1 p X (k) = k α, k = 1, 2,.... (k + 1) α A equivalet but more ituitive way of specifyig this PMF is i terms of the formula 1 P(X k) =, k = 1, 2,.... k α Note that whe α is small, the tail P(X k) of the distributio decays slowly (slower tha a expoetial) as k icreases, ad i some sese such a distributio has heavy tails. Notatio: Let us use the abbreviatios du(a, b), Ber(p), Bi(, p), Geo(p), Pois(λ), ad Pow(α) to refer the above defied PMFs. We will use otatio d such as X = du(a, b) or X du(a, b) as a shorthad for the statemet that X is a discrete radom variable whose PMF is uiform o (a, b), ad similarly for the other PMFs we defied. We will also use the otatio X = Y to idicate that two radom variables have the same PMFs. d 2
3 1.1 Poisso distributio as a limit of the biomial To get a feel for the Poisso radom variable, thik of a biomial radom variable with very small p ad very large. For example, cosider the umber of typos i a book with a total of words, whe the probability p that ay oe word is misspelled is very small (associate a word with a coi toss that results i a head whe the word is misspelled), or the umber of cars ivolved i accidets i a city o a give day (associate a car with a coi toss that results i a head whe the car has a accidet). Such radom variables ca be well modeled with a Poisso PMF. More precisely, the Poisso PMF with parameter λ is a good approximatio for a biomial PMF with parameters ad p, i.e., k e λ λ k!! k! ( k)! p k (1 p) k, k = 0, 1,...,, provided λ = p, is large, ad p is small. I this case, usig the Poisso PMF may result i simpler models ad calculatios. For example, let = 100 ad p = The the probability of k = 5 successes i = 100 trials is calculated usig the biomial PMF as 100! 95! 5! (1 0.01) 95 = Usig the Poisso PMF with λ = p = = 1, this probability is approximated by 1 e 1 = ! Propositio 1. (Biomial covergece to Poisso) Let us fix some λ > 0, d ad suppose that X = Bi(, λ/), for every. Let X = Pois(λ). The, as, the PMF of X coverges to the PMF of X, i the sese that lim P(X = k) = P(X = k), for ay k 0. Proof: We have ( 1) ( k + 1) λk ( P(X = k) = k k! λ ) k 1. Fix k ad let. We have, for j = 1,..., k, k + j 1, ( 1 λ ) k ( 1, 1 λ ) e λ. 3 d
4 Thus, for ay fixed k, we obtai as claimed. lim P(X = k) = e λ λk = P(X = k), k! 2 JOINT, MARGINAL, AND CONDITIONAL PMFS I most applicatios, oe typically deals with several radom variables at oce. I this sectio, we itroduce a few cocepts that are useful i such a cotext. 2.1 Margial PMFs Cosider two discrete radom variables X ad Y associated with the same experimet. The probability law of each oe of them is described by the correspodig PMF, p X or p Y, called a margial PMF. However, the margial PMFs do ot provide ay iformatio o possible relatios betwee these two radom variables. For example, suppose that the PMF of X is symmetric aroud the origi. If we have either Y = X or Y = X, the PMF of Y remais the same, ad fails to capture the specifics of the depedece betwee X ad Y. 2.2 Joit PMFs The statistical properties of two radom variables X ad Y are captured by a fuctio p X,Y : R 2 [0, 1], defied by p X,Y (x, y) = P(X = x, Y = y), called the joit PMF of X ad Y. Here ad i the sequel, we will use the abbreviated otatio P(X = x, Y = y) istead of the more precise otatios P({X = x} {Y = y}) or P(X = x ad Y = x). More geerally, the PMF of fiitely may discrete radom variables, X 1,..., X o the same probability space is defied by p X1,...,X (x 1,..., x ) = P(X 1 = x 1,..., X = x ). Sometimes, we defie a vector radom variable X, by lettig X = (X 1,..., X ), i which case the joit PMF will be deoted simply as p X (x), where ow the argumet x is a -dimesioal vector. 4
5 The joit PMF of X ad Y determies the probability of ay evet that ca be specified i terms of the radom variables X ad Y. For example if A is the set of all pairs (x, y) that have a certai property, the ( ) P (X, Y ) A = p X,Y (x, y). (x,y) A I fact, we ca calculate the margial PMFs of X ad Y by usig the formulas p X (x) = p X,Y (x, y), p Y (y) = p X,Y (x, y). y The formula for p X (x) ca be verified usig the calculatio p X (x) = P(X = x) = P(X = x, Y = y) = p X,Y (x, y), y where the secod equality follows by otig that the evet {X = x} is the uio of the coutably may disjoit evets {X = x, Y = y}, as y rages over all the differet values of Y. The formula for p Y (y) is verified similarly. 2.3 Coditioal PMFs Let X ad Y be two discrete radom variables, defied o the same probability space, with joit PMF p X,Y. The coditioal PMF of X give Y is a fuctio p X Y, defied by p X Y (x y) = P(X = x Y = y), if P(Y = y) > 0; if P(Y = y) = 0, the value of p X Y (y x) is left udefied. Usig the defiitio of coditioal probabilities, we obtai x y p X Y (x y) = p X,Y (x, y), p Y (y) wheever p Y (y) > 0. More geerally, if we have radom variables X 1,..., X ad Y 1,..., Y m, defied o the same probability space, we defie a coditioal PMF by lettig p X1,...,X Y 1,...,Y m (x 1,..., x y 1,..., y m ) = P(X 1 = x 1,..., X = x Y 1 = y 1,..., Y m = y m ) p X1,...,X,Y 1,...,Y m (x 1,..., x, y 1,..., y m ) =, p Y1,...,Y m (y 1,..., y m ) 5
6 wheever p Y1,...,Y m (y 1,..., y m ) > 0. Agai, if we defie X = (X 1,..., X ) ad Y = (Y 1,..., Y m ), the shorthad otatio p X Y (x y) ca be used. Note that if p Y (y) > 0, the x p X Y (x y) = 1, where the sum is over all x i the rage of the radom variable X. Thus, the coditioal PMF is essetially the same as a ordiary PMF, but with redefied probabilities that take ito accout the coditioig evet Y = y. Visually, if we fix y, the coditioal PMF p X Y (x y), viewed as a fuctio of x is a slice of the joit PMF p X,Y, reormalized so that its etries sum to oe. 3 INDEPENDENCE OF RANDOM VARIABLES We ow defie the importat otio of idepedece of radom variables. We start with a geeral defiitio that applies to all types of radom variables, icludig discrete ad cotiuous oes. We the specialize to the case of discrete radom variables. 3.1 Idepedece of geeral radom variables Ituitively, two radom variables are idepedet if ay partial iformatio o the realized value of oe radom variable does ot chage the distributio of the other. This otio is formalized i the followig defiitio. Defiitio 1. (Idepedece of radom variables) (a) Let X 1,..., X be radom variables defied o the same probability space. We say that these radom variables are idepedet if P(X 1 B 1,..., X B ) = P(X 1 B 1 ) P(X B ), for ay Borel subsets B 1,..., B of the real lie. (b) Let {X s s S} be a collectio of radom variables idexed by the elemets of a (possibly ifiite) idex set S. We say that these radom variables are idepedet if for every fiite subset {s 1,..., s } of S, the radom variables X s1,..., X s are idepedet. Recallig the defiitio of idepedet evets, we see that idepedece of the radom variables X s, s S, is the same as requirig idepedece of the evets {X s B s }, s S, for every choice of Borel subsets B s, s S, of the real lie. 6
7 Verifyig the idepedece of radom variables usig the above defiitio (which ivolves arbitrary Borel sets) is rather difficult. It turs out that oe oly eeds to examie Borel sets of the form (, x]. Propositio 2. Suppose that for every, every x 1,..., x, ad every fiite subset {s 1,..., s } of S, the evets {X si x i }, i = 1,...,, are idepedet. The, the radom variables X s, s S, are idepedet. We omit the proof of the above propositio. However, we remark that ultimately, the proof relies o the fact that the collectio of evets of the form (, x] geerate the Borel σ-field. Let us defie the joit CDF of of the radom variables X 1,..., X by F X1,...,X (x 1,..., x ) = P(X 1 x 1,..., X x ). I view of Propositio 2, idepedece of X 1,..., X is equivalet to the coditio F X1,...,X (x 1,..., x ) = F X1 (x 1 ) F X (x ), x 1,..., x. Exercise 1. Cosider a collectio {A s s S} of evets, where S is a (possibly ifiite) idex set. Prove that the evets A s are idepedet if ad oly if the correspodig idicator fuctios I As, s S, are idepedet radom variables. 3.2 Idepedece of discrete radom variables For a fiite umber of discrete radom variables, idepedece is equivalet to havig a joit PMF which factors ito a product of margial PMFs. Theorem 1. Let X ad Y be discrete radom variables defied o the same probability space. The followig are equivalet. (a) The radom variables X ad Y are idepedet. (b) For ay x, y R, the evets {X = x} ad {Y = y} are idepedet. (c) For ay x, y R, we have p X,Y (x, y) = p X (x)p Y (y). (d) For ay x, y R such that p Y (y) > 0, we have p X Y (x y) = p X (x). Proof: The fact that (a) implies (b) is immediate from the defiitio of idepedece. The equivalece of (b), (c), ad (d) is also a immediate cosequece of our defiitios. We complete the proof by verifyig that (c) implies (a). 7
8 Suppose that X ad Y are idepedet, ad let A, B, be two Borel subsets of the real lie. We the have P(X A, Y B) = P(X = x, Y = y) x A, y B = p X,Y (x, y) x A, y B = p X (x)p Y (x) x A, y B ( )( = p X (x) p Y (y)) x A y B = P(X A) P(Y B). Sice this is true for ay Borel sets A ad B, we coclude that X ad Y are idepedet. We ote that Theorem 1 geeralizes to the case of multiple, but fiitely may, radom variables. The geeralizatio of coditios (a)-(c) should be obvious. As for coditio (d), it ca be geeralized to a few differet forms, oe of which is the followig: give ay subset S 0 of the radom variables uder cosideratio, the coditioal joit PMF of the radom variables X s, s S 0, give the values of the remaiig radom variables, is the same as the ucoditioal joit PMF of the radom variables X s, s S 0, as log as we are coditioig o a evet with positive probability. We fially ote that fuctios g(x) ad h(y ) of two idepedet radom variables X ad Y must themselves be idepedet. This should be expected o ituitive grouds: If X is idepedet from Y, the the iformatio provided by the value of g(x) should ot affect the distributio of Y, ad cosequetly should ot affect the distributio of h(y ). Observe that whe X ad Y are discrete, the g(x) ad h(y ) are radom variables (the required measurability coditios are satisfied) eve if the fuctios g ad h are ot measurable (why?). Theorem 2. Let X ad Y be idepedet discrete radom variables. Let g ad h be some fuctios from R ito itself. The, the radom variables g(x) ad h(y ) are idepedet. The proof is left as a exercise. 8
9 3.3 Examples Example. Let X 1,..., X be idepedet Beroulli radom variables with the same parameter p. The, the radom variable X defied by X = X X is biomial with parameters ad p. To see this, cosider idepedet tosses of a coi i which every toss has probability p of resultig i a oe, ad let X i be the result of the ith coi toss. The, X is the umber of oes observed i idepedet tosses, ad is therefore a biomial radom variable. Example. Let X ad Y be idepedet biomial radom variables with parameters (, p) ad (m, p), respectively. The, the radom variable Z, defied by Z = X + Y is biomial with parameters ( + m, p). To see this, cosider + m idepedet tosses of a coi i which every toss has probability p of resultig i a oe. Let X be the umber of oes i the first tosses, ad let Y be the umber of oes i the last m tosses. The, Z is the umber of oes i +m idepedet tosses, which is biomial with parameters ( + m, p). Example. Cosider idepedet tosses of a coi i which every toss has probability p of resultig i a oe. Let X be the umber of oes obtaied, ad let Y = X, which is the umber of zeros. The radom variables X ad Y are ot idepedet. For example, P(X = 0) = (1 p) ad P(Y = 0) = p, but P(X = 0, Y = 0) = 0 = P(X = 0)P(Y = 0). Ituitively, kowig that there was a small umber of heads gives us iformatio that the umber of tails must be large. However, i sharp cotrast to the ituitio from the precedig example, we obtai idepedece whe the umber of coi tosses is itself radom, with a Poisso distributio. More precisely, let N be a Poisso radom variable with parameter λ. We assume that the coditioal PMF p X N ( ) is biomial with parameters ad p (represetig the umber of oes observed i coi tosses), ad defie Y = N X, which represets the umber of zeros obtaied. We have the followig surprisig result. A ituitive justificatio will have to wait util we cosider the Poisso process, later i this course. The proof is left as a exercise. Theorem 3. (Splittig of a Poisso radom variable) The radom variables ( X ad ) Y are idepedet. Moreover, X = Pois(λp) ad Y = Pois λ(1 p). d d 9
10 4 EXPECTED VALUES 4.1 Prelimiaries: ifiite sums Cosider a sequece {a } of oegative real umbers ad the ifiite sum i=1 a i, defied as the limit, lim i=1 a i, of the partial sums. The ifiite sum ca be fiite or ifiite; i either case, it is well defied, as log as we allow the limit to be a exteded real umber. Furthermore, it ca be verified that the value of the ifiite sum is the same eve if we reorder the elemets of the sequece {a } ad carry out the summatio accordig to this differet order. Because the order of the summatio does ot matter, we ca use the otatio N a for the ifiite sum. More geerally, if C is a coutable set ad g : C [0, ) is a oegative fuctio, we ca use the otatio x C g(x), which is uambiguous eve without specifyig a particular order i which the values g(x) are to be summed. Whe we cosider a sequece of opositive real umbers, the discussio remais the same, ad ifiite sums ca be uambiguously defied. However, whe we cosider sequeces that ivolve both positive ad egative umbers, the situatio is more complicated. I particular, the order at which the elemets of the sequece are added ca make a differece. Example. Let a = ( 1) /. It ca be verified that the limit lim i=1 a exists, ad is fiite, but that the elemets of the sequece {a } ca be reordered to form a ew sequece {b } for which the limit of i=1 b does ot exist. I order to deal with the geeral case, we proceed as follows. Let S be a coutable set, ad cosider a collectio of real umbers a s, s S. Let S + (respectively, S ) be the set of idices s for which a s 0 (respectively, a s < 0). Let S + = s S + a s ad S = s S a s. We distiguish four cases. (a) If both S + ad S are fiite (or equivaletly, if s S a s <, we say that the sum s S a s is absolutely coverget, ad is equal to S + S. I this case, for every possible arragemet of the elemets of S i a sequece {s }, we have lim a si = S + S. i=1 (b) If S + = ad S <, the sum s S a s is ot absolutely coverget; we defie it to be equal to. I this case, for every possible arragemet of the elemets of S i a sequece {s }, we have lim a si =. i=1 10
11 (c) If S + < ad S =, the sum s S a s is ot absolutely coverget; we defie it to be equal to. I this case, for every possible arragemet of the elemets of S i a sequece {s }, we have lim a si =. i=1 (d) If S + = ad S =, the sum s S a is left udefied. I fact, i this case, differet arragemets of the elemets of S i a sequece {s } will result ito differet or eve oexistet values of the limit lim a si. i=1 To summarize, we cosider a coutable sum to be well defied i cases (a) (c), ad call it absolutely coverget oly i case (a). We close by recordig a related useful fact. If we have a doubly idexed family of oegative umbers a ij, i, j N, ad if either (i) the umbers are oegative, or (ii) the sum (i,j) a ij is absolutely coverget, the a ij = a ij = a ij. (1) i=1 j=1 j=1 i=1 (i,j) N 2 More importat, we stress that the first equality eed ot hold i the absece of coditios (i) or (ii) above. 4.2 Defiitio of the expectatio The PMF of a radom variable X provides us with several umbers, the probabilities of all the possible values of X. It is ofte desirable to summarize this iformatio i a sigle represetative umber. This is accomplished by the expectatio of X, which is a weighted (i proportio to probabilities) average of the possible values of X. As motivatio, suppose you spi a wheel of fortue may times. At each spi, oe of the umbers m 1, m 2,..., m comes up with correspodig probability p 1, p 2,..., p, ad this is your moetary reward from that spi. What is the amout of moey that you expect to get per spi? The terms expect ad per spi are a little ambiguous, but here is a reasoable iterpretatio. 11
12 Suppose that you spi the wheel k times, ad that k i is the umber of times that the outcome is m i. The, the total amout received is m 1 k 1 + m 2 k m k. The amout received per spi is m 1 k 1 + m 2 k m k M =. k If the umber of spis k is very large, ad if we are willig to iterpret probabilities as relative frequecies, it is reasoable to aticipate that m i comes up a fractio of times that is roughly equal to p i : k i pi, i = 1,...,. k Thus, the amout of moey per spi that you expect to receive is M = m 1k 1 + m 2 k m k m1 p 1 + m 2 p m p. k Motivated by this example, we itroduce the followig defiitio. Defiitio 2. (Expectatio) We defie the expected value (also called the expectatio or the mea) of a discrete radom variable X, with PMF p X, as E[X] = xp X (x), x wheever the sum is well defied, ad where the sum is take over the coutable set of values i the rage of X. 4.3 Properties of the expectatio We start by poitig out a alterative formula for the expectatio, ad leave its proof as a exercise. I particular, if X ca oly take oegative iteger values, the E[X] = P(X > ). (2) 0 Example. Usig this formula, it is easy to give a example of a radom variable for d which the expected value is ifiite. Cosider X = Pow(α), where α 1. The, it ca be verified, usig the fact =1 1/ =, that E[X] = 1 0 α =. O the other had, if α > 1, the E[X] <. 12
13 Here is aother useful fact, whose proof is agai left as a exercise. Propositio 3. Give a discrete radom variable X ad a fuctio g : R R, we have E[g(X)] = g(x)p X (x). (3) {x p X (x)>0} More geerally, this formula remais valid give a vector X = (X 1,..., X ) of radom variables with joit PMF p X = p X1,...,X, ad a fuctio g : R R. For example, suppose that X is a discrete radom variable ad cosider the fuctio g : R R defied by g(x) = x 2. Let Y = g(x). I order to calculate the expectatio E[Y ] accordig to Defiitio 1, we eed to first fid the PMF of Y, ad the use the formula E[Y ] = y yp Y (y). However, accordig to Propositio 3, we ca work directly with the PMF of X, ad write E[Y ] = E[X 2 ] = x x 2 p X (x). The quatity E[X 2 ] is called the secod momet of X. More geerally, if [( r N, the ) quatity ] E[X r ] is called the rth momet of X. Furthermore, E X E[X] r is called the rth cetral momet of X. The secod cetral momet, E[(X E[X]) 2 ] is called the variace of X, ad is deoted by var(x). The square root of the variace is called the stadard deviatio of X, ad is ofte deoted by σ X, or just σ. Note, that for every eve r, the rth momet ad the rth cetral momet are always oegative; i particular, the stadard deviatio is always well defied. We cotiue with a few more importat properties of expectatios. I the sequel, otatios such as X 0 or X = c mea that X(ω) 0 or X(ω) = c, respectively, for all ω Ω. Similarly, a statemet such as X 0, almost surely or X 0, a.s., meas that P(X 0) = 1. 13
14 Propositio 4. Let X ad Y be discrete radom variables defied o the same probability space. (a) If X 0, a.s., the E[X] 0. (b) If X = c, a.s., for some costat c R, the E[X] = c. (c) For ay a, b R, we have E[aX + by ] = ae[x] + be[y ] (as log as the sum ae[x] + be[y ] is well-defied). (d) If E[X] is fiite, the var(x) = E[X 2 ] (E[X]) 2. (e) For every a R, we have var(ax) = a 2 var(x). (f) If X ad Y are idepedet, the E[XY ] = E[X]E[Y ], ad var(x + Y ) = var(x)+var(y ), provided all of the expectatios ivolved are well defied. (g) More geerally, if X 1,..., X are idepedet, the [ ] E X i = E[X i ], i=1 i=1 ad ( ) var X i = var(x i ), i=1 i=1 as log as all expectatios ivolved are well defied. Remark: We emphasize that property (c) does ot require idepedece. Proof: We oly give the proof for the case where all expectatios ivolved are well defied ad fiite, ad leave it to the reader to verify that the results exted to the case where all expectatios ivolved are well defied but possibly ifiite. Parts (a) ad (b) are immediate cosequeces of the defiitios. For part (c), we use the secod part of Propositio 3, ad the Eq. (1), we obtai E[aX + by ] = (ax + by)p X,Y (x, y) x,y ( ) ( ) = ax p X,Y (x, y) + by p X,Y (x, y) x y y x = a xp X (x) + b yp Y (y) x = ae[x] + be[y ]. y 14
15 For part (d), we have [ ] var(x) = E X 2 2XE[X] + (E[X]) 2 [ ] = E[X 2 ] 2E XE[X] + (E[X]) 2 = E[X 2 ] 2(E[X]) 2 + (E[X]) 2 = E[X 2 ] (E[X]) 2. where the secod equality made use of property (c). Part (e) follows easily from (d) ad (c). For part (f), we apply Propositio 3 ad the use idepedece to obtai E[XY ] = xyp X,Y (x, y) x,y = xyp X (x)p Y (y) ( x,y )( ) = xp X (x) p Y (y) x = E[X] E[Y ]. Furthermore, usig property (d), we have var(x + Y ) = E[(X + Y ) 2 ] (E[X + Y ]) 2 = E[X 2 ] + E[Y 2 ] + 2E[XY ] (E[X]) 2 (E[Y ]) 2 2E[X]E[Y ]. Usig the equality E[XY ] = E[X]E[Y ], the above expressio becomes var(x)+ var(y ). The proof of part (g) is similar ad is omitted. Remark: The equalities i part (f) eed ot hold i the absece of idepedece. For example, cosider a radom variable X that takes either value 1 or 1, with probability 1/2. The, E[X] = ( 0, but ) E[X 2 ] = 1. If we let Y = X, we see that E[XY ] = E[X 2 ] = 1 = 0 = E[X]. Furthermore, var(x + Y ) = var(2x) = 4var(X), while var(x) + var(y ) = 2. Exercise 2. Show that var(x) = 0 if ad oly if there exists a costat c such that P(X = c) = 1. y 15
16 MIT OpeCourseWare J / J Fudametals of Probability Fall 2008 For iformatio about citig these materials or our Terms of Use, visit:
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationMath 525: Lecture 5. January 18, 2018
Math 525: Lecture 5 Jauary 18, 2018 1 Series (review) Defiitio 1.1. A sequece (a ) R coverges to a poit L R (writte a L or lim a = L) if for each ǫ > 0, we ca fid N such that a L < ǫ for all N. If the
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationEE 4TM4: Digital Communications II Probability Theory
1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair
More informationVariance of Discrete Random Variables Class 5, Jeremy Orloff and Jonathan Bloom
Variace of Discrete Radom Variables Class 5, 18.05 Jeremy Orloff ad Joatha Bloom 1 Learig Goals 1. Be able to compute the variace ad stadard deviatio of a radom variable.. Uderstad that stadard deviatio
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationf X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probablity that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c} Pr(X c) = Pr({s S X(s)
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationDiscrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22
CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19
CS 70 Discrete Mathematics ad Probability Theory Sprig 2016 Rao ad Walrad Note 19 Some Importat Distributios Recall our basic probabilistic experimet of tossig a biased coi times. This is a very simple
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More information0, otherwise. EX = E(X 1 + X n ) = EX j = np and. Var(X j ) = np(1 p). Var(X) = Var(X X n ) =
PROBABILITY MODELS 35 10. Discrete probability distributios I this sectio, we discuss several well-ow discrete probability distributios ad study some of their properties. Some of these distributios, lie
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationDiscrete Mathematics and Probability Theory Summer 2014 James Cook Note 15
CS 70 Discrete Mathematics ad Probability Theory Summer 2014 James Cook Note 15 Some Importat Distributios I this ote we will itroduce three importat probability distributios that are widely used to model
More informationLecture 12: November 13, 2018
Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More informationMathematics 170B Selected HW Solutions.
Mathematics 17B Selected HW Solutios. F 4. Suppose X is B(,p). (a)fidthemometgeeratigfuctiom (s)of(x p)/ p(1 p). Write q = 1 p. The MGF of X is (pe s + q), sice X ca be writte as the sum of idepedet Beroulli
More informationDiscrete Mathematics for CS Spring 2005 Clancy/Wagner Notes 21. Some Important Distributions
CS 70 Discrete Mathematics for CS Sprig 2005 Clacy/Wager Notes 21 Some Importat Distributios Questio: A biased coi with Heads probability p is tossed repeatedly util the first Head appears. What is the
More informationProbability and Random Processes
Probability ad Radom Processes Lecture 5 Probability ad radom variables The law of large umbers Mikael Skoglud, Probability ad radom processes 1/21 Why Measure Theoretic Probability? Stroger limit theorems
More informationRandom Models. Tusheng Zhang. February 14, 2013
Radom Models Tusheg Zhag February 14, 013 1 Radom Walks Let me describe the model. Radom walks are used to describe the motio of a movig particle (object). Suppose that a particle (object) moves alog the
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationEntropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP
Etropy ad Ergodic Theory Lecture 5: Joit typicality ad coditioal AEP 1 Notatio: from RVs back to distributios Let (Ω, F, P) be a probability space, ad let X ad Y be A- ad B-valued discrete RVs, respectively.
More informationMath 155 (Lecture 3)
Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,
More informationThe Random Walk For Dummies
The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli
More informationProblems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:
Math 224 Fall 2017 Homework 4 Drew Armstrog Problems from 9th editio of Probability ad Statistical Iferece by Hogg, Tais ad Zimmerma: Sectio 2.3, Exercises 16(a,d),18. Sectio 2.4, Exercises 13, 14. Sectio
More informationNOTES ON DISTRIBUTIONS
NOTES ON DISTRIBUTIONS MICHAEL N KATEHAKIS Radom Variables Radom variables represet outcomes from radom pheomea They are specified by two objects The rage R of possible values ad the frequecy fx with which
More informationIntroduction to Probability. Ariel Yadin. Lecture 7
Itroductio to Probability Ariel Yadi Lecture 7 1. Idepedece Revisited 1.1. Some remiders. Let (Ω, F, P) be a probability space. Give a collectio of subsets K F, recall that the σ-algebra geerated by K,
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationSome Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables
Some Basic Probability Cocepts 2. Experimets, Outcomes ad Radom Variables A radom variable is a variable whose value is ukow util it is observed. The value of a radom variable results from a experimet;
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationn outcome is (+1,+1, 1,..., 1). Let the r.v. X denote our position (relative to our starting point 0) after n moves. Thus X = X 1 + X 2 + +X n,
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 9 Variace Questio: At each time step, I flip a fair coi. If it comes up Heads, I walk oe step to the right; if it comes up Tails, I walk oe
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationChapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities
Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationLecture 6: Coupon Collector s problem
Radomized Algorithms Lecture 6: Coupo Collector s problem Sotiris Nikoletseas Professor CEID - ETY Course 2017-2018 Sotiris Nikoletseas, Professor Radomized Algorithms - Lecture 6 1 / 16 Variace: key features
More information1 Convergence in Probability and the Weak Law of Large Numbers
36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec
More informationLecture Chapter 6: Convergence of Random Sequences
ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite
More informationDefinition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.
4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad
More informationLecture 2: April 3, 2013
TTIC/CMSC 350 Mathematical Toolkit Sprig 203 Madhur Tulsiai Lecture 2: April 3, 203 Scribe: Shubhedu Trivedi Coi tosses cotiued We retur to the coi tossig example from the last lecture agai: Example. Give,
More informationTopic 8: Expected Values
Topic 8: Jue 6, 20 The simplest summary of quatitative data is the sample mea. Give a radom variable, the correspodig cocept is called the distributioal mea, the epectatio or the epected value. We begi
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationf X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probability that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c}) Pr(X c) = Pr({s S X(s)
More information10/31/2018 CentralLimitTheorem
10/31/2018 CetralLimitTheorem http://127.0.0.1:8888/bcovert/html/cs237/web/homeworks%2c%20labs%2c%20ad%20code/cetrallimittheorem.ipyb?dowload=false 1/10 10/31/2018 CetralLimitTheorem Cetral Limit Theorem
More informationDiscrete Mathematics and Probability Theory Spring 2012 Alistair Sinclair Note 15
CS 70 Discrete Mathematics ad Probability Theory Sprig 2012 Alistair Siclair Note 15 Some Importat Distributios The first importat distributio we leared about i the last Lecture Note is the biomial distributio
More informationLecture 3 : Random variables and their distributions
Lecture 3 : Radom variables ad their distributios 3.1 Radom variables Let (Ω, F) ad (S, S) be two measurable spaces. A map X : Ω S is measurable or a radom variable (deoted r.v.) if X 1 (A) {ω : X(ω) A}
More informationLecture 2. The Lovász Local Lemma
Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio
More informationProbability for mathematicians INDEPENDENCE TAU
Probability for mathematicias INDEPENDENCE TAU 2013 28 Cotets 3 Ifiite idepedet sequeces 28 3a Idepedet evets........................ 28 3b Idepedet radom variables.................. 33 3 Ifiite idepedet
More informationProbability and statistics: basic terms
Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample
More information6. Sufficient, Complete, and Ancillary Statistics
Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary
More information4. Basic probability theory
Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More informationLecture 3 The Lebesgue Integral
Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified
More informationCH.25 Discrete Random Variables
CH.25 Discrete Radom Variables 25B PG.784-785 #1, 3, 4, 6 25C PG.788-789 #1, 3, 5, 8, 10, 11 25D PG.791-792 #1, 3, 6 25E PG.794-795 #1, 2, 3, 7, 10 25F.1 PG.798-799 #2, 3, 5 25F.2 PG. 800-802 #2, 4, 7,
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationBinomial Distribution
0.0 0.5 1.0 1.5 2.0 2.5 3.0 0 1 2 3 4 5 6 7 0.0 0.5 1.0 1.5 2.0 2.5 3.0 Overview Example: coi tossed three times Defiitio Formula Recall that a r.v. is discrete if there are either a fiite umber of possible
More informationLecture 5. Random variable and distribution of probability
Itroductio to theory of probability ad statistics Lecture 5. Radom variable ad distributio of probability prof. dr hab.iż. Katarzya Zarzewsa Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za
More informationSingular Continuous Measures by Michael Pejic 5/14/10
Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More informationLecture 15: Strong, Conditional, & Joint Typicality
EE376A/STATS376A Iformatio Theory Lecture 15-02/27/2018 Lecture 15: Strog, Coditioal, & Joit Typicality Lecturer: Tsachy Weissma Scribe: Nimit Sohoi, William McCloskey, Halwest Mohammad I this lecture,
More informationIntegrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number
MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationL = n i, i=1. dp p n 1
Exchageable sequeces ad probabilities for probabilities 1996; modified 98 5 21 to add material o mutual iformatio; modified 98 7 21 to add Heath-Sudderth proof of de Fietti represetatio; modified 99 11
More informationLecture 20: Multivariate convergence and the Central Limit Theorem
Lecture 20: Multivariate covergece ad the Cetral Limit Theorem Covergece i distributio for radom vectors Let Z,Z 1,Z 2,... be radom vectors o R k. If the cdf of Z is cotiuous, the we ca defie covergece
More informationMassachusetts Institute of Technology
Solutios to Quiz : Sprig 006 Problem : Each of the followig statemets is either True or False. There will be o partial credit give for the True False questios, thus ay explaatios will ot be graded. Please
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet
More informationMeasure and Measurable Functions
3 Measure ad Measurable Fuctios 3.1 Measure o a Arbitrary σ-algebra Recall from Chapter 2 that the set M of all Lebesgue measurable sets has the followig properties: R M, E M implies E c M, E M for N implies
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More informationChapter 0. Review of set theory. 0.1 Sets
Chapter 0 Review of set theory Set theory plays a cetral role i the theory of probability. Thus, we will ope this course with a quick review of those otios of set theory which will be used repeatedly.
More informationLecture 12: September 27
36-705: Itermediate Statistics Fall 207 Lecturer: Siva Balakrisha Lecture 2: September 27 Today we will discuss sufficiecy i more detail ad the begi to discuss some geeral strategies for costructig estimators.
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig
More informationLecture Notes for Analysis Class
Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationParameter, Statistic and Random Samples
Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER / Statistics
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER 1 018/019 DR. ANTHONY BROWN 8. Statistics 8.1. Measures of Cetre: Mea, Media ad Mode. If we have a series of umbers the
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More informationCHAPTER 10 INFINITE SEQUENCES AND SERIES
CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece
More informationApplication to Random Graphs
A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let
More informationSets and Probabilistic Models
ets ad Probabilistic Models Berli Che Departmet of Computer ciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Referece: - D. P. Bertsekas, J. N. Tsitsiklis, Itroductio to Probability, ectios 1.1-1.2
More informationCS 330 Discussion - Probability
CS 330 Discussio - Probability March 24 2017 1 Fudametals of Probability 11 Radom Variables ad Evets A radom variable X is oe whose value is o-determiistic For example, suppose we flip a coi ad set X =
More informationCS166 Handout 02 Spring 2018 April 3, 2018 Mathematical Terms and Identities
CS166 Hadout 02 Sprig 2018 April 3, 2018 Mathematical Terms ad Idetities Thaks to Ady Nguye ad Julie Tibshirai for their advice o this hadout. This hadout covers mathematical otatio ad idetities that may
More informationEntropy Rates and Asymptotic Equipartition
Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,
More informationLecture 4. Random variable and distribution of probability
Itroductio to theory of probability ad statistics Lecture. Radom variable ad distributio of probability dr hab.iż. Katarzya Zarzewsa, prof.agh Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za
More information