f X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36

Size: px
Start display at page:

Download "f X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36"

Transcription

1 Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probability that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c}) Pr(X c) = Pr({s S X(s) c} This makes sese sice the rage of X is the real umbers Example: I the coi example, Pr(#H = 2) = 4/9 ad Pr(#H 1) = 5/9 Give a probability measure Pr o a sample space S ad a radom variable X, the probability distributio associated with X is f X (x) = Pr(X = x) f X is a probability measure o the real umbers The cumulative distributio associated with X is F X (x) = Pr(X x) Suppose S is the sample space correspodig to tossig a pair of fair dice: {(i, j) 1 i,j 6} Let X be the radom variable that gives the sum: X(i,j) = i + j f X (2) = Pr(X = 2) = Pr({(1, 1)}) = 1/36 f X (3) = Pr(X = 3) = Pr({(1, 2), (2, 1)}) = 2/36 f X (7) = Pr(X = 7) = Pr({(1, 6), (2, 5),,(6, 1)}) = 6/36 f X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36 Ca similarly compute the cumulative distributio: F X (2) = f X (2) = 1/36 F X (3) = f X (2) + f X (3) = 3/36 F X (12) = The Fiite Uiform Distributio The Biomial Distributio The fiite uiform distributio is a equiprobable distributio If S = {x 1,,x }, where x 1 < x 2 < < x, the: f(x k ) = 1/ F(x k ) = k/ Suppose there is a experimet with probability p of success ad thus probability q = 1 p of failure For example, cosider tossig a biased coi, where Pr(h) = p Gettig heads is success, ad gettig tails is failure Suppose the experimet is repeated idepedetly times For example, the coi is tossed times This is called a sequece of Beroulli trials Key features: Oly two possibilities: success or failure Probability of success does ot chage from trial to trial The trials are idepedet 3 4

2 What is the probability of k successes i trials? Suppose = 5 ad k = 3 How may sequeces of 5 coi tosses have exactly three heads? hhhtt hhtht hhtth C(5, 3) such sequeces! What is the probability of each oe? p 3 (1 p) 2 Therefore, probability is C(5, 3)p 3 (1 p) 2 Let B,p (k) be the probability of gettig k successes i Beroulli trials with probability p of success B,p (k) = C(,k)p k (1 p) k Not surprisigly, B,p is called the Biomal Distributio The Poisso Distributio A large call ceter receives, o average, λ calls/miute What is the probability that exactly k calls come durig a give miute? Uderstadig this probability is critical for staffig! Similar issues arise if a priter receives, o average λ jobs/miute, a site gets λ hits/miute, This is modelled well by the Poisso distributio with parameter λ: f λ (k) = e λλk f λ (0) = e λ f λ (1) = e λ λ f λ (2) = e λ λ 2 /2 e λ is a ormalizatio costat, sice 1 + λ + λ 2 /2 + λ 3 /3! + = e λ 5 6 Derivig the Poisso New Distributios from Old Poisso distributio = limit of biomial distributios Suppose at most oe call arrives i each secod Sice λ calls come each miute, expect about λ/60 each secod The probability that k calls come is B 60,λ/60 (k) This model does t allow more tha oe call/secod What s so special about 60? Suppose we divide oe miute ito time segmets Probability of gettig a call i each segmet is λ/ Probability of gettig k calls i a miute is B,λ/ (k) = C(, k)(λ/) k (1 λ ) k = C(, k) = λk! ( k)! Now let : ( ) lim 1 λ = e λ (! lim ) 1 k ( k)! λ = 1 λ/ 1 λ ( 1 λ k ( 1 λ ) k ( 1 λ Coclusio: lim B,λ/ (k) = e λλk 7 ) ) If X ad Y are radom variables o a sample space S, so is X + Y, X + 2Y, XY, si(x), etc For example, (X + Y )(s) = X(s) + Y (s) si(x)(s) = si(x(s)) Note si(x) is a radom variable: a fuctio from the sample space to the reals 8

3 Some Examples Example 1: A fair die is rolled Let X deote the umber that shows up What is the probability distributio of Y = X 2? {s : Y (s) = k} = {s : X 2 (s) = k} = {s : X(s) = k} {s : X(s) = k} Coclusio: f Y (k) = f X ( k) + f X ( k) So f Y (1) = f Y (4) = f Y (9) = f Y (36) = 1/6 f Y (k) = 0 if k / {1, 4, 9, 16, 25, 36} Example 2: A coi is flipped Let X be 1 if the coi shows H ad -1 if T Let Y = X 2 I this case Y 1, so Pr(Y = 1) = 1 Example 3: If two dice are rolled, let X be the umber that comes up o the first dice, ad Y the umber that comes up o the secod Formally, X((i,j)) = i, Y ((i,j)) = j The radom variable X +Y is the total umber showig Example 4: Suppose we toss a biased coi times (more geerally, we perform Beroulli trials) Let X k describe the outcome of the kth coi toss: X k = 1 if the kth coi toss is heads, ad 0 otherwise How do we formalize this? What s the sample space? Notice that Σ k=1x k describes the umber of successes of Beroulli trials If the probability of a sigle success is p, the Σ k=1x k has distributio B,p The biomial distributio is the sum of Beroullis 9 10 Idepedet radom variables Pairwise vs mutual idepedece I a roll of two dice, let X ad Y record the umbers o the first ad secod die respectively What ca you say about the evets X = 3, Y = 2? What about X = i ad Y = j? Defiitio: The radom variables X ad Y are idepedet if for every x ad y the evets X = x ad Y = y are idepedet Example: X ad Y above are idepedet Defiitio: The radom variables X 1,X 2,,X are mutually idepedet if, for every x 1, x 2,x Pr(X 1 = x 1 X = x ) = Pr(X 1 = x 1 ) Pr(X = x ) Example: X k, the success idicators i Beroulli trials, are idepedet Mutual idepedece implies pairwise idepedece; the coverse may ot be true: Example 1: A ball is radomly draw from a ur cotaiig 4 balls: oe blue, oe red, oe gree ad oe multicolored (red + blue + gree) Let X 1, X 2 ad X 3 deote the idicators of the evets the ball has (some) blue, red ad gree respectively Pr(X i = 1) = 1/2, for i = 1, 2, 3 X 1 = 0 X 1 = 1 X 1 ad X 2 idepedet: X 2 = 0 1/4 1/4 X 2 = 1 1/4 1/4 Similarly, X 1 ad X 3 are idepedet; so are X 2 ad X 3 Are X 1, X 2 ad X 3 idepedet? No! Pr(X 1 = 1 X 2 = 1 X 3 = 1) = 1/4 Pr(X 1 = 1) Pr(X 2 = 1) Pr(X 3 = 1) = 1/8 Example 2: Suppose X 1 ad X 2 are bits (0 or 1) chose uiformly at radom; X 3 = X 1 X 2 X 1, X 2 are idepedet, as are X 1, X 3 ad X 2, X 3 But X 1, X 2, ad X 3 are ot mutually idepedet X 1 ad X 2 together determie X 3! 11 12

4 The distributio of X + Y Example: The Sum of Biomials Suppose X ad Y are idepedet radom variables whose rage is icluded i {0, 1,,} For k {0, 1,,2}, (X + Y = k) = k j=0 ((X = j) (Y = k j)) Note that some of the evets might be empty Eg, X = k is boud to be empty if k > This is a disjoit uio so Pr(X + Y = k) = Σ k j=0 Pr(X = j Y = k j) = Σ k j=0 Pr(X = j) Pr(Y = k j) [by idepedece] Suppose X has distributio B,p, Y has distributio B m,p, ad X ad Y are idepedet Pr(X + Y = k) = Σ k j=0 Pr(X = j Y = k j) [sum rule] = Σ k j=0 Pr(X = j) Pr(Y = k j) [idepedece] = Σ k ( ) j=0 j p j (1 p) j( ) m k j p k j (1 p) m k+j = Σ k ( )( ) m j=0 j k j p k (1 p) +m k = (Σ k ( )( ) m j=0 j k j )p k (1 p) +m k ) p k (1 p) +m k = ( +m k = B +m,p (k) Thus, X + Y has distributio B +m,p A easier argumet: Perform + m Beroulli trials Let X be the umber of successes i the first ad let Y be the umber of successes i the last m X has distributio B,p, Y has distributio B m,p, X ad Y are idepedet, ad X +Y is the umber of successes i all +m trials, ad so has distributio B +m,p Expected Value Suppose we toss a biased coi, with Pr(h) = 2/3 If the coi lads heads, you get $1; if the coi lads tails, you get $3 What are your expected wiigs? 2/3 of the time you get $1; 1/3 of the time you get $3 (2/3 1) + (1/3 3) = 5/3 What s a good way to thik about this? We have a radom variable W (for wiigs): W(h) = 1 W(t) = 3 The expectatio of W is E(W) = Pr(h)W(h) + Pr(t)W(t) = Pr(W = 1) 1 + Pr(W = 3) 3 Example: What is the expected cout whe two dice are rolled? Let X be the cout (the sum of the values o the two dice): E(X) = Σ 12 i=2i Pr(X = i) = = = 7 More geerally, the expected value of radom variable X o sample space S is A equivalet defiitio: E(X) = Σ x x Pr(X = x) E(X) = Σ s S X(s) Pr(s) 15 16

5 Expectatio of Biomials Expectatio is Liear What is E(B,p ), the expectatio for the biomial distributio B,p How may heads do you expect to get after tosses of a biased coi with Pr(h) = p? Method 1: Use the defiitio ad crak it out: E(B,p ) = Σ k=0k k p k (1 p) k This looks awful, but it ca be calculated Method 2: Use Iductio; break it up ito what happes o the first toss ad o the later tosses O the first toss you get heads with probability p ad tails with probability 1 p O the last 1 tosses, you expect E(B 1,p ) heads Thus, the expected umber of heads is: E(B,p ) = p(1 + E(B 1,p )) + (1 p)(e(b 1,p )) = p + E(B 1,p ) E(B 1,p ) = p Now a easy iductio shows that E(B,p ) = p There s a eve easier way 17 Theorem: E(X + Y ) = E(X) + E(Y ) Proof: Recall that Thus, E(X) = Σ s S Pr(s)X(s) E(X + Y ) = Σ s S Pr(s)(X + Y )(s) = Σ s S Pr(s)X(s) + Σ s S Pr(s)Y (s) = E(X) + E(Y ) Theorem: E(aX) = ae(x) Proof: E(aX) = Σ s S Pr(s)(aX)(s) = aσ s S X(s) = ae(x) 18 Example 1: Back to the expected value of tossig two dice: Let X 1 be the cout o the first die, X 2 the cout o the secod die, ad let X be the total cout Notice that E(X 1 ) = E(X 2 ) = ( )/6 = 35 E(X) = E(X 1 +X 2 ) = E(X 1 ) +E(X 2 ) = = 7 Example 2: Back to the expected value of B,p Let X be the total umber of successes ad let X k be the outcome of the kth experimet, k = 1,,: Therefore E(X k ) = p 1 + (1 p) 0 = p X = X X E(X) = E(X 1 ) + + E(X ) = p Expectatio of Poisso Distributio Let X be Poisso with parameter λ: f X (k) = e λλk for k N E(X) = Σ k=0k e λλk λ λk = Σ k=1e (k 1)! = λe λ Σ k=1 λk 1 (k 1)! = λe λ Σ j=0 λj j! = λe λ e λ [Taylor series!] = λ Does this make sese? Recall that, for example, X models the umber of icomig calls for a tech support ceter whose average rate per miute is λ 19 20

6 Geometric Distributio Cosider a sequece of Beroulli trials Let X deote the umber of the first successful trial Eg, the first time you see heads X has a geometric distributio f X (k) = (1 p) k 1 p k N + The probability of seeig heads for the first time o the kth toss is the probability of gettig k 1 tails followed by heads This is also called a egative biomial distributio of order 1 The egative biomial of order gives the probability that it will take k trials to have successes 21

f X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36

f X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36 Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probablity that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c} Pr(X c) = Pr({s S X(s)

More information

Randomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)

Randomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018) Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black

More information

Lecture 6: Coupon Collector s problem

Lecture 6: Coupon Collector s problem Radomized Algorithms Lecture 6: Coupo Collector s problem Sotiris Nikoletseas Professor CEID - ETY Course 2017-2018 Sotiris Nikoletseas, Professor Radomized Algorithms - Lecture 6 1 / 16 Variace: key features

More information

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19 CS 70 Discrete Mathematics ad Probability Theory Sprig 2016 Rao ad Walrad Note 19 Some Importat Distributios Recall our basic probabilistic experimet of tossig a biased coi times. This is a very simple

More information

Lecture 12: November 13, 2018

Lecture 12: November 13, 2018 Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,

More information

CS 330 Discussion - Probability

CS 330 Discussion - Probability CS 330 Discussio - Probability March 24 2017 1 Fudametals of Probability 11 Radom Variables ad Evets A radom variable X is oe whose value is o-determiistic For example, suppose we flip a coi ad set X =

More information

4. Basic probability theory

4. Basic probability theory Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio

More information

Final Review for MATH 3510

Final Review for MATH 3510 Fial Review for MATH 50 Calculatio 5 Give a fairly simple probability mass fuctio or probability desity fuctio of a radom variable, you should be able to compute the expected value ad variace of the variable

More information

Introduction to Probability and Statistics Twelfth Edition

Introduction to Probability and Statistics Twelfth Edition Itroductio to Probability ad Statistics Twelfth Editio Robert J. Beaver Barbara M. Beaver William Medehall Presetatio desiged ad writte by: Barbara M. Beaver Itroductio to Probability ad Statistics Twelfth

More information

0, otherwise. EX = E(X 1 + X n ) = EX j = np and. Var(X j ) = np(1 p). Var(X) = Var(X X n ) =

0, otherwise. EX = E(X 1 + X n ) = EX j = np and. Var(X j ) = np(1 p). Var(X) = Var(X X n ) = PROBABILITY MODELS 35 10. Discrete probability distributios I this sectio, we discuss several well-ow discrete probability distributios ad study some of their properties. Some of these distributios, lie

More information

kp(x = k) = λe λ λ k 1 (k 1)! = λe λ r k e λλk k! = e λ g(r) = e λ e rλ = e λ(r 1) g (1) = E[X] = λ g(r) = kr k 1 e λλk k! = E[X]

kp(x = k) = λe λ λ k 1 (k 1)! = λe λ r k e λλk k! = e λ g(r) = e λ e rλ = e λ(r 1) g (1) = E[X] = λ g(r) = kr k 1 e λλk k! = E[X] Problem 1: (8 poits) Let X be a Poisso radom variable of parameter λ. 1. ( poits) Compute E[X]. E[X] = = kp(x = k) = k=1 λe λ λ k 1 (k 1)! = λe λ ke λλk λ k k! k =0 2. ( poits) Compute g(r) = E [ r X],

More information

EE 4TM4: Digital Communications II Probability Theory

EE 4TM4: Digital Communications II Probability Theory 1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair

More information

IE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes.

IE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes. Closed book ad otes. No calculators. 120 miutes. Cover page, five pages of exam, ad tables for discrete ad cotiuous distributios. Score X i =1 X i / S X 2 i =1 (X i X ) 2 / ( 1) = [i =1 X i 2 X 2 ] / (

More information

NOTES ON DISTRIBUTIONS

NOTES ON DISTRIBUTIONS NOTES ON DISTRIBUTIONS MICHAEL N KATEHAKIS Radom Variables Radom variables represet outcomes from radom pheomea They are specified by two objects The rage R of possible values ad the frequecy fx with which

More information

Topic 8: Expected Values

Topic 8: Expected Values Topic 8: Jue 6, 20 The simplest summary of quatitative data is the sample mea. Give a radom variable, the correspodig cocept is called the distributioal mea, the epectatio or the epected value. We begi

More information

Introduction to Probability. Ariel Yadin. Lecture 7

Introduction to Probability. Ariel Yadin. Lecture 7 Itroductio to Probability Ariel Yadi Lecture 7 1. Idepedece Revisited 1.1. Some remiders. Let (Ω, F, P) be a probability space. Give a collectio of subsets K F, recall that the σ-algebra geerated by K,

More information

CH.25 Discrete Random Variables

CH.25 Discrete Random Variables CH.25 Discrete Radom Variables 25B PG.784-785 #1, 3, 4, 6 25C PG.788-789 #1, 3, 5, 8, 10, 11 25D PG.791-792 #1, 3, 6 25E PG.794-795 #1, 2, 3, 7, 10 25F.1 PG.798-799 #2, 3, 5 25F.2 PG. 800-802 #2, 4, 7,

More information

n outcome is (+1,+1, 1,..., 1). Let the r.v. X denote our position (relative to our starting point 0) after n moves. Thus X = X 1 + X 2 + +X n,

n outcome is (+1,+1, 1,..., 1). Let the r.v. X denote our position (relative to our starting point 0) after n moves. Thus X = X 1 + X 2 + +X n, CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 9 Variace Questio: At each time step, I flip a fair coi. If it comes up Heads, I walk oe step to the right; if it comes up Tails, I walk oe

More information

Lecture Chapter 6: Convergence of Random Sequences

Lecture Chapter 6: Convergence of Random Sequences ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite

More information

CH5. Discrete Probability Distributions

CH5. Discrete Probability Distributions CH5. Discrete Probabilit Distributios Radom Variables A radom variable is a fuctio or rule that assigs a umerical value to each outcome i the sample space of a radom eperimet. Nomeclature: - Capital letters:

More information

PRACTICE PROBLEMS FOR THE FINAL

PRACTICE PROBLEMS FOR THE FINAL PRACTICE PROBLEMS FOR THE FINAL Math 36Q Fall 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2 to

More information

Discrete Mathematics and Probability Theory Summer 2014 James Cook Note 15

Discrete Mathematics and Probability Theory Summer 2014 James Cook Note 15 CS 70 Discrete Mathematics ad Probability Theory Summer 2014 James Cook Note 15 Some Importat Distributios I this ote we will itroduce three importat probability distributios that are widely used to model

More information

Lecture 1 Probability and Statistics

Lecture 1 Probability and Statistics Wikipedia: Lecture 1 Probability ad Statistics Bejami Disraeli, British statesma ad literary figure (1804 1881): There are three kids of lies: lies, damed lies, ad statistics. popularized i US by Mark

More information

AMS 216 Stochastic Differential Equations Lecture 02 Copyright by Hongyun Wang, UCSC ( ( )) 2 = E X 2 ( ( )) 2

AMS 216 Stochastic Differential Equations Lecture 02 Copyright by Hongyun Wang, UCSC ( ( )) 2 = E X 2 ( ( )) 2 AMS 216 Stochastic Differetial Equatios Lecture 02 Copyright by Hogyu Wag, UCSC Review of probability theory (Cotiued) Variace: var X We obtai: = E X E( X ) 2 = E( X 2 ) 2E ( X )E X var( X ) = E X 2 Stadard

More information

PH 425 Quantum Measurement and Spin Winter SPINS Lab 1

PH 425 Quantum Measurement and Spin Winter SPINS Lab 1 PH 425 Quatum Measuremet ad Spi Witer 23 SPIS Lab Measure the spi projectio S z alog the z-axis This is the experimet that is ready to go whe you start the program, as show below Each atom is measured

More information

Lecture 1 Probability and Statistics

Lecture 1 Probability and Statistics Wikipedia: Lecture 1 Probability ad Statistics Bejami Disraeli, British statesma ad literary figure (1804 1881): There are three kids of lies: lies, damed lies, ad statistics. popularized i US by Mark

More information

Discrete Mathematics for CS Spring 2005 Clancy/Wagner Notes 21. Some Important Distributions

Discrete Mathematics for CS Spring 2005 Clancy/Wagner Notes 21. Some Important Distributions CS 70 Discrete Mathematics for CS Sprig 2005 Clacy/Wager Notes 21 Some Importat Distributios Questio: A biased coi with Heads probability p is tossed repeatedly util the first Head appears. What is the

More information

Some discrete distribution

Some discrete distribution Some discrete distributio p. 2-13 Defiitio (Beroulli distributio B(p)) A Beroulli distributio takes o oly two values: 0 ad 1, with probabilities 1 p ad p, respectively. pmf: p() = p (1 p) (1 ), if =0or

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

The Binomial Theorem

The Binomial Theorem The Biomial Theorem Lecture 47 Sectio 9.7 Robb T. Koether Hampde-Sydey College Fri, Apr 8, 204 Robb T. Koether (Hampde-Sydey College The Biomial Theorem Fri, Apr 8, 204 / 25 Combiatios 2 Pascal s Triagle

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

IE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes.

IE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes. IE 230 Seat # Name < KEY > Please read these directios. Closed book ad otes. 60 miutes. Covers through the ormal distributio, Sectio 4.7 of Motgomery ad Ruger, fourth editio. Cover page ad four pages of

More information

Limit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p).

Limit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p). Limit Theorems Covergece i Probability Let X be the umber of heads observed i tosses. The, E[X] = p ad Var[X] = p(-p). L O This P x p NM QP P x p should be close to uity for large if our ituitio is correct.

More information

Problems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:

Problems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman: Math 224 Fall 2017 Homework 4 Drew Armstrog Problems from 9th editio of Probability ad Statistical Iferece by Hogg, Tais ad Zimmerma: Sectio 2.3, Exercises 16(a,d),18. Sectio 2.4, Exercises 13, 14. Sectio

More information

AMS570 Lecture Notes #2

AMS570 Lecture Notes #2 AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)

More information

Discrete Mathematics and Probability Theory Spring 2012 Alistair Sinclair Note 15

Discrete Mathematics and Probability Theory Spring 2012 Alistair Sinclair Note 15 CS 70 Discrete Mathematics ad Probability Theory Sprig 2012 Alistair Siclair Note 15 Some Importat Distributios The first importat distributio we leared about i the last Lecture Note is the biomial distributio

More information

Learning Theory: Lecture Notes

Learning Theory: Lecture Notes Learig Theory: Lecture Notes Kamalika Chaudhuri October 4, 0 Cocetratio of Averages Cocetratio of measure is very useful i showig bouds o the errors of machie-learig algorithms. We will begi with a basic

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

Problem Set 2 Solutions

Problem Set 2 Solutions CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S

More information

Approximations and more PMFs and PDFs

Approximations and more PMFs and PDFs Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Lecture 2: April 3, 2013

Lecture 2: April 3, 2013 TTIC/CMSC 350 Mathematical Toolkit Sprig 203 Madhur Tulsiai Lecture 2: April 3, 203 Scribe: Shubhedu Trivedi Coi tosses cotiued We retur to the coi tossig example from the last lecture agai: Example. Give,

More information

On Random Line Segments in the Unit Square

On Random Line Segments in the Unit Square O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,

More information

Discrete probability distributions

Discrete probability distributions Discrete probability distributios I the chapter o probability we used the classical method to calculate the probability of various values of a radom variable. I some cases, however, we may be able to develop

More information

Discrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22

Discrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22 CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

Massachusetts Institute of Technology

Massachusetts Institute of Technology Solutios to Quiz : Sprig 006 Problem : Each of the followig statemets is either True or False. There will be o partial credit give for the True False questios, thus ay explaatios will ot be graded. Please

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

5. Likelihood Ratio Tests

5. Likelihood Ratio Tests 1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,

More information

As stated by Laplace, Probability is common sense reduced to calculation.

As stated by Laplace, Probability is common sense reduced to calculation. Note: Hadouts DO NOT replace the book. I most cases, they oly provide a guidelie o topics ad a ituitive feel. The math details will be covered i class, so it is importat to atted class ad also you MUST

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

( ) = p and P( i = b) = q.

( ) = p and P( i = b) = q. MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of

More information

Empirical Distributions

Empirical Distributions Empirical Distributios A empirical distributio is oe for which each possible evet is assiged a probability derived from experimetal observatio. It is assumed that the evets are idepedet ad the sum of the

More information

Poisson approximations

Poisson approximations The Bi, p) ca be thought of as the distributio of a sum of idepedet idicator radom variables X +...+ X, with {X i = } deotig a head o the ith toss of a coi. The ormal approximatio to the Biomial works

More information

Average Case Complexity

Average Case Complexity Probability Applicatios Aalysis of Algorithms Average Case Complexity Mote Carlo Methods Spam Filters Probability Distributio Basic Cocepts S = {a 1,, a } = fiite set of outcomes = sample space p :S [0,1]

More information

PRACTICE PROBLEMS FOR THE FINAL

PRACTICE PROBLEMS FOR THE FINAL PRACTICE PROBLEMS FOR THE FINAL Math 36Q Sprig 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 6 9/24/2008 DISCRETE RANDOM VARIABLES AND THEIR EXPECTATIONS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 6 9/24/2008 DISCRETE RANDOM VARIABLES AND THEIR EXPECTATIONS MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 6 9/24/2008 DISCRETE RANDOM VARIABLES AND THEIR EXPECTATIONS Cotets 1. A few useful discrete radom variables 2. Joit, margial, ad

More information

Random Models. Tusheng Zhang. February 14, 2013

Random Models. Tusheng Zhang. February 14, 2013 Radom Models Tusheg Zhag February 14, 013 1 Radom Walks Let me describe the model. Radom walks are used to describe the motio of a movig particle (object). Suppose that a particle (object) moves alog the

More information

Solutions of Homework 2.

Solutions of Homework 2. 1 Solutios of Homework 2. 1. Suppose X Y with E(Y )

More information

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand Final Solutions

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand Final Solutions CS 70 Discrete Mathematics ad Probability Theory Fall 2016 Seshia ad Walrad Fial Solutios CS 70, Fall 2016, Fial Solutios 1 1 TRUE or FALSE?: 2x8=16 poits Clearly put your aswers i the aswer box o the

More information

Lecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables

Lecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables CSCI-B609: A Theorist s Toolkit, Fall 06 Aug 3 Lecture 0: the Cetral Limit Theorem Lecturer: Yua Zhou Scribe: Yua Xie & Yua Zhou Cetral Limit Theorem for iid radom variables Let us say that we wat to aalyze

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

Math 525: Lecture 5. January 18, 2018

Math 525: Lecture 5. January 18, 2018 Math 525: Lecture 5 Jauary 18, 2018 1 Series (review) Defiitio 1.1. A sequece (a ) R coverges to a poit L R (writte a L or lim a = L) if for each ǫ > 0, we ca fid N such that a L < ǫ for all N. If the

More information

Probability theory and mathematical statistics:

Probability theory and mathematical statistics: N.I. Lobachevsky State Uiversity of Nizhi Novgorod Probability theory ad mathematical statistics: Law of Total Probability. Associate Professor A.V. Zorie Law of Total Probability. 1 / 14 Theorem Let H

More information

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?

More information

CS 171 Lecture Outline October 09, 2008

CS 171 Lecture Outline October 09, 2008 CS 171 Lecture Outlie October 09, 2008 The followig theorem comes very hady whe calculatig the expectatio of a radom variable that takes o o-egative iteger values. Theorem: Let Y be a radom variable that

More information

The Random Walk For Dummies

The Random Walk For Dummies The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli

More information

Discrete Probability Functions

Discrete Probability Functions Discrete Probability Fuctios Daiel B. Rowe, Ph.D. Professor Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 017 by 1 Outlie Discrete RVs, PMFs, CDFs Discrete Expectatios Discrete Momets

More information

Sample Midterm This midterm consists of 10 questions. The rst seven questions are multiple choice; the remaining three

Sample Midterm This midterm consists of 10 questions. The rst seven questions are multiple choice; the remaining three CS{74 Combiatorics & Discrete Probability, Fall 97 Sample Midterm :30{:00pm, 7 October Read these istructios carefully. This is a closed book exam. Calculators are permitted.. This midterm cosists of 0

More information

STAT Homework 1 - Solutions

STAT Homework 1 - Solutions STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better

More information

Unbiased Estimation. February 7-12, 2008

Unbiased Estimation. February 7-12, 2008 Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

More information

STAT 516 Answers Homework 6 April 2, 2008 Solutions by Mark Daniel Ward PROBLEMS

STAT 516 Answers Homework 6 April 2, 2008 Solutions by Mark Daniel Ward PROBLEMS STAT 56 Aswers Homework 6 April 2, 28 Solutios by Mark Daiel Ward PROBLEMS Chapter 6 Problems 2a. The mass p(, correspods to either o the irst two balls beig white, so p(, 8 7 4/39. The mass p(, correspods

More information

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the

More information

UNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY

UNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY UNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY Structure 2.1 Itroductio Objectives 2.2 Relative Frequecy Approach ad Statistical Probability 2. Problems Based o Relative Frequecy 2.4 Subjective Approach

More information

Econ 325: Introduction to Empirical Economics

Econ 325: Introduction to Empirical Economics Eco 35: Itroductio to Empirical Ecoomics Lecture 3 Discrete Radom Variables ad Probability Distributios Copyright 010 Pearso Educatio, Ic. Publishig as Pretice Hall Ch. 4-1 4.1 Itroductio to Probability

More information

Quick Review of Probability

Quick Review of Probability Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig

More information

Chapter 1. Probability

Chapter 1. Probability Chapter. Probability. Set defiitios 2. Set operatios 3. Probability itroduced through sets ad relative frequecy 4. Joit ad coditioal probability 5. Idepedet evets 6. Combied experimets 7. Beroulli trials

More information

IIT JAM Mathematical Statistics (MS) 2006 SECTION A

IIT JAM Mathematical Statistics (MS) 2006 SECTION A IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim

More information

Probability for mathematicians INDEPENDENCE TAU

Probability for mathematicians INDEPENDENCE TAU Probability for mathematicias INDEPENDENCE TAU 2013 28 Cotets 3 Ifiite idepedet sequeces 28 3a Idepedet evets........................ 28 3b Idepedet radom variables.................. 33 3 Ifiite idepedet

More information

Discrete Mathematics and Probability Theory Fall 2016 Walrand Probability: An Overview

Discrete Mathematics and Probability Theory Fall 2016 Walrand Probability: An Overview CS 70 Discrete Mathematics ad Probability Theory Fall 2016 Walrad Probability: A Overview Probability is a fasciatig theory. It provides a precise, clea, ad useful model of ucertaity. The successes of

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Lecture 2 February 8, 2016

Lecture 2 February 8, 2016 MIT 6.854/8.45: Advaced Algorithms Sprig 206 Prof. Akur Moitra Lecture 2 February 8, 206 Scribe: Calvi Huag, Lih V. Nguye I this lecture, we aalyze the problem of schedulig equal size tasks arrivig olie

More information

Mathematical Statistics - MS

Mathematical Statistics - MS Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios

More information

Parameter, Statistic and Random Samples

Parameter, Statistic and Random Samples Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,

More information

Textbook: D.C. Montgomery and G.C. Runger, Applied Statistics and Probability for Engineers, John Wiley & Sons, New York, Sections

Textbook: D.C. Montgomery and G.C. Runger, Applied Statistics and Probability for Engineers, John Wiley & Sons, New York, Sections Textbook: DC Motgomery ad GC Ruger, Applied Statistics ad Probability for Egieers, Joh Wiley & Sos, New York, 2003 Sectios 28 35 1 Defiitio of "radom variable" (a) Write the defiitio of a radom variable

More information

Lecture 7: Properties of Random Samples

Lecture 7: Properties of Random Samples Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ

More information

STAT 515 fa 2016 Lec Sampling distribution of the mean, part 2 (central limit theorem)

STAT 515 fa 2016 Lec Sampling distribution of the mean, part 2 (central limit theorem) STAT 515 fa 2016 Lec 15-16 Samplig distributio of the mea, part 2 cetral limit theorem Karl B. Gregory Moday, Sep 26th Cotets 1 The cetral limit theorem 1 1.1 The most importat theorem i statistics.............

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

Solutions to Homework 6

Solutions to Homework 6 Solutios to Homework Math 500-, Summer 00 July 7, 00 p. 0 07, #. Clearly, Y has a biomial distributio with parameters 3 ad p. That is, k 0 3 PfY kg ( )3 ( )3 3 ( )3 3 ( )3 `3 0 `3 `3 `3 3 E(Y ) 0 ˆ «+

More information

Variance of Discrete Random Variables Class 5, Jeremy Orloff and Jonathan Bloom

Variance of Discrete Random Variables Class 5, Jeremy Orloff and Jonathan Bloom Variace of Discrete Radom Variables Class 5, 18.05 Jeremy Orloff ad Joatha Bloom 1 Learig Goals 1. Be able to compute the variace ad stadard deviatio of a radom variable.. Uderstad that stadard deviatio

More information

Quick Review of Probability

Quick Review of Probability Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.

More information

HOMEWORK I: PREREQUISITES FROM MATH 727

HOMEWORK I: PREREQUISITES FROM MATH 727 HOMEWORK I: PREREQUISITES FROM MATH 727 Questio. Let X, X 2,... be idepedet expoetial radom variables with mea µ. (a) Show that for Z +, we have EX µ!. (b) Show that almost surely, X + + X (c) Fid the

More information

Probability and Statistics

Probability and Statistics robability ad Statistics rof. Zheg Zheg Radom Variable A fiite sigle valued fuctio.) that maps the set of all eperimetal outcomes ito the set of real umbers R is a r.v., if the set ) is a evet F ) for

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Probability and statistics: basic terms

Probability and statistics: basic terms Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample

More information

B Supplemental Notes 2 Hypergeometric, Binomial, Poisson and Multinomial Random Variables and Borel Sets

B Supplemental Notes 2 Hypergeometric, Binomial, Poisson and Multinomial Random Variables and Borel Sets B671-672 Supplemetal otes 2 Hypergeometric, Biomial, Poisso ad Multiomial Radom Variables ad Borel Sets 1 Biomial Approximatio to the Hypergeometric Recall that the Hypergeometric istributio is fx = x

More information

Simulation. Two Rule For Inverting A Distribution Function

Simulation. Two Rule For Inverting A Distribution Function Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Chapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities

Chapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other

More information