f X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
|
|
- Amberlynn King
- 6 years ago
- Views:
Transcription
1 Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probability that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c}) Pr(X c) = Pr({s S X(s) c} This makes sese sice the rage of X is the real umbers Example: I the coi example, Pr(#H = 2) = 4/9 ad Pr(#H 1) = 5/9 Give a probability measure Pr o a sample space S ad a radom variable X, the probability distributio associated with X is f X (x) = Pr(X = x) f X is a probability measure o the real umbers The cumulative distributio associated with X is F X (x) = Pr(X x) Suppose S is the sample space correspodig to tossig a pair of fair dice: {(i, j) 1 i,j 6} Let X be the radom variable that gives the sum: X(i,j) = i + j f X (2) = Pr(X = 2) = Pr({(1, 1)}) = 1/36 f X (3) = Pr(X = 3) = Pr({(1, 2), (2, 1)}) = 2/36 f X (7) = Pr(X = 7) = Pr({(1, 6), (2, 5),,(6, 1)}) = 6/36 f X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36 Ca similarly compute the cumulative distributio: F X (2) = f X (2) = 1/36 F X (3) = f X (2) + f X (3) = 3/36 F X (12) = The Fiite Uiform Distributio The Biomial Distributio The fiite uiform distributio is a equiprobable distributio If S = {x 1,,x }, where x 1 < x 2 < < x, the: f(x k ) = 1/ F(x k ) = k/ Suppose there is a experimet with probability p of success ad thus probability q = 1 p of failure For example, cosider tossig a biased coi, where Pr(h) = p Gettig heads is success, ad gettig tails is failure Suppose the experimet is repeated idepedetly times For example, the coi is tossed times This is called a sequece of Beroulli trials Key features: Oly two possibilities: success or failure Probability of success does ot chage from trial to trial The trials are idepedet 3 4
2 What is the probability of k successes i trials? Suppose = 5 ad k = 3 How may sequeces of 5 coi tosses have exactly three heads? hhhtt hhtht hhtth C(5, 3) such sequeces! What is the probability of each oe? p 3 (1 p) 2 Therefore, probability is C(5, 3)p 3 (1 p) 2 Let B,p (k) be the probability of gettig k successes i Beroulli trials with probability p of success B,p (k) = C(,k)p k (1 p) k Not surprisigly, B,p is called the Biomal Distributio The Poisso Distributio A large call ceter receives, o average, λ calls/miute What is the probability that exactly k calls come durig a give miute? Uderstadig this probability is critical for staffig! Similar issues arise if a priter receives, o average λ jobs/miute, a site gets λ hits/miute, This is modelled well by the Poisso distributio with parameter λ: f λ (k) = e λλk f λ (0) = e λ f λ (1) = e λ λ f λ (2) = e λ λ 2 /2 e λ is a ormalizatio costat, sice 1 + λ + λ 2 /2 + λ 3 /3! + = e λ 5 6 Derivig the Poisso New Distributios from Old Poisso distributio = limit of biomial distributios Suppose at most oe call arrives i each secod Sice λ calls come each miute, expect about λ/60 each secod The probability that k calls come is B 60,λ/60 (k) This model does t allow more tha oe call/secod What s so special about 60? Suppose we divide oe miute ito time segmets Probability of gettig a call i each segmet is λ/ Probability of gettig k calls i a miute is B,λ/ (k) = C(, k)(λ/) k (1 λ ) k = C(, k) = λk! ( k)! Now let : ( ) lim 1 λ = e λ (! lim ) 1 k ( k)! λ = 1 λ/ 1 λ ( 1 λ k ( 1 λ ) k ( 1 λ Coclusio: lim B,λ/ (k) = e λλk 7 ) ) If X ad Y are radom variables o a sample space S, so is X + Y, X + 2Y, XY, si(x), etc For example, (X + Y )(s) = X(s) + Y (s) si(x)(s) = si(x(s)) Note si(x) is a radom variable: a fuctio from the sample space to the reals 8
3 Some Examples Example 1: A fair die is rolled Let X deote the umber that shows up What is the probability distributio of Y = X 2? {s : Y (s) = k} = {s : X 2 (s) = k} = {s : X(s) = k} {s : X(s) = k} Coclusio: f Y (k) = f X ( k) + f X ( k) So f Y (1) = f Y (4) = f Y (9) = f Y (36) = 1/6 f Y (k) = 0 if k / {1, 4, 9, 16, 25, 36} Example 2: A coi is flipped Let X be 1 if the coi shows H ad -1 if T Let Y = X 2 I this case Y 1, so Pr(Y = 1) = 1 Example 3: If two dice are rolled, let X be the umber that comes up o the first dice, ad Y the umber that comes up o the secod Formally, X((i,j)) = i, Y ((i,j)) = j The radom variable X +Y is the total umber showig Example 4: Suppose we toss a biased coi times (more geerally, we perform Beroulli trials) Let X k describe the outcome of the kth coi toss: X k = 1 if the kth coi toss is heads, ad 0 otherwise How do we formalize this? What s the sample space? Notice that Σ k=1x k describes the umber of successes of Beroulli trials If the probability of a sigle success is p, the Σ k=1x k has distributio B,p The biomial distributio is the sum of Beroullis 9 10 Idepedet radom variables Pairwise vs mutual idepedece I a roll of two dice, let X ad Y record the umbers o the first ad secod die respectively What ca you say about the evets X = 3, Y = 2? What about X = i ad Y = j? Defiitio: The radom variables X ad Y are idepedet if for every x ad y the evets X = x ad Y = y are idepedet Example: X ad Y above are idepedet Defiitio: The radom variables X 1,X 2,,X are mutually idepedet if, for every x 1, x 2,x Pr(X 1 = x 1 X = x ) = Pr(X 1 = x 1 ) Pr(X = x ) Example: X k, the success idicators i Beroulli trials, are idepedet Mutual idepedece implies pairwise idepedece; the coverse may ot be true: Example 1: A ball is radomly draw from a ur cotaiig 4 balls: oe blue, oe red, oe gree ad oe multicolored (red + blue + gree) Let X 1, X 2 ad X 3 deote the idicators of the evets the ball has (some) blue, red ad gree respectively Pr(X i = 1) = 1/2, for i = 1, 2, 3 X 1 = 0 X 1 = 1 X 1 ad X 2 idepedet: X 2 = 0 1/4 1/4 X 2 = 1 1/4 1/4 Similarly, X 1 ad X 3 are idepedet; so are X 2 ad X 3 Are X 1, X 2 ad X 3 idepedet? No! Pr(X 1 = 1 X 2 = 1 X 3 = 1) = 1/4 Pr(X 1 = 1) Pr(X 2 = 1) Pr(X 3 = 1) = 1/8 Example 2: Suppose X 1 ad X 2 are bits (0 or 1) chose uiformly at radom; X 3 = X 1 X 2 X 1, X 2 are idepedet, as are X 1, X 3 ad X 2, X 3 But X 1, X 2, ad X 3 are ot mutually idepedet X 1 ad X 2 together determie X 3! 11 12
4 The distributio of X + Y Example: The Sum of Biomials Suppose X ad Y are idepedet radom variables whose rage is icluded i {0, 1,,} For k {0, 1,,2}, (X + Y = k) = k j=0 ((X = j) (Y = k j)) Note that some of the evets might be empty Eg, X = k is boud to be empty if k > This is a disjoit uio so Pr(X + Y = k) = Σ k j=0 Pr(X = j Y = k j) = Σ k j=0 Pr(X = j) Pr(Y = k j) [by idepedece] Suppose X has distributio B,p, Y has distributio B m,p, ad X ad Y are idepedet Pr(X + Y = k) = Σ k j=0 Pr(X = j Y = k j) [sum rule] = Σ k j=0 Pr(X = j) Pr(Y = k j) [idepedece] = Σ k ( ) j=0 j p j (1 p) j( ) m k j p k j (1 p) m k+j = Σ k ( )( ) m j=0 j k j p k (1 p) +m k = (Σ k ( )( ) m j=0 j k j )p k (1 p) +m k ) p k (1 p) +m k = ( +m k = B +m,p (k) Thus, X + Y has distributio B +m,p A easier argumet: Perform + m Beroulli trials Let X be the umber of successes i the first ad let Y be the umber of successes i the last m X has distributio B,p, Y has distributio B m,p, X ad Y are idepedet, ad X +Y is the umber of successes i all +m trials, ad so has distributio B +m,p Expected Value Suppose we toss a biased coi, with Pr(h) = 2/3 If the coi lads heads, you get $1; if the coi lads tails, you get $3 What are your expected wiigs? 2/3 of the time you get $1; 1/3 of the time you get $3 (2/3 1) + (1/3 3) = 5/3 What s a good way to thik about this? We have a radom variable W (for wiigs): W(h) = 1 W(t) = 3 The expectatio of W is E(W) = Pr(h)W(h) + Pr(t)W(t) = Pr(W = 1) 1 + Pr(W = 3) 3 Example: What is the expected cout whe two dice are rolled? Let X be the cout (the sum of the values o the two dice): E(X) = Σ 12 i=2i Pr(X = i) = = = 7 More geerally, the expected value of radom variable X o sample space S is A equivalet defiitio: E(X) = Σ x x Pr(X = x) E(X) = Σ s S X(s) Pr(s) 15 16
5 Expectatio of Biomials Expectatio is Liear What is E(B,p ), the expectatio for the biomial distributio B,p How may heads do you expect to get after tosses of a biased coi with Pr(h) = p? Method 1: Use the defiitio ad crak it out: E(B,p ) = Σ k=0k k p k (1 p) k This looks awful, but it ca be calculated Method 2: Use Iductio; break it up ito what happes o the first toss ad o the later tosses O the first toss you get heads with probability p ad tails with probability 1 p O the last 1 tosses, you expect E(B 1,p ) heads Thus, the expected umber of heads is: E(B,p ) = p(1 + E(B 1,p )) + (1 p)(e(b 1,p )) = p + E(B 1,p ) E(B 1,p ) = p Now a easy iductio shows that E(B,p ) = p There s a eve easier way 17 Theorem: E(X + Y ) = E(X) + E(Y ) Proof: Recall that Thus, E(X) = Σ s S Pr(s)X(s) E(X + Y ) = Σ s S Pr(s)(X + Y )(s) = Σ s S Pr(s)X(s) + Σ s S Pr(s)Y (s) = E(X) + E(Y ) Theorem: E(aX) = ae(x) Proof: E(aX) = Σ s S Pr(s)(aX)(s) = aσ s S X(s) = ae(x) 18 Example 1: Back to the expected value of tossig two dice: Let X 1 be the cout o the first die, X 2 the cout o the secod die, ad let X be the total cout Notice that E(X 1 ) = E(X 2 ) = ( )/6 = 35 E(X) = E(X 1 +X 2 ) = E(X 1 ) +E(X 2 ) = = 7 Example 2: Back to the expected value of B,p Let X be the total umber of successes ad let X k be the outcome of the kth experimet, k = 1,,: Therefore E(X k ) = p 1 + (1 p) 0 = p X = X X E(X) = E(X 1 ) + + E(X ) = p Expectatio of Poisso Distributio Let X be Poisso with parameter λ: f X (k) = e λλk for k N E(X) = Σ k=0k e λλk λ λk = Σ k=1e (k 1)! = λe λ Σ k=1 λk 1 (k 1)! = λe λ Σ j=0 λj j! = λe λ e λ [Taylor series!] = λ Does this make sese? Recall that, for example, X models the umber of icomig calls for a tech support ceter whose average rate per miute is λ 19 20
6 Geometric Distributio Cosider a sequece of Beroulli trials Let X deote the umber of the first successful trial Eg, the first time you see heads X has a geometric distributio f X (k) = (1 p) k 1 p k N + The probability of seeig heads for the first time o the kth toss is the probability of gettig k 1 tails followed by heads This is also called a egative biomial distributio of order 1 The egative biomial of order gives the probability that it will take k trials to have successes 21
f X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probablity that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c} Pr(X c) = Pr({s S X(s)
More informationRandomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)
Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black
More informationLecture 6: Coupon Collector s problem
Radomized Algorithms Lecture 6: Coupo Collector s problem Sotiris Nikoletseas Professor CEID - ETY Course 2017-2018 Sotiris Nikoletseas, Professor Radomized Algorithms - Lecture 6 1 / 16 Variace: key features
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19
CS 70 Discrete Mathematics ad Probability Theory Sprig 2016 Rao ad Walrad Note 19 Some Importat Distributios Recall our basic probabilistic experimet of tossig a biased coi times. This is a very simple
More informationLecture 12: November 13, 2018
Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,
More informationCS 330 Discussion - Probability
CS 330 Discussio - Probability March 24 2017 1 Fudametals of Probability 11 Radom Variables ad Evets A radom variable X is oe whose value is o-determiistic For example, suppose we flip a coi ad set X =
More information4. Basic probability theory
Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio
More informationFinal Review for MATH 3510
Fial Review for MATH 50 Calculatio 5 Give a fairly simple probability mass fuctio or probability desity fuctio of a radom variable, you should be able to compute the expected value ad variace of the variable
More informationIntroduction to Probability and Statistics Twelfth Edition
Itroductio to Probability ad Statistics Twelfth Editio Robert J. Beaver Barbara M. Beaver William Medehall Presetatio desiged ad writte by: Barbara M. Beaver Itroductio to Probability ad Statistics Twelfth
More information0, otherwise. EX = E(X 1 + X n ) = EX j = np and. Var(X j ) = np(1 p). Var(X) = Var(X X n ) =
PROBABILITY MODELS 35 10. Discrete probability distributios I this sectio, we discuss several well-ow discrete probability distributios ad study some of their properties. Some of these distributios, lie
More informationkp(x = k) = λe λ λ k 1 (k 1)! = λe λ r k e λλk k! = e λ g(r) = e λ e rλ = e λ(r 1) g (1) = E[X] = λ g(r) = kr k 1 e λλk k! = E[X]
Problem 1: (8 poits) Let X be a Poisso radom variable of parameter λ. 1. ( poits) Compute E[X]. E[X] = = kp(x = k) = k=1 λe λ λ k 1 (k 1)! = λe λ ke λλk λ k k! k =0 2. ( poits) Compute g(r) = E [ r X],
More informationEE 4TM4: Digital Communications II Probability Theory
1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair
More informationIE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes.
Closed book ad otes. No calculators. 120 miutes. Cover page, five pages of exam, ad tables for discrete ad cotiuous distributios. Score X i =1 X i / S X 2 i =1 (X i X ) 2 / ( 1) = [i =1 X i 2 X 2 ] / (
More informationNOTES ON DISTRIBUTIONS
NOTES ON DISTRIBUTIONS MICHAEL N KATEHAKIS Radom Variables Radom variables represet outcomes from radom pheomea They are specified by two objects The rage R of possible values ad the frequecy fx with which
More informationTopic 8: Expected Values
Topic 8: Jue 6, 20 The simplest summary of quatitative data is the sample mea. Give a radom variable, the correspodig cocept is called the distributioal mea, the epectatio or the epected value. We begi
More informationIntroduction to Probability. Ariel Yadin. Lecture 7
Itroductio to Probability Ariel Yadi Lecture 7 1. Idepedece Revisited 1.1. Some remiders. Let (Ω, F, P) be a probability space. Give a collectio of subsets K F, recall that the σ-algebra geerated by K,
More informationCH.25 Discrete Random Variables
CH.25 Discrete Radom Variables 25B PG.784-785 #1, 3, 4, 6 25C PG.788-789 #1, 3, 5, 8, 10, 11 25D PG.791-792 #1, 3, 6 25E PG.794-795 #1, 2, 3, 7, 10 25F.1 PG.798-799 #2, 3, 5 25F.2 PG. 800-802 #2, 4, 7,
More informationn outcome is (+1,+1, 1,..., 1). Let the r.v. X denote our position (relative to our starting point 0) after n moves. Thus X = X 1 + X 2 + +X n,
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 9 Variace Questio: At each time step, I flip a fair coi. If it comes up Heads, I walk oe step to the right; if it comes up Tails, I walk oe
More informationLecture Chapter 6: Convergence of Random Sequences
ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite
More informationCH5. Discrete Probability Distributions
CH5. Discrete Probabilit Distributios Radom Variables A radom variable is a fuctio or rule that assigs a umerical value to each outcome i the sample space of a radom eperimet. Nomeclature: - Capital letters:
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Math 36Q Fall 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2 to
More informationDiscrete Mathematics and Probability Theory Summer 2014 James Cook Note 15
CS 70 Discrete Mathematics ad Probability Theory Summer 2014 James Cook Note 15 Some Importat Distributios I this ote we will itroduce three importat probability distributios that are widely used to model
More informationLecture 1 Probability and Statistics
Wikipedia: Lecture 1 Probability ad Statistics Bejami Disraeli, British statesma ad literary figure (1804 1881): There are three kids of lies: lies, damed lies, ad statistics. popularized i US by Mark
More informationAMS 216 Stochastic Differential Equations Lecture 02 Copyright by Hongyun Wang, UCSC ( ( )) 2 = E X 2 ( ( )) 2
AMS 216 Stochastic Differetial Equatios Lecture 02 Copyright by Hogyu Wag, UCSC Review of probability theory (Cotiued) Variace: var X We obtai: = E X E( X ) 2 = E( X 2 ) 2E ( X )E X var( X ) = E X 2 Stadard
More informationPH 425 Quantum Measurement and Spin Winter SPINS Lab 1
PH 425 Quatum Measuremet ad Spi Witer 23 SPIS Lab Measure the spi projectio S z alog the z-axis This is the experimet that is ready to go whe you start the program, as show below Each atom is measured
More informationLecture 1 Probability and Statistics
Wikipedia: Lecture 1 Probability ad Statistics Bejami Disraeli, British statesma ad literary figure (1804 1881): There are three kids of lies: lies, damed lies, ad statistics. popularized i US by Mark
More informationDiscrete Mathematics for CS Spring 2005 Clancy/Wagner Notes 21. Some Important Distributions
CS 70 Discrete Mathematics for CS Sprig 2005 Clacy/Wager Notes 21 Some Importat Distributios Questio: A biased coi with Heads probability p is tossed repeatedly util the first Head appears. What is the
More informationSome discrete distribution
Some discrete distributio p. 2-13 Defiitio (Beroulli distributio B(p)) A Beroulli distributio takes o oly two values: 0 ad 1, with probabilities 1 p ad p, respectively. pmf: p() = p (1 p) (1 ), if =0or
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationThe Binomial Theorem
The Biomial Theorem Lecture 47 Sectio 9.7 Robb T. Koether Hampde-Sydey College Fri, Apr 8, 204 Robb T. Koether (Hampde-Sydey College The Biomial Theorem Fri, Apr 8, 204 / 25 Combiatios 2 Pascal s Triagle
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationIE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes.
IE 230 Seat # Name < KEY > Please read these directios. Closed book ad otes. 60 miutes. Covers through the ormal distributio, Sectio 4.7 of Motgomery ad Ruger, fourth editio. Cover page ad four pages of
More informationLimit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p).
Limit Theorems Covergece i Probability Let X be the umber of heads observed i tosses. The, E[X] = p ad Var[X] = p(-p). L O This P x p NM QP P x p should be close to uity for large if our ituitio is correct.
More informationProblems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:
Math 224 Fall 2017 Homework 4 Drew Armstrog Problems from 9th editio of Probability ad Statistical Iferece by Hogg, Tais ad Zimmerma: Sectio 2.3, Exercises 16(a,d),18. Sectio 2.4, Exercises 13, 14. Sectio
More informationAMS570 Lecture Notes #2
AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)
More informationDiscrete Mathematics and Probability Theory Spring 2012 Alistair Sinclair Note 15
CS 70 Discrete Mathematics ad Probability Theory Sprig 2012 Alistair Siclair Note 15 Some Importat Distributios The first importat distributio we leared about i the last Lecture Note is the biomial distributio
More informationLearning Theory: Lecture Notes
Learig Theory: Lecture Notes Kamalika Chaudhuri October 4, 0 Cocetratio of Averages Cocetratio of measure is very useful i showig bouds o the errors of machie-learig algorithms. We will begi with a basic
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationProblem Set 2 Solutions
CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationLecture 2: April 3, 2013
TTIC/CMSC 350 Mathematical Toolkit Sprig 203 Madhur Tulsiai Lecture 2: April 3, 203 Scribe: Shubhedu Trivedi Coi tosses cotiued We retur to the coi tossig example from the last lecture agai: Example. Give,
More informationOn Random Line Segments in the Unit Square
O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,
More informationDiscrete probability distributions
Discrete probability distributios I the chapter o probability we used the classical method to calculate the probability of various values of a radom variable. I some cases, however, we may be able to develop
More informationDiscrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22
CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationMassachusetts Institute of Technology
Solutios to Quiz : Sprig 006 Problem : Each of the followig statemets is either True or False. There will be o partial credit give for the True False questios, thus ay explaatios will ot be graded. Please
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More informationAs stated by Laplace, Probability is common sense reduced to calculation.
Note: Hadouts DO NOT replace the book. I most cases, they oly provide a guidelie o topics ad a ituitive feel. The math details will be covered i class, so it is importat to atted class ad also you MUST
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More information( ) = p and P( i = b) = q.
MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of
More informationEmpirical Distributions
Empirical Distributios A empirical distributio is oe for which each possible evet is assiged a probability derived from experimetal observatio. It is assumed that the evets are idepedet ad the sum of the
More informationPoisson approximations
The Bi, p) ca be thought of as the distributio of a sum of idepedet idicator radom variables X +...+ X, with {X i = } deotig a head o the ith toss of a coi. The ormal approximatio to the Biomial works
More informationAverage Case Complexity
Probability Applicatios Aalysis of Algorithms Average Case Complexity Mote Carlo Methods Spam Filters Probability Distributio Basic Cocepts S = {a 1,, a } = fiite set of outcomes = sample space p :S [0,1]
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Math 36Q Sprig 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 6 9/24/2008 DISCRETE RANDOM VARIABLES AND THEIR EXPECTATIONS
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 6 9/24/2008 DISCRETE RANDOM VARIABLES AND THEIR EXPECTATIONS Cotets 1. A few useful discrete radom variables 2. Joit, margial, ad
More informationRandom Models. Tusheng Zhang. February 14, 2013
Radom Models Tusheg Zhag February 14, 013 1 Radom Walks Let me describe the model. Radom walks are used to describe the motio of a movig particle (object). Suppose that a particle (object) moves alog the
More informationDiscrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand Final Solutions
CS 70 Discrete Mathematics ad Probability Theory Fall 2016 Seshia ad Walrad Fial Solutios CS 70, Fall 2016, Fial Solutios 1 1 TRUE or FALSE?: 2x8=16 poits Clearly put your aswers i the aswer box o the
More informationLecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables
CSCI-B609: A Theorist s Toolkit, Fall 06 Aug 3 Lecture 0: the Cetral Limit Theorem Lecturer: Yua Zhou Scribe: Yua Xie & Yua Zhou Cetral Limit Theorem for iid radom variables Let us say that we wat to aalyze
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationMath 525: Lecture 5. January 18, 2018
Math 525: Lecture 5 Jauary 18, 2018 1 Series (review) Defiitio 1.1. A sequece (a ) R coverges to a poit L R (writte a L or lim a = L) if for each ǫ > 0, we ca fid N such that a L < ǫ for all N. If the
More informationProbability theory and mathematical statistics:
N.I. Lobachevsky State Uiversity of Nizhi Novgorod Probability theory ad mathematical statistics: Law of Total Probability. Associate Professor A.V. Zorie Law of Total Probability. 1 / 14 Theorem Let H
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More informationCS 171 Lecture Outline October 09, 2008
CS 171 Lecture Outlie October 09, 2008 The followig theorem comes very hady whe calculatig the expectatio of a radom variable that takes o o-egative iteger values. Theorem: Let Y be a radom variable that
More informationThe Random Walk For Dummies
The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli
More informationDiscrete Probability Functions
Discrete Probability Fuctios Daiel B. Rowe, Ph.D. Professor Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 017 by 1 Outlie Discrete RVs, PMFs, CDFs Discrete Expectatios Discrete Momets
More informationSample Midterm This midterm consists of 10 questions. The rst seven questions are multiple choice; the remaining three
CS{74 Combiatorics & Discrete Probability, Fall 97 Sample Midterm :30{:00pm, 7 October Read these istructios carefully. This is a closed book exam. Calculators are permitted.. This midterm cosists of 0
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More informationUnbiased Estimation. February 7-12, 2008
Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom
More informationSTAT 516 Answers Homework 6 April 2, 2008 Solutions by Mark Daniel Ward PROBLEMS
STAT 56 Aswers Homework 6 April 2, 28 Solutios by Mark Daiel Ward PROBLEMS Chapter 6 Problems 2a. The mass p(, correspods to either o the irst two balls beig white, so p(, 8 7 4/39. The mass p(, correspods
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationUNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY
UNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY Structure 2.1 Itroductio Objectives 2.2 Relative Frequecy Approach ad Statistical Probability 2. Problems Based o Relative Frequecy 2.4 Subjective Approach
More informationEcon 325: Introduction to Empirical Economics
Eco 35: Itroductio to Empirical Ecoomics Lecture 3 Discrete Radom Variables ad Probability Distributios Copyright 010 Pearso Educatio, Ic. Publishig as Pretice Hall Ch. 4-1 4.1 Itroductio to Probability
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig
More informationChapter 1. Probability
Chapter. Probability. Set defiitios 2. Set operatios 3. Probability itroduced through sets ad relative frequecy 4. Joit ad coditioal probability 5. Idepedet evets 6. Combied experimets 7. Beroulli trials
More informationIIT JAM Mathematical Statistics (MS) 2006 SECTION A
IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim
More informationProbability for mathematicians INDEPENDENCE TAU
Probability for mathematicias INDEPENDENCE TAU 2013 28 Cotets 3 Ifiite idepedet sequeces 28 3a Idepedet evets........................ 28 3b Idepedet radom variables.................. 33 3 Ifiite idepedet
More informationDiscrete Mathematics and Probability Theory Fall 2016 Walrand Probability: An Overview
CS 70 Discrete Mathematics ad Probability Theory Fall 2016 Walrad Probability: A Overview Probability is a fasciatig theory. It provides a precise, clea, ad useful model of ucertaity. The successes of
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationLecture 2 February 8, 2016
MIT 6.854/8.45: Advaced Algorithms Sprig 206 Prof. Akur Moitra Lecture 2 February 8, 206 Scribe: Calvi Huag, Lih V. Nguye I this lecture, we aalyze the problem of schedulig equal size tasks arrivig olie
More informationMathematical Statistics - MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More informationParameter, Statistic and Random Samples
Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,
More informationTextbook: D.C. Montgomery and G.C. Runger, Applied Statistics and Probability for Engineers, John Wiley & Sons, New York, Sections
Textbook: DC Motgomery ad GC Ruger, Applied Statistics ad Probability for Egieers, Joh Wiley & Sos, New York, 2003 Sectios 28 35 1 Defiitio of "radom variable" (a) Write the defiitio of a radom variable
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationSTAT 515 fa 2016 Lec Sampling distribution of the mean, part 2 (central limit theorem)
STAT 515 fa 2016 Lec 15-16 Samplig distributio of the mea, part 2 cetral limit theorem Karl B. Gregory Moday, Sep 26th Cotets 1 The cetral limit theorem 1 1.1 The most importat theorem i statistics.............
More informationGeneralized Semi- Markov Processes (GSMP)
Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual
More informationSolutions to Homework 6
Solutios to Homework Math 500-, Summer 00 July 7, 00 p. 0 07, #. Clearly, Y has a biomial distributio with parameters 3 ad p. That is, k 0 3 PfY kg ( )3 ( )3 3 ( )3 3 ( )3 `3 0 `3 `3 `3 3 E(Y ) 0 ˆ «+
More informationVariance of Discrete Random Variables Class 5, Jeremy Orloff and Jonathan Bloom
Variace of Discrete Radom Variables Class 5, 18.05 Jeremy Orloff ad Joatha Bloom 1 Learig Goals 1. Be able to compute the variace ad stadard deviatio of a radom variable.. Uderstad that stadard deviatio
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More informationHOMEWORK I: PREREQUISITES FROM MATH 727
HOMEWORK I: PREREQUISITES FROM MATH 727 Questio. Let X, X 2,... be idepedet expoetial radom variables with mea µ. (a) Show that for Z +, we have EX µ!. (b) Show that almost surely, X + + X (c) Fid the
More informationProbability and Statistics
robability ad Statistics rof. Zheg Zheg Radom Variable A fiite sigle valued fuctio.) that maps the set of all eperimetal outcomes ito the set of real umbers R is a r.v., if the set ) is a evet F ) for
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationProbability and statistics: basic terms
Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample
More informationB Supplemental Notes 2 Hypergeometric, Binomial, Poisson and Multinomial Random Variables and Borel Sets
B671-672 Supplemetal otes 2 Hypergeometric, Biomial, Poisso ad Multiomial Radom Variables ad Borel Sets 1 Biomial Approximatio to the Hypergeometric Recall that the Hypergeometric istributio is fx = x
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationChapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities
Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other
More information