STAT 430/510: Lecture 15
|
|
- Cameron Chambers
- 5 years ago
- Views:
Transcription
1 STAT 430/510: Lecture 15 James Piette June 23, 2010
2 Updates HW4 is up on my website. It is due next Mon. (June 28th). Starting today back at section
3 Conditional Distribution: Discrete Def: The conditional pmf of X given Y y is defined as p X Y (x y) P(X x Y y) p(x, y) p Y (y) for all values of y such that p Y (y) > 0. The conditional cdf of X given that Y y is defined similarily: F X Y (x y) P(X x Y y) a x p X Y (a y) Also, if X and Y are independent, then the conditional pmf of X on Y y is equal to: p X Y (x y) P(X x), P(Y y) P(Y y) P(X x)
4 Example 1 Question: If X and Y are independent Poisson r.v. s with respective parameters λ 1 and λ 2, then what is the conditional distribution of X given that X + Y n?
5 Example 1 Question: If X and Y are independent Poisson r.v. s with respective parameters λ 1 and λ 2, then what is the conditional distribution of X given that X + Y n? Solution: Go through similar motions that we had when calculating the conditional probabilities of events: P(X k X + Y n) P(X k, X + Y n) P(X + Y n)
6 Example 1 Question: If X and Y are independent Poisson r.v. s with respective parameters λ 1 and λ 2, then what is the conditional distribution of X given that X + Y n? Solution: Go through similar motions that we had when calculating the conditional probabilities of events: P(X k X + Y n) P(X k, X + Y n) P(X + Y n) P(X k, k + Y n) P(X + Y n) P(X k)p(y n k) P(X + Y n)
7 Example 1 Question: If X and Y are independent Poisson r.v. s with respective parameters λ 1 and λ 2, then what is the conditional distribution of X given that X + Y n? Solution: Go through similar motions that we had when calculating the conditional probabilities of events: P(X k X + Y n) P(X k, X + Y n) P(X + Y n) P(X k, k + Y n) P(X + Y n) P(X k)p(y n k) P(X + Y n) Recalling from the previous lecture, we know that X + Y is distributed...
8 Example 1 Question: If X and Y are independent Poisson r.v. s with respective parameters λ 1 and λ 2, then what is the conditional distribution of X given that X + Y n? Solution: Go through similar motions that we had when calculating the conditional probabilities of events: P(X k X + Y n) P(X k, X + Y n) P(X + Y n) P(X k, k + Y n) P(X + Y n) P(X k)p(y n k) P(X + Y n) Recalling from the previous lecture, we know that X + Y is distributed... Poisson with parameter λ 1 and λ 2.
9 Example 1 (cont.) Using that fact, we can proceed... P(X k)p(y n k) P(X + Y n) e λ 1λ k 1 e λ 2λ n k 2 k! (n k)! [ e (λ 1+λ 2 ) (λ 1 + λ 2 ) n n! ] 1
10 Example 1 (cont.) Using that fact, we can proceed... P(X k)p(y n k) P(X + Y n) e λ 1λ k 1 e λ 2λ n k 2 k! (n k)! [ e (λ 1+λ 2 ) (λ 1 + λ 2 ) n n! ] 1 λ k 1 λn k 2 n! (n k)!k! (λ 1 + λ 2 ) n
11 Example 1 (cont.) Using that fact, we can proceed... P(X k)p(y n k) P(X + Y n) e λ 1λ k 1 e λ 2λ n k 2 k! (n k)! [ e (λ 1+λ 2 ) (λ 1 + λ 2 ) n n! ] 1 λ k 1 λn k 2 n! (n k)!k! (λ 1 + λ 2 ) n ( ) ( ) n k ( λ1 λ2 k λ 1 + λ 2 λ 1 + λ 2 ) n k Recognize this as anything?
12 Example 1 (cont.) Using that fact, we can proceed... P(X k)p(y n k) P(X + Y n) e λ 1λ k 1 e λ 2λ n k 2 k! (n k)! [ e (λ 1+λ 2 ) (λ 1 + λ 2 ) n n! ] 1 λ k 1 λn k 2 n! (n k)!k! (λ 1 + λ 2 ) n ( ) ( ) n k ( λ1 λ2 k λ 1 + λ 2 λ 1 + λ 2 ) n k Recognize this as anything? Binomial with n trials and prob. λ 1 λ 1 +λ 2.
13 Formalization Def: Let X and Y be jointly continuous r.v s. Then, for any x value for which f X (x) > 0, the conditional pdf of X given Y y is f X Y (x y) For any set A, P(X A Y y) f (x, y) f Y (y), where f Y (y) > 0 A f X Y (x y)dx By letting A (, a], we define the conditional cdf of X given Y y by F X Y (a y) P(X a Y y) a f X Y (x y)dx
14 Example 2 The joint density of X and Y is given by f (x, y) { 12 5 x(2 x y) 0 < x < 1, 0 < y < 1 0 otherwise Question: What is the conditional density of X given that Y y, where 0 < y < 1?
15 Example 2 (cont.) For 0 < x < 1, 0 < y < 1, we have f X Y (x y) f (x, y) f Y (y)
16 Example 2 (cont.) For 0 < x < 1, 0 < y < 1, we have f X Y (x y) f (x, y) f Y (y) f (x, y) f (x, y)dx
17 Example 2 (cont.) For 0 < x < 1, 0 < y < 1, we have f X Y (x y) f (x, y) f Y (y) f (x, y) f (x, y)dx 1 0 x(2 x y) x(2 x y)dx
18 Example 2 (cont.) For 0 < x < 1, 0 < y < 1, we have f X Y (x y) f (x, y) f Y (y) f (x, y) f (x, y)dx 1 0 x(2 x y) x(2 x y)dx x(2 x y) 2 3 y 2 6x(2 x y) 4 3y
19 Example 3 Suppose that the joint density of X and Y is given by f (x, y) { e x/y e y y 0 otherwise Question: What is P(X > 1 Y y)? 0 < x <, 0 < y <
20 Example 3 Suppose that the joint density of X and Y is given by f (x, y) { e x/y e y y 0 otherwise 0 < x <, 0 < y < Question: What is P(X > 1 Y y)? Solution: First, we need to obtain the conditional density of X given that Y y.
21 Example 3 Suppose that the joint density of X and Y is given by f (x, y) { e x/y e y y 0 otherwise 0 < x <, 0 < y < Question: What is P(X > 1 Y y)? Solution: First, we need to obtain the conditional density of X given that Y y. f X Y (x y) f (x, y) f Y (y) e x/y e y /y e y 0 (1/y)e x/y dx
22 Example 3 Suppose that the joint density of X and Y is given by f (x, y) { e x/y e y y 0 otherwise 0 < x <, 0 < y < Question: What is P(X > 1 Y y)? Solution: First, we need to obtain the conditional density of X given that Y y. f X Y (x y) f (x, y) f Y (y) e x/y e y /y e y 0 (1/y)e x/y dx 1 y e x/y
23 Example 3 (cont.) With this, we can find P(X > 1 Y y)...
24 Example 3 (cont.) With this, we can find P(X > 1 Y y)... P(X > 1 Y y) 1 1 y e x/y dx
25 Example 3 (cont.) With this, we can find P(X > 1 Y y)... P(X > 1 Y y) 1 1 y e x/y dx e x/y 1
26 Example 3 (cont.) With this, we can find P(X > 1 Y y)... P(X > 1 Y y) 1 1 y e x/y dx e x/y e 1/y 1
27 One Discrete and One Continuous Suppose that X is a continuous r.v. with pdf f and N is a discrete r.v. Then, the conditional distribution of X given that N n is f X N (x n) P(N n X x) f (x) P(N n)
28 Example 4 Consider n + m trials having a common prob. of success. Suppose, however, that this success prob. is not fixed in advance, but is chosen from a uniform (0,1). Question: What is the conditional distribution of the success prob. given that n + m trials result in n successes?
29 Example 4 Consider n + m trials having a common prob. of success. Suppose, however, that this success prob. is not fixed in advance, but is chosen from a uniform (0,1). Question: What is the conditional distribution of the success prob. given that n + m trials result in n successes? Solution: Let X denote the prob. that a given trial is a success. Then X is distributed uniform (0,1).
30 Example 4 Consider n + m trials having a common prob. of success. Suppose, however, that this success prob. is not fixed in advance, but is chosen from a uniform (0,1). Question: What is the conditional distribution of the success prob. given that n + m trials result in n successes? Solution: Let X denote the prob. that a given trial is a success. Then X is distributed uniform (0,1). Given that X x, the n + m trials are independent with common prob. of success x, so N, the number of successes, is a binomial r.v. with parameters (n + m, x).
31 Example 4 (cont.) The conditional density of X given that N n is f X N (x n) P(N n X x)f X (x) P(N n)
32 Example 4 (cont.) The conditional density of X given that N n is f X N (x n) P(N n X x)f X (x) P(N n) ( n+m ) n x n (1 x) m where 0 < x < 1 P(N n)
33 Example 4 (cont.) The conditional density of X given that N n is f X N (x n) P(N n X x)f X (x) P(N n) ( n+m ) n x n (1 x) m where 0 < x < 1 P(N n) cx n (1 x) m The conditional density is that of a beta r.v. with parameters n + 1, m + 1.
34 Motivation Let X 1 and X 2 be jointly cont. r.v. s with joint pdf f X1,X 2. Suppose there are two r.v. s, Y 1 and Y 2, such that Y 1 g 1 (X 1, X 2 ) and Y 2 g 2 (X 1, X 2 ) for some functions g 1 and g 2. There are two assumptions: 1 Equations y 1 g 1 (x 1, x 2 ) and y 2 g 2 (x 1, x 2 ) can be uniquely solved for x 1 and x 2 in terms of y 1 and y 2, with solutions given by x 1 h 1 (y 1, y 2 ) and x 2 h 2 (y 1, y 2 ). 2 The functions g 1 and g 2 have cont. partial derivatives at all points (x 1, x 2 ) and are s.t. the 2 2 determinant: g 1 J(x 1, x 2 ) x 1 g 2 x 2 g 1 g 1 x 1 x 2 0
35 Formalization Under the previous two assumptions, the r.v. s Y 1 and Y 2 are jointly cont. with joint density given by f Y1 Y 2 (y 1, y 2 ) f X1 X 2 (x 1, x 2 ) J(x 1, x 2 ) 1 where x 1 h 1 (y 1, y 2 ), x 2 h 2 (y 1, y 2 ).
36 Example 5 Let X 1 and X 2 be jointly cont. r.v. s with pdf f X1 X 2. Let Y 1 X 1 + X 2, Y 2 X 1 X 2. Question: What is the joint pdf of Y 1 and Y 2 in terms of f X1 X 2?
37 Example 5 Let X 1 and X 2 be jointly cont. r.v. s with pdf f X1 X 2. Let Y 1 X 1 + X 2, Y 2 X 1 X 2. Question: What is the joint pdf of Y 1 and Y 2 in terms of f X1 X 2? Solution: Let g 1 (x 1, x 2 ) x 1 + x 2 and g 2 (x 1, x 2 ) x 1 x 2. Then, we need to verify the assumption 2...
38 Example 5 Let X 1 and X 2 be jointly cont. r.v. s with pdf f X1 X 2. Let Y 1 X 1 + X 2, Y 2 X 1 X 2. Question: What is the joint pdf of Y 1 and Y 2 in terms of f X1 X 2? Solution: Let g 1 (x 1, x 2 ) x 1 + x 2 and g 2 (x 1, x 2 ) x 1 x 2. Then, we need to verify the assumption 2... J(x 1, x 2 )
39 Example 5 (cont.) And verify assumption 1...
40 Example 5 (cont.) And verify assumption 1... x 1 (y 1 + y 2 ) 2 x 2 (y 1 y 2 ) 2
41 Example 5 (cont.) And verify assumption 1... x 1 (y 1 + y 2 ) 2 x 2 (y 1 y 2 ) 2 Thus, the desired probability is:
42 Example 5 (cont.) And verify assumption 1... x 1 (y 1 + y 2 ) 2 x 2 (y 1 y 2 ) 2 Thus, the desired probability is: f Y1 Y 2 (y 1, y 2 ) 1 ( 2 f y1 + y 2 X 1 X 2, y ) 1 y 2 2 2
43 Let s cover self-test problems 6.13 and We ve now covered up to 6.5 and started 6.7 (skipped 6.6). Remember, I ve posted HW4 up on my website and it is due on Mon. June 28th.
STAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 16 June 24th, 2009 Review Sum of Independent Normal Random Variables Sum of Independent Poisson Random Variables Sum of Independent Binomial Random Variables Conditional
More informationSTAT 430/510: Lecture 16
STAT 430/510: Lecture 16 James Piette June 24, 2010 Updates HW4 is up on my website. It is due next Mon. (June 28th). Starting today back at section 6.7 and will begin Ch. 7. Joint Distribution of Functions
More informationSTAT 430/510: Lecture 10
STAT 430/510: Lecture 10 James Piette June 9, 2010 Updates HW2 is due today! Pick up your HW1 s up in stat dept. There is a box located right when you enter that is labeled "Stat 430 HW1". It ll be out
More informationMultivariate distributions
CHAPTER Multivariate distributions.. Introduction We want to discuss collections of random variables (X, X,..., X n ), which are known as random vectors. In the discrete case, we can define the density
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationLecture 13. Poisson Distribution. Text: A Course in Probability by Weiss 5.5. STAT 225 Introduction to Probability Models February 16, 2014
Lecture 13 Text: A Course in Probability by Weiss 5.5 STAT 225 Introduction to Probability Models February 16, 2014 Whitney Huang Purdue University 13.1 Agenda 1 2 3 13.2 Review So far, we have seen discrete
More informationChapter 4 Multiple Random Variables
Review for the previous lecture Theorems and Examples: How to obtain the pmf (pdf) of U = g ( X Y 1 ) and V = g ( X Y) Chapter 4 Multiple Random Variables Chapter 43 Bivariate Transformations Continuous
More informationLecture 14. Text: A Course in Probability by Weiss 5.6. STAT 225 Introduction to Probability Models February 23, Whitney Huang Purdue University
Lecture 14 Text: A Course in Probability by Weiss 5.6 STAT 225 Introduction to Probability Models February 23, 2014 Whitney Huang Purdue University 14.1 Agenda 14.2 Review So far, we have covered Bernoulli
More informationIEOR 3106: Introduction to Operations Research: Stochastic Models. Professor Whitt. SOLUTIONS to Homework Assignment 2
IEOR 316: Introduction to Operations Research: Stochastic Models Professor Whitt SOLUTIONS to Homework Assignment 2 More Probability Review: In the Ross textbook, Introduction to Probability Models, read
More information4 Pairs of Random Variables
B.Sc./Cert./M.Sc. Qualif. - Statistical Theory 4 Pairs of Random Variables 4.1 Introduction In this section, we consider a pair of r.v. s X, Y on (Ω, F, P), i.e. X, Y : Ω R. More precisely, we define a
More informationBasics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationThe Binomial distribution. Probability theory 2. Example. The Binomial distribution
Probability theory Tron Anders Moger September th 7 The Binomial distribution Bernoulli distribution: One experiment X i with two possible outcomes, probability of success P. If the experiment is repeated
More informationChapter 5 Class Notes
Chapter 5 Class Notes Sections 5.1 and 5.2 It is quite common to measure several variables (some of which may be correlated) and to examine the corresponding joint probability distribution One example
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 17: Continuous random variables: conditional PDF Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin
More informationSOLUTION FOR HOMEWORK 12, STAT 4351
SOLUTION FOR HOMEWORK 2, STAT 435 Welcome to your 2th homework. It looks like this is the last one! As usual, try to find mistakes and get extra points! Now let us look at your problems.. Problem 7.22.
More informationCh. 8 Math Preliminaries for Lossy Coding. 8.5 Rate-Distortion Theory
Ch. 8 Math Preliminaries for Lossy Coding 8.5 Rate-Distortion Theory 1 Introduction Theory provide insight into the trade between Rate & Distortion This theory is needed to answer: What do typical R-D
More informationSTA2603/205/1/2014 /2014. ry II. Tutorial letter 205/1/
STA263/25//24 Tutorial letter 25// /24 Distribution Theor ry II STA263 Semester Department of Statistics CONTENTS: Examination preparation tutorial letterr Solutions to Assignment 6 2 Dear Student, This
More informationProblem Y is an exponential random variable with parameter λ = 0.2. Given the event A = {Y < 2},
ECE32 Spring 25 HW Solutions April 6, 25 Solutions to HW Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in italics where
More information1 Probability and Random Variables
1 Probability and Random Variables The models that you have seen thus far are deterministic models. For any time t, there is a unique solution X(t). On the other hand, stochastic models will result in
More informationStat 35: Introduction to Probability. Outline for the day: 1. teams, s, bruin. 2. HW2. 3. Booth and Ivey. 4. Binomial random variables. 5.
Stat 35: Introduction to Probability. Outline for the day: 1. teams, emails, bruin. 2. HW2. 3. Booth and Ivey. 4. Binomial random variables. 5. Geometric random variables. 6. Moment generating functions.
More informationRandom Variables. Cumulative Distribution Function (CDF) Amappingthattransformstheeventstotherealline.
Random Variables Amappingthattransformstheeventstotherealline. Example 1. Toss a fair coin. Define a random variable X where X is 1 if head appears and X is if tail appears. P (X =)=1/2 P (X =1)=1/2 Example
More informationStat 100a, Introduction to Probability.
Stat 100a, Introduction to Probability. Outline for the day: 1. Geometric random variables. 2. Negative binomial random variables. 3. Moment generating functions. 4. Poisson random variables. 5. Continuous
More information1 Joint and marginal distributions
DECEMBER 7, 204 LECTURE 2 JOINT (BIVARIATE) DISTRIBUTIONS, MARGINAL DISTRIBUTIONS, INDEPENDENCE So far we have considered one random variable at a time. However, in economics we are typically interested
More informationConditional distributions
Conditional distributions Will Monroe July 6, 017 with materials by Mehran Sahami and Chris Piech Independence of discrete random variables Two random variables are independent if knowing the value of
More informationChapter 4 Multiple Random Variables
Review for the previous lecture Definition: n-dimensional random vector, joint pmf (pdf), marginal pmf (pdf) Theorem: How to calculate marginal pmf (pdf) given joint pmf (pdf) Example: How to calculate
More informationContinuous r.v practice problems
Continuous r.v practice problems SDS 321 Intro to Probability and Statistics 1. (2+2+1+1 6 pts) The annual rainfall (in inches) in a certain region is normally distributed with mean 4 and standard deviation
More informationIE 230 Probability & Statistics in Engineering I. Closed book and notes. 60 minutes.
Closed book and notes. 60 minutes. A summary table of some univariate continuous distributions is provided. Four Pages. In this version of the Key, I try to be more complete than necessary to receive full
More informationCDA5530: Performance Models of Computers and Networks. Chapter 2: Review of Practical Random Variables
CDA5530: Performance Models of Computers and Networks Chapter 2: Review of Practical Random Variables Definition Random variable (R.V.) X: A function on sample space X: S R Cumulative distribution function
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationProbability review. September 11, Stoch. Systems Analysis Introduction 1
Probability review Alejandro Ribeiro Dept. of Electrical and Systems Engineering University of Pennsylvania aribeiro@seas.upenn.edu http://www.seas.upenn.edu/users/~aribeiro/ September 11, 2015 Stoch.
More informationSTAT 3610: Review of Probability Distributions
STAT 3610: Review of Probability Distributions Mark Carpenter Professor of Statistics Department of Mathematics and Statistics August 25, 2015 Support of a Random Variable Definition The support of a random
More informationECE353: Probability and Random Processes. Lecture 7 -Continuous Random Variable
ECE353: Probability and Random Processes Lecture 7 -Continuous Random Variable Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu Continuous
More informationConditional distributions. Conditional expectation and conditional variance with respect to a variable.
Conditional distributions Conditional expectation and conditional variance with respect to a variable Probability Theory and Stochastic Processes, summer semester 07/08 80408 Conditional distributions
More informationCh. 5 Joint Probability Distributions and Random Samples
Ch. 5 Joint Probability Distributions and Random Samples 5. 1 Jointly Distributed Random Variables In chapters 3 and 4, we learned about probability distributions for a single random variable. However,
More informationEXAM # 3 PLEASE SHOW ALL WORK!
Stat 311, Summer 2018 Name EXAM # 3 PLEASE SHOW ALL WORK! Problem Points Grade 1 30 2 20 3 20 4 30 Total 100 1. A socioeconomic study analyzes two discrete random variables in a certain population of households
More informationDistributions of Functions of Random Variables. 5.1 Functions of One Random Variable
Distributions of Functions of Random Variables 5.1 Functions of One Random Variable 5.2 Transformations of Two Random Variables 5.3 Several Random Variables 5.4 The Moment-Generating Function Technique
More informationBivariate distributions
Bivariate distributions 3 th October 017 lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.) Bivariate Distributions of the Discrete Type The Correlation Coefficient
More information3 Multiple Discrete Random Variables
3 Multiple Discrete Random Variables 3.1 Joint densities Suppose we have a probability space (Ω, F,P) and now we have two discrete random variables X and Y on it. They have probability mass functions f
More informationSpecial Discrete RV s. Then X = the number of successes is a binomial RV. X ~ Bin(n,p).
Sect 3.4: Binomial RV Special Discrete RV s 1. Assumptions and definition i. Experiment consists of n repeated trials ii. iii. iv. There are only two possible outcomes on each trial: success (S) or failure
More information1 Random Variable: Topics
Note: Handouts DO NOT replace the book. In most cases, they only provide a guideline on topics and an intuitive feel. 1 Random Variable: Topics Chap 2, 2.1-2.4 and Chap 3, 3.1-3.3 What is a random variable?
More informationChapter 5 continued. Chapter 5 sections
Chapter 5 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions
More informationDiscrete Random Variables
CPSC 53 Systems Modeling and Simulation Discrete Random Variables Dr. Anirban Mahanti Department of Computer Science University of Calgary mahanti@cpsc.ucalgary.ca Random Variables A random variable is
More informationClosed book and notes. 60 minutes. Cover page and four pages of exam. No calculators.
IE 230 Seat # Closed book and notes. 60 minutes. Cover page and four pages of exam. No calculators. Score Exam #3a, Spring 2002 Schmeiser Closed book and notes. 60 minutes. 1. True or false. (for each,
More informationProbability Review. Gonzalo Mateos
Probability Review Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ September 11, 2018 Introduction
More informationLecture 3. Discrete Random Variables
Math 408 - Mathematical Statistics Lecture 3. Discrete Random Variables January 23, 2013 Konstantin Zuev (USC) Math 408, Lecture 3 January 23, 2013 1 / 14 Agenda Random Variable: Motivation and Definition
More informationCDA6530: Performance Models of Computers and Networks. Chapter 2: Review of Practical Random Variables
CDA6530: Performance Models of Computers and Networks Chapter 2: Review of Practical Random Variables Two Classes of R.V. Discrete R.V. Bernoulli Binomial Geometric Poisson Continuous R.V. Uniform Exponential,
More informationCS145: Probability & Computing
CS45: Probability & Computing Lecture 0: Continuous Bayes Rule, Joint and Marginal Probability Densities Instructor: Eli Upfal Brown University Computer Science Figure credits: Bertsekas & Tsitsiklis,
More informationSTA 256: Statistics and Probability I
Al Nosedal. University of Toronto. Fall 2017 My momma always said: Life was like a box of chocolates. You never know what you re gonna get. Forrest Gump. There are situations where one might be interested
More informationThe Random Variable for Probabilities Chris Piech CS109, Stanford University
The Random Variable for Probabilities Chris Piech CS109, Stanford University Assignment Grades 10 20 30 40 50 60 70 80 90 100 10 20 30 40 50 60 70 80 90 100 Frequency Frequency 10 20 30 40 50 60 70 80
More informationJoint Probability Distributions, Correlations
Joint Probability Distributions, Correlations What we learned so far Events: Working with events as sets: union, intersection, etc. Some events are simple: Head vs Tails, Cancer vs Healthy Some are more
More information(y 1, y 2 ) = 12 y3 1e y 1 y 2 /2, y 1 > 0, y 2 > 0 0, otherwise.
54 We are given the marginal pdfs of Y and Y You should note that Y gamma(4, Y exponential( E(Y = 4, V (Y = 4, E(Y =, and V (Y = 4 (a With U = Y Y, we have E(U = E(Y Y = E(Y E(Y = 4 = (b Because Y and
More information2 Functions of random variables
2 Functions of random variables A basic statistical model for sample data is a collection of random variables X 1,..., X n. The data are summarised in terms of certain sample statistics, calculated as
More informationConditional distributions (discrete case)
Conditional distributions (discrete case) The basic idea behind conditional distributions is simple: Suppose (XY) is a jointly-distributed random vector with a discrete joint distribution. Then we can
More informationA Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.
A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,
More informationJoint Probability Distributions and Random Samples (Devore Chapter Five)
Joint Probability Distributions and Random Samples (Devore Chapter Five) 1016-345-01: Probability and Statistics for Engineers Spring 2013 Contents 1 Joint Probability Distributions 2 1.1 Two Discrete
More informationSTOR Lecture 14. Jointly distributed Random Variables - II
STOR 435.001 Lecture 14 Jointly distributed Random Variables - II Jan Hannig UNC Chapel Hill 1 / 24 Discrete case: Independence is equivalent to p(x, y) = p X (x)p Y (y), all x, y, where p(x, y) is the
More informationChapter 2: Random Variables
ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:
More informationIEOR 4703: Homework 2 Solutions
IEOR 4703: Homework 2 Solutions Exercises for which no programming is required Let U be uniformly distributed on the interval (0, 1); P (U x) = x, x (0, 1). We assume that your computer can sequentially
More informationMath 416 Lecture 2 DEFINITION. Here are the multivariate versions: X, Y, Z iff P(X = x, Y = y, Z =z) = p(x, y, z) of X, Y, Z iff for all sets A, B, C,
Math 416 Lecture 2 DEFINITION. Here are the multivariate versions: PMF case: p(x, y, z) is the joint Probability Mass Function of X, Y, Z iff P(X = x, Y = y, Z =z) = p(x, y, z) PDF case: f(x, y, z) is
More informationSTAT Chapter 5 Continuous Distributions
STAT 270 - Chapter 5 Continuous Distributions June 27, 2012 Shirin Golchi () STAT270 June 27, 2012 1 / 59 Continuous rv s Definition: X is a continuous rv if it takes values in an interval, i.e., range
More informationChapter 5. Chapter 5 sections
1 / 43 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 14: Continuous random variables Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/
More informationESS011 Mathematical statistics and signal processing
ESS011 Mathematical statistics and signal processing Lecture 9: Gaussian distribution, transformation formula for continuous random variables, and the joint distribution Tuomas A. Rajala Chalmers TU April
More informationMoments. Raw moment: February 25, 2014 Normalized / Standardized moment:
Moments Lecture 10: Central Limit Theorem and CDFs Sta230 / Mth 230 Colin Rundel Raw moment: Central moment: µ n = EX n ) µ n = E[X µ) 2 ] February 25, 2014 Normalized / Standardized moment: µ n σ n Sta230
More informationCheck Your Understanding of the Lecture Material Finger Exercises with Solutions
Check Your Understanding of the Lecture Material Finger Exercises with Solutions Instructor: David Dobor March 6, 2017 While the solutions to these questions are available, you are strongly encouraged
More informationMathematical Statistics 1 Math A 6330
Mathematical Statistics 1 Math A 6330 Chapter 2 Transformations and Expectations Mohamed I. Riffi Department of Mathematics Islamic University of Gaza September 14, 2015 Outline 1 Distributions of Functions
More informationCDA6530: Performance Models of Computers and Networks. Chapter 2: Review of Practical Random
CDA6530: Performance Models of Computers and Networks Chapter 2: Review of Practical Random Variables Definition Random variable (RV)X (R.V.) X: A function on sample space X: S R Cumulative distribution
More informationHW4 : Bivariate Distributions (1) Solutions
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 7 Néhémy Lim HW4 : Bivariate Distributions () Solutions Problem. The joint probability mass function of X and Y is given by the following table : X Y
More informationChapter 6 Expectation and Conditional Expectation. Lectures Definition 6.1. Two random variables defined on a probability space are said to be
Chapter 6 Expectation and Conditional Expectation Lectures 24-30 In this chapter, we introduce expected value or the mean of a random variable. First we define expectation for discrete random variables
More informationContinuous Probability Distributions. Uniform Distribution
Continuous Probability Distributions Uniform Distribution Important Terms & Concepts Learned Probability Mass Function (PMF) Cumulative Distribution Function (CDF) Complementary Cumulative Distribution
More informationBasic concepts of probability theory
Basic concepts of probability theory Random variable discrete/continuous random variable Transform Z transform, Laplace transform Distribution Geometric, mixed-geometric, Binomial, Poisson, exponential,
More informationHW Solution 12 Due: Dec 2, 9:19 AM
ECS 315: Probability and Random Processes 2015/1 HW Solution 12 Due: Dec 2, 9:19 AM Lecturer: Prapun Suksompong, Ph.D. Problem 1. Let X E(3). (a) For each of the following function g(x). Indicate whether
More informationRandom variables. DS GA 1002 Probability and Statistics for Data Science.
Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities
More informationJoint Probability Distributions, Correlations
Joint Probability Distributions, Correlations What we learned so far Events: Working with events as sets: union, intersection, etc. Some events are simple: Head vs Tails, Cancer vs Healthy Some are more
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationMath/Stat 352 Lecture 8
Math/Stat 352 Lecture 8 Sections 4.3 and 4.4 Commonly Used Distributions: Poisson, hypergeometric, geometric, and negative binomial. 1 The Poisson Distribution Poisson random variable counts the number
More informationStatistics for Economists Lectures 6 & 7. Asrat Temesgen Stockholm University
Statistics for Economists Lectures 6 & 7 Asrat Temesgen Stockholm University 1 Chapter 4- Bivariate Distributions 41 Distributions of two random variables Definition 41-1: Let X and Y be two random variables
More informationWhy study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables
ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section
More informationLecture 4. Continuous Random Variables and Transformations of Random Variables
Math 408 - Mathematical Statistics Lecture 4. Continuous Random Variables and Transformations of Random Variables January 25, 2013 Konstantin Zuev (USC) Math 408, Lecture 4 January 25, 2013 1 / 13 Agenda
More informationChapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University
Chapter 3, 4 Random Variables ENCS6161 - Probability and Stochastic Processes Concordia University ENCS6161 p.1/47 The Notion of a Random Variable A random variable X is a function that assigns a real
More informationStat 5101 Lecture Slides: Deck 8 Dirichlet Distribution. Charles J. Geyer School of Statistics University of Minnesota
Stat 5101 Lecture Slides: Deck 8 Dirichlet Distribution Charles J. Geyer School of Statistics University of Minnesota 1 The Dirichlet Distribution The Dirichlet Distribution is to the beta distribution
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationStat 451 Lecture Notes Simulating Random Variables
Stat 451 Lecture Notes 05 12 Simulating Random Variables Ryan Martin UIC www.math.uic.edu/~rgmartin 1 Based on Chapter 6 in Givens & Hoeting, Chapter 22 in Lange, and Chapter 2 in Robert & Casella 2 Updated:
More information1 Review of Probability and Distributions
Random variables. A numerically valued function X of an outcome ω from a sample space Ω X : Ω R : ω X(ω) is called a random variable (r.v.), and usually determined by an experiment. We conventionally denote
More informationProbability Models. 4. What is the definition of the expectation of a discrete random variable?
1 Probability Models The list of questions below is provided in order to help you to prepare for the test and exam. It reflects only the theoretical part of the course. You should expect the questions
More informationECE 302 Division 2 Exam 2 Solutions, 11/4/2009.
NAME: ECE 32 Division 2 Exam 2 Solutions, /4/29. You will be required to show your student ID during the exam. This is a closed-book exam. A formula sheet is provided. No calculators are allowed. Total
More informationBivariate Distributions
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 17 Néhémy Lim Bivariate Distributions 1 Distributions of Two Random Variables Definition 1.1. Let X and Y be two rrvs on probability space (Ω, A, P).
More informationENGG2430A-Homework 2
ENGG3A-Homework Due on Feb 9th,. Independence vs correlation a For each of the following cases, compute the marginal pmfs from the joint pmfs. Explain whether the random variables X and Y are independent,
More informationECE 4400:693 - Information Theory
ECE 4400:693 - Information Theory Dr. Nghi Tran Lecture 8: Differential Entropy Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Lecture 1 / 43 Outline 1 Review: Entropy of discrete RVs 2 Differential
More information7 Random samples and sampling distributions
7 Random samples and sampling distributions 7.1 Introduction - random samples We will use the term experiment in a very general way to refer to some process, procedure or natural phenomena that produces
More informationUNIT Define joint distribution and joint probability density function for the two random variables X and Y.
UNIT 4 1. Define joint distribution and joint probability density function for the two random variables X and Y. Let and represent the probability distribution functions of two random variables X and Y
More informationContents 1. Contents
Contents 1 Contents 6 Distributions of Functions of Random Variables 2 6.1 Transformation of Discrete r.v.s............. 3 6.2 Method of Distribution Functions............. 6 6.3 Method of Transformations................
More informationP (x). all other X j =x j. If X is a continuous random vector (see p.172), then the marginal distributions of X i are: f(x)dx 1 dx n
JOINT DENSITIES - RANDOM VECTORS - REVIEW Joint densities describe probability distributions of a random vector X: an n-dimensional vector of random variables, ie, X = (X 1,, X n ), where all X is are
More informationECE353: Probability and Random Processes. Lecture 5 - Cumulative Distribution Function and Expectation
ECE353: Probability and Random Processes Lecture 5 - Cumulative Distribution Function and Expectation Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu
More informationConditional densities, mass functions, and expectations
Conditional densities, mass functions, and expectations Jason Swanson April 22, 27 1 Discrete random variables Suppose that X is a discrete random variable with range {x 1, x 2, x 3,...}, and that Y is
More informationPerhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows.
Chapter 5 Two Random Variables In a practical engineering problem, there is almost always causal relationship between different events. Some relationships are determined by physical laws, e.g., voltage
More information4 Moment generating functions
4 Moment generating functions Moment generating functions (mgf) are a very powerful computational tool. They make certain computations much shorter. However, they are only a computational tool. The mgf
More informationBasic concepts of probability theory
Basic concepts of probability theory Random variable discrete/continuous random variable Transform Z transform, Laplace transform Distribution Geometric, mixed-geometric, Binomial, Poisson, exponential,
More informationINF FALL NATURAL LANGUAGE PROCESSING. Jan Tore Lønning
1 INF4080 2018 FALL NATURAL LANGUAGE PROCESSING Jan Tore Lønning 2 Probability distributions Lecture 5, 5 September Today 3 Recap: Bayes theorem Discrete random variable Probability distribution Discrete
More informationM378K In-Class Assignment #1
The following problems are a review of M6K. M7K In-Class Assignment # Problem.. Complete the definition of mutual exclusivity of events below: Events A, B Ω are said to be mutually exclusive if A B =.
More information