STAT/MATH 395 PROBABILITY II
|
|
- Jack Perkins
- 5 years ago
- Views:
Transcription
1 STAT/MATH 395 PROBABILITY II Bivariate Distributions Néhémy Lim University of Washington Winter 2017
2 Outline Distributions of Two Random Variables Distributions of Two Discrete Random Variables Distributions of Two Continuous Random Variables The Correlation Coefficient Covariance Correlation Conditional Distributions Discrete case Continuous case
3 Outline Distributions of Two Random Variables Distributions of Two Discrete Random Variables Distributions of Two Continuous Random Variables The Correlation Coefficient Covariance Correlation Conditional Distributions Discrete case Continuous case
4 Example: Climate Change
5 Objectives Extend the definition of a probability distribution of one random variable to the joint probability distribution of two random variables Learn a way of quantifying the extent to which two random variables are related Define the conditional probability distribution of a random variable X given that Y has occurred
6 Definition Let X and Y be two rrvs on probability space (Ω, A, P). A two-dimensional random variable (X, Y ) is a function mapping (X, Y ) : Ω R 2, such that for any numbers x, y R: {ω Ω X(ω) x and Y (ω) y} A (1) Definition (Joint cumulative distribution function) Let X and Y be two rrvs on probability space (Ω, A, P). The joint (cumulative) distribution function (joint c.d.f.) of X and Y is the function F XY given by F XY (x, y) = P ({X x} {Y y}) P (X x, Y y), (2) for x, y R
7 Why Gen Y Loves Restaurants And Restaurants Love Them Even More According to a new report from the research firm Technomic, 42% of millennials say they visit upscale casual-dining restaurants at least once a month. That s a higher percentage than Gen X (33%) and Baby Boomers (24%) who go to such restaurants once or more monthly. Time, Aug. 15, 2012, By Brad Tuttle Age Population ,267, (Millenials) 62,649, (Gen X) 63,779, (Baby Boomers) 71,216, ,832,721 Demography in the US by age group [US Census data]
8 Definition Let X and Y be two discrete rrvs on probability space (Ω, A, P). The joint pmf of X and Y, denoted by p XY, is defined as follows : p XY (x, y) = P ({X = x} {Y = y}) P (X = x, Y = y), (3) for x X(Ω) and y Y (Ω)
9 Why Gen Y Loves Restaurants And Restaurants Love Them Even More X = 1 : the person visits upscale restaurants at least once a month / {X = 0} = {X = 1} c Y = 1 : the person is a millenial / Y = 2 : the person is a Gen X / Y = 3 : the person is a Baby Boomer X Y X Y ,337 42,732 47, ,313 21,047 24,213 Table 1: Count Data ( 1000) Table 2: Joint Probability Mass Function p XY (x, y)
10 Property Let X and Y be two discrete rrvs on probability space (Ω, A, P) with joint pmf p XY, then the following holds : p XY (x, y) 0, for x X(Ω) and y Y (Ω) x X(Ω) y Y (Ω) p XY (x, y) = 1 Property Let X and Y be two disctete rrvs on probability space (Ω, A, P) with joint pmf p XY. Then, for any subset B X(Ω) Y (Ω) P ((X, Y ) B) = (x,y) B p XY (x, y)
11 Definition (Marginal distributions) Let X and Y be two discrete rrvs on probability space (Ω, A, P) with joint pmf p XY. Then the pmf of X alone is called the marginal probability mass function of X and is defined by: p X (x) = P(X = x) = y Y (Ω) p XY (x, y), for x X(Ω) (4) Similarly, the pmf of Y alone is called the marginal probability mass function of Y and is defined by: p Y (y) = P(Y = y) = x X(Ω) p XY (x, y), for y Y (Ω) (5)
12 Definition (Independence) Let X and Y be two discrete rrvs on probability space (Ω, A, P) with joint pmf p XY. Let p X and p Y be the respective marginal pmfs of X and Y. Then X and Y are said to be independent if and only if : p XY (x, y) = p X (x)p Y (y), for all x X(Ω) and y Y (Ω) (6)
13 Definition (Expected Value) Let X and Y be two discrete rrvs on probability space (Ω, A, P) with joint pmf p XY and let g : R 2 R be a bounded piecewise continuous function. Then, the mathematical expectation of g(x, Y ), if it exists, is denoted by E[g(X, Y )] and is defined as follows : E[g(X, Y )] = x X(Ω) y Y (Ω) g(x, y)p XY (x, y) (7)
14 Example Consider the following joint probability mass function : p XY (x, y) = xy S(x, y) with S = {(1, 1), (1, 2), (2, 2)} 1. Show that p XY is a valid joint probability mass function. 2. What is P(X + Y 3)? 3. Give the marginal probability mass functions of X and Y. 4. What are the expected values of X and Y? 5. Are X and Y independent?
15 Definition (Joint probability density function) Let X and Y be two continuous rrvs on probability space (Ω, A, P). X and Y are said to be jointly continuous if there exists a function f XY such that, for any Borel set on R 2 : P((X, Y ) B) = f XY (x, y) dx dy (8) Then function f XY is called the joint probability density function of X and Y. Moreover, if the joint distribution function F XY is of class C 2, then the joint pdf of X and Y can be expressed in terms of partial derivatives : f XY (x, y) = 2 F (x, y) (9) x y B
16 Property Let X and Y be two continuous rrvs on probability space (Ω, A, P) with joint pdf f XY, then the following holds : f XY (x, y) 0, for x, y R f XY (x, y) dx dy = 1 Example. Let X and Y be two continuous random variables with joint probability density function : f XY (x, y) = 4xy1 [0,1] 2(x, y) Verify that f XY is a valid joint probability density function. What is P(Y < X)?
17 Definition (Marginal distributions) Let X and Y be two continuous rrvs on probability space (Ω, A, P) with joint pdf f XY. Then the pdf of X alone is called the marginal probability density function of X and is defined by: f X (x) = f XY (x, y) dy, for x R (10) Similarly, the pdf of Y alone is called the marginal probability density function of Y and is defined by: f Y (y) = f XY (x, y) dx, for y R (11) Example. Let X and Y be two continuous random variables with joint probability density function : f XY (x, y) = 4xy1 [0,1] 2(x, y) What are the marginal probability density functions of X and Y?
18 Definition (Independence) Let X and Y be two continuous rrvs on probability space (Ω, A, P) with joint pdf f XY. Let f X and f Y be the respective marginal pdfs of X and Y. Then X and Y are said to be independent if and only if : f XY (x, y) = f X (x)f Y (y), for all x, y R (12) Example. Let X and Y be two continuous random variables with joint probability density function : Are X and Y independent? f XY (x, y) = 4xy1 [0,1] 2(x, y)
19 Definition (Expected Value) Let X and Y be two continuous rrvs on probability space (Ω, A, P) with joint pdf f XY and let g : R 2 R be a bounded piecewise continuous function. Then, the mathematical expectation of g(x, Y ), if it exists, is denoted by E[g(X, Y )] and is defined as follows : E[g(X, Y )] = g(x, y)f XY (x, y) dx dy (13) Example. Let X and Y be two continuous random variables with joint probability density function : f XY (x, y) = 4xy1 [0,1] 2(x, y) What are the expected values of X and Y?
20 Example The joint probability density function of X and Y is given by: f XY (x, y) = 6 ( x 2 + xy ) 1 S (x, y) 7 2 with S = {(x, y) 0 < x < 1, 0 < y < 2} 1. Show that f XY is a valid joint probability density function. 2. Compute the marginal probability density function of X. 3. Find P(X > Y ). 4. What are the expected values of X and Y? 5. Are X and Y independent?
21 Outline Distributions of Two Random Variables Distributions of Two Discrete Random Variables Distributions of Two Continuous Random Variables The Correlation Coefficient Covariance Correlation Conditional Distributions Discrete case Continuous case
22 Definition (Covariance) Let X and Y be two rrvs on probability space (Ω, A, P). The covariance of X and Y, denoted by Cov(X, Y ), is defined as follows : Cov(X, Y ) = E[(X E[X])(Y E[Y ])] (14) upon existence of the above expression If X and Y are discrete rrv with joint pmf p XY, then the covariance of X and Y is : Cov(X, Y ) = x X(Ω) y Y (Ω) (x E[X])(y E[Y ])p XY (x, y) If X and Y are continuous rrv with joint pdf f XY, then the covariance of X and Y is : Cov(X, Y ) = (15) (x E[X])(y E[Y ])f XY (x, y) dx dy (16)
23 Theorem Let X and Y be two rrvs on probability space (Ω, A, P). The covariance of X and Y can be calculated as : Cov(X, Y ) = E[XY ] E[X] E[Y ] (17) Example 6. Suppose that X and Y have the following joint probability mass function: X Y What is the covariance of X and Y?
24 Property Here are some properties of the covariance. For any random variables X and Y, we have : 1. Cov(X, Y ) = Cov(Y, X) 2. Cov(X, X) = Var(X) 3. Cov(aX, Y ) = acov(x, Y ) for a R 4. Let X 1,..., X n be n random variables and Y 1,..., Y m be m random variables. Then : n m n m Cov X i, = Cov(X i, Y j ) i=1 Y j j=1 i=1 j=1
25 Definition (Correlation) Let X and Y be two rrvs on probability space (Ω, A, P) with respective standard deviations σ X = Var(X) and σ Y = Var(Y ). The correlation of X and Y, denoted by ρ XY, is defined as follows : ρ XY = Cov(X, Y ) σ X σ Y (18) upon existence of the above expression Property Let X and Y be two rrvs on probability space (Ω, A, P). 1 ρ XY 1 (19)
26 Interpretation of Correlation The correlation coefficient of X and Y is interpreted as follows: If ρ XY = 1, then X and Y are perfectly, positively, linearly correlated. If ρ XY = 1, then X and Y are perfectly, negatively, linearly correlated. X and Y are also said to be perfectly linearly anticorrelated. If ρ XY = 0, then X and Y are completely, linearly uncorrelated. If 0 < ρ XY < 1, then X and Y are positively, linearly correlated. If 1 < ρ XY < 0, then X and Y are negatively, linearly correlated.
27 Example : Dining Habits X = 1 : a person between 20 and 69 visits upscale restaurants at least once a month and X = 0 otherwise Y = 1 : a person between 20 and 69 is a millenial Y = 2 : a person between 20 and 69 is a Gen X Y = 3 : a person between 20 and 69 is a Baby Boomer The joint probability mass function of X and Y is given below : X Y Compute the covariance and the correlation of X and Y. What can you say about the relationship between X and Y?
28 Correlation is not causation!
29 Theorem Let X and Y be two rrvs on probability space (Ω, A, P) and let g 1 and g 2 be two bounded piecewise continuous functions. If X and Y are independent, then E[g 1 (X)g 2 (Y )] = E[g 1 (X)] E[g 2 (Y )] (20) provided that the expectations exist. Theorem Let X and Y be two rrvs on probability space (Ω, A, P). If X and Y are independent, then Cov(X, Y ) = ρ XY = 0 (21)
30 Example Let X and Y be discrete random variables with joint pmf: X Y What is the correlation between X and Y? 2. Are X and Y independent?
31 Outline Distributions of Two Random Variables Distributions of Two Discrete Random Variables Distributions of Two Continuous Random Variables The Correlation Coefficient Covariance Correlation Conditional Distributions Discrete case Continuous case
32 Example An international TV network company is interested in the relationship between the region of citizenship of its customers and their favorite sport. Sports Citizenship Africa America Asia Europe Tennis Basketball Soccer Football
33 Definition Let X and Y be two discrete rrvs on probability space (Ω, A, P) with joint pmf p XY and respective marginal pmfs p X and p Y. Then, for y Y (Ω), the conditional probability mass function of X given Y = y is defined by : p X Y (x y) = P(X = x Y = y) = p XY (x, y) p Y (y) (22) provided that p Y (y) 0.
34 Definition (Conditional Expectation) Let X and Y be two discrete rrvs on probability space (Ω, A, P). Then, for y Y (Ω), the conditional expectation of X given Y = y is defined as follows : E[X Y = y] = x X(Ω) xp X Y (x y) (23) Property (Linearity of conditional expectation) Let X and Y be two rrvs on probability space (Ω, A, P). If c 1, c 2 R and g 1 : X(Ω) R and g 2 : X(Ω) R are piecewise continuous functions. Then, for y Y (Ω), we have : E[c 1 g 1 (X)+c 2 g 2 (X) Y = y] = c 1 E[g 1 (X) Y = y]+c 2 E[g 2 (X) Y = y] (24)
35 Property Let X and Y be two discrete rrvs on probability space (Ω, A, P). If X and Y are independent, then, for y Y (Ω), we have : p X Y (x y) = p X (x) for all x X(Ω) (25) Similarly, for x X(Ω), we have : Also, p Y X (y x) = p Y (y) for all y Y (Ω) (26) Similarly, for x X(Ω), we have : E[X Y = y] = E[X] (27) E[Y X = x] = E[Y ] (28) Remark : Those properties are also true for continuous rrvs.
36 Definition (Conditional Variance) Let X and Y be two rrvs on probability space (Ω, A, P). Then, for y Y (Ω), the conditional variance of X given Y = y is defined as follows : Var(X Y = y) = E[(X E[X Y = y]) 2 Y = y] (29) Property For y Y (Ω), the conditional variance of X given Y = y can be calculated as follows : Var(X Y = y) = E[X 2 Y = y] (E[X Y = y]) 2 (30)
37 Definition Let X and Y be two continuous rrvs on probability space (Ω, A, P) with joint pdf f XY and respective marginal pdfs f X and f Y. Then, for y R, the conditional probability density function of X given Y = y is defined by : f X Y (x y) = f XY (x, y) f Y (y) (31) provided that f Y (y) 0.
38 Definition (Conditional Expectation) Let X and Y be two continuous rrvs on probability space (Ω, A, P). Then, for y R, the conditional expectation of X given Y = y is defined as follows : E[X Y = y] = xf X Y (x y) dx (32)
39 Example Let X and Y be two continuous random variables with joint probability density function : f XY (x, y) = S(x, y) with S = {(x, y) x 2 < y < 1, 0 < x < 1} Compute the expected value of Y given X = x.
Bivariate Distributions
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 17 Néhémy Lim Bivariate Distributions 1 Distributions of Two Random Variables Definition 1.1. Let X and Y be two rrvs on probability space (Ω, A, P).
More informationJointly Distributed Random Variables
Jointly Distributed Random Variables CE 311S What if there is more than one random variable we are interested in? How should you invest the extra money from your summer internship? To simplify matters,
More informationContinuous Random Variables
1 / 24 Continuous Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 27, 2013 2 / 24 Continuous Random Variables
More informationHW4 : Bivariate Distributions (1) Solutions
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 7 Néhémy Lim HW4 : Bivariate Distributions () Solutions Problem. The joint probability mass function of X and Y is given by the following table : X Y
More informationRandom Variables. Cumulative Distribution Function (CDF) Amappingthattransformstheeventstotherealline.
Random Variables Amappingthattransformstheeventstotherealline. Example 1. Toss a fair coin. Define a random variable X where X is 1 if head appears and X is if tail appears. P (X =)=1/2 P (X =1)=1/2 Example
More informationENGG2430A-Homework 2
ENGG3A-Homework Due on Feb 9th,. Independence vs correlation a For each of the following cases, compute the marginal pmfs from the joint pmfs. Explain whether the random variables X and Y are independent,
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationCovariance and Correlation
Covariance and Correlation ST 370 The probability distribution of a random variable gives complete information about its behavior, but its mean and variance are useful summaries. Similarly, the joint probability
More informationRandom Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R
In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample
More informationJoint probability distributions: Discrete Variables. Two Discrete Random Variables. Example 1. Example 1
Joint probability distributions: Discrete Variables Two Discrete Random Variables Probability mass function (pmf) of a single discrete random variable X specifies how much probability mass is placed on
More informationDistributions of Functions of Random Variables
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 217 Néhémy Lim Distributions of Functions of Random Variables 1 Functions of One Random Variable In some situations, you are given the pdf f X of some
More informationReview of Probability Theory
Review of Probability Theory Arian Maleki and Tom Do Stanford University Probability theory is the study of uncertainty Through this class, we will be relying on concepts from probability theory for deriving
More informationFunctions of two random variables. Conditional pairs
Handout 10 Functions of two random variables. Conditional pairs "Science is a wonderful thing if one does not have to earn a living at it. One should earn one's living by work of which one is sure one
More informationLecture 25: Review. Statistics 104. April 23, Colin Rundel
Lecture 25: Review Statistics 104 Colin Rundel April 23, 2012 Joint CDF F (x, y) = P [X x, Y y] = P [(X, Y ) lies south-west of the point (x, y)] Y (x,y) X Statistics 104 (Colin Rundel) Lecture 25 April
More informationBivariate distributions
Bivariate distributions 3 th October 017 lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.) Bivariate Distributions of the Discrete Type The Correlation Coefficient
More information1 Joint and marginal distributions
DECEMBER 7, 204 LECTURE 2 JOINT (BIVARIATE) DISTRIBUTIONS, MARGINAL DISTRIBUTIONS, INDEPENDENCE So far we have considered one random variable at a time. However, in economics we are typically interested
More informationSTAT/MATH 395 PROBABILITY II
STAT/MATH 395 PROBABILITY II Chapter 6 : Moment Functions Néhémy Lim 1 1 Department of Statistics, University of Washington, USA Winter Quarter 2016 of Common Distributions Outline 1 2 3 of Common Distributions
More informationSTA 256: Statistics and Probability I
Al Nosedal. University of Toronto. Fall 2017 My momma always said: Life was like a box of chocolates. You never know what you re gonna get. Forrest Gump. There are situations where one might be interested
More informationMultivariate Random Variable
Multivariate Random Variable Author: Author: Andrés Hincapié and Linyi Cao This Version: August 7, 2016 Multivariate Random Variable 3 Now we consider models with more than one r.v. These are called multivariate
More informationProblem Y is an exponential random variable with parameter λ = 0.2. Given the event A = {Y < 2},
ECE32 Spring 25 HW Solutions April 6, 25 Solutions to HW Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in italics where
More informationIAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES
IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES VARIABLE Studying the behavior of random variables, and more importantly functions of random variables is essential for both the
More informationReview: mostly probability and some statistics
Review: mostly probability and some statistics C2 1 Content robability (should know already) Axioms and properties Conditional probability and independence Law of Total probability and Bayes theorem Random
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationNotes for Math 324, Part 19
48 Notes for Math 324, Part 9 Chapter 9 Multivariate distributions, covariance Often, we need to consider several random variables at the same time. We have a sample space S and r.v. s X, Y,..., which
More informationJoint Distribution of Two or More Random Variables
Joint Distribution of Two or More Random Variables Sometimes more than one measurement in the form of random variable is taken on each member of the sample space. In cases like this there will be a few
More informationECE302 Exam 2 Version A April 21, You must show ALL of your work for full credit. Please leave fractions as fractions, but simplify them, etc.
ECE32 Exam 2 Version A April 21, 214 1 Name: Solution Score: /1 This exam is closed-book. You must show ALL of your work for full credit. Please read the questions carefully. Please check your answers
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationProblem #1 #2 #3 #4 Total Points /5 /7 /8 /4 /24
STAT/MATH 395 A - Winter Quarter 17 - Midterm - February 17, 17 Name: Student ID Number: Problem #1 # #3 #4 Total Points /5 /7 /8 /4 /4 Directions. Read directions carefully and show all your work. Define
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 8 10/1/2008 CONTINUOUS RANDOM VARIABLES
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 8 10/1/2008 CONTINUOUS RANDOM VARIABLES Contents 1. Continuous random variables 2. Examples 3. Expected values 4. Joint distributions
More informationP (x). all other X j =x j. If X is a continuous random vector (see p.172), then the marginal distributions of X i are: f(x)dx 1 dx n
JOINT DENSITIES - RANDOM VECTORS - REVIEW Joint densities describe probability distributions of a random vector X: an n-dimensional vector of random variables, ie, X = (X 1,, X n ), where all X is are
More informationChapter 4 continued. Chapter 4 sections
Chapter 4 sections Chapter 4 continued 4.1 Expectation 4.2 Properties of Expectations 4.3 Variance 4.4 Moments 4.5 The Mean and the Median 4.6 Covariance and Correlation 4.7 Conditional Expectation SKIP:
More informationPCMI Introduction to Random Matrix Theory Handout # REVIEW OF PROBABILITY THEORY. Chapter 1 - Events and Their Probabilities
PCMI 207 - Introduction to Random Matrix Theory Handout #2 06.27.207 REVIEW OF PROBABILITY THEORY Chapter - Events and Their Probabilities.. Events as Sets Definition (σ-field). A collection F of subsets
More informationMULTIVARIATE PROBABILITY DISTRIBUTIONS
MULTIVARIATE PROBABILITY DISTRIBUTIONS. PRELIMINARIES.. Example. Consider an experiment that consists of tossing a die and a coin at the same time. We can consider a number of random variables defined
More informationBASICS OF PROBABILITY
October 10, 2018 BASICS OF PROBABILITY Randomness, sample space and probability Probability is concerned with random experiments. That is, an experiment, the outcome of which cannot be predicted with certainty,
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 14: Continuous random variables Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/
More informationSTAT 430/510: Lecture 16
STAT 430/510: Lecture 16 James Piette June 24, 2010 Updates HW4 is up on my website. It is due next Mon. (June 28th). Starting today back at section 6.7 and will begin Ch. 7. Joint Distribution of Functions
More informationSTAT Chapter 5 Continuous Distributions
STAT 270 - Chapter 5 Continuous Distributions June 27, 2012 Shirin Golchi () STAT270 June 27, 2012 1 / 59 Continuous rv s Definition: X is a continuous rv if it takes values in an interval, i.e., range
More informationQuick review on Discrete Random Variables
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 2017 Néhémy Lim Quick review on Discrete Random Variables Notations. Z = {..., 2, 1, 0, 1, 2,...}, set of all integers; N = {0, 1, 2,...}, set of natural
More informationMA 575 Linear Models: Cedric E. Ginestet, Boston University Revision: Probability and Linear Algebra Week 1, Lecture 2
MA 575 Linear Models: Cedric E Ginestet, Boston University Revision: Probability and Linear Algebra Week 1, Lecture 2 1 Revision: Probability Theory 11 Random Variables A real-valued random variable is
More informationf X, Y (x, y)dx (x), where f(x,y) is the joint pdf of X and Y. (x) dx
INDEPENDENCE, COVARIANCE AND CORRELATION Independence: Intuitive idea of "Y is independent of X": The distribution of Y doesn't depend on the value of X. In terms of the conditional pdf's: "f(y x doesn't
More informationLecture 1: August 28
36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 1: August 28 Our broad goal for the first few lectures is to try to understand the behaviour of sums of independent random
More informationPerhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows.
Chapter 5 Two Random Variables In a practical engineering problem, there is almost always causal relationship between different events. Some relationships are determined by physical laws, e.g., voltage
More information6.041/6.431 Fall 2010 Quiz 2 Solutions
6.04/6.43: Probabilistic Systems Analysis (Fall 200) 6.04/6.43 Fall 200 Quiz 2 Solutions Problem. (80 points) In this problem: (i) X is a (continuous) uniform random variable on [0, 4]. (ii) Y is an exponential
More informationOutline Properties of Covariance Quantifying Dependence Models for Joint Distributions Lab 4. Week 8 Jointly Distributed Random Variables Part II
Week 8 Jointly Distributed Random Variables Part II Week 8 Objectives 1 The connection between the covariance of two variables and the nature of their dependence is given. 2 Pearson s correlation coefficient
More informationProbability Models. 4. What is the definition of the expectation of a discrete random variable?
1 Probability Models The list of questions below is provided in order to help you to prepare for the test and exam. It reflects only the theoretical part of the course. You should expect the questions
More informationCHAPTER 4 MATHEMATICAL EXPECTATION. 4.1 Mean of a Random Variable
CHAPTER 4 MATHEMATICAL EXPECTATION 4.1 Mean of a Random Variable The expected value, or mathematical expectation E(X) of a random variable X is the long-run average value of X that would emerge after a
More informationMathematics 426 Robert Gross Homework 9 Answers
Mathematics 4 Robert Gross Homework 9 Answers. Suppose that X is a normal random variable with mean µ and standard deviation σ. Suppose that PX > 9 PX
More information18.440: Lecture 28 Lectures Review
18.440: Lecture 28 Lectures 18-27 Review Scott Sheffield MIT Outline Outline It s the coins, stupid Much of what we have done in this course can be motivated by the i.i.d. sequence X i where each X i is
More informationLecture 11. Probability Theory: an Overveiw
Math 408 - Mathematical Statistics Lecture 11. Probability Theory: an Overveiw February 11, 2013 Konstantin Zuev (USC) Math 408, Lecture 11 February 11, 2013 1 / 24 The starting point in developing the
More information2 (Statistics) Random variables
2 (Statistics) Random variables References: DeGroot and Schervish, chapters 3, 4 and 5; Stirzaker, chapters 4, 5 and 6 We will now study the main tools use for modeling experiments with unknown outcomes
More informationSTT 441 Final Exam Fall 2013
STT 441 Final Exam Fall 2013 (12:45-2:45pm, Thursday, Dec. 12, 2013) NAME: ID: 1. No textbooks or class notes are allowed in this exam. 2. Be sure to show all of your work to receive credit. Credits are
More information1 Probability theory. 2 Random variables and probability theory.
Probability theory Here we summarize some of the probability theory we need. If this is totally unfamiliar to you, you should look at one of the sources given in the readings. In essence, for the major
More informationCh. 5 Joint Probability Distributions and Random Samples
Ch. 5 Joint Probability Distributions and Random Samples 5. 1 Jointly Distributed Random Variables In chapters 3 and 4, we learned about probability distributions for a single random variable. However,
More informationReview of Probability. CS1538: Introduction to Simulations
Review of Probability CS1538: Introduction to Simulations Probability and Statistics in Simulation Why do we need probability and statistics in simulation? Needed to validate the simulation model Needed
More information4 Pairs of Random Variables
B.Sc./Cert./M.Sc. Qualif. - Statistical Theory 4 Pairs of Random Variables 4.1 Introduction In this section, we consider a pair of r.v. s X, Y on (Ω, F, P), i.e. X, Y : Ω R. More precisely, we define a
More informationSummary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016
8. For any two events E and F, P (E) = P (E F ) + P (E F c ). Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 Sample space. A sample space consists of a underlying
More informationChapter 5 Class Notes
Chapter 5 Class Notes Sections 5.1 and 5.2 It is quite common to measure several variables (some of which may be correlated) and to examine the corresponding joint probability distribution One example
More information4. Distributions of Functions of Random Variables
4. Distributions of Functions of Random Variables Setup: Consider as given the joint distribution of X 1,..., X n (i.e. consider as given f X1,...,X n and F X1,...,X n ) Consider k functions g 1 : R n
More informationExpectation of Random Variables
1 / 19 Expectation of Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 13, 2015 2 / 19 Expectation of Discrete
More informationHypergeometric, Poisson & Joint Distributions
Hypergeometric, Poisson & Joint Distributions Sec 4.7-4.9 Cathy Poliak, Ph.D. cathy@math.uh.edu Office in Fleming 11c Department of Mathematics University of Houston Lecture 6-3339 Cathy Poliak, Ph.D.
More informationClass 8 Review Problems solutions, 18.05, Spring 2014
Class 8 Review Problems solutions, 8.5, Spring 4 Counting and Probability. (a) Create an arrangement in stages and count the number of possibilities at each stage: ( ) Stage : Choose three of the slots
More information1 Random Variable: Topics
Note: Handouts DO NOT replace the book. In most cases, they only provide a guideline on topics and an intuitive feel. 1 Random Variable: Topics Chap 2, 2.1-2.4 and Chap 3, 3.1-3.3 What is a random variable?
More informationChapter 4 : Discrete Random Variables
STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 2015 Néhémy Lim Chapter 4 : Discrete Random Variables 1 Random variables Objectives of this section. To learn the formal definition of a random variable.
More informationStatistics for Economists Lectures 6 & 7. Asrat Temesgen Stockholm University
Statistics for Economists Lectures 6 & 7 Asrat Temesgen Stockholm University 1 Chapter 4- Bivariate Distributions 41 Distributions of two random variables Definition 41-1: Let X and Y be two random variables
More informationLecture 16 : Independence, Covariance and Correlation of Discrete Random Variables
Lecture 6 : Independence, Covariance and Correlation of Discrete Random Variables 0/ 3 Definition Two discrete random variables X and Y defined on the same sample space are said to be independent if for
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter Five Jesse Crawford Department of Mathematics Tarleton State University Spring 2011 (Tarleton State University) Chapter Five Notes Spring 2011 1 / 37 Outline 1
More informationIntroduction to Machine Learning
What does this mean? Outline Contents Introduction to Machine Learning Introduction to Probabilistic Methods Varun Chandola December 26, 2017 1 Introduction to Probability 1 2 Random Variables 3 3 Bayes
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More informationClass 8 Review Problems 18.05, Spring 2014
1 Counting and Probability Class 8 Review Problems 18.05, Spring 2014 1. (a) How many ways can you arrange the letters in the word STATISTICS? (e.g. SSSTTTIIAC counts as one arrangement.) (b) If all arrangements
More informationIntroduction to Machine Learning
Introduction to Machine Learning Introduction to Probabilistic Methods Varun Chandola Computer Science & Engineering State University of New York at Buffalo Buffalo, NY, USA chandola@buffalo.edu Chandola@UB
More informationHW Solution 12 Due: Dec 2, 9:19 AM
ECS 315: Probability and Random Processes 2015/1 HW Solution 12 Due: Dec 2, 9:19 AM Lecturer: Prapun Suksompong, Ph.D. Problem 1. Let X E(3). (a) For each of the following function g(x). Indicate whether
More informationLecture 4: Proofs for Expectation, Variance, and Covariance Formula
Lecture 4: Proofs for Expectation, Variance, and Covariance Formula by Hiro Kasahara Vancouver School of Economics University of British Columbia Hiro Kasahara (UBC) Econ 325 1 / 28 Discrete Random Variables:
More information3. General Random Variables Part IV: Mul8ple Random Variables. ECE 302 Fall 2009 TR 3 4:15pm Purdue University, School of ECE Prof.
3. General Random Variables Part IV: Mul8ple Random Variables ECE 302 Fall 2009 TR 3 4:15pm Purdue University, School of ECE Prof. Ilya Pollak Joint PDF of two con8nuous r.v. s PDF of continuous r.v.'s
More information3. Probability and Statistics
FE661 - Statistical Methods for Financial Engineering 3. Probability and Statistics Jitkomut Songsiri definitions, probability measures conditional expectations correlation and covariance some important
More informationContinuous distributions
CHAPTER 7 Continuous distributions 7.. Introduction A r.v. X is said to have a continuous distribution if there exists a nonnegative function f such that P(a X b) = ˆ b a f(x)dx for every a and b. distribution.)
More informationProbability Review. Yutian Li. January 18, Stanford University. Yutian Li (Stanford University) Probability Review January 18, / 27
Probability Review Yutian Li Stanford University January 18, 2018 Yutian Li (Stanford University) Probability Review January 18, 2018 1 / 27 Outline 1 Elements of probability 2 Random variables 3 Multiple
More informationSTOR Lecture 16. Properties of Expectation - I
STOR 435.001 Lecture 16 Properties of Expectation - I Jan Hannig UNC Chapel Hill 1 / 22 Motivation Recall we found joint distributions to be pretty complicated objects. Need various tools from combinatorics
More informationJoint Probability Distributions and Random Samples (Devore Chapter Five)
Joint Probability Distributions and Random Samples (Devore Chapter Five) 1016-345-01: Probability and Statistics for Engineers Spring 2013 Contents 1 Joint Probability Distributions 2 1.1 Two Discrete
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationProbability. Paul Schrimpf. January 23, UBC Economics 326. Probability. Paul Schrimpf. Definitions. Properties. Random variables.
Probability UBC Economics 326 January 23, 2018 1 2 3 Wooldridge (2013) appendix B Stock and Watson (2009) chapter 2 Linton (2017) chapters 1-5 Abbring (2001) sections 2.1-2.3 Diez, Barr, and Cetinkaya-Rundel
More informationSTAT/MATH 395 A - PROBABILITY II UW Winter Quarter Moment functions. x r p X (x) (1) E[X r ] = x r f X (x) dx (2) (x E[X]) r p X (x) (3)
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 07 Néhémy Lim Moment functions Moments of a random variable Definition.. Let X be a rrv on probability space (Ω, A, P). For a given r N, E[X r ], if it
More informationMATHEMATICS 154, SPRING 2009 PROBABILITY THEORY Outline #11 (Tail-Sum Theorem, Conditional distribution and expectation)
MATHEMATICS 154, SPRING 2009 PROBABILITY THEORY Outline #11 (Tail-Sum Theorem, Conditional distribution and expectation) Last modified: March 7, 2009 Reference: PRP, Sections 3.6 and 3.7. 1. Tail-Sum Theorem
More informationChapter 4. Chapter 4 sections
Chapter 4 sections 4.1 Expectation 4.2 Properties of Expectations 4.3 Variance 4.4 Moments 4.5 The Mean and the Median 4.6 Covariance and Correlation 4.7 Conditional Expectation SKIP: 4.8 Utility Expectation
More informationMore on Distribution Function
More on Distribution Function The distribution of a random variable X can be determined directly from its cumulative distribution function F X. Theorem: Let X be any random variable, with cumulative distribution
More informationChapter 2. Some Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables
Chapter 2 Some Basic Probability Concepts 2.1 Experiments, Outcomes and Random Variables A random variable is a variable whose value is unknown until it is observed. The value of a random variable results
More informationECE353: Probability and Random Processes. Lecture 7 -Continuous Random Variable
ECE353: Probability and Random Processes Lecture 7 -Continuous Random Variable Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu Continuous
More informationconditional cdf, conditional pdf, total probability theorem?
6 Multiple Random Variables 6.0 INTRODUCTION scalar vs. random variable cdf, pdf transformation of a random variable conditional cdf, conditional pdf, total probability theorem expectation of a random
More information18.440: Lecture 28 Lectures Review
18.440: Lecture 28 Lectures 17-27 Review Scott Sheffield MIT 1 Outline Continuous random variables Problems motivated by coin tossing Random variable properties 2 Outline Continuous random variables Problems
More informationFormulas for probability theory and linear models SF2941
Formulas for probability theory and linear models SF2941 These pages + Appendix 2 of Gut) are permitted as assistance at the exam. 11 maj 2008 Selected formulae of probability Bivariate probability Transforms
More informationLecture 2: Review of Probability
Lecture 2: Review of Probability Zheng Tian Contents 1 Random Variables and Probability Distributions 2 1.1 Defining probabilities and random variables..................... 2 1.2 Probability distributions................................
More information18.440: Lecture 26 Conditional expectation
18.440: Lecture 26 Conditional expectation Scott Sheffield MIT 1 Outline Conditional probability distributions Conditional expectation Interpretation and examples 2 Outline Conditional probability distributions
More informationIntroduction to Computational Finance and Financial Econometrics Probability Review - Part 2
You can t see this text! Introduction to Computational Finance and Financial Econometrics Probability Review - Part 2 Eric Zivot Spring 2015 Eric Zivot (Copyright 2015) Probability Review - Part 2 1 /
More informationCHAPTER 5. Jointly Probability Mass Function for Two Discrete Distributed Random Variables:
CHAPTER 5 Jointl Distributed Random Variable There are some situations that experiment contains more than one variable and researcher interested in to stud joint behavior of several variables at the same
More informationAppendix A : Introduction to Probability and stochastic processes
A-1 Mathematical methods in communication July 5th, 2009 Appendix A : Introduction to Probability and stochastic processes Lecturer: Haim Permuter Scribe: Shai Shapira and Uri Livnat The probability of
More informationProbability, Random Processes and Inference
INSTITUTO POLITÉCNICO NACIONAL CENTRO DE INVESTIGACION EN COMPUTACION Laboratorio de Ciberseguridad Probability, Random Processes and Inference Dr. Ponciano Jorge Escamilla Ambrosio pescamilla@cic.ipn.mx
More informationChapter 5: Joint Probability Distributions
Chapter 5: Joint Probability Distributions Seungchul Baek Department of Statistics, University of South Carolina STAT 509: Statistics for Engineers 1 / 19 Joint pmf Definition: The joint probability mass
More informationChapter 4 Multiple Random Variables
Review for the previous lecture Theorems and Examples: How to obtain the pmf (pdf) of U = g ( X Y 1 ) and V = g ( X Y) Chapter 4 Multiple Random Variables Chapter 43 Bivariate Transformations Continuous
More informationMath 3215 Intro. Probability & Statistics Summer 14. Homework 5: Due 7/3/14
Math 325 Intro. Probability & Statistics Summer Homework 5: Due 7/3/. Let X and Y be continuous random variables with joint/marginal p.d.f. s f(x, y) 2, x y, f (x) 2( x), x, f 2 (y) 2y, y. Find the conditional
More informationChapter 2. Probability
2-1 Chapter 2 Probability 2-2 Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance with certainty. Examples: rolling a die tossing
More information