Random Signals and Systems. Chapter 3. Jitendra K Tugnait. Department of Electrical & Computer Engineering. Auburn University.
|
|
- Austin Allison
- 5 years ago
- Views:
Transcription
1 Random Signals and Systems Chapter 3 Jitendra K Tugnait Professor Department of Electrical & Computer Engineering Auburn University
2 Two Random Variables Previously, we only dealt with one random variable For the next few lectures, we will study two random variables» How they are related to each other» How we describe this relationship This is an intermediate step toward random signals
3 Example + V - V O L T M E T E R measured voltage (random) random voltage measurement error (random variable) 3
4 Joint Probability Distribution Joint Probability Distribution: Consider two RV s X and Y F xy, PX ( xy, y) Properties AND ) 0 Fx, y x y ) 3) F, y F x, F, 0 F, 4
5 Properties cont d 4) F(x,y) is a nondecreasing function as either x or y, or both increase 5) F, y F ( y Y ), ( ) F x F x X marginal distributions F, y P( X, Y y) P( Y y) F ( y) Y 5
6 Joint Density Function, f x y, F x y x y order of differentiation is not important f x, y dxdy P x X xdx, yy ydy ), 0 f x y x y ) f x, y dxdy 3) x y F xy, fuvdvdu, 6
7 Joint Density Function cont d 4) f x f x, ydy X f y f x, y dx Y marginal densities 5) x y P x X x, y Y y f x, y dxdy x y 7
8 Example, y yx x f x y 0 elsewhere for x x x, y y y f xy, height y y x x y y x x 8
9 Expected Values Given two RV s X and Y, the expected value of g(x,y) is E g Y g y f y X, x, x, dydx E XY xyf x, y dydx is called the correlation. 9
10 Example, y yx x f x y 0 elsewhere for x x x, y y y y f xy, x x y x y E XY xy dydx x y y y x x x y y y x x 4 x y x y x x y y 0
11 Example cont d f x dy y X y y x x y y y y y y x x x x y y f xy, x x Similarly, f y dx x Y y y x x y y x
12 Example Rectangular semiconductor substrate with dimensions having mean values of cm and cm.» Actual dimensions are independent and uniformly distributed between ±0.0cm of their means a) Probability that both dimensions are larger than their mean values by cm P (.005 X,.005 Y ) dxdy
13 Example cont d b) Probability that the larger dimension is greater than its mean value by 0.05cm and the smaller dimension is less than its mean value by 0.05 cm P ( X 0.995,.005 Y ) dxdy
14 Example cont d c) The mean value of the area of the substrate A E{ A} E{ XY } xy dydx x y
15 Joint Density Function cont d Ex: Two RV s X and Y f x, y a) Value of A x 3y Ae x 0, y 0 0 x 0, y 0 A 00 x 3y 3y x 3y x A e e dx dy A e e dy y e dy A A 3 6 Ae dxdy 0 5
16 Joint Density Function cont d 4 3 4, 6 6 [ ] [ ] x y b) 3 P X Y e dydx e e 00 c) The expected value of XY. 0 0 x 3y E XY 6 xye dydx x 3y xe ye dy dx 6
17 Conditional Probability Previously, we worked with conditional probability in terms of events PA ( B) PAB ( ) PB ( ) We now define conditional probability in terms of random variables Example: What is the probability density of the actual voltage given that the measured voltage is.v? + V - V O L T M E T E R measured voltage actual voltage measurement error 8
18 Conditional Probability Consider two RV s X and Y with joint distribution F(x,y) First, consider the probability that X x given that Y y.,, P X x Y y F xy PX x Y y F x Y y X P Y y F y Y Now, suppose that y Y y is given,, F x y F x y PX x y Y y F x y Y y X F y F y Y Y Now, suppose that Y = y is given (i.e. y =y ) F x, y F x, y 0 PX x Y y? F y F y 0 Y Y 9
19 Conditional Probability cont d By using something similar to l Hospital s Rule, we get, f xy f x Y y X f y Y conditional density often written f(x y) f x y, f xy f y x f y Y, f xy f x X joint marginal 0
20 Conditional Probability cont d Bayes Theorem: f y x Y f x y f y f x X Total Probability:, f x f x y dy f x y f y dy X Y, f y f x y dx f y x f x dx Y X
21 Conditional Probability Example Ex:, f x y 0, k x y x y 0 elsewhere a) Value of k x y kx ydxdy k k
22 Conditional Probability Example, f x y x y 0 x, y 0 elsewhere b) Probability that X>/ given that Y=/4? f y f x, ydx x ydx y Y 0 P X Y 4 f( x, y) f( x y) f y Y x y y f x x x x f Y, P dx dx 4 3/
23 Statistical Independence Two RV s X and Y are statistically independent if and only if f(x,y)=f X (x) f Y (y)» the joint density is separable. 5
24 Statistical Independence If X and Y are independent, then, f x y f x f y X Y Y Y f x y f x f y f y X» Knowledge of y tells us nothing about x» Similarly f y x f y Y 6
25 Uncorrelated Random Variables The random variables X and Y are uncorrelated if» E{XY}=E{X} E{Y} 7
26 Example Two random variables, X and Y, have the following joint density function, f x y» Are they independent? x y 0 x, y 0 elsewhere Answer: NO! Density function is not separable 8
27 Example Two random variables, X and Y, have the following joint density function, f x y 4xy 0 x, y 0 elsewhere» Are they independent? Answer: YES! Density function is separable fx ( x) x 0 x fy ( y) y 0 y 9
28 Statistical Independence If X and Y are independent, then E XY xyf ( x, y ) dxdy» X and Y are uncorrelated xyf ( x ) f ( y ) dxdy X Y [ xf ( x )][ yf ( y )] dxdy X Y xf ( x) dx yf ( y) dy X Y E XY E{ X} E{ Y} XY 30
29 Independent vs. Uncorrelated Both uncorrelated and independent mean that the RV s are not related They differ in how this uncorrelatedness is defined» Independent density function» Uncorrelated first and second order statistics uncorrelated E XY E X E Y independent f ( xy, ) f x f y X Y 3
30 Example f( x, y) k( xy x y) 0 x, y a) Are X and Y independent? Answer: YES! f( x, y) k( xy x y) kx ( )( y) b) Find k 4 5 kx ( )( y) dxdy 0 0 x y k ( x) ( y) k ( )( ) k
31 Example f( x, y) k( xy x y) 0 x, y b) Find E{XY} E{ X} x ( x) dx x x [ ] 3 3 ( ) EY { } y ( y) dx [ y ] y 5 3 ( ) Since X and Y are independent, E { XY } E { X } E { Y }
32 height in feet Correlation Between RV s shoe size 35
33 vision 0/x Correlation Between RV s shoe size 36
34 miles per gallon Correlation Between RV s car weight in lbs 37
35 Correlation Between RV s We need to quantify the relationship between RV s Correlation E{XY} is one way» X and Y may have different mean values and scales» Difficult to tell much about how related they are. If we subtract the mean, we get the covariance E X X Y Y» The covariance is not affected by the mean values, but we still have a problem with RV s with different scales (i.e. σ) 38
36 Y X X Y EXY=80 EXY= Problem with Correlation 39
37 Correlation Coefficient If we substract the means and divide by the standard deviations, we get the correlation coefficient X X Y Y E XY XY E X Y XY»» ρ>0 means the RV s are positively correlated» ρ<0 means the RV s are negatively correlated» ρ=0 means the RV s are not correlated (uncorrelated)» ρ=± means the RV s are linearly related e.g. Y=mX+b If ρ=, m>0 If ρ=-, m<0 40
38 height in feet shoe size shoe size car weight in lbs vision 0/x miles per gallon Correlation Coefficient
39 Example, f x y X Y X Y 7 x y 0 x,0 y X Y else XY E XY xy x y dxdy Slight E XY XY Negative correlation 4
40 Correlation Between RV s cont d Ex: Z ax by a,b constant. What is z? E Z E ax by ax by E Z E ax by a E X abe XY b E Y a X ab XY b Y X X Y Y a ab b a X abxy b Y X X Y Y a ab b ax by X X Y Y a ab b E Z X X Y Y Z Z z ax by a ab b X X Y Y 43
41 Formulas to Remember X X Y Y E XY XY E X Y XY E XY XY X Y a ab b ax by X X Y Y 44
42 Density Function of the Sum of Two RV s Suppose we have RV s X and Y that are statistically independent Let Z=X+Y What is f z Z? First find the probability distribution function. y z=x+y Z z F z P Z z P X Y z Z x=z-y Integrate f(x,y) over this region z y z y, F z f x y dxdy Z f x f y dxdy X Y z y f y f x dxdy Y X since X and Y are independent 46
43 Density Function of the Sum of Two RV s cont d z y F z f y f x dxdy Z Y X Differentiate both sides with respect to z using Leibniz rule ht ht d d,,, ( ), dt gt gt dt A tsds Atht ht Atgt gt Atsds f z f y f z y dy Z Y X 47
44 Density Function of the Sum of Two RV s cont d f z f f z d Z Y X The probability density function of Z=X+Y where X and Y are independent is the convolution of the density functions of X and Y f z f z f z Z X Y f z f f z d Z Y X For Z=X-Y 48
45 Convolution Example f x X f y Y x y e y Flip and shift f Y (y) f z f f z d Z X Y 49
46 f x X e Convolution Example f y Y x y e y z 3 cases z 0 0 z z z 0 λ 50
47 Convolution Example z 0 0 f z Z 0 z z z 0 f z e d e Z 0 z z f z e d e e Z z z f z Z 0.63 z 5
48 Correlation For Z=X-Y f z f f z d Z Y X Deterministic correlation of two functions Similar to convolution, but» No flipping just shifting» Must shift the z+λ function» When shifting, f(0) is at λ=- z 5
49 f y Y Shift f X (x) Correlation Example f x X y x e x f z f f z d Z Y X z e z 0 λ 53
50 f y Y Correlation Example f x X y x e x 3 cases z 0 0 z 0 z z 0 z z z e z 0 λ 54
51 Correlation Example 0 z f z e d e e Z 0 z z e z z 0 λ z 0 f z e d e Z z z ( z ) 0 z e z λ z f z 0 Z 0 z e z λ 55
52 f y Y Correlation Example f x X y x e x f z f f z d Z Y X f z Z z 56
53 Two Important Consequences ) CENTRAL LIMIT THEOREM (CLT) The PDF of sum of n independent random variables approaches a Gaussian density as n becomes large, regardless of the pdf s of the individual RV s. (many RV s encountered in real life satisfy this)
54 Two Important Consequences ) If X and Y are Gaussian, Z is also Gaussian with: Z X Y Z X Y X Y 58
55
ENGG2430A-Homework 2
ENGG3A-Homework Due on Feb 9th,. Independence vs correlation a For each of the following cases, compute the marginal pmfs from the joint pmfs. Explain whether the random variables X and Y are independent,
More informationSTA 256: Statistics and Probability I
Al Nosedal. University of Toronto. Fall 2017 My momma always said: Life was like a box of chocolates. You never know what you re gonna get. Forrest Gump. There are situations where one might be interested
More informationContinuous r.v practice problems
Continuous r.v practice problems SDS 321 Intro to Probability and Statistics 1. (2+2+1+1 6 pts) The annual rainfall (in inches) in a certain region is normally distributed with mean 4 and standard deviation
More informationLecture 11. Probability Theory: an Overveiw
Math 408 - Mathematical Statistics Lecture 11. Probability Theory: an Overveiw February 11, 2013 Konstantin Zuev (USC) Math 408, Lecture 11 February 11, 2013 1 / 24 The starting point in developing the
More informationconditional cdf, conditional pdf, total probability theorem?
6 Multiple Random Variables 6.0 INTRODUCTION scalar vs. random variable cdf, pdf transformation of a random variable conditional cdf, conditional pdf, total probability theorem expectation of a random
More informationPerhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows.
Chapter 5 Two Random Variables In a practical engineering problem, there is almost always causal relationship between different events. Some relationships are determined by physical laws, e.g., voltage
More informationChapter 2. Some Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables
Chapter 2 Some Basic Probability Concepts 2.1 Experiments, Outcomes and Random Variables A random variable is a variable whose value is unknown until it is observed. The value of a random variable results
More informationBivariate Distributions
Bivariate Distributions EGR 260 R. Van Til Industrial & Systems Engineering Dept. Copyright 2013. Robert P. Van Til. All rights reserved. 1 What s It All About? Many random processes produce Examples.»
More informationContinuous Random Variables
1 / 24 Continuous Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 27, 2013 2 / 24 Continuous Random Variables
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 17: Continuous random variables: conditional PDF Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin
More informationCovariance and Correlation
Covariance and Correlation ST 370 The probability distribution of a random variable gives complete information about its behavior, but its mean and variance are useful summaries. Similarly, the joint probability
More informationBivariate distributions
Bivariate distributions 3 th October 017 lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.) Bivariate Distributions of the Discrete Type The Correlation Coefficient
More informationECE Lecture #9 Part 2 Overview
ECE 450 - Lecture #9 Part Overview Bivariate Moments Mean or Expected Value of Z = g(x, Y) Correlation and Covariance of RV s Functions of RV s: Z = g(x, Y); finding f Z (z) Method : First find F(z), by
More informationP (x). all other X j =x j. If X is a continuous random vector (see p.172), then the marginal distributions of X i are: f(x)dx 1 dx n
JOINT DENSITIES - RANDOM VECTORS - REVIEW Joint densities describe probability distributions of a random vector X: an n-dimensional vector of random variables, ie, X = (X 1,, X n ), where all X is are
More informationHomework 5 Solutions
126/DCP126 Probability, Fall 214 Instructor: Prof. Wen-Guey Tzeng Homework 5 Solutions 5-Jan-215 1. Let the joint probability mass function of discrete random variables X and Y be given by { c(x + y) ifx
More informationJoint Probability Distributions, Correlations
Joint Probability Distributions, Correlations What we learned so far Events: Working with events as sets: union, intersection, etc. Some events are simple: Head vs Tails, Cancer vs Healthy Some are more
More informationUNIT Define joint distribution and joint probability density function for the two random variables X and Y.
UNIT 4 1. Define joint distribution and joint probability density function for the two random variables X and Y. Let and represent the probability distribution functions of two random variables X and Y
More informationf X, Y (x, y)dx (x), where f(x,y) is the joint pdf of X and Y. (x) dx
INDEPENDENCE, COVARIANCE AND CORRELATION Independence: Intuitive idea of "Y is independent of X": The distribution of Y doesn't depend on the value of X. In terms of the conditional pdf's: "f(y x doesn't
More informationSTAT 430/510: Lecture 16
STAT 430/510: Lecture 16 James Piette June 24, 2010 Updates HW4 is up on my website. It is due next Mon. (June 28th). Starting today back at section 6.7 and will begin Ch. 7. Joint Distribution of Functions
More informationCHAPTER 5. Jointly Probability Mass Function for Two Discrete Distributed Random Variables:
CHAPTER 5 Jointl Distributed Random Variable There are some situations that experiment contains more than one variable and researcher interested in to stud joint behavior of several variables at the same
More informationJoint Probability Distributions, Correlations
Joint Probability Distributions, Correlations What we learned so far Events: Working with events as sets: union, intersection, etc. Some events are simple: Head vs Tails, Cancer vs Healthy Some are more
More informationMathematics 426 Robert Gross Homework 9 Answers
Mathematics 4 Robert Gross Homework 9 Answers. Suppose that X is a normal random variable with mean µ and standard deviation σ. Suppose that PX > 9 PX
More informationUNIT-2: MULTIPLE RANDOM VARIABLES & OPERATIONS
UNIT-2: MULTIPLE RANDOM VARIABLES & OPERATIONS In many practical situations, multiple random variables are required for analysis than a single random variable. The analysis of two random variables especially
More informationRandom Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R
In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample
More information5 Operations on Multiple Random Variables
EE360 Random Signal analysis Chapter 5: Operations on Multiple Random Variables 5 Operations on Multiple Random Variables Expected value of a function of r.v. s Two r.v. s: ḡ = E[g(X, Y )] = g(x, y)f X,Y
More information4 Pairs of Random Variables
B.Sc./Cert./M.Sc. Qualif. - Statistical Theory 4 Pairs of Random Variables 4.1 Introduction In this section, we consider a pair of r.v. s X, Y on (Ω, F, P), i.e. X, Y : Ω R. More precisely, we define a
More informationBasics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationReview: mostly probability and some statistics
Review: mostly probability and some statistics C2 1 Content robability (should know already) Axioms and properties Conditional probability and independence Law of Total probability and Bayes theorem Random
More informationMultivariate distributions
CHAPTER Multivariate distributions.. Introduction We want to discuss collections of random variables (X, X,..., X n ), which are known as random vectors. In the discrete case, we can define the density
More information2 (Statistics) Random variables
2 (Statistics) Random variables References: DeGroot and Schervish, chapters 3, 4 and 5; Stirzaker, chapters 4, 5 and 6 We will now study the main tools use for modeling experiments with unknown outcomes
More informationECE 302: Probabilistic Methods in Engineering
Purdue University School of Electrical and Computer Engineering ECE 32: Probabilistic Methods in Engineering Fall 28 - Final Exam SOLUTION Monday, December 5, 28 Prof. Sanghavi s Section Score: Name: No
More informationQuantitative Methods in Economics Conditional Expectations
Quantitative Methods in Economics Conditional Expectations Maximilian Kasy Harvard University, fall 2016 1 / 19 Roadmap, Part I 1. Linear predictors and least squares regression 2. Conditional expectations
More informationProblem Y is an exponential random variable with parameter λ = 0.2. Given the event A = {Y < 2},
ECE32 Spring 25 HW Solutions April 6, 25 Solutions to HW Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in italics where
More informationEE4601 Communication Systems
EE4601 Communication Systems Week 2 Review of Probability, Important Distributions 0 c 2011, Georgia Institute of Technology (lect2 1) Conditional Probability Consider a sample space that consists of two
More informationMATH 38061/MATH48061/MATH68061: MULTIVARIATE STATISTICS Solutions to Problems on Random Vectors and Random Sampling. 1+ x2 +y 2 ) (n+2)/2
MATH 3806/MATH4806/MATH6806: MULTIVARIATE STATISTICS Solutions to Problems on Rom Vectors Rom Sampling Let X Y have the joint pdf: fx,y) + x +y ) n+)/ π n for < x < < y < this is particular case of the
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationECE 4400:693 - Information Theory
ECE 4400:693 - Information Theory Dr. Nghi Tran Lecture 8: Differential Entropy Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Lecture 1 / 43 Outline 1 Review: Entropy of discrete RVs 2 Differential
More information2 Functions of random variables
2 Functions of random variables A basic statistical model for sample data is a collection of random variables X 1,..., X n. The data are summarised in terms of certain sample statistics, calculated as
More informationReview of Probability Theory
Review of Probability Theory Arian Maleki and Tom Do Stanford University Probability theory is the study of uncertainty Through this class, we will be relying on concepts from probability theory for deriving
More informationIntroduction to Probability and Stocastic Processes - Part I
Introduction to Probability and Stocastic Processes - Part I Lecture 1 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark
More informationSolutions to Homework Set #5 (Prepared by Lele Wang) MSE = E [ (sgn(x) g(y)) 2],, where f X (x) = 1 2 2π e. e (x y)2 2 dx 2π
Solutions to Homework Set #5 (Prepared by Lele Wang). Neural net. Let Y X + Z, where the signal X U[,] and noise Z N(,) are independent. (a) Find the function g(y) that minimizes MSE E [ (sgn(x) g(y))
More informationSTAT Chapter 5 Continuous Distributions
STAT 270 - Chapter 5 Continuous Distributions June 27, 2012 Shirin Golchi () STAT270 June 27, 2012 1 / 59 Continuous rv s Definition: X is a continuous rv if it takes values in an interval, i.e., range
More informationSTAT 515 MIDTERM 2 EXAM November 14, 2018
STAT 55 MIDTERM 2 EXAM November 4, 28 NAME: Section Number: Instructor: In problems that require reasoning, algebraic calculation, or the use of your graphing calculator, it is not sufficient just to write
More informationLecture Notes 3 Multiple Random Variables. Joint, Marginal, and Conditional pmfs. Bayes Rule and Independence for pmfs
Lecture Notes 3 Multiple Random Variables Joint, Marginal, and Conditional pmfs Bayes Rule and Independence for pmfs Joint, Marginal, and Conditional pdfs Bayes Rule and Independence for pdfs Functions
More informationAppendix A : Introduction to Probability and stochastic processes
A-1 Mathematical methods in communication July 5th, 2009 Appendix A : Introduction to Probability and stochastic processes Lecturer: Haim Permuter Scribe: Shai Shapira and Uri Livnat The probability of
More informationECE302 Exam 2 Version A April 21, You must show ALL of your work for full credit. Please leave fractions as fractions, but simplify them, etc.
ECE32 Exam 2 Version A April 21, 214 1 Name: Solution Score: /1 This exam is closed-book. You must show ALL of your work for full credit. Please read the questions carefully. Please check your answers
More informationMultiple Random Variables
Multiple Random Variables Joint Probability Density Let X and Y be two random variables. Their joint distribution function is F ( XY x, y) P X x Y y. F XY ( ) 1, < x
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationChapter 4 Multiple Random Variables
Review for the previous lecture Definition: n-dimensional random vector, joint pmf (pdf), marginal pmf (pdf) Theorem: How to calculate marginal pmf (pdf) given joint pmf (pdf) Example: How to calculate
More informationECE 650 Lecture 4. Intro to Estimation Theory Random Vectors. ECE 650 D. Van Alphen 1
EE 650 Lecture 4 Intro to Estimation Theory Random Vectors EE 650 D. Van Alphen 1 Lecture Overview: Random Variables & Estimation Theory Functions of RV s (5.9) Introduction to Estimation Theory MMSE Estimation
More information6.041/6.431 Fall 2010 Quiz 2 Solutions
6.04/6.43: Probabilistic Systems Analysis (Fall 200) 6.04/6.43 Fall 200 Quiz 2 Solutions Problem. (80 points) In this problem: (i) X is a (continuous) uniform random variable on [0, 4]. (ii) Y is an exponential
More informationJoint Probability Distributions and Random Samples (Devore Chapter Five)
Joint Probability Distributions and Random Samples (Devore Chapter Five) 1016-345-01: Probability and Statistics for Engineers Spring 2013 Contents 1 Joint Probability Distributions 2 1.1 Two Discrete
More informationSUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416)
SUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416) D. ARAPURA This is a summary of the essential material covered so far. The final will be cumulative. I ve also included some review problems
More informationSTAT/MA 416 Answers Homework 6 November 15, 2007 Solutions by Mark Daniel Ward PROBLEMS
STAT/MA 4 Answers Homework November 5, 27 Solutions by Mark Daniel Ward PROBLEMS Chapter Problems 2a. The mass p, corresponds to neither of the first two balls being white, so p, 8 7 4/39. The mass p,
More informationProblem #1 #2 #3 #4 Total Points /5 /7 /8 /4 /24
STAT/MATH 395 A - Winter Quarter 17 - Midterm - February 17, 17 Name: Student ID Number: Problem #1 # #3 #4 Total Points /5 /7 /8 /4 /4 Directions. Read directions carefully and show all your work. Define
More informationECSE B Solutions to Assignment 8 Fall 2008
ECSE 34-35B Solutions to Assignment 8 Fall 28 Problem 8.1 A manufacturing system is governed by a Poisson counting process {N t ; t < } with rate parameter λ >. If a counting event occurs at an instant
More informationHW4 : Bivariate Distributions (1) Solutions
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 7 Néhémy Lim HW4 : Bivariate Distributions () Solutions Problem. The joint probability mass function of X and Y is given by the following table : X Y
More informationChapter 2. Probability
2-1 Chapter 2 Probability 2-2 Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance with certainty. Examples: rolling a die tossing
More informationGeneral Random Variables
1/65 Chia-Ping Chen Professor Department of Computer Science and Engineering National Sun Yat-sen University Probability A general random variable is discrete, continuous, or mixed. A discrete random variable
More informationSTAT515, Review Worksheet for Midterm 2 Spring 2019
STAT55, Review Worksheet for Midterm 2 Spring 29. During a week, the proportion of time X that a machine is down for maintenance or repair has the following probability density function: 2( x, x, f(x The
More informationLet X and Y denote two random variables. The joint distribution of these random
EE385 Class Notes 9/7/0 John Stensby Chapter 3: Multiple Random Variables Let X and Y denote two random variables. The joint distribution of these random variables is defined as F XY(x,y) = [X x,y y] P.
More informationMultivariate Distributions CIVL 7012/8012
Multivariate Distributions CIVL 7012/8012 Multivariate Distributions Engineers often are interested in more than one measurement from a single item. Multivariate distributions describe the probability
More informationMath 416 Lecture 2 DEFINITION. Here are the multivariate versions: X, Y, Z iff P(X = x, Y = y, Z =z) = p(x, y, z) of X, Y, Z iff for all sets A, B, C,
Math 416 Lecture 2 DEFINITION. Here are the multivariate versions: PMF case: p(x, y, z) is the joint Probability Mass Function of X, Y, Z iff P(X = x, Y = y, Z =z) = p(x, y, z) PDF case: f(x, y, z) is
More informationUCSD ECE153 Handout #27 Prof. Young-Han Kim Tuesday, May 6, Solutions to Homework Set #5 (Prepared by TA Fatemeh Arbabjolfaei)
UCSD ECE53 Handout #7 Prof. Young-Han Kim Tuesday, May 6, 4 Solutions to Homework Set #5 (Prepared by TA Fatemeh Arbabjolfaei). Neural net. Let Y = X + Z, where the signal X U[,] and noise Z N(,) are independent.
More information1 Review of di erential calculus
Review of di erential calculus This chapter presents the main elements of di erential calculus needed in probability theory. Often, students taking a course on probability theory have problems with concepts
More informationLecture 19: Properties of Expectation
Lecture 19: Properties of Expectation Dan Sloughter Furman University Mathematics 37 February 11, 4 19.1 The unconscious statistician, revisited The following is a generalization of the law of the unconscious
More informationProbability theory. References:
Reasoning Under Uncertainty References: Probability theory Mathematical methods in artificial intelligence, Bender, Chapter 7. Expert systems: Principles and programming, g, Giarratano and Riley, pag.
More informationHomework 10 (due December 2, 2009)
Homework (due December, 9) Problem. Let X and Y be independent binomial random variables with parameters (n, p) and (n, p) respectively. Prove that X + Y is a binomial random variable with parameters (n
More informationConsider the joint probability, P(x,y), shown as the contours in the figure above. P(x) is given by the integral of P(x,y) over all values of y.
ATMO/OPTI 656b Spring 009 Bayesian Retrievals Note: This follows the discussion in Chapter of Rogers (000) As we have seen, the problem with the nadir viewing emission measurements is they do not contain
More information1 Solution to Problem 2.1
Solution to Problem 2. I incorrectly worked this exercise instead of 2.2, so I decided to include the solution anyway. a) We have X Y /3, which is a - function. It maps the interval, ) where X lives) onto
More informationFormulas for probability theory and linear models SF2941
Formulas for probability theory and linear models SF2941 These pages + Appendix 2 of Gut) are permitted as assistance at the exam. 11 maj 2008 Selected formulae of probability Bivariate probability Transforms
More informationRaquel Prado. Name: Department of Applied Mathematics and Statistics AMS-131. Spring 2010
Raquel Prado Name: Department of Applied Mathematics and Statistics AMS-131. Spring 2010 Final Exam (Type B) The midterm is closed-book, you are only allowed to use one page of notes and a calculator.
More informationJoint p.d.f. and Independent Random Variables
1 Joint p.d.f. and Independent Random Variables Let X and Y be two discrete r.v. s and let R be the corresponding space of X and Y. The joint p.d.f. of X = x and Y = y, denoted by f(x, y) = P(X = x, Y
More informationCS145: Probability & Computing
CS45: Probability & Computing Lecture 0: Continuous Bayes Rule, Joint and Marginal Probability Densities Instructor: Eli Upfal Brown University Computer Science Figure credits: Bertsekas & Tsitsiklis,
More informationName of the Student: Problems on Discrete & Continuous R.Vs
Engineering Mathematics 05 SUBJECT NAME : Probability & Random Process SUBJECT CODE : MA6 MATERIAL NAME : University Questions MATERIAL CODE : JM08AM004 REGULATION : R008 UPDATED ON : Nov-Dec 04 (Scan
More informationRandom Variables. Cumulative Distribution Function (CDF) Amappingthattransformstheeventstotherealline.
Random Variables Amappingthattransformstheeventstotherealline. Example 1. Toss a fair coin. Define a random variable X where X is 1 if head appears and X is if tail appears. P (X =)=1/2 P (X =1)=1/2 Example
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More information1 Random variables and distributions
Random variables and distributions In this chapter we consider real valued functions, called random variables, defined on the sample space. X : S R X The set of possible values of X is denoted by the set
More informationNotes for Math 324, Part 19
48 Notes for Math 324, Part 9 Chapter 9 Multivariate distributions, covariance Often, we need to consider several random variables at the same time. We have a sample space S and r.v. s X, Y,..., which
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationBivariate Paired Numerical Data
Bivariate Paired Numerical Data Pearson s correlation, Spearman s ρ and Kendall s τ, tests of independence University of California, San Diego Instructor: Ery Arias-Castro http://math.ucsd.edu/~eariasca/teaching.html
More informationIntroduction to Computational Finance and Financial Econometrics Probability Review - Part 2
You can t see this text! Introduction to Computational Finance and Financial Econometrics Probability Review - Part 2 Eric Zivot Spring 2015 Eric Zivot (Copyright 2015) Probability Review - Part 2 1 /
More informationLecture 25: Review. Statistics 104. April 23, Colin Rundel
Lecture 25: Review Statistics 104 Colin Rundel April 23, 2012 Joint CDF F (x, y) = P [X x, Y y] = P [(X, Y ) lies south-west of the point (x, y)] Y (x,y) X Statistics 104 (Colin Rundel) Lecture 25 April
More information3-1. all x all y. [Figure 3.1]
- Chapter. Multivariate Distributions. All of the most interesting problems in statistics involve looking at more than a single measurement at a time, at relationships among measurements and comparisons
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationMAS223 Statistical Inference and Modelling Exercises
MAS223 Statistical Inference and Modelling Exercises The exercises are grouped into sections, corresponding to chapters of the lecture notes Within each section exercises are divided into warm-up questions,
More informationStatistics, Data Analysis, and Simulation SS 2015
Statistics, Data Analysis, and Simulation SS 2015 08.128.730 Statistik, Datenanalyse und Simulation Dr. Michael O. Distler Mainz, 27. April 2015 Dr. Michael O. Distler
More informationJointly Distributed Random Variables
Jointly Distributed Random Variables CE 311S What if there is more than one random variable we are interested in? How should you invest the extra money from your summer internship? To simplify matters,
More informationMATH 307: Problem Set #3 Solutions
: Problem Set #3 Solutions Due on: May 3, 2015 Problem 1 Autonomous Equations Recall that an equilibrium solution of an autonomous equation is called stable if solutions lying on both sides of it tend
More informationChapter 5 Joint Probability Distributions
Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger Chapter 5 Joint Probability Distributions 5 Joint Probability Distributions CHAPTER OUTLINE 5-1 Two
More informationPartial Solutions for h4/2014s: Sampling Distributions
27 Partial Solutions for h4/24s: Sampling Distributions ( Let X and X 2 be two independent random variables, each with the same probability distribution given as follows. f(x 2 e x/2, x (a Compute the
More informationMath 222 Spring 2013 Exam 3 Review Problem Answers
. (a) By the Chain ule, Math Spring 3 Exam 3 eview Problem Answers w s w x x s + w y y s (y xy)() + (xy x )( ) (( s + 4t) (s 3t)( s + 4t)) ((s 3t)( s + 4t) (s 3t) ) 8s 94st + 3t (b) By the Chain ule, w
More informationBivariate Distributions. Discrete Bivariate Distribution Example
Spring 7 Geog C: Phaedon C. Kyriakidis Bivariate Distributions Definition: class of multivariate probability distributions describing joint variation of outcomes of two random variables (discrete or continuous),
More informationSTAT 430/510: Lecture 15
STAT 430/510: Lecture 15 James Piette June 23, 2010 Updates HW4 is up on my website. It is due next Mon. (June 28th). Starting today back at section 6.4... Conditional Distribution: Discrete Def: The conditional
More informationMath 266, Midterm Exam 1
Math 266, Midterm Exam 1 February 19th 2016 Name: Ground Rules: 1. Calculator is NOT allowed. 2. Show your work for every problem unless otherwise stated (partial credits are available). 3. You may use
More informationSolution to Assignment 3
The Chinese University of Hong Kong ENGG3D: Probability and Statistics for Engineers 5-6 Term Solution to Assignment 3 Hongyang Li, Francis Due: 3:pm, March Release Date: March 8, 6 Dear students, The
More information[POLS 8500] Review of Linear Algebra, Probability and Information Theory
[POLS 8500] Review of Linear Algebra, Probability and Information Theory Professor Jason Anastasopoulos ljanastas@uga.edu January 12, 2017 For today... Basic linear algebra. Basic probability. Programming
More informationIntroduction to Probability and Stocastic Processes - Part I
Introduction to Probability and Stocastic Processes - Part I Lecture 2 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark
More information