ECE302 Exam 2 Version A April 21, You must show ALL of your work for full credit. Please leave fractions as fractions, but simplify them, etc.

Similar documents
ENGG2430A-Homework 2

ECE 302 Division 2 Exam 2 Solutions, 11/4/2009.

P (x). all other X j =x j. If X is a continuous random vector (see p.172), then the marginal distributions of X i are: f(x)dx 1 dx n

Chapter 4. Chapter 4 sections

2 (Statistics) Random variables

ECE353: Probability and Random Processes. Lecture 7 -Continuous Random Variable

Lecture 19: Properties of Expectation

This exam contains 6 questions. The questions are of equal weight. Print your name at the top of this page in the upper right hand corner.

UC Berkeley Department of Electrical Engineering and Computer Sciences. EECS 126: Probability and Random Processes

1 Random Variable: Topics

Problem Y is an exponential random variable with parameter λ = 0.2. Given the event A = {Y < 2},

STT 441 Final Exam Fall 2013

MATH/STAT 395 Winter 2013 This homework is due at the beginning of class on Friday, March 1.

Statistics STAT:5100 (22S:193), Fall Sample Final Exam B

ECE 302: Probabilistic Methods in Engineering

Perhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows.

Midterm Exam 1 Solution

Covariance and Correlation

STAT 515 MIDTERM 2 EXAM November 14, 2018

Lecture 2: Repetition of probability theory and statistics

Final Exam # 3. Sta 230: Probability. December 16, 2012

ECE 302 Division 1 MWF 10:30-11:20 (Prof. Pollak) Final Exam Solutions, 5/3/2004. Please read the instructions carefully before proceeding.

E X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl.

1.1 Review of Probability Theory

Probability. Paul Schrimpf. January 23, UBC Economics 326. Probability. Paul Schrimpf. Definitions. Properties. Random variables.

Raquel Prado. Name: Department of Applied Mathematics and Statistics AMS-131. Spring 2010

Random Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay

conditional cdf, conditional pdf, total probability theorem?

Continuous Random Variables

Bivariate Distributions

First Year Examination Department of Statistics, University of Florida

ECE569 Exam 1 October 28, Name: Score: /100. Please leave fractions as fractions, but simplify them, etc.

Bivariate Distributions

BASICS OF PROBABILITY

Random Variables. Cumulative Distribution Function (CDF) Amappingthattransformstheeventstotherealline.

Multivariate Random Variable

Continuous r.v practice problems

Random Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R

Probability and Statistics Notes

STAT/MATH 395 PROBABILITY II

Problem #1 #2 #3 #4 Total Points /5 /7 /8 /4 /24

Final. Fall 2016 (Dec 16, 2016) Please copy and write the following statement:

Properties of Random Variables

Lecture 11. Probability Theory: an Overveiw

EECS 126 Probability and Random Processes University of California, Berkeley: Spring 2015 Abhay Parekh February 17, 2015.

Algorithms for Uncertainty Quantification

STA 256: Statistics and Probability I

Probability review. September 11, Stoch. Systems Analysis Introduction 1

Functions of two random variables. Conditional pairs

ECE Lecture #9 Part 2 Overview

f X, Y (x, y)dx (x), where f(x,y) is the joint pdf of X and Y. (x) dx

Review of Probability Theory

Math 426: Probability MWF 1pm, Gasson 310 Exam 3 SOLUTIONS

Math 151. Rumbos Fall Solutions to Review Problems for Exam 2. Pr(X = 1) = ) = Pr(X = 2) = Pr(X = 3) = p X. (k) =

EE4601 Communication Systems

1 Joint and marginal distributions

matrix-free Elements of Probability Theory 1 Random Variables and Distributions Contents Elements of Probability Theory 2

Multiple Random Variables

HW Solution 12 Due: Dec 2, 9:19 AM

4. Distributions of Functions of Random Variables

14.30 Introduction to Statistical Methods in Economics Spring 2009

Statistics Examples. Cathal Ormond

Class 8 Review Problems solutions, 18.05, Spring 2014

University of Illinois ECE 313: Final Exam Fall 2014

Probability Theory and Statistics. Peter Jochumzen

p. 6-1 Continuous Random Variables p. 6-2

1 Review of Probability

1 Presessional Probability

ECE580 Exam 1 October 4, Please do not write on the back of the exam pages. Extra paper is available from the instructor.

Practice Examination # 3

6.041/6.431 Fall 2010 Quiz 2 Solutions

Multiple Random Variables

Math Spring Practice for the final Exam.

STAT 430/510: Lecture 16

APPM/MATH 4/5520 Solutions to Exam I Review Problems. f X 1,X 2. 2e x 1 x 2. = x 2

STAT Chapter 5 Continuous Distributions

Review: mostly probability and some statistics

5 Operations on Multiple Random Variables

UCSD ECE153 Handout #27 Prof. Young-Han Kim Tuesday, May 6, Solutions to Homework Set #5 (Prepared by TA Fatemeh Arbabjolfaei)

CS145: Probability & Computing

ELEG 3143 Probability & Stochastic Process Ch. 4 Multiple Random Variables

Lecture 1: August 28

1 x 2 and 1 y 2. 0 otherwise. c) Estimate by eye the value of x for which F(x) = x + y 0 x 1 and 0 y 1. 0 otherwise

Lecture 14: Multivariate mgf s and chf s

Jointly Distributed Random Variables

ECE580 Fall 2015 Solution to Midterm Exam 1 October 23, Please leave fractions as fractions, but simplify them, etc.

EE 302: Probabilistic Methods in Electrical Engineering

Review of Probability. CS1538: Introduction to Simulations

Bivariate Distributions. Discrete Bivariate Distribution Example

Probability and Distributions

DO NOT OPEN THIS QUESTION BOOKLET UNTIL YOU ARE TOLD TO DO SO

Stat 5101 Notes: Algorithms (thru 2nd midterm)

Introduction to Probability

Probability. Paul Schrimpf. January 23, Definitions 2. 2 Properties 3

Statistics 351 Probability I Fall 2006 (200630) Final Exam Solutions. θ α β Γ(α)Γ(β) (uv)α 1 (v uv) β 1 exp v }

Quantitative Methods in Economics Conditional Expectations

1 Expectation of a continuously distributed random variable

FINAL EXAM: Monday 8-10am

Ch. 5 Joint Probability Distributions and Random Samples

We introduce methods that are useful in:

Transcription:

ECE32 Exam 2 Version A April 21, 214 1 Name: Solution Score: /1 This exam is closed-book. You must show ALL of your work for full credit. Please read the questions carefully. Please check your answers carefully. Calculators may NOT be used. Please leave fractions as fractions, but simplify them, etc. I do not want the decimal equivalents. Cell phones and other electronic communication devices must be turned off and stowed under your desk. Please do not write on the backs of the exam or additional pages. The instructor will grade only one side of each page. Extra paper is available from the instructor. Please write your name on every page that you would like graded. 1 2 3 4 5 6 7 8 9 1 11

ECE32 Exam 2 Version A April 21, 214 2 1. (1 points) The PDF of the random variable Y is { 2y < y 1, f Y (y) (a) Find the CDF of Y. The CDF is obtained by integrating the PDF, y 2rdr r 2 y. For y the integrand is zero. Thus for y [, 1] r 2 y r2 y y2. For y > 1, the integrand is again zero so r 2 y r2 1 1 The CDF is thus y <, F Y (y) y 2 y < 1, 1 y 1. (b) Find P[1/3 < Y 2/3]. Using the CDF obtained in the previous part, P[1/3 < Y 2/3] F Y (2/3) F Y (1/3) 4/9 1/9 3/9 1/3. (c) Find E[Y ]. The expected value is E[Y ] (d) Find Var[Y ]. yf Y (y)dy y(2y)dy 2y 3 /3 1 2/3. To compute the variance we need E[Y 2 ], which is Thus E[Y ] yf Y (y)dy y 2 (2y)dy 2y 4 /4 1 1/2. Var[Y ] E[Y 2 ] (E[Y ]) 2 1/2 4/9 1/18.

ECE32 Exam 2 Version A April 21, 214 3 2. (12 points) The joint PMF of the random variables X and Y is 1/3 (x, y) (1, 1), 1/6 (x, y) {(2, 1), (2, 2)}, P X,Y (x, y) 1/9 (x, y) {(3, 1), (3, 2), (3, 3)}, (a) Find the marginal PMF P X (x). The marginal is obtained by summing (for discrete random variables) or integrating (for continuous random variables) over all values taken by the other variable(s), so P X (1) y S Y P X,Y (1, y) 1/3, P X (2) y S Y P X,Y (2, y) 2(1/6) 1/3, P X (3) y S Y P X,Y (3, y) 3(1/9) 1/3, so the marginal PMF is 1/3 x 1, 1/3 x 2, P X (x) 1/3 x 3, (b) Find the conditional PMF P Y X (y 2). The conditional PMF is defined on the range of values of y for which x 2 to be P Y X (y 2) P X,Y (x, y). P X (2) Thus, for each of the two values taken by y when x 2 we obtain 1/6 1/2 so 1/3 1/2 y 1, P Y X (y 2) 1/2 y 2, (c) Find E[Y X 2]. The set of values that y takes when X 2 is just {1, 2}, so E[Y X 2] yp Y X (y 2) 1(1/2) + 2(1/2) 3/2. y {1,2}

ECE32 Exam 2 Version A April 21, 214 4 3. (6 points) The joint PMF of the random variables X and Y is 1/3 (x, y) (1, 1), 1/6 (x, y) {(2, 1), (2, 2)}, P X,Y (x, y) 1/9 (x, y) {(3, 1), (3, 2), (3, 3)}, Let B {(1, 1), (2, 2), (3, 3)}. (a) Find P[B]. The probability of the event is the sum of the probabilities of the outcomes that comprise the event, so P [B] 1/3 + 1/6 + 1/9 11/18. (b) Find the conditional PMF P X,Y B (x, y). For (x, y) B, so P X,Y B (x, y) P X,Y B (x, y) P (X,Y )(x, y) P (B) (1/3)/(11/18) (x, y) (1, 1), (1/6)/(11/18) (x, y) (2, 2), (1/9)/(11/18) (x, y) (3, 3), otherwise, 6/11 (x, y) (1, 1), 3/11 (x, y) (2, 2), 2/11 (x, y) (3, 3),

ECE32 Exam 2 Version A April 21, 214 5 4. (1) The random vector X has PDF { 1e 5x 1 2x 2 x f X (x) 1, x 2, (a) Find the marginal PDF f x1 (x 1 ). The marginal is obtained by integrating the PDF over x 2, to obtain on S X1, Thus f x1 (x 1 ) f x1 (x 1 ) f X (x)dx 2 1e 5x 1 2x 2 dx 2 5e 5x 1 2e 2x 2 dx 2 5e 5x 1 e 2x 2 5e 5x 1 ( ( 1)). { 5e 5x 1 x 1 To verify that this is a valid PDF, we first note that it is i. non-negative, as required, and ii. integrates over x 1 to one, as shown below: f x1 (x 1 )dx 1 5e 5x 1 dx 1 e 5x 1 ( 1) 1. as required. (b) Are X 1 and X 2 independent? (Explanation required.) By symmetry, we see that f x2 (x 2 ) { 2e 2x 2 x 2 Thus f X (x) f x1 (x 1 )f x2 (x 2 ) so X 1 and X 2 are independent. (c) Are X 1 and X 2 uncorrelated? (Explanation required.) Random variables that are independent are uncorrelated. is not necessarily true.) (The reverse

ECE32 Exam 2 Version A April 21, 214 6 5. (1 points) The joint CDF of random variables X and Y is x <, y <, F X,Y (x, y) xy x < 1, y < 1, 1 x 1, y 1. Let Z [X, Y ] T. (a) Find E [Z]. By definition E [Z] E [[ X Y ]] [ E[X] E[Y ] so we will need the marginals f X (x) and f Y (y). These are so f X (x) and by symmetry, Then E[X] and by symmetry, ], xydy xy 2 /2 1 x/2 x [, 1], f X (x) f Y (y) xf X (x)dx { x/2 x [, 1], otherwise, { y/2 y [, 1], x 2 /2 dx x 3 /6 1 1/6, Thus E[Y ] yf Y (y)dy E[Z] y 2 /2 dy y 3 /6 1 1/6, [ 1/6 1/6 ].

ECE32 Exam 2 Version A April 21, 214 7 (b) Find the vector covariance matrix C Z. The vector covariance of the random vector Z is C Z E[(Z E[Z])(Z E[Z]) T ] [[ ] X E[X] [ ] ] E X E[X] Y E[Y ] Y E[Y ] [[ ]] X E 2 E[X] 2 XY XY Y 2 E[Y ] 2 [ ] E[X 2 ] E[XY ] E[XY ] E[Y 2. ] We need the expected values of the squares: and by symmetry, E[X 2 ] E[Y 2 ] x 2 (x/2)dx x 4 /8 1 1/8, y 2 (y/2)dy y 4 /8 1 1/8, and, as calculated in the next problem, E[XY ] 1/4, so [ ] E[X C Z 2 ] E[X] 2 E[XY ] E[X]E[Y ] E[XY ] E[X]E[Y ] E[Y 2 ] E[Y 2 ] [ ] 1/8 (1/6) 2 1/4 (1/6) 2 1/4 (1/6) 2 1/8 (1/6) 2 [ ] 7/72 2/9. 2/9 7/72

ECE32 Exam 2 Version A April 21, 214 8 6. (1 points) The joint CDF of random variables X and Y is x <, y <, F X,Y (x, y) xy x < 1, y < 1, 1 x > 1, y > 1. (a) Find the joint PDF f X,Y (x, y). On [, 1] [, 1], so f X,Y (x, y) 2 x y F X,Y (x, y) 2 x y xy x x 1 { 1 x 1, y 1, f X,Y (x, y) Because X and Y are continuous, P [(X, Y ) (x, y)] for any specific (x, y) lr 2, it would be valid to define the joint PDF to be one on (, 1) (, 1) or [, 1) (, 1) or [, 1) [, 1) etc. instead. (b) Find E[XY ]. E[XY ] x xdx xyf X,Y (x, y)dydx xydxdy ydydx ydy x 2 /2 1 y2 /2 1 1/4.

ECE32 Exam 2 Version A April 21, 214 9 (c) Find the vector cross-covariance matrix C X,Y. The vector cross-covariance of a pair of random vectors X and Y is C XY E [ (X E [X])(Y E [Y]) ] T. Of course here our random vectors are of length one. Thus the cross covariance is a scalar. In the previous problem we found that E[X] E[Y ] 1/6. Above we found that Thus E[XY ] 1/4. C XY E[(X E[X])(Y E[Y ])] E[XY XE[Y ] E[X]Y + E[X]E[Y ]] E[XY ] 2E[X]E[Y ] + E[X]E[Y ] E[XY ] E[X]E[Y ] 1/4 (1/6) 2 2/9.

ECE32 Exam 2 Version A April 21, 214 1 7. (6 points) Find the moment generating function of the random variable X where 1/3 x, 1/2 x 1, P X (x) 1/6 x 2, φ X (s) E [ e sx] x S X e sx f X (x) e s() /3 + e s(1) /2 + e s(2) /6 1/3 + e s /2 + e 2s /6 8. (6 points) Find the moment generating function of the random variable X where { 1/(b a) a < x < b, f X (x) φ X (s) E [ e sx] b e sx a b a dx e sx b s(b a) esb e sa s(b a). a

ECE32 Exam 2 Version A April 21, 214 11 9. (1 points) Let W X 1 + X 2 + + X n, where n is a constant and the X i are iid Poisson(β) random variables with MGF φ X (s) e β(es 1). (a) Find the moment generating function of W. Because the X i are independent φ W (s) n φ Xi (s). i1 Because they are identically distributed Poisson(β), φ Xi (s) φ X (s) i [n]. Thus φ W (s) (φ X (s)) n e nβ(es 1). (b) Find the PMF of W. The moment generating function of W is that of a Poisson(nβ) random variable so { (nβ) w e nβ w, 1, 2,... P W (s) w!

ECE32 Exam 2 Version A April 21, 214 12 1. (1 points) Let W X 1 + X 2 + + X n, where N is a Bernoulli(p) random variable and the X i are iid Poisson(β) random variables with MGF φ X (s) e β(es 1). Find the moment generating function of W. First we need the moment generating function of N. E[e sn ] n S N e sn P N (n) e s(1) p + e s() (1 p) pe s + 1 p Now the moment generating function of W is The natural log is so φ W (s) φ N (ln φ X (s)). ln e β(es 1) β(e s 1), φ W (s) pe β(es 1) + 1 p p ( e β(es 1) 1 ) + 1

ECE32 Exam 2 Version A April 21, 214 13 11. (1 points) The central limit theorem approximation to the CDF of a random variable W n X 1 + X 2 + + X n that is the sum of n iid random variables X i, each with E[X i ] µ X and Var[X] σ 2 X is (a) What are a, b, and c? ( ) a b F Wn (w) Φ. c The central limit theorem approximation is ( ) w nµ X F Wn (w) Φ.. nσ 2 X (b) What does iid stand for? independent identically distributed Note that order is important. Identically modifies distributed not independent.