Probability and Stochastic Processes: A Friendly Introduction for Electrical and Computer Engineers Roy D. Yates and David J.

Similar documents
Probability and Stochastic Processes

PROBABILITY AND STOCHASTIC PROCESSES A Friendly Introduction for Electrical and Computer Engineers

A Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.

UC Berkeley Department of Electrical Engineering and Computer Science. EE 126: Probablity and Random Processes. Problem Set 4: Solutions Fall 2007

Contents 1. Contents

Probability Theory and Statistics (EE/TE 3341) Homework 3 Solutions

HW Solution 12 Due: Dec 2, 9:19 AM

This exam contains 6 questions. The questions are of equal weight. Print your name at the top of this page in the upper right hand corner.

ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables

Problem Y is an exponential random variable with parameter λ = 0.2. Given the event A = {Y < 2},

Three hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER.

Quick review on Discrete Random Variables

Topic 3 - Discrete distributions

ECE353: Probability and Random Processes. Lecture 5 - Cumulative Distribution Function and Expectation

Closed book and notes. 120 minutes. Cover page, five pages of exam. No calculators.

b. ( ) ( ) ( ) ( ) ( ) 5. Independence: Two events (A & B) are independent if one of the conditions listed below is satisfied; ( ) ( ) ( )

Chapter 6 Expectation and Conditional Expectation. Lectures Definition 6.1. Two random variables defined on a probability space are said to be

Problem Solutions Chapter 4

Chapter 4 Multiple Random Variables

Discrete Random Variables

Mathematical Statistics 1 Math A 6330

Learning Objectives for Stat 225

TUTORIAL 8 SOLUTIONS #

Lecture 3. Discrete Random Variables

Course 1 Solutions November 2001 Exams

FINAL EXAM: 3:30-5:30pm

Massachusetts Institute of Technology

Topic 3: The Expectation of a Random Variable

Distributions of Functions of Random Variables. 5.1 Functions of One Random Variable

STAT509: Discrete Random Variable

Math 407: Probability Theory 5/10/ Final exam (11am - 1pm)

MATH 3670 First Midterm February 17, No books or notes. No cellphone or wireless devices. Write clearly and show your work for every answer.

Basics on Probability. Jingrui He 09/11/2007

MTH 202 : Probability and Statistics

Introduction to Probability Theory for Graduate Economics Fall 2008

1 Review of Probability

FINAL EXAM PLEASE SHOW ALL WORK!

2.3 Analysis of Categorical Data

Chapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory

STAT 302 Introduction to Probability Learning Outcomes. Textbook: A First Course in Probability by Sheldon Ross, 8 th ed.

Computer Science, Informatik 4 Communication and Distributed Systems. Simulation. Discrete-Event System Simulation. Dr.

Statistics 224 Solution key to EXAM 2 FALL 2007 Friday 11/2/07 Professor Michael Iltis (Lecture 2)

Massachusetts Institute of Technology

Chapter 5 Joint Probability Distributions

STAT 418: Probability and Stochastic Processes

STAT/MATH 395 A - PROBABILITY II UW Winter Quarter Moment functions. x r p X (x) (1) E[X r ] = x r f X (x) dx (2) (x E[X]) r p X (x) (3)

Northwestern University Department of Electrical Engineering and Computer Science

Discrete Random Variable

ACM 116: Lectures 3 4

Jointly Distributed Random Variables

Chapter 3 Common Families of Distributions

Fault-Tolerant Computer System Design ECE 60872/CS 590. Topic 2: Discrete Distributions

Random Variables Example:

Suppose that you have three coins. Coin A is fair, coin B shows heads with probability 0.6 and coin C shows heads with probability 0.8.

Chapter 3. Discrete Random Variables and Their Probability Distributions

*** Sorry...no solutions will be posted*** University of Toronto at Scarborough Department of Computer and Mathematical Sciences

Review for the previous lecture

Special Discrete RV s. Then X = the number of successes is a binomial RV. X ~ Bin(n,p).

3 Conditional Expectation

Outline PMF, CDF and PDF Mean, Variance and Percentiles Some Common Distributions. Week 5 Random Variables and Their Distributions

STAT/MATH 395 PROBABILITY II

ELEG 3143 Probability & Stochastic Process Ch. 4 Multiple Random Variables

Chapter 5 Class Notes

MAS113 Introduction to Probability and Statistics. Proofs of theorems

Lecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable

Practice Problems Section Problems

Lecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable

Probability Distributions Columns (a) through (d)

3 Multiple Discrete Random Variables

MA6451 PROBABILITY AND RANDOM PROCESSES

Closed book and notes. 60 minutes. Cover page and four pages of exam. No calculators.

IEOR 3106: Introduction to Operations Research: Stochastic Models. Professor Whitt. SOLUTIONS to Homework Assignment 2

STAT 3610: Review of Probability Distributions

1 Joint and marginal distributions

STAT 414: Introduction to Probability Theory

FINAL EXAM: Monday 8-10am

Chapter 3: Discrete Random Variable

Midterm Exam 1 Solution

Random Processes. DS GA 1002 Probability and Statistics for Data Science.

Probability and Stochastic Processes: A Friendly Introduction for Electrical and Computer Engineers Roy D. Yates and David J.

Chapter 4 Multiple Random Variables

Chapter 2: Random Variables

Math 151. Rumbos Fall Solutions to Review Problems for Exam 2. Pr(X = 1) = ) = Pr(X = 2) = Pr(X = 3) = p X. (k) =

Two hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER.

3.4. The Binomial Probability Distribution

Lecture 4: Sampling, Tail Inequalities

Things to remember when learning probability distributions:

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

Topic 3: The Expectation of a Random Variable

LINEAR PROGRAMMING: A GEOMETRIC APPROACH. Copyright Cengage Learning. All rights reserved.

EE 345 MIDTERM 2 Fall 2018 (Time: 1 hour 15 minutes) Total of 100 points

MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems

Probability Review. Gonzalo Mateos

STAT2201. Analysis of Engineering & Scientific Data. Unit 3

DO NOT OPEN THIS QUESTION BOOKLET UNTIL YOU ARE TOLD TO DO SO

Chapters 3.2 Discrete distributions

Notes for Math 324, Part 19

Analysis of Engineering and Scientific Data. Semester

Exam 3, Math Fall 2016 October 19, 2016

Transcription:

Probability and Stochastic Processes: A Friendly Introduction for Electrical and Computer Engineers Roy D. Yates and David J. Goodman Problem Solutions : Yates and Goodman,.6.3.7.7.8..9.6 3.. 3.. and 3.. Problem.6.3 Problem..3, the PMF of X is (a) The PMF of W X satisfies P X x 0 x 3 0 x 5 0 x 7 P W w P X w P X w This implies P W 7 P X 7 0 P W 5 P X 5 0 P W 3 P X 3 0 The complete PMF for W is P W w 0 w 7 0 w 5 0 w 3 (b) From the PMF, the CDF of W is F W w 0 w 7 0 7 w 5 0 6 5 w 3 w 3 (c) From the PMF, W has expected value E W wp W w 7 0 5 0 3 0 w Problem.7.7 Let W denote the event that a circuit works. The circuit works and generates revenue of k dollars if all of its 0 constituent devices work. For each implementation, standard or ultra-reliable, let R denote the profit on a device. We can express the expected profit as E R P W E RW P W c E RW c

Let s first consider the case when only standard devices are used. In this case, a circuit works with probability P W q 0. The profit made on a working device is k 0 dollars while a nonworking circuit has a profit of -0 dollars. That is, E RW k 0 and E RW c 0. Of course, a negative profit is actually a loss. Using R s to denote the profit using standard circuits, the expected profit is 0 0 E R s q k 0 q 0 0 9 0 k 0 And for the ultra-reliable case, the circuit works with probability P W q 0. The profit per working circuit is E RW k 30 dollars while the profit for a nonworking circuit is E RW c 30 dollars. The expected profit is 0 0 E R u q k 30 q 30 0 95 0 k 30 Now we wish to determine which implementation will generate the most profit. Realizing that both profit functions are linear functions of k, we can plot them versus k and find for which values of k each plan is preferable. The two lines intersect at a value of k 80 dollars. So for values of k $80 using all standard devices results in greater revenue, and for values of k $80 more revenue will be generated by implementing all ultra-reliable devices. So we can see that when the price commanded for each working circuit is sufficiently high it is worthwhile to spend the extra money to ensure that more working circuits can be produced. Problem.8. The PMF of K is the Poisson PMF The mean of K is P K E K k k# 0 To find E K, we use the hint and first find E K K $ By factoring out and substituting j k e k! k 0!!" " " k k e k! E K K $ k k k# 0 k# k e k! k, we obtain j e j# 0 j! k e k! k# k e k! The above sum equals because it is the sum of a Poisson PMF over all possible values. Since E K, the variance of K is Var K E K E K % E K K $ E K & E K %

- Problem.9.6 (a) Consider each circuit test as a binomial trial such that a failed circuit is called a success. The number of trias until the first success (i.e. a failed circuit) has the geometric PMF P N n (b) The probability there are at least 0 tests is P B P N 0 p n p n!!" " " 9 P N n p n# 0 Note that p 9 is just the probability that the first 9 circuits pass the test, which is what we would expect since there must be at least 0 tests if the first 9 circuits pass. The conditional PMF of N given B is P N' B n P N( n) P* B+ n, B p n 0 p n 0!!" " " (c) Given the event B the conditional expectation of N is Making the substitution j E N B E N B np N' B n n n 9 yields j# n n# 0 p n 0 p j 9 p j p p 9 We see that in the above sum, we effectively have the expected value of J 9 where J is geometric random variable with parameter p. This is not surprising since the N 0 iff we observed 9 successful tests. After 9 successful tests, the number of additional tests needed to find the first failure is still a geometric random variable with mean p. Problem 3.. In this problem, it is helpful to label points with nonzero probability on the X! Y plane: y. P X/ Y x! y 3 0 3c 0 6c 0 c 0 0 c 0 c 0 c 0 3 x 3

- (a) We must choose c so the PMF sums to one: P X/ Y x! y c x y c 3 3 3 $ c x# / / y# / 3 x# / / y# / 3 Thus c. (b) The event Y X has probability P Y X P X/ Y x# / / y3 x x! y 0 3 8 (c) The event Y X has probability P Y X P X/ Y x# / / y x 3 3 0 9 (d) There are two ways to solve this part. The direct way is to calculate P Y X P X/ Y x# / / y# x 0 The indirect way is to use the previous results and the observation that P Y X 5 P Y X & P Y X 8 9 6 (e) P Y 3 P X/ Y x# / / x! 3 3 3 3 3 Problem 3.. On the X! Y plane, the joint PMF P X/ Y x! y is y. P X/ Y x! y 3 03c 06c c 0 0c 0c 0c 0 0 3 x By choosing c, the PMF sums to one.

. ; (a) The marginal PMFs of X and Y are P X x P X/ Y y# / 3 P Y y P X/ Y x# / / x 8 x 6 x 7 y y 3 (b) The expected values of X and Y are E X E Y xp X x 8 6 7 3 x# / / yp Y y 7 3 5 y# / 3 (c) The second moments are The variances are E X xp X x 8 6 6 73 7 x# / / E Y yp Y y 7 3 6 7 y# / 3 Var X E X E X 8 0 7 Var Y E Y E Y 9 3 The standard deviations are σ X 0 7 and σ Y 3. Problem 3.. On the X! Y plane, the joint PMF is P X/ Y x! y 0 c 0 c y : - 0 3c 0 c 0 c 0 3c 0 c 0 c x The PMF sums to one when c. 5

(a) The marginal PMFs of X and Y are P X x P X/ Y y# / 0/ P Y y P X/ Y x# / 0/ (b) The expected values of X and Y are x! y 6 x! x 0 5 y! y 0 E X E Y xp X x 6 6 0 x# / 0/ yp Y y 5 5 0 y# / 0/ (c) Since X and Y both have zero mean, the variances are Var X E X x P X x 6 6 7 x# / 0/ Var Y E Y y P Y y 5 5 < 5 7 y# / 0/ The standard deviations are σ X 7 and σ Y 5 7. 6