Random Variables. ECE 313 Probability with Engineering Applications Lecture 8 Professor Ravi K. Iyer University of Illinois

Similar documents
2. Independence and Bernoulli Trials

Lecture 9. Some Useful Discrete Distributions. Some Useful Discrete Distributions. The observations generated by different experiments have

D KL (P Q) := p i ln p i q i

å 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018

Channel Models with Memory. Channel Models with Memory. Channel Models with Memory. Channel Models with Memory

Random Variables and Probability Distributions

Special Instructions / Useful Data

Application of Generating Functions to the Theory of Success Runs

X ε ) = 0, or equivalently, lim

Chapter 4 Multiple Random Variables

Chapter 5 Properties of a Random Sample

Chapter 5 Properties of a Random Sample

2SLS Estimates ECON In this case, begin with the assumption that E[ i

Probability and Statistics. What is probability? What is statistics?

ρ < 1 be five real numbers. The

Introduction to Probability

IS 709/809: Computational Methods in IS Research. Simple Markovian Queueing Model

Chain Rules for Entropy

CHAPTER 6. d. With success = observation greater than 10, x = # of successes = 4, and

Mu Sequences/Series Solutions National Convention 2014

CHAPTER VI Statistical Analysis of Experimental Data

Entropy, Relative Entropy and Mutual Information

Law of Large Numbers

Random Variate Generation ENM 307 SIMULATION. Anadolu Üniversitesi, Endüstri Mühendisliği Bölümü. Yrd. Doç. Dr. Gürkan ÖZTÜRK.

Lecture Notes Types of economic variables

Set Theory and Probability

Pr[X (p + t)n] e D KL(p+t p)n.

STK3100 and STK4100 Autumn 2017

CS 2750 Machine Learning Lecture 5. Density estimation. Density estimation

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA

Factorization of Finite Abelian Groups

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

ON BIVARIATE GEOMETRIC DISTRIBUTION. K. Jayakumar, D.A. Mundassery 1. INTRODUCTION

Continuous Random Variables: Conditioning, Expectation and Independence

STK4011 and STK9011 Autumn 2016

Parameter, Statistic and Random Samples

Two Fuzzy Probability Measures

Chapter 14 Logistic Regression Models

Functions of Random Variables

MATH 371 Homework assignment 1 August 29, 2013

STK3100 and STK4100 Autumn 2018

7. Joint Distributions

BASIC PRINCIPLES OF STATISTICS

Unit 9. The Tangent Bundle

Lecture 3 Probability review (cont d)

Simulation Output Analysis

Summary of the lecture in Biostatistics

arxiv: v1 [math.st] 24 Oct 2016

Introduction to local (nonparametric) density estimation. methods

On the characteristics of partial differential equations

1 Onto functions and bijections Applications to Counting

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

= lim. (x 1 x 2... x n ) 1 n. = log. x i. = M, n

L Inequalities for Polynomials

Some queue models with different service rates. Július REBO, Žilinská univerzita, DP Prievidza

. The set of these sums. be a partition of [ ab, ]. Consider the sum f( x) f( x 1)

A NEW LOG-NORMAL DISTRIBUTION

Chapter 4 Multiple Random Variables

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best

CS 109 Lecture 12 April 22th, 2016

1. A real number x is represented approximately by , and we are told that the relative error is 0.1 %. What is x? Note: There are two answers.

TESTING FOR SERIAL CORRELATION BY MEANS OF EXTREME VALUES ABSTRACT

Parameter Estimation

Econometric Methods. Review of Estimation

Lecture 3. Sampling, sampling distributions, and parameter estimation

Lecture 3 Naïve Bayes, Maximum Entropy and Text Classification COSI 134

The Mathematical Appendix

Multiple Choice Test. Chapter Adequacy of Models for Regression

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

Complete Convergence and Some Maximal Inequalities for Weighted Sums of Random Variables

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements

Applications of Stochastic Models on Test mis-scaling in Educational and Psychological Measurement

Lebesgue Measure of Generalized Cantor Set

UNIT 2 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS

Comparing Different Estimators of three Parameters for Transmuted Weibull Distribution

Singular Value Decomposition. Linear Algebra (3) Singular Value Decomposition. SVD and Eigenvectors. Solving LEs with SVD

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b

,m = 1,...,n; 2 ; p m (1 p) n m,m = 0,...,n; E[X] = np; n! e λ,n 0; E[X] = λ.

1 Solution to Problem 6.40

Continuous Distributions

Extend the Borel-Cantelli Lemma to Sequences of. Non-Independent Random Variables

JAM 2015: General Instructions during Examination

Point Estimation: definition of estimators

22 Nonparametric Methods.

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Semi-Riemann Metric on. the Tangent Bundle and its Index

Part I: Background on the Binomial Distribution

Q-analogue of a Linear Transformation Preserving Log-concavity

CHAPTER 3 POSTERIOR DISTRIBUTIONS

Mathematics HL and Further mathematics HL Formula booklet

Nonparametric Density Estimation Intro

THE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA MODULE 2

Module 7: Probability and Statistics

Analysis of System Performance IN2072 Chapter 5 Analysis of Non Markov Systems

Beta Exponentiated Mukherjii-Islam Distribution: Mathematical Study of Different Properties

Qualifying Exam Statistical Theory Problem Solutions August 2005

STATISTICAL INFERENCE

A be a probability space. A random vector

Transcription:

Radom Varables ECE 313 Probablty wth Egeerg Alcatos Lecture 8 Professor Rav K. Iyer Uversty of Illos Iyer - Lecture 8 ECE 313 Fall 013

Today s Tocs Revew o Radom Varables Cumulatve Dstrbuto Fucto (CDF Probablty Mass Fucto (PMF Dscrete Radom Varables Beroull Bomal Posso Geometrc Iyer - Lecture 8 ECE 313 Fall 013

Cumulatve Dstrbuto Fucto (CDF Some roertes of cdf are: F(b. lm b + F( b F( 1, lm F( b F( 0.. s a o-decreasg fucto of b,. b F a < b { a} Proerty ( follows sce for the evet s cotaed the evet, ad so t must have a smaller robablty. { b} Proertes ( ad ( follow sce must take o some fte value. All robablty questos about ca be aswered terms of cdf. For examle: F( P { a b} F( b F( a for all a < b.e. calculate b ( F( b P{ a b} by frst comutg the robablty that a ( F( a ad the subtract from ths the robablty that. Iyer - Lecture 8 ECE 313 Fall 013

Dscrete Radom Varables A radom varable that ca take o at most coutable umber of ossble values s sad to be dscrete. For a dscrete radom varable, we defe the robablty mass fucto of by: (a ( a P{ a} (a s ostve for at most a coutable umber of values of a..e., f Sce take values x: must assume oe of the values x1, x,, the ( x ( x > 0, 1,,... 0, for other values of x 1 ( x 1 Iyer - Lecture 8 ECE 313 Fall 013

Cumulatve Dstrbuto Fucto The cumulatve dstrbuto fucto ca be exressed terms of (a by: x Suose has a robablty mass fucto gve by F ( a ( all x a 1 1 1 ( 1, (, (3 3 6 the the cumulatve dstrbuto fucto F of s gve by F( a F 0, 1 a < 1, 1 a < 5, a < 6 3 a 1 3 Iyer - Lecture 8 ECE 313 Fall 013

Dscrete Radom Varables Examles Beroull Bomal Posso Geometrc Iyer - Lecture 8 ECE 313 Fall 013

The Beroull Radom Varable (0 P{ P{ 0} 1 1}, Where, 0 1 s the robablty that the tral s a success s sad to be a Beroull radom varable f ts robablty mass fucto s gve by the above equato some for (0,1 Iyer - Lecture 8 ECE 313 Fall 013

The Bomal Radom Varable deedet trals, each of whch results a success wth ad a falure wth robablty 1- If reresets the umber of successes that occur the trals, s sad to be a bomal radom varable wth arameters (, The robablty mass fucto of a bomal radom varable havg arameters (, s gve by (, Equato (.3 where! (!! equals the umber of dfferet grous of objects that ca be chose from a set of objects Iyer - Lecture 8 ECE 313 Fall 013

The Bomal Radom Varable Equato (.3 may be verfed by frst otg that the robablty of ay artcular sequece of the outcomes cotag successes ad - falures s, by the assumed deedece of trals, Equato (.3 the follows sce there are dfferet sequeces of the outcomes leadg to I successes ad - 3 falures. For stace f 3,, the there are 3 ways whch the three trals ca result two successes. By the bomal theorem, the robabltes sum to oe: 0 ( 0 ( + 1 Iyer - Lecture 8 ECE 313 Fall 013

Bomal Radom Varable Examle 1 Four far cos are fled. Outcomes are assumed deedet, what s the robablty that two heads ad two tals are obtaed? Lettg equal the umber of heads ( successes that aear, the s a bomal radom varable wth arameters ( 4, 1. Hece by the bomal equato, P{ } 4 ( 1 1 ( 3 8 Iyer - Lecture 8 ECE 313 Fall 013

Bomal Radom Varable Examle It s kow that ay tem roduced by a certa mache wll be defectve wth robablty 0.1, deedetly of ay other tem. What s the robablty that a samle of three tems, at most oe wll be defectve? If s the umber of defectve tems the samle, the s a bomal radom varable wth arameters (3, 0.1. Hece, the desred robablty s gve by: P{ 0} + P{ 1} 3 (0.1 0 0 (0.9 3 3 + (0.1 1 1 (0.9 0.97 Iyer - Lecture 8 ECE 313 Fall 013

Bomal RV Examle 3 Suose that a arlae ege wll fal, whe flght, wth robablty 1 deedetly from ege to ege; suose that the arlae wll make a successful flght f at least 50 ercet of ts eges rema oeratve. For what values of s a four-ege lae referable to a two-ege lae? Because each ege s assumed to fal or fucto deedetly of what haes wth the other eges, t follows that the umber of eges remag oeratve s a bomal radom varable. Hece, the robablty that a four-ege lae makes a successful flght s: 4 6 4 3 4 + + 3 4 3 4 + 4 + 4 0 Iyer - Lecture 8 ECE 313 Fall 013

Iyer - Lecture 8 ECE 313 Fall 013 Bomal RV Examle 3 (Cot The corresodg robablty for a two-ege lae s: The four-ege lae s safer f: Or equvaletly f: Hece, the four-ege lae s safer whe the ege success robablty s at least as large as /3, whereas the two-ege lae s safer whe ths robablty falls below /3. 4 3 4 6 + + + 1 + + + + 4 6 3 0 (3 1 ( 0 7 8 3 3 + or 3 0 3 or

Iyer - Lecture 8 ECE 313 Fall 013 The Posso Radom Varable A radom varable, takg o oe of the values 0,1,,, s sad to be a Posso radom varable wth arameter, f for some >0, defes a robablty mass fucto sce 1! ( 0 0 e e e 0,1,...,! } { ( e P

Iyer - Lecture 8 ECE 313 Fall 013 The Posso Radom Varable Cot d A mortat roerty of the Posso radom varable, t may be used to aroxmate a bomal radom varable wth the bomal arameter s large ad s small Now, for large ad small Hece for large ad small P / /! 1 ( 1 ( 1!! (!!! (! } { +! } { e P 1 1-1, 1 ( 1 (, - 1 + e

Cotuous Radom Varables Radom varables whose ossble varables whose set of ossble values s ucoutable s a cotuous radom varable f there exsts a oegatve fucto f(x defed for all real, havg the roerty that for ay set of B real umbers f(x s called the robablty desty fucto of the radom varable The robablty that wll be B may be obtaed by tegratg the robablty desty fucto over the set B. Sce must assume some value, f(x must satsfy 1 P { (, } f ( x dx Iyer - Lecture 8 ECE 313 Fall 013

Cotuous Radom Varables Cot d All robablty statemets about ca be aswered terms of f(x b e.g. lettg B[a,b], we obta P { a b} f ( x dx a If we let ab the recedg, the P{ a} f ( x dx 0 a a Ths equato states that the robablty that a cotuous radom varable wll assume ay artcular value s zero The relatosh betwee the cumulatve dstrbuto F( ad the robablty desty f( a F ( a P{ (, a} f ( x dx Dfferetatg both sdes of the recedg yelds d da F( a f ( a Iyer - Lecture 8 ECE 313 Fall 013

Cotuous Radom Varables Cot d That s, the desty of the dervatve of the cumulatve dstrbuto fucto. A somewhat more tutve terretato of the desty fucto whe ε s small ε P a ε a + a + ε / aε / f ( x dx εf ( a The robablty that wll be cotaed a terval of legth ε aroud the ot a s aroxmately εf(a Iyer - Lecture 8 ECE 313 Fall 013