On Extreme Bernoulli and Dependent Families of Bivariate Distributions
|
|
- Ada Barrett
- 5 years ago
- Views:
Transcription
1 Int J Contemp Math Sci, Vol 3, 2008, no 23, On Extreme Bernoulli and Dependent Families of Bivariate Distributions Broderick O Oluyede Department of Mathematical Sciences Georgia Southern University, Statesboro, GA 30460, USA Boluyede@GeorgiaSouthernedu Mavis Pararai Department of Mathematics Indiana University of Pennsylvania Indiana, PA 15705, USA Abstract The obective and purpose of this note is to generate bivariate distributions via extreme Bernoulli distributions and obtain results on positively and negatively dependent families of bivariate binomial distributions generated by extreme Bernoulli distributions Some distributional properties and results are presented The factorial moment generating functions, correlation functions, conditional distributions and the regression functions are given Mathematics Subect Classifications: 60E05; 60F99 Keywords: Extreme Bernoulli distributions; Conditional distributions; Bivariate binomial distributions 1 Introduction Bernoulli distribution is an important distribution that arises in many applications in probability and statistics There are several distributions and models that take into account the concept of dependence in the parameters for certain classes of distributions Lancaster 1958), Hamdan and Jensen 1976), Takeuchi and Takemura 1987) obtained expressions for association correlation) functions in the form of series bilinear in suitable orthogonal polynomials
2 1104 B O Oluyede and M Pararai Oluyede 1994) studied a family of bivariate binomial distributions generated by extreme Bernoulli distributions, see also references therein, including results by Marshall and Olkin 1985) on bivariate distributions generated by the Bernoulli distribution Hamdan 1972) provided applications of canonical expansion of the bivariate binomial distribution In this paper, we present new probability distributions generated by extreme Bernoulli distributions and discuss the properties of these distributions including the factorial moment generating functions, correlation functions, conditional distributions and the regression functions In section 2, some basic results leading to the generated distributions are presented In section 3, distributional results including their properties and some comparisons are presented Section 4 offers useful results on families of positive and negative dependent distributions including some comparisons In Section 5, a brief discussion and concluding remarks are given 2 Extreme Bernoulli Distributions and Some Basic Results Let P p i ) and Q q i )ber c probability matrices with r r p i q i i1 i1 c c for 1, 2,,c, p i q i for i 1, 2,, r 1 1 Then P maorizes Q, denoted by P > m Q if k h1 p h) k h1 q h), k 1, 2,,rc 1, where p h) and q h), h 1, 2,,k, are elements of P and Q respectively, arranged in a nondecreasing order Now let p 11, p 10, p 01 and p 00 be the probabilities of classification of individuals into one of four mutually exclusive classes AB, AB, AB, AB A and B denotes negation) An example will be to classify patients as diseased or healthy using standard diagnostic as opposed to surgical procedures The number of occurrences of A and B, denoted by X and Y are random variables having the binomial distributions with parameters n, p 1+ ) and n, ) respectively, where p 1+ p 11 + p 10 and p 11 + p 01 The oint probability function of X and Y is given by Aitken and Gonin 1935) The distribution is given by P X x, Y y) n! s s!x s)!y s)!n x y + s! ps 11 px s 10 py s 01 p n x y+s 00, 1) for x, y 0, 1, 2,, n When sampling without replacement from a finite population, a bivariate hypergeometric distribution is obtained leading to a bivariate binomial distribution in the limit
3 Extreme Bernoulli distributions 1105 The extreme Bernoulli distributions can be displayed as follows [ ] p E if p p 1+ 1 p 1+ ; +1 [ ] 0 p1+ E 2 if p 1 p 1+ p ; [ ] p+1 p E 3 1+ if p 0 1 p 1+ ; 1+ and [ ] p1+ + p E if 1 1 p p 1+ 2) The extreme Bernoulli distributions E k, k 1, 2, 3, 4 can be obtained as follows Let p i ), i 0, 1 0, 1, be a probability matrix with p 1+ p 11 +p 10, p 11 + p 01 If p 1+, then p 1+, 0) > m p 11,p 10 ) and p 1+, 1 ) > m p 01,p 00 ) Similarly, if p 1+, then,p 1+ ) > m p 11,p 10 ) and 1 p 1+, 0) > m p 01,p 00 ) The results now follows from the fact that max0,p 1+ + p 1+ 1) p 11 minp 1+, ) The bivariate distributions generated to E k, k 1, 2, 3, 4 are as follows Suppose n independent drawings are made from these populations and let X i, i, 0, 1 be the number of occurrences of event whose cell probabilities are given by E k, k 1, 2, 3, 4 For E 1, P E1 X 11 n 1,X 10 n 2,X 01 n 3 ) n!pn 1 1+ p 1+ ) n 3 1 ) n n 1+n 3 ), n 1!n 3!n n 1 + n 3 ))! 3) where n i 0, i 1,2,3,andn 1 + n 2 + n 3 n With X X 11 + X 10 and Y X 11 + X 01, the oint distribution of X and Y is given by n!p x 1+ p 1+ ) y x 1 ) n y, n y x 0 P E1 X x, Y y) x!y x)!n y)! 4) 0, otherwise For E 2, n!p x 1+ py +1 1 p 1+ ) n x y 0 x, y n, P E2 X x, Y y) x!y!n x y)! x + y n 0, otherwise For E 3, n!p y +1 p 1+ ) x y 1 p 1+ ) n x, n x y 0 P E3 X x, Y y) x!x y)!n x)! 0 otherwise 5) 6)
4 1106 B O Oluyede and M Pararai For E 4, n!p ) x 1 p 1+ ) n y 1 ) n x 0 x, y n, P E4 X x, Y y) x!n y)!n x)! x + y n 0, otherwise 7) We now examine obtain the regression functions EY X x) and EX Y y) for the distributions given in 1) and those generated by E 1 and E 2 respectively The regression functions for the distributions generated by E 3 and E 4 can be obtained similarly obtained For the distribution given by 1), after some simplification, the conditional distribution of X given Y y is P X Y y) minx,y) max0,x+y n) n y x ) y ) ) ) y ) x ) n x y+ p11 p01 p10 p00 8) This is the distribution of the sum of two random variables One distributed as binomial with parameters y and p 11, and the other as binomial with parameters n y and p 10 The regression function is given by EX Y y) n ) p10 + y p11 p ) 10 9) For the bivariate distribution generated by E 1, the regression function is EX Y y) y p 1+ ) and for E2, the corresponding regression function is given by EY X x) n x) p+1 1 p 1+ 3 Some Distributions and Properties ) 10) In this section, we examine some distributions and their properties including those generated by αi +1 α)e i,i1,2,3,4,0 α 1, where I is the fourfold independence table with entries p hk p h+ p +k,h,k0, 1 First, consider the convex combination of P E1 x, y) and P E2 x, y) The corresponding distribution P E x, y) has the covariance function CovX, Y )np 1+ α ) The regression function is given by EY X x) n α ) + xαp 1+ ) 11) 1 p 1+ 1 p 1+ Now consider the family generated by a linear combination of the independence model I and E i, i 1, 2, 3, 4 Here, we consider the family generated
5 Extreme Bernoulli distributions 1107 by A i 1 α)i + α)e i, 0 α 1, i 1, 2, 3, 4 Suppose n independent drawings are made from the population A 1 1 α)i + αe 1, and let X hk, h, k 0, 1, be the number of occurrences of the event whose cell probabilities are given by A 1 Then, the oint distribution of X and Y is given by P A1 X x, Y Y ) minx,y) max0,x+y n) n! [1 α)p 1+ + αp 1+ ] [αp 1+ ] x!x )! [1 α)p 0+ + α p 1+ )] y [1 α) p 0+ + α1 )] n x y+ y )!n x y + )! x, y 0, 1, 2,, n, 0 α 1, p 1+ 12) The conditional distribution of X given Y y is given by P A1 X x Y y) minx,y) max0,x+y n) y ) n y x ) 1 α)p1+ + αp 1+ ) ) y 1 α)p0+ + α p 1+ ) αp1+ ) n x y+ 1 α)p0+ + α1 p 1+ ) ) x This is the distribution of the sum of two random variables One distributed as binomial ) y, 1 α)p 1+ +αp 1+ and the other as binomial n y, αp1+ ) The regression function is EX Y y) nαp 1+ + y 1 α)p 1+ + αp 1+ αp 1+ 13) Also, the variance of X given Y y is given by VarX Y y) n y) αp 1+ + y 1 α)p 1+ + αp 1+ αp 1+ 14) For the extreme Bernoulli distribution generated by A 2 1 α)i + αe 2, suppose n independent drawings are made from this population and let X hk, h, k 0, 1, be the number of occurrences of the event whose cell probabilities are given by A 2 Then the oint distribution of X and Y is given by
6 1108 B O Oluyede and M Pararai P A2 X x, Y Y ) minx,y) max0,x+y n) n! [1 α)p 1+ ] [1 α)p 1+ + αp 1+ ] x!x )!y )!n x y + )! [1 α)p 0+ + α ] y [1 α) p 0+ + α1 )] n x y+ x, y 0, 1, 2,, n, 0 α 1 15) The corresponding conditional distribution of X given Y y is given by P A2 X x Y y) minx,y) max0,x+y n) y ) n y x ) 1 α)p1+ ) ) y 1 α)p0+ + α αp1+ +1 α)p 1+ ) n x y+ 1 α)p0+ + α1 p 1+ ) The regression function reduces to EX Y y) n [ 1 α)p 1+ + αp 1+ The factorial moment generating function is given by ] ) x y αp 1+ 16) Mt 1,t 2 ) [1 α)p 0+ + α1 p 1+ ) + 1 α)p 1+ + αp 1+ )t 1 from which the correlation +1 α)p 0+ + α )t 2 +1 α)p 1+ t 1 t 2 ] n, CorrX, Y ) α ) 1/2 p1+ p 0+ Proposition For the bivariate binomial distribution generated by A 2 1 α)i + E 2, α CorrX, Y ) 0, if p )
7 Extreme Bernoulli distributions Positive and Negative Dependent Families of Distributions In this section, we present positive and negative dependent families of bivariate binomial distributions generated by the extreme Bernoulli distributions discussed in section 2 For the distributions generated by {Γ :p 11 p 1+ }, we have, P 2 X x, Y Y ) minx,y) max0,x+y n) n! [1 α)p 1+ + αp 1+ ] [αp 1+ ] x!x )!y )!n x y + )! [1 α) p 1+ )+α ] y [α p α)1 )] n x y+ x, y 0, 1, 2,, n, p 1+, 0 α 1 18) The corresponding conditional distribution of X given Y y is given by P 2 X x Y y) minx,y) max0,x+y n) y ) n y x ) 1 α)p1+ + αp 1+ ) y 1 α)p+1 )+αp 0+ αp1+ The regression function is given by ) n x y+ 1 α)p0+ + α1 ) ) x EX Y y) nαp 1+ + y αp α)p 1+ αp 1+ 19) The factorial moment generating function is Mt 1,t 2 )[αp α)1 )+αp 1+ t 1 +αp α) p 1+ ))t 2 +αp α) )t 1 t 2 ] n The correlation CorrX, Y ) is given by ) 1/2 p1+ CorrX, Y )1 α) 0 p 0+ Proposition For the bivariate binomial distribution generated by A 2 1 α)i + E 2, 0 CorrX, Y ) 1 α), if p ) )
8 1110 B O Oluyede and M Pararai The bivariate binomial distributions generated by {Δ :p 11 p 1+ }, is P 3 X x, Y Y ) minx,y) max0,x+y n) n![αp 1+ ] [αp α)p 1+ ] x!x )!y )!n x y + )! [1 α) + αp 0+ ] y [α p α)1 p 1+ )] n x y+ x, y 0, 1, 2,, n, p 1+, 0 α 1 21) The corresponding conditional distribution of X given Y y is given by P 3 X x Y y) minx,y) max0,x+y n) y ) n y x ) ) αp1+ ) y 1 α)p+1 + αp 0+ αp1+ +1 α)p 1+ αp0+ +1 α)1 p 1+ ) The regression function is given by ) n x y+ ) x EX Y y) n αp α)p 1+ + y αp α)p 1+ + αp 0+ 22) Proposition For the bivariate binomial distribution generated by A 2 1 α)i + E 2, CorrX, Y ) 1 α) ) 1/2 p ) p 0+ Let P C X x, Y y) be the bivariate binomial distribution generated by αe 1 +1 α)e 2, 0 α 1 If y<xand x + y n, then the oint probability function is given by P αe1 +1 α)e 2 X x, Y y) P C X x, Y y) n x ) p x1+1 p 1+ ) n x minx,y) max0,x+y n) n x y ) x ) ) αp1+ 1 αp ) x ) y 1+ p+1 αp 1+ 1 p ) n x y+ +1 αp 1+, p 1+ p 0+ p 0+ x, y 0, 1, 2,, n, 0 α 1 24) p 1+
9 Extreme Bernoulli distributions 1111 The following result provides a lower bound for the oint cumulative distribution function P C X x, Y y) in terms of the bivariate binomial distributions generated by E 1 and E 2 respectively Theorem For y x and p 1+, P C X x, Y y) P E1 X x, Y y)p E2 X x, Y y) provided α Proof: For y x, and p 1+, P C X x, Y y) P E1 X x, Y y)p E2 X x, Y y)k x, y) where { n n k0 h0 } τ n k, h) φ k x, p 1+ )φ h y, ), k!h! 0 if k h αp 1+ p 1+ ) τ n k, h) ) k, if k h, n k [ K y x)!x! n x y)!y! 1 p 1+ ) n x ][ ] n x y 1 x, y), y! n x)! p 1+ ) y x p x 1+ 1 p 1+ and φ k x, p 1+ ) is the kth Krawchouk polynomial Note that { [ ] n y x)!x! n x y)!y! 1 p 1+ lim n K x, y) n lim y! n x)! 1 p 1+ [ ] x [ ] y } p+1 p 1+ )1 p 1+ ) 1 p1+ 1, p 1+ 1 p 1+ ) p 1+ so that P C X x, Y y) P E1 x, y)p E2 x, y) { n } n τ n k, h) φ k x, p 1+ )φ h y, ) k!h! k0 h0 Consequently, for α, P C X x, Y y) P E1 X x, Y y)p E2 X x, Y y) Corollary Fory x, p 1+, and α, P C X x, Y y) P E1 X x, Y y)p E2 X x, Y y)
10 1112 B O Oluyede and M Pararai 5 Concluding Remarks Several bivariate binomial distributions generated by extreme Bernoulli distributions are derived Important properties of these distributions including factorial moment generating functions and the regression functions are presented Families of positive and negative dependent bivariate binomial distributions generated by the extreme Bernoulli distributions as well as their properties are presented The representations of convex combinations of these extreme distributions are given in terms of Krawchouk polynomials Some comparisons and dependence of the random variables X and Y are explored Also, bounds on certain oint probabilities are given ACKNOWLEDGEMENT: The authors expresses their gratitude to the editor and referee for many useful comments and suggestions References [1] A C Aitken, and H T Gonin, On fourfold sampling with and without replacement, Proceedings of Royal Society of Edinburg, 55, 1935), [2] M A Hamdan, Canonical expansion of the bivariate binomial distribution with unequal marginal index, International Statistical Review, 40, 1972), [3] M A Hamdan, and D R Jensen, A bivariate binomial distribution with some applications, Australian Journal of Statistics, 18, 1976), [4] H O Lancaster, The structure of bivariate distributions, Annals of Mathematical Statistics, 29, 1958), [5] A W Marshall, and I Olkin, A family of bivariate distributions generated by Bernoulli distribution, Journal of the American Statistical Association, 80, 1985), [6] B O Oluyede, A family of bivariate binomial distributions generated by extreme Bernoulli distributions, Communications in Statistics, 235), 1994), [7] K Takeuchi, and A Takemura, On sum of 0-1 random variables multivariate) Annals of the Institute of Statistical Mathematics, 39, 1987), Received: December 10, 2007
Copyright c 2006 Jason Underdown Some rights reserved. choose notation. n distinct items divided into r distinct groups.
Copyright & License Copyright c 2006 Jason Underdown Some rights reserved. choose notation binomial theorem n distinct items divided into r distinct groups Axioms Proposition axioms of probability probability
More informationPart IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationWrite your Registration Number, Test Centre, Test Code and the Number of this booklet in the appropriate places on the answersheet.
2016 Booklet No. Test Code : PSA Forenoon Questions : 30 Time : 2 hours Write your Registration Number, Test Centre, Test Code and the Number of this booklet in the appropriate places on the answersheet.
More information2 (Statistics) Random variables
2 (Statistics) Random variables References: DeGroot and Schervish, chapters 3, 4 and 5; Stirzaker, chapters 4, 5 and 6 We will now study the main tools use for modeling experiments with unknown outcomes
More informationSTA2603/205/1/2014 /2014. ry II. Tutorial letter 205/1/
STA263/25//24 Tutorial letter 25// /24 Distribution Theor ry II STA263 Semester Department of Statistics CONTENTS: Examination preparation tutorial letterr Solutions to Assignment 6 2 Dear Student, This
More informationNotes 12 Autumn 2005
MAS 08 Probability I Notes Autumn 005 Conditional random variables Remember that the conditional probability of event A given event B is P(A B) P(A B)/P(B). Suppose that X is a discrete random variable.
More informationMATH c UNIVERSITY OF LEEDS Examination for the Module MATH2715 (January 2015) STATISTICAL METHODS. Time allowed: 2 hours
MATH2750 This question paper consists of 8 printed pages, each of which is identified by the reference MATH275. All calculators must carry an approval sticker issued by the School of Mathematics. c UNIVERSITY
More informationEE4601 Communication Systems
EE4601 Communication Systems Week 2 Review of Probability, Important Distributions 0 c 2011, Georgia Institute of Technology (lect2 1) Conditional Probability Consider a sample space that consists of two
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationPart IA Probability. Theorems. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Theorems Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More information4. Distributions of Functions of Random Variables
4. Distributions of Functions of Random Variables Setup: Consider as given the joint distribution of X 1,..., X n (i.e. consider as given f X1,...,X n and F X1,...,X n ) Consider k functions g 1 : R n
More informationLecture 11. Probability Theory: an Overveiw
Math 408 - Mathematical Statistics Lecture 11. Probability Theory: an Overveiw February 11, 2013 Konstantin Zuev (USC) Math 408, Lecture 11 February 11, 2013 1 / 24 The starting point in developing the
More informationFormulas for probability theory and linear models SF2941
Formulas for probability theory and linear models SF2941 These pages + Appendix 2 of Gut) are permitted as assistance at the exam. 11 maj 2008 Selected formulae of probability Bivariate probability Transforms
More informationMath 3215 Intro. Probability & Statistics Summer 14. Homework 5: Due 7/3/14
Math 325 Intro. Probability & Statistics Summer Homework 5: Due 7/3/. Let X and Y be continuous random variables with joint/marginal p.d.f. s f(x, y) 2, x y, f (x) 2( x), x, f 2 (y) 2y, y. Find the conditional
More informationMarshall-Olkin Bivariate Exponential Distribution: Generalisations and Applications
CHAPTER 6 Marshall-Olkin Bivariate Exponential Distribution: Generalisations and Applications 6.1 Introduction Exponential distributions have been introduced as a simple model for statistical analysis
More informationTheoretical Properties of Weighted Generalized. Rayleigh and Related Distributions
Theoretical Mathematics & Applications, vol.2, no.2, 22, 45-62 ISSN: 792-9687 (print, 792-979 (online International Scientific Press, 22 Theoretical Properties of Weighted Generalized Rayleigh and Related
More informationChapter 7. Basic Probability Theory
Chapter 7. Basic Probability Theory I-Liang Chern October 20, 2016 1 / 49 What s kind of matrices satisfying RIP Random matrices with iid Gaussian entries iid Bernoulli entries (+/ 1) iid subgaussian entries
More informationCS 591, Lecture 2 Data Analytics: Theory and Applications Boston University
CS 591, Lecture 2 Data Analytics: Theory and Applications Boston University Charalampos E. Tsourakakis January 25rd, 2017 Probability Theory The theory of probability is a system for making better guesses.
More informationAsymptotic Statistics-III. Changliang Zou
Asymptotic Statistics-III Changliang Zou The multivariate central limit theorem Theorem (Multivariate CLT for iid case) Let X i be iid random p-vectors with mean µ and and covariance matrix Σ. Then n (
More informationBivariate distributions
Bivariate distributions 3 th October 017 lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.) Bivariate Distributions of the Discrete Type The Correlation Coefficient
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationEconomics 573 Problem Set 5 Fall 2002 Due: 4 October b. The sample mean converges in probability to the population mean.
Economics 573 Problem Set 5 Fall 00 Due: 4 October 00 1. In random sampling from any population with E(X) = and Var(X) =, show (using Chebyshev's inequality) that sample mean converges in probability to..
More information18 Bivariate normal distribution I
8 Bivariate normal distribution I 8 Example Imagine firing arrows at a target Hopefully they will fall close to the target centre As we fire more arrows we find a high density near the centre and fewer
More informationStatistics for Economists Lectures 6 & 7. Asrat Temesgen Stockholm University
Statistics for Economists Lectures 6 & 7 Asrat Temesgen Stockholm University 1 Chapter 4- Bivariate Distributions 41 Distributions of two random variables Definition 41-1: Let X and Y be two random variables
More informationTAMS39 Lecture 2 Multivariate normal distribution
TAMS39 Lecture 2 Multivariate normal distribution Martin Singull Department of Mathematics Mathematical Statistics Linköping University, Sweden Content Lecture Random vectors Multivariate normal distribution
More informationMathematical Statistics 1 Math A 6330
Mathematical Statistics 1 Math A 6330 Chapter 3 Common Families of Distributions Mohamed I. Riffi Department of Mathematics Islamic University of Gaza September 28, 2015 Outline 1 Subjects of Lecture 04
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationExam 1 - Math Solutions
Exam 1 - Math 3200 - Solutions Spring 2013 1. Without actually expanding, find the coefficient of x y 2 z 3 in the expansion of (2x y z) 6. (A) 120 (B) 60 (C) 30 (D) 20 (E) 10 (F) 10 (G) 20 (H) 30 (I)
More informationFinal Exam # 3. Sta 230: Probability. December 16, 2012
Final Exam # 3 Sta 230: Probability December 16, 2012 This is a closed-book exam so do not refer to your notes, the text, or any other books (please put them on the floor). You may use the extra sheets
More informationUniversity of Illinois ECE 313: Final Exam Fall 2014
University of Illinois ECE 313: Final Exam Fall 2014 Monday, December 15, 2014, 7:00 p.m. 10:00 p.m. Sect. B, names A-O, 1013 ECE, names P-Z, 1015 ECE; Section C, names A-L, 1015 ECE; all others 112 Gregory
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationMultivariate probability distributions and linear regression
Multivariate probability distributions and linear regression Patrik Hoyer 1 Contents: Random variable, probability distribution Joint distribution Marginal distribution Conditional distribution Independence,
More informationMAS113 Introduction to Probability and Statistics. Proofs of theorems
MAS113 Introduction to Probability and Statistics Proofs of theorems Theorem 1 De Morgan s Laws) See MAS110 Theorem 2 M1 By definition, B and A \ B are disjoint, and their union is A So, because m is a
More informationUNIT-2: MULTIPLE RANDOM VARIABLES & OPERATIONS
UNIT-2: MULTIPLE RANDOM VARIABLES & OPERATIONS In many practical situations, multiple random variables are required for analysis than a single random variable. The analysis of two random variables especially
More informationMachine learning - HT Maximum Likelihood
Machine learning - HT 2016 3. Maximum Likelihood Varun Kanade University of Oxford January 27, 2016 Outline Probabilistic Framework Formulate linear regression in the language of probability Introduce
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter Five Jesse Crawford Department of Mathematics Tarleton State University Spring 2011 (Tarleton State University) Chapter Five Notes Spring 2011 1 / 37 Outline 1
More informationRandom Variables. Lecture 6: E(X ), Var(X ), & Cov(X, Y ) Random Variables - Vocabulary. Random Variables, cont.
Lecture 6: E(X ), Var(X ), & Cov(X, Y ) Sta230/Mth230 Colin Rundel February 5, 2014 We have been using them for a while now in a variety of forms but it is good to explicitly define what we mean Random
More informationLecture 1: August 28
36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 1: August 28 Our broad goal for the first few lectures is to try to understand the behaviour of sums of independent random
More informationLecture 2: Review of Probability
Lecture 2: Review of Probability Zheng Tian Contents 1 Random Variables and Probability Distributions 2 1.1 Defining probabilities and random variables..................... 2 1.2 Probability distributions................................
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions
Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions 1999 Prentice-Hall, Inc. Chap. 4-1 Chapter Topics Basic Probability Concepts: Sample
More informationPractice Problem - Skewness of Bernoulli Random Variable. Lecture 7: Joint Distributions and the Law of Large Numbers. Joint Distributions - Example
A little more E(X Practice Problem - Skewness of Bernoulli Random Variable Lecture 7: and the Law of Large Numbers Sta30/Mth30 Colin Rundel February 7, 014 Let X Bern(p We have shown that E(X = p Var(X
More informationLecture 16 : Independence, Covariance and Correlation of Discrete Random Variables
Lecture 6 : Independence, Covariance and Correlation of Discrete Random Variables 0/ 3 Definition Two discrete random variables X and Y defined on the same sample space are said to be independent if for
More informationChapter 5 continued. Chapter 5 sections
Chapter 5 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions
More informationSTAT Chapter 5 Continuous Distributions
STAT 270 - Chapter 5 Continuous Distributions June 27, 2012 Shirin Golchi () STAT270 June 27, 2012 1 / 59 Continuous rv s Definition: X is a continuous rv if it takes values in an interval, i.e., range
More informationCheng Soon Ong & Christian Walder. Canberra February June 2018
Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 2018 (Many figures from C. M. Bishop, "Pattern Recognition and ") 1of 89 Part II
More informationLecture 13. Poisson Distribution. Text: A Course in Probability by Weiss 5.5. STAT 225 Introduction to Probability Models February 16, 2014
Lecture 13 Text: A Course in Probability by Weiss 5.5 STAT 225 Introduction to Probability Models February 16, 2014 Whitney Huang Purdue University 13.1 Agenda 1 2 3 13.2 Review So far, we have seen discrete
More informationDiscrete Distributions
Chapter 2 Discrete Distributions 2.1 Random Variables of the Discrete Type An outcome space S is difficult to study if the elements of S are not numbers. However, we can associate each element/outcome
More informationIntroduction to Statistical Inference Self-study
Introduction to Statistical Inference Self-study Contents Definition, sample space The fundamental object in probability is a nonempty sample space Ω. An event is a subset A Ω. Definition, σ-algebra A
More informationSTAT 302 Introduction to Probability Learning Outcomes. Textbook: A First Course in Probability by Sheldon Ross, 8 th ed.
STAT 302 Introduction to Probability Learning Outcomes Textbook: A First Course in Probability by Sheldon Ross, 8 th ed. Chapter 1: Combinatorial Analysis Demonstrate the ability to solve combinatorial
More informationBivariate Distributions
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 17 Néhémy Lim Bivariate Distributions 1 Distributions of Two Random Variables Definition 1.1. Let X and Y be two rrvs on probability space (Ω, A, P).
More informationWeek 2. Review of Probability, Random Variables and Univariate Distributions
Week 2 Review of Probability, Random Variables and Univariate Distributions Probability Probability Probability Motivation What use is Probability Theory? Probability models Basis for statistical inference
More informationMATH Notebook 5 Fall 2018/2019
MATH442601 2 Notebook 5 Fall 2018/2019 prepared by Professor Jenny Baglivo c Copyright 2004-2019 by Jenny A. Baglivo. All Rights Reserved. 5 MATH442601 2 Notebook 5 3 5.1 Sequences of IID Random Variables.............................
More informationEEL 5544 Noise in Linear Systems Lecture 30. X (s) = E [ e sx] f X (x)e sx dx. Moments can be found from the Laplace transform as
L30-1 EEL 5544 Noise in Linear Systems Lecture 30 OTHER TRANSFORMS For a continuous, nonnegative RV X, the Laplace transform of X is X (s) = E [ e sx] = 0 f X (x)e sx dx. For a nonnegative RV, the Laplace
More informationfor valid PSD. PART B (Answer all five units, 5 X 10 = 50 Marks) UNIT I
Code: 15A04304 R15 B.Tech II Year I Semester (R15) Regular Examinations November/December 016 PROBABILITY THEY & STOCHASTIC PROCESSES (Electronics and Communication Engineering) Time: 3 hours Max. Marks:
More informationChapter 5. Chapter 5 sections
1 / 43 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions
More informationLet X and Y denote two random variables. The joint distribution of these random
EE385 Class Notes 9/7/0 John Stensby Chapter 3: Multiple Random Variables Let X and Y denote two random variables. The joint distribution of these random variables is defined as F XY(x,y) = [X x,y y] P.
More informationRandom Vectors, Random Matrices, and Matrix Expected Value
Random Vectors, Random Matrices, and Matrix Expected Value James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) 1 / 16 Random Vectors,
More informationPerhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows.
Chapter 5 Two Random Variables In a practical engineering problem, there is almost always causal relationship between different events. Some relationships are determined by physical laws, e.g., voltage
More informationDiscrete Random Variables
CPSC 53 Systems Modeling and Simulation Discrete Random Variables Dr. Anirban Mahanti Department of Computer Science University of Calgary mahanti@cpsc.ucalgary.ca Random Variables A random variable is
More informationDennis Bricker Dept of Mechanical & Industrial Engineering The University of Iowa
Dennis Bricker Dept of Mechanical & Industrial Engineering The University of Iowa dennis-bricker@uiowa.edu Probability Theory Results page 1 D.Bricker, U. of Iowa, 2002 Probability of simultaneous occurrence
More informationStatistics for Economists. Lectures 3 & 4
Statistics for Economists Lectures 3 & 4 Asrat Temesgen Stockholm University 1 CHAPTER 2- Discrete Distributions 2.1. Random variables of the Discrete Type Definition 2.1.1: Given a random experiment with
More informationHW4 : Bivariate Distributions (1) Solutions
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 7 Néhémy Lim HW4 : Bivariate Distributions () Solutions Problem. The joint probability mass function of X and Y is given by the following table : X Y
More informationA Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.
A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,
More informationMeasure-theoretic probability
Measure-theoretic probability Koltay L. VEGTMAM144B November 28, 2012 (VEGTMAM144B) Measure-theoretic probability November 28, 2012 1 / 27 The probability space De nition The (Ω, A, P) measure space is
More informationMULTINOMIAL PROBABILITY DISTRIBUTION
MTH/STA 56 MULTINOMIAL PROBABILITY DISTRIBUTION The multinomial probability distribution is an extension of the binomial probability distribution when the identical trial in the experiment has more than
More informationGaussian vectors and central limit theorem
Gaussian vectors and central limit theorem Samy Tindel Purdue University Probability Theory 2 - MA 539 Samy T. Gaussian vectors & CLT Probability Theory 1 / 86 Outline 1 Real Gaussian random variables
More informationACM 116: Lectures 3 4
1 ACM 116: Lectures 3 4 Joint distributions The multivariate normal distribution Conditional distributions Independent random variables Conditional distributions and Monte Carlo: Rejection sampling Variance
More informationCSC 411: Lecture 09: Naive Bayes
CSC 411: Lecture 09: Naive Bayes Class based on Raquel Urtasun & Rich Zemel s lectures Sanja Fidler University of Toronto Feb 8, 2015 Urtasun, Zemel, Fidler (UofT) CSC 411: 09-Naive Bayes Feb 8, 2015 1
More informationConditional distributions (discrete case)
Conditional distributions (discrete case) The basic idea behind conditional distributions is simple: Suppose (XY) is a jointly-distributed random vector with a discrete joint distribution. Then we can
More informationA BIVARIATE MARSHALL AND OLKIN EXPONENTIAL MINIFICATION PROCESS
Faculty of Sciences Mathematics, University of Niš, Serbia Available at: http://wwwpmfniacyu/filomat Filomat 22: (2008), 69 77 A BIVARIATE MARSHALL AND OLKIN EXPONENTIAL MINIFICATION PROCESS Miroslav M
More informationCovariance. Lecture 20: Covariance / Correlation & General Bivariate Normal. Covariance, cont. Properties of Covariance
Covariance Lecture 0: Covariance / Correlation & General Bivariate Normal Sta30 / Mth 30 We have previously discussed Covariance in relation to the variance of the sum of two random variables Review Lecture
More informationMath Bootcamp 2012 Miscellaneous
Math Bootcamp 202 Miscellaneous Factorial, combination and permutation The factorial of a positive integer n denoted by n!, is the product of all positive integers less than or equal to n. Define 0! =.
More informationBasics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationGenerating and characteristic functions. Generating and Characteristic Functions. Probability generating function. Probability generating function
Generating and characteristic functions Generating and Characteristic Functions September 3, 03 Probability generating function Moment generating function Power series expansion Characteristic function
More informationContinuous Random Variables
1 / 24 Continuous Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 27, 2013 2 / 24 Continuous Random Variables
More informationReview of Probabilities and Basic Statistics
Alex Smola Barnabas Poczos TA: Ina Fiterau 4 th year PhD student MLD Review of Probabilities and Basic Statistics 10-701 Recitations 1/25/2013 Recitation 1: Statistics Intro 1 Overview Introduction to
More informationBivariate scatter plots and densities
Multivariate descriptive statistics Bivariate scatter plots and densities Plotting two (related) variables is often called a scatter plot. It is a bivariate version of the rug plot. It can show something
More informationProbability Models. 4. What is the definition of the expectation of a discrete random variable?
1 Probability Models The list of questions below is provided in order to help you to prepare for the test and exam. It reflects only the theoretical part of the course. You should expect the questions
More informationProbability reminders
CS246 Winter 204 Mining Massive Data Sets Probability reminders Sammy El Ghazzal selghazz@stanfordedu Disclaimer These notes may contain typos, mistakes or confusing points Please contact the author so
More informationEXAMINATIONS OF THE HONG KONG STATISTICAL SOCIETY
EXAMINATIONS OF THE HONG KONG STATISTICAL SOCIETY HIGHER CERTIFICATE IN STATISTICS, 2013 MODULE 5 : Further probability and inference Time allowed: One and a half hours Candidates should answer THREE questions.
More informationBASICS OF PROBABILITY
October 10, 2018 BASICS OF PROBABILITY Randomness, sample space and probability Probability is concerned with random experiments. That is, an experiment, the outcome of which cannot be predicted with certainty,
More information1 Random Variable: Topics
Note: Handouts DO NOT replace the book. In most cases, they only provide a guideline on topics and an intuitive feel. 1 Random Variable: Topics Chap 2, 2.1-2.4 and Chap 3, 3.1-3.3 What is a random variable?
More informationMAS113 Introduction to Probability and Statistics
MAS113 Introduction to Probability and Statistics School of Mathematics and Statistics, University of Sheffield 2018 19 Identically distributed Suppose we have n random variables X 1, X 2,..., X n. Identically
More informationRandom Variables. P(x) = P[X(e)] = P(e). (1)
Random Variables Random variable (discrete or continuous) is used to derive the output statistical properties of a system whose input is a random variable or random in nature. Definition Consider an experiment
More informationSummary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016
8. For any two events E and F, P (E) = P (E F ) + P (E F c ). Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 Sample space. A sample space consists of a underlying
More informationA Marshall-Olkin Gamma Distribution and Process
CHAPTER 3 A Marshall-Olkin Gamma Distribution and Process 3.1 Introduction Gamma distribution is a widely used distribution in many fields such as lifetime data analysis, reliability, hydrology, medicine,
More informationThe Canonical Gaussian Measure on R
The Canonical Gaussian Measure on R 1. Introduction The main goal of this course is to study Gaussian measures. The simplest example of a Gaussian measure is the canonical Gaussian measure P on R where
More informationE X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl.
E X A M Course code: Course name: Number of pages incl. front page: 6 MA430-G Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours Resources allowed: Notes: Pocket calculator,
More informationSection 8.1. Vector Notation
Section 8.1 Vector Notation Definition 8.1 Random Vector A random vector is a column vector X = [ X 1 ]. X n Each Xi is a random variable. Definition 8.2 Vector Sample Value A sample value of a random
More informationRelationship between probability set function and random variable - 2 -
2.0 Random Variables A rat is selected at random from a cage and its sex is determined. The set of possible outcomes is female and male. Thus outcome space is S = {female, male} = {F, M}. If we let X be
More informationTest Problems for Probability Theory ,
1 Test Problems for Probability Theory 01-06-16, 010-1-14 1. Write down the following probability density functions and compute their moment generating functions. (a) Binomial distribution with mean 30
More informationClass 8 Review Problems solutions, 18.05, Spring 2014
Class 8 Review Problems solutions, 8.5, Spring 4 Counting and Probability. (a) Create an arrangement in stages and count the number of possibilities at each stage: ( ) Stage : Choose three of the slots
More informationPreliminary statistics
1 Preliminary statistics The solution of a geophysical inverse problem can be obtained by a combination of information from observed data, the theoretical relation between data and earth parameters (models),
More informationCS37300 Class Notes. Jennifer Neville, Sebastian Moreno, Bruno Ribeiro
CS37300 Class Notes Jennifer Neville, Sebastian Moreno, Bruno Ribeiro 2 Background on Probability and Statistics These are basic definitions, concepts, and equations that should have been covered in your
More informationMultivariate Gaussian Distribution. Auxiliary notes for Time Series Analysis SF2943. Spring 2013
Multivariate Gaussian Distribution Auxiliary notes for Time Series Analysis SF2943 Spring 203 Timo Koski Department of Mathematics KTH Royal Institute of Technology, Stockholm 2 Chapter Gaussian Vectors.
More informationTopic 2: Probability & Distributions. Road Map Probability & Distributions. ECO220Y5Y: Quantitative Methods in Economics. Dr.
Topic 2: Probability & Distributions ECO220Y5Y: Quantitative Methods in Economics Dr. Nick Zammit University of Toronto Department of Economics Room KN3272 n.zammit utoronto.ca November 21, 2017 Dr. Nick
More informationSTAT/MATH 395 PROBABILITY II
STAT/MATH 395 PROBABILITY II Bivariate Distributions Néhémy Lim University of Washington Winter 2017 Outline Distributions of Two Random Variables Distributions of Two Discrete Random Variables Distributions
More information(c) Find the product moment correlation coefficient between s and t.
1. A clothes shop manager records the weekly sales figures, s, and the average weekly temperature, t C, for 6 weeks during the summer. The sales figures were coded so that s w = 1000 The data are summarised
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 2016 MODULE 1 : Probability distributions Time allowed: Three hours Candidates should answer FIVE questions. All questions carry equal marks.
More information