On bounds in multivariate Poisson approximation
|
|
- Arline Skinner
- 5 years ago
- Views:
Transcription
1 Workshop on New Directions in Stein s Method IMS (NUS, Singapore), May 18-29, 2015
2 Acknowledgments Thanks Institute for Mathematical Sciences (IMS, NUS), for the invitation, hospitality and accommodation support. Professor Chen Louis H. for helpful discussions on Stein-Chen method, Poisson approximation and related topics.
3 Talk Title Note: This talk is based on two our papers published in years 2013 and T. L. Hung and V. T. Thao, (2013), Bounds for the Approximation of Poisson-binomial distribution by Poisson distribution, Journal of Inequalities and Applications, 2013:30. 2 T. L. Hung and L. T. Giang, (2104), On bounds in Poisson approximation for integer-valued independent random variables, Journal of Inequalities and Applications, 2014:291.
4 Outline 1 A few words about Poisson approximation. 2 Motivation (Multivariate Poisson approximation). 3 Mathematical tools (A linear oprator, A probability distance). 4 Results (Le Cam type bounds for sums and random sums of d-dimensional independent Bernoulli distributed random vectors) 5 Remarks 6 References
5 Bernoulli s formula Let X 1, X 2,... be a sequence of independent Bernoulli random variables with success probability p, such that P (X j = 1) = p = 1 P (X j = 0), p (0, 1) Set S n = X X n the number of successes. Then Formula P (S n = k) = n! k!(n k)! pk (1 p) n k ; n 1, k = 1, 2,..., n. (1)
6 Approximation formula Suppose that the number n is large enough, and the success probability p is small, such that n p = λ. Then, Formula P (S n = k) P (Z λ = k); k = 0, 1, 2,...,. (2) where λ = E(S n ) = np = E(Z λ ) and P (Z λ = k) = e λ λ k k!. We denote Z λ P oi(λ) the Poisson random variable with mean λ.
7 Poisson limit theorem Suppose that n, p 0 such that n p λ. Then, Formula S n d Zλ, as n (3) where the notation d denotes the convergence in distribution. Note:The Poisson limit theorem suggests that the distribution of a sum of independent Bernoulli random variables with small success probabilities (p) can be approximated by the Poisson distribution with the same mean (np), if the success probabilities (p) are small and the number (n) of random variables is large.
8 Le Cam s bound, (1960) Let X 1, X 2,... be a sequence of independent Bernoulli distributed random variables such that P (X j = 1) = p j = 1 P (X j = 0) = 1 p j ; p j (0, 1). Let S n = X X n and λ n = E(S n ) = n p j. Then, Le Cam s result k=0 P (S n = k) P (Z λn = k 2 n p 2 j. (4)
9 Chen s bound, (1975) Chen s result P (S n = k) P (Z λn = k 2 ( 1 e λn) k=0 λ n n p 2 j (5)
10 Mathematical tools Operator theoretic method (Le Cam, (1960)) Stein-Chen method: 1 the local approach (Chen (1975), Arratia, Goldstein and Gordon (1989, 1990) 2 the size-bias coupling approach (Barbour((1982), Barbour, Holst and Janson (1992), Chatterjee, Diaconis and Meckes (2005))
11 Total variation distance A measure of the accuracy of the approximation is the total variation distance. For two distributions P and Q over Z + = {0, 1, 2,...}, the total variation distance between them is defined by d T V (P, Q) = sup A Z + P (A) Q(A) which is also equal to 1 2 sup hdp h =1 hdq = 1 P {i} Q{i}. 2 i Z +
12 Well-known results For the binomial distribution Bin n (p), Prohorov ((1953)) proved that [ ] 1 1 d T V (Bin n (p), P oi(np)) p + O(inf(1, ) + p 2πe n (6) Using the method of convolution operators, Le Cam ((1960)) obtained the error bounds n d T V (L(S n ), P oi(λ n )) 2 p 2 j (7) and, if max 1 j n p j 1 4, d T V (L(S n ), P oi(λ n )) 8 λ n n p 2 j (8)
13 Motivation A. Renyi, Probability Theory, ((1970)) Poisson approximation Theorem: Let X n1, X n2,... be a sequence of independent random variables which assume only the values 0 and 1, with P (X nj = 1) = p nj = 1 P (X nj = 0). Put λ n = n p nj and suppose that and Then, X n X nn d Zλ as n. lim λ n = λ (9) n lim max p nj = 0. (10) n 1 j n
14 Linear Operator Let K denote the set of all real-valued bounded functions f(x), defined on the nonnegative integers Z + = {0, 1, 2,...}. Put f = sup f(x). Let there be associated with every probability distribution P = {p 0, p 1,...} an operator defined by for every f K. A P f = f(x + r)p r, (11) r=0
15 Properties Operator A P maps the set K into itself. A P is a linear contraction operator If P and Q are any two distributions defined on the nonnegative integers, then A P A Q = A R, where R is the convolution of the distributions P and Q. The sufficient condition for proof of Poisson approximation Theorem is lim n A P Sn A PZλ = 0 (12) for f K, S n = n P oi(λ). X nj, λ n = E(S n ), λ = lim n λ n, Z λ
16 Le Cam s type bounds in Poisson approximation via operator introduced by A. Renyi Hung T. L. and Thao V. T., Journal of Inequalities and Applications, ((2013)) Theorem 1. Let X n1, X n2,... be a row-wise triangular array of independent, Bernoulli random variables with success probabilities P (X nj = 1) = 1 P (X nj = 0) = p nj, p nj (0, 1), j = 1, 2,..., n; n = 1, 2,... Let us write S n = n X nj, λ n = E(S n ). We denote by Z λn the Poisson random variable with the parameter λ n. Then, for all real-valued bounded functions f K, we have A PSn f A PZλn n 2 f p 2 nj. (13)
17 Le Cam s type bounds in Poisson approximation for Random sums Theorem 2. Let X n1, X n2,... be a row-wise triangular array of independent, Bernoulli random variables. Let {N n, n 1} be a sequence of non-negative integer-valued random variables independent of all X nj. Let us write S Nn = Nn X nj, λ Nn = E(S Nn ). Then, for all real-valued bounded functions f K, we have N n A PSNn f A PZλNn 2 f E p 2 N nj. (14)
18 Le Cam s type bounds in Poisson approximation for sum of independent integer-valued random variables Hung T. L. and Giang L. T., Journal of Inequalities and Applications, ((2014)) Theorem 3. Let X n1, X n2,... be a row-wise triangular array of independent, integer-valued random variables with success probabilities P (X nj = 1) = p nj, P (X nj = 0) = 1 p nj q nj, p nj, q nj (0, 1), p nj + q nj (0, 1), j = 1, 2,..., n; n = 1, 2,... Then, for all real-valued bounded functions f K, we have A PSn f A PZλn n 2 f (p 2 nj + q nj ). (15)
19 Le Cam s type bounds in Poisson approximation for random sum of independent integer-valued random variables Theorem 4. Let X n1, X n2,... be a row-wise triangular array of independent, integer-valued random variables with success probabilities P (X nj = 1) = p nj, P (X nj = 0) = 1 p nj q nj, p nj, q nj (0, 1), p nj + q nj (0, 1), j = 1, 2,..., n; n = 1, 2,... Let {N n, n 1} be a sequence of non-negative integer-valued random variables independent of all X nj. Then, for all real-valued bounded functions f K, we have N n A PSNn f A PZλNn 2 f E (p 2 N nj + q Nnj). (16)
20 Multivariate Poisson approximation Consider independent Bernoulli random d-vectors, X 1, X 2,... with P (X j = e (i) ) = p j,i, P (X j = 0) = 1 p j, 1 i d, 1 j n, where e (i) denotes the ith coordinate vector in R d and p j = p j,i. 1 i d Let S n = n X j, λ n = n p j.
21 Multivariate Poisson approximation McDonald (1980): for the independent Bernoulli d- random vectors d T V (P Sn, P Zλn ) := sup P (S n A) P (Z λn A) A Z+ d ( n d ) 2 (17) p j,i i=1 for S n = X 1 + X X n, and λ n = E(S n ) = (λ 1,..., λ d ), Z λn P oi(λ n ),
22 Multivariate Poisson approximation Using the Stein-Chen method, Barbour (1988) showed that d T V (P Sn, P Z ) n { ( c λn min λ n n p 2 j,i µ i=1 i ) ( d ) 2 }, p j,i i=1 (18) where c λn = log+ (2λ n ), µ i = λ 1 n p j,i, Z = (Z 1,..., Z d ), and Z 1,..., Z d are independent Poisson random variables with means λµ 1,..., λµ d. This bound is sharper than the bound in McDonald (1980).
23 Multivariate Poisson approximation Using the multivariate adaption of Kerstan s generating function method, Roos (1999) proved that d T V (P Sn, P Z ) 8.8 n { ( 1 min p j 2, λ n d i=1 p 2 j,i µ i ) } (19) which improved over (18)in removing c λn from the error bound although the absolute constant is increased to 8.8
24 Operator for d-dimensional random vector Definition Let X be a d-dinensional random vector with probability distribution P X. A linear operator A PX : K K such that (A PX f) (x) := f(x + m)p (X = m) (20) m Z d + where f K, the class of all real-valued bounded functions f on the set of all non-negative integers Z+ d and x = (x 1,..., x d ), m = (m 1,..., m d ) Z+. d The norm of function f is f = sup f(x) x Z+ d
25 Properties 1 Operator A PX is a contraction operator A PX f f 2 For the convolution of two distributions: A PX P Y f = A PX (A PY f) = A PY (A PX f) 3 Let A PXn f A PX f = o(1) as n. Then X n d X as n.
26 Inequalities 1 Let X 1,..., X n and Y 1,..., Y n be two sequences of independent d-random vectors in each group (and they are independent). Then, for f K, A n f A n f P Xj P Yj n A PXj f A PYj f 2 Let N n, n 1 be a sequence of non-negative integer random variables, independent from all X j and Y j. Then A Nn f A Nn P Xj P Yj f P (N n = k) k=1 k A PYj f A PYj f
27 Inequalities for iid. d-random vectors 1 Let X 1,..., X n and Y 1,..., Y n be two sequences of iid. d-random vectors in each group (and they are independent). Then, for f K, A n f A n f n A PX1 f A PY1 f P Xj P Yj 2 Let {N n, n 1} be a sequence of non-negative integer random variables, independent from all iid. X j and Y j. Then A Nn f A Nn P Xj P Yj f E(N n ) A PY1 f A PY1 f
28 Notations Denote by P Z d by the distribution of Poisson d-random vector λn Zλ d n, where λ n = (λ 1,..., λ d ) and P (Z λn = m) = where m = (m 1,..., λ d ) Z d +. d ( e λ j λ m j j m j! ),
29 Notations Denote P Sn by the distribution of sum S d n = X d Xd n, where X d 1,..., Xd n are independent Bernoulii d-random vectors with success probabilities P (X d k = e j) = p j,k [0, 1], k = 1, 2,..., n; j = 1, 2,... d. and d P (Xk d = (0,..., 0)) = 1 p j,k [0, 1] Here e j R d denotes the vector with entry 1 at position j and entry 0 otherwise.
30 Le Cam type bound in multivariate Poisson approximation Theorem 5. For the independent Bernoulli distributed d-dimensional random vectors. For f K, A PSn f A PZλn 2 ( n d ) 2 p j,i (21) i=1
31 Le Cam type bound in multivariate Poisson approximation for random sum Theorem 6. For the independent Bernoulli distributed d-dimensional random vectors. For f K, For {N n, n 1} the sequence of non-negative integer-value random variables independent from all X 1, X 2,..., Z λ1, Z λ2,... A PSNn f A PZλNn ( N n d ) 2 2E p j,i (22) i=1
32 Concluding Remarks 1 The operator method is elementary and elegant, but efficient in use. 2 This operator method can be applicable to a wide class of discrete d-dimensional random vectors as geometric, hypergeometric, negative binomial, etc. 3 This operator theoretic method can be applicaable to compound Poisson approximation and Poisson process approximation problems. 4 Based on this operator we can define a probability distance having a role in stydy of Poisson approximation problems.
33 Probability distance based on operator A PX A probability distance for two probability distributions P X and P Y is defined by Definition for f K. d(p X, P Y, f) := A PX f A PY = sup x Z d + Ef(X + x) Ef(Y + x) (23)
34 Properties 1 Distance d(p X, P Y, f) is a probability distance, i.e. d(p X, P Y, f) 0. d(p X, P Y, f) = 0, if P (X = Y ) = 1. d(p X, P Y, f) = d(p Y, P X, f) d(p X, P Z, f) d(p X, P Y, f) + d(p Y, P Z, f). 2 Convergence d(p Xn, P X, f) 0 as n implies convergence in distribution for X n d X, as n.
35 Properties 1 Suppose that X 1, X 2,... X n ; Y 1, Y 2,... Y n are d-dimensional independent random variables (in each group). Then, for every f K, ( ) n d P n X, j P n Y ; f d(p j Xj, P Yj ; f). (24) 2 Moreover, let {N n, n 1} be a sequence of positive integer-valued random variables that independent of X 1, X 2,..., X n and Y 1, Y 2,..., Y n. Then, for every f K, ( ) d P Nn X, P Nn j Y ; f j P (N n = k) k=1 k d(p Xj, P Yj ; f). (25)
36 Comparision with total variation distance Use the simple inequality (A. D. Barbour), for every f K, d(p X, P Y, f) 2 f d T V (P X, P Y ) Thus, we can apply the probability distance d(p X, P Y, f) to some problems related to Poisson approximation.
37 References Barbour A. D., L. Holst and S. Janson, (1992) Poisson Approximation, Clarendon Press-Oxford. Chen L. H. Y. and Röllin A., (2013), Approximating dependent rare events, Bernoulli19(4), Hung T. L., and Thao V. T.,(2013), Bounds for the Approximation of Poisson-binomial distribution by Poisson distribution, Journal of Inequalities and Applications. Hung T. L., and Giang L. T., (2014), On bounds in Poisson approximation for integer-valued independent random variables, Journal of Inequalities and Applications.
38 References Renyi A.(1970), Probability Theorem, A. Kiado, Budapest. Roos B.,(1998), Metric multivariate Poisson approximation of the generalized multinomial distribution, Teor. Veroyatnost. i Primenen. 43, Roos B.,(1999) On the rate of multivariate Poisson convergence, Journal of Multivariate Analysis, V. 69, Teerapabolarn K., (2013), A new bound on Poisson approximation for independent geometric variables, International Journal of Pure and Applied Mathematics, Vol. 84, No. 4,
39 Thanks Thanks for your attention!
A New Approach to Poisson Approximations
A New Approach to Poisson Approximations Tran Loc Hung and Le Truong Giang March 29, 2014 Abstract The main purpose of this note is to present a new approach to Poisson Approximations. Some bounds in Poisson
More informationA new approach to Poisson approximation and applications
A new approach to Poisson approximation and applications Tran Loc Hung and Le Truong Giang October 7, 014 Abstract The main purpose of this article is to introduce a new approach to Poisson approximation
More informationOn the rate of convergence in limit theorems for geometric sums of i.i.d. random variables
On the rate of convergence in limit theorems for geometric sums of i.i.d. random variables Self-normalized Asymptotic Theory in Probability, Statistics and Econometrics IMS (NUS, Singapore), May 19-23,
More informationPoisson approximations
Chapter 9 Poisson approximations 9.1 Overview The Binn, p) can be thought of as the distribution of a sum of independent indicator random variables X 1 + + X n, with {X i = 1} denoting a head on the ith
More informationPoisson Approximation for Independent Geometric Random Variables
International Mathematical Forum, 2, 2007, no. 65, 3211-3218 Poisson Approximation for Independent Geometric Random Variables K. Teerapabolarn 1 and P. Wongasem Department of Mathematics, Faculty of Science
More informationMODERATE DEVIATIONS IN POISSON APPROXIMATION: A FIRST ATTEMPT
Statistica Sinica 23 (2013), 1523-1540 doi:http://dx.doi.org/10.5705/ss.2012.203s MODERATE DEVIATIONS IN POISSON APPROXIMATION: A FIRST ATTEMPT Louis H. Y. Chen 1, Xiao Fang 1,2 and Qi-Man Shao 3 1 National
More informationA Note on Poisson Approximation for Independent Geometric Random Variables
International Mathematical Forum, 4, 2009, no, 53-535 A Note on Poisson Approximation for Independent Geometric Random Variables K Teerapabolarn Department of Mathematics, Faculty of Science Burapha University,
More informationOn the Entropy of Sums of Bernoulli Random Variables via the Chen-Stein Method
On the Entropy of Sums of Bernoulli Random Variables via the Chen-Stein Method Igal Sason Department of Electrical Engineering Technion - Israel Institute of Technology Haifa 32000, Israel ETH, Zurich,
More informationApproximation of the conditional number of exceedances
Approximation of the conditional number of exceedances Han Liang Gan University of Melbourne July 9, 2013 Joint work with Aihua Xia Han Liang Gan Approximation of the conditional number of exceedances
More informationOn Approximating a Generalized Binomial by Binomial and Poisson Distributions
International Journal of Statistics and Systems. ISSN 0973-675 Volume 3, Number (008), pp. 3 4 Research India Publications http://www.ripublication.com/ijss.htm On Approximating a Generalized inomial by
More informationA Pointwise Approximation of Generalized Binomial by Poisson Distribution
Applied Mathematical Sciences, Vol. 6, 2012, no. 22, 1095-1104 A Pointwise Approximation of Generalized Binomial by Poisson Distribution K. Teerapabolarn Department of Mathematics, Faculty of Science,
More informationTotal variation error bounds for geometric approximation
Bernoulli 192, 2013, 610 632 DOI: 10.3150/11-BEJ406 Total variation error bounds for geometric approximation EROL A. PEKÖZ 1, ADRIAN RÖLLIN 2 and NATHAN ROSS 3 1 School of Management, Boston University,
More informationEntropy, Compound Poisson Approximation, Log-Sobolev Inequalities and Measure Concentration
Entropy, Compound Poisson Approximation, Log-Sobolev Inequalities and Measure Concentration Ioannis Kontoyiannis 1 and Mokshay Madiman Division of Applied Mathematics, Brown University 182 George St.,
More informationNon Uniform Bounds on Geometric Approximation Via Stein s Method and w-functions
Communications in Statistics Theory and Methods, 40: 45 58, 20 Copyright Taylor & Francis Group, LLC ISSN: 036-0926 print/532-45x online DOI: 0.080/036092090337778 Non Uniform Bounds on Geometric Approximation
More informationA COMPOUND POISSON APPROXIMATION INEQUALITY
J. Appl. Prob. 43, 282 288 (2006) Printed in Israel Applied Probability Trust 2006 A COMPOUND POISSON APPROXIMATION INEQUALITY EROL A. PEKÖZ, Boston University Abstract We give conditions under which the
More informationKERSTAN S METHOD FOR COMPOUND POISSON APPROXIMATION. BY BERO ROOS Universität Hamburg
The Annals of Probability 2003, Vol. 31, No. 4, 1754 1771 Institute of Mathematical Statistics, 2003 KERSTAN S METHOD FOR COMPOUND POISSON APPROXIMATION BY BERO ROOS Universität Hamburg We consider the
More informationMeasure-theoretic probability
Measure-theoretic probability Koltay L. VEGTMAM144B November 28, 2012 (VEGTMAM144B) Measure-theoretic probability November 28, 2012 1 / 27 The probability space De nition The (Ω, A, P) measure space is
More informationRandomized Load Balancing:The Power of 2 Choices
Randomized Load Balancing: The Power of 2 Choices June 3, 2010 Balls and Bins Problem We have m balls that are thrown into n bins, the location of each ball chosen independently and uniformly at random
More informationLecture 3. Discrete Random Variables
Math 408 - Mathematical Statistics Lecture 3. Discrete Random Variables January 23, 2013 Konstantin Zuev (USC) Math 408, Lecture 3 January 23, 2013 1 / 14 Agenda Random Variable: Motivation and Definition
More informationFisher Information, Compound Poisson Approximation, and the Poisson Channel
Fisher Information, Compound Poisson Approximation, and the Poisson Channel Mokshay Madiman Department of Statistics Yale University New Haven CT, USA Email: mokshaymadiman@yaleedu Oliver Johnson Department
More informationAsymptotic Statistics-III. Changliang Zou
Asymptotic Statistics-III Changliang Zou The multivariate central limit theorem Theorem (Multivariate CLT for iid case) Let X i be iid random p-vectors with mean µ and and covariance matrix Σ. Then n (
More informationMonotonicity and Aging Properties of Random Sums
Monotonicity and Aging Properties of Random Sums Jun Cai and Gordon E. Willmot Department of Statistics and Actuarial Science University of Waterloo Waterloo, Ontario Canada N2L 3G1 E-mail: jcai@uwaterloo.ca,
More informationStein s Method Applied to Some Statistical Problems
Stein s Method Applied to Some Statistical Problems Jay Bartroff Borchard Colloquium 2017 Jay Bartroff (USC) Stein s for Stats 4.Jul.17 1 / 36 Outline of this talk 1. Stein s Method 2. Bounds to the normal
More informationMathematical Statistics 1 Math A 6330
Mathematical Statistics 1 Math A 6330 Chapter 3 Common Families of Distributions Mohamed I. Riffi Department of Mathematics Islamic University of Gaza September 28, 2015 Outline 1 Subjects of Lecture 04
More informationarxiv: v1 [math.pr] 16 Jun 2009
A THREE-PARAMETER BINOMIAL APPROXIMATION arxiv:0906.2855v1 [math.pr] 16 Jun 2009 Vydas Čekanavičius, Erol A. Peköz, Adrian Röllin and Michael Shwartz Version from June 3, 2018 Abstract We approximate the
More informationNotes on Poisson Approximation
Notes on Poisson Approximation A. D. Barbour* Universität Zürich Progress in Stein s Method, Singapore, January 2009 These notes are a supplement to the article Topics in Poisson Approximation, which appeared
More informationTopic 9 Examples of Mass Functions and Densities
Topic 9 Examples of Mass Functions and Densities Discrete Random Variables 1 / 12 Outline Bernoulli Binomial Negative Binomial Poisson Hypergeometric 2 / 12 Introduction Write f X (x θ) = P θ {X = x} for
More informationLecture 12. Poisson random variables
18.440: Lecture 12 Poisson random variables Scott Sheffield MIT 1 Outline Poisson random variable definition Poisson random variable properties Poisson random variable problems 2 Outline Poisson random
More informationThings to remember when learning probability distributions:
SPECIAL DISTRIBUTIONS Some distributions are special because they are useful They include: Poisson, exponential, Normal (Gaussian), Gamma, geometric, negative binomial, Binomial and hypergeometric distributions
More informationSusceptible-Infective-Removed Epidemics and Erdős-Rényi random
Susceptible-Infective-Removed Epidemics and Erdős-Rényi random graphs MSR-Inria Joint Centre October 13, 2015 SIR epidemics: the Reed-Frost model Individuals i [n] when infected, attempt to infect all
More informationA Short Introduction to Stein s Method
A Short Introduction to Stein s Method Gesine Reinert Department of Statistics University of Oxford 1 Overview Lecture 1: focusses mainly on normal approximation Lecture 2: other approximations 2 1. The
More information1. Introduction. Let the distribution of a non-negative integer-valued random variable X be defined as follows:
International Journal of Pure and Applied Mathematics Volume 82 No. 5 2013, 737-745 ISSN: 1311-8080 (printed version); ISSN: 1314-335 (on-line version) url: http://www.ijpam.eu doi: http://dx.doi.org/.12732/ijpam.v82i5.7
More informationPart IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationConcentration of Measures by Bounded Couplings
Concentration of Measures by Bounded Couplings Subhankar Ghosh, Larry Goldstein and Ümit Işlak University of Southern California [arxiv:0906.3886] [arxiv:1304.5001] May 2013 Concentration of Measure Distributional
More informationFundamental Tools - Probability Theory IV
Fundamental Tools - Probability Theory IV MSc Financial Mathematics The University of Warwick October 1, 2015 MSc Financial Mathematics Fundamental Tools - Probability Theory IV 1 / 14 Model-independent
More informationA Criterion for the Compound Poisson Distribution to be Maximum Entropy
A Criterion for the Compound Poisson Distribution to be Maximum Entropy Oliver Johnson Department of Mathematics University of Bristol University Walk Bristol, BS8 1TW, UK. Email: O.Johnson@bristol.ac.uk
More information18.175: Lecture 13 Infinite divisibility and Lévy processes
18.175 Lecture 13 18.175: Lecture 13 Infinite divisibility and Lévy processes Scott Sheffield MIT Outline Poisson random variable convergence Extend CLT idea to stable random variables Infinite divisibility
More informationSTEIN S METHOD, SEMICIRCLE DISTRIBUTION, AND REDUCED DECOMPOSITIONS OF THE LONGEST ELEMENT IN THE SYMMETRIC GROUP
STIN S MTHOD, SMICIRCL DISTRIBUTION, AND RDUCD DCOMPOSITIONS OF TH LONGST LMNT IN TH SYMMTRIC GROUP JASON FULMAN AND LARRY GOLDSTIN Abstract. Consider a uniformly chosen random reduced decomposition of
More informationBINOMIAL DISTRIBUTION
BINOMIAL DISTRIBUTION The binomial distribution is a particular type of discrete pmf. It describes random variables which satisfy the following conditions: 1 You perform n identical experiments (called
More information18.175: Lecture 17 Poisson random variables
18.175: Lecture 17 Poisson random variables Scott Sheffield MIT 1 Outline More on random walks and local CLT Poisson random variable convergence Extend CLT idea to stable random variables 2 Outline More
More informationChapter 1. Sets and probability. 1.3 Probability space
Random processes - Chapter 1. Sets and probability 1 Random processes Chapter 1. Sets and probability 1.3 Probability space 1.3 Probability space Random processes - Chapter 1. Sets and probability 2 Probability
More informationStein s Method and Characteristic Functions
Stein s Method and Characteristic Functions Alexander Tikhomirov Komi Science Center of Ural Division of RAS, Syktyvkar, Russia; Singapore, NUS, 18-29 May 2015 Workshop New Directions in Stein s method
More informationStein s method and zero bias transformation: Application to CDO pricing
Stein s method and zero bias transformation: Application to CDO pricing ESILV and Ecole Polytechnique Joint work with N. El Karoui Introduction CDO a portfolio credit derivative containing 100 underlying
More informationMath/Stat 352 Lecture 8
Math/Stat 352 Lecture 8 Sections 4.3 and 4.4 Commonly Used Distributions: Poisson, hypergeometric, geometric, and negative binomial. 1 The Poisson Distribution Poisson random variable counts the number
More informationThe Generalized Coupon Collector Problem
The Generalized Coupon Collector Problem John Moriarty & Peter Neal First version: 30 April 2008 Research Report No. 9, 2008, Probability and Statistics Group School of Mathematics, The University of Manchester
More informationChapter 5. Chapter 5 sections
1 / 43 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions
More informationStein s Method for Steady-State Approximations: Error Bounds and Engineering Solutions
Stein s Method for Steady-State Approximations: Error Bounds and Engineering Solutions Jim Dai Joint work with Anton Braverman and Jiekun Feng Cornell University Workshop on Congestion Games Institute
More informationA = A U. U [n] P(A U ). n 1. 2 k(n k). k. k=1
Lecture I jacques@ucsd.edu Notation: Throughout, P denotes probability and E denotes expectation. Denote (X) (r) = X(X 1)... (X r + 1) and let G n,p denote the Erdős-Rényi model of random graphs. 10 Random
More informationModelling Dependent Credit Risks with Extensions of CreditRisk + and Application to Operational Risk (Lecture Notes)
Modelling Dependent Credit Risks with Extensions of CreditRisk + and Application to Operational Risk (Lecture Notes) Prof. Dr. Uwe Schmock PRisMa Lab Financial and Actuarial Mathematics (FAM) Institute
More informationThe first divisible sum
The first divisible sum A.D. Barbour and R. Grübel Universität Zürich and Technische Universiteit Delft now: "Universität-Gesamthochschule-Paderborn" Abstract. We consider the distribution of the first
More informationCS 5014: Research Methods in Computer Science. Bernoulli Distribution. Binomial Distribution. Poisson Distribution. Clifford A. Shaffer.
Department of Computer Science Virginia Tech Blacksburg, Virginia Copyright c 2015 by Clifford A. Shaffer Computer Science Title page Computer Science Clifford A. Shaffer Fall 2015 Clifford A. Shaffer
More informationCovering n-permutations with (n + 1)-Permutations
Covering n-permutations with n + 1)-Permutations Taylor F. Allison Department of Mathematics University of North Carolina Chapel Hill, NC, U.S.A. tfallis2@ncsu.edu Kathryn M. Hawley Department of Mathematics
More informationStatistical Methods in Particle Physics
Statistical Methods in Particle Physics Lecture 3 October 29, 2012 Silvia Masciocchi, GSI Darmstadt s.masciocchi@gsi.de Winter Semester 2012 / 13 Outline Reminder: Probability density function Cumulative
More information1: PROBABILITY REVIEW
1: PROBABILITY REVIEW Marek Rutkowski School of Mathematics and Statistics University of Sydney Semester 2, 2016 M. Rutkowski (USydney) Slides 1: Probability Review 1 / 56 Outline We will review the following
More informationU N I V E R S I T Ä T
U N I V E S I T Ä T H A M B U G Compound binomial approximations Vydas Čekanavičius and Bero oos Preprint No. 25 2 March 25 FACHBEEICH MATHEMATIK SCHWEPUNKT MATHEMATISCHE STATISTIK UND STOCHASTISCHE POZESSE
More informationChapter 4 - MATRIX ALGEBRA. ... a 2j... a 2n. a i1 a i2... a ij... a in
Chapter 4 - MATRIX ALGEBRA 4.1. Matrix Operations A a 11 a 12... a 1j... a 1n a 21. a 22.... a 2j... a 2n. a i1 a i2... a ij... a in... a m1 a m2... a mj... a mn The entry in the ith row and the jth column
More informationBALANCING GAUSSIAN VECTORS. 1. Introduction
BALANCING GAUSSIAN VECTORS KEVIN P. COSTELLO Abstract. Let x 1,... x n be independent normally distributed vectors on R d. We determine the distribution function of the minimum norm of the 2 n vectors
More informationMath Bootcamp 2012 Miscellaneous
Math Bootcamp 202 Miscellaneous Factorial, combination and permutation The factorial of a positive integer n denoted by n!, is the product of all positive integers less than or equal to n. Define 0! =.
More informationWeak convergence in Probability Theory A summer excursion! Day 3
BCAM June 2013 1 Weak convergence in Probability Theory A summer excursion! Day 3 Armand M. Makowski ECE & ISR/HyNet University of Maryland at College Park armand@isr.umd.edu BCAM June 2013 2 Day 1: Basic
More informationMath 117: Infinite Sequences
Math 7: Infinite Sequences John Douglas Moore November, 008 The three main theorems in the theory of infinite sequences are the Monotone Convergence Theorem, the Cauchy Sequence Theorem and the Subsequence
More informationTom Salisbury
MATH 2030 3.00MW Elementary Probability Course Notes Part V: Independence of Random Variables, Law of Large Numbers, Central Limit Theorem, Poisson distribution Geometric & Exponential distributions Tom
More informationDOUBLE SERIES AND PRODUCTS OF SERIES
DOUBLE SERIES AND PRODUCTS OF SERIES KENT MERRYFIELD. Various ways to add up a doubly-indexed series: Let be a sequence of numbers depending on the two variables j and k. I will assume that 0 j < and 0
More informationIntroduction and Preliminaries
Chapter 1 Introduction and Preliminaries This chapter serves two purposes. The first purpose is to prepare the readers for the more systematic development in later chapters of methods of real analysis
More informationSharp threshold functions for random intersection graphs via a coupling method.
Sharp threshold functions for random intersection graphs via a coupling method. Katarzyna Rybarczyk Faculty of Mathematics and Computer Science, Adam Mickiewicz University, 60 769 Poznań, Poland kryba@amu.edu.pl
More information4 Sums of Independent Random Variables
4 Sums of Independent Random Variables Standing Assumptions: Assume throughout this section that (,F,P) is a fixed probability space and that X 1, X 2, X 3,... are independent real-valued random variables
More informationCh3. Generating Random Variates with Non-Uniform Distributions
ST4231, Semester I, 2003-2004 Ch3. Generating Random Variates with Non-Uniform Distributions This chapter mainly focuses on methods for generating non-uniform random numbers based on the built-in standard
More informationSolutions to Problem Set 4
UC Berkeley, CS 174: Combinatorics and Discrete Probability (Fall 010 Solutions to Problem Set 4 1. (MU 5.4 In a lecture hall containing 100 people, you consider whether or not there are three people in
More informationProbability Theory. Richard F. Bass
Probability Theory Richard F. Bass ii c Copyright 2014 Richard F. Bass Contents 1 Basic notions 1 1.1 A few definitions from measure theory............. 1 1.2 Definitions............................. 2
More informationMarkov Chain Model for ALOHA protocol
Markov Chain Model for ALOHA protocol Laila Daniel and Krishnan Narayanan April 22, 2012 Outline of the talk A Markov chain (MC) model for Slotted ALOHA Basic properties of Discrete-time Markov Chain Stability
More informationDiscrete Distributions Chapter 6
Discrete Distributions Chapter 6 Negative Binomial Distribution section 6.3 Consider k r, r +,... independent Bernoulli trials with probability of success in one trial being p. Let the random variable
More informationElementary Row Operations on Matrices
King Saud University September 17, 018 Table of contents 1 Definition A real matrix is a rectangular array whose entries are real numbers. These numbers are organized on rows and columns. An m n matrix
More informationZero sum games Proving the vn theorem. Zero sum games. Roberto Lucchetti. Politecnico di Milano
Politecnico di Milano General form Definition A two player zero sum game in strategic form is the triplet (X, Y, f : X Y R) f (x, y) is what Pl1 gets from Pl2, when they play x, y respectively. Thus g
More informationProbability Distributions Columns (a) through (d)
Discrete Probability Distributions Columns (a) through (d) Probability Mass Distribution Description Notes Notation or Density Function --------------------(PMF or PDF)-------------------- (a) (b) (c)
More informationLecture 5: Moment generating functions
Lecture 5: Moment generating functions Definition 2.3.6. The moment generating function (mgf) of a random variable X is { x e tx f M X (t) = E(e tx X (x) if X has a pmf ) = etx f X (x)dx if X has a pdf
More informationQualifying Exam in Probability and Statistics. https://www.soa.org/files/edu/edu-exam-p-sample-quest.pdf
Part 1: Sample Problems for the Elementary Section of Qualifying Exam in Probability and Statistics https://www.soa.org/files/edu/edu-exam-p-sample-quest.pdf Part 2: Sample Problems for the Advanced Section
More informationThe purpose of this section is to derive the asymptotic distribution of the Pearson chi-square statistic. k (n j np j ) 2. np j.
Chapter 9 Pearson s chi-square test 9. Null hypothesis asymptotics Let X, X 2, be independent from a multinomial(, p) distribution, where p is a k-vector with nonnegative entries that sum to one. That
More information1 Generating functions
1 Generating functions Even quite straightforward counting problems can lead to laborious and lengthy calculations. These are greatly simplified by using generating functions. 2 Definition 1.1. Given a
More informationIntroduction to Probability
LECTURE NOTES Course 6.041-6.431 M.I.T. FALL 2000 Introduction to Probability Dimitri P. Bertsekas and John N. Tsitsiklis Professors of Electrical Engineering and Computer Science Massachusetts Institute
More informationDoubly Indexed Infinite Series
The Islamic University of Gaza Deanery of Higher studies Faculty of Science Department of Mathematics Doubly Indexed Infinite Series Presented By Ahed Khaleel Abu ALees Supervisor Professor Eissa D. Habil
More informationBivariate scatter plots and densities
Multivariate descriptive statistics Bivariate scatter plots and densities Plotting two (related) variables is often called a scatter plot. It is a bivariate version of the rug plot. It can show something
More informationConcentration of Measures by Bounded Size Bias Couplings
Concentration of Measures by Bounded Size Bias Couplings Subhankar Ghosh, Larry Goldstein University of Southern California [arxiv:0906.3886] January 10 th, 2013 Concentration of Measure Distributional
More informationWeek 1 Quantitative Analysis of Financial Markets Distributions A
Week 1 Quantitative Analysis of Financial Markets Distributions A Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 October
More informationPoisson Process Approximation: From Palm Theory to Stein s Method
IMS Lecture Notes Monograph Series c Institute of Mathematical Statistics Poisson Process Approximation: From Palm Theory to Stein s Method Louis H. Y. Chen 1 and Aihua Xia 2 National University of Singapore
More informationTHE LINDEBERG-FELLER CENTRAL LIMIT THEOREM VIA ZERO BIAS TRANSFORMATION
THE LINDEBERG-FELLER CENTRAL LIMIT THEOREM VIA ZERO BIAS TRANSFORMATION JAINUL VAGHASIA Contents. Introduction. Notations 3. Background in Probability Theory 3.. Expectation and Variance 3.. Convergence
More informationReview of Probabilities and Basic Statistics
Alex Smola Barnabas Poczos TA: Ina Fiterau 4 th year PhD student MLD Review of Probabilities and Basic Statistics 10-701 Recitations 1/25/2013 Recitation 1: Statistics Intro 1 Overview Introduction to
More informationCompound binomial approximations
AISM (6) 58: 187 1 DOI 1.17/s1463-5-18-4 Vydas Čekanavičius Bero oos Compound binomial approximations eceived: 3 August 4 / Accepted: 7 January 5 / Published online: 8 March 6 The Institute of Statistical
More informationSTAT 7032 Probability Spring Wlodek Bryc
STAT 7032 Probability Spring 2018 Wlodek Bryc Created: Friday, Jan 2, 2014 Revised for Spring 2018 Printed: January 9, 2018 File: Grad-Prob-2018.TEX Department of Mathematical Sciences, University of Cincinnati,
More informationOn Improved Bounds for Probability Metrics and f- Divergences
IRWIN AND JOAN JACOBS CENTER FOR COMMUNICATION AND INFORMATION TECHNOLOGIES On Improved Bounds for Probability Metrics and f- Divergences Igal Sason CCIT Report #855 March 014 Electronics Computers Communications
More informationSOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker CHAPTER 2. UNIVARIATE DISTRIBUTIONS
SOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker CHAPTER. UNIVARIATE DISTRIBUTIONS. Random Variables and Distribution Functions. This chapter deals with the notion of random variable, the distribution
More information1 Bernoulli Distribution: Single Coin Flip
STAT 350 - An Introduction to Statistics Named Discrete Distributions Jeremy Troisi Bernoulli Distribution: Single Coin Flip trial of an experiment that yields either a success or failure. X Bern(p),X
More informationLecture 13 and 14: Bayesian estimation theory
1 Lecture 13 and 14: Bayesian estimation theory Spring 2012 - EE 194 Networked estimation and control (Prof. Khan) March 26 2012 I. BAYESIAN ESTIMATORS Mother Nature conducts a random experiment that generates
More information3. Review of Probability and Statistics
3. Review of Probability and Statistics ECE 830, Spring 2014 Probabilistic models will be used throughout the course to represent noise, errors, and uncertainty in signal processing problems. This lecture
More informationRandom Bernstein-Markov factors
Random Bernstein-Markov factors Igor Pritsker and Koushik Ramachandran October 20, 208 Abstract For a polynomial P n of degree n, Bernstein s inequality states that P n n P n for all L p norms on the unit
More informationSection 9.1. Expected Values of Sums
Section 9.1 Expected Values of Sums Theorem 9.1 For any set of random variables X 1,..., X n, the sum W n = X 1 + + X n has expected value E [W n ] = E [X 1 ] + E [X 2 ] + + E [X n ]. Proof: Theorem 9.1
More informationMultivariate approximation in total variation
Multivariate approximation in total variation A. D. Barbour, M. J. Luczak and A. Xia Department of Mathematics and Statistics The University of Melbourne, VIC 3010 29 May, 2015 [Slide 1] Background Information
More informationNumerical Sequences and Series
Numerical Sequences and Series Written by Men-Gen Tsai email: b89902089@ntu.edu.tw. Prove that the convergence of {s n } implies convergence of { s n }. Is the converse true? Solution: Since {s n } is
More information3 Conditional Expectation
3 Conditional Expectation 3.1 The Discrete case Recall that for any two events E and F, the conditional probability of E given F is defined, whenever P (F ) > 0, by P (E F ) P (E)P (F ). P (F ) Example.
More informationA Study of Poisson and Related Processes with Applications
University of Tennessee, Knoxville Trace: Tennessee Research and Creative Exchange University of Tennessee Honors Thesis Projects University of Tennessee Honors Program 5-2013 A Study of Poisson and Related
More informationNew Versions of Some Classical Stochastic Inequalities
New Versions of Some Classical Stochastic Inequalities Deli Li Lakehead University, Canada 19 July 2018 at The 14th WMPRT in Chengdu This is a joint work with Professor Andrew ROSALSKY at University of
More informationChapter 2 Metrics, Information Theory, Convergence, and Poisson Approximations
Chapter 2 Metrics, Information Theory, Convergence, and Poisson Approximations Sometimes it is technically convenient to prove a certain type of convergence by proving that, for some suitable metric d
More information