Orthonormal polynomial expansions and lognormal sum densities

Size: px
Start display at page:

Download "Orthonormal polynomial expansions and lognormal sum densities"

Transcription

1 1/28 Orthonormal polynomial expansions and lognormal sum densities Pierre-Olivier Goffard Université Libre de Bruxelles February 22, 2016

2 2/28 Introduction Motivations Definition Goal: Recover the PDF of the sum of n lognormally distributed random variables. Dependence The lognormals in the sum may be correlated. Extreme Value The lognormal distribution is heavy tailed. Actuarial Science Modelization of the total claim amounts of non life insurance portfolios.

3 3/28 Introduction Motivations Definition Further aplications... Finance Black & Scholes model security prices are lognormally distributed, The value of the portfolio is distributed as a sum of lognormally distributed random variable, Pricing of Asian option. The pay off is determined by the average of the underlying price. Telecommunication The inverse of the signal to noise ratio can be modeled as a sum of i.i.d. lognormals.

4 4/28 Introduction Motivations Definition Definition The random variable defined as S = e X e Xn where (X 1,..., X n ) MN (µ, Σ) admits a sum of lognormals distribution SLN (µ, Σ). The PDF is given by

5 4/28 Introduction Motivations Definition Definition The random variable defined as S = e X e Xn where (X 1,..., X n ) MN (µ, Σ) admits a sum of lognormals distribution SLN (µ, Σ). The PDF is given by f S (x) =???

6 4/28 Introduction Motivations Definition Definition The random variable defined as S = e X e Xn where (X 1,..., X n ) MN (µ, Σ) admits a sum of lognormals distribution SLN (µ, Σ). The PDF is given by f S (x) =??? The PDF is unknown even in the case of the sum of two i.i.d. lognormals.

7 5/28 Let X be a random variable governed by P X, with unknown PDF f X. I. Pick a reference probability measure ν P X absolutely continuous w.r.t. ν. f ν as first approximation of f X. II. {Q k } k N sequence of orthonormal polynomials w.r.t. ν Gram-Schmidt orthogonalization procedure. III. Orthogonal projection of f X /f ν onto {Q k } Adjustment of the first approximation.

8 6/28 {Q k } k N must be complete in a set of functions in which f X /f ν belongs. The L 2 (ν) space The set of square integrable functions with respect to ν. Inner product, f, g = f (x)g(x)dν(x), where f, g L 2 (ν). {Q k } k N is a sequence of orthogonal polynomials w.r.t. ν in the sense that Q k, Q l = Q k (x)q l (x)dν(x) = δ kl.

9 7/28 Sufficient Condition If e α x dν(x) < +, then {Q k } k N is complete in L 2 (ν). Orthonormal Polynomial Expansion If f X /f ν L 2 (ν) then f X (x) = + k=0 a k Q k (x)f ν (x), where a k = Q k, f X = f ν Q k (x) f X (x) f ν (x) dν(x) = E [Q k(x )].

10 8/28 Orthonormal polynomial approximation The approximation follows from simple truncation K fx K (x) = a k Q k (x)f ν (x). k=0 The accuracy relies on the decay of the a k s.

11 9/28 Lognormal distribution as reference f ν (x) = Associated Orthogonal Polynomials ( ) 1 xσ ln(x) µ 2 2π e σ 2, x > 0. Q k (x) = e k2 σ 2 2 k i=0 ( 1) k+i e iµ i2 σ 2 2 [e σ 2, e σ2] k e k i (1,..., e (k 1)σ2) x i, for k N where e i (X 1,..., X k ) are the elementary symmetric polynomials and [x, q] n = n 1 ( i=0 1 xq i ) is the Q-Pochhammer symbol.

12 10/28 Let S be SLN (µ, σ)-distributed. Integrability Condition If ( ) f S (x) = O e b log2 x for x 0 and, where b > ( 4σ 2) 1, then fs /f ν L 2 (ν)

13 10/28 Let S be SLN (µ, σ)-distributed. Integrability Condition If ( ) f S (x) = O e b log2 x for x 0 and, where b > ( 4σ 2) 1, then fs /f ν L 2 (ν) Asymptotics for f S f S (x) = O(exp{ c 1 ln(x) 2 }) as x 0, where c 1 = [ 2 min w w T Σ 1 w ] 1, see Tankov et al [GT15]. and f S (x) = O(exp{ c 2 ln(x) 2 }) as x where c 2 = [ 2 max i=1,...,n Σ ii ] 1, see Asmussen et al. [ARN08]

14 11/28 The integrability condition is satisfied as long as σ 2 > max Σ ii. 2 PB1 Is {Q k } k N complete in L 2 (ν)?

15 11/28 The integrability condition is satisfied as long as σ 2 > max Σ ii. 2 PB1 Is {Q k } k N complete in L 2 (ν)? Proposition No, it s not!

16 11/28 The integrability condition is satisfied as long as σ 2 > max Σ ii. 2 PB1 Is {Q k } k N complete in L 2 (ν)? Proposition No, it s not! PB2 The lognormal distribution is not characterized by its moments and neither is the sum of lognormals distribution.

17 12/ K = 0 K = 1 K = 40 f Fig. 1 orthogonal polynomial approximations of LN (0, ) using a LN (0, ) reference.

18 13/28 Normal distribution N (µ, σ) as reference f ν (x) = 1 ( ) 2 σ x µ 2π e σ 2, x R. Associated Orthonormal Polynomials Q k (x) = 1 k!2 k/2 H k ( x µ σ 2 ), where {H k } k N are the Hermite polynomials, see Szego [Sze39].

19 f S /f ν / L 2 (ν). We consider a transformation of S Integrability Condition Z = ln(s). f Z (x) = O ( e ax2 ) as x ±, where a > ( 4σ 2) 1. Asymptotics for f Z f Z (z) = O(exp{ c 1 z 2 }) as z and f Z (z) = O(exp{ c 2 z 2 }) as z + Extension of the work of Gao et al. [GXY09]. 14/28

20 15/28 The integrability condition is satisfied as long as σ 2 > max Σ ii. 2 f Z is approximated by f Z (z) = K a k Q k (z)f ν (z), k=0 where the coefficient a k = E {Q k [ln(s)]} are evaluated using Crude Monte Carlo for k = 1,..., K. f S is approximated by f S, N (x) = 1 x f Z (ln(x)).

21 16/28 Gamma Distribution Γ(m, r) As Reference f ν (x) = e x/m x r 1 Γ(r)m r, x > 0. Associated Orthonormal Polynomials [ ] Γ(n + r) 1/2 Q n (x) = ( 1) n L r 1 n (x/m), Γ(n + 1)Γ(r) where the {L r 1 n } k N are the generalized Laguerre polynomials defined in Szego [Sze39].

22 17/28 f S /f ν / L 2 (ν). We consider the PDF of the exponentially tilted distribution of S f θ (x) = e θx f S (x), L(θ) where L(θ) = E ( e θs). Integrability Condition If ( f θ (x) = O e δx) where δ > 1 2m, and for x +, ( f θ (x) = O x β) for x 0, where β > r/2 1, then f θ /f ν L 2 (ν).

23 18/28 The integrability condition is satisfied as long as m > 1 2θ. f θ is approximated by f θ (x) = K a k Q k (x)f ν (x), k=0 where the coefficient a k = E [Q k (S θ )] with S θ f θ. f S is approximated by f S, Γ (x) = L(θ)e θx fθ (x).

24 19/28 Regarding the evaluation of the a k s, we have a k = E [Q k (S θ )] = q k0 + q k1 E(S θ ) q kk E(S k θ ) where the q ki s are the coefficients of Q k, and E(S i θ ) = E ( S i e θs) L(θ) = L i(θ) L(θ) where L i (θ) denotes the i th derivative of L(θ). We adapt techniques developed in Asmussen et al. [AJRN14, LAJRN16] to access L i (θ).

25 20/28 Polynomial Aproximation Settings Normal distribution as reference µ = E(Z) and σ 2 = V(Z) 10 5 replications for the CMC procedure Gamma distribution as reference θ = 1 Moment matching of order 2 between fθ and f ν to get m and r.

26 21/28 Some Challengers The Fenton-Wilkinson approximation f FW, see [Fen60] The log skew normal approximation f SK, see [HB15] The conditionnal Monte Carlo approximation f Cond, cf. Example 4.3 on p. 146 of [AG07]. A benchmark is obtained through numerical integration. f S (x) and f S (x) together with ( fs (x) f S (x)) are plotted over x [0, 2E(S)], The L 2 error are computed over [0, E(S)].

27 22/ f FW f Sk f Cond f N f Γ f f FW fsk fcond fn f Γ Test 1 mu = (0, 0), diag(σ) = (0.5, 1), ρ = 0.2. Reference distributions used are N (0.88, ) and Gamma(2.43, 0.51) with K = 32.

28 23/ f FW f Sk f Cond f N f Γ f f FW fsk fcond fn f Γ Test 2 n = 4, µ i = 0, Σ ii = 1, ρ = 0.1. Reference distributions used are N (1.32, ) and Gamma(3.37, 0.51) with K = 32

29 24/ Test 6 Sum of 3 LN (0, 1) r.v.s with C Cl 10 ( ) copula (i.e., τ = 5 6 ). Reference distributions used are N (1.46, ) and Gamma(8.78, 0.25) with K = 40. The L 2 errors of f N and f Γ are and respectively. f N f Γ f

30 25/28 The orthonormal polynomial approximation is an efficicient numerical method: Accurate and easy to code. None of the method tested here seem to universally superior to the other. Good behavior in presence of a non-gaussian dependence structure: cf. test 3 with Clayton copula. For more details, the paper is available on ArXiv [AGL16].

31 26/28 Søren Asmussen and Peter W Glynn, Stochastic Simulation: Algorithms and Analysis, Stochastic Modelling and Applied Probability series, vol. 57, Springer, S. Asmussen, P.-O. Goffard, and P. J. Laub, Orthonormal polynomial expansion and lognormal sum densities, arxiv preprint arxiv: (2016). S. Asmussen, J. L. Jensen, and L. Rojas-Nandapaya, On the Laplace transform of the lognormal distribution, Methodology and Computing in Applied Probability (2014), Søren Asmussen and Leonardo Rojas-Nandayapa, Asymptotics of sums of lognormal random variables with Gaussian copula, Statistics & Probability Letters 78 (2008), no. 16,

32 27/28 Lawrence Fenton, The sum of log-normal probability distributions in scatter transmission systems, IRE Transactions on Communications Systems 8 (1960), no. 1, Archil Gulisashvili and Peter Tankov, Tail behavior of sums and differences of log-normal random variables, Bernoulli (2015), To appear, accessed online on 26th August 2015 at user/submissionfile/17119?confirm=ef Xin Gao, Hong Xu, and Dong Ye, Asymptotic behavior of tail density for sum of correlated lognormal variables, International Journal of Mathematics and Mathematical Sciences (2009), Volume 2009, Article ID , 28 pages. Marwane Ben Hcine and Ridha Bouallegue, Highly accurate log skew normal approximation to the sum of correlated lognormals, In the Proc. of NeTCoM 2014 (2015).

33 28/28 Patrick J. Laub, Søren Asmussen, Jens L. Jensen, and Leonardo Rojas-Nandayapa, Approximating the Laplace transform of the sum of dependent lognormals, Volume 48A of Advances in Applied Probability. (2016), In Festschrift for Nick Bingham, C. M. Goldie and A. Mijatovic (Eds.), Probability, Analysis and Number Theory. To appear. G. Szegö, Orthogonal polynomials, vol. XXIII, American Mathematical Society Colloquium Publications, 1939.

34 28/28 The symmetric polynomials are defined as { 1 j e i (X 1,..., X k ) = 1 <...<j i k X j 1... X ji, for i k, 0, for i > k, and [x, q] n = n 1 ( i=0 1 xq i ) is the Q-Pochhammer symbol.

35 28/28 Log Skew Normal Approximation X is governed by a skew normal distribution SN (λ, ω, ɛ) if its PDF is given by f X (x) = 2 ( ) ( x ɛ ω φ Φ λ x ɛ ), ω ω where φ and Φ are respectively the PDF and CDF of the standard normal distribution. Y = e X is governed by a log skew normal distribution LSN (λ, ω, ɛ) Central moment matching (the two first one) with the sum of lognormals distribution. Left tail slope matching using the asymptotics derived in [GT15].

36 28/28 Conditional Monte Carlo Approximation By definition, the conditional Monte Carlo is the Crude Monte Carlo estimator of the representation f S (x) = E {P(S dx Y )} Recall that S = e X e Xn, and set Y = e X 1, then the conditional Monte Carlo estimator is written as follows [ ] } f Cond = E {f e X1 x (S e X 1 X1 ), where f e X 1 is the PDF of a lognormal distribution LN [E(X 1 ), V(X 1 )]

37 28/28 Approximation of L(θ) Precisions regarding the evaluation of the a k s in the gamma case The Laplace transform of S is given by ( L(θ) = E e θs) exp ( h θ (x)) dx where h θ (x) = θ(e µ ) T e x xt Dx, where D = Σ 1.

38 Replace h θ by its second order Taylor expansion arround its unique minimizer x ( 1 1 ) T 2 x Dx (x x ) T (Λ + D) (x x ), where Λ = θdiag ( e µ+x ), to get the approximation L(θ). The reinjection of the Taylor expansion in the initial Laplace transform expansion permits to get a correction term L(θ) = L(θ)I (θ), where I (θ) = [ ( )] det(i + ΣΛ)E v Σ 1/2 Z, with v(u) = exp { (x ) T D(e u 1 u } and Z N (0, 1). More detail can be found in [LAJRN16] 28/28

THIELE CENTRE. Orthonormal polynomial expansions and lognormal sum densities. Søren Asmussen, Pierre-Olivier Goffard and Patrick J.

THIELE CENTRE. Orthonormal polynomial expansions and lognormal sum densities. Søren Asmussen, Pierre-Olivier Goffard and Patrick J. THIELE CENTRE for applied mathematics in natural science Orthonormal polynomial expansions and lognormal sum densities Søren Asmussen, Pierre-Olivier Goffard and Patrick J. Laub Research Report No. 01

More information

Orthonormal polynomial expansions and lognormal sum densities

Orthonormal polynomial expansions and lognormal sum densities December 24, 2015 9:54 ws-book9x6 Norberg Festschrift main page 1 Chapter 1 Orthonormal polynomial expansions and lognormal sum densities By Søren Asmussen, Pierre-Olivier Goffard, Patrick J. Laub Abstract

More information

Polynomial approximation of mutivariate aggregate claim amounts distribution

Polynomial approximation of mutivariate aggregate claim amounts distribution Polynomial approximation of mutivariate aggregate claim amounts distribution Applications to reinsurance P.O. Goffard Axa France - Mathematics Institute of Marseille I2M Aix-Marseille University 19 th

More information

A polynomial expansion to approximate ruin probabilities

A polynomial expansion to approximate ruin probabilities A polynomial expansion to approximate ruin probabilities P.O. Goffard 1 X. Guerrault 2 S. Loisel 3 D. Pommerêt 4 1 Axa France - Institut de mathématiques de Luminy Université de Aix-Marseille 2 Axa France

More information

Two numerical methods to evaluate stop-loss premiums

Two numerical methods to evaluate stop-loss premiums Two numerical methods to evaluate stop-loss premiums Pierre-Olivier Goffard 1 and Patrick J. Laub 2 1 Department of Statistics and Applied Probability, University of California, Santa Barbara, USA 2 University

More information

Efficient rare-event simulation for sums of dependent random varia

Efficient rare-event simulation for sums of dependent random varia Efficient rare-event simulation for sums of dependent random variables Leonardo Rojas-Nandayapa joint work with José Blanchet February 13, 2012 MCQMC UNSW, Sydney, Australia Contents Introduction 1 Introduction

More information

Introduction to Rare Event Simulation

Introduction to Rare Event Simulation Introduction to Rare Event Simulation Brown University: Summer School on Rare Event Simulation Jose Blanchet Columbia University. Department of Statistics, Department of IEOR. Blanchet (Columbia) 1 / 31

More information

1 Review of Probability

1 Review of Probability 1 Review of Probability Random variables are denoted by X, Y, Z, etc. The cumulative distribution function (c.d.f.) of a random variable X is denoted by F (x) = P (X x), < x

More information

Proceedings of the 2016 Winter Simulation Conference T. M. K. Roeder, P. I. Frazier, R. Szechtman, E. Zhou, T. Huschka, and S. E. Chick, eds.

Proceedings of the 2016 Winter Simulation Conference T. M. K. Roeder, P. I. Frazier, R. Szechtman, E. Zhou, T. Huschka, and S. E. Chick, eds. Proceedings of the 2016 Winter Simulation Conference T. M. K. Roeder, P. I. Frazier, R. Szechtman, E. Zhou, T. Huschka, and S. E. Chick, eds. AN M-ESTIMATOR FOR RARE-EVENT PROBABILITY ESTIMATION Zdravko

More information

THIELE CENTRE. On the Laplace transform of the Lognormal distribution. Søren Asmussen, Jens Ledet Jensen and Leonardo Rojas-Nandayapa

THIELE CENTRE. On the Laplace transform of the Lognormal distribution. Søren Asmussen, Jens Ledet Jensen and Leonardo Rojas-Nandayapa THIELE CENTRE for applied mathematics in natural science On the Laplace transform of the Lognormal distribution Søren Asmussen, Jens Ledet Jensen and Leonardo Rojas-Nandayapa Research Report No. 06 November

More information

Statistics for scientists and engineers

Statistics for scientists and engineers Statistics for scientists and engineers February 0, 006 Contents Introduction. Motivation - why study statistics?................................... Examples..................................................3

More information

Random Matrix Eigenvalue Problems in Probabilistic Structural Mechanics

Random Matrix Eigenvalue Problems in Probabilistic Structural Mechanics Random Matrix Eigenvalue Problems in Probabilistic Structural Mechanics S Adhikari Department of Aerospace Engineering, University of Bristol, Bristol, U.K. URL: http://www.aer.bris.ac.uk/contact/academic/adhikari/home.html

More information

Week 1 Quantitative Analysis of Financial Markets Distributions A

Week 1 Quantitative Analysis of Financial Markets Distributions A Week 1 Quantitative Analysis of Financial Markets Distributions A Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 October

More information

Sums of dependent lognormal random variables: asymptotics and simulation

Sums of dependent lognormal random variables: asymptotics and simulation Sums of dependent lognormal random variables: asymptotics and simulation Søren Asmussen Leonardo Rojas-Nandayapa Department of Theoretical Statistics, Department of Mathematical Sciences Aarhus University,

More information

Monte-Carlo MMD-MA, Université Paris-Dauphine. Xiaolu Tan

Monte-Carlo MMD-MA, Université Paris-Dauphine. Xiaolu Tan Monte-Carlo MMD-MA, Université Paris-Dauphine Xiaolu Tan tan@ceremade.dauphine.fr Septembre 2015 Contents 1 Introduction 1 1.1 The principle.................................. 1 1.2 The error analysis

More information

Random Eigenvalue Problems Revisited

Random Eigenvalue Problems Revisited Random Eigenvalue Problems Revisited S Adhikari Department of Aerospace Engineering, University of Bristol, Bristol, U.K. Email: S.Adhikari@bristol.ac.uk URL: http://www.aer.bris.ac.uk/contact/academic/adhikari/home.html

More information

arxiv:cond-mat/ v2 [cond-mat.stat-mech] 23 Feb 1998

arxiv:cond-mat/ v2 [cond-mat.stat-mech] 23 Feb 1998 Multiplicative processes and power laws arxiv:cond-mat/978231v2 [cond-mat.stat-mech] 23 Feb 1998 Didier Sornette 1,2 1 Laboratoire de Physique de la Matière Condensée, CNRS UMR6632 Université des Sciences,

More information

STA205 Probability: Week 8 R. Wolpert

STA205 Probability: Week 8 R. Wolpert INFINITE COIN-TOSS AND THE LAWS OF LARGE NUMBERS The traditional interpretation of the probability of an event E is its asymptotic frequency: the limit as n of the fraction of n repeated, similar, and

More information

Asymptotic distribution of the sample average value-at-risk

Asymptotic distribution of the sample average value-at-risk Asymptotic distribution of the sample average value-at-risk Stoyan V. Stoyanov Svetlozar T. Rachev September 3, 7 Abstract In this paper, we prove a result for the asymptotic distribution of the sample

More information

EFFICIENT TAIL ESTIMATION FOR SUMS OF CORRELATED LOGNORMALS. Leonardo Rojas-Nandayapa Department of Mathematical Sciences

EFFICIENT TAIL ESTIMATION FOR SUMS OF CORRELATED LOGNORMALS. Leonardo Rojas-Nandayapa Department of Mathematical Sciences Proceedings of the 2008 Winter Simulation Conference S. J. Mason, R. R. Hill, L. Mönch, O. Rose, T. Jefferson, J. W. Fowler eds. EFFICIENT TAIL ESTIMATION FOR SUMS OF CORRELATED LOGNORMALS Jose Blanchet

More information

Gaussian vectors and central limit theorem

Gaussian vectors and central limit theorem Gaussian vectors and central limit theorem Samy Tindel Purdue University Probability Theory 2 - MA 539 Samy T. Gaussian vectors & CLT Probability Theory 1 / 86 Outline 1 Real Gaussian random variables

More information

Asymptotic Tail Probabilities of Sums of Dependent Subexponential Random Variables

Asymptotic Tail Probabilities of Sums of Dependent Subexponential Random Variables Asymptotic Tail Probabilities of Sums of Dependent Subexponential Random Variables Jaap Geluk 1 and Qihe Tang 2 1 Department of Mathematics The Petroleum Institute P.O. Box 2533, Abu Dhabi, United Arab

More information

where r n = dn+1 x(t)

where r n = dn+1 x(t) Random Variables Overview Probability Random variables Transforms of pdfs Moments and cumulants Useful distributions Random vectors Linear transformations of random vectors The multivariate normal distribution

More information

Method of Moments. which we usually denote by X or sometimes by X n to emphasize that there are n observations.

Method of Moments. which we usually denote by X or sometimes by X n to emphasize that there are n observations. Method of Moments Definition. If {X 1,..., X n } is a sample from a population, then the empirical k-th moment of this sample is defined to be X k 1 + + Xk n n Example. For a sample {X 1, X, X 3 } the

More information

Asymptotics of sums of lognormal random variables with Gaussian copula

Asymptotics of sums of lognormal random variables with Gaussian copula Asymptotics of sums of lognormal random variables with Gaussian copula Søren Asmussen, Leonardo Rojas-Nandayapa To cite this version: Søren Asmussen, Leonardo Rojas-Nandayapa. Asymptotics of sums of lognormal

More information

Shape of the return probability density function and extreme value statistics

Shape of the return probability density function and extreme value statistics Shape of the return probability density function and extreme value statistics 13/09/03 Int. Workshop on Risk and Regulation, Budapest Overview I aim to elucidate a relation between one field of research

More information

Stat 451 Lecture Notes Numerical Integration

Stat 451 Lecture Notes Numerical Integration Stat 451 Lecture Notes 03 12 Numerical Integration Ryan Martin UIC www.math.uic.edu/~rgmartin 1 Based on Chapter 5 in Givens & Hoeting, and Chapters 4 & 18 of Lange 2 Updated: February 11, 2016 1 / 29

More information

Approximation of Heavy-tailed distributions via infinite dimensional phase type distributions

Approximation of Heavy-tailed distributions via infinite dimensional phase type distributions 1 / 36 Approximation of Heavy-tailed distributions via infinite dimensional phase type distributions Leonardo Rojas-Nandayapa The University of Queensland ANZAPW March, 2015. Barossa Valley, SA, Australia.

More information

Explicit Bounds for the Distribution Function of the Sum of Dependent Normally Distributed Random Variables

Explicit Bounds for the Distribution Function of the Sum of Dependent Normally Distributed Random Variables Explicit Bounds for the Distribution Function of the Sum of Dependent Normally Distributed Random Variables Walter Schneider July 26, 20 Abstract In this paper an analytic expression is given for the bounds

More information

4. Distributions of Functions of Random Variables

4. Distributions of Functions of Random Variables 4. Distributions of Functions of Random Variables Setup: Consider as given the joint distribution of X 1,..., X n (i.e. consider as given f X1,...,X n and F X1,...,X n ) Consider k functions g 1 : R n

More information

EFFICIENT SIMULATION OF TAIL PROBABILITIES OF SUMS OF DEPENDENT RANDOM VARIABLES

EFFICIENT SIMULATION OF TAIL PROBABILITIES OF SUMS OF DEPENDENT RANDOM VARIABLES Applied Probability Trust (8 February 2011) EFFICIENT SIMULATION OF TAIL PROBABILITIES OF SUMS OF DEPENDENT RANDOM VARIABLES Abstract We study asymptotically optimal simulation algorithms for approximating

More information

Exponential Family Techniques for the Lognormal Left Tail

Exponential Family Techniques for the Lognormal Left Tail Exponential Family Techniques for the Lognormal Left Tail Søren Asmussen 1, Jens Ledet Jensen 1 and Leonardo Rojas-Nandayapa 2 arxiv:1403.4689v1 [math.pr] 19 Mar 2014 1 Department of Mathematics, Aarhus

More information

Weighted Exponential Distribution and Process

Weighted Exponential Distribution and Process Weighted Exponential Distribution and Process Jilesh V Some generalizations of exponential distribution and related time series models Thesis. Department of Statistics, University of Calicut, 200 Chapter

More information

Extreme Value Analysis and Spatial Extremes

Extreme Value Analysis and Spatial Extremes Extreme Value Analysis and Department of Statistics Purdue University 11/07/2013 Outline Motivation 1 Motivation 2 Extreme Value Theorem and 3 Bayesian Hierarchical Models Copula Models Max-stable Models

More information

Linear Models Review

Linear Models Review Linear Models Review Vectors in IR n will be written as ordered n-tuples which are understood to be column vectors, or n 1 matrices. A vector variable will be indicted with bold face, and the prime sign

More information

6.1 Moment Generating and Characteristic Functions

6.1 Moment Generating and Characteristic Functions Chapter 6 Limit Theorems The power statistics can mostly be seen when there is a large collection of data points and we are interested in understanding the macro state of the system, e.g., the average,

More information

Definition 1.1 (Parametric family of distributions) A parametric distribution is a set of distribution functions, each of which is determined by speci

Definition 1.1 (Parametric family of distributions) A parametric distribution is a set of distribution functions, each of which is determined by speci Definition 1.1 (Parametric family of distributions) A parametric distribution is a set of distribution functions, each of which is determined by specifying one or more values called parameters. The number

More information

On the Chi square and higher-order Chi distances for approximating f-divergences

On the Chi square and higher-order Chi distances for approximating f-divergences c 2013 Frank Nielsen, Sony Computer Science Laboratories, Inc. 1/17 On the Chi square and higher-order Chi distances for approximating f-divergences Frank Nielsen 1 Richard Nock 2 www.informationgeometry.org

More information

Multivariate Normal-Laplace Distribution and Processes

Multivariate Normal-Laplace Distribution and Processes CHAPTER 4 Multivariate Normal-Laplace Distribution and Processes The normal-laplace distribution, which results from the convolution of independent normal and Laplace random variables is introduced by

More information

Reflections and Rotations in R 3

Reflections and Rotations in R 3 Reflections and Rotations in R 3 P. J. Ryan May 29, 21 Rotations as Compositions of Reflections Recall that the reflection in the hyperplane H through the origin in R n is given by f(x) = x 2 ξ, x ξ (1)

More information

Randomly Weighted Sums of Conditionnally Dependent Random Variables

Randomly Weighted Sums of Conditionnally Dependent Random Variables Gen. Math. Notes, Vol. 25, No. 1, November 2014, pp.43-49 ISSN 2219-7184; Copyright c ICSRS Publication, 2014 www.i-csrs.org Available free online at http://www.geman.in Randomly Weighted Sums of Conditionnally

More information

3. Probability and Statistics

3. Probability and Statistics FE661 - Statistical Methods for Financial Engineering 3. Probability and Statistics Jitkomut Songsiri definitions, probability measures conditional expectations correlation and covariance some important

More information

Non-Life Insurance: Mathematics and Statistics

Non-Life Insurance: Mathematics and Statistics ETH Zürich, D-MATH HS 08 Prof. Dr. Mario V. Wüthrich Coordinator Andrea Gabrielli Non-Life Insurance: Mathematics and Statistics Solution sheet 9 Solution 9. Utility Indifference Price (a) Suppose that

More information

Ordinal Optimization and Multi Armed Bandit Techniques

Ordinal Optimization and Multi Armed Bandit Techniques Ordinal Optimization and Multi Armed Bandit Techniques Sandeep Juneja. with Peter Glynn September 10, 2014 The ordinal optimization problem Determining the best of d alternative designs for a system, on

More information

Statistical Methods in Particle Physics

Statistical Methods in Particle Physics Statistical Methods in Particle Physics Lecture 3 October 29, 2012 Silvia Masciocchi, GSI Darmstadt s.masciocchi@gsi.de Winter Semester 2012 / 13 Outline Reminder: Probability density function Cumulative

More information

conditional cdf, conditional pdf, total probability theorem?

conditional cdf, conditional pdf, total probability theorem? 6 Multiple Random Variables 6.0 INTRODUCTION scalar vs. random variable cdf, pdf transformation of a random variable conditional cdf, conditional pdf, total probability theorem expectation of a random

More information

Estimation of Quantiles

Estimation of Quantiles 9 Estimation of Quantiles The notion of quantiles was introduced in Section 3.2: recall that a quantile x α for an r.v. X is a constant such that P(X x α )=1 α. (9.1) In this chapter we examine quantiles

More information

Meixner matrix ensembles

Meixner matrix ensembles Meixner matrix ensembles W lodek Bryc 1 Cincinnati April 12, 2011 1 Based on joint work with Gerard Letac W lodek Bryc (Cincinnati) Meixner matrix ensembles April 12, 2011 1 / 29 Outline of talk Random

More information

Estimating Tail Probabilities of Heavy Tailed Distributions with Asymptotically Zero Relative Error

Estimating Tail Probabilities of Heavy Tailed Distributions with Asymptotically Zero Relative Error Estimating Tail Probabilities of Heavy Tailed Distributions with Asymptotically Zero Relative Error S. Juneja Tata Institute of Fundamental Research, Mumbai juneja@tifr.res.in February 28, 2007 Abstract

More information

f (x) = k=0 f (0) = k=0 k=0 a k k(0) k 1 = a 1 a 1 = f (0). a k k(k 1)x k 2, k=2 a k k(k 1)(0) k 2 = 2a 2 a 2 = f (0) 2 a k k(k 1)(k 2)x k 3, k=3

f (x) = k=0 f (0) = k=0 k=0 a k k(0) k 1 = a 1 a 1 = f (0). a k k(k 1)x k 2, k=2 a k k(k 1)(0) k 2 = 2a 2 a 2 = f (0) 2 a k k(k 1)(k 2)x k 3, k=3 1 M 13-Lecture Contents: 1) Taylor Polynomials 2) Taylor Series Centered at x a 3) Applications of Taylor Polynomials Taylor Series The previous section served as motivation and gave some useful expansion.

More information

On the Chi square and higher-order Chi distances for approximating f-divergences

On the Chi square and higher-order Chi distances for approximating f-divergences On the Chi square and higher-order Chi distances for approximating f-divergences Frank Nielsen, Senior Member, IEEE and Richard Nock, Nonmember Abstract We report closed-form formula for calculating the

More information

the convolution of f and g) given by

the convolution of f and g) given by 09:53 /5/2000 TOPIC Characteristic functions, cont d This lecture develops an inversion formula for recovering the density of a smooth random variable X from its characteristic function, and uses that

More information

Generalised Fractional-Black-Scholes Equation: pricing and hedging

Generalised Fractional-Black-Scholes Equation: pricing and hedging Generalised Fractional-Black-Scholes Equation: pricing and hedging Álvaro Cartea Birkbeck College, University of London April 2004 Outline Lévy processes Fractional calculus Fractional-Black-Scholes 1

More information

This ODE arises in many physical systems that we shall investigate. + ( + 1)u = 0. (λ + s)x λ + s + ( + 1) a λ. (s + 1)(s + 2) a 0

This ODE arises in many physical systems that we shall investigate. + ( + 1)u = 0. (λ + s)x λ + s + ( + 1) a λ. (s + 1)(s + 2) a 0 Legendre equation This ODE arises in many physical systems that we shall investigate We choose We then have Substitution gives ( x 2 ) d 2 u du 2x 2 dx dx + ( + )u u x s a λ x λ a du dx λ a λ (λ + s)x

More information

Multivariate Distribution Models

Multivariate Distribution Models Multivariate Distribution Models Model Description While the probability distribution for an individual random variable is called marginal, the probability distribution for multiple random variables is

More information

Fast Numerical Methods for Stochastic Computations

Fast Numerical Methods for Stochastic Computations Fast AreviewbyDongbinXiu May 16 th,2013 Outline Motivation 1 Motivation 2 3 4 5 Example: Burgers Equation Let us consider the Burger s equation: u t + uu x = νu xx, x [ 1, 1] u( 1) =1 u(1) = 1 Example:

More information

Branching Processes II: Convergence of critical branching to Feller s CSB

Branching Processes II: Convergence of critical branching to Feller s CSB Chapter 4 Branching Processes II: Convergence of critical branching to Feller s CSB Figure 4.1: Feller 4.1 Birth and Death Processes 4.1.1 Linear birth and death processes Branching processes can be studied

More information

Part IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015

Part IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015 Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.

More information

Chapter 7. Basic Probability Theory

Chapter 7. Basic Probability Theory Chapter 7. Basic Probability Theory I-Liang Chern October 20, 2016 1 / 49 What s kind of matrices satisfying RIP Random matrices with iid Gaussian entries iid Bernoulli entries (+/ 1) iid subgaussian entries

More information

Definition of a Stochastic Process

Definition of a Stochastic Process Definition of a Stochastic Process Balu Santhanam Dept. of E.C.E., University of New Mexico Fax: 505 277 8298 bsanthan@unm.edu August 26, 2018 Balu Santhanam (UNM) August 26, 2018 1 / 20 Overview 1 Stochastic

More information

Lecture Tricks with Random Variables: The Law of Large Numbers & The Central Limit Theorem

Lecture Tricks with Random Variables: The Law of Large Numbers & The Central Limit Theorem Math 408 - Mathematical Statistics Lecture 9-10. Tricks with Random Variables: The Law of Large Numbers & The Central Limit Theorem February 6-8, 2013 Konstantin Zuev (USC) Math 408, Lecture 9-10 February

More information

The moment-generating function of the log-normal distribution using the star probability measure

The moment-generating function of the log-normal distribution using the star probability measure Noname manuscript No. (will be inserted by the editor) The moment-generating function of the log-normal distribution using the star probability measure Yuri Heymann Received: date / Accepted: date Abstract

More information

Discrete Distributions Chapter 6

Discrete Distributions Chapter 6 Discrete Distributions Chapter 6 Negative Binomial Distribution section 6.3 Consider k r, r +,... independent Bernoulli trials with probability of success in one trial being p. Let the random variable

More information

3 Continuous Random Variables

3 Continuous Random Variables Jinguo Lian Math437 Notes January 15, 016 3 Continuous Random Variables Remember that discrete random variables can take only a countable number of possible values. On the other hand, a continuous random

More information

Chapter 5 continued. Chapter 5 sections

Chapter 5 continued. Chapter 5 sections Chapter 5 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions

More information

Formulas for probability theory and linear models SF2941

Formulas for probability theory and linear models SF2941 Formulas for probability theory and linear models SF2941 These pages + Appendix 2 of Gut) are permitted as assistance at the exam. 11 maj 2008 Selected formulae of probability Bivariate probability Transforms

More information

VaR vs. Expected Shortfall

VaR vs. Expected Shortfall VaR vs. Expected Shortfall Risk Measures under Solvency II Dietmar Pfeifer (2004) Risk measures and premium principles a comparison VaR vs. Expected Shortfall Dependence and its implications for risk measures

More information

A LOGARITHMIC EFFICIENT ESTIMATOR OF THE PROBABILITY OF RUIN WITH RECUPERATION FOR SPECTRALLY NEGATIVE LEVY RISK PROCESSES.

A LOGARITHMIC EFFICIENT ESTIMATOR OF THE PROBABILITY OF RUIN WITH RECUPERATION FOR SPECTRALLY NEGATIVE LEVY RISK PROCESSES. A LOGARITHMIC EFFICIENT ESTIMATOR OF THE PROBABILITY OF RUIN WITH RECUPERATION FOR SPECTRALLY NEGATIVE LEVY RISK PROCESSES Riccardo Gatto Submitted: April 204 Revised: July 204 Abstract This article provides

More information

) ) = γ. and P ( X. B(a, b) = Γ(a)Γ(b) Γ(a + b) ; (x + y, ) I J}. Then, (rx) a 1 (ry) b 1 e (x+y)r r 2 dxdy Γ(a)Γ(b) D

) ) = γ. and P ( X. B(a, b) = Γ(a)Γ(b) Γ(a + b) ; (x + y, ) I J}. Then, (rx) a 1 (ry) b 1 e (x+y)r r 2 dxdy Γ(a)Γ(b) D 3 Independent Random Variables II: Examples 3.1 Some functions of independent r.v. s. Let X 1, X 2,... be independent r.v. s with the known distributions. Then, one can compute the distribution of a r.v.

More information

Master s Written Examination

Master s Written Examination Master s Written Examination Option: Statistics and Probability Spring 016 Full points may be obtained for correct answers to eight questions. Each numbered question which may have several parts is worth

More information

Random variables. DS GA 1002 Probability and Statistics for Data Science.

Random variables. DS GA 1002 Probability and Statistics for Data Science. Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities

More information

Risk Aggregation. Paul Embrechts. Department of Mathematics, ETH Zurich Senior SFI Professor.

Risk Aggregation. Paul Embrechts. Department of Mathematics, ETH Zurich Senior SFI Professor. Risk Aggregation Paul Embrechts Department of Mathematics, ETH Zurich Senior SFI Professor www.math.ethz.ch/~embrechts/ Joint work with P. Arbenz and G. Puccetti 1 / 33 The background Query by practitioner

More information

EEL 5544 Noise in Linear Systems Lecture 30. X (s) = E [ e sx] f X (x)e sx dx. Moments can be found from the Laplace transform as

EEL 5544 Noise in Linear Systems Lecture 30. X (s) = E [ e sx] f X (x)e sx dx. Moments can be found from the Laplace transform as L30-1 EEL 5544 Noise in Linear Systems Lecture 30 OTHER TRANSFORMS For a continuous, nonnegative RV X, the Laplace transform of X is X (s) = E [ e sx] = 0 f X (x)e sx dx. For a nonnegative RV, the Laplace

More information

Lecture 3: Central Limit Theorem

Lecture 3: Central Limit Theorem Lecture 3: Central Limit Theorem Scribe: Jacy Bird (Division of Engineering and Applied Sciences, Harvard) February 8, 003 The goal of today s lecture is to investigate the asymptotic behavior of P N (

More information

Statistics (1): Estimation

Statistics (1): Estimation Statistics (1): Estimation Marco Banterlé, Christian Robert and Judith Rousseau Practicals 2014-2015 L3, MIDO, Université Paris Dauphine 1 Table des matières 1 Random variables, probability, expectation

More information

STATISTICAL METHODS FOR SIGNAL PROCESSING c Alfred Hero

STATISTICAL METHODS FOR SIGNAL PROCESSING c Alfred Hero STATISTICAL METHODS FOR SIGNAL PROCESSING c Alfred Hero 1999 32 Statistic used Meaning in plain english Reduction ratio T (X) [X 1,..., X n ] T, entire data sample RR 1 T (X) [X (1),..., X (n) ] T, rank

More information

Polynomial chaos expansions for structural reliability analysis

Polynomial chaos expansions for structural reliability analysis DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Polynomial chaos expansions for structural reliability analysis B. Sudret & S. Marelli Incl.

More information

Multivariate Distributions

Multivariate Distributions IEOR E4602: Quantitative Risk Management Spring 2016 c 2016 by Martin Haugh Multivariate Distributions We will study multivariate distributions in these notes, focusing 1 in particular on multivariate

More information

Spatially Smoothed Kernel Density Estimation via Generalized Empirical Likelihood

Spatially Smoothed Kernel Density Estimation via Generalized Empirical Likelihood Spatially Smoothed Kernel Density Estimation via Generalized Empirical Likelihood Kuangyu Wen & Ximing Wu Texas A&M University Info-Metrics Institute Conference: Recent Innovations in Info-Metrics October

More information

The multidimensional Ito Integral and the multidimensional Ito Formula. Eric Mu ller June 1, 2015 Seminar on Stochastic Geometry and its applications

The multidimensional Ito Integral and the multidimensional Ito Formula. Eric Mu ller June 1, 2015 Seminar on Stochastic Geometry and its applications The multidimensional Ito Integral and the multidimensional Ito Formula Eric Mu ller June 1, 215 Seminar on Stochastic Geometry and its applications page 2 Seminar on Stochastic Geometry and its applications

More information

Multivariate Random Variable

Multivariate Random Variable Multivariate Random Variable Author: Author: Andrés Hincapié and Linyi Cao This Version: August 7, 2016 Multivariate Random Variable 3 Now we consider models with more than one r.v. These are called multivariate

More information

Lifetime Dependence Modelling using a Generalized Multivariate Pareto Distribution

Lifetime Dependence Modelling using a Generalized Multivariate Pareto Distribution Lifetime Dependence Modelling using a Generalized Multivariate Pareto Distribution Daniel Alai Zinoviy Landsman Centre of Excellence in Population Ageing Research (CEPAR) School of Mathematics, Statistics

More information

The Laplace driven moving average a non-gaussian stationary process

The Laplace driven moving average a non-gaussian stationary process The Laplace driven moving average a non-gaussian stationary process 1, Krzysztof Podgórski 2, Igor Rychlik 1 1 Mathematical Sciences, Mathematical Statistics, Chalmers 2 Centre for Mathematical Sciences,

More information

n! (k 1)!(n k)! = F (X) U(0, 1). (x, y) = n(n 1) ( F (y) F (x) ) n 2

n! (k 1)!(n k)! = F (X) U(0, 1). (x, y) = n(n 1) ( F (y) F (x) ) n 2 Order statistics Ex. 4. (*. Let independent variables X,..., X n have U(0, distribution. Show that for every x (0,, we have P ( X ( < x and P ( X (n > x as n. Ex. 4.2 (**. By using induction or otherwise,

More information

A nonparametric test for trend based on initial ranks

A nonparametric test for trend based on initial ranks Journal of Statistical Computation and Simulation Vol. 76, No. 9, September 006, 89 837 A nonparametric test for trend based on initial ranks GLENN HOFMANN* and N. BALAKRISHNAN HSBC, USA ID Analytics,

More information

Basic concepts of probability theory

Basic concepts of probability theory Basic concepts of probability theory Random variable discrete/continuous random variable Transform Z transform, Laplace transform Distribution Geometric, mixed-geometric, Binomial, Poisson, exponential,

More information

Multiple Random Variables

Multiple Random Variables Multiple Random Variables Joint Probability Density Let X and Y be two random variables. Their joint distribution function is F ( XY x, y) P X x Y y. F XY ( ) 1, < x

More information

Northwestern University Department of Electrical Engineering and Computer Science

Northwestern University Department of Electrical Engineering and Computer Science Northwestern University Department of Electrical Engineering and Computer Science EECS 454: Modeling and Analysis of Communication Networks Spring 2008 Probability Review As discussed in Lecture 1, probability

More information

MS&E 321 Spring Stochastic Systems June 1, 2013 Prof. Peter W. Glynn Page 1 of 10. x n+1 = f(x n ),

MS&E 321 Spring Stochastic Systems June 1, 2013 Prof. Peter W. Glynn Page 1 of 10. x n+1 = f(x n ), MS&E 321 Spring 12-13 Stochastic Systems June 1, 2013 Prof. Peter W. Glynn Page 1 of 10 Section 4: Steady-State Theory Contents 4.1 The Concept of Stochastic Equilibrium.......................... 1 4.2

More information

Statistical Methods for Handling Incomplete Data Chapter 2: Likelihood-based approach

Statistical Methods for Handling Incomplete Data Chapter 2: Likelihood-based approach Statistical Methods for Handling Incomplete Data Chapter 2: Likelihood-based approach Jae-Kwang Kim Department of Statistics, Iowa State University Outline 1 Introduction 2 Observed likelihood 3 Mean Score

More information

1 Presessional Probability

1 Presessional Probability 1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional

More information

Nonlinear Filtering Revisited: a Spectral Approach, II

Nonlinear Filtering Revisited: a Spectral Approach, II Nonlinear Filtering Revisited: a Spectral Approach, II Sergey V. Lototsky Center for Applied Mathematical Sciences University of Southern California Los Angeles, CA 90089-3 sergey@cams-00.usc.edu Remijigus

More information

Basic concepts of probability theory

Basic concepts of probability theory Basic concepts of probability theory Random variable discrete/continuous random variable Transform Z transform, Laplace transform Distribution Geometric, mixed-geometric, Binomial, Poisson, exponential,

More information

Actuarial Science Exam 1/P

Actuarial Science Exam 1/P Actuarial Science Exam /P Ville A. Satopää December 5, 2009 Contents Review of Algebra and Calculus 2 2 Basic Probability Concepts 3 3 Conditional Probability and Independence 4 4 Combinatorial Principles,

More information

SOLUTIONS TO MATH68181 EXTREME VALUES AND FINANCIAL RISK EXAM

SOLUTIONS TO MATH68181 EXTREME VALUES AND FINANCIAL RISK EXAM SOLUTIONS TO MATH68181 EXTREME VALUES AND FINANCIAL RISK EXAM Solutions to Question A1 a) The marginal cdfs of F X,Y (x, y) = [1 + exp( x) + exp( y) + (1 α) exp( x y)] 1 are F X (x) = F X,Y (x, ) = [1

More information

From Gram-Charlier Series to Orthogonal Polynomials

From Gram-Charlier Series to Orthogonal Polynomials From Gram-Charlier Series to Orthogonal Polynomials HC Eggers University of Stellenbosch Workshop on Particle Correlations and Fluctuations 2008 Kraków Earlier work on Gram-Charlier Series (GCS) Work by

More information

Perhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows.

Perhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows. Chapter 5 Two Random Variables In a practical engineering problem, there is almost always causal relationship between different events. Some relationships are determined by physical laws, e.g., voltage

More information

1: PROBABILITY REVIEW

1: PROBABILITY REVIEW 1: PROBABILITY REVIEW Marek Rutkowski School of Mathematics and Statistics University of Sydney Semester 2, 2016 M. Rutkowski (USydney) Slides 1: Probability Review 1 / 56 Outline We will review the following

More information

Chapter 2 Continuous Distributions

Chapter 2 Continuous Distributions Chapter Continuous Distributions Continuous random variables For a continuous random variable X the probability distribution is described by the probability density function f(x), which has the following

More information

Lecture 2: Repetition of probability theory and statistics

Lecture 2: Repetition of probability theory and statistics Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:

More information