Generalized Laplacian Distributions and Autoregressive Processes

Size: px
Start display at page:

Download "Generalized Laplacian Distributions and Autoregressive Processes"

Transcription

1 CHAPTER Generalized Laplacian Distributions and Autoregressive Processes. Introduction Generalized Laplacian distribution corresponds to the distribution of differences of independently and identically distributed (i.i.d.) gamma random variables. Mathai (993a,b,c), Mathai et al. (006) discussed various generalizations of Laplace distribution and their applications in different contexts such as input-output processes, growth-decay mechanism, formation of sand dunes, growth of melatonin in human body, formation of solar neutrinos etc. Another variant namely, the skew Laplace distribution was introduced and studied in detail by Kozubowski and Podgórski (008a,b). Skew Laplace distribution arises as a mix- Some results included in this chapter form part of papers Jose and Manu (009) and Jose and Manu (0). 5

2 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES ture of normal distributions with stochastic variance having gamma distribution, and hence it is also called Variance Gamma Model. The tails of the variance gamma distribution decrease more slowly than the normal distribution. Due to the simplicity, flexibility and an excellent fit to empirical data, the variance gamma model is recently very popular among financial modelers. In the present chapter, we consider the generalized Laplacian distribution and a more general case namely bilateral gamma distribution. We develop first order autoregressive processes with generalized Laplacian marginals and the generation of the process. The regression behaviour and simulation of sample paths are discussed. We consider the distribution of sums and the covariance structure. We introduce the geometric generalized Laplacian distribution and study its properties. Geometric generalized Laplacian processes are discussed. The k th order autoregressive processes are described. Bilateral gamma distribution and its estimation of parameters and a numerical illustration is also carried out.. Generalized Laplacian distribution and its properties Mathai (993a,b,c) introduced a generalized Laplacian distribution with parameters α and β, which has the characteristic function (c.f.), φ(t) = ( + β t ) α, α > 0, β > 0. Kotz et al. (00) give a more general form of the generalized Laplacian distribution with more parameters and we concentrate on this form. The c.f is as follows φ(t) = e iθt ( + σ t iµt) τ, < t <, σ > 0, < µ <. 6

3 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES This c.f. can be factored as ( ) τ ( ) τ φ(t) = e iθt + i σ κt i σ, (..) κ t where κ > 0, µ = σ ( κ κ). The probability density function (p.d.f.) of generalized Laplace distribution (GL(θ, κ, σ, τ)) is h(x) = e σ ( κ κ)(x θ) πσ τ+ Γ(τ) ( x θ κ + κ ) τ ( ( K τ κ + ) ) x θ σ κ for x θ, (..) where K λ is the modified Bessel function of the third kind with the index λ, see Kotz et al. (00). There are some special cases associated with this distribution. A standard GL density is obtained for θ = 0 and σ =. For τ =, we have an asymmetric Laplace, and for κ = and θ = 0, we obtain a symmetric Laplace distribution. The p.d.f. (..) can also be written as ( ) ( ) τ / ( ) f(x) = (αβ) τ (α β)x x α + β exp K τ / x, α + β where α and β describe the left and right-tail behavior and τ is a parameter relating to the peakedness of the pdf (for details see Wu (008)). The mean value, variance, coefficients of skewness and kurtosis of generalized Laplacian distribution are obtained as Mean value = τµ, Variance = τ(µ + σ ). Coefficient of skewness = µ(µ + 3σ ) τ(µ + σ ) 3/. Coefficient of kurtosis = 3 + 3(µ4 + 4σ µ + 3σ 4 ) τ(µ + σ ). 7

4 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES Figure.: The histogram and frequency curve corresponding to GL(0,,, ) From the factorization of the c.f. of the generalized Laplacian distribution, it can be noted that a variable Y following GL(θ, κ, σ, τ) can be represented as Y d = θ + σ ( κ G κg ), where G and G are i.i.d. gamma random variables following one parameter gamma distribution with p.d.f., f Gi (x) = Γ(τ) e x x τ ; x > 0, τ > 0, i =,. The generalized Laplacian random variable Y also admits the representation of the form Y d = θ + µw + σ W Z, where Z is a standard normal variate and W is a gamma variate with parameters (τ,). Figure. gives the histogram and frequency curve corresponding to GL(0,,, ) obtained as the result of a simulation study..3 Generalized Laplacian autoregressive processes Consider the usual linear, additive first order autoregressive model given by X n = ax n + ε n, 0 < a <, n = 0, ±, ±,..., (.3.) 8

5 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES where {ε n } is the innovation sequence of i.i.d. random variables. The basic problem is to find the distribution of {ε n } such that {X n } has the generalized Laplacian distribution GL(θ, κ, σ, τ) as the stationary marginal distribution. The following theorem summarizes the results in this context. Theorem.3.. A necessary and sufficient condition that an AR() process of the form X n = ax n + ε n is stationary with GL(θ, κ, σ, τ) marginals is that the innovations {ε n } are i.i.d. as a convolution of the form X + Y Y as in (.3.3) provided ε 0 d = X 0. Proof. The necessary part can be proved as follows. In terms of the c.f., we can rewrite (.3.) in the form φ Xn (t) = φ Xn (at)φ εn (t). Under stationarity this yields φ ε (t) = φ X(t) φ X (at). Substituting the c.f. given by (..) we get, φ ɛ (t) = eiθt ( + i σ τ κat) ( i σ κ at) τ e iθat ( + i σ κt) τ ( i σ κ t) τ ] τ [ = e [a iθ( a)t + ( a) ( + i σ a + ( a) κt) ( i σ This implies that ε has a convolution structure of the following form. κ t) ] τ.(.3.) ε d = X + Y Y, (.3.3) where X is a degenerate random variable taking value θ( a) with probability one and Y and Y are τ -fold convolutions of T and T where, 0, with probability a T = E, with probability a 0, with probability a T = E, with probability a 9

6 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES where E and E are exponential random variables with means σ κ and σ κ respectively. When τ is integer valued, Y and Y can be easily generated as gamma convolutions. The sufficiency part can be proved by the method of induction. We assume that X n follows GL(θ, κ, σ, τ) with c.f. (..). φ Xn (t) = φ Xn (at)φ εn (t) [ = e iθat ( + i σ κat) τ ( i σ κ at) τ ( ) τ ( ) τ = e iθt + i σ κt i σ, κ t ] [ e iθ( a)t ( + i σ κat) τ ( i σ κ at) τ ( + i σ κt) τ ( i σ κ t) τ ] which is the same as the generalized Laplacian c.f. This shows that the process {X n } is strictly stationary with generalized Laplacian marginals, provided ε d 0 = X 0 which follows GL(θ, κ, σ, τ)..3. Generation of the process Irrespective of whether τ is integer-valued or not, the process can be generated using a [ τ compound Poisson representation. In (.3.), the expression a + ( a) σ κ t)] can be obtained as the c.f. of a compound Poisson distribution, see Lawrance (98). In N particular, this is the c.f. of the random sum a U i σ V i, where {V i } are gamma(, κ ) random variables, {U i } are i.i.d. random variables uniformly distributed on (0,), N is a Poisson random variable of mean τ ln a and all these random variables are independent. This can be proved as follows. N Let η = a U i σ V i, where {V i } are gamma(, κ ) random variables, {U i } are i.i.d. i= random variables uniformly distributed on (0,), N is a Poisson random variable of mean i= ( i 30

7 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES τ ln a. Then the c.f. of η can be obtained as φ η (t) = [ φv (a U t) ] n P [N = n] n=0 [ = φv (a U t) ] n e τ ln a ( τ ln a) n n! n=0 = exp ( τ ln a ( φ V (a U t) )) ( ( )) = exp τ ln a 0 ia u σ κ t du ( ( )) ia u σ = exp τ ln a κ t 0 ia u σ κ t du ( ( ( = exp τ ln ia σ ) ( ))) σ t ln i t κ κ [ ] τ = a + ( a) i σ. κ t Similarly we can generate the other gamma process also and taking the difference we can obtain a generalized Laplacian process. Remark.3.. If X 0 is distributed arbitrary, then also the process is asymptotically stationary with generalized Laplacian marginal distribution. Proof. We have n X n = ax n + ε n = a n X 0 + a l ε n l. n φ Xn (t) = φ X0 (a n t) φ ε (a l t) l=0 l=0 n n = φ X0 (a n t){exp(iθt( a) a l )} l=0 l=0 e iθt ( + i σ κt) τ ( i σ κ t) τ as n. [ ( + i σ κa l+ t) τ ( i σ κ a l+ t) τ ( + i σ κa l t) τ ( i σ κ a l t) τ ] 3

8 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES.3. Regression behaviour and sample path properties The forward regression equation for the process is given by E(X n X n = x) = ax + ( a)[θ + τµ]. Similarly the conditional variance is given by Var(X n X n = x) = ( a )τ(µ + σ ) where µ = σ ( κ κ ). In the backward direction, the conditional distribution of X n given X n+ = x has nonlinear regression and non-constant conditional variance. In this backward case we will proceed from the joint characteristic function of X n and X n+ following the steps described in Lawrance (978). Then we have, φ Xn,Xn+ (t, t ) = φ X(t + at )φ X (t ). φ X (at ) Differentiating this with respect to t and setting t = 0, t = t; i E[e itx n+ E(X n X n+ )] = φ X (at)φ X(t) φ X (at) = φ X(at)φ ε (t), (.3.4) where φ ε (t) is as defined in (.3.). Lawrance (978) showed that linear backward regression is only possible in the Gaussian case and that non-normal autoregressive processes are not time reversible as a result due to Weiss (977). In this case, E(X n X n ) E(X n X n+ ) so that the process is not time reversible..3.3 Observed sample path properties The sample path properties of the process are studied by generating 00 observations each from the generalized Laplacian process with various parameter (θ, κ, σ, τ) combina- 3

9 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES (a) (b) Figure.: (a) Sample path of the process for a = 0.8 and (θ, κ, σ, τ) = (0,,, ) (b) Sample path of the process for a = 0.3 and (θ, κ, σ, τ) = (0,,, ) (a) (b) Figure.3: (a) Sample path of the process for a = 0.3 and (θ, κ, σ, τ) = (0,.3,, ) (b) Sample path of the process for a = 0.3 and (θ, κ, σ, τ) = (0,.,.9, ) tions. In Figure.(a), we take a = 0.8 and the values of (θ, κ, σ, τ) as (0,,, ) and in Figures.(b),.3(a) and.3(b) we take a = 0.3 and parameter values as (0,,, ), (0,.3,, ) and (0,.,.9, ) respectively. The process exhibits both positive and negative values with upward as well as downward runs as evident from the figures. These figures point out the rich variety of contexts where the newly developed time series models can be applied. These observations can be verified by referring to the table showing P (X n < X n ). These probabilities are obtained by a simulation procedure. Sequences of 0,000 observations from generalized Laplacian process are generated repeatedly for ten times, and from each sequence the probability is estimated. Table. provides the 33

10 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES (θ, κ, σ, τ) (0,,, ) (0,.3,,) (0,.,.9,) (0,.5,.5,) a (0.00) (0.0035) (0.003) (0.003) (0.006) (0.007) (0.009) (0.0043) (0.007) (0.0038) (0.003) (0.007) (0.0034) (0.0033) (0.004) (0.0043) (0.004) (0.003) (0.0039) (0.0030) (0.007) (0.003) (0.003) (0.005) (0.007) (0.003) (0.003) (0.0034) (0.003) (0.007) (0.006) (0.004) (0.0036) (0.0043) (0.0034) (0.008) Table.: P (X n < X n ) for the generalized Laplacian process. average of such probabilities from the ten trials along with an estimate of variance for different values of a and for different combinations of (θ, κ, σ, τ)..3.4 Distribution of sums and joint distribution of (X n, X n+ ) When a stationary sequence X n is used, the distribution of sums T r = X n + X n+ + + X n+r is important. We have X n+j = a j X n + a j ε n+ + a j ε n+ + + ε n+j. 34

11 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES Hence T r = X n + X n+ + + X n+r r = [a j X n + a j ε n+ + + ε n+j ] j=0 = X n ( a r a ) r + j= ( ) a r j ε n+j. a The c.f. of T r is given by ( φ Tr (t) = φ Xn t ) r ( ar φ ε t ) ar j. a a j= φ Tr (t) = ar iθ(t e a ) [ + i σ κ ( ) ] τ[ ( ) ] t ar i σ a κ t a r τ a r e iθt( ar j ) a + ( a) ( j= + i σ κt ( ) ) a r j a τ a + ( a) ( i σ κ t ( ) ). a r j a τ The distribution of T r can be obtained by inverting the c.f. as the c.f. uniquely determines the distribution of a random variable. Now the joint distribution of (X n, X n+ ) can be given 35

12 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES in terms of c.f. as φ Xn,X n+ (t, t ) = E [ e (it X n+it X n+ ) ] = E [ e (it X n+it (ax n+ε n+ )) ] = E [ e (i(t +at )X n+it ε n+ ) ] = φ Xn (t + at )φ εn+ (t ) [ ] τ [ ] τ e iθ(t +t ) a + ( a) (+i σ κt a + ( a) σ ) ( i t ) = κ [ + i σ κ(t + at )] τ [ i σ κ (t + at )] τ. The above c.f. is not symmetric in t and t, demonstrating once again that the process is not time reversible. Remark.3.. The covariance between X n and X n is Cov(X n, X n ) = θ + ( a)τ µ θτµ. The correlation coefficient ρ is ρ = θ + ( a)τ µ θτµ. ( a )τ(µ + σ ) When θ = 0, ρ = τµ ( + a)(µ + σ )..4 Geometric generalized Laplacian distribution Here we introduce a new distribution namely the geometric generalized Laplacian distribution (GGLD(θ, µ, σ, τ )). Its c.f. is given by ψ(t) = + τ ln( + σ t iµt) iθt. (.4.) 36

13 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES The above c.f. ( ) ψ(t) can be written in the form φ(t) = exp, where φ(t) is ψ(t) the c.f. of the generalized Laplacian distribution, which is infinitely divisible. Therefore the geometric generalized Laplacian distribution is geometrically infinitely divisible (see Klebanov et al. (984), Pillai and Sandhya (990), Seethalekshmi and Jose (004a,b; 006)). Theorem.4.. Let X, X,... be i.i.d. GGLD(0, µ, σ, τ) random variables and N be geometric with mean p, such that P [N = k] = p( p)k, k =,,..., 0 < p <. Then Y = X + X + + X N d = GGLD(0, µ, σ, τ/p). Proof. The c.f. of Y is φ Y (t) = = = [φ X (t)] k p( p) k k= p/( + τ ln( + t σ iµt)) (( p)/( + τ ln( + t σ iµt)) + (τ/p) ln( + t σ iµt). Hence Y d = GGLD(0, µ, σ, τ/p). Theorem.4.. Geometric generalized Laplacian distribution GGLD(0, µ, σ, τ) is the limit distribution of geometric sum of random variables following GL(0, µ, σ, τ/n). Proof. We have [ + t σ iµt] τ/n = { + [ + t σ iµt] τ/n } is the c.f. of a probability distribution since generalized Laplacian distribution is infinitely divisible. Hence by Lemma 3. of Pillai (990), φ n (t) = { + n[( + t σ iµt)τ/n ]} is the c.f. of geometric sum of i.i.d. generalized Laplacian random variables. Taking limit 37

14 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES as n. φ(t) = lim n φ n (t) = { + lim n n[( + t σ iµt)τ/n ]} = [ + τ ln( + t σ iµt)]..4. Geometric generalized Laplacian processes Here we develop a first order autoregressive process with geometric generalized Laplacian marginals. Consider an autoregressive structure given by ε n, with probability p X n = X n + ε n, with probability p (.4.) where {X n } and {ε n } are independently distributed and 0 < p <. Now we shall construct an AR() process with stationary marginal distribution as GGLD(0, µ, σ, τ). Theorem.4.3. Consider a stationary autoregressive process {X n } with the structure as in (.4.). Then a necessary and sufficient condition that {X n } is stationary with GGLD(0, µ, σ, τ) marginal distribution, is that {ε n } follows GGLD(0, µ, σ, pτ). Proof. In terms of c.f.s, we can write the above model as φ Xn (t) = pφ εn (t) + ( p)φ Xn (t)φ εn (t). Assuming stationarity it reduces to the form φ X (t) = pφ ε (t) + ( p)φ X (t)φ ε (t). 38

15 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES Therefore φ ε (t) = Substituting, φ X (t) = φ X (t) p + ( p)φ X (t). + τ ln( + σ t iµt). We get φ ε (t) = + pτ ln( + σ t iµt). (.4.3) Hence ε n d = GGLD(0, µ, σ, pτ). Conversely assume that {ε n } are identically distributed as given by (.4.3), so that φ ε (t) = + pτ ln( + σ t iµt). Then φ X (t) = = pφ ε (t) ( p)φ ε (t) + τ ln( + t σ iµt). Hence it follows that X n is distributed as GGLD(0, µ, σ, τ)..4. Extension to higher order processes Consider a k th order autoregressive process having the following structure, ε n, with probability p, a X n + ε n, with probability p, X n = a X n + ε n, with probability p,,... a k X n k + ε n, with probability p k, where p + p + + p k = p, 0 p i, p, i =,,..., k and {ε n } is sequence of independently and identically distributed random variables. When a = a = = a k = a; 0 < a <, we can write the above model in terms of 39

16 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES characteristic functions as φ Xn (t) = pφ εn (t) + p φ Xn (at)φ εn (t) + + p k φ Xn k (at)φ εn (t). If {X n } is stationary, then φ X (t) = φ ε (t)[p + ( p)φ X (at)]. That is φ ε (t) = φ X (t) p + ( p)φ X (at). This shows that the innovation structure can be obtained as in the first order case..5 Bilateral gamma distribution and bilateral gamma processes Küchler and Tappe (008a,b) introduced and studied bilateral gamma distribution and its various properties and also developed an associated Lévy process namely bilateral gamma processes which have applications in modelling financial market fluctuations. A bilateral gamma distribution with parameters α, λ, α, λ > 0 (BG(α, λ, α, λ )) is defined as the distribution of the difference of two independent gamma variables with parameters (α, λ ) and (α, λ ). The characteristic function of a bilateral gamma distribution is The p.d.f. is f(x) = ϕ(t) = λ α λ α (λ + λ ) α Γ(α )Γ(α ) e λ x ( ) α ( ) α λ λ, t R. (.5.) λ it λ + it 0 ( v λ x + v λ + λ ) α e v dv, x > 0. 40

17 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES The density function can also be expressed by means of Whittaker function f(x) = λ α λ α (λ + λ ) (α +α ) Γ(α ) x (α +α ) e x (λ +λ ) W (α α ), (α +α ) (x (λ + λ )), x > 0, (.5.) where W λ,µ (z) = z λ e z Γ(µ λ + ) 0 ( t µ λ e t + t ) µ+λ dt for µ λ > z..5. Geometric bilateral gamma distribution Here, we introduce a new distribution namely the geometric bilateral gamma distribution (GBG(α, λ, α, λ )). Its characteristic function is given by ψ(t) = + α ln( it λ ) + α ln( + it λ ). (.5.3) ( ) The above characteristic function ψ(t) can be written in the form ϕ(t) = exp, ψ(t) where ϕ(t) is the characteristic function of the bilateral gamma distribution, which is infinitely divisible. Therefore the geometric bilateral gamma distribution is geometrically infinitely divisible, see Klebanov et al. (984). Theorem.5.. Let X, X,... are i.i.d. GBG(α, λ, α, λ ) random variables and N be geometric with mean p, such that P [N = k] = p( p)k, k =,,..., 0 < p <. Then Y = X + X + + X N d = GBG(α /p, λ, α /p, λ ). 4

18 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES Proof. The characteristic function of Y is ψ Y (t) = = = [ψ X (t)] k p( p) k k= p/( + α ln( it λ ) + α ln( + it λ )) (( p)/( + α ln( it λ ) + α ln( + it λ ))) + (α /p) ln( it λ ) + (α /p) ln( + it λ ). Hence Y d = GBG(α /p, λ, α /p, λ )..5. Geometric bilateral gamma processes Here, we develop a first-order autoregressive process with geometric bilateral gamma marginals. structure given by Consider an autoregressive structure given by Consider an autoregressive ε n, with probability p X n = X n + ε n, with probability p (.5.4) where {X n } and {ε n } are independently distributed and 0 < p <. Now we shall construct an AR() process with stationary marginal distribution as GBG (α, λ, α, λ ). The innovation structure can be derived by considering the characteristic functions on both sides of (.5.4), which will yield ψ Xn (t) = pψ εn (t) + ( p)ψ Xn (t)ψ εn (t). Assuming stationarity it reduces to the form ψ X (t) = pψ ε (t) + ( p)ψ X (t)ψ ε (t). 4

19 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES Therefore ψ ε (t) = ψ X (t) p + ( p)φ X (t). On substitution, we get ψ ε (t) = + pα ln( it λ ) + pα ln( + it λ ). Hence ε n d =GBG(pα, λ, pα, λ )..5.3 Estimation of parameters Bilateral gamma distributions are absolutely continuous with respect to the Lebesgue measure, because they are the convolution of two gamma distributions. In order to perform a maximum likelihood estimation, the density in terms of Whittaker function given in (.5.) is used. We take a sample of n observations. The logarithm of the likelihood function for Θ = (α, α, λ, λ ) is given by ( ln L(Θ) = n α ln λ + α ln λ α + α ( α + α + + n i= ) ( n i= ln x i ) ) ln(λ + λ ) ln Γ(α ) ( n ) x i λ λ i= ( ) ln W (α α ), (α +α ) ( x i (λ + λ )) (.5.5) The vector ˆΘ 0 obtained from the method of moments is taken as starting point for an algorithm, for example the Hooke-Jeeves algorithm (see Quarteroni et al. (00)), which maximizes the logarithmic likelihood function (.5.5) numerically. This gives a maximum likelihood estimate ˆΘ of the parameters. For more details see Küchler and Tappe (008b). Now we consider the estimation of parameters. We use the conditional least square approach to estimate the four parameters of bilateral gamma distribution. The conditional least square estimators are strongly consistent under certain conditions, see Klimko and Nelson (978). Let x 0, x,..., x k be a given set of observations of an AR() process {X n } 43

20 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES with bilateral gamma marginals. Then the conditional estimators of the parameters can be obtained by minimizing E = k [x n E(X n X n = x n )] = n= k n= [ ( α x n ax n ( a) α )]. λ λ We get the estimates of the parameters by solving the following equations recursively. â = ˆα = ˆα = ˆλ = ˆλ = k n= [ x n ( α λ α ( )] α λ α λ ( )] α λ α λ )] λ [x n [ k n= x n [ k ] λ k x n a x n ( a) k n= n= [ ] λ k k a x n x n ( a) k n= n= { [ k ] k x n a x n ( a)α k n= n= { [ k ] k x n a x n ( a)α k n= n= + λ λ α + λ λ α + α α λ + α α λ } }. These equations can be easily solved using standard software packages like Matlab, Maple etc. Tjetjep and Seneta (006) discussed the generalized method of moments to estimate the parameters in situations where the method of moments is not easily tractable. This resembles the method of minimum chi-squared estimation but applied to moments. This is based on the quantity: where M = min parameters M (i), ( ) M (i) MP (i) M E (i) =, M E (i) i 44

21 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES (a) (b) Figure.4: (a) The histogram of the log transformed data (b) The Q-Q plot for the data and bilateral gamma random variables where M P (i) is the moment expressed in terms of parameters and M E (i) is the sample moment. When the value of M = 0 it is clear that the totality of estimating equations for the model are consistent with each other and that there is a solution for the parameter estimates..5.4 Application to a financial data Now we apply the model to a data on daily exchange rates of Pound to Indian rupee during the period 004 to 008. The data is available in Hand Book of Statistics on the Indian Economy, published by Reserve Bank of India. From the data, the summary statistics obtained are as follows. Mean value = , Variance = , Coefficient of skewness = 0.39, Coefficient of kurtosis =

22 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES The parameter values are obtained by the generalized method of moments as α = , α = , λ = , λ = Here these estimated values make M equal to zero, showing that the model is consistent with the data. The histogram of the log transformed data is given in Figure.4(a) and the Q-Q plot is given in Figure.4(b). The Q-Q plot confirms that the distribution is a good fit for the data..6 Conclusion In this chapter the generalized Laplacian distribution is considered and its properties are studied. We developed first order autoregressive processes with generalized Laplacian marginals and the generation of the process. The regression behaviour and simulation of sample paths are discussed. We consider the distribution of sums and the covariance structure. We introduced the geometric generalized Laplacian distribution and its properties are studied. Geometric generalized Laplacian processes are discussed. The k th order autoregressive processes are described. A more general case namely bilateral gamma distribution is also considered. Its parameters are estimated using conditional least squares and generalized method of moments and a numerical illustration is also carried out. References Jose, K.K., Manu, M.T. (009). Bessel function processes, STARS International Journal (Sciences) (), Jose, K.K., Manu, M.T. (0). Generalized Laplacian distributions and autoregressive processes, Communications in Statistics - Theory and Methods 40, Klebanov, L.B., Maniya, G.M., Melamed, I.A. (984). A problem of Zolotarev and analogs of infinitely divisible and stable distribution in a scheme for summing a random num- 46

23 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES ber of random variables, Theory of Probability and its Applications 9, Klimko, L.A., Nelson, P.I. (978). On conditional least squares estimation for stochastic processes, Annals of Statistics 6(3), Kotz, S., Kozubowski, T.J., Podgorski, K. (00). The Laplace Distribution and Generalizations - A Revisit with Applications to Communications, Economics, Engineering and Finance, Birkhäuser, Boston. Kozubowski, T., Podgórski, K. (008a). Skew Laplace distributions I, their origins and inter-relations. The Mathematical Scientist 33, -34. Kozubowski, T., Podgórski, K. (008b). Skew Laplace distributions II, divisibility properties and extensions to stochastic processes. The Mathematical Scientist 33, 4. Küchler, U., Tappe, S. (008a). On the shapes of bilateral Gamma densities, Statistics and Probability Letters 78, Küchler, U., Tappe, S. (008b). Bilateral Gamma distributions and processes in financial Mathematics, Stochastic Processes and their Applications 8(), Lawrance, A.J. (978). Some autoregressive models for point processes, In Proceedings of Bolyai Mathematical Society Colloquiuon point processes and queuing problems 4, Hungary, Lawrance, A.J. (98). The innovation distribution of a gamma distributed autoregressive process, Scandinavian Journal of Statistics 9, Mathai, A.M., Saxena, R.K., Haubold, H.J. (006). A certain class of Laplace transforms with applications to reaction and reaction-diffusion equations, Astrophysics and Space Science 305, Mathai, A.M. (993a). On noncentral generalized Laplacian distribution, Journal of Statistical Research 7(-), Nos.,

24 CHAPTER. GENERALIZED LAPLACIAN DISTRIBUTIONS AND AUTOREGRESSIVE PROCESSES Mathai, A.M. (993b). On noncentral generalized Laplacianness of quadratic forms in normal variables, Journal of Multivariate Analysis 45(), Mathai, A.M. (993c). The residual effect of a growth-decay mechanism and the distribution of covariance structures, The Canadian Journal of Statistics (3) Pillai, R.N. (990). Harmonic mixtures and geometric infinite divisibility, Journal of Indian Statistical Association 8, Pillai, R.N., Sandhya, E. (990). Distributions with complete monotone derivative and geometric infinite divisibility, Advances in Applied Probability, Quarteroni, A., Sacco, R., Saleri, F. (00). Numerische Mathematik, Springer, Berlin. Seethalekshmi, V., Jose, K.K. (004a). An autoregressive process with geometric α- Laplace marginals, Statistical Papers 45, Seethalekshmi, V., Jose, K.K. (004b). Geometric Mittag-Leffler distributions and processes, Journal of Applied Statistical Science 3(4), Seethalekshmi, V., Jose, K.K. (006). Autoregressive process with Pakes and geometric Pakes generalized Linnik marginals, Statistics and Probability Letters 76(), Tjetjep, A., Seneta, E. (006). Skewed normal variance-mean models for asset pricing and the method of moments, International Statistical Review 74(), Weiss, G. (977). Shot noise models for the generation of synthetic streamflow data, Water Resources Research 3, Wu, F. (008). Applications of the normal Laplace and generalized normal Laplace Distributions, Unpublished M.Sc. Thesis, Department of Mathematics and Statistics, University of Victoria

Multivariate Normal-Laplace Distribution and Processes

Multivariate Normal-Laplace Distribution and Processes CHAPTER 4 Multivariate Normal-Laplace Distribution and Processes The normal-laplace distribution, which results from the convolution of independent normal and Laplace random variables is introduced by

More information

A Note on Certain Stability and Limiting Properties of ν-infinitely divisible distributions

A Note on Certain Stability and Limiting Properties of ν-infinitely divisible distributions Int. J. Contemp. Math. Sci., Vol. 1, 2006, no. 4, 155-161 A Note on Certain Stability and Limiting Properties of ν-infinitely divisible distributions Tomasz J. Kozubowski 1 Department of Mathematics &

More information

Weighted Exponential Distribution and Process

Weighted Exponential Distribution and Process Weighted Exponential Distribution and Process Jilesh V Some generalizations of exponential distribution and related time series models Thesis. Department of Statistics, University of Calicut, 200 Chapter

More information

Katz Family of Distributions and Processes

Katz Family of Distributions and Processes CHAPTER 7 Katz Family of Distributions and Processes 7. Introduction The Poisson distribution and the Negative binomial distribution are the most widely used discrete probability distributions for the

More information

Product Autoregressive Models with Log-Laplace and Double Pareto Log-normal Marginal Distributions

Product Autoregressive Models with Log-Laplace and Double Pareto Log-normal Marginal Distributions CHAPTER 6 Product Autoregressive Models with Log-Laplace and Double Pareto Log-normal Marginal Distributions 6.1 Introduction The relationships between Laplace and log-laplace distributions and double

More information

Laplace Distribution Based Stochastic Models

Laplace Distribution Based Stochastic Models Laplace Distribution Based Stochastic Models Anastassia Baxevani Department of Mathematics and Statistics University of Cyprus results based on work of/with Podgorski, Wegener, Aberg, Bolin, Walin July

More information

Some Generalizations of Weibull Distribution and Related Processes

Some Generalizations of Weibull Distribution and Related Processes Journal of Statistical Theory and Applications, Vol. 4, No. 4 (December 205), 425-434 Some Generalizations of Weibull Distribution and Related Processes K. Jayakumar Department of Statistics, University

More information

COMPOSITION SEMIGROUPS AND RANDOM STABILITY. By John Bunge Cornell University

COMPOSITION SEMIGROUPS AND RANDOM STABILITY. By John Bunge Cornell University The Annals of Probability 1996, Vol. 24, No. 3, 1476 1489 COMPOSITION SEMIGROUPS AND RANDOM STABILITY By John Bunge Cornell University A random variable X is N-divisible if it can be decomposed into a

More information

Multivariate Distributions

Multivariate Distributions IEOR E4602: Quantitative Risk Management Spring 2016 c 2016 by Martin Haugh Multivariate Distributions We will study multivariate distributions in these notes, focusing 1 in particular on multivariate

More information

A skew Laplace distribution on integers

A skew Laplace distribution on integers AISM (2006) 58: 555 571 DOI 10.1007/s10463-005-0029-1 Tomasz J. Kozubowski Seidu Inusah A skew Laplace distribution on integers Received: 17 November 2004 / Revised: 24 February 2005 / Published online:

More information

Volatility. Gerald P. Dwyer. February Clemson University

Volatility. Gerald P. Dwyer. February Clemson University Volatility Gerald P. Dwyer Clemson University February 2016 Outline 1 Volatility Characteristics of Time Series Heteroskedasticity Simpler Estimation Strategies Exponentially Weighted Moving Average Use

More information

Slash Distributions and Applications

Slash Distributions and Applications CHAPTER 2 Slash Distributions and Alications 2.1 Introduction The concet of slash distributions was introduced by Kafadar (1988) as a heavy tailed alternative to the normal distribution. Further literature

More information

The Laplace driven moving average a non-gaussian stationary process

The Laplace driven moving average a non-gaussian stationary process The Laplace driven moving average a non-gaussian stationary process 1, Krzysztof Podgórski 2, Igor Rychlik 1 1 Mathematical Sciences, Mathematical Statistics, Chalmers 2 Centre for Mathematical Sciences,

More information

Marshall-Olkin Univariate and Bivariate Logistic Processes

Marshall-Olkin Univariate and Bivariate Logistic Processes CHAPTER 5 Marshall-Olkin Univariate and Bivariate Logistic Processes 5. Introduction The logistic distribution is the most commonly used probability model for modelling data on population growth, bioassay,

More information

3. Probability and Statistics

3. Probability and Statistics FE661 - Statistical Methods for Financial Engineering 3. Probability and Statistics Jitkomut Songsiri definitions, probability measures conditional expectations correlation and covariance some important

More information

If we want to analyze experimental or simulated data we might encounter the following tasks:

If we want to analyze experimental or simulated data we might encounter the following tasks: Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction

More information

Chapter 5 continued. Chapter 5 sections

Chapter 5 continued. Chapter 5 sections Chapter 5 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions

More information

On the rate of convergence in limit theorems for geometric sums of i.i.d. random variables

On the rate of convergence in limit theorems for geometric sums of i.i.d. random variables On the rate of convergence in limit theorems for geometric sums of i.i.d. random variables Self-normalized Asymptotic Theory in Probability, Statistics and Econometrics IMS (NUS, Singapore), May 19-23,

More information

Time Series Analysis -- An Introduction -- AMS 586

Time Series Analysis -- An Introduction -- AMS 586 Time Series Analysis -- An Introduction -- AMS 586 1 Objectives of time series analysis Data description Data interpretation Modeling Control Prediction & Forecasting 2 Time-Series Data Numerical data

More information

Some Generalizations of Poisson Processes

Some Generalizations of Poisson Processes Journal of Statistical Theory and Applications Volume 11, Number 3, 212, pp. 225-235 ISSN 1538-7887 Some Generalizations of Poisson Processes Seetha Lekshmi, V. Dept.of Statistics, Nirmala College Muvattupuzha,

More information

Chapter 5. Chapter 5 sections

Chapter 5. Chapter 5 sections 1 / 43 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions

More information

Introduction to Probability Theory for Graduate Economics Fall 2008

Introduction to Probability Theory for Graduate Economics Fall 2008 Introduction to Probability Theory for Graduate Economics Fall 008 Yiğit Sağlam October 10, 008 CHAPTER - RANDOM VARIABLES AND EXPECTATION 1 1 Random Variables A random variable (RV) is a real-valued function

More information

Probability and Distributions

Probability and Distributions Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated

More information

University of Oxford. Statistical Methods Autocorrelation. Identification and Estimation

University of Oxford. Statistical Methods Autocorrelation. Identification and Estimation University of Oxford Statistical Methods Autocorrelation Identification and Estimation Dr. Órlaith Burke Michaelmas Term, 2011 Department of Statistics, 1 South Parks Road, Oxford OX1 3TG Contents 1 Model

More information

Renewal Theory and Geometric Infinite Divisibility

Renewal Theory and Geometric Infinite Divisibility ProbStat Models, 2, May-2003, Pages 1-8 Department of Statistics Valiavilakom Prajyoti Niketan College Ookode Pudukkad, Trichur 680 301 Trivandrum 695 020 India. India. esandhya@hotmail.com Received in

More information

Invariance Properties of the Negative Binomial Lévy Process and Stochastic Self-similarity

Invariance Properties of the Negative Binomial Lévy Process and Stochastic Self-similarity International Mathematical Forum, 2, 2007, no. 30, 1457-1468 Invariance Properties of the Negative Binomial Lévy Process and Stochastic Self-similarity Tomasz J. Kozubowski Department of Mathematics &

More information

Lecture 2: Univariate Time Series

Lecture 2: Univariate Time Series Lecture 2: Univariate Time Series Analysis: Conditional and Unconditional Densities, Stationarity, ARMA Processes Prof. Massimo Guidolin 20192 Financial Econometrics Spring/Winter 2017 Overview Motivation:

More information

GARCH Models Estimation and Inference

GARCH Models Estimation and Inference GARCH Models Estimation and Inference Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 1 Likelihood function The procedure most often used in estimating θ 0 in

More information

Formulas for probability theory and linear models SF2941

Formulas for probability theory and linear models SF2941 Formulas for probability theory and linear models SF2941 These pages + Appendix 2 of Gut) are permitted as assistance at the exam. 11 maj 2008 Selected formulae of probability Bivariate probability Transforms

More information

Discrete time processes

Discrete time processes Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following

More information

Does k-th Moment Exist?

Does k-th Moment Exist? Does k-th Moment Exist? Hitomi, K. 1 and Y. Nishiyama 2 1 Kyoto Institute of Technology, Japan 2 Institute of Economic Research, Kyoto University, Japan Email: hitomi@kit.ac.jp Keywords: Existence of moments,

More information

GARCH Models Estimation and Inference. Eduardo Rossi University of Pavia

GARCH Models Estimation and Inference. Eduardo Rossi University of Pavia GARCH Models Estimation and Inference Eduardo Rossi University of Pavia Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function

More information

CHAPTER 6 TIME SERIES AND STOCHASTIC PROCESSES

CHAPTER 6 TIME SERIES AND STOCHASTIC PROCESSES CHAPTER 6 TIME SERIES AND STOCHASTIC PROCESSES [This chapter is based on the lectures of K.K. Jose, Department of Statistics, St. Thomas College, Palai, Kerala, India at the 5th SERC School] 6.0. Introduction

More information

Parameter Estimation of the Stable GARCH(1,1)-Model

Parameter Estimation of the Stable GARCH(1,1)-Model WDS'09 Proceedings of Contributed Papers, Part I, 137 142, 2009. ISBN 978-80-7378-101-9 MATFYZPRESS Parameter Estimation of the Stable GARCH(1,1)-Model V. Omelchenko Charles University, Faculty of Mathematics

More information

Multiple Random Variables

Multiple Random Variables Multiple Random Variables Joint Probability Density Let X and Y be two random variables. Their joint distribution function is F ( XY x, y) P X x Y y. F XY ( ) 1, < x

More information

Lévy-VaR and the Protection of Banks and Insurance Companies. A joint work by. Olivier Le Courtois, Professor of Finance and Insurance.

Lévy-VaR and the Protection of Banks and Insurance Companies. A joint work by. Olivier Le Courtois, Professor of Finance and Insurance. Lévy-VaR and the Protection of Banks and Insurance Companies A joint work by Olivier Le Courtois, Professor of Finance and Insurance and Christian Walter, Actuary and Consultant Institutions : EM Lyon

More information

MAS223 Statistical Inference and Modelling Exercises

MAS223 Statistical Inference and Modelling Exercises MAS223 Statistical Inference and Modelling Exercises The exercises are grouped into sections, corresponding to chapters of the lecture notes Within each section exercises are divided into warm-up questions,

More information

Qualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama

Qualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama Qualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama Instructions This exam has 7 pages in total, numbered 1 to 7. Make sure your exam has all the pages. This exam will be 2 hours

More information

Stat 5101 Notes: Brand Name Distributions

Stat 5101 Notes: Brand Name Distributions Stat 5101 Notes: Brand Name Distributions Charles J. Geyer September 5, 2012 Contents 1 Discrete Uniform Distribution 2 2 General Discrete Uniform Distribution 2 3 Uniform Distribution 3 4 General Uniform

More information

Econ 424 Time Series Concepts

Econ 424 Time Series Concepts Econ 424 Time Series Concepts Eric Zivot January 20 2015 Time Series Processes Stochastic (Random) Process { 1 2 +1 } = { } = sequence of random variables indexed by time Observed time series of length

More information

Marshall-Olkin Bivariate Exponential Distribution: Generalisations and Applications

Marshall-Olkin Bivariate Exponential Distribution: Generalisations and Applications CHAPTER 6 Marshall-Olkin Bivariate Exponential Distribution: Generalisations and Applications 6.1 Introduction Exponential distributions have been introduced as a simple model for statistical analysis

More information

On q-gamma Distributions, Marshall-Olkin q-gamma Distributions and Minification Processes

On q-gamma Distributions, Marshall-Olkin q-gamma Distributions and Minification Processes CHAPTER 4 On q-gamma Distributions, Marshall-Olkin q-gamma Distributions and Minification Processes 4.1 Introduction Several skewed distributions such as logistic, Weibull, gamma and beta distributions

More information

LARGE DEVIATION PROBABILITIES FOR SUMS OF HEAVY-TAILED DEPENDENT RANDOM VECTORS*

LARGE DEVIATION PROBABILITIES FOR SUMS OF HEAVY-TAILED DEPENDENT RANDOM VECTORS* LARGE EVIATION PROBABILITIES FOR SUMS OF HEAVY-TAILE EPENENT RANOM VECTORS* Adam Jakubowski Alexander V. Nagaev Alexander Zaigraev Nicholas Copernicus University Faculty of Mathematics and Computer Science

More information

SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions

SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu

More information

GARCH Models Estimation and Inference

GARCH Models Estimation and Inference Università di Pavia GARCH Models Estimation and Inference Eduardo Rossi Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function

More information

Convolution Based Unit Root Processes: a Simulation Approach

Convolution Based Unit Root Processes: a Simulation Approach International Journal of Statistics and Probability; Vol., No. 6; November 26 ISSN 927-732 E-ISSN 927-74 Published by Canadian Center of Science and Education Convolution Based Unit Root Processes: a Simulation

More information

Chapter 2. Discrete Distributions

Chapter 2. Discrete Distributions Chapter. Discrete Distributions Objectives ˆ Basic Concepts & Epectations ˆ Binomial, Poisson, Geometric, Negative Binomial, and Hypergeometric Distributions ˆ Introduction to the Maimum Likelihood Estimation

More information

CONTAGION VERSUS FLIGHT TO QUALITY IN FINANCIAL MARKETS

CONTAGION VERSUS FLIGHT TO QUALITY IN FINANCIAL MARKETS EVA IV, CONTAGION VERSUS FLIGHT TO QUALITY IN FINANCIAL MARKETS Jose Olmo Department of Economics City University, London (joint work with Jesús Gonzalo, Universidad Carlos III de Madrid) 4th Conference

More information

Some functional (Hölderian) limit theorems and their applications (II)

Some functional (Hölderian) limit theorems and their applications (II) Some functional (Hölderian) limit theorems and their applications (II) Alfredas Račkauskas Vilnius University Outils Statistiques et Probabilistes pour la Finance Université de Rouen June 1 5, Rouen (Rouen

More information

Asymptotic distribution of the sample average value-at-risk

Asymptotic distribution of the sample average value-at-risk Asymptotic distribution of the sample average value-at-risk Stoyan V. Stoyanov Svetlozar T. Rachev September 3, 7 Abstract In this paper, we prove a result for the asymptotic distribution of the sample

More information

STAT Financial Time Series

STAT Financial Time Series STAT 6104 - Financial Time Series Chapter 9 - Heteroskedasticity Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 43 Agenda 1 Introduction 2 AutoRegressive Conditional Heteroskedastic Model (ARCH)

More information

Stochastic Volatility and Correction to the Heat Equation

Stochastic Volatility and Correction to the Heat Equation Stochastic Volatility and Correction to the Heat Equation Jean-Pierre Fouque, George Papanicolaou and Ronnie Sircar Abstract. From a probabilist s point of view the Twentieth Century has been a century

More information

1.1 Review of Probability Theory

1.1 Review of Probability Theory 1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,

More information

ELEMENTS OF PROBABILITY THEORY

ELEMENTS OF PROBABILITY THEORY ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable

More information

Statistics 3858 : Maximum Likelihood Estimators

Statistics 3858 : Maximum Likelihood Estimators Statistics 3858 : Maximum Likelihood Estimators 1 Method of Maximum Likelihood In this method we construct the so called likelihood function, that is L(θ) = L(θ; X 1, X 2,..., X n ) = f n (X 1, X 2,...,

More information

Master s Written Examination - Solution

Master s Written Examination - Solution Master s Written Examination - Solution Spring 204 Problem Stat 40 Suppose X and X 2 have the joint pdf f X,X 2 (x, x 2 ) = 2e (x +x 2 ), 0 < x < x 2

More information

Some Contra-Arguments for the Use of Stable Distributions in Financial Modeling

Some Contra-Arguments for the Use of Stable Distributions in Financial Modeling arxiv:1602.00256v1 [stat.ap] 31 Jan 2016 Some Contra-Arguments for the Use of Stable Distributions in Financial Modeling Lev B Klebanov, Gregory Temnov, Ashot V. Kakosyan Abstract In the present paper,

More information

A Short Course in Basic Statistics

A Short Course in Basic Statistics A Short Course in Basic Statistics Ian Schindler November 5, 2017 Creative commons license share and share alike BY: C 1 Descriptive Statistics 1.1 Presenting statistical data Definition 1 A statistical

More information

Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics. Jiti Gao

Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics. Jiti Gao Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics Jiti Gao Department of Statistics School of Mathematics and Statistics The University of Western Australia Crawley

More information

Pattern Recognition and Machine Learning. Bishop Chapter 2: Probability Distributions

Pattern Recognition and Machine Learning. Bishop Chapter 2: Probability Distributions Pattern Recognition and Machine Learning Chapter 2: Probability Distributions Cécile Amblard Alex Kläser Jakob Verbeek October 11, 27 Probability Distributions: General Density Estimation: given a finite

More information

Random Variables and Their Distributions

Random Variables and Their Distributions Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital

More information

Jump-type Levy Processes

Jump-type Levy Processes Jump-type Levy Processes Ernst Eberlein Handbook of Financial Time Series Outline Table of contents Probabilistic Structure of Levy Processes Levy process Levy-Ito decomposition Jump part Probabilistic

More information

Random Vectors and Multivariate Normal Distributions

Random Vectors and Multivariate Normal Distributions Chapter 3 Random Vectors and Multivariate Normal Distributions 3.1 Random vectors Definition 3.1.1. Random vector. Random vectors are vectors of random 75 variables. For instance, X = X 1 X 2., where each

More information

t x 1 e t dt, and simplify the answer when possible (for example, when r is a positive even number). In particular, confirm that EX 4 = 3.

t x 1 e t dt, and simplify the answer when possible (for example, when r is a positive even number). In particular, confirm that EX 4 = 3. Mathematical Statistics: Homewor problems General guideline. While woring outside the classroom, use any help you want, including people, computer algebra systems, Internet, and solution manuals, but mae

More information

1 Presessional Probability

1 Presessional Probability 1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional

More information

MGR-815. Notes for the MGR-815 course. 12 June School of Superior Technology. Professor Zbigniew Dziong

MGR-815. Notes for the MGR-815 course. 12 June School of Superior Technology. Professor Zbigniew Dziong Modeling, Estimation and Control, for Telecommunication Networks Notes for the MGR-815 course 12 June 2010 School of Superior Technology Professor Zbigniew Dziong 1 Table of Contents Preface 5 1. Example

More information

Time Series 2. Robert Almgren. Sept. 21, 2009

Time Series 2. Robert Almgren. Sept. 21, 2009 Time Series 2 Robert Almgren Sept. 21, 2009 This week we will talk about linear time series models: AR, MA, ARMA, ARIMA, etc. First we will talk about theory and after we will talk about fitting the models

More information

Tail dependence coefficient of generalized hyperbolic distribution

Tail dependence coefficient of generalized hyperbolic distribution Tail dependence coefficient of generalized hyperbolic distribution Mohalilou Aleiyouka Laboratoire de mathématiques appliquées du Havre Université du Havre Normandie Le Havre France mouhaliloune@gmail.com

More information

Econometría 2: Análisis de series de Tiempo

Econometría 2: Análisis de series de Tiempo Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 II. Basic definitions A time series is a set of observations X t, each

More information

Asymptotic Statistics-III. Changliang Zou

Asymptotic Statistics-III. Changliang Zou Asymptotic Statistics-III Changliang Zou The multivariate central limit theorem Theorem (Multivariate CLT for iid case) Let X i be iid random p-vectors with mean µ and and covariance matrix Σ. Then n (

More information

Joint Distributions. (a) Scalar multiplication: k = c d. (b) Product of two matrices: c d. (c) The transpose of a matrix:

Joint Distributions. (a) Scalar multiplication: k = c d. (b) Product of two matrices: c d. (c) The transpose of a matrix: Joint Distributions Joint Distributions A bivariate normal distribution generalizes the concept of normal distribution to bivariate random variables It requires a matrix formulation of quadratic forms,

More information

Understanding Regressions with Observations Collected at High Frequency over Long Span

Understanding Regressions with Observations Collected at High Frequency over Long Span Understanding Regressions with Observations Collected at High Frequency over Long Span Yoosoon Chang Department of Economics, Indiana University Joon Y. Park Department of Economics, Indiana University

More information

Computational statistics

Computational statistics Computational statistics Markov Chain Monte Carlo methods Thierry Denœux March 2017 Thierry Denœux Computational statistics March 2017 1 / 71 Contents of this chapter When a target density f can be evaluated

More information

Nonlinear Time Series Modeling

Nonlinear Time Series Modeling Nonlinear Time Series Modeling Part II: Time Series Models in Finance Richard A. Davis Colorado State University (http://www.stat.colostate.edu/~rdavis/lectures) MaPhySto Workshop Copenhagen September

More information

A Marshall-Olkin Gamma Distribution and Process

A Marshall-Olkin Gamma Distribution and Process CHAPTER 3 A Marshall-Olkin Gamma Distribution and Process 3.1 Introduction Gamma distribution is a widely used distribution in many fields such as lifetime data analysis, reliability, hydrology, medicine,

More information

Modeling point processes by the stochastic differential equation

Modeling point processes by the stochastic differential equation Modeling point processes by the stochastic differential equation Vygintas Gontis, Bronislovas Kaulakys, Miglius Alaburda and Julius Ruseckas Institute of Theoretical Physics and Astronomy of Vilnius University,

More information

Mathematics Ph.D. Qualifying Examination Stat Probability, January 2018

Mathematics Ph.D. Qualifying Examination Stat Probability, January 2018 Mathematics Ph.D. Qualifying Examination Stat 52800 Probability, January 2018 NOTE: Answers all questions completely. Justify every step. Time allowed: 3 hours. 1. Let X 1,..., X n be a random sample from

More information

ECON 3150/4150, Spring term Lecture 6

ECON 3150/4150, Spring term Lecture 6 ECON 3150/4150, Spring term 2013. Lecture 6 Review of theoretical statistics for econometric modelling (II) Ragnar Nymoen University of Oslo 31 January 2013 1 / 25 References to Lecture 3 and 6 Lecture

More information

Conditional Distributions

Conditional Distributions Conditional Distributions The goal is to provide a general definition of the conditional distribution of Y given X, when (X, Y ) are jointly distributed. Let F be a distribution function on R. Let G(,

More information

Estimation, Inference, and Hypothesis Testing

Estimation, Inference, and Hypothesis Testing Chapter 2 Estimation, Inference, and Hypothesis Testing Note: The primary reference for these notes is Ch. 7 and 8 of Casella & Berger 2. This text may be challenging if new to this topic and Ch. 7 of

More information

Module 9: Stationary Processes

Module 9: Stationary Processes Module 9: Stationary Processes Lecture 1 Stationary Processes 1 Introduction A stationary process is a stochastic process whose joint probability distribution does not change when shifted in time or space.

More information

Shape of the return probability density function and extreme value statistics

Shape of the return probability density function and extreme value statistics Shape of the return probability density function and extreme value statistics 13/09/03 Int. Workshop on Risk and Regulation, Budapest Overview I aim to elucidate a relation between one field of research

More information

Estimation of the long Memory parameter using an Infinite Source Poisson model applied to transmission rate measurements

Estimation of the long Memory parameter using an Infinite Source Poisson model applied to transmission rate measurements of the long Memory parameter using an Infinite Source Poisson model applied to transmission rate measurements François Roueff Ecole Nat. Sup. des Télécommunications 46 rue Barrault, 75634 Paris cedex 13,

More information

7. MULTIVARATE STATIONARY PROCESSES

7. MULTIVARATE STATIONARY PROCESSES 7. MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalar-valued random variables on the same probability

More information

Comprehensive Examination Quantitative Methods Spring, 2018

Comprehensive Examination Quantitative Methods Spring, 2018 Comprehensive Examination Quantitative Methods Spring, 2018 Instruction: This exam consists of three parts. You are required to answer all the questions in all the parts. 1 Grading policy: 1. Each part

More information

5: MULTIVARATE STATIONARY PROCESSES

5: MULTIVARATE STATIONARY PROCESSES 5: MULTIVARATE STATIONARY PROCESSES 1 1 Some Preliminary Definitions and Concepts Random Vector: A vector X = (X 1,..., X n ) whose components are scalarvalued random variables on the same probability

More information

Infinite Divisibility and Max-Infinite Divisibility with Random Sample Size

Infinite Divisibility and Max-Infinite Divisibility with Random Sample Size Statistical Methods 5 (2), 2003, 126-139 Infinite Divisibility and Max-Infinite Divisibility with Random Sample Size S. Satheesh Department of Statistics Cochin University of Science and Technology Cochin

More information

Gumbel Distribution: Generalizations and Applications

Gumbel Distribution: Generalizations and Applications CHAPTER 3 Gumbel Distribution: Generalizations and Applications 31 Introduction Extreme Value Theory is widely used by many researchers in applied sciences when faced with modeling extreme values of certain

More information

1 Exercises for lecture 1

1 Exercises for lecture 1 1 Exercises for lecture 1 Exercise 1 a) Show that if F is symmetric with respect to µ, and E( X )

More information

Optimization. The value x is called a maximizer of f and is written argmax X f. g(λx + (1 λ)y) < λg(x) + (1 λ)g(y) 0 < λ < 1; x, y X.

Optimization. The value x is called a maximizer of f and is written argmax X f. g(λx + (1 λ)y) < λg(x) + (1 λ)g(y) 0 < λ < 1; x, y X. Optimization Background: Problem: given a function f(x) defined on X, find x such that f(x ) f(x) for all x X. The value x is called a maximizer of f and is written argmax X f. In general, argmax X f may

More information

Generalised Fractional-Black-Scholes Equation: pricing and hedging

Generalised Fractional-Black-Scholes Equation: pricing and hedging Generalised Fractional-Black-Scholes Equation: pricing and hedging Álvaro Cartea Birkbeck College, University of London April 2004 Outline Lévy processes Fractional calculus Fractional-Black-Scholes 1

More information

Issues on quantile autoregression

Issues on quantile autoregression Issues on quantile autoregression Jianqing Fan and Yingying Fan We congratulate Koenker and Xiao on their interesting and important contribution to the quantile autoregression (QAR). The paper provides

More information

On Discrete Distributions Generated through Mittag-Leffler Function and their Properties

On Discrete Distributions Generated through Mittag-Leffler Function and their Properties On Discrete Distributions Generated through Mittag-Leffler Function and their Properties Mariamma Antony Department of Statistics Little Flower College, Guruvayur Kerala, India Abstract The Poisson distribution

More information

MFM Practitioner Module: Quantitative Risk Management. John Dodson. September 23, 2015

MFM Practitioner Module: Quantitative Risk Management. John Dodson. September 23, 2015 MFM Practitioner Module: Quantitative Risk Management September 23, 2015 Mixtures Mixtures Mixtures Definitions For our purposes, A random variable is a quantity whose value is not known to us right now

More information

RESEARCH REPORT. Estimation of sample spacing in stochastic processes. Anders Rønn-Nielsen, Jon Sporring and Eva B.

RESEARCH REPORT. Estimation of sample spacing in stochastic processes.   Anders Rønn-Nielsen, Jon Sporring and Eva B. CENTRE FOR STOCHASTIC GEOMETRY AND ADVANCED BIOIMAGING www.csgb.dk RESEARCH REPORT 6 Anders Rønn-Nielsen, Jon Sporring and Eva B. Vedel Jensen Estimation of sample spacing in stochastic processes No. 7,

More information

X t = a t + r t, (7.1)

X t = a t + r t, (7.1) Chapter 7 State Space Models 71 Introduction State Space models, developed over the past 10 20 years, are alternative models for time series They include both the ARIMA models of Chapters 3 6 and the Classical

More information

Mathematics Qualifying Examination January 2015 STAT Mathematical Statistics

Mathematics Qualifying Examination January 2015 STAT Mathematical Statistics Mathematics Qualifying Examination January 2015 STAT 52800 - Mathematical Statistics NOTE: Answer all questions completely and justify your derivations and steps. A calculator and statistical tables (normal,

More information

Nonlinear time series

Nonlinear time series Based on the book by Fan/Yao: Nonlinear Time Series Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna October 27, 2009 Outline Characteristics of

More information

CHANGE DETECTION IN TIME SERIES

CHANGE DETECTION IN TIME SERIES CHANGE DETECTION IN TIME SERIES Edit Gombay TIES - 2008 University of British Columbia, Kelowna June 8-13, 2008 Outline Introduction Results Examples References Introduction sunspot.year 0 50 100 150 1700

More information

STA 2201/442 Assignment 2

STA 2201/442 Assignment 2 STA 2201/442 Assignment 2 1. This is about how to simulate from a continuous univariate distribution. Let the random variable X have a continuous distribution with density f X (x) and cumulative distribution

More information