Laplace Distribution Based Stochastic Models

Size: px
Start display at page:

Download "Laplace Distribution Based Stochastic Models"

Transcription

1 Laplace Distribution Based Stochastic Models Anastassia Baxevani Department of Mathematics and Statistics University of Cyprus results based on work of/with Podgorski, Wegener, Aberg, Bolin, Walin July 2, 213

2 Outline 1 Introduction 2 Laplace distributions and their generalizations 3 Stochastic processes build upon Laplace distribution 4 Model fitting, estimation

3 Mathematical Models In spatial statistics and geostatistics, Gaussian random fields are important tools for constructing models for data. This is mainly because of their simplicity: they are specified through the mean and covariance structures, which is what is needed for prediction and estimation.

4 Mathematical Models In spatial statistics and geostatistics, Gaussian random fields are important tools for constructing models for data. This is mainly because of their simplicity: they are specified through the mean and covariance structures, which is what is needed for prediction and estimation. Drawback: they have difficulty in efficiently accounting for asymmetries and unusually extreme values in the data. When data exhibit such characteristics is usual to consider transformed Gaussian models, with the choice of transformation driven by the particular application.

5 Mathematical Models In spatial statistics and geostatistics, Gaussian random fields are important tools for constructing models for data. This is mainly because of their simplicity: they are specified through the mean and covariance structures, which is what is needed for prediction and estimation. Drawback: they have difficulty in efficiently accounting for asymmetries and unusually extreme values in the data. When data exhibit such characteristics is usual to consider transformed Gaussian models, with the choice of transformation driven by the particular application. To provide with a more universal model, there is a growing interest in models featuring more general distributions: Laplace moving average models, are formulated as convolutions of Laplace noise and some deterministic kernel and theoretically, they constitute a rich class that is capable of modeling a variety of geometrical asymmetries in the records, and simultaneously can efficiently account for occasional highly extreme events.

6 Outline 1 Introduction 2 Laplace distributions and their generalizations 3 Stochastic processes build upon Laplace distribution 4 Model fitting, estimation

7 Asymmetric Laplace distribution Characteristic function: φ(t) = e itδ 1 + σ 2 t 2 /2 µit where δ for location, usually δ =, µ shape, σ > the scale parameter.

8 Asymmetric Laplace distribution Characteristic function: φ(t) = e itδ 1 + σ 2 t 2 /2 µit where δ for location, usually δ =, µ shape, σ > the scale parameter. There is an analog of the Central Limit Theorem with random number of terms in the summation: If ν p is a geometric random variable with mean 1/p (waiting until failure) and independent of Y i s which have finite variances, then the random sum ν p S p = a p (Y i + b p) converges in distribution to an asymmetric Laplace distribution - -stability with respect to geometric summation. i=1

9 Generalized skewed Laplace distribution Generalized skewed Laplace distributions have ch.f. φ(t) = e itδ (1 + σ 2 t 2 /2 iµt) ν

10 Generalized skewed Laplace distribution Generalized skewed Laplace distributions have ch.f. φ(t) = e itδ (1 + σ 2 t 2 /2 iµt) ν !=1/4.8.6 Standard Gaussian!= infinity Standard Laplace!= Standard Gaussian Asymmetric Laplace!=1.4.6!=3.2!=1/4!3!2! !1.5!1! Left: µ = Right: µ = 3σ 2 3/2 and τ = 1/ν

11 Generalized skewed Laplace distribution, cont. Equivalent expressions:

12 Generalized skewed Laplace distribution, cont. Equivalent expressions: Gamma variance-mean mixtures of normal σ W Z + µw + δ, Z standard normal, W gamma variable with the shape ν independent of Z.

13 Generalized skewed Laplace distribution, cont. Equivalent expressions: Gamma variance-mean mixtures of normal σ W Z + µw + δ, Z standard normal, W gamma variable with the shape ν independent of Z. W 1, W 2 independent exponential. κw 1 1 κ W 2 + δ The equivalent expressions give rise to different parameterizations! Choice should be based on the purpose, i.e. inference or theoretical properties?

14 Multivariate extension Gamma variance models Y = δ + Γ µ + Γ 1/2 Σ 1/2 Z where Γ is a gamma variable with the shape parameter ν and Z has a multivariate normal distribution.

15 Multivariate extension Gamma variance models Y = δ + Γ µ + Γ 1/2 Σ 1/2 Z where Γ is a gamma variable with the shape parameter ν and Z has a multivariate normal distribution. Characteristics function ( ) ν φ(t) = e iδ t 1, t R d t Σt iµ t

16 Multivariate extension Gamma variance models Y = δ + Γ µ + Γ 1/2 Σ 1/2 Z where Γ is a gamma variable with the shape parameter ν and Z has a multivariate normal distribution. Characteristics function ( ) ν φ(t) = e iδ t 1, t R d t Σt iµ t Density 2 exp(µ Σ 1 (y δ)) (2π) d/2 Γ(ν) Σ 1/2 ( ) ν d/2 Q(y δ) K ν d/2(q(y δ)c(σ, µ)), C(Σ, µ) where Q(x) = x Σ 1 x and C(Σ, µ) = 2 + µ Σ 1 µ.

17 Examples of the densities

18 Outline 1 Introduction 2 Laplace distributions and their generalizations 3 Stochastic processes build upon Laplace distribution 4 Model fitting, estimation

19 Stochastic Laplace measure A stochastic Laplace measure, Λ with parameters δ R, µ R and σ > and controlled by a measure m, is a σ-additive function: Λ : (X, B, m) L 2 (Ω, F, P) : Λ(A) GL(µ, σ, 1 m(a) ), A B

20 Stochastic Laplace measure A stochastic Laplace measure, Λ with parameters δ R, µ R and σ > and controlled by a measure m, is a σ-additive function: Λ : (X, B, m) L 2 (Ω, F, P) : Λ(A) GL(µ, σ, 1 m(a) ), A B φ Λ(A) (t) = e itδm(a) (1 + σ 2 t 2 /2 µit) m(a)

21 Stochastic Laplace measure A stochastic Laplace measure, Λ with parameters δ R, µ R and σ > and controlled by a measure m, is a σ-additive function: Λ : (X, B, m) L 2 (Ω, F, P) : Λ(A) GL(µ, σ, 1 m(a) ), A B φ Λ(A) (t) = e itδm(a) (1 + σ 2 t 2 /2 µit) m(a) for disjoint A i B, Λ(A i ) are independent and with probability one Λ( i=1 A i) = Λ(A i ). i=1

22 Stochastic Laplace measure A stochastic Laplace measure, Λ with parameters δ R, µ R and σ > and controlled by a measure m, is a σ-additive function: Λ : (X, B, m) L 2 (Ω, F, P) : Λ(A) GL(µ, σ, 1 m(a) ), A B φ Λ(A) (t) = e itδm(a) (1 + σ 2 t 2 /2 µit) m(a) for disjoint A i B, Λ(A i ) are independent and with probability one Λ( i=1 A i) = Λ(A i ). i=1 Note: E(Λ(A)) = µm(a), Var(Λ(A)) = (µ 2 + σ 2 )m(a)

23 Laplace motion A Laplace motion L(t) with the asymmetry parameter µ, the space scale parameter σ and the time scale parameter ν, is defined by the following: it starts from the origin, L() = it has independent and stationary increments L(t + ν) L(t) GL(, σ, 1), i.e has an asymmetric Laplace distribution, centered in mean at zero, with parameter µ and σ. Relation to measure is through Λ(a, b] = L(b) L(a)

24 Alternatively, Laplace motion can be defined through... B(λ) denote standard Brownian motion

25 Alternatively, Laplace motion can be defined through... B(λ) denote standard Brownian motion Γ(λ) a standard gamma process, i.e. Lévy motion with density γ = νdλ g(x) = 1 Γ(γ) x γ 1 e x, x >

26 Alternatively, Laplace motion can be defined through... B(λ) denote standard Brownian motion Γ(λ) a standard gamma process, i.e. Lévy motion with density γ = νdλ g(x) = 1 Γ(γ) x γ 1 e x, x > Laplace motion - subordinated Brownian motion L(λ) = B(Γ(λ))

27 Alternatively, Laplace motion can be defined through... B(λ) denote standard Brownian motion Γ(λ) a standard gamma process, i.e. Lévy motion with density γ = νdλ g(x) = 1 Γ(γ) x γ 1 e x, x > Laplace motion - subordinated Brownian motion L(λ) = B(Γ(λ)) Some properties are inherited from the distribution (stochastic self-similarity): pl(λ) = L(NBp (λ)), where NB p is binomial Lévy motion.

28 Moving averages through stochastic integration Standard construction of stochastic integrals with deterministic kernels : X(τ) = f (τ x)dλ(x). R

29 Moving averages through stochastic integration Standard construction of stochastic integrals with deterministic kernels : X(τ) = f (τ x)dλ(x). Characteristic function ( φ X (t) = e itδ fdm exp Extension to multivariate case is immediate. R R log(1 iµtf (x) + σ2 t 2 f 2 ) (x) )dm(x). 2

30 Moving averages through stochastic integration Standard construction of stochastic integrals with deterministic kernels : X(τ) = f (τ x)dλ(x). Characteristic function ( φ X (t) = e itδ fdm exp Extension to multivariate case is immediate. Covariance : Spectral density: R R r(τ) = σ2 + µ 2 ν log(1 iµtf (x) + σ2 t 2 f 2 ) (x) )dm(x). 2 f (x τ)f (x)dx R(ω) = σ2 + µ 2 Ff (ω)ff ( ω) ν

31 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν

32 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν 1 Pick equally spaced grid: dt 2dt ndt

33 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν 1 Pick equally spaced grid: dt 2dt ndt 2 Simulate n i.i.d Γ( dt ν, 1) and store them in G

34 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν 1 Pick equally spaced grid: dt 2dt ndt 2 Simulate n i.i.d Γ( dt ν, 1) and store them in G 3 Simulate n i.i.d N(, σ 2 G i ) and store them in B

35 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν 1 Pick equally spaced grid: dt 2dt ndt 2 Simulate n i.i.d Γ( dt ν, 1) and store them in G 3 Simulate n i.i.d N(, σ 2 G i ) and store them in B 4 Compute X = d f (x)dx + µ(f G) + f B

36 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν 1 Pick equally spaced grid: dt 2dt ndt 2 Simulate n i.i.d Γ( dt ν, 1) and store them in G 3 Simulate n i.i.d N(, σ 2 G i ) and store them in B 4 Compute X = d f (x)dx + µ(f G) + f B 5 Remove the first and last m entries, where m is the length of f

37 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν 1 Pick equally spaced grid: dt 2dt ndt 2 Simulate n i.i.d Γ( dt ν, 1) and store them in G 3 Simulate n i.i.d N(, σ 2 G i ) and store them in B 4 Compute X = d f (x)dx + µ(f G) + f B 5 Remove the first and last m entries, where m is the length of f Very fast and efficient but it looses some resolution where the jumps of the Gamma process occur because of the grid! For d > 1 we simulate GL increments

38 Symmetric spatial models - realizations

39 Asymmetric spatial models

40 Outline 1 Introduction 2 Laplace distributions and their generalizations 3 Stochastic processes build upon Laplace distribution 4 Model fitting, estimation

41 Fitting the model The problem of fitting the model is two folded:

42 Fitting the model The problem of fitting the model is two folded: Fit the kernel

43 Fitting the model The problem of fitting the model is two folded: Fit the kernel Fit the Laplace noice

44 Symmetric kernel case

45 Symmetric kernel case A non-parametric approach is to estimate f by f (x) = F 1 Ŝ(ω), where Ŝ(ω) is an estimate of spectrum

46 Non-symmetric kernels measures of asymmetries There is no general non-parametric approach to the problem.

47 Non-symmetric kernels measures of asymmetries There is no general non-parametric approach to the problem. Various parametrized families of kernels are available

48 Non-symmetric kernels measures of asymmetries There is no general non-parametric approach to the problem. Various parametrized families of kernels are available Measures of asymmetries for random surfaces should involve moments of joint distributions of the process and its derivative

49 Non-symmetric kernels measures of asymmetries There is no general non-parametric approach to the problem. Various parametrized families of kernels are available Measures of asymmetries for random surfaces should involve moments of joint distributions of the process and its derivative Estimation of distributional and kernel parameters has to be performed through solution of the resulting equations.

50 Laplace moving average trajectories

51 Measuring tilting using Rice s formula N(T, A) number of times the field X takes value zero in [, T ] and at the same time has a property A

52 Measuring tilting using Rice s formula N(T, A) number of times the field X takes value zero in [, T ] and at the same time has a property A For ergodic stationary processes ] N(T, A) E [{X A} Ẋ() X() = lim = [ ], T N(T ) E Ẋ() X() =

53 Measuring tilting using Rice s formula N(T, A) number of times the field X takes value zero in [, T ] and at the same time has a property A For ergodic stationary processes ] N(T, A) E [{X A} Ẋ() X() = lim = [ ], T N(T ) E Ẋ() X() = The right hand side represents the biased sampling distribution when sampling is made over the -level contour C = {τ : X(τ ) = }

54 Tilting of trajectories empirical theoretical 1 empirical theoretical relative number relative number derivative at down/upcrossing of level u= derivative at down/upcrossing of level u=

55 Tilting o LMA with odd kernels 5 4 level derivative at down/upcrossing f (x; α, β) = C sgn(x) x α 1 e x /β, α > 1/2, β >. Marginal distribution of LMA always symmetric, but trajectories may exhibit some asymmetric features due to asymmetry of kernel.

56 Measures of tilting Measures of tilting should involve derivatives of the LMA process. We propose: ρ 3 = EẊ 3 E 3/2Ẋ 2, - skewness of the derivative process. If process has symmetric distribution, this measure fails to capture any asymmetries in the records!

57 Measures of tilting Measures of tilting should involve derivatives of the LMA process. We propose: ρ 3 = EẊ 3 E 3/2Ẋ 2, - skewness of the derivative process. If process has symmetric distribution, this measure fails to capture any asymmetries in the records! ρ 3,1 = E(Ẋ 3 X) E 3/2Ẋ 2 E 1/2 X or r 2 3,1 = E(Ẋ 3 X) E 2 X 2

58 The Gamma kernel f (x; τ, β) = 2 τ 1/2 Γ(2τ 1)β τ 1/2 x τ 1 e x/β x, τ >, β >, - for τ = 1 exponential for τ Gaussian case.

59 The Gamma kernel f (x; τ, β) = 2 τ 1/2 Γ(2τ 1)β τ 1/2 x τ 1 e x/β x, τ >, β >, - for τ = 1 exponential for τ Gaussian case. r 31 = 3ν 42(2 τ) (τ 1)Γ(4τ 6) β 4 Γ 2 (2τ 1), τ > 3/2.

60 The Gamma kernel f (x; τ, β) = 2 τ 1/2 Γ(2τ 1)β τ 1/2 x τ 1 e x/β x, τ >, β >, - for τ = 1 exponential for τ Gaussian case. r 31 = 3ν 42(2 τ) (τ 1)Γ(4τ 6) β 4 Γ 2 (2τ 1) τ E(ˆτ) Std(ˆτ) , τ > 3/2. Monte-Carlo estimation of τ, for ν = 1 and µ =. Hundred Monte-Carlo replicates of sample size of 3, with step.1.

61 The Gamma kernel, cont scaled Gamma kernel τ=2 τ=4 τ= τ τ β = 1 and tilting measures r 31 (top), and ρ 31 (bottom) as functions of τ.

62 Distributional parameters - Method of moments

63 Distributional parameters - Method of moments Moments of any integer order are available for LMA - the first four central moments are explicitely available and can be used to fit the four distributional parameters: E X = µ ( fdm, E (X E X) 2 = µ 2 + σ 2) ( E (X E X) 3 =µ 2µ 2 + 3σ 2) ( E (X E X) 4 =3 µ 2 + σ 2) ( 2 f 3 dm, f 2 dm, 2 ( f dm) µ 4 + 4µ 2 σ 2 + σ 4) f 4 dm

64 Distributional parameters - Method of moments Moments of any integer order are available for LMA - the first four central moments are explicitely available and can be used to fit the four distributional parameters: E X = µ ( fdm, E (X E X) 2 = µ 2 + σ 2) ( E (X E X) 3 =µ 2µ 2 + 3σ 2) ( E (X E X) 4 =3 µ 2 + σ 2) ( 2 f 3 dm, f 2 dm, 2 ( f dm) µ 4 + 4µ 2 σ 2 + σ 4) f 4 dm The method of moments estimation is not the most efficient way of estimation

65 Distributional parameters - Method of moments Moments of any integer order are available for LMA - the first four central moments are explicitely available and can be used to fit the four distributional parameters: E X = µ ( fdm, E (X E X) 2 = µ 2 + σ 2) ( E (X E X) 3 =µ 2µ 2 + 3σ 2) ( E (X E X) 4 =3 µ 2 + σ 2) ( 2 f 3 dm, f 2 dm, 2 ( f dm) µ 4 + 4µ 2 σ 2 + σ 4) f 4 dm The method of moments estimation is not the most efficient way of estimation Empirical moments may fall outside the range permitted by the parameters of the distribution

66 MLE estimation System of moment equations that would account for both distributional and kernel parameters maybe fairly complex

67 MLE estimation System of moment equations that would account for both distributional and kernel parameters maybe fairly complex More efficiently, one can attempt Maximum Likelihood Estimation

68 MLE estimation System of moment equations that would account for both distributional and kernel parameters maybe fairly complex More efficiently, one can attempt Maximum Likelihood Estimation Explicit formula for the MLE estimation can not be obtained except for some very special cases since the density of a generalized Laplace distribution is given through the Bessel function for the Laplace moving averages only characteristics functions can be written in an explicit fashion Numerical optimization has to be implemented

69 MLE estimation through EM algorithm Representation of GL distribution as σ ΓZ + µγ + δ is used and gamma variable Γ with parameter τ is treated as a missing value

70 MLE estimation through EM algorithm Representation of GL distribution as σ ΓZ + µγ + δ is used and gamma variable Γ with parameter τ is treated as a missing value For implementation of the algorithm see Podgórski and Wallin, EM algorithm for maximizing likelihood of linear models involving generalized Laplace distribution, under preparation.

71 MME vs. MLE - illustration The MME estimates of parameters (crosses) vs. the MLE ones (dots). The true parameters δ =.33, σ = 1.5, µ = 1.32, and τ =.25 are marked by the large star.

72 Highlights

73 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data.

74 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions.

75 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions. Resulting stationary second order processes have, as opposed to their Gaussian counterpart, a possibility of accounting for asymmetry and heavier tails.

76 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions. Resulting stationary second order processes have, as opposed to their Gaussian counterpart, a possibility of accounting for asymmetry and heavier tails. Despite this greater flexibility the discussed models still share a lot of spectral properties with Gaussian processes having the latter as a special case.

77 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions. Resulting stationary second order processes have, as opposed to their Gaussian counterpart, a possibility of accounting for asymmetry and heavier tails. Despite this greater flexibility the discussed models still share a lot of spectral properties with Gaussian processes having the latter as a special case. The models extend directly to random fields.

78 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions. Resulting stationary second order processes have, as opposed to their Gaussian counterpart, a possibility of accounting for asymmetry and heavier tails. Despite this greater flexibility the discussed models still share a lot of spectral properties with Gaussian processes having the latter as a special case. The models extend directly to random fields. Spatio-temporal characteristics including asymmetries in the records can be studied by the means of generalized Rice s formula.

79 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions. Resulting stationary second order processes have, as opposed to their Gaussian counterpart, a possibility of accounting for asymmetry and heavier tails. Despite this greater flexibility the discussed models still share a lot of spectral properties with Gaussian processes having the latter as a special case. The models extend directly to random fields. Spatio-temporal characteristics including asymmetries in the records can be studied by the means of generalized Rice s formula. Model fitting can be obtained by utilizing: a) Method of Moments (simpler) or b) Maximum Likelihood (more accurate)

80 Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions. Resulting stationary second order processes have, as opposed to their Gaussian counterpart, a possibility of accounting for asymmetry and heavier tails. Despite this greater flexibility the discussed models still share a lot of spectral properties with Gaussian processes having the latter as a special case. The models extend directly to random fields. Spatio-temporal characteristics including asymmetries in the records can be studied by the means of generalized Rice s formula. Model fitting can be obtained by utilizing: a) Method of Moments (simpler) or b) Maximum Likelihood (more accurate) Markov Random Fields can be used to localize efficiently the fitting problem and provide a way to account for non-stationarity in the data. Highlights

81 List of related papers Kotz, S., Kozubowski, T.J., Podgórski, K. (21). The Laplace distribution and generalizations: A revisit with applications to communications, economics, engineering and finance. Boston: Birkhaüser. Åberg, S. and Podgórski, K. (211). A class of non-gaussian second order random fields. Extremes Podgórski, K. and Wegener, J. (21). Estimation for stochastic models driven by Laplace motion. Comm. Statist. - Theory and Methods.

82 List of related papers Kotz, S., Kozubowski, T.J., Podgórski, K. (21). The Laplace distribution and generalizations: A revisit with applications to communications, economics, engineering and finance. Boston: Birkhaüser. Åberg, S. and Podgórski, K. (211). A class of non-gaussian second order random fields. Extremes Podgórski, K. and Wegener, J. (21). Estimation for stochastic models driven by Laplace motion. Comm. Statist. - Theory and Methods. Lindgren, F., Rue, H., and Lindström, J. (211). An explicit link between gaussian fields and gaussian markov random fields: the stochastic partial differential equation approach. J. Royal Stat. Soc., Series B. Lindgren, G., Bolin, D., Lindgren, F. (21) Non-traditional stochastic models for ocean waves Lagrange models and nested SPDE models. European Phys. J.

83 List of related papers Kotz, S., Kozubowski, T.J., Podgórski, K. (21). The Laplace distribution and generalizations: A revisit with applications to communications, economics, engineering and finance. Boston: Birkhaüser. Åberg, S. and Podgórski, K. (211). A class of non-gaussian second order random fields. Extremes Podgórski, K. and Wegener, J. (21). Estimation for stochastic models driven by Laplace motion. Comm. Statist. - Theory and Methods. Lindgren, F., Rue, H., and Lindström, J. (211). An explicit link between gaussian fields and gaussian markov random fields: the stochastic partial differential equation approach. J. Royal Stat. Soc., Series B. Lindgren, G., Bolin, D., Lindgren, F. (21) Non-traditional stochastic models for ocean waves Lagrange models and nested SPDE models. European Phys. J. Bolin, D. (211). Non-gaussian spatial models generated by stochastic partial differential equations. Podgórski, K., Walin, J. (211). The EM-algorithm for models involving generalized Laplace distribution. In progress

84 List of related papers Kotz, S., Kozubowski, T.J., Podgórski, K. (21). The Laplace distribution and generalizations: A revisit with applications to communications, economics, engineering and finance. Boston: Birkhaüser. Åberg, S. and Podgórski, K. (211). A class of non-gaussian second order random fields. Extremes Podgórski, K. and Wegener, J. (21). Estimation for stochastic models driven by Laplace motion. Comm. Statist. - Theory and Methods. Lindgren, F., Rue, H., and Lindström, J. (211). An explicit link between gaussian fields and gaussian markov random fields: the stochastic partial differential equation approach. J. Royal Stat. Soc., Series B. Lindgren, G., Bolin, D., Lindgren, F. (21) Non-traditional stochastic models for ocean waves Lagrange models and nested SPDE models. European Phys. J. Bolin, D. (211). Non-gaussian spatial models generated by stochastic partial differential equations. Podgórski, K., Walin, J. (211). The EM-algorithm for models involving generalized Laplace distribution. In progress Baxevani A., Podgórski, K. and Wegener, J. (212). Vertical and Horizontal asymmetries for moving averages driven by Laplace motion. In progress Baxevani A. and Podgórski, K., (212). Spectral representation of Laplace moving average process. In progress

85 Final Slide

86 Final Slide The French physicist Gabriel Lippman wrote the following in a letter to Henri Poincare. Tout le monde y croit cependent, car les experimenteurs s imaginent que c est un theorem de mathematiques, et les mathematiciens que c est un fait experimental. Everybody believes in the exponential law of errors: the experimenters, because they think it can be proved by mathematics; and the mathematicians, because they believe it has been established by observation.

The Laplace driven moving average a non-gaussian stationary process

The Laplace driven moving average a non-gaussian stationary process The Laplace driven moving average a non-gaussian stationary process 1, Krzysztof Podgórski 2, Igor Rychlik 1 1 Mathematical Sciences, Mathematical Statistics, Chalmers 2 Centre for Mathematical Sciences,

More information

PREPRINT 2012:13. Note on modeling of fatigue damage rates for non-gaussian stresses IGOR RYCHLIK

PREPRINT 2012:13. Note on modeling of fatigue damage rates for non-gaussian stresses IGOR RYCHLIK PREPRINT 2012:13 Note on modeling of fatigue damage rates for non-gaussian stresses IGOR RYCHLIK Department of Mathematical Sciences Division of Mathematics CHALMERS UNIVERSITY OF TECHNOLOGY UNIVERSITY

More information

A Note on Certain Stability and Limiting Properties of ν-infinitely divisible distributions

A Note on Certain Stability and Limiting Properties of ν-infinitely divisible distributions Int. J. Contemp. Math. Sci., Vol. 1, 2006, no. 4, 155-161 A Note on Certain Stability and Limiting Properties of ν-infinitely divisible distributions Tomasz J. Kozubowski 1 Department of Mathematics &

More information

State Space Representation of Gaussian Processes

State Space Representation of Gaussian Processes State Space Representation of Gaussian Processes Simo Särkkä Department of Biomedical Engineering and Computational Science (BECS) Aalto University, Espoo, Finland June 12th, 2013 Simo Särkkä (Aalto University)

More information

ELEMENTS OF PROBABILITY THEORY

ELEMENTS OF PROBABILITY THEORY ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable

More information

Introduction to Spatial Data and Models

Introduction to Spatial Data and Models Introduction to Spatial Data and Models Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry

More information

Introduction to Spatial Data and Models

Introduction to Spatial Data and Models Introduction to Spatial Data and Models Sudipto Banerjee 1 and Andrew O. Finley 2 1 Department of Forestry & Department of Geography, Michigan State University, Lansing Michigan, U.S.A. 2 Biostatistics,

More information

PREPRINT 2010:47. Multivariate Generalized Laplace Distributions and Related Random Fields TOMASZ J. KOZUBOWSKI KRZYSZTOF PODGÓRSKI IGOR RYCHLIK

PREPRINT 2010:47. Multivariate Generalized Laplace Distributions and Related Random Fields TOMASZ J. KOZUBOWSKI KRZYSZTOF PODGÓRSKI IGOR RYCHLIK PREPRINT 2010:47 Multivariate Generalized Laplace Distributions and Related Random Fields TOMASZ J. KOZUBOWSKI KRZYSZTOF PODGÓRSKI IGOR RYCHLIK Department of Mathematical Sciences Division of Mathematical

More information

Multivariate Normal-Laplace Distribution and Processes

Multivariate Normal-Laplace Distribution and Processes CHAPTER 4 Multivariate Normal-Laplace Distribution and Processes The normal-laplace distribution, which results from the convolution of independent normal and Laplace random variables is introduced by

More information

Reliability Theory of Dynamically Loaded Structures (cont.)

Reliability Theory of Dynamically Loaded Structures (cont.) Outline of Reliability Theory of Dynamically Loaded Structures (cont.) Probability Density Function of Local Maxima in a Stationary Gaussian Process. Distribution of Extreme Values. Monte Carlo Simulation

More information

A Framework for Daily Spatio-Temporal Stochastic Weather Simulation

A Framework for Daily Spatio-Temporal Stochastic Weather Simulation A Framework for Daily Spatio-Temporal Stochastic Weather Simulation, Rick Katz, Balaji Rajagopalan Geophysical Statistics Project Institute for Mathematics Applied to Geosciences National Center for Atmospheric

More information

Generalized Laplacian Distributions and Autoregressive Processes

Generalized Laplacian Distributions and Autoregressive Processes CHAPTER Generalized Laplacian Distributions and Autoregressive Processes. Introduction Generalized Laplacian distribution corresponds to the distribution of differences of independently and identically

More information

A short introduction to INLA and R-INLA

A short introduction to INLA and R-INLA A short introduction to INLA and R-INLA Integrated Nested Laplace Approximation Thomas Opitz, BioSP, INRA Avignon Workshop: Theory and practice of INLA and SPDE November 7, 2018 2/21 Plan for this talk

More information

Nonparametric Bayesian Methods (Gaussian Processes)

Nonparametric Bayesian Methods (Gaussian Processes) [70240413 Statistical Machine Learning, Spring, 2015] Nonparametric Bayesian Methods (Gaussian Processes) Jun Zhu dcszj@mail.tsinghua.edu.cn http://bigml.cs.tsinghua.edu.cn/~jun State Key Lab of Intelligent

More information

Stat 451 Lecture Notes Markov Chain Monte Carlo. Ryan Martin UIC

Stat 451 Lecture Notes Markov Chain Monte Carlo. Ryan Martin UIC Stat 451 Lecture Notes 07 12 Markov Chain Monte Carlo Ryan Martin UIC www.math.uic.edu/~rgmartin 1 Based on Chapters 8 9 in Givens & Hoeting, Chapters 25 27 in Lange 2 Updated: April 4, 2016 1 / 42 Outline

More information

Nonstationary spatial process modeling Part II Paul D. Sampson --- Catherine Calder Univ of Washington --- Ohio State University

Nonstationary spatial process modeling Part II Paul D. Sampson --- Catherine Calder Univ of Washington --- Ohio State University Nonstationary spatial process modeling Part II Paul D. Sampson --- Catherine Calder Univ of Washington --- Ohio State University this presentation derived from that presented at the Pan-American Advanced

More information

Basics of Point-Referenced Data Models

Basics of Point-Referenced Data Models Basics of Point-Referenced Data Models Basic tool is a spatial process, {Y (s), s D}, where D R r Chapter 2: Basics of Point-Referenced Data Models p. 1/45 Basics of Point-Referenced Data Models Basic

More information

Multistage Methodologies for Partitioning a Set of Exponential. populations.

Multistage Methodologies for Partitioning a Set of Exponential. populations. Multistage Methodologies for Partitioning a Set of Exponential Populations Department of Mathematics, University of New Orleans, 2000 Lakefront, New Orleans, LA 70148, USA tsolanky@uno.edu Tumulesh K.

More information

GAUSSIAN PROCESS REGRESSION

GAUSSIAN PROCESS REGRESSION GAUSSIAN PROCESS REGRESSION CSE 515T Spring 2015 1. BACKGROUND The kernel trick again... The Kernel Trick Consider again the linear regression model: y(x) = φ(x) w + ε, with prior p(w) = N (w; 0, Σ). The

More information

Stationary distributions of non Gaussian Ornstein Uhlenbeck processes for beam halos

Stationary distributions of non Gaussian Ornstein Uhlenbeck processes for beam halos N Cufaro Petroni: CYCLOTRONS 2007 Giardini Naxos, 1 5 October, 2007 1 Stationary distributions of non Gaussian Ornstein Uhlenbeck processes for beam halos CYCLOTRONS 2007 Giardini Naxos, 1 5 October Nicola

More information

Module 9: Stationary Processes

Module 9: Stationary Processes Module 9: Stationary Processes Lecture 1 Stationary Processes 1 Introduction A stationary process is a stochastic process whose joint probability distribution does not change when shifted in time or space.

More information

ABC methods for phase-type distributions with applications in insurance risk problems

ABC methods for phase-type distributions with applications in insurance risk problems ABC methods for phase-type with applications problems Concepcion Ausin, Department of Statistics, Universidad Carlos III de Madrid Joint work with: Pedro Galeano, Universidad Carlos III de Madrid Simon

More information

Numerical Methods with Lévy Processes

Numerical Methods with Lévy Processes Numerical Methods with Lévy Processes 1 Objective: i) Find models of asset returns, etc ii) Get numbers out of them. Why? VaR and risk management Valuing and hedging derivatives Why not? Usual assumption:

More information

Slash Distributions and Applications

Slash Distributions and Applications CHAPTER 2 Slash Distributions and Alications 2.1 Introduction The concet of slash distributions was introduced by Kafadar (1988) as a heavy tailed alternative to the normal distribution. Further literature

More information

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please

More information

Physician Performance Assessment / Spatial Inference of Pollutant Concentrations

Physician Performance Assessment / Spatial Inference of Pollutant Concentrations Physician Performance Assessment / Spatial Inference of Pollutant Concentrations Dawn Woodard Operations Research & Information Engineering Cornell University Johns Hopkins Dept. of Biostatistics, April

More information

Bayesian Methods for Machine Learning

Bayesian Methods for Machine Learning Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),

More information

Bayesian Regression Linear and Logistic Regression

Bayesian Regression Linear and Logistic Regression When we want more than point estimates Bayesian Regression Linear and Logistic Regression Nicole Beckage Ordinary Least Squares Regression and Lasso Regression return only point estimates But what if we

More information

Universal examples. Chapter The Bernoulli process

Universal examples. Chapter The Bernoulli process Chapter 1 Universal examples 1.1 The Bernoulli process First description: Bernoulli random variables Y i for i = 1, 2, 3,... independent with P [Y i = 1] = p and P [Y i = ] = 1 p. Second description: Binomial

More information

On prediction and density estimation Peter McCullagh University of Chicago December 2004

On prediction and density estimation Peter McCullagh University of Chicago December 2004 On prediction and density estimation Peter McCullagh University of Chicago December 2004 Summary Having observed the initial segment of a random sequence, subsequent values may be predicted by calculating

More information

Beyond the color of the noise: what is memory in random phenomena?

Beyond the color of the noise: what is memory in random phenomena? Beyond the color of the noise: what is memory in random phenomena? Gennady Samorodnitsky Cornell University September 19, 2014 Randomness means lack of pattern or predictability in events according to

More information

Statistícal Methods for Spatial Data Analysis

Statistícal Methods for Spatial Data Analysis Texts in Statistícal Science Statistícal Methods for Spatial Data Analysis V- Oliver Schabenberger Carol A. Gotway PCT CHAPMAN & K Contents Preface xv 1 Introduction 1 1.1 The Need for Spatial Analysis

More information

Multivariate Gaussian Random Fields with SPDEs

Multivariate Gaussian Random Fields with SPDEs Multivariate Gaussian Random Fields with SPDEs Xiangping Hu Daniel Simpson, Finn Lindgren and Håvard Rue Department of Mathematics, University of Oslo PASI, 214 Outline The Matérn covariance function and

More information

Archimer

Archimer Please note that this is an author-produced PDF of an article accepted for publication following peer review. The definitive publisher-authenticated version is available on the publisher Web site Computational

More information

Statistics - Lecture One. Outline. Charlotte Wickham 1. Basic ideas about estimation

Statistics - Lecture One. Outline. Charlotte Wickham  1. Basic ideas about estimation Statistics - Lecture One Charlotte Wickham wickham@stat.berkeley.edu http://www.stat.berkeley.edu/~wickham/ Outline 1. Basic ideas about estimation 2. Method of Moments 3. Maximum Likelihood 4. Confidence

More information

Markov Chain Monte Carlo (MCMC)

Markov Chain Monte Carlo (MCMC) Markov Chain Monte Carlo (MCMC Dependent Sampling Suppose we wish to sample from a density π, and we can evaluate π as a function but have no means to directly generate a sample. Rejection sampling can

More information

Ornstein-Uhlenbeck processes for geophysical data analysis

Ornstein-Uhlenbeck processes for geophysical data analysis Ornstein-Uhlenbeck processes for geophysical data analysis Semere Habtemicael Department of Mathematics North Dakota State University May 19, 2014 Outline 1 Introduction 2 Model 3 Characteristic function

More information

STA414/2104 Statistical Methods for Machine Learning II

STA414/2104 Statistical Methods for Machine Learning II STA414/2104 Statistical Methods for Machine Learning II Murat A. Erdogdu & David Duvenaud Department of Computer Science Department of Statistical Sciences Lecture 3 Slide credits: Russ Salakhutdinov Announcements

More information

Lecture 2 APPLICATION OF EXREME VALUE THEORY TO CLIMATE CHANGE. Rick Katz

Lecture 2 APPLICATION OF EXREME VALUE THEORY TO CLIMATE CHANGE. Rick Katz 1 Lecture 2 APPLICATION OF EXREME VALUE THEORY TO CLIMATE CHANGE Rick Katz Institute for Study of Society and Environment National Center for Atmospheric Research Boulder, CO USA email: rwk@ucar.edu Home

More information

Invariance Properties of the Negative Binomial Lévy Process and Stochastic Self-similarity

Invariance Properties of the Negative Binomial Lévy Process and Stochastic Self-similarity International Mathematical Forum, 2, 2007, no. 30, 1457-1468 Invariance Properties of the Negative Binomial Lévy Process and Stochastic Self-similarity Tomasz J. Kozubowski Department of Mathematics &

More information

Chapter 4 - Fundamentals of spatial processes Lecture notes

Chapter 4 - Fundamentals of spatial processes Lecture notes Chapter 4 - Fundamentals of spatial processes Lecture notes Geir Storvik January 21, 2013 STK4150 - Intro 2 Spatial processes Typically correlation between nearby sites Mostly positive correlation Negative

More information

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature

More information

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please

More information

Max stable Processes & Random Fields: Representations, Models, and Prediction

Max stable Processes & Random Fields: Representations, Models, and Prediction Max stable Processes & Random Fields: Representations, Models, and Prediction Stilian Stoev University of Michigan, Ann Arbor March 2, 2011 Based on joint works with Yizao Wang and Murad S. Taqqu. 1 Preliminaries

More information

Extreme Value Analysis and Spatial Extremes

Extreme Value Analysis and Spatial Extremes Extreme Value Analysis and Department of Statistics Purdue University 11/07/2013 Outline Motivation 1 Motivation 2 Extreme Value Theorem and 3 Bayesian Hierarchical Models Copula Models Max-stable Models

More information

Introduction. Chapter 1

Introduction. Chapter 1 Chapter 1 Introduction In this book we will be concerned with supervised learning, which is the problem of learning input-output mappings from empirical data (the training dataset). Depending on the characteristics

More information

Exact Linear Likelihood Inference for Laplace

Exact Linear Likelihood Inference for Laplace Exact Linear Likelihood Inference for Laplace Prof. N. Balakrishnan McMaster University, Hamilton, Canada bala@mcmaster.ca p. 1/52 Pierre-Simon Laplace 1749 1827 p. 2/52 Laplace s Biography Born: On March

More information

If we want to analyze experimental or simulated data we might encounter the following tasks:

If we want to analyze experimental or simulated data we might encounter the following tasks: Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction

More information

Stat 516, Homework 1

Stat 516, Homework 1 Stat 516, Homework 1 Due date: October 7 1. Consider an urn with n distinct balls numbered 1,..., n. We sample balls from the urn with replacement. Let N be the number of draws until we encounter a ball

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 7 Approximate

More information

Normalized kernel-weighted random measures

Normalized kernel-weighted random measures Normalized kernel-weighted random measures Jim Griffin University of Kent 1 August 27 Outline 1 Introduction 2 Ornstein-Uhlenbeck DP 3 Generalisations Bayesian Density Regression We observe data (x 1,

More information

E[X n ]= dn dt n M X(t). ). What is the mgf? Solution. Found this the other day in the Kernel matching exercise: 1 M X (t) =

E[X n ]= dn dt n M X(t). ). What is the mgf? Solution. Found this the other day in the Kernel matching exercise: 1 M X (t) = Chapter 7 Generating functions Definition 7.. Let X be a random variable. The moment generating function is given by M X (t) =E[e tx ], provided that the expectation exists for t in some neighborhood of

More information

Multi-resolution models for large data sets

Multi-resolution models for large data sets Multi-resolution models for large data sets Douglas Nychka, National Center for Atmospheric Research National Science Foundation NORDSTAT, Umeå, June, 2012 Credits Steve Sain, NCAR Tia LeRud, UC Davis

More information

Understanding Regressions with Observations Collected at High Frequency over Long Span

Understanding Regressions with Observations Collected at High Frequency over Long Span Understanding Regressions with Observations Collected at High Frequency over Long Span Yoosoon Chang Department of Economics, Indiana University Joon Y. Park Department of Economics, Indiana University

More information

Networked Control System Protocols Modeling & Analysis using Stochastic Impulsive Systems

Networked Control System Protocols Modeling & Analysis using Stochastic Impulsive Systems Networked Control System Protocols Modeling & Analysis using Stochastic Impulsive Systems João P. Hespanha Center for Control Dynamical Systems and Computation Talk outline Examples feedback over shared

More information

A Gaussian state-space model for wind fields in the North-East Atlantic

A Gaussian state-space model for wind fields in the North-East Atlantic A Gaussian state-space model for wind fields in the North-East Atlantic Julie BESSAC - Université de Rennes 1 with Pierre AILLIOT and Valï 1 rie MONBET 2 Juillet 2013 Plan Motivations 1 Motivations 2 Context

More information

Exponential Distribution and Poisson Process

Exponential Distribution and Poisson Process Exponential Distribution and Poisson Process Stochastic Processes - Lecture Notes Fatih Cavdur to accompany Introduction to Probability Models by Sheldon M. Ross Fall 215 Outline Introduction Exponential

More information

Covariance function estimation in Gaussian process regression

Covariance function estimation in Gaussian process regression Covariance function estimation in Gaussian process regression François Bachoc Department of Statistics and Operations Research, University of Vienna WU Research Seminar - May 2015 François Bachoc Gaussian

More information

Point-Referenced Data Models

Point-Referenced Data Models Point-Referenced Data Models Jamie Monogan University of Georgia Spring 2013 Jamie Monogan (UGA) Point-Referenced Data Models Spring 2013 1 / 19 Objectives By the end of these meetings, participants should

More information

Towards inference for skewed alpha stable Levy processes

Towards inference for skewed alpha stable Levy processes Towards inference for skewed alpha stable Levy processes Simon Godsill and Tatjana Lemke Signal Processing and Communications Lab. University of Cambridge www-sigproc.eng.cam.ac.uk/~sjg Overview Motivation

More information

Estimation of the long Memory parameter using an Infinite Source Poisson model applied to transmission rate measurements

Estimation of the long Memory parameter using an Infinite Source Poisson model applied to transmission rate measurements of the long Memory parameter using an Infinite Source Poisson model applied to transmission rate measurements François Roueff Ecole Nat. Sup. des Télécommunications 46 rue Barrault, 75634 Paris cedex 13,

More information

Copulas, a novel approach to model spatial and spatio-temporal dependence

Copulas, a novel approach to model spatial and spatio-temporal dependence Copulas, a novel approach to model spatial and spatio-temporal dependence Benedikt Gräler 1, Hannes Kazianka 2, Giovana Mira de Espindola 3 1 Institute for Geoinformatics, University of Münster, Germany

More information

Econometría 2: Análisis de series de Tiempo

Econometría 2: Análisis de series de Tiempo Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 II. Basic definitions A time series is a set of observations X t, each

More information

Discrete time processes

Discrete time processes Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following

More information

The Bayesian approach to inverse problems

The Bayesian approach to inverse problems The Bayesian approach to inverse problems Youssef Marzouk Department of Aeronautics and Astronautics Center for Computational Engineering Massachusetts Institute of Technology ymarz@mit.edu, http://uqgroup.mit.edu

More information

Spatial Statistics with Image Analysis. Outline. A Statistical Approach. Johan Lindström 1. Lund October 6, 2016

Spatial Statistics with Image Analysis. Outline. A Statistical Approach. Johan Lindström 1. Lund October 6, 2016 Spatial Statistics Spatial Examples More Spatial Statistics with Image Analysis Johan Lindström 1 1 Mathematical Statistics Centre for Mathematical Sciences Lund University Lund October 6, 2016 Johan Lindström

More information

3. Review of Probability and Statistics

3. Review of Probability and Statistics 3. Review of Probability and Statistics ECE 830, Spring 2014 Probabilistic models will be used throughout the course to represent noise, errors, and uncertainty in signal processing problems. This lecture

More information

Hierarchical Modeling for Univariate Spatial Data

Hierarchical Modeling for Univariate Spatial Data Hierarchical Modeling for Univariate Spatial Data Geography 890, Hierarchical Bayesian Models for Environmental Spatial Data Analysis February 15, 2011 1 Spatial Domain 2 Geography 890 Spatial Domain This

More information

Asymptotics for posterior hazards

Asymptotics for posterior hazards Asymptotics for posterior hazards Pierpaolo De Blasi University of Turin 10th August 2007, BNR Workshop, Isaac Newton Intitute, Cambridge, UK Joint work with Giovanni Peccati (Université Paris VI) and

More information

3. Probability and Statistics

3. Probability and Statistics FE661 - Statistical Methods for Financial Engineering 3. Probability and Statistics Jitkomut Songsiri definitions, probability measures conditional expectations correlation and covariance some important

More information

Short-time expansions for close-to-the-money options under a Lévy jump model with stochastic volatility

Short-time expansions for close-to-the-money options under a Lévy jump model with stochastic volatility Short-time expansions for close-to-the-money options under a Lévy jump model with stochastic volatility José Enrique Figueroa-López 1 1 Department of Statistics Purdue University Statistics, Jump Processes,

More information

Jump-type Levy Processes

Jump-type Levy Processes Jump-type Levy Processes Ernst Eberlein Handbook of Financial Time Series Outline Table of contents Probabilistic Structure of Levy Processes Levy process Levy-Ito decomposition Jump part Probabilistic

More information

1.1 Review of Probability Theory

1.1 Review of Probability Theory 1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,

More information

Computational statistics

Computational statistics Computational statistics Markov Chain Monte Carlo methods Thierry Denœux March 2017 Thierry Denœux Computational statistics March 2017 1 / 71 Contents of this chapter When a target density f can be evaluated

More information

Regular Variation and Extreme Events for Stochastic Processes

Regular Variation and Extreme Events for Stochastic Processes 1 Regular Variation and Extreme Events for Stochastic Processes FILIP LINDSKOG Royal Institute of Technology, Stockholm 2005 based on joint work with Henrik Hult www.math.kth.se/ lindskog 2 Extremes for

More information

Lecture 7 and 8: Markov Chain Monte Carlo

Lecture 7 and 8: Markov Chain Monte Carlo Lecture 7 and 8: Markov Chain Monte Carlo 4F13: Machine Learning Zoubin Ghahramani and Carl Edward Rasmussen Department of Engineering University of Cambridge http://mlg.eng.cam.ac.uk/teaching/4f13/ Ghahramani

More information

CS Lecture 19. Exponential Families & Expectation Propagation

CS Lecture 19. Exponential Families & Expectation Propagation CS 6347 Lecture 19 Exponential Families & Expectation Propagation Discrete State Spaces We have been focusing on the case of MRFs over discrete state spaces Probability distributions over discrete spaces

More information

Modelling the risk process

Modelling the risk process Modelling the risk process Krzysztof Burnecki Hugo Steinhaus Center Wroc law University of Technology www.im.pwr.wroc.pl/ hugo Modelling the risk process 1 Risk process If (Ω, F, P) is a probability space

More information

Figure 10.1: Recording when the event E occurs

Figure 10.1: Recording when the event E occurs 10 Poisson Processes Let T R be an interval. A family of random variables {X(t) ; t T} is called a continuous time stochastic process. We often consider T = [0, 1] and T = [0, ). As X(t) is a random variable

More information

A skew Laplace distribution on integers

A skew Laplace distribution on integers AISM (2006) 58: 555 571 DOI 10.1007/s10463-005-0029-1 Tomasz J. Kozubowski Seidu Inusah A skew Laplace distribution on integers Received: 17 November 2004 / Revised: 24 February 2005 / Published online:

More information

Modeling processes asymmetries with Laplace Moving Average.

Modeling processes asymmetries with Laplace Moving Average. Modeling processes asymmetries with Laplace Moving Average. Nicolas Raillard, Marc Prevosto, Pierre Ailliot To cite this version: Nicolas Raillard, Marc Prevosto, Pierre Ailliot. Modeling processes asymmetries

More information

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno

Stochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.

More information

Statistical techniques for data analysis in Cosmology

Statistical techniques for data analysis in Cosmology Statistical techniques for data analysis in Cosmology arxiv:0712.3028; arxiv:0911.3105 Numerical recipes (the bible ) Licia Verde ICREA & ICC UB-IEEC http://icc.ub.edu/~liciaverde outline Lecture 1: Introduction

More information

IE 303 Discrete-Event Simulation

IE 303 Discrete-Event Simulation IE 303 Discrete-Event Simulation 1 L E C T U R E 5 : P R O B A B I L I T Y R E V I E W Review of the Last Lecture Random Variables Probability Density (Mass) Functions Cumulative Density Function Discrete

More information

GARCH Models Estimation and Inference

GARCH Models Estimation and Inference GARCH Models Estimation and Inference Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 1 Likelihood function The procedure most often used in estimating θ 0 in

More information

ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering

ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering Lecturer: Nikolay Atanasov: natanasov@ucsd.edu Teaching Assistants: Siwei Guo: s9guo@eng.ucsd.edu Anwesan Pal:

More information

Review. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda

Review. DS GA 1002 Statistical and Mathematical Models.   Carlos Fernandez-Granda Review DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall16 Carlos Fernandez-Granda Probability and statistics Probability: Framework for dealing with

More information

Weak convergence to the t-distribution

Weak convergence to the t-distribution Weak convergence to the t-distribution Christian Schluter and Mark Trede 21/2011 DEFI, Aix-Marseille Université, France and University of Southampton, UK Department of Economics, University of Münster,

More information

Random Variables and Their Distributions

Random Variables and Their Distributions Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital

More information

Lecture 6: Markov Chain Monte Carlo

Lecture 6: Markov Chain Monte Carlo Lecture 6: Markov Chain Monte Carlo D. Jason Koskinen koskinen@nbi.ku.dk Photo by Howard Jackman University of Copenhagen Advanced Methods in Applied Statistics Feb - Apr 2016 Niels Bohr Institute 2 Outline

More information

Introduction to Bayesian methods in inverse problems

Introduction to Bayesian methods in inverse problems Introduction to Bayesian methods in inverse problems Ville Kolehmainen 1 1 Department of Applied Physics, University of Eastern Finland, Kuopio, Finland March 4 2013 Manchester, UK. Contents Introduction

More information

Advanced Statistical Methods. Lecture 6

Advanced Statistical Methods. Lecture 6 Advanced Statistical Methods Lecture 6 Convergence distribution of M.-H. MCMC We denote the PDF estimated by the MCMC as. It has the property Convergence distribution After some time, the distribution

More information

GARCH Models Estimation and Inference. Eduardo Rossi University of Pavia

GARCH Models Estimation and Inference. Eduardo Rossi University of Pavia GARCH Models Estimation and Inference Eduardo Rossi University of Pavia Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function

More information

HANDBOOK OF APPLICABLE MATHEMATICS

HANDBOOK OF APPLICABLE MATHEMATICS HANDBOOK OF APPLICABLE MATHEMATICS Chief Editor: Walter Ledermann Volume II: Probability Emlyn Lloyd University oflancaster A Wiley-Interscience Publication JOHN WILEY & SONS Chichester - New York - Brisbane

More information

Eco517 Fall 2004 C. Sims MIDTERM EXAM

Eco517 Fall 2004 C. Sims MIDTERM EXAM Eco517 Fall 2004 C. Sims MIDTERM EXAM Answer all four questions. Each is worth 23 points. Do not devote disproportionate time to any one question unless you have answered all the others. (1) We are considering

More information

Statistical signal processing

Statistical signal processing Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable

More information

Part I Stochastic variables and Markov chains

Part I Stochastic variables and Markov chains Part I Stochastic variables and Markov chains Random variables describe the behaviour of a phenomenon independent of any specific sample space Distribution function (cdf, cumulative distribution function)

More information

Stochastic Processes. A stochastic process is a function of two variables:

Stochastic Processes. A stochastic process is a function of two variables: Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:

More information

Does k-th Moment Exist?

Does k-th Moment Exist? Does k-th Moment Exist? Hitomi, K. 1 and Y. Nishiyama 2 1 Kyoto Institute of Technology, Japan 2 Institute of Economic Research, Kyoto University, Japan Email: hitomi@kit.ac.jp Keywords: Existence of moments,

More information

. Find E(V ) and var(v ).

. Find E(V ) and var(v ). Math 6382/6383: Probability Models and Mathematical Statistics Sample Preliminary Exam Questions 1. A person tosses a fair coin until she obtains 2 heads in a row. She then tosses a fair die the same number

More information