Laplace Distribution Based Stochastic Models
|
|
- Marjory Perry
- 5 years ago
- Views:
Transcription
1 Laplace Distribution Based Stochastic Models Anastassia Baxevani Department of Mathematics and Statistics University of Cyprus results based on work of/with Podgorski, Wegener, Aberg, Bolin, Walin July 2, 213
2 Outline 1 Introduction 2 Laplace distributions and their generalizations 3 Stochastic processes build upon Laplace distribution 4 Model fitting, estimation
3 Mathematical Models In spatial statistics and geostatistics, Gaussian random fields are important tools for constructing models for data. This is mainly because of their simplicity: they are specified through the mean and covariance structures, which is what is needed for prediction and estimation.
4 Mathematical Models In spatial statistics and geostatistics, Gaussian random fields are important tools for constructing models for data. This is mainly because of their simplicity: they are specified through the mean and covariance structures, which is what is needed for prediction and estimation. Drawback: they have difficulty in efficiently accounting for asymmetries and unusually extreme values in the data. When data exhibit such characteristics is usual to consider transformed Gaussian models, with the choice of transformation driven by the particular application.
5 Mathematical Models In spatial statistics and geostatistics, Gaussian random fields are important tools for constructing models for data. This is mainly because of their simplicity: they are specified through the mean and covariance structures, which is what is needed for prediction and estimation. Drawback: they have difficulty in efficiently accounting for asymmetries and unusually extreme values in the data. When data exhibit such characteristics is usual to consider transformed Gaussian models, with the choice of transformation driven by the particular application. To provide with a more universal model, there is a growing interest in models featuring more general distributions: Laplace moving average models, are formulated as convolutions of Laplace noise and some deterministic kernel and theoretically, they constitute a rich class that is capable of modeling a variety of geometrical asymmetries in the records, and simultaneously can efficiently account for occasional highly extreme events.
6 Outline 1 Introduction 2 Laplace distributions and their generalizations 3 Stochastic processes build upon Laplace distribution 4 Model fitting, estimation
7 Asymmetric Laplace distribution Characteristic function: φ(t) = e itδ 1 + σ 2 t 2 /2 µit where δ for location, usually δ =, µ shape, σ > the scale parameter.
8 Asymmetric Laplace distribution Characteristic function: φ(t) = e itδ 1 + σ 2 t 2 /2 µit where δ for location, usually δ =, µ shape, σ > the scale parameter. There is an analog of the Central Limit Theorem with random number of terms in the summation: If ν p is a geometric random variable with mean 1/p (waiting until failure) and independent of Y i s which have finite variances, then the random sum ν p S p = a p (Y i + b p) converges in distribution to an asymmetric Laplace distribution - -stability with respect to geometric summation. i=1
9 Generalized skewed Laplace distribution Generalized skewed Laplace distributions have ch.f. φ(t) = e itδ (1 + σ 2 t 2 /2 iµt) ν
10 Generalized skewed Laplace distribution Generalized skewed Laplace distributions have ch.f. φ(t) = e itδ (1 + σ 2 t 2 /2 iµt) ν !=1/4.8.6 Standard Gaussian!= infinity Standard Laplace!= Standard Gaussian Asymmetric Laplace!=1.4.6!=3.2!=1/4!3!2! !1.5!1! Left: µ = Right: µ = 3σ 2 3/2 and τ = 1/ν
11 Generalized skewed Laplace distribution, cont. Equivalent expressions:
12 Generalized skewed Laplace distribution, cont. Equivalent expressions: Gamma variance-mean mixtures of normal σ W Z + µw + δ, Z standard normal, W gamma variable with the shape ν independent of Z.
13 Generalized skewed Laplace distribution, cont. Equivalent expressions: Gamma variance-mean mixtures of normal σ W Z + µw + δ, Z standard normal, W gamma variable with the shape ν independent of Z. W 1, W 2 independent exponential. κw 1 1 κ W 2 + δ The equivalent expressions give rise to different parameterizations! Choice should be based on the purpose, i.e. inference or theoretical properties?
14 Multivariate extension Gamma variance models Y = δ + Γ µ + Γ 1/2 Σ 1/2 Z where Γ is a gamma variable with the shape parameter ν and Z has a multivariate normal distribution.
15 Multivariate extension Gamma variance models Y = δ + Γ µ + Γ 1/2 Σ 1/2 Z where Γ is a gamma variable with the shape parameter ν and Z has a multivariate normal distribution. Characteristics function ( ) ν φ(t) = e iδ t 1, t R d t Σt iµ t
16 Multivariate extension Gamma variance models Y = δ + Γ µ + Γ 1/2 Σ 1/2 Z where Γ is a gamma variable with the shape parameter ν and Z has a multivariate normal distribution. Characteristics function ( ) ν φ(t) = e iδ t 1, t R d t Σt iµ t Density 2 exp(µ Σ 1 (y δ)) (2π) d/2 Γ(ν) Σ 1/2 ( ) ν d/2 Q(y δ) K ν d/2(q(y δ)c(σ, µ)), C(Σ, µ) where Q(x) = x Σ 1 x and C(Σ, µ) = 2 + µ Σ 1 µ.
17 Examples of the densities
18 Outline 1 Introduction 2 Laplace distributions and their generalizations 3 Stochastic processes build upon Laplace distribution 4 Model fitting, estimation
19 Stochastic Laplace measure A stochastic Laplace measure, Λ with parameters δ R, µ R and σ > and controlled by a measure m, is a σ-additive function: Λ : (X, B, m) L 2 (Ω, F, P) : Λ(A) GL(µ, σ, 1 m(a) ), A B
20 Stochastic Laplace measure A stochastic Laplace measure, Λ with parameters δ R, µ R and σ > and controlled by a measure m, is a σ-additive function: Λ : (X, B, m) L 2 (Ω, F, P) : Λ(A) GL(µ, σ, 1 m(a) ), A B φ Λ(A) (t) = e itδm(a) (1 + σ 2 t 2 /2 µit) m(a)
21 Stochastic Laplace measure A stochastic Laplace measure, Λ with parameters δ R, µ R and σ > and controlled by a measure m, is a σ-additive function: Λ : (X, B, m) L 2 (Ω, F, P) : Λ(A) GL(µ, σ, 1 m(a) ), A B φ Λ(A) (t) = e itδm(a) (1 + σ 2 t 2 /2 µit) m(a) for disjoint A i B, Λ(A i ) are independent and with probability one Λ( i=1 A i) = Λ(A i ). i=1
22 Stochastic Laplace measure A stochastic Laplace measure, Λ with parameters δ R, µ R and σ > and controlled by a measure m, is a σ-additive function: Λ : (X, B, m) L 2 (Ω, F, P) : Λ(A) GL(µ, σ, 1 m(a) ), A B φ Λ(A) (t) = e itδm(a) (1 + σ 2 t 2 /2 µit) m(a) for disjoint A i B, Λ(A i ) are independent and with probability one Λ( i=1 A i) = Λ(A i ). i=1 Note: E(Λ(A)) = µm(a), Var(Λ(A)) = (µ 2 + σ 2 )m(a)
23 Laplace motion A Laplace motion L(t) with the asymmetry parameter µ, the space scale parameter σ and the time scale parameter ν, is defined by the following: it starts from the origin, L() = it has independent and stationary increments L(t + ν) L(t) GL(, σ, 1), i.e has an asymmetric Laplace distribution, centered in mean at zero, with parameter µ and σ. Relation to measure is through Λ(a, b] = L(b) L(a)
24 Alternatively, Laplace motion can be defined through... B(λ) denote standard Brownian motion
25 Alternatively, Laplace motion can be defined through... B(λ) denote standard Brownian motion Γ(λ) a standard gamma process, i.e. Lévy motion with density γ = νdλ g(x) = 1 Γ(γ) x γ 1 e x, x >
26 Alternatively, Laplace motion can be defined through... B(λ) denote standard Brownian motion Γ(λ) a standard gamma process, i.e. Lévy motion with density γ = νdλ g(x) = 1 Γ(γ) x γ 1 e x, x > Laplace motion - subordinated Brownian motion L(λ) = B(Γ(λ))
27 Alternatively, Laplace motion can be defined through... B(λ) denote standard Brownian motion Γ(λ) a standard gamma process, i.e. Lévy motion with density γ = νdλ g(x) = 1 Γ(γ) x γ 1 e x, x > Laplace motion - subordinated Brownian motion L(λ) = B(Γ(λ)) Some properties are inherited from the distribution (stochastic self-similarity): pl(λ) = L(NBp (λ)), where NB p is binomial Lévy motion.
28 Moving averages through stochastic integration Standard construction of stochastic integrals with deterministic kernels : X(τ) = f (τ x)dλ(x). R
29 Moving averages through stochastic integration Standard construction of stochastic integrals with deterministic kernels : X(τ) = f (τ x)dλ(x). Characteristic function ( φ X (t) = e itδ fdm exp Extension to multivariate case is immediate. R R log(1 iµtf (x) + σ2 t 2 f 2 ) (x) )dm(x). 2
30 Moving averages through stochastic integration Standard construction of stochastic integrals with deterministic kernels : X(τ) = f (τ x)dλ(x). Characteristic function ( φ X (t) = e itδ fdm exp Extension to multivariate case is immediate. Covariance : Spectral density: R R r(τ) = σ2 + µ 2 ν log(1 iµtf (x) + σ2 t 2 f 2 ) (x) )dm(x). 2 f (x τ)f (x)dx R(ω) = σ2 + µ 2 Ff (ω)ff ( ω) ν
31 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν
32 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν 1 Pick equally spaced grid: dt 2dt ndt
33 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν 1 Pick equally spaced grid: dt 2dt ndt 2 Simulate n i.i.d Γ( dt ν, 1) and store them in G
34 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν 1 Pick equally spaced grid: dt 2dt ndt 2 Simulate n i.i.d Γ( dt ν, 1) and store them in G 3 Simulate n i.i.d N(, σ 2 G i ) and store them in B
35 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν 1 Pick equally spaced grid: dt 2dt ndt 2 Simulate n i.i.d Γ( dt ν, 1) and store them in G 3 Simulate n i.i.d N(, σ 2 G i ) and store them in B 4 Compute X = d f (x)dx + µ(f G) + f B
36 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν 1 Pick equally spaced grid: dt 2dt ndt 2 Simulate n i.i.d Γ( dt ν, 1) and store them in G 3 Simulate n i.i.d N(, σ 2 G i ) and store them in B 4 Compute X = d f (x)dx + µ(f G) + f B 5 Remove the first and last m entries, where m is the length of f
37 Simulation To simulate the Moving Average process (d = 1) : Λ(t) = d t + µγ(t) + B(Γ(t)), Γ(t) Γ( t, 1), B(t) BM(σ) ν 1 Pick equally spaced grid: dt 2dt ndt 2 Simulate n i.i.d Γ( dt ν, 1) and store them in G 3 Simulate n i.i.d N(, σ 2 G i ) and store them in B 4 Compute X = d f (x)dx + µ(f G) + f B 5 Remove the first and last m entries, where m is the length of f Very fast and efficient but it looses some resolution where the jumps of the Gamma process occur because of the grid! For d > 1 we simulate GL increments
38 Symmetric spatial models - realizations
39 Asymmetric spatial models
40 Outline 1 Introduction 2 Laplace distributions and their generalizations 3 Stochastic processes build upon Laplace distribution 4 Model fitting, estimation
41 Fitting the model The problem of fitting the model is two folded:
42 Fitting the model The problem of fitting the model is two folded: Fit the kernel
43 Fitting the model The problem of fitting the model is two folded: Fit the kernel Fit the Laplace noice
44 Symmetric kernel case
45 Symmetric kernel case A non-parametric approach is to estimate f by f (x) = F 1 Ŝ(ω), where Ŝ(ω) is an estimate of spectrum
46 Non-symmetric kernels measures of asymmetries There is no general non-parametric approach to the problem.
47 Non-symmetric kernels measures of asymmetries There is no general non-parametric approach to the problem. Various parametrized families of kernels are available
48 Non-symmetric kernels measures of asymmetries There is no general non-parametric approach to the problem. Various parametrized families of kernels are available Measures of asymmetries for random surfaces should involve moments of joint distributions of the process and its derivative
49 Non-symmetric kernels measures of asymmetries There is no general non-parametric approach to the problem. Various parametrized families of kernels are available Measures of asymmetries for random surfaces should involve moments of joint distributions of the process and its derivative Estimation of distributional and kernel parameters has to be performed through solution of the resulting equations.
50 Laplace moving average trajectories
51 Measuring tilting using Rice s formula N(T, A) number of times the field X takes value zero in [, T ] and at the same time has a property A
52 Measuring tilting using Rice s formula N(T, A) number of times the field X takes value zero in [, T ] and at the same time has a property A For ergodic stationary processes ] N(T, A) E [{X A} Ẋ() X() = lim = [ ], T N(T ) E Ẋ() X() =
53 Measuring tilting using Rice s formula N(T, A) number of times the field X takes value zero in [, T ] and at the same time has a property A For ergodic stationary processes ] N(T, A) E [{X A} Ẋ() X() = lim = [ ], T N(T ) E Ẋ() X() = The right hand side represents the biased sampling distribution when sampling is made over the -level contour C = {τ : X(τ ) = }
54 Tilting of trajectories empirical theoretical 1 empirical theoretical relative number relative number derivative at down/upcrossing of level u= derivative at down/upcrossing of level u=
55 Tilting o LMA with odd kernels 5 4 level derivative at down/upcrossing f (x; α, β) = C sgn(x) x α 1 e x /β, α > 1/2, β >. Marginal distribution of LMA always symmetric, but trajectories may exhibit some asymmetric features due to asymmetry of kernel.
56 Measures of tilting Measures of tilting should involve derivatives of the LMA process. We propose: ρ 3 = EẊ 3 E 3/2Ẋ 2, - skewness of the derivative process. If process has symmetric distribution, this measure fails to capture any asymmetries in the records!
57 Measures of tilting Measures of tilting should involve derivatives of the LMA process. We propose: ρ 3 = EẊ 3 E 3/2Ẋ 2, - skewness of the derivative process. If process has symmetric distribution, this measure fails to capture any asymmetries in the records! ρ 3,1 = E(Ẋ 3 X) E 3/2Ẋ 2 E 1/2 X or r 2 3,1 = E(Ẋ 3 X) E 2 X 2
58 The Gamma kernel f (x; τ, β) = 2 τ 1/2 Γ(2τ 1)β τ 1/2 x τ 1 e x/β x, τ >, β >, - for τ = 1 exponential for τ Gaussian case.
59 The Gamma kernel f (x; τ, β) = 2 τ 1/2 Γ(2τ 1)β τ 1/2 x τ 1 e x/β x, τ >, β >, - for τ = 1 exponential for τ Gaussian case. r 31 = 3ν 42(2 τ) (τ 1)Γ(4τ 6) β 4 Γ 2 (2τ 1), τ > 3/2.
60 The Gamma kernel f (x; τ, β) = 2 τ 1/2 Γ(2τ 1)β τ 1/2 x τ 1 e x/β x, τ >, β >, - for τ = 1 exponential for τ Gaussian case. r 31 = 3ν 42(2 τ) (τ 1)Γ(4τ 6) β 4 Γ 2 (2τ 1) τ E(ˆτ) Std(ˆτ) , τ > 3/2. Monte-Carlo estimation of τ, for ν = 1 and µ =. Hundred Monte-Carlo replicates of sample size of 3, with step.1.
61 The Gamma kernel, cont scaled Gamma kernel τ=2 τ=4 τ= τ τ β = 1 and tilting measures r 31 (top), and ρ 31 (bottom) as functions of τ.
62 Distributional parameters - Method of moments
63 Distributional parameters - Method of moments Moments of any integer order are available for LMA - the first four central moments are explicitely available and can be used to fit the four distributional parameters: E X = µ ( fdm, E (X E X) 2 = µ 2 + σ 2) ( E (X E X) 3 =µ 2µ 2 + 3σ 2) ( E (X E X) 4 =3 µ 2 + σ 2) ( 2 f 3 dm, f 2 dm, 2 ( f dm) µ 4 + 4µ 2 σ 2 + σ 4) f 4 dm
64 Distributional parameters - Method of moments Moments of any integer order are available for LMA - the first four central moments are explicitely available and can be used to fit the four distributional parameters: E X = µ ( fdm, E (X E X) 2 = µ 2 + σ 2) ( E (X E X) 3 =µ 2µ 2 + 3σ 2) ( E (X E X) 4 =3 µ 2 + σ 2) ( 2 f 3 dm, f 2 dm, 2 ( f dm) µ 4 + 4µ 2 σ 2 + σ 4) f 4 dm The method of moments estimation is not the most efficient way of estimation
65 Distributional parameters - Method of moments Moments of any integer order are available for LMA - the first four central moments are explicitely available and can be used to fit the four distributional parameters: E X = µ ( fdm, E (X E X) 2 = µ 2 + σ 2) ( E (X E X) 3 =µ 2µ 2 + 3σ 2) ( E (X E X) 4 =3 µ 2 + σ 2) ( 2 f 3 dm, f 2 dm, 2 ( f dm) µ 4 + 4µ 2 σ 2 + σ 4) f 4 dm The method of moments estimation is not the most efficient way of estimation Empirical moments may fall outside the range permitted by the parameters of the distribution
66 MLE estimation System of moment equations that would account for both distributional and kernel parameters maybe fairly complex
67 MLE estimation System of moment equations that would account for both distributional and kernel parameters maybe fairly complex More efficiently, one can attempt Maximum Likelihood Estimation
68 MLE estimation System of moment equations that would account for both distributional and kernel parameters maybe fairly complex More efficiently, one can attempt Maximum Likelihood Estimation Explicit formula for the MLE estimation can not be obtained except for some very special cases since the density of a generalized Laplace distribution is given through the Bessel function for the Laplace moving averages only characteristics functions can be written in an explicit fashion Numerical optimization has to be implemented
69 MLE estimation through EM algorithm Representation of GL distribution as σ ΓZ + µγ + δ is used and gamma variable Γ with parameter τ is treated as a missing value
70 MLE estimation through EM algorithm Representation of GL distribution as σ ΓZ + µγ + δ is used and gamma variable Γ with parameter τ is treated as a missing value For implementation of the algorithm see Podgórski and Wallin, EM algorithm for maximizing likelihood of linear models involving generalized Laplace distribution, under preparation.
71 MME vs. MLE - illustration The MME estimates of parameters (crosses) vs. the MLE ones (dots). The true parameters δ =.33, σ = 1.5, µ = 1.32, and τ =.25 are marked by the large star.
72 Highlights
73 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data.
74 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions.
75 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions. Resulting stationary second order processes have, as opposed to their Gaussian counterpart, a possibility of accounting for asymmetry and heavier tails.
76 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions. Resulting stationary second order processes have, as opposed to their Gaussian counterpart, a possibility of accounting for asymmetry and heavier tails. Despite this greater flexibility the discussed models still share a lot of spectral properties with Gaussian processes having the latter as a special case.
77 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions. Resulting stationary second order processes have, as opposed to their Gaussian counterpart, a possibility of accounting for asymmetry and heavier tails. Despite this greater flexibility the discussed models still share a lot of spectral properties with Gaussian processes having the latter as a special case. The models extend directly to random fields.
78 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions. Resulting stationary second order processes have, as opposed to their Gaussian counterpart, a possibility of accounting for asymmetry and heavier tails. Despite this greater flexibility the discussed models still share a lot of spectral properties with Gaussian processes having the latter as a special case. The models extend directly to random fields. Spatio-temporal characteristics including asymmetries in the records can be studied by the means of generalized Rice s formula.
79 Highlights Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions. Resulting stationary second order processes have, as opposed to their Gaussian counterpart, a possibility of accounting for asymmetry and heavier tails. Despite this greater flexibility the discussed models still share a lot of spectral properties with Gaussian processes having the latter as a special case. The models extend directly to random fields. Spatio-temporal characteristics including asymmetries in the records can be studied by the means of generalized Rice s formula. Model fitting can be obtained by utilizing: a) Method of Moments (simpler) or b) Maximum Likelihood (more accurate)
80 Non-Gaussian stochastic fields are proposed that can be suitable for modeling environmental data. The models are introduced by means of integrals with respect to independently scattered stochastic measures that have generalized Laplace distributions. Resulting stationary second order processes have, as opposed to their Gaussian counterpart, a possibility of accounting for asymmetry and heavier tails. Despite this greater flexibility the discussed models still share a lot of spectral properties with Gaussian processes having the latter as a special case. The models extend directly to random fields. Spatio-temporal characteristics including asymmetries in the records can be studied by the means of generalized Rice s formula. Model fitting can be obtained by utilizing: a) Method of Moments (simpler) or b) Maximum Likelihood (more accurate) Markov Random Fields can be used to localize efficiently the fitting problem and provide a way to account for non-stationarity in the data. Highlights
81 List of related papers Kotz, S., Kozubowski, T.J., Podgórski, K. (21). The Laplace distribution and generalizations: A revisit with applications to communications, economics, engineering and finance. Boston: Birkhaüser. Åberg, S. and Podgórski, K. (211). A class of non-gaussian second order random fields. Extremes Podgórski, K. and Wegener, J. (21). Estimation for stochastic models driven by Laplace motion. Comm. Statist. - Theory and Methods.
82 List of related papers Kotz, S., Kozubowski, T.J., Podgórski, K. (21). The Laplace distribution and generalizations: A revisit with applications to communications, economics, engineering and finance. Boston: Birkhaüser. Åberg, S. and Podgórski, K. (211). A class of non-gaussian second order random fields. Extremes Podgórski, K. and Wegener, J. (21). Estimation for stochastic models driven by Laplace motion. Comm. Statist. - Theory and Methods. Lindgren, F., Rue, H., and Lindström, J. (211). An explicit link between gaussian fields and gaussian markov random fields: the stochastic partial differential equation approach. J. Royal Stat. Soc., Series B. Lindgren, G., Bolin, D., Lindgren, F. (21) Non-traditional stochastic models for ocean waves Lagrange models and nested SPDE models. European Phys. J.
83 List of related papers Kotz, S., Kozubowski, T.J., Podgórski, K. (21). The Laplace distribution and generalizations: A revisit with applications to communications, economics, engineering and finance. Boston: Birkhaüser. Åberg, S. and Podgórski, K. (211). A class of non-gaussian second order random fields. Extremes Podgórski, K. and Wegener, J. (21). Estimation for stochastic models driven by Laplace motion. Comm. Statist. - Theory and Methods. Lindgren, F., Rue, H., and Lindström, J. (211). An explicit link between gaussian fields and gaussian markov random fields: the stochastic partial differential equation approach. J. Royal Stat. Soc., Series B. Lindgren, G., Bolin, D., Lindgren, F. (21) Non-traditional stochastic models for ocean waves Lagrange models and nested SPDE models. European Phys. J. Bolin, D. (211). Non-gaussian spatial models generated by stochastic partial differential equations. Podgórski, K., Walin, J. (211). The EM-algorithm for models involving generalized Laplace distribution. In progress
84 List of related papers Kotz, S., Kozubowski, T.J., Podgórski, K. (21). The Laplace distribution and generalizations: A revisit with applications to communications, economics, engineering and finance. Boston: Birkhaüser. Åberg, S. and Podgórski, K. (211). A class of non-gaussian second order random fields. Extremes Podgórski, K. and Wegener, J. (21). Estimation for stochastic models driven by Laplace motion. Comm. Statist. - Theory and Methods. Lindgren, F., Rue, H., and Lindström, J. (211). An explicit link between gaussian fields and gaussian markov random fields: the stochastic partial differential equation approach. J. Royal Stat. Soc., Series B. Lindgren, G., Bolin, D., Lindgren, F. (21) Non-traditional stochastic models for ocean waves Lagrange models and nested SPDE models. European Phys. J. Bolin, D. (211). Non-gaussian spatial models generated by stochastic partial differential equations. Podgórski, K., Walin, J. (211). The EM-algorithm for models involving generalized Laplace distribution. In progress Baxevani A., Podgórski, K. and Wegener, J. (212). Vertical and Horizontal asymmetries for moving averages driven by Laplace motion. In progress Baxevani A. and Podgórski, K., (212). Spectral representation of Laplace moving average process. In progress
85 Final Slide
86 Final Slide The French physicist Gabriel Lippman wrote the following in a letter to Henri Poincare. Tout le monde y croit cependent, car les experimenteurs s imaginent que c est un theorem de mathematiques, et les mathematiciens que c est un fait experimental. Everybody believes in the exponential law of errors: the experimenters, because they think it can be proved by mathematics; and the mathematicians, because they believe it has been established by observation.
The Laplace driven moving average a non-gaussian stationary process
The Laplace driven moving average a non-gaussian stationary process 1, Krzysztof Podgórski 2, Igor Rychlik 1 1 Mathematical Sciences, Mathematical Statistics, Chalmers 2 Centre for Mathematical Sciences,
More informationPREPRINT 2012:13. Note on modeling of fatigue damage rates for non-gaussian stresses IGOR RYCHLIK
PREPRINT 2012:13 Note on modeling of fatigue damage rates for non-gaussian stresses IGOR RYCHLIK Department of Mathematical Sciences Division of Mathematics CHALMERS UNIVERSITY OF TECHNOLOGY UNIVERSITY
More informationA Note on Certain Stability and Limiting Properties of ν-infinitely divisible distributions
Int. J. Contemp. Math. Sci., Vol. 1, 2006, no. 4, 155-161 A Note on Certain Stability and Limiting Properties of ν-infinitely divisible distributions Tomasz J. Kozubowski 1 Department of Mathematics &
More informationState Space Representation of Gaussian Processes
State Space Representation of Gaussian Processes Simo Särkkä Department of Biomedical Engineering and Computational Science (BECS) Aalto University, Espoo, Finland June 12th, 2013 Simo Särkkä (Aalto University)
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More informationIntroduction to Spatial Data and Models
Introduction to Spatial Data and Models Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry
More informationIntroduction to Spatial Data and Models
Introduction to Spatial Data and Models Sudipto Banerjee 1 and Andrew O. Finley 2 1 Department of Forestry & Department of Geography, Michigan State University, Lansing Michigan, U.S.A. 2 Biostatistics,
More informationPREPRINT 2010:47. Multivariate Generalized Laplace Distributions and Related Random Fields TOMASZ J. KOZUBOWSKI KRZYSZTOF PODGÓRSKI IGOR RYCHLIK
PREPRINT 2010:47 Multivariate Generalized Laplace Distributions and Related Random Fields TOMASZ J. KOZUBOWSKI KRZYSZTOF PODGÓRSKI IGOR RYCHLIK Department of Mathematical Sciences Division of Mathematical
More informationMultivariate Normal-Laplace Distribution and Processes
CHAPTER 4 Multivariate Normal-Laplace Distribution and Processes The normal-laplace distribution, which results from the convolution of independent normal and Laplace random variables is introduced by
More informationReliability Theory of Dynamically Loaded Structures (cont.)
Outline of Reliability Theory of Dynamically Loaded Structures (cont.) Probability Density Function of Local Maxima in a Stationary Gaussian Process. Distribution of Extreme Values. Monte Carlo Simulation
More informationA Framework for Daily Spatio-Temporal Stochastic Weather Simulation
A Framework for Daily Spatio-Temporal Stochastic Weather Simulation, Rick Katz, Balaji Rajagopalan Geophysical Statistics Project Institute for Mathematics Applied to Geosciences National Center for Atmospheric
More informationGeneralized Laplacian Distributions and Autoregressive Processes
CHAPTER Generalized Laplacian Distributions and Autoregressive Processes. Introduction Generalized Laplacian distribution corresponds to the distribution of differences of independently and identically
More informationA short introduction to INLA and R-INLA
A short introduction to INLA and R-INLA Integrated Nested Laplace Approximation Thomas Opitz, BioSP, INRA Avignon Workshop: Theory and practice of INLA and SPDE November 7, 2018 2/21 Plan for this talk
More informationNonparametric Bayesian Methods (Gaussian Processes)
[70240413 Statistical Machine Learning, Spring, 2015] Nonparametric Bayesian Methods (Gaussian Processes) Jun Zhu dcszj@mail.tsinghua.edu.cn http://bigml.cs.tsinghua.edu.cn/~jun State Key Lab of Intelligent
More informationStat 451 Lecture Notes Markov Chain Monte Carlo. Ryan Martin UIC
Stat 451 Lecture Notes 07 12 Markov Chain Monte Carlo Ryan Martin UIC www.math.uic.edu/~rgmartin 1 Based on Chapters 8 9 in Givens & Hoeting, Chapters 25 27 in Lange 2 Updated: April 4, 2016 1 / 42 Outline
More informationNonstationary spatial process modeling Part II Paul D. Sampson --- Catherine Calder Univ of Washington --- Ohio State University
Nonstationary spatial process modeling Part II Paul D. Sampson --- Catherine Calder Univ of Washington --- Ohio State University this presentation derived from that presented at the Pan-American Advanced
More informationBasics of Point-Referenced Data Models
Basics of Point-Referenced Data Models Basic tool is a spatial process, {Y (s), s D}, where D R r Chapter 2: Basics of Point-Referenced Data Models p. 1/45 Basics of Point-Referenced Data Models Basic
More informationMultistage Methodologies for Partitioning a Set of Exponential. populations.
Multistage Methodologies for Partitioning a Set of Exponential Populations Department of Mathematics, University of New Orleans, 2000 Lakefront, New Orleans, LA 70148, USA tsolanky@uno.edu Tumulesh K.
More informationGAUSSIAN PROCESS REGRESSION
GAUSSIAN PROCESS REGRESSION CSE 515T Spring 2015 1. BACKGROUND The kernel trick again... The Kernel Trick Consider again the linear regression model: y(x) = φ(x) w + ε, with prior p(w) = N (w; 0, Σ). The
More informationStationary distributions of non Gaussian Ornstein Uhlenbeck processes for beam halos
N Cufaro Petroni: CYCLOTRONS 2007 Giardini Naxos, 1 5 October, 2007 1 Stationary distributions of non Gaussian Ornstein Uhlenbeck processes for beam halos CYCLOTRONS 2007 Giardini Naxos, 1 5 October Nicola
More informationModule 9: Stationary Processes
Module 9: Stationary Processes Lecture 1 Stationary Processes 1 Introduction A stationary process is a stochastic process whose joint probability distribution does not change when shifted in time or space.
More informationABC methods for phase-type distributions with applications in insurance risk problems
ABC methods for phase-type with applications problems Concepcion Ausin, Department of Statistics, Universidad Carlos III de Madrid Joint work with: Pedro Galeano, Universidad Carlos III de Madrid Simon
More informationNumerical Methods with Lévy Processes
Numerical Methods with Lévy Processes 1 Objective: i) Find models of asset returns, etc ii) Get numbers out of them. Why? VaR and risk management Valuing and hedging derivatives Why not? Usual assumption:
More informationSlash Distributions and Applications
CHAPTER 2 Slash Distributions and Alications 2.1 Introduction The concet of slash distributions was introduced by Kafadar (1988) as a heavy tailed alternative to the normal distribution. Further literature
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More informationPhysician Performance Assessment / Spatial Inference of Pollutant Concentrations
Physician Performance Assessment / Spatial Inference of Pollutant Concentrations Dawn Woodard Operations Research & Information Engineering Cornell University Johns Hopkins Dept. of Biostatistics, April
More informationBayesian Methods for Machine Learning
Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),
More informationBayesian Regression Linear and Logistic Regression
When we want more than point estimates Bayesian Regression Linear and Logistic Regression Nicole Beckage Ordinary Least Squares Regression and Lasso Regression return only point estimates But what if we
More informationUniversal examples. Chapter The Bernoulli process
Chapter 1 Universal examples 1.1 The Bernoulli process First description: Bernoulli random variables Y i for i = 1, 2, 3,... independent with P [Y i = 1] = p and P [Y i = ] = 1 p. Second description: Binomial
More informationOn prediction and density estimation Peter McCullagh University of Chicago December 2004
On prediction and density estimation Peter McCullagh University of Chicago December 2004 Summary Having observed the initial segment of a random sequence, subsequent values may be predicted by calculating
More informationBeyond the color of the noise: what is memory in random phenomena?
Beyond the color of the noise: what is memory in random phenomena? Gennady Samorodnitsky Cornell University September 19, 2014 Randomness means lack of pattern or predictability in events according to
More informationStatistícal Methods for Spatial Data Analysis
Texts in Statistícal Science Statistícal Methods for Spatial Data Analysis V- Oliver Schabenberger Carol A. Gotway PCT CHAPMAN & K Contents Preface xv 1 Introduction 1 1.1 The Need for Spatial Analysis
More informationMultivariate Gaussian Random Fields with SPDEs
Multivariate Gaussian Random Fields with SPDEs Xiangping Hu Daniel Simpson, Finn Lindgren and Håvard Rue Department of Mathematics, University of Oslo PASI, 214 Outline The Matérn covariance function and
More informationArchimer
Please note that this is an author-produced PDF of an article accepted for publication following peer review. The definitive publisher-authenticated version is available on the publisher Web site Computational
More informationStatistics - Lecture One. Outline. Charlotte Wickham 1. Basic ideas about estimation
Statistics - Lecture One Charlotte Wickham wickham@stat.berkeley.edu http://www.stat.berkeley.edu/~wickham/ Outline 1. Basic ideas about estimation 2. Method of Moments 3. Maximum Likelihood 4. Confidence
More informationMarkov Chain Monte Carlo (MCMC)
Markov Chain Monte Carlo (MCMC Dependent Sampling Suppose we wish to sample from a density π, and we can evaluate π as a function but have no means to directly generate a sample. Rejection sampling can
More informationOrnstein-Uhlenbeck processes for geophysical data analysis
Ornstein-Uhlenbeck processes for geophysical data analysis Semere Habtemicael Department of Mathematics North Dakota State University May 19, 2014 Outline 1 Introduction 2 Model 3 Characteristic function
More informationSTA414/2104 Statistical Methods for Machine Learning II
STA414/2104 Statistical Methods for Machine Learning II Murat A. Erdogdu & David Duvenaud Department of Computer Science Department of Statistical Sciences Lecture 3 Slide credits: Russ Salakhutdinov Announcements
More informationLecture 2 APPLICATION OF EXREME VALUE THEORY TO CLIMATE CHANGE. Rick Katz
1 Lecture 2 APPLICATION OF EXREME VALUE THEORY TO CLIMATE CHANGE Rick Katz Institute for Study of Society and Environment National Center for Atmospheric Research Boulder, CO USA email: rwk@ucar.edu Home
More informationInvariance Properties of the Negative Binomial Lévy Process and Stochastic Self-similarity
International Mathematical Forum, 2, 2007, no. 30, 1457-1468 Invariance Properties of the Negative Binomial Lévy Process and Stochastic Self-similarity Tomasz J. Kozubowski Department of Mathematics &
More informationChapter 4 - Fundamentals of spatial processes Lecture notes
Chapter 4 - Fundamentals of spatial processes Lecture notes Geir Storvik January 21, 2013 STK4150 - Intro 2 Spatial processes Typically correlation between nearby sites Mostly positive correlation Negative
More informationGaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012
Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More informationMax stable Processes & Random Fields: Representations, Models, and Prediction
Max stable Processes & Random Fields: Representations, Models, and Prediction Stilian Stoev University of Michigan, Ann Arbor March 2, 2011 Based on joint works with Yizao Wang and Murad S. Taqqu. 1 Preliminaries
More informationExtreme Value Analysis and Spatial Extremes
Extreme Value Analysis and Department of Statistics Purdue University 11/07/2013 Outline Motivation 1 Motivation 2 Extreme Value Theorem and 3 Bayesian Hierarchical Models Copula Models Max-stable Models
More informationIntroduction. Chapter 1
Chapter 1 Introduction In this book we will be concerned with supervised learning, which is the problem of learning input-output mappings from empirical data (the training dataset). Depending on the characteristics
More informationExact Linear Likelihood Inference for Laplace
Exact Linear Likelihood Inference for Laplace Prof. N. Balakrishnan McMaster University, Hamilton, Canada bala@mcmaster.ca p. 1/52 Pierre-Simon Laplace 1749 1827 p. 2/52 Laplace s Biography Born: On March
More informationIf we want to analyze experimental or simulated data we might encounter the following tasks:
Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction
More informationStat 516, Homework 1
Stat 516, Homework 1 Due date: October 7 1. Consider an urn with n distinct balls numbered 1,..., n. We sample balls from the urn with replacement. Let N be the number of draws until we encounter a ball
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 7 Approximate
More informationNormalized kernel-weighted random measures
Normalized kernel-weighted random measures Jim Griffin University of Kent 1 August 27 Outline 1 Introduction 2 Ornstein-Uhlenbeck DP 3 Generalisations Bayesian Density Regression We observe data (x 1,
More informationE[X n ]= dn dt n M X(t). ). What is the mgf? Solution. Found this the other day in the Kernel matching exercise: 1 M X (t) =
Chapter 7 Generating functions Definition 7.. Let X be a random variable. The moment generating function is given by M X (t) =E[e tx ], provided that the expectation exists for t in some neighborhood of
More informationMulti-resolution models for large data sets
Multi-resolution models for large data sets Douglas Nychka, National Center for Atmospheric Research National Science Foundation NORDSTAT, Umeå, June, 2012 Credits Steve Sain, NCAR Tia LeRud, UC Davis
More informationUnderstanding Regressions with Observations Collected at High Frequency over Long Span
Understanding Regressions with Observations Collected at High Frequency over Long Span Yoosoon Chang Department of Economics, Indiana University Joon Y. Park Department of Economics, Indiana University
More informationNetworked Control System Protocols Modeling & Analysis using Stochastic Impulsive Systems
Networked Control System Protocols Modeling & Analysis using Stochastic Impulsive Systems João P. Hespanha Center for Control Dynamical Systems and Computation Talk outline Examples feedback over shared
More informationA Gaussian state-space model for wind fields in the North-East Atlantic
A Gaussian state-space model for wind fields in the North-East Atlantic Julie BESSAC - Université de Rennes 1 with Pierre AILLIOT and Valï 1 rie MONBET 2 Juillet 2013 Plan Motivations 1 Motivations 2 Context
More informationExponential Distribution and Poisson Process
Exponential Distribution and Poisson Process Stochastic Processes - Lecture Notes Fatih Cavdur to accompany Introduction to Probability Models by Sheldon M. Ross Fall 215 Outline Introduction Exponential
More informationCovariance function estimation in Gaussian process regression
Covariance function estimation in Gaussian process regression François Bachoc Department of Statistics and Operations Research, University of Vienna WU Research Seminar - May 2015 François Bachoc Gaussian
More informationPoint-Referenced Data Models
Point-Referenced Data Models Jamie Monogan University of Georgia Spring 2013 Jamie Monogan (UGA) Point-Referenced Data Models Spring 2013 1 / 19 Objectives By the end of these meetings, participants should
More informationTowards inference for skewed alpha stable Levy processes
Towards inference for skewed alpha stable Levy processes Simon Godsill and Tatjana Lemke Signal Processing and Communications Lab. University of Cambridge www-sigproc.eng.cam.ac.uk/~sjg Overview Motivation
More informationEstimation of the long Memory parameter using an Infinite Source Poisson model applied to transmission rate measurements
of the long Memory parameter using an Infinite Source Poisson model applied to transmission rate measurements François Roueff Ecole Nat. Sup. des Télécommunications 46 rue Barrault, 75634 Paris cedex 13,
More informationCopulas, a novel approach to model spatial and spatio-temporal dependence
Copulas, a novel approach to model spatial and spatio-temporal dependence Benedikt Gräler 1, Hannes Kazianka 2, Giovana Mira de Espindola 3 1 Institute for Geoinformatics, University of Münster, Germany
More informationEconometría 2: Análisis de series de Tiempo
Econometría 2: Análisis de series de Tiempo Karoll GOMEZ kgomezp@unal.edu.co http://karollgomez.wordpress.com Segundo semestre 2016 II. Basic definitions A time series is a set of observations X t, each
More informationDiscrete time processes
Discrete time processes Predictions are difficult. Especially about the future Mark Twain. Florian Herzog 2013 Modeling observed data When we model observed (realized) data, we encounter usually the following
More informationThe Bayesian approach to inverse problems
The Bayesian approach to inverse problems Youssef Marzouk Department of Aeronautics and Astronautics Center for Computational Engineering Massachusetts Institute of Technology ymarz@mit.edu, http://uqgroup.mit.edu
More informationSpatial Statistics with Image Analysis. Outline. A Statistical Approach. Johan Lindström 1. Lund October 6, 2016
Spatial Statistics Spatial Examples More Spatial Statistics with Image Analysis Johan Lindström 1 1 Mathematical Statistics Centre for Mathematical Sciences Lund University Lund October 6, 2016 Johan Lindström
More information3. Review of Probability and Statistics
3. Review of Probability and Statistics ECE 830, Spring 2014 Probabilistic models will be used throughout the course to represent noise, errors, and uncertainty in signal processing problems. This lecture
More informationHierarchical Modeling for Univariate Spatial Data
Hierarchical Modeling for Univariate Spatial Data Geography 890, Hierarchical Bayesian Models for Environmental Spatial Data Analysis February 15, 2011 1 Spatial Domain 2 Geography 890 Spatial Domain This
More informationAsymptotics for posterior hazards
Asymptotics for posterior hazards Pierpaolo De Blasi University of Turin 10th August 2007, BNR Workshop, Isaac Newton Intitute, Cambridge, UK Joint work with Giovanni Peccati (Université Paris VI) and
More information3. Probability and Statistics
FE661 - Statistical Methods for Financial Engineering 3. Probability and Statistics Jitkomut Songsiri definitions, probability measures conditional expectations correlation and covariance some important
More informationShort-time expansions for close-to-the-money options under a Lévy jump model with stochastic volatility
Short-time expansions for close-to-the-money options under a Lévy jump model with stochastic volatility José Enrique Figueroa-López 1 1 Department of Statistics Purdue University Statistics, Jump Processes,
More informationJump-type Levy Processes
Jump-type Levy Processes Ernst Eberlein Handbook of Financial Time Series Outline Table of contents Probabilistic Structure of Levy Processes Levy process Levy-Ito decomposition Jump part Probabilistic
More information1.1 Review of Probability Theory
1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,
More informationComputational statistics
Computational statistics Markov Chain Monte Carlo methods Thierry Denœux March 2017 Thierry Denœux Computational statistics March 2017 1 / 71 Contents of this chapter When a target density f can be evaluated
More informationRegular Variation and Extreme Events for Stochastic Processes
1 Regular Variation and Extreme Events for Stochastic Processes FILIP LINDSKOG Royal Institute of Technology, Stockholm 2005 based on joint work with Henrik Hult www.math.kth.se/ lindskog 2 Extremes for
More informationLecture 7 and 8: Markov Chain Monte Carlo
Lecture 7 and 8: Markov Chain Monte Carlo 4F13: Machine Learning Zoubin Ghahramani and Carl Edward Rasmussen Department of Engineering University of Cambridge http://mlg.eng.cam.ac.uk/teaching/4f13/ Ghahramani
More informationCS Lecture 19. Exponential Families & Expectation Propagation
CS 6347 Lecture 19 Exponential Families & Expectation Propagation Discrete State Spaces We have been focusing on the case of MRFs over discrete state spaces Probability distributions over discrete spaces
More informationModelling the risk process
Modelling the risk process Krzysztof Burnecki Hugo Steinhaus Center Wroc law University of Technology www.im.pwr.wroc.pl/ hugo Modelling the risk process 1 Risk process If (Ω, F, P) is a probability space
More informationFigure 10.1: Recording when the event E occurs
10 Poisson Processes Let T R be an interval. A family of random variables {X(t) ; t T} is called a continuous time stochastic process. We often consider T = [0, 1] and T = [0, ). As X(t) is a random variable
More informationA skew Laplace distribution on integers
AISM (2006) 58: 555 571 DOI 10.1007/s10463-005-0029-1 Tomasz J. Kozubowski Seidu Inusah A skew Laplace distribution on integers Received: 17 November 2004 / Revised: 24 February 2005 / Published online:
More informationModeling processes asymmetries with Laplace Moving Average.
Modeling processes asymmetries with Laplace Moving Average. Nicolas Raillard, Marc Prevosto, Pierre Ailliot To cite this version: Nicolas Raillard, Marc Prevosto, Pierre Ailliot. Modeling processes asymmetries
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationStatistical techniques for data analysis in Cosmology
Statistical techniques for data analysis in Cosmology arxiv:0712.3028; arxiv:0911.3105 Numerical recipes (the bible ) Licia Verde ICREA & ICC UB-IEEC http://icc.ub.edu/~liciaverde outline Lecture 1: Introduction
More informationIE 303 Discrete-Event Simulation
IE 303 Discrete-Event Simulation 1 L E C T U R E 5 : P R O B A B I L I T Y R E V I E W Review of the Last Lecture Random Variables Probability Density (Mass) Functions Cumulative Density Function Discrete
More informationGARCH Models Estimation and Inference
GARCH Models Estimation and Inference Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 1 Likelihood function The procedure most often used in estimating θ 0 in
More informationECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering
ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering Lecturer: Nikolay Atanasov: natanasov@ucsd.edu Teaching Assistants: Siwei Guo: s9guo@eng.ucsd.edu Anwesan Pal:
More informationReview. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda
Review DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall16 Carlos Fernandez-Granda Probability and statistics Probability: Framework for dealing with
More informationWeak convergence to the t-distribution
Weak convergence to the t-distribution Christian Schluter and Mark Trede 21/2011 DEFI, Aix-Marseille Université, France and University of Southampton, UK Department of Economics, University of Münster,
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationLecture 6: Markov Chain Monte Carlo
Lecture 6: Markov Chain Monte Carlo D. Jason Koskinen koskinen@nbi.ku.dk Photo by Howard Jackman University of Copenhagen Advanced Methods in Applied Statistics Feb - Apr 2016 Niels Bohr Institute 2 Outline
More informationIntroduction to Bayesian methods in inverse problems
Introduction to Bayesian methods in inverse problems Ville Kolehmainen 1 1 Department of Applied Physics, University of Eastern Finland, Kuopio, Finland March 4 2013 Manchester, UK. Contents Introduction
More informationAdvanced Statistical Methods. Lecture 6
Advanced Statistical Methods Lecture 6 Convergence distribution of M.-H. MCMC We denote the PDF estimated by the MCMC as. It has the property Convergence distribution After some time, the distribution
More informationGARCH Models Estimation and Inference. Eduardo Rossi University of Pavia
GARCH Models Estimation and Inference Eduardo Rossi University of Pavia Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function
More informationHANDBOOK OF APPLICABLE MATHEMATICS
HANDBOOK OF APPLICABLE MATHEMATICS Chief Editor: Walter Ledermann Volume II: Probability Emlyn Lloyd University oflancaster A Wiley-Interscience Publication JOHN WILEY & SONS Chichester - New York - Brisbane
More informationEco517 Fall 2004 C. Sims MIDTERM EXAM
Eco517 Fall 2004 C. Sims MIDTERM EXAM Answer all four questions. Each is worth 23 points. Do not devote disproportionate time to any one question unless you have answered all the others. (1) We are considering
More informationStatistical signal processing
Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable
More informationPart I Stochastic variables and Markov chains
Part I Stochastic variables and Markov chains Random variables describe the behaviour of a phenomenon independent of any specific sample space Distribution function (cdf, cumulative distribution function)
More informationStochastic Processes. A stochastic process is a function of two variables:
Stochastic Processes Stochastic: from Greek stochastikos, proceeding by guesswork, literally, skillful in aiming. A stochastic process is simply a collection of random variables labelled by some parameter:
More informationDoes k-th Moment Exist?
Does k-th Moment Exist? Hitomi, K. 1 and Y. Nishiyama 2 1 Kyoto Institute of Technology, Japan 2 Institute of Economic Research, Kyoto University, Japan Email: hitomi@kit.ac.jp Keywords: Existence of moments,
More information. Find E(V ) and var(v ).
Math 6382/6383: Probability Models and Mathematical Statistics Sample Preliminary Exam Questions 1. A person tosses a fair coin until she obtains 2 heads in a row. She then tosses a fair die the same number
More information