Bayesian Inference for Pair-copula Constructions of Multiple Dependence

Size: px
Start display at page:

Download "Bayesian Inference for Pair-copula Constructions of Multiple Dependence"

Transcription

1 Bayesian Inference for Pair-copula Constructions of Multiple Dependence Claudia Czado and Aleksey Min Technische Universität München December 7, 2007

2 Overview 1 Introduction 2 Pair-copula constructions (PCC) 3 Bayesian Analysis of PCC s 4 Application: Financial Returns 5 Bayesian Model Selection among PCC s 6 Euro Swap Rates 7 Summary and Outlook

3 Introduction Introduction Bedford and Cooke (2001) and Bedford and Cooke (2002) gave a probabilistic construction of multivariate distributions based on simple building blocks called pair-copulas. See also Kurowicka and Cooke (2006). Extends work by Joe (1996). Aas, Czado, Frigessi, and Bakken (2007) used the PCC construction to construct flexible multivariate copulas based on pair-copulas such as bivariate Gaussian, t-, Gumbel and Clayton copulas

4 Introduction Introduction Parameters are estimated by maximum likelihood (ML) and PCC s are sucessfully applied to financial return data Berg and Aas (2007) give further example of PCC s and developed an R-package for fitting PCC s using MLE The Fisher information is difficult to handle analytically, so therefore estimated standard errors for parameter estimates are so far absent Here we follow a Bayesian approach where such interval estimates are easy to establish

5 Introduction Multivariate Distributions Consider n random variables X = (X 1,...,X n ) with joint density f (x 1,...,x n ) and marginal densities f i (x i ),i = 1,...,n joint cdf F(x 1,...,x n ) and marginal cdf s F i (x i ),i = 1,...,n factorization f (x 1,..., x n) = f n(x n) f (x n 1 x n) f (x n 2 x n 1, x n)... f (x 1 x 2,...,x n) (1)

6 Introduction Copula A copula is a multivariate distribution on [0,1] n with uniformly distributed marginals. copula cdf C(u 1,...,u n ) copula density c(u 1,...,u n ) Using Sklar s Theorem (1959) we have for absolutely continuous distributions with continuous marginal cdf s f (x 1,...,x n ) = c 12 n (F 1 (x 1 ),... F n (x n )) f 1 (x 1 ) f n (x n ) (2) for some n-variate copula density c 12 n ( ).

7 Pair-copula constructions (PCC) Pair-copula constructions (PCC) n = 3 f 1 23 (x 1 x 2,x 3 ) = f 12 3(x 1,x 2 x 3 ) f 2 3 (x 2 x 3 ) = c 12 3 (F 1 3 (x 1 x 3 ),F 2 3 (x 2 x 3 )) f 1 3 (x 1 x 3 ) general n For v = (v 1,...,v d ) and any j = 1,...,d f (x v) = c xvj v j (F(x v j ),F(v j v j )) f (x v j ) v j = (v 1,...,v j 1,v j+1,...,v d ) c xvj v j ( ) = bivariate copula density Combining this decomposition of the conditional distribution with the factorization (1), we derive at a decomposition of f (x 1,...,x n ) that only consist of pair-copulae. We call this a pair-copula construction (PCC).

8 Pair-copula constructions (PCC) Conditional cdf s Univariate v: Since f (x v) = c xv (F x (x),f v (v))f x (x) we have F(x v) = x c xv (F x (u),f v (v))f x (u)du = C xv(f x (x),f v (v)) F v (v) General v: Under regularity conditions Joe (1996) showed that F(x v) = C x,v j v j (F(x v j ),F(v j v j )), F(v j v j )

9 Pair-copula constructions (PCC) Vines For high-dimensional distributions there are many possible pair-copula constructions. Bedford and Cooke (2001) introduced a graphical model called regular vine to help organize them. The class of regular vines is large and embraces a large number of possible PCC s. We concentrate on two special cases (Kurowicka and Cooke 2004): D-vine Canonical Vine

10 Pair-copula constructions (PCC) Vines(2) An n-dimensional vine is represented by n-1 trees. Tree j has n + 1 j nodes and n j edges. Each edge corresponds to a pair-copula density. Edges in tree j become nodes in tree j + 1. Two nodes in tree j + 1 are joined by an edge if the corresponding edges in tree j share a node. The complete decomposition is defined by the n(n 1) 2 edges (i.e. pair copula densities) and the marginal densities.

11 Pair-copula constructions (PCC) Canonical and D-vines Canonical vine: A regular vine for which each tree has a unique node that is connected to n j edges. D-vine: A regular vine for which no node in any tree is connected to more than two edges Abbreviations: c ij v := c ij v (F i v (x i x v ),F j v (x j x v )) f j := f j (x j ) f v := f v (x v )

12 Pair-copula constructions (PCC) Five dimensional canonical vine f = f 1 f 2 f 3 f 4 f 5 c 12 c 13 c 14 c 15 c 23 1 c 24 1 c 25 1 c c c T T T T 4

13 Pair-copula constructions (PCC) Five dimensional D-vine f = f 1 f 2 f 3 f 4 f 5 c 12 c 23 c 34 c 45 c 13 2 c 24 3 c 35 4 c c c T T T T 4

14 Pair-copula constructions (PCC) General density expressions Canonical vine density D-vine density n k=1 n k=1 n 1 f k n j c j,j+i 1,...,j 1 j=1 i=1 n 1 n j f k c i,i+j i+1,...,i+j 1 j=1 i=1 where index j identifies the trees, while i runs over the edges in each tree.

15 Bayesian Analysis of PCC s Bayesian Analysis of PCC s with t-copula pairs Assume bivariate t-copula for each pair copula term, i.e. θ c(u 1, u 2 θ) = where = (ρ, ν) ρ = correlation, ν = df Γ( ν+2 2 )/Γ( ν 2 ) νπt ν (x 1 )t ν (x 2 ) 1 ρ 2 ( 1 + x2 1 + x2 2 2ρ x 1 x 2 ν(1 ρ 2 ) x 1 = tν 1 1) x 2 = tν 1 (u 2 ) t ν ( ) = pdf of univariate t ν distribution tν 1 ( ) = quantile function of t ν distribution ) ν+2 2,

16 Bayesian Analysis of PCC s Bayesian Analysis of PCC s with t-copula pairs For the PCC s we assume a regular vine structure with edge indices denoted by s := ij v for s S. Let θ s = (ρ s,ν s ) the corresponding parameters of the pair copula associated with edge s. Let θ = {θ s,s S} denote the vector of all parameters of the PCC with t-copula pairs We assume uniform priors for ρ s on ( 1,1) and for ν s on (1, U) for each s and prior independence among all parameters Inference is based on the posterior distribution given by p(θ data) = f (data θ) p(θ) f (data θ) p(θ)dθ where f (data θ) is the likelihood of the PCC and p(θ) the prior for θ

17 Bayesian Analysis of PCC s Bayesian Analysis of PCC s with t-copula pairs Since θ is high dimensional the posterior is not analytically tractable. Posterior distribution is estimated using Markov Chain Monte Carlo (MCMC) methods For each univariate parameter Metropolis-Hastings (MH) updates with symmetric normal random walk proposals are used Proposal variances are determined by pilot runs to achieve acceptance rates between 20% and 80%. Posterior mean, mode, median and density are estimated using the MCMC iterates. Credible intervals are estimated by empirical quantiles of the MCMC iterates.

18 Application: Financial Returns Application: Financial Returns Tail dependence properties are important in finance. n-dimensional Student s t-copula has been often used for modeling financial returns, however it only has a single parameter for tail dependence. Pair-copula constructions allows for multiple parameters for modeling tail dependence.

19 Application: Financial Returns Data set Daily data from Jan. 4, 1999 until July 8, 2003 for T = Norwegian stock index (TOTX) M = MSCI world stock index B = Norwegian bond index (BRIX) S = SSBWG hedged bond index Standardized residuals of a AR(1)-GARCH(1,1) model for the log return x i,t x i,t = c i + α i x i,t 1 + σ i,t z i,t, E[z t,i ] = 0 and Var[z t,i ] = 1, σ 2 i,t = a i,0 + a i ǫ 2 i,t 1 + b i σ 2 i,t 1 where ǫ i,t 1 = σ i,t z i,t are found to be independent and are transformed to uniform margins

20 Application: Financial Returns Data set Fitted degree of freedom for a t-copula to each pair Between M T B S M T 12.60

21 Application: Financial Returns Which PCC? Strongest dependence between S and M, M and T and T and B, which will be used in the top tree of a D-vine SM MT TB S M T B ST M MB T SM MT TB ST M SB MT MB T

22 Application: Financial Returns Bayesian Inference of the Norwegian return data For each pair copula we assume a bivariate t-copula with correlation ρ and ν degree of freedom. For each ρ we assume uniform(-1,1) prior and for ν a uniform(1,1000) prior. Further prior independence between all parameters are assumed. For the likelihood we assume the following PCC c(x S, x M, x T, x B ) = c SM (F(x S ), F(x M )) c MT (F(x M ), F(x T )) c TB (F(x T ), F(x B )) c ST M (F(x S x M ), F(x T x M )) c MB T (F(x M x T ), F(x B x T )) c SB MT (F(x S x M, x T ), F(x B x M, x T ))

23 Application: Financial Returns Bayesian Inference of the Norwegian return data For the MH updates in the MCMC algorithm we used symmetric random walk proposals normal proposals with variances determined by pilot runs to achieve acceptance rates between 25% and 80% MCMC iterations were run MLE estimates were used as starting values Implemented using Daniel Berg s R-package

24 Application: Financial Returns Trace Plots of MCMC iterations ρ SM ν SM ρ MT ν MT ρ Iterations ν Iterations ρ Iterations ν Iterations ρ TB ν TB ρ ST M ν ST M ρ Iterations ν Iterations ρ Iterations ρ MB T ν MB T ρ SB MT ν SB MT ρ ρ ν Iterations ν ν Iterations Iterations Iterations Iterations

25 Application: Financial Returns Autocorrelations of the MCMC iterations ρ SM ν SM ρ MT ν MT ACF ACF ACF ACF Lag Lag Lag Lag ρ TB ν TB ρ ST M ν ST M ACF ACF ACF ACF Lag Lag Lag Lag ρ MB T ν MB T ρ SB MT ν SB MT ACF ACF ACF ACF Lag Lag Lag Lag For the further analysis we used burnin 1000 iteration and only every 20th iteration.

26 Application: Financial Returns Estimated Posterior Densities ρ SM ν SM ρ MT ν MT Density Density Density Density ρ TB ν TB ρ ST M ν ST M Density Density 4e 04 1e Density Density 4e 04 1e ρ MB T ν MB T ρ SB MT ν SB MT Density Density 5e 04 9e Density Density

27 Application: Financial Returns Summary statistics for thinned MCMC 2.5% 50% 97.5% Est. Post. Est. Post. MLE Quantile Quantile Quantile Mean Mode ρ SM ν SM ρ MT ν MT ρ TB ν TB ρ ST M ν ST M ρ MB T ν MB T ρ SB MT ν SB MT red corresponds to uncorrelatedness magenta corresponds to near normality

28 Application: Financial Returns Model fit: Kendall s τ Kendall s τ measures dependence and is defined by τ := P((X 1 X 2 )(Y 1 Y 2 ) > 0) P((X 1 X 2 )(Y 1 Y 2 ) < 0) where (X 1,Y 1 ) and (X 2,Y 2 ) are i.i.d. τ is invariant under monotone transformations Relationship between τ and ρ for bivariate t-distributions τ = 2 π arcsin(ρ) Estimated posterior summaries of τ 2.5% 50% 97.5% Est. Post. Est. Post Empirical Quantile Quantile Quantile Mean Mode τ τ SM τ MT τ TB

29 Application: Financial Returns Model fit: Tail dependence Lower and upper tail dependence: λ l := lim P(X F 1 1 v 0 X (v) Y FY λ u := lim P(X F 1 1 v 1 X (v) Y FY For t distributions we have λ := λ l = λ u = 2t ν+1 ( ) 1 ρ ν ρ Estimated posterior summaries of λ 2.5% 50% 97.5% Est. Post. Est. Post Empirical Quantile Quantile Quantile Mean Mode λ l λ SM λ MT λ TB

30 Application: Financial Returns Model fit: Lambda function The λ function is defined as a shifted copula distribution function given by λ(z,θ) := z K(z,θ) K(z,θ) := P(C(u 1,u 2,θ) z) Here θ denotes the parameters of the bivariate copula pair. For the conditional pairs ST M,MB T and SB MT an empirical estimate of λ(z,θ) is based on transformed data using posterior mode estimates

31 Application: Financial Returns Estimated pointwise posterior mode λ(z, θ) Pair ST Pair MT Pair TB z z z Pair ST M Pair MB T Pair SB MT λ(z) λ(z) λ(z) λ(z) λ(z) λ(z) z z z red = 95% CI, black = est. posterior mode, green = empirical

32 Bayesian Model Selection among PCC s Bayesian Model Selection among PCC s Want to select among K models M 1,,M K, where Model M k has parameter θ k and compare them on the basis of posterior model probabilities given by P( Model M k data),k = 1,,K We distinguish two situations K is small and it is feasible timewise to fit all models (Congdon (2006) and Scott (2002)) K is large and we want only to fit models which are probable using reversible jump MCMC (RJMCMC) (Green (1995))

33 Bayesian Model Selection among PCC s Bayesian Model Selection : K small Congdon (2006) made the following assumptions The distribution of the data is independent of {θ j k } given M k Independence among θ k s given Model M and showed that Posterior distributions of θ k are independent given M = M k and can be sampled individually and used that P(M = M k data, θ) P(data θ k, M = M k )P(θ M = M k )P(M = M k ) (3)

34 Bayesian Model Selection among PCC s Bayesian Model Selection : K small Assume that K independently MCMC runs result in M 1 : θ (r) 1,r = 1,,R. M K : θ (r) K,r = 1,,R approximating p(θ 1 data). p(θ K data) Using {θ (r) := (θ (r) 1,,θ(r) K ),r = 1,,R} P(M data) = P(M θ, data)p(θ data)dθ is approximated by P(M data) := 1 R R r=1 P(M θ(r),data).

35 Bayesian Model Selection among PCC s Bayesian Model Selection : K small Using (3) we can estimate P(M = M k data,θ (r) ) by w (r) k := G (r) k K j=1 G(r) j, where G (r) k L (r) k := exp(l (r) k L max) (r) ( ) := log P(data θ (r) k,m = M k)p(θ (r) k M = M k)p(m = M k ) L (r) max := max k=1,,k L(r) k Therefore 1 R R r=1 w (r) k estimates P(M = M k data).

36 Bayesian Model Selection among PCC s K small: Model selection for financial return data Since zero in 95% credible interval for ρ MB T and the posterior mode of ρ ST M and ρ MB T small we want to use Congdon (2006) s method if these copula pairs needed Model PCC Formula P(Mk data) M 1 : with all pairs c SM c MT c TB c ST M c MB T c SB MT M 2 : without c SM c MT c TB c ST M c SB MT c MB T M 3 : without c SM c MT c TB c SB MT c MB T and c ST M M 4 : without c SM c MT c SB MT c MB T,c ST M and c TB

37 Bayesian Model Selection among PCC s K small: Model selection for financial return data Many of the posterior estimates of the degree of freedom are large, so want to check if we can use for these pairs a Gaussian copula Model PCC P(Mk data) M 1 : All pairs are t copulas M 2 : First pair c SM is t copula all other pairs are Gaussian copulas M 3 : All pairs are Gaussian copulas Only for c SM a t-copula is needed.

38 Bayesian Model Selection among PCC s Bayesian Model Selection: K large (RJMCMC) If a single pair copula type is used in a PCC of dimension n, then all other possible PCC s of dimension n provide a factorization of the same joint density So we want to find reduced PCC s which best fits the data, i.e. let the data discover conditional independence conditions. Identifiability: Use only one decomposition n = 3: Full PCC s: c 12 c 23 c 13 2 Reduced by 1 pair-copula: c 12 c 23,c 12 c 13 2,c 23 c 13 2 Reduced by 2 pair copulas: c 12,c 23,c 13 2

39 Bayesian Model Selection among PCC s Bayesian framework of PCC s with n = 3 Each of the 7 different PCC s with n 3 is identified by a model index m = (m 1,m 2,m 3 ) = (i 1 j 1,i 2 j 2,i 3 j 3 k 3 ). Example: c 12 c 23 1 corresponds to m = (12,00,23 1). Each PCC model m has parameter vector θ m = (θ m1,θ m2,θ m3 ). Example: Model m = (12, 23, 00 0) has parameter vector θ m = (θ 12,θ 23,θ 00 0 ) = (θ 12,θ 23 ). Goal is to estimate the best fitting model m and the corresponding parameter vector θ m using a Bayesian approach, i.e. the model m and θ m are considered random quantities. Inference about m and θ m is done via the joint posterior distribution of (m,θ m ).

40 Bayesian Model Selection among PCC s MCMC algorithm for PCC s with n = 3 Problems: Want to facilitate estimation without having to fit all models Joint posterior is not analytically tractable Approach: Construct a Markov Chain Monte Carlo (MCMC) algorithm which simultaneously estimates m and θ m. Requirement: Need to accommodate varying model dimension, i.e. construct MCMC iterates θ m r = (θ r m r 1,θr m r 2,θr m r 3 ) where mr is the current model at iteration r. Solution: Reversible jump (RJ) MCMC proposed by (Green 1995)

41 Bayesian Model Selection among PCC s General RJ MCMC (1) algorithm stays in current model using a Metropolis Hastings (MH) step algorithm moves to a larger model using a MH step (birth) algorithm moves to a smaller model using a MH step (death)

42 Bayesian Model Selection among PCC s General RJ MCMC (2) Model M 1 M 2 Parameter θ (1) R d 1 θ (2) R d 2 d 1 < d 2 Proposal η (1) ϕ 1 ( ) η (2) ϕ 2 ( ) η (1) R a 1 η (2) R a 2 Dimension matching d 1 + a 1 = d 2 + a ( ) ( 2 ) θ (1) θ (2) Bijection η (1) η (2)

43 Bayesian Model Selection among PCC s Acceptance probability for MH step from M 1 to M 2 α(θ (1),θ (2) ) = min {1,A}, where A := p(2,θ(2) y) p(1,θ (1) y) p2 1 ϕ2(η (2) ) p 1 2 ϕ 1 (η (1) ) ) (θ (2),η (2) ) (θ (1),η (1) p(k,θ (k) y) = joint posterior density of M k and θ (k) p i j = prior switching probability from M i to M j ϕ k (η (k) ) = proposal distribution of η (k) (suitably chosen) θ (2),η (2) θ (1) = Jacobian of bijection,η (1) For moves from M 2 to M 1 we use A 1.

44 Bayesian Model Selection among PCC s RJ MCMC moves for selecting PCC s (n=3) Notation Meaning Example B0D0 stay move c 12 c 12 B1D0 birth of 1 factor c 12 c 12 c 23 D1B0 death of 1 factor c 12 c 23 c 12

45 Bayesian Model Selection among PCC s Graph of all PCC s for n = 3 a = 1 4, b = 1 3 b a c12c23c13 2 a a a a a a a c12c23 c12c13 2 c23c13 2 a a a a a a a b b b b b b c12 c23 c13 2 b b a With probabilities a or b the chain moves to other model or stays in the current model

46 Bayesian Model Selection among PCC s Acceptance probability for B1D0 move Actual state θ o := θ o m o mo = (m1 o,mo 2,mo 3 ) Proposed state θ p := θ p m p mp = (m p 1,mp 2,mp 3 ) birth index {ms p } := m p \m o stay indices {mv o,mo w } := mp m o Example: ( θ p ) 12,θp 23 (θ p 12,θp 23,θp 13 2 ) Bijection: θ p := θ p m p s θ p m o v θ p m o w = η o m p s θ o m o v θ o m o w =: ( η o m p s θ o ) Here η o ms p is bivariate normal centered at θ m p s,last covariance matrix with specified

47 Bayesian Model Selection among PCC s MLE for SMT- data Parameter MLE ρ SM ρ MT 0.47 ρ ST M ν SM 4.22 ν MT ν ST M 300 log.likelih Is the correlation ρ ST M = 0.11 significantly negligible?

48 Bayesian Model Selection among PCC s Model notation c SM c MT c ST M M 1 c SM c MT M 2 c SM c ST M M 3 c MT c ST M M 4 c SM M 5 c MT M 6 c ST M M 7 Would Model M 2 now be preferred to Model M 1?

49 Bayesian Model Selection among PCC s Model M 1 was visited 2872 times out of Model M 2 was visited 7128 times out of Financial returns: Statistics of visited models c ST M c ST M c SM c SM c MT c ST M c MT c ST M c SM c ST M c SM c ST M c SM c MT c SM c MT c SM c MT c ST M c SM c MT c ST M Iterations First 10 Iterations

50 Bayesian Model Selection among PCC s Summary statistics for visited Models Model M 2 : c SM c MT 2.5% 50% 97.5% Est. Post. Est. Post. MLE Quantile Quantile Quantile Mean Mode ρ SM ν SM ρ MT ν MT Model M 1 : c SM c MT c ST M 2.5% 50% 97.5% Est. Post. Est. Post. MLE Quantile Quantile Quantile Mean Mode ρ SM ν SM ρ MT ν MT ρ ST M ν ST M

51 Bayesian Model Selection among PCC s Posterior model probabilities RJMCMC Model PCC Formula P(Mk data) M 1 with all pairs c SM c MT c ST M 0.29 M 2 without c ST M c SM c MT 0.71 M 3 without c MT c SM c ST M 0 M 4 without c SM c MT c ST M 0 M 5 without c MT and c ST M c SM 0 M 6 without c SM and c ST M c MT 0 M 7 without c SM and c MT c ST M 0 Congdon Model PCC Formula P(Mk data) M 1 : with all pairs c SM c MT c ST M 0.22 M 2 : without c ST M c SM c MT 0.78

52 Euro Swap Rates Euro Swap Rates daily swap rates with 2,3,5,7 and 10 year maturity quoted in Euro s considered period is Dec 7, 1988 until June 21, 2001 serial marginal correlation removed with an ARMA(1,1)-GARCH(1,1) model and standardized residuals transformed empirically to data with uniform margins Notation: Swap2, Swap3, Swap5, Swap7 and Swap10 or abbreviated S 1,...,S 5

53 Euro Swap Rates Dependence structure of Euro Swap Rates Swap Swap3 Swap Swap7 Swap

54 Euro Swap Rates Estimated df s of bivariate t-copula margins for swap rates Swap3 Swap5 Swap7 Swap10 Swap Swap Swap Swap7 2.07

55 Euro Swap Rates Chosen D-vine structure for swap rates S 1 S 1 S 2 S2 S 2 S 3 S3 S 3 S 4 S4 S 4 S 5 S5 S 1 S 2 S 1 S 3 S 2 S 2 S 3 S 2 S 4 S 3 S 3 S 4 S 3 S 5 S 4 S 4 S 5 S 1 S 3 S 2 S 1 S 4 S 2 S 3 S 2 S 4 S 3 S 2 S 5 S 3 S 4 S 3 S 5 S 4 S 1 S 4 S 2 S 3 S 1 S 5 S 2 S 3 S 4 S 2 S 5 S 3 S 4

56 Euro Swap Rates Trace of MCMC iterations for swap rates ρ S1 S 2 ν S1 S 2 ρ S2 S 3 ν S2 S 3 ρ S3 S 4 ρ Iterations ν Iterations ρ Iterations ν Iterations ρ Iterations ν S3 S 4 ρ S4 S 5 ν S4 S 5 ρ S1 S 3 S 2 ν S1 S 3 S 2 ν Iterations ρ Iterations ν Iterations ρ Iterations ν Iterations ρ S2 S 4 S 3 ν S2 S 4 S 3 ρ S3 S 5 S 4 ν S3 S 5 S 4 ρ S1 S 4 S 2 S 3 ρ Iterations ν Iterations ρ Iterations ν Iterations ρ Iterations ν S1 S 4 S 2 S 3 ρ S2 S 5 S 3 S 4 ν S2 S 5 S 3 S 4 ρ S1 S 5 S 2 S 3 S 4 ν S1 S 5 S 2 S 3 S 4 ν Iterations ρ Iterations ν Iterations ρ Iterations ν Iterations

57 Euro Swap Rates For the further analysis we used burnin 1000 iteration and only every 20th iteration. Autocorrelations among the MCMC iterations for the swap rates ρ S1 S 2 ν S1 S 2 ρ S2 S 3 ν S2 S 3 ρ S3 S 4 ACF ACF ACF ACF ACF Lag Lag Lag Lag Lag ν S3 S 4 ρ S4 S 5 ν S4 S 5 ρ S1 S 3 S 2 ν S1 S 3 S 2 ACF ACF ACF ACF ACF Lag Lag Lag Lag Lag ρ S2 S 4 S 3 ν S2 S 4 S 3 ρ S3 S 5 S 4 ν S3 S 5 S 4 ρ S1 S 4 S 2 S 3 ACF ACF ACF ACF ACF Lag Lag Lag Lag Lag ν S1 S 4 S 2 S 3 ρ S2 S 5 S 3 S 4 ν S2 S 5 S 3 S 4 ρ S1 S 5 S 2 S 3 S 4 ν S1 S 5 S 2 S 3 S 4 ACF ACF ACF ACF ACF Lag Lag Lag Lag Lag

58 Euro Swap Rates Estimated posterior densities of D-vine parameters ρ S1 S 2 ν S1 S 2 ρ S2 S 3 ν S2 S 3 ρ S3 S 4 Density Density Density Density Density ν S3 S 4 ρ S4 S 5 ν S4 S 5 ρ S1 S 3 S 2 ν S1 S 3 S 2 Density Density Density Density Density ρ S2 S 4 S 3 ν S2 S 4 S 3 ρ S3 S 5 S 4 ν S3 S 5 S 4 ρ S1 S 4 S 2 S 3 Density Density Density Density Density Density ν S1 S 4 S 2 S 3 ρ S2 S 5 S 3 S 4 ν S2 S 5 S 3 S 4 ρ S1 S 5 S 2 S 3 S 4 ν S1 S 5 S 2 S 3 S Density Density Density Density

59 Euro Swap Rates Summary statistics for thinned MCMC 2.5% 50% 97.5% Est. Post. Est. Post. MLE Quantile Quantile Quantile Mean Mode ρ S1 S ν S1 S ρ S2 S ν S2 S ρ S3 S ν S3 S ρ S4 S ν S4 S ρ S1 S 3 S ν S1 S 3 S ρ S2 S 4 S ν S2 S 4 S ρ S3 S 5 S ν S3 S 5 S ρ S1 S 4 S 2 S ν S1 S 4 S 2 S ρ S2 S 5 S 3 S ν S2 S 5 S 3 S ρ S1 S 5 S 2 S 3 S ν S1 S 5 S 2 S 3 S

60 Euro Swap Rates Log likelihoods Parameter values loglikelihood multivariate t with common df MLE Posterior Mode Likelihood Ratio Test rejects a multivariate t copula with common df decisively, estimated common df is Since posterior mode log likelihood is close to MLE likelihood, prior choice for ρ and ν are close to being noninformative in this data set.

61 Euro Swap Rates Model selection for swap rate data Model PCC P(Mk data) M 1 : with all pairs 0.19 M 2 : without c S1 S 5 S 2 S 3 S M 3 : without c S1 S 5 S 2 S 3 S 4 and c S2 S 5 S 3 S M 4 : without c S1 S 5 S 2 S 3 S 4, c S2 S 5 S 3 S and c S1 S 4 S 2 S 3

62 Summary and Outlook Summary and Conclusion PCC s such as canonical and D-Vines allow for very flexible class of multivariate distributions. The Bayesian approach can solve estimation as well as model selection problems. It also gives credible intervals for parameters of interest. The proposed RJMCMC Bayesian algorithm for n > 3 is under implementation. Incorporation of pair-copulas from different parametric families is under consideration. The proposed RJMCMC algorithm is an alternative to DIC and other Bayesian model choice algorithms Congdon s method can be used to make model comparisons for a small number of models

63 References Aas, K., C. Czado, A. Frigessi, and H. Bakken (2007). Pair-copula constructions of multiple dependence. Insurance, Mathematics and Economics, DOI /j.insmatheco , preprint available at SFB 386 Statistical Analysis of Diskrete Structures, muenchen.de/sfb386/. Bedford, T. and R. M. Cooke (2001). Probability density decomposition for conditionally dependent random variables modeled by vines. Annals of Mathematics and Artificial Intelligence 32, Bedford, T. and R. M. Cooke (2002). Vines - a new graphical model for dependent random variables. Annals of Statistics 30(4), Berg, D. and K. Aas (2007). Models for construction of higher-dimensional dependence.

64 References Kurowicka, D. and R. Cooke (2006). Uncertainty analysis with high dimensional dependence modelling. Congdon, P. (2006). Bayesian model choice based on monte carlo estimates of posterior model probabilities. Computational Statistics & Data Analysis 50, Green, P. (1995). Reversible jump markov chain monte carlo computation and Bayesian model determination. Biometrika 82, Joe, H. (1996). Families of m-variate distributions with given margins and m(m-1)/2 bivariate dependence parameters. In L. Rüschendorf and B. Schweizer and M. D. Taylor (Ed.), Distributions with Fixed Marginals and Related Topics.

65 Summary and Outlook Chichester: Wiley. Kurowicka, D. and R. M. Cooke (2004). Distribution - free continuous bayesian belief nets. In Fourth International Conference on Mathematical Methods in Reliability Methodology and Practice, Santa Fe, New Mexico. Scott, S. L. (2002). Bayesian methods for hidden Markov models: Recursive computing in the 21st century. J. Amer. Statist. Assoc. 97,

Chapter 1. Bayesian Inference for D-vines: Estimation and Model Selection

Chapter 1. Bayesian Inference for D-vines: Estimation and Model Selection Chapter 1 Bayesian Inference for D-vines: Estimation and Model Selection Claudia Czado and Aleksey Min Technische Universität München, Zentrum Mathematik, Boltzmannstr. 3, 85747 Garching, Germany cczado@ma.tum.de

More information

Bayesian inference for multivariate copulas using pair-copula constructions

Bayesian inference for multivariate copulas using pair-copula constructions Bayesian inference for multivariate copulas using pair-copula constructions Aleksey MIN and Claudia CZADO Munich University of Technology Munich University of Technology Corresponding author: Aleksey Min

More information

Markov Switching Regular Vine Copulas

Markov Switching Regular Vine Copulas Int. Statistical Inst.: Proc. 58th World Statistical Congress, 2011, Dublin (Session CPS057) p.5304 Markov Switching Regular Vine Copulas Stöber, Jakob and Czado, Claudia Lehrstuhl für Mathematische Statistik,

More information

Pair-copula constructions of multiple dependence

Pair-copula constructions of multiple dependence Pair-copula constructions of multiple dependence 3 4 5 3 34 45 T 3 34 45 3 4 3 35 4 T 3 4 3 35 4 4 3 5 34 T 3 4 3 5 34 5 34 T 4 Note no SAMBA/4/06 Authors Kjersti Aas Claudia Czado Arnoldo Frigessi Henrik

More information

How to select a good vine

How to select a good vine Universitetet i Oslo ingrihaf@math.uio.no International FocuStat Workshop on Focused Information Criteria and Related Themes, May 9-11, 2016 Copulae Regular vines Model selection and reduction Limitations

More information

Assessing the VaR of a portfolio using D-vine copula based multivariate GARCH models

Assessing the VaR of a portfolio using D-vine copula based multivariate GARCH models Assessing the VaR of a portfolio using D-vine copula based multivariate GARCH models Mathias Hofmann a,, Claudia Czado b a Technische Universität München Zentrum Mathematik Lehrstuhl für Mathematische

More information

Truncated regular vines in high dimensions with application to financial data

Truncated regular vines in high dimensions with application to financial data Truncated regular vines in high dimensions with application to financial data This is a preprint of an article published in the Canadian Journal of Statistics Vol. 40, No. 1, 2012, Pages 68 85, http://www.interscience.wiley.com/

More information

Gaussian Process Vine Copulas for Multivariate Dependence

Gaussian Process Vine Copulas for Multivariate Dependence Gaussian Process Vine Copulas for Multivariate Dependence José Miguel Hernández-Lobato 1,2 joint work with David López-Paz 2,3 and Zoubin Ghahramani 1 1 Department of Engineering, Cambridge University,

More information

Bayesian Model Selection of Regular Vine Copulas

Bayesian Model Selection of Regular Vine Copulas Bayesian Model Selection of Regular Vine Copulas Lutz F. Gruber Claudia Czado Abstract Regular vine copulas are a novel and very flexible class of dependence models. This paper presents a reversible jump

More information

Technische Universität München. Zentrum Mathematik

Technische Universität München. Zentrum Mathematik Technische Universität München Zentrum Mathematik Joint estimation of parameters in multivariate normal regression with correlated errors using pair-copula constructions and an application to finance Diplomarbeit

More information

Financial Econometrics and Volatility Models Copulas

Financial Econometrics and Volatility Models Copulas Financial Econometrics and Volatility Models Copulas Eric Zivot Updated: May 10, 2010 Reading MFTS, chapter 19 FMUND, chapters 6 and 7 Introduction Capturing co-movement between financial asset returns

More information

Journal of Statistical Software

Journal of Statistical Software JSS Journal of Statistical Software January 2013, Volume 52, Issue 3. http://www.jstatsoft.org/ CDVine: Modeling Dependence with C- and D-Vine Copulas in R Eike Christian Brechmann Technische Universität

More information

Spatial Statistics 2013, S2.2 6 th June Institute for Geoinformatics University of Münster.

Spatial Statistics 2013, S2.2 6 th June Institute for Geoinformatics University of Münster. Spatial Statistics 2013, S2.2 6 th June 2013 Institute for Geoinformatics University of Münster http://ifgi.uni-muenster.de/graeler Vine Vine 1 Spatial/spatio-temporal data Typically, spatial/spatio-temporal

More information

Bayesian Estimation of DSGE Models 1 Chapter 3: A Crash Course in Bayesian Inference

Bayesian Estimation of DSGE Models 1 Chapter 3: A Crash Course in Bayesian Inference 1 The views expressed in this paper are those of the authors and do not necessarily reflect the views of the Federal Reserve Board of Governors or the Federal Reserve System. Bayesian Estimation of DSGE

More information

Variational Inference with Copula Augmentation

Variational Inference with Copula Augmentation Variational Inference with Copula Augmentation Dustin Tran 1 David M. Blei 2 Edoardo M. Airoldi 1 1 Department of Statistics, Harvard University 2 Department of Statistics & Computer Science, Columbia

More information

Approximation Multivariate Distribution of Main Indices of Tehran Stock Exchange with Pair-Copula

Approximation Multivariate Distribution of Main Indices of Tehran Stock Exchange with Pair-Copula Journal of Modern Applied Statistical Methods Volume Issue Article 5 --03 Approximation Multivariate Distribution of Main Indices of Tehran Stock Exchange with Pair-Copula G. Parham Shahid Chamran University,

More information

Marginal Specifications and a Gaussian Copula Estimation

Marginal Specifications and a Gaussian Copula Estimation Marginal Specifications and a Gaussian Copula Estimation Kazim Azam Abstract Multivariate analysis involving random variables of different type like count, continuous or mixture of both is frequently required

More information

Multivariate Non-Normally Distributed Random Variables

Multivariate Non-Normally Distributed Random Variables Multivariate Non-Normally Distributed Random Variables An Introduction to the Copula Approach Workgroup seminar on climate dynamics Meteorological Institute at the University of Bonn 18 January 2008, Bonn

More information

Bayesian Regression Linear and Logistic Regression

Bayesian Regression Linear and Logistic Regression When we want more than point estimates Bayesian Regression Linear and Logistic Regression Nicole Beckage Ordinary Least Squares Regression and Lasso Regression return only point estimates But what if we

More information

CPSC 540: Machine Learning

CPSC 540: Machine Learning CPSC 540: Machine Learning MCMC and Non-Parametric Bayes Mark Schmidt University of British Columbia Winter 2016 Admin I went through project proposals: Some of you got a message on Piazza. No news is

More information

MCMC algorithms for fitting Bayesian models

MCMC algorithms for fitting Bayesian models MCMC algorithms for fitting Bayesian models p. 1/1 MCMC algorithms for fitting Bayesian models Sudipto Banerjee sudiptob@biostat.umn.edu University of Minnesota MCMC algorithms for fitting Bayesian models

More information

Estimation of Copula Models with Discrete Margins (via Bayesian Data Augmentation) Michael S. Smith

Estimation of Copula Models with Discrete Margins (via Bayesian Data Augmentation) Michael S. Smith Estimation of Copula Models with Discrete Margins (via Bayesian Data Augmentation) Michael S. Smith Melbourne Business School, University of Melbourne (Joint with Mohamad Khaled, University of Queensland)

More information

Models for construction of multivariate dependence

Models for construction of multivariate dependence Dept. of Math. University of Oslo Statistical Research Report No. 3 ISSN 0806 3842 June 2007 Models for construction of multivariate dependence Daniel Berg University of Oslo and Norwegian Computing Center

More information

Principles of Bayesian Inference

Principles of Bayesian Inference Principles of Bayesian Inference Sudipto Banerjee University of Minnesota July 20th, 2008 1 Bayesian Principles Classical statistics: model parameters are fixed and unknown. A Bayesian thinks of parameters

More information

Selection of Vine Copulas

Selection of Vine Copulas Selection of Vine Copulas Claudia Czado and Eike Christian Brechmann and Lutz Gruber Abstract Vine copula models have proven themselves as a very flexible class of multivariate copula models with regard

More information

THE VINE COPULA METHOD FOR REPRESENTING HIGH DIMENSIONAL DEPENDENT DISTRIBUTIONS: APPLICATION TO CONTINUOUS BELIEF NETS

THE VINE COPULA METHOD FOR REPRESENTING HIGH DIMENSIONAL DEPENDENT DISTRIBUTIONS: APPLICATION TO CONTINUOUS BELIEF NETS Proceedings of the 00 Winter Simulation Conference E. Yücesan, C.-H. Chen, J. L. Snowdon, and J. M. Charnes, eds. THE VINE COPULA METHOD FOR REPRESENTING HIGH DIMENSIONAL DEPENDENT DISTRIBUTIONS: APPLICATION

More information

Representing sparse Gaussian DAGs as sparse R-vines allowing for non-gaussian dependence

Representing sparse Gaussian DAGs as sparse R-vines allowing for non-gaussian dependence Representing sparse Gaussian DAGs as sparse R-vines allowing for non-gaussian dependence arxiv:604.040v [stat.me] 0 Nov 06 Dominik Müller and Claudia Czado December, 06 Abstract Modeling dependence in

More information

Markov Chain Monte Carlo methods

Markov Chain Monte Carlo methods Markov Chain Monte Carlo methods By Oleg Makhnin 1 Introduction a b c M = d e f g h i 0 f(x)dx 1.1 Motivation 1.1.1 Just here Supresses numbering 1.1.2 After this 1.2 Literature 2 Method 2.1 New math As

More information

ST 740: Markov Chain Monte Carlo

ST 740: Markov Chain Monte Carlo ST 740: Markov Chain Monte Carlo Alyson Wilson Department of Statistics North Carolina State University October 14, 2012 A. Wilson (NCSU Stsatistics) MCMC October 14, 2012 1 / 20 Convergence Diagnostics:

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 7 Approximate

More information

The Instability of Correlations: Measurement and the Implications for Market Risk

The Instability of Correlations: Measurement and the Implications for Market Risk The Instability of Correlations: Measurement and the Implications for Market Risk Prof. Massimo Guidolin 20254 Advanced Quantitative Methods for Asset Pricing and Structuring Winter/Spring 2018 Threshold

More information

Reminder of some Markov Chain properties:

Reminder of some Markov Chain properties: Reminder of some Markov Chain properties: 1. a transition from one state to another occurs probabilistically 2. only state that matters is where you currently are (i.e. given present, future is independent

More information

An Econometric Study of Vine Copulas

An Econometric Study of Vine Copulas An Econometric Study of Vine Copulas Pierre-André Maugis (Corresponding author) PSE, Université Paris 1 Panthéon-Sorbonne, 106 boulevard de l Hopital 75647 Paris Cedex 13, France E-mail: pierre-andre.maugis@malix.univ-paris1.fr.

More information

A copula goodness-of-t approach. conditional probability integral transform. Daniel Berg 1 Henrik Bakken 2

A copula goodness-of-t approach. conditional probability integral transform. Daniel Berg 1 Henrik Bakken 2 based on the conditional probability integral transform Daniel Berg 1 Henrik Bakken 2 1 Norwegian Computing Center (NR) & University of Oslo (UiO) 2 Norwegian University of Science and Technology (NTNU)

More information

Vines in Overview Invited Paper Third Brazilian Conference on Statistical Modelling in Insurance and Finance Maresias, March 25-30, 2007

Vines in Overview Invited Paper Third Brazilian Conference on Statistical Modelling in Insurance and Finance Maresias, March 25-30, 2007 Vines in Overview Invited Paper Third Brazilian Conference on Statistical Modelling in Insurance and Finance Maresias, March 25-30, 2007 R.M. Cooke, O. Morales, D. Kurowicka Resources for the Future and

More information

A simple graphical method to explore tail-dependence in stock-return pairs

A simple graphical method to explore tail-dependence in stock-return pairs A simple graphical method to explore tail-dependence in stock-return pairs Klaus Abberger, University of Konstanz, Germany Abstract: For a bivariate data set the dependence structure can not only be measured

More information

MCMC and Gibbs Sampling. Kayhan Batmanghelich

MCMC and Gibbs Sampling. Kayhan Batmanghelich MCMC and Gibbs Sampling Kayhan Batmanghelich 1 Approaches to inference l Exact inference algorithms l l l The elimination algorithm Message-passing algorithm (sum-product, belief propagation) The junction

More information

Computational statistics

Computational statistics Computational statistics Markov Chain Monte Carlo methods Thierry Denœux March 2017 Thierry Denœux Computational statistics March 2017 1 / 71 Contents of this chapter When a target density f can be evaluated

More information

arxiv: v1 [cs.ne] 19 Oct 2012

arxiv: v1 [cs.ne] 19 Oct 2012 Modeling with Copulas and Vines in Estimation of Distribution Algorithms arxiv:121.55v1 [cs.ne] 19 Oct 212 Marta Soto Institute of Cybernetics, Mathematics and Physics, Cuba. Email: mrosa@icimaf.cu Yasser

More information

Truncation of vine copulas using fit indices

Truncation of vine copulas using fit indices Truncation of vine copulas using fit indices Eike C. Brechmann Harry Joe February 2, 2015 Abstract Vine copulas are flexible multivariate dependence models, which are built up from a set of bivariate copulas

More information

Markov Chain Monte Carlo

Markov Chain Monte Carlo Markov Chain Monte Carlo Recall: To compute the expectation E ( h(y ) ) we use the approximation E(h(Y )) 1 n n h(y ) t=1 with Y (1),..., Y (n) h(y). Thus our aim is to sample Y (1),..., Y (n) from f(y).

More information

Assessing Regime Uncertainty Through Reversible Jump McMC

Assessing Regime Uncertainty Through Reversible Jump McMC Assessing Regime Uncertainty Through Reversible Jump McMC August 14, 2008 1 Introduction Background Research Question 2 The RJMcMC Method McMC RJMcMC Algorithm Dependent Proposals Independent Proposals

More information

Copulas and Measures of Dependence

Copulas and Measures of Dependence 1 Copulas and Measures of Dependence Uttara Naik-Nimbalkar December 28, 2014 Measures for determining the relationship between two variables: the Pearson s correlation coefficient, Kendalls tau and Spearmans

More information

Modeling Ultra-High-Frequency Multivariate Financial Data by Monte Carlo Simulation Methods

Modeling Ultra-High-Frequency Multivariate Financial Data by Monte Carlo Simulation Methods Outline Modeling Ultra-High-Frequency Multivariate Financial Data by Monte Carlo Simulation Methods Ph.D. Student: Supervisor: Marco Minozzo Dipartimento di Scienze Economiche Università degli Studi di

More information

Gaussian Process Vine Copulas for Multivariate Dependence

Gaussian Process Vine Copulas for Multivariate Dependence Gaussian Process Vine Copulas for Multivariate Dependence José Miguel Hernández Lobato 1,2, David López Paz 3,2 and Zoubin Ghahramani 1 June 27, 2013 1 University of Cambridge 2 Equal Contributor 3 Ma-Planck-Institute

More information

Monte Carlo in Bayesian Statistics

Monte Carlo in Bayesian Statistics Monte Carlo in Bayesian Statistics Matthew Thomas SAMBa - University of Bath m.l.thomas@bath.ac.uk December 4, 2014 Matthew Thomas (SAMBa) Monte Carlo in Bayesian Statistics December 4, 2014 1 / 16 Overview

More information

Bayesian Linear Regression

Bayesian Linear Regression Bayesian Linear Regression Sudipto Banerjee 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. September 15, 2010 1 Linear regression models: a Bayesian perspective

More information

SAMSI Astrostatistics Tutorial. More Markov chain Monte Carlo & Demo of Mathematica software

SAMSI Astrostatistics Tutorial. More Markov chain Monte Carlo & Demo of Mathematica software SAMSI Astrostatistics Tutorial More Markov chain Monte Carlo & Demo of Mathematica software Phil Gregory University of British Columbia 26 Bayesian Logical Data Analysis for the Physical Sciences Contents:

More information

Improving forecasting performance using covariate-dependent copula models

Improving forecasting performance using covariate-dependent copula models Improving forecasting performance using covariate-dependent copula models Feng Li a, Yanfei Kang b, a School of Statistics and Mathematics, Central University of Finance and Economics, Beijing 100081,

More information

Forecasting time series with multivariate copulas

Forecasting time series with multivariate copulas Depend. Model. 2015; 3:59 82 Research Article Open Access Clarence Simard* and Bruno Rémillard Forecasting time series with multivariate copulas DOI 10.1515/demo-2015-0005 5 Received august 17, 2014; accepted

More information

Conditional Least Squares and Copulae in Claims Reserving for a Single Line of Business

Conditional Least Squares and Copulae in Claims Reserving for a Single Line of Business Conditional Least Squares and Copulae in Claims Reserving for a Single Line of Business Michal Pešta Charles University in Prague Faculty of Mathematics and Physics Ostap Okhrin Dresden University of Technology

More information

Vine copulas with asymmetric tail dependence and applications to financial return data 1. Abstract

Vine copulas with asymmetric tail dependence and applications to financial return data 1. Abstract *Manuscript Vine copulas with asymmetric tail dependence and applications to financial return data 1 Aristidis K. Nikoloulopoulos 2, Harry Joe 3 and Haijun Li 4 Abstract In Aas et al. (2009) and Aas and

More information

Modelling Dependence in Space and Time with Vine Copulas

Modelling Dependence in Space and Time with Vine Copulas Modelling Dependence in Space and Time with Vine Copulas Benedikt Gräler, Edzer Pebesma Abstract We utilize the concept of Vine Copulas to build multi-dimensional copulas out of bivariate ones, as bivariate

More information

Infinite-State Markov-switching for Dynamic. Volatility Models : Web Appendix

Infinite-State Markov-switching for Dynamic. Volatility Models : Web Appendix Infinite-State Markov-switching for Dynamic Volatility Models : Web Appendix Arnaud Dufays 1 Centre de Recherche en Economie et Statistique March 19, 2014 1 Comparison of the two MS-GARCH approximations

More information

17 : Markov Chain Monte Carlo

17 : Markov Chain Monte Carlo 10-708: Probabilistic Graphical Models, Spring 2015 17 : Markov Chain Monte Carlo Lecturer: Eric P. Xing Scribes: Heran Lin, Bin Deng, Yun Huang 1 Review of Monte Carlo Methods 1.1 Overview Monte Carlo

More information

CS242: Probabilistic Graphical Models Lecture 7B: Markov Chain Monte Carlo & Gibbs Sampling

CS242: Probabilistic Graphical Models Lecture 7B: Markov Chain Monte Carlo & Gibbs Sampling CS242: Probabilistic Graphical Models Lecture 7B: Markov Chain Monte Carlo & Gibbs Sampling Professor Erik Sudderth Brown University Computer Science October 27, 2016 Some figures and materials courtesy

More information

Model selection in sparse high-dimensional vine copula models with application to portfolio risk

Model selection in sparse high-dimensional vine copula models with application to portfolio risk Model selection in sparse high-dimensional vine copula models with application to portfolio risk arxiv:1801.09739v3 [stat.me] 19 Nov 2018 Thomas Nagler, Christian Bumann, Claudia Czado November 20, 2018

More information

BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA

BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA Intro: Course Outline and Brief Intro to Marina Vannucci Rice University, USA PASI-CIMAT 04/28-30/2010 Marina Vannucci

More information

Eco517 Fall 2013 C. Sims MCMC. October 8, 2013

Eco517 Fall 2013 C. Sims MCMC. October 8, 2013 Eco517 Fall 2013 C. Sims MCMC October 8, 2013 c 2013 by Christopher A. Sims. This document may be reproduced for educational and research purposes, so long as the copies contain this notice and are retained

More information

Multivariate Distribution Models

Multivariate Distribution Models Multivariate Distribution Models Model Description While the probability distribution for an individual random variable is called marginal, the probability distribution for multiple random variables is

More information

Markov chain Monte Carlo

Markov chain Monte Carlo Markov chain Monte Carlo Feng Li feng.li@cufe.edu.cn School of Statistics and Mathematics Central University of Finance and Economics Revised on April 24, 2017 Today we are going to learn... 1 Markov Chains

More information

Principles of Bayesian Inference

Principles of Bayesian Inference Principles of Bayesian Inference Sudipto Banerjee and Andrew O. Finley 2 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry & Department

More information

Metropolis-Hastings Algorithm

Metropolis-Hastings Algorithm Strength of the Gibbs sampler Metropolis-Hastings Algorithm Easy algorithm to think about. Exploits the factorization properties of the joint probability distribution. No difficult choices to be made to

More information

Extreme Value Analysis and Spatial Extremes

Extreme Value Analysis and Spatial Extremes Extreme Value Analysis and Department of Statistics Purdue University 11/07/2013 Outline Motivation 1 Motivation 2 Extreme Value Theorem and 3 Bayesian Hierarchical Models Copula Models Max-stable Models

More information

Dynamic D-Vine Copula Model with Applications to Value-at-Risk (VaR)

Dynamic D-Vine Copula Model with Applications to Value-at-Risk (VaR) Dynamic D-Vine Copula Model with Applications to Value-at-Risk (VaR) Paula V. Tófoli Flávio A. Ziegelmann Osvaldo C. Silva Filho Abstract Regular vine copulas constitute a very flexible class of multivariate

More information

Pattern Recognition and Machine Learning

Pattern Recognition and Machine Learning Christopher M. Bishop Pattern Recognition and Machine Learning ÖSpri inger Contents Preface Mathematical notation Contents vii xi xiii 1 Introduction 1 1.1 Example: Polynomial Curve Fitting 4 1.2 Probability

More information

The Mixture Approach for Simulating New Families of Bivariate Distributions with Specified Correlations

The Mixture Approach for Simulating New Families of Bivariate Distributions with Specified Correlations The Mixture Approach for Simulating New Families of Bivariate Distributions with Specified Correlations John R. Michael, Significance, Inc. and William R. Schucany, Southern Methodist University The mixture

More information

Modeling conditional distributions with mixture models: Applications in finance and financial decision-making

Modeling conditional distributions with mixture models: Applications in finance and financial decision-making Modeling conditional distributions with mixture models: Applications in finance and financial decision-making John Geweke University of Iowa, USA Journal of Applied Econometrics Invited Lecture Università

More information

Markov Chain Monte Carlo Methods

Markov Chain Monte Carlo Methods Markov Chain Monte Carlo Methods John Geweke University of Iowa, USA 2005 Institute on Computational Economics University of Chicago - Argonne National Laboaratories July 22, 2005 The problem p (θ, ω I)

More information

Program and big picture Big data: can copula modelling be used for high dimensions, say

Program and big picture Big data: can copula modelling be used for high dimensions, say Conditional independence copula models with graphical representations Harry Joe (University of British Columbia) For multivariate Gaussian with a large number of variables, there are several approaches

More information

Likelihood-free MCMC

Likelihood-free MCMC Bayesian inference for stable distributions with applications in finance Department of Mathematics University of Leicester September 2, 2011 MSc project final presentation Outline 1 2 3 4 Classical Monte

More information

Parameter estimation and forecasting. Cristiano Porciani AIfA, Uni-Bonn

Parameter estimation and forecasting. Cristiano Porciani AIfA, Uni-Bonn Parameter estimation and forecasting Cristiano Porciani AIfA, Uni-Bonn Questions? C. Porciani Estimation & forecasting 2 Temperature fluctuations Variance at multipole l (angle ~180o/l) C. Porciani Estimation

More information

arxiv: v1 [stat.me] 9 Feb 2012

arxiv: v1 [stat.me] 9 Feb 2012 Modeling high dimensional time-varying dependence using D-vine SCAR models Carlos Almeida a, Claudia Czado b, Hans Manner c, arxiv:1202.2008v1 [stat.me] 9 Feb 2012 a Georges Lemaitre Centre for Earth and

More information

Parametric Models. Dr. Shuang LIANG. School of Software Engineering TongJi University Fall, 2012

Parametric Models. Dr. Shuang LIANG. School of Software Engineering TongJi University Fall, 2012 Parametric Models Dr. Shuang LIANG School of Software Engineering TongJi University Fall, 2012 Today s Topics Maximum Likelihood Estimation Bayesian Density Estimation Today s Topics Maximum Likelihood

More information

A Review of Pseudo-Marginal Markov Chain Monte Carlo

A Review of Pseudo-Marginal Markov Chain Monte Carlo A Review of Pseudo-Marginal Markov Chain Monte Carlo Discussed by: Yizhe Zhang October 21, 2016 Outline 1 Overview 2 Paper review 3 experiment 4 conclusion Motivation & overview Notation: θ denotes the

More information

Multivariate Statistics

Multivariate Statistics Multivariate Statistics Chapter 2: Multivariate distributions and inference Pedro Galeano Departamento de Estadística Universidad Carlos III de Madrid pedro.galeano@uc3m.es Course 2016/2017 Master in Mathematical

More information

Lecture 8: The Metropolis-Hastings Algorithm

Lecture 8: The Metropolis-Hastings Algorithm 30.10.2008 What we have seen last time: Gibbs sampler Key idea: Generate a Markov chain by updating the component of (X 1,..., X p ) in turn by drawing from the full conditionals: X (t) j Two drawbacks:

More information

Construction and estimation of high dimensional copulas

Construction and estimation of high dimensional copulas Construction and estimation of high dimensional copulas Gildas Mazo PhD work supervised by S. Girard and F. Forbes Mistis, Inria and laboratoire Jean Kuntzmann, Grenoble, France Séminaire Statistiques,

More information

When is a copula constant? A test for changing relationships

When is a copula constant? A test for changing relationships When is a copula constant? A test for changing relationships Fabio Busetti and Andrew Harvey Bank of Italy and University of Cambridge November 2007 usetti and Harvey (Bank of Italy and University of Cambridge)

More information

Markov Chain Monte Carlo, Numerical Integration

Markov Chain Monte Carlo, Numerical Integration Markov Chain Monte Carlo, Numerical Integration (See Statistics) Trevor Gallen Fall 2015 1 / 1 Agenda Numerical Integration: MCMC methods Estimating Markov Chains Estimating latent variables 2 / 1 Numerical

More information

Online Appendix to: Marijuana on Main Street? Estimating Demand in Markets with Limited Access

Online Appendix to: Marijuana on Main Street? Estimating Demand in Markets with Limited Access Online Appendix to: Marijuana on Main Street? Estating Demand in Markets with Lited Access By Liana Jacobi and Michelle Sovinsky This appendix provides details on the estation methodology for various speci

More information

Principles of Bayesian Inference

Principles of Bayesian Inference Principles of Bayesian Inference Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry & Department

More information

Markov Chain Monte Carlo

Markov Chain Monte Carlo 1 Motivation 1.1 Bayesian Learning Markov Chain Monte Carlo Yale Chang In Bayesian learning, given data X, we make assumptions on the generative process of X by introducing hidden variables Z: p(z): prior

More information

Bayesian spatial hierarchical modeling for temperature extremes

Bayesian spatial hierarchical modeling for temperature extremes Bayesian spatial hierarchical modeling for temperature extremes Indriati Bisono Dr. Andrew Robinson Dr. Aloke Phatak Mathematics and Statistics Department The University of Melbourne Maths, Informatics

More information

A Brief Introduction to Copulas

A Brief Introduction to Copulas A Brief Introduction to Copulas Speaker: Hua, Lei February 24, 2009 Department of Statistics University of British Columbia Outline Introduction Definition Properties Archimedean Copulas Constructing Copulas

More information

Bayesian Methods for Machine Learning

Bayesian Methods for Machine Learning Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),

More information

Dependence Modeling in Ultra High Dimensions with Vine Copulas and the Graphical Lasso

Dependence Modeling in Ultra High Dimensions with Vine Copulas and the Graphical Lasso Dependence Modeling in Ultra High Dimensions with Vine Copulas and the Graphical Lasso Dominik Müller Claudia Czado arxiv:1709.05119v1 [stat.ml] 15 Sep 2017 September 18, 2017 Abstract To model high dimensional

More information

Sampling Algorithms for Probabilistic Graphical models

Sampling Algorithms for Probabilistic Graphical models Sampling Algorithms for Probabilistic Graphical models Vibhav Gogate University of Washington References: Chapter 12 of Probabilistic Graphical models: Principles and Techniques by Daphne Koller and Nir

More information

Riemann Manifold Methods in Bayesian Statistics

Riemann Manifold Methods in Bayesian Statistics Ricardo Ehlers ehlers@icmc.usp.br Applied Maths and Stats University of São Paulo, Brazil Working Group in Statistical Learning University College Dublin September 2015 Bayesian inference is based on Bayes

More information

Graphical Models and Kernel Methods

Graphical Models and Kernel Methods Graphical Models and Kernel Methods Jerry Zhu Department of Computer Sciences University of Wisconsin Madison, USA MLSS June 17, 2014 1 / 123 Outline Graphical Models Probabilistic Inference Directed vs.

More information

ComputationalToolsforComparing AsymmetricGARCHModelsviaBayes Factors. RicardoS.Ehlers

ComputationalToolsforComparing AsymmetricGARCHModelsviaBayes Factors. RicardoS.Ehlers ComputationalToolsforComparing AsymmetricGARCHModelsviaBayes Factors RicardoS.Ehlers Laboratório de Estatística e Geoinformação- UFPR http://leg.ufpr.br/ ehlers ehlers@leg.ufpr.br II Workshop on Statistical

More information

Recall that the AR(p) model is defined by the equation

Recall that the AR(p) model is defined by the equation Estimation of AR models Recall that the AR(p) model is defined by the equation X t = p φ j X t j + ɛ t j=1 where ɛ t are assumed independent and following a N(0, σ 2 ) distribution. Assume p is known and

More information

MCMC and Gibbs Sampling. Sargur Srihari

MCMC and Gibbs Sampling. Sargur Srihari MCMC and Gibbs Sampling Sargur srihari@cedar.buffalo.edu 1 Topics 1. Markov Chain Monte Carlo 2. Markov Chains 3. Gibbs Sampling 4. Basic Metropolis Algorithm 5. Metropolis-Hastings Algorithm 6. Slice

More information

April 20th, Advanced Topics in Machine Learning California Institute of Technology. Markov Chain Monte Carlo for Machine Learning

April 20th, Advanced Topics in Machine Learning California Institute of Technology. Markov Chain Monte Carlo for Machine Learning for for Advanced Topics in California Institute of Technology April 20th, 2017 1 / 50 Table of Contents for 1 2 3 4 2 / 50 History of methods for Enrico Fermi used to calculate incredibly accurate predictions

More information

Fall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.

Fall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A. 1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n

More information

Gaussian kernel GARCH models

Gaussian kernel GARCH models Gaussian kernel GARCH models Xibin (Bill) Zhang and Maxwell L. King Department of Econometrics and Business Statistics Faculty of Business and Economics 7 June 2013 Motivation A regression model is often

More information

Dependence. Practitioner Course: Portfolio Optimization. John Dodson. September 10, Dependence. John Dodson. Outline.

Dependence. Practitioner Course: Portfolio Optimization. John Dodson. September 10, Dependence. John Dodson. Outline. Practitioner Course: Portfolio Optimization September 10, 2008 Before we define dependence, it is useful to define Random variables X and Y are independent iff For all x, y. In particular, F (X,Y ) (x,

More information

HANDBOOK OF APPLICABLE MATHEMATICS

HANDBOOK OF APPLICABLE MATHEMATICS HANDBOOK OF APPLICABLE MATHEMATICS Chief Editor: Walter Ledermann Volume VI: Statistics PART A Edited by Emlyn Lloyd University of Lancaster A Wiley-Interscience Publication JOHN WILEY & SONS Chichester

More information

A simple nonparametric test for structural change in joint tail probabilities SFB 823. Discussion Paper. Walter Krämer, Maarten van Kampen

A simple nonparametric test for structural change in joint tail probabilities SFB 823. Discussion Paper. Walter Krämer, Maarten van Kampen SFB 823 A simple nonparametric test for structural change in joint tail probabilities Discussion Paper Walter Krämer, Maarten van Kampen Nr. 4/2009 A simple nonparametric test for structural change in

More information

Time Series Copulas for Heteroskedastic Data

Time Series Copulas for Heteroskedastic Data Time Series Copulas for Heteroskedastic Data Rubén Loaiza-Maya, Michael S. Smith and Worapree Maneesoonthorn arxiv:7.752v [stat.ap] 25 Jan 27 First Version March 26 This Version January 27 Rubén Loaiza-Maya

More information