Bayesian Inference for Pair-copula Constructions of Multiple Dependence
|
|
- Chrystal Morris
- 5 years ago
- Views:
Transcription
1 Bayesian Inference for Pair-copula Constructions of Multiple Dependence Claudia Czado and Aleksey Min Technische Universität München December 7, 2007
2 Overview 1 Introduction 2 Pair-copula constructions (PCC) 3 Bayesian Analysis of PCC s 4 Application: Financial Returns 5 Bayesian Model Selection among PCC s 6 Euro Swap Rates 7 Summary and Outlook
3 Introduction Introduction Bedford and Cooke (2001) and Bedford and Cooke (2002) gave a probabilistic construction of multivariate distributions based on simple building blocks called pair-copulas. See also Kurowicka and Cooke (2006). Extends work by Joe (1996). Aas, Czado, Frigessi, and Bakken (2007) used the PCC construction to construct flexible multivariate copulas based on pair-copulas such as bivariate Gaussian, t-, Gumbel and Clayton copulas
4 Introduction Introduction Parameters are estimated by maximum likelihood (ML) and PCC s are sucessfully applied to financial return data Berg and Aas (2007) give further example of PCC s and developed an R-package for fitting PCC s using MLE The Fisher information is difficult to handle analytically, so therefore estimated standard errors for parameter estimates are so far absent Here we follow a Bayesian approach where such interval estimates are easy to establish
5 Introduction Multivariate Distributions Consider n random variables X = (X 1,...,X n ) with joint density f (x 1,...,x n ) and marginal densities f i (x i ),i = 1,...,n joint cdf F(x 1,...,x n ) and marginal cdf s F i (x i ),i = 1,...,n factorization f (x 1,..., x n) = f n(x n) f (x n 1 x n) f (x n 2 x n 1, x n)... f (x 1 x 2,...,x n) (1)
6 Introduction Copula A copula is a multivariate distribution on [0,1] n with uniformly distributed marginals. copula cdf C(u 1,...,u n ) copula density c(u 1,...,u n ) Using Sklar s Theorem (1959) we have for absolutely continuous distributions with continuous marginal cdf s f (x 1,...,x n ) = c 12 n (F 1 (x 1 ),... F n (x n )) f 1 (x 1 ) f n (x n ) (2) for some n-variate copula density c 12 n ( ).
7 Pair-copula constructions (PCC) Pair-copula constructions (PCC) n = 3 f 1 23 (x 1 x 2,x 3 ) = f 12 3(x 1,x 2 x 3 ) f 2 3 (x 2 x 3 ) = c 12 3 (F 1 3 (x 1 x 3 ),F 2 3 (x 2 x 3 )) f 1 3 (x 1 x 3 ) general n For v = (v 1,...,v d ) and any j = 1,...,d f (x v) = c xvj v j (F(x v j ),F(v j v j )) f (x v j ) v j = (v 1,...,v j 1,v j+1,...,v d ) c xvj v j ( ) = bivariate copula density Combining this decomposition of the conditional distribution with the factorization (1), we derive at a decomposition of f (x 1,...,x n ) that only consist of pair-copulae. We call this a pair-copula construction (PCC).
8 Pair-copula constructions (PCC) Conditional cdf s Univariate v: Since f (x v) = c xv (F x (x),f v (v))f x (x) we have F(x v) = x c xv (F x (u),f v (v))f x (u)du = C xv(f x (x),f v (v)) F v (v) General v: Under regularity conditions Joe (1996) showed that F(x v) = C x,v j v j (F(x v j ),F(v j v j )), F(v j v j )
9 Pair-copula constructions (PCC) Vines For high-dimensional distributions there are many possible pair-copula constructions. Bedford and Cooke (2001) introduced a graphical model called regular vine to help organize them. The class of regular vines is large and embraces a large number of possible PCC s. We concentrate on two special cases (Kurowicka and Cooke 2004): D-vine Canonical Vine
10 Pair-copula constructions (PCC) Vines(2) An n-dimensional vine is represented by n-1 trees. Tree j has n + 1 j nodes and n j edges. Each edge corresponds to a pair-copula density. Edges in tree j become nodes in tree j + 1. Two nodes in tree j + 1 are joined by an edge if the corresponding edges in tree j share a node. The complete decomposition is defined by the n(n 1) 2 edges (i.e. pair copula densities) and the marginal densities.
11 Pair-copula constructions (PCC) Canonical and D-vines Canonical vine: A regular vine for which each tree has a unique node that is connected to n j edges. D-vine: A regular vine for which no node in any tree is connected to more than two edges Abbreviations: c ij v := c ij v (F i v (x i x v ),F j v (x j x v )) f j := f j (x j ) f v := f v (x v )
12 Pair-copula constructions (PCC) Five dimensional canonical vine f = f 1 f 2 f 3 f 4 f 5 c 12 c 13 c 14 c 15 c 23 1 c 24 1 c 25 1 c c c T T T T 4
13 Pair-copula constructions (PCC) Five dimensional D-vine f = f 1 f 2 f 3 f 4 f 5 c 12 c 23 c 34 c 45 c 13 2 c 24 3 c 35 4 c c c T T T T 4
14 Pair-copula constructions (PCC) General density expressions Canonical vine density D-vine density n k=1 n k=1 n 1 f k n j c j,j+i 1,...,j 1 j=1 i=1 n 1 n j f k c i,i+j i+1,...,i+j 1 j=1 i=1 where index j identifies the trees, while i runs over the edges in each tree.
15 Bayesian Analysis of PCC s Bayesian Analysis of PCC s with t-copula pairs Assume bivariate t-copula for each pair copula term, i.e. θ c(u 1, u 2 θ) = where = (ρ, ν) ρ = correlation, ν = df Γ( ν+2 2 )/Γ( ν 2 ) νπt ν (x 1 )t ν (x 2 ) 1 ρ 2 ( 1 + x2 1 + x2 2 2ρ x 1 x 2 ν(1 ρ 2 ) x 1 = tν 1 1) x 2 = tν 1 (u 2 ) t ν ( ) = pdf of univariate t ν distribution tν 1 ( ) = quantile function of t ν distribution ) ν+2 2,
16 Bayesian Analysis of PCC s Bayesian Analysis of PCC s with t-copula pairs For the PCC s we assume a regular vine structure with edge indices denoted by s := ij v for s S. Let θ s = (ρ s,ν s ) the corresponding parameters of the pair copula associated with edge s. Let θ = {θ s,s S} denote the vector of all parameters of the PCC with t-copula pairs We assume uniform priors for ρ s on ( 1,1) and for ν s on (1, U) for each s and prior independence among all parameters Inference is based on the posterior distribution given by p(θ data) = f (data θ) p(θ) f (data θ) p(θ)dθ where f (data θ) is the likelihood of the PCC and p(θ) the prior for θ
17 Bayesian Analysis of PCC s Bayesian Analysis of PCC s with t-copula pairs Since θ is high dimensional the posterior is not analytically tractable. Posterior distribution is estimated using Markov Chain Monte Carlo (MCMC) methods For each univariate parameter Metropolis-Hastings (MH) updates with symmetric normal random walk proposals are used Proposal variances are determined by pilot runs to achieve acceptance rates between 20% and 80%. Posterior mean, mode, median and density are estimated using the MCMC iterates. Credible intervals are estimated by empirical quantiles of the MCMC iterates.
18 Application: Financial Returns Application: Financial Returns Tail dependence properties are important in finance. n-dimensional Student s t-copula has been often used for modeling financial returns, however it only has a single parameter for tail dependence. Pair-copula constructions allows for multiple parameters for modeling tail dependence.
19 Application: Financial Returns Data set Daily data from Jan. 4, 1999 until July 8, 2003 for T = Norwegian stock index (TOTX) M = MSCI world stock index B = Norwegian bond index (BRIX) S = SSBWG hedged bond index Standardized residuals of a AR(1)-GARCH(1,1) model for the log return x i,t x i,t = c i + α i x i,t 1 + σ i,t z i,t, E[z t,i ] = 0 and Var[z t,i ] = 1, σ 2 i,t = a i,0 + a i ǫ 2 i,t 1 + b i σ 2 i,t 1 where ǫ i,t 1 = σ i,t z i,t are found to be independent and are transformed to uniform margins
20 Application: Financial Returns Data set Fitted degree of freedom for a t-copula to each pair Between M T B S M T 12.60
21 Application: Financial Returns Which PCC? Strongest dependence between S and M, M and T and T and B, which will be used in the top tree of a D-vine SM MT TB S M T B ST M MB T SM MT TB ST M SB MT MB T
22 Application: Financial Returns Bayesian Inference of the Norwegian return data For each pair copula we assume a bivariate t-copula with correlation ρ and ν degree of freedom. For each ρ we assume uniform(-1,1) prior and for ν a uniform(1,1000) prior. Further prior independence between all parameters are assumed. For the likelihood we assume the following PCC c(x S, x M, x T, x B ) = c SM (F(x S ), F(x M )) c MT (F(x M ), F(x T )) c TB (F(x T ), F(x B )) c ST M (F(x S x M ), F(x T x M )) c MB T (F(x M x T ), F(x B x T )) c SB MT (F(x S x M, x T ), F(x B x M, x T ))
23 Application: Financial Returns Bayesian Inference of the Norwegian return data For the MH updates in the MCMC algorithm we used symmetric random walk proposals normal proposals with variances determined by pilot runs to achieve acceptance rates between 25% and 80% MCMC iterations were run MLE estimates were used as starting values Implemented using Daniel Berg s R-package
24 Application: Financial Returns Trace Plots of MCMC iterations ρ SM ν SM ρ MT ν MT ρ Iterations ν Iterations ρ Iterations ν Iterations ρ TB ν TB ρ ST M ν ST M ρ Iterations ν Iterations ρ Iterations ρ MB T ν MB T ρ SB MT ν SB MT ρ ρ ν Iterations ν ν Iterations Iterations Iterations Iterations
25 Application: Financial Returns Autocorrelations of the MCMC iterations ρ SM ν SM ρ MT ν MT ACF ACF ACF ACF Lag Lag Lag Lag ρ TB ν TB ρ ST M ν ST M ACF ACF ACF ACF Lag Lag Lag Lag ρ MB T ν MB T ρ SB MT ν SB MT ACF ACF ACF ACF Lag Lag Lag Lag For the further analysis we used burnin 1000 iteration and only every 20th iteration.
26 Application: Financial Returns Estimated Posterior Densities ρ SM ν SM ρ MT ν MT Density Density Density Density ρ TB ν TB ρ ST M ν ST M Density Density 4e 04 1e Density Density 4e 04 1e ρ MB T ν MB T ρ SB MT ν SB MT Density Density 5e 04 9e Density Density
27 Application: Financial Returns Summary statistics for thinned MCMC 2.5% 50% 97.5% Est. Post. Est. Post. MLE Quantile Quantile Quantile Mean Mode ρ SM ν SM ρ MT ν MT ρ TB ν TB ρ ST M ν ST M ρ MB T ν MB T ρ SB MT ν SB MT red corresponds to uncorrelatedness magenta corresponds to near normality
28 Application: Financial Returns Model fit: Kendall s τ Kendall s τ measures dependence and is defined by τ := P((X 1 X 2 )(Y 1 Y 2 ) > 0) P((X 1 X 2 )(Y 1 Y 2 ) < 0) where (X 1,Y 1 ) and (X 2,Y 2 ) are i.i.d. τ is invariant under monotone transformations Relationship between τ and ρ for bivariate t-distributions τ = 2 π arcsin(ρ) Estimated posterior summaries of τ 2.5% 50% 97.5% Est. Post. Est. Post Empirical Quantile Quantile Quantile Mean Mode τ τ SM τ MT τ TB
29 Application: Financial Returns Model fit: Tail dependence Lower and upper tail dependence: λ l := lim P(X F 1 1 v 0 X (v) Y FY λ u := lim P(X F 1 1 v 1 X (v) Y FY For t distributions we have λ := λ l = λ u = 2t ν+1 ( ) 1 ρ ν ρ Estimated posterior summaries of λ 2.5% 50% 97.5% Est. Post. Est. Post Empirical Quantile Quantile Quantile Mean Mode λ l λ SM λ MT λ TB
30 Application: Financial Returns Model fit: Lambda function The λ function is defined as a shifted copula distribution function given by λ(z,θ) := z K(z,θ) K(z,θ) := P(C(u 1,u 2,θ) z) Here θ denotes the parameters of the bivariate copula pair. For the conditional pairs ST M,MB T and SB MT an empirical estimate of λ(z,θ) is based on transformed data using posterior mode estimates
31 Application: Financial Returns Estimated pointwise posterior mode λ(z, θ) Pair ST Pair MT Pair TB z z z Pair ST M Pair MB T Pair SB MT λ(z) λ(z) λ(z) λ(z) λ(z) λ(z) z z z red = 95% CI, black = est. posterior mode, green = empirical
32 Bayesian Model Selection among PCC s Bayesian Model Selection among PCC s Want to select among K models M 1,,M K, where Model M k has parameter θ k and compare them on the basis of posterior model probabilities given by P( Model M k data),k = 1,,K We distinguish two situations K is small and it is feasible timewise to fit all models (Congdon (2006) and Scott (2002)) K is large and we want only to fit models which are probable using reversible jump MCMC (RJMCMC) (Green (1995))
33 Bayesian Model Selection among PCC s Bayesian Model Selection : K small Congdon (2006) made the following assumptions The distribution of the data is independent of {θ j k } given M k Independence among θ k s given Model M and showed that Posterior distributions of θ k are independent given M = M k and can be sampled individually and used that P(M = M k data, θ) P(data θ k, M = M k )P(θ M = M k )P(M = M k ) (3)
34 Bayesian Model Selection among PCC s Bayesian Model Selection : K small Assume that K independently MCMC runs result in M 1 : θ (r) 1,r = 1,,R. M K : θ (r) K,r = 1,,R approximating p(θ 1 data). p(θ K data) Using {θ (r) := (θ (r) 1,,θ(r) K ),r = 1,,R} P(M data) = P(M θ, data)p(θ data)dθ is approximated by P(M data) := 1 R R r=1 P(M θ(r),data).
35 Bayesian Model Selection among PCC s Bayesian Model Selection : K small Using (3) we can estimate P(M = M k data,θ (r) ) by w (r) k := G (r) k K j=1 G(r) j, where G (r) k L (r) k := exp(l (r) k L max) (r) ( ) := log P(data θ (r) k,m = M k)p(θ (r) k M = M k)p(m = M k ) L (r) max := max k=1,,k L(r) k Therefore 1 R R r=1 w (r) k estimates P(M = M k data).
36 Bayesian Model Selection among PCC s K small: Model selection for financial return data Since zero in 95% credible interval for ρ MB T and the posterior mode of ρ ST M and ρ MB T small we want to use Congdon (2006) s method if these copula pairs needed Model PCC Formula P(Mk data) M 1 : with all pairs c SM c MT c TB c ST M c MB T c SB MT M 2 : without c SM c MT c TB c ST M c SB MT c MB T M 3 : without c SM c MT c TB c SB MT c MB T and c ST M M 4 : without c SM c MT c SB MT c MB T,c ST M and c TB
37 Bayesian Model Selection among PCC s K small: Model selection for financial return data Many of the posterior estimates of the degree of freedom are large, so want to check if we can use for these pairs a Gaussian copula Model PCC P(Mk data) M 1 : All pairs are t copulas M 2 : First pair c SM is t copula all other pairs are Gaussian copulas M 3 : All pairs are Gaussian copulas Only for c SM a t-copula is needed.
38 Bayesian Model Selection among PCC s Bayesian Model Selection: K large (RJMCMC) If a single pair copula type is used in a PCC of dimension n, then all other possible PCC s of dimension n provide a factorization of the same joint density So we want to find reduced PCC s which best fits the data, i.e. let the data discover conditional independence conditions. Identifiability: Use only one decomposition n = 3: Full PCC s: c 12 c 23 c 13 2 Reduced by 1 pair-copula: c 12 c 23,c 12 c 13 2,c 23 c 13 2 Reduced by 2 pair copulas: c 12,c 23,c 13 2
39 Bayesian Model Selection among PCC s Bayesian framework of PCC s with n = 3 Each of the 7 different PCC s with n 3 is identified by a model index m = (m 1,m 2,m 3 ) = (i 1 j 1,i 2 j 2,i 3 j 3 k 3 ). Example: c 12 c 23 1 corresponds to m = (12,00,23 1). Each PCC model m has parameter vector θ m = (θ m1,θ m2,θ m3 ). Example: Model m = (12, 23, 00 0) has parameter vector θ m = (θ 12,θ 23,θ 00 0 ) = (θ 12,θ 23 ). Goal is to estimate the best fitting model m and the corresponding parameter vector θ m using a Bayesian approach, i.e. the model m and θ m are considered random quantities. Inference about m and θ m is done via the joint posterior distribution of (m,θ m ).
40 Bayesian Model Selection among PCC s MCMC algorithm for PCC s with n = 3 Problems: Want to facilitate estimation without having to fit all models Joint posterior is not analytically tractable Approach: Construct a Markov Chain Monte Carlo (MCMC) algorithm which simultaneously estimates m and θ m. Requirement: Need to accommodate varying model dimension, i.e. construct MCMC iterates θ m r = (θ r m r 1,θr m r 2,θr m r 3 ) where mr is the current model at iteration r. Solution: Reversible jump (RJ) MCMC proposed by (Green 1995)
41 Bayesian Model Selection among PCC s General RJ MCMC (1) algorithm stays in current model using a Metropolis Hastings (MH) step algorithm moves to a larger model using a MH step (birth) algorithm moves to a smaller model using a MH step (death)
42 Bayesian Model Selection among PCC s General RJ MCMC (2) Model M 1 M 2 Parameter θ (1) R d 1 θ (2) R d 2 d 1 < d 2 Proposal η (1) ϕ 1 ( ) η (2) ϕ 2 ( ) η (1) R a 1 η (2) R a 2 Dimension matching d 1 + a 1 = d 2 + a ( ) ( 2 ) θ (1) θ (2) Bijection η (1) η (2)
43 Bayesian Model Selection among PCC s Acceptance probability for MH step from M 1 to M 2 α(θ (1),θ (2) ) = min {1,A}, where A := p(2,θ(2) y) p(1,θ (1) y) p2 1 ϕ2(η (2) ) p 1 2 ϕ 1 (η (1) ) ) (θ (2),η (2) ) (θ (1),η (1) p(k,θ (k) y) = joint posterior density of M k and θ (k) p i j = prior switching probability from M i to M j ϕ k (η (k) ) = proposal distribution of η (k) (suitably chosen) θ (2),η (2) θ (1) = Jacobian of bijection,η (1) For moves from M 2 to M 1 we use A 1.
44 Bayesian Model Selection among PCC s RJ MCMC moves for selecting PCC s (n=3) Notation Meaning Example B0D0 stay move c 12 c 12 B1D0 birth of 1 factor c 12 c 12 c 23 D1B0 death of 1 factor c 12 c 23 c 12
45 Bayesian Model Selection among PCC s Graph of all PCC s for n = 3 a = 1 4, b = 1 3 b a c12c23c13 2 a a a a a a a c12c23 c12c13 2 c23c13 2 a a a a a a a b b b b b b c12 c23 c13 2 b b a With probabilities a or b the chain moves to other model or stays in the current model
46 Bayesian Model Selection among PCC s Acceptance probability for B1D0 move Actual state θ o := θ o m o mo = (m1 o,mo 2,mo 3 ) Proposed state θ p := θ p m p mp = (m p 1,mp 2,mp 3 ) birth index {ms p } := m p \m o stay indices {mv o,mo w } := mp m o Example: ( θ p ) 12,θp 23 (θ p 12,θp 23,θp 13 2 ) Bijection: θ p := θ p m p s θ p m o v θ p m o w = η o m p s θ o m o v θ o m o w =: ( η o m p s θ o ) Here η o ms p is bivariate normal centered at θ m p s,last covariance matrix with specified
47 Bayesian Model Selection among PCC s MLE for SMT- data Parameter MLE ρ SM ρ MT 0.47 ρ ST M ν SM 4.22 ν MT ν ST M 300 log.likelih Is the correlation ρ ST M = 0.11 significantly negligible?
48 Bayesian Model Selection among PCC s Model notation c SM c MT c ST M M 1 c SM c MT M 2 c SM c ST M M 3 c MT c ST M M 4 c SM M 5 c MT M 6 c ST M M 7 Would Model M 2 now be preferred to Model M 1?
49 Bayesian Model Selection among PCC s Model M 1 was visited 2872 times out of Model M 2 was visited 7128 times out of Financial returns: Statistics of visited models c ST M c ST M c SM c SM c MT c ST M c MT c ST M c SM c ST M c SM c ST M c SM c MT c SM c MT c SM c MT c ST M c SM c MT c ST M Iterations First 10 Iterations
50 Bayesian Model Selection among PCC s Summary statistics for visited Models Model M 2 : c SM c MT 2.5% 50% 97.5% Est. Post. Est. Post. MLE Quantile Quantile Quantile Mean Mode ρ SM ν SM ρ MT ν MT Model M 1 : c SM c MT c ST M 2.5% 50% 97.5% Est. Post. Est. Post. MLE Quantile Quantile Quantile Mean Mode ρ SM ν SM ρ MT ν MT ρ ST M ν ST M
51 Bayesian Model Selection among PCC s Posterior model probabilities RJMCMC Model PCC Formula P(Mk data) M 1 with all pairs c SM c MT c ST M 0.29 M 2 without c ST M c SM c MT 0.71 M 3 without c MT c SM c ST M 0 M 4 without c SM c MT c ST M 0 M 5 without c MT and c ST M c SM 0 M 6 without c SM and c ST M c MT 0 M 7 without c SM and c MT c ST M 0 Congdon Model PCC Formula P(Mk data) M 1 : with all pairs c SM c MT c ST M 0.22 M 2 : without c ST M c SM c MT 0.78
52 Euro Swap Rates Euro Swap Rates daily swap rates with 2,3,5,7 and 10 year maturity quoted in Euro s considered period is Dec 7, 1988 until June 21, 2001 serial marginal correlation removed with an ARMA(1,1)-GARCH(1,1) model and standardized residuals transformed empirically to data with uniform margins Notation: Swap2, Swap3, Swap5, Swap7 and Swap10 or abbreviated S 1,...,S 5
53 Euro Swap Rates Dependence structure of Euro Swap Rates Swap Swap3 Swap Swap7 Swap
54 Euro Swap Rates Estimated df s of bivariate t-copula margins for swap rates Swap3 Swap5 Swap7 Swap10 Swap Swap Swap Swap7 2.07
55 Euro Swap Rates Chosen D-vine structure for swap rates S 1 S 1 S 2 S2 S 2 S 3 S3 S 3 S 4 S4 S 4 S 5 S5 S 1 S 2 S 1 S 3 S 2 S 2 S 3 S 2 S 4 S 3 S 3 S 4 S 3 S 5 S 4 S 4 S 5 S 1 S 3 S 2 S 1 S 4 S 2 S 3 S 2 S 4 S 3 S 2 S 5 S 3 S 4 S 3 S 5 S 4 S 1 S 4 S 2 S 3 S 1 S 5 S 2 S 3 S 4 S 2 S 5 S 3 S 4
56 Euro Swap Rates Trace of MCMC iterations for swap rates ρ S1 S 2 ν S1 S 2 ρ S2 S 3 ν S2 S 3 ρ S3 S 4 ρ Iterations ν Iterations ρ Iterations ν Iterations ρ Iterations ν S3 S 4 ρ S4 S 5 ν S4 S 5 ρ S1 S 3 S 2 ν S1 S 3 S 2 ν Iterations ρ Iterations ν Iterations ρ Iterations ν Iterations ρ S2 S 4 S 3 ν S2 S 4 S 3 ρ S3 S 5 S 4 ν S3 S 5 S 4 ρ S1 S 4 S 2 S 3 ρ Iterations ν Iterations ρ Iterations ν Iterations ρ Iterations ν S1 S 4 S 2 S 3 ρ S2 S 5 S 3 S 4 ν S2 S 5 S 3 S 4 ρ S1 S 5 S 2 S 3 S 4 ν S1 S 5 S 2 S 3 S 4 ν Iterations ρ Iterations ν Iterations ρ Iterations ν Iterations
57 Euro Swap Rates For the further analysis we used burnin 1000 iteration and only every 20th iteration. Autocorrelations among the MCMC iterations for the swap rates ρ S1 S 2 ν S1 S 2 ρ S2 S 3 ν S2 S 3 ρ S3 S 4 ACF ACF ACF ACF ACF Lag Lag Lag Lag Lag ν S3 S 4 ρ S4 S 5 ν S4 S 5 ρ S1 S 3 S 2 ν S1 S 3 S 2 ACF ACF ACF ACF ACF Lag Lag Lag Lag Lag ρ S2 S 4 S 3 ν S2 S 4 S 3 ρ S3 S 5 S 4 ν S3 S 5 S 4 ρ S1 S 4 S 2 S 3 ACF ACF ACF ACF ACF Lag Lag Lag Lag Lag ν S1 S 4 S 2 S 3 ρ S2 S 5 S 3 S 4 ν S2 S 5 S 3 S 4 ρ S1 S 5 S 2 S 3 S 4 ν S1 S 5 S 2 S 3 S 4 ACF ACF ACF ACF ACF Lag Lag Lag Lag Lag
58 Euro Swap Rates Estimated posterior densities of D-vine parameters ρ S1 S 2 ν S1 S 2 ρ S2 S 3 ν S2 S 3 ρ S3 S 4 Density Density Density Density Density ν S3 S 4 ρ S4 S 5 ν S4 S 5 ρ S1 S 3 S 2 ν S1 S 3 S 2 Density Density Density Density Density ρ S2 S 4 S 3 ν S2 S 4 S 3 ρ S3 S 5 S 4 ν S3 S 5 S 4 ρ S1 S 4 S 2 S 3 Density Density Density Density Density Density ν S1 S 4 S 2 S 3 ρ S2 S 5 S 3 S 4 ν S2 S 5 S 3 S 4 ρ S1 S 5 S 2 S 3 S 4 ν S1 S 5 S 2 S 3 S Density Density Density Density
59 Euro Swap Rates Summary statistics for thinned MCMC 2.5% 50% 97.5% Est. Post. Est. Post. MLE Quantile Quantile Quantile Mean Mode ρ S1 S ν S1 S ρ S2 S ν S2 S ρ S3 S ν S3 S ρ S4 S ν S4 S ρ S1 S 3 S ν S1 S 3 S ρ S2 S 4 S ν S2 S 4 S ρ S3 S 5 S ν S3 S 5 S ρ S1 S 4 S 2 S ν S1 S 4 S 2 S ρ S2 S 5 S 3 S ν S2 S 5 S 3 S ρ S1 S 5 S 2 S 3 S ν S1 S 5 S 2 S 3 S
60 Euro Swap Rates Log likelihoods Parameter values loglikelihood multivariate t with common df MLE Posterior Mode Likelihood Ratio Test rejects a multivariate t copula with common df decisively, estimated common df is Since posterior mode log likelihood is close to MLE likelihood, prior choice for ρ and ν are close to being noninformative in this data set.
61 Euro Swap Rates Model selection for swap rate data Model PCC P(Mk data) M 1 : with all pairs 0.19 M 2 : without c S1 S 5 S 2 S 3 S M 3 : without c S1 S 5 S 2 S 3 S 4 and c S2 S 5 S 3 S M 4 : without c S1 S 5 S 2 S 3 S 4, c S2 S 5 S 3 S and c S1 S 4 S 2 S 3
62 Summary and Outlook Summary and Conclusion PCC s such as canonical and D-Vines allow for very flexible class of multivariate distributions. The Bayesian approach can solve estimation as well as model selection problems. It also gives credible intervals for parameters of interest. The proposed RJMCMC Bayesian algorithm for n > 3 is under implementation. Incorporation of pair-copulas from different parametric families is under consideration. The proposed RJMCMC algorithm is an alternative to DIC and other Bayesian model choice algorithms Congdon s method can be used to make model comparisons for a small number of models
63 References Aas, K., C. Czado, A. Frigessi, and H. Bakken (2007). Pair-copula constructions of multiple dependence. Insurance, Mathematics and Economics, DOI /j.insmatheco , preprint available at SFB 386 Statistical Analysis of Diskrete Structures, muenchen.de/sfb386/. Bedford, T. and R. M. Cooke (2001). Probability density decomposition for conditionally dependent random variables modeled by vines. Annals of Mathematics and Artificial Intelligence 32, Bedford, T. and R. M. Cooke (2002). Vines - a new graphical model for dependent random variables. Annals of Statistics 30(4), Berg, D. and K. Aas (2007). Models for construction of higher-dimensional dependence.
64 References Kurowicka, D. and R. Cooke (2006). Uncertainty analysis with high dimensional dependence modelling. Congdon, P. (2006). Bayesian model choice based on monte carlo estimates of posterior model probabilities. Computational Statistics & Data Analysis 50, Green, P. (1995). Reversible jump markov chain monte carlo computation and Bayesian model determination. Biometrika 82, Joe, H. (1996). Families of m-variate distributions with given margins and m(m-1)/2 bivariate dependence parameters. In L. Rüschendorf and B. Schweizer and M. D. Taylor (Ed.), Distributions with Fixed Marginals and Related Topics.
65 Summary and Outlook Chichester: Wiley. Kurowicka, D. and R. M. Cooke (2004). Distribution - free continuous bayesian belief nets. In Fourth International Conference on Mathematical Methods in Reliability Methodology and Practice, Santa Fe, New Mexico. Scott, S. L. (2002). Bayesian methods for hidden Markov models: Recursive computing in the 21st century. J. Amer. Statist. Assoc. 97,
Chapter 1. Bayesian Inference for D-vines: Estimation and Model Selection
Chapter 1 Bayesian Inference for D-vines: Estimation and Model Selection Claudia Czado and Aleksey Min Technische Universität München, Zentrum Mathematik, Boltzmannstr. 3, 85747 Garching, Germany cczado@ma.tum.de
More informationBayesian inference for multivariate copulas using pair-copula constructions
Bayesian inference for multivariate copulas using pair-copula constructions Aleksey MIN and Claudia CZADO Munich University of Technology Munich University of Technology Corresponding author: Aleksey Min
More informationMarkov Switching Regular Vine Copulas
Int. Statistical Inst.: Proc. 58th World Statistical Congress, 2011, Dublin (Session CPS057) p.5304 Markov Switching Regular Vine Copulas Stöber, Jakob and Czado, Claudia Lehrstuhl für Mathematische Statistik,
More informationPair-copula constructions of multiple dependence
Pair-copula constructions of multiple dependence 3 4 5 3 34 45 T 3 34 45 3 4 3 35 4 T 3 4 3 35 4 4 3 5 34 T 3 4 3 5 34 5 34 T 4 Note no SAMBA/4/06 Authors Kjersti Aas Claudia Czado Arnoldo Frigessi Henrik
More informationHow to select a good vine
Universitetet i Oslo ingrihaf@math.uio.no International FocuStat Workshop on Focused Information Criteria and Related Themes, May 9-11, 2016 Copulae Regular vines Model selection and reduction Limitations
More informationAssessing the VaR of a portfolio using D-vine copula based multivariate GARCH models
Assessing the VaR of a portfolio using D-vine copula based multivariate GARCH models Mathias Hofmann a,, Claudia Czado b a Technische Universität München Zentrum Mathematik Lehrstuhl für Mathematische
More informationTruncated regular vines in high dimensions with application to financial data
Truncated regular vines in high dimensions with application to financial data This is a preprint of an article published in the Canadian Journal of Statistics Vol. 40, No. 1, 2012, Pages 68 85, http://www.interscience.wiley.com/
More informationGaussian Process Vine Copulas for Multivariate Dependence
Gaussian Process Vine Copulas for Multivariate Dependence José Miguel Hernández-Lobato 1,2 joint work with David López-Paz 2,3 and Zoubin Ghahramani 1 1 Department of Engineering, Cambridge University,
More informationBayesian Model Selection of Regular Vine Copulas
Bayesian Model Selection of Regular Vine Copulas Lutz F. Gruber Claudia Czado Abstract Regular vine copulas are a novel and very flexible class of dependence models. This paper presents a reversible jump
More informationTechnische Universität München. Zentrum Mathematik
Technische Universität München Zentrum Mathematik Joint estimation of parameters in multivariate normal regression with correlated errors using pair-copula constructions and an application to finance Diplomarbeit
More informationFinancial Econometrics and Volatility Models Copulas
Financial Econometrics and Volatility Models Copulas Eric Zivot Updated: May 10, 2010 Reading MFTS, chapter 19 FMUND, chapters 6 and 7 Introduction Capturing co-movement between financial asset returns
More informationJournal of Statistical Software
JSS Journal of Statistical Software January 2013, Volume 52, Issue 3. http://www.jstatsoft.org/ CDVine: Modeling Dependence with C- and D-Vine Copulas in R Eike Christian Brechmann Technische Universität
More informationSpatial Statistics 2013, S2.2 6 th June Institute for Geoinformatics University of Münster.
Spatial Statistics 2013, S2.2 6 th June 2013 Institute for Geoinformatics University of Münster http://ifgi.uni-muenster.de/graeler Vine Vine 1 Spatial/spatio-temporal data Typically, spatial/spatio-temporal
More informationBayesian Estimation of DSGE Models 1 Chapter 3: A Crash Course in Bayesian Inference
1 The views expressed in this paper are those of the authors and do not necessarily reflect the views of the Federal Reserve Board of Governors or the Federal Reserve System. Bayesian Estimation of DSGE
More informationVariational Inference with Copula Augmentation
Variational Inference with Copula Augmentation Dustin Tran 1 David M. Blei 2 Edoardo M. Airoldi 1 1 Department of Statistics, Harvard University 2 Department of Statistics & Computer Science, Columbia
More informationApproximation Multivariate Distribution of Main Indices of Tehran Stock Exchange with Pair-Copula
Journal of Modern Applied Statistical Methods Volume Issue Article 5 --03 Approximation Multivariate Distribution of Main Indices of Tehran Stock Exchange with Pair-Copula G. Parham Shahid Chamran University,
More informationMarginal Specifications and a Gaussian Copula Estimation
Marginal Specifications and a Gaussian Copula Estimation Kazim Azam Abstract Multivariate analysis involving random variables of different type like count, continuous or mixture of both is frequently required
More informationMultivariate Non-Normally Distributed Random Variables
Multivariate Non-Normally Distributed Random Variables An Introduction to the Copula Approach Workgroup seminar on climate dynamics Meteorological Institute at the University of Bonn 18 January 2008, Bonn
More informationBayesian Regression Linear and Logistic Regression
When we want more than point estimates Bayesian Regression Linear and Logistic Regression Nicole Beckage Ordinary Least Squares Regression and Lasso Regression return only point estimates But what if we
More informationCPSC 540: Machine Learning
CPSC 540: Machine Learning MCMC and Non-Parametric Bayes Mark Schmidt University of British Columbia Winter 2016 Admin I went through project proposals: Some of you got a message on Piazza. No news is
More informationMCMC algorithms for fitting Bayesian models
MCMC algorithms for fitting Bayesian models p. 1/1 MCMC algorithms for fitting Bayesian models Sudipto Banerjee sudiptob@biostat.umn.edu University of Minnesota MCMC algorithms for fitting Bayesian models
More informationEstimation of Copula Models with Discrete Margins (via Bayesian Data Augmentation) Michael S. Smith
Estimation of Copula Models with Discrete Margins (via Bayesian Data Augmentation) Michael S. Smith Melbourne Business School, University of Melbourne (Joint with Mohamad Khaled, University of Queensland)
More informationModels for construction of multivariate dependence
Dept. of Math. University of Oslo Statistical Research Report No. 3 ISSN 0806 3842 June 2007 Models for construction of multivariate dependence Daniel Berg University of Oslo and Norwegian Computing Center
More informationPrinciples of Bayesian Inference
Principles of Bayesian Inference Sudipto Banerjee University of Minnesota July 20th, 2008 1 Bayesian Principles Classical statistics: model parameters are fixed and unknown. A Bayesian thinks of parameters
More informationSelection of Vine Copulas
Selection of Vine Copulas Claudia Czado and Eike Christian Brechmann and Lutz Gruber Abstract Vine copula models have proven themselves as a very flexible class of multivariate copula models with regard
More informationTHE VINE COPULA METHOD FOR REPRESENTING HIGH DIMENSIONAL DEPENDENT DISTRIBUTIONS: APPLICATION TO CONTINUOUS BELIEF NETS
Proceedings of the 00 Winter Simulation Conference E. Yücesan, C.-H. Chen, J. L. Snowdon, and J. M. Charnes, eds. THE VINE COPULA METHOD FOR REPRESENTING HIGH DIMENSIONAL DEPENDENT DISTRIBUTIONS: APPLICATION
More informationRepresenting sparse Gaussian DAGs as sparse R-vines allowing for non-gaussian dependence
Representing sparse Gaussian DAGs as sparse R-vines allowing for non-gaussian dependence arxiv:604.040v [stat.me] 0 Nov 06 Dominik Müller and Claudia Czado December, 06 Abstract Modeling dependence in
More informationMarkov Chain Monte Carlo methods
Markov Chain Monte Carlo methods By Oleg Makhnin 1 Introduction a b c M = d e f g h i 0 f(x)dx 1.1 Motivation 1.1.1 Just here Supresses numbering 1.1.2 After this 1.2 Literature 2 Method 2.1 New math As
More informationST 740: Markov Chain Monte Carlo
ST 740: Markov Chain Monte Carlo Alyson Wilson Department of Statistics North Carolina State University October 14, 2012 A. Wilson (NCSU Stsatistics) MCMC October 14, 2012 1 / 20 Convergence Diagnostics:
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 7 Approximate
More informationThe Instability of Correlations: Measurement and the Implications for Market Risk
The Instability of Correlations: Measurement and the Implications for Market Risk Prof. Massimo Guidolin 20254 Advanced Quantitative Methods for Asset Pricing and Structuring Winter/Spring 2018 Threshold
More informationReminder of some Markov Chain properties:
Reminder of some Markov Chain properties: 1. a transition from one state to another occurs probabilistically 2. only state that matters is where you currently are (i.e. given present, future is independent
More informationAn Econometric Study of Vine Copulas
An Econometric Study of Vine Copulas Pierre-André Maugis (Corresponding author) PSE, Université Paris 1 Panthéon-Sorbonne, 106 boulevard de l Hopital 75647 Paris Cedex 13, France E-mail: pierre-andre.maugis@malix.univ-paris1.fr.
More informationA copula goodness-of-t approach. conditional probability integral transform. Daniel Berg 1 Henrik Bakken 2
based on the conditional probability integral transform Daniel Berg 1 Henrik Bakken 2 1 Norwegian Computing Center (NR) & University of Oslo (UiO) 2 Norwegian University of Science and Technology (NTNU)
More informationVines in Overview Invited Paper Third Brazilian Conference on Statistical Modelling in Insurance and Finance Maresias, March 25-30, 2007
Vines in Overview Invited Paper Third Brazilian Conference on Statistical Modelling in Insurance and Finance Maresias, March 25-30, 2007 R.M. Cooke, O. Morales, D. Kurowicka Resources for the Future and
More informationA simple graphical method to explore tail-dependence in stock-return pairs
A simple graphical method to explore tail-dependence in stock-return pairs Klaus Abberger, University of Konstanz, Germany Abstract: For a bivariate data set the dependence structure can not only be measured
More informationMCMC and Gibbs Sampling. Kayhan Batmanghelich
MCMC and Gibbs Sampling Kayhan Batmanghelich 1 Approaches to inference l Exact inference algorithms l l l The elimination algorithm Message-passing algorithm (sum-product, belief propagation) The junction
More informationComputational statistics
Computational statistics Markov Chain Monte Carlo methods Thierry Denœux March 2017 Thierry Denœux Computational statistics March 2017 1 / 71 Contents of this chapter When a target density f can be evaluated
More informationarxiv: v1 [cs.ne] 19 Oct 2012
Modeling with Copulas and Vines in Estimation of Distribution Algorithms arxiv:121.55v1 [cs.ne] 19 Oct 212 Marta Soto Institute of Cybernetics, Mathematics and Physics, Cuba. Email: mrosa@icimaf.cu Yasser
More informationTruncation of vine copulas using fit indices
Truncation of vine copulas using fit indices Eike C. Brechmann Harry Joe February 2, 2015 Abstract Vine copulas are flexible multivariate dependence models, which are built up from a set of bivariate copulas
More informationMarkov Chain Monte Carlo
Markov Chain Monte Carlo Recall: To compute the expectation E ( h(y ) ) we use the approximation E(h(Y )) 1 n n h(y ) t=1 with Y (1),..., Y (n) h(y). Thus our aim is to sample Y (1),..., Y (n) from f(y).
More informationAssessing Regime Uncertainty Through Reversible Jump McMC
Assessing Regime Uncertainty Through Reversible Jump McMC August 14, 2008 1 Introduction Background Research Question 2 The RJMcMC Method McMC RJMcMC Algorithm Dependent Proposals Independent Proposals
More informationCopulas and Measures of Dependence
1 Copulas and Measures of Dependence Uttara Naik-Nimbalkar December 28, 2014 Measures for determining the relationship between two variables: the Pearson s correlation coefficient, Kendalls tau and Spearmans
More informationModeling Ultra-High-Frequency Multivariate Financial Data by Monte Carlo Simulation Methods
Outline Modeling Ultra-High-Frequency Multivariate Financial Data by Monte Carlo Simulation Methods Ph.D. Student: Supervisor: Marco Minozzo Dipartimento di Scienze Economiche Università degli Studi di
More informationGaussian Process Vine Copulas for Multivariate Dependence
Gaussian Process Vine Copulas for Multivariate Dependence José Miguel Hernández Lobato 1,2, David López Paz 3,2 and Zoubin Ghahramani 1 June 27, 2013 1 University of Cambridge 2 Equal Contributor 3 Ma-Planck-Institute
More informationMonte Carlo in Bayesian Statistics
Monte Carlo in Bayesian Statistics Matthew Thomas SAMBa - University of Bath m.l.thomas@bath.ac.uk December 4, 2014 Matthew Thomas (SAMBa) Monte Carlo in Bayesian Statistics December 4, 2014 1 / 16 Overview
More informationBayesian Linear Regression
Bayesian Linear Regression Sudipto Banerjee 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. September 15, 2010 1 Linear regression models: a Bayesian perspective
More informationSAMSI Astrostatistics Tutorial. More Markov chain Monte Carlo & Demo of Mathematica software
SAMSI Astrostatistics Tutorial More Markov chain Monte Carlo & Demo of Mathematica software Phil Gregory University of British Columbia 26 Bayesian Logical Data Analysis for the Physical Sciences Contents:
More informationImproving forecasting performance using covariate-dependent copula models
Improving forecasting performance using covariate-dependent copula models Feng Li a, Yanfei Kang b, a School of Statistics and Mathematics, Central University of Finance and Economics, Beijing 100081,
More informationForecasting time series with multivariate copulas
Depend. Model. 2015; 3:59 82 Research Article Open Access Clarence Simard* and Bruno Rémillard Forecasting time series with multivariate copulas DOI 10.1515/demo-2015-0005 5 Received august 17, 2014; accepted
More informationConditional Least Squares and Copulae in Claims Reserving for a Single Line of Business
Conditional Least Squares and Copulae in Claims Reserving for a Single Line of Business Michal Pešta Charles University in Prague Faculty of Mathematics and Physics Ostap Okhrin Dresden University of Technology
More informationVine copulas with asymmetric tail dependence and applications to financial return data 1. Abstract
*Manuscript Vine copulas with asymmetric tail dependence and applications to financial return data 1 Aristidis K. Nikoloulopoulos 2, Harry Joe 3 and Haijun Li 4 Abstract In Aas et al. (2009) and Aas and
More informationModelling Dependence in Space and Time with Vine Copulas
Modelling Dependence in Space and Time with Vine Copulas Benedikt Gräler, Edzer Pebesma Abstract We utilize the concept of Vine Copulas to build multi-dimensional copulas out of bivariate ones, as bivariate
More informationInfinite-State Markov-switching for Dynamic. Volatility Models : Web Appendix
Infinite-State Markov-switching for Dynamic Volatility Models : Web Appendix Arnaud Dufays 1 Centre de Recherche en Economie et Statistique March 19, 2014 1 Comparison of the two MS-GARCH approximations
More information17 : Markov Chain Monte Carlo
10-708: Probabilistic Graphical Models, Spring 2015 17 : Markov Chain Monte Carlo Lecturer: Eric P. Xing Scribes: Heran Lin, Bin Deng, Yun Huang 1 Review of Monte Carlo Methods 1.1 Overview Monte Carlo
More informationCS242: Probabilistic Graphical Models Lecture 7B: Markov Chain Monte Carlo & Gibbs Sampling
CS242: Probabilistic Graphical Models Lecture 7B: Markov Chain Monte Carlo & Gibbs Sampling Professor Erik Sudderth Brown University Computer Science October 27, 2016 Some figures and materials courtesy
More informationModel selection in sparse high-dimensional vine copula models with application to portfolio risk
Model selection in sparse high-dimensional vine copula models with application to portfolio risk arxiv:1801.09739v3 [stat.me] 19 Nov 2018 Thomas Nagler, Christian Bumann, Claudia Czado November 20, 2018
More informationBAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA
BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA Intro: Course Outline and Brief Intro to Marina Vannucci Rice University, USA PASI-CIMAT 04/28-30/2010 Marina Vannucci
More informationEco517 Fall 2013 C. Sims MCMC. October 8, 2013
Eco517 Fall 2013 C. Sims MCMC October 8, 2013 c 2013 by Christopher A. Sims. This document may be reproduced for educational and research purposes, so long as the copies contain this notice and are retained
More informationMultivariate Distribution Models
Multivariate Distribution Models Model Description While the probability distribution for an individual random variable is called marginal, the probability distribution for multiple random variables is
More informationMarkov chain Monte Carlo
Markov chain Monte Carlo Feng Li feng.li@cufe.edu.cn School of Statistics and Mathematics Central University of Finance and Economics Revised on April 24, 2017 Today we are going to learn... 1 Markov Chains
More informationPrinciples of Bayesian Inference
Principles of Bayesian Inference Sudipto Banerjee and Andrew O. Finley 2 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry & Department
More informationMetropolis-Hastings Algorithm
Strength of the Gibbs sampler Metropolis-Hastings Algorithm Easy algorithm to think about. Exploits the factorization properties of the joint probability distribution. No difficult choices to be made to
More informationExtreme Value Analysis and Spatial Extremes
Extreme Value Analysis and Department of Statistics Purdue University 11/07/2013 Outline Motivation 1 Motivation 2 Extreme Value Theorem and 3 Bayesian Hierarchical Models Copula Models Max-stable Models
More informationDynamic D-Vine Copula Model with Applications to Value-at-Risk (VaR)
Dynamic D-Vine Copula Model with Applications to Value-at-Risk (VaR) Paula V. Tófoli Flávio A. Ziegelmann Osvaldo C. Silva Filho Abstract Regular vine copulas constitute a very flexible class of multivariate
More informationPattern Recognition and Machine Learning
Christopher M. Bishop Pattern Recognition and Machine Learning ÖSpri inger Contents Preface Mathematical notation Contents vii xi xiii 1 Introduction 1 1.1 Example: Polynomial Curve Fitting 4 1.2 Probability
More informationThe Mixture Approach for Simulating New Families of Bivariate Distributions with Specified Correlations
The Mixture Approach for Simulating New Families of Bivariate Distributions with Specified Correlations John R. Michael, Significance, Inc. and William R. Schucany, Southern Methodist University The mixture
More informationModeling conditional distributions with mixture models: Applications in finance and financial decision-making
Modeling conditional distributions with mixture models: Applications in finance and financial decision-making John Geweke University of Iowa, USA Journal of Applied Econometrics Invited Lecture Università
More informationMarkov Chain Monte Carlo Methods
Markov Chain Monte Carlo Methods John Geweke University of Iowa, USA 2005 Institute on Computational Economics University of Chicago - Argonne National Laboaratories July 22, 2005 The problem p (θ, ω I)
More informationProgram and big picture Big data: can copula modelling be used for high dimensions, say
Conditional independence copula models with graphical representations Harry Joe (University of British Columbia) For multivariate Gaussian with a large number of variables, there are several approaches
More informationLikelihood-free MCMC
Bayesian inference for stable distributions with applications in finance Department of Mathematics University of Leicester September 2, 2011 MSc project final presentation Outline 1 2 3 4 Classical Monte
More informationParameter estimation and forecasting. Cristiano Porciani AIfA, Uni-Bonn
Parameter estimation and forecasting Cristiano Porciani AIfA, Uni-Bonn Questions? C. Porciani Estimation & forecasting 2 Temperature fluctuations Variance at multipole l (angle ~180o/l) C. Porciani Estimation
More informationarxiv: v1 [stat.me] 9 Feb 2012
Modeling high dimensional time-varying dependence using D-vine SCAR models Carlos Almeida a, Claudia Czado b, Hans Manner c, arxiv:1202.2008v1 [stat.me] 9 Feb 2012 a Georges Lemaitre Centre for Earth and
More informationParametric Models. Dr. Shuang LIANG. School of Software Engineering TongJi University Fall, 2012
Parametric Models Dr. Shuang LIANG School of Software Engineering TongJi University Fall, 2012 Today s Topics Maximum Likelihood Estimation Bayesian Density Estimation Today s Topics Maximum Likelihood
More informationA Review of Pseudo-Marginal Markov Chain Monte Carlo
A Review of Pseudo-Marginal Markov Chain Monte Carlo Discussed by: Yizhe Zhang October 21, 2016 Outline 1 Overview 2 Paper review 3 experiment 4 conclusion Motivation & overview Notation: θ denotes the
More informationMultivariate Statistics
Multivariate Statistics Chapter 2: Multivariate distributions and inference Pedro Galeano Departamento de Estadística Universidad Carlos III de Madrid pedro.galeano@uc3m.es Course 2016/2017 Master in Mathematical
More informationLecture 8: The Metropolis-Hastings Algorithm
30.10.2008 What we have seen last time: Gibbs sampler Key idea: Generate a Markov chain by updating the component of (X 1,..., X p ) in turn by drawing from the full conditionals: X (t) j Two drawbacks:
More informationConstruction and estimation of high dimensional copulas
Construction and estimation of high dimensional copulas Gildas Mazo PhD work supervised by S. Girard and F. Forbes Mistis, Inria and laboratoire Jean Kuntzmann, Grenoble, France Séminaire Statistiques,
More informationWhen is a copula constant? A test for changing relationships
When is a copula constant? A test for changing relationships Fabio Busetti and Andrew Harvey Bank of Italy and University of Cambridge November 2007 usetti and Harvey (Bank of Italy and University of Cambridge)
More informationMarkov Chain Monte Carlo, Numerical Integration
Markov Chain Monte Carlo, Numerical Integration (See Statistics) Trevor Gallen Fall 2015 1 / 1 Agenda Numerical Integration: MCMC methods Estimating Markov Chains Estimating latent variables 2 / 1 Numerical
More informationOnline Appendix to: Marijuana on Main Street? Estimating Demand in Markets with Limited Access
Online Appendix to: Marijuana on Main Street? Estating Demand in Markets with Lited Access By Liana Jacobi and Michelle Sovinsky This appendix provides details on the estation methodology for various speci
More informationPrinciples of Bayesian Inference
Principles of Bayesian Inference Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry & Department
More informationMarkov Chain Monte Carlo
1 Motivation 1.1 Bayesian Learning Markov Chain Monte Carlo Yale Chang In Bayesian learning, given data X, we make assumptions on the generative process of X by introducing hidden variables Z: p(z): prior
More informationBayesian spatial hierarchical modeling for temperature extremes
Bayesian spatial hierarchical modeling for temperature extremes Indriati Bisono Dr. Andrew Robinson Dr. Aloke Phatak Mathematics and Statistics Department The University of Melbourne Maths, Informatics
More informationA Brief Introduction to Copulas
A Brief Introduction to Copulas Speaker: Hua, Lei February 24, 2009 Department of Statistics University of British Columbia Outline Introduction Definition Properties Archimedean Copulas Constructing Copulas
More informationBayesian Methods for Machine Learning
Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),
More informationDependence Modeling in Ultra High Dimensions with Vine Copulas and the Graphical Lasso
Dependence Modeling in Ultra High Dimensions with Vine Copulas and the Graphical Lasso Dominik Müller Claudia Czado arxiv:1709.05119v1 [stat.ml] 15 Sep 2017 September 18, 2017 Abstract To model high dimensional
More informationSampling Algorithms for Probabilistic Graphical models
Sampling Algorithms for Probabilistic Graphical models Vibhav Gogate University of Washington References: Chapter 12 of Probabilistic Graphical models: Principles and Techniques by Daphne Koller and Nir
More informationRiemann Manifold Methods in Bayesian Statistics
Ricardo Ehlers ehlers@icmc.usp.br Applied Maths and Stats University of São Paulo, Brazil Working Group in Statistical Learning University College Dublin September 2015 Bayesian inference is based on Bayes
More informationGraphical Models and Kernel Methods
Graphical Models and Kernel Methods Jerry Zhu Department of Computer Sciences University of Wisconsin Madison, USA MLSS June 17, 2014 1 / 123 Outline Graphical Models Probabilistic Inference Directed vs.
More informationComputationalToolsforComparing AsymmetricGARCHModelsviaBayes Factors. RicardoS.Ehlers
ComputationalToolsforComparing AsymmetricGARCHModelsviaBayes Factors RicardoS.Ehlers Laboratório de Estatística e Geoinformação- UFPR http://leg.ufpr.br/ ehlers ehlers@leg.ufpr.br II Workshop on Statistical
More informationRecall that the AR(p) model is defined by the equation
Estimation of AR models Recall that the AR(p) model is defined by the equation X t = p φ j X t j + ɛ t j=1 where ɛ t are assumed independent and following a N(0, σ 2 ) distribution. Assume p is known and
More informationMCMC and Gibbs Sampling. Sargur Srihari
MCMC and Gibbs Sampling Sargur srihari@cedar.buffalo.edu 1 Topics 1. Markov Chain Monte Carlo 2. Markov Chains 3. Gibbs Sampling 4. Basic Metropolis Algorithm 5. Metropolis-Hastings Algorithm 6. Slice
More informationApril 20th, Advanced Topics in Machine Learning California Institute of Technology. Markov Chain Monte Carlo for Machine Learning
for for Advanced Topics in California Institute of Technology April 20th, 2017 1 / 50 Table of Contents for 1 2 3 4 2 / 50 History of methods for Enrico Fermi used to calculate incredibly accurate predictions
More informationFall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.
1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n
More informationGaussian kernel GARCH models
Gaussian kernel GARCH models Xibin (Bill) Zhang and Maxwell L. King Department of Econometrics and Business Statistics Faculty of Business and Economics 7 June 2013 Motivation A regression model is often
More informationDependence. Practitioner Course: Portfolio Optimization. John Dodson. September 10, Dependence. John Dodson. Outline.
Practitioner Course: Portfolio Optimization September 10, 2008 Before we define dependence, it is useful to define Random variables X and Y are independent iff For all x, y. In particular, F (X,Y ) (x,
More informationHANDBOOK OF APPLICABLE MATHEMATICS
HANDBOOK OF APPLICABLE MATHEMATICS Chief Editor: Walter Ledermann Volume VI: Statistics PART A Edited by Emlyn Lloyd University of Lancaster A Wiley-Interscience Publication JOHN WILEY & SONS Chichester
More informationA simple nonparametric test for structural change in joint tail probabilities SFB 823. Discussion Paper. Walter Krämer, Maarten van Kampen
SFB 823 A simple nonparametric test for structural change in joint tail probabilities Discussion Paper Walter Krämer, Maarten van Kampen Nr. 4/2009 A simple nonparametric test for structural change in
More informationTime Series Copulas for Heteroskedastic Data
Time Series Copulas for Heteroskedastic Data Rubén Loaiza-Maya, Michael S. Smith and Worapree Maneesoonthorn arxiv:7.752v [stat.ap] 25 Jan 27 First Version March 26 This Version January 27 Rubén Loaiza-Maya
More information