Supplementary Material for Analysis of Job Satisfaction: The Case of Japanese Private Companies

Size: px
Start display at page:

Download "Supplementary Material for Analysis of Job Satisfaction: The Case of Japanese Private Companies"

Transcription

1 Supplementary Material for Analysis of Job Satisfaction: The Case of Japanese Private Companies S1. Sampling Algorithms We assume that z i NX i β, Σ), i =1,,n, 1) where Σ is an m m positive definite covariance matrix. To complete the Bayesian model, we introduce the prior distributions of the parameters pβ, γ, Σ, z). On the basis of Bayes theorem, the joint posterior distribution can be written as pβ, γ, Σ, z y) pβ, γ, Σ, z)py β, γ, Σ, z) = pβ, γ, Σ)pz β, γ, Σ)py β, γ, Σ, z) [ n ] = pβ, γ, Σ) pz i β, γ, Σ)py i β, γ, Σ, z i ). Further, defining we have G ij = ] γ jc 1),γ jc if yij = c, c {1,,C j },j=1,,m G i = G i1 G im, i =1,,n, py i β, γ, Σ, z i )=1 zi G i), i =1,,n, where 1 ) is an indicator function. 1 Now, we specify the prior distributions as follows: m pβ, γ, Σ) =pβ)pγ)pσ) = pβ j )pγ j ) pσ), where j=1 β j Nβ j0, B j0 ), j =1,,m, Σ 1 Wκ 0, Q 1 0 ), 1 See Chib and Greenberg 1998, p.349). 1

2 and Wκ 0, Q 1 0 ) denotes a Wishart distribution with degrees of freedom κ 0 and scale matrix Q 1 0. Further, we introduce the prior distribution of γ j, pγ j )= pδ j γ j )) based on the following transformation for the cutoff points Chen and Dey, 2000, p.140): ) γjc γ jc 1) δ jc =log, c =2,,C j 2, 1 γ jc where δ j γ j )=δ j2,,δ jcj 2)) j =1,,m). follows: We specify pδ j γ j )) as δ j γ j ) Nδ j0, D j0 ), j =1,,m. Thus, the joint posterior distribution can be written as pβ, γ, Σ, z y) pβ, γ, Σ) { n [ 1 zi G i) Σ 1 2 exp 1 2 z i X i β) Σ 1 z i X i β)] }. 2) Using the MCMC sampling scheme, we can sample parameters β, γ, Σ, z) from the joint posterior distribution 2). S1.1. Sampling of β and Σ 1 For the sake of convenience of expression, we replace the jth factor of z i, X i, β, Σ and Σ 1 as the first factor, that is, ) ) ) zij x z i =, X z i = ij 0 βj, β = i j) 0 X i j) β j) σjj σ ) j) σ Σ =, Σ 1 jj σ j) ) = σ j) Σ j) σ j) Σ j). Then, we have the following full conditional distributions FCDs) of β j Σ 1. The FCD of β j is and β j N β j, B j ), j =1,,m, 3) where denotes that 3) is conditional on the other unspecified variables in the equation, and B j = B 1 j0 + σjj n x ij x ij β j = B j [B 1 j0 β j0 + σjj The FCD of Σ 1 is ) 1 n x ij z ij + n ) ] x ij σ j) z i j) X i j) β j). Σ 1 W κ, Q 1 ) 4) 2

3 where n κ = κ 0 + n, Q = Q0 + z i X i β)z i X i β). Applying a Gibbs sampling to the FCDs of 3) and 4), we can generate β j and Σ 1. S1.2. Sampling of z and γ Let z j) =z 1j,z 2j,,z nj ) denote the vector of the jth element z ij from z i i =1,,n). Further, let z j) denote the vector obtained by removing z j) from z, and let z i j) denote the vector of removing z ij from z i.wecanthen generate γ j and z j) from the joint conditional distribution pγ j, z j) β, Σ, z j), y) j =1,,m). The joint conditional distribution pγ j, z j) β, Σ, z j), y) can be written as pγ j, z j) β, Σ, z j), y) = pγ j β, Σ, z j), y)pz j) γ j, β, Σ, z j), y), j =1,,m. Similar to the sampling of β j, for the sake of convenience of expression, we replace the jth factor as the first factor. Since z i β, Σ, γ NX i β, Σ), from the property of the multivariate normal distribution, we have where z ij γ j, β, Σ, z j), y N μ ij, σ jj )1 zij G ij), i =1,,n; j =1,,m, 5) ) μ ij = x ij β j + σ j) Σ 1 j) z i j) X i j) β j) σ jj = σ jj σ j) Σ 1 j) σ j). The distribution of z ij is a truncated normal distribution. Since z 1j,z 2j,,z nj are independent, given γ j, β, Σ, wehave pγ j β, Σ, z j), y) pδ j γ j )) i:y ij=3 [ Φ γj3 μ ij i:y ij =C j 1 σ jj [ Φ i:y ij=2 [ Φ ) γj2 μ ij Φ 1 μij σ jj σ jj ) Φ γj2 μ ij )] σ jj γjcj 2) μ ij σ jj ) Φ μ )] ij σ jj )], where Φ ) is the distribution function of the standard normal distribution. Thus, the conditional distribution of δ j is C j 2 pδ j β, Σ, z j), y) pγ j β, Σ, z j), y) c=2 1 γjc 1) ) expδjc ) 1+expδjc ) ) 2. 6) 3

4 We use a multivariate t distribution, Mtδ j δ j, Σ δj,ν), as a proposal distribution for generating δ j,where δ j isthemodeof6), [ ] 1 Σ δj = 2 log pδ j ) δ j δ j δ j= δ j and ν is the degrees of freedom. The M-H algorithm for generating δ j is as follows: 1. Let δ t) j denote the value of δ j at the tth iteration. 2. At the t + 1)th iteration, sample δ p j from Mtδ j δ j, Σ δj,ν). 3. The transition probability from δ t) j to δ p j is { pδ p j α =min )Mtδt) j δ j, Σ } δj,ν) pδ t) j )Mtδp j δ j, Σ δj,ν), Generate u U0, 1), the uniform distribution on 0, 1), and take { δ p j if u<α δ t+1) j = δ t) j otherwise. We can obtain γ j from δ j using the equation γ jc = γ jc 1) +expδ jc ),c=2,,c j 2. 1+expδ jc ) S2. Partial Effects of Explanatory Variables We are more interested in the response probabilities Pry i1 = c) than in the coefficient parameters themselves. Dropping the suffix i in 1), we consider the population regression, that is, z NXβ, Σ), where X =diagx 1,,. x m), and divide z as z = z 1, z 1)) Suppose that z1 is a latent variable associated with a dependent variable of interest, y 1,andz 1) is a vector of latent variables corresponding to the other ordinal variables. Then, we have pz X, )=p z 1, z 1) X, ) = p z 1 z 1), X, ) p z 1) X, ). On the basis of the property of the multivariate normal distribution, we obtain where z 1 z 1), X, N μ 1, σ 11 ), 7) ) μ 1 = x 1 β 1 + σ 1) Σ 1 1) z 1) X 1) β 1) σ 11 = σ 11 σ 1) Σ 1 1) σ 1) 8) ) ) x X = 1 0 β1 σ11 σ ), β =, Σ = 1). O X 1) β 1) σ 1) Σ 1) 4

5 From 7), we have the following response probabilities of y 1 : Pry 1 = c) =Prγ 1c 1) <z 1 γ 1c ) γ1c 1) μ 1 =Pr < z 1 μ 1 γ ) 1c μ 1 σ11 σ11 σ11 Φ μ ) 1 c =1 σ11 ) ) γ1c μ 1 γ1c 1) μ 1 = Φ Φ c =2,,C 1 1 σ11 ) σ11 1 μ1 1 Φ c = C 1, σ11 9) where Φ ) is the distribution function of the standard normal distribution. If x is a binary explanatory variable, we can obtain the partial effect of x on the response probability Pry 1 = c) by calculating the average of Δ Pry 1 = c) = Pry 1 = c x =1) Pry 1 = c x = 0); that is, 1 n n ΔPry i1 = c) = 1 n n Pry i1 = c x i =1) 1 n S3. Correlation Matrices n Pry i1 = c x i =0). Following Hasegawa 2013), we calculate the simple version of the polychoric correlation matrix at each MCMC iteration based on the sample of Σ: R s = {r s ij} = D s ΣD s, 10) where D s = diag1/ σ 11,, 1/ σ mm )andσ jj is the jth diagonal element of Σ. Further, we can calculate the partial version of the polychoric correlation coefficients, defined as the lower triangular part without the diagonal elements of the following matrix: R p = {r p ij } = D rr 1 s D r, 11) where D r = diag1/ r 11,, 1/ r mm )andr jj is the jth diagonal element of R 1 s. 5

6 S4. Effects of gender and employment status differences on specific aspects related to job satisfaction Figures S4.1 to S4.9 show the effects of gender and employment satus differences on specific aspects related to the job satisfaction. Figure S4.1 : β 2,2, β 2,2 + β 2,4, β 2,3, β 2,3 + β 2,4, and economic indexes for motivation to work work1) β 2,2 β 2,2 + β 2,4 β 2,3 β 2,3 + β 2,4 6

7 Figure S4.2 : β 3,2, β 3,2 + β 3,4, β 3,3, β 3,3 + β 3,4, and economic indexes for adequately making use of your abilities and expertise work2) β 3,2 β 3,2 + β 3,4 β 3,3 β 3,3 + β 3,4 7

8 Figure S4.3 : β 4,2, β 4,2 + β 4,4, β 4,3, β 4,3 + β 4,4, and economic indexes for opportunities and support to enhance vocational skills and career work3) β 4,2 β 4,2 + β 4,4 β 4,3 β 4,3 + β 4,4 8

9 Figure S4.4 : β 5,2, β 5,2 + β 5,4, β 5,3, β 5,3 + β 5,4, and economic indexes for being given a certain amount of responsibility and discretion work4) β 5,2 β 5,2 + β 5,4 β 5,3 β 5,3 + β 5,4 9

10 Figure S4.5 : β 6,2, β 6,2 + β 6,4, β 6,3, β 6,3 + β 6,4, and economic indexes for wage and working conditions enough to run a household work5) β 6,2 β 6,2 + β 6,4 β 6,3 β 6,3 + β 6,4 10

11 Figure S4.6 : β 7,2, β 7,2 + β 7,4, β 7,3, β 7,3 + β 7,4, and economic indexes for adequate and satisfactory wage and working conditions, work6) β 7,2 β 7,2 + β 7,4 β 7,3 β 7,3 + β 7,4 11

12 Figure S4.7 : β 8,2, β 8,2 + β 8,4, β 8,3, β 8,3 + β 8,4, and economic indexes for feeling no excessive mental stress, work7) β 8,2 β 8,2 + β 8,4 β 8,3 β 8,3 + β 8,4 12

13 Figure S4.8 : β 9,2, β 9,2 + β 9,4, β 9,3, β 9,3 + β 9,4, and economic indexes for having good personal relationships in the workplace work8) β 9,2 β 9,2 + β 9,4 β 9,3 β 9,3 + β 9,4 13

14 Figure S4.9 : β 10,2, β 10,2 + β 10,4, β 10,3, β 10,3 + β 10,4, and economic indexes for work-life balance work9) β 10,2 β 10,2 + β 10,4 β 10,3 β 10,3 + β 10,4 References Chen M.-H. and Dey D. K. 2000) Bayesian analysis for correlated ordinal data models, In Dey D. K., Ghosh S. K. and Mallick B. K. Eds.), Generalized Linear Models: A Bayesian Perspective, New York: Marcel Dekker:

15 Chib S. and Greenberg E. 1998) Biometrika 852): Analysis of multivariate probit models, Hasegawa H. 2013) On polychoric and polyserial partial correlation coefficients: A Bayesian approach, Metron 712):

Latent Variable Models for Binary Data. Suppose that for a given vector of explanatory variables x, the latent

Latent Variable Models for Binary Data. Suppose that for a given vector of explanatory variables x, the latent Latent Variable Models for Binary Data Suppose that for a given vector of explanatory variables x, the latent variable, U, has a continuous cumulative distribution function F (u; x) and that the binary

More information

A Fully Nonparametric Modeling Approach to. BNP Binary Regression

A Fully Nonparametric Modeling Approach to. BNP Binary Regression A Fully Nonparametric Modeling Approach to Binary Regression Maria Department of Applied Mathematics and Statistics University of California, Santa Cruz SBIES, April 27-28, 2012 Outline 1 2 3 Simulation

More information

A Nonparametric Bayesian Model for Multivariate Ordinal Data

A Nonparametric Bayesian Model for Multivariate Ordinal Data A Nonparametric Bayesian Model for Multivariate Ordinal Data Athanasios Kottas, University of California at Santa Cruz Peter Müller, The University of Texas M. D. Anderson Cancer Center Fernando A. Quintana,

More information

Bayesian Multivariate Logistic Regression

Bayesian Multivariate Logistic Regression Bayesian Multivariate Logistic Regression Sean M. O Brien and David B. Dunson Biostatistics Branch National Institute of Environmental Health Sciences Research Triangle Park, NC 1 Goals Brief review of

More information

November 2002 STA Random Effects Selection in Linear Mixed Models

November 2002 STA Random Effects Selection in Linear Mixed Models November 2002 STA216 1 Random Effects Selection in Linear Mixed Models November 2002 STA216 2 Introduction It is common practice in many applications to collect multiple measurements on a subject. Linear

More information

Gibbs Sampling in Latent Variable Models #1

Gibbs Sampling in Latent Variable Models #1 Gibbs Sampling in Latent Variable Models #1 Econ 690 Purdue University Outline 1 Data augmentation 2 Probit Model Probit Application A Panel Probit Panel Probit 3 The Tobit Model Example: Female Labor

More information

STA 216, GLM, Lecture 16. October 29, 2007

STA 216, GLM, Lecture 16. October 29, 2007 STA 216, GLM, Lecture 16 October 29, 2007 Efficient Posterior Computation in Factor Models Underlying Normal Models Generalized Latent Trait Models Formulation Genetic Epidemiology Illustration Structural

More information

Bayesian Inference in GLMs. Frequentists typically base inferences on MLEs, asymptotic confidence

Bayesian Inference in GLMs. Frequentists typically base inferences on MLEs, asymptotic confidence Bayesian Inference in GLMs Frequentists typically base inferences on MLEs, asymptotic confidence limits, and log-likelihood ratio tests Bayesians base inferences on the posterior distribution of the unknowns

More information

variability of the model, represented by σ 2 and not accounted for by Xβ

variability of the model, represented by σ 2 and not accounted for by Xβ Posterior Predictive Distribution Suppose we have observed a new set of explanatory variables X and we want to predict the outcomes ỹ using the regression model. Components of uncertainty in p(ỹ y) variability

More information

The joint posterior distribution of the unknown parameters and hidden variables, given the

The joint posterior distribution of the unknown parameters and hidden variables, given the DERIVATIONS OF THE FULLY CONDITIONAL POSTERIOR DENSITIES The joint posterior distribution of the unknown parameters and hidden variables, given the data, is proportional to the product of the joint prior

More information

Bayes methods for categorical data. April 25, 2017

Bayes methods for categorical data. April 25, 2017 Bayes methods for categorical data April 25, 2017 Motivation for joint probability models Increasing interest in high-dimensional data in broad applications Focus may be on prediction, variable selection,

More information

AMS-207: Bayesian Statistics

AMS-207: Bayesian Statistics Linear Regression How does a quantity y, vary as a function of another quantity, or vector of quantities x? We are interested in p(y θ, x) under a model in which n observations (x i, y i ) are exchangeable.

More information

Motivation Scale Mixutres of Normals Finite Gaussian Mixtures Skew-Normal Models. Mixture Models. Econ 690. Purdue University

Motivation Scale Mixutres of Normals Finite Gaussian Mixtures Skew-Normal Models. Mixture Models. Econ 690. Purdue University Econ 690 Purdue University In virtually all of the previous lectures, our models have made use of normality assumptions. From a computational point of view, the reason for this assumption is clear: combined

More information

Marginal Specifications and a Gaussian Copula Estimation

Marginal Specifications and a Gaussian Copula Estimation Marginal Specifications and a Gaussian Copula Estimation Kazim Azam Abstract Multivariate analysis involving random variables of different type like count, continuous or mixture of both is frequently required

More information

Bayesian Linear Regression

Bayesian Linear Regression Bayesian Linear Regression Sudipto Banerjee 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. September 15, 2010 1 Linear regression models: a Bayesian perspective

More information

Gibbs Sampling for the Probit Regression Model with Gaussian Markov Random Field Latent Variables

Gibbs Sampling for the Probit Regression Model with Gaussian Markov Random Field Latent Variables Gibbs Sampling for the Probit Regression Model with Gaussian Markov Random Field Latent Variables Mohammad Emtiyaz Khan Department of Computer Science University of British Columbia May 8, 27 Abstract

More information

Bayesian Linear Models

Bayesian Linear Models Bayesian Linear Models Sudipto Banerjee September 03 05, 2017 Department of Biostatistics, Fielding School of Public Health, University of California, Los Angeles Linear Regression Linear regression is,

More information

The linear model is the most fundamental of all serious statistical models encompassing:

The linear model is the most fundamental of all serious statistical models encompassing: Linear Regression Models: A Bayesian perspective Ingredients of a linear model include an n 1 response vector y = (y 1,..., y n ) T and an n p design matrix (e.g. including regressors) X = [x 1,..., x

More information

Gibbs Sampling in Endogenous Variables Models

Gibbs Sampling in Endogenous Variables Models Gibbs Sampling in Endogenous Variables Models Econ 690 Purdue University Outline 1 Motivation 2 Identification Issues 3 Posterior Simulation #1 4 Posterior Simulation #2 Motivation In this lecture we take

More information

Bayesian Inference in the Multivariate Probit Model

Bayesian Inference in the Multivariate Probit Model Bayesian Inference in the Multivariate Probit Model Estimation of the Correlation Matrix by Aline Tabet A THESIS SUBMITTED IN PARTIAL FULFILMENT OF THE REQUIREMENTS FOR THE DEGREE OF Master of Science

More information

A Bayesian Treatment of Linear Gaussian Regression

A Bayesian Treatment of Linear Gaussian Regression A Bayesian Treatment of Linear Gaussian Regression Frank Wood December 3, 2009 Bayesian Approach to Classical Linear Regression In classical linear regression we have the following model y β, σ 2, X N(Xβ,

More information

Nonparametric Bayesian Modeling for Multivariate Ordinal. Data

Nonparametric Bayesian Modeling for Multivariate Ordinal. Data Nonparametric Bayesian Modeling for Multivariate Ordinal Data Athanasios Kottas, Peter Müller and Fernando Quintana Abstract We propose a probability model for k-dimensional ordinal outcomes, i.e., we

More information

Bayesian linear regression

Bayesian linear regression Bayesian linear regression Linear regression is the basis of most statistical modeling. The model is Y i = X T i β + ε i, where Y i is the continuous response X i = (X i1,..., X ip ) T is the corresponding

More information

Online Appendix to: Marijuana on Main Street? Estimating Demand in Markets with Limited Access

Online Appendix to: Marijuana on Main Street? Estimating Demand in Markets with Limited Access Online Appendix to: Marijuana on Main Street? Estating Demand in Markets with Lited Access By Liana Jacobi and Michelle Sovinsky This appendix provides details on the estation methodology for various speci

More information

Bayesian (conditionally) conjugate inference for discrete data models. Jon Forster (University of Southampton)

Bayesian (conditionally) conjugate inference for discrete data models. Jon Forster (University of Southampton) Bayesian (conditionally) conjugate inference for discrete data models Jon Forster (University of Southampton) with Mark Grigsby (Procter and Gamble?) Emily Webb (Institute of Cancer Research) Table 1:

More information

MULTILEVEL IMPUTATION 1

MULTILEVEL IMPUTATION 1 MULTILEVEL IMPUTATION 1 Supplement B: MCMC Sampling Steps and Distributions for Two-Level Imputation This document gives technical details of the full conditional distributions used to draw regression

More information

Default Priors and Effcient Posterior Computation in Bayesian

Default Priors and Effcient Posterior Computation in Bayesian Default Priors and Effcient Posterior Computation in Bayesian Factor Analysis January 16, 2010 Presented by Eric Wang, Duke University Background and Motivation A Brief Review of Parameter Expansion Literature

More information

Limited Dependent Variables and Panel Data

Limited Dependent Variables and Panel Data and Panel Data June 24 th, 2009 Structure 1 2 Many economic questions involve the explanation of binary variables, e.g.: explaining the participation of women in the labor market explaining retirement

More information

Nonparametric Bayesian modeling for dynamic ordinal regression relationships

Nonparametric Bayesian modeling for dynamic ordinal regression relationships Nonparametric Bayesian modeling for dynamic ordinal regression relationships Athanasios Kottas Department of Applied Mathematics and Statistics, University of California, Santa Cruz Joint work with Maria

More information

Accounting for Complex Sample Designs via Mixture Models

Accounting for Complex Sample Designs via Mixture Models Accounting for Complex Sample Designs via Finite Normal Mixture Models 1 1 University of Michigan School of Public Health August 2009 Talk Outline 1 2 Accommodating Sampling Weights in Mixture Models 3

More information

Research Article Power Prior Elicitation in Bayesian Quantile Regression

Research Article Power Prior Elicitation in Bayesian Quantile Regression Hindawi Publishing Corporation Journal of Probability and Statistics Volume 11, Article ID 87497, 16 pages doi:1.1155/11/87497 Research Article Power Prior Elicitation in Bayesian Quantile Regression Rahim

More information

Lecture 5: Spatial probit models. James P. LeSage University of Toledo Department of Economics Toledo, OH

Lecture 5: Spatial probit models. James P. LeSage University of Toledo Department of Economics Toledo, OH Lecture 5: Spatial probit models James P. LeSage University of Toledo Department of Economics Toledo, OH 43606 jlesage@spatial-econometrics.com March 2004 1 A Bayesian spatial probit model with individual

More information

Variable Selection for Multivariate Logistic Regression Models

Variable Selection for Multivariate Logistic Regression Models Variable Selection for Multivariate Logistic Regression Models Ming-Hui Chen and Dipak K. Dey Journal of Statistical Planning and Inference, 111, 37-55 Abstract In this paper, we use multivariate logistic

More information

Gibbs Sampling in Linear Models #2

Gibbs Sampling in Linear Models #2 Gibbs Sampling in Linear Models #2 Econ 690 Purdue University Outline 1 Linear Regression Model with a Changepoint Example with Temperature Data 2 The Seemingly Unrelated Regressions Model 3 Gibbs sampling

More information

Bayesian Linear Models

Bayesian Linear Models Bayesian Linear Models Sudipto Banerjee 1 and Andrew O. Finley 2 1 Department of Forestry & Department of Geography, Michigan State University, Lansing Michigan, U.S.A. 2 Biostatistics, School of Public

More information

Gibbs Sampling in Linear Models #1

Gibbs Sampling in Linear Models #1 Gibbs Sampling in Linear Models #1 Econ 690 Purdue University Justin L Tobias Gibbs Sampling #1 Outline 1 Conditional Posterior Distributions for Regression Parameters in the Linear Model [Lindley and

More information

Bayesian Nonparametric Modeling for Multivariate Ordinal Regression

Bayesian Nonparametric Modeling for Multivariate Ordinal Regression Bayesian Nonparametric Modeling for Multivariate Ordinal Regression arxiv:1408.1027v3 [stat.me] 20 Sep 2016 Maria DeYoreo Department of Statistical Science, Duke University and Athanasios Kottas Department

More information

Bayesian Linear Models

Bayesian Linear Models Bayesian Linear Models Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry & Department

More information

A Bayesian Mixture Model with Application to Typhoon Rainfall Predictions in Taipei, Taiwan 1

A Bayesian Mixture Model with Application to Typhoon Rainfall Predictions in Taipei, Taiwan 1 Int. J. Contemp. Math. Sci., Vol. 2, 2007, no. 13, 639-648 A Bayesian Mixture Model with Application to Typhoon Rainfall Predictions in Taipei, Taiwan 1 Tsai-Hung Fan Graduate Institute of Statistics National

More information

On Bayesian Computation

On Bayesian Computation On Bayesian Computation Michael I. Jordan with Elaine Angelino, Maxim Rabinovich, Martin Wainwright and Yun Yang Previous Work: Information Constraints on Inference Minimize the minimax risk under constraints

More information

Fixed and random effects selection in linear and logistic models

Fixed and random effects selection in linear and logistic models Fixed and random effects selection in linear and logistic models Satkartar K. Kinney Institute of Statistics and Decision Sciences, Duke University, Box 9051, Durham, North Carolina 7705, U.S.A. email:

More information

Bayesian Nonparametric Regression for Diabetes Deaths

Bayesian Nonparametric Regression for Diabetes Deaths Bayesian Nonparametric Regression for Diabetes Deaths Brian M. Hartman PhD Student, 2010 Texas A&M University College Station, TX, USA David B. Dahl Assistant Professor Texas A&M University College Station,

More information

Fixed and Random Effects Selection in Linear and Logistic Models

Fixed and Random Effects Selection in Linear and Logistic Models Biometrics 63, 690 698 September 2007 DOI: 10.1111/j.1541-0420.2007.00771.x Fixed and Random Effects Selection in Linear and Logistic Models Satkartar K. Kinney Institute of Statistics and Decision Sciences,

More information

Cross-sectional space-time modeling using ARNN(p, n) processes

Cross-sectional space-time modeling using ARNN(p, n) processes Cross-sectional space-time modeling using ARNN(p, n) processes W. Polasek K. Kakamu September, 006 Abstract We suggest a new class of cross-sectional space-time models based on local AR models and nearest

More information

Katsuhiro Sugita Faculty of Law and Letters, University of the Ryukyus. Abstract

Katsuhiro Sugita Faculty of Law and Letters, University of the Ryukyus. Abstract Bayesian analysis of a vector autoregressive model with multiple structural breaks Katsuhiro Sugita Faculty of Law and Letters, University of the Ryukyus Abstract This paper develops a Bayesian approach

More information

Nonparametric Bayesian Modeling for Multivariate Ordinal. Data

Nonparametric Bayesian Modeling for Multivariate Ordinal. Data Nonparametric Bayesian Modeling for Multivariate Ordinal Data Athanasios Kottas, Peter Müller and Fernando Quintana August 18, 2004 Abstract We propose a probability model for k-dimensional ordinal outcomes,

More information

The Wishart distribution Scaled Wishart. Wishart Priors. Patrick Breheny. March 28. Patrick Breheny BST 701: Bayesian Modeling in Biostatistics 1/11

The Wishart distribution Scaled Wishart. Wishart Priors. Patrick Breheny. March 28. Patrick Breheny BST 701: Bayesian Modeling in Biostatistics 1/11 Wishart Priors Patrick Breheny March 28 Patrick Breheny BST 701: Bayesian Modeling in Biostatistics 1/11 Introduction When more than two coefficients vary, it becomes difficult to directly model each element

More information

Multivariate Normal & Wishart

Multivariate Normal & Wishart Multivariate Normal & Wishart Hoff Chapter 7 October 21, 2010 Reading Comprehesion Example Twenty-two children are given a reading comprehsion test before and after receiving a particular instruction method.

More information

Bayesian Multicategory Support Vector Machines

Bayesian Multicategory Support Vector Machines Bayesian Multicategory Support Vector Machines Zhihua Zhang Electrical and Computer Engineering University of California Santa Barbara CA 93106 Michael I. Jordan Computer Science and Statistics University

More information

Dynamic Generalized Linear Models

Dynamic Generalized Linear Models Dynamic Generalized Linear Models Jesse Windle Oct. 24, 2012 Contents 1 Introduction 1 2 Binary Data (Static Case) 2 3 Data Augmentation (de-marginalization) by 4 examples 3 3.1 Example 1: CDF method.............................

More information

A model of skew item response theory

A model of skew item response theory 1 A model of skew item response theory Jorge Luis Bazán, Heleno Bolfarine, Marcia D Ellia Branco Department of Statistics University of So Paulo Brazil ISBA 2004 May 23-27, Via del Mar, Chile 2 Motivation

More information

Online appendix to On the stability of the excess sensitivity of aggregate consumption growth in the US

Online appendix to On the stability of the excess sensitivity of aggregate consumption growth in the US Online appendix to On the stability of the excess sensitivity of aggregate consumption growth in the US Gerdie Everaert 1, Lorenzo Pozzi 2, and Ruben Schoonackers 3 1 Ghent University & SHERPPA 2 Erasmus

More information

Scaling Neighbourhood Methods

Scaling Neighbourhood Methods Quick Recap Scaling Neighbourhood Methods Collaborative Filtering m = #items n = #users Complexity : m * m * n Comparative Scale of Signals ~50 M users ~25 M items Explicit Ratings ~ O(1M) (1 per billion)

More information

A Bayesian Probit Model with Spatial Dependencies

A Bayesian Probit Model with Spatial Dependencies A Bayesian Probit Model with Spatial Dependencies Tony E. Smith Department of Systems Engineering University of Pennsylvania Philadephia, PA 19104 email: tesmith@ssc.upenn.edu James P. LeSage Department

More information

Foundations of Statistical Inference

Foundations of Statistical Inference Foundations of Statistical Inference Julien Berestycki Department of Statistics University of Oxford MT 2015 Julien Berestycki (University of Oxford) SB2a MT 2015 1 / 16 Lecture 16 : Bayesian analysis

More information

Part 6: Multivariate Normal and Linear Models

Part 6: Multivariate Normal and Linear Models Part 6: Multivariate Normal and Linear Models 1 Multiple measurements Up until now all of our statistical models have been univariate models models for a single measurement on each member of a sample of

More information

Estimation of Sample Selection Models With Two Selection Mechanisms

Estimation of Sample Selection Models With Two Selection Mechanisms University of California Transportation Center UCTC-FR-2010-06 (identical to UCTC-2010-06) Estimation of Sample Selection Models With Two Selection Mechanisms Philip Li University of California, Irvine

More information

Default Priors and Efficient Posterior Computation in Bayesian Factor Analysis

Default Priors and Efficient Posterior Computation in Bayesian Factor Analysis Default Priors and Efficient Posterior Computation in Bayesian Factor Analysis Joyee Ghosh Institute of Statistics and Decision Sciences, Duke University Box 90251, Durham, NC 27708 joyee@stat.duke.edu

More information

VCMC: Variational Consensus Monte Carlo

VCMC: Variational Consensus Monte Carlo VCMC: Variational Consensus Monte Carlo Maxim Rabinovich, Elaine Angelino, Michael I. Jordan Berkeley Vision and Learning Center September 22, 2015 probabilistic models! sky fog bridge water grass object

More information

Data Augmentation for the Bayesian Analysis of Multinomial Logit Models

Data Augmentation for the Bayesian Analysis of Multinomial Logit Models Data Augmentation for the Bayesian Analysis of Multinomial Logit Models Steven L. Scott, University of Southern California Bridge Hall 401-H, Los Angeles, CA 90089-1421 (sls@usc.edu) Key Words: Markov

More information

Sparse Factor-Analytic Probit Models

Sparse Factor-Analytic Probit Models Sparse Factor-Analytic Probit Models By JAMES G. SCOTT Department of Statistical Science, Duke University, Durham, North Carolina 27708-0251, U.S.A. james@stat.duke.edu PAUL R. HAHN Department of Statistical

More information

Timevarying VARs. Wouter J. Den Haan London School of Economics. c Wouter J. Den Haan

Timevarying VARs. Wouter J. Den Haan London School of Economics. c Wouter J. Den Haan Timevarying VARs Wouter J. Den Haan London School of Economics c Wouter J. Den Haan Time-Varying VARs Gibbs-Sampler general idea probit regression application (Inverted Wishart distribution Drawing from

More information

Female Wage Careers - A Bayesian Analysis Using Markov Chain Clustering

Female Wage Careers - A Bayesian Analysis Using Markov Chain Clustering Statistiktage Graz, September 7 9, Female Wage Careers - A Bayesian Analysis Using Markov Chain Clustering Regina Tüchler, Wirtschaftskammer Österreich Christoph Pamminger, The Austrian Center for Labor

More information

Research Division Federal Reserve Bank of St. Louis Working Paper Series

Research Division Federal Reserve Bank of St. Louis Working Paper Series Research Division Federal Reserve Bank of St Louis Working Paper Series Kalman Filtering with Truncated Normal State Variables for Bayesian Estimation of Macroeconomic Models Michael Dueker Working Paper

More information

An Introduction to Bayesian Linear Regression

An Introduction to Bayesian Linear Regression An Introduction to Bayesian Linear Regression APPM 5720: Bayesian Computation Fall 2018 A SIMPLE LINEAR MODEL Suppose that we observe explanatory variables x 1, x 2,..., x n and dependent variables y 1,

More information

Efficient Bayesian Multivariate Surface Regression

Efficient Bayesian Multivariate Surface Regression Efficient Bayesian Multivariate Surface Regression Feng Li feng.li@cufe.edu.cn School of Statistics and Mathematics Central University of Finance and Economics Outline of the talk 1 Introduction to flexible

More information

Hierarchical Modeling for Spatial Data

Hierarchical Modeling for Spatial Data Bayesian Spatial Modelling Spatial model specifications: P(y X, θ). Prior specifications: P(θ). Posterior inference of model parameters: P(θ y). Predictions at new locations: P(y 0 y). Model comparisons.

More information

University of Groningen. The multilevel p2 model Zijlstra, B.J.H.; van Duijn, Maria; Snijders, Thomas. Published in: Methodology

University of Groningen. The multilevel p2 model Zijlstra, B.J.H.; van Duijn, Maria; Snijders, Thomas. Published in: Methodology University of Groningen The multilevel p2 model Zijlstra, B.J.H.; van Duijn, Maria; Snijders, Thomas Published in: Methodology IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's

More information

Separable covariance arrays via the Tucker product - Final

Separable covariance arrays via the Tucker product - Final Separable covariance arrays via the Tucker product - Final by P. Hoff Kean Ming Tan June 4, 2013 1 / 28 International Trade Data set Yearly change in log trade value (in 2000 dollars): Y = {y i,j,k,t }

More information

Introduction to Machine Learning

Introduction to Machine Learning Outline Introduction to Machine Learning Bayesian Classification Varun Chandola March 8, 017 1. {circular,large,light,smooth,thick}, malignant. {circular,large,light,irregular,thick}, malignant 3. {oval,large,dark,smooth,thin},

More information

Riemann Manifold Methods in Bayesian Statistics

Riemann Manifold Methods in Bayesian Statistics Ricardo Ehlers ehlers@icmc.usp.br Applied Maths and Stats University of São Paulo, Brazil Working Group in Statistical Learning University College Dublin September 2015 Bayesian inference is based on Bayes

More information

Large-scale Ordinal Collaborative Filtering

Large-scale Ordinal Collaborative Filtering Large-scale Ordinal Collaborative Filtering Ulrich Paquet, Blaise Thomson, and Ole Winther Microsoft Research Cambridge, University of Cambridge, Technical University of Denmark ulripa@microsoft.com,brmt2@cam.ac.uk,owi@imm.dtu.dk

More information

Econometrics Lecture 5: Limited Dependent Variable Models: Logit and Probit

Econometrics Lecture 5: Limited Dependent Variable Models: Logit and Probit Econometrics Lecture 5: Limited Dependent Variable Models: Logit and Probit R. G. Pierse 1 Introduction In lecture 5 of last semester s course, we looked at the reasons for including dichotomous variables

More information

Hierarchical Linear Models. Hierarchical Linear Models. Much of this material already seen in Chapters 5 and 14. Hyperprior on K parameters α:

Hierarchical Linear Models. Hierarchical Linear Models. Much of this material already seen in Chapters 5 and 14. Hyperprior on K parameters α: Hierarchical Linear Models Hierarchical Linear Models Much of this material already seen in Chapters 5 and 14 Hierarchical linear models combine regression framework with hierarchical framework Unified

More information

Bayesian spatial hierarchical modeling for temperature extremes

Bayesian spatial hierarchical modeling for temperature extremes Bayesian spatial hierarchical modeling for temperature extremes Indriati Bisono Dr. Andrew Robinson Dr. Aloke Phatak Mathematics and Statistics Department The University of Melbourne Maths, Informatics

More information

LINEAR MODELS FOR CLASSIFICATION. J. Elder CSE 6390/PSYC 6225 Computational Modeling of Visual Perception

LINEAR MODELS FOR CLASSIFICATION. J. Elder CSE 6390/PSYC 6225 Computational Modeling of Visual Perception LINEAR MODELS FOR CLASSIFICATION Classification: Problem Statement 2 In regression, we are modeling the relationship between a continuous input variable x and a continuous target variable t. In classification,

More information

Use of Bayesian multivariate prediction models to optimize chromatographic methods

Use of Bayesian multivariate prediction models to optimize chromatographic methods Use of Bayesian multivariate prediction models to optimize chromatographic methods UCB Pharma! Braine lʼalleud (Belgium)! May 2010 Pierre Lebrun, ULg & Arlenda Bruno Boulanger, ULg & Arlenda Philippe Lambert,

More information

Multivariate Versus Multinomial Probit: When are Binary Decisions Made Separately also Jointly Optimal?

Multivariate Versus Multinomial Probit: When are Binary Decisions Made Separately also Jointly Optimal? Multivariate Versus Multinomial Probit: When are Binary Decisions Made Separately also Jointly Optimal? Dale J. Poirier and Deven Kapadia University of California, Irvine March 10, 2012 Abstract We provide

More information

Stat 535 C - Statistical Computing & Monte Carlo Methods. Arnaud Doucet.

Stat 535 C - Statistical Computing & Monte Carlo Methods. Arnaud Doucet. Stat 535 C - Statistical Computing & Monte Carlo Methods Arnaud Doucet Email: arnaud@cs.ubc.ca 1 1.1 Outline Introduction to Markov chain Monte Carlo The Gibbs Sampler Examples Overview of the Lecture

More information

A note on Reversible Jump Markov Chain Monte Carlo

A note on Reversible Jump Markov Chain Monte Carlo A note on Reversible Jump Markov Chain Monte Carlo Hedibert Freitas Lopes Graduate School of Business The University of Chicago 5807 South Woodlawn Avenue Chicago, Illinois 60637 February, 1st 2006 1 Introduction

More information

Outline. Clustering. Capturing Unobserved Heterogeneity in the Austrian Labor Market Using Finite Mixtures of Markov Chain Models

Outline. Clustering. Capturing Unobserved Heterogeneity in the Austrian Labor Market Using Finite Mixtures of Markov Chain Models Capturing Unobserved Heterogeneity in the Austrian Labor Market Using Finite Mixtures of Markov Chain Models Collaboration with Rudolf Winter-Ebmer, Department of Economics, Johannes Kepler University

More information

Essays on selection in health survey data

Essays on selection in health survey data University of Iowa Iowa Research Online Theses and Dissertations Spring 2010 Essays on selection in health survey data Maksym Obrizan University of Iowa Copyright 2010 Maksym Obrizan This dissertation

More information

Bayesian model selection in graphs by using BDgraph package

Bayesian model selection in graphs by using BDgraph package Bayesian model selection in graphs by using BDgraph package A. Mohammadi and E. Wit March 26, 2013 MOTIVATION Flow cytometry data with 11 proteins from Sachs et al. (2005) RESULT FOR CELL SIGNALING DATA

More information

Estimating the Correlation in Bivariate Normal Data with Known Variances and Small Sample Sizes 1

Estimating the Correlation in Bivariate Normal Data with Known Variances and Small Sample Sizes 1 Estimating the Correlation in Bivariate Normal Data with Known Variances and Small Sample Sizes 1 Bailey K. Fosdick and Adrian E. Raftery Department of Statistics University of Washington Technical Report

More information

Bayesian Inference for the Multivariate Normal

Bayesian Inference for the Multivariate Normal Bayesian Inference for the Multivariate Normal Will Penny Wellcome Trust Centre for Neuroimaging, University College, London WC1N 3BG, UK. November 28, 2014 Abstract Bayesian inference for the multivariate

More information

A BAYESIAN APPROACH TO SPATIAL CORRELATIONS IN THE MULTIVARIATE PROBIT MODEL

A BAYESIAN APPROACH TO SPATIAL CORRELATIONS IN THE MULTIVARIATE PROBIT MODEL A BAYESIAN APPROACH TO SPATIAL CORRELATIONS IN THE MULTIVARIATE PROBIT MODEL by Jervyn Ang B.Sc, Simon Fraser University, 2008 a Project submitted in partial fulfillment of the requirements for the degree

More information

Multivariate beta regression with application to small area estimation

Multivariate beta regression with application to small area estimation Multivariate beta regression with application to small area estimation Debora Ferreira de Souza debora@dme.ufrj.br Fernando Antônio da Silva Moura fmoura@im.ufrj.br Departamento de Métodos Estatísticos

More information

Linear Regression (9/11/13)

Linear Regression (9/11/13) STA561: Probabilistic machine learning Linear Regression (9/11/13) Lecturer: Barbara Engelhardt Scribes: Zachary Abzug, Mike Gloudemans, Zhuosheng Gu, Zhao Song 1 Why use linear regression? Figure 1: Scatter

More information

Index. Pagenumbersfollowedbyf indicate figures; pagenumbersfollowedbyt indicate tables.

Index. Pagenumbersfollowedbyf indicate figures; pagenumbersfollowedbyt indicate tables. Index Pagenumbersfollowedbyf indicate figures; pagenumbersfollowedbyt indicate tables. Adaptive rejection metropolis sampling (ARMS), 98 Adaptive shrinkage, 132 Advanced Photo System (APS), 255 Aggregation

More information

Lecture 16 : Bayesian analysis of contingency tables. Bayesian linear regression. Jonathan Marchini (University of Oxford) BS2a MT / 15

Lecture 16 : Bayesian analysis of contingency tables. Bayesian linear regression. Jonathan Marchini (University of Oxford) BS2a MT / 15 Lecture 16 : Bayesian analysis of contingency tables. Bayesian linear regression. Jonathan Marchini (University of Oxford) BS2a MT 2013 1 / 15 Contingency table analysis North Carolina State University

More information

Review of Multinomial Distribution If n trials are performed: in each trial there are J > 2 possible outcomes (categories) Multicategory Logit Models

Review of Multinomial Distribution If n trials are performed: in each trial there are J > 2 possible outcomes (categories) Multicategory Logit Models Chapter 6 Multicategory Logit Models Response Y has J > 2 categories. Extensions of logistic regression for nominal and ordinal Y assume a multinomial distribution for Y. 6.1 Logit Models for Nominal Responses

More information

July First version: September Abstract. This paper provides a unied simulation-based Bayesian and non-bayesian analysis

July First version: September Abstract. This paper provides a unied simulation-based Bayesian and non-bayesian analysis Bayesian Analysis of Multivariate Probit Models Siddhartha Chib Edward Greenberg July 996 First version: September 995 Abstract This paper provides a unied simulation-based Bayesian and non-bayesian analysis

More information

Estimation of Semiparametric Models in the Presence of Endogeneity and Sample Selection

Estimation of Semiparametric Models in the Presence of Endogeneity and Sample Selection Estimation of Semiparametric Models in the Presence of Endogeneity and Sample Selection Siddhartha Chib Edward Greenberg Ivan Jeliazkov September 1, 28 Abstract We analyze a semiparametric model for data

More information

Stat 535 C - Statistical Computing & Monte Carlo Methods. Lecture 15-7th March Arnaud Doucet

Stat 535 C - Statistical Computing & Monte Carlo Methods. Lecture 15-7th March Arnaud Doucet Stat 535 C - Statistical Computing & Monte Carlo Methods Lecture 15-7th March 2006 Arnaud Doucet Email: arnaud@cs.ubc.ca 1 1.1 Outline Mixture and composition of kernels. Hybrid algorithms. Examples Overview

More information

Bayesian Hypothesis Testing in GLMs: One-Sided and Ordered Alternatives. 1(w i = h + 1)β h + ɛ i,

Bayesian Hypothesis Testing in GLMs: One-Sided and Ordered Alternatives. 1(w i = h + 1)β h + ɛ i, Bayesian Hypothesis Testing in GLMs: One-Sided and Ordered Alternatives Often interest may focus on comparing a null hypothesis of no difference between groups to an ordered restricted alternative. For

More information

Working Papers in Econometrics and Applied Statistics

Working Papers in Econometrics and Applied Statistics T h e U n i v e r s i t y o f NEW ENGLAND Working Papers in Econometrics and Applied Statistics Finite Sample Inference in the SUR Model Duangkamon Chotikapanich and William E. Griffiths No. 03 - April

More information

Bayes factor testing of equality and order constraints on measures of association in social research

Bayes factor testing of equality and order constraints on measures of association in social research arxiv:1807.05819v1 [stat.me] 16 Jul 2018 Bayes factor testing of equality and order constraints on measures of association in social research Joris Mulder & John P.T.M. Gelissen July 17, 2018 Abstract

More information

Econ Some Bayesian Econometrics

Econ Some Bayesian Econometrics Econ 8208- Some Bayesian Econometrics Patrick Bajari Patrick Bajari () Econ 8208- Some Bayesian Econometrics 1 / 72 Motivation Next we shall begin to discuss Gibbs sampling and Markov Chain Monte Carlo

More information

Standard Errors & Confidence Intervals. N(0, I( β) 1 ), I( β) = [ 2 l(β, φ; y) β i β β= β j

Standard Errors & Confidence Intervals. N(0, I( β) 1 ), I( β) = [ 2 l(β, φ; y) β i β β= β j Standard Errors & Confidence Intervals β β asy N(0, I( β) 1 ), where I( β) = [ 2 l(β, φ; y) ] β i β β= β j We can obtain asymptotic 100(1 α)% confidence intervals for β j using: β j ± Z 1 α/2 se( β j )

More information

x. Figure 1: Examples of univariate Gaussian pdfs N (x; µ, σ 2 ).

x. Figure 1: Examples of univariate Gaussian pdfs N (x; µ, σ 2 ). .8.6 µ =, σ = 1 µ = 1, σ = 1 / µ =, σ =.. 3 1 1 3 x Figure 1: Examples of univariate Gaussian pdfs N (x; µ, σ ). The Gaussian distribution Probably the most-important distribution in all of statistics

More information