Discussion of Robust Bayes Inference for non-identied SVARs", by March Giacomini 2014 and1 Kitagaw / 14

Size: px
Start display at page:

Download "Discussion of Robust Bayes Inference for non-identied SVARs", by March Giacomini 2014 and1 Kitagaw / 14"

Transcription

1 Discussion of Robust Bayes Inference for non-identied SVARs", by Giacomini and Kitagawa Sophocles Mavroeidis 1 1 Oxford University March 2014 Discussion of Robust Bayes Inference for non-identied SVARs", by March Giacomini 2014 and1 Kitagaw / 14

2 Outline My understanding of the paper. What I like about the paper. What I don't like about the paper. Conclusion. Discussion of Robust Bayes Inference for non-identied SVARs", by March Giacomini 2014 and2 Kitagaw / 14

3 The main idea using a simple example Bivariate SVAR(0) Reduced form A 0 Y t = ε t iidn (0, I 2 ). Y t = u t iidn (0, Σ). Under-identication: 3 RF parameters in Σ, call them φ = (σ 1, σ 2, ρ) ; 4 in A 0. Choleski decomposition of Σ = Σ tr Σ 0 tr. Write A 0 = Q 0 Σ 1 tr, where Q = Σ tr is identied, θ is not. cos θ sin θ sin θ cos θ, θ 2 [ π, π]. Discussion of Robust Bayes Inference for non-identied SVARs", by March Giacomini 2014 and3 Kitagaw / 14

4 Inference on IRFs Data is completely uninformative about θ 2 [ π, π]. Impulse responses: IR 0 σ1 0 = Σ tr Q = p cos θ σ 2 ρ σ 2 1 ρ 2 sin θ = σ 2 p 1 σ 1 cos θ ρ 2 sin θ + ρ cos θ sin θ cos θ σ 1 sin θ σ 2 p 1 ρ 2 cos θ ρ sin θ From this we can obtain identied sets (IS) on each IR, e.g., for r = IR 0 [1, 2] = Y 1 / ε 2, we have Nice and convex! (Lemma 1) IS r (φ) = [ σ 1, σ 1 ].! Discussion of Robust Bayes Inference for non-identied SVARs", by March Giacomini 2014 and4 Kitagaw / 14

5 Bayes inference Existing practice (Uhlig, 2005): 1 postulate `agnostic' prior on Q, here θ Uniform[ π, π]. 2 draw φ from its posterior π φjy. 3 keep Q or θ such that sign restrictions at φ hold (here all θ no restrictions) 4 collect posterior draws of Σ tr Q. Is this really `agnostic'? Discussion of Robust Bayes Inference for non-identied SVARs", by March Giacomini 2014 and5 Kitagaw / 14

6 Example Σ 1 iw (Σ 0, T ), Σ 0 = , T = 100. Q uniform on O (2). IR[11] IR[12] IR[21] IR[22] Discussion of Robust Bayes Inference for non-identied SVARs", by March Giacomini 2014 and6 Kitagaw / 14

7 Example Σ 1 iw (Σ 0, T ), Σ 0 = , T = 100. q 11 uniform on [ 1, 1]. 0.5 IR[11] IR[12] IR[21] IR[22] Discussion of Robust Bayes Inference for non-identied SVARs", by March Giacomini 2014 and7 Kitagaw / 14

8 Example with sign restriction IR[11]>=0 Q uniform on O (2). 1.5 IR[11] 0.75 IR[12] IR[21] IR[22] Pr [IR > 0jY ] = Discussion of Robust Bayes Inference for non-identied SVARs", by March Giacomini 2014 and8 Kitagaw / 14

9 Example with sign restriction IR[11]>=0 q 11 uniform on [ 1, 1] IR[11] IR[12] IR[21] IR[22] Pr [IR > 0jY ] = Discussion of Robust Bayes Inference for non-identied SVARs", by March Giacomini 2014 and9 Kitagaw / 14

10 Truly agnostic (in my opinion) Bayes inference The Giacomini-Kitagawa way: 1 Obtain posterior of φ, π φjy. (this is all we can ever hope to learn from the data). 2 Consider all possible priors on Q such that the restrictions hold Π Qjφ (here all distributions π θ supported on [ π, π] with sign restriction support is π 2, π 2 ). 3 Derive bounds for the (posterior) probability of any event of interest. 4 Derive agnostic credible sets for any parameter of interest. In our example, GK produce Pr [IR 12 > 0jY ] 2 [0, 1] and Pr [IR 21 > 0jY ] 2 [0, 1] quite sensibly, in my opinion. Discussion of Robust Bayes Inference for non-identied SVARs", March by Giacomini 2014 and10 Kitagaw / 14

11 Robust evaluation of restrictions If you want to know whether the restrictions are consistent with the data, use this: Pr (identied set is nonempty). With sign restrictions S (φ, Q) 0, this is Pr max S (φ, Q) 0. Q This only depends on π φjy, which is the only thing we can learn from the likelihood/data..... unlike Pr (S (φ, Q) 0) which depends on the prior on Q. Discussion of Robust Bayes Inference for non-identied SVARs", March by Giacomini 2014 and11 Kitagaw / 14

12 What I like about the paper 1 Very neat way of conveying our ignorance about things we can never hope to learn from the data! 2 Lemma 1 (convexity of identied sets) is very useful in practice (though not essential for point 1). 3 Intuitive way of checking the consistency of sign restrictions with data robust to prior! 4 Clear algorithm for implementing the procedure. 5 Real life examples that show how it works in practice. Discussion of Robust Bayes Inference for non-identied SVARs", March by Giacomini 2014 and12 Kitagaw / 14

13 What I don't like about the paper Not much: Needs some editing. Term under-exactly-identied sounds awkward. Discussion of Robust Bayes Inference for non-identied SVARs", March by Giacomini 2014 and13 Kitagaw / 14

14 Conclusion Fantastic paper! Discussion of Robust Bayes Inference for non-identied SVARs", March by Giacomini 2014 and14 Kitagaw / 14

Shrinkage in Set-Identified SVARs

Shrinkage in Set-Identified SVARs Shrinkage in Set-Identified SVARs Alessio Volpicella (Queen Mary, University of London) 2018 IAAE Annual Conference, Université du Québec à Montréal (UQAM) and Université de Montréal (UdeM) 26-29 June

More information

Robust Bayes Inference for Non-identified SVARs

Robust Bayes Inference for Non-identified SVARs 1/29 Robust Bayes Inference for Non-identified SVARs Raffaella Giacomini (UCL) & Toru Kitagawa (UCL) 27, Dec, 2013 work in progress 2/29 Motivating Example Structural VAR (SVAR) is a useful tool to infer

More information

Estimation under Ambiguity

Estimation under Ambiguity Estimation under Ambiguity R. Giacomini (UCL), T. Kitagawa (UCL), H. Uhlig (Chicago) Giacomini, Kitagawa, Uhlig Ambiguity 1 / 33 Introduction Questions: How to perform posterior analysis (inference/decision)

More information

Robust Bayes Inference for Non-Identified SVARs

Robust Bayes Inference for Non-Identified SVARs Robust Bayes Inference for Non-Identified SVARs Raffaella Giacomini and Toru Kitagawa This draft: March, 2014 Abstract This paper considers a robust Bayes inference for structural vector autoregressions,

More information

Inference Based on SVARs Identified with Sign and Zero Restrictions: Theory and Applications

Inference Based on SVARs Identified with Sign and Zero Restrictions: Theory and Applications Inference Based on SVARs Identified with Sign and Zero Restrictions: Theory and Applications Jonas Arias 1 Juan F. Rubio-Ramírez 2,3 Daniel F. Waggoner 3 1 Federal Reserve Board 2 Duke University 3 Federal

More information

Inference about Non- Identified SVARs

Inference about Non- Identified SVARs Inference about Non- Identified SVARs Raffaella Giacomini Toru Kitagawa The Institute for Fiscal Studies Department of Economics, UCL cemmap working paper CWP45/14 Inference about Non-Identified SVARs

More information

Estimation under Ambiguity (Very preliminary)

Estimation under Ambiguity (Very preliminary) Estimation under Ambiguity (Very preliminary) Ra aella Giacomini, Toru Kitagawa, y and Harald Uhlig z Abstract To perform a Bayesian analysis for a set-identi ed model, two distinct approaches exist; the

More information

On the maximum and minimum response to an impulse in Svars

On the maximum and minimum response to an impulse in Svars On the maximum and minimum response to an impulse in Svars Bulat Gafarov (PSU), Matthias Meier (UBonn), and José-Luis Montiel-Olea (NYU) September 23, 2015 1 / 58 Introduction Structural VAR: Theoretical

More information

Robust inference about partially identified SVARs

Robust inference about partially identified SVARs Robust inference about partially identified SVARs Raffaella Giacomini and Toru Kitagawa This draft: June 2015 Abstract Most empirical applications using partially identified Structural Vector Autoregressions

More information

Estimation under Ambiguity

Estimation under Ambiguity Estimation under Ambiguity Raffaella Giacomini, Toru Kitagawa, and Harald Uhlig This draft: March 2019 Abstract To perform a Bayesian analysis for a set-identified model, two distinct approaches exist;

More information

Identification of Economic Shocks by Inequality Constraints in Bayesian Structural Vector Autoregression

Identification of Economic Shocks by Inequality Constraints in Bayesian Structural Vector Autoregression Identification of Economic Shocks by Inequality Constraints in Bayesian Structural Vector Autoregression Markku Lanne Department of Political and Economic Studies, University of Helsinki Jani Luoto Department

More information

Projection Inference for Set-Identified Svars

Projection Inference for Set-Identified Svars Projection Inference for Set-Identified Svars Bulat Gafarov (PSU), Matthias Meier (University of Bonn), and José-Luis Montiel-Olea (Columbia) September 21, 2016 1 / 38 Introduction: Set-id. SVARs SVAR:

More information

CPSC 540: Machine Learning

CPSC 540: Machine Learning CPSC 540: Machine Learning Undirected Graphical Models Mark Schmidt University of British Columbia Winter 2016 Admin Assignment 3: 2 late days to hand it in today, Thursday is final day. Assignment 4:

More information

Robust Bayesian inference for set-identified models

Robust Bayesian inference for set-identified models Robust Bayesian inference for set-identified models Raffaella Giacomini Toru Kitagawa The Institute for Fiscal Studies Department of Economics, UCL cemmap working paper CWP61/18 Robust Bayesian Inference

More information

Stat260: Bayesian Modeling and Inference Lecture Date: February 10th, Jeffreys priors. exp 1 ) p 2

Stat260: Bayesian Modeling and Inference Lecture Date: February 10th, Jeffreys priors. exp 1 ) p 2 Stat260: Bayesian Modeling and Inference Lecture Date: February 10th, 2010 Jeffreys priors Lecturer: Michael I. Jordan Scribe: Timothy Hunter 1 Priors for the multivariate Gaussian Consider a multivariate

More information

Short Questions (Do two out of three) 15 points each

Short Questions (Do two out of three) 15 points each Econometrics Short Questions Do two out of three) 5 points each ) Let y = Xβ + u and Z be a set of instruments for X When we estimate β with OLS we project y onto the space spanned by X along a path orthogonal

More information

Bayesian Graphical Models for Structural Vector AutoregressiveMarch Processes 21, / 1

Bayesian Graphical Models for Structural Vector AutoregressiveMarch Processes 21, / 1 Bayesian Graphical Models for Structural Vector Autoregressive Processes Daniel Ahelegbey, Monica Billio, and Roberto Cassin (2014) March 21, 2015 Bayesian Graphical Models for Structural Vector AutoregressiveMarch

More information

Uncertain Identification

Uncertain Identification Uncertain Identification Raffaella Giacomini, Toru Kitagawa, and Alessio Volpicella This draft: September 2016 Abstract Uncertainty about the choice of identifying assumptions in causal studies has been

More information

CSC321 Lecture 18: Learning Probabilistic Models

CSC321 Lecture 18: Learning Probabilistic Models CSC321 Lecture 18: Learning Probabilistic Models Roger Grosse Roger Grosse CSC321 Lecture 18: Learning Probabilistic Models 1 / 25 Overview So far in this course: mainly supervised learning Language modeling

More information

Stat 535 C - Statistical Computing & Monte Carlo Methods. Arnaud Doucet.

Stat 535 C - Statistical Computing & Monte Carlo Methods. Arnaud Doucet. Stat 535 C - Statistical Computing & Monte Carlo Methods Arnaud Doucet Email: arnaud@cs.ubc.ca 1 CS students: don t forget to re-register in CS-535D. Even if you just audit this course, please do register.

More information

Correlated Equilibrium in Games with Incomplete Information

Correlated Equilibrium in Games with Incomplete Information Correlated Equilibrium in Games with Incomplete Information Dirk Bergemann and Stephen Morris Econometric Society Summer Meeting June 2012 Robust Predictions Agenda game theoretic predictions are very

More information

(1) Introduction to Bayesian statistics

(1) Introduction to Bayesian statistics Spring, 2018 A motivating example Student 1 will write down a number and then flip a coin If the flip is heads, they will honestly tell student 2 if the number is even or odd If the flip is tails, they

More information

A primer on Structural VARs

A primer on Structural VARs A primer on Structural VARs Claudia Foroni Norges Bank 10 November 2014 Structural VARs 1/ 26 Refresh: what is a VAR? VAR (p) : where y t K 1 y t = ν + B 1 y t 1 +... + B p y t p + u t, (1) = ( y 1t...

More information

6.842 Randomness and Computation March 3, Lecture 8

6.842 Randomness and Computation March 3, Lecture 8 6.84 Randomness and Computation March 3, 04 Lecture 8 Lecturer: Ronitt Rubinfeld Scribe: Daniel Grier Useful Linear Algebra Let v = (v, v,..., v n ) be a non-zero n-dimensional row vector and P an n n

More information

Machine Learning CSE546 Carlos Guestrin University of Washington. September 30, 2013

Machine Learning CSE546 Carlos Guestrin University of Washington. September 30, 2013 Bayesian Methods Machine Learning CSE546 Carlos Guestrin University of Washington September 30, 2013 1 What about prior n Billionaire says: Wait, I know that the thumbtack is close to 50-50. What can you

More information

Uncertain Identification

Uncertain Identification Uncertain Identification Raffaella Giacomini, Toru Kitagawa, and Alessio Volpicella This draft: April 2017 Abstract Uncertainty about the choice of identifying assumptions is common in causal studies,

More information

Some Curiosities Arising in Objective Bayesian Analysis

Some Curiosities Arising in Objective Bayesian Analysis . Some Curiosities Arising in Objective Bayesian Analysis Jim Berger Duke University Statistical and Applied Mathematical Institute Yale University May 15, 2009 1 Three vignettes related to John s work

More information

Uncertain Identification

Uncertain Identification Uncertain Identification Raffaella Giacomini, Toru Kitagawa, and Alessio Volpicella This draft: January 2017 Abstract Uncertainty about the choice of identifying assumptions is common in causal studies,

More information

σ(a) = a N (x; 0, 1 2 ) dx. σ(a) = Φ(a) =

σ(a) = a N (x; 0, 1 2 ) dx. σ(a) = Φ(a) = Until now we have always worked with likelihoods and prior distributions that were conjugate to each other, allowing the computation of the posterior distribution to be done in closed form. Unfortunately,

More information

Part 3 Robust Bayesian statistics & applications in reliability networks

Part 3 Robust Bayesian statistics & applications in reliability networks Tuesday 9:00-12:30 Part 3 Robust Bayesian statistics & applications in reliability networks by Gero Walter 69 Robust Bayesian statistics & applications in reliability networks Outline Robust Bayesian Analysis

More information

Labor-Supply Shifts and Economic Fluctuations. Technical Appendix

Labor-Supply Shifts and Economic Fluctuations. Technical Appendix Labor-Supply Shifts and Economic Fluctuations Technical Appendix Yongsung Chang Department of Economics University of Pennsylvania Frank Schorfheide Department of Economics University of Pennsylvania January

More information

Inference Based on SVARs Identified with Sign and Zero Restrictions: Theory and Applications

Inference Based on SVARs Identified with Sign and Zero Restrictions: Theory and Applications Inference Based on SVARs Identified with Sign and Zero Restrictions: Theory and Applications Jonas E. Arias Federal Reserve Board Juan F. Rubio-Ramírez Duke University, BBVA Research, and Federal Reserve

More information

Chapter 15. Probability Rules! Copyright 2012, 2008, 2005 Pearson Education, Inc.

Chapter 15. Probability Rules! Copyright 2012, 2008, 2005 Pearson Education, Inc. Chapter 15 Probability Rules! Copyright 2012, 2008, 2005 Pearson Education, Inc. The General Addition Rule When two events A and B are disjoint, we can use the addition rule for disjoint events from Chapter

More information

Statistics of Small Signals

Statistics of Small Signals Statistics of Small Signals Gary Feldman Harvard University NEPPSR August 17, 2005 Statistics of Small Signals In 1998, Bob Cousins and I were working on the NOMAD neutrino oscillation experiment and we

More information

Visualizing VAR s: Regularization and Network Tools for High-Dimensional Financial Econometrics

Visualizing VAR s: Regularization and Network Tools for High-Dimensional Financial Econometrics Visualizing VAR s: Regularization and Network Tools for High-Dimensional Financial Econometrics Francis X. Diebold University of Pennsylvania March 7, 2015 1 / 32 DGP: N-Variable VAR(p), t = 1,..., T Φ(L)x

More information

Identification through Heterogeneity

Identification through Heterogeneity Identification through Heterogeneity Pooyan Amir-Ahmadi and Thorsten Drautzburg April, 7 Abstract We analyze set identification in Bayesian vector autoregressions (VARs). Because set identification can

More information

ST 740: Markov Chain Monte Carlo

ST 740: Markov Chain Monte Carlo ST 740: Markov Chain Monte Carlo Alyson Wilson Department of Statistics North Carolina State University October 14, 2012 A. Wilson (NCSU Stsatistics) MCMC October 14, 2012 1 / 20 Convergence Diagnostics:

More information

Dynamic Factor Models, Factor Augmented VARs, and SVARs in Macroeconomics. -- Part 2: SVARs and SDFMs --

Dynamic Factor Models, Factor Augmented VARs, and SVARs in Macroeconomics. -- Part 2: SVARs and SDFMs -- Dynamic Factor Models, Factor Augmented VARs, and SVARs in Macroeconomics -- Part 2: SVARs and SDFMs -- Mark Watson Princeton University Central Bank of Chile October 22-24, 208 Reference: Stock, James

More information

Bayesian inference. Fredrik Ronquist and Peter Beerli. October 3, 2007

Bayesian inference. Fredrik Ronquist and Peter Beerli. October 3, 2007 Bayesian inference Fredrik Ronquist and Peter Beerli October 3, 2007 1 Introduction The last few decades has seen a growing interest in Bayesian inference, an alternative approach to statistical inference.

More information

Mixed Membership Stochastic Blockmodels

Mixed Membership Stochastic Blockmodels Mixed Membership Stochastic Blockmodels Journal of Machine Learning Research, 2008 by E.M. Airoldi, D.M. Blei, S.E. Fienberg, E.P. Xing as interpreted by Ted Westling STAT 572 Final Talk May 8, 2014 Ted

More information

Model Selection for Gaussian Processes

Model Selection for Gaussian Processes Institute for Adaptive and Neural Computation School of Informatics,, UK December 26 Outline GP basics Model selection: covariance functions and parameterizations Criteria for model selection Marginal

More information

Estimation of moment-based models with latent variables

Estimation of moment-based models with latent variables Estimation of moment-based models with latent variables work in progress Ra aella Giacomini and Giuseppe Ragusa UCL/Cemmap and UCI/Luiss UPenn, 5/4/2010 Giacomini and Ragusa (UCL/Cemmap and UCI/Luiss)Moments

More information

Bayes Correlated Equilibrium and Comparing Information Structures

Bayes Correlated Equilibrium and Comparing Information Structures Bayes Correlated Equilibrium and Comparing Information Structures Dirk Bergemann and Stephen Morris Spring 2013: 521 B Introduction game theoretic predictions are very sensitive to "information structure"

More information

Katsuhiro Sugita Faculty of Law and Letters, University of the Ryukyus. Abstract

Katsuhiro Sugita Faculty of Law and Letters, University of the Ryukyus. Abstract Bayesian analysis of a vector autoregressive model with multiple structural breaks Katsuhiro Sugita Faculty of Law and Letters, University of the Ryukyus Abstract This paper develops a Bayesian approach

More information

Machine Learning CSE546 Carlos Guestrin University of Washington. September 30, What about continuous variables?

Machine Learning CSE546 Carlos Guestrin University of Washington. September 30, What about continuous variables? Linear Regression Machine Learning CSE546 Carlos Guestrin University of Washington September 30, 2014 1 What about continuous variables? n Billionaire says: If I am measuring a continuous variable, what

More information

Models of Reputation with Bayesian Updating

Models of Reputation with Bayesian Updating Models of Reputation with Bayesian Updating Jia Chen 1 The Tariff Game (Downs and Rocke 1996) 1.1 Basic Setting Two states, A and B, are setting the tariffs for trade. The basic setting of the game resembles

More information

A Primer on Vector Autoregressions

A Primer on Vector Autoregressions A Primer on Vector Autoregressions Ambrogio Cesa-Bianchi VAR models 1 [DISCLAIMER] These notes are meant to provide intuition on the basic mechanisms of VARs As such, most of the material covered here

More information

What are the Findings?

What are the Findings? What are the Findings? James B. Rawlings Department of Chemical and Biological Engineering University of Wisconsin Madison Madison, Wisconsin April 2010 Rawlings (Wisconsin) Stating the findings 1 / 33

More information

Neutral Bayesian reference models for incidence rates of (rare) clinical events

Neutral Bayesian reference models for incidence rates of (rare) clinical events Neutral Bayesian reference models for incidence rates of (rare) clinical events Jouni Kerman Statistical Methodology, Novartis Pharma AG, Basel BAYES2012, May 10, Aachen Outline Motivation why reference

More information

Pr[X = s Y = t] = Pr[X = s] Pr[Y = t]

Pr[X = s Y = t] = Pr[X = s] Pr[Y = t] Homework 4 By: John Steinberger Problem 1. Recall that a real n n matrix A is positive semidefinite if A is symmetric and x T Ax 0 for all x R n. Assume A is a real n n matrix. Show TFAE 1 : (a) A is positive

More information

Bayesian Learning (II)

Bayesian Learning (II) Universität Potsdam Institut für Informatik Lehrstuhl Maschinelles Lernen Bayesian Learning (II) Niels Landwehr Overview Probabilities, expected values, variance Basic concepts of Bayesian learning MAP

More information

1.2. Structural VARs

1.2. Structural VARs 1. Shocks Nr. 1 1.2. Structural VARs How to identify A 0? A review: Choleski (Cholesky?) decompositions. Short-run restrictions. Inequality restrictions. Long-run restrictions. Then, examples, applications,

More information

Bayesian Inference for DSGE Models. Lawrence J. Christiano

Bayesian Inference for DSGE Models. Lawrence J. Christiano Bayesian Inference for DSGE Models Lawrence J. Christiano Outline State space-observer form. convenient for model estimation and many other things. Bayesian inference Bayes rule. Monte Carlo integation.

More information

A Study into Mechanisms of Attitudinal Scale Conversion: A Randomized Stochastic Ordering Approach

A Study into Mechanisms of Attitudinal Scale Conversion: A Randomized Stochastic Ordering Approach A Study into Mechanisms of Attitudinal Scale Conversion: A Randomized Stochastic Ordering Approach Zvi Gilula (Hebrew University) Robert McCulloch (Arizona State) Ya acov Ritov (University of Michigan)

More information

Approximate Inference

Approximate Inference Approximate Inference Simulation has a name: sampling Sampling is a hot topic in machine learning, and it s really simple Basic idea: Draw N samples from a sampling distribution S Compute an approximate

More information

Parameter Estimation. William H. Jefferys University of Texas at Austin Parameter Estimation 7/26/05 1

Parameter Estimation. William H. Jefferys University of Texas at Austin Parameter Estimation 7/26/05 1 Parameter Estimation William H. Jefferys University of Texas at Austin bill@bayesrules.net Parameter Estimation 7/26/05 1 Elements of Inference Inference problems contain two indispensable elements: Data

More information

CS-E3210 Machine Learning: Basic Principles

CS-E3210 Machine Learning: Basic Principles CS-E3210 Machine Learning: Basic Principles Lecture 4: Regression II slides by Markus Heinonen Department of Computer Science Aalto University, School of Science Autumn (Period I) 2017 1 / 61 Today s introduction

More information

Hypothesis Testing. Econ 690. Purdue University. Justin L. Tobias (Purdue) Testing 1 / 33

Hypothesis Testing. Econ 690. Purdue University. Justin L. Tobias (Purdue) Testing 1 / 33 Hypothesis Testing Econ 690 Purdue University Justin L. Tobias (Purdue) Testing 1 / 33 Outline 1 Basic Testing Framework 2 Testing with HPD intervals 3 Example 4 Savage Dickey Density Ratio 5 Bartlett

More information

Principles of Bayesian Inference

Principles of Bayesian Inference Principles of Bayesian Inference Sudipto Banerjee and Andrew O. Finley 2 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry & Department

More information

An Extended BIC for Model Selection

An Extended BIC for Model Selection An Extended BIC for Model Selection at the JSM meeting 2007 - Salt Lake City Surajit Ray Boston University (Dept of Mathematics and Statistics) Joint work with James Berger, Duke University; Susie Bayarri,

More information

Bayesian Models in Machine Learning

Bayesian Models in Machine Learning Bayesian Models in Machine Learning Lukáš Burget Escuela de Ciencias Informáticas 2017 Buenos Aires, July 24-29 2017 Frequentist vs. Bayesian Frequentist point of view: Probability is the frequency of

More information

Variational Bayesian Logistic Regression

Variational Bayesian Logistic Regression Variational Bayesian Logistic Regression Sargur N. University at Buffalo, State University of New York USA Topics in Linear Models for Classification Overview 1. Discriminant Functions 2. Probabilistic

More information

Principles of Bayesian Inference

Principles of Bayesian Inference Principles of Bayesian Inference Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry & Department

More information

the unification of statistics its uses in practice and its role in Objective Bayesian Analysis:

the unification of statistics its uses in practice and its role in Objective Bayesian Analysis: Objective Bayesian Analysis: its uses in practice and its role in the unification of statistics James O. Berger Duke University and the Statistical and Applied Mathematical Sciences Institute Allen T.

More information

Identifying SVARs with Sign Restrictions and Heteroskedasticity

Identifying SVARs with Sign Restrictions and Heteroskedasticity Identifying SVARs with Sign Restrictions and Heteroskedasticity Srečko Zimic VERY PRELIMINARY AND INCOMPLETE NOT FOR DISTRIBUTION February 13, 217 Abstract This paper introduces a new method to identify

More information

Bayesian Quadrature: Model-based Approximate Integration. David Duvenaud University of Cambridge

Bayesian Quadrature: Model-based Approximate Integration. David Duvenaud University of Cambridge Bayesian Quadrature: Model-based Approimate Integration David Duvenaud University of Cambridge The Quadrature Problem ˆ We want to estimate an integral Z = f ()p()d ˆ Most computational problems in inference

More information

Bayesian Inference. Chapter 1. Introduction and basic concepts

Bayesian Inference. Chapter 1. Introduction and basic concepts Bayesian Inference Chapter 1. Introduction and basic concepts M. Concepción Ausín Department of Statistics Universidad Carlos III de Madrid Master in Business Administration and Quantitative Methods Master

More information

Journeys of an Accidental Statistician

Journeys of an Accidental Statistician Journeys of an Accidental Statistician A partially anecdotal account of A Unified Approach to the Classical Statistical Analysis of Small Signals, GJF and Robert D. Cousins, Phys. Rev. D 57, 3873 (1998)

More information

PATTERN RECOGNITION AND MACHINE LEARNING

PATTERN RECOGNITION AND MACHINE LEARNING PATTERN RECOGNITION AND MACHINE LEARNING Chapter 1. Introduction Shuai Huang April 21, 2014 Outline 1 What is Machine Learning? 2 Curve Fitting 3 Probability Theory 4 Model Selection 5 The curse of dimensionality

More information

COMMENT ON DEL NEGRO, SCHORFHEIDE, SMETS AND WOUTERS COMMENT ON DEL NEGRO, SCHORFHEIDE, SMETS AND WOUTERS

COMMENT ON DEL NEGRO, SCHORFHEIDE, SMETS AND WOUTERS COMMENT ON DEL NEGRO, SCHORFHEIDE, SMETS AND WOUTERS COMMENT ON DEL NEGRO, SCHORFHEIDE, SMETS AND WOUTERS COMMENT ON DEL NEGRO, SCHORFHEIDE, SMETS AND WOUTERS CHRISTOPHER A. SIMS 1. WHY THIS APPROACH HAS BEEN SUCCESSFUL This paper sets out to blend the advantages

More information

Inference for VARs identified with sign restrictions

Inference for VARs identified with sign restrictions Quantitative Economics 9 (2018), 1087 1121 1759-7331/20181087 Inference for VARs identified with sign restrictions Eleonora Granziera Monetary Policy and Research Department, Bank of Finland Hyungsik Roger

More information

SOME NOTES ON HOTELLING TUBES

SOME NOTES ON HOTELLING TUBES SOME NOTES ON HOTELLING TUBES ROGER KOENKER 1. Introduction We begin with the two examples of Johansen and Johnstone. The first is Hotelling s (1939) original example, and the second is closely related

More information

Identification in Dynamic Models Using Sign Restrictions

Identification in Dynamic Models Using Sign Restrictions Identification in Dynamic Models Using Sign Restrictions Bulat Gafarov Pennsylvania State University, National Research University Higher School of Economics September 30, 2013 Abstract Sign restrictions

More information

Lecture PowerPoints. Chapter 20 Physics: Principles with Applications, 6 th edition Giancoli

Lecture PowerPoints. Chapter 20 Physics: Principles with Applications, 6 th edition Giancoli Lecture PowerPoints Chapter 20 Physics: Principles with Applications, 6 th edition Giancoli 2005 Pearson Prentice Hall This work is protected by United States copyright laws and is provided solely for

More information

Physics 403. Segev BenZvi. Credible Intervals, Confidence Intervals, and Limits. Department of Physics and Astronomy University of Rochester

Physics 403. Segev BenZvi. Credible Intervals, Confidence Intervals, and Limits. Department of Physics and Astronomy University of Rochester Physics 403 Credible Intervals, Confidence Intervals, and Limits Segev BenZvi Department of Physics and Astronomy University of Rochester Table of Contents 1 Summarizing Parameters with a Range Bayesian

More information

Lectures 5 & 6: Hypothesis Testing

Lectures 5 & 6: Hypothesis Testing Lectures 5 & 6: Hypothesis Testing in which you learn to apply the concept of statistical significance to OLS estimates, learn the concept of t values, how to use them in regression work and come across

More information

Sampling Distributions

Sampling Distributions Sampling Distributions In previous chapters we have discussed taking a single observation from a distribution. More accurately, we looked at the probability of a single variable taking a specific value

More information

ST440/540: Applied Bayesian Statistics. (9) Model selection and goodness-of-fit checks

ST440/540: Applied Bayesian Statistics. (9) Model selection and goodness-of-fit checks (9) Model selection and goodness-of-fit checks Objectives In this module we will study methods for model comparisons and checking for model adequacy For model comparisons there are a finite number of candidate

More information

VI. OBSERVATIONS / DATA COLLECTION:

VI. OBSERVATIONS / DATA COLLECTION: Lab Write-Up Format THIS OUTLINE WILL HELP YOU TO WRITE OUT YOUR LABS. There may be changes or modifications but all elements must be included in your lab write-up. Each section on your lab paper must

More information

Online Appendix: Uncertainty and Economic Activity: Evidence from Business Survey Data" Rüdiger Bachmann, Steffen Elstner, and Eric R.

Online Appendix: Uncertainty and Economic Activity: Evidence from Business Survey Data Rüdiger Bachmann, Steffen Elstner, and Eric R. Online Appendix: Uncertainty and Economic Activity: Evidence from Business Survey Data" Rüdiger Bachmann, Steffen Elstner, and Eric R. Sims This Appendix presents a simple model and some additional robustness

More information

Robust inference in structural VARs with long-run restrictions

Robust inference in structural VARs with long-run restrictions Robust inference in structural VARs with long-run restrictions Guillaume Chevillon ESSEC and CRES Sophocles Mavroeidis University of Oxford Zhaoguo Zhan singhua University 23 May 2015 Abstract Long-run

More information

COHERENCE OF THE POSTERIOR PREDICTIVE P-VALUE BASED ON THE POSTERIOR ODDS. J. de la Horra Navarro and M.T. Rodríguez Bernal*

COHERENCE OF THE POSTERIOR PREDICTIVE P-VALUE BASED ON THE POSTERIOR ODDS. J. de la Horra Navarro and M.T. Rodríguez Bernal* Working Paper 01-25 Statistics and Econometrics Series 16 March 2001 Departamento de Estadística y Econometría Universidad Carlos III de Madrid Calle Madrid, 126 28903 Getafe (Spain) Fax (34) 91 624-98-49

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Sampling Distributions and Central Limit Theorem In previous topics we have discussed taking a single observation from a distribution. More accurately, we looked at the probability of a single variable

More information

Statistical Measures of Uncertainty in Inverse Problems

Statistical Measures of Uncertainty in Inverse Problems Statistical Measures of Uncertainty in Inverse Problems Workshop on Uncertainty in Inverse Problems Institute for Mathematics and Its Applications Minneapolis, MN 19-26 April 2002 P.B. Stark Department

More information

ON THE MAXIMUM AND MINIMUM RESPONSE TO AN IMPULSE IN SVARS

ON THE MAXIMUM AND MINIMUM RESPONSE TO AN IMPULSE IN SVARS ON THE MAXIMUM AND MINIMUM RESPONSE TO AN IMPULSE IN SVARS Bulat Gafarov and José Luis Montiel Olea 2 This paper proposes an intuitive, computationally simple, adjusted delta method confidence interval

More information

Fast Rates for Estimation Error and Oracle Inequalities for Model Selection

Fast Rates for Estimation Error and Oracle Inequalities for Model Selection Fast Rates for Estimation Error and Oracle Inequalities for Model Selection Peter L. Bartlett Computer Science Division and Department of Statistics University of California, Berkeley bartlett@cs.berkeley.edu

More information

Inference for VARs Identified with Sign Restrictions

Inference for VARs Identified with Sign Restrictions Inference for VARs Identified with Sign Restrictions Eleonora Granziera Bank of Finland Hyungsik Roger Moon University of Southern California and Yonsei University Frank Schorfheide University of Pennsylvania,

More information

Learning Energy-Based Models of High-Dimensional Data

Learning Energy-Based Models of High-Dimensional Data Learning Energy-Based Models of High-Dimensional Data Geoffrey Hinton Max Welling Yee-Whye Teh Simon Osindero www.cs.toronto.edu/~hinton/energybasedmodelsweb.htm Discovering causal structure as a goal

More information

CPSC 540: Machine Learning

CPSC 540: Machine Learning CPSC 540: Machine Learning Multivariate Gaussians Mark Schmidt University of British Columbia Winter 2019 Last Time: Multivariate Gaussian http://personal.kenyon.edu/hartlaub/mellonproject/bivariate2.html

More information

Entanglement Measures and Monotones Pt. 2

Entanglement Measures and Monotones Pt. 2 Entanglement Measures and Monotones Pt. 2 PHYS 500 - Southern Illinois University April 8, 2017 PHYS 500 - Southern Illinois University Entanglement Measures and Monotones Pt. 2 April 8, 2017 1 / 13 Entanglement

More information

Masquerading Shocks in Sign-Restricted VARs

Masquerading Shocks in Sign-Restricted VARs Masquerading Shocks in Sign-Restricted VARs Christian K. Wolf November 7, 2016 Abstract This paper shows that sign-restricted vector autoregressions (VARs) are vulnerable to misidentification through masquerading

More information

Point spread function reconstruction from the image of a sharp edge

Point spread function reconstruction from the image of a sharp edge DOE/NV/5946--49 Point spread function reconstruction from the image of a sharp edge John Bardsley, Kevin Joyce, Aaron Luttman The University of Montana National Security Technologies LLC Montana Uncertainty

More information

1 A simple example. A short introduction to Bayesian statistics, part I Math 217 Probability and Statistics Prof. D.

1 A simple example. A short introduction to Bayesian statistics, part I Math 217 Probability and Statistics Prof. D. probabilities, we ll use Bayes formula. We can easily compute the reverse probabilities A short introduction to Bayesian statistics, part I Math 17 Probability and Statistics Prof. D. Joyce, Fall 014 I

More information

Entanglement Measures and Monotones

Entanglement Measures and Monotones Entanglement Measures and Monotones PHYS 500 - Southern Illinois University March 30, 2017 PHYS 500 - Southern Illinois University Entanglement Measures and Monotones March 30, 2017 1 / 11 Quantifying

More information

Efficient Random Assignment with Cardinal and Ordinal Preferences: Online Appendix

Efficient Random Assignment with Cardinal and Ordinal Preferences: Online Appendix Efficient Random Assignment with Cardinal and Ordinal Preferences: Online Appendix James C. D. Fisher December 11, 2018 1 1 Introduction This document collects several results, which supplement those in

More information

Data-Driven Inference on Sign Restrictions in Bayesian Structural Vector Autoregression. Markku Lanne and Jani Luoto. CREATES Research Paper

Data-Driven Inference on Sign Restrictions in Bayesian Structural Vector Autoregression. Markku Lanne and Jani Luoto. CREATES Research Paper Data-Driven Inference on Sign Restrictions in Bayesian Structural Vector Autoregression Markku Lanne and Jani Luoto CREATES Research Paper 2016-4 Department of Economics and Business Economics Aarhus University

More information

Choosing priors Class 15, Jeremy Orloff and Jonathan Bloom

Choosing priors Class 15, Jeremy Orloff and Jonathan Bloom 1 Learning Goals Choosing priors Class 15, 18.05 Jeremy Orloff and Jonathan Bloom 1. Learn that the choice of prior affects the posterior. 2. See that too rigid a prior can make it difficult to learn from

More information

A Note on the Existence of Ratifiable Acts

A Note on the Existence of Ratifiable Acts A Note on the Existence of Ratifiable Acts Joseph Y. Halpern Cornell University Computer Science Department Ithaca, NY 14853 halpern@cs.cornell.edu http://www.cs.cornell.edu/home/halpern August 15, 2018

More information

Partial Fractions. Combining fractions over a common denominator is a familiar operation from algebra: 2 x 3 + 3

Partial Fractions. Combining fractions over a common denominator is a familiar operation from algebra: 2 x 3 + 3 Partial Fractions Combining fractions over a common denominator is a familiar operation from algebra: x 3 + 3 x + x + 3x 7 () x 3 3x + x 3 From the standpoint of integration, the left side of Equation

More information

Intersection Bounds, Robust Bayes, and Updating Ambiguous Beliefs.

Intersection Bounds, Robust Bayes, and Updating Ambiguous Beliefs. Intersection Bounds, Robust Bayes, and Updating mbiguous Beliefs. Toru Kitagawa CeMMP and Department of Economics, UCL Preliminary Draft November, 2011 bstract This paper develops multiple-prior Bayesian

More information