Simulation. Li Zhao, SJTU. Spring, Li Zhao Simulation 1 / 19
|
|
- Letitia Rose
- 6 years ago
- Views:
Transcription
1 Simulation Li Zhao, SJTU Spring, 2017 Li Zhao Simulation 1 / 19
2 Introduction Simulation consists of drawing from a density, calculating a statistic for each draw, and averaging the results. Simulation methods play a very important role in Approximating integration (such as simulated maximum likelihood, simulated method of moments); Maximization; Forecasting; Counterfactual analysis; Bayesian analysis. Li Zhao Simulation 2 / 19
3 Outline 1 Simulate Random Variables 2 Approximate Expectation Simple Case Importance Sampling 3 Simulated-Assisted Estimation Maximum Simulated Likelihood Method of Simulated Moments 4 GHK Simulator Li Zhao Simulation 3 / 19
4 Simulate One Random Variable Statistical software can draw many types of random numbers. Uniform, binomial, normal, etc. Drawing a random variable from corresponding cumulative distribution F (ε). Step 1: Draw u (r) U[0,1]. A draw from the standard uniform provides a number between zero and one. Step 2: Solve ε (r) = F 1 (u (r) ). The cumulative distribution of ε (r) equals F ( ). Note that this procedure works only for univariate distributions. Li Zhao Simulation 4 / 19
5 Example: Simulate Type 1 Extreme Value Distribution The Type 1 extreme value distribution, which is the basis for logit model, has cumulative distribution F (ε) = exp( exp( ε)). A draw from this density if obtained as ε = ln( ln µ)). Suppose that (X 1,X 2,...) is a sequence of independent random variables, each with the standard exponential distribution G(x) = 1 e x. The distribution of Y = max{x 1,X 2,...X n ) ln(n) converges to the (type 1) standard extreme value distribution as n. We can verify this using simulation. Li Zhao Simulation 5 / 19
6 Simulate Multivariate Normals Suppose we want to draw ε N(b,Σ). ε is a p 1 vector. A Choleski factor of is dened as a lower-triangular matrix L such that L L = Σ. L is called the Choleski factor. Then we can generate η (r) N(0 3,I 3 ). Then b + Lη (r) N(b,Σ). For example, when p = 3, we generate ε 1 l ε 2 = b + l 21 l 22 0 ε 3 l 31 l 32 l 33 η 1 η 2 η 3 Li Zhao Simulation 6 / 19
7 Outline 1 Simulate Random Variables 2 Approximate Expectation Simple Case Importance Sampling 3 Simulated-Assisted Estimation Maximum Simulated Likelihood Method of Simulated Moments 4 GHK Simulator Li Zhao Simulation 7 / 19
8 Approximate Expectation Suppose x F ( ). Principle of integration via simulation (Monte Carlo integration"): approximate an expectation as a sample average. If we are interested in E(x), we can draw ε (1),ε (2),...ε (R) independently from f (x). By law of large number, E(x) = ε f (ε) dε 1 R F R ε (r). r=1 If we are interested in E(t(x)), we can draw ε (1),ε (2),...ε (R) independently from f (x). By LLN, E(t(x)) = t(ε) f (ε) dε 1 R F R t(ε (r) ). r=1 Li Zhao Simulation 8 / 19
9 Importance Sampling Suppose we want to approximate. E(t(x)) = t(ε) f (ε) dε 1 R F R t(ε (r) ) r=1 What is is hard to fraw ε f ( ) but it is easy to draw ε g( )? We can draw ε (1),ε (2),...ε (R) independently from g( ) E(t(x)) = t(ε)f (ε)dε = t(ε) f (ε) F G t g(ε) g(ε)ds 1 R R t(ε (r) ) f (ε(r) ) r=1 g(ε (r) ) Sampling t(ε) from f ( ) distribution is equivalent to sampling t(ε) w(ε) from g( ) distribution, with importance sampling weight w(ε) = f (ε) g(ε). f and g should have the same support. Li Zhao Simulation 9 / 19
10 Importance Sampling - Algorithm Suppose ε has a density f (ε) that cannot be easily drawn from by the other procedures. Suppose further that there is another density, g(ε), that can easily be drawn from. Draws from f ( ) can be obtained as follows. 1) Take a draw from g(ε) and label it ε 1. 2) Weight the draw by f (ε 1 )/g(ε 2 ). 3) Repeat this process many times. The set of weighted draws is equivalent to a set of draws from f. Li Zhao Simulation 10 / 19
11 Importance Sampling - Example Suppose we want to simulate the mean of a standard normal distribution, truncated to the unit interval [0, 1]. The desired sampling density is: f (x) = φ(x) 1 0 φ(x)dx. We may draw ε N(0,1) and throw away observations outside [0,1]. Or, we can use importance sampling, draw ε U[0,1] so g(ε) = 1. For each draw, we multiple its weight w(ε) = f (x) g(x) = φ(x) 10 φ(x)dx. The simulated mean 1 R R r=1 ε (r) w(ε (r) ) is the mean of truncated normal. We will use importance sampling in discrete-outcome game-theoretic model. In that application, we are asked to draw truncated multivariate normal distribution. Li Zhao Simulation 11 / 19
12 Outline 1 Simulate Random Variables 2 Approximate Expectation Simple Case Importance Sampling 3 Simulated-Assisted Estimation Maximum Simulated Likelihood Method of Simulated Moments 4 GHK Simulator Li Zhao Simulation 12 / 19
13 Maximum Simulated Likelihood The log-likelihood function is: LL(θ) = lnp n (θ). n P n (θ) is the (exact) probability of the observed choice of observation n, and the summation is over a sample. Let P S n (θ) be a simulated approximation to P n (θ). The simulated log-likelihood function is SLL(θ) = lnpn S (θ). n Li Zhao Simulation 13 / 19
14 Method of Simulated Moments Method of moments: The moments, like the expectation of any variables, are functions of the parameters: E(g(x,y,θ)) = 0. For example. E(x(y x β)) = 0. g(x,yβ) = x(y x β). We take sample moments ĝ. The GMM estimator minimizes The MSM ĝ(θ) W ĝ(θ). If g(β) is dicult to calculate, we can simulate it, denote as g S (β). MSM estimator minimizes gˆ S (θ) W g ˆS (θ). Li Zhao Simulation 14 / 19
15 Outline 1 Simulate Random Variables 2 Approximate Expectation Simple Case Importance Sampling 3 Simulated-Assisted Estimation Maximum Simulated Likelihood Method of Simulated Moments 4 GHK Simulator Li Zhao Simulation 15 / 19
16 GHK simulator GewekeHajivassiliouKeane (GHK) multivariate normal simulator. Consider the Probit Model where ε 1 ε 2 ε 3 What is P 0? How to get ˆP 0? P 0 = N(0,Σ). u 0 = 0 u 1 = βx 1 + ε 1 u 2 = βx 2 + ε 2 u 3 = βx 3 + ε 3 P 0 = Pr(u 1 < 0,u 2 < 0,u 3 < 0). βx1 βx2 βx3 φ 123 (ε 1,ε 2,ε 3 ;Σ)dε 3 dε 2 dε 1. numerical approximations perform poorly in computing high order integrals. Li Zhao Simulation 16 / 19
17 GHK Simulator - Trivariate Case (1) Let us illustrate the GHK simulator in the trivariate case (generalization to higher orders is straightforward). We wish to evaluate P 0 = Pr(ε 1 < βx 1,ε 2 < βx 2,ε 3 < βx 3 ). The joint distribution can be rewritten as a product of conditional probabilities: Pr(ε 1 < βx 1 ) Pr(ε 2 < βx 2 ε 1 < βx 1 ) Pr(ε 3 < βx 2 ε 1 < βx 1,ε 2 < βx 2 ) Let L be the lower triangular Cholesky decomposition of Σ, such that: L L = Σ. ε 1 l η 1 ε 2 = l 21 l 22 0 η 2 ε 3 l 31 l 32 l 33 η 3 Li Zhao Simulation 17 / 19
18 GHK simulator - Trivariate Case (2) Pr(ε 1 < βx 1 ) Pr(ε 2 < βx 2 ε 1 < βx 1 ) Pr(ε 3 < βx 2 ε 1 < βx 1,ε 2 < βx 2 ). Pr(ε 1 < βx 1 ) = Pr(η 1 < βx 1 l 11 ) Pr(ε 2 < βx 2 ε 1 < βx 1 ) = Pr(η 2 < βx 2 l 21 η 1 l 22 η 1 < βx 1 l 11 ) Pr(ε 3 < βx 2 ε 1 < βx 1,ε 2 < βx 2 ) =Pr(η 3 < βx 3 l 31 η 1 l 32 η 2 l 33 η 1 < βx 1 l 11,η 2 < βx 2 l 21 η 1 l 22 ) Because (η 1,η 2,η 3 ) are independent, we can draw η (s) 1, η (s) 2 from truncated normal, and approximate P 0 as a product of univariate CDF. P 0,GHK = 1 S S s=1 Φ( βx 1 l 11 )Φ( βx2 l η (s) 21 1 l 22 )Φ( βx 3 l 31 η (s) 1 l 32 η (s) 2 ). l 33 Li Zhao Simulation 18 / 19
19 Summarize Like other mathematically intensive sciences, economics is becoming increasingly computerized. Common software Stata / EViews / GAUSS/ R / Matlab / C / Fortran / Python / Julia. Econometrics: Approximate expectation, SML, MSM. Approximate standard error by bootstrap and subsampling. Optimization. Forecast and counterfactual analysis. Li Zhao Simulation 19 / 19
MLE and GMM. Li Zhao, SJTU. Spring, Li Zhao MLE and GMM 1 / 22
MLE and GMM Li Zhao, SJTU Spring, 2017 Li Zhao MLE and GMM 1 / 22 Outline 1 MLE 2 GMM 3 Binary Choice Models Li Zhao MLE and GMM 2 / 22 Maximum Likelihood Estimation - Introduction For a linear model y
More informationLatent Variable Models for Binary Data. Suppose that for a given vector of explanatory variables x, the latent
Latent Variable Models for Binary Data Suppose that for a given vector of explanatory variables x, the latent variable, U, has a continuous cumulative distribution function F (u; x) and that the binary
More information9 Drawing from Densities
9 Drawing from Densities 9.1 Introduction Simulation consists of drawing from a density, calculating a statistic for each draw, and averaging the results. In all cases, the researcher wants to calculate
More informationI. Multinomial Logit Suppose we only have individual specific covariates. Then we can model the response probability as
Econ 513, USC, Fall 2005 Lecture 15 Discrete Response Models: Multinomial, Conditional and Nested Logit Models Here we focus again on models for discrete choice with more than two outcomes We assume that
More informationMultivariate probit regression using simulated maximum likelihood
Multivariate probit regression using simulated maximum likelihood Lorenzo Cappellari & Stephen P. Jenkins ISER, University of Essex stephenj@essex.ac.uk 1 Overview Introduction and motivation The model
More information2 Random Variable Generation
2 Random Variable Generation Most Monte Carlo computations require, as a starting point, a sequence of i.i.d. random variables with given marginal distribution. We describe here some of the basic methods
More informationLecture 3 Optimization methods for econometrics models
Lecture 3 Optimization methods for econometrics models Cinzia Cirillo University of Maryland Department of Civil and Environmental Engineering 06/29/2016 Summer Seminar June 27-30, 2016 Zinal, CH 1 Overview
More informationBayesian tsunami fragility modeling considering input data uncertainty
Bayesian tsunami fragility modeling considering input data uncertainty Raffaele De Risi Research Associate University of Bristol United Kingdom De Risi, R., Goda, K., Mori, N., & Yasuda, T. (2016). Bayesian
More informationBayesian Inference in GLMs. Frequentists typically base inferences on MLEs, asymptotic confidence
Bayesian Inference in GLMs Frequentists typically base inferences on MLEs, asymptotic confidence limits, and log-likelihood ratio tests Bayesians base inferences on the posterior distribution of the unknowns
More informationDirect Simulation Methods #2
Direct Simulation Methods #2 Econ 690 Purdue University Outline 1 A Generalized Rejection Sampling Algorithm 2 The Weighted Bootstrap 3 Importance Sampling Rejection Sampling Algorithm #2 Suppose we wish
More informationMonte Carlo Composition Inversion Acceptance/Rejection Sampling. Direct Simulation. Econ 690. Purdue University
Methods Econ 690 Purdue University Outline 1 Monte Carlo Integration 2 The Method of Composition 3 The Method of Inversion 4 Acceptance/Rejection Sampling Monte Carlo Integration Suppose you wish to calculate
More informationThis exam is closed book and closed notes. (You will have access to a copy of the Table of Common Distributions given in the back of the text.
TEST #1 STA 5326 September 25, 2014 Name: Please read the following directions. DO NOT TURN THE PAGE UNTIL INSTRUCTED TO DO SO Directions This exam is closed book and closed notes. (You will have access
More informationPatterns of Scalable Bayesian Inference Background (Session 1)
Patterns of Scalable Bayesian Inference Background (Session 1) Jerónimo Arenas-García Universidad Carlos III de Madrid jeronimo.arenas@gmail.com June 14, 2017 1 / 15 Motivation. Bayesian Learning principles
More informationMath 151. Rumbos Fall Solutions to Review Problems for Exam 2. Pr(X = 1) = ) = Pr(X = 2) = Pr(X = 3) = p X. (k) =
Math 5. Rumbos Fall 07 Solutions to Review Problems for Exam. A bowl contains 5 chips of the same size and shape. Two chips are red and the other three are blue. Draw three chips from the bowl at random,
More informationGaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012
Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature
More informationChapter 5 continued. Chapter 5 sections
Chapter 5 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions
More informationEfficient estimation of Probit models with correlated errors
Efficient estimation of Probit models with correlated errors Roman Liesenfeld, Jean-François Richard To cite this version: Roman Liesenfeld, Jean-François Richard. Efficient estimation of Probit models
More informationProbabilistic Choice Models
Econ 3: James J. Heckman Probabilistic Choice Models This chapter examines different models commonly used to model probabilistic choice, such as eg the choice of one type of transportation from among many
More informationEconomics 583: Econometric Theory I A Primer on Asymptotics
Economics 583: Econometric Theory I A Primer on Asymptotics Eric Zivot January 14, 2013 The two main concepts in asymptotic theory that we will use are Consistency Asymptotic Normality Intuition consistency:
More informationA Model of Human Capital Accumulation and Occupational Choices. A simplified version of Keane and Wolpin (JPE, 1997)
A Model of Human Capital Accumulation and Occupational Choices A simplified version of Keane and Wolpin (JPE, 1997) We have here three, mutually exclusive decisions in each period: 1. Attend school. 2.
More informationSimulating Uniform- and Triangular- Based Double Power Method Distributions
Journal of Statistical and Econometric Methods, vol.6, no.1, 2017, 1-44 ISSN: 1792-6602 (print), 1792-6939 (online) Scienpress Ltd, 2017 Simulating Uniform- and Triangular- Based Double Power Method Distributions
More informationBasic Sampling Methods
Basic Sampling Methods Sargur Srihari srihari@cedar.buffalo.edu 1 1. Motivation Topics Intractability in ML How sampling can help 2. Ancestral Sampling Using BNs 3. Transforming a Uniform Distribution
More information,..., θ(2),..., θ(n)
Likelihoods for Multivariate Binary Data Log-Linear Model We have 2 n 1 distinct probabilities, but we wish to consider formulations that allow more parsimonious descriptions as a function of covariates.
More informationEcon 673: Microeconometrics
Econ 673: Microeconometrics Chapter 2: Simulation Tools for Estimation and Inference Fall 2008 Herriges (ISU) Chapter 1: Simulation Tools Fall 2008 1 / 63 Outline 1 The Role of Simulation in Estimation
More informationMultivariate Distribution Models
Multivariate Distribution Models Model Description While the probability distribution for an individual random variable is called marginal, the probability distribution for multiple random variables is
More informationProperties of Random Variables
Properties of Random Variables 1 Definitions A discrete random variable is defined by a probability distribution that lists each possible outcome and the probability of obtaining that outcome If the random
More informationStatistical Distributions and Uncertainty Analysis. QMRA Institute Patrick Gurian
Statistical Distributions and Uncertainty Analysis QMRA Institute Patrick Gurian Probability Define a function f(x) probability density distribution function (PDF) Prob [A
More informationMathematical statistics
October 18 th, 2018 Lecture 16: Midterm review Countdown to mid-term exam: 7 days Week 1 Chapter 1: Probability review Week 2 Week 4 Week 7 Chapter 6: Statistics Chapter 7: Point Estimation Chapter 8:
More informationLecture 1: August 28
36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 1: August 28 Our broad goal for the first few lectures is to try to understand the behaviour of sums of independent random
More informationEfficient multivariate normal distribution calculations in Stata
Supervisor: Adrian Mander MRC Biostatistics Unit 2015 UK Stata Users Group Meeting 10/09/15 1/21 Why and what? Why do we need to be able to work with the Multivariate Normal Distribution? The normal distribution
More informationBinary choice. Michel Bierlaire
Binary choice Michel Bierlaire Transport and Mobility Laboratory School of Architecture, Civil and Environmental Engineering Ecole Polytechnique Fédérale de Lausanne M. Bierlaire (TRANSP-OR ENAC EPFL)
More informationStat 451 Lecture Notes Simulating Random Variables
Stat 451 Lecture Notes 05 12 Simulating Random Variables Ryan Martin UIC www.math.uic.edu/~rgmartin 1 Based on Chapter 6 in Givens & Hoeting, Chapter 22 in Lange, and Chapter 2 in Robert & Casella 2 Updated:
More informationFinancial Econometrics
Financial Econometrics Estimation and Inference Gerald P. Dwyer Trinity College, Dublin January 2013 Who am I? Visiting Professor and BB&T Scholar at Clemson University Federal Reserve Bank of Atlanta
More informationBayesian Inference for DSGE Models. Lawrence J. Christiano
Bayesian Inference for DSGE Models Lawrence J. Christiano Outline State space-observer form. convenient for model estimation and many other things. Bayesian inference Bayes rule. Monte Carlo integation.
More informationResearch Division Federal Reserve Bank of St. Louis Working Paper Series
Research Division Federal Reserve Bank of St Louis Working Paper Series Kalman Filtering with Truncated Normal State Variables for Bayesian Estimation of Macroeconomic Models Michael Dueker Working Paper
More informationconditional cdf, conditional pdf, total probability theorem?
6 Multiple Random Variables 6.0 INTRODUCTION scalar vs. random variable cdf, pdf transformation of a random variable conditional cdf, conditional pdf, total probability theorem expectation of a random
More informationThree hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER.
Three hours To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER EXTREME VALUES AND FINANCIAL RISK Examiner: Answer QUESTION 1, QUESTION
More informationMultivariate Capability Analysis Using Statgraphics. Presented by Dr. Neil W. Polhemus
Multivariate Capability Analysis Using Statgraphics Presented by Dr. Neil W. Polhemus Multivariate Capability Analysis Used to demonstrate conformance of a process to requirements or specifications that
More informationDiscrete Choice Modeling
[Part 4] 1/43 Discrete Choice Modeling 0 Introduction 1 Summary 2 Binary Choice 3 Panel Data 4 Bivariate Probit 5 Ordered Choice 6 Count Data 7 Multinomial Choice 8 Nested Logit 9 Heterogeneity 10 Latent
More informationGibbs Sampling in Endogenous Variables Models
Gibbs Sampling in Endogenous Variables Models Econ 690 Purdue University Outline 1 Motivation 2 Identification Issues 3 Posterior Simulation #1 4 Posterior Simulation #2 Motivation In this lecture we take
More informationMultivariate Distributions
IEOR E4602: Quantitative Risk Management Spring 2016 c 2016 by Martin Haugh Multivariate Distributions We will study multivariate distributions in these notes, focusing 1 in particular on multivariate
More informationChapter 9 Regression with a Binary Dependent Variable. Multiple Choice. 1) The binary dependent variable model is an example of a
Chapter 9 Regression with a Binary Dependent Variable Multiple Choice ) The binary dependent variable model is an example of a a. regression model, which has as a regressor, among others, a binary variable.
More informationDensity estimation Nonparametric conditional mean estimation Semiparametric conditional mean estimation. Nonparametrics. Gabriel Montes-Rojas
0 0 5 Motivation: Regression discontinuity (Angrist&Pischke) Outcome.5 1 1.5 A. Linear E[Y 0i X i] 0.2.4.6.8 1 X Outcome.5 1 1.5 B. Nonlinear E[Y 0i X i] i 0.2.4.6.8 1 X utcome.5 1 1.5 C. Nonlinearity
More informationML estimation: Random-intercepts logistic model. and z
ML estimation: Random-intercepts logistic model log p ij 1 p = x ijβ + υ i with υ i N(0, συ) 2 ij Standardizing the random effect, θ i = υ i /σ υ, yields log p ij 1 p = x ij β + σ υθ i with θ i N(0, 1)
More informationModeling Binary Outcomes: Logit and Probit Models
Modeling Binary Outcomes: Logit and Probit Models Eric Zivot December 5, 2009 Motivating Example: Women s labor force participation y i = 1 if married woman is in labor force = 0 otherwise x i k 1 = observed
More informationBinary Models with Endogenous Explanatory Variables
Binary Models with Endogenous Explanatory Variables Class otes Manuel Arellano ovember 7, 2007 Revised: January 21, 2008 1 Introduction In Part I we considered linear and non-linear models with additive
More informationMax. Likelihood Estimation. Outline. Econometrics II. Ricardo Mora. Notes. Notes
Maximum Likelihood Estimation Econometrics II Department of Economics Universidad Carlos III de Madrid Máster Universitario en Desarrollo y Crecimiento Económico Outline 1 3 4 General Approaches to Parameter
More informationUsing the Delta Method to Construct Confidence Intervals for Predicted Probabilities, Rates, and Discrete Changes 1
Using the Delta Method to Construct Confidence Intervals for Predicted Probabilities, Rates, Discrete Changes 1 JunXuJ.ScottLong Indiana University 2005-02-03 1 General Formula The delta method is a general
More informationFundamentals. CS 281A: Statistical Learning Theory. Yangqing Jia. August, Based on tutorial slides by Lester Mackey and Ariel Kleiner
Fundamentals CS 281A: Statistical Learning Theory Yangqing Jia Based on tutorial slides by Lester Mackey and Ariel Kleiner August, 2011 Outline 1 Probability 2 Statistics 3 Linear Algebra 4 Optimization
More informationSpring 2012 Math 541B Exam 1
Spring 2012 Math 541B Exam 1 1. A sample of size n is drawn without replacement from an urn containing N balls, m of which are red and N m are black; the balls are otherwise indistinguishable. Let X denote
More informationWeb Appendix for The Value of Reputation in an Online Freelance Marketplace
Web Appendix for The Value of Reputation in an Online Freelance Marketplace Hema Yoganarasimhan 1 Details of Second-Step Estimation All the estimates from state transitions (θ p, θ g, θ t ), η i s, and
More informationGibbs Sampling in Latent Variable Models #1
Gibbs Sampling in Latent Variable Models #1 Econ 690 Purdue University Outline 1 Data augmentation 2 Probit Model Probit Application A Panel Probit Panel Probit 3 The Tobit Model Example: Female Labor
More informationFormulas for probability theory and linear models SF2941
Formulas for probability theory and linear models SF2941 These pages + Appendix 2 of Gut) are permitted as assistance at the exam. 11 maj 2008 Selected formulae of probability Bivariate probability Transforms
More informationA heuristic for moment-matching scenario generation
Lukáš Adam 4. 11. 2013 1 / 21 Table of contents 1 Introduction 2 Basic algorithm 3 Modified algorithm 4 Results 2 / 21 Introduction Consider an optimization stochastic problem. To solve the problem one
More informationSTA 2201/442 Assignment 2
STA 2201/442 Assignment 2 1. This is about how to simulate from a continuous univariate distribution. Let the random variable X have a continuous distribution with density f X (x) and cumulative distribution
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 2016 MODULE 1 : Probability distributions Time allowed: Three hours Candidates should answer FIVE questions. All questions carry equal marks.
More informationSession 5B: A worked example EGARCH model
Session 5B: A worked example EGARCH model John Geweke Bayesian Econometrics and its Applications August 7, worked example EGARCH model August 7, / 6 EGARCH Exponential generalized autoregressive conditional
More informationEconomics 520. Lecture Note 19: Hypothesis Testing via the Neyman-Pearson Lemma CB 8.1,
Economics 520 Lecture Note 9: Hypothesis Testing via the Neyman-Pearson Lemma CB 8., 8.3.-8.3.3 Uniformly Most Powerful Tests and the Neyman-Pearson Lemma Let s return to the hypothesis testing problem
More informationSimulating Random Variables
Simulating Random Variables Timothy Hanson Department of Statistics, University of South Carolina Stat 740: Statistical Computing 1 / 23 R has many built-in random number generators... Beta, gamma (also
More informationThis paper is not to be removed from the Examination Halls
~~ST104B ZA d0 This paper is not to be removed from the Examination Halls UNIVERSITY OF LONDON ST104B ZB BSc degrees and Diplomas for Graduates in Economics, Management, Finance and the Social Sciences,
More information1 Outline. 1. MSL. 2. MSM and Indirect Inference. 3. Example of MSM-Berry(1994) and BLP(1995). 4. Ackerberg s Importance Sampler.
1 Outline. 1. MSL. 2. MSM and Indirect Inference. 3. Example of MSM-Berry(1994) and BLP(1995). 4. Ackerberg s Importance Sampler. 2 Some Examples. In this chapter, we will be concerned with examples of
More informationSampling Distributions and Asymptotics Part II
Sampling Distributions and Asymptotics Part II Insan TUNALI Econ 511 - Econometrics I Koç University 18 October 2018 I. Tunal (Koç University) Week 5 18 October 2018 1 / 29 Lecture Outline v Sampling Distributions
More informationGraduate Econometrics I: What is econometrics?
Graduate Econometrics I: What is econometrics? Yves Dominicy Université libre de Bruxelles Solvay Brussels School of Economics and Management ECARES Yves Dominicy Graduate Econometrics I: What is econometrics?
More informationReview. December 4 th, Review
December 4 th, 2017 Att. Final exam: Course evaluation Friday, 12/14/2018, 10:30am 12:30pm Gore Hall 115 Overview Week 2 Week 4 Week 7 Week 10 Week 12 Chapter 6: Statistics and Sampling Distributions Chapter
More informationEstimation theory. Parametric estimation. Properties of estimators. Minimum variance estimator. Cramer-Rao bound. Maximum likelihood estimators
Estimation theory Parametric estimation Properties of estimators Minimum variance estimator Cramer-Rao bound Maximum likelihood estimators Confidence intervals Bayesian estimation 1 Random Variables Let
More informationσ(a) = a N (x; 0, 1 2 ) dx. σ(a) = Φ(a) =
Until now we have always worked with likelihoods and prior distributions that were conjugate to each other, allowing the computation of the posterior distribution to be done in closed form. Unfortunately,
More informationJohn Geweke Department of Economics University of Minnesota Minneapolis, MN First draft: April, 1991
Efficient Simulation from the Multivariate Normal and Student-t Distributions Subject to Linear Constraints and the Evaluation of Constraint Probabilities John Geweke Department of Economics University
More informationEconometric Analysis of Cross Section and Panel Data
Econometric Analysis of Cross Section and Panel Data Jeffrey M. Wooldridge / The MIT Press Cambridge, Massachusetts London, England Contents Preface Acknowledgments xvii xxiii I INTRODUCTION AND BACKGROUND
More informationLinear Regression With Special Variables
Linear Regression With Special Variables Junhui Qian December 21, 2014 Outline Standardized Scores Quadratic Terms Interaction Terms Binary Explanatory Variables Binary Choice Models Standardized Scores:
More informationA6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 2011 Reading Chapter 5 (continued) Lecture 8 Key points in probability CLT CLT examples Prior vs Likelihood Box & Tiao
More informationECLT 5810 Linear Regression and Logistic Regression for Classification. Prof. Wai Lam
ECLT 5810 Linear Regression and Logistic Regression for Classification Prof. Wai Lam Linear Regression Models Least Squares Input vectors is an attribute / feature / predictor (independent variable) The
More informationLecture 12: Application of Maximum Likelihood Estimation:Truncation, Censoring, and Corner Solutions
Econ 513, USC, Department of Economics Lecture 12: Application of Maximum Likelihood Estimation:Truncation, Censoring, and Corner Solutions I Introduction Here we look at a set of complications with the
More informationBayesian Inference for DSGE Models. Lawrence J. Christiano
Bayesian Inference for DSGE Models Lawrence J. Christiano Outline State space-observer form. convenient for model estimation and many other things. Preliminaries. Probabilities. Maximum Likelihood. Bayesian
More informationGaussian Processes for Machine Learning
Gaussian Processes for Machine Learning Carl Edward Rasmussen Max Planck Institute for Biological Cybernetics Tübingen, Germany carl@tuebingen.mpg.de Carlos III, Madrid, May 2006 The actual science of
More informationEconometrica Supplementary Material
Econometrica Supplementary Material SUPPLEMENT TO CONDITIONAL CHOICE PROBABILITY ESTIMATION OF DYNAMIC DISCRETE CHOICE MODELS WITH UNOBSERVED HETEROGENEITY (Econometrica, Vol. 79, No. 6, November 20, 823
More informationBayesian Econometrics - Computer section
Bayesian Econometrics - Computer section Leandro Magnusson Department of Economics Brown University Leandro Magnusson@brown.edu http://www.econ.brown.edu/students/leandro Magnusson/ April 26, 2006 Preliminary
More informationSpatial Discrete Choice Models
Spatial Discrete Choice Models Professor William Greene Stern School of Business, New York University SPATIAL ECONOMETRICS ADVANCED INSTITUTE University of Rome May 23, 2011 Spatial Correlation Spatially
More informationWeek 9 The Central Limit Theorem and Estimation Concepts
Week 9 and Estimation Concepts Week 9 and Estimation Concepts Week 9 Objectives 1 The Law of Large Numbers and the concept of consistency of averages are introduced. The condition of existence of the population
More informationMidterm Examination. STA 215: Statistical Inference. Due Wednesday, 2006 Mar 8, 1:15 pm
Midterm Examination STA 215: Statistical Inference Due Wednesday, 2006 Mar 8, 1:15 pm This is an open-book take-home examination. You may work on it during any consecutive 24-hour period you like; please
More informationTesting an Autoregressive Structure in Binary Time Series Models
ömmföäflsäafaäsflassflassflas ffffffffffffffffffffffffffffffffffff Discussion Papers Testing an Autoregressive Structure in Binary Time Series Models Henri Nyberg University of Helsinki and HECER Discussion
More informationIdentification and Estimation Using Heteroscedasticity Without Instruments: The Binary Endogenous Regressor Case
Identification and Estimation Using Heteroscedasticity Without Instruments: The Binary Endogenous Regressor Case Arthur Lewbel Boston College Original December 2016, revised July 2017 Abstract Lewbel (2012)
More informationStat 5101 Lecture Notes
Stat 5101 Lecture Notes Charles J. Geyer Copyright 1998, 1999, 2000, 2001 by Charles J. Geyer May 7, 2001 ii Stat 5101 (Geyer) Course Notes Contents 1 Random Variables and Change of Variables 1 1.1 Random
More informationR. Koenker Spring 2017 Economics 574 Problem Set 1
R. Koenker Spring 207 Economics 574 Problem Set.: Suppose X, Y are random variables with joint density f(x, y) = x 2 + xy/3 x [0, ], y [0, 2]. Find: (a) the joint df, (b) the marginal density of X, (c)
More informationLecture 21: Convergence of transformations and generating a random variable
Lecture 21: Convergence of transformations and generating a random variable If Z n converges to Z in some sense, we often need to check whether h(z n ) converges to h(z ) in the same sense. Continuous
More informationGeometric Skew-Normal Distribution
Debasis Kundu Arun Kumar Chair Professor Department of Mathematics & Statistics Indian Institute of Technology Kanpur Part of this work is going to appear in Sankhya, Ser. B. April 11, 2014 Outline 1 Motivation
More informationf(x θ)dx with respect to θ. Assuming certain smoothness conditions concern differentiating under the integral the integral sign, we first obtain
0.1. INTRODUCTION 1 0.1 Introduction R. A. Fisher, a pioneer in the development of mathematical statistics, introduced a measure of the amount of information contained in an observaton from f(x θ). Fisher
More informationField Course Descriptions
Field Course Descriptions Ph.D. Field Requirements 12 credit hours with 6 credit hours in each of two fields selected from the following fields. Each class can count towards only one field. Course descriptions
More informationCMPE 58K Bayesian Statistics and Machine Learning Lecture 5
CMPE 58K Bayesian Statistics and Machine Learning Lecture 5 Multivariate distributions: Gaussian, Bernoulli, Probability tables Department of Computer Engineering, Boğaziçi University, Istanbul, Turkey
More informationMixtures of Gaussians. Sargur Srihari
Mixtures of Gaussians Sargur srihari@cedar.buffalo.edu 1 9. Mixture Models and EM 0. Mixture Models Overview 1. K-Means Clustering 2. Mixtures of Gaussians 3. An Alternative View of EM 4. The EM Algorithm
More informationIrr. Statistical Methods in Experimental Physics. 2nd Edition. Frederick James. World Scientific. CERN, Switzerland
Frederick James CERN, Switzerland Statistical Methods in Experimental Physics 2nd Edition r i Irr 1- r ri Ibn World Scientific NEW JERSEY LONDON SINGAPORE BEIJING SHANGHAI HONG KONG TAIPEI CHENNAI CONTENTS
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationA New Generalized Gumbel Copula for Multivariate Distributions
A New Generalized Gumbel Copula for Multivariate Distributions Chandra R. Bhat* The University of Texas at Austin Department of Civil, Architectural & Environmental Engineering University Station, C76,
More informationMachine learning - HT Maximum Likelihood
Machine learning - HT 2016 3. Maximum Likelihood Varun Kanade University of Oxford January 27, 2016 Outline Probabilistic Framework Formulate linear regression in the language of probability Introduce
More informationFall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.
1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n
More informationECON 594: Lecture #6
ECON 594: Lecture #6 Thomas Lemieux Vancouver School of Economics, UBC May 2018 1 Limited dependent variables: introduction Up to now, we have been implicitly assuming that the dependent variable, y, was
More informationLecture 6: Discrete Choice: Qualitative Response
Lecture 6: Instructor: Department of Economics Stanford University 2011 Types of Discrete Choice Models Univariate Models Binary: Linear; Probit; Logit; Arctan, etc. Multinomial: Logit; Nested Logit; GEV;
More informationBayesian Semiparametric GARCH Models
Bayesian Semiparametric GARCH Models Xibin (Bill) Zhang and Maxwell L. King Department of Econometrics and Business Statistics Faculty of Business and Economics xibin.zhang@monash.edu Quantitative Methods
More informationBayesian Semiparametric GARCH Models
Bayesian Semiparametric GARCH Models Xibin (Bill) Zhang and Maxwell L. King Department of Econometrics and Business Statistics Faculty of Business and Economics xibin.zhang@monash.edu Quantitative Methods
More informationRockefeller College University at Albany
Rockefeller College University at Albany Commonly Used Terms, Symbols, and Expressions The lectures, handouts, readings, and problem sets use many terms and symbols which may have been used in different
More informationLimited Dependent Variables and Panel Data
and Panel Data June 24 th, 2009 Structure 1 2 Many economic questions involve the explanation of binary variables, e.g.: explaining the participation of women in the labor market explaining retirement
More information