The Delta Method ECON Tori Kreinbrink & Shawn Enriques December 7, 2017

Size: px
Start display at page:

Download "The Delta Method ECON Tori Kreinbrink & Shawn Enriques December 7, 2017"

Transcription

1 The Delta Method ECON 5350 Tori Kreinbrink & Shawn Enriques December 7, 2017

2 Table of contents 1. Background 2. Delta Method Explained 3. Example 4. Matlab 1

3 Background

4 Review Concepts Taylor Series Approximation Central Limit Theorem & Asymptotic Normality 2

5 Review We often encounter nonlinear functions in econometrics To handle these, we can take Taylor expansion of the function around the true parameter This linear approximation can be used for further analysis 3

6 Taylor Series Approximation The nonlinear function f(x) needs to be approximated. 4

7 Taylor Series Approximation Taylor s theorem says that there exists a c such that f f(b) f(a) (c) =. b a 5

8 Central Limit Theorem & Asymptotic Normality As n, the distribution becomes a normal 6

9 Background What is the delta method used for? The delta method is often used to estimate standard errors. n( ˆβ β 0 ) d N(0, V) ( ) n(f( ˆβ) f(β 0 )) d df 2 N(0, ˆβ=β 0 V) 7

10 Delta Method Explained

11 The Linear Case Let X 1, X 2,...X n N(10, σ 2 = 2). Or in short, we have X i N(10, 2). We can take the linear transformation of this Y i = 4X i + 3 8

12 The Linear Case For real scalar constants a and b we can show that E(a) = a E(aX + b) = ae(x) + b var(a) = 0 var(ax + b) = a 2 var(x) Thus we find, Y N([4(10) + 3 = 43], [(4 2 )(2)]) Y N(43, 32) 9

13 The Nonlinear Case Any differentiable function over a narrow enough region appears approximately linear. The approximating line is the tangent line to the curve, and its slope is the derivative of the function. 10

14 When do we use the Delta Method? We can derive an approximation to the same tangent line by using a Taylor series expansion of f( ˆβ) aroun = β 0 : γ = f( ˆβ) f(β 0 ) + df ˆβ=β ( ˆβ β 0 0 ) = f(β 0 ) + df ˆβ=β ˆβ df 0 ˆβ=β β 0 0. Rearranging this and taking the limits we get: n(f( ˆβ) f(β 0 )) = a df ˆβ=β0 n( ˆβ β 0 ) 11

15 When do we use the Delta Method? We can derive an approximation to the same tangent line by using a Taylor series expansion of f( ˆβ) aroun = β 0 : E(γ) df ˆβ=β β f(β 0 ) df ˆβ=β β 0 0 = f(β 0 ) var(γ) var(f( ( ˆβ)) = f( ˆβ) f(β 0 ) ) 2 = ( df ˆβ=β ( ˆβ β 0 0 )) 2 ( ) df 2 = ˆβ=β0 ( ˆβ β 0 ) 2 ( ) df 2 = ˆβ=β var( ˆβ) 0 12

16 Example

17 Example Government spending multiplier The amount by which equilibrium real GDP changes as a result of a $1 change in autonomous consumption, investment spending, government purchases or net exports. 1, where MPC is the Marginal Propensity to 1 MPC Consume 13

18 Example Government spending multiplier Let s set MPC = ˆβ. We know that that the government spending multiplier is a nonlinear function of the MPC. Let s call this f( ˆβ). 14

19 Government spending multiplier If we know ˆβ N(β 0, σ 2 ) We can do a first-order Taylor series expansion f( ˆβ) f(β 0 ) + df ˆβ=β0 ( ˆβ β 0 ) = f(β 0 ) + df ˆβ=β ˆβ df 0 ˆβ=β β 0 0. Rearranging this and taking the limits we get: n(f( ˆβ) f(β 0 )) = a df ˆβ=β0 n( ˆβ β 0 ) 15

20 Government spending multiplier From the above we can see E(f( ˆβ)) = f(β 0 ) ( ) df 2 var(f( ˆβ)) = var( ˆβ) ˆβ=β 0 Plugging back in... MPC N(MPC0, σ 2 ) ( ) f( MPC) df 2 N(f(MPC 0 ), σ 2 d MPC MPC=MPC0 ) 16

21 Matlab

22 Matlab- Example Model Set-up Suppose we want to find the Spending Multiplier for GDP and do a significance test on its value. The Marginal Propensity to Consume, MPC, is defined as the rate of change of spending from a change in income. MPC = C Y And the Spending Multiplier is a simple transformation of the MPC 1 MULT = 1 MPC 17

23 Matlab- The Problem In order to do the hypothesis test, we need to generate the t-statistic. It is given by t = MULT µ s e ( MULT) s e ( MULT) is NOT KNOWN, but the Delta Method can estimate it. 18

24 Matlab- Example Set-up Because the spending multiplier is not a linear function, it is difficult to estimate the variance. Here s a good example of when to use the Delta Method to estimate it. The MPC along with its variance can be estimated using the this model C t = β 1 + β 2 Y t + ϵ t Using data from FRED for per capita income and personal consumption we can estimate β 2, which is the MPC

25 Matlab- Income and Spending Data Here is a scatter plot of consumption and income. Here, the MPC is the slope of the regression line, β 2. With a variance of σ 2 (X X) 1. 20

26 Matlab- The Delta Method to Estimate Variance After completing the OLS estimate for the MPC (β 2 ), we can use the delta method to estimate the variance of the Spending Multiplier, MULT. Recall that from the Delta method, s e ( MULT) = f (x) 2 V x where, f(mpc) = 1 1 MPC, df dx = 1 (1 MPC) 2 21

27 Matlab- The Solution The hypothesis test can now be completed. Let H o : MULT = 5 and H a : MULT 5 t = MULT µ s e ( MULT) t = MULT µ 2 df Var MPC dmult Lets do some tweaking of the parameters in the Matlab Code. 22

IS-LM Analysis. Math 202. Brian D. Fitzpatrick. Duke University. February 14, 2018 MATH

IS-LM Analysis. Math 202. Brian D. Fitzpatrick. Duke University. February 14, 2018 MATH IS-LM Analysis Math 202 Brian D. Fitzpatrick Duke University February 14, 2018 MATH Overview Background History Variables The GDP Equation Definition of GDP Assumptions The GDP Equation with Assumptions

More information

The Simple Linear Regression Model

The Simple Linear Regression Model The Simple Linear Regression Model Lesson 3 Ryan Safner 1 1 Department of Economics Hood College ECON 480 - Econometrics Fall 2017 Ryan Safner (Hood College) ECON 480 - Lesson 3 Fall 2017 1 / 77 Bivariate

More information

Applied Econometrics - QEM Theme 1: Introduction to Econometrics Chapter 1 + Probability Primer + Appendix B in PoE

Applied Econometrics - QEM Theme 1: Introduction to Econometrics Chapter 1 + Probability Primer + Appendix B in PoE Applied Econometrics - QEM Theme 1: Introduction to Econometrics Chapter 1 + Probability Primer + Appendix B in PoE Warsaw School of Economics Outline 1. Introduction to econometrics 2. Denition of econometrics

More information

The Keynesian Model of Income Determination (revised)

The Keynesian Model of Income Determination (revised) Economics 32 Menzie D. Chinn Spring 2 Social Sciences 748 University of Wisconsin-Madison The Keynesian Model of Income Determination revised This set of notes outlines the Keynesian model of national

More information

ECON501 - Vector Di erentiation Simon Grant

ECON501 - Vector Di erentiation Simon Grant ECON01 - Vector Di erentiation Simon Grant October 00 Abstract Notes on vector di erentiation and some simple economic applications and examples 1 Functions of One Variable g : R! R derivative (slope)

More information

Lab 07 Introduction to Econometrics

Lab 07 Introduction to Econometrics Lab 07 Introduction to Econometrics Learning outcomes for this lab: Introduce the different typologies of data and the econometric models that can be used Understand the rationale behind econometrics Understand

More information

Marginal Propensity to Consume/Save

Marginal Propensity to Consume/Save Marginal Propensity to Consume/Save The marginal propensity to consume is the increase (or decrease) in consumption that an economy experiences when income increases (or decreases). The marginal propensity

More information

ECON Fundamentals of Probability

ECON Fundamentals of Probability ECON 351 - Fundamentals of Probability Maggie Jones 1 / 32 Random Variables A random variable is one that takes on numerical values, i.e. numerical summary of a random outcome e.g., prices, total GDP,

More information

Definition: If y = f(x), then. f(x + x) f(x) y = f (x) = lim. Rules and formulas: 1. If f(x) = C (a constant function), then f (x) = 0.

Definition: If y = f(x), then. f(x + x) f(x) y = f (x) = lim. Rules and formulas: 1. If f(x) = C (a constant function), then f (x) = 0. Definition: If y = f(x), then Rules and formulas: y = f (x) = lim x 0 f(x + x) f(x). x 1. If f(x) = C (a constant function), then f (x) = 0. 2. If f(x) = x k (a power function), then f (x) = kx k 1. 3.

More information

Econ 583 Final Exam Fall 2008

Econ 583 Final Exam Fall 2008 Econ 583 Final Exam Fall 2008 Eric Zivot December 11, 2008 Exam is due at 9:00 am in my office on Friday, December 12. 1 Maximum Likelihood Estimation and Asymptotic Theory Let X 1,...,X n be iid random

More information

EC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix)

EC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix) 1 EC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix) Taisuke Otsu London School of Economics Summer 2018 A.1. Summation operator (Wooldridge, App. A.1) 2 3 Summation operator For

More information

Lecture: Simultaneous Equation Model (Wooldridge s Book Chapter 16)

Lecture: Simultaneous Equation Model (Wooldridge s Book Chapter 16) Lecture: Simultaneous Equation Model (Wooldridge s Book Chapter 16) 1 2 Model Consider a system of two regressions y 1 = β 1 y 2 + u 1 (1) y 2 = β 2 y 1 + u 2 (2) This is a simultaneous equation model

More information

Econ Review Set 2 - Answers

Econ Review Set 2 - Answers Econ 4808 Review Set 2 - Answers EQUILIBRIUM ANALYSIS 1. De ne the concept of equilibrium within the con nes of an economic model. Provide an example of an economic equilibrium. Economic models contain

More information

Chapter 2. Some Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables

Chapter 2. Some Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables Chapter 2 Some Basic Probability Concepts 2.1 Experiments, Outcomes and Random Variables A random variable is a variable whose value is unknown until it is observed. The value of a random variable results

More information

The regression model with one fixed regressor cont d

The regression model with one fixed regressor cont d The regression model with one fixed regressor cont d 3150/4150 Lecture 4 Ragnar Nymoen 27 January 2012 The model with transformed variables Regression with transformed variables I References HGL Ch 2.8

More information

Forecasting. Simultaneous equations bias (Lect 16)

Forecasting. Simultaneous equations bias (Lect 16) Forecasting. Simultaneous equations bias (Lect 16) Ragnar Nymoen University of Oslo 11 April 2013 1 / 20 References Same as to Lecture 15 (as a background to the forecasting part) HGL, Ch 9.7.2 (forecasting

More information

Preliminary Statistics Lecture 3: Probability Models and Distributions (Outline) prelimsoas.webs.com

Preliminary Statistics Lecture 3: Probability Models and Distributions (Outline) prelimsoas.webs.com 1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 3: Probability Models and Distributions (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics,

More information

The multiple regression model; Indicator variables as regressors

The multiple regression model; Indicator variables as regressors The multiple regression model; Indicator variables as regressors Ragnar Nymoen University of Oslo 28 February 2013 1 / 21 This lecture (#12): Based on the econometric model specification from Lecture 9

More information

STATISTICS 1 REVISION NOTES

STATISTICS 1 REVISION NOTES STATISTICS 1 REVISION NOTES Statistical Model Representing and summarising Sample Data Key words: Quantitative Data This is data in NUMERICAL FORM such as shoe size, height etc. Qualitative Data This is

More information

Integration by Substitution

Integration by Substitution Integration by Substitution MATH 151 Calculus for Management J. Robert Buchanan Department of Mathematics Fall 2018 Objectives After this lesson we will be able to use the method of integration by substitution

More information

Chapter 4 AD AS. O. Afonso, P. B. Vasconcelos. Computational Economics: a concise introduction

Chapter 4 AD AS. O. Afonso, P. B. Vasconcelos. Computational Economics: a concise introduction Chapter 4 AD AS O. Afonso, P. B. Vasconcelos Computational Economics: a concise introduction O. Afonso, P. B. Vasconcelos Computational Economics 1 / 32 Overview 1 Introduction 2 Economic model 3 Numerical

More information

More on Distribution Function

More on Distribution Function More on Distribution Function The distribution of a random variable X can be determined directly from its cumulative distribution function F X. Theorem: Let X be any random variable, with cumulative distribution

More information

Appendix A. Math Reviews 03Jan2007. A.1 From Simple to Complex. Objectives. 1. Review tools that are needed for studying models for CLDVs.

Appendix A. Math Reviews 03Jan2007. A.1 From Simple to Complex. Objectives. 1. Review tools that are needed for studying models for CLDVs. Appendix A Math Reviews 03Jan007 Objectives. Review tools that are needed for studying models for CLDVs.. Get you used to the notation that will be used. Readings. Read this appendix before class.. Pay

More information

LECTURE 10: NEYMAN-PEARSON LEMMA AND ASYMPTOTIC TESTING. The last equality is provided so this can look like a more familiar parametric test.

LECTURE 10: NEYMAN-PEARSON LEMMA AND ASYMPTOTIC TESTING. The last equality is provided so this can look like a more familiar parametric test. Economics 52 Econometrics Professor N.M. Kiefer LECTURE 1: NEYMAN-PEARSON LEMMA AND ASYMPTOTIC TESTING NEYMAN-PEARSON LEMMA: Lesson: Good tests are based on the likelihood ratio. The proof is easy in the

More information

Econometrics I KS. Module 1: Bivariate Linear Regression. Alexander Ahammer. This version: March 12, 2018

Econometrics I KS. Module 1: Bivariate Linear Regression. Alexander Ahammer. This version: March 12, 2018 Econometrics I KS Module 1: Bivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: March 12, 2018 Alexander Ahammer (JKU) Module 1: Bivariate

More information

Econ 5410 (former 641) Econometrics I. Prof. J. Huston McCulloch

Econ 5410 (former 641) Econometrics I. Prof. J. Huston McCulloch Econ 5410 (former 641) Econometrics I Prof. J. Huston McCulloch Lecture 1 Introduction Chapter 1 Elementary Statistics Random Variables, distributions Mean, variance Appendi B.1 B.3. Levels of Econometrics

More information

Mankiw Chapter 11. Aggregate Demand I. Building the IS-LM Model

Mankiw Chapter 11. Aggregate Demand I. Building the IS-LM Model Mankiw Chapter 11 Building the IS-LM Model 0 IN THIS CHAPTER, WE WILL COVER: the IS curve and its relation to: the Keynesian cross the LM curve and its relation to: the theory of liquidity preference how

More information

Chapter 8: Taylor s theorem and L Hospital s rule

Chapter 8: Taylor s theorem and L Hospital s rule Chapter 8: Taylor s theorem and L Hospital s rule Theorem: [Inverse Mapping Theorem] Suppose that a < b and f : [a, b] R. Given that f (x) > 0 for all x (a, b) then f 1 is differentiable on (f(a), f(b))

More information

Preliminary Statistics. Lecture 3: Probability Models and Distributions

Preliminary Statistics. Lecture 3: Probability Models and Distributions Preliminary Statistics Lecture 3: Probability Models and Distributions Rory Macqueen (rm43@soas.ac.uk), September 2015 Outline Revision of Lecture 2 Probability Density Functions Cumulative Distribution

More information

ECON3150/4150 Spring 2015

ECON3150/4150 Spring 2015 ECON3150/4150 Spring 2015 Lecture 3&4 - The linear regression model Siv-Elisabeth Skjelbred University of Oslo January 29, 2015 1 / 67 Chapter 4 in S&W Section 17.1 in S&W (extended OLS assumptions) 2

More information

A time series plot: a variable Y t on the vertical axis is plotted against time on the horizontal axis

A time series plot: a variable Y t on the vertical axis is plotted against time on the horizontal axis TIME AS A REGRESSOR A time series plot: a variable Y t on the vertical axis is plotted against time on the horizontal axis Many economic variables increase or decrease with time A linear trend relationship

More information

x = 1 n (x = 1 (x n 1 ι(ι ι) 1 ι x) (x ι(ι ι) 1 ι x) = 1

x = 1 n (x = 1 (x n 1 ι(ι ι) 1 ι x) (x ι(ι ι) 1 ι x) = 1 Estimation and Inference in Econometrics Exercises, January 24, 2003 Solutions 1. a) cov(wy ) = E [(WY E[WY ])(WY E[WY ]) ] = E [W(Y E[Y ])(Y E[Y ]) W ] = W [(Y E[Y ])(Y E[Y ]) ] W = WΣW b) Let Σ be a

More information

Economics 583: Econometric Theory I A Primer on Asymptotics

Economics 583: Econometric Theory I A Primer on Asymptotics Economics 583: Econometric Theory I A Primer on Asymptotics Eric Zivot January 14, 2013 The two main concepts in asymptotic theory that we will use are Consistency Asymptotic Normality Intuition consistency:

More information

Regression #4: Properties of OLS Estimator (Part 2)

Regression #4: Properties of OLS Estimator (Part 2) Regression #4: Properties of OLS Estimator (Part 2) Econ 671 Purdue University Justin L. Tobias (Purdue) Regression #4 1 / 24 Introduction In this lecture, we continue investigating properties associated

More information

Final Exam. Economics 835: Econometrics. Fall 2010

Final Exam. Economics 835: Econometrics. Fall 2010 Final Exam Economics 835: Econometrics Fall 2010 Please answer the question I ask - no more and no less - and remember that the correct answer is often short and simple. 1 Some short questions a) For each

More information

The linear regression model: functional form and structural breaks

The linear regression model: functional form and structural breaks The linear regression model: functional form and structural breaks Ragnar Nymoen Department of Economics, UiO 16 January 2009 Overview Dynamic models A little bit more about dynamics Extending inference

More information

Probability. Paul Schrimpf. January 23, Definitions 2. 2 Properties 3

Probability. Paul Schrimpf. January 23, Definitions 2. 2 Properties 3 Probability Paul Schrimpf January 23, 2018 Contents 1 Definitions 2 2 Properties 3 3 Random variables 4 3.1 Discrete........................................... 4 3.2 Continuous.........................................

More information

Gov 2000: 9. Regression with Two Independent Variables

Gov 2000: 9. Regression with Two Independent Variables Gov 2000: 9. Regression with Two Independent Variables Matthew Blackwell Fall 2016 1 / 62 1. Why Add Variables to a Regression? 2. Adding a Binary Covariate 3. Adding a Continuous Covariate 4. OLS Mechanics

More information

Problem Set #6: OLS. Economics 835: Econometrics. Fall 2012

Problem Set #6: OLS. Economics 835: Econometrics. Fall 2012 Problem Set #6: OLS Economics 835: Econometrics Fall 202 A preliminary result Suppose we have a random sample of size n on the scalar random variables (x, y) with finite means, variances, and covariance.

More information

ECON 4160, Spring term 2015 Lecture 7

ECON 4160, Spring term 2015 Lecture 7 ECON 4160, Spring term 2015 Lecture 7 Identification and estimation of SEMs (Part 1) Ragnar Nymoen Department of Economics 8 Oct 2015 1 / 55 HN Ch 15 References to Davidson and MacKinnon, Ch 8.1-8.5 Ch

More information

Discrete Dependent Variable Models

Discrete Dependent Variable Models Discrete Dependent Variable Models James J. Heckman University of Chicago This draft, April 10, 2006 Here s the general approach of this lecture: Economic model Decision rule (e.g. utility maximization)

More information

ECONOMICS TRIPOS PART I. Friday 15 June to 12. Paper 3 QUANTITATIVE METHODS IN ECONOMICS

ECONOMICS TRIPOS PART I. Friday 15 June to 12. Paper 3 QUANTITATIVE METHODS IN ECONOMICS ECONOMICS TRIPOS PART I Friday 15 June 2007 9 to 12 Paper 3 QUANTITATIVE METHODS IN ECONOMICS This exam comprises four sections. Sections A and B are on Mathematics; Sections C and D are on Statistics.

More information

Math 10b Ch. 8 Reading 1: Introduction to Taylor Polynomials

Math 10b Ch. 8 Reading 1: Introduction to Taylor Polynomials Math 10b Ch. 8 Reading 1: Introduction to Taylor Polynomials Introduction: In applications, it often turns out that one cannot solve the differential equations or antiderivatives that show up in the real

More information

ECON2285: Mathematical Economics

ECON2285: Mathematical Economics ECON2285: Mathematical Economics Yulei Luo FBE, HKU September 2, 2018 Luo, Y. (FBE, HKU) ME September 2, 2018 1 / 35 Course Outline Economics: The study of the choices people (consumers, firm managers,

More information

Econ 300/QAC 201: Quantitative Methods in Economics/Applied Data Analysis. 18th Class 7/2/10

Econ 300/QAC 201: Quantitative Methods in Economics/Applied Data Analysis. 18th Class 7/2/10 Econ 300/QAC 201: Quantitative Methods in Economics/Applied Data Analysis 18th Class 7/2/10 Out of the air a voice without a face Proved by statistics that some cause was just In tones as dry and level

More information

Motivation Non-linear Rational Expectations The Permanent Income Hypothesis The Log of Gravity Non-linear IV Estimation Summary.

Motivation Non-linear Rational Expectations The Permanent Income Hypothesis The Log of Gravity Non-linear IV Estimation Summary. Econometrics I Department of Economics Universidad Carlos III de Madrid Master in Industrial Economics and Markets Outline Motivation 1 Motivation 2 3 4 5 Motivation Hansen's contributions GMM was developed

More information

Assignment #5. 1 Keynesian Cross. Econ 302: Intermediate Macroeconomics. December 2, 2009

Assignment #5. 1 Keynesian Cross. Econ 302: Intermediate Macroeconomics. December 2, 2009 Assignment #5 Econ 0: Intermediate Macroeconomics December, 009 Keynesian Cross Consider a closed economy. Consumption function: C = C + M C(Y T ) () In addition, suppose that planned investment expenditure

More information

MAS113 Introduction to Probability and Statistics. Proofs of theorems

MAS113 Introduction to Probability and Statistics. Proofs of theorems MAS113 Introduction to Probability and Statistics Proofs of theorems Theorem 1 De Morgan s Laws) See MAS110 Theorem 2 M1 By definition, B and A \ B are disjoint, and their union is A So, because m is a

More information

Joint Distribution of Two or More Random Variables

Joint Distribution of Two or More Random Variables Joint Distribution of Two or More Random Variables Sometimes more than one measurement in the form of random variable is taken on each member of the sample space. In cases like this there will be a few

More information

Tutorial 2: Comparative Statics

Tutorial 2: Comparative Statics Tutorial 2: Comparative Statics ECO42F 20 Derivatives and Rules of Differentiation For each of the functions below: (a) Find the difference quotient. (b) Find the derivative dx. (c) Find f (4) and f (3)..

More information

Department of Economics Queen s University. ECON435/835: Development Economics Professor: Huw Lloyd-Ellis

Department of Economics Queen s University. ECON435/835: Development Economics Professor: Huw Lloyd-Ellis Department of Economics Queen s University ECON435/835: Development Economics Professor: Huw Lloyd-Ellis Assignment # Answer Guide Due Date:.30 a.m., Monday October, 202. (48 percent) Let s see the extent

More information

Violation of OLS assumption - Heteroscedasticity

Violation of OLS assumption - Heteroscedasticity Violation of OLS assumption - Heteroscedasticity What, why, so what and what to do? Lars Forsberg Uppsala Uppsala University, Department of Statistics October 22, 2014 Lars Forsberg (Uppsala University)

More information

Inferential Statistics

Inferential Statistics Inferential Statistics Correlation Pearson s Correlation Coefficient, r Regression OLS (Ordinary Least Squares Method) R 2 Normal Distribution Interval Estimation of the Prediction Error Sample and Population

More information

11. Regression and Least Squares

11. Regression and Least Squares 11. Regression and Least Squares Prof. Tesler Math 186 Winter 2016 Prof. Tesler Ch. 11: Linear Regression Math 186 / Winter 2016 1 / 23 Regression Given n points ( 1, 1 ), ( 2, 2 ),..., we want to determine

More information

Linear Regression. Junhui Qian. October 27, 2014

Linear Regression. Junhui Qian. October 27, 2014 Linear Regression Junhui Qian October 27, 2014 Outline The Model Estimation Ordinary Least Square Method of Moments Maximum Likelihood Estimation Properties of OLS Estimator Unbiasedness Consistency Efficiency

More information

Random Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay

Random Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay 1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued

More information

ES103 Introduction to Econometrics

ES103 Introduction to Econometrics Anita Staneva May 16, ES103 2015Introduction to Econometrics.. Lecture 1 ES103 Introduction to Econometrics Lecture 1: Basic Data Handling and Anita Staneva Egypt Scholars Economic Society Outline Introduction

More information

Correlation and Regression

Correlation and Regression Correlation and Regression October 25, 2017 STAT 151 Class 9 Slide 1 Outline of Topics 1 Associations 2 Scatter plot 3 Correlation 4 Regression 5 Testing and estimation 6 Goodness-of-fit STAT 151 Class

More information

Chapter 12 - Lecture 2 Inferences about regression coefficient

Chapter 12 - Lecture 2 Inferences about regression coefficient Chapter 12 - Lecture 2 Inferences about regression coefficient April 19th, 2010 Facts about slope Test Statistic Confidence interval Hypothesis testing Test using ANOVA Table Facts about slope In previous

More information

ECON0702: Mathematical Methods in Economics

ECON0702: Mathematical Methods in Economics ECON0702: Mathematical Methods in Economics Yulei Luo SEF of HKU January 14, 2009 Luo, Y. (SEF of HKU) MME January 14, 2009 1 / 44 Comparative Statics and The Concept of Derivative Comparative Statics

More information

Random Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R

Random Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample

More information

Monetary Policy in a Macro Model

Monetary Policy in a Macro Model Monetary Policy in a Macro Model ECON 40364: Monetary Theory & Policy Eric Sims University of Notre Dame Fall 2017 1 / 67 Readings Mishkin Ch. 20 Mishkin Ch. 21 Mishkin Ch. 22 Mishkin Ch. 23, pg. 553-569

More information

Statistics 910, #5 1. Regression Methods

Statistics 910, #5 1. Regression Methods Statistics 910, #5 1 Overview Regression Methods 1. Idea: effects of dependence 2. Examples of estimation (in R) 3. Review of regression 4. Comparisons and relative efficiencies Idea Decomposition Well-known

More information

ECON 497: Lecture Notes 10 Page 1 of 1

ECON 497: Lecture Notes 10 Page 1 of 1 ECON 497: Lecture Notes 10 Page 1 of 1 Metropolitan State University ECON 497: Research and Forecasting Lecture Notes 10 Heteroskedasticity Studenmund Chapter 10 We'll start with a quote from Studenmund:

More information

9. Linear Regression and Correlation

9. Linear Regression and Correlation 9. Linear Regression and Correlation Data: y a quantitative response variable x a quantitative explanatory variable (Chap. 8: Recall that both variables were categorical) For example, y = annual income,

More information

Probability. Paul Schrimpf. January 23, UBC Economics 326. Probability. Paul Schrimpf. Definitions. Properties. Random variables.

Probability. Paul Schrimpf. January 23, UBC Economics 326. Probability. Paul Schrimpf. Definitions. Properties. Random variables. Probability UBC Economics 326 January 23, 2018 1 2 3 Wooldridge (2013) appendix B Stock and Watson (2009) chapter 2 Linton (2017) chapters 1-5 Abbring (2001) sections 2.1-2.3 Diez, Barr, and Cetinkaya-Rundel

More information

Statistics 203 Introduction to Regression Models and ANOVA Practice Exam

Statistics 203 Introduction to Regression Models and ANOVA Practice Exam Statistics 203 Introduction to Regression Models and ANOVA Practice Exam Prof. J. Taylor You may use your 4 single-sided pages of notes This exam is 7 pages long. There are 4 questions, first 3 worth 10

More information

Extended IS-LM model - construction and analysis of behavior

Extended IS-LM model - construction and analysis of behavior Extended IS-LM model - construction and analysis of behavior David Martinčík Department of Economics and Finance, Faculty of Economics, University of West Bohemia, martinci@kef.zcu.cz Blanka Šedivá Department

More information

Multi Variable Calculus

Multi Variable Calculus Multi Variable Calculus Joshua Wilde, revised by Isabel Tecu, Takeshi Suzuki and María José Boccardi August 3, 03 Functions from R n to R m So far we have looked at functions that map one number to another

More information

1 Probability theory. 2 Random variables and probability theory.

1 Probability theory. 2 Random variables and probability theory. Probability theory Here we summarize some of the probability theory we need. If this is totally unfamiliar to you, you should look at one of the sources given in the readings. In essence, for the major

More information

ECON 186 Class Notes: Derivatives and Differentials

ECON 186 Class Notes: Derivatives and Differentials ECON 186 Class Notes: Derivatives and Differentials Jijian Fan Jijian Fan ECON 186 1 / 27 Partial Differentiation Consider a function y = f (x 1,x 2,...,x n ) where the x i s are all independent, so each

More information

Chapter 9 Solow. O. Afonso, P. B. Vasconcelos. Computational Economics: a concise introduction

Chapter 9 Solow. O. Afonso, P. B. Vasconcelos. Computational Economics: a concise introduction Chapter 9 Solow O. Afonso, P. B. Vasconcelos Computational Economics: a concise introduction O. Afonso, P. B. Vasconcelos Computational Economics 1 / 27 Overview 1 Introduction 2 Economic model 3 Computational

More information

ECON0702: Mathematical Methods in Economics

ECON0702: Mathematical Methods in Economics ECON0702: Mathematical Methods in Economics Yulei Luo SEF of HKU January 12, 2009 Luo, Y. (SEF of HKU) MME January 12, 2009 1 / 35 Course Outline Economics: The study of the choices people (consumers,

More information

Test code: ME I/ME II, 2004 Syllabus for ME I. Matrix Algebra: Matrices and Vectors, Matrix Operations, Determinants,

Test code: ME I/ME II, 2004 Syllabus for ME I. Matrix Algebra: Matrices and Vectors, Matrix Operations, Determinants, Test code: ME I/ME II, 004 Syllabus for ME I Matri Algebra: Matrices and Vectors, Matri Operations, Determinants, Nonsingularity, Inversion, Cramer s rule. Calculus: Limits, Continuity, Differentiation

More information

Brandon C. Kelly (Harvard Smithsonian Center for Astrophysics)

Brandon C. Kelly (Harvard Smithsonian Center for Astrophysics) Brandon C. Kelly (Harvard Smithsonian Center for Astrophysics) Probability quantifies randomness and uncertainty How do I estimate the normalization and logarithmic slope of a X ray continuum, assuming

More information

Practical Econometrics. for. Finance and Economics. (Econometrics 2)

Practical Econometrics. for. Finance and Economics. (Econometrics 2) Practical Econometrics for Finance and Economics (Econometrics 2) Seppo Pynnönen and Bernd Pape Department of Mathematics and Statistics, University of Vaasa 1. Introduction 1.1 Econometrics Econometrics

More information

Financial Econometrics Lecture 6: Testing the CAPM model

Financial Econometrics Lecture 6: Testing the CAPM model Financial Econometrics Lecture 6: Testing the CAPM model Richard G. Pierse 1 Introduction The capital asset pricing model has some strong implications which are testable. The restrictions that can be tested

More information

MAS113 Introduction to Probability and Statistics. Proofs of theorems

MAS113 Introduction to Probability and Statistics. Proofs of theorems MAS113 Introduction to Probability and Statistics Proofs of theorems Theorem 1 De Morgan s Laws) See MAS110 Theorem 2 M1 By definition, B and A \ B are disjoint, and their union is A So, because m is a

More information

Empirical Application of Simple Regression (Chapter 2)

Empirical Application of Simple Regression (Chapter 2) Empirical Application of Simple Regression (Chapter 2) 1. The data file is House Data, which can be downloaded from my webpage. 2. Use stata menu File Import Excel Spreadsheet to read the data. Don t forget

More information

PROBLEM SET 1 (Solutions) (MACROECONOMICS cl. 15)

PROBLEM SET 1 (Solutions) (MACROECONOMICS cl. 15) PROBLEM SET (Solutions) (MACROECONOMICS cl. 5) Exercise Calculating GDP In an economic system there are two sectors A and B. The sector A: - produces value added or a value o 50; - pays wages or a value

More information

Introduction to Linear regression analysis. Part 2. Model comparisons

Introduction to Linear regression analysis. Part 2. Model comparisons Introduction to Linear regression analysis Part Model comparisons 1 ANOVA for regression Total variation in Y SS Total = Variation explained by regression with X SS Regression + Residual variation SS Residual

More information

From last time... The equations

From last time... The equations This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this

More information

Chapter 2 The Simple Linear Regression Model: Specification and Estimation

Chapter 2 The Simple Linear Regression Model: Specification and Estimation Chapter The Simple Linear Regression Model: Specification and Estimation Page 1 Chapter Contents.1 An Economic Model. An Econometric Model.3 Estimating the Regression Parameters.4 Assessing the Least Squares

More information

Economics 121b: Intermediate Microeconomics Midterm Suggested Solutions 2/8/ (a) The equation of the indifference curve is given by,

Economics 121b: Intermediate Microeconomics Midterm Suggested Solutions 2/8/ (a) The equation of the indifference curve is given by, Dirk Bergemann Department of Economics Yale University Economics 121b: Intermediate Microeconomics Midterm Suggested Solutions 2/8/12 1. (a) The equation of the indifference curve is given by, (x 1 + 2)

More information

Topics. Estimation. Regression Through the Origin. Basic Econometrics in Transportation. Bivariate Regression Discussion

Topics. Estimation. Regression Through the Origin. Basic Econometrics in Transportation. Bivariate Regression Discussion 1/24 Topics Basic Econometrics in Transportation Bivariate Regression Discussion Amir Samimi Civil Engineering Department Sharif University of Technology First we consider the case of regression through

More information

Chapter 2 Polynomial and Rational Functions

Chapter 2 Polynomial and Rational Functions Chapter 2 Polynomial and Rational Functions Overview: 2.2 Polynomial Functions of Higher Degree 2.3 Real Zeros of Polynomial Functions 2.4 Complex Numbers 2.5 The Fundamental Theorem of Algebra 2.6 Rational

More information

Lecture 6: Dynamic Models

Lecture 6: Dynamic Models Lecture 6: Dynamic Models R.G. Pierse 1 Introduction Up until now we have maintained the assumption that X values are fixed in repeated sampling (A4) In this lecture we look at dynamic models, where the

More information

Estimating σ 2. We can do simple prediction of Y and estimation of the mean of Y at any value of X.

Estimating σ 2. We can do simple prediction of Y and estimation of the mean of Y at any value of X. Estimating σ 2 We can do simple prediction of Y and estimation of the mean of Y at any value of X. To perform inferences about our regression line, we must estimate σ 2, the variance of the error term.

More information

Unit #4 : Interpreting Derivatives, Local Linearity, Marginal Rates

Unit #4 : Interpreting Derivatives, Local Linearity, Marginal Rates Unit #4 : Interpreting Derivatives, Local Linearity, Marginal Rates Goals: Develop natural language interpretations of the derivative Create and use linearization/tangent line formulae Describe marginal

More information

Chapter 4. Continuous Random Variables 4.1 PDF

Chapter 4. Continuous Random Variables 4.1 PDF Chapter 4 Continuous Random Variables In this chapter we study continuous random variables. The linkage between continuous and discrete random variables is the cumulative distribution (CDF) which we will

More information

F X (x) = P [X x] = x f X (t)dt. 42 Lebesgue-a.e, to be exact 43 More specifically, if g = f Lebesgue-a.e., then g is also a pdf for X.

F X (x) = P [X x] = x f X (t)dt. 42 Lebesgue-a.e, to be exact 43 More specifically, if g = f Lebesgue-a.e., then g is also a pdf for X. 10.2 Properties of PDF and CDF for Continuous Random Variables 10.18. The pdf f X is determined only almost everywhere 42. That is, given a pdf f for a random variable X, if we construct a function g by

More information

ECE353: Probability and Random Processes. Lecture 7 -Continuous Random Variable

ECE353: Probability and Random Processes. Lecture 7 -Continuous Random Variable ECE353: Probability and Random Processes Lecture 7 -Continuous Random Variable Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu Continuous

More information

Lecture 3: Multiple Regression

Lecture 3: Multiple Regression Lecture 3: Multiple Regression R.G. Pierse 1 The General Linear Model Suppose that we have k explanatory variables Y i = β 1 + β X i + β 3 X 3i + + β k X ki + u i, i = 1,, n (1.1) or Y i = β j X ji + u

More information

Chapter 4. Continuous Random Variables

Chapter 4. Continuous Random Variables Chapter 4. Continuous Random Variables Review Continuous random variable: A random variable that can take any value on an interval of R. Distribution: A density function f : R R + such that 1. non-negative,

More information

MULTIVARIATE PROBABILITY DISTRIBUTIONS

MULTIVARIATE PROBABILITY DISTRIBUTIONS MULTIVARIATE PROBABILITY DISTRIBUTIONS. PRELIMINARIES.. Example. Consider an experiment that consists of tossing a die and a coin at the same time. We can consider a number of random variables defined

More information

1 Regression with Time Series Variables

1 Regression with Time Series Variables 1 Regression with Time Series Variables With time series regression, Y might not only depend on X, but also lags of Y and lags of X Autoregressive Distributed lag (or ADL(p; q)) model has these features:

More information

CHAPTER 5 FUNCTIONAL FORMS OF REGRESSION MODELS

CHAPTER 5 FUNCTIONAL FORMS OF REGRESSION MODELS CHAPTER 5 FUNCTIONAL FORMS OF REGRESSION MODELS QUESTIONS 5.1. (a) In a log-log model the dependent and all explanatory variables are in the logarithmic form. (b) In the log-lin model the dependent variable

More information

CHAPTER 7. An Introduction to Numerical Methods for. Linear and Nonlinear ODE s

CHAPTER 7. An Introduction to Numerical Methods for. Linear and Nonlinear ODE s A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 1 A COLLECTION OF HANDOUTS ON FIRST ORDER ORDINARY DIFFERENTIAL

More information

Linear IV and Simultaneous Equations

Linear IV and Simultaneous Equations Linear IV and Daniel Schmierer Econ 312 April 6, 2007 Setup Linear regression model Y = X β + ε (1) Endogeneity of X means that X and ε are correlated, ie. E(X ε) 0. Suppose we observe another variable

More information

Recitation 1: Regression Review. Christina Patterson

Recitation 1: Regression Review. Christina Patterson Recitation 1: Regression Review Christina Patterson Outline For Recitation 1. Statistics. Bias, sampling variance and hypothesis testing.. Two important statistical theorems: Law of large numbers (LLN)

More information