Solutions for Econometrics I Homework No.3

Size: px
Start display at page:

Download "Solutions for Econometrics I Homework No.3"

Transcription

1 Solutions for Econometrics I Homework No3 due Feldkircher, Forstner, Ghoddusi, Pichler, Reiss, Yan, Zeugner April 7, 6 Exercise 31 We have the following model: y T N 1 X T N Nk β Nk 1 + u T N 1 In Matrix notation this looks like: y 11 y 1T y N1 y NT X 1T k X T k X NT k β 1k 1 β k 1 β Nk 1 + u 11 u 1T u N1 u NT The cont correlation among the observations Eu i,t u j,t σ ij and Eu it σ i results into a VCV of the following form: Σ uut N T N σ 1I T σ 1, I T σ 1N I T σ I T σ N,1 I T σ N I T 1

2 To write the VCV in more compact form we introduce Σ N N given by: σ 1 σ 1, σ 1N σ Σ N N σ N,1 σn We can write now Σ uut N T N Σ N N I T The generalized least squares estimator is given by: β GLS [X Σ 1 I T X] 1 [X Σ 1 I T y] Show that if X 1 X X 3 X N X then β GLS coincides with the OlS estimator for N seperate OLS Regressions The X-matrix X T N Nk looks now like X X X

3 which can be rewritten as X I N X T k The GLS estimator then becomes: β GLS [X Σ 1 I T X] 1 [X Σ 1 I T y] 1 [I N X k T Σ 1 N N I T I N X T k ] 1 [I N X Σ 1 I T y N 1 ] [Σ 1 N N X k T I N X T k ] 1 [Σ 1 X y] 3 [Σ 1 N N X X k k ] 1 [Σ 1 X y] 4 [Σ 1 N N X X k k 1 ][Σ 1 X y] 5 [Σ N N Σ 1 }{{ N N } X X 1X ]y 6 I N I N X X 1 X y 7 X X 1 X y 1 8 X X 1 X y N Where we have used the following rules concerning the Kronecker product: For A, B nonsingular it holds that For A, B with matching dimensions A B 1 A 1 B 1 A BC D AC BD Exercise 3 i Show that the function fy 1 π it integrates to one over R Show that y y dy π 3 is a density function, ie show that

4 One may split up the integral on the left-hand side: y dy y dy + y dy y dy 9 Now take the square of it and rename y into t in one factor Since the integral with respect to t can be considered constant with respect to y, it may by put into the integral with respect to y: y dy t dt y dy t dt y dy Now substitute in 1 for t xy, which implies dt y dx Note: we substitute for t since it is in the inner integral and thus y can be regarded as constant? right? y x y dx y dy 1 + x y y dx dy By Fubini s Theorem*, we may interchange the -signs in 1 Now set z : 1+x y, ie y z y 1 + x y and dy 1+x x dy dx dz : 1+x z z dz dx We know the antiderivative of the inner integral : z z dz z 1 1 4

5 Substituting into the entire ression, and remembering that the resulting formula is the definition of arc tan yields the following ression for 1: So we know that Since the ression y x dx arc tan x π y dy π is non-negative over the interval [, ], the whole ression 9 and its integral is non-negative, therefore the root of it is non-negative as well y dy which is what we aimed to show y π dy π Any non-negative Lebesgue-integrable function fx on R with total integral over fxdx is a density function for some probability distribution and vice versa R Note: we could equally have used Fubini s Theorem in order to transform y dy into polar coordinates see Gaussian_integral * Outline of use of Fubini s Theorem in this exercise: Let µ and ν some σ-finite measures on Ω 1, B 1 and Ω, B respectively Further let fx, y L + Ω 1 Ω, B 1 B, µ ν Then f dµ ν fx, y dνy dµx fx, y dνx dµy ii variance 1 Show that a random variable with density function fy has mean and Ey y fydy 1 π y y dy 5

6 The antiderivative of y Therefore Ie Ey d dy y y Since Ey, Vary Ey : Vary is easily recognized: y y y dy y fydy 1 π y y y y y dy For this we use partial integration: b a uv uv b a b a u v where we set u y and v y y : 1 π y y + y dy }{{} π by i The first summand in the above ression is zero since vanishes faster as any polynomial as y : y y Hence we have Vary 1 π π 1 y lim n + n n n Exercise 33 Let z i for i 1,, T be independently distributed N, σ Denote with z 1 T T t1 z t the empirical mean and with s 1 T T t1 z t z the empirical variance Show that T s σ 6

7 is X T 1 distributed From our Q1 Theorem we know that the quadratic form Q z Az σ is X r,λ distributed, with λ µ Aµ σ form and A being a projector with rkar Proof: Since in our example µ it follows that λ Now consider the quadratic T s T 1 σ σ T T z t z t1 1 σ z I T 11 T I T 11 T z z I T 11 T z σ We know from a previous exercise, that I T 11 is a projector projecting on the T orthocomplement of the space spanned by 1 Hence its rank is equal to T 1 So we can apply the Q1 Theorem, whith A I T 11, λ to get that T is X T 1 distributed Q z Az σ Exercise 34 Show that the ected value under the true probability measure of the score is equal to, ie Esθ y and that the variance of the score is equal to the information matrix Iθ y Remark: you can assume throughout that you can interchange differentiation and integration when necessary or helpful The random variable is y which is a function from a σ-field in a probability space to R Moreover any transformation R R applied on y is still a random variable The probability measure of, x] is thus the function x fydy which satisfies the requirements for a probability measure 7

8 We know Therefore: E θ sθ y sθ y : θ lθ y θ lnfy θ θ fy θ fy θ θ lθ yfy θdy θ fy θdy θ fy θ fy θ fy θdy Here we may change integration and differentiation signs if there exists a function gy, θ such that fy,θ +δ fy,θ gx, θ δ and gy, θ R dy 1 E θ sθ y θ fy θdy d 1fy θdy d dθ dθ 1 }{{} E11 is: We know θ sθ y θ lnfy θ The score lnfy θ θ θ [ fy θ ] is a vector whose i-th element θ i fy θ i Differentiating this ression with respect to the vector θ is equivalent to differentiating each element of the score This results into a matrix, whose i-j-th entry is the following: [ θ j fy θ θ i fy θ ] i,j fy θ θ j θ i fy θ fy θ θ j θ i fy θ fy θ θ j fy θ fy θ θ j fy θ }{{} j-th element of the score fy θ θ i fy θ fy θ θ i i,j Since the latter two terms are equal to the j-th and the i-th element of the score, respectively, while the very first second derivative is equal the i-j-th entry of the Hessian of f, we may write the matrix whose i-j-th element is given above as: θ sθ y 1 fy θ H f sθ ysθ y 1 compare Casella/Berger 199: Statistical Inference; Duxbury Press, Belmont, CA p7 i,j 8

9 Taking the ected value of the i,j-th element yields the following: [ ] E s i θ y fy θ θ j θ i θ j i,j fy θ s iθ ys j θ y fy θdy [ ] fy θ dy E s i θ ys j θ y θ j θ i i,j The integral first ression the second derivative thing is zero if we may interchange integration and differentiation signs: fy θdy fy θdy θ j θ i θ i θ } i {{} * Where we know that ression * is zero from the first part of Exercise 34 i,j Knowing that θ sθ y E l, the Hessian of l, we have: θ θ l θ θ E sθ ysθ y E H l θ y E sθ ysθ y Therefore the two definitions of the information Iθ y yield the same result Exercise 35 proof of Lemma : F b β e β X X b β e β σ T k bu bu m σ is F m,t k The denominator bu bu σ is χ T k we know that by theorem Q4 β β X X 1 R [ RX X 1 R ] 1 R β r 9

10 so we can rearrange: β β X X β β R β r [ RX X 1 R ] 1 RX X 1 X XX X 1 R [ RX X 1 R ] 1 R β r R β r [ RX X 1 R ] 1 R β r null hypothesis holds: Rβ r we know that β X X 1 X y X X 1 X Xβ + u β + X X 1 X u R β r Rβ r + RX X 1 X u as Rβ r by assumption Plugging in above yields: So [ R β r ] RX X 1 R 1 [ R β r u XX X 1 R ] RX X 1 R 1 RX X 1 X u Note that the matrix between the u is symmetric and idempotent and has Rank m number of restrictions rank of R So by Theorem Q1, this quantity divided by σ is χ m as the u are centered As û I P y I P u where P XX X 1 X we can write: F β β X X β β T k û û m [ u XX X 1 R ] RX X 1 R 1 RX X 1 X u T k u I P u m What s left to check for proving that the whole quantity is F m,t k is the independence of the denominator and the nominator Note that I P XX X 1 By theorem Q3, this establishes independence X XX X 1 X X X X 1 1

11 β β, where Rβ r if this is the case, we know from class theorem Q5 and the stuff before that β β β + X + u β [ X + u + Xβ β ] u + Xβ β is NXβ β, σ I T Caution: This conclusion is incorrect: We did the correct thing in class F β β X X β β T k û û m u + Xβ β XX X 1 X XX X 1 X u + Xβ β T k u I P u m u + Xβ β XX X 1 X XX X 1 X u + Xβ β T k u I P u m u + Xβ β XX X 1 X u + Xβ β T k u I P u m By theorem Q1, the nominator divided by σ is χ λ k as XX X 1 X is symmetric and idempotent λ β e β X Xβ e β σ Note that I P XX X 1 X So by theorem Q3, denominator and nominator are independent has rank k and Exercise 36 leave out T k and m ũ ũ û û û û ũ ũ û û 1 ũ ũ/t û û/t 1 1 R 1 R 1 1 R 1 R R R 1 R 1 R Exercise 37 Exercise 37 is very similar to Exercise 35 11

12 Exercise 38 Denote with ˆβ the unrestricted OLS estimator and with β the restricted OLS estimator under the restriction Rβ r Then the quantities R ˆβ r RX X 1 R 1 R ˆβ r and ˆβ β X X ˆβ β are equal and can be written, by Lemma 3, as ũ ũ û û ˆβ X X 1 X y, β ˆβ QR ˆβ r with Q X X 1 R [RX X 1 R ] 1 Thus ˆβ β QR ˆβ r and ˆβ β X X ˆβ β R ˆβ r Q X XQR ˆβ r Now Q [ X X 1 R [RX X 1 R ] 1] [ [RX X 1 R ] ] 1 [ X X 1 R ] [ R[RX X 1 ] ] 1 RX X 1 [ RX X 1 R ] 1 RX X 1 Thus ˆβ β X X ˆβ β R ˆβ r [ RX X 1 R ] 1 RX X 1 X XX X 1 R [RX X 1 R ] 1 R ˆβ r R ˆβ r [ RX X 1 R ] 1 [ RX X 1 R ] [ RX X 1 R ] 1 R ˆβ r R ˆβ r [ RX X 1 R ] 1 R ˆβ r QED Exercise 39 Show Lemma 7 y X β M 1 y X β y X ˆβ y X ˆβ + ˆβ β H ˆβ β Proof: Let y X β y x ˆβ + x ˆβ X β y x ˆβ + x 1 ˆβ1 + x ˆβ β, then we have 1

13 y X β M 1 y X β [y x ˆβ + x 1 ˆβ1 + x ˆβ β] M 1 [y x ˆβ + x 1 ˆβ1 + x ˆβ β] y x ˆβ M }{{} 1 y x ˆβ + y x ˆβ {}}{ M 1 X }{{} 1 ˆβ 1 + y x ˆβ M 1 X }{{} ˆβ û û β + ˆβ 1 X 1M }{{} 1 X ˆβ β + ˆβ β X M 1 X }{{} ˆβ β H We know that M 1 is orthogonal to the space spanned by colx 1, thus M 1 X 1 and û [colx 1, X ] [colx 1 ], so û M 1 û Similarly, û [colx ], so û X Hence the right side of the equation above only remains y X ˆβ y X ˆβ + ˆβ β H ˆβ β, which is just what we have to show Exercise 31, first part i Show Lemma 8 of the document Some Basics on Testing : Under the null hypothesis that β β with β R k, the quantity is F k,t k distributed F ˆβ β H ˆβ β T k û û k By the Frisch-Waugh Theorem ˆβ X M 1 X 1 X M 1 y Under the Null-Hypothesis, we hence receive Y X β + u 13

14 Inserting this into ˆβ yields ˆβ X M 1 X 1 X M 1 X β + X M 1 X 1 X M 1 u β + X M 1 X 1 X M 1 u We also know that H X M 1 X Inserting these into the nominator above yields u X M 1 X 1 X M 1 X M 1 X X M 1 X 1 X }{{} M 1 u I u M 1X X M 1 X 1 X M }{{} 1 u symmetric+idempotent The rank of this projector is k By Theorem Q1 and exercise 35 we hence know that this, if divided by σ, is distributed as χ m We also again know by Theorem Q4 that the denominator is, if divided by σ, distributed as χ T k So what remains is to show independence by multiplying both projectors and receiving: I X + X }{{} I P X X + }{{} idempotent X X + X X + 14

15 Again by Theorem Q3 this establishes independence ii Derive the distribution of the quantity F when the ture value of β is equal to some arbitrary, fixed β Exercise 311 Exercise 311 is concerned with MATLAB programming in groups of two 15

Solutions for Econometrics I Homework No.1

Solutions for Econometrics I Homework No.1 Solutions for Econometrics I Homework No.1 due 2006-02-20 Feldkircher, Forstner, Ghoddusi, Grafenhofer, Pichler, Reiss, Yan, Zeugner Exercise 1.1 Structural form of the problem: 1. q d t = α 0 + α 1 p

More information

The outline for Unit 3

The outline for Unit 3 The outline for Unit 3 Unit 1. Introduction: The regression model. Unit 2. Estimation principles. Unit 3: Hypothesis testing principles. 3.1 Wald test. 3.2 Lagrange Multiplier. 3.3 Likelihood Ratio Test.

More information

Interpreting Regression Results

Interpreting Regression Results Interpreting Regression Results Carlo Favero Favero () Interpreting Regression Results 1 / 42 Interpreting Regression Results Interpreting regression results is not a simple exercise. We propose to split

More information

Linear Models Review

Linear Models Review Linear Models Review Vectors in IR n will be written as ordered n-tuples which are understood to be column vectors, or n 1 matrices. A vector variable will be indicted with bold face, and the prime sign

More information

LECTURE 10: NEYMAN-PEARSON LEMMA AND ASYMPTOTIC TESTING. The last equality is provided so this can look like a more familiar parametric test.

LECTURE 10: NEYMAN-PEARSON LEMMA AND ASYMPTOTIC TESTING. The last equality is provided so this can look like a more familiar parametric test. Economics 52 Econometrics Professor N.M. Kiefer LECTURE 1: NEYMAN-PEARSON LEMMA AND ASYMPTOTIC TESTING NEYMAN-PEARSON LEMMA: Lesson: Good tests are based on the likelihood ratio. The proof is easy in the

More information

The Linear Regression Model

The Linear Regression Model The Linear Regression Model Carlo Favero Favero () The Linear Regression Model 1 / 67 OLS To illustrate how estimation can be performed to derive conditional expectations, consider the following general

More information

5.1 Consistency of least squares estimates. We begin with a few consistency results that stand on their own and do not depend on normality.

5.1 Consistency of least squares estimates. We begin with a few consistency results that stand on their own and do not depend on normality. 88 Chapter 5 Distribution Theory In this chapter, we summarize the distributions related to the normal distribution that occur in linear models. Before turning to this general problem that assumes normal

More information

3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?

3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure? MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due ). Show that the open disk x 2 + y 2 < 1 is a countable union of planar elementary sets. Show that the closed disk x 2 + y 2 1 is a countable

More information

2 (Bonus). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?

2 (Bonus). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure? MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due 9/5). Prove that every countable set A is measurable and µ(a) = 0. 2 (Bonus). Let A consist of points (x, y) such that either x or y is

More information

Econometrics Multiple Regression Analysis: Heteroskedasticity

Econometrics Multiple Regression Analysis: Heteroskedasticity Econometrics Multiple Regression Analysis: João Valle e Azevedo Faculdade de Economia Universidade Nova de Lisboa Spring Semester João Valle e Azevedo (FEUNL) Econometrics Lisbon, April 2011 1 / 19 Properties

More information

The Statistical Property of Ordinary Least Squares

The Statistical Property of Ordinary Least Squares The Statistical Property of Ordinary Least Squares The linear equation, on which we apply the OLS is y t = X t β + u t Then, as we have derived, the OLS estimator is ˆβ = [ X T X] 1 X T y Then, substituting

More information

Review of Classical Least Squares. James L. Powell Department of Economics University of California, Berkeley

Review of Classical Least Squares. James L. Powell Department of Economics University of California, Berkeley Review of Classical Least Squares James L. Powell Department of Economics University of California, Berkeley The Classical Linear Model The object of least squares regression methods is to model and estimate

More information

Lecture 7 - Separable Equations

Lecture 7 - Separable Equations Lecture 7 - Separable Equations Separable equations is a very special type of differential equations where you can separate the terms involving only y on one side of the equation and terms involving only

More information

DA Freedman Notes on the MLE Fall 2003

DA Freedman Notes on the MLE Fall 2003 DA Freedman Notes on the MLE Fall 2003 The object here is to provide a sketch of the theory of the MLE. Rigorous presentations can be found in the references cited below. Calculus. Let f be a smooth, scalar

More information

Statistics and econometrics

Statistics and econometrics 1 / 36 Slides for the course Statistics and econometrics Part 10: Asymptotic hypothesis testing European University Institute Andrea Ichino September 8, 2014 2 / 36 Outline Why do we need large sample

More information

Regression: Lecture 2

Regression: Lecture 2 Regression: Lecture 2 Niels Richard Hansen April 26, 2012 Contents 1 Linear regression and least squares estimation 1 1.1 Distributional results................................ 3 2 Non-linear effects and

More information

Gaussian vectors and central limit theorem

Gaussian vectors and central limit theorem Gaussian vectors and central limit theorem Samy Tindel Purdue University Probability Theory 2 - MA 539 Samy T. Gaussian vectors & CLT Probability Theory 1 / 86 Outline 1 Real Gaussian random variables

More information

Statement: With my signature I confirm that the solutions are the product of my own work. Name: Signature:.

Statement: With my signature I confirm that the solutions are the product of my own work. Name: Signature:. MATHEMATICAL STATISTICS Homework assignment Instructions Please turn in the homework with this cover page. You do not need to edit the solutions. Just make sure the handwriting is legible. You may discuss

More information

1 Solution to Problem 2.1

1 Solution to Problem 2.1 Solution to Problem 2. I incorrectly worked this exercise instead of 2.2, so I decided to include the solution anyway. a) We have X Y /3, which is a - function. It maps the interval, ) where X lives) onto

More information

3. For a given dataset and linear model, what do you think is true about least squares estimates? Is Ŷ always unique? Yes. Is ˆβ always unique? No.

3. For a given dataset and linear model, what do you think is true about least squares estimates? Is Ŷ always unique? Yes. Is ˆβ always unique? No. 7. LEAST SQUARES ESTIMATION 1 EXERCISE: Least-Squares Estimation and Uniqueness of Estimates 1. For n real numbers a 1,...,a n, what value of a minimizes the sum of squared distances from a to each of

More information

Math Homework 2

Math Homework 2 Math 73 Homework Due: September 8, 6 Suppose that f is holomorphic in a region Ω, ie an open connected set Prove that in any of the following cases (a) R(f) is constant; (b) I(f) is constant; (c) f is

More information

Lecture 6: Geometry of OLS Estimation of Linear Regession

Lecture 6: Geometry of OLS Estimation of Linear Regession Lecture 6: Geometry of OLS Estimation of Linear Regession Xuexin Wang WISE Oct 2013 1 / 22 Matrix Algebra An n m matrix A is a rectangular array that consists of nm elements arranged in n rows and m columns

More information

Statistical Methods for Handling Incomplete Data Chapter 2: Likelihood-based approach

Statistical Methods for Handling Incomplete Data Chapter 2: Likelihood-based approach Statistical Methods for Handling Incomplete Data Chapter 2: Likelihood-based approach Jae-Kwang Kim Department of Statistics, Iowa State University Outline 1 Introduction 2 Observed likelihood 3 Mean Score

More information

MATH MEASURE THEORY AND FOURIER ANALYSIS. Contents

MATH MEASURE THEORY AND FOURIER ANALYSIS. Contents MATH 3969 - MEASURE THEORY AND FOURIER ANALYSIS ANDREW TULLOCH Contents 1. Measure Theory 2 1.1. Properties of Measures 3 1.2. Constructing σ-algebras and measures 3 1.3. Properties of the Lebesgue measure

More information

MLES & Multivariate Normal Theory

MLES & Multivariate Normal Theory Merlise Clyde September 6, 2016 Outline Expectations of Quadratic Forms Distribution Linear Transformations Distribution of estimates under normality Properties of MLE s Recap Ŷ = ˆµ is an unbiased estimate

More information

Ma 3/103: Lecture 24 Linear Regression I: Estimation

Ma 3/103: Lecture 24 Linear Regression I: Estimation Ma 3/103: Lecture 24 Linear Regression I: Estimation March 3, 2017 KC Border Linear Regression I March 3, 2017 1 / 32 Regression analysis Regression analysis Estimate and test E(Y X) = f (X). f is the

More information

MATH 31B: MIDTERM 2 REVIEW. sin 2 x = 1 cos(2x) dx = x 2 sin(2x) 4. + C = x 2. dx = x sin(2x) + C = x sin x cos x

MATH 31B: MIDTERM 2 REVIEW. sin 2 x = 1 cos(2x) dx = x 2 sin(2x) 4. + C = x 2. dx = x sin(2x) + C = x sin x cos x MATH 3B: MIDTERM REVIEW JOE HUGHES. Evaluate sin x and cos x. Solution: Recall the identities cos x = + cos(x) Using these formulas gives cos(x) sin x =. Trigonometric Integrals = x sin(x) sin x = cos(x)

More information

Both these computations follow immediately (and trivially) from the definitions. Finally, observe that if f L (R n ) then we have that.

Both these computations follow immediately (and trivially) from the definitions. Finally, observe that if f L (R n ) then we have that. Lecture : One Parameter Maximal Functions and Covering Lemmas In this first lecture we start studying one of the basic and fundamental operators in harmonic analysis, the Hardy-Littlewood maximal function.

More information

MA22S3 Summary Sheet: Ordinary Differential Equations

MA22S3 Summary Sheet: Ordinary Differential Equations MA22S3 Summary Sheet: Ordinary Differential Equations December 14, 2017 Kreyszig s textbook is a suitable guide for this part of the module. Contents 1 Terminology 1 2 First order separable 2 2.1 Separable

More information

Projection. Ping Yu. School of Economics and Finance The University of Hong Kong. Ping Yu (HKU) Projection 1 / 42

Projection. Ping Yu. School of Economics and Finance The University of Hong Kong. Ping Yu (HKU) Projection 1 / 42 Projection Ping Yu School of Economics and Finance The University of Hong Kong Ping Yu (HKU) Projection 1 / 42 1 Hilbert Space and Projection Theorem 2 Projection in the L 2 Space 3 Projection in R n Projection

More information

Lebesgue s Differentiation Theorem via Maximal Functions

Lebesgue s Differentiation Theorem via Maximal Functions Lebesgue s Differentiation Theorem via Maximal Functions Parth Soneji LMU München Hütteseminar, December 2013 Parth Soneji Lebesgue s Differentiation Theorem via Maximal Functions 1/12 Philosophy behind

More information

Advanced Quantitative Methods: maximum likelihood

Advanced Quantitative Methods: maximum likelihood Advanced Quantitative Methods: Maximum Likelihood University College Dublin 4 March 2014 1 2 3 4 5 6 Outline 1 2 3 4 5 6 of straight lines y = 1 2 x + 2 dy dx = 1 2 of curves y = x 2 4x + 5 of curves y

More information

Introduction to Estimation Methods for Time Series models Lecture 2

Introduction to Estimation Methods for Time Series models Lecture 2 Introduction to Estimation Methods for Time Series models Lecture 2 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 2 SNS Pisa 1 / 21 Estimators:

More information

Sensitivity of GLS estimators in random effects models

Sensitivity of GLS estimators in random effects models of GLS estimators in random effects models Andrey L. Vasnev (University of Sydney) Tokyo, August 4, 2009 1 / 19 Plan Plan Simulation studies and estimators 2 / 19 Simulation studies Plan Simulation studies

More information

Linear Algebra Review

Linear Algebra Review Linear Algebra Review Yang Feng http://www.stat.columbia.edu/~yangfeng Yang Feng (Columbia University) Linear Algebra Review 1 / 45 Definition of Matrix Rectangular array of elements arranged in rows and

More information

Graduate Econometrics I: Unbiased Estimation

Graduate Econometrics I: Unbiased Estimation Graduate Econometrics I: Unbiased Estimation Yves Dominicy Université libre de Bruxelles Solvay Brussels School of Economics and Management ECARES Yves Dominicy Graduate Econometrics I: Unbiased Estimation

More information

p. 6-1 Continuous Random Variables p. 6-2

p. 6-1 Continuous Random Variables p. 6-2 Continuous Random Variables Recall: For discrete random variables, only a finite or countably infinite number of possible values with positive probability (>). Often, there is interest in random variables

More information

1. The accumulated net change function or area-so-far function

1. The accumulated net change function or area-so-far function Name: Section: Names of collaborators: Main Points: 1. The accumulated net change function ( area-so-far function) 2. Connection to antiderivative functions: the Fundamental Theorem of Calculus 3. Evaluating

More information

Econometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018

Econometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018 Econometrics I KS Module 2: Multivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: April 16, 2018 Alexander Ahammer (JKU) Module 2: Multivariate

More information

(I AL BL 2 )z t = (I CL)ζ t, where

(I AL BL 2 )z t = (I CL)ζ t, where ECO 513 Fall 2011 MIDTERM EXAM The exam lasts 90 minutes. Answer all three questions. (1 Consider this model: x t = 1.2x t 1.62x t 2 +.2y t 1.23y t 2 + ε t.7ε t 1.9ν t 1 (1 [ εt y t = 1.4y t 1.62y t 2

More information

Regression and Statistical Inference

Regression and Statistical Inference Regression and Statistical Inference Walid Mnif wmnif@uwo.ca Department of Applied Mathematics The University of Western Ontario, London, Canada 1 Elements of Probability 2 Elements of Probability CDF&PDF

More information

Math 250B Final Exam Review Session Spring 2015 SOLUTIONS

Math 250B Final Exam Review Session Spring 2015 SOLUTIONS Math 5B Final Exam Review Session Spring 5 SOLUTIONS Problem Solve x x + y + 54te 3t and y x + 4y + 9e 3t λ SOLUTION: We have det(a λi) if and only if if and 4 λ only if λ 3λ This means that the eigenvalues

More information

Advanced Quantitative Methods: maximum likelihood

Advanced Quantitative Methods: maximum likelihood Advanced Quantitative Methods: Maximum Likelihood University College Dublin March 23, 2011 1 Introduction 2 3 4 5 Outline Introduction 1 Introduction 2 3 4 5 Preliminaries Introduction Ordinary least squares

More information

Math 162: Calculus IIA

Math 162: Calculus IIA Math 62: Calculus IIA Final Exam ANSWERS December 9, 26 Part A. (5 points) Evaluate the integral x 4 x 2 dx Substitute x 2 cos θ: x 8 cos dx θ ( 2 sin θ) dθ 4 x 2 2 sin θ 8 cos θ dθ 8 cos 2 θ cos θ dθ

More information

SOLUTION GUIDE TO MATH GRE FORM GR9367

SOLUTION GUIDE TO MATH GRE FORM GR9367 SOLUTION GUIDE TO MATH GRE FORM GR9367 IAN COLEY The questions for this solution guide can be found here. Solution. (D) We have f(g(x)) = g(x) + 3 = 5 for all x, so g(x) = for all x R. Solution. (C) We

More information

Solutions to Tutorial 11 (Week 12)

Solutions to Tutorial 11 (Week 12) THE UIVERSITY OF SYDEY SCHOOL OF MATHEMATICS AD STATISTICS Solutions to Tutorial 11 (Week 12) MATH3969: Measure Theory and Fourier Analysis (Advanced) Semester 2, 2017 Web Page: http://sydney.edu.au/science/maths/u/ug/sm/math3969/

More information

10550 PRACTICE FINAL EXAM SOLUTIONS. x 2 4. x 2 x 2 5x +6 = lim x +2. x 2 x 3 = 4 1 = 4.

10550 PRACTICE FINAL EXAM SOLUTIONS. x 2 4. x 2 x 2 5x +6 = lim x +2. x 2 x 3 = 4 1 = 4. 55 PRACTICE FINAL EXAM SOLUTIONS. First notice that x 2 4 x 2x + 2 x 2 5x +6 x 2x. This function is undefined at x 2. Since, in the it as x 2, we only care about what happens near x 2 an for x less than

More information

SPRING 2006 PRELIMINARY EXAMINATION SOLUTIONS

SPRING 2006 PRELIMINARY EXAMINATION SOLUTIONS SPRING 006 PRELIMINARY EXAMINATION SOLUTIONS 1A. Let G be the subgroup of the free abelian group Z 4 consisting of all integer vectors (x, y, z, w) such that x + 3y + 5z + 7w = 0. (a) Determine a linearly

More information

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2.

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2. APPENDIX A Background Mathematics A. Linear Algebra A.. Vector algebra Let x denote the n-dimensional column vector with components 0 x x 2 B C @. A x n Definition 6 (scalar product). The scalar product

More information

Master s Written Examination

Master s Written Examination Master s Written Examination Option: Statistics and Probability Spring 016 Full points may be obtained for correct answers to eight questions. Each numbered question which may have several parts is worth

More information

Maximum Likelihood Estimation

Maximum Likelihood Estimation Maximum Likelihood Estimation Merlise Clyde STA721 Linear Models Duke University August 31, 2017 Outline Topics Likelihood Function Projections Maximum Likelihood Estimates Readings: Christensen Chapter

More information

2.2 Separable Equations

2.2 Separable Equations 2.2 Separable Equations Definition A first-order differential equation that can be written in the form Is said to be separable. Note: the variables of a separable equation can be written as Examples Solve

More information

Write your Registration Number, Test Centre, Test Code and the Number of this booklet in the appropriate places on the answersheet.

Write your Registration Number, Test Centre, Test Code and the Number of this booklet in the appropriate places on the answersheet. 2016 Booklet No. Test Code : PSA Forenoon Questions : 30 Time : 2 hours Write your Registration Number, Test Centre, Test Code and the Number of this booklet in the appropriate places on the answersheet.

More information

Econometrics of Panel Data

Econometrics of Panel Data Econometrics of Panel Data Jakub Mućk Meeting # 3 Jakub Mućk Econometrics of Panel Data Meeting # 3 1 / 21 Outline 1 Fixed or Random Hausman Test 2 Between Estimator 3 Coefficient of determination (R 2

More information

MATH 56A SPRING 2008 STOCHASTIC PROCESSES 197

MATH 56A SPRING 2008 STOCHASTIC PROCESSES 197 MATH 56A SPRING 8 STOCHASTIC PROCESSES 197 9.3. Itô s formula. First I stated the theorem. Then I did a simple example to make sure we understand what it says. Then I proved it. The key point is Lévy s

More information

CITY UNIVERSITY LONDON. BEng (Hons) in Electrical and Electronic Engineering PART 2 EXAMINATION. ENGINEERING MATHEMATICS 2 (resit) EX2003

CITY UNIVERSITY LONDON. BEng (Hons) in Electrical and Electronic Engineering PART 2 EXAMINATION. ENGINEERING MATHEMATICS 2 (resit) EX2003 No: CITY UNIVERSITY LONDON BEng (Hons) in Electrical and Electronic Engineering PART 2 EXAMINATION ENGINEERING MATHEMATICS 2 (resit) EX2003 Date: August 2004 Time: 3 hours Attempt Five out of EIGHT questions

More information

REAL ANALYSIS I Spring 2016 Product Measures

REAL ANALYSIS I Spring 2016 Product Measures REAL ANALSIS I Spring 216 Product Measures We assume that (, M, µ), (, N, ν) are σ- finite measure spaces. We want to provide the Cartesian product with a measure space structure in which all sets of the

More information

For example, the real line is σ-finite with respect to Lebesgue measure, since

For example, the real line is σ-finite with respect to Lebesgue measure, since More Measure Theory In this set of notes we sketch some results in measure theory that we don t have time to cover in full. Most of the results can be found in udin s eal & Complex Analysis. Some of the

More information

Math 10C - Fall Final Exam

Math 10C - Fall Final Exam Math 1C - Fall 217 - Final Exam Problem 1. Consider the function f(x, y) = 1 x 2 (y 1) 2. (i) Draw the level curve through the point P (1, 2). Find the gradient of f at the point P and draw the gradient

More information

Ma 3/103: Lecture 25 Linear Regression II: Hypothesis Testing and ANOVA

Ma 3/103: Lecture 25 Linear Regression II: Hypothesis Testing and ANOVA Ma 3/103: Lecture 25 Linear Regression II: Hypothesis Testing and ANOVA March 6, 2017 KC Border Linear Regression II March 6, 2017 1 / 44 1 OLS estimator 2 Restricted regression 3 Errors in variables 4

More information

8. Hypothesis Testing

8. Hypothesis Testing FE661 - Statistical Methods for Financial Engineering 8. Hypothesis Testing Jitkomut Songsiri introduction Wald test likelihood-based tests significance test for linear regression 8-1 Introduction elements

More information

Topics in Probability and Statistics

Topics in Probability and Statistics Topics in Probability and tatistics A Fundamental Construction uppose {, P } is a sample space (with probability P), and suppose X : R is a random variable. The distribution of X is the probability P X

More information

Math Refresher Course

Math Refresher Course Math Refresher Course Columbia University Department of Political Science Fall 2007 Day 2 Prepared by Jessamyn Blau 6 Calculus CONT D 6.9 Antiderivatives and Integration Integration is the reverse of differentiation.

More information

Review of Econometrics

Review of Econometrics Review of Econometrics Zheng Tian June 5th, 2017 1 The Essence of the OLS Estimation Multiple regression model involves the models as follows Y i = β 0 + β 1 X 1i + β 2 X 2i + + β k X ki + u i, i = 1,...,

More information

4. CONTINUOUS RANDOM VARIABLES

4. CONTINUOUS RANDOM VARIABLES IA Probability Lent Term 4 CONTINUOUS RANDOM VARIABLES 4 Introduction Up to now we have restricted consideration to sample spaces Ω which are finite, or countable; we will now relax that assumption We

More information

LEBESGUE INTEGRATION. Introduction

LEBESGUE INTEGRATION. Introduction LEBESGUE INTEGATION EYE SJAMAA Supplementary notes Math 414, Spring 25 Introduction The following heuristic argument is at the basis of the denition of the Lebesgue integral. This argument will be imprecise,

More information

Heteroskedasticity and Autocorrelation

Heteroskedasticity and Autocorrelation Lesson 7 Heteroskedasticity and Autocorrelation Pilar González and Susan Orbe Dpt. Applied Economics III (Econometrics and Statistics) Pilar González and Susan Orbe OCW 2014 Lesson 7. Heteroskedasticity

More information

Exercise The solution of

Exercise The solution of Exercise 8.51 The solution of dx dy = sin φ cos θdr + r cos φ cos θdφ r sin φ sin θdθ sin φ sin θdr + r cos φ sin θdφ r sin φ cos θdθ is dr dφ = dz cos φdr r sin φdφ dθ sin φ cos θdx + sin φ sin θdy +

More information

Review for the First Midterm Exam

Review for the First Midterm Exam Review for the First Midterm Exam Thomas Morrell 5 pm, Sunday, 4 April 9 B9 Van Vleck Hall For the purpose of creating questions for this review session, I did not make an effort to make any of the numbers

More information

Partial Fractions. June 27, In this section, we will learn to integrate another class of functions: the rational functions.

Partial Fractions. June 27, In this section, we will learn to integrate another class of functions: the rational functions. Partial Fractions June 7, 04 In this section, we will learn to integrate another class of functions: the rational functions. Definition. A rational function is a fraction of two polynomials. For example,

More information

Georgia Tech PHYS 6124 Mathematical Methods of Physics I

Georgia Tech PHYS 6124 Mathematical Methods of Physics I Georgia Tech PHYS 612 Mathematical Methods of Physics I Instructor: Predrag Cvitanović Fall semester 2012 Homework Set #5 due October 2, 2012 == show all your work for maximum credit, == put labels, title,

More information

Peter Hoff Linear and multilinear models April 3, GLS for multivariate regression 5. 3 Covariance estimation for the GLM 8

Peter Hoff Linear and multilinear models April 3, GLS for multivariate regression 5. 3 Covariance estimation for the GLM 8 Contents 1 Linear model 1 2 GLS for multivariate regression 5 3 Covariance estimation for the GLM 8 4 Testing the GLH 11 A reference for some of this material can be found somewhere. 1 Linear model Recall

More information

Large Sample Properties of Estimators in the Classical Linear Regression Model

Large Sample Properties of Estimators in the Classical Linear Regression Model Large Sample Properties of Estimators in the Classical Linear Regression Model 7 October 004 A. Statement of the classical linear regression model The classical linear regression model can be written in

More information

Analysis IV : Assignment 3 Solutions John Toth, Winter ,...). In particular for every fixed m N the sequence (u (n)

Analysis IV : Assignment 3 Solutions John Toth, Winter ,...). In particular for every fixed m N the sequence (u (n) Analysis IV : Assignment 3 Solutions John Toth, Winter 203 Exercise (l 2 (Z), 2 ) is a complete and separable Hilbert space. Proof Let {u (n) } n N be a Cauchy sequence. Say u (n) = (..., u 2, (n) u (n),

More information

MATH 51H Section 4. October 16, Recall what it means for a function between metric spaces to be continuous:

MATH 51H Section 4. October 16, Recall what it means for a function between metric spaces to be continuous: MATH 51H Section 4 October 16, 2015 1 Continuity Recall what it means for a function between metric spaces to be continuous: Definition. Let (X, d X ), (Y, d Y ) be metric spaces. A function f : X Y is

More information

Chapter 8 Integral Operators

Chapter 8 Integral Operators Chapter 8 Integral Operators In our development of metrics, norms, inner products, and operator theory in Chapters 1 7 we only tangentially considered topics that involved the use of Lebesgue measure,

More information

6.2 Fubini s Theorem. (µ ν)(c) = f C (x) dµ(x). (6.2) Proof. Note that (X Y, A B, µ ν) must be σ-finite as well, so that.

6.2 Fubini s Theorem. (µ ν)(c) = f C (x) dµ(x). (6.2) Proof. Note that (X Y, A B, µ ν) must be σ-finite as well, so that. 6.2 Fubini s Theorem Theorem 6.2.1. (Fubini s theorem - first form) Let (, A, µ) and (, B, ν) be complete σ-finite measure spaces. Let C = A B. Then for each µ ν- measurable set C C the section x C is

More information

1 Mixed effect models and longitudinal data analysis

1 Mixed effect models and longitudinal data analysis 1 Mixed effect models and longitudinal data analysis Mixed effects models provide a flexible approach to any situation where data have a grouping structure which introduces some kind of correlation between

More information

Final practice, Math 31A - Lec 1, Fall 2013 Name and student ID: Question Points Score Total: 90

Final practice, Math 31A - Lec 1, Fall 2013 Name and student ID: Question Points Score Total: 90 Final practice, Math 31A - Lec 1, Fall 13 Name and student ID: Question Points Score 1 1 1 3 1 4 1 5 1 6 1 7 1 8 1 9 1 Total: 9 1. a) 4 points) Find all points x at which the function fx) x 4x + 3 + x

More information

ARCS IN FINITE PROJECTIVE SPACES. Basic objects and definitions

ARCS IN FINITE PROJECTIVE SPACES. Basic objects and definitions ARCS IN FINITE PROJECTIVE SPACES SIMEON BALL Abstract. These notes are an outline of a course on arcs given at the Finite Geometry Summer School, University of Sussex, June 26-30, 2017. Let K denote an

More information

Folland: Real Analysis, Chapter 2 Sébastien Picard

Folland: Real Analysis, Chapter 2 Sébastien Picard Folland: Real Analysis, Chapter 2 Sébastien Picard Problem 2.3 If {f n } is a sequence of measurable functions on X, then {x : limf n (x) exists} is a measurable set. Define h limsupf n, g liminff n. By

More information

x n cos 2x dx. dx = nx n 1 and v = 1 2 sin(2x). Andreas Fring (City University London) AS1051 Lecture Autumn / 36

x n cos 2x dx. dx = nx n 1 and v = 1 2 sin(2x). Andreas Fring (City University London) AS1051 Lecture Autumn / 36 We saw in Example 5.4. that we sometimes need to apply integration by parts several times in the course of a single calculation. Example 5.4.4: For n let S n = x n cos x dx. Find an expression for S n

More information

Math 147, Homework 1 Solutions Due: April 10, 2012

Math 147, Homework 1 Solutions Due: April 10, 2012 1. For what values of a is the set: Math 147, Homework 1 Solutions Due: April 10, 2012 M a = { (x, y, z) : x 2 + y 2 z 2 = a } a smooth manifold? Give explicit parametrizations for open sets covering M

More information

Mathematics 136 Calculus 2 Everything You Need Or Want To Know About Partial Fractions (and maybe more!) October 19 and 21, 2016

Mathematics 136 Calculus 2 Everything You Need Or Want To Know About Partial Fractions (and maybe more!) October 19 and 21, 2016 Mathematics 36 Calculus 2 Everything You Need Or Want To Know About Partial Fractions (and maybe more!) October 9 and 2, 206 Every rational function (quotient of polynomials) can be written as a polynomial

More information

Lecture 3: Multiple Regression

Lecture 3: Multiple Regression Lecture 3: Multiple Regression R.G. Pierse 1 The General Linear Model Suppose that we have k explanatory variables Y i = β 1 + β X i + β 3 X 3i + + β k X ki + u i, i = 1,, n (1.1) or Y i = β j X ji + u

More information

g(t) = f(x 1 (t),..., x n (t)).

g(t) = f(x 1 (t),..., x n (t)). Reading: [Simon] p. 313-333, 833-836. 0.1 The Chain Rule Partial derivatives describe how a function changes in directions parallel to the coordinate axes. Now we shall demonstrate how the partial derivatives

More information

Math 181, Exam 2, Study Guide 2 Problem 1 Solution. 1 + dx. 1 + (cos x)2 dx. 1 + cos2 xdx. = π ( 1 + cos π 2

Math 181, Exam 2, Study Guide 2 Problem 1 Solution. 1 + dx. 1 + (cos x)2 dx. 1 + cos2 xdx. = π ( 1 + cos π 2 Math 8, Exam, Study Guide Problem Solution. Use the trapezoid rule with n to estimate the arc-length of the curve y sin x between x and x π. Solution: The arclength is: L b a π π + ( ) dy + (cos x) + cos

More information

Math The Laplacian. 1 Green s Identities, Fundamental Solution

Math The Laplacian. 1 Green s Identities, Fundamental Solution Math. 209 The Laplacian Green s Identities, Fundamental Solution Let be a bounded open set in R n, n 2, with smooth boundary. The fact that the boundary is smooth means that at each point x the external

More information

Methods of Integration

Methods of Integration Methods of Integration Professor D. Olles January 8, 04 Substitution The derivative of a composition of functions can be found using the chain rule form d dx [f (g(x))] f (g(x)) g (x) Rewriting the derivative

More information

Introduction to Estimation Methods for Time Series models. Lecture 1

Introduction to Estimation Methods for Time Series models. Lecture 1 Introduction to Estimation Methods for Time Series models Lecture 1 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 1 SNS Pisa 1 / 19 Estimation

More information

AMS-207: Bayesian Statistics

AMS-207: Bayesian Statistics Linear Regression How does a quantity y, vary as a function of another quantity, or vector of quantities x? We are interested in p(y θ, x) under a model in which n observations (x i, y i ) are exchangeable.

More information

Quick Review on Linear Multiple Regression

Quick Review on Linear Multiple Regression Quick Review on Linear Multiple Regression Mei-Yuan Chen Department of Finance National Chung Hsing University March 6, 2007 Introduction for Conditional Mean Modeling Suppose random variables Y, X 1,

More information

CS Tutorial 5 - Differential Geometry I - Surfaces

CS Tutorial 5 - Differential Geometry I - Surfaces 236861 Numerical Geometry of Images Tutorial 5 Differential Geometry II Surfaces c 2009 Parameterized surfaces A parameterized surface X : U R 2 R 3 a differentiable map 1 X from an open set U R 2 to R

More information

Lesson 17: Vector AutoRegressive Models

Lesson 17: Vector AutoRegressive Models Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@ec.univaq.it Vector AutoRegressive models The extension of ARMA models into a multivariate framework

More information

Math 205A - Fall 2015 Homework #4 Solutions

Math 205A - Fall 2015 Homework #4 Solutions Math 25A - Fall 25 Homework #4 Solutions Problem : Let f L and µ(t) = m{x : f(x) > t} the distribution function of f. Show that: (i) µ(t) t f L (). (ii) f L () = t µ(t)dt. (iii) For any increasing differentiable

More information

Math 423/533: The Main Theoretical Topics

Math 423/533: The Main Theoretical Topics Math 423/533: The Main Theoretical Topics Notation sample size n, data index i number of predictors, p (p = 2 for simple linear regression) y i : response for individual i x i = (x i1,..., x ip ) (1 p)

More information

MATH 452. SAMPLE 3 SOLUTIONS May 3, (10 pts) Let f(x + iy) = u(x, y) + iv(x, y) be an analytic function. Show that u(x, y) is harmonic.

MATH 452. SAMPLE 3 SOLUTIONS May 3, (10 pts) Let f(x + iy) = u(x, y) + iv(x, y) be an analytic function. Show that u(x, y) is harmonic. MATH 45 SAMPLE 3 SOLUTIONS May 3, 06. (0 pts) Let f(x + iy) = u(x, y) + iv(x, y) be an analytic function. Show that u(x, y) is harmonic. Because f is holomorphic, u and v satisfy the Cauchy-Riemann equations:

More information

Multiple Regression Analysis

Multiple Regression Analysis Multiple Regression Analysis y = 0 + 1 x 1 + x +... k x k + u 6. Heteroskedasticity What is Heteroskedasticity?! Recall the assumption of homoskedasticity implied that conditional on the explanatory variables,

More information

LINEAR ALGEBRA REVIEW

LINEAR ALGEBRA REVIEW LINEAR ALGEBRA REVIEW When we define a term, we put it in boldface. This is a very compressed review; please read it very carefully and be sure to ask questions on parts you aren t sure of. x 1 WedenotethesetofrealnumbersbyR.

More information

DRAFT - Math 102 Lecture Note - Dr. Said Algarni

DRAFT - Math 102 Lecture Note - Dr. Said Algarni Math02 - Term72 - Guides and Exercises - DRAFT 7 Techniques of Integration A summery for the most important integrals that we have learned so far: 7. Integration by Parts The Product Rule states that if

More information