ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin
|
|
- Matilda Eileen Morton
- 6 years ago
- Views:
Transcription
1 ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model Specificaion and Esimaion," Ch. 5 in Learning and Pracicing Economerics Noaion Warning: I previously disinguished random variables (Y) from heir realized sample values (y). Following HGJ, I will no longer do his. Conex of equaion should make he disincion clear. ACE 56, Universiy of Illinois a Urbana-Champaign 4-
2 Overview Previously, we examined one economic variable a a ime We will now focus on wo economic variables Primary objecive of economic analysis is o undersand he relaionship beween economic variables Key quesion: How o use he informaion conained in samples of economic daa o learn abou unknown parameers of economic relaionships? When i is believed ha values of one variable are sysemaically deermined by anoher variable, simple linear regression can be used o model he relaionship Simple linear regression model is a specificaion of he process ha we believe describes he relaionship beween wo variables ACE 56, Universiy of Illinois a Urbana-Champaign 4-
3 Sar wih wo variables y and x For each observaion, we assume ha x is generaed "ouside" he process given by he simple linear regression model For each level of x, we assume ha y is generaed by he following simple linear regression model y = β + β x + e Since we only acually observe one sample of daa, our objecive is o esimae he parameers β and β ) of he above model ( ACE 56, Universiy of Illinois a Urbana-Champaign 4-3
4 ACE 56, Universiy of Illinois a Urbana-Champaign 4-4
5 ACE 56, Universiy of Illinois a Urbana-Champaign 4-5
6 he Problem Wha is he relaionship beween average household expendiure on food and income? o answer his quesion, we mus exend economic and saisical models considered Lecure 3 Focused on food expendiure of households of size 3 wih annual income of $5,0000 Populaion of ineres is now all households of size 3, regardless of income level Why is knowledge of he relaionship beween food expendiure and income imporan Micro-level decision? Macro-level decisions? ACE 56, Universiy of Illinois a Urbana-Champaign 4-6
7 he Economic Model Define household expendiure on food as y and household income as x Economic heory shows ha y = f( x) and we expec he relaionship o be posiive We need o be more precise abou he relaionship in order o ulimaely esimae he parameers of he relaionship Linear vs. non-linear In pracice, never know exac form of he relaion Use economic heory and informaion in sample o make a reasonable choice ACE 56, Universiy of Illinois a Urbana-Champaign 4-7
8 ACE 56, Universiy of Illinois a Urbana-Champaign 4-8
9 For simpliciy, le's assume a linear relaionship is reasonable, y = β + β x Conras his model wih he one considered earlier, y = β he linear economic model has wo parameers β : inercep, which shows he level of food expendiure when income is zero β : slope, which shows how much food expendiure changes when income changes ACE 56, Universiy of Illinois a Urbana-Champaign 4-9
10 Ofen ineresed in relaionship beween y and x in percenage erms, or elasiciy Poin elasiciy formula, η y dy x x = = β dx y y where y η is he elasiciy of food expendiure wih respec o income ACE 56, Universiy of Illinois a Urbana-Champaign 4-0
11 ACE 56, Universiy of Illinois a Urbana-Champaign 4-
12 he Saisical Model he linear economic model predics ha food expendiure for a given level of income will be he same for all consumers No scaer of poins around he line in Figure 5. Recognize ha acual expendiure for a given level of income will no be he same for all consumers, where, y = β+ βx + e =,..., y is he dependen variable x is he independen, or explanaory, variable e is he error, or disurbance, erm is he number of consumers in he sample Noe ha x is assumed o be he same for all consumers ACE 56, Universiy of Illinois a Urbana-Champaign 4-
13 Moivaion for adding he error erm is similar o earlier argumens, bu more deail is helpful Combined effec of oher influences In realiy, a large number of independen variables in addiion o income affec food expendiure Assume he oher independen variables are unobservable, or we would include hem in economic model Approximaion error Linear form of model may only be an approximaion of he rue relaionship beween income and food expendiure Random componen of human behavior Knowledge of all variables ha influence an individual's food expendiure, may no be sufficien o explain ha expendiure ACE 56, Universiy of Illinois a Urbana-Champaign 4-3
14 o complee he saisical model, we mus specify he assumpions abou he error erm, Ee ( ) = 0 var( e ) = E[ e E( e )] = E[ e ] = σ e are independen so ha Cov( ee s) = 0 for all s e follows a normal disribuion his can be summarized using he following noaion, e ~ N(0, σ ) =,..., As we saw in Lecure 3, his is referred o as he iid normaliy assumpion, which is shorhand for idenical, independenly disribued normal random variables Noe: he simple linear regression model does no require he assumpion ha he error erm is normally disribued. However, i is ypically assumed. ACE 56, Universiy of Illinois a Urbana-Champaign 4-4
15 Now, le's explore some of he implicaions of he saisical model y = β+ βx + e =,..., Someimes he saisical model is referred o as he "daa generaing process" for y For a given observaion, y can be hough of as having wo componens A sysemaic componen β+ βx, ha is deermined by an economic process A random componen e, ha is deermined by a probabilisic process Anoher way of saying he same hing is ha he random variable y is simply a linear ransformaion of he random variable e y = a+ be where a= β + β x and b= (Noe ha a is a parameer for each observaion because x is fixed for ha observaion, bu a akes on differen values for differen observaions) ACE 56, Universiy of Illinois a Urbana-Champaign 4-5
16 We can examine he saisical properies more formally by considering he expeced value of food expendiure, Ey [ ] = E[ β + β x+ e] Ey [ ] = E[ β ] + E[ β x] + Ee [ ] Ey [ ] = β + β x Shows ha he expeced value of food expendiure, or "average" expendiure, is a linear funcion of income Now, reconsider he original saisical model, y = β + β x + e From above, we can subsiue for β+ βx as follows, y = E[ y ] + e Allows a new inerpreaion of he saisical model ACE 56, Universiy of Illinois a Urbana-Champaign 4-6
17 Wriing he saisical model as, y = E[ y ] + e Allows us o hink of observed food expendiure as consising of wo componens, Ey [ ]: expeced, or mean, food expendiure, which will be he same for all consumers a a given level of income e : a random componen ha is unique o each consumer We generaed he same inerpreaion in he earlier consan mean model Now, he crucial difference is ha he mean componen is a funcion, raher han a consan he mean componen varies linearly wih he level of income Ey [ ] = β+ β x ACE 56, Universiy of Illinois a Urbana-Champaign 4-7
18 ACE 56, Universiy of Illinois a Urbana-Champaign 4-8
19 Now, consider he variance of food expendiure var[ y] = E ( y E[ y]) var[ y] = E ( y β βx) var[ y ] = E e = σ his resul is equivalen o saying ha he variance of food expendiure (or he error erm) is no relaed o he level of income Nex, consider he covariance of food expendiure beween wo values y and y s, [ ] cov[ y, y ] = E ( y E[ y ])( y E[ y ]) s s s [ β β β β ] cov[ y, y ] = E ( y x )( y x ) s s s [ ] cov[ y, y ] = E ee = 0 s s s Hence, if he errors are independen, as implied by random sampling, hen he selecion of one consumer does no influence wheher anoher will be seleced ACE 56, Universiy of Illinois a Urbana-Champaign 4-9
20 Assumpions of he Simple Linear Regression Model SR. y = β+ β x + e, =,..., SR. Ee ( ) = 0 Ey ( ) = β+ βx SR3. var( e ) = var( y ) = σ SR4. cov[ e, e ] = cov[ y, y ] = 0 s s s SR5. he variable x is no random and mus ake on a leas wo differen values SR6. e ~ N(0, σ ) y ~ N( β + β x, σ ) ACE 56, Universiy of Illinois a Urbana-Champaign 4-0
21 ACE 56, Universiy of Illinois a Urbana-Champaign 4-
22 ACE 56, Universiy of Illinois a Urbana-Champaign 4-
23 Esimaing he Parameers for he Saisical Model of he Food Expendiure and Income Relaionship he saisical model "explains" how he sample of household expendiure daa is generaed he problem a hand is how o use he sample informaion on y and x o esimae he unknown parameers β and β One approach is o simply draw a line hrough he scaer of poins ha seems o "bes fi" he daa "Eyeball economerics" While eyeball analysis may be useful as a saring poin, here are several weaknesses o his approach: Highly subjecive; wo researchers looking a he same graph may choose differen lines endency o ignore ouliers For mos researchers, will work only for one y and one x (wo dimensions) ACE 56, Universiy of Illinois a Urbana-Champaign 4-3
24 ACE 56, Universiy of Illinois a Urbana-Champaign 4-4
25 ACE 56, Universiy of Illinois a Urbana-Champaign 4-5
26 ACE 56, Universiy of Illinois a Urbana-Champaign 4-6
27 Jus as in he consan mean model, we need a rule o sysemaically esimae β and β based on he observed sample of daa Noice ha for a given level of x, Ey [ ] = β + β x, or he "cener" of he pdf for y Suggess he "cener" of sample daa may yield good esimaes of he populaion parameers β and β he only difference from he consan mean model is ha he "cener" varies wih he level of income he principle of leas squared disance can again be used o find he desired esimaes Minimize he sum of squares of he verical disances beween he line and he sample observaions ACE 56, Universiy of Illinois a Urbana-Champaign 4-7
28 y x Minimizing he sum of squared errors ACE 56, Universiy of Illinois a Urbana-Champaign 4-8
29 o begin he formal derivaion, le's resae he saisical model, y = β + β x + e which can be re-wrien as, e = y β β x hen, given he sample observaions on y and x, our objecive is o minimize he following funcion, = = = = S( β, β ) e ( y β β x ) Since he values for y are known, S is solely a funcion of he unknown parameers β and β Expanding he square, we obain, = = S( β, β ) ( y β x β y β x y β xβ β ) ACE 56, Universiy of Illinois a Urbana-Champaign 4-9
30 Wih furher re-arranging, = = = = = = S( β, β ) y β β x β y β xy ββ x For he sample of 40 households, = 40 x = 79 y = = = xy = x = = = = y = and based on hese compuaions he sum of squares relaionship is, S( β, β ) = β β β β β β his funcion is a quadraic in erms of he unknown parameers β and β "bowl-shaped" funcion ACE 56, Universiy of Illinois a Urbana-Champaign 4-30
31 ACE 56, Universiy of Illinois a Urbana-Champaign 4-3
32 Minimum value of funcion is found by aking he parial differenials of S wih respec o β and β, S = ( y β βx)( ) β = S = ( y β βx)( x) β = he values of β and β ha make he parial derivaives equal zero are he leas squares esimaors, which are denoed b and b Subsiuing and seing each parial derivaive equal o zero, ( y b b x )( ) = 0 = ( y b b x )( x ) = 0 = ACE 56, Universiy of Illinois a Urbana-Champaign 4-3
33 If we muliply boh sides of each equaion by (-), hey can be re-wrien in he following form: = ( y + b + b x ) = 0 and, ( yx + bx + bx ) = 0 = y + b + b x = 0 = = yx b x b x = = = + + = 0 Wih a lile more re-arranging, we can arrive a he following equaions, b + b x = y = = + = = = = b x b x y x he previous wo equaions are known as he normal equaions in leas squares regression ACE 56, Universiy of Illinois a Urbana-Champaign 4-33
34 Now, we have wo unknowns and wo knowns in each equaion, and we can solve for b and b Muliply he firs normal equaion by second by, x and he = xb + b x = x y = = = = + = = = = xb x b y x ACE 56, Universiy of Illinois a Urbana-Champaign 4-34
35 Now subrac he firs of he above wo equaions from he second, x x b y x x y = = = = = = or, b y x x y = = = = x x = = which is he leas squares esimaor for he slope ACE 56, Universiy of Illinois a Urbana-Champaign 4-35
36 Now, having found he leas squares esimaor of he slope, b, les solve for b he firs normal equaion is, b + b x = y = = Simply divide his equaion by, b + b x = y = = or, b+ bx = y b = y bx ACE 56, Universiy of Illinois a Urbana-Champaign 4-36
37 o summarize, he leas squares esimaors for he inercep and slope of he regression line are, b = y bx b y x x y = = = = x x = = You may see he formula for b saed in several differen forms he derivaion for one widely used formula can be found by subsiuing he formula for b ino he second normal equaion as follows, ( ) = = = y b x x + b x = y x Expanding and re-arranging, y x b x x x y x + = = = = = ACE 56, Universiy of Illinois a Urbana-Champaign 4-37
38 Or, b = yx y x = = x x x = = Recognizing ha = x = x, we can hen wrie he following soluion for b, which known as he compuaional formula, b = = = yx x yx x ACE 56, Universiy of Illinois a Urbana-Champaign 4-38
39 Anoher version of he formula is, b = = ( x x)( y y) = ( x x) Which is equivalen o, b = ( x x)( y y) = ( x x) = b ˆ σ sample covariance of x and = = sample variance of x xy ˆ σ x y his is ofen a helpful inerpreaion of he leas squares slope esimaor A good exercise is o derive his form of he formula from he firs one presened ACE 56, Universiy of Illinois a Urbana-Champaign 4-39
40 Finally, he formula is ofen saed in deviaions from he mean form Le, hen, x = x x and y = y y * * b = = = yx * * x * Imporan Poins All of he differen formulas for he leas squares esimaor b are equivalen Assuming arihmeic accuracy, all formulas will yield exacly he same numerical values for a given sample of x and y hree Noable Properies of LS Esimaes ACE 56, Universiy of Illinois a Urbana-Champaign 4-40
41 . Sum of he esimaed errors always equals zero Firs, noe ha he esimaed error for each observaion is simply he acual observaion on y minus he value projeced by he esimaed regression line, or e = y b b x ˆ Condiion "enforced" by he firs normal equaion ( y b b x )( ) = 0 = or = eˆ = 0 ACE 56, Universiy of Illinois a Urbana-Champaign 4-4
42 . Esimaed regression line mus pass hrough he sample means of x and y (cenroid) Shown by firs noing ha b = y b x, which can be re-wrien as y = b+ bx 3. Zero correlaion beween he esimaed errors and x, he explanaory variable Condiion "enforced" by he second normal equaion ( y b b x )( x ) = 0 = or = ex ˆ = 0 No endency of esimaed errors for observaions above (below) he mean of x o be posiive (negaive) and vice versa ACE 56, Universiy of Illinois a Urbana-Champaign 4-4
43 Esimaes for he Household Expendiure Funcion Based on he daa from 40 randomly seleced households, we can compue esimaes of β and β as follows, b = y bx = (0.353)(69.8) = b y x x y (40)( ) (79)(943.78) = = = = = (40)(006.3) (79) x x = = = 0.33 I is useful o repor he esimaes in erms of he esimaed relaionship beween y and x, yˆ = x where y ˆ is he esimae of he expeced (mean ) food expendiure for a given level of income Someimes y ˆ is called he "fied value" of y y ˆ is a poin on he LS line for a given x ACE 56, Universiy of Illinois a Urbana-Champaign 4-43
44 ACE 56, Universiy of Illinois a Urbana-Champaign 4-44
45 Sample Regression Oupu from Excel SUMMARY OUPU Regression Saisics Muliple R R Square Adjused R Square Sandard Error Observaions 40 ANOVA df SS MS F Significance F Regression Residual oal Coefficiens Sandard Error Sa P-value Lower 95% Upper 95% Inercep X Variable ACE 56, Universiy of Illinois a Urbana-Champaign 4-45
46 Inerpreing he Leas Squares Esimaes yˆ = x Inercep (b ) = 7.38 lierally is an esimae of he expeced (average) level of food expendiure per week when income is zero Cauion needs o be exercised when inerpreing inercep esimaes Usually lile if any observaions around zero for independen variable Suggess esimae may no be very reliable in his range of he independen variable Slope (b ) = 0.33 is an esimae of he expeced (average) change in food expendiure per week when income increases by one uni In his case, slope esimae indicaes food expendiure per week is expeced o increase by $0.3 when income per week increases by $ ACE 56, Universiy of Illinois a Urbana-Champaign 4-46
47 Imporan o emphasize ha slope indicaes expeced change on average when income increases one uni, no he acual change Remember ha he acual change will in all likelihood differ from he expeced change due o he error erm We can hink of he expeced change as being on he line while he acual change is off he line Income elasiciy of food expendiure also may be of ineres Recall he formula, η y dy x x = = β dx y y Replacing β wih b we can esimae he income elasiciy as, x ˆy η = b y his sill leaves he quesion of wha levels of x and y o use in esimaing he elasiciy ACE 56, Universiy of Illinois a Urbana-Champaign 4-47
48 I is convenional o use he sample means, since ha is a represenaive poin on he regression line, η = b ˆy x y In his case, he esimaed income elasiciy is, ˆ η y = 0.33 = Elasiciy ˆ η y = is an esimae of he expeced (average) percen change in food expendiure per week when income increases by one percen In his case, elasiciy esimae indicaes food expendiure per week is expeced o increase by percen when income per week increases by percen Remember ha income elasiciy esimae will vary for differen poins on he esimaed regression line ACE 56, Universiy of Illinois a Urbana-Champaign 4-48
49 Lineariy and Oher Funcional Forms In he simple regression example considered here, only a "sraigh-line" relaionship beween food expendiure and income was considered A non-linear relaionship may well be more appropriae he simple regression model is more flexible han i appears x and y variables can be ransformaions, such as logarihms, squares, cubes, or reciprocals his raises he quesion of wha do we mean when we sae ha he simple regression model is linear here are wo definiions of lineariy ACE 56, Universiy of Illinois a Urbana-Champaign 4-49
50 Lineariy in variables: only a power of one on x or y, y = β + β x + e Yes! y = β + β x + e No! 4 y = β + β x + e No! ln( y ) = β + β ln( x ) + e No! Lineariy in parameers: only a power of one on βor β, bu higher powers and/or ransformaions are allowed on x and/or y, y = β + β x + e Yes! y = β + β x + e No! y = β + β x + e No! 3 ln( y ) = β + β ln( x ) + e Yes! y = β + ln( β ) x + e No! ACE 56, Universiy of Illinois a Urbana-Champaign 4-50
51 he definiion of lineariy used in he simple linear regression model is linear in parameers Allows considerable flexibiliy in he specificaion of he funcional form of he model We will sudy alernaive funcional forms ha are linear in parameers nex semeser ACE 56, Universiy of Illinois a Urbana-Champaign 4-5
ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.
ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple
More informationACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H.
ACE 56 Fall 5 Lecure 8: The Simple Linear Regression Model: R, Reporing he Resuls and Predicion by Professor Sco H. Irwin Required Readings: Griffihs, Hill and Judge. "Explaining Variaion in he Dependen
More informationThe Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form
Chaper 6 The Simple Linear Regression Model: Reporing he Resuls and Choosing he Funcional Form To complee he analysis of he simple linear regression model, in his chaper we will consider how o measure
More informationACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H.
ACE 564 Spring 2006 Lecure 7 Exensions of The Muliple Regression Model: Dumm Independen Variables b Professor Sco H. Irwin Readings: Griffihs, Hill and Judge. "Dumm Variables and Varing Coefficien Models
More information(a) Set up the least squares estimation procedure for this problem, which will consist in minimizing the sum of squared residuals. 2 t.
Insrucions: The goal of he problem se is o undersand wha you are doing raher han jus geing he correc resul. Please show your work clearly and nealy. No credi will be given o lae homework, regardless of
More informationSolutions to Odd Number Exercises in Chapter 6
1 Soluions o Odd Number Exercises in 6.1 R y eˆ 1.7151 y 6.3 From eˆ ( T K) ˆ R 1 1 SST SST SST (1 R ) 55.36(1.7911) we have, ˆ 6.414 T K ( ) 6.5 y ye ye y e 1 1 Consider he erms e and xe b b x e y e b
More informationDistribution of Estimates
Disribuion of Esimaes From Economerics (40) Linear Regression Model Assume (y,x ) is iid and E(x e )0 Esimaion Consisency y α + βx + he esimaes approach he rue values as he sample size increases Esimaion
More informationEcon107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)
I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression
More informationBias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé
Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070
More informationR t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t
Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,
More information20. Applications of the Genetic-Drift Model
0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0
More informationDiebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles
Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance
More informationTime series Decomposition method
Time series Decomposiion mehod A ime series is described using a mulifacor model such as = f (rend, cyclical, seasonal, error) = f (T, C, S, e) Long- Iner-mediaed Seasonal Irregular erm erm effec, effec,
More informationGMM - Generalized Method of Moments
GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................
More informationComparing Means: t-tests for One Sample & Two Related Samples
Comparing Means: -Tess for One Sample & Two Relaed Samples Using he z-tes: Assumpions -Tess for One Sample & Two Relaed Samples The z-es (of a sample mean agains a populaion mean) is based on he assumpion
More informationChapter 2. First Order Scalar Equations
Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.
More informationSimulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010
Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid
More informationProperties of Autocorrelated Processes Economics 30331
Properies of Auocorrelaed Processes Economics 3033 Bill Evans Fall 05 Suppose we have ime series daa series labeled as where =,,3, T (he final period) Some examples are he dail closing price of he S&500,
More informationTwo Coupled Oscillators / Normal Modes
Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own
More informationEstimation Uncertainty
Esimaion Uncerainy The sample mean is an esimae of β = E(y +h ) The esimaion error is = + = T h y T b ( ) = = + = + = = = T T h T h e T y T y T b β β β Esimaion Variance Under classical condiions, where
More informationDEPARTMENT OF STATISTICS
A Tes for Mulivariae ARCH Effecs R. Sco Hacker and Abdulnasser Haemi-J 004: DEPARTMENT OF STATISTICS S-0 07 LUND SWEDEN A Tes for Mulivariae ARCH Effecs R. Sco Hacker Jönköping Inernaional Business School
More informationLet us start with a two dimensional case. We consider a vector ( x,
Roaion marices We consider now roaion marices in wo and hree dimensions. We sar wih wo dimensions since wo dimensions are easier han hree o undersand, and one dimension is a lile oo simple. However, our
More informationPENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD
PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.
More informationLicenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A
Licenciaura de ADE y Licenciaura conjuna Derecho y ADE Hoja de ejercicios PARTE A 1. Consider he following models Δy = 0.8 + ε (1 + 0.8L) Δ 1 y = ε where ε and ε are independen whie noise processes. In
More information2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes
Some common engineering funcions 2.7 Inroducion This secion provides a caalogue of some common funcions ofen used in Science and Engineering. These include polynomials, raional funcions, he modulus funcion
More informationChapter 11. Heteroskedasticity The Nature of Heteroskedasticity. In Chapter 3 we introduced the linear model (11.1.1)
Chaper 11 Heeroskedasiciy 11.1 The Naure of Heeroskedasiciy In Chaper 3 we inroduced he linear model y = β+β x (11.1.1) 1 o explain household expendiure on food (y) as a funcion of household income (x).
More informationWednesday, November 7 Handout: Heteroskedasticity
Amhers College Deparmen of Economics Economics 360 Fall 202 Wednesday, November 7 Handou: Heeroskedasiciy Preview Review o Regression Model o Sandard Ordinary Leas Squares (OLS) Premises o Esimaion Procedures
More informationUnit Root Time Series. Univariate random walk
Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he
More informationPhysics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle
Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More informationLecture 33: November 29
36-705: Inermediae Saisics Fall 2017 Lecurer: Siva Balakrishnan Lecure 33: November 29 Today we will coninue discussing he boosrap, and hen ry o undersand why i works in a simple case. In he las lecure
More informationOutline. lse-logo. Outline. Outline. 1 Wald Test. 2 The Likelihood Ratio Test. 3 Lagrange Multiplier Tests
Ouline Ouline Hypohesis Tes wihin he Maximum Likelihood Framework There are hree main frequenis approaches o inference wihin he Maximum Likelihood framework: he Wald es, he Likelihood Raio es and he Lagrange
More informationBiol. 356 Lab 8. Mortality, Recruitment, and Migration Rates
Biol. 356 Lab 8. Moraliy, Recruimen, and Migraion Raes (modified from Cox, 00, General Ecology Lab Manual, McGraw Hill) Las week we esimaed populaion size hrough several mehods. One assumpion of all hese
More information4.1 Other Interpretations of Ridge Regression
CHAPTER 4 FURTHER RIDGE THEORY 4. Oher Inerpreaions of Ridge Regression In his secion we will presen hree inerpreaions for he use of ridge regression. The firs one is analogous o Hoerl and Kennard reasoning
More informationOn Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature
On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check
More informationMeasurement Error 1: Consequences Page 1. Definitions. For two variables, X and Y, the following hold: Expectation, or Mean, of X.
Measuremen Error 1: Consequences of Measuremen Error Richard Williams, Universiy of Nore Dame, hps://www3.nd.edu/~rwilliam/ Las revised January 1, 015 Definiions. For wo variables, X and Y, he following
More informationState-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter
Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when
More informationLecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.
Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in
More informationOBJECTIVES OF TIME SERIES ANALYSIS
OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging
More information23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes
Represening Periodic Funcions by Fourier Series 3. Inroducion In his Secion we show how a periodic funcion can be expressed as a series of sines and cosines. We begin by obaining some sandard inegrals
More information5.1 - Logarithms and Their Properties
Chaper 5 Logarihmic Funcions 5.1 - Logarihms and Their Properies Suppose ha a populaion grows according o he formula P 10, where P is he colony size a ime, in hours. When will he populaion be 2500? We
More informationRobust estimation based on the first- and third-moment restrictions of the power transformation model
h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,
More informationRegression with Time Series Data
Regression wih Time Series Daa y = β 0 + β 1 x 1 +...+ β k x k + u Serial Correlaion and Heeroskedasiciy Time Series - Serial Correlaion and Heeroskedasiciy 1 Serially Correlaed Errors: Consequences Wih
More informationHow to Deal with Structural Breaks in Practical Cointegration Analysis
How o Deal wih Srucural Breaks in Pracical Coinegraion Analysis Roselyne Joyeux * School of Economic and Financial Sudies Macquarie Universiy December 00 ABSTRACT In his noe we consider he reamen of srucural
More informationSome Basic Information about M-S-D Systems
Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,
More informationMathcad Lecture #8 In-class Worksheet Curve Fitting and Interpolation
Mahcad Lecure #8 In-class Workshee Curve Fiing and Inerpolaion A he end of his lecure, you will be able o: explain he difference beween curve fiing and inerpolaion decide wheher curve fiing or inerpolaion
More informationPhysics 127b: Statistical Mechanics. Fokker-Planck Equation. Time Evolution
Physics 7b: Saisical Mechanics Fokker-Planck Equaion The Langevin equaion approach o he evoluion of he velociy disribuion for he Brownian paricle migh leave you uncomforable. A more formal reamen of his
More informationLab #2: Kinematics in 1-Dimension
Reading Assignmen: Chaper 2, Secions 2-1 hrough 2-8 Lab #2: Kinemaics in 1-Dimension Inroducion: The sudy of moion is broken ino wo main areas of sudy kinemaics and dynamics. Kinemaics is he descripion
More informationThe Multiple Regression Model: Hypothesis Tests and the Use of Nonsample Information
Chaper 8 The Muliple Regression Model: Hypohesis Tess and he Use of Nonsample Informaion An imporan new developmen ha we encouner in his chaper is using he F- disribuion o simulaneously es a null hypohesis
More information(10) (a) Derive and plot the spectrum of y. Discuss how the seasonality in the process is evident in spectrum.
January 01 Final Exam Quesions: Mark W. Wason (Poins/Minues are given in Parenheses) (15) 1. Suppose ha y follows he saionary AR(1) process y = y 1 +, where = 0.5 and ~ iid(0,1). Le x = (y + y 1 )/. (11)
More informationLecture 4. Classical Linear Regression Model: Overview
Lecure 4 Classical Linear Regression Model: Overview Regression Regression is probably he single mos imporan ool a he economerician s disposal. Bu wha is regression analysis? I is concerned wih describing
More informationHypothesis Testing in the Classical Normal Linear Regression Model. 1. Components of Hypothesis Tests
ECONOMICS 35* -- NOTE 8 M.G. Abbo ECON 35* -- NOTE 8 Hypohesis Tesing in he Classical Normal Linear Regression Model. Componens of Hypohesis Tess. A esable hypohesis, which consiss of wo pars: Par : a
More informationKriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number
More informationMath 10B: Mock Mid II. April 13, 2016
Name: Soluions Mah 10B: Mock Mid II April 13, 016 1. ( poins) Sae, wih jusificaion, wheher he following saemens are rue or false. (a) If a 3 3 marix A saisfies A 3 A = 0, hen i canno be inverible. True.
More informationDynamic Econometric Models: Y t = + 0 X t + 1 X t X t k X t-k + e t. A. Autoregressive Model:
Dynamic Economeric Models: A. Auoregressive Model: Y = + 0 X 1 Y -1 + 2 Y -2 + k Y -k + e (Wih lagged dependen variable(s) on he RHS) B. Disribued-lag Model: Y = + 0 X + 1 X -1 + 2 X -2 + + k X -k + e
More informationWednesday, December 5 Handout: Panel Data and Unobservable Variables
Amhers College Deparmen of Economics Economics 360 Fall 0 Wednesday, December 5 Handou: Panel Daa and Unobservable Variables Preview Taking Sock: Ordinary Leas Squares (OLS) Esimaion Procedure o Sandard
More information4.1 - Logarithms and Their Properties
Chaper 4 Logarihmic Funcions 4.1 - Logarihms and Their Properies Wha is a Logarihm? We define he common logarihm funcion, simply he log funcion, wrien log 10 x log x, as follows: If x is a posiive number,
More informationMath 333 Problem Set #2 Solution 14 February 2003
Mah 333 Problem Se #2 Soluion 14 February 2003 A1. Solve he iniial value problem dy dx = x2 + e 3x ; 2y 4 y(0) = 1. Soluion: This is separable; we wrie 2y 4 dy = x 2 + e x dx and inegrae o ge The iniial
More informationECON 482 / WH Hong Time Series Data Analysis 1. The Nature of Time Series Data. Example of time series data (inflation and unemployment rates)
ECON 48 / WH Hong Time Series Daa Analysis. The Naure of Time Series Daa Example of ime series daa (inflaion and unemploymen raes) ECON 48 / WH Hong Time Series Daa Analysis The naure of ime series daa
More informationt is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...
Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger
More informationESTIMATION OF DYNAMIC PANEL DATA MODELS WHEN REGRESSION COEFFICIENTS AND INDIVIDUAL EFFECTS ARE TIME-VARYING
Inernaional Journal of Social Science and Economic Research Volume:02 Issue:0 ESTIMATION OF DYNAMIC PANEL DATA MODELS WHEN REGRESSION COEFFICIENTS AND INDIVIDUAL EFFECTS ARE TIME-VARYING Chung-ki Min Professor
More informationThe Brock-Mirman Stochastic Growth Model
c December 3, 208, Chrisopher D. Carroll BrockMirman The Brock-Mirman Sochasic Growh Model Brock and Mirman (972) provided he firs opimizing growh model wih unpredicable (sochasic) shocks. The social planner
More informationKINEMATICS IN ONE DIMENSION
KINEMATICS IN ONE DIMENSION PREVIEW Kinemaics is he sudy of how hings move how far (disance and displacemen), how fas (speed and velociy), and how fas ha how fas changes (acceleraion). We say ha an objec
More informationThe general Solow model
The general Solow model Back o a closed economy In he basic Solow model: no growh in GDP per worker in seady sae This conradics he empirics for he Wesern world (sylized fac #5) In he general Solow model:
More information10. State Space Methods
. Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he
More informationExplaining Total Factor Productivity. Ulrich Kohli University of Geneva December 2015
Explaining Toal Facor Produciviy Ulrich Kohli Universiy of Geneva December 2015 Needed: A Theory of Toal Facor Produciviy Edward C. Presco (1998) 2 1. Inroducion Toal Facor Produciviy (TFP) has become
More informationL07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms
L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)
More informationy = β 1 + β 2 x (11.1.1)
Chaper 11 Heeroskedasiciy 11.1 The Naure of Heeroskedasiciy In Chaper 3 we inroduced he linear model y = β 1 + β x (11.1.1) o explain household expendiure on food (y) as a funcion of household income (x).
More informationFinal Spring 2007
.615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o
More informationTesting for a Single Factor Model in the Multivariate State Space Framework
esing for a Single Facor Model in he Mulivariae Sae Space Framework Chen C.-Y. M. Chiba and M. Kobayashi Inernaional Graduae School of Social Sciences Yokohama Naional Universiy Japan Faculy of Economics
More informationMath Week 14 April 16-20: sections first order systems of linear differential equations; 7.4 mass-spring systems.
Mah 2250-004 Week 4 April 6-20 secions 7.-7.3 firs order sysems of linear differenial equaions; 7.4 mass-spring sysems. Mon Apr 6 7.-7.2 Sysems of differenial equaions (7.), and he vecor Calculus we need
More informationMacroeconomic Theory Ph.D. Qualifying Examination Fall 2005 ANSWER EACH PART IN A SEPARATE BLUE BOOK. PART ONE: ANSWER IN BOOK 1 WEIGHT 1/3
Macroeconomic Theory Ph.D. Qualifying Examinaion Fall 2005 Comprehensive Examinaion UCLA Dep. of Economics You have 4 hours o complee he exam. There are hree pars o he exam. Answer all pars. Each par has
More information3.1 More on model selection
3. More on Model selecion 3. Comparing models AIC, BIC, Adjused R squared. 3. Over Fiing problem. 3.3 Sample spliing. 3. More on model selecion crieria Ofen afer model fiing you are lef wih a handful of
More informationChapter 16. Regression with Time Series Data
Chaper 16 Regression wih Time Series Daa The analysis of ime series daa is of vial ineres o many groups, such as macroeconomiss sudying he behavior of naional and inernaional economies, finance economiss
More informationSolutions: Wednesday, November 14
Amhers College Deparmen of Economics Economics 360 Fall 2012 Soluions: Wednesday, November 14 Judicial Daa: Cross secion daa of judicial and economic saisics for he fify saes in 2000. JudExp CrimesAll
More informationDEPARTMENT OF ECONOMICS
ISSN 0819-6 ISBN 0 730 609 9 THE UNIVERSITY OF MELBOURNE DEPARTMENT OF ECONOMICS RESEARCH PAPER NUMBER 95 NOVEMBER 005 INTERACTIONS IN REGRESSIONS by Joe Hirschberg & Jenny Lye Deparmen of Economics The
More informationTesting the Random Walk Model. i.i.d. ( ) r
he random walk heory saes: esing he Random Walk Model µ ε () np = + np + Momen Condiions where where ε ~ i.i.d he idea here is o es direcly he resricions imposed by momen condiions. lnp lnp µ ( lnp lnp
More informationMatlab and Python programming: how to get started
Malab and Pyhon programming: how o ge sared Equipping readers he skills o wrie programs o explore complex sysems and discover ineresing paerns from big daa is one of he main goals of his book. In his chaper,
More informationFITTING EQUATIONS TO DATA
TANTON S TAKE ON FITTING EQUATIONS TO DATA CURRICULUM TIDBITS FOR THE MATHEMATICS CLASSROOM MAY 013 Sandard algebra courses have sudens fi linear and eponenial funcions o wo daa poins, and quadraic funcions
More informationNotes on Kalman Filtering
Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren
More information1. Diagnostic (Misspeci cation) Tests: Testing the Assumptions
Business School, Brunel Universiy MSc. EC5501/5509 Modelling Financial Decisions and Markes/Inroducion o Quaniaive Mehods Prof. Menelaos Karanasos (Room SS269, el. 01895265284) Lecure Noes 6 1. Diagnosic
More information5. Stochastic processes (1)
Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly
More informationArticle from. Predictive Analytics and Futurism. July 2016 Issue 13
Aricle from Predicive Analyics and Fuurism July 6 Issue An Inroducion o Incremenal Learning By Qiang Wu and Dave Snell Machine learning provides useful ools for predicive analyics The ypical machine learning
More informationReferences are appeared in the last slide. Last update: (1393/08/19)
SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be
More informationMathematical Theory and Modeling ISSN (Paper) ISSN (Online) Vol 3, No.3, 2013
Mahemaical Theory and Modeling ISSN -580 (Paper) ISSN 5-05 (Online) Vol, No., 0 www.iise.org The ffec of Inverse Transformaion on he Uni Mean and Consan Variance Assumpions of a Muliplicaive rror Model
More informationEXERCISES FOR SECTION 1.5
1.5 Exisence and Uniqueness of Soluions 43 20. 1 v c 21. 1 v c 1 2 4 6 8 10 1 2 2 4 6 8 10 Graph of approximae soluion obained using Euler s mehod wih = 0.1. Graph of approximae soluion obained using Euler
More informationCointegration and Implications for Forecasting
Coinegraion and Implicaions for Forecasing Two examples (A) Y Y 1 1 1 2 (B) Y 0.3 0.9 1 1 2 Example B: Coinegraion Y and coinegraed wih coinegraing vecor [1, 0.9] because Y 0.9 0.3 is a saionary process
More information( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is
UNIT IMPULSE RESPONSE, UNIT STEP RESPONSE, STABILITY. Uni impulse funcion (Dirac dela funcion, dela funcion) rigorously defined is no sricly a funcion, bu disribuion (or measure), precise reamen requires
More informationIntroduction to Probability and Statistics Slides 4 Chapter 4
Inroducion o Probabiliy and Saisics Slides 4 Chaper 4 Ammar M. Sarhan, asarhan@mahsa.dal.ca Deparmen of Mahemaics and Saisics, Dalhousie Universiy Fall Semeser 8 Dr. Ammar Sarhan Chaper 4 Coninuous Random
More information23.5. Half-Range Series. Introduction. Prerequisites. Learning Outcomes
Half-Range Series 2.5 Inroducion In his Secion we address he following problem: Can we find a Fourier series expansion of a funcion defined over a finie inerval? Of course we recognise ha such a funcion
More informationProblem Set 5. Graduate Macro II, Spring 2017 The University of Notre Dame Professor Sims
Problem Se 5 Graduae Macro II, Spring 2017 The Universiy of Nore Dame Professor Sims Insrucions: You may consul wih oher members of he class, bu please make sure o urn in your own work. Where applicable,
More information= ( ) ) or a system of differential equations with continuous parametrization (T = R
XIII. DIFFERENCE AND DIFFERENTIAL EQUATIONS Ofen funcions, or a sysem of funcion, are paramerized in erms of some variable, usually denoed as and inerpreed as ime. The variable is wrien as a funcion of
More informationStochastic Model for Cancer Cell Growth through Single Forward Mutation
Journal of Modern Applied Saisical Mehods Volume 16 Issue 1 Aricle 31 5-1-2017 Sochasic Model for Cancer Cell Growh hrough Single Forward Muaion Jayabharahiraj Jayabalan Pondicherry Universiy, jayabharahi8@gmail.com
More informationSolutions from Chapter 9.1 and 9.2
Soluions from Chaper 9 and 92 Secion 9 Problem # This basically boils down o an exercise in he chain rule from calculus We are looking for soluions of he form: u( x) = f( k x c) where k x R 3 and k is
More informationDecimal moved after first digit = 4.6 x Decimal moves five places left SCIENTIFIC > POSITIONAL. a) g) 5.31 x b) 0.
PHYSICS 20 UNIT 1 SCIENCE MATH WORKSHEET NAME: A. Sandard Noaion Very large and very small numbers are easily wrien using scienific (or sandard) noaion, raher han decimal (or posiional) noaion. Sandard
More informationChapter 5. Heterocedastic Models. Introduction to time series (2008) 1
Chaper 5 Heerocedasic Models Inroducion o ime series (2008) 1 Chaper 5. Conens. 5.1. The ARCH model. 5.2. The GARCH model. 5.3. The exponenial GARCH model. 5.4. The CHARMA model. 5.5. Random coefficien
More informationFinancial Econometrics Jeffrey R. Russell Midterm Winter 2009 SOLUTIONS
Name SOLUTIONS Financial Economerics Jeffrey R. Russell Miderm Winer 009 SOLUTIONS You have 80 minues o complee he exam. Use can use a calculaor and noes. Try o fi all your work in he space provided. If
More informationPredator - Prey Model Trajectories and the nonlinear conservation law
Predaor - Prey Model Trajecories and he nonlinear conservaion law James K. Peerson Deparmen of Biological Sciences and Deparmen of Mahemaical Sciences Clemson Universiy Ocober 28, 213 Ouline Drawing Trajecories
More informationEcon Autocorrelation. Sanjaya DeSilva
Econ 39 - Auocorrelaion Sanjaya DeSilva Ocober 3, 008 1 Definiion Auocorrelaion (or serial correlaion) occurs when he error erm of one observaion is correlaed wih he error erm of any oher observaion. This
More informationProblem 1 / 25 Problem 2 / 20 Problem 3 / 10 Problem 4 / 15 Problem 5 / 30 TOTAL / 100
eparmen of Applied Economics Johns Hopkins Universiy Economics 602 Macroeconomic Theory and Policy Miderm Exam Suggesed Soluions Professor Sanjay hugh Fall 2008 NAME: The Exam has a oal of five (5) problems
More information