ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.
|
|
- Madeline Lang
- 6 years ago
- Views:
Transcription
1 ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple Regression Model: Esimaor Sampling Characerisics and Properies," Ch. 6 in Learning and Pracicing Economerics Opional Reading: Kennedy. Appendix A: Sampling Disribuions: he Foundaion of Saisics, in A Guide o Economerics (Ag Library reserve) ACE 56, Universiy of Illinois a Urbana-Champaign 5-
2 Overview In he previous secion, we specified a linear economic model ha led o he following saisical model, known as he simple linear regression model y = β + β x + e We assumed ha e and y are independen and idenically disribued normal random variables In compac form, he assumpions of he simple linear regression model are, SR. y = β+ β x + e, =,..., SR. Ee ( ) = 0 Ey ( ) = β+ βx SR3. var( e ) = var( y ) = σ SR4. cov[ e, e ] = cov[ y, y ] = 0 s s s SR5. he variable x is no random and mus ake on a leas wo differen values SR6. e ~ N(0, σ ) y ~ N( β + β x, σ ) ACE 56, Universiy of Illinois a Urbana-Champaign 5-
3 One sample of daa was obained consising of observaions on food expendiure and income for fory households We assumed ha he sample daa was generaed by he previous saisical model Given his sample of daa, we developed he following rules (esimaors) for esimaing he inercep and slope parameers of he (rue, bu unknown) linear saisical model b y x x y = = = = x x = = b = y bx Using he sample daa and leas squares esimaors, we compued he following leas squares esimaes of he unknown inercep and slope for he saisical model b = b = 0.33 A his poin, he esimaes are simply compued numbers ha have no saisical properies! ACE 56, Universiy of Illinois a Urbana-Champaign 5-3
4 We can never know how close hese paricular numbers are o he rue values we are rying o esimae While we canno know he accuracy of he leas squares esimaes, we can examine he properies of he esimaor under repeaed sampling As before, we imagine "hiing" he esimaor wih many hypoheical samples and examining is performance across he samples Repeaed sampling in he food expendiure example can be hough of as seing income levels o be he same across samples, so ha we jus randomly selec new households for he given levels of income In effec, assume ha we can perform a conrolled experimen where he se of values for x are fixed across repeaed samples, bu he values for y vary randomly Applying he leas squares esimaion rules o each new (hypoheical) sample leads o differen b and b esimaes Consequenly, he leas squares esimaion rules b and b are random variables ACE 56, Universiy of Illinois a Urbana-Champaign 5-4
5 Viewing b and b as random variables leads o he following imporan quesions Wha are he means, variances, covariances, and forms of he sampling disribuions for he random variables b and b? Since he leas squares esimaors are only one way of using he sample daa o obain esimaes of he unknown parameers β and β, how well do he leas squares esimaors compare o oher esimaors in repeaed sampling? If someone proposes an esimaion rule for a paricular saisical model, your nex quesion should be: Wha are is sampling characerisics and how good is i? ---Griffihs, Hill and Judge, LPE, p.09 ACE 56, Universiy of Illinois a Urbana-Champaign 5-5
6 ACE 56, Universiy of Illinois a Urbana-Champaign 5-6
7 ACE 56, Universiy of Illinois a Urbana-Champaign 5-7
8 Means, Variances and Covariances of b and b he sampling disribuions shown on he previous page can be developed heoreically We will concenrae on he derivaion of wo imporan properies of he sampling disribuion of b : mean and variance he derivaions for he mean and variance of b and he covariance of b and b are similar, so here is no need o repea he process o develop he desired formulas for he mean and variance of b, i is helpful o firs derive a new version of he leas squares formula for b We sar by re-saing he original version, b y x x y = = = = x x = = ACE 56, Universiy of Illinois a Urbana-Champaign 5-8
9 he previous formula can be re-wrien as, b = = ( x x)( y y) = ( x x) Simply muliplying ou he righ hand erm of he numeraor, we ge, b ( x x)( y y) ( x x) y ( x x) y = = = = = ( x x) ( x x) = = or, b = ( x x) y y ( x x) = = ( x x) = Since, = ( x x) = 0, his can be simplified o ACE 56, Universiy of Illinois a Urbana-Champaign 5-9
10 b = = = ( x x) y ( x x) Nex, b = wy = where, w = = ( x x) ( x x) Finally, subsiue he original formula for he saisical model, y = β+ βx + e, for y, b = w y = w ( β + β x + e ) = = ACE 56, Universiy of Illinois a Urbana-Champaign 5-0
11 or, and, since b = β w + β wx + we = = = b = = = β + we = w = 0 and wx = his new formula for he leas squares esimaor is quie valuable in deriving properies of b ACE 56, Universiy of Illinois a Urbana-Champaign 5-
12 Mean he mean is derived by aking he expecaion of b, Eb ( ) = E β + we = Eb ( ) E( β ) wee ( ) = + Eb ( ) = = β his shows ha he mean of he sampling disribuion of b is β, he populaion slope parameer Wha happens if our saisical model is no correcly specified? In his case, omiing an imporan variable will make and Ee ( ) 0 Eb ( ) β wee ( ) = + = ACE 56, Universiy of Illinois a Urbana-Champaign 5-
13 If β is posiive and he omied variable ends o increase he size of posiive errors, hen Eb ( ) > β If β is posiive and he omied variable ends o increase he size of negaive errors, hen Eb ( ) < β Discussion highlighs he imporance of using economic heory o correcly specify he saisical model Specificaion quesions dominae applied economeric work We will discuss his issue exensively nex semeser ACE 56, Universiy of Illinois a Urbana-Champaign 5-3
14 Variance he variance of b in repeaed samples is var( b ) = E[ b E( b )] = E[ b β ] Variance measures he precision of b in he sense ha i ells us how much he esimaes produced by b vary from sample-o-sample he lower he variance of an esimaor, he greaer he sampling precision he greaer he variance of an esimaor, he lower he sampling precision Key poin: An esimaor is considered more precise han anoher esimaor if is sampling variance is less han ha of anoher esimaor Economericians place a high prioriy on developing precise esimaors ACE 56, Universiy of Illinois a Urbana-Champaign 5-4
15 ACE 56, Universiy of Illinois a Urbana-Champaign 5-5
16 We can derive he variance of b as follows, var( b) = var β + we = var we = = var( ) var( ) scov(, s) = = s= b = w e + ww e e s var( b ) = w var( e) = σ σ = = var( b ) = w = w and, var( b ) σ = ( x x) = where = w = = ( x x) ACE 56, Universiy of Illinois a Urbana-Champaign 5-6
17 he sandard deviaion of b is found in he usual manner se( b) = var( b) = σ ( x x) = Noice ha he erm "sandard error" (se) is normally used in place of sandard deviaion of he sampling disribuion o see why, define he error ha arises in esimaing he rue slope parameer as f = b β Applying our rules for he mean and variance of he ransformaion of a random variable we find ha E( f) = 0 and var( f) = var( b ) Since he expeced esimaion error is zero, we can say ha he ypical error (wihou regard o sign) is given by he sandard deviaion of f, which equals he sandard deviaion of b If we replace "ypical" wih "sandard" we can say ha se( b ) measures he sandard esimaion error for b, or in abbreviaed form, sandard error ACE 56, Universiy of Illinois a Urbana-Champaign 5-7
18 Form Now ha we have derived he mean and variance of he sampling disribuion of b, we can urn our aenion o he form of he sampling disribuion Earlier, we noed ha b = wy = where, w = = ( x x) ( x x) Wriing he formula in he above forma shows ha he leas squares rule b is a linear funcion of he y he y are normally disribued (by assumpion) Any linear funcion of normally disribued random variables is iself normally disribued ACE 56, Universiy of Illinois a Urbana-Champaign 5-8
19 ACE 56, Universiy of Illinois a Urbana-Champaign 5-9 hus, b is normally disribued in repeaed sampling ~, ( ) b N x x β σ = We will simply sae he mean and variance resuls for b, ( ) Eb β = var( ) ( ) x b x x σ = = = Using a similar argumen as we did for b, i can be shown ha ~, ( ) x b N x x β σ = =
20 Covariance Finally, he covariance beween random variables b and b in repeaed sampling is, cov( b, b ) x = σ ( x x) = ACE 56, Universiy of Illinois a Urbana-Champaign 5-0
21 Probabiliy Calculaions Using Sampling Disribuions While i is fun (!) o simply derive sampling disribuions, heir real usefulness is found in making probabiliy saemens abou our esimaes Le's suppose ha he rue regression model is y = x + e and all of he sandard assumpions hold for he error erm and σ = 50 Now assume ha we are "given" a se of = 5 values for he independen variable x and ( x x) = 5,000 = We now have all he informaion o derive he sampling disribuion of b he expeced value of b is given in his example as Eb ( ) = β = 0.5 ACE 56, Universiy of Illinois a Urbana-Champaign 5-
22 he sampling variance of b is b = = = var( ) σ ,000 ( x x) = Puing he wo ogeher wih our normaliy assumpion b ~ N (0.5,0.0033) Suppose we wan o deermine he probabiliy ha our esimae from a single sample is beween 0.0 and 0.30 Pr(0.0 b 0.30) =? We can ransform his ino a sandard normal probabiliy saemen o obain he answer b = Pr? Pr( Z ) ACE 56, Universiy of Illinois a Urbana-Champaign 5-
23 Facors ha Affec he Variances and Covariance of he Sampling Disribuions of b and b var( b ) x = = σ ( x x) = var( b ) = σ ( x x) = cov( b, b ) x = σ ( x x) = Imporan observaions:. he variance of he error erm ( σ ) appears in each formula he larger he variance, σ, he greaer he uncerainy abou where he values of y will fall relaive o he populaion mean, E( y ) Sample informaion available o esimae βand β is less precise he larger is σ ACE 56, Universiy of Illinois a Urbana-Champaign 5-3
24 ACE 56, Universiy of Illinois a Urbana-Champaign 5-4
25 ACE 56, Universiy of Illinois a Urbana-Champaign 5-5
26 . he sum of squares for x denominaor of each formula = ( x x) appears in he Sum of squares for x measures he spread, or variaion, of x he larger he variaion in x, he smaller are he variances and covariance of b and b he more informaion we have abou x, he more precisely can we esimae βand β 3. he larger he sample size, he smaller he variances and covariance of b and b As increases, he sum of squares for increases unambiguously Effec is clear for var( b ) and cov( b, b ) Same impac on var( b ) because and variaion in x appear in denominaor he more informaion we have abou x, he more precisely can we esimae βand β ACE 56, Universiy of Illinois a Urbana-Champaign 5-6
27 ACE 56, Universiy of Illinois a Urbana-Champaign 5-7
28 y y y y x x x x x Which daa sample would you raher use o esimae he linear relaionship beween x and y? ACE 56, Universiy of Illinois a Urbana-Champaign 5-8
29 4. he erm for var( b ) = x appears in he numeraor of he formula x measures he disance of he daa on x from he = origin he more disan from zero are he daa on x, he independen variable, he more difficul i is o accuraely esimae he inercep β 5. x appears in he numeraor of cov( b, b ) Covariance has he opposie sign as x Covariance increases in magniude he larger is x An undersanding of he previous five poins is of grea value when inerpreing regression resuls in applied research ACE 56, Universiy of Illinois a Urbana-Champaign 5-9
30 y y y y x x x x Which daa sample would you raher use o esimae he inercep in he linear relaionship beween x and y? ACE 56, Universiy of Illinois a Urbana-Champaign 5-30
31 y y y y x x x x x Demonsraion of negaive covariance beween slope and inercep esimaes when mean of x is posiive ACE 56, Universiy of Illinois a Urbana-Champaign 5-3
32 Summary of Key Facors Affecing Precision of Leas Squares Esimaors In he following able, characerisics of he sample daa are caegorized in erms of impac on precision Sample Characerisic High Variance of y Low Variance of y High Variaion in x Low Variaion in x Large Small Small Disance from Origin and x Large Disance from Origin and x More Precision Less Precision ACE 56, Universiy of Illinois a Urbana-Champaign 5-3
33 Sampling Properies of he Leas Squares Esimaors Since here are a number of differen rules for obaining esimaes of β and β, how can we be assured ha b and b are he "bes" rules? Previously, we developed four main crieria for "good" esimaors Compuaional cos: Esimaor is a linear funcion of sample daa Unbiasedness: In repeaed sampling, he esimaor generaes esimaes ha on average equal he populaion parameer Efficiency: Of all possible unbiased esimaors, here is no oher esimaor ha has a smaller variance Consisency: As he sample size increases he probabiliy mass of he of esimaor "collapses" on he populaion parameer We will examine he leas squares esimaor b o see if i mees hese four crieria Similar resuls hold for b ACE 56, Universiy of Illinois a Urbana-Champaign 5-33
34 Compuaional Cos Earlier, we noed ha, where, w b = = wy = = ( x x) ( x x) Wriing he formula in he above forma shows ha he leas squares rule b is a linear funcion of he y Unbiasedness We wan o know wheher he expeced value of b is in fac equal o β Earlier, we showed ha he mean is derived by aking he expecaion of he following version of he formula for b, Eb ( ) = E β + we = ACE 56, Universiy of Illinois a Urbana-Champaign 5-34
35 Eb ( ) E( β ) wee ( ) = + Eb ( ) = = β Shows ha he leas squares esimaor b is unbiased Efficiency For a given sample size, we wan o know wheher he sampling variance of b is smaller han any oher unbiased, linear esimaor Desire an esimaor ha gives us he highes probabiliy of obaining an esimae close o he rue parameer value In oher words, is here a differen esimaor ha produces a sampling variance smaller han he following formula, var( b ) = σ ( x x) = ACE 56, Universiy of Illinois a Urbana-Champaign 5-35
36 For all unbiased linear esimaors, var(b ) is he smalles sampling variance possible Proof is found on pp of Hill e. al, Undergraduae Economerics and many oher exs Consisency We wan o show ha as he sample size increases, he probabiliy mass of he of esimaor "collapses" on he populaion parameer his can be demonsraed informally by noing he formula for he sampling variance of b, var( b ) = σ ( x x) = and ha b = σ = x x lim var( ) 0 ( ) = ACE 56, Universiy of Illinois a Urbana-Champaign 5-36
37 Summary of Sampling Properies Discussion he leas squares esimaors b and b of he populaion parameers β and β are, Linear Unbiased Efficien Consisen he firs hree properies are sufficien o prove ha b and b are he bes linear unbiased esimaors (BLUE) of β and β In his conex "bes" implies minimum variance sampling disribuion Known as he Gauss-Markov heorem ACE 56, Universiy of Illinois a Urbana-Champaign 5-37
38 Key Poins: he esimaors b and b are bes when compared o similar esimaors, hose ha are linear and unbiased. he Gauss-Markov heorem does no say ha b and b are he bes of all possible esimaors. he esimaors b and b are bes wihin heir class because hey have he minimum variance. In order for he Gauss-Markov heorem o hold, he assumpions (SR-SR5) mus be rue. If any of he assumpions -5 are no rue, hen b and b are no he bes linear unbiased esimaors of β and β. he Gauss-Markov heorem does no depend on he assumpion of normaliy. In he simple linear regression model, if we wan o use a linear and unbiased esimaor, hen we have o do no more searching. he Gauss-Markov heorem applies o he leas squares esimaors. I does no apply o he leas squares esimaes from a single sample. ACE 56, Universiy of Illinois a Urbana-Champaign 5-38
39 Esimaing he Variance of he Error erm Recall ha e and y were assumed o be iid wih he following disribuions, e ~ N(0, σ ) and y ~ N( β + β x, σ ) Unless σ is known, which is highly unlikely, i will have o be esimaed as well Again, we canno use he leas squares principle, as does no appear in he sum of squares funcion, σ = = = = S( β, β ) e ( y β β x ) Insead, we apply a "heurisic" procedure based on he definiion of σ ACE 56, Universiy of Illinois a Urbana-Champaign 5-39
40 he original definiion of σ in he saisical model is, σ var( y) = var( e) = = E[ e ] In oher words, he variance is he expeced value of he squared errors Given his definiion, i would be naural o esimae as he average of he squared errors σ In order o do his, we mus firs obain esimaes of he populaion errors using our sample daa as e = y b b x ˆ We can hen develop our sample esimaor of σ as, eˆ eˆ + eˆ eˆ ˆ = = Noice he squared sample errors are averaged by dividing by - no (or -) Accouns for he fac ha regression parameers ( β, β ) have o be esimaed ACE 56, Universiy of Illinois a Urbana-Champaign 5-40
41 Many regression packages repor somehing called he "sandard error of he regression" his is simply he square roo of he esimaed variance of he error erm, eˆ ˆ ˆ ˆ... ˆ σ ˆ σ e + e + + e = = = = Warning: Do no confuse he sandard error of he regression wih he sandard error of he sampling disribuion of he leas squares esimaors b and b ACE 56, Universiy of Illinois a Urbana-Champaign 5-4
42 Sampling Properies of Variance Esimaor he rule derived for esimaing he populaion variance of he error erm ( σ ) is, ˆ = σ = eˆ Jus as was he case wih b and b, we are ineresed in he sampling properies of ˆ σ he same four crieria are applied when asking wheher ˆ σ is a "good" esimaion rule Compuaional cos, unbiasedness, efficiency, consisency I is obvious ha ˆ σ is no a linear esimaor I can be shown ha ˆ σ is unbiased, efficien, and consisen Bes unbiased esimaor (BUE) Proof can be found in advanced economerics books ACE 56, Universiy of Illinois a Urbana-Champaign 5-4
43 he nex issue is he form of he sampling disribuion of he variance esimaor ˆ σ o derive he sampling disribuion, firs noe ha he populaion random errors are disribued as, e ~ N(0, σ ) =,..., Consequenly, e ~ N(0,) =,..., σ and, e σ ~ χ =,..., If we sum over he ransformed random errors, i= e σ ~ χ ACE 56, Universiy of Illinois a Urbana-Champaign 5-43
44 Based on he previous resul, we can generae he sampling disribuion of ˆ σ, ˆ ~ σ σ χ Noe ha he sampling disribuion of ˆ σ is proporional o a chi-square wih - degrees of freedom ACE 56, Universiy of Illinois a Urbana-Champaign 5-44
45 Esimaors of he Variances and Covariance of b and b Recall ha he variances and covariance of he sampling disribuions of b and b were funcions of he unknown parameer σ We can generae esimaors of he variances and covariances of b and b by simply replacing σ wih ˆ σ in he earlier formulas, var( ˆ b ) x = = ˆ σ ( x x) = var( ˆ b ) ˆ = σ ( x x) = cov( ˆ b, b ) ˆ x = σ ( x x) = ACE 56, Universiy of Illinois a Urbana-Champaign 5-45
46 Likewise, he esimaors for he sandard errors of b and b are, x = se ˆ( b ˆ ˆ ) = var( b) = σ ( x x) = se ˆ( b ) var( ˆ ) ˆ σ = b = ( x x) = his maerial is ricky: We developed esimaors of he variances, covariance and sandard errors of he leas squares esimaors of b and b!! While we will no consider he exra complexiy, he esimaors of he variances, covariance and sandard errors are hemselves random variables whose values vary in repeaed sampling ACE 56, Universiy of Illinois a Urbana-Champaign 5-46
47 Sample Esimaes of he Variances and Covariance of b and b We can now use our sample daa on food expendiure and income o generae esimaes of he variances and covariance of b and b Firs, esimae he variance of he error erm, eˆ = ˆ σ = = = and he sandard error of he regression, ˆ ˆ σ = σ = = Nex, esimae he variances, sandard errors, and covariance of b and b, x = var( ˆ b ˆ ) = σ = (0.349) = ( x x) = ACE 56, Universiy of Illinois a Urbana-Champaign 5-47
48 se ˆ ( b ) = var( ˆ b ) = = ˆ ˆ var( b ) = σ = ( ) = ( x x) = se ˆ ( b ) = var( ˆ b ) = = ˆ b b ˆ x cov(, ) = σ = ( ) = 0.34 ( x x) = ACE 56, Universiy of Illinois a Urbana-Champaign 5-48
49 Sample Regression Oupu from Excel SUMMARY OUPU Regression Saisics Muliple R R Square Adjused R Square Sandard Error Observaions 40 ANOVA df SS MS F Significance F Regression Residual oal Coefficiens Sandard Error Sa P-value Lower 95% Upper 95% Inercep X Variable ACE 56, Universiy of Illinois a Urbana-Champaign 5-49
50 Summary of Esimaes for Food Expendiure Daa b = b = 0.33 ˆ σ = var( ˆ ) b = cov( ˆ b, b ) = 0.34 var( ˆ b ) = Based on his informaion and he assumpion ha he saisical model is correcly specified, we can esimae he disribuions of e and y as, e ~ N(0, ) y ~ N( x, ) We also can esimae he sampling disribuions of b and b as, b ~ N(7.38,6.0669) b ~ N (0.33, 0.003) ACE 56, Universiy of Illinois a Urbana-Champaign 5-50
51 Inerpreaion Guidelines Regression sandard error ˆ ˆ σ = σ = = We say, he ypical error of he regression model, wihou regard o sign, is esimaed o be $6.845/week. Sandard error of parameer esimaes se ˆ ( b ) = var( ˆ b ) = = We say, he ypical error in esimaing β, wihou regard o sign, is esimaed o be se ˆ ( b ) = var( ˆ b ) = = We say, he ypical error in esimaing β, wihou regard o sign, is esimaed o be ACE 56, Universiy of Illinois a Urbana-Champaign 5-5
52 ACE 56, Universiy of Illinois a Urbana-Champaign 5-5
53 ACE 56, Universiy of Illinois a Urbana-Champaign 5-53
54 ACE 56, Universiy of Illinois a Urbana-Champaign 5-54
ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H.
ACE 56 Fall 5 Lecure 8: The Simple Linear Regression Model: R, Reporing he Resuls and Predicion by Professor Sco H. Irwin Required Readings: Griffihs, Hill and Judge. "Explaining Variaion in he Dependen
More informationACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin
ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model
More informationACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H.
ACE 564 Spring 2006 Lecure 7 Exensions of The Muliple Regression Model: Dumm Independen Variables b Professor Sco H. Irwin Readings: Griffihs, Hill and Judge. "Dumm Variables and Varing Coefficien Models
More informationDistribution of Estimates
Disribuion of Esimaes From Economerics (40) Linear Regression Model Assume (y,x ) is iid and E(x e )0 Esimaion Consisency y α + βx + he esimaes approach he rue values as he sample size increases Esimaion
More information20. Applications of the Genetic-Drift Model
0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0
More informationDiebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles
Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance
More informationUnit Root Time Series. Univariate random walk
Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he
More informationThe Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form
Chaper 6 The Simple Linear Regression Model: Reporing he Resuls and Choosing he Funcional Form To complee he analysis of he simple linear regression model, in his chaper we will consider how o measure
More informationComparing Means: t-tests for One Sample & Two Related Samples
Comparing Means: -Tess for One Sample & Two Relaed Samples Using he z-tes: Assumpions -Tess for One Sample & Two Relaed Samples The z-es (of a sample mean agains a populaion mean) is based on he assumpion
More informationGMM - Generalized Method of Moments
GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................
More informationChapter 11. Heteroskedasticity The Nature of Heteroskedasticity. In Chapter 3 we introduced the linear model (11.1.1)
Chaper 11 Heeroskedasiciy 11.1 The Naure of Heeroskedasiciy In Chaper 3 we inroduced he linear model y = β+β x (11.1.1) 1 o explain household expendiure on food (y) as a funcion of household income (x).
More informationBias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé
Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070
More informationEcon107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)
I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression
More informationLecture 33: November 29
36-705: Inermediae Saisics Fall 2017 Lecurer: Siva Balakrishnan Lecure 33: November 29 Today we will coninue discussing he boosrap, and hen ry o undersand why i works in a simple case. In he las lecure
More informationWednesday, November 7 Handout: Heteroskedasticity
Amhers College Deparmen of Economics Economics 360 Fall 202 Wednesday, November 7 Handou: Heeroskedasiciy Preview Review o Regression Model o Sandard Ordinary Leas Squares (OLS) Premises o Esimaion Procedures
More informationEcon Autocorrelation. Sanjaya DeSilva
Econ 39 - Auocorrelaion Sanjaya DeSilva Ocober 3, 008 1 Definiion Auocorrelaion (or serial correlaion) occurs when he error erm of one observaion is correlaed wih he error erm of any oher observaion. This
More informationRobust estimation based on the first- and third-moment restrictions of the power transformation model
h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,
More informationTesting the Random Walk Model. i.i.d. ( ) r
he random walk heory saes: esing he Random Walk Model µ ε () np = + np + Momen Condiions where where ε ~ i.i.d he idea here is o es direcly he resricions imposed by momen condiions. lnp lnp µ ( lnp lnp
More informationOn Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature
On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check
More informationProperties of Autocorrelated Processes Economics 30331
Properies of Auocorrelaed Processes Economics 3033 Bill Evans Fall 05 Suppose we have ime series daa series labeled as where =,,3, T (he final period) Some examples are he dail closing price of he S&500,
More informationMeasurement Error 1: Consequences Page 1. Definitions. For two variables, X and Y, the following hold: Expectation, or Mean, of X.
Measuremen Error 1: Consequences of Measuremen Error Richard Williams, Universiy of Nore Dame, hps://www3.nd.edu/~rwilliam/ Las revised January 1, 015 Definiions. For wo variables, X and Y, he following
More informationLinear Response Theory: The connection between QFT and experiments
Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and
More information(a) Set up the least squares estimation procedure for this problem, which will consist in minimizing the sum of squared residuals. 2 t.
Insrucions: The goal of he problem se is o undersand wha you are doing raher han jus geing he correc resul. Please show your work clearly and nealy. No credi will be given o lae homework, regardless of
More informationBiol. 356 Lab 8. Mortality, Recruitment, and Migration Rates
Biol. 356 Lab 8. Moraliy, Recruimen, and Migraion Raes (modified from Cox, 00, General Ecology Lab Manual, McGraw Hill) Las week we esimaed populaion size hrough several mehods. One assumpion of all hese
More information3.1 More on model selection
3. More on Model selecion 3. Comparing models AIC, BIC, Adjused R squared. 3. Over Fiing problem. 3.3 Sample spliing. 3. More on model selecion crieria Ofen afer model fiing you are lef wih a handful of
More informationRegression with Time Series Data
Regression wih Time Series Daa y = β 0 + β 1 x 1 +...+ β k x k + u Serial Correlaion and Heeroskedasiciy Time Series - Serial Correlaion and Heeroskedasiciy 1 Serially Correlaed Errors: Consequences Wih
More informationLecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.
Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in
More informationGeneralized Least Squares
Generalized Leas Squares Augus 006 1 Modified Model Original assumpions: 1 Specificaion: y = Xβ + ε (1) Eε =0 3 EX 0 ε =0 4 Eεε 0 = σ I In his secion, we consider relaxing assumpion (4) Insead, assume
More information1 Review of Zero-Sum Games
COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any
More informationChapter 2. First Order Scalar Equations
Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.
More informationEstimation Uncertainty
Esimaion Uncerainy The sample mean is an esimae of β = E(y +h ) The esimaion error is = + = T h y T b ( ) = = + = + = = = T T h T h e T y T y T b β β β Esimaion Variance Under classical condiions, where
More informationNotes for Lecture 17-18
U.C. Berkeley CS278: Compuaional Complexiy Handou N7-8 Professor Luca Trevisan April 3-8, 2008 Noes for Lecure 7-8 In hese wo lecures we prove he firs half of he PCP Theorem, he Amplificaion Lemma, up
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More informationR t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t
Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,
More informationy = β 1 + β 2 x (11.1.1)
Chaper 11 Heeroskedasiciy 11.1 The Naure of Heeroskedasiciy In Chaper 3 we inroduced he linear model y = β 1 + β x (11.1.1) o explain household expendiure on food (y) as a funcion of household income (x).
More informationHypothesis Testing in the Classical Normal Linear Regression Model. 1. Components of Hypothesis Tests
ECONOMICS 35* -- NOTE 8 M.G. Abbo ECON 35* -- NOTE 8 Hypohesis Tesing in he Classical Normal Linear Regression Model. Componens of Hypohesis Tess. A esable hypohesis, which consiss of wo pars: Par : a
More information2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes
Some common engineering funcions 2.7 Inroducion This secion provides a caalogue of some common funcions ofen used in Science and Engineering. These include polynomials, raional funcions, he modulus funcion
More informationSolutions to Odd Number Exercises in Chapter 6
1 Soluions o Odd Number Exercises in 6.1 R y eˆ 1.7151 y 6.3 From eˆ ( T K) ˆ R 1 1 SST SST SST (1 R ) 55.36(1.7911) we have, ˆ 6.414 T K ( ) 6.5 y ye ye y e 1 1 Consider he erms e and xe b b x e y e b
More informationDynamic Econometric Models: Y t = + 0 X t + 1 X t X t k X t-k + e t. A. Autoregressive Model:
Dynamic Economeric Models: A. Auoregressive Model: Y = + 0 X 1 Y -1 + 2 Y -2 + k Y -k + e (Wih lagged dependen variable(s) on he RHS) B. Disribued-lag Model: Y = + 0 X + 1 X -1 + 2 X -2 + + k X -k + e
More informationExplaining Total Factor Productivity. Ulrich Kohli University of Geneva December 2015
Explaining Toal Facor Produciviy Ulrich Kohli Universiy of Geneva December 2015 Needed: A Theory of Toal Facor Produciviy Edward C. Presco (1998) 2 1. Inroducion Toal Facor Produciviy (TFP) has become
More informationAnswers to QUIZ
18441 Answers o QUIZ 1 18441 1 Le P be he proporion of voers who will voe Yes Suppose he prior probabiliy disribuion of P is given by Pr(P < p) p for 0 < p < 1 You ake a poll by choosing nine voers a random,
More informationt is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...
Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger
More informationECON 482 / WH Hong Time Series Data Analysis 1. The Nature of Time Series Data. Example of time series data (inflation and unemployment rates)
ECON 48 / WH Hong Time Series Daa Analysis. The Naure of Time Series Daa Example of ime series daa (inflaion and unemploymen raes) ECON 48 / WH Hong Time Series Daa Analysis The naure of ime series daa
More informationMathcad Lecture #8 In-class Worksheet Curve Fitting and Interpolation
Mahcad Lecure #8 In-class Workshee Curve Fiing and Inerpolaion A he end of his lecure, you will be able o: explain he difference beween curve fiing and inerpolaion decide wheher curve fiing or inerpolaion
More information1. Diagnostic (Misspeci cation) Tests: Testing the Assumptions
Business School, Brunel Universiy MSc. EC5501/5509 Modelling Financial Decisions and Markes/Inroducion o Quaniaive Mehods Prof. Menelaos Karanasos (Room SS269, el. 01895265284) Lecure Noes 6 1. Diagnosic
More informationProblem Set 5. Graduate Macro II, Spring 2017 The University of Notre Dame Professor Sims
Problem Se 5 Graduae Macro II, Spring 2017 The Universiy of Nore Dame Professor Sims Insrucions: You may consul wih oher members of he class, bu please make sure o urn in your own work. Where applicable,
More informationMath 10B: Mock Mid II. April 13, 2016
Name: Soluions Mah 10B: Mock Mid II April 13, 016 1. ( poins) Sae, wih jusificaion, wheher he following saemens are rue or false. (a) If a 3 3 marix A saisfies A 3 A = 0, hen i canno be inverible. True.
More informationChristos Papadimitriou & Luca Trevisan November 22, 2016
U.C. Bereley CS170: Algorihms Handou LN-11-22 Chrisos Papadimiriou & Luca Trevisan November 22, 2016 Sreaming algorihms In his lecure and he nex one we sudy memory-efficien algorihms ha process a sream
More informationPENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD
PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.
More informationFITTING EQUATIONS TO DATA
TANTON S TAKE ON FITTING EQUATIONS TO DATA CURRICULUM TIDBITS FOR THE MATHEMATICS CLASSROOM MAY 013 Sandard algebra courses have sudens fi linear and eponenial funcions o wo daa poins, and quadraic funcions
More informationSome Basic Information about M-S-D Systems
Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,
More informationState-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter
Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when
More informationd 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3
and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or
More informationIntroduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.
Inroducion Gordon Model (1962): D P = r g r = consan discoun rae, g = consan dividend growh rae. If raional expecaions of fuure discoun raes and dividend growh vary over ime, so should he D/P raio. Since
More information( ) ( ) if t = t. It must satisfy the identity. So, bulkiness of the unit impulse (hyper)function is equal to 1. The defining characteristic is
UNIT IMPULSE RESPONSE, UNIT STEP RESPONSE, STABILITY. Uni impulse funcion (Dirac dela funcion, dela funcion) rigorously defined is no sricly a funcion, bu disribuion (or measure), precise reamen requires
More information13.3 Term structure models
13.3 Term srucure models 13.3.1 Expecaions hypohesis model - Simples "model" a) shor rae b) expecaions o ge oher prices Resul: y () = 1 h +1 δ = φ( δ)+ε +1 f () = E (y +1) (1) =δ + φ( δ) f (3) = E (y +)
More informationDEPARTMENT OF STATISTICS
A Tes for Mulivariae ARCH Effecs R. Sco Hacker and Abdulnasser Haemi-J 004: DEPARTMENT OF STATISTICS S-0 07 LUND SWEDEN A Tes for Mulivariae ARCH Effecs R. Sco Hacker Jönköping Inernaional Business School
More informationSimulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010
Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid
More informationLicenciatura de ADE y Licenciatura conjunta Derecho y ADE. Hoja de ejercicios 2 PARTE A
Licenciaura de ADE y Licenciaura conjuna Derecho y ADE Hoja de ejercicios PARTE A 1. Consider he following models Δy = 0.8 + ε (1 + 0.8L) Δ 1 y = ε where ε and ε are independen whie noise processes. In
More informationKriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number
More information5.1 - Logarithms and Their Properties
Chaper 5 Logarihmic Funcions 5.1 - Logarihms and Their Properies Suppose ha a populaion grows according o he formula P 10, where P is he colony size a ime, in hours. When will he populaion be 2500? We
More informationTime series Decomposition method
Time series Decomposiion mehod A ime series is described using a mulifacor model such as = f (rend, cyclical, seasonal, error) = f (T, C, S, e) Long- Iner-mediaed Seasonal Irregular erm erm effec, effec,
More informationMatrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality
Marix Versions of Some Refinemens of he Arihmeic-Geomeric Mean Inequaliy Bao Qi Feng and Andrew Tonge Absrac. We esablish marix versions of refinemens due o Alzer ], Carwrigh and Field 4], and Mercer 5]
More informationReferences are appeared in the last slide. Last update: (1393/08/19)
SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be
More informationCONFIDENCE LIMITS AND THEIR ROBUSTNESS
CONFIDENCE LIMITS AND THEIR ROBUSTNESS Rajendran Raja Fermi Naional Acceleraor laboraory Baavia, IL 60510 Absrac Confidence limis are common place in physics analysis. Grea care mus be aken in heir calculaion
More informationChapter 7: Solving Trig Equations
Haberman MTH Secion I: The Trigonomeric Funcions Chaper 7: Solving Trig Equaions Le s sar by solving a couple of equaions ha involve he sine funcion EXAMPLE a: Solve he equaion sin( ) The inverse funcions
More informationOBJECTIVES OF TIME SERIES ANALYSIS
OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging
More informationDistribution of Least Squares
Disribuion of Leas Squares In classic regression, if he errors are iid normal, and independen of he regressors, hen he leas squares esimaes have an exac normal disribuion, no jus asympoic his is no rue
More informationThe Multiple Regression Model: Hypothesis Tests and the Use of Nonsample Information
Chaper 8 The Muliple Regression Model: Hypohesis Tess and he Use of Nonsample Informaion An imporan new developmen ha we encouner in his chaper is using he F- disribuion o simulaneously es a null hypohesis
More informationLet us start with a two dimensional case. We consider a vector ( x,
Roaion marices We consider now roaion marices in wo and hree dimensions. We sar wih wo dimensions since wo dimensions are easier han hree o undersand, and one dimension is a lile oo simple. However, our
More informationWednesday, December 5 Handout: Panel Data and Unobservable Variables
Amhers College Deparmen of Economics Economics 360 Fall 0 Wednesday, December 5 Handou: Panel Daa and Unobservable Variables Preview Taking Sock: Ordinary Leas Squares (OLS) Esimaion Procedure o Sandard
More information5. Stochastic processes (1)
Lec05.pp S-38.45 - Inroducion o Teleraffic Theory Spring 2005 Conens Basic conceps Poisson process 2 Sochasic processes () Consider some quaniy in a eleraffic (or any) sysem I ypically evolves in ime randomly
More information10. State Space Methods
. Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he
More informationINTRODUCTION TO MACHINE LEARNING 3RD EDITION
ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class
More informationPhysics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle
Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,
More informationNCSS Statistical Software. , contains a periodic (cyclic) component. A natural model of the periodic component would be
NCSS Saisical Sofware Chaper 468 Specral Analysis Inroducion This program calculaes and displays he periodogram and specrum of a ime series. This is someimes nown as harmonic analysis or he frequency approach
More informationMATH 4330/5330, Fourier Analysis Section 6, Proof of Fourier s Theorem for Pointwise Convergence
MATH 433/533, Fourier Analysis Secion 6, Proof of Fourier s Theorem for Poinwise Convergence Firs, some commens abou inegraing periodic funcions. If g is a periodic funcion, g(x + ) g(x) for all real x,
More informationComputer Simulates the Effect of Internal Restriction on Residuals in Linear Regression Model with First-order Autoregressive Procedures
MPRA Munich Personal RePEc Archive Compuer Simulaes he Effec of Inernal Resricion on Residuals in Linear Regression Model wih Firs-order Auoregressive Procedures Mei-Yu Lee Deparmen of Applied Finance,
More informationWe just finished the Erdős-Stone Theorem, and ex(n, F ) (1 1/(χ(F ) 1)) ( n
Lecure 3 - Kövari-Sós-Turán Theorem Jacques Versraëe jacques@ucsd.edu We jus finished he Erdős-Sone Theorem, and ex(n, F ) ( /(χ(f ) )) ( n 2). So we have asympoics when χ(f ) 3 bu no when χ(f ) = 2 i.e.
More informationL07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms
L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)
More informationExponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits
DOI: 0.545/mjis.07.5009 Exponenial Weighed Moving Average (EWMA) Char Under The Assumpion of Moderaeness And Is 3 Conrol Limis KALPESH S TAILOR Assisan Professor, Deparmen of Saisics, M. K. Bhavnagar Universiy,
More information23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes
Represening Periodic Funcions by Fourier Series 3. Inroducion In his Secion we show how a periodic funcion can be expressed as a series of sines and cosines. We begin by obaining some sandard inegrals
More informationEnsamble methods: Bagging and Boosting
Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par
More informationTwo Coupled Oscillators / Normal Modes
Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own
More informationSection 4.4 Logarithmic Properties
Secion. Logarihmic Properies 59 Secion. Logarihmic Properies In he previous secion, we derived wo imporan properies of arihms, which allowed us o solve some asic eponenial and arihmic equaions. Properies
More informationA Bayesian Approach to Spectral Analysis
Chirped Signals A Bayesian Approach o Specral Analysis Chirped signals are oscillaing signals wih ime variable frequencies, usually wih a linear variaion of frequency wih ime. E.g. f() = A cos(ω + α 2
More informationSection 4.4 Logarithmic Properties
Secion. Logarihmic Properies 5 Secion. Logarihmic Properies In he previous secion, we derived wo imporan properies of arihms, which allowed us o solve some asic eponenial and arihmic equaions. Properies
More informationSolutions to Exercises in Chapter 12
Chaper in Chaper. (a) The leas-squares esimaed equaion is given by (b)!i = 6. + 0.770 Y 0.8 R R = 0.86 (.5) (0.07) (0.6) Boh b and b 3 have he expeced signs; income is expeced o have a posiive effec on
More informationFITTING OF A PARTIALLY REPARAMETERIZED GOMPERTZ MODEL TO BROILER DATA
FITTING OF A PARTIALLY REPARAMETERIZED GOMPERTZ MODEL TO BROILER DATA N. Okendro Singh Associae Professor (Ag. Sa.), College of Agriculure, Cenral Agriculural Universiy, Iroisemba 795 004, Imphal, Manipur
More informationEnsamble methods: Boosting
Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room
More informationLearning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power
Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.
More informationSolutions: Wednesday, November 14
Amhers College Deparmen of Economics Economics 360 Fall 2012 Soluions: Wednesday, November 14 Judicial Daa: Cross secion daa of judicial and economic saisics for he fify saes in 2000. JudExp CrimesAll
More information72 Calculus and Structures
72 Calculus and Srucures CHAPTER 5 DISTANCE AND ACCUMULATED CHANGE Calculus and Srucures 73 Copyrigh Chaper 5 DISTANCE AND ACCUMULATED CHANGE 5. DISTANCE a. Consan velociy Le s ake anoher look a Mary s
More informationLecture 4. Classical Linear Regression Model: Overview
Lecure 4 Classical Linear Regression Model: Overview Regression Regression is probably he single mos imporan ool a he economerician s disposal. Bu wha is regression analysis? I is concerned wih describing
More informationThe Brock-Mirman Stochastic Growth Model
c December 3, 208, Chrisopher D. Carroll BrockMirman The Brock-Mirman Sochasic Growh Model Brock and Mirman (972) provided he firs opimizing growh model wih unpredicable (sochasic) shocks. The social planner
More informationMatlab and Python programming: how to get started
Malab and Pyhon programming: how o ge sared Equipping readers he skills o wrie programs o explore complex sysems and discover ineresing paerns from big daa is one of he main goals of his book. In his chaper,
More informationTwo Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017
Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =
More informationLecture Notes 2. The Hilbert Space Approach to Time Series
Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship
More informationBernoulli numbers. Francesco Chiatti, Matteo Pintonello. December 5, 2016
UNIVERSITÁ DEGLI STUDI DI PADOVA, DIPARTIMENTO DI MATEMATICA TULLIO LEVI-CIVITA Bernoulli numbers Francesco Chiai, Maeo Pinonello December 5, 206 During las lessons we have proved he Las Ferma Theorem
More informationKINEMATICS IN ONE DIMENSION
KINEMATICS IN ONE DIMENSION PREVIEW Kinemaics is he sudy of how hings move how far (disance and displacemen), how fas (speed and velociy), and how fas ha how fas changes (acceleraion). We say ha an objec
More information