Data Considerations and Ordinary Least Squares Estimation of Single-Equation Econometric Models

Size: px
Start display at page:

Download "Data Considerations and Ordinary Least Squares Estimation of Single-Equation Econometric Models"

Transcription

1 Chapter Data Consderatons and Ordnary Least Squares Estmaton of Sngle-Equaton Econometrc Models

2 Secton. Data

3 Crtcal Ingredent n All Appled Econometrc Models Suffcently large amount of hstorcal data. Ask not what you can do to the data, but rather what the data can do for you. Data Types Tme-Seres Cross-Sectonal Combnaton (Panel) 3

4 Crtcal Ingredent Crtcal Ingredent data (sample suffcently large ) Tme-seres data daly, weekly, monthly quarterly, annual DAILY closng prces of stock prces WEEKLY measures of money supply MONTHLY housng starts QUARTERLY GDP fgures ANNUAL salary fgures Cross-Sectonal Data Snapshot of actvty at a gven pont n tme Survey of household expendture patterns Sales fgures from a number of supermarkets at a gven pont n tme Pooled Tme-Seres, Cross-Sectonal Data 4

5 Quote from Lord Kelvn I often say that when you can measure what you are speakng about, and express t n numbers, you know somethng about t; but when you cannot measure t, when you cannot express t n numbers, your knowledge s of a meager and unsatsfactory knd. 5

6 Other Notable Quotes Concernng Data n Appled Econometrcs R.H. Coase: If you torture the data long enough, nature wll confess. E.E. Leamer (983): There are two thngs you are better off not watchng n the makng: sausages and econometrc estmates. 6

7 Secton. Gettng a Feel for the Data

8 Examnng the Data Get a feel for the data. Plots of key varables Scatter plots Descrptve statstcs Mean Outler(s) Medan Skewness Mnmum Kurtoss Maxmum Dstrbuton Standard devaton 8

9 Descrptve Statstcs X Let X X correspond to a vector of T observatons for M X T the varable x. The mean, a measure of central tendency, corresponds to the average of the set of observatons correspondng to a partcular data seres. The mean s gven by. x T The unts assocated wth the mean are the same as the unts of x,,,, T. T x 9

10 Descrptve Statstcs The medan also s a measure of central tendency of a data seres. The medan corresponds to the 50 th percentle of the data seres. The unts assocated wth the medan are the same as the unts of x,,,, T. To fnd the medan, arrange the observatons n ncreasng order. When sample values are arranged n ths fashon, they often are called the st, nd, 3 rd, order statstcs. In general, f T s an odd number, the medan s the order statstc whose number s T and T +. If T s an even number, the medan corresponds to the average of the order statstcs whose numbers are T +. 0 contnued...

11 Descrptve Statstcs The standard devaton s a measure of the spread or dsperson of a seres about the mean. The standard devaton s gven by S The unts assocated wth the standard devaton are the same as the unts of x. T ( x T x) The varance also s a measure of the spread or dsperson of a seres about the mean. ˆ The varance s expressed as Note that σ The unts assocated wth the varance are the square of the unts of x. contnued... T ( x T x).. ˆ σ S.

12 Descrptve Statstcs The mnmum of a seres corresponds to the smallest value, mn(x, x,, x T ). The unts assocated wth the mnmum are the same as the unts of x. The maxmum of a seres corresponds to the largest value, max(x, x,, x T ). The unts assocated wth the mnmum are the same as the unts of x. The range of a seres s the dfference between the maxmum and the mnmum values. The range s expressed as Range x max x - mn x. The unts assocated wth the range are the same as the unts of x. contnued...

13 Descrptve Statstcs Skewness s a measure of the amount of asymmetry n the dstrbuton of a seres. If a dstrbuton s symmetrc, skewness equals zero. If the skewness coeffcent s negatve (postve), then the dstrbuton of the seres has a left (rght) tal. The greater the absolute value of the skewness statstc, the more asymmetrc s the dstrbuton. The skewness coeffcent s gven by T ( x ˆ 3 m T S x) 3. The skewness statstc s a untless measure. 3 contnued...

14 Descrptve Statstcs Kurtoss s a measure of the flatness or peakedness of the dstrbuton of a seres relatve to that of a normal dstrbuton. A normal random varable has a kurtoss of 3. A kurtoss statstc greater than 3 ndcates a more peaked dstrbuton than the normal dstrbuton. A kurtoss statstc less than 3 ndcates a more flat dstrbuton than the normal dstrbuton. The kurtoss coeffcent s gven by kˆ T T ( x S 4 x) 4. The kurtoss coeffcent also s a untless measure. 4

15 Descrptve Statstcs The Jarque-Bera (JB) test statstc combnes the skewness and kurtoss coeffcents to produce another measure of the departure of normalty of a seres. Ths T measure s gven by ˆ ( ˆ JB m + k 3). 6 4 For a normal dstrbuton, m ˆ 0 and kˆ 3. Thus, the JB statstc s 0 for normal dstrbutons. Values greater than 0 ndcate the degree of departure from normalty. (Jarque and Bera, 980) 5 contnued...

16 Descrptve Statstcs The coeffcent of varaton s the rato of the standard devaton to ts mean. Ths measure typcally s converted to a percentage by multplyng the rato by 00. Ths statstc descrbes how much dsperson exsts n a seres relatve to ts mean. Ths measure s gven by CV S 00%. The utlty of ths nformaton s that x n most seres the mean and standard devaton change together. As well, ths statstc s not dependent on unts of measurement. 6

17 7 Correlaton Coeffcent The correlaton coeffcent s a measure of the degree of lnear assocaton between two varables. The statstc, denoted by r, s gven by r ( x T T ( x x) T x)( y y) ( y y). Whle r s a pure number wthout unts, r always les between - and +. Postve values of r ndcate a tendency of x and y to move together, that s, large values of x are assocated wth large values of y and small values of x are lnked wth small values of y. When r s negatve, large values of x are assocated wth small values of y and small values of x are assocated wth large values of y. The closer to +, the greater the degree of drect lnear relatonshp s between x and y. The closer to -, the greater the degree of nverse lnear relatonshp s between x and y. Fnally, when r 0, there s no lnear assocaton between x and y.

18 Descrptve Statstcs The mode corresponds to the most frequent observaton n the data seres x, x,, x r. The unts assocated wth mode are the same as the unts of x. In emprcal applcatons, often the observatons are non-repettve. Hence, ths measure often s of lmted usefulness. 8

19 Data Example Prces and quanttes sold of Prego Spaghett Sauce by week obs PPRG QPRG 6/03/ /0/ /7/ /4/ /0/ /08/ /5/ // /9/ /05/ // /9/ /6/ contnued...

20 obs PPRG QPRG 9/0/ /09/ /6/ /3/ /30/ /07/ /4/ // /8/ /04/ // /8/ /5/ /0/ /09/ /6/ /3/ /30/ /06/ /3/ obs PPRG QPRG /0/ /7/ /03/ /0/ /7/ /4/ /0/ /09/ /6/ /3/ /30/ /06/ /3/ /0/ /7/ /04/ // /8/ /5/ /0/99 NA NA 0

21 Tme-Seres Plot Volume of Prego Spaghett Sauce Sold by Week Q3 99Q4 99Q 99Q QPRG

22 Descrptve Statstcs and Hstogram Descrptve Statstcs and the Hstogram Assocated wth the Volume of Prego Spaghett Sauce Seres: QPRG Sample 6/03/99 6/0/99 Observatons 5 Mean Medan Maxmum Mnmum Std. Dev Skewness Kurtoss Jarque-Bera Probablty 0.974

23 Tme-Seres Plot.95 Prce of Prego Spaghett Sauce by Week Q3 99Q4 99Q 99Q 3 PPRG

24 Descrptve Statstcs Prce of Prego Spaghett Sauce Seres: PPRG Sample 6/03/99 6/0/99 Observatons 5 Mean Medan Maxmum.9367 Mnmum.6568 Std. Dev Skewness Kurtoss Jarque-Bera 9.98 Probablty

25 PPRG versus QPRG Weekly Scatter Plot of Prces and Quanttes Sold of Prego Spaghett Sauce PPRG QPRG

26 Correlaton Matrx The correlaton between the prce and quantty sold of Prego Spaghett Sauce s PPRG QPRG PPRG QPRG

27 The MEANS Procedure Varable N Mean Std Dev Mnmum Maxmum QPREGO PPREGO The UNIVARIATE Procedure Varable: QPREGO Moments 7 N 5 Sum Weghts 5 Mean Sum Observatons Std Devaton Varance Skewness Kurtoss Uncorrected SS Corrected SS Coeff Varaton Std Error Mean.4693

28 Basc Statstcal Measures Locaton Varablty Mean Std Devaton Medan Varance Mode. Range Interquartle Range Tests for Normalty Test --Statstc p Value Shapro-Wlk W Pr < W Kolmogorov-Smrnov D Pr > D 0.37 Cramer-von Mses W-Sq Pr > W-Sq Anderson-Darlng A-Sq Pr > A-Sq

29 Quantles (Defnton 5) Quantle Estmate 00% Max % % % % Q % Medan % Q.06 0% % % % Mn Extreme Observatons Lowest Hghest----- Value Obs Value Obs

30 The UNIVARIATE Procedure Varable: PPREGO Moments N 5 Sum Weghts 5 Mean Sum Observatons Std Devaton Varance Skewness Kurtoss Uncorrected SS Corrected SS Coeff Varaton Std Error Mean Basc Statstcal Measures Locaton Varablty Mean Std Devaton Medan Varance Mode. Range Interquartle Range

31 Tests for Normalty Test --Statstc p Value Shapro-Wlk W Pr < W Kolmogorov-Smrnov D Pr > D 0.75 Cramer-von Mses W-Sq Pr > W-Sq Anderson-Darlng A-Sq Pr > A-Sq Quantles (Defnton 5) Quantle Estmate 00% Max % % % % Q % Medan % Q.8 0% % % % Mn.6563

32 Secton.3 Massagng the Data

33 Massagng the Data Ask not what you can do to the data, but rather what the data can do for you. Express data n real or nomnal terms. Total or per capta measures Levels, changes, or percentage changes Smoothng Movng averages Exponental smoothng Seasonal adjustments Imputatons for mssng data See also Gerhard Svolba, Data Preparaton for Analyss Usng SAS (006). 33

34 Smoothng Smoothng technques provde a means of removng or at least reducng volatle short-term fluctuatons n a tme seres. These technques can be useful because t s often easer to dscern trends and cyclcal patterns and otherwse analyze a smoothed seres. Seasonal adjustment s really a specal form of smoothng. 34

35 N-Perod Movng Averages t n t t t t X X X X g e X X X n X )... (.. )... ( t t t t t X X X X g e )... (.. Use of the EXPAND Procedure

36 EWMA: Exponentally Weghted Movng Average (Exponental Smoothng) X X t t α. αxt + α( α)xt + α( α) Xt 0 < α <.X t +.09X t +.08X t X 3 t u u t t α.9 X t.9x t +.09X t +.009X t u t Weghts must sum to. Use of the EXPAND Procedure 36

37 A Plot of the Actual Seres FUBK and Its -Month Movng Average 80,000 70,000 60,000 50,000 40,000 30,000 0,000 0, FUBK FUBKMOVAVG

38 The MEANS Procedure Varable N Mean Std Dev Mnmum Maxmum fubk fubkmov The UNIVARIATE Procedure Varable: fubk 38 Moments N 07 Sum Weghts 07 Mean Sum Observatons Std Devaton Varance Skewness Kurtoss Uncorrected SS.7334E Corrected SS E0 Coeff Varaton Std Error Mean

39 Basc Statstcal Measures Locaton Varablty Mean Std Devaton 6986 Medan Varance Mode. Range Interquartle Range 5730 Tests for Normalty Test --Statstc p Value Shapro-Wlk W Pr < W <0.000 Kolmogorov-Smrnov D Pr > D <0.000 Cramer-von Mses W-Sq Pr > W-Sq < Anderson-Darlng A-Sq Pr > A-Sq <

40 Quantles (Defnton 5) Quantle Estmate 00% Max % % % % Q % Medan % Q 470 0% 397 5% 3667 % % Mn 3380 Extreme Observatons ----Lowest Hghest---- Value Obs Value Obs

41 Mssng Values -----Percent Of----- Mssng Mssng Value Count All Obs Obs The CORR Procedure 3 Varables: fubk fubkmov debtncome Smple Statstcs Varable N Mean Std Dev Sum Mnmum Maxmum fubk fubkmov debtncome

42 Pearson Correlaton Coeffcents Prob > r under H0: Rho0 Number of Observatons fubk fubkmov debtncome fubk <.000 < fubkmov <.000 < debtncome <.000 <

43 The Estmate of Alpha n the Exponental Smoothng Process Sample: 99M07 000M05 Included observatons: 07 Method: Sngle Exponental Orgnal Seres: FUBK Forecast Seres: FUBKSES Parameters: Alpha Sum of Squared Resduals.95E+09 Root Mean Squared Error End of Perod Levels: Mean

44 A Plot of the Actual Seres FUBK and the Exponental Smoothng of Ths Seres 80,000 70,000 60,000 50,000 40,000 30,000 0,000 0, FUBK FUBKSES

45 Seasonal Adjustment X or X Bureau of the Census Procedure Apply the seasonal adjustment technque to a seres for monthly housng starts. To do ths, compute a -month average ( Ŷ t ) of the orgnal seres Y t and then dvde (Y t ) by Y ˆ ( / ˆ ). Notce that Z contans t for example, Z t Y t Y t t (roughly) the seasonal and rregular components of the orgnal seres. Remove the rregular component by averagng the values of Z t that correspond to the same month, that s, compute Z ~ Z ~,...Z ~,. Then compute the fnal seasonal ndces Z, Z,... Z by multplyng Z ~, Z ~,... Z ~ by a factor that brngs the sum to. 45

46 Seasonal Adjustment Example Monthly Per Capta Consumpton of Orange Juce 989:0 to 00:09 MONTH INDEX MONTH INDEX January.397 July February August March September Aprl October.0360 May November June December Sum Use of PROC X or PROC X 46

47 Plot of the Actual Seres and the Seasonally Adjusted Seres A Plot of the Actual Seres Called ALLOJGALPC and Its Seasonally Adjusted (SA) Verson ALLOJGALPCSA ALLOJGALPC

48 Addtonal Transformatons of Varables Trgonometrc (cycles) Logarthmc (elastctes, flexbltes) Polynomal (economes of scale) Lags n varables The logarthmc transformaton mght lessen the possblty of heteroscedastcty ssues. The use of lags mght lessen the possblty of seral correlaton ssues. Be careful of the use of polynomals and the potental dangers of over-fttng. 48

49 Secton.4 Estmaton of the Smple Lnear Regresson Model

50 The Smple Lnear Regresson Model Dependent Varable Left-Hand Sde Varable Explaned Varable Regressand Response Varable Independent Varable Rght-Hand Sde Varable Explanatory Varable Regressor Control Varable y β 0 + β x + u Coeffcents β 0 : Intercepts β : Slope Error Term Dsturbance Term Innovaton 50

51 Y (Depend dent Varable) Graphcal Illustraton y β 0 + β x + u Regresson lne: E(y x) β 0 + β x β : Slope β 0 5 How do you nterpret coeffcents? x x+h X (Independent Varable)

52 An Example: Relatonshp between Total Personal Bankruptces and Real GDP Queston: What s the effect of real gross domestc product (GDP) on total personal bankruptces? Known nformaton: Dependent varable: total personal bankruptces (TPB) Explanatory varable: real GDP (RGDP) Regresson: TPB β 0 + β RGDP + u Interpretaton: β measures the change n real GDP on TPB. β 0 represents the autonomous level of total personal bankruptces. 5

53 Random Samplng Randomly sample n observatons from a populaton (979:4 to 003:). 94 quarterly observatons For each observaton, TPB t β 0 + β RGDP t + u t Goal: Estmate β 0 and β Explanatory Varable RGDP Dependent Varable TPB RGDP 979:4 TPB 979:4 RGDP 980: TPB 980: RGDP 003: TPB 003: 53

54 Ordnary Least Squares, Regresson Lne, Ftted Values, and Resduals y y 4 y. 3 } û. 3 û { y y. } û û 4 {. yˆ ˆ β + ˆ βx OLS: choose β 0 and β to mnmze these sum of squared predcton errors. 0 x x x 3 x 4 x 54

55 ,800,000,600,000,400,000,00,000 TPB,000, , , ,000 00, ,000 6,000 8,000 0,000, RGDP

56 Intutve Thnkng about Ordnary Least Squares Ordnary least squares (OLS) s fttng a lne through the sample ponts so that the sum of squared predcton errors s as small as possble; hence the term least squares. Resdual û s an estmate of the error term, u, and s the dfference between sample pont (actual value) and the ftted lne (sample regresson lne). uˆ AV FV,,..., n Actual Value Ftted Value 56

57 Mnmzng Resdual Sum of Squares ( ) 0 ˆ ˆ 0 n x y β β ( ) ( ) n n x y u 0,, mn mn 0 0 ˆ β β β β β β ) ) ) ) ) ) ( )( ) ( ) n n y y x x ˆβ Frst order condtons: ( ) 0 ˆ ˆ 0 0 n x y x β β ( ) x x y x 0 ˆ ˆ β β Interpretaton: The slope estmate s the sample covarance between x and y dvded by the sample varance of x.

58 The Resdual Varance Use the resdual to estmate the resdual varance. Ths varance represents the amount of dsperson about the ftted model. ( ) ˆ ˆ ˆ ˆ ˆ ˆ x u x u x y u β β β β β β û SSE s the resdual or error sum of squares, and (n-) s the degrees-of-freedom ( ) ( ) ( ) ( ) / ˆ ˆ ˆ ˆ ˆ 0 0 n SSE u n x u u σ σ β β β β s of an unbased estmator Then,

59 Standard Error of OLS Estmates ˆ σ ˆ σ standard error of the regresson The standard error of β s gven by se ( ˆ β ). se ( ˆ β ) ˆ σ /( ( x x ) ( ) ) The standard error of β s gven by se ( ˆ β ) se ( ˆ β ) 0 ( ˆ σ x x n x ( ) )

60 Goodness-of-Ft: Coeffcent of Determnaton Goodness-of-ft: How well does the lnear regresson model explan the varaton nherent n the dependent varable? Y Yˆ Y ˆ Yˆ Y Unexplaned varaton ( Y Y ˆ ) u Explaned varaton ( Yˆ Y ) 60 X X X

61 y Goodness-of-Ft: Some Termnology Goodness-of-ft: How well does the smple regresson lne ft the sample data? Calculate R SSR/SST SSE/SST. yˆ + uˆ Then defne the followng: Thus, ( y ) y ( yˆ ) y ( y yˆ ) s the total sum of s uˆ SST SSR + SSE the regresson sum of squares (SST). squares (SSR). s the resdual or error sum of squares (SSE). 6 contnued...

62 Goodness-of-Ft Concept: measures the proporton of the varaton n the dependent varable explaned by the regresson equaton. Formula: R Explaned sample varablty Total sample varablty n ( yˆ y ) ˆ SSR SST SSE n ( y y) SST Range: between zero and one Example: R 0.78, the regresson equaton explans 78% of the varaton n y. 6

63 The R-square Statstc and the Adjusted R ( yˆ ) R y Explaned sample varablty R n Total sample varablty ( y y) n SSR SST SSE SST Adjusted R SSE /( n k ) R SST /( n ) Questons: (a) Why do you care about the adjusted R? (b) Is adjusted R always better than R? (c) What s the relatonshp between R and adjusted R? 63

64 Secton.5 SAS Output of the Smple Lnear Regresson of Total Personal Bankruptces (TPB) on Real Gross Domestc Product (RGDP)

65 The REG Procedure Model: MODEL Dependent Varable: TPB Number of Observatons Read 94 Number of Observatons Used 94 Analyss of Varance p-value Sum of Mean Source DF Squares Square F Value Pr > F Model.58735E E <.000 Error 9.079E Corrected Total E3 Estmate of resdual varance Root MSE 0794 R-Square Dependent Mean Adj R-Sq Coeff Var Goodness-of-Ft statstcs

66 Parameter Estmates Parameter Standard Varable DF Estmate Error t Value Pr > t Intercept <.000 RGDP <.000 Covarance of Estmates p-value Varable Intercept RGDP Intercept RGDP

67 Smple Lnear Regresson of RGDP on Total U.S. Personal Bankruptces σˆ se ( ˆ β 0 se ( ˆ β ) SSE 9,65,39,045 ) 53,44 R R SST SSR SSE.079 0

68 Actual Values, Ftted Values, and Resduals Obs TPB predtpb restpbrgdp

69 Predctng Total U.S. Personal Bankruptces: 003:, 003:3, and 003:4 Let t 003: RGDP 003: 0,47.8 TPB 003:,58,734 t 003:3 RGDP 003:3 0,580.7 TPB 003:3,60,70 t 003:4 RGDP 003:4 0,697.5 TPB 003:4,640,974 T PB ˆ t RGDP t Key Pont: Need nformaton on out-of-sample values for RGDP n order to predct out-of-sample values for TPB. Condtonal Forecastng 69

70 Secton.6 Estmaton of the Multple Regresson Model The Generc Sngle-Equaton Econometrc Model

71 Multple Regresson Model y β 0 + β x + β x + + β k x k + u β 0 s stll the ntercept. β to β k are all called slope parameters. u s stll the error term (or dsturbance term). You can stll mnmze the sum of squared resduals. 7

72 Random Samplng Dependent Varable Prce Income Advertsng Q P I A Q P I A Q 3 P 3 I 3 A 3 Q 3 P 3 I 3 A 3 Use OLS to estmate the coeffcents to mnmze the sum of squared errors. ) β n n ( ) uˆ ( ) y β0 βp βi β3a mn mn ) ) ) ) ) ),,,,,, 0 β β β 3 β 0 β β ) β 3 ) ) ) ) 7

73 OLS Estmates Assocated wth the Multple Regresson Model ) ( y )) ( ( ˆ ) ( nx y y k nx x x x x x x x y x x x k k T T + β L L ) ) (( ˆ ˆ ˆ ˆ ) ) x (( the transpose of s ) ( y )) ( ( 0 x k xn k x nx y k nx x x x x k T n kn n n β β β β M M O M M M

74 Goodness-of-Ft y yˆ + uˆ Defntons : ( ) y y s the total sum of squares (SST). ( yˆ ) y s the regresson sum of squares (SSR). uˆ s the resdual(or error)sum of squares (SSE). Then SST SSR + SSE. 74 contnued...

75 Sample Regresson Lne and Sample Data How well does your sample regresson lne ft your sample data? The R-square statstc of regresson s the fracton of the total sum of squares (SST) that s explaned by the model. R SSR/SST SSE/SST 75

76 More about the R-square Statstc R can never decrease when another explanatory varable s added to a regresson, and usually t wll ncrease. Because R wll usually ncrease (or at least not decrease) wth ncreases n the number of explanatory varables, t s not a good way to compare alternatve models wth the same dependent varable. 76

77 Estmatng the Resdual Varance df n (k + ), or df n k df (that s, degrees of freedom) s (number of observatons) (number of estmated parameters) ( ) u ( n k ) SSE df s σˆ ˆ 77

78 Varances and Covarances of OLS Parameter Estmates Varance: Covarance Matrx of OLS Parameter Estmates ( ˆ) s (x T x) - Var β Ths matrx s a functon of the estmated resdual varance. 78

79 The R-square Statstc and the Adjusted R ( yˆ ) R y Explaned sample varablty R n Total sample varablty ( y y) n SSR SST SSE SST Adjusted R SSE /( n k ) R SST /( n ) Questons: (a) Why do you care about the adjusted R? (b) Is adjusted R always better than R? (c) What s the relatonshp between R and adjusted R? 79

80 80 Model Selecton Crtera T T p s T T MSE s the penalty factor. p T t T e t T t T e t T T Akake Informaton Crteron (AIC) AIC MSE MSE p Useful way of dscernng alternatve model specfcatons. For each specfcaton, calculate the assocated model selecton statstcs. Then the smallest statstc yelds the most approprate model specfcaton. Schwarz or Bayesan Informaton Crteron (SIC) or (BIC) SIC ( BIC p s the number of parameters to be estmated. T s the number of observatons. ) e p T T p T MSE

81 Model Selecton Crtera Example Model Model Model 3 AIC SIC Whch model to choose? 8

82 Secton.7 Example: SAS Output of the Demand Functon for Shrmp

83 Example: SAS Output of the Demand Functon The REG Procedure Model: MODEL Dependent Varable: QSHRIMP Number of Observatons Read 97 Number of Observatons Used 97 Quantty sold of shrmp Analyss of Varance Sum of Mean Source DF Squares Square F Value Pr > F Model <.000 Error Corrected Total Root MSE 4.93 R-Square Dependent Mean Adj R-Sq Coeff Var contnued...

84 Parameter Estmates Parameter Standard 95% Varable DF Estmate Error t Value Pr > t Confdence Intercept PSHRIMP < PFIN PSHELL ADSHRIMP ADFIN ADSHELL Prce of shrmp Prce of fnfsh Prce of other shellfsh Advertsng for shrmp Advertsng for fnfsh Advertsng for other shellfsh

85 Correlaton of Qshrmp t and predqshrimp t Varables: QSHRIMP predqshrimp Smple Statstcs Varable N Mean Std Dev Sum Mnmum Maxmum QSHRIMP predqshrimp Smple Statstcs Varable Label QSHRIMP predqshrimp Predcted Value of QSHRIMP Pearson Correlaton Coeffcents, N 97 Prob > r under H0: Rho0 QSHRIMP pred QSHRIMP QSHRIMP < predqshrimp Predcted Value of QSHRIMP <.000

86 Varance-Covarance Matrx of Estmated Coeffcents of the Econometrc Model Varable Intercept PSHRIMP PFIN PSHELL Intercept PSHRIMP E E-6 PFIN E E-6 PSHELL E E ADSHRIMP E E E-6 ADFIN E E E-7 ADSHELL E Varable ADSHRIMP ADFIN ADSHELL Intercept PSHRIMP E E PFIN E E E-6 PSHELL E E ADSHRIMP ADFIN E-6 ADSHELL E

87 Model Selecton Crtera for the QSHRIMP Problem MSE SSE/T / s T T-P MSE (6.9) 7.56 AIC e P T MSE e 4 97 (6.9) 8.8 SIC T P T MSE (6.9).67 87

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear

More information

[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.

[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students. PPOL 59-3 Problem Set Exercses n Smple Regresson Due n class /8/7 In ths problem set, you are asked to compute varous statstcs by hand to gve you a better sense of the mechancs of the Pearson correlaton

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Y = β 0 + β 1 X 1 + β 2 X β k X k + ε

Y = β 0 + β 1 X 1 + β 2 X β k X k + ε Chapter 3 Secton 3.1 Model Assumptons: Multple Regresson Model Predcton Equaton Std. Devaton of Error Correlaton Matrx Smple Lnear Regresson: 1.) Lnearty.) Constant Varance 3.) Independent Errors 4.) Normalty

More information

Introduction to Regression

Introduction to Regression Introducton to Regresson Dr Tom Ilvento Department of Food and Resource Economcs Overvew The last part of the course wll focus on Regresson Analyss Ths s one of the more powerful statstcal technques Provdes

More information

Basic Business Statistics, 10/e

Basic Business Statistics, 10/e Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management

Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 1 Chapters 14, 15 & 16 Professor Ahmad, Ph.D. Department of Management Revsed August 005 Chapter 14 Formulas Smple Lnear Regresson Model: y =

More information

β0 + β1xi. You are interested in estimating the unknown parameters β

β0 + β1xi. You are interested in estimating the unknown parameters β Ordnary Least Squares (OLS): Smple Lnear Regresson (SLR) Analytcs The SLR Setup Sample Statstcs Ordnary Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals) wth OLS

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Statistics for Business and Economics

Statistics for Business and Economics Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear

More information

Chapter 3. Two-Variable Regression Model: The Problem of Estimation

Chapter 3. Two-Variable Regression Model: The Problem of Estimation Chapter 3. Two-Varable Regresson Model: The Problem of Estmaton Ordnary Least Squares Method (OLS) Recall that, PRF: Y = β 1 + β X + u Thus, snce PRF s not drectly observable, t s estmated by SRF; that

More information

Statistics MINITAB - Lab 2

Statistics MINITAB - Lab 2 Statstcs 20080 MINITAB - Lab 2 1. Smple Lnear Regresson In smple lnear regresson we attempt to model a lnear relatonshp between two varables wth a straght lne and make statstcal nferences concernng that

More information

/ n ) are compared. The logic is: if the two

/ n ) are compared. The logic is: if the two STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence

More information

Economics 130. Lecture 4 Simple Linear Regression Continued

Economics 130. Lecture 4 Simple Linear Regression Continued Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do

More information

Chapter 3 Describing Data Using Numerical Measures

Chapter 3 Describing Data Using Numerical Measures Chapter 3 Student Lecture Notes 3-1 Chapter 3 Descrbng Data Usng Numercal Measures Fall 2006 Fundamentals of Busness Statstcs 1 Chapter Goals To establsh the usefulness of summary measures of data. The

More information

Chapter 15 Student Lecture Notes 15-1

Chapter 15 Student Lecture Notes 15-1 Chapter 15 Student Lecture Notes 15-1 Basc Busness Statstcs (9 th Edton) Chapter 15 Multple Regresson Model Buldng 004 Prentce-Hall, Inc. Chap 15-1 Chapter Topcs The Quadratc Regresson Model Usng Transformatons

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study

More information

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise. Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the

More information

Chapter 15 - Multiple Regression

Chapter 15 - Multiple Regression Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term

More information

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

Correlation and Regression

Correlation and Regression Correlaton and Regresson otes prepared by Pamela Peterson Drake Index Basc terms and concepts... Smple regresson...5 Multple Regresson...3 Regresson termnology...0 Regresson formulas... Basc terms and

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

18. SIMPLE LINEAR REGRESSION III

18. SIMPLE LINEAR REGRESSION III 8. SIMPLE LINEAR REGRESSION III US Domestc Beers: Calores vs. % Alcohol Ftted Values and Resduals To each observed x, there corresponds a y-value on the ftted lne, y ˆ ˆ = α + x. The are called ftted values.

More information

28. SIMPLE LINEAR REGRESSION III

28. SIMPLE LINEAR REGRESSION III 8. SIMPLE LINEAR REGRESSION III Ftted Values and Resduals US Domestc Beers: Calores vs. % Alcohol To each observed x, there corresponds a y-value on the ftted lne, y ˆ = βˆ + βˆ x. The are called ftted

More information

β0 + β1xi and want to estimate the unknown

β0 + β1xi and want to estimate the unknown SLR Models Estmaton Those OLS Estmates Estmators (e ante) v. estmates (e post) The Smple Lnear Regresson (SLR) Condtons -4 An Asde: The Populaton Regresson Functon B and B are Lnear Estmators (condtonal

More information

17 - LINEAR REGRESSION II

17 - LINEAR REGRESSION II Topc 7 Lnear Regresson II 7- Topc 7 - LINEAR REGRESSION II Testng and Estmaton Inferences about β Recall that we estmate Yˆ ˆ β + ˆ βx. 0 μ Y X x β0 + βx usng To estmate σ σ squared error Y X x ε s ε we

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

Learning Objectives for Chapter 11

Learning Objectives for Chapter 11 Chapter : Lnear Regresson and Correlaton Methods Hldebrand, Ott and Gray Basc Statstcal Ideas for Managers Second Edton Learnng Objectves for Chapter Usng the scatterplot n regresson analyss Usng the method

More information

Chapter 14 Simple Linear Regression

Chapter 14 Simple Linear Regression Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng

More information

β0 + β1xi. You are interested in estimating the unknown parameters β

β0 + β1xi. You are interested in estimating the unknown parameters β Revsed: v3 Ordnar Least Squares (OLS): Smple Lnear Regresson (SLR) Analtcs The SLR Setup Sample Statstcs Ordnar Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals)

More information

The Ordinary Least Squares (OLS) Estimator

The Ordinary Least Squares (OLS) Estimator The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal

More information

Lecture 6: Introduction to Linear Regression

Lecture 6: Introduction to Linear Regression Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6

More information

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model

More information

e i is a random error

e i is a random error Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown

More information

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE)

ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE) ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE) June 7, 016 15:30 Frst famly name: Name: DNI/ID: Moble: Second famly Name: GECO/GADE: Instructor: E-mal: Queston 1 A B C Blank Queston A B C Blank Queston

More information

a. (All your answers should be in the letter!

a. (All your answers should be in the letter! Econ 301 Blkent Unversty Taskn Econometrcs Department of Economcs Md Term Exam I November 8, 015 Name For each hypothess testng n the exam complete the followng steps: Indcate the test statstc, ts crtcal

More information

Linear regression. Regression Models. Chapter 11 Student Lecture Notes Regression Analysis is the

Linear regression. Regression Models. Chapter 11 Student Lecture Notes Regression Analysis is the Chapter 11 Student Lecture Notes 11-1 Lnear regresson Wenl lu Dept. Health statstcs School of publc health Tanjn medcal unversty 1 Regresson Models 1. Answer What Is the Relatonshp Between the Varables?.

More information

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9 Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,

More information

Lecture 3 Stat102, Spring 2007

Lecture 3 Stat102, Spring 2007 Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture

More information

III. Econometric Methodology Regression Analysis

III. Econometric Methodology Regression Analysis Page Econ07 Appled Econometrcs Topc : An Overvew of Regresson Analyss (Studenmund, Chapter ) I. The Nature and Scope of Econometrcs. Lot s of defntons of econometrcs. Nobel Prze Commttee Paul Samuelson,

More information

Econ107 Applied Econometrics Topic 9: Heteroskedasticity (Studenmund, Chapter 10)

Econ107 Applied Econometrics Topic 9: Heteroskedasticity (Studenmund, Chapter 10) I. Defnton and Problems Econ7 Appled Econometrcs Topc 9: Heteroskedastcty (Studenmund, Chapter ) We now relax another classcal assumpton. Ths s a problem that arses often wth cross sectons of ndvduals,

More information

Outline. Zero Conditional mean. I. Motivation. 3. Multiple Regression Analysis: Estimation. Read Wooldridge (2013), Chapter 3.

Outline. Zero Conditional mean. I. Motivation. 3. Multiple Regression Analysis: Estimation. Read Wooldridge (2013), Chapter 3. Outlne 3. Multple Regresson Analyss: Estmaton I. Motvaton II. Mechancs and Interpretaton of OLS Read Wooldrdge (013), Chapter 3. III. Expected Values of the OLS IV. Varances of the OLS V. The Gauss Markov

More information

Chapter 4: Regression With One Regressor

Chapter 4: Regression With One Regressor Chapter 4: Regresson Wth One Regressor Copyrght 2011 Pearson Addson-Wesley. All rghts reserved. 1-1 Outlne 1. Fttng a lne to data 2. The ordnary least squares (OLS) lne/regresson 3. Measures of ft 4. Populaton

More information

Topic 7: Analysis of Variance

Topic 7: Analysis of Variance Topc 7: Analyss of Varance Outlne Parttonng sums of squares Breakdown the degrees of freedom Expected mean squares (EMS) F test ANOVA table General lnear test Pearson Correlaton / R 2 Analyss of Varance

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Question 1 carries a weight of 25%; question 2 carries 20%; question 3 carries 25%; and question 4 carries 30%.

Question 1 carries a weight of 25%; question 2 carries 20%; question 3 carries 25%; and question 4 carries 30%. UNIVERSITY OF EAST ANGLIA School of Economcs Man Seres PGT Examnaton 017-18 FINANCIAL ECONOMETRICS ECO-7009A Tme allowed: HOURS Answer ALL FOUR questons. Queston 1 carres a weght of 5%; queston carres

More information

where I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).

where I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X). 11.4.1 Estmaton of Multple Regresson Coeffcents In multple lnear regresson, we essentally solve n equatons for the p unnown parameters. hus n must e equal to or greater than p and n practce n should e

More information

Diagnostics in Poisson Regression. Models - Residual Analysis

Diagnostics in Poisson Regression. Models - Residual Analysis Dagnostcs n Posson Regresson Models - Resdual Analyss 1 Outlne Dagnostcs n Posson Regresson Models - Resdual Analyss Example 3: Recall of Stressful Events contnued 2 Resdual Analyss Resduals represent

More information

The SAS program I used to obtain the analyses for my answers is given below.

The SAS program I used to obtain the analyses for my answers is given below. Homework 1 Answer sheet Page 1 The SAS program I used to obtan the analyses for my answers s gven below. dm'log;clear;output;clear'; *************************************************************; *** EXST7034

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models

Statistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 14 Multple Regresson Models 1999 Prentce-Hall, Inc. Chap. 14-1 Chapter Topcs The Multple Regresson Model Contrbuton of Indvdual Independent Varables

More information

STATISTICS QUESTIONS. Step by Step Solutions.

STATISTICS QUESTIONS. Step by Step Solutions. STATISTICS QUESTIONS Step by Step Solutons www.mathcracker.com 9//016 Problem 1: A researcher s nterested n the effects of famly sze on delnquency for a group of offenders and examnes famles wth one to

More information

Reminder: Nested models. Lecture 9: Interactions, Quadratic terms and Splines. Effect Modification. Model 1

Reminder: Nested models. Lecture 9: Interactions, Quadratic terms and Splines. Effect Modification. Model 1 Lecture 9: Interactons, Quadratc terms and Splnes An Manchakul amancha@jhsph.edu 3 Aprl 7 Remnder: Nested models Parent model contans one set of varables Extended model adds one or more new varables to

More information

SIMPLE LINEAR REGRESSION

SIMPLE LINEAR REGRESSION Smple Lnear Regresson and Correlaton Introducton Prevousl, our attenton has been focused on one varable whch we desgnated b x. Frequentl, t s desrable to learn somethng about the relatonshp between two

More information

DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes

DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes 25/6 Canddates Only January Examnatons 26 Student Number: Desk Number:...... DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR Department Module Code Module Ttle Exam Duraton

More information

Chapter 5 Multilevel Models

Chapter 5 Multilevel Models Chapter 5 Multlevel Models 5.1 Cross-sectonal multlevel models 5.1.1 Two-level models 5.1.2 Multple level models 5.1.3 Multple level modelng n other felds 5.2 Longtudnal multlevel models 5.2.1 Two-level

More information

January Examinations 2015

January Examinations 2015 24/5 Canddates Only January Examnatons 25 DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR STUDENT CANDIDATE NO.. Department Module Code Module Ttle Exam Duraton (n words)

More information

Statistics II Final Exam 26/6/18

Statistics II Final Exam 26/6/18 Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the

More information

Properties of Least Squares

Properties of Least Squares Week 3 3.1 Smple Lnear Regresson Model 3. Propertes of Least Squares Estmators Y Y β 1 + β X + u weekly famly expendtures X weekly famly ncome For a gven level of x, the expected level of food expendtures

More information

Biostatistics 360 F&t Tests and Intervals in Regression 1

Biostatistics 360 F&t Tests and Intervals in Regression 1 Bostatstcs 360 F&t Tests and Intervals n Regresson ORIGIN Model: Y = X + Corrected Sums of Squares: X X bar where: s the y ntercept of the regresson lne (translaton) s the slope of the regresson lne (scalng

More information

Basically, if you have a dummy dependent variable you will be estimating a probability.

Basically, if you have a dummy dependent variable you will be estimating a probability. ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy

More information

Chap 10: Diagnostics, p384

Chap 10: Diagnostics, p384 Chap 10: Dagnostcs, p384 Multcollnearty 10.5 p406 Defnton Multcollnearty exsts when two or more ndependent varables used n regresson are moderately or hghly correlated. - when multcollnearty exsts, regresson

More information

Cathy Walker March 5, 2010

Cathy Walker March 5, 2010 Cathy Walker March 5, 010 Part : Problem Set 1. What s the level of measurement for the followng varables? a) SAT scores b) Number of tests or quzzes n statstcal course c) Acres of land devoted to corn

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Lecture 2: Prelude to the big shrink

Lecture 2: Prelude to the big shrink Lecture 2: Prelude to the bg shrnk Last tme A slght detour wth vsualzaton tools (hey, t was the frst day... why not start out wth somethng pretty to look at?) Then, we consdered a smple 120a-style regresson

More information

NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MTH352/MH3510 Regression Analysis

NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MTH352/MH3510 Regression Analysis NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION 014-015 MTH35/MH3510 Regresson Analyss December 014 TIME ALLOWED: HOURS INSTRUCTIONS TO CANDIDATES 1. Ths examnaton paper contans FOUR (4) questons

More information

Chapter 14 Simple Linear Regression Page 1. Introduction to regression analysis 14-2

Chapter 14 Simple Linear Regression Page 1. Introduction to regression analysis 14-2 Chapter 4 Smple Lnear Regresson Page. Introducton to regresson analyss 4- The Regresson Equaton. Lnear Functons 4-4 3. Estmaton and nterpretaton of model parameters 4-6 4. Inference on the model parameters

More information

T E C O L O T E R E S E A R C H, I N C.

T E C O L O T E R E S E A R C H, I N C. T E C O L O T E R E S E A R C H, I N C. B rdg n g En g neern g a nd Econo mcs S nce 1973 THE MINIMUM-UNBIASED-PERCENTAGE ERROR (MUPE) METHOD IN CER DEVELOPMENT Thrd Jont Annual ISPA/SCEA Internatonal Conference

More information

Econ Statistical Properties of the OLS estimator. Sanjaya DeSilva

Econ Statistical Properties of the OLS estimator. Sanjaya DeSilva Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate

More information

Module Contact: Dr Susan Long, ECO Copyright of the University of East Anglia Version 1

Module Contact: Dr Susan Long, ECO Copyright of the University of East Anglia Version 1 UNIVERSITY OF EAST ANGLIA School of Economcs Man Seres PG Examnaton 016-17 ECONOMETRIC METHODS ECO-7000A Tme allowed: hours Answer ALL FOUR Questons. Queston 1 carres a weght of 5%; Queston carres 0%;

More information

Biostatistics. Chapter 11 Simple Linear Correlation and Regression. Jing Li

Biostatistics. Chapter 11 Simple Linear Correlation and Regression. Jing Li Bostatstcs Chapter 11 Smple Lnear Correlaton and Regresson Jng L jng.l@sjtu.edu.cn http://cbb.sjtu.edu.cn/~jngl/courses/2018fall/b372/ Dept of Bonformatcs & Bostatstcs, SJTU Recall eat chocolate Cell 175,

More information

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable

More information

Midterm Examination. Regression and Forecasting Models

Midterm Examination. Regression and Forecasting Models IOMS Department Regresson and Forecastng Models Professor Wllam Greene Phone: 22.998.0876 Offce: KMC 7-90 Home page: people.stern.nyu.edu/wgreene Emal: wgreene@stern.nyu.edu Course web page: people.stern.nyu.edu/wgreene/regresson/outlne.htm

More information

JAB Chain. Long-tail claims development. ASTIN - September 2005 B.Verdier A. Klinger

JAB Chain. Long-tail claims development. ASTIN - September 2005 B.Verdier A. Klinger JAB Chan Long-tal clams development ASTIN - September 2005 B.Verder A. Klnger Outlne Chan Ladder : comments A frst soluton: Munch Chan Ladder JAB Chan Chan Ladder: Comments Black lne: average pad to ncurred

More information

UNIVERSITY OF TORONTO. Faculty of Arts and Science JUNE EXAMINATIONS STA 302 H1F / STA 1001 H1F Duration - 3 hours Aids Allowed: Calculator

UNIVERSITY OF TORONTO. Faculty of Arts and Science JUNE EXAMINATIONS STA 302 H1F / STA 1001 H1F Duration - 3 hours Aids Allowed: Calculator UNIVERSITY OF TORONTO Faculty of Arts and Scence JUNE EXAMINATIONS 008 STA 30 HF / STA 00 HF Duraton - 3 hours Ads Allowed: Calculator LAST NAME: FIRST NAME: STUDENT NUMBER: Enrolled n (Crcle one): STA30

More information

Continuous vs. Discrete Goods

Continuous vs. Discrete Goods CE 651 Transportaton Economcs Charsma Choudhury Lecture 3-4 Analyss of Demand Contnuous vs. Dscrete Goods Contnuous Goods Dscrete Goods x auto 1 Indfference u curves 3 u u 1 x 1 0 1 bus Outlne Data Modelng

More information

Definition. Measures of Dispersion. Measures of Dispersion. Definition. The Range. Measures of Dispersion 3/24/2014

Definition. Measures of Dispersion. Measures of Dispersion. Definition. The Range. Measures of Dispersion 3/24/2014 Measures of Dsperson Defenton Range Interquartle Range Varance and Standard Devaton Defnton Measures of dsperson are descrptve statstcs that descrbe how smlar a set of scores are to each other The more

More information

Statistical Inference. 2.3 Summary Statistics Measures of Center and Spread. parameters ( population characteristics )

Statistical Inference. 2.3 Summary Statistics Measures of Center and Spread. parameters ( population characteristics ) Ismor Fscher, 8//008 Stat 54 / -8.3 Summary Statstcs Measures of Center and Spread Dstrbuton of dscrete contnuous POPULATION Random Varable, numercal True center =??? True spread =???? parameters ( populaton

More information

Some basic statistics and curve fitting techniques

Some basic statistics and curve fitting techniques Some basc statstcs and curve fttng technques Statstcs s the dscplne concerned wth the study of varablty, wth the study of uncertanty, and wth the study of decsonmakng n the face of uncertanty (Lndsay et

More information

Lecture 3: Probability Distributions

Lecture 3: Probability Distributions Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the

More information

Chapter 16 Student Lecture Notes 16-1

Chapter 16 Student Lecture Notes 16-1 Chapter 16 Student Lecture Notes 16-1 Basc Busness Statstcs (9 th Edton) Chapter 16 Tme-Seres Forecastng and Index Numbers 2004 Prentce-Hall, Inc. Chap 16-1 Chapter Topcs The Importance of Forecastng Component

More information

BETWEEN-PARTICIPANTS EXPERIMENTAL DESIGNS

BETWEEN-PARTICIPANTS EXPERIMENTAL DESIGNS 1 BETWEEN-PARTICIPANTS EXPERIMENTAL DESIGNS I. Sngle-factor desgns: the model s: y j = µ + α + ε j = µ + ε j where: y j jth observaton n the sample from the th populaton ( = 1,..., I; j = 1,..., n ) µ

More information

Problem of Estimation. Ordinary Least Squares (OLS) Ordinary Least Squares Method. Basic Econometrics in Transportation. Bivariate Regression Analysis

Problem of Estimation. Ordinary Least Squares (OLS) Ordinary Least Squares Method. Basic Econometrics in Transportation. Bivariate Regression Analysis 1/60 Problem of Estmaton Basc Econometrcs n Transportaton Bvarate Regresson Analyss Amr Samm Cvl Engneerng Department Sharf Unversty of Technology Ordnary Least Squares (OLS) Maxmum Lkelhood (ML) Generally,

More information

Professor Chris Murray. Midterm Exam

Professor Chris Murray. Midterm Exam Econ 7 Econometrcs Sprng 4 Professor Chrs Murray McElhnney D cjmurray@uh.edu Mdterm Exam Wrte your answers on one sde of the blank whte paper that I have gven you.. Do not wrte your answers on ths exam.

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Econometrics of Panel Data

Econometrics of Panel Data Econometrcs of Panel Data Jakub Mućk Meetng # 8 Jakub Mućk Econometrcs of Panel Data Meetng # 8 1 / 17 Outlne 1 Heterogenety n the slope coeffcents 2 Seemngly Unrelated Regresson (SUR) 3 Swamy s random

More information

Unit 10: Simple Linear Regression and Correlation

Unit 10: Simple Linear Regression and Correlation Unt 10: Smple Lnear Regresson and Correlaton Statstcs 571: Statstcal Methods Ramón V. León 6/28/2004 Unt 10 - Stat 571 - Ramón V. León 1 Introductory Remarks Regresson analyss s a method for studyng the

More information

CHAPER 11: HETEROSCEDASTICITY: WHAT HAPPENS WHEN ERROR VARIANCE IS NONCONSTANT?

CHAPER 11: HETEROSCEDASTICITY: WHAT HAPPENS WHEN ERROR VARIANCE IS NONCONSTANT? Basc Econometrcs, Gujarat and Porter CHAPER 11: HETEROSCEDASTICITY: WHAT HAPPENS WHEN ERROR VARIANCE IS NONCONSTANT? 11.1 (a) False. The estmators are unbased but are neffcent. (b) True. See Sec. 11.4

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

STAT 3008 Applied Regression Analysis

STAT 3008 Applied Regression Analysis STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,

More information

Here is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)

Here is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y) Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,

More information

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques

More information