Solutions to Odd-Numbered End-of-Chapter Exercises: Chapter 17
|
|
- Catherine Daniel
- 5 years ago
- Views:
Transcription
1 Itroucto to Ecoometrcs (3 r Upate Eto) by James H. Stock a Mark W. Watso Solutos to O-Numbere E-of-Chapter Exercses: Chapter 7 (Ths erso August 7, 04) 05 Pearso Eucato, Ic.
2 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter (a) Suppose there are obseratos. Let b be a arbtrary estmator of β. Ge the estmator b, the sum of square errors for the ge regresso moel s ( Y b ). ˆ β, the restrcte least squares estmator of β, mmzes the sum of square RLS ˆ RLS errors. That s, β satsfes the frst orer coto for the mmzato whch requres the fferetal of the sum of square errors wth respect to b equals zero: ( Y b )( ) 0. Solg for b from the frst orer coto leas to the restrcte least squares estmator ˆ Y. RLS β (b) We show frst that ˆ β RLS s ubase. We ca represet the restrcte least squares estmator ˆ β RLS terms of the regressors a errors: Thus ˆ Y ( β + u) u β. RLS β + ˆ RLS u Eu (,, ) E( β ) β E E, β K + + β where the seco equalty follows by usg the law of terate expectatos, a the thr equalty follows from Eu (, K, ) 0 (cotue o the ext page) 05 Pearso Eucato, Ic.
3 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter 7 7. (cotue) because the obseratos are... a E(u ) 0. (Note, E(u,, ) E(u ) because the obseratos are... Uer assumptos 3 of Key Cocept 7., ˆ β RLS s asymptotcally ormally strbute. The large sample ormal approxmato to the lmtg strbuto ˆ RLS of β follows from coserg ˆ u u β β. RLS Coser frst the umerator whch s the sample aerage of u. By assumpto of Key Cocept 7., has mea zero: Eu ( ) EEu [ ( )] 0. By assumpto, s... By assumpto 3, ar( ) s fte. Let u Usg the cetral lmt theorem, the sample aerage or, the σ σ/. / σ N(0, ) σ u N(0, σ ). For the eomator, s... wth fte seco arace (because has a fte fourth momet), so that by the law of large umbers E( ). p Combg the results o the umerator a the eomator a applyg Slutsky s theorem lea to (cotue o the ext page) 05 Pearso Eucato, Ic.
4 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter (cotue) ˆ RLS u ar( u ) ( β βu ) N 0,. E( ) (c) ˆ β RLS s a lear estmator: ˆ Y, where. RLS β ay a The weght a (,, ) epes o,, but ot o Y,, Y. Thus ˆ u β β. RLS + ˆ β RLS s cotoally ubase because E( ˆβ RLS,, E β + u,, β + E u,, β. The fal equalty use the fact that E u,, E(u,, ) 0 because the obseratos are... a E (u ) 0. (cotue o the ext page) 05 Pearso Eucato, Ic.
5 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter (cotue) () The cotoal arace of ˆ RLS β, ge,,, s ar( ˆβ RLS,, ) ar β + u,, ( σ u ar(u,, ) ( σ u ). ) (e) The cotoal arace of the OLS estmator ˆβ s Sce ar( ˆ σ β,, ). u K ( ) ( ) + <, the OLS estmator has a larger cotoal arace: ar(,, ) ar( ˆ RLS β K > β, K, ). ˆ RLS The restrcte least squares estmator β s more effcet. (f) Uer assumpto 5 of Key Cocept 7., cotoal o,,, ˆ β RLS s ormally strbute sce t s a weghte aerage of ormally strbute arables u : ˆ u β β. RLS + (cotue o the ext page) 05 Pearso Eucato, Ic.
6 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter (cotue) Usg the cotoal mea a cotoal arace of ˆ β RLS ere parts (c) a () respectely, the samplg strbuto of ˆ β RLS, cotoal o,,, s (g) The estmator!β The cotoal arace s ˆ RLS σ u β ~ N β,. Y (β + u ) β + u ar( β!,, ) ar β + u,, ar(u,, ) σ u ( ( ). ) The fferece the cotoal arace of! β a ˆβ RLS s ar(! β,, ) ar( ˆβ RLS,, ) σ u ( ) σ u. I orer to proe ar(! β,, ) ar( ˆβ RLS,, ), we ee to show ( ) or equaletly (cotue o the ext page) 05 Pearso Eucato, Ic.
7 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter (cotue) Ths equalty comes rectly by applyg the Cauchy-Schwartz equalty. whch mples ( a b) a b. That s Σ (Σ x ), or ar( β!,, ) ar( ˆβ RLS,, ). Note: because! β s lear a cotoally ubase, the result ar(! β,, ) ar( ˆβ RLS,, ) follows rectly from the Gauss-Marko theorem. 05 Pearso Eucato, Ic.
8 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter (a) Usg Equato (7.9), we hae β ( ) ( ˆ β ) ( ) u [( µ ) ( µ )] u ( ) ( µ ) u ( µ ) u ( ) ( ) ( µ ) u ( ) ( ) by efg ( µ )u. (b) The raom arables u,, u are... wth mea µ u 0 a arace 0 σ u. < < By the cetral lmt theorem, u ( µ ) u u σ σ u u N(0, ). The law of large umbers mples p µ,or µ 0. By the cosstecy of sample arace, ( ) Σ coerges probablty to populato arace, ar( ), whch s fte a o-zero. The result the follows from Slutsky s theorem. (c) The raom arable ( µ ) u has fte arace: p ar( ) ar[( µ ) µ ] E [( µ ) u ] E < 4 4 [( µ ) ] E[( u) ]. The equalty follows by applyg the Cauchy-Schwartz equalty, a the seco equalty follows because of the fte fourth momets for (, u ). The fte arace alog wth the fact that has mea zero (by assumpto of Key Cocept 5.) a s... (by assumpto ) mples that the sample aerage satsfes the requremets of the cetral lmt theorem. Thus, (cotue o the ext page) 05 Pearso Eucato, Ic.
9 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter (cotue) σ σ satsfes the cetral lmt theorem. () Applyg the cetral lmt theorem, we hae σ N(0, ). Because the sample arace s a cosstet estmator of the populato arace, we hae Usg Slutsky s theorem, ( ) p. ar( ) t σ ( ) σ t N(0,), or equaletly ar( ) N 0,. ( ) [ar( )] Thus ( µ ) u β ( ) ( ) ( ˆ β ) ar( ) N 0, [ar( )] sce the seco term for ( ˆ β β) coerges probablty to zero as show part (b). 05 Pearso Eucato, Ic.
10 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter Because E(W 4 ) [E(W )] + ar(w ), [E(W )] E (W 4 ) <. Thus E(W ) <. 05 Pearso Eucato, Ic.
11 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter (a) The jot probablty strbuto fucto of u, u j,, j s f (u, u j,, j ). The cotoal probablty strbuto fucto of u a ge u j a j s f (u, u j, j ). Sce u,,,, are..., f (u, u j, j ) f (u, ). By efto of the cotoal probablty strbuto fucto, we hae f( u, u,, ) f( u, u, ) f( u, ) j j j j j j f( u, ) f( u, ). j j (b) The cotoal probablty strbuto fucto of u a u j ge a j equals f( u, uj,, j) f( u, ) f( uj, j) f( u, uj, j) f( u ) f( uj j). f(, ) f( ) f( ) j j The frst a thr equaltes use the efto of the cotoal probablty strbuto fucto. The seco equalty use the cocluso the from part (a) a the epeece betwee a j. Substtutg f( u, u, ) f( u ) f( u ) j j j j to the efto of the cotoal expectato, we hae E( u u, ) u u f ( u, u, ) u u j j j j j j u u f ( u ) f ( u ) u u j j j j u f ( u ) u u f ( u ) u j j j j Eu ( ) Eu ( ). j j (c) Let Q (,,,, +,, ), so that f (u,, ) f (u, Q). Wrte (cotue o ext page) 05 Pearso Eucato, Ic.
12 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter (cotue) f( u, Q) f( u,, Q) f(, Q) f( u, ) f( Q) f( ) f( Q) f( u, ) f( ) f( u ) where the frst equalty uses the efto of the cotoal esty, the seco uses the fact that (u, ) a Q are epeet, a the fal equalty uses the efto of the cotoal esty. The result the follows rectly. () A argumet lke that use (c) mples f( uu, K ) f( uu, ) j j j a the result the follows from part (b). 05 Pearso Eucato, Ic.
13 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter We ee to proe p [( ) ˆ u ( µ ) u ] 0. Usg the etty µ + ( µ ), [( ) ˆ ( ) ] ( ) ˆ u µ u µ u ( µ ) ( µ ) u ˆ + ( ) ( ˆ µ u u ). The efto of u ˆ mples uˆ u + ( ˆ β β ) + ( ˆ β β ) u ( ˆ β β ) Substtutg ths to the expresso for u ( ˆ β β ) + ( ˆ β β )( ˆ β β ). 0 0 Σ [( ) u ( ) u ] yels a ˆ µ seres of terms each of whch ca be wrtte as a b where a 0 a b Σ u where r a s are tegers. For example, r s a ( µ ), a ( ˆ β β ) a so forth. The result the follows from Slutksy s p theorem f r s r s Σ u where s a fte costat. Let w u a ote that w s... The law of large umbers ca the be use for the esre result f Ew ( ). < There are two cases that ee to be aresse. I the frst, both r a s are o-zero. I ths case wrte p Ew E u E Eu r s 4r 4s ( ) ( ) < [ ( )][ ( )] a ths term s fte f r a s are less tha. Ispecto of the terms shows that ths s true. I the seco case, ether r 0 or s 0. I ths case the result follows rectly f the o-zero expoet (r or s) s less tha 4. Ispecto of the terms shows that ths s true. 05 Pearso Eucato, Ic.
14 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter Note: early prtg of the thr eto there was a typographcal error the expresso for µ Y. The correct expresso s µ Y µ Y+ ( σy / σ )( x µ ). (a) Usg the ht a equato (7.38) f Y x( y) σ ( ρ ) Y Y x µ x µ y µ Y y µ Y x µ exp ρ. Y + + ( ρy ) σ σ σy σ Y σ Smplfyg yels the esre expresso. (b) The result follows by otg that f Y x (y) s a ormal esty (see equato (7.36)) wth µ µ T a σ σ. (c) Let b σ Y / σ a a µ Y bµ. Y 05 Pearso Eucato, Ic.
15 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter (a) The aswer s proe by equato (3.0) a the scusso followg the equato. The result was also show Exercse 3.0, a the approach use the exercse s scusse part (b). (b) Wrte the regresso moel as Y β0 + β +, where β0 E(β0), β E(β), a u + (β0 β0) + (β β). Notce that E( ) E(u ) + E(β0 β0 ) + E(β β ) 0 because β0 a β are epeet of. Because E( ) 0, the OLS regresso of Y o wll proe cosstet estmates of β0 E(β0) a β E(β). Recall that the weghte least squares estmator s the OLS estmator of Y/σ oto /σ a /σ, where σ θ + θ. Wrte ths regresso as 0 Y / σ β (/ σ ) + β ( / σ ) + / σ. 0 Ths regresso has two regressors, /σ a /σ. Because these regressors epe oly o, E( ) 0 mples that E(/σ (/σ), /σ) 0. Thus, weghte least squares proes a cosstet estmator of β0 E(β0) a β E(β). 05 Pearso Eucato, Ic.
16 Stock/Watso - Itroucto to Ecoometrcs - 3 r Upate Eto - Aswers to Exercses: Chapter (a) Wrte W Z where Z ~ N(0,). From the law of large umber W/. E( Z ) (b) The umerator s N(0,) a the eomator coerges probablty to. The result follows from Slutsky s theorem (equato (7.9)). (c) V/m s strbute χ m / m a the eomator coerges probablty to. The result follows from Slutsky s theorem (equato (7.9)). 05 Pearso Eucato, Ic.
M2S1 - EXERCISES 8: SOLUTIONS
MS - EXERCISES 8: SOLUTIONS. As X,..., X P ossoλ, a gve that T ˉX, the usg elemetary propertes of expectatos, we have E ft [T E fx [X λ λ, so that T s a ubase estmator of λ. T X X X Furthermore X X X From
More information= 2. Statistic - function that doesn't depend on any of the known parameters; examples:
of Samplg Theory amples - uemploymet househol cosumpto survey Raom sample - set of rv's... ; 's have ot strbuto [ ] f f s vector of parameters e.g. Statstc - fucto that oes't epe o ay of the ow parameters;
More informationChapter 5 Properties of a Random Sample
Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample
More informationX ε ) = 0, or equivalently, lim
Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece
More informationEconometrics. 3) Statistical properties of the OLS estimator
30C0000 Ecoometrcs 3) Statstcal propertes of the OLS estmator Tmo Kuosmae Professor, Ph.D. http://omepre.et/dex.php/tmokuosmae Today s topcs Whch assumptos are eeded for OLS to work? Statstcal propertes
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More informationIntroduction to Econometrics (3 rd Updated Edition, Global Edition) Solutions to Odd-Numbered End-of-Chapter Exercises: Chapter 9
Itroducto to Ecoometrcs (3 rd Udated Edto, Global Edto) by James H. Stock ad Mark W. Watso Solutos to Odd-Numbered Ed-of-Chater Exercses: Chater 9 (Ths verso August 7, 04) 05 Pearso Educato, Ltd. Stock/Watso
More information( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model
Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch
More informationSTAT 400 Homework 09 Spring 2018 Dalpiaz UIUC Due: Friday, April 6, 2:00 PM
STAT Homework 9 Sprg 28 Dalpaz UIUC Due: Fray, Aprl 6, 2: PM Exercse f(x, θ) = θ e x/θ, x >, θ > Note that, the momets of ths strbuto are gve by E[X k ] = Ths wll be a useful fact for Exercses 2 a 3. x
More informationEconometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More informationOrdinary Least Squares Regression. Simple Regression. Algebra and Assumptions.
Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos
More informationC.11 Bang-bang Control
Itroucto to Cotrol heory Iclug Optmal Cotrol Nguye a e -.5 C. Bag-bag Cotrol. Itroucto hs chapter eals wth the cotrol wth restrctos: s boue a mght well be possble to have scotutes. o llustrate some of
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More information9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d
9 U-STATISTICS Suppose,,..., are P P..d. wth CDF F. Our goal s to estmate the expectato t (P)=Eh(,,..., m ). Note that ths expectato requres more tha oe cotrast to E, E, or Eh( ). Oe example s E or P((,
More informationWu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1
Wu-Hausma Test: Detectg Falure of E( ε X ) Caot drectly test ths assumpto because lack ubased estmator of ε ad the OLS resduals wll be orthogoal to X, by costructo as ca be see from the momet codto X'
More informationLecture Notes to Rice Chapter 5
ECON 430 Revsed Sept. 06 Lecture Notes to Rce Chapter 5 By H. Goldste. Chapter 5 gves a troducto to probablstc approxmato methods, but s suffcet for the eeds of a adequate study of ecoometrcs. The commo
More informationAnswer key to problem set # 2 ECON 342 J. Marcelo Ochoa Spring, 2009
Aswer key to problem set # ECON 34 J. Marcelo Ochoa Sprg, 009 Problem. For T cosder the stadard pael data model: y t x t β + α + ǫ t a Numercally compare the fxed effect ad frst dfferece estmates. b Compare
More information1 Solution to Problem 6.40
1 Soluto to Problem 6.40 (a We wll wrte T τ (X 1,...,X where the X s are..d. wth PDF f(x µ, σ 1 ( x µ σ g, σ where the locato parameter µ s ay real umber ad the scale parameter σ s > 0. Lettg Z X µ σ we
More informationMaximum Walk Entropy Implies Walk Regularity
Maxmum Walk Etropy Imples Walk Regularty Eresto Estraa, a José. e la Peña Departmet of Mathematcs a Statstcs, Uversty of Strathclye, Glasgow G XH, U.K., CIMT, Guaajuato, Mexco BSTRCT: The oto of walk etropy
More informationLinear Regression with One Regressor
Lear Regresso wth Oe Regressor AIM QA.7. Expla how regresso aalyss ecoometrcs measures the relatoshp betwee depedet ad depedet varables. A regresso aalyss has the goal of measurg how chages oe varable,
More informationUNIT 7 RANK CORRELATION
UNIT 7 RANK CORRELATION Rak Correlato Structure 7. Itroucto Objectves 7. Cocept of Rak Correlato 7.3 Dervato of Rak Correlato Coeffcet Formula 7.4 Te or Repeate Raks 7.5 Cocurret Devato 7.6 Summar 7.7
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationECON 5360 Class Notes GMM
ECON 560 Class Notes GMM Geeralzed Method of Momets (GMM) I beg by outlg the classcal method of momets techque (Fsher, 95) ad the proceed to geeralzed method of momets (Hase, 98).. radtoal Method of Momets
More informationChapter 4 Multiple Random Variables
Revew o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for Chapter 4-5 Notes: Although all deftos ad theorems troduced our lectures ad ths ote are mportat ad you should be famlar wth, but I put those
More informationCS 3710 Advanced Topics in AI Lecture 17. Density estimation. CS 3710 Probabilistic graphical models. Administration
CS 37 Avace Topcs AI Lecture 7 esty estmato Mlos Hauskrecht mlos@cs.ptt.eu 539 Seott Square CS 37 robablstc graphcal moels Amstrato Mterm: A take-home exam week ue o Weesay ovember 5 before the class epes
More informationNONPARAMETRIC ESTIMATION OF AN ADDITIVE MODEL WITH A LINK FUNCTION
NONPARAMETRIC ESTIMATION OF AN ADDITIVE MODEL WITH A LINK FUNCTION Joel Horowtz a Eo Mamme THE INSTITUTE FOR FISCAL STUDIES DEPARTMENT OF ECONOMICS, UCL cemmap workg paper CWP9/0 NONPARAMETRIC ESTIMATION
More informationSimulation Output Analysis
Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5
More informationCHAPTER 4 RADICAL EXPRESSIONS
6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube
More informationLecture 3. Sampling, sampling distributions, and parameter estimation
Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called
More informationUseful Statistical Identities, Inequalities and Manipulations
Useful Statstcal Iettes, Iequaltes a Mapulatos Cotets Itroucto Probablty Os, Log-Os PA ( ) π Let π PA ( ) We efe the Os Rato θ If θ we say that the patet s three PA ( ) π tmes more lely to have the sease
More information1. The weight of six Golden Retrievers is 66, 61, 70, 67, 92 and 66 pounds. The weight of six Labrador Retrievers is 54, 60, 72, 78, 84 and 67.
Ecoomcs 3 Itroducto to Ecoometrcs Sprg 004 Professor Dobk Name Studet ID Frst Mdterm Exam You must aswer all the questos. The exam s closed book ad closed otes. You may use your calculators but please
More informationCOV. Violation of constant variance of ε i s but they are still independent. The error term (ε) is said to be heteroscedastic.
c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty olato of costat varace of s but they are stll depedet. C,, he error term s sad to be heteroscedastc. c Pogsa Porchawseskul, Faculty of Ecoomcs,
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationLecture 9: Tolerant Testing
Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have
More informationInvestigation of Partially Conditional RP Model with Response Error. Ed Stanek
Partally Codtoal Radom Permutato Model 7- vestgato of Partally Codtoal RP Model wth Respose Error TRODUCTO Ed Staek We explore the predctor that wll result a smple radom sample wth respose error whe a
More informationENGI 4421 Propagation of Error Page 8-01
ENGI 441 Propagato of Error Page 8-01 Propagato of Error [Navd Chapter 3; ot Devore] Ay realstc measuremet procedure cotas error. Ay calculatos based o that measuremet wll therefore also cota a error.
More informationFeature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)
CSE 546: Mache Learg Lecture 6 Feature Selecto: Part 2 Istructor: Sham Kakade Greedy Algorthms (cotued from the last lecture) There are varety of greedy algorthms ad umerous amg covetos for these algorthms.
More informationECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model
ECON 48 / WH Hog The Smple Regresso Model. Defto of the Smple Regresso Model Smple Regresso Model Expla varable y terms of varable x y = β + β x+ u y : depedet varable, explaed varable, respose varable,
More informationPart 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))
art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the
More informationBounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy
Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled
More informationLecture Note to Rice Chapter 8
ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,
More informationThe Mathematical Appendix
The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.
More informationENGI 3423 Simple Linear Regression Page 12-01
ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable
More informationPoint Estimation: definition of estimators
Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More informationUNIT 6 CORRELATION COEFFICIENT
UNIT CORRELATION COEFFICIENT Correlato Coeffcet Structure. Itroucto Objectves. Cocept a Defto of Correlato.3 Tpes of Correlato.4 Scatter Dagram.5 Coeffcet of Correlato Assumptos for Correlato Coeffcet.
More informationLINEARLY CONSTRAINED MINIMIZATION BY USING NEWTON S METHOD
Jural Karya Asl Loreka Ahl Matematk Vol 8 o 205 Page 084-088 Jural Karya Asl Loreka Ahl Matematk LIEARLY COSTRAIED MIIMIZATIO BY USIG EWTO S METHOD Yosza B Dasrl, a Ismal B Moh 2 Faculty Electrocs a Computer
More informationChapter 3 Sampling For Proportions and Percentages
Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys
More informationSTK4011 and STK9011 Autumn 2016
STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto
More information(2014) ISSN
Estraa, Eresto a e la Pea, Jose too (4) Maxmum walk etropy mples walk regularty. Lear lgebra a ts pplcatos, 458. pp. 54-547. ISSN 4-3795, http://x.o.org/.6/j.laa.4.6.3 Ths verso s avalable at https://strathprts.strath.ac.uk/5879/
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationTHE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA
THE ROYAL STATISTICAL SOCIETY 3 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER I STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad
More informationMidterm Exam 1, section 2 (Solution) Thursday, February hour, 15 minutes
coometrcs, CON Sa Fracsco State Uverst Mchael Bar Sprg 5 Mdterm xam, secto Soluto Thursda, Februar 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes exam.. No calculators of a kd are allowed..
More informationQualifying Exam Statistical Theory Problem Solutions August 2005
Qualfyg Exam Statstcal Theory Problem Solutos August 5. Let X, X,..., X be d uform U(,),
More information5 Short Proofs of Simplified Stirling s Approximation
5 Short Proofs of Smplfed Strlg s Approxmato Ofr Gorodetsky, drtymaths.wordpress.com Jue, 20 0 Itroducto Strlg s approxmato s the followg (somewhat surprsg) approxmato of the factoral,, usg elemetary fuctos:
More informationChapter 4 Multiple Random Variables
Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:
More informationModule 7. Lecture 7: Statistical parameter estimation
Lecture 7: Statstcal parameter estmato Parameter Estmato Methods of Parameter Estmato 1) Method of Matchg Pots ) Method of Momets 3) Mamum Lkelhood method Populato Parameter Sample Parameter Ubased estmato
More informationESS Line Fitting
ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here
More informationClass 13,14 June 17, 19, 2015
Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral
More informationGeneralized Linear Regression with Regularization
Geeralze Lear Regresso wth Regularzato Zoya Bylsk March 3, 05 BASIC REGRESSION PROBLEM Note: I the followg otes I wll make explct what s a vector a what s a scalar usg vec t or otato, to avo cofuso betwee
More informationSection 2 Notes. Elizabeth Stone and Charles Wang. January 15, Expectation and Conditional Expectation of a Random Variable.
Secto Notes Elzabeth Stoe ad Charles Wag Jauar 5, 9 Jot, Margal, ad Codtoal Probablt Useful Rules/Propertes. P ( x) P P ( x; ) or R f (x; ) d. P ( xj ) P (x; ) P ( ) 3. P ( x; ) P ( xj ) P ( ) 4. Baes
More informationChapter 3. Differentiation 3.3 Differentiation Rules
3.3 Dfferetato Rules 1 Capter 3. Dfferetato 3.3 Dfferetato Rules Dervatve of a Costat Fucto. If f as te costat value f(x) = c, te f x = [c] = 0. x Proof. From te efto: f (x) f(x + ) f(x) o c c 0 = 0. QED
More informationENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections
ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty
More informationCS286.2 Lecture 4: Dinur s Proof of the PCP Theorem
CS86. Lecture 4: Dur s Proof of the PCP Theorem Scrbe: Thom Bohdaowcz Prevously, we have prove a weak verso of the PCP theorem: NP PCP 1,1/ (r = poly, q = O(1)). Wth ths result we have the desred costat
More informationSimple Linear Regression
Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato
More informationTHE ROYAL STATISTICAL SOCIETY 2010 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA MODULE 2 STATISTICAL INFERENCE
THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA MODULE STATISTICAL INFERENCE The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the
More information2SLS Estimates ECON In this case, begin with the assumption that E[ i
SLS Estmates ECON 3033 Bll Evas Fall 05 Two-Stage Least Squares (SLS Cosder a stadard lear bvarate regresso model y 0 x. I ths case, beg wth the assumto that E[ x] 0 whch meas that OLS estmates of wll
More informationHamilton s principle for non-holonomic systems
Das Hamltosche Przp be chtholoome Systeme, Math. A. (935), pp. 94-97. Hamlto s prcple for o-holoomc systems by Georg Hamel Berl Traslate by: D. H. Delphech I the paper Le prcpe e Hamlto et l holoomsme,
More informationmeans the first term, a2 means the term, etc. Infinite Sequences: follow the same pattern forever.
9.4 Sequeces ad Seres Pre Calculus 9.4 SEQUENCES AND SERIES Learg Targets:. Wrte the terms of a explctly defed sequece.. Wrte the terms of a recursvely defed sequece. 3. Determe whether a sequece s arthmetc,
More informationSampling Theory MODULE X LECTURE - 35 TWO STAGE SAMPLING (SUB SAMPLING)
Samplg Theory ODULE X LECTURE - 35 TWO STAGE SAPLIG (SUB SAPLIG) DR SHALABH DEPARTET OF ATHEATICS AD STATISTICS IDIA ISTITUTE OF TECHOLOG KAPUR Two stage samplg wth uequal frst stage uts: Cosder two stage
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationL(θ X) s 0 (1 θ 0) m s. (s/m) s (1 s/m) m s
Hw 4 (due March ) 83 The LRT statstcs s λ(x) sup θ θ 0 L(θ X) The lkelhood s L(θ) θ P x ( sup Θ L(θ X) θ) m P x ad ad the log-lkelhood s (θ) x log θ +(m x ) log( θ) Let S X Note that the ucostraed MLE
More informationHomework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015
Fall 05 Homework : Solutos Problem : (Practce wth Asymptotc Notato) A essetal requremet for uderstadg scalg behavor s comfort wth asymptotc (or bg-o ) otato. I ths problem, you wll prove some basc facts
More informationCIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights
CIS 800/002 The Algorthmc Foudatos of Data Prvacy October 13, 2011 Lecturer: Aaro Roth Lecture 9 Scrbe: Aaro Roth Database Update Algorthms: Multplcatve Weghts We ll recall aga) some deftos from last tme:
More informationOn the Inconsistency of Instrumental Variables Estimators for the Coefficients of Certain Dummy Variables
O the Icosstecy of Istrumetal Varales Estmators for the Coeffcets of Certa Dummy Varales Itroucto Dummy cator varales are routely use as covarates regresso aalyss These ary varales are assge the value
More informationTHE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5
THE ROYAL STATISTICAL SOCIETY 06 EAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5 The Socety s provdg these solutos to assst cadtes preparg for the examatos 07. The solutos are teded as learg ads ad should
More informationChapter -2 Simple Random Sampling
Chapter - Smple Radom Samplg Smple radom samplg (SRS) s a method of selecto of a sample comprsg of umber of samplg uts out of the populato havg umber of samplg uts such that every samplg ut has a equal
More informationMidterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes
coometrcs, CON Sa Fracsco State Uversty Mchael Bar Sprg 5 Mdterm am, secto Soluto Thursday, February 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes eam.. No calculators of ay kd are allowed..
More informationMean is only appropriate for interval or ratio scales, not ordinal or nominal.
Mea Same as ordary average Sum all the data values ad dvde by the sample sze. x = ( x + x +... + x Usg summato otato, we wrte ths as x = x = x = = ) x Mea s oly approprate for terval or rato scales, ot
More informationMu Sequences/Series Solutions National Convention 2014
Mu Sequeces/Seres Solutos Natoal Coveto 04 C 6 E A 6C A 6 B B 7 A D 7 D C 7 A B 8 A B 8 A C 8 E 4 B 9 B 4 E 9 B 4 C 9 E C 0 A A 0 D B 0 C C Usg basc propertes of arthmetc sequeces, we fd a ad bm m We eed
More informationGENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA
Sc.It.(Lahore),26(3),985-990,2014 ISSN 1013-5316; CODEN: SINTE 8 GENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA Beradhta H. S. Utam 1, Warsoo 1, Da Kurasar 1, Mustofa Usma
More informationChapter -2 Simple Random Sampling
Chapter - Smple Radom Samplg Smple radom samplg (SRS) s a method of selecto of a sample comprsg of umber of samplg uts out of the populato havg umber of samplg uts such that every samplg ut has a equal
More information1. Linear second-order circuits
ear eco-orer crcut Sere R crcut Dyamc crcut cotag two capactor or two uctor or oe uctor a oe capactor are calle the eco orer crcut At frt we coer a pecal cla of the eco-orer crcut, amely a ere coecto of
More informationRecall MLR 5 Homskedasticity error u has the same variance given any values of the explanatory variables Var(u x1,...,xk) = 2 or E(UU ) = 2 I
Chapter 8 Heterosedastcty Recall MLR 5 Homsedastcty error u has the same varace gve ay values of the eplaatory varables Varu,..., = or EUU = I Suppose other GM assumptos hold but have heterosedastcty.
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More informationDimensionality Reduction and Learning
CMSC 35900 (Sprg 009) Large Scale Learg Lecture: 3 Dmesoalty Reducto ad Learg Istructors: Sham Kakade ad Greg Shakharovch L Supervsed Methods ad Dmesoalty Reducto The theme of these two lectures s that
More informationOn the Inconsistency of Instrumental Variables Estimators for the Coefficients of Certain Dummy Variables
O the Icosstecy of Istrumetal Varales Estmators for the Coeffcets of Certa Dummy Varales Dav E Gles Departmet of Ecoomcs, Uversty of Vctora Vctora, BC, Caaa V8W Y Uer Revso, August Astract I ths paper
More informationC-1: Aerodynamics of Airfoils 1 C-2: Aerodynamics of Airfoils 2 C-3: Panel Methods C-4: Thin Airfoil Theory
ROAD MAP... AE301 Aerodyamcs I UNIT C: 2-D Arfols C-1: Aerodyamcs of Arfols 1 C-2: Aerodyamcs of Arfols 2 C-3: Pael Methods C-4: Th Arfol Theory AE301 Aerodyamcs I Ut C-3: Lst of Subects Problem Solutos?
More informationExtend the Borel-Cantelli Lemma to Sequences of. Non-Independent Random Variables
ppled Mathematcal Sceces, Vol 4, 00, o 3, 637-64 xted the Borel-Catell Lemma to Sequeces of No-Idepedet Radom Varables olah Der Departmet of Statstc, Scece ad Research Campus zad Uversty of Tehra-Ira der53@gmalcom
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More information4 Inner Product Spaces
11.MH1 LINEAR ALGEBRA Summary Notes 4 Ier Product Spaces Ier product s the abstracto to geeral vector spaces of the famlar dea of the scalar product of two vectors or 3. I what follows, keep these key
More informationDiscrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b
CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package
More informationON THE CHROMATIC NUMBER OF GENERALIZED STABLE KNESER GRAPHS
ON THE CHROMATIC NUMBER OF GENERALIZED STABLE KNESER GRAPHS JAKOB JONSSON Abstract. For each teger trple (, k, s) such that k 2, s 2, a ks, efe a graph the followg maer. The vertex set cossts of all k-subsets
More informationTHE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA
THE ROYAL STATISTICAL SOCIETY EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER II STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for
More informationSTA302/1001-Fall 2008 Midterm Test October 21, 2008
STA3/-Fall 8 Mdterm Test October, 8 Last Name: Frst Name: Studet Number: Erolled (Crcle oe) STA3 STA INSTRUCTIONS Tme allowed: hour 45 mutes Ads allowed: A o-programmable calculator A table of values from
More informationDimensionality reduction Feature selection
CS 675 Itroucto to ache Learg Lecture Dmesoalty reucto Feature selecto los Hauskrecht mlos@cs.ptt.eu 539 Seott Square Dmesoalty reucto. otvato. L methos are sestve to the mesoalty of ata Questo: Is there
More informationhp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations
HP 30S Statstcs Averages ad Stadard Devatos Average ad Stadard Devato Practce Fdg Averages ad Stadard Devatos HP 30S Statstcs Averages ad Stadard Devatos Average ad stadard devato The HP 30S provdes several
More informationå 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018
Chrs Pech Fal Practce CS09 Dec 5, 08 Practce Fal Examato Solutos. Aswer: 4/5 8/7. There are multle ways to obta ths aswer; here are two: The frst commo method s to sum over all ossbltes for the rak of
More information