Robust Data-Driven Inference for Density-Weighted Average Derivatives

Size: px
Start display at page:

Download "Robust Data-Driven Inference for Density-Weighted Average Derivatives"

Transcription

1 Supplemetary materials for this article are available olie. Please click the JASA lik at Robust Data-Drive Iferece for Desity-Weighte Average Derivatives Matias D. CATTANEO, Richar K. CRUMP, a Michael JANSSON This paper presets a ovel ata-rive bawith selector compatible with the small bawith asymptotics evelope i Cattaeo, Crump, a Jasso (009) for esity-weighte average erivatives. The ew bawith selector is of the plug-i variety, a is obtaie base o a mea square error expasio of the estimator of iterest. A extesive Mote Carlo experimet shows a remarkable improvemet i performace whe the bawith-epeet robust iferece proceures propose by Cattaeo, Crump, a Jasso (009) are couple with this ew ata-rive bawith selector. The resultig robust ata-rive cofiece itervals compare favorably to the alterative proceures available i the literature. The olie supplemetal material to this paper cotais further results from the simulatio stuy. KEY WORDS: Average erivative; Bawith selectio; Robust iferece; Small bawith asymptotics. Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary INTRODUCTION Semiparametric moels, which iclue both a fiite imesioal parameter of iterest a a ifiite imesioal uisace parameter, play a cetral role i moer statistical a ecoometric theory, a are potetially of great iterest i empirical work. However, the applicability of semiparametric estimators is seriously hampere by the sesitivity of their performace to seemigly a hoc choices of smoothig a tuig parameters ivolve i the estimatio proceure. Although classical large sample theory for semiparametric estimators is ow well evelope, these theoretical results are typically ivariat to the particular choice of parameters associate with the oparametric estimator employe, a usually require strog utestable assumptios (e.g., smoothess of the ifiite imesioal uisace parameter). As a cosequece, iferece proceures base o these estimators are i geeral ot robust to chages i the choice of tuig a smoothig parameters uerlyig the oparametric estimator, a to epartures from key uobservable moel assumptios. These facts suggest that classical asymptotic results for semiparametric estimators may ot always accurately capture their behavior i fiite samples, posig cosierable restrictios o the overall applicability they may have for empirical work. This paper proposes two robust ata-rive iferece proceures for the semiparametric esity-weighte average erivatives estimator of Powell, Stock, a Stoker (1989). The average erivatives is a simple yet importat semiparametric estima of iterest, which aturally arises i may statistical a ecoometric moels such as (oaitive) sigle-iex moels Matias D. Cattaeo is Assistat Professor of Ecoomics, Departmet of Ecoomics, Uiversity of Michiga, A Arbor, MI ( cattaeo@umich.eu). Richar K. Crump is Ecoomist, Capital Markets Fuctio, Feeral Reserve Bak of New York, New York, NY Michael Jasso is Associate Professor of Ecoomics, Departmet of Ecoomics, Uiversity of Califoria at Berkeley a CREATES, Berkeley, CA The authors thak Sebastia Caloico, Lutz Kilia, semiar participats at Georgetow, Michiga, Pe State a Wiscosi, a coferece participats at the 009 Lati America Meetig of the Ecoometric Society a 010 North America Witer Meetig of the Ecoometric Society for commets. We also thak the eitor, associate eitor, a a referee for commets a suggestios that improve this paper. The first author gratefully ackowleges fiacial support from the Natioal Sciece Fouatio (SES ). The thir author gratefully ackowleges fiacial support from the Natioal Sciece Fouatio (SES ) a the research support of CREATES (fue by the Daish Natioal Research Fouatio). (see, e.g., Powell 1994 a Matzki 007 forreview).thisestima has bee cosiere i a variety of empirical problems, icluig oparametric ema estimatio (Härle, Hilebra, a Jeriso 1991), policy aalysis of tax a subsiy reform (Deato a Ng 1998), a oliear pricig i labor markets (Coppejas a Sieg 005). This paper focuses o the esity-weighte average erivatives estimator ot oly because of its ow importace, but also because it amits a particular U-statistic represetatio. As iscusse i etail below, this represetatio is heavily exploite i the theoretical evelopmets presete here, which implies that the results i this paper may be extee to cover other estimators havig a similar represetatio. The mai iea is to evelop a ovel ata-rive bawith selector compatible with the small bawith asymptotic theory presete i Cattaeo, Crump, a Jasso (009). This alterative (first-orer) large sample theory ecompasses the classical large sample theory available i the literature, a also ejoys several robustess properties. I particular, (i) it provies vali iferece proceures for (small) bawith sequeces that woul reer the classical results ivali, (ii) it permits the use of a seco-orer kerel regarless of the imesio of the regressors a therefore removes strog smoothess assumptios, a (iii) it provies a limitig istributio that is i geeral ot ivariat to the particular choices of smoothig a tuig parameters, without ecessarily forcig a slower tha root- rate of covergece (where is the sample size). The key theoretical isight behi these results is to accommoate bawith sequeces that break ow the asymptotic liearity of the estimator of iterest, leaig to a more geeral first-orer asymptotic theory that is o loger ivariat to the particular choices of parameters uerlyig the prelimiary oparametric estimator. Cosequetly, it is expecte that a iferece proceure base o this alterative asymptotic theory woul (at least partially) aapt to the particular choices of these parameters. The prelimiary simulatio results i Cattaeo, Crump, a Jasso (009) show that this alterative asymptotic theory opes the possibility for the costructio of a robust iferece proceure, proviig a rage of (small) bawiths for which the appropriate test statistic ejoys approximately correct size. 010 America Statistical Associatio Joural of the America Statistical Associatio September 010, Vol. 105, No. 491, Theory a Methos DOI: /jasa.010.tm

2 Cattaeo, Crump, a Jasso: Robust Data-Drive Iferece for Average Derivatives 1071 Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 However, the bawith selectors available i the literature tur out to be icompatible with these ew results i the sese that they woul ot eliver a bawith choice withi the robust rage. The ew ata-rive bawith selector presete here achieves this goal, thereby proviig a robust automatic (i.e., fully ata-rive) iferece proceure for the estima of iterest. These results are corroborate by a extesive Mote Carlo experimet, which shows that the asymptotic theory evelope i Cattaeo, Crump, a Jasso (009) couple with the atarive bawith selector propose here leas to remarkable improvemets i iferece whe compare to the alterative proceures available i the literature. I particular, the resultig cofiece itervals exhibit close-to-correct empirical coverage across all esigs cosiere. Amog other avatages, these ata-rive statistical proceures allow for the use of a secoorer kerel, which is believe to eliver more stable results i applicatios (see, e.g., Horowitz a Härle 1996), a appear to be cosierably more robust to the aitioal variability itrouce by the estimatio of the bawith selectors. Furthermore, these results are importat because the staar oparametric bootstrap is ot a vali alterative i geeral to the large sample theory employe i this paper (Cattaeo, Crump, a Jasso 010). Aother iterestig feature of the aalysis presete here is relate to the well-kow trae-off betwee efficiecy a robustess i statistical iferece. I particular, the ovel proceures presete here are cosierably more robust while i geeral (semiparametric) iefficiet. This feature is capture by the behavior of the ew robust cofiece itervals i the simulatio stuy, where they are see to have correct size a less bias but larger legth o average. For example, whe the classical proceure is vali (i.e., whe usig a higher-orer kerel), the efficiecy loss is fou to be arou 10% o average, while the bias of the estimator is reuce by about 60% o average. This paper cotributes to the importat literature of semiparametric iferece for weighte average erivatives. This populatio parameter was origially itrouce by Stoker (1986), a has bee itesely stuie sice the. Härle a Stoker (1989) a Härle et al. (199) stuy the asymptotic properties of geeral weighte average erivatives estimators, while Newey a Stoker (1993) iscuss their semiparametric efficiecy properties uer appropriate restrictios. The asymptotic results, however, are cosierably complicate by the fact that their represetatio requires halig stochastic eomiators a appears to be very sesitive to the choice of trimmig parameters. The esity-weighte average erivatives estimator circumvets this problem, while retaiig the esirable properties of the geeral weighte average erivative, a leas to a simple a useful semiparametric estimator. Powell, Stock, a Stoker (1989) stuy the first-orer large sample properties of this estimator a provie sufficiet (but ot ecessary) coitios for root- cosistecy a asymptotic ormality. Nishiyama a Robiso (000, 005) stuy the seco-orer large sample properties of esity-weighte average erivatives by erivig vali Egeworth expasios for the estimator cosiere i this paper (see also Robiso 1995), while Härle a Tsybakov (1993) a Powell a Stoker (1996) provie seco-orer mea square error expasios for this estimator (see also Newey, Hsieh, a Robis 004). Both types of higher-orer expasios provie simple plug-i bawith selectors targetig ifferet properties of this estimator, a are compatible with the classical large sample theory available i the literature. Ichimura a To (007) provie a recet survey with particular emphasis o implemetatio. The rest of the paper is orgaize as follows. Sectio escribes the moel a reviews the mai results available i the literature regarig first-orer large sample iferece for esity-weighte average erivatives. Sectio 3 presets the higher-orer mea square error expasio a evelops the ew (ifeasible) theoretical bawith selector, while Sectio 4 escribes how to costruct a feasible (i.e., ata-rive) bawith selector a establishes its cosistecy. Sectio 5 summarizes the results of a extesive Mote Carlo experimet. Sectio 6 iscusses how the results may be geeralize a coclues.. MODEL AND PREVIOUS RESULTS Let z i = (y i, x i ), i = 1,...,, be a raom sample from a vector z = (y, x ), where y R is a epeet variable a x = (x 1,...,x ) R is a cotiuous explaatory variable with a esity f ( ). The populatio parameter of iterest is the esityweighte average erivative give by [ θ = E f (x) x g(x) where g(x) = E[y x] eotes the populatio regressio fuctio. For example, this estima is a popular choice for the estimatio of the coefficiets (up to scale) i a sigle-iex moel with ukow lik fuctio. To see this, ote that θ β whe g(x) = τ(x β) for a ukow (lik) fuctio τ( ), a semiparametric problem that arises i a variety of cotexts, icluig iscrete choice a cesore moels. The followig assumptio collects typical regularity coitios impose o this moel. Assumptio 1. (a) E[y 4 ] <, E[σ (x)f (x)] > 0 a V[ e(x)/ x y f (x)/ x] is positive efiite, where σ (x) = V[y x] a e(x) = f (x)g(x). (b) f is (Q+1) times ifferetiable, a f a its first (Q+1) erivatives are boue, for some Q. (c) g is twice ifferetiable, a e a its first two erivatives are boue. () v is ifferetiable, a vf a its first erivative are boue, where v(x) = E[y x]. (e) lim x [f (x)+ e(x) ] = 0, where is the Eucliea orm. Assumptio 1 a itegratio by parts lea to θ = E[y f (x)/ x], which i tur motivates the aalogue estimator of Powell, Stock, a Stoker (1989) give by ˆθ = 1 ˆf,i (x) = 1 1 i=1 ], y i x ˆf,i (x i ), h j=1,j i ( 1 xj x K where ˆf,i ( ) is a leave-oe-out kerel esity estimator for some kerel fuctio K : R R a some positive (bawith) sequece h. Typical regularity coitios impose o h ),

3 107 Joural of the America Statistical Associatio, September 010 Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 the kerel-base oparametric estimator are give i the followig assumptio. Assumptio. (a) K is eve a ifferetiable, a K a its first erivative are boue. (b) K(u) R K(u) u is positive efiite, where K(u) = K(u)/ u. (c) For some P, R [ K(u) (1 + u P ) + K(u) (1 + u )] u <, a for (l 1,...,l ) Z +, R u l 1 1 u l K(u) u = { 1, if l1 + +l = 0 0, if 0 < l 1 + +l < P. Powell, Stock, a Stoker (1989) showe that, uer appropriate restrictios o the bawith sequece a kerel fuctio, the estimator ˆθ is asymptotically liear with ifluece fuctio give by L(z) = [ e(x)/ x y f (x)/ x θ]. Thus, the asymptotic variace of this estimator is give by = E[L(z)L(z) ]. Moreover, although ot covere by the results i Newey a Stoker (1993), it is possible to show that L(z) is the efficiet ifluece fuctio for θ, a hece is the semiparametric efficiecy bou for this estima. The followig result escribes the exact coitios a summarizes the mai coclusio. (Limits are take as uless otherwise ote.) Result 1 (Powell, Stock, a Stoker 1989). If Assumptios 1 a hol, a if h mi(p,q) 0 a h +, the (ˆθ θ) = 1 L(z i ) + o p (1) N (0, ). i=1 Result 1 follows from otig that the estimator ˆθ amits a -varyig U-statistic represetatio give by ( ) 1 1 ˆθ = U(z i, z j ; h ), ( ) U(z i, z j ; h) = h (+1) xi x j K (y i y j ), h which leas to the Hoeffig ecompositio ˆθ = θ + L + W, where θ = E[U(z i, z j ; h )], L = 1 L(z i ; h ), ( ) 1 1 W = i=1 W(z i, z j ; h ), with L(z i ; h) = [E[U(z i, z j ; h) z i ] E[U(z i, z j ; h)]] a W(z i, z j ; h) = U(z i, z j ; h) (L(z i ; h) + L(z j ; h))/ E[U(z i, z j ; h)]. This ecompositio shows that the estimator amits a biliear form represetatio i geeral, which clearly justifies the coitios impose o the bawith sequece a the kerel fuctio: (i) coitio h mi(p,q) 0 esures that the bias of the estimator is asymptotically egligible because θ θ = O(h mi(p,q) ), a (ii) coitio h + esures that the quaratic term of the Hoeffig ecompositio is also asymptotically egligible because W = O p ( 1 h (+)/ ). Uer the same coitios, Powell, Stock, a Stoker (1989) also evelop a simple cosistet estimator for, which is give by the aalogue estimator ˆ = 1 ˆL,i ˆL,i, i=1 [ 1 ˆL,i = 1 j=1,j i U(z i, z j ; h ) ˆθ ]. Cosequetly, uer the coitios impose i Result 1,itis straightforwar to form a stuetize versio of ˆθ, leaig to a asymptotically pivotal test statistic give by ˆ 1/ (ˆθ θ) N (0, I ), with ˆ p. This test statistic may be use i the usual way to costruct a cofiece iterval for θ (or, equivaletly, to carry out the correspoig ual hypothesis test). As iscusse i Newey (1994), asymptotic liearity of a semiparametric estimator has several istict features that may be cosiere attractive from a theoretical poit of view. I particular, asymptotic liearity is a ecessary coitio for semiparametric efficiecy a leas to a limitig istributio of the statistic of iterest that is ivariat to the choice of the oparametric estimator use i the costructio of the semiparametric proceure. I other wors, regarless of the particular choice of prelimiary oparametric estimator, the limitig istributio will ot epe o the oparametric estimator wheever the semiparametric estimator amits a asymptotic liear represetatio. However, achievig a asymptotic liear represetatio of a semiparametric estimator imposes several strog moel assumptios a leas to a large sample theory that may ot accurately represet the fiite sample behavior of the estimator. I the case of ˆθ, asymptotic liearity woul require P > uless = 1, which i tur requires strog smoothess coitios (Q P). Cosequetly, classical asymptotic theory will require the use of a higher-orer kerel wheever more tha oe covariate is iclue. I aitio, classical asymptotic theory (wheever vali) leas to a limitig experimet which is ivariat to the particular choices of smoothig (K) a tuig (h ) parameters ivolve i the costructio of the estimator, a therefore it is ulikely to be able to aapt to chages i these parameters. I other wors, iferece base o classical asymptotic theory is silet with respect to the impact that these parameters may have o the fiite sample behavior of ˆθ. I a attempt to better characterize the fiite sample behavior of ˆθ, Cattaeo, Crump, a Jasso (009) show that it is possible to icrease the robustess of this estimator by cosierig a ifferet asymptotic experimet. I particular, istea of forcig asymptotic liearity of the estimator, the authors evelop a alterative first-orer asymptotic theory that accommoates weaker assumptios tha those impose i the classical firstorer asymptotic theory iscusse above. Ituitively, the iea is to characterize the (joit) asymptotic behavior of both the liear ( L ) a quaratic ( W ) terms. The followig result collects the mai fiigs. Result (Cattaeo, Crump, a Jasso 009). If Assumptios 1 a hol, a if mi(h +, 1)h mi(p,q) 0 a

4 Cattaeo, Crump, a Jasso: Robust Data-Drive Iferece for Average Derivatives 1073 Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 h, the where (V[ˆθ ]) 1/ (ˆθ θ) N (0, I ), V[ˆθ ]= 1 [ + o(1)]+ ( ) 1 h (+) [ + o(1)], with = E[σ (x)f (x)] K(u) R K(u) u. I aitio, 1 ˆ = 1 ( ) 1 [ + o p(1)]+ h (+) [ + o p (1)]. Result shows that the coitios o the bawith sequece may be cosierably weakee without ivaliatig the limitig Gaussia istributio. I particular, wheever h is chose so that h + is boue, the limitig istributio will cease to be ivariat with respect to the uerlyig prelimiary oparametric estimator because ˆθ is o loger asymptotically liear. I particular, ote that h + κ>0retais the root cosistecy of ˆθ. I aitio, because h is allowe to be smaller tha usual, the bias of the estimator is cotrolle i a ifferet way, removig the ee for higher-orer kerels. I particular, Result remais vali eve i cases whe the estimator is ot cosistet. Fially, this result also highlights the well-kow trae-off betwee robustess a efficiecy i the cotext of semiparametric estimatio. I particular, the estimator ˆθ is semiparametric efficiet if a oly if h +, while it is possible to costruct more robust iferece proceures uer cosierably weaker coitios. It follows from Result that the feasible classical testig proceure base o ˆ 1/ (ˆθ θ) will be ivali uless h +, which correspos to the classical large sample theory case (Result 1). To solve this problem, Cattaeo, Crump, a Jasso (009) propose two alterative correctios to the staar error matrix ˆ, leaig to two optios for robust staar errors. To costruct the first robust staar error formula, the authors itrouce a simple cosistet estimator for, uer the same coitios of Result, which is give by the aalogue estimator ( ) 1 ˆ = h + 1 Ŵ,ij Ŵ,ij, Ŵ,ij = U(z i, z j ; h ) 1 ( ˆL,i + ˆL,j ) ˆθ. Thus, usig this estimator, ˆV 1, = 1 ( ) 1 ˆ h (+) yiels a cosistet staar error estimate uer small bawith asymptotics (i.e., uer the weaker coitios impose i Result, which iclue i particular those impose i Result 1). To escribe the seco robust staar error formula, let ˆ (H ) be the estimator ˆ costructe usig a bawith sequece H [e.g., ˆ = ˆ (h ) by efiitio]. The, uer the same coitios of Result, ˆV, = 1 ˆ ( 1/(+) ) h ˆ also yiels a cosistet staar error estimate uer small bawith asymptotics. Cosequetly, uer the coitios impose i Result, it is straightforwar to form a stuetize versio of ˆθ, leaig to two simple, robust a pivotal test statistics of the form ˆV 1/ k, (ˆθ θ) N (0, I ), with ˆV 1 k, V[ˆθ ] p I, k = 1,. These test statistics may also be use to costruct (asymptotically equivalet) cofiece itervals for θ uer the (weaker) coitios impose i Result, a costitute alterative proceures to the classical cofiece iterval itrouce above. These results, however, have the obvious rawback of beig epeet o the choice of h, which is urestricte beyo the rate restrictios impose i Result. A prelimiary Mote Carlo experimet reporte i Cattaeo, Crump, a Jasso (009) shows that the ew, robust staar error formulas have the potetial to eliver goo fiite sample behavior if the iitial bawith is chose to be small eough. Ufortuately, the plug-i rules available i the literature for h fail to eliver a choice of bawith that woul ejoy the robustess property itrouce by the ew asymptotic theory escribe i Result. This is ot too surprisig, sice these bawith selectors are typically costructe to balace (higher-orer) bias a variace i a way that is appropriate for the classical large sample theory. 3. MSE EXPANSION AND OPTIMAL BANDWIDTH SELECTORS This paper cosiers the mea square error expasio of ˆθ as the startig poit for the costructio of the plug-i optimal bawith selector. To erive this expasio it is ecessary to stregthe the assumptios cocerig the atageeratig process. The followig assumptio escribes these aitioal mil sufficiet coitios. Assumptio 3. (a) E[ g(x)/ x f (x)] <. (b) g is (Q + 1) times ifferetiable, a e a its first (Q + 1) erivatives are boue. (c) v is three times ifferetiable, a vf a its first three erivatives are boue. () lim x [σ(x)f (x) + σ(x)/ x f (x)]=0. Assumptio 3(a) is use to esure that the higher-orer mea square expasio is vali up to the orer eee i this paper. Assumptios 3(b) a 3(c) are i agreemet with those impose i Powell a Stoker (1996) a Nishiyama a Robiso (000, 005), while Assumptio 3() is slightly stroger tha the aalogue restrictio impose i those papers. Theorem 1. If Assumptios 1,, a 3 hol, the for s = mi(p, Q) a ḟ(x) = f (x)/ x, E[(ˆθ θ)(ˆθ θ) ] = 1 ( ) 1 ( ) 1 + h (+) + h V + h s BB + O( 1 h s ) + o( h + h s ),

5 1074 Joural of the America Statistical Associatio, September 010 Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 where B = ( 1)s s! 0 l 1,...,l s l 1 + +l =s [ ] u l 1 1 u l K(u) u R [( (l 1 + +l ) ) ] E x l 1 1 x l ḟ(x) g(x) a ( [ V = K(u) K(u) u E σ (x) R x x f (x) ( )( ) ) + x g(x) x g(x) f (x)] u u. The result i Theorem 1 is similar to the oe obtaie by Härle a Tsybakov (1993) a Powell a Stoker (1996), the key ifferece beig that the aitioal term of orer O( h ) is explicitly retaie here. (Recall that Result requires h.) To motivate the ew optimal bawith selector, recall that the robust variace matrix i Result is give by the first two terms of the mea square error expasio presete i Theorem 1, which suggests cosierig the ext two terms of the expasio to costruct a optimal bawith selector. (Note that, as it is commo i the literature, this approach implicitly assumes that both B a V are ozero.) Ituitively, balacig these terms correspos to the case of h + κ<, a therefore pushes the selecte bawith to the small bawith regio. This approach may be cosiere optimal i a mea square error sese because it makes the leaig terms igore i the geeral large sample approximatio presete i Result as small as possible. To escribe the ew bawith selector, let λ R a cosier (for simplicity) a bawith that miimizes the ext two terms of E[(λ (ˆθ θ)) ]. This optimal bawith selector is give by ( (λ ) Vλ) 1/(s+) h CCJ = s(λ B), if λ Vλ > 0 ( λ ) Vλ 1/(s+) (λ B), if λ Vλ < 0. This ew theoretical bawith selector is cosistet with the small bawith asymptotics escribe i Result because (h CCJ ). I aitio, observe that 1 h s = o( h ) wheever h s+ 0, which is satisfie whe h = h CCJ. This ew bawith selector may be compare to the two competig plug-i bawith selectors available i the literature, propose by Powell a Stoker (1996) a Nishiyama a Robiso (005), a give by ( ( + )(λ h ) PS = λ) 1/(s++) s(λ B) a ( (λ h ) NR = λ) 1/(s++) (λ B), respectively. Ispectio of these bawith selectors shows that h CCJ h PS h NR, leaig to a bawith selectio of smaller orer. [Nishiyama a Robiso (000) erive a thir alterative bawith selector which is ot explicitly iscusse here because this proceure is targete to oe-sie hypothesis testig. Noetheless, ispectio of this alterative bawith selectio proceure, eote h NR00, shows that h CCJ h NR00 wheever + 8 > s. Therefore, h CCJ is of smaller orer uless strog smoothess assumptios are impose i the moel a a correspoig higher-orer kerel is employe.] 4. DATA DRIVEN BANDWIDTH SELECTORS The previous sectio escribe a ew (ifeasible) plug-i bawith selector that is compatible with the small bawith asymptotic theory itrouce i Result. I orer to implemet this selector i practice, as well as its competitors h PS a h NR, it is ecessary to costruct cosistet estimates for each of the leaig costats. These estimates woul lea to a atarive (i.e., automatic) bawith selector, eote ĥ CCJ.This sectio itrouces easy to implemet, cosistet oparametric estimators for B,, a V. (Alteratively, a straightforwar bawith selector may be costructe usig a rule-of-thumb estimator base o some a hoc istributioal assumptios.) To escribe the ata-rive plug-i bawith selectors, let b be a prelimiary positive bawith sequece, which may be ifferet for each estimator. A simple aalog estimator of was itrouce i Sectio. I particular, let ˆ (b ) be the estimator ˆ costructe usig a bawith sequece b [e.g., ˆ = ˆ (h ) by efiitio]. Note that this estimator is a -varyig U-statistic as well. Theorem 1 a the calculatios provie i Cattaeo, Crump, a Jasso (009) show that, if Assumptios 1,, a 3 hol, the ˆ (b ) = + b V + O p( b 3 + 1/ + 1 b / which gives the cosistecy of this estimator if b 0 a b. Next, cosier the costructio of cosistet estimators of B a V, the two parameters eterig the ew bawith selector h CCJ. To this e, let k be a kerel fuctio, which may be ifferet for each estimator, a may be ifferet from K. The followig assumptio collects a set of sufficiet coitios to establish cosistecy of the plug-i estimators propose i this paper for B a V. Assumptio 4. (a) f, v, a e are (s S) times ifferetiable, a f, vf, e, a their first (s S) erivatives are boue, for some S 1. (b) k is eve a M times ifferetiable, a k a its first M erivatives are boue, for some M 0. (c) For some R, R k(u) (1 + u R ) u <, a for (l 1,...,l ) Z +, R u l 1 1 u l k(u) u = ), { 1, if l1 + +l = 0 0, if 0 < l 1 + +l < R. For the bias B, a plug-i estimator is give by ˆB = ( 1)s [ s! 0 l 1,...,l s l 1 + +l =s R u l 1 1 u l K(u) u ] ˆϑ l1,...,l,,

6 Cattaeo, Crump, a Jasso: Robust Data-Drive Iferece for Average Derivatives 1075 Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 where ˆϑ l1,...,l, = 1 ( 1) i=1 j=1,j i b (+1) ( (l 1 + +l ) k(x) x l 1 1 x l )y i, x=(xi x j )/b with k(x) = k(x)/ x. The estimator ˆϑ l1,...,l, is the sample aalog estimator of the estima E[( (l 1+ +l ) ḟ(x)/ x l 1 1 x l )y], a is also a -varyig U-statistic estimator employig a leave-oe-out kerel-base esity estimator. It is also possible to form a obvious plug-i estimator for the ew higher-orer term V. However, this estimator woul have the uappealig property of requirig the estimatio of several oparametric objects (σ (x), f (x)/ x x, g(x)/ x, f (x)). Moreover, this irect plug-i approach is likely to be less stable whe implemete because it woul require halig stochastic eomiators. Fortuately, it is possible to costruct a alterative, iirect estimator much easier to implemet i practice. This estimator is ituitively justifie as follows: the results presete above show that, uer appropriate regularity coitios, b ( ˆ (b ) ) = V +O p (b + 1/ b + 1 b / ), a therefore a estimator satisfyig = + o p (b ) woul lea to ˆV = b ( ˆ (b ) ) = V + o p (1), if b 0, b 4 0, a b Uer appropriate coitios, a estimator havig these properties is give by = ˆδ R K(u) K(u) u, ( ) 1 1 ˆδ = ( ) b k xj x i (y i y j ). b I this case, ˆδ is a sample aalog estimator of the estima E[σ (x)f (x)], which is also a -varyig U-statistic estimator employig a leave-oe-out kerel-base esity estimator. Theorem. If Assumptios 1, 3, a 4 hol, the: (i) For M s + 1, [( (l 1 + +l ) ) ] ˆϑ l1,...,l, = E x l 1 1 x l ḟ(x) y (ii) For R 3, + O p ( b mi(r,s) ˆδ = E[σ (x)f (x)]+o p ( b mi(r,s+1+s) + 1/ + 1 b (++s)/ ). + 1/ + 1 b / ). This theorem gives simple sufficiet coitios to costruct a robust ata-rive bawith selector cosistet with the small bawith asymptotics erive i Cattaeo, Crump, a Jasso (009). I particular, efie ( (λ ) ˆV λ) 1/(s+) s(λ ĥ CCJ =, if λ ˆV λ > 0 ˆB ) ( λ ) ˆV λ 1/(s+) (λ, if λ ˆV λ < 0. ˆB ) The followig corollary establishes the cosistecy of the ew bawith selector ĥ CCJ. Corollary 1. If Assumptios 1,, 3, a 4 hol with M s + 1 a R 3, a if b 0 a b max(8,++s), the for λ R such that λ B 0 a λ Vλ 0, ĥ CCJ h CCJ p 1. (The aalogous result also hols for ĥ PS a ĥ NR.) The results presete so far are silet about the selectio of the iitial bawith choice b i applicatios, beyo the rate restrictios impose by Corollary 1. A simple choice for the prelimiary bawith b may be base o some atarive bawith selector evelope for a oparametric object preset i the correspoig target estimas B, a V. Typical examples of such proceures iclue simple rule-of-thumbs, plug-i bawith selectors, a (smoothe) cross-valiatio. As show i the simulatios presete i the ext sectio, it appears that a simple ata-rive bawith selector from the literature of oparametric estimatio works well for the choice of b. Noetheless, it may be esirable to improve upo this prelimiary bawith selector i orer to obtai better fiite sample behavior. Although beyo the scope of this paper, a coceptually feasible (but computatioally emaig) iea woul be to compute seco-orer mea square error expasios for ˆϑ l1,...,l,, ˆ a ˆδ. Sice these three estimators are -varyig U-statistics, the results from Powell a Stoker (1996) may be applie to obtai a correspoig set of optimal bawith choices. These proceures will, i tur, also epe o a prelimiary bawith whe implemete empirically, which agai woul ee to be chose i some way. This iea mimics, i the cotext of semiparametric estimatio, the well-kow seco-geeratio irect plug-i bawith selector (of level ) from the literature of oparametric esity estimatio. (See, e.g., Wa a Joes 1995 for a etaile iscussio.) Although the valiity of such bawith selectors woul require stroger assumptios, by aalogy from the oparametric esity estimatio literature, they woul be expecte to improve the fiite sample properties of the bawith selector for h a, i tur, the performace of the semiparametric iferece proceure. 5. MONTE CARLO EXPERIMENT This sectio summarizes the mai fiigs from a extesive Mote Carlo experimet coucte to aalyze the fiite sample properties of the ew robust ata-rive proceures a their relative merits whe compare to the other proceures available. The olie supplemetal material iclues a larger set of results from this simulatio stuy, which shows that the fiigs reporte here are cosistet across all esigs cosiere. Followig the results reporte i Cattaeo, Crump, a Jasso (009), the Mote Carlo experimet cosiers six ifferet moels of the sigle iex form y i = τ(y i ), where y i = x i β + ε i, τ( ) is a oecreasig (lik) fuctio a ε i N (0, 1) is iepeet of the vector of regressors x i R. Three ifferet lik fuctios are cosiere: τ(y ) = y, τ(y ) = 1(y > 0), a τ(y ) = y 1(y > 0), which correspo to a liear regressio, probit, a Tobit moel, respectively. [1( ) represets the

7 1076 Joural of the America Statistical Associatio, September 010 Table 1. Mote Carlo moels y i = y i y i = 1(y i > 0) y i = y i 1(y i > 0) x 1i N (0, 1) Moel 1: θ 1 = 4π 1 Moel 3: θ 1 = 1 8π 3/ Moel 5: θ 1 = 8π 1 x 1i χ 4 4 Moel : θ 8 1 = 1 4 Moel 4: θ π 1 = Moel 6: θ 1 = Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 iicator fuctio.] The vector of regressors is geerate usig iepeet raom variables a staarize to have E[x i ]=0 a E[x i x i ]=I, with the first compoet x 1i havig either a Gaussia istributio or a chi-square istributio with 4 egrees of freeom (eote χ 4 ), while the remaiig compoets have a Gaussia istributio throughout the experimet. All the compoets of β are set equal to uity, a for simplicity oly results for the first compoet θ 1 are cosiere. Table 1 summarizes the Mote Carlo moels, reports the value of the populatio parameter of iterest, a provies the correspoig label of each moel cosiere. (Wheever uavailable i close form, the populatio parameters are compute by a umerical approximatio.) The simulatio stuy cosiers three sample sizes ( = 100, = 400, = 700), two imesios of the regressors vector ( =, = 4), a two kerel orers (P =, P = 4). The kerel fuctio K( ) is chose to be a Gaussia prouct kerel, a the prelimiary kerel fuctio k( ) is chose to be a fourth-orer Gaussia prouct kerel as require by Corollary 1. For each combiatio of parameters 10,000 replicatios are carrie out. To coserve space this sectio oly iclues the results for = a = 400. The simulatio experimet cosiers the three (ifeasible) populatio bawith choices erive i Sectio 3 (h PS, h NR, h CCJ ), a their correspoig ata-rive estimates (ĥ PS, ĥ NR, ĥ CCJ ). The three estimate bawiths are obtaie usig the results escribe i Sectio 4 with a commo iitial bawith plug-i estimate use to costruct ˆB, ˆ a ˆV.To provie a parsimoious ata-rive proceure, a estimate of the iitial bawith b is costructe as a sample average of a seco-geeratio irect plug-i level-two estimate for the (margial) esity of each imesio of the regressors vector (see, e.g., Wa a Joes 1995). Cofiece itervals for θ 1 are costructe usig the classical test statistic ˆ 1/ (ˆθ θ), eote PSS, a the two alterative robust test statistics ˆV 1/ k, (ˆθ θ), k = 1,, eote by CCJ1 a CCJ, respectively. The classical iferece proceure PSS is oly theoretically vali whe P = 4, while the robust proceures CCJ1 a CCJ are always vali across all simulatio esigs. Figures 1 a plot the empirical coverage for the three competig 95% cofiece itervals as a fuctio of the choice of bawith for each of the six moels. To facilitate the aalysis two aitioal horizotal lies at 0.90 a at the omial coverage rate 0.95 are iclue for referece, a the three populatio bawith selectors (h PS, h NR, h CCJ ) are plotte as vertical lies. (Note that h PS = h NR for the case = a P =.) These figures highlight the potetial robustess properties that the test statistics CCJ1 a CCJ may have whe usig the ew ata-rive plug-i bawith selector. I particular, the theoretical bawith selector h CCJ lays withi the robust regio for which both CCJ1 a CCJ have correct empirical coverage for a rage of bawiths. For example, this suggests that (at least) some of the variability itrouce by the estimatio of this bawith selector will ot affect the performace of the robust test statistics CCJ1 a CCJ, a property ulikely to hol for the classical proceure PSS. Table reports the empirical coverage of each possible cofiece iterval (PSS, CCJ1, CCJ) whe usig each possible populatio bawith selector (h PS, h NR, h CCJ ). Figures 3 a 4 plot correspoig kerel esity estimates for the test statistic PSS couple with either h PS a h NR, a for the test statistics CCJ1 a CCJ couple with h CCJ.Tofacilitate the compariso the esity of the staar ormal is also epicte. These figures show that the Gaussia approximatio of the robust test statistics usig the ew bawith selector is cosierably better tha the correspoig approximatio for PSS whe costructe usig either of the classical bawith selectors. I particular, the empirical istributio of the classical proceure appears to be more biase a more cocetrate tha the empirical istributios of either CCJ1 or CCJ. These fiigs highlight the well-kow trae-off betwee efficiecy a robustess previously iscusse. These results are verifie i Table 3, where the average empirical bias a average empirical iterval legth are reporte for each competig cofiece iterval whe couple with each possible populatio bawith selector. To aalyze the performace of the ew ata-rive bawith selector, a the resultig robust ata-rive cofiece itervals, Table 4 presets the empirical coverage of each possible cofiece iterval (PSS, CCJ1, CCJ) whe usig each possible estimate bawith selector (ĥ PS, ĥ NR, ĥ CCJ ). These tables provie cocrete eviece of the superior performace (i terms of achievig correct coverage) of the robust test statistics whe couple with the ew estimate bawith. Both robust cofiece itervals (CCJ1, CCJ) usig ĥ CCJ provie close-to-correct empirical coverage across all esigs, a property ot ejoye by the classical cofiece iterval (PSS) usig either ĥ PS or ĥ NR. The goo performace of CCJ1 a CCJ is maitaie ot oly whe usig a seco-orer kerel (P = ), but also whe the imesio of x is larger ( = 4), which provies simulatio eviece of the relatively low sesitivity of the ew robust ata-rive proceures to the so-calle curse of imesioality. This fiig may be (heuristically) justifie by the fact that uer the small bawith asymptotics, the limitig istributio is ot ivariat to the parameter, which i tur may lea to the aitioal robustess properties fou. I aitio, as suggeste by the superior istributioal approximatio reporte i Figures 3 a 4, the mai fiigs cotiue to hol if other omial cofiece levels are cosiere. 6. EXTENSIONS AND FINAL REMARKS This paper itrouce a ovel ata-rive plug-i bawith selector compatible with the small bawith asymptotics evelope i Cattaeo, Crump, a Jasso (009) for esity-

8 Cattaeo, Crump, a Jasso: Robust Data-Drive Iferece for Average Derivatives 1077 Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 Figure 1. Empirical coverage rates for 95% cofiece itervals: =, P =, = 400. The olie versio of this figure is i color.

9 1078 Joural of the America Statistical Associatio, September 010 Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 Figure. Empirical coverage rates for 95% cofiece itervals: =, P = 4, = 400. The olie versio of this figure is i color.

10 Cattaeo, Crump, a Jasso: Robust Data-Drive Iferece for Average Derivatives 1079 Table. Empirical coverage rates of 95% cofiece itervals with populatio bawith: =, = 400 BW PSS CCJ1 CCJ BW PSS CCJ1 CCJ BW PSS CCJ1 CCJ Moel 1 Moel 3 Moel 5 P = h PS h NR h CCJ P = 4 h PS h NR h CCJ Moel Moel 4 Moel 6 P = h PS h NR h CCJ P = 4 h PS h NR h CCJ Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 NOTE: Colum BW reports populatio bawiths. weighte average erivatives. This ew bawith selector is of the plug-i variety, a is obtaie base o a mea square error expasio of the estimator of iterest. A extesive Mote Carlo experimet showe a remarkable improvemet i performace of the resultig ew robust ata-rive iferece proceure. I particular, the ew cofiece itervals provie approximately correct coverage i cases where there are o vali alterative iferece proceures (i.e., usig a seco-orer kerel with at least two regressors), a also compares favorably to the alterative, classical cofiece itervals whe they are theoretically justifie. Sice these results are erive by exploitig the -varyig U- statistic represetatio of ˆθ, it is plausible that similar results coul be obtaie for other estimators havig a aalogous represetatio. For example, the class of estimas cosiere i Newey, Hsieh, a Robis (004, sectio ) have this represetatio, a therefore it seems possible that the results presete here coul be geeralize to cover that class. More geerally, as suggeste i Cattaeo, Crump, a Jasso (009), a - varyig U-statistic may be represete as a miimizer of the U-process: ˆθ = arg mi θ ( ) 1 1 Q(z i, z j ; θ, h) = U(z i, z j, h) θ, Q(z i, z j ; θ, h ), which also suggests that the results presete here may be extee to cover this class of estimators (see, e.g., Araillas- Lopéz, Hooré, a Powell 007, pp ). APPENDIX Proof of Theorem 1 To save otatio, for ay fuctio a : R R let ȧ(x) = a(x)/ x a ä(x) = a(x)/ x x. A Hoeffig ecompositio of ˆθ gives E[(ˆθ θ)( ˆθ θ) ]=V[ ˆθ ]+(E[ˆθ ] θ)(e[ˆθ ] θ) = V[ L ]+V[ W ]+h s BB + o(h s ), where the bias expasio follows immeiately by a Taylor series expasio. For V[ L ], usig itegratio by parts, E[U (z i, z j ) z i ] = ė(x R i + uh )K(u) u y i ḟ(x i + uh )K(u) u, R a therefore V[ L ]=4 1 V[E[U (z i, z j ) z i ] θ ]= 1 + O( 1 h s ). For V[ W ], by staar calculatios, ( ) 1 V[ W ]= E[U (z i, z j )U (z i, z j ) ]+O( ) ( ) 1 = h (+) K(u) K(u) T(x, uh ) x u + O( ), R with T(x, u) = (v(x) + v(x + u) g(x)g(x + u))f (x)f (x + u). The, usig a Taylor series expasio, T(x, uh ) = T 1 (x) + T (x) uh + u T 3 (x)uh + o(h ),wheret 1(x) = σ (x)f (x), T (x) = σ (x) f (x)ḟ(x) + f (x) σ (x),at 3 (x) = σ (x)f (x) f(x) + f (x) σ (x)ḟ(x) + ( v(x)/ g(x) g(x))f (x). Note that R R K(u) K(u) T 1 (x) x u = R R K(u) K(u) σ (x)f (x) x u = a, usig itegratio by parts, h K(u) K(u) (T (x) u) x u R R = h K(u) K(u) R [( ) [σ (x)f (x)ḟ(x) + f (x) σ (x)] x u] u R = 0. Fially, usig itegratio by parts a the fact that σ (x) = v(x) ġ(x)ġ(x) g(x) g(x), h K(u) K(u) (u T 3 (x)u) x u R = h K(u) K(u) R ( ) ] [u σ (x) f(x)f (x) x + ġ(x)ġ(x) f (x) x u u. R R Therefore, V[ W ]= ( ) 1h (+) + ( ) 1h V + o( h ).

11 1080 Joural of the America Statistical Associatio, September 010 Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 Figure 3. Empirical Gaussia approximatio with populatio bawith: =, P =, = 400. The olie versio of this figure is i color.

12 Cattaeo, Crump, a Jasso: Robust Data-Drive Iferece for Average Derivatives 1081 Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 Figure 4. Empirical Gaussia approximatio with populatio bawith: =, P = 4, = 400. The olie versio of this figure is i color.

13 108 Joural of the America Statistical Associatio, September 010 Table 3. Empirical average legth of 95% cofiece itervals with populatio bawith: =, = 400 BIAS PSS CCJ1 CCJ BIAS PSS CCJ1 CCJ BIAS PSS CCJ1 CCJ Moel 1 Moel 3 Moel 5 P = h PS h NR h CCJ P = 4 h PS h NR h CCJ Moel Moel 4 Moel 6 P = h PS h NR h CCJ P = 4 h PS h NR h CCJ Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 NOTE: Colum BIAS reports absolute ifferece betwee average of ˆθ (across simulatios) a θ 0. All figures times 100. Proof of Theorem For part (i), ote that ˆϑ l1,...,l, may be writte as a -varyig U- statistic (assumig without loss of geerality that s is eve), give by ( ) 1 1 ˆϑ l1,...,l, = u 1 (z i, z j ; b ), with (recall that s = l 1 + +l ) ( u 1 (z i, z j ; b) = b (+1+s) s ) k(x) x l 1 1 x l (y i y j ). x=(xi x j )/b First, chage of variables a itegratio by parts give ( E[u 1 (z i, z j ; b ) z i ]= k(u) s R x l 1 1 x l ḟ(x) y i x=xi ub s ) x l 1 1 x l ė(x) u. x=xi ub Seco, a Taylor series expasio gives E[u 1 (z i, z j ; b )]= ϑ l1,...,l + O(b mi(r,s) ). Next, lettig ˆϑ = ˆϑ l1,...,l, to save otatio, a Hoeffig ecompositio gives V[ ˆϑ ]=V[ ˆϑ 1, ]+V[ ˆϑ, ], where ˆϑ 1, = 1 [ E[u 1 (z i, z j ; b ) z i ] E[u 1 (z i, z j ; b )] ], i=1 a ( ) 1 1 [ ˆϑ, = u1 (z i, z j ; b ) E[u 1 (z i, z j ; b ) z i ] E[u 1 (z i, z j ; b ) z j ]+E[u 1 (z i, z j ; b )] ]. Fially, usig staar calculatios, V[ ˆϑ 1, ]=O( 1 ) a V[ ˆϑ, ]=O( b (++s) ), a the coclusio follows by Markov s Iequality. Table 4. Empirical coverage rates of 95% cofiece itervals with estimate bawith: =, = 400 BW PSS CCJ1 CCJ BW PSS CCJ1 CCJ BW PSS CCJ1 CCJ Moel 1 Moel 3 Moel 5 P = ĥ PS ĥ NR ĥ CCJ P = 4 ĥ PS ĥ NR ĥ CCJ Moel Moel 4 Moel 6 P = ĥ PS ĥ NR ĥ CCJ P = 4 ĥ PS ĥ NR ĥ CCJ NOTE: Colum BW reports sample mea of estimate bawiths.

14 Cattaeo, Crump, a Jasso: Robust Data-Drive Iferece for Average Derivatives 1083 Dowloae by [Uiversity of Michiga] at 08:39 15 Jauary 016 For part (ii), ote that ˆδ is also a -varyig U-statistic, give by ( ) 1 1 ˆδ = u (z i, z j ; b ), ( ) u (z i, z j ; b) = b xj x i k (y i y j ). b First, chage of variables gives E[u (z i, z j ; b ) z i ]= k(u)( y R i f (x i ub ) + v(x i ub )f (x i ub ) y i e(x i ub ) ) u. Seco, a Taylor s expasio gives E[ˆδ ]=E[σ (x)f (x)] + O(b mi(r,s+1+s) ). Next, a Hoeffig ecompositio gives V[ˆδ ]= V[ˆδ 1, ]+V[ˆδ, ],where a ˆδ, = ˆδ 1, = 1 [ E[u (z i, z j ; b ) z i ] E[u (z i, z j ; b )] ], i=1 ( ) 1 1 [ u (z i, z j ; b ) E[u (z i, z j ; b ) z i ] E[u (z i, z j ; b ) z j ]+E[u (z i, z j ; b )] ]. Fially, usig staar calculatios, V[ˆδ 1, ] = O( 1 ) a V[ˆδ, ]=O( b ), a the coclusio follows by Markov s Iequality. SUPPLEMENTAL MATERIALS Further Simulatio Results: This ocumet cotais a comprehesive set of results from the Mote Carlo experimet summarize i Sectio 5. These results iclue all combiatios of sample sizes ( = 100, = 400, = 700), imesio of regressors vector ( =, = 4), a kerel orers (P =, P = 4). (06_SmallBawithMSE_6Mar010- -Supplemetal.pf) [Receive October 009. Revise February 010.] REFERENCES Araillas-Lopéz, A., Hooré, B. E., a Powell, J. L. (007), Pairwise Differece Estimatio With Noparametric Cotrol Variables, Iteratioal Ecoomic Review, 48, [1079] Cattaeo, M. D., Crump, R. K., a Jasso, M. (009), Small Bawith Asymptotics for Desity-Weighte Average Derivatives, workig paper, UC Berkeley a Uiversity of Michiga. [ ,1079] (010), Bootstrappig Desity-Weighte Average Derivatives, workig paper, UC Berkeley a Uiversity of Michiga. [1071] Coppejas, M., a Sieg, H. (005), Kerel Estimatio of Average Derivatives a Differeces, Joural of Busiess & Ecoomic Statistics, 3, [1070] Deato, A., a Ng, S. (1998), Parametric a Noparametric Approaches to Price a Tax Reform, Joural of the America Statistical Associatio,93, [1070] Härle, W., a Stoker, T. (1989), Ivestigatig Smooth Multiple Regressio by the Metho of Average Derivatives, Joural of the America Statistical Associatio, 84, [1071] Härle, W., a Tsybakov, A. (1993), How Sesitive Are Average Derivatives? Joural of Ecoometrics, 58, [1071,1074] Härle, W., Hart, J., Marro, J., a Tsybakov, A. (199), Bawith Choice for Average Derivative Estimatio, Joural of the America Statistical Associatio, 87, [1071] Härle, W., Hilebra, W., a Jeriso, M. (1991), Empirical Eviece o the Law of Dema, Ecoometrica, 59, [1070] Horowitz, J., a W. Härle (1996), Direct Semiparametric Estimatio of Sigle-Iex Moels With Discrete Covariates, Joural of the America Statistical Associatio, 91, [1071] Ichimura, H., a To, P. E. (007), Implemetig Noparametric a Semiparametric Estimators, i Habook of Ecoometrics, Vol. 6B, es. J. Heckma a E. Leamer, New York: Elsevier, pp [1071] Matzki, R. L. (007), Noparametric Ietificatio, i Habook of Ecoometrics, Vol. 6B, es. J. Heckma a E. Leamer, New York: Elsevier, pp [1070] Newey, W. K. (1994), The Asymptotic Variace of Semiparametric Estimators, Ecoometrica, 6, [107] Newey, W. K., a Stoker, T. M. (1993), Efficiecy of Weighte Average Derivative Estimators a Iex Moels, Ecoometrica, 61, [1071,107] Newey, W. K., Hsieh, F., a Robis, J. M. (004), Twicig Kerels a a Small Bias Property of Semiparametric Estimators, Ecoometrica, 7, [1071,1079] Nishiyama, Y., a Robiso, P. M. (000), Egeworth Expasios for Semiparametric Average Derivatives, Ecoometrica, 68, [1071, 1073,1074] (005), The Bootstrap a the Egeworth Correctio for Semiparametric Average Derivatives, Ecoometrica, 73, [1071,1073, 1074] Powell, J. L. (1994), Estimatio of Semiparametric Moels, i Habook of Ecoometrics, Vol. 6, es. R. Egle a D. McFae, New York: Elsevier, pp [1070] Powell, J. L., a Stoker, T. M. (1996), Optimal Bawith Choice for Desity-Weighte Averages, Joural of Ecoometrics, 75, [1071, ] Powell, J. L., Stock, J. H., a Stoker, T. M. (1989), Semiparametric Estimatio of Iex Coefficiets, Ecoometrica, 57, [ ] Robiso, P. M. (1995), The Normal Approximatio for Semiparametric Average Derivatives, Ecoometrica, 63, [1071] Stoker, T. M. (1986), Cosistet Estimatio of Scale Coefficiets, Ecoometrica, 54, [1071] Wa, M., a Joes, M. (1995), Kerel Smoothig, Boca Rato, FL: Chapma & Hall/CRC.

Lecture 6 Testing Nonlinear Restrictions 1. The previous lectures prepare us for the tests of nonlinear restrictions of the form:

Lecture 6 Testing Nonlinear Restrictions 1. The previous lectures prepare us for the tests of nonlinear restrictions of the form: Eco 75 Lecture 6 Testig Noliear Restrictios The previous lectures prepare us for the tests of oliear restrictios of the form: H 0 : h( 0 ) = 0 versus H : h( 0 ) 6= 0: () I this lecture, we cosier Wal,

More information

A COMPUTATIONAL STUDY UPON THE BURR 2-DIMENSIONAL DISTRIBUTION

A COMPUTATIONAL STUDY UPON THE BURR 2-DIMENSIONAL DISTRIBUTION TOME VI (year 8), FASCICULE 1, (ISSN 1584 665) A COMPUTATIONAL STUDY UPON THE BURR -DIMENSIONAL DISTRIBUTION MAKSAY Ştefa, BISTRIAN Diaa Alia Uiversity Politehica Timisoara, Faculty of Egieerig Hueoara

More information

k=1 s k (x) (3) and that the corresponding infinite series may also converge; moreover, if it converges, then it defines a function S through its sum

k=1 s k (x) (3) and that the corresponding infinite series may also converge; moreover, if it converges, then it defines a function S through its sum 0. L Hôpital s rule You alreay kow from Lecture 0 that ay sequece {s k } iuces a sequece of fiite sums {S } through S = s k, a that if s k 0 as k the {S } may coverge to the it k= S = s s s 3 s 4 = s k.

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

6.451 Principles of Digital Communication II Wednesday, March 9, 2005 MIT, Spring 2005 Handout #12. Problem Set 5 Solutions

6.451 Principles of Digital Communication II Wednesday, March 9, 2005 MIT, Spring 2005 Handout #12. Problem Set 5 Solutions 6.51 Priciples of Digital Commuicatio II Weesay, March 9, 2005 MIT, Sprig 2005 Haout #12 Problem Set 5 Solutios Problem 5.1 (Eucliea ivisio algorithm). (a) For the set F[x] of polyomials over ay fiel F,

More information

6.3.3 Parameter Estimation

6.3.3 Parameter Estimation 130 CHAPTER 6. ARMA MODELS 6.3.3 Parameter Estimatio I this sectio we will iscuss methos of parameter estimatio for ARMAp,q assumig that the orers p a q are kow. Metho of Momets I this metho we equate

More information

On triangular billiards

On triangular billiards O triagular billiars Abstract We prove a cojecture of Keyo a Smillie cocerig the oexistece of acute ratioal-agle triagles with the lattice property. MSC-iex: 58F99, 11N25 Keywors: Polygoal billiars, Veech

More information

Chapter 2 Transformations and Expectations

Chapter 2 Transformations and Expectations Chapter Trasformatios a Epectatios Chapter Distributios of Fuctios of a Raom Variable Problem: Let be a raom variable with cf F ( ) If we efie ay fuctio of, say g( ) g( ) is also a raom variable whose

More information

Output Analysis and Run-Length Control

Output Analysis and Run-Length Control IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%

More information

SMALL BANDWIDTH ASYMPTOTICS FOR DENSITY-WEIGHTED AVERAGE DERIVATIVES

SMALL BANDWIDTH ASYMPTOTICS FOR DENSITY-WEIGHTED AVERAGE DERIVATIVES Ecoometric Theory, 30, 014, 176 00. doi:10.1017/s066466613000169 SMALL BANDWIDTH ASYMPTOTICS FOR DENSITY-WEIGHTED AVERAGE DERIVATIVES MATIAS D. CATTANEO Uiversity of Michiga RICHARD K. CRUMP Federal Reserve

More information

Small Bandwidth Asymptotics for Density-Weighted Average Derivatives. April 21, 2011

Small Bandwidth Asymptotics for Density-Weighted Average Derivatives. April 21, 2011 Small Badwidth Asymptotics for Desity-Weighted Average Derivatives M D. C D E, U M R K. C F R B N Y M J D E, UC B CREATES April 21, 2011 A. This paper proposes (apparetly) ovel stadard error formulas for

More information

Sparsification using Regular and Weighted. Graphs

Sparsification using Regular and Weighted. Graphs Sparsificatio usig Regular a Weighte 1 Graphs Aly El Gamal ECE Departmet a Cooriate Sciece Laboratory Uiversity of Illiois at Urbaa-Champaig Abstract We review the state of the art results o spectral approximatio

More information

(average number of points per unit length). Note that Equation (9B1) does not depend on the

(average number of points per unit length). Note that Equation (9B1) does not depend on the EE603 Class Notes 9/25/203 Joh Stesby Appeix 9-B: Raom Poisso Poits As iscusse i Chapter, let (t,t 2 ) eote the umber of Poisso raom poits i the iterval (t, t 2 ]. The quatity (t, t 2 ) is a o-egative-iteger-value

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Variance function estimation in multivariate nonparametric regression with fixed design

Variance function estimation in multivariate nonparametric regression with fixed design Joural of Multivariate Aalysis 00 009 6 36 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Variace fuctio estimatio i multivariate oparametric

More information

Lecture #3. Math tools covered today

Lecture #3. Math tools covered today Toay s Program:. Review of previous lecture. QM free particle a particle i a bo. 3. Priciple of spectral ecompositio. 4. Fourth Postulate Math tools covere toay Lecture #3. Lear how to solve separable

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

6.867 Machine learning, lecture 11 (Jaakkola)

6.867 Machine learning, lecture 11 (Jaakkola) 6.867 Machie learig, lecture 11 (Jaakkola) 1 Lecture topics: moel selectio criteria Miimum escriptio legth (MDL) Feature (subset) selectio Moel selectio criteria: Miimum escriptio legth (MDL) The miimum

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Commonly Used Distributions and Parameter Estimation

Commonly Used Distributions and Parameter Estimation Commoly Use Distributios a Parameter stimatio Berli Che Departmet of Computer Sciece & Iformatio gieerig Natioal Taiwa Normal Uiversity Referece:. W. Navii. Statistics for gieerig a Scietists. Chapter

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

Kernel density estimator

Kernel density estimator Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I

More information

Investigating the Significance of a Correlation Coefficient using Jackknife Estimates

Investigating the Significance of a Correlation Coefficient using Jackknife Estimates Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------

More information

The structure of Fourier series

The structure of Fourier series The structure of Fourier series Valery P Dmitriyev Lomoosov Uiversity, Russia Date: February 3, 2011) Fourier series is costructe basig o the iea to moel the elemetary oscillatio 1, +1) by the expoetial

More information

A Note on the Weak Law of Large Numbers for Free Random Variables

A Note on the Weak Law of Large Numbers for Free Random Variables A Note o the Weak Law of Large Numbers for Free Raom Variables Raluca Bala Uiversity of Ottawa George Stoica Uiversity of New Bruswick July 28, 2006 Abstract I this article we prove that if {X k } k are

More information

11/19/ Chapter 10 Overview. Chapter 10: Two-Sample Inference. + The Big Picture : Inference for Mean Difference Dependent Samples

11/19/ Chapter 10 Overview. Chapter 10: Two-Sample Inference. + The Big Picture : Inference for Mean Difference Dependent Samples /9/0 + + Chapter 0 Overview Dicoverig Statitic Eitio Daiel T. Laroe Chapter 0: Two-Sample Iferece 0. Iferece for Mea Differece Depeet Sample 0. Iferece for Two Iepeet Mea 0.3 Iferece for Two Iepeet Proportio

More information

AP Calculus BC Review Chapter 12 (Sequences and Series), Part Two. n n th derivative of f at x = 5 is given by = x = approximates ( 6)

AP Calculus BC Review Chapter 12 (Sequences and Series), Part Two. n n th derivative of f at x = 5 is given by = x = approximates ( 6) AP Calculus BC Review Chapter (Sequeces a Series), Part Two Thigs to Kow a Be Able to Do Uersta the meaig of a power series cetere at either or a arbitrary a Uersta raii a itervals of covergece, a kow

More information

Summary. Recap. Last Lecture. Let W n = W n (X 1,, X n ) = W n (X) be a sequence of estimators for

Summary. Recap. Last Lecture. Let W n = W n (X 1,, X n ) = W n (X) be a sequence of estimators for Last Lecture Biostatistics 602 - Statistical Iferece Lecture 17 Asymptotic Evaluatio of oit Estimators Hyu Mi Kag March 19th, 2013 What is a Bayes Risk? What is the Bayes rule Estimator miimizig square

More information

Title. Author(s)Cho, Yonggeun; Jin, Bum Ja. CitationJournal of Mathematical Analysis and Applications, 3. Issue Date Doc URL.

Title. Author(s)Cho, Yonggeun; Jin, Bum Ja. CitationJournal of Mathematical Analysis and Applications, 3. Issue Date Doc URL. Title Blow-up of viscous heat-couctig compressible flow Author(s)Cho, Yoggeu; Ji, Bum Ja CitatioJoural of Mathematical Aalysis a Applicatios, 3 Issue Date 26-8-15 Doc URL http://hl.hale.et/2115/1442 Type

More information

Exponential function and its derivative revisited

Exponential function and its derivative revisited Expoetial fuctio a its erivative revisite Weg Ki Ho, Foo Him Ho Natioal Istitute of Eucatio, Sigapore {wegki,foohim}.ho@ie.eu.sg Tuo Yeog Lee NUS High School of Math & Sciece hsleety@us.eu.sg February

More information

Inhomogeneous Poisson process

Inhomogeneous Poisson process Chapter 22 Ihomogeeous Poisso process We coclue our stuy of Poisso processes with the case of o-statioary rates. Let us cosier a arrival rate, λ(t), that with time, but oe that is still Markovia. That

More information

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece

More information

Bootstrapping Density-Weighted Average Derivatives. May 17, 2010

Bootstrapping Density-Weighted Average Derivatives. May 17, 2010 Bootstrappig Desity-Weighted Average Derivatives M D. C D E, U M R K. C F R B N Y M J D E, UC B CREATES May 7, 00 A. Employig the small badwidth asymptotic framework of Cattaeo, Crump, ad Jasso (009),

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

A Central Limit Theorem for Local Polynomial Backfitting Estimators

A Central Limit Theorem for Local Polynomial Backfitting Estimators Joural of Multivariate Aalysis 70, 5765 (1999) Article ID mva.1999.1812, available olie at httpwww.iealibrary.com o A Cetral Limit Theorem for Local Polyomial Backfittig Estimators M. P. Wa Harvar School

More information

Small Bandwidth Asymptotics 2

Small Bandwidth Asymptotics 2 Small Badwidth Asymptotics for Desity-Weighted Average Derivatives Matias D. Cattaeo Departmet of Ecoomics, Uiversity of Michiga Richard K. Crump Departmet of Ecoomics, UC Berkeley Michael Jasso Departmet

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

THE DATA-BASED CHOICE OF BANDWIDTH FOR KERNEL QUANTILE ESTIMATOR OF VAR

THE DATA-BASED CHOICE OF BANDWIDTH FOR KERNEL QUANTILE ESTIMATOR OF VAR Iteratioal Joural of Iovative Maagemet, Iformatio & Productio ISME Iteratioal c2013 ISSN 2185-5439 Volume 4, Number 1, Jue 2013 PP. 17-24 THE DATA-BASED CHOICE OF BANDWIDTH FOR KERNEL QUANTILE ESTIMATOR

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

Lecture 33: Bootstrap

Lecture 33: Bootstrap Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece

More information

Study the bias (due to the nite dimensional approximation) and variance of the estimators

Study the bias (due to the nite dimensional approximation) and variance of the estimators 2 Series Methods 2. Geeral Approach A model has parameters (; ) where is ite-dimesioal ad is oparametric. (Sometimes, there is o :) We will focus o regressio. The fuctio is approximated by a series a ite

More information

Confidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation

Confidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation Cofidece Iterval for tadard Deviatio of Normal Distributio with Kow Coefficiets of Variatio uparat Niwitpog Departmet of Applied tatistics, Faculty of Applied ciece Kig Mogkut s Uiversity of Techology

More information

u t + f(u) x = 0, (12.1) f(u) x dx = 0. u(x, t)dx = f(u(a)) f(u(b)).

u t + f(u) x = 0, (12.1) f(u) x dx = 0. u(x, t)dx = f(u(a)) f(u(b)). 12 Fiite Volume Methos Whe solvig a PDE umerically, how o we eal with iscotiuous iitial ata? The Fiite Volume metho has particular stregth i this area. It is commoly use for hyperbolic PDEs whose solutios

More information

Moment closure for biochemical networks

Moment closure for biochemical networks Momet closure for biochemical etworks João Hespaha Departmet of Electrical a Computer Egieerig Uiversity of Califoria, Sata Barbara 9-9 email: hespaha@ece.ucsb.eu Abstract Momet closure is a techique use

More information

FROM SPECIFICATION TO MEASUREMENT: THE BOTTLENECK IN ANALOG INDUSTRIAL TESTING

FROM SPECIFICATION TO MEASUREMENT: THE BOTTLENECK IN ANALOG INDUSTRIAL TESTING FROM SPECIFICATION TO MEASUREMENT: THE BOTTLENECK IN ANALOG INDUSTRIAL TESTING R.J. va Rijsige, A.A.R.M. Haggeburg, C. e Vries Philips Compoets Busiess Uit Cosumer IC Gerstweg 2, 6534 AE Nijmege The Netherlas

More information

Matrix Operators and Functions Thereof

Matrix Operators and Functions Thereof Mathematics Notes Note 97 31 May 27 Matrix Operators a Fuctios Thereof Carl E. Baum Uiversity of New Mexico Departmet of Electrical a Computer Egieerig Albuquerque New Mexico 87131 Abstract This paper

More information

Class 27. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700

Class 27. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700 Marquette Uiversity MATH 700 Class 7 Daiel B. Rowe, Ph.D. Departmet of Mathematics, Statistics, a Computer Sciece Copyright 07 by D.B. Rowe Marquette Uiversity MATH 700 Agea: Recap Chapter 0.-0.3 Lecture

More information

SOME RESULTS RELATED TO DISTRIBUTION FUNCTIONS OF CHI-SQUARE TYPE RANDOM VARIABLES WITH RANDOM DEGREES OF FREEDOM

SOME RESULTS RELATED TO DISTRIBUTION FUNCTIONS OF CHI-SQUARE TYPE RANDOM VARIABLES WITH RANDOM DEGREES OF FREEDOM Bull Korea Math Soc 45 (2008), No 3, pp 509 522 SOME RESULTS RELATED TO DISTRIBUTION FUNCTIONS OF CHI-SQUARE TYPE RANDOM VARIABLES WITH RANDOM DEGREES OF FREEDOM Tra Loc Hug, Tra Thie Thah, a Bui Quag

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10 DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set

More information

1 Covariance Estimation

1 Covariance Estimation Eco 75 Lecture 5 Covariace Estimatio ad Optimal Weightig Matrices I this lecture, we cosider estimatio of the asymptotic covariace matrix B B of the extremum estimator b : Covariace Estimatio Lemma 4.

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

1 Review and Overview

1 Review and Overview CS229T/STATS231: Statistical Learig Theory Lecturer: Tegyu Ma Lecture #12 Scribe: Garrett Thomas, Pega Liu October 31, 2018 1 Review a Overview Recall the GAN setup: we have iepeet samples x 1,..., x raw

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

Subsampling vs Bootstrap. Dimitris N. Politis, Joseph P. Romano, Michael Wolf. (ˆθn θ (P ) under P. For real ˆθ n, (τ n

Subsampling vs Bootstrap. Dimitris N. Politis, Joseph P. Romano, Michael Wolf. (ˆθn θ (P ) under P. For real ˆθ n, (τ n Subsamlig vs Bootstra Dimitris N. Politis, Joseh P. Romao, Michael Wolf R x, θ P = τ ˆθ θ P Examle: ˆθ = X, τ =, θ = EX = µ P orˆθ = mi X, τ =, θ P = su{x : F x 0} Defie: J P, the istributio of τ ˆθ θ

More information

Definition 2 (Eigenvalue Expansion). We say a d-regular graph is a λ eigenvalue expander if

Definition 2 (Eigenvalue Expansion). We say a d-regular graph is a λ eigenvalue expander if Expaer Graphs Graph Theory (Fall 011) Rutgers Uiversity Swastik Kopparty Throughout these otes G is a -regular graph 1 The Spectrum Let A G be the ajacecy matrix of G Let λ 1 λ λ be the eigevalues of A

More information

11 THE GMM ESTIMATION

11 THE GMM ESTIMATION Cotets THE GMM ESTIMATION 2. Cosistecy ad Asymptotic Normality..................... 3.2 Regularity Coditios ad Idetificatio..................... 4.3 The GMM Iterpretatio of the OLS Estimatio.................

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

Lecture 7: Density Estimation: k-nearest Neighbor and Basis Approach

Lecture 7: Density Estimation: k-nearest Neighbor and Basis Approach STAT 425: Itroductio to Noparametric Statistics Witer 28 Lecture 7: Desity Estimatio: k-nearest Neighbor ad Basis Approach Istructor: Ye-Chi Che Referece: Sectio 8.4 of All of Noparametric Statistics.

More information

Algorithms in The Real World Fall 2002 Homework Assignment 2 Solutions

Algorithms in The Real World Fall 2002 Homework Assignment 2 Solutions Algorithms i The Real Worl Fall 00 Homewor Assigmet Solutios Problem. Suppose that a bipartite graph with oes o the left a oes o the right is costructe by coectig each oe o the left to raomly-selecte oes

More information

Statistical inference: example 1. Inferential Statistics

Statistical inference: example 1. Inferential Statistics Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either

More information

Slide Set 13 Linear Model with Endogenous Regressors and the GMM estimator

Slide Set 13 Linear Model with Endogenous Regressors and the GMM estimator Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

Bull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung

Bull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung Bull. Korea Math. Soc. 36 (999), No. 3, pp. 45{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Abstract. This paper provides suciet coditios which esure the strog cosistecy of regressio

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

3. Calculus with distributions

3. Calculus with distributions 6 RODICA D. COSTIN 3.1. Limits of istributios. 3. Calculus with istributios Defiitio 4. A sequece of istributios {u } coverges to the istributio u (all efie o the same space of test fuctios) if (φ, u )

More information

Ω ). Then the following inequality takes place:

Ω ). Then the following inequality takes place: Lecture 8 Lemma 5. Let f : R R be a cotiuously differetiable covex fuctio. Choose a costat δ > ad cosider the subset Ωδ = { R f δ } R. Let Ωδ ad assume that f < δ, i.e., is ot o the boudary of f = δ, i.e.,

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

Intelligent Systems I 08 SVM

Intelligent Systems I 08 SVM Itelliget Systems I 08 SVM Stefa Harmelig & Philipp Heig 12. December 2013 Max Plack Istitute for Itelliget Systems Dptmt. of Empirical Iferece 1 / 30 Your feeback Ejoye most Laplace approximatio gettig

More information

Analytic Number Theory Solutions

Analytic Number Theory Solutions Aalytic Number Theory Solutios Sea Li Corell Uiversity sl6@corell.eu Ja. 03 Itrouctio This ocumet is a work-i-progress solutio maual for Tom Apostol s Itrouctio to Aalytic Number Theory. The solutios were

More information

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials

More information

Robust Estimator with the SCAD Function in Penalized Linear Regression

Robust Estimator with the SCAD Function in Penalized Linear Regression The SIJ Trasactios o Computer Sciece Egieerig & its Applicatios (CSEA), Vol. 2, No. 4, Jue 24 Robust Estimator with the SCAD Fuctio i Pealize Liear Regressio Kag-Mo Jug* *Professor, Departmet of Statistics

More information

BENDING FREQUENCIES OF BEAMS, RODS, AND PIPES Revision S

BENDING FREQUENCIES OF BEAMS, RODS, AND PIPES Revision S BENDING FREQUENCIES OF BEAMS, RODS, AND PIPES Revisio S By Tom Irvie Email: tom@vibratioata.com November, Itrouctio The fuametal frequecies for typical beam cofiguratios are give i Table. Higher frequecies

More information

A generalization of the Leibniz rule for derivatives

A generalization of the Leibniz rule for derivatives A geeralizatio of the Leibiz rule for erivatives R. DYBOWSKI School of Computig, Uiversity of East Loo, Docklas Campus, Loo E16 RD e-mail: ybowski@uel.ac.uk I will shamelessly tell you what my bottom lie

More information

Bootstrap-Based Inference for Cube Root Consistent Estimators

Bootstrap-Based Inference for Cube Root Consistent Estimators Bootstrap-Based Iferece for Cube Root Cosistet Estimators Matias D. Cattaeo Michael Jasso Keichi Nagasawa April 24, 2017 Abstract This ote proposes a cosistet bootstrap-based distributioal approximatio

More information

New method for evaluating integrals involving orthogonal polynomials: Laguerre polynomial and Bessel function example

New method for evaluating integrals involving orthogonal polynomials: Laguerre polynomial and Bessel function example New metho for evaluatig itegrals ivolvig orthogoal polyomials: Laguerre polyomial a Bessel fuctio eample A. D. Alhaiari Shura Coucil, Riyah, Saui Arabia AND Physics Departmet, Kig Fah Uiversity of Petroleum

More information

Gaps between Consecutive Perfect Powers

Gaps between Consecutive Perfect Powers Iteratioal Mathematical Forum, Vol. 11, 016, o. 9, 49-437 HIKARI Lt, www.m-hikari.com http://x.oi.org/10.1988/imf.016.63 Gaps betwee Cosecutive Perfect Powers Rafael Jakimczuk Divisió Matemática, Uiversia

More information

CS284A: Representations and Algorithms in Molecular Biology

CS284A: Representations and Algorithms in Molecular Biology CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by

More information

Ma 530 Introduction to Power Series

Ma 530 Introduction to Power Series Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power

More information

Representing Functions as Power Series. 3 n ...

Representing Functions as Power Series. 3 n ... Math Fall 7 Lab Represetig Fuctios as Power Series I. Itrouctio I sectio.8 we leare the series c c c c c... () is calle a power series. It is a uctio o whose omai is the set o all or which it coverges.

More information

Frontier Estimation and Extreme Values Theory

Frontier Estimation and Extreme Values Theory Frotier Estimatio a Extreme Values Theory Abelaati Daouia Toulouse School of Ecoomics (GREMAQ) Jea-pierre Flores Toulouse School of Ecoomics (GREMAQ, IDEI) Léopol Simar Uiversité Catholique e Louvai (Istitut

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

The Chi Squared Distribution Page 1

The Chi Squared Distribution Page 1 The Chi Square Distributio Page Cosier the istributio of the square of a score take from N(, The probability that z woul have a value less tha is give by z / g ( ( e z if > F π, if < z where ( e g e z

More information

Rank tests and regression rank scores tests in measurement error models

Rank tests and regression rank scores tests in measurement error models Rak tests ad regressio rak scores tests i measuremet error models J. Jurečková ad A.K.Md.E. Saleh Charles Uiversity i Prague ad Carleto Uiversity i Ottawa Abstract The rak ad regressio rak score tests

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values

More information

Notes On Median and Quantile Regression. James L. Powell Department of Economics University of California, Berkeley

Notes On Median and Quantile Regression. James L. Powell Department of Economics University of California, Berkeley Notes O Media ad Quatile Regressio James L. Powell Departmet of Ecoomics Uiversity of Califoria, Berkeley Coditioal Media Restrictios ad Least Absolute Deviatios It is well-kow that the expected value

More information

Rank-1 lattice rules for multivariate integration in spaces of permutation-invariant functions: Error bounds and tractability

Rank-1 lattice rules for multivariate integration in spaces of permutation-invariant functions: Error bounds and tractability Rak- lattice rules for multivariate itegratio i spaces of permutatio-ivariat fuctios: Error bous a tractability Dirk Nuyes Gowri Suryaarayaa Markus Weimar May 3, 204 Abstract We stuy multivariate itegratio

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

4.5 Multiple Imputation

4.5 Multiple Imputation 45 ultiple Imputatio Itroductio Assume a parametric model: y fy x; θ We are iterested i makig iferece about θ I Bayesia approach, we wat to make iferece about θ from fθ x, y = πθfy x, θ πθfy x, θdθ where

More information

Introductory statistics

Introductory statistics CM9S: Machie Learig for Bioiformatics Lecture - 03/3/06 Itroductory statistics Lecturer: Sriram Sakararama Scribe: Sriram Sakararama We will provide a overview of statistical iferece focussig o the key

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio

More information

Lecture 3 The Lebesgue Integral

Lecture 3 The Lebesgue Integral Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

Entropy Rates and Asymptotic Equipartition

Entropy Rates and Asymptotic Equipartition Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,

More information

LECTURE 14 NOTES. A sequence of α-level tests {ϕ n (x)} is consistent if

LECTURE 14 NOTES. A sequence of α-level tests {ϕ n (x)} is consistent if LECTURE 14 NOTES 1. Asymptotic power of tests. Defiitio 1.1. A sequece of -level tests {ϕ x)} is cosistet if β θ) := E θ [ ϕ x) ] 1 as, for ay θ Θ 1. Just like cosistecy of a sequece of estimators, Defiitio

More information