Technische Universität Ilmenau Institut für Mathematik
|
|
- Suzanna Richardson
- 6 years ago
- Views:
Transcription
1 Techische Uiversität Ilmeau Istitut für Mathematik Preprit No. M 03/14 Rates of cosistecy for oparametric estimatio of the mode i absece of smoothess assumptios Herrma, Eva; Ziegler, Klaus 2003 Impressum: Hrsg.: Leiter des Istituts für Mathematik Weimarer Straße Ilmeau Tel.: Fax: ISSN xxxx-xxxx
2 Rates of cosistecy for oparametric estimatio of the mode i absece of smoothess assumptios Eva Herrma ad Klaus Ziegler Techical Uiversity of Darmstadt ad Techical Uiversity of Ilmeau Abstract Noparametric estimatio of the mode of a desity or regressio fuctio via kerel methods is cosidered. It is show that the rate of cosistecy of the mode estimator ca be determied without the typical smoothess coditios. Oly the uiform rate of the so-called stochastic part of the problem together with some mild coditios characterizig the shape or acuteess of the mode ifluece the rate of the mode estimator. I particular, outside the locatio of the mode, our assumptios do ot eve imply cotiuity. Overall, it turs out that the locatio of the mode ca be estimated at a rate that is the better the peakier (ad hece o-smooth) the mode is, while the cotrary holds with estimatio of the size of the mode. AMS subject classificatio: 62G05, 62G07 Key words ad phrases: oparametric curve estimatio, mode, kerel smoothig, rates of cosistecy, o-smooth curves 1 Itroductio ad assumptios A importat problem i oparametric curve estimatio cosists i estimatio of the mode, i.e., the locatio of a isolated maximum of the ukow desity or regressio fuctio. A umber of distiguished papers deal with this topic. There are, amog others, Parze (1962), Rüschedorf (1977), Eddy (1980, 1982), Müller (1985, 1989), Romao (1988a,b), Grud ad Hall (1995), Ehm (1996), ad, most recetly, Mokkadem ad Pelletier (2003) as well as Abraham, Biau ad Cadre (2003). I the followig, we will restrict to the uivariate situatio but extesios to the multivariate case are possible. The classical approach is as follows. Let f be the ukow real-valued curve ad θ the mode of f, i.e. f(θ) > sup f(x) for each ɛ > 0, (1) x θ >ɛ which meas that θ is the locatio of the uique global maximum of f. Theθ is estimated from the locatio ˆθ ˆθ of a maximum of a curve estimator ˆf ˆf for f. Uiqueess of the maximum or eve a coditio like (1) for ˆf caot be expected here, but, i geeral, this does ot affect the validity of asymptotic theory. It is well-kow that uiform cosistecy of ˆf for f is sufficiet to esure cosistecy of ˆθ for θ (see, e.g., Parze, 1962; Rüschedorf, 1977; Nadaraya, 1989). 1
3 To obtai rates, however, oe has to kow some more about the local geometry of f aroud θ. Müller (1985) showed, i essece, that if the uiform cosistecy of ˆf is of order β, i.e. sup ˆf (x) f(x) = O(β ) (2) x (i probability or a.s.), ad if there are ρ>0,c>0 such that f(θ) f(x) c x θ ρ i a eighborhood of θ, (3) the ˆθ θ = O(β 1/ρ ) (4) i probability or a.s. depedig o what holds i (2). A similar cocept was used by Boulara et al. (1995) for estimatio of poits θ with f (p) (θ) =b, i.e. where some p-th derivative of the curve takes a give value b. So, (2) seems to be crucial for (4). But i order to obtai (2), global smoothess coditios have to be imposed o f. Most authors, amog them Müller (1985), assume f to be twice cotiuously differetiable. Differetiability, however, excludes the case ρ 1 i (3), (4), ad hece his results do ot apply to cusp-shaped modes (ρ =1,seeEhm, 1996, where, however, C p -smoothess, p 2, of f is assumed outside of θ) oreve proper peaks (ρ <1). I fact, Müller s coditios tacitly eve imply ρ 2, ad the case ρ<2 does t seem to have bee cosidered explicitly so far. It should be metioed here that Härdle et al. require oly some uiform local Lipschitz coditio istead of differetiability i order to obtai (2), but this is still a global smoothess coditio. Results of type (2) are always prove by splittig ito a stochastic part ˆf (x) f (x) ad a determiistic part f (x) f(x) where i desity estimatio, f (x) =E ˆf (x) ad the aalytic part is simply the bias. A look at the proofs beig available i the literature reveals that smoothess coditios are eeded exclusively for hadlig the aalytic part whereas a rate of the stochastic part sup ˆf (x) f (x) = O(U ) (5) x (a.s. or i probability) ca be determied without imposig ay smoothess coditios. For example, if ˆf is the Roseblatt-Parze kerel desity estimator ˆf (x) = 1 h i=1 K( x X i h ) (6) based o i.i.d. observatios X i havig desity f, (5) ca be established with a.s. rate log U = h uder some regularity coditios o the kerel K ad the badwidth h. A aalogous result holds for regressio estimators, see, e.g., Härdle et al. (1988) ad ca also be derived 2
4 from the results cotaied i Ziegler (2002). Similar results with somewhat worse rates are available i the case of depedet observatios ad i the multivariate case (see Györfi et al., 1989; Koshki ad Vasil iev, 1998; Liebscher, 2001). The aim of the preset paper is to show that the kowledge of the rate of the stochastic part U i (6) together with some iformatio about the shape or acuteess of the peak already suffice to prove a result like (4), with o smoothess coditios beig required at all. Apart from θ, cotiuityoff will at most be required for (5), which is sometimes the case due to techical reasos, see e.g. Eimahl ad Maso (1999) where eve the costat i the O-term is determied. I the sequel, we cosider the slightly more geeral case of θ beig the locatio of a local maximum of f, with (1) holdig for x i some eighborhood I of θ. I part, the local shape of the peak is characterized by (3) (holdig for x i some maybe smaller eighborhood J I), but this gives oly a upper boud for f aroud θ. A lower boud will be eeded i additio. Therefore, we itroduce the further coditio that there are ρ >0, d>0such that f(θ) f(x) d x θ ρ i a eighborhood of θ. (7) Note, that (3) together with (7) implies ρ ρ. Ideed, ρ >ρwould imply d x θ ρ < c x θ ρ for x θ beig small eough. If, e.g., f is twice cotiuously differetiable i a eighborhood of θ, the, by Taylor s theorem ad f (θ) =0,thechoice ρ = ρ =2is possible. Eve i this case, our result still improves o kow oes, because this is oly a local smoothess assumptio while (2) always requires global smoothess. If f has a cusp-shaped mode at θ, i.e. the oe-sided derivatives exist i θ with f (θ 0) > 0, f (θ 0) < 0adiff is cotiuously differetiable i left ad right eighborhoods of θ,the ρ = ρ =1.Forρ<1there is ecessarily f (θ 0) =, f (θ+0) =. We will retur to a discussio of these special cases i the remark after the corollary below ad i Sectio 3. I the ext sectio, we will show for the desity estimator (6) that (5), where agai f = E ˆf, together with (1), (3) ad (7) imply (4) with β = U + h ρ. This is the same rate as beig obtaied i (4) from (2) from the global smoothess assumptio that f is uiform local Lipschitz of order ρ. We will also prove a rate for the estimatio of the size f(θ) ofthepeak. I Sectio 3 we compare our results to those beig available i the literature ad i Sectio 4 we idicate how to exted our techiques to regressio aalysis. 2 Mai results For simplicity, we give the result oly for fixed, i.e., o-data-drive badwidths ad compactly supported kerels but we stress that they remai valid for data-depedet badwidths ad more geeral kerels. This ca be achieved usig the techiques described i Romao (1988a), Herrma (2000) or Ziegler (2002). Our methods also apply to the estimatio of modes of derivatives of f usig itegratio by parts as, e.g., i Ziegler (2002). Ad fially we remark that extesios to the multivariate case are possible, too. 3
5 Theorem 1 Let K 0 be a bouded ad symmetric kerel fuctio with K(u)du =1 ad compact support, h > 0, h 0 a badwidth sequece, ˆf the desity estimator (6). We assume that there are a eighborhood I of θ ad a umerical sequece U such that sup ˆf (x) E ˆf (x) = O(U ) a.s. (8) x I Let f ad its mode θ satisfy (1) for all x I. We also assume that (3), (7) hold ad ˆθ is defied by ˆf (ˆθ )=maxˆf (x). (9) x I The ˆθ θ = O((U + h ρ ) 1/ρ ) a.s. (10) Outlie of proof Write agai f (x) for E ˆf (x). I the proof of Theorem 2.1 i Grud ad Hall (1995) it has bee show (see also, Ziegler, 2002) that for each ɛ>0 the iequality ˆθ θ >ɛimplies sup ˆf (x) f (x) 1 x I 2 (f (θ) sup f (x)). x θ >ɛ Therefore, i order to derive (10) from (8), it suffices to fid for each η>0someτ>0 such that, for V =(U + h ρ ) 1/ρ it holds that f (θ) sup f (x) ηu. (11) x θ >τv Let x I with x θ >τv be give (with τ to be specified later). Accordig to (1) ad (3), there exists δ>0 such that f(θ) f(x h u) mi(c θ x + h u ρ,δ) mi(c θ x ρ,δ) for either u>0oru<0, depedig o the sig of θ x. ChooseM > 0 such that supp K [ M, M]. The, accordig to (7) f(θ h u) f(θ) dh ρ u ρ for large eough ad u [ M,M]. Hece, with d = d M u ρ K(u)du < ad c = M c M K(u)du = c 0 K(u)du = 1 c we have for large eough, by K 0, that 0 M 2 f (θ) f (x) = = M M M M K(u)(f(θ h u) f(x h u))du K(u)(f(θ h u) f(θ))du + dh ρ + cτ ρ V ρ = dh ρ + cτ ρ h ρ + cτ ρ U. 4 M M K(u)(f(θ) f(x h u))du
6 If we ow take τ such that cτ ρ max( d, η), the (11) will be satisfied. Remarks (a) By quite the same proof, we see that if (8) holds i probability istead of a.s., the result (10) is also obtaied i probability istead of a.s. (b) The existece of a θ with (9) is e.g. automatically esured if K is take to be cotiuous, sice due to the compact support, ˆf is also cotiuous ad compactly supported the. Of course, the estimatio of the height f(θ) of the peak is of iterest, too. A atural estimator is ˆf (ˆθ ) = sup x R ˆf (x). See, e.g., Nadaraya (1989) for results uder smoothess coditios. A rate for the cosistecy of ˆf (ˆθ ) ca be derived from (8) ad (10) if we replace (7) by a locally uiform versio. Theorem 2 Let the coditios of Theorem 1 be fulfilled. Istead of (7), assume that holds for some ρ, d > 0. The f(x) f(y) d x y ρ x, y i a eighborhood of θ (12) ˆf (ˆθ ) f(θ) =O((U + h ρ ) ρ/ρ ) a.s. Proof First we ote that from (12) it follows that E ˆf (x) f(x) =O(h ρ ) uiformly i x i a eighborhood of θ (13) sice E ˆf (x) f(x) M M K(u) f(x uh ) f(x) du dh ρ M M u ρ K(u)du for small eough h so that x ad x uh are both i the eighborhood where (12) holds if x is i a certai smaller eighborhood. The, from (8), (10), (12) ad (13), ˆf (ˆθ ) f(θ) = ˆf (ˆθ ) f(ˆθ )+f(ˆθ ) f(θ) = O(U + h ρ )+O( ˆθ θ ρ ) = O((U + h ρ ) ρ/ρ ) wherewehaveused ρ ρ. Remarks (a) Agai we obtai the assertio of Theorem 2 i probability if (8) is assumed to hold i probability. (b) The coditio (12) meas that f is locally uiform Lipschitz of order ρ i a eighborhood of θ, which is stroger tha (7). Ideed, it is kow that for estimatio of the size of the mode, stroger smoothess assumptios are required tha for estimatio of the locatio of the mode. See, e.g., Ziegler (2002). 5
7 As we have metioed i the itroductio, i case of i.i.d. observatios X i, the rate log U = h beig attaied a.s. for the stochastic part is familiar. Here, the rate of U + h ρ becomes best if we choose ( (log ) ) 1 2 ρ+1 h = O, which leads to ( (log ) ρ ) U + h ρ 2 ρ+1 = O. Ideed, for miimizatio of U + h ρ the rates of U ad h ρ must coicide, whece h ρ = O( log h ). Hece we have the followig corollary: Corollary Let the desity estimator be based o i.i.d. samples. The, we have uder the assumptios of Theorem 1 ( (log ) ρ ) (2 ρ+1)ρ ˆθ θ = O (14) (a.s.), while uder the assumptios of Theorem 2 it holds that ( ) ρ 2 ˆf (ˆθ ) f(θ) =O log (2 ρ+1)ρ (15) (a.s.) Remarks (a) Assume ρ = ρ which will cover most situatios ayway. The, we see from (14) that the rate of ˆθ θ is O(( log )1/(2ρ+1) )=O(h ) which improves as ρ decreases, i.e., as the peak gets acuter. Istead, the rate of ˆf (ˆθ ) f(θ) iso( log )ρ/(2ρ+1) )which worses with ρ gettig smaller. Naturally, the latter is the same rate at which f ca be estimated uiformly if it is uiformly local Lipschitz of order ρ. Thisbehaviorisroughly what we should have expected before. A high ad slim peak is met more exactly by the estimator, while its height will be abraded by the smoothig process. Furthermore, it is atural that the badwidth should be chose the smaller the acuter the peak is. (b) Note that our assumptios i Theorem 1 do ot eve imply cotiuity except i θ itself. Ideed, the case ρ <ρmay allow f to jump ad oscillate quite heavily outside θ. I Theorem 2, the coditio (12) implies cotiuity of f i a eighborhood of θ. However, the proof shows that Theorem 2 holds uder the weaker coditio (13) which might be valid without cotiuity i special situatios. 6
8 3 Brief discussio (a) I the twice differetiable case ρ = ρ = 2 our rates coicide with the kow oes i Müller (1985; see also Vieu, 1996). However, our results are still a slight improvemet i this case sice we eed to impose differetiability oly locally i a small eighborhood of θ. O the other had, uder some additioal requiremets, the rate has bee slightly improved by Leclerc ad Pierre-Loti-Viaud (2000). I the degeerate case, i.e. f (θ) =0 with some higher differetiability, the exact rate has bee recetly determied by Mokkadem ad Pelletier (2003). I the case ρ<2, o results seem to have bee available so far. This has also bee poited out by Abraham et al. (2003), p.7. See, however, Ehm, 1996, where f is assumed to be C p -smooth, p 2 except at θ itself, where it has a kik (ρ = ρ = 1). I this case, our rate (14), i.e. O( 1/3 ) ca be improved by the very sophisticated costructio of aother estimator for θ. (b) I Abraham et al. (2003), for computatioal reasos, a differet estimator is cosidered which maximizes ˆf oly over the values of X 1,...,X (istead of maximizig over x R or a iterval which the classical mode estimate does). The authors compare the performace of their estimator to that of the classical oe i the smooth case, ad state that it would be desirable to do the like i the o-smooth case. Now eve as we have results for the classical estimator i o-smooth cases, such a compariso is difficult sice the coditios give i Abraham et al. (2003) do ot directly correspod to ours. However, their β clearly equals our ρ sice they employ our coditio (13), while their α should correspod to our 1/ρ. Furthermore, we are i the uivariate case d = 1. With i.i.d. observatios beig available, the rate obtaied from (14) is O(( log ) ρ/(2 ρ+1)ρ ) = O(( log )αβ/(2β+d) ). Sice αβ 1, this is slightly better tha the rate give i Cor. 2.1 of Abraham et al. (2003) (log )2/(2β+d) which is O( ). Hece, eve i the o-smooth case, the classical estimator still αβ/(2β+d) seems to perform slightly superior to the computatioally advatageous oe. However, we do ot kow if oe of those rates ca still be improved. (c) Note that our assumptios, eve i the case ρ = ρ, do ot imply ay local symmetry of f aroud θ. The situatio chages dramatically as soo as we wat to costruct a cofidece iterval for θ. For asymptotic ormality of ˆθ θ the coditios f (θ 0) = f (θ +0) ad f (θ 0) = f (θ + 0), i.e., local symmetry of f aroud θ up to order 2, seem to be crucial. This will be show i a forthcomig paper of the secod author. However, eve i o-symmetric situatios of this kid, the mode ca still be estimated asymptotically ormal usig a differet estimator. The costructio of such a estimator is described i Ehm (1996). 7
9 4 Extesios to regressio fuctios Now we tur to regressio aalysis. For fixed desig regressio Y i = f(x i )+ɛ i with desig poits x 1,...,x I =[a, b] satisfyig x i x i 1 1 = o( 1 ) uiformly i 2 i ad i.i.d. error variables with zero mea ad variace Eɛ 2 i = σ 2 <, the Gasser-Müller estimator ˆf (x) = 1 h i=1 si K( x u s i 1 h (with s i 1 = 1(x 2 i + x i 1 ),i=2,...,, s 0 = a, s = b) is kow to fulfill E ˆf (x) = K(u)f(x h u)du + O( 1 ) h (Müller, 1985). Therefore, our results take over to this case quite straightforwardly as log 1 as h is of smaller order tha both U ad h ρ which is the typical case. I the case of radom desig, with f(x) =E(Y X = x) to be estimated via the Nadaraya-Watso estimator where ad ˆr (x) = 1 h ĝ (x) = 1 h ˆf (x) = ˆr (x) ĝ (x), i=1 i=1 )du Y i K( x X i h ) K( x X i h ), the quatity ˆf is compared to i the stochastic part (5) is f (x) = Eˆr (x) Eĝ (x) rather tha E ˆf (x). Note, however, that the asymptotic equivalece of the two quatities is show i Ziegler (2001a). For estimatio from i.i.d. pairs of observatios, (5) ca still be prove with log U = h 8
10 (see Härdle et al., 1988). For U i the case of depedet observatios, see Györfi et al. (1989) or Liebscher (1998) amog others. To prove a aalogue to our theorem for the Nadaraya-Watso estimator, oe has to fid a appropriate lower boud of f (θ) f (x) = Eˆr(θ) Eˆr(x) Eĝ (θ) Eĝ (x).ifx has a desig desity g beig bouded away from zero ad ifiity o I, i.e. we have 0 <C 1 g(x) C 2 < for x I, = f (θ) f (x) K(u)f(θ uh)g(θ uh)du K(u)g(θ uh)du K(u)f(x uh)g(x uh)du K(u)g(x uh)du = C 2 C 1 K(u)(f(θ uh) f(θ))g(θ uh)du K(u)(f(θ) f(x uh))g(x uh)du + K(u)g(θ uh)du K(u)g(x uh)du K(u)(f(θ uh) f(θ))du + C 1 C 2 K(u)(f(θ) f(x uh))du, ad from ow o oe may proceed as i the proof of the theorem. Further extesios to local polyomial smoothers are possible i a similar way. Fially we remark that our method should take over to the estimatio of poits θ with f (p) = b as metioed i the itroductio by modifyig assumptios (3) ad (7) appropriately. This will be show i a forthcomig paper of the secod author. Refereces Abraham, C., Biau, G. ad Cadre, B. (2003). Simple estimatio of the mode of a multivariate desity. Preprit. Boulara, J., Ferré, L. ad Vieu, P. (1995). Locatio of particular poits i o-parametric regressio aalysis. Aust. J. Stat. 37, Eddy, W. (1980). Optimal kerel estimators of the mode. A. Statist Eddy, W. (1982). The asymptotic distributios of kerel estimators of the mode. Z. Wahrsch. Verw. Gebiete Ehm, W. (1996). Adaptive kerel estimatio of a cusp-shaped mode. I: Fischer, Herbert (ed.) et al.: Applied mathematics ad parallel computig. Festschrift for Klaus Ritter, , Physica- Verlag, Heidelberg. Eimahl, U. ad Maso, D.M. (2000). A empirical process approach to the uiform cosistecy of kerel-type fuctio estimators. J. Theoret. Probab. 13, Grud, B. ad Hall, P. (1995). O the miimisatio of L p error i mode estimatio. A. Statist Györfi, L., Härdle, W., Sarda, P. ad Vieu, P. (1989). Noparametric Estimatio from Time Series. Lecture Notes i Statistics 60, Spriger-Verlag. Härdle, W., Jasse, P. ad Serflig, R. (1988). Strog uiform cosistecy rates for estimators of coditioal fuctioals. A. Statist
11 Koshki, G.M. ad Vasil iev, V.A. (1998). Noparametric estimatio of derivatives of a multivariate desity from depedet observatios. Mathematical Methods Statist Herrma, E. (2000) Data adaptive kerel regressio estimatio. Habilitatiosschrift, Darmstadt Techical Uiversity. Leclerc, J. ad Pierre-Loti-Viaud, D. (2000). Vitesse de covergece presque sure de l estimateur a oyau du mode. Comptes redus de l Academie des Scieces de Paris Liebscher, E. (2001). Estimatio of the desity ad the regressio fuctio uder mixig coditio. Statistics ad Decisios 19, Mokkadem, A. ad Pelletier, M. (2003): The law of the iterated logarithm for the multivariate kerel mode estimator. ESAIM: Probability ad Statistics Müller, H.-G. (1985). Kerel estimators of zeros ad of locatio ad size of extrema of regressio fuctios. Scad. J. Statist Müller, H.-G. (1989). Adaptive oparametric peak estimatio. A. Statist Nadaraya, E.A. (1989). Noparametric Estimatio of Probability Desities ad Regressio Curves. Kluver Academic Publishers, Dordrecht. Parze, E. (1962). O estimatio of a probability desity fuctio ad mode. A. Math. Statist Romao, J.P. (1988a). O weak covergece ad optimality of kerel desity estimates of the mode. A. Statist Romao, J.P. (1988b). Bootstrappig the mode. A. Ist. Statist. Math Rüschedorf, L. (1977). Cosistecy of estimators for multivariate desity fuctios ad for the mode. Sakhyā Ser.A Vieu, P. (1996). A ote o desity mode estimatio. Statistics ad Probability Letters Ziegler, K. (2001): O approximatios to the bias of the Nadaraya-Watso regressio estimator. J. Noparametric Statistics Ziegler, K. (2002): O oparametric kerel estimatio of the mode of the regressio fuctio i the radom desig model. J. Noparametric Statistics
Kernel density estimator
Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I
More informationEstimation of the essential supremum of a regression function
Estimatio of the essetial supremum of a regressio fuctio Michael ohler, Adam rzyżak 2, ad Harro Walk 3 Fachbereich Mathematik, Techische Uiversität Darmstadt, Schlossgartestr. 7, 64289 Darmstadt, Germay,
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationJournal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula
Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials
More informationECE 901 Lecture 14: Maximum Likelihood Estimation and Complexity Regularization
ECE 90 Lecture 4: Maximum Likelihood Estimatio ad Complexity Regularizatio R Nowak 5/7/009 Review : Maximum Likelihood Estimatio We have iid observatios draw from a ukow distributio Y i iid p θ, i,, where
More informationb i u x i U a i j u x i u x j
M ath 5 2 7 Fall 2 0 0 9 L ecture 1 9 N ov. 1 6, 2 0 0 9 ) S ecod- Order Elliptic Equatios: Weak S olutios 1. Defiitios. I this ad the followig two lectures we will study the boudary value problem Here
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationMath 341 Lecture #31 6.5: Power Series
Math 341 Lecture #31 6.5: Power Series We ow tur our attetio to a particular kid of series of fuctios, amely, power series, f(x = a x = a 0 + a 1 x + a 2 x 2 + where a R for all N. I terms of a series
More informationEFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS
EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS Ryszard Zieliński Ist Math Polish Acad Sc POBox 21, 00-956 Warszawa 10, Polad e-mail: rziel@impagovpl ABSTRACT Weak laws of large umbers (W LLN), strog
More informationLecture 10 October Minimaxity and least favorable prior sequences
STATS 300A: Theory of Statistics Fall 205 Lecture 0 October 22 Lecturer: Lester Mackey Scribe: Brya He, Rahul Makhijai Warig: These otes may cotai factual ad/or typographic errors. 0. Miimaxity ad least
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationLecture 7: Density Estimation: k-nearest Neighbor and Basis Approach
STAT 425: Itroductio to Noparametric Statistics Witer 28 Lecture 7: Desity Estimatio: k-nearest Neighbor ad Basis Approach Istructor: Ye-Chi Che Referece: Sectio 8.4 of All of Noparametric Statistics.
More informationA survey on penalized empirical risk minimization Sara A. van de Geer
A survey o pealized empirical risk miimizatio Sara A. va de Geer We address the questio how to choose the pealty i empirical risk miimizatio. Roughly speakig, this pealty should be a good boud for the
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationEmpirical Processes: Glivenko Cantelli Theorems
Empirical Processes: Gliveko Catelli Theorems Mouliath Baerjee Jue 6, 200 Gliveko Catelli classes of fuctios The reader is referred to Chapter.6 of Weller s Torgo otes, Chapter??? of VDVW ad Chapter 8.3
More informationFall 2013 MTH431/531 Real analysis Section Notes
Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More information1 Approximating Integrals using Taylor Polynomials
Seughee Ye Ma 8: Week 7 Nov Week 7 Summary This week, we will lear how we ca approximate itegrals usig Taylor series ad umerical methods. Topics Page Approximatig Itegrals usig Taylor Polyomials. Defiitios................................................
More informationAdaptive Estimation of Density Function Derivative
Applied Methods of Statistical Aalysis. Noparametric Approach Adaptive Estimatio of Desity Fuctio Derivative Dimitris N. Politis, Vyacheslav A. Vasiliev 2 ad Peter F. Tarasseko 2 Departmet of Mathematics,
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationSieve Estimators: Consistency and Rates of Convergence
EECS 598: Statistical Learig Theory, Witer 2014 Topic 6 Sieve Estimators: Cosistecy ad Rates of Covergece Lecturer: Clayto Scott Scribe: Julia Katz-Samuels, Brado Oselio, Pi-Yu Che Disclaimer: These otes
More informationLecture 8: Convergence of transformations and law of large numbers
Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More informationMi-Hwa Ko and Tae-Sung Kim
J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More informationA NOTE ON BOUNDARY BLOW-UP PROBLEM OF u = u p
A NOTE ON BOUNDARY BLOW-UP PROBLEM OF u = u p SEICK KIM Abstract. Assume that Ω is a bouded domai i R with 2. We study positive solutios to the problem, u = u p i Ω, u(x) as x Ω, where p > 1. Such solutios
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationApproximation by Superpositions of a Sigmoidal Function
Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 22 (2003, No. 2, 463 470 Approximatio by Superpositios of a Sigmoidal Fuctio G. Lewicki ad G. Mario Abstract. We geeralize
More information6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.
6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationREAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS
REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS 18th Feb, 016 Defiitio (Lipschitz fuctio). A fuctio f : R R is said to be Lipschitz if there exists a positive real umber c such that for ay x, y i the domai
More informationThe Growth of Functions. Theoretical Supplement
The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that
More information5.1 A mutual information bound based on metric entropy
Chapter 5 Global Fao Method I this chapter, we exted the techiques of Chapter 2.4 o Fao s method the local Fao method) to a more global costructio. I particular, we show that, rather tha costructig a local
More informationUniversity of Colorado Denver Dept. Math. & Stat. Sciences Applied Analysis Preliminary Exam 13 January 2012, 10:00 am 2:00 pm. Good luck!
Uiversity of Colorado Dever Dept. Math. & Stat. Scieces Applied Aalysis Prelimiary Exam 13 Jauary 01, 10:00 am :00 pm Name: The proctor will let you read the followig coditios before the exam begis, ad
More informationStochastic Simulation
Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso
More informationLecture 3 The Lebesgue Integral
Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified
More informationLECTURE 2 LEAST SQUARES CROSS-VALIDATION FOR KERNEL DENSITY ESTIMATION
Jauary 3 07 LECTURE LEAST SQUARES CROSS-VALIDATION FOR ERNEL DENSITY ESTIMATION Noparametric kerel estimatio is extremely sesitive to te coice of badwidt as larger values of result i averagig over more
More informationAdvanced Analysis. Min Yan Department of Mathematics Hong Kong University of Science and Technology
Advaced Aalysis Mi Ya Departmet of Mathematics Hog Kog Uiversity of Sciece ad Techology September 3, 009 Cotets Limit ad Cotiuity 7 Limit of Sequece 8 Defiitio 8 Property 3 3 Ifiity ad Ifiitesimal 8 4
More informationA RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS
J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationLecture 15: Learning Theory: Concentration Inequalities
STAT 425: Itroductio to Noparametric Statistics Witer 208 Lecture 5: Learig Theory: Cocetratio Iequalities Istructor: Ye-Chi Che 5. Itroductio Recall that i the lecture o classificatio, we have see that
More informationOptimally Sparse SVMs
A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but
More informationDirection: This test is worth 250 points. You are required to complete this test within 50 minutes.
Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely
More informationLecture 15: Density estimation
Lecture 15: Desity estimatio Why do we estimate a desity? Suppose that X 1,...,X are i.i.d. radom variables from F ad that F is ukow but has a Lebesgue p.d.f. f. Estimatio of F ca be doe by estimatig f.
More informationRates of Convergence by Moduli of Continuity
Rates of Covergece by Moduli of Cotiuity Joh Duchi: Notes for Statistics 300b March, 017 1 Itroductio I this ote, we give a presetatio showig the importace, ad relatioship betwee, the modulis of cotiuity
More informationNotes 5 : More on the a.s. convergence of sums
Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationSAMPLING LIPSCHITZ CONTINUOUS DENSITIES. 1. Introduction
SAMPLING LIPSCHITZ CONTINUOUS DENSITIES OLIVIER BINETTE Abstract. A simple ad efficiet algorithm for geeratig radom variates from the class of Lipschitz cotiuous desities is described. A MatLab implemetatio
More informationNonparametric regression: minimax upper and lower bounds
Capter 4 Noparametric regressio: miimax upper ad lower bouds 4. Itroductio We cosider oe of te two te most classical o-parametric problems i tis example: estimatig a regressio fuctio o a subset of te real
More informationRegression with quadratic loss
Regressio with quadratic loss Maxim Ragisky October 13, 2015 Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X,Y, where, as before,
More informationInformation-based Feature Selection
Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationAsymptotic distribution of products of sums of independent random variables
Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege
More informationIt is often useful to approximate complicated functions using simpler ones. We consider the task of approximating a function by a polynomial.
Taylor Polyomials ad Taylor Series It is ofte useful to approximate complicated fuctios usig simpler oes We cosider the task of approximatig a fuctio by a polyomial If f is at least -times differetiable
More informationLecture 3: August 31
36-705: Itermediate Statistics Fall 018 Lecturer: Siva Balakrisha Lecture 3: August 31 This lecture will be mostly a summary of other useful expoetial tail bouds We will ot prove ay of these i lecture,
More informationAn alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales.
A alterative proof of a theorem of Aldous cocerig covergece i distributio for martigales. Maurizio Pratelli Dipartimeto di Matematica, Uiversità di Pisa. Via Buoarroti 2. I-56127 Pisa, Italy e-mail: pratelli@dm.uipi.it
More informationDetailed proofs of Propositions 3.1 and 3.2
Detailed proofs of Propositios 3. ad 3. Proof of Propositio 3. NB: itegratio sets are geerally omitted for itegrals defied over a uit hypercube [0, s with ay s d. We first give four lemmas. The proof of
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationMathematical Methods for Physics and Engineering
Mathematical Methods for Physics ad Egieerig Lecture otes Sergei V. Shabaov Departmet of Mathematics, Uiversity of Florida, Gaiesville, FL 326 USA CHAPTER The theory of covergece. Numerical sequeces..
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationTR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT
TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationMachine Learning Theory Tübingen University, WS 2016/2017 Lecture 12
Machie Learig Theory Tübige Uiversity, WS 06/07 Lecture Tolstikhi Ilya Abstract I this lecture we derive risk bouds for kerel methods. We will start by showig that Soft Margi kerel SVM correspods to miimizig
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationMATH301 Real Analysis (2008 Fall) Tutorial Note #7. k=1 f k (x) converges pointwise to S(x) on E if and
MATH01 Real Aalysis (2008 Fall) Tutorial Note #7 Sequece ad Series of fuctio 1: Poitwise Covergece ad Uiform Covergece Part I: Poitwise Covergece Defiitio of poitwise covergece: A sequece of fuctios f
More informationLecture 2. The Lovász Local Lemma
Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio
More informationBull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung
Bull. Korea Math. Soc. 36 (999), No. 3, pp. 45{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Abstract. This paper provides suciet coditios which esure the strog cosistecy of regressio
More informationBerry-Esseen bounds for self-normalized martingales
Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,
More informationCSE 527, Additional notes on MLE & EM
CSE 57 Lecture Notes: MLE & EM CSE 57, Additioal otes o MLE & EM Based o earlier otes by C. Grat & M. Narasimha Itroductio Last lecture we bega a examiatio of model based clusterig. This lecture will be
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet
More informationREGRESSION WITH QUADRATIC LOSS
REGRESSION WITH QUADRATIC LOSS MAXIM RAGINSKY Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X, Y ), where, as before, X is a R d
More informationStudy the bias (due to the nite dimensional approximation) and variance of the estimators
2 Series Methods 2. Geeral Approach A model has parameters (; ) where is ite-dimesioal ad is oparametric. (Sometimes, there is o :) We will focus o regressio. The fuctio is approximated by a series a ite
More informationlim za n n = z lim a n n.
Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationDefinition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.
4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad
More informationElement sampling: Part 2
Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig
More informationMath 128A: Homework 1 Solutions
Math 8A: Homework Solutios Due: Jue. Determie the limits of the followig sequeces as. a) a = +. lim a + = lim =. b) a = + ). c) a = si4 +6) +. lim a = lim = lim + ) [ + ) ] = [ e ] = e 6. Observe that
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More information6a Time change b Quadratic variation c Planar Brownian motion d Conformal local martingales e Hints to exercises...
Tel Aviv Uiversity, 28 Browia motio 59 6 Time chage 6a Time chage..................... 59 6b Quadratic variatio................. 61 6c Plaar Browia motio.............. 64 6d Coformal local martigales............
More informationMath 113 Exam 4 Practice
Math Exam 4 Practice Exam 4 will cover.-.. This sheet has three sectios. The first sectio will remid you about techiques ad formulas that you should kow. The secod gives a umber of practice questios for
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationPoint Estimation: properties of estimators 1 FINITE-SAMPLE PROPERTIES. finite-sample properties (CB 7.3) large-sample properties (CB 10.
Poit Estimatio: properties of estimators fiite-sample properties CB 7.3) large-sample properties CB 10.1) 1 FINITE-SAMPLE PROPERTIES How a estimator performs for fiite umber of observatios. Estimator:
More informationPRELIM PROBLEM SOLUTIONS
PRELIM PROBLEM SOLUTIONS THE GRAD STUDENTS + KEN Cotets. Complex Aalysis Practice Problems 2. 2. Real Aalysis Practice Problems 2. 4 3. Algebra Practice Problems 2. 8. Complex Aalysis Practice Problems
More information