A Law of the Iterated Logarithm. for Grenander s Estimator
|
|
- Cameron Waters
- 5 years ago
- Views:
Transcription
1 A Law of the Iterated Logarithm for Grenander s Estimator Jon A. Wellner University of Washington, Seattle Probability Seminar October 24, 2016
2 Based on joint work with: Lutz Dümbgen and Malcolm Wolff
3 Outline 1: 2: 3: 4: 5: Introduction: classical LIL s. Grenander s estimator: the MLE of a decreasing density. Chernoff s distribution and tail behavior. A LIL for Grenander s estimator. Summary; further questions and open problems. UW Probability Seminar, October 24,
4 1. Introduction: Classical LIL s Setting: X 1, X 2,..., X n,... i.i.d. random variables with µ = E(X 1 ) = 0, V ar(x 1 ) = σ 2. S n n i=1 X i = nx n. Then, with Z N(0, 1), S n n = n(x n µ) d σz Theorem. (Hartman and Wintner (1941)). lim sup n lim inf n S n 2nloglogn = +σ S n 2nloglogn = σ Moreover, Strassen (1964) showed that a.s., a.s.. S n 2nloglogn [ σ, σ] a.s.... and... UW Probability Seminar, October 24,
5 with S n (t) we have S k at t = k/n, 2nloglogn linearly interp. on k/n t (k + 1)/n, k = 0, 1,..., n 1, S n σk a.s. where { K f C[0, 1] : f(t) = Corollary. t 0 f(s)ds, some f, 1 0 } f 2 (s)ds 1. lim sup n S n = lim sup 2nloglogn n S n(1) = σ sup f(1) = σ 1 f K where the supremum in the last line is achieved at f(t) = t, 0 t 1. UW Probability Seminar, October 24,
6 Connection with exponential bounds: Suppose that X i N(0, 1) for 1 i n. n 1/2 S n N(0, 1), σ = 1, and P ( n 1/2 S n > x ) = 1 Φ(x) x 1 φ(x) = 1 2π 1 x e x2 /2. Thus with b n (2loglogn) 1/2, and δ > 0, P (n 1/2 S n > (1 + δ)(2loglogn) 1/2 ) 1 1 exp( (1 + δ) 2 loglogn) 2π (1 + δ)b n C (logn) (1+δ)2 b n C b nk (klogα) (1+δ)2, n k α k, α > 1. Therefore, by the Borell-Cantelli lemma, P (n 1/2 k S nk > (1 + δ)(2loglogn k ) 1/2 i.o.) = 0. UW Probability Seminar, October 24,
7 2. Grenander s estimator X 1, X 2,..., X n are i.i.d. with density f on R + [0, ). Then Grenander s estimator f n of f is the Maximum Likelihood Estimator of f 0 over the class of decreasing densities on R + : if then f n satisfies L n (g) n 1 n i=1 log{g(x i )} = P n (logg) L n ( f n ) = max{l n (g) : g a monotone decreasing density on R + }. UW Probability Seminar, October 24,
8 Grenander (1956) showed that the maximum likelihood estimator f n of f is the (left-) derivative of the least concave majorant of the empirical distribution function F n f n = left derivative of the least concave majorant of F n, the empirical distribution of X 1,..., X n i.i.d. F UW Probability Seminar, October 24,
9 Least Concave Majorant and Empirical n = 10 UW Probability Seminar, October 24,
10 Grenander Estimator and Exp(1) density, n = 10 UW Probability Seminar, October 24,
11 Least Concave Majorant and Empirical n = 40 UW Probability Seminar, October 24,
12 Grenander Estimator and Exp(1) density, n = 40 4 UW Probability Seminar, October 24,
13 How to study f n? Groeneboom s switching relation! Switching for f n : Define ŝ n (a) argmax s 0 {F n (s) as}, a > 0 sup{s 0 : F n (s) as = sup(f n (z) az)}. z 0 Then for each fixed t (0, ) and a > 0 { f n (t) < a } = {ŝ n (a) < t}. UW Probability Seminar, October 24,
14 s n (a) t UW Probability Seminar, October 24,
15 Theorem. (Prakasa Rao (1969), Groeneboom (1985)): If f(x) > 0, f (x) < 0, and f is continuous at x, then with c (4f(x)/(f (x)) 2 ) 1/3 and C (2 1 f(x) f (x) ) 1/3, S n (x, t) n 1/3 ( f n (x + n 1/3 ct) f(x) ) where d C S(t) W is a standard two-sided Brownian motion starting at 0, and S the left - derivative of the least concave majorant C of W (t) t 2. UW Probability Seminar, October 24,
16 In particular, with t = 0, n 1/3 ( f n (x) f(x) ) d CS(0) d = C2Z where the distribution of Z argmax h {W (h) h 2 } is Chernoff s distribution. Proof: By the switching relation { f n (t) < a} = {ŝ n (a) < t}: P (n 1/3 ( f n (x 0 + n 1/3 t) f(x 0 )) < y) = P ( ˆf n (x 0 + n 1/3 t) < f(x 0 ) + yn 1/3 ), = P (ŝ n (f(x 0 ) + yn 1/3 ) < x 0 + n 1/3 t) = P (argmax v {F n (v) (f(x 0 ) + n 1/3 y)v} < x 0 + n 1/3 t) UW Probability Seminar, October 24,
17 Now we change variables v = x 0 + n 1/3 h in the argument of F n, center and scale to find: the right side in the last display equals P (argmax h {F n (x 0 + n 1/3 h) (f(x 0 ) + n 1/3 y)(x 0 + n 1/3 h)} < t) = P ( argmax h {F n (x 0 + n 1/3 h) F n (x 0 ) (F (x 0 + n 1/3 h) F (x 0 )) (1) + F (x 0 + n 1/3 h) F (x 0 ) f(x 0 )n 1/3 h n 2/3 yh} < t ). Let G n (t) n 1 n i=1 1{ξ i t}, U n (t) n(g n (t) t) with ξ i i.i.d. Uniform[0, 1]. Thus F n d = Gn (F ). The the stochastic term in (1) satisfies, with W two-sided standard Brownian motion, UW Probability Seminar, October 24,
18 n 2/3 { F n (x 0 + n 1/3 h) F n (x 0 ) (F (x 0 + n 1/3 h) F (x 0 )) } d = n 2/3 1/2 { U n (F (x 0 + n 1/3 h)) U n (F (x 0 )) } = n 1/6 { U(F (x 0 + n 1/3 h)) U(F (x 0 )) } + o p (1) by KMT d = n 1/6 W (f(x 0 )n 1/3 h) + o p (1) d = f(x 0 )W (h) + o p (1) where W is a standard two-sided Brownian motion process starting from 0. On the other hand, with δ n n 1/3, n 2/3 ( F (x 0 + n 1/3 ) F (x 0 ) f(x 0 )n 1/3 h ) = δ 2 n (F (x 0 + δ n h) F (x 0 ) f(x 0 )δ n h) b h 2 with b = f (x 0 ) /2 by our hypotheses, while n 2/3 n 1/3 n 1/3 h = n 0 h = h. UW Probability Seminar, October 24,
19 Thus it follows that the last probability above converges to P ( { argmax h aw (h) b h 2 yh } < t ) { P (Sa,b (t) < y) by switching again = where P ( (a/b) (2/3) argmax h {W (h) h 2 } (2b) 1 y < t ), by (2) below S a,b (t) = slope at t of the least concave majorant of aw (h) bh 2 f 0 (x 0 )W (h) f 0 (x 0) h 2 /2 d = 2 1 f 0 (x 0 )f 0 (x 0) S(t/c 0 ). and where we used argmax{aw (h) bh 2 } d = ( a ) 2/3 argmax{w (h) h 2 } 1 y. (2) b 2b UW Probability Seminar, October 24,
20 First appearance of Z: Chernoff (1964), Estimation of the mode: X 1,..., X n i.i.d. with density f and distribution function F. Fix a > 0; ˆx a center of the interval of length 2a containing the most observations. x a center of the interval of length 2a maximizing F (x + a) F (x a). Chernoff shows: ) 1/3 Z n 1/3 ( (ˆx a x a ) 8f(xa +a) d c where c f (x a a) f (x a + a). f Z (z) = 1 2g(z)g( z) where g(t) lim x u(t, x) = lim x t 2 u x(t, x), x t 2 UW Probability Seminar, October 24,
21 u(t, x) P (t,x) (W (z) > z 2, for some z t) is a solution to the backward heat equation t u(t, x) = 1 2 x2u(t, x) under the boundary conditions 2 u(t, t 2 ) = lim u(t, x) = 1, lim x t2 u(t, x) = 0. x UW Probability Seminar, October 24,
22 Groeneboom (1989) showed that g has Fourier transform given by ĝ(λ) = eiλs g(s)ds = Groeneboom (1989) also showed that 2 1/3 Ai(i(2) 1/3 λ) ; (3) 1 f Z (z) 2Ai (a 1 ) 44/3 z exp 2 3 z /3 a 1 z 1 P (Z > z) ( 2Ai (a 1 ) 44/31 z exp 23 ) z3 as ( ), z where a is the largest zero of the Airy function Ai on the negative real axis and Ai (a 1 ) UW Probability Seminar, October 24,
23 UW Probability Seminar, October 24,
24 4. A LIL for Grenander s estimator The tail behavior of Z given in the last display leads naturally to the following conjecture concerning a LIL for the Grenander estimator: lim sup n n 1/3 ( f n (x 0 ) f(x 0 )) ((3/2)loglogn) 1/3 = a.s. 1 2 f(x 0)f (x 0 ) 1/3 2; note that if δ > 0 and n k α k with α > 1, then exp ( 23 ) [(1 + δ)((3/2)loglogn k) 1/3 ] 3 = exp ( (1 + δ) 3 ) loglogn k Equivalently lim sup n = (logn k ) (1+δ)3 n 1/3 ( f n (x 0 ) f(x 0 )) (2loglogn) 1/3 = a.s. ( klogα) (1+δ)3). 1 2 f(x 0)f (x 0 ) 1/3 2 1 = a.s. 2 f(x 0)f (x 0 ) 1/ /3 ( ) 3 1/3 2 ( ) 3 1/3. UW Probability Seminar, October 24,
25 How to prove this conjecture? Step 1: Switching! Step 2: localize; use a functional LIL for the local empirical process: Deheuvels and Mason (1994); Mason (2004). Step 3: Find the set of limit points via 1 and 2; study these via properties of the natural Strassen limit sets analogous to the distributional equivalents for Brownian motion. Step 4: Solve the resulting variational problem over the set of limit points expressed in terms of the Strassen limit points. UW Probability Seminar, October 24,
26 Step 1: Switching. Let r n (n 1 2loglogn) 1/3. We want to find a number y 0 such that P (r 1 n ( f n (x 0 ) f(x 0 )) > y i.o.) = { 0, if y > y0, 1, if y < y 0. Now { f n (x 0 ) > a} = {ŝ n (a) > x 0 }, so { f n (x 0 ) > f(x 0 ) + r n y i.o. } = {ŝ n (f(x 0 ) + r n y) > x 0 i.o.}. (4) By letting s = x 0 + r n h in the definition of ŝ n we see that ŝ n (f(x 0 ) + r n y) x 0 = r n argmax h {F n (x 0 + r n h) f(x 0 + r n y)(x 0 + r n h)} and hence the right side of (4) can be rewritten as {ĥn > 0 i.o.} where ĥ n = argmax h {F n (x 0 + r n h) (f(x 0 ) + r n y)(x 0 + r n h)} = argmax h { r 2 n [F n (x 0 + r n h) F n (x 0 ) (F (x 0 + r n h) F (x 0 ))] + r 2 n [F (x 0 + r n h) F (x 0 ) f(x 0 )r n h] yh }. (5) UW Probability Seminar, October 24,
27 The deterministic (drift) term on the right side converges to f (x 0 )h 2 /2 as n. Step 2: LIL for the local empirical process. By a theorem of Mason (1988), the sequence of functions { r 2 n [F n (x 0 + r n h) F n (x 0 ) (F (x 0 + r n h) F (x 0 )) : h R } is almost surely relatively compact with limit set {g(f(x 0 ) ) : g G} where the two-sided Strassen limit set G is given by G = { g : R R g(t) = t 0 ġ(s)ds, t R, ġ2 (s)ds 1 Proof: Reduce to the local empirical process of ξ 1,..., ξ n i.i.d. Uniform(0, 1). As in Mason (1988), take k n nr n = n 2/3 (2loglogn) 1/3 and n 1 k n = r n 0. UW Probability Seminar, October 24, }.
28 Thus the processes involved in the argmax in (5) are almost surely relatively compact with limit set {g(f(x 0 )h) f (x 0 )h 2 yh : g G} (6) Step 3: Strassen set equivalences. Lemma 1. Let c > 0 and d R. then {t g(ct + d) g(d) : g G} = cg. [This is analogous to W (ct + d) W (d) = d cw (t).] UW Probability Seminar, October 24,
29 Lemma 2. Let α, β be positive constants and γ R. Then { argmax{αg(h) βh 2 γh} : g G } = { (α/β) 2/3 argmax h {g(h) h 2 } γ/(2β) : g G }. [This is analogous to argmax ( αw (h) βh 2 γh) ) d = (α/β) 2/3 {W (h) h 2 )} γ/(2β).] By Lemmas 1 and 2, with a = f(x 0 ), b = f (x 0 ) /2, {g(f(x 0 )h) f (x 0 )h 2 yh : g G} = {ag(h) bh 2 yh : g G} = {(a/b) 2/3 argmax{g(h) h 2 } y/(2b) : g G} UW Probability Seminar, October 24,
30 Hence with T g argmax h {g(h) h 2 }, {ĥn > 0 i.o. } { (a if y > y 0 2b(a/b) 2/3 sup g G a.s. = = { = It remains only to show that sup g G This follows from Lemma 3: b 2b ) 2/3 sup ( a b g G T g > y 2b ) 2/3 sup g G } T g > y T g = 2 1 f(x 0 )f (x 0 ) 1/3 2 sup g G T g = (3/4) 1/ } T g. UW Probability Seminar, October 24,
31 Lemma 3. Let t 0 be an arbitrary positive number and let ġ L 1 ([0, t 0 ]) be an arbitrary function satisfying t0 t ġ(s)ds 0 t2 0 0 t2 for 0 t t 0. Then, with ġ 0 (u) 2u, 0 t u, t0 0 ġ(u)2 du t0 0 ġ0(u) 2 du = t0 0 (2u)2 du = 4t UW Probability Seminar, October 24,
32 g 0 (t) and g 0 (t) t 2 UW Probability Seminar, October 24,
33 Intuition: A few pictures and trial functions ġ quickly lead to For this ġ 0 we have ġ 0 (s) 2s, 0 s t 0, 0, t 0 < s <, 0, t < 0. g 0 (t) = t 2 1 [0,t0 ] (t) + t2 0 1 (t 0, ) (t) (,0) (t). Note that ġ0 2(s)ds = t 0 0 (2s)2 ds = 4t 3 0 /3. and that g 0 (t) t 2 = { 0, t t0, t 2 0 t2, t > t 0. Thus argmax(g 0 (t) t 2 ) = t 0 while sup t 0 (g 0 (t) t 2 ) = 0 is achieved for all 0 t t 0. To force g 0 G we simply require that t 0 0 ġ2 0 (s)ds = 1 and this yields 4t3 0 /3 = 1 or t 0 = (3/4) 1/3. Proof. UW Probability Seminar, October 24,
34 6. Open questions and further problems: For the mode estimator M( f n ) of a log-concave density with mode m M(f) and f (m) < 0, we know that n 1/5 (M( f n ) M(f)) d C 2 M(H (2) ) where H (2) is the convex function given by the second derivative of the invelope process H of Y (t) t 4 + Do we have a LIL for M( f n ): lim sup n t 0 W (s)ds. n 1/5 (M( f n ) M(f)) (2loglogn) 1/5 = a.s. C 2 <? With definitions as in the last problem, do we have P (M(H (2) ) t) K 1 exp( K 2 t 5 ) for all t 0 for some K 1, K 2 <? An answer to the previous problem would start to give information about K 2! UW Probability Seminar, October 24,
35 Are the touch points of H and Y isolated? (See Groeneboom, Jongbloed, & W (2001), Groeneboom and Jongbloed (2015), page 320.) Balabdaoui and W (2014) show that Chernoff s distribution is log-concave. Is it strongly log-concave? Is there a Berry-Esseen type result for Grenander s estimator? That is, for what sequences r n do we have sup t R P ( n 1/3 ( f n (x) f(x))/c t ) P (2Z t) K r n for some K finite. UW Probability Seminar, October 24,
36 References: Chernoff s density is log- Balabdaoui, F. and Wellner, J. A. (2014). concave. Bernoulli 20, Balabdaoui, F., Rufibach, K., and Wellner, J. A. (2009). Limit distribution theory for maximum likelihood estimation of a log-concave density. Ann. Statist. 37, Chernoff, H. (1964). Estimation of the mode. Ann. Inst. Statist. Math. 16, Dümbgen, L., Wellner, J.A., and Wolff, M. (2016). A law of the iterated logarithm for Grenander s estimator. Stoch. Proc. Applic. xx, yy-zz. To appear. arxiv: v1. Groeneboom, P. (1989). Brownian motion with a parabolic drift and Airy functions. Prob. Theor. Rel. Fields 81, Groeneboom, P., Jongbloed, G., and Wellner, J.A. (2001). A canonical process for estimation of convex functions: the invelope of integrated Brownian motion +t 4. Ann. Statist. 29, Mason, D. (2004). A uniform functional law of the logarithm for the local empirical process. Ann. Prob. 32, UW Probability Seminar, October 24,
37 Mason, D. (2004). A uniform functional law of the logarithm for the local empirical process. Ann. Prob. 32, UW Probability Seminar, October 24,
Chernoff s distribution is log-concave. But why? (And why does it matter?)
Chernoff s distribution is log-concave But why? (And why does it matter?) Jon A. Wellner University of Washington, Seattle University of Michigan April 1, 2011 Woodroofe Seminar Based on joint work with:
More informationNonparametric estimation of log-concave densities
Nonparametric estimation of log-concave densities Jon A. Wellner University of Washington, Seattle Seminaire, Institut de Mathématiques de Toulouse 5 March 2012 Seminaire, Toulouse Based on joint work
More informationNonparametric estimation under Shape Restrictions
Nonparametric estimation under Shape Restrictions Jon A. Wellner University of Washington, Seattle Statistical Seminar, Frejus, France August 30 - September 3, 2010 Outline: Five Lectures on Shape Restrictions
More informationSTATISTICAL INFERENCE UNDER ORDER RESTRICTIONS LIMIT THEORY FOR THE GRENANDER ESTIMATOR UNDER ALTERNATIVE HYPOTHESES
STATISTICAL INFERENCE UNDER ORDER RESTRICTIONS LIMIT THEORY FOR THE GRENANDER ESTIMATOR UNDER ALTERNATIVE HYPOTHESES By Jon A. Wellner University of Washington 1. Limit theory for the Grenander estimator.
More informationNonparametric estimation of log-concave densities
Nonparametric estimation of log-concave densities Jon A. Wellner University of Washington, Seattle Northwestern University November 5, 2010 Conference on Shape Restrictions in Non- and Semi-Parametric
More informationNonparametric estimation: s concave and log-concave densities: alternatives to maximum likelihood
Nonparametric estimation: s concave and log-concave densities: alternatives to maximum likelihood Jon A. Wellner University of Washington, Seattle Statistics Seminar, York October 15, 2015 Statistics Seminar,
More informationShape constrained estimation: a brief introduction
Shape constrained estimation: a brief introduction Jon A. Wellner University of Washington, Seattle Cowles Foundation, Yale November 7, 2016 Econometrics lunch seminar, Yale Based on joint work with: Fadoua
More informationwith Current Status Data
Estimation and Testing with Current Status Data Jon A. Wellner University of Washington Estimation and Testing p. 1/4 joint work with Moulinath Banerjee, University of Michigan Talk at Université Paul
More informationNonparametric estimation of. s concave and log-concave densities: alternatives to maximum likelihood
Nonparametric estimation of s concave and log-concave densities: alternatives to maximum likelihood Jon A. Wellner University of Washington, Seattle Cowles Foundation Seminar, Yale University November
More informationNonparametric estimation under Shape Restrictions
Nonparametric estimation under Shape Restrictions Jon A. Wellner University of Washington, Seattle Statistical Seminar, Frejus, France August 30 - September 3, 2010 Outline: Five Lectures on Shape Restrictions
More informationBi-s -Concave Distributions
Bi-s -Concave Distributions Jon A. Wellner (Seattle) Non- and Semiparametric Statistics In Honor of Arnold Janssen, On the occasion of his 65th Birthday Non- and Semiparametric Statistics: In Honor of
More informationNonparametric estimation under shape constraints, part 2
Nonparametric estimation under shape constraints, part 2 Piet Groeneboom, Delft University August 7, 2013 What to expect? Theory and open problems for interval censoring, case 2. Same for the bivariate
More informationMaximum likelihood: counterexamples, examples, and open problems. Jon A. Wellner. University of Washington. Maximum likelihood: p.
Maximum likelihood: counterexamples, examples, and open problems Jon A. Wellner University of Washington Maximum likelihood: p. 1/7 Talk at University of Idaho, Department of Mathematics, September 15,
More informationMaximum likelihood estimation of a log-concave density based on censored data
Maximum likelihood estimation of a log-concave density based on censored data Dominic Schuhmacher Institute of Mathematical Statistics and Actuarial Science University of Bern Joint work with Lutz Dümbgen
More informationSOME CONVERSE LIMIT THEOREMS FOR EXCHANGEABLE BOOTSTRAPS
SOME CONVERSE LIMIT THEOREMS OR EXCHANGEABLE BOOTSTRAPS Jon A. Wellner University of Washington The bootstrap Glivenko-Cantelli and bootstrap Donsker theorems of Giné and Zinn (990) contain both necessary
More informationThe International Journal of Biostatistics
The International Journal of Biostatistics Volume 1, Issue 1 2005 Article 3 Score Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics Moulinath Banerjee Jon A. Wellner
More informationEstimation of a k monotone density, part 3: limiting Gaussian versions of the problem; invelopes and envelopes
Estimation of a monotone density, part 3: limiting Gaussian versions of the problem; invelopes and envelopes Fadoua Balabdaoui 1 and Jon A. Wellner University of Washington September, 004 Abstract Let
More informationNonparametric estimation under shape constraints, part 1
Nonparametric estimation under shape constraints, part 1 Piet Groeneboom, Delft University August 6, 2013 What to expect? History of the subject Distribution of order restricted monotone estimates. Connection
More informationAsymptotic normality of the L k -error of the Grenander estimator
Asymptotic normality of the L k -error of the Grenander estimator Vladimir N. Kulikov Hendrik P. Lopuhaä 1.7.24 Abstract: We investigate the limit behavior of the L k -distance between a decreasing density
More informationA generalization of Strassen s functional LIL
A generalization of Strassen s functional LIL Uwe Einmahl Departement Wiskunde Vrije Universiteit Brussel Pleinlaan 2 B-1050 Brussel, Belgium E-mail: ueinmahl@vub.ac.be Abstract Let X 1, X 2,... be a sequence
More informationMaximum Likelihood Estimation under Shape Constraints
Maximum Likelihood Estimation under Shape Constraints Hanna K. Jankowski June 2 3, 29 Contents 1 Introduction 2 2 The MLE of a decreasing density 3 2.1 Finding the Estimator..............................
More informationScore Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics
Score Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics Moulinath Banerjee 1 and Jon A. Wellner 2 1 Department of Statistics, Department of Statistics, 439, West
More informationMaximum likelihood: counterexamples, examples, and open problems
Maximum likelihood: counterexamples, examples, and open problems Jon A. Wellner University of Washington visiting Vrije Universiteit, Amsterdam Talk at BeNeLuxFra Mathematics Meeting 21 May, 2005 Email:
More informationLarge Deviations Principles for McKean-Vlasov SDEs, Skeletons, Supports and the law of iterated logarithm
Large Deviations Principles for McKean-Vlasov SDEs, Skeletons, Supports and the law of iterated logarithm Gonçalo dos Reis University of Edinburgh (UK) & CMA/FCT/UNL (PT) jointly with: W. Salkeld, U. of
More informationMathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( )
Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio (2014-2015) Etienne Tanré - Olivier Faugeras INRIA - Team Tosca October 22nd, 2014 E. Tanré (INRIA - Team Tosca) Mathematical
More informationIntroduction to Self-normalized Limit Theory
Introduction to Self-normalized Limit Theory Qi-Man Shao The Chinese University of Hong Kong E-mail: qmshao@cuhk.edu.hk Outline What is the self-normalization? Why? Classical limit theorems Self-normalized
More informationEstimation of a Convex Function: Characterizations and Asymptotic Theory
Estimation of a Convex Function: Characterizations and Asymptotic Theory Piet Groeneboom, Geurt Jongbloed, and Jon Wellner Delft University of Technology, Vrije Universiteit Amsterdam, and University of
More informationAN EXTREME-VALUE ANALYSIS OF THE LIL FOR BROWNIAN MOTION 1. INTRODUCTION
AN EXTREME-VALUE ANALYSIS OF THE LIL FOR BROWNIAN MOTION DAVAR KHOSHNEVISAN, DAVID A. LEVIN, AND ZHAN SHI ABSTRACT. We present an extreme-value analysis of the classical law of the iterated logarithm LIL
More informationPreservation Theorems for Glivenko-Cantelli and Uniform Glivenko-Cantelli Classes
Preservation Theorems for Glivenko-Cantelli and Uniform Glivenko-Cantelli Classes This is page 5 Printer: Opaque this Aad van der Vaart and Jon A. Wellner ABSTRACT We show that the P Glivenko property
More informationSelf-normalized Cramér-Type Large Deviations for Independent Random Variables
Self-normalized Cramér-Type Large Deviations for Independent Random Variables Qi-Man Shao National University of Singapore and University of Oregon qmshao@darkwing.uoregon.edu 1. Introduction Let X, X
More informationEstimation of a k-monotone density, part 2: algorithms for computation and numerical results
Estimation of a k-monotone density, part 2: algorithms for computation and numerical results Fadoua Balabdaoui 1 and Jon A. Wellner 2 University of Washington September 2, 2004 Abstract The iterative (2k
More informationAsymptotic results for empirical measures of weighted sums of independent random variables
Asymptotic results for empirical measures of weighted sums of independent random variables B. Bercu and W. Bryc University Bordeaux 1, France Workshop on Limit Theorems, University Paris 1 Paris, January
More informationLog-concave distributions: definitions, properties, and consequences
Log-concave distributions: definitions, properties, and consequences Jon A. Wellner University of Washington, Seattle; visiting Heidelberg Seminaire, Institut de Mathématiques de Toulouse 28 February 202
More informationarxiv:math/ v1 [math.st] 11 Feb 2006
The Annals of Statistics 25, Vol. 33, No. 5, 2228 2255 DOI: 1.1214/95365462 c Institute of Mathematical Statistics, 25 arxiv:math/62244v1 [math.st] 11 Feb 26 ASYMPTOTIC NORMALITY OF THE L K -ERROR OF THE
More informationBrownian Motion and Stochastic Calculus
ETHZ, Spring 17 D-MATH Prof Dr Martin Larsson Coordinator A Sepúlveda Brownian Motion and Stochastic Calculus Exercise sheet 6 Please hand in your solutions during exercise class or in your assistant s
More informationBrownian motion. Samy Tindel. Purdue University. Probability Theory 2 - MA 539
Brownian motion Samy Tindel Purdue University Probability Theory 2 - MA 539 Mostly taken from Brownian Motion and Stochastic Calculus by I. Karatzas and S. Shreve Samy T. Brownian motion Probability Theory
More informationOn the Set of Limit Points of Normed Sums of Geometrically Weighted I.I.D. Bounded Random Variables
On the Set of Limit Points of Normed Sums of Geometrically Weighted I.I.D. Bounded Random Variables Deli Li 1, Yongcheng Qi, and Andrew Rosalsky 3 1 Department of Mathematical Sciences, Lakehead University,
More informationAsymptotic results for empirical measures of weighted sums of independent random variables
Asymptotic results for empirical measures of weighted sums of independent random variables B. Bercu and W. Bryc University Bordeaux 1, France Seminario di Probabilità e Statistica Matematica Sapienza Università
More informationSelf-normalized laws of the iterated logarithm
Journal of Statistical and Econometric Methods, vol.3, no.3, 2014, 145-151 ISSN: 1792-6602 print), 1792-6939 online) Scienpress Ltd, 2014 Self-normalized laws of the iterated logarithm Igor Zhdanov 1 Abstract
More informationEstimation of a discrete monotone distribution
Electronic Journal of Statistics Vol. 3 (009) 1567 1605 ISSN: 1935-754 DOI: 10.114/09-EJS56 Estimation of a discrete monotone distribution Hanna K. Jankowski Department of Mathematics and Statistics York
More informationOn the law of the iterated logarithm for Gaussian processes 1
On the law of the iterated logarithm for Gaussian processes 1 Miguel A. Arcones 2 Suggested running head: L.I.L. for Gaussian processes We present some optimal conditions for the compact law of the iterated
More informationA note on the asymptotic distribution of Berk-Jones type statistics under the null hypothesis
A note on the asymptotic distribution of Berk-Jones type statistics under the null hypothesis Jon A. Wellner and Vladimir Koltchinskii Abstract. Proofs are given of the limiting null distributions of the
More informationTHE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, R. M. Dudley
THE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, 2011 R. M. Dudley 1 A. Dvoretzky, J. Kiefer, and J. Wolfowitz 1956 proved the Dvoretzky Kiefer Wolfowitz
More informationMarch 1, Florida State University. Concentration Inequalities: Martingale. Approach and Entropy Method. Lizhe Sun and Boning Yang.
Florida State University March 1, 2018 Framework 1. (Lizhe) Basic inequalities Chernoff bounding Review for STA 6448 2. (Lizhe) Discrete-time martingales inequalities via martingale approach 3. (Boning)
More informationarxiv: v1 [math.pr] 23 Feb 2014
HOW TALL CAN BE THE EXCURSIONS OF A RANDOM WALK ON A SPIDER? arxiv:1402.5682v1 [math.pr] 23 Feb 2014 Dedicated to the memory of Marc Yor. Antónia Földes 1 Department of Mathematics, College of Staten Island,
More informationStrong log-concavity is preserved by convolution
Strong log-concavity is preserved by convolution Jon A. Wellner Abstract. We review and formulate results concerning strong-log-concavity in both discrete and continuous settings. Although four different
More informationThe Codimension of the Zeros of a Stable Process in Random Scenery
The Codimension of the Zeros of a Stable Process in Random Scenery Davar Khoshnevisan The University of Utah, Department of Mathematics Salt Lake City, UT 84105 0090, U.S.A. davar@math.utah.edu http://www.math.utah.edu/~davar
More informationIntroduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued
Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations Research
More informationSmall ball probabilities and metric entropy
Small ball probabilities and metric entropy Frank Aurzada, TU Berlin Sydney, February 2012 MCQMC Outline 1 Small ball probabilities vs. metric entropy 2 Connection to other questions 3 Recent results for
More informationδ xj β n = 1 n Theorem 1.1. The sequence {P n } satisfies a large deviation principle on M(X) with the rate function I(β) given by
. Sanov s Theorem Here we consider a sequence of i.i.d. random variables with values in some complete separable metric space X with a common distribution α. Then the sample distribution β n = n maps X
More informationEstimation of the Bivariate and Marginal Distributions with Censored Data
Estimation of the Bivariate and Marginal Distributions with Censored Data Michael Akritas and Ingrid Van Keilegom Penn State University and Eindhoven University of Technology May 22, 2 Abstract Two new
More informationRandom Process Lecture 1. Fundamentals of Probability
Random Process Lecture 1. Fundamentals of Probability Husheng Li Min Kao Department of Electrical Engineering and Computer Science University of Tennessee, Knoxville Spring, 2016 1/43 Outline 2/43 1 Syllabus
More informationProbability and Measure
Chapter 4 Probability and Measure 4.1 Introduction In this chapter we will examine probability theory from the measure theoretic perspective. The realisation that measure theory is the foundation of probability
More informationSOLUTIONS OF SEMILINEAR WAVE EQUATION VIA STOCHASTIC CASCADES
Communications on Stochastic Analysis Vol. 4, No. 3 010) 45-431 Serials Publications www.serialspublications.com SOLUTIONS OF SEMILINEAR WAVE EQUATION VIA STOCHASTIC CASCADES YURI BAKHTIN* AND CARL MUELLER
More informationZeros of lacunary random polynomials
Zeros of lacunary random polynomials Igor E. Pritsker Dedicated to Norm Levenberg on his 60th birthday Abstract We study the asymptotic distribution of zeros for the lacunary random polynomials. It is
More informationNonlinear Analysis 71 (2009) Contents lists available at ScienceDirect. Nonlinear Analysis. journal homepage:
Nonlinear Analysis 71 2009 2744 2752 Contents lists available at ScienceDirect Nonlinear Analysis journal homepage: www.elsevier.com/locate/na A nonlinear inequality and applications N.S. Hoang A.G. Ramm
More informationf(s)ds, i.e. to write down the general solution in
1. First order ODEs. Simplest examples. Existence and uniqueness theorem Example 1.1. Consider the equation (1.1) x (t) = 1 This is an equation because there is an unknown: the function x(t). This is a
More informationLinear Independence of Finite Gabor Systems
Linear Independence of Finite Gabor Systems 1 Linear Independence of Finite Gabor Systems School of Mathematics Korea Institute for Advanced Study Linear Independence of Finite Gabor Systems 2 Short trip
More informationPart II Probability and Measure
Part II Probability and Measure Theorems Based on lectures by J. Miller Notes taken by Dexter Chua Michaelmas 2016 These notes are not endorsed by the lecturers, and I have modified them (often significantly)
More informationarxiv:math/ v2 [math.st] 17 Jun 2008
The Annals of Statistics 2008, Vol. 36, No. 3, 1031 1063 DOI: 10.1214/009053607000000974 c Institute of Mathematical Statistics, 2008 arxiv:math/0609020v2 [math.st] 17 Jun 2008 CURRENT STATUS DATA WITH
More informationOn convex least squares estimation when the truth is linear
Electronic Journal of Statistics Vol. 1 16 171 9 ISSN: 1935-754 DOI: 1.114/15-EJS198 On convex least squares estimation when the truth is linear Yining Chen and Jon A. Wellner London School of Economics
More informationNonlinear representation, backward SDEs, and application to the Principal-Agent problem
Nonlinear representation, backward SDEs, and application to the Principal-Agent problem Ecole Polytechnique, France April 4, 218 Outline The Principal-Agent problem Formulation 1 The Principal-Agent problem
More informationScaling Limits of Waves in Convex Scalar Conservation Laws under Random Initial Perturbations
Scaling Limits of Waves in Convex Scalar Conservation Laws under Random Initial Perturbations Jan Wehr and Jack Xin Abstract We study waves in convex scalar conservation laws under noisy initial perturbations.
More informationSTA205 Probability: Week 8 R. Wolpert
INFINITE COIN-TOSS AND THE LAWS OF LARGE NUMBERS The traditional interpretation of the probability of an event E is its asymptotic frequency: the limit as n of the fraction of n repeated, similar, and
More informationConcentration behavior of the penalized least squares estimator
Concentration behavior of the penalized least squares estimator Penalized least squares behavior arxiv:1511.08698v2 [math.st] 19 Oct 2016 Alan Muro and Sara van de Geer {muro,geer}@stat.math.ethz.ch Seminar
More informationNONPARAMETRIC CONFIDENCE INTERVALS FOR MONOTONE FUNCTIONS. By Piet Groeneboom and Geurt Jongbloed Delft University of Technology
NONPARAMETRIC CONFIDENCE INTERVALS FOR MONOTONE FUNCTIONS By Piet Groeneboom and Geurt Jongbloed Delft University of Technology We study nonparametric isotonic confidence intervals for monotone functions.
More information. Find E(V ) and var(v ).
Math 6382/6383: Probability Models and Mathematical Statistics Sample Preliminary Exam Questions 1. A person tosses a fair coin until she obtains 2 heads in a row. She then tosses a fair die the same number
More information1. Introduction In many biomedical studies, the random survival time of interest is never observed and is only known to lie before an inspection time
ASYMPTOTIC PROPERTIES OF THE GMLE WITH CASE 2 INTERVAL-CENSORED DATA By Qiqing Yu a;1 Anton Schick a, Linxiong Li b;2 and George Y. C. Wong c;3 a Dept. of Mathematical Sciences, Binghamton University,
More informationn E(X t T n = lim X s Tn = X s
Stochastic Calculus Example sheet - Lent 15 Michael Tehranchi Problem 1. Let X be a local martingale. Prove that X is a uniformly integrable martingale if and only X is of class D. Solution 1. If If direction:
More informationarxiv:math/ v2 [math.st] 17 Jun 2008
The Annals of Statistics 2008, Vol. 36, No. 3, 1064 1089 DOI: 10.1214/009053607000000983 c Institute of Mathematical Statistics, 2008 arxiv:math/0609021v2 [math.st] 17 Jun 2008 CURRENT STATUS DATA WITH
More informationDistributed MAP probability estimation of dynamic systems with wireless sensor networks
Distributed MAP probability estimation of dynamic systems with wireless sensor networks Felicia Jakubiec, Alejandro Ribeiro Dept. of Electrical and Systems Engineering University of Pennsylvania https://fling.seas.upenn.edu/~life/wiki/
More informationON THE PATHWISE UNIQUENESS OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS
PORTUGALIAE MATHEMATICA Vol. 55 Fasc. 4 1998 ON THE PATHWISE UNIQUENESS OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS C. Sonoc Abstract: A sufficient condition for uniqueness of solutions of ordinary
More informationOn continuous time contract theory
Ecole Polytechnique, France Journée de rentrée du CMAP, 3 octobre, 218 Outline 1 2 Semimartingale measures on the canonical space Random horizon 2nd order backward SDEs (Static) Principal-Agent Problem
More informationBrownian Motion. 1 Definition Brownian Motion Wiener measure... 3
Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................
More informationAsymptotic Properties of an Approximate Maximum Likelihood Estimator for Stochastic PDEs
Asymptotic Properties of an Approximate Maximum Likelihood Estimator for Stochastic PDEs M. Huebner S. Lototsky B.L. Rozovskii In: Yu. M. Kabanov, B. L. Rozovskii, and A. N. Shiryaev editors, Statistics
More information1 Sequences of events and their limits
O.H. Probability II (MATH 2647 M15 1 Sequences of events and their limits 1.1 Monotone sequences of events Sequences of events arise naturally when a probabilistic experiment is repeated many times. For
More informationFunctional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals
Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals Noèlia Viles Cuadros BCAM- Basque Center of Applied Mathematics with Prof. Enrico
More informationThe Convergence Rate for the Normal Approximation of Extreme Sums
The Convergence Rate for the Normal Approximation of Extreme Sums Yongcheng Qi University of Minnesota Duluth WCNA 2008, Orlando, July 2-9, 2008 This talk is based on a joint work with Professor Shihong
More informationPreservation Theorems for Glivenko-Cantelli and Uniform Glivenko-Cantelli Classes
Preservation Theorems for Glivenko-Cantelli and Uniform Glivenko-Cantelli Classes Aad van der Vaart and Jon A. Wellner Free University and University of Washington ABSTRACT We show that the P Glivenko
More informationQuick Tour of Basic Probability Theory and Linear Algebra
Quick Tour of and Linear Algebra Quick Tour of and Linear Algebra CS224w: Social and Information Network Analysis Fall 2011 Quick Tour of and Linear Algebra Quick Tour of and Linear Algebra Outline Definitions
More informationNONPARAMETRIC ESTIMATION OF MULTIVARIATE CONVEX-TRANSFORMED DENSITIES. By Arseni Seregin, and Jon A. Wellner, University of Washington
Submitted to the Annals of Statistics arxiv: math.st/0911.4151v1 NONPARAMETRIC ESTIMATION OF MULTIVARIATE CONVEX-TRANSFORMED DENSITIES By Arseni Seregin, and Jon A. Wellner, University of Washington We
More informationMATH 220 solution to homework 5
MATH 220 solution to homework 5 Problem. (i Define E(t = k(t + p(t = then E (t = 2 = 2 = 2 u t u tt + u x u xt dx u 2 t + u 2 x dx, u t u xx + u x u xt dx x [u tu x ] dx. Because f and g are compactly
More informationShape constrained kernel density estimation
Shape constrained kernel density estimation Melanie Birke Ruhr-Universität Bochum Fakultät für Mathematik 4478 Bochum, Germany e-mail: melanie.birke@ruhr-uni-bochum.de March 27, 28 Abstract In this paper,
More informationErgodic Theorems. Samy Tindel. Purdue University. Probability Theory 2 - MA 539. Taken from Probability: Theory and examples by R.
Ergodic Theorems Samy Tindel Purdue University Probability Theory 2 - MA 539 Taken from Probability: Theory and examples by R. Durrett Samy T. Ergodic theorems Probability Theory 1 / 92 Outline 1 Definitions
More information1 Delayed Renewal Processes: Exploiting Laplace Transforms
IEOR 6711: Stochastic Models I Professor Whitt, Tuesday, October 22, 213 Renewal Theory: Proof of Blackwell s theorem 1 Delayed Renewal Processes: Exploiting Laplace Transforms The proof of Blackwell s
More informationAn Overview of the Martingale Representation Theorem
An Overview of the Martingale Representation Theorem Nuno Azevedo CEMAPRE - ISEG - UTL nazevedo@iseg.utl.pt September 3, 21 Nuno Azevedo (CEMAPRE - ISEG - UTL) LXDS Seminar September 3, 21 1 / 25 Background
More informationOn the length of the longest consecutive switches
On the length of the longest consecutive switches arxiv:8.0454v [math.pr] 2 Nov 208 Chen-Xu Hao, Ze-Chun Hu and Ting Ma College of Mathematics, Sichuan University, China November 3, 208 Abstract An unbiased
More informationUNIFORM IN BANDWIDTH CONSISTENCY OF KERNEL REGRESSION ESTIMATORS AT A FIXED POINT
UNIFORM IN BANDWIDTH CONSISTENCY OF KERNEL RERESSION ESTIMATORS AT A FIXED POINT JULIA DONY AND UWE EINMAHL Abstract. We consider pointwise consistency properties of kernel regression function type estimators
More informationA connection between the stochastic heat equation and fractional Brownian motion, and a simple proof of a result of Talagrand
A connection between the stochastic heat equation and fractional Brownian motion, and a simple proof of a result of Talagrand Carl Mueller 1 and Zhixin Wu Abstract We give a new representation of fractional
More informationSome Background Math Notes on Limsups, Sets, and Convexity
EE599 STOCHASTIC NETWORK OPTIMIZATION, MICHAEL J. NEELY, FALL 2008 1 Some Background Math Notes on Limsups, Sets, and Convexity I. LIMITS Let f(t) be a real valued function of time. Suppose f(t) converges
More informationStat 710: Mathematical Statistics Lecture 31
Stat 710: Mathematical Statistics Lecture 31 Jun Shao Department of Statistics University of Wisconsin Madison, WI 53706, USA Jun Shao (UW-Madison) Stat 710, Lecture 31 April 13, 2009 1 / 13 Lecture 31:
More informationOn large deviations for combinatorial sums
arxiv:1901.0444v1 [math.pr] 14 Jan 019 On large deviations for combinatorial sums Andrei N. Frolov Dept. of Mathematics and Mechanics St. Petersburg State University St. Petersburg, Russia E-mail address:
More informationMakarov s LIL for SLE
Makarov s LIL for SLE Nam-Gyu Kang Department of Mathematics, M.I.T. Workshop at IPAM, 2007 Nam-Gyu Kang (M.I.T.) Makarov s LIL for SLE Workshop at IPAM, 2007 1 / 24 Outline 1 Introduction and Preliminaries
More informationPERCOLATION IN SELFISH SOCIAL NETWORKS
PERCOLATION IN SELFISH SOCIAL NETWORKS Charles Bordenave UC Berkeley joint work with David Aldous (UC Berkeley) PARADIGM OF SOCIAL NETWORKS OBJECTIVE - Understand better the dynamics of social behaviors
More informationKrzysztof Burdzy University of Washington. = X(Y (t)), t 0}
VARIATION OF ITERATED BROWNIAN MOTION Krzysztof Burdzy University of Washington 1. Introduction and main results. Suppose that X 1, X 2 and Y are independent standard Brownian motions starting from 0 and
More informationFUNCTIONAL LAWS OF THE ITERATED LOGARITHM FOR THE INCREMENTS OF THE COMPOUND EMPIRICAL PROCESS 1 2. Abstract
FUNCTIONAL LAWS OF THE ITERATED LOGARITHM FOR THE INCREMENTS OF THE COMPOUND EMPIRICAL PROCESS 1 2 Myriam MAUMY Received: Abstract Let {Y i : i 1} be a sequence of i.i.d. random variables and let {U i
More information1. Introduction. Consider a single cell in a mobile phone system. A \call setup" is a request for achannel by an idle customer presently in the cell t
Heavy Trac Limit for a Mobile Phone System Loss Model Philip J. Fleming and Alexander Stolyar Motorola, Inc. Arlington Heights, IL Burton Simon Department of Mathematics University of Colorado at Denver
More informationBrownian Motion and Conditional Probability
Math 561: Theory of Probability (Spring 2018) Week 10 Brownian Motion and Conditional Probability 10.1 Standard Brownian Motion (SBM) Brownian motion is a stochastic process with both practical and theoretical
More informationOn the Kolmogorov exponential inequality for negatively dependent random variables
On the Kolmogorov exponential inequality for negatively dependent random variables Andrei Volodin Department of Mathematics and Statistics, University of Regina, Regina, SK, S4S 0A, Canada e-mail: volodin@math.uregina.ca
More informationThe Chaotic Character of the Stochastic Heat Equation
The Chaotic Character of the Stochastic Heat Equation March 11, 2011 Intermittency The Stochastic Heat Equation Blowup of the solution Intermittency-Example ξ j, j = 1, 2,, 10 i.i.d. random variables Taking
More information