Editorial Manager(tm) for Lifetime Data Analysis Manuscript Draft. Manuscript Number: Title: On An Exponential Bound for the Kaplan - Meier Estimator

Size: px
Start display at page:

Download "Editorial Manager(tm) for Lifetime Data Analysis Manuscript Draft. Manuscript Number: Title: On An Exponential Bound for the Kaplan - Meier Estimator"

Transcription

1 Editorial Managertm) for Lifetime Data Analysis Manuscript Draft Manuscript Number: Title: On An Exponential Bound for the Kaplan - Meier Estimator Article Type: SI-honor of N. Breslow invitation only) Section/Category: Keywords: random censoring; right censoring; product limit estimator; inequalities; universal limit theorems; uniform limit theorems; confidence bands; empirical distribution Corresponding Author: Prof. J. A Wellner, Corresponding Author's Institution: University Of Washington First Author: J. A Wellner Order of Authors: J. A Wellner Manuscript Region of Origin: Abstract:

2 * Title Page w/ ALL Author Contact Info. On An Exponential Bound for the Kaplan - Meier Estimator Jon A. Wellner University of Washington Abstract: We review limit theory and inequalities for the Kaplan-Meier product limit estimator of a survival function on the whole line R. Along the way we provide bounds for the constant in an interesting inequality due to Bitouzé, Laurent, and Massart, and provide some numerical evidence in support of one of their conectures. Jon A. Wellner University of Washington Department of Statistics Box Seattle, WA - aw@stat.washington.edu Supported in part by NSF grant DMS-0 and by NI-AID grant R0 AI- 0 AMS 000 subect classifications: Primary G, G0; secondary G0 Keywords and phrases: random censoring, right censoring, product limit estimator, inequalities, universal limit theorems, uniform limit theorems, confidence bands, empirical distribution

3 * Title Page w/ ALL Author Contact Info On An Exponential Bound for the Kaplan - Meier Estimator Jon A. Wellner University of Washington Abstract: We review limit theory and inequalities for the Kaplan-Meier Kaplan and Meier ) product limit estimator of a survival function on the whole line R. Along the way we provide bounds for the constant in an interesting inequality due to Bitouzé, Laurent and Massart ), and provide some numerical evidence in support of one of their conectures.. Introduction: the Kaplan-Meier estimator Suppose that X,...,X n,... are independent and identically distributed with distribution function F, and suppose that Y,...,Y n are independent and identically distributed with distribution function G. Suppose that we only observe W i = Z i,δ i ) where Z i = X i Y i, δ i = Xi Y i ]. Typically in survival analysis the X i s represent lifetimes and the Y i s represent censoring times. The above model for right-)censored data is sometimes called the random right censoring model. Define the empirical sub-distribution functions of the uncensored and censored Z s by and define Λ n by Λ n x) = H uc n z) = n H c n z) = n n δ i Zi z], i= n δ i ) Zi z], i= H n z) = H uc n z) + H c nz),,x] H n z ) dhuc n z). Supported in part by NSF grant DMS-0 and by NI-AID grant R0 AI- 0 AMS 000 subect classifications: Primary G, G0; secondary G0 Keywords and phrases: random censoring, right censoring, product limit estimator, inequalities, universal limit theorems, uniform limit theorems, confidence bands, empirical distribution

4 0 0 0 Wellner/Exponential Bound for Kaplan - Meier Then the Kaplan-Meier or product limit) estimator F n of the distribution function F is defined by F n x) = z x Λ n z)) = z:z i x ) n δi Ri n R i + where R i is the rank of Z i, δ i ) in the set {Z, δ ), =,...,n} with lexicographical ordering. For the empirical distribution function F n of the X i s, we know from Dvoretzky, Kiefer and Wolfowitz ) and Massart 0) that P n F n F > λ) exp λ ) ) for all λ > 0. In the spirit of the exponential bound ), Bitouzé, Laurent and Massart ) established the following exponential bound for the supremum distance between F n and F weighted by G: Theorem. Let F n be the Kaplan-Meier estimator of the distribution function F. There is an absolute constant C such that, for any λ > 0, P n G) F n F) > λ).exp λ + Cλ). ) As noted by Bitouzé, Laurent and Massart ), Of course, it would be desirable to compute C, but unfortunately, our techniques are not sharp enough to do that efficiently. One goal of this paper is to provide the following bound for the constant C: Proposition. The constant C in ) satisfies C. In the course of the proof of this proposition, we also provide explicit bounds on the constants involved in the bracketing entropy for bounded monotone functions given in Theorem.. of van der Vaart and Wellner ); see Theorem below. This bound on the numerical constants in that theorem may be of independent interest. Bitouzé, Laurent and Massart ) also say page ) that: We do not know whether the inequality P n G) b F n F) > λ) exp λ ) ) holds or not for the Kaplan-Meier estimator. Indeed, this is a natural question since on the one hand we know... that it holds asymptotically, and on the other hand that it is valid for all n in the non censored case see Massart 0)). Inequality ) does not of course imply ), but can be considered as a first step toward such a result.

5 0 0 0 Wellner/Exponential Bound for Kaplan - Meier Of course the bound provided by Proposition is absurdly large, especially in view of the numerical evidence in favor of ), but it gives a strong indication of the limitations of the current method of proof. Significant improvements of the current bound will likely involve the use of local entropy as discussed in van de Geer ) and van de Geer 000), or improvements of the bracketing entropy bound obtained here in Theorem, or both. Here is some numerical evidence in support of ). The following two scenarios and plots have been selected from a list of about thirty different scenarios. The first scenario is F = exponential), G = Uniform0, ], n = 00, and m = 00 Monte-Carlo replications. The dashed line shows the conectured bound exp λ ) ), while the solid line is the empirical survival function or one minus the empirical distribution function) for the m = 00 computed values of n G) F n F). In the second scenario, F = exponential), Gt) = t/).0, n = 00, and m = 00. The dashed line shows the conectured bound exp λ ) ), while the solid line is the empirical survival function or one minus the empirical distribution function) for the m = 00 computed values of n G) F n F) Fig. Empirical survival function solid) and conectured bound dashed) n = 00, F = exponential), G = Uniform0, )

6 Wellner/Exponential Bound for Kaplan - Meier 0... Fig. Empirical survival function solid) and conectured bound dashed) n = 00, F = exponential), Gt) = t/).0. Bracketing entropy for monotone functions Let F denote a class of uniformly bounded monotone functions on the real line; without loss we assume that f : R 0,] for all f F. Theorem. The class F of monotone functions f : R 0,] satisfies log N ], F,L r Q)) K r for every probability measure Q, every r, and a constant K r = C r r r + C r )) /r logl r) where C r = / /) /) ) and L r = /r + ). In particular C. and K.. Proof. This is proved in Section.. of van der Vaart and Wellner ), pages -. The constant follows from that proof by careful bookkeeping; see Section for details.. Limit theory for the Kaplan - Meier estimator In this section we give a very brief review of known limit theory for the Kaplan - Meier estimator F n, with emphasis on results that hold on either

7 0 0 0 Wellner/Exponential Bound for Kaplan - Meier all R or large subintervals of 0,τ H ] where, for any distribution function F, let τ F inf{t : Ft) = }. Donsker theorems: The original weak convergence theorem for the Kaplan-Meier estimator established by Breslow and Crowley ) showed that n Fn F) F)BC) in D0,T] ) for fixed T < τ H where B is a standard Brownian motion process on 0, ) and Ct) H ) dhuc = 0,t] F ) G ) df. 0,t] It was noted by Hall and Wellner 0) that ) could be rephrased as n K F F n F) B 0 K) in D0,T] ) where B 0 is a standard Brownian bridge process on 0,] and K C/+C). The weak convergence result in ) was improved to a strong approximation result by Burke, Csörgő and Horváth ) as follows: consider intervals of the form 0,T n ] with T n ր τ H satisfying HT n ) δ log n/n) / where δ > 0. Then F n can be defined on a common probability space with a sequence of) Brownian motion processes) B n so that Pr sup 0 t T n n F n t) Ft)) Ft))B n t) r n ) Cn δ where C is a constant, b n / HT n )), and r n = Omax{n / b nlog n) /, n / b n log n, n / b nlog n) }). In a different direction, Gill ) showed that { } n K F F Zn) n F) B 0 K) in D0,τ H ] ) where Z n) max i n Z i and for any process W the stopped process W T W T). Moreover, Gill ) showed that if then τh 0 df G <, ) { n } Zn) Fn F) F)BC) in D0,τH ] )

8 0 0 0 and Wellner/Exponential Bound for Kaplan - Meier { n K } Zn) F F n F) B 0 K) in D0,τ H ]. ) These conclusions were strengthened by Ying ) who showed that stopping of the process at Z n) is not needed; e.g. and if ) holds, then and n K F F n F) B 0 K) in D0,τ H ], ) n Fn F) F)BC) in D0,τ H ] ) K n F F n F) B 0 K) in D0,τ H ]. ) On the other hand Chen and Ying ) showed that ) can fail if ) does not hold, providing a counterexample to a conecture of Hall and Wellner 0). See Gillespie and Fisher ), Nair ), Csörgő and Horváth ), Hollander and Peña ), Hollander, McKeague and Yang ), and McKeague and Zhao 00) for other related work on confidence bands. Glivenko-Cantelli theorems: After incorrect proofs of Glivenko-Cantelli type theorems for the Kaplan-Meier estimator by Gill 0) and Shorack and Wellner ), Wang ) succeeded in establishing the first correct and clean) theorem. Wang showed that always hold, and hence that sup t<τ H Ft) Ft) p 0, and ) sup t<z n) Ft) Ft) p 0 ) sup Ft) Ft) p 0 ) t τ H if and only if Gτ H ) < or Fτ H ) = F {τ H } = 0. Wang ) also pointed out an error in Shorack and Wellner ) and gave a correct statement of the result which could be proved by the methods used by Shorack and Wellner. Stute and Wang ) showed that ) also holds with a.s. under the same conditions. Gill ) provided an alternative proof of the result of Stute and Wang ). Stute a) obtained a

9 0 0 0 Wellner/Exponential Bound for Kaplan - Meier weighted Glivenko-Cantelli type theorem by showing that if ψ = ψ + ψ is a U type weight function where ψ is and ψ is, then if it follows that τh 0 ψdf <, df <, and G τh ψ 0 sup ψt) F n t) Ft) p 0. t τ H df <, C / df <, Stute a) also indicated how this could be extended to an almost sure result. Univeral approximation theorems on increasing sets: Gu and Lai 0) and Gu ) apparently initiated the study of sup t Z n kn) Λ n t) Λt) sup F n t) Ft) t Z n kn) Ft) = O ) for k n {,...,n }. Stute b) continued this study and showed that if n k n )/n and k n /log n, then for each > 0 log n) + almost surely, and k n + sup t Z n kn)) F n t) Ft) = Oγ n ). sup t Z n kn) Λ n t) Λt) = log n)+)/ kn ) Oγ n ) The results of Stute b) were improved and sharpened by Csörgő ) who showed that log ) O n kn almost surely ) O p kn in probability. ) and similarly with the left side in ) replaced by the supremum in ). The almost sure part of Csörgő s bounds were further improved by Giné and Guillou ) who showed that the log n in the almost sure bounds can be replaced by log log n. Alternative derivations of limit theory for the Kaplan - Meier estimator F n under the assumption of constant censoring times have been given by Meier ) and Pollard 0). It would be interesting to try to extend the results of these authors to the whole line or 0,τ H ] with some appropriate re-definition of 0,τ H ]. For a treatment of some rate of convergence results in the encompassing framework of variable censoring in which each censoring time Y i is allowed to have its own distribution G i, see Csörgő and Horváth ), section, pages -.

10 Proof of Proposition Wellner/Exponential Bound for Kaplan - Meier From Theorem of Bitouzé, Laurent and Massart ), the proof on page, and rephrasing in the notation of van der Vaart and Wellner ), it follows that ) k P sup sup n G λ kf) > λ + c 0 σ + c ϕ 0 ) k n f F.e H 0) exp λ /a ) ) where c =./, c =., 0 < 0 <, sup f F V ar P f) σ a /, and t t ϕt) = log N ] x, F,L P)) dx Hx) dx. 0 In the context of Bitouzé, Laurent and Massart ), Corollary, ϕt) t 0 γ/xdx = γt / where γ K. by Theorem, so the inequality in ) becomes ) k P sup sup n G kf) > λ + c 0 ) + c 0 k n f F where c = γc = K c =. K. Set ξ λ + c 0 ) + c 0 ; then for ξ c 0, P sup sup k n f F Note that for 0 < /c we have 0.e γ/ 0 exp λ /a ) ) ) k n G kf) > ξ.e γ/ 0 exp a ξ c 0 + c 0 ) ξ c 0 ξ c 0 ) c 0 ) + c 0 ) ) ξ c 0 ξ c 0 ξ c 0 ) ξ c 0 ξ c 0 ξ.. 0) Taking 0 = b/ξ /c ) for a constant b which will be chosen appropri-

11 0 0 0 Wellner/Exponential Bound for Kaplan - Meier ately) so that ξ bc, the bound becomes γξ. exp b + c ξ a b + c ) bξ a exp ξ /a ) ) =.exp a γc ) / ξ + c γ / ξ a c /a ) / exp ξ /a ) by choosing b = a γ/c ) so that ξ ac γ/c ) = a γc, and hence ξ aγc ) /,.exp a γc ) / ξ + c c /a ) c c /a ) / γ/ ξ exp ξ /a ).exp a γc ) / ξ + c ) ξ c /a ) / c aγc ) /γ/ ξ exp ξ /a ) =.exp a γc ) / ξ + c c /a ) / )exp ξ c ac ) /ξ /a ) { ) } =.exp a γc ) / + / c a ξ exp ξ /a ). c In our particular problem which corresponds to Theorem of Bitouzé, Laurent and Massart )), a = from Bitouzé, Laurent and Massart ), proof of Theorem, pages -), and γ = K is given by Theorem above, so we calculate a γc ) / + / c a c.. Note that the bound of ) holds trivially for λ = ξ. since the right side with the above choice of C is for all such values of λ; thus the exponential bound holds trivially for λ = ξ < bc.. This completes the proof of Proposition.. Proof of Theorem Proof. Let G denote the collection of all distribution functions concentrated on 0,] i.e. corresponding to the distributions of random variables V with V 0,] with probability ). As shown in van der Vaart and Wellner ), we can reduce to finding a bound for log N ], G,L r λ)) for the uniform probability measure λ on 0,] i.e. Lebesgue measure). We say F L is a left bracket for F G if F L x) Fx) for all x 0,], and F L F λ,r ; similarly, F R is a right bracket for F G if F R x) Fx) for all x 0,], and F R F λ,r. To obtain an upper bound for the bracketing number for the class G, the key is to define left and right brackets and count the number require to cover G. As in the proof

12 0 0 0 Wellner/Exponential Bound for Kaplan - Meier of Theorem.. in van der Vaart and Wellner ) which is based on van de Geer ) who, in turn, used results and methods of Birman and Solomak )), the idea here is based on different levels of partitioning of the unit interval 0,]. At each level of partitioning, the class G is partitioned into finitely many subsets. Then we construct left and right brackets, so that they have size proportional to), and find an upper bound for the total number of brackets. Fix > 0. Let c = /r. Fix F G. Let P 0 be the trivial) partition of the unit interval 0 = u 0) 0 < u 0) =. The i-th partition P i of 0,] is of the form 0 = u i) 0 < u i) < < u i) =. n i) Given a partition P i, define i i F) = ] max Fu i) n i) ) Fui) ) u i) u i) )/r). To form the next partition P i+ P i, find all the intervals in u i),ui) ] in the partition P i that satisfy ] Fu i) ) Fui) ) u i) u i) )/r c i. ) Then, the partition P i+ is obtained from P i by dividing all the intervals u i),ui) ) that satisfy ) into two halves of equal length. The partition P i+ is obtained by forming S i+) = u i+),ui+) ], where {,,...,n i+) }. Let u i+) ] be an interval in the partition P i+ that is contained in,ui+) the interval u i),ui) ] in partition P i. If ) is not satisfied for an interval u i),ui) ], then Fu i+) = If ) is satisfied for u i) and It follows that ] ) Fu i+) ) u i+) u i+) )/r ] Fu i) ) Fui) ) u i) u i) )/r i+ c i.,ui) ) in P i, then u i+) Fu i+) ) Fu i+) ) Fui) ) Fui) ). Fu i+) c This shows again that i+ c i. ] ) Fu i+) ) u i+) u i+) )/r ] Fu i) ) Fui) ) u i) u i) )/r. u i+) ) = ui) u i),

13 0 0 0 Wellner/Exponential Bound for Kaplan - Meier On the other hand, let u i),ui) ] be an interval in the partition P i that satisfies ) and ] i = Fu i) ) Fui) ) u i) u i) )/r. It follows from the definition of i+ that i+ Hence, we have F u i) + F u i) + u i) ) ) ] F u i) u i) ) F u i) + u i) )] u i) ui) ] = c Fu i) ) Fui) ) u i) u ) i) /r = ci. + u i) ) /r u i) + u i) )/r i+ c i i+. ) Let n i n i F) = n i) be the number of intervals in the partition P i. Let s i = n i+ n i be the number of intervals in P i that are divided to obtain P i+. It follows from the definitions of s i, i and Hölder s inequality with p = r + )/r and q = r + ) that s i c i ) r Therefore Consequently, n i) = = ] Fu i) r ) Fui) ) u i) u i) ) n i) ) Fu i) ) F ku i) ) =. i n = i + = since i = Note that, by ), i s i i + = s i c i ) r. i c i ) r = c i ) r ic r c i i + i + c r r n i) = u i) u i) i = 0 = i /) i. i + c i c. ) c i ) r

14 0 0 0 This implies that Thus, i n = Then, we have T i ) It follows that Hence, i = Wellner/Exponential Bound for Kaplan - Meier c i ) r c )r c )r r Ti = + = T i i = i = r i. ) r i T i r i. ) ) ) i ) i i ) i ) i = i ) i ) ] C r). ) n C r) r i. ) The above partitions P 0 P are generated by a fixed function F G. Two monotone functions F and G are said to be equivalent at level i if their partitions up to the ith level are the same. As we continue the partitioning process, the class G is equivalently partitioned into a finite number of subsets. Let L denote the first such level of partition that L F) r for every F in that subset of G. For each subset and i, define i = sup i F), F where F ranges over the subset of G in the final level partition. Note that the number of intervals n 0 n n i only depends on the sequence of partitions P 0 P P i. Thus, the i in the inequality ) can be replaced by i. To obtain the upper bound for the bracketing number N ], G,L r λ)), we first find an upper bound for the total number of different final partitions. By definition of the L th level partition, we know that there exists a function G G such that L G) r > at the L )th level partition. This implies that L G) r /. Then it follows from ) that L = n C r) r L C r)..

15 0 0 0 Since n L n L, then we have Wellner/Exponential Bound for Kaplan - Meier = n 0 n n L C, ) where C Cr) = C r) = /) /)]. To count the number of sequences n 0 n n L C/, note that this is equivalent to picking L numbers out of {,,,..., C/ }, and this is easily seen to be is C/ ) L, which is bounded by C/. For a given sequence n 0 n n L, the number of ways to obtain P i+ from P i is n i ) s i which is bounded by n i. Thus, the total number of different final partitions of the form P 0 P P L when F ranges over G is bounded by C/ n n L C/ since L i= n i C/. We now define the bracket F l,f r ] for a fixed function F G in the final stage partition P L. For u 0,], let and F l u) = n L) = F r u) = n L) = { ) F u L) / { F u L) ) / S L) S L) } u), } u). For u S L), it follows from ), the definitions of the brackets, and L that ) F r u) F l u) F u L) ) + F u L) ) ) = + F u L) F u L) L + ) /r + u L) u L) L u L) u L) ) /r.

16 0 0 0 Wellner/Exponential Bound for Kaplan - Meier Thus, we have, using the inequality x + y r r { x r + y r }, F r u) F l u) r λ,r n L) + L = u L) u L) )/r { n L) r ) r + L ) r = n L) = r )r = u L) ] λs L) ) + L ) r r u L) λs L) ) n L) = ]} λs L) ) λs L) ) u L) u L) ] { = r ) r + L ) r n L)} { ]} C r ) r + = r r + C) r ) by ). Here we have also used the fact that λ is the uniform distribution, and hence u L) u L) = λsl) ). The inequality ) implies that the brackets F l,f r ] have the right size. Now we count how many brackets can be constructed on the final stage partition P L when F ranges over the subset of G for a given sequence of partitions P 0 P P L. Let Fu ) l =, r = Fu ) As argued in van der Vaart and Wellner ), page, the number of left brackets for a given final partition is at most L C/ with L = /c + ) = /r +), and similarly for the number of right brackets. Thus we conclude that N r ] r + C) ] ) /r, G,Lr λ) or, equivalently That is,. C/ L C/ L C/ = L ) C/, log N r ] r + C) ] ) /r, G,Lr λ) log N ], G,L r λ)) K, C logl ). where K = Kr) C logl )] r r + C) ] /r. Combining this with the conclusion of the reduction step at the beginning of the proof yields the stated bound.

17 Acknowledgements Wellner/Exponential Bound for Kaplan - Meier I owe thanks to John Crowley for stimulating my interest in the Kaplan- Meier estimator during conversations in Seattle in - concerning his work with Norman Breslow on the asymptotic theory of the Kaplan-Meier estimator. I also owe thanks to Richard Gill for his many probing questions and challenges about censored data over the years, and to Shuguang Song for help with the computation of the constants in Theorem. References Birman, M. Š. and Solomak, M. Z. ). Piecewise polynomial approximations of functions of classes W α p. Mat. Sb. N.S.) ). Bitouzé, D., Laurent, B. and Massart, P. ). A Dvoretzky-Kiefer- Wolfowitz type inequality for the Kaplan-Meier estimator. Ann. Inst. H. Poincaré Probab. Statist.. Breslow, N. and Crowley, J. ). A large sample study of the life table and product limit estimates under random censorship. Ann. Statist.. Burke, M. D., Csörgő, S. and Horváth, L. ). Strong approximations of some biometric estimates under random censorship. Z. Wahrsch. Verw. Gebiete. Chen, K. and Ying, Z. ). A counterexample to a conecture concerning the Hall-Wellner band. Ann. Statist.. Csörgő, S. ). Universal Gaussian approximations under random censorship. Ann. Statist.. Csörgő, S. and Horváth, L. ). The rate of strong uniform consistency for the product-limit estimator. Z. Wahrsch. Verw. Gebiete. Csörgő, S. and Horváth, L. ). Confidence bands from censored samples. Canad. J. Statist.. Dvoretzky, A., Kiefer, J. and Wolfowitz, J. ). Asymptotic minimax character of the sample distribution function and of the classical multinomial estimator. Ann. Math. Statist.. Gill, R. ). Large sample behaviour of the product-limit estimator on the whole line. Ann. Statist.. Gill, R. D. 0). Censoring and stochastic integrals, vol. of Mathematical Centre Tracts. Mathematisch Centrum, Amsterdam.

18 0 0 0 Wellner/Exponential Bound for Kaplan - Meier Gill, R. D. ). Glivenko-Cantelli for Kaplan-Meier. Math. Methods Statist.. Gillespie, M. J. and Fisher, L. ). Confidence bands for the Kaplan- Meier survival curve estimate. Ann. Statist. 0. Giné, E. and Guillou, A. ). Laws of the iterated logarithm for censored data. Ann. Probab Gu, M. ). The Chung-Smirnov law for the product-limit estimator under random censorship. Chinese Ann. Math. Ser. B. A Chinese summary appears in Chinese Ann. Math. Ser. A ), no.,. Gu, M. G. and Lai, T. L. 0). Functional laws of the iterated logarithm for the product-limit estimator of a distribution function under random censorship or truncation. Ann. Probab.. Hall, W. J. and Wellner, J. A. 0). Confidence bands for a survival curve from censored data. Biometrika. Hollander, M., McKeague, I. W. and Yang, J. ). Likelihood ratio-based confidence bands for survival functions. J. Amer. Statist. Assoc.. Hollander, M. and Peña, E. ). Families of confidence bands for the survival function under the general random censorship model and the Koziol-Green model. Canad. J. Statist.. Kaplan, E. L. and Meier, P. ). Nonparametric estimation from incomplete observations. J. Amer. Statist. Assoc.. Massart, P. 0). The tight constant in the Dvoretzky-Kiefer-Wolfowitz inequality. Ann. Probab.. McKeague, I. W. and Zhao, Y. 00). Width-scaled confidence bands for survival functions. Statist. Probab. Lett.. Meier, P. ). Estimation of a distribution function from incomplete observations. In Perspectives in probability and statistics papers in honour of M. S. Bartlett on the occasion of his th birthday). Applied Probability Trust, Univ. Sheffield, Sheffield,. Nair, V. N. ). Plots and tests for goodness of fit with randomly censored data. Biometrika. Pollard, D. 0). Empirical processes: theory and applications. NSF- CBMS Regional Conference Series in Probability and Statistics,, Institute of Mathematical Statistics, Hayward, CA.

19 0 0 0 Wellner/Exponential Bound for Kaplan - Meier Shorack, G. R. and Wellner, J. A. ). Empirical processes with applications to statistics. Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics, John Wiley & Sons Inc., New York. Stute, W. a). Convergence of the Kaplan-Meier estimator in weighted sup-norms. Statist. Probab. Lett. 0. Stute, W. b). Strong and weak representations of cumulative hazard function and Kaplan-Meier estimators on increasing sets. J. Statist. Plann. Inference. Stute, W. and Wang, J.-L. ). The strong law under random censorship. Ann. Statist.. van de Geer, S. ). The entropy bound for monotone functions. Tech. Rep. Report -, University of Leiden. van de Geer, S. ). Hellinger-consistency of certain nonparametric maximum likelihood estimators. Ann. Statist.. van de Geer, S. A. 000). Applications of empirical process theory, vol. of Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, Cambridge. van der Vaart, A. W. and Wellner, J. A. ). Weak convergence and empirical processes. Springer Series in Statistics, Springer-Verlag, New York. With applications to statistics. Wang, J. G. ). A note on the uniform consistency of the Kaplan-Meier estimator. Ann. Statist.. Ying, Z. ). A note on the asymptotic properties of the product-limit estimator on the whole line. Statist. Probab. Lett.. Jon A. Wellner University of Washington Department of Statistics Box Seattle, WA - aw@stat.washington.edu

SOME CONVERSE LIMIT THEOREMS FOR EXCHANGEABLE BOOTSTRAPS

SOME CONVERSE LIMIT THEOREMS FOR EXCHANGEABLE BOOTSTRAPS SOME CONVERSE LIMIT THEOREMS OR EXCHANGEABLE BOOTSTRAPS Jon A. Wellner University of Washington The bootstrap Glivenko-Cantelli and bootstrap Donsker theorems of Giné and Zinn (990) contain both necessary

More information

Estimation of the Bivariate and Marginal Distributions with Censored Data

Estimation of the Bivariate and Marginal Distributions with Censored Data Estimation of the Bivariate and Marginal Distributions with Censored Data Michael Akritas and Ingrid Van Keilegom Penn State University and Eindhoven University of Technology May 22, 2 Abstract Two new

More information

Asymptotic Properties of Kaplan-Meier Estimator. for Censored Dependent Data. Zongwu Cai. Department of Mathematics

Asymptotic Properties of Kaplan-Meier Estimator. for Censored Dependent Data. Zongwu Cai. Department of Mathematics To appear in Statist. Probab. Letters, 997 Asymptotic Properties of Kaplan-Meier Estimator for Censored Dependent Data by Zongwu Cai Department of Mathematics Southwest Missouri State University Springeld,

More information

A note on the asymptotic distribution of Berk-Jones type statistics under the null hypothesis

A note on the asymptotic distribution of Berk-Jones type statistics under the null hypothesis A note on the asymptotic distribution of Berk-Jones type statistics under the null hypothesis Jon A. Wellner and Vladimir Koltchinskii Abstract. Proofs are given of the limiting null distributions of the

More information

Product-limit estimators of the survival function with left or right censored data

Product-limit estimators of the survival function with left or right censored data Product-limit estimators of the survival function with left or right censored data 1 CREST-ENSAI Campus de Ker-Lann Rue Blaise Pascal - BP 37203 35172 Bruz cedex, France (e-mail: patilea@ensai.fr) 2 Institut

More information

Goodness-of-fit tests for randomly censored Weibull distributions with estimated parameters

Goodness-of-fit tests for randomly censored Weibull distributions with estimated parameters Communications for Statistical Applications and Methods 2017, Vol. 24, No. 5, 519 531 https://doi.org/10.5351/csam.2017.24.5.519 Print ISSN 2287-7843 / Online ISSN 2383-4757 Goodness-of-fit tests for randomly

More information

FULL LIKELIHOOD INFERENCES IN THE COX MODEL

FULL LIKELIHOOD INFERENCES IN THE COX MODEL October 20, 2007 FULL LIKELIHOOD INFERENCES IN THE COX MODEL BY JIAN-JIAN REN 1 AND MAI ZHOU 2 University of Central Florida and University of Kentucky Abstract We use the empirical likelihood approach

More information

TESTS FOR LOCATION WITH K SAMPLES UNDER THE KOZIOL-GREEN MODEL OF RANDOM CENSORSHIP Key Words: Ke Wu Department of Mathematics University of Mississip

TESTS FOR LOCATION WITH K SAMPLES UNDER THE KOZIOL-GREEN MODEL OF RANDOM CENSORSHIP Key Words: Ke Wu Department of Mathematics University of Mississip TESTS FOR LOCATION WITH K SAMPLES UNDER THE KOIOL-GREEN MODEL OF RANDOM CENSORSHIP Key Words: Ke Wu Department of Mathematics University of Mississippi University, MS38677 K-sample location test, Koziol-Green

More information

1 Glivenko-Cantelli type theorems

1 Glivenko-Cantelli type theorems STA79 Lecture Spring Semester Glivenko-Cantelli type theorems Given i.i.d. observations X,..., X n with unknown distribution function F (t, consider the empirical (sample CDF ˆF n (t = I [Xi t]. n Then

More information

FULL LIKELIHOOD INFERENCES IN THE COX MODEL: AN EMPIRICAL LIKELIHOOD APPROACH

FULL LIKELIHOOD INFERENCES IN THE COX MODEL: AN EMPIRICAL LIKELIHOOD APPROACH FULL LIKELIHOOD INFERENCES IN THE COX MODEL: AN EMPIRICAL LIKELIHOOD APPROACH Jian-Jian Ren 1 and Mai Zhou 2 University of Central Florida and University of Kentucky Abstract: For the regression parameter

More information

Efficiency of Profile/Partial Likelihood in the Cox Model

Efficiency of Profile/Partial Likelihood in the Cox Model Efficiency of Profile/Partial Likelihood in the Cox Model Yuichi Hirose School of Mathematics, Statistics and Operations Research, Victoria University of Wellington, New Zealand Summary. This paper shows

More information

On the generalized maximum likelihood estimator of survival function under Koziol Green model

On the generalized maximum likelihood estimator of survival function under Koziol Green model On the generalized maximum likelihood estimator of survival function under Koziol Green model By: Haimeng Zhang, M. Bhaskara Rao, Rupa C. Mitra Zhang, H., Rao, M.B., and Mitra, R.C. (2006). On the generalized

More information

Goodness-of-Fit Tests for Time Series Models: A Score-Marked Empirical Process Approach

Goodness-of-Fit Tests for Time Series Models: A Score-Marked Empirical Process Approach Goodness-of-Fit Tests for Time Series Models: A Score-Marked Empirical Process Approach By Shiqing Ling Department of Mathematics Hong Kong University of Science and Technology Let {y t : t = 0, ±1, ±2,

More information

University of California, Berkeley

University of California, Berkeley University of California, Berkeley U.C. Berkeley Division of Biostatistics Working Paper Series Year 24 Paper 153 A Note on Empirical Likelihood Inference of Residual Life Regression Ying Qing Chen Yichuan

More information

A COMPARISON OF POISSON AND BINOMIAL EMPIRICAL LIKELIHOOD Mai Zhou and Hui Fang University of Kentucky

A COMPARISON OF POISSON AND BINOMIAL EMPIRICAL LIKELIHOOD Mai Zhou and Hui Fang University of Kentucky A COMPARISON OF POISSON AND BINOMIAL EMPIRICAL LIKELIHOOD Mai Zhou and Hui Fang University of Kentucky Empirical likelihood with right censored data were studied by Thomas and Grunkmier (1975), Li (1995),

More information

Strong log-concavity is preserved by convolution

Strong log-concavity is preserved by convolution Strong log-concavity is preserved by convolution Jon A. Wellner Abstract. We review and formulate results concerning strong-log-concavity in both discrete and continuous settings. Although four different

More information

Maximum likelihood: counterexamples, examples, and open problems

Maximum likelihood: counterexamples, examples, and open problems Maximum likelihood: counterexamples, examples, and open problems Jon A. Wellner University of Washington visiting Vrije Universiteit, Amsterdam Talk at BeNeLuxFra Mathematics Meeting 21 May, 2005 Email:

More information

Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued

Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations Research

More information

Size and Shape of Confidence Regions from Extended Empirical Likelihood Tests

Size and Shape of Confidence Regions from Extended Empirical Likelihood Tests Biometrika (2014),,, pp. 1 13 C 2014 Biometrika Trust Printed in Great Britain Size and Shape of Confidence Regions from Extended Empirical Likelihood Tests BY M. ZHOU Department of Statistics, University

More information

NETWORK-REGULARIZED HIGH-DIMENSIONAL COX REGRESSION FOR ANALYSIS OF GENOMIC DATA

NETWORK-REGULARIZED HIGH-DIMENSIONAL COX REGRESSION FOR ANALYSIS OF GENOMIC DATA Statistica Sinica 213): Supplement NETWORK-REGULARIZED HIGH-DIMENSIONAL COX REGRESSION FOR ANALYSIS OF GENOMIC DATA Hokeun Sun 1, Wei Lin 2, Rui Feng 2 and Hongzhe Li 2 1 Columbia University and 2 University

More information

Empirical likelihood ratio with arbitrarily censored/truncated data by EM algorithm

Empirical likelihood ratio with arbitrarily censored/truncated data by EM algorithm Empirical likelihood ratio with arbitrarily censored/truncated data by EM algorithm Mai Zhou 1 University of Kentucky, Lexington, KY 40506 USA Summary. Empirical likelihood ratio method (Thomas and Grunkmier

More information

Likelihood ratio confidence bands in nonparametric regression with censored data

Likelihood ratio confidence bands in nonparametric regression with censored data Likelihood ratio confidence bands in nonparametric regression with censored data Gang Li University of California at Los Angeles Department of Biostatistics Ingrid Van Keilegom Eindhoven University of

More information

Maximum likelihood: counterexamples, examples, and open problems. Jon A. Wellner. University of Washington. Maximum likelihood: p.

Maximum likelihood: counterexamples, examples, and open problems. Jon A. Wellner. University of Washington. Maximum likelihood: p. Maximum likelihood: counterexamples, examples, and open problems Jon A. Wellner University of Washington Maximum likelihood: p. 1/7 Talk at University of Idaho, Department of Mathematics, September 15,

More information

Asymptotic Properties of Nonparametric Estimation Based on Partly Interval-Censored Data

Asymptotic Properties of Nonparametric Estimation Based on Partly Interval-Censored Data Asymptotic Properties of Nonparametric Estimation Based on Partly Interval-Censored Data Jian Huang Department of Statistics and Actuarial Science University of Iowa, Iowa City, IA 52242 Email: jian@stat.uiowa.edu

More information

STAT Sample Problem: General Asymptotic Results

STAT Sample Problem: General Asymptotic Results STAT331 1-Sample Problem: General Asymptotic Results In this unit we will consider the 1-sample problem and prove the consistency and asymptotic normality of the Nelson-Aalen estimator of the cumulative

More information

Preservation Theorems for Glivenko-Cantelli and Uniform Glivenko-Cantelli Classes

Preservation Theorems for Glivenko-Cantelli and Uniform Glivenko-Cantelli Classes Preservation Theorems for Glivenko-Cantelli and Uniform Glivenko-Cantelli Classes This is page 5 Printer: Opaque this Aad van der Vaart and Jon A. Wellner ABSTRACT We show that the P Glivenko property

More information

Full likelihood inferences in the Cox model: an empirical likelihood approach

Full likelihood inferences in the Cox model: an empirical likelihood approach Ann Inst Stat Math 2011) 63:1005 1018 DOI 10.1007/s10463-010-0272-y Full likelihood inferences in the Cox model: an empirical likelihood approach Jian-Jian Ren Mai Zhou Received: 22 September 2008 / Revised:

More information

Bahadur representations for bootstrap quantiles 1

Bahadur representations for bootstrap quantiles 1 Bahadur representations for bootstrap quantiles 1 Yijun Zuo Department of Statistics and Probability, Michigan State University East Lansing, MI 48824, USA zuo@msu.edu 1 Research partially supported by

More information

The Central Limit Theorem Under Random Truncation

The Central Limit Theorem Under Random Truncation The Central Limit Theorem Under Random Truncation WINFRIED STUTE and JANE-LING WANG Mathematical Institute, University of Giessen, Arndtstr., D-3539 Giessen, Germany. winfried.stute@math.uni-giessen.de

More information

The International Journal of Biostatistics

The International Journal of Biostatistics The International Journal of Biostatistics Volume 1, Issue 1 2005 Article 3 Score Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics Moulinath Banerjee Jon A. Wellner

More information

A Recursive Formula for the Kaplan-Meier Estimator with Mean Constraints

A Recursive Formula for the Kaplan-Meier Estimator with Mean Constraints Noname manuscript No. (will be inserted by the editor) A Recursive Formula for the Kaplan-Meier Estimator with Mean Constraints Mai Zhou Yifan Yang Received: date / Accepted: date Abstract In this note

More information

THE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, R. M. Dudley

THE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, R. M. Dudley THE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, 2011 R. M. Dudley 1 A. Dvoretzky, J. Kiefer, and J. Wolfowitz 1956 proved the Dvoretzky Kiefer Wolfowitz

More information

Approximate Self Consistency for Middle-Censored Data

Approximate Self Consistency for Middle-Censored Data Approximate Self Consistency for Middle-Censored Data by S. Rao Jammalamadaka Department of Statistics & Applied Probability, University of California, Santa Barbara, CA 93106, USA. and Srikanth K. Iyer

More information

Smooth nonparametric estimation of a quantile function under right censoring using beta kernels

Smooth nonparametric estimation of a quantile function under right censoring using beta kernels Smooth nonparametric estimation of a quantile function under right censoring using beta kernels Chanseok Park 1 Department of Mathematical Sciences, Clemson University, Clemson, SC 29634 Short Title: Smooth

More information

Lecture 22 Survival Analysis: An Introduction

Lecture 22 Survival Analysis: An Introduction University of Illinois Department of Economics Spring 2017 Econ 574 Roger Koenker Lecture 22 Survival Analysis: An Introduction There is considerable interest among economists in models of durations, which

More information

Nonparametric Bayes Estimator of Survival Function for Right-Censoring and Left-Truncation Data

Nonparametric Bayes Estimator of Survival Function for Right-Censoring and Left-Truncation Data Nonparametric Bayes Estimator of Survival Function for Right-Censoring and Left-Truncation Data Mai Zhou and Julia Luan Department of Statistics University of Kentucky Lexington, KY 40506-0027, U.S.A.

More information

Inconsistency of the MLE for the joint distribution. of interval censored survival times. and continuous marks

Inconsistency of the MLE for the joint distribution. of interval censored survival times. and continuous marks Inconsistency of the MLE for the joint distribution of interval censored survival times and continuous marks By M.H. Maathuis and J.A. Wellner Department of Statistics, University of Washington, Seattle,

More information

Empirical Likelihood in Survival Analysis

Empirical Likelihood in Survival Analysis Empirical Likelihood in Survival Analysis Gang Li 1, Runze Li 2, and Mai Zhou 3 1 Department of Biostatistics, University of California, Los Angeles, CA 90095 vli@ucla.edu 2 Department of Statistics, The

More information

Score Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics

Score Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics Score Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics Moulinath Banerjee 1 and Jon A. Wellner 2 1 Department of Statistics, Department of Statistics, 439, West

More information

Empirical Processes & Survival Analysis. The Functional Delta Method

Empirical Processes & Survival Analysis. The Functional Delta Method STAT/BMI 741 University of Wisconsin-Madison Empirical Processes & Survival Analysis Lecture 3 The Functional Delta Method Lu Mao lmao@biostat.wisc.edu 3-1 Objectives By the end of this lecture, you will

More information

Exercises. (a) Prove that m(t) =

Exercises. (a) Prove that m(t) = Exercises 1. Lack of memory. Verify that the exponential distribution has the lack of memory property, that is, if T is exponentially distributed with parameter λ > then so is T t given that T > t for

More information

Estimating Bivariate Survival Function by Volterra Estimator Using Dynamic Programming Techniques

Estimating Bivariate Survival Function by Volterra Estimator Using Dynamic Programming Techniques Journal of Data Science 7(2009), 365-380 Estimating Bivariate Survival Function by Volterra Estimator Using Dynamic Programming Techniques Jiantian Wang and Pablo Zafra Kean University Abstract: For estimating

More information

An elementary proof of the weak convergence of empirical processes

An elementary proof of the weak convergence of empirical processes An elementary proof of the weak convergence of empirical processes Dragan Radulović Department of Mathematics, Florida Atlantic University Marten Wegkamp Department of Mathematics & Department of Statistical

More information

Asymptotic Distributions for the Nelson-Aalen and Kaplan-Meier estimators and for test statistics.

Asymptotic Distributions for the Nelson-Aalen and Kaplan-Meier estimators and for test statistics. Asymptotic Distributions for the Nelson-Aalen and Kaplan-Meier estimators and for test statistics. Dragi Anevski Mathematical Sciences und University November 25, 21 1 Asymptotic distributions for statistical

More information

STATISTICAL INFERENCE UNDER ORDER RESTRICTIONS LIMIT THEORY FOR THE GRENANDER ESTIMATOR UNDER ALTERNATIVE HYPOTHESES

STATISTICAL INFERENCE UNDER ORDER RESTRICTIONS LIMIT THEORY FOR THE GRENANDER ESTIMATOR UNDER ALTERNATIVE HYPOTHESES STATISTICAL INFERENCE UNDER ORDER RESTRICTIONS LIMIT THEORY FOR THE GRENANDER ESTIMATOR UNDER ALTERNATIVE HYPOTHESES By Jon A. Wellner University of Washington 1. Limit theory for the Grenander estimator.

More information

Random Bernstein-Markov factors

Random Bernstein-Markov factors Random Bernstein-Markov factors Igor Pritsker and Koushik Ramachandran October 20, 208 Abstract For a polynomial P n of degree n, Bernstein s inequality states that P n n P n for all L p norms on the unit

More information

and Comparison with NPMLE

and Comparison with NPMLE NONPARAMETRIC BAYES ESTIMATOR OF SURVIVAL FUNCTIONS FOR DOUBLY/INTERVAL CENSORED DATA and Comparison with NPMLE Mai Zhou Department of Statistics, University of Kentucky, Lexington, KY 40506 USA http://ms.uky.edu/

More information

Concentration behavior of the penalized least squares estimator

Concentration behavior of the penalized least squares estimator Concentration behavior of the penalized least squares estimator Penalized least squares behavior arxiv:1511.08698v2 [math.st] 19 Oct 2016 Alan Muro and Sara van de Geer {muro,geer}@stat.math.ethz.ch Seminar

More information

1. Introduction In many biomedical studies, the random survival time of interest is never observed and is only known to lie before an inspection time

1. Introduction In many biomedical studies, the random survival time of interest is never observed and is only known to lie before an inspection time ASYMPTOTIC PROPERTIES OF THE GMLE WITH CASE 2 INTERVAL-CENSORED DATA By Qiqing Yu a;1 Anton Schick a, Linxiong Li b;2 and George Y. C. Wong c;3 a Dept. of Mathematical Sciences, Binghamton University,

More information

Quantile Regression for Residual Life and Empirical Likelihood

Quantile Regression for Residual Life and Empirical Likelihood Quantile Regression for Residual Life and Empirical Likelihood Mai Zhou email: mai@ms.uky.edu Department of Statistics, University of Kentucky, Lexington, KY 40506-0027, USA Jong-Hyeon Jeong email: jeong@nsabp.pitt.edu

More information

Testing Exponentiality by comparing the Empirical Distribution Function of the Normalized Spacings with that of the Original Data

Testing Exponentiality by comparing the Empirical Distribution Function of the Normalized Spacings with that of the Original Data Testing Exponentiality by comparing the Empirical Distribution Function of the Normalized Spacings with that of the Original Data S.Rao Jammalamadaka Department of Statistics and Applied Probability University

More information

GOODNESS-OF-FIT TEST FOR RANDOMLY CENSORED DATA BASED ON MAXIMUM CORRELATION. Ewa Strzalkowska-Kominiak and Aurea Grané (1)

GOODNESS-OF-FIT TEST FOR RANDOMLY CENSORED DATA BASED ON MAXIMUM CORRELATION. Ewa Strzalkowska-Kominiak and Aurea Grané (1) Working Paper 4-2 Statistics and Econometrics Series (4) July 24 Departamento de Estadística Universidad Carlos III de Madrid Calle Madrid, 26 2893 Getafe (Spain) Fax (34) 9 624-98-49 GOODNESS-OF-FIT TEST

More information

Chapter 2 Inference on Mean Residual Life-Overview

Chapter 2 Inference on Mean Residual Life-Overview Chapter 2 Inference on Mean Residual Life-Overview Statistical inference based on the remaining lifetimes would be intuitively more appealing than the popular hazard function defined as the risk of immediate

More information

ASYMPTOTIC EQUIVALENCE OF DENSITY ESTIMATION AND GAUSSIAN WHITE NOISE. By Michael Nussbaum Weierstrass Institute, Berlin

ASYMPTOTIC EQUIVALENCE OF DENSITY ESTIMATION AND GAUSSIAN WHITE NOISE. By Michael Nussbaum Weierstrass Institute, Berlin The Annals of Statistics 1996, Vol. 4, No. 6, 399 430 ASYMPTOTIC EQUIVALENCE OF DENSITY ESTIMATION AND GAUSSIAN WHITE NOISE By Michael Nussbaum Weierstrass Institute, Berlin Signal recovery in Gaussian

More information

Strong approximations for resample quantile processes and application to ROC methodology

Strong approximations for resample quantile processes and application to ROC methodology Strong approximations for resample quantile processes and application to ROC methodology Jiezhun Gu 1, Subhashis Ghosal 2 3 Abstract The receiver operating characteristic (ROC) curve is defined as true

More information

Multistate Modeling and Applications

Multistate Modeling and Applications Multistate Modeling and Applications Yang Yang Department of Statistics University of Michigan, Ann Arbor IBM Research Graduate Student Workshop: Statistics for a Smarter Planet Yang Yang (UM, Ann Arbor)

More information

L p Functions. Given a measure space (X, µ) and a real number p [1, ), recall that the L p -norm of a measurable function f : X R is defined by

L p Functions. Given a measure space (X, µ) and a real number p [1, ), recall that the L p -norm of a measurable function f : X R is defined by L p Functions Given a measure space (, µ) and a real number p [, ), recall that the L p -norm of a measurable function f : R is defined by f p = ( ) /p f p dµ Note that the L p -norm of a function f may

More information

STAT 6385 Survey of Nonparametric Statistics. Order Statistics, EDF and Censoring

STAT 6385 Survey of Nonparametric Statistics. Order Statistics, EDF and Censoring STAT 6385 Survey of Nonparametric Statistics Order Statistics, EDF and Censoring Quantile Function A quantile (or a percentile) of a distribution is that value of X such that a specific percentage of the

More information

Investigation of goodness-of-fit test statistic distributions by random censored samples

Investigation of goodness-of-fit test statistic distributions by random censored samples d samples Investigation of goodness-of-fit test statistic distributions by random censored samples Novosibirsk State Technical University November 22, 2010 d samples Outline 1 Nonparametric goodness-of-fit

More information

A Probabilistic Upper Bound on Differential Entropy

A Probabilistic Upper Bound on Differential Entropy A Probabilistic Upper Bound on Differential Entropy Joseph DeStefano, Qifeng Lu and Erik Learned-Miller Abstract The differential entrops a quantity employed ubiquitousln communications, statistical learning,

More information

Asymptotic Nonequivalence of Nonparametric Experiments When the Smoothness Index is ½

Asymptotic Nonequivalence of Nonparametric Experiments When the Smoothness Index is ½ University of Pennsylvania ScholarlyCommons Statistics Papers Wharton Faculty Research 1998 Asymptotic Nonequivalence of Nonparametric Experiments When the Smoothness Index is ½ Lawrence D. Brown University

More information

Statistics 581 Revision of Section 4.4: Consistency of Maximum Likelihood Estimates Wellner; 11/30/2001

Statistics 581 Revision of Section 4.4: Consistency of Maximum Likelihood Estimates Wellner; 11/30/2001 Statistics 581 Revision of Section 4.4: Consistency of Maximum Likelihood Estimates Wellner; 11/30/2001 Some Uniform Strong Laws of Large Numbers Suppose that: A. X, X 1,...,X n are i.i.d. P on the measurable

More information

arxiv:math/ v2 [math.st] 17 Jun 2008

arxiv:math/ v2 [math.st] 17 Jun 2008 The Annals of Statistics 2008, Vol. 36, No. 3, 1031 1063 DOI: 10.1214/009053607000000974 c Institute of Mathematical Statistics, 2008 arxiv:math/0609020v2 [math.st] 17 Jun 2008 CURRENT STATUS DATA WITH

More information

arxiv:submit/ [math.st] 6 May 2011

arxiv:submit/ [math.st] 6 May 2011 A Continuous Mapping Theorem for the Smallest Argmax Functional arxiv:submit/0243372 [math.st] 6 May 2011 Emilio Seijo and Bodhisattva Sen Columbia University Abstract This paper introduces a version of

More information

UNIVERSITY OF CALIFORNIA, SAN DIEGO

UNIVERSITY OF CALIFORNIA, SAN DIEGO UNIVERSITY OF CALIFORNIA, SAN DIEGO Estimation of the primary hazard ratio in the presence of a secondary covariate with non-proportional hazards An undergraduate honors thesis submitted to the Department

More information

Weak Convergence of Stationary Empirical Processes

Weak Convergence of Stationary Empirical Processes Weak Convergence of Stationary Empirical Processes Dragan Radulović Department of Mathematics, Florida Atlantic University Marten Wegkamp Department of Mathematics & Department of Statistical Science,

More information

11 Survival Analysis and Empirical Likelihood

11 Survival Analysis and Empirical Likelihood 11 Survival Analysis and Empirical Likelihood The first paper of empirical likelihood is actually about confidence intervals with the Kaplan-Meier estimator (Thomas and Grunkmeier 1979), i.e. deals with

More information

ST745: Survival Analysis: Nonparametric methods

ST745: Survival Analysis: Nonparametric methods ST745: Survival Analysis: Nonparametric methods Eric B. Laber Department of Statistics, North Carolina State University February 5, 2015 The KM estimator is used ubiquitously in medical studies to estimate

More information

A Law of the Iterated Logarithm. for Grenander s Estimator

A Law of the Iterated Logarithm. for Grenander s Estimator A Law of the Iterated Logarithm for Grenander s Estimator Jon A. Wellner University of Washington, Seattle Probability Seminar October 24, 2016 Based on joint work with: Lutz Dümbgen and Malcolm Wolff

More information

Statistical Analysis of Competing Risks With Missing Causes of Failure

Statistical Analysis of Competing Risks With Missing Causes of Failure Proceedings 59th ISI World Statistics Congress, 25-3 August 213, Hong Kong (Session STS9) p.1223 Statistical Analysis of Competing Risks With Missing Causes of Failure Isha Dewan 1,3 and Uttara V. Naik-Nimbalkar

More information

Nonparametric estimation of linear functionals of a multivariate distribution under multivariate censoring with applications.

Nonparametric estimation of linear functionals of a multivariate distribution under multivariate censoring with applications. Chapter 1 Nonparametric estimation of linear functionals of a multivariate distribution under multivariate censoring with applications. 1.1. Introduction The study of dependent durations arises in many

More information

RATES OF CONVERGENCE OF ESTIMATES, KOLMOGOROV S ENTROPY AND THE DIMENSIONALITY REDUCTION PRINCIPLE IN REGRESSION 1

RATES OF CONVERGENCE OF ESTIMATES, KOLMOGOROV S ENTROPY AND THE DIMENSIONALITY REDUCTION PRINCIPLE IN REGRESSION 1 The Annals of Statistics 1997, Vol. 25, No. 6, 2493 2511 RATES OF CONVERGENCE OF ESTIMATES, KOLMOGOROV S ENTROPY AND THE DIMENSIONALITY REDUCTION PRINCIPLE IN REGRESSION 1 By Theodoros Nicoleris and Yannis

More information

AFT Models and Empirical Likelihood

AFT Models and Empirical Likelihood AFT Models and Empirical Likelihood Mai Zhou Department of Statistics, University of Kentucky Collaborators: Gang Li (UCLA); A. Bathke; M. Kim (Kentucky) Accelerated Failure Time (AFT) models: Y = log(t

More information

Estimation and Inference of Quantile Regression. for Survival Data under Biased Sampling

Estimation and Inference of Quantile Regression. for Survival Data under Biased Sampling Estimation and Inference of Quantile Regression for Survival Data under Biased Sampling Supplementary Materials: Proofs of the Main Results S1 Verification of the weight function v i (t) for the lengthbiased

More information

On probabilities of large and moderate deviations for L-statistics: a survey of some recent developments

On probabilities of large and moderate deviations for L-statistics: a survey of some recent developments UDC 519.2 On probabilities of large and moderate deviations for L-statistics: a survey of some recent developments N. V. Gribkova Department of Probability Theory and Mathematical Statistics, St.-Petersburg

More information

Power and Sample Size Calculations with the Additive Hazards Model

Power and Sample Size Calculations with the Additive Hazards Model Journal of Data Science 10(2012), 143-155 Power and Sample Size Calculations with the Additive Hazards Model Ling Chen, Chengjie Xiong, J. Philip Miller and Feng Gao Washington University School of Medicine

More information

A NONPARAMETRIC TEST FOR SERIAL INDEPENDENCE OF REGRESSION ERRORS

A NONPARAMETRIC TEST FOR SERIAL INDEPENDENCE OF REGRESSION ERRORS A NONPARAMETRIC TEST FOR SERIAL INDEPENDENCE OF REGRESSION ERRORS Miguel A. Delgado and Juan Mora WP-AD 99-28 Correspondence to J. Mora: University of Alicante. Departamento de Fundamentos del Análisis

More information

An invariance result for Hammersley s process with sources and sinks

An invariance result for Hammersley s process with sources and sinks An invariance result for Hammersley s process with sources and sinks Piet Groeneboom Delft University of Technology, Vrije Universiteit, Amsterdam, and University of Washington, Seattle March 31, 26 Abstract

More information

Efficient Semiparametric Estimators via Modified Profile Likelihood in Frailty & Accelerated-Failure Models

Efficient Semiparametric Estimators via Modified Profile Likelihood in Frailty & Accelerated-Failure Models NIH Talk, September 03 Efficient Semiparametric Estimators via Modified Profile Likelihood in Frailty & Accelerated-Failure Models Eric Slud, Math Dept, Univ of Maryland Ongoing joint project with Ilia

More information

ICSA Applied Statistics Symposium 1. Balanced adjusted empirical likelihood

ICSA Applied Statistics Symposium 1. Balanced adjusted empirical likelihood ICSA Applied Statistics Symposium 1 Balanced adjusted empirical likelihood Art B. Owen Stanford University Sarah Emerson Oregon State University ICSA Applied Statistics Symposium 2 Empirical likelihood

More information

Goodness of fit test for ergodic diffusion processes

Goodness of fit test for ergodic diffusion processes Ann Inst Stat Math (29) 6:99 928 DOI.7/s463-7-62- Goodness of fit test for ergodic diffusion processes Ilia Negri Yoichi Nishiyama Received: 22 December 26 / Revised: July 27 / Published online: 2 January

More information

An augmented inverse probability weighted survival function estimator

An augmented inverse probability weighted survival function estimator An augmented inverse probability weighted survival function estimator Sundarraman Subramanian & Dipankar Bandyopadhyay Abstract We analyze an augmented inverse probability of non-missingness weighted estimator

More information

Part III. Hypothesis Testing. III.1. Log-rank Test for Right-censored Failure Time Data

Part III. Hypothesis Testing. III.1. Log-rank Test for Right-censored Failure Time Data 1 Part III. Hypothesis Testing III.1. Log-rank Test for Right-censored Failure Time Data Consider a survival study consisting of n independent subjects from p different populations with survival functions

More information

d(x n, x) d(x n, x nk ) + d(x nk, x) where we chose any fixed k > N

d(x n, x) d(x n, x nk ) + d(x nk, x) where we chose any fixed k > N Problem 1. Let f : A R R have the property that for every x A, there exists ɛ > 0 such that f(t) > ɛ if t (x ɛ, x + ɛ) A. If the set A is compact, prove there exists c > 0 such that f(x) > c for all x

More information

EMPIRICAL PROCESSES. and the empirical process. G n (x) = n 1/2 (F n (x) F(x)) (6)

EMPIRICAL PROCESSES. and the empirical process. G n (x) = n 1/2 (F n (x) F(x)) (6) EMPIRICAL PROCESSES If X 1, X 2,..., X n are independent identically distributed random variables (RVs) with values in a measurable space (X, B) andwith common probability measure P on X, the empirical

More information

Regularity of the density for the stochastic heat equation

Regularity of the density for the stochastic heat equation Regularity of the density for the stochastic heat equation Carl Mueller 1 Department of Mathematics University of Rochester Rochester, NY 15627 USA email: cmlr@math.rochester.edu David Nualart 2 Department

More information

Nonparametric estimation and testing time-homogeneity for processes with independent increments

Nonparametric estimation and testing time-homogeneity for processes with independent increments Stochastic Processes and their Applications 118 (2008) 1043 1055 www.elsevier.com/locate/spa Nonparametric estimation and testing time-homogeneity for processes with independent increments Yoichi Nishiyama

More information

A SIMPLE IMPROVEMENT OF THE KAPLAN-MEIER ESTIMATOR. Agnieszka Rossa

A SIMPLE IMPROVEMENT OF THE KAPLAN-MEIER ESTIMATOR. Agnieszka Rossa A SIMPLE IMPROVEMENT OF THE KAPLAN-MEIER ESTIMATOR Agnieszka Rossa Dept of Stat Methods, University of Lódź, Poland Rewolucji 1905, 41, Lódź e-mail: agrossa@krysiaunilodzpl and Ryszard Zieliński Inst Math

More information

arxiv: v1 [math.ca] 23 Oct 2018

arxiv: v1 [math.ca] 23 Oct 2018 A REMARK ON THE ARCSINE DISTRIBUTION AND THE HILBERT TRANSFORM arxiv:80.08v [math.ca] 3 Oct 08 RONALD R. COIFMAN AND STEFAN STEINERBERGER Abstract. We prove that if fx) ) /4 L,) and its Hilbert transform

More information

Comparing Distribution Functions via Empirical Likelihood

Comparing Distribution Functions via Empirical Likelihood Georgia State University ScholarWorks @ Georgia State University Mathematics and Statistics Faculty Publications Department of Mathematics and Statistics 25 Comparing Distribution Functions via Empirical

More information

Verifying Regularity Conditions for Logit-Normal GLMM

Verifying Regularity Conditions for Logit-Normal GLMM Verifying Regularity Conditions for Logit-Normal GLMM Yun Ju Sung Charles J. Geyer January 10, 2006 In this note we verify the conditions of the theorems in Sung and Geyer (submitted) for the Logit-Normal

More information

Nonparametric regression with martingale increment errors

Nonparametric regression with martingale increment errors S. Gaïffas (LSTA - Paris 6) joint work with S. Delattre (LPMA - Paris 7) work in progress Motivations Some facts: Theoretical study of statistical algorithms requires stationary and ergodicity. Concentration

More information

Brownian Motion. 1 Definition Brownian Motion Wiener measure... 3

Brownian Motion. 1 Definition Brownian Motion Wiener measure... 3 Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................

More information

Density estimators for the convolution of discrete and continuous random variables

Density estimators for the convolution of discrete and continuous random variables Density estimators for the convolution of discrete and continuous random variables Ursula U Müller Texas A&M University Anton Schick Binghamton University Wolfgang Wefelmeyer Universität zu Köln Abstract

More information

BERNSTEIN POLYNOMIAL DENSITY ESTIMATION 1265 bounded away from zero and infinity. Gibbs sampling techniques to compute the posterior mean and other po

BERNSTEIN POLYNOMIAL DENSITY ESTIMATION 1265 bounded away from zero and infinity. Gibbs sampling techniques to compute the posterior mean and other po The Annals of Statistics 2001, Vol. 29, No. 5, 1264 1280 CONVERGENCE RATES FOR DENSITY ESTIMATION WITH BERNSTEIN POLYNOMIALS By Subhashis Ghosal University of Minnesota Mixture models for density estimation

More information

Almost Sure Central Limit Theorem for Self-Normalized Partial Sums of Negatively Associated Random Variables

Almost Sure Central Limit Theorem for Self-Normalized Partial Sums of Negatively Associated Random Variables Filomat 3:5 (207), 43 422 DOI 0.2298/FIL70543W Published by Faculty of Sciences and Mathematics, University of Niš, Serbia Available at: http://www.pmf.ni.ac.rs/filomat Almost Sure Central Limit Theorem

More information

MOMENT CONVERGENCE RATES OF LIL FOR NEGATIVELY ASSOCIATED SEQUENCES

MOMENT CONVERGENCE RATES OF LIL FOR NEGATIVELY ASSOCIATED SEQUENCES J. Korean Math. Soc. 47 1, No., pp. 63 75 DOI 1.4134/JKMS.1.47..63 MOMENT CONVERGENCE RATES OF LIL FOR NEGATIVELY ASSOCIATED SEQUENCES Ke-Ang Fu Li-Hua Hu Abstract. Let X n ; n 1 be a strictly stationary

More information

A General Kernel Functional Estimator with Generalized Bandwidth Strong Consistency and Applications

A General Kernel Functional Estimator with Generalized Bandwidth Strong Consistency and Applications A General Kernel Functional Estimator with Generalized Bandwidth Strong Consistency and Applications Rafael Weißbach Fakultät Statistik, Universität Dortmund e-mail: Rafael.Weissbach@uni-dortmund.de March

More information

First passage time for Brownian motion and piecewise linear boundaries

First passage time for Brownian motion and piecewise linear boundaries To appear in Methodology and Computing in Applied Probability, (2017) 19: 237-253. doi 10.1007/s11009-015-9475-2 First passage time for Brownian motion and piecewise linear boundaries Zhiyong Jin 1 and

More information

ON CONCENTRATION FUNCTIONS OF RANDOM VARIABLES. Sergey G. Bobkov and Gennadiy P. Chistyakov. June 2, 2013

ON CONCENTRATION FUNCTIONS OF RANDOM VARIABLES. Sergey G. Bobkov and Gennadiy P. Chistyakov. June 2, 2013 ON CONCENTRATION FUNCTIONS OF RANDOM VARIABLES Sergey G. Bobkov and Gennadiy P. Chistyakov June, 3 Abstract The concentration functions are considered for sums of independent random variables. Two sided

More information