ICSA Applied Statistics Symposium 1. Balanced adjusted empirical likelihood
|
|
- Bryan Day
- 5 years ago
- Views:
Transcription
1 ICSA Applied Statistics Symposium 1 Balanced adjusted empirical likelihood Art B. Owen Stanford University Sarah Emerson Oregon State University
2 ICSA Applied Statistics Symposium 2 Empirical likelihood Observations x i R d, x i iid F0 L(F ) = n F {X i } i=1 Nonparametric MLE is at F = F n = 1 n n i=1 δ x i ECDF Kiefer & Wolfowitz (1956) Some other NPMLE results: Survival analysis Kaplan & Meier (1958) Survey sampling Hartley & Rao (1967) Interval censoring Peto (1973) Censoring & truncation Lynden-Bell (1971) Monotone density Grenander (1956) etc., see monograph O (2001)
3 ICSA Applied Statistics Symposium 3 Nonparametric likelihood ratios R(F ) = L(F ) L(F n ) = n i=1 nw i where w i = F {X i }. Profile likelihood Statistic T = T (F ), true value τ 0 = T (F 0 ), NPMLE T = T (F n ) R(τ) = max{r(f ) T (F ) = τ} When do we get 2 log(r(τ 0 )) d χ 2? IE, a Wilks like result without assuming a parametric form. Then C = {τ R(τ) η} is an approximate confidence region.
4 ICSA Applied Statistics Symposium 4 For the mean T (F ) = x df (x), ie µ = E(X) Degeneracy R ( ) (1 ɛ)f n + ɛ1 x 1 as ɛ 0 any x For small enough ɛ > 0, (1 ɛ) X + ɛx C {µ R(µ) η} Letting x we get C = R d
5 ICSA Applied Statistics Symposium 5 Non-degeneracy For the mean, restrict F to have support in a bounded set B R d. It is enough to take B = B n chull(x 1,..., x n ) B n grows with n Upshot { R(µ) = sup (nw i ) i n i=1 w i x i = µ, w i > 0, i w i = 1, } Then 2 log(r(µ 0 )) d χ 2 (d) under moment conditions. O (1990)
6 ICSA Applied Statistics Symposium 6 Some good things about EL 1) (correct) data driven shape for confidence sets Hall 2) power optimality of tests Kitamura 3) allows side constraints O (1991), Qin & Lawless (1993) 4) Bartlett correctable DiCiccio, Hall & Romano (1991) 5) extends for a) censoring b) truncation c) biased sampling, 6) methods for a) time series Kitamura b) survey sampling Qin, Chen, Sitter,... Many more extensions S.-X. Chen; Hjort, McKeague & van Keilegom; Lahiri
7 ICSA Applied Statistics Symposium 7 Drawbacks 1) Region for mean bounded by convex hull of B n 2) Profiling the likelihood can be hard Hull Coverage of EL is at most coverage of hull of B n. This is a problem for small n and/or large d. Profiling Profiling is also hard for parametric likelihoods. Empirical likelihood is usually easy to compute for a fixed parameter vector.
8 ICSA Applied Statistics Symposium 8 Convexity { n R(µ) = sup (nw i ) i=1 Profile empirical likelihood w i 0, i w i = 1, i Confidence region for a mean w i (x i µ) = 0 } C(ɛ) = {µ R d R(µ) > ɛ} Nested inside convex hull C(ɛ) C(0) = convex hull(x 1,..., x n ), ɛ > 0
9 ICSA Applied Statistics Symposium 9 Adjusted EL coverage (extreme case) d = 4, n = 10 Normal Q Q Plot P P Plot EL Quantiles p values χ (4) Quantiles Uniform Quantiles Emerson & O (2009) Vertical asymptote from atom at + for 2 log R(µ 0 ).
10 ICSA Applied Statistics Symposium 10 Escape from the hull Idea: extend B n to ensure that µ B n Add an artificial point (undata) x n+1. Now, T (F ) = L(F ) = L(F ) = n+1 i=1 w i x i, n w i, i=1 n+1 i=1 w i. or, and, The second version is easier computationally and asymptotically the same (if x n+1 reasonable). Chen, Variyath & Abraham (2008) originate this approach.
11 ICSA Applied Statistics Symposium 11 Adjusted empirical likelihood Chen, Variyath & Abraham (2008) use x n+1 = µ a n ( x µ), a n = log(n)/2 a n = o p (n 2/3 ) preserves 1st order asymptotics Note: new point x n+1 depends on µ Now µ is between x and x n+1 : Hull of x 1,..., x n1 contains µ µ = x n+1 + a n x 1 + a n
12 ICSA Applied Statistics Symposium 12 Not all is well yet Let R be adjusted profile empirical likelihood. Then: [ ( ) (n + 2 log R 1)an (µ) 2 n log n(a n + 1) ( )] n log a n + 1 which is bounded, even if µ. Opposite problem from log R(µ) which diverged at finite µ. Instead of a bounded 100% region we can get all of R d at less than 100% confidence. Extreme example ctd. n = 10, d = 4, 88.1% region is R 4.
13 ICSA Applied Statistics Symposium 13 Coverage (extreme case) d = 4, n = 10 Normal Q Q Plot P P Plot AEL Quantiles p values χ (4) Quantiles Uniform Quantiles Emerson & O (2009)
14 ICSA Applied Statistics Symposium 14 Balanced adjusted empirical likelihood Dissertation: Emerson (2009) 1) Add 2 points x n+1 and x n+2 2) (x n+1 + x n+2 )/2 = x (preserving sample mean) 3) farther new points if µ x is a direction where the sample varies a lot Add points x n+1 = µ sc u u x n+2 = 2 x µ + sc u u where u = x µ c u = (u T S 1 u ) 1/2 x µ S = 1 n (x i x)(x i x) T s 1.9 n 1 i=1 Choice of s is based on empirical work. The best s depends (weakly) on d.
15 ICSA Applied Statistics Symposium 15 Related Independently Liu & Chen (2009) also added 2 points. Their 2 points were designed to improve Bartlett correction. Ours were tuned to give good small sample coverage in high dimensions.
16 ICSA Applied Statistics Symposium 16 Invariance Let A R d d be non-singular. Set x i = Ax i and µ = Aµ. Let C be the balanced adjusted empirical likelihood region for µ 0 based on x 1,..., x n. Let C be the balanced adjusted empirical likelihood region for µ 0 = Aµ 0 based on x 1,..., x n. Then µ C µ C. Emerson & O (2009) Proposition 4.1. Hotelling s T 2 and the original EL are also invariant this way.
17 ICSA Applied Statistics Symposium 17 Avoiding the boundedness Recall 2 log R was bounded. The new criterion 2 log R is unbounded. The ultimate cause is that x n+1 µ is proportional to x µ in AEL but is of constant order in BAEL The larger x n+1 µ in AEL means that less weight needs to go there. Less weight there allows more weight on the other n points and a higher likelihood.
18 ICSA Applied Statistics Symposium 18 Connection to T 2 Recall x n+1 = µ sc u u x n+2 = 2 x µ + sc u u, where u = x µ x µ and c u = (u T S 1 u ) 1/2. Theorem 4.2 Emerson & O (2009) lim s 2ns 2 ( ) (n + 2) 2 2 log R (µ) = T 2 (µ)
19 ICSA Applied Statistics Symposium 19 Quantile Quantile Plots d = 4, n = 10 Normal t(3) Double Exponential Empirical Quantiles Empirical Quantiles Empirical Quantiles Chi Square (4) Quantiles Uniform Chi Square (4) Quantiles Beta(0.1, 0.1) Chi Square (4) Quantiles Exponential(3) Empirical Quantiles Empirical Quantiles Empirical Quantiles Chi Square (4) Quantiles F(4, 10) Chi Square (4) Quantiles Chi square(1) Chi Square (4) Quantiles Gamma(1/4, 1/10) Empirical Quantiles Empirical Quantiles Empirical Quantiles Emerson & O (2009) Chi Square (4) Quantiles Chi Square (4) Quantiles Chi Square (4) Quantiles
20 ICSA Applied Statistics Symposium 20 Comments 1) More examples in the article 2) Good calibration for distributions with shorter tails 3) High kurtosis is harder 4) Even there the calibration is almost linear so a Bartlett correction could help a lot 5) Exact nonparametric CI.s for the mean are unobtainable Bahadur & Savage (1956)
21 ICSA Applied Statistics Symposium 21 Now, regression y x T β, x R d y R Estimating equations E ( x(y x T β) ) = 0 Normal equations n x i (y i x T i β) = 0 R d i=1 In principle we let z i = z i (β) x i (y i x T i β) Rd, adjoin z n+1 and z n+2, and carry on. residuals ɛ = (y x T β) are uncorrelated with x. They have mean zero too, when as usual, x contains a constant.
22 ICSA Applied Statistics Symposium 22 Regression hull condition { n R(β) = sup (nw i ) i=1 w i 0, n w i = 1, i=1 } n w i x i (y i x T i β) = 0 i=1 P = P(β) = {x i y i x T i β > 0} N = N (β) = {x i y i x T i β < 0} x with pos resid x with neg resid Convex hull condition O (2000) chull(p) chull(n ) = β C(0) For x i = (1, t i ) T R 2 P and N are intervals in {1} R.
23 ICSA Applied Statistics Symposium 23 Converse Suppose that τ {t 1,..., t n } and 1 t i > τ Sign(y i β 0 β 1 t i ) = 1 t i < τ Suppose also that Then i w i 1 (y i β 0 β 1 t i ) = t i 0 0 w i (y i β 0 β 1 t i )(t i τ) = 0 i But (y i β 0 β 1 t i )(t i τ) > 0 i Therefore the hull condition is necessary.
24 ICSA Applied Statistics Symposium 24 Example regression data y x Y = β 0 + β 1 X + σɛ β = (0, 3) T, σ = 1 β solid ˆβ dashed
25 ICSA Applied Statistics Symposium 25 Example regression data y x Red line is on boundary of set of (β 0, β 1 ) with positive empirical likelihood
26 ICSA Applied Statistics Symposium 26 Example regression data y x Another boundary line.
27 ICSA Applied Statistics Symposium 27 Example regression data y x Yet another boundary line. Left side has positive residuals; right side negative. Wiggle it up and point 3 gets a negative residual = ok. Wiggle down = NOT ok.
28 ICSA Applied Statistics Symposium 28 Example regression data y x All the boundary lines that interpolate two data points. They are a subset of the boundary.
29 ICSA Applied Statistics Symposium 29 Some regression parameters on the boundary β LS true β 1 Boundary points (β 0, β 1 ). Region is not convex. It is convex in β 0 (vertical) for fixed β 1 (horizontal).
30 ICSA Applied Statistics Symposium 30 What is a convex set of lines? convex set of (β 0, β 1 )? convex set of (ρ, θ)? (polar coordinates) convex set of (a, b) (ax + by = 1)?
31 ICSA Applied Statistics Symposium 31 Polar coordinates of a line y = mx + b y r θ x
32 ICSA Applied Statistics Symposium 32 Boundary pts in polar coords Some boundary points (polar coords) angle true radius Not convex here either.
33 ICSA Applied Statistics Symposium 33 Intrinsic convexity There is a geometrically intrinsic notion for a convex set of linear flats. J. E. Goodman (1998) When is a set of lines in space convex? Maybe... that can support some computation. Dual definition The set of flats that intersects a convex set C R d is a convex set of flats. So is the set of flats that intersect all of C 1,..., C k R d for convex C j.
34 ICSA Applied Statistics Symposium 34 Thanks Sarah Emerson Invitation: Heping Zhang Contacts: Mingxiu Hu, Tianxi Cao, Hongliang Shi & Naitee Ting NSF DMS
Calibration of the Empirical Likelihood Method for a Vector Mean
Calibration of the Empirical Likelihood Method for a Vector Mean Sarah C. Emerson and Art B. Owen Department of Statistics Stanford University Abstract The empirical likelihood method is a versatile approach
More informationHigh Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data
High Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data Song Xi CHEN Guanghua School of Management and Center for Statistical Science, Peking University Department
More informationBayesian Empirical Likelihood: a survey
Bayesian Empirical Likelihood 1 Bayesian Empirical Likelihood: a survey Art B. Owen Stanford University Bayesian Empirical Likelihood 2 These are the slides I presented at BNP 11 in Paris, a very fine
More informationAdjusted Empirical Likelihood for Long-memory Time Series Models
Adjusted Empirical Likelihood for Long-memory Time Series Models arxiv:1604.06170v1 [stat.me] 21 Apr 2016 Ramadha D. Piyadi Gamage, Wei Ning and Arjun K. Gupta Department of Mathematics and Statistics
More informationEmpirical likelihood for linear models in the presence of nuisance parameters
Empirical likelihood for linear models in the presence of nuisance parameters Mi-Ok Kim, Mai Zhou To cite this version: Mi-Ok Kim, Mai Zhou. Empirical likelihood for linear models in the presence of nuisance
More informationEmpirical Likelihood Methods for Sample Survey Data: An Overview
AUSTRIAN JOURNAL OF STATISTICS Volume 35 (2006), Number 2&3, 191 196 Empirical Likelihood Methods for Sample Survey Data: An Overview J. N. K. Rao Carleton University, Ottawa, Canada Abstract: The use
More informationUniversity of California, Berkeley
University of California, Berkeley U.C. Berkeley Division of Biostatistics Working Paper Series Year 24 Paper 153 A Note on Empirical Likelihood Inference of Residual Life Regression Ying Qing Chen Yichuan
More informationQuantile Regression for Residual Life and Empirical Likelihood
Quantile Regression for Residual Life and Empirical Likelihood Mai Zhou email: mai@ms.uky.edu Department of Statistics, University of Kentucky, Lexington, KY 40506-0027, USA Jong-Hyeon Jeong email: jeong@nsabp.pitt.edu
More informationGeneralized Neyman Pearson optimality of empirical likelihood for testing parameter hypotheses
Ann Inst Stat Math (2009) 61:773 787 DOI 10.1007/s10463-008-0172-6 Generalized Neyman Pearson optimality of empirical likelihood for testing parameter hypotheses Taisuke Otsu Received: 1 June 2007 / Revised:
More informationStatistica Sinica Preprint No: SS R1
Statistica Sinica Preprint No: SS-2017-0059.R1 Title Peter Hall's Contribution to Empirical Likelihood Manuscript ID SS-2017-0059.R1 URL http://www.stat.sinica.edu.tw/statistica/ DOI 10.5705/ss.202017.0059
More informationEmpirical Likelihood Inference for Two-Sample Problems
Empirical Likelihood Inference for Two-Sample Problems by Ying Yan A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master of Mathematics in Statistics
More informationJackknife Empirical Likelihood for the Variance in the Linear Regression Model
Georgia State University ScholarWorks @ Georgia State University Mathematics Theses Department of Mathematics and Statistics Summer 7-25-2013 Jackknife Empirical Likelihood for the Variance in the Linear
More informationCONSTRUCTING NONPARAMETRIC LIKELIHOOD CONFIDENCE REGIONS WITH HIGH ORDER PRECISIONS
Statistica Sinica 21 (2011), 1767-1783 doi:http://dx.doi.org/10.5705/ss.2009.117 CONSTRUCTING NONPARAMETRIC LIKELIHOOD CONFIDENCE REGIONS WITH HIGH ORDER PRECISIONS Xiao Li 1, Jiahua Chen 2, Yaohua Wu
More informationST745: Survival Analysis: Nonparametric methods
ST745: Survival Analysis: Nonparametric methods Eric B. Laber Department of Statistics, North Carolina State University February 5, 2015 The KM estimator is used ubiquitously in medical studies to estimate
More information11 Survival Analysis and Empirical Likelihood
11 Survival Analysis and Empirical Likelihood The first paper of empirical likelihood is actually about confidence intervals with the Kaplan-Meier estimator (Thomas and Grunkmeier 1979), i.e. deals with
More informationSemi-Empirical Likelihood Confidence Intervals for the ROC Curve with Missing Data
Georgia State University ScholarWorks @ Georgia State University Mathematics Theses Department of Mathematics and Statistics Summer 6-11-2010 Semi-Empirical Likelihood Confidence Intervals for the ROC
More informationSize and Shape of Confidence Regions from Extended Empirical Likelihood Tests
Biometrika (2014),,, pp. 1 13 C 2014 Biometrika Trust Printed in Great Britain Size and Shape of Confidence Regions from Extended Empirical Likelihood Tests BY M. ZHOU Department of Statistics, University
More informationAFT Models and Empirical Likelihood
AFT Models and Empirical Likelihood Mai Zhou Department of Statistics, University of Kentucky Collaborators: Gang Li (UCLA); A. Bathke; M. Kim (Kentucky) Accelerated Failure Time (AFT) models: Y = log(t
More informationA COMPARISON OF POISSON AND BINOMIAL EMPIRICAL LIKELIHOOD Mai Zhou and Hui Fang University of Kentucky
A COMPARISON OF POISSON AND BINOMIAL EMPIRICAL LIKELIHOOD Mai Zhou and Hui Fang University of Kentucky Empirical likelihood with right censored data were studied by Thomas and Grunkmier (1975), Li (1995),
More informationEmpirical Likelihood Tests for High-dimensional Data
Empirical Likelihood Tests for High-dimensional Data Department of Statistics and Actuarial Science University of Waterloo, Canada ICSA - Canada Chapter 2013 Symposium Toronto, August 2-3, 2013 Based on
More informationStat 5101 Lecture Notes
Stat 5101 Lecture Notes Charles J. Geyer Copyright 1998, 1999, 2000, 2001 by Charles J. Geyer May 7, 2001 ii Stat 5101 (Geyer) Course Notes Contents 1 Random Variables and Change of Variables 1 1.1 Random
More informationEmpirical likelihood-based methods for the difference of two trimmed means
Empirical likelihood-based methods for the difference of two trimmed means 24.09.2012. Latvijas Universitate Contents 1 Introduction 2 Trimmed mean 3 Empirical likelihood 4 Empirical likelihood for the
More informationLecture 32: Asymptotic confidence sets and likelihoods
Lecture 32: Asymptotic confidence sets and likelihoods Asymptotic criterion In some problems, especially in nonparametric problems, it is difficult to find a reasonable confidence set with a given confidence
More informationStatistics 262: Intermediate Biostatistics Non-parametric Survival Analysis
Statistics 262: Intermediate Biostatistics Non-parametric Survival Analysis Jonathan Taylor & Kristin Cobb Statistics 262: Intermediate Biostatistics p.1/?? Overview of today s class Kaplan-Meier Curve
More informationEmpirical Likelihood
Empirical Likelihood Patrick Breheny September 20 Patrick Breheny STA 621: Nonparametric Statistics 1/15 Introduction Empirical likelihood We will discuss one final approach to constructing confidence
More informationLikelihood ratio confidence bands in nonparametric regression with censored data
Likelihood ratio confidence bands in nonparametric regression with censored data Gang Li University of California at Los Angeles Department of Biostatistics Ingrid Van Keilegom Eindhoven University of
More informationEmpirical Likelihood in Survival Analysis
Empirical Likelihood in Survival Analysis Gang Li 1, Runze Li 2, and Mai Zhou 3 1 Department of Biostatistics, University of California, Los Angeles, CA 90095 vli@ucla.edu 2 Department of Statistics, The
More informationA Recursive Formula for the Kaplan-Meier Estimator with Mean Constraints
Noname manuscript No. (will be inserted by the editor) A Recursive Formula for the Kaplan-Meier Estimator with Mean Constraints Mai Zhou Yifan Yang Received: date / Accepted: date Abstract In this note
More informationFall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.
1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n
More informationBetter Bootstrap Confidence Intervals
by Bradley Efron University of Washington, Department of Statistics April 12, 2012 An example Suppose we wish to make inference on some parameter θ T (F ) (e.g. θ = E F X ), based on data We might suppose
More informationTail bound inequalities and empirical likelihood for the mean
Tail bound inequalities and empirical likelihood for the mean Sandra Vucane 1 1 University of Latvia, Riga 29 th of September, 2011 Sandra Vucane (LU) Tail bound inequalities and EL for the mean 29.09.2011
More informationCovariance and Correlation
Covariance and Correlation ST 370 The probability distribution of a random variable gives complete information about its behavior, but its mean and variance are useful summaries. Similarly, the joint probability
More informationReview and continuation from last week Properties of MLEs
Review and continuation from last week Properties of MLEs As we have mentioned, MLEs have a nice intuitive property, and as we have seen, they have a certain equivariance property. We will see later that
More informationPenalized Empirical Likelihood and Growing Dimensional General Estimating Equations
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 Biometrika (0000), 00, 0, pp. 1 15 C 0000 Biometrika Trust Printed
More informationInvestigation of goodness-of-fit test statistic distributions by random censored samples
d samples Investigation of goodness-of-fit test statistic distributions by random censored samples Novosibirsk State Technical University November 22, 2010 d samples Outline 1 Nonparametric goodness-of-fit
More informationSTA 2201/442 Assignment 2
STA 2201/442 Assignment 2 1. This is about how to simulate from a continuous univariate distribution. Let the random variable X have a continuous distribution with density f X (x) and cumulative distribution
More informationFIXED-b ASYMPTOTICS FOR BLOCKWISE EMPIRICAL LIKELIHOOD
Statistica Sinica 24 (214), - doi:http://dx.doi.org/1.575/ss.212.321 FIXED-b ASYMPTOTICS FOR BLOCKWISE EMPIRICAL LIKELIHOOD Xianyang Zhang and Xiaofeng Shao University of Missouri-Columbia and University
More informationThe Hybrid Likelihood: Combining Parametric and Empirical Likelihoods
1/25 The Hybrid Likelihood: Combining Parametric and Empirical Likelihoods Nils Lid Hjort (with Ingrid Van Keilegom and Ian McKeague) Department of Mathematics, University of Oslo Building Bridges (at
More informationEstimation for two-phase designs: semiparametric models and Z theorems
Estimation for two-phase designs:semiparametric models and Z theorems p. 1/27 Estimation for two-phase designs: semiparametric models and Z theorems Jon A. Wellner University of Washington Estimation for
More informationEmpirical likelihood based modal regression
Stat Papers (2015) 56:411 430 DOI 10.1007/s00362-014-0588-4 REGULAR ARTICLE Empirical likelihood based modal regression Weihua Zhao Riquan Zhang Yukun Liu Jicai Liu Received: 24 December 2012 / Revised:
More informationSingle Index Quantile Regression for Heteroscedastic Data
Single Index Quantile Regression for Heteroscedastic Data E. Christou M. G. Akritas Department of Statistics The Pennsylvania State University SMAC, November 6, 2015 E. Christou, M. G. Akritas (PSU) SIQR
More information1 Glivenko-Cantelli type theorems
STA79 Lecture Spring Semester Glivenko-Cantelli type theorems Given i.i.d. observations X,..., X n with unknown distribution function F (t, consider the empirical (sample CDF ˆF n (t = I [Xi t]. n Then
More informationEmpirical Likelihood Confidence Intervals for ROC Curves with Missing Data
Georgia State University ScholarWorks @ Georgia State University Mathematics Theses Department of Mathematics and Statistics Spring 4-25-2011 Empirical Likelihood Confidence Intervals for ROC Curves with
More informationEffects of data dimension on empirical likelihood
Biometrika Advance Access published August 8, 9 Biometrika (9), pp. C 9 Biometrika Trust Printed in Great Britain doi:.9/biomet/asp7 Effects of data dimension on empirical likelihood BY SONG XI CHEN Department
More informationTESTING FOR NORMALITY IN THE LINEAR REGRESSION MODEL: AN EMPIRICAL LIKELIHOOD RATIO TEST
Econometrics Working Paper EWP0402 ISSN 1485-6441 Department of Economics TESTING FOR NORMALITY IN THE LINEAR REGRESSION MODEL: AN EMPIRICAL LIKELIHOOD RATIO TEST Lauren Bin Dong & David E. A. Giles Department
More informationEmpirical Likelihood Methods
Handbook of Statistics, Volume 29 Sample Surveys: Theory, Methods and Inference Empirical Likelihood Methods J.N.K. Rao and Changbao Wu (February 14, 2008, Final Version) 1 Likelihood-based Approaches
More informationMaximum likelihood: counterexamples, examples, and open problems. Jon A. Wellner. University of Washington. Maximum likelihood: p.
Maximum likelihood: counterexamples, examples, and open problems Jon A. Wellner University of Washington Maximum likelihood: p. 1/7 Talk at University of Idaho, Department of Mathematics, September 15,
More informationLecture 3. Truncation, length-bias and prevalence sampling
Lecture 3. Truncation, length-bias and prevalence sampling 3.1 Prevalent sampling Statistical techniques for truncated data have been integrated into survival analysis in last two decades. Truncation in
More informationEmpirical likelihood ratio with arbitrarily censored/truncated data by EM algorithm
Empirical likelihood ratio with arbitrarily censored/truncated data by EM algorithm Mai Zhou 1 University of Kentucky, Lexington, KY 40506 USA Summary. Empirical likelihood ratio method (Thomas and Grunkmier
More informationUNIVERSITÄT POTSDAM Institut für Mathematik
UNIVERSITÄT POTSDAM Institut für Mathematik Testing the Acceleration Function in Life Time Models Hannelore Liero Matthias Liero Mathematische Statistik und Wahrscheinlichkeitstheorie Universität Potsdam
More informationThe International Journal of Biostatistics
The International Journal of Biostatistics Volume 1, Issue 1 2005 Article 3 Score Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics Moulinath Banerjee Jon A. Wellner
More informationSMOOTHED BLOCK EMPIRICAL LIKELIHOOD FOR QUANTILES OF WEAKLY DEPENDENT PROCESSES
Statistica Sinica 19 (2009), 71-81 SMOOTHED BLOCK EMPIRICAL LIKELIHOOD FOR QUANTILES OF WEAKLY DEPENDENT PROCESSES Song Xi Chen 1,2 and Chiu Min Wong 3 1 Iowa State University, 2 Peking University and
More informationOther Survival Models. (1) Non-PH models. We briefly discussed the non-proportional hazards (non-ph) model
Other Survival Models (1) Non-PH models We briefly discussed the non-proportional hazards (non-ph) model λ(t Z) = λ 0 (t) exp{β(t) Z}, where β(t) can be estimated by: piecewise constants (recall how);
More informationA Review on Empirical Likelihood Methods for Regression
Noname manuscript No. (will be inserted by the editor) A Review on Empirical Likelihood Methods for Regression Song Xi Chen Ingrid Van Keilegom Received: date / Accepted: date Abstract We provide a review
More informationEmpirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications
Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications Fumiya Akashi Research Associate Department of Applied Mathematics Waseda University
More informationSurvival Analysis: Weeks 2-3. Lu Tian and Richard Olshen Stanford University
Survival Analysis: Weeks 2-3 Lu Tian and Richard Olshen Stanford University 2 Kaplan-Meier(KM) Estimator Nonparametric estimation of the survival function S(t) = pr(t > t) The nonparametric estimation
More informationExtending the two-sample empirical likelihood method
Extending the two-sample empirical likelihood method Jānis Valeinis University of Latvia Edmunds Cers University of Latvia August 28, 2011 Abstract In this paper we establish the empirical likelihood method
More informationEXTENDING THE SCOPE OF EMPIRICAL LIKELIHOOD
The Annals of Statistics 2009, Vol. 37, No. 3, 1079 1111 DOI: 10.1214/07-AOS555 Institute of Mathematical Statistics, 2009 EXTENDING THE SCOPE OF EMPIRICAL LIKELIHOOD BY NILS LID HJORT, IAN W. MCKEAGUE
More informationOutline of GLMs. Definitions
Outline of GLMs Definitions This is a short outline of GLM details, adapted from the book Nonparametric Regression and Generalized Linear Models, by Green and Silverman. The responses Y i have density
More informationJackknife Empirical Likelihood Inference For The Pietra Ratio
Georgia State University ScholarWorks @ Georgia State University Mathematics Theses Department of Mathematics and Statistics 12-17-2014 Jackknife Empirical Likelihood Inference For The Pietra Ratio Yueju
More informationModel Fitting. Jean Yves Le Boudec
Model Fitting Jean Yves Le Boudec 0 Contents 1. What is model fitting? 2. Linear Regression 3. Linear regression with norm minimization 4. Choosing a distribution 5. Heavy Tail 1 Virus Infection Data We
More informationNonparametric hypothesis testing for equality of means on the simplex. Greece,
Nonparametric hypothesis testing for equality of means on the simplex Michail Tsagris 1, Simon Preston 2 and Andrew T.A. Wood 2 1 Department of Computer Science, University of Crete, Herakleion, Greece,
More informationEstimation de mesures de risques à partir des L p -quantiles
1/ 42 Estimation de mesures de risques à partir des L p -quantiles extrêmes Stéphane GIRARD (Inria Grenoble Rhône-Alpes) collaboration avec Abdelaati DAOUIA (Toulouse School of Economics), & Gilles STUPFLER
More informationTesting Statistical Hypotheses
E.L. Lehmann Joseph P. Romano Testing Statistical Hypotheses Third Edition 4y Springer Preface vii I Small-Sample Theory 1 1 The General Decision Problem 3 1.1 Statistical Inference and Statistical Decisions
More informationM- and Z- theorems; GMM and Empirical Likelihood Wellner; 5/13/98, 1/26/07, 5/08/09, 6/14/2010
M- and Z- theorems; GMM and Empirical Likelihood Wellner; 5/13/98, 1/26/07, 5/08/09, 6/14/2010 Z-theorems: Notation and Context Suppose that Θ R k, and that Ψ n : Θ R k, random maps Ψ : Θ R k, deterministic
More informationAsymmetric least squares estimation and testing
Asymmetric least squares estimation and testing Whitney Newey and James Powell Princeton University and University of Wisconsin-Madison January 27, 2012 Outline ALS estimators Large sample properties Asymptotic
More informationIntroduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued
Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations Research
More informationInformation in Data. Sufficiency, Ancillarity, Minimality, and Completeness
Information in Data Sufficiency, Ancillarity, Minimality, and Completeness Important properties of statistics that determine the usefulness of those statistics in statistical inference. These general properties
More informationExtreme L p quantiles as risk measures
1/ 27 Extreme L p quantiles as risk measures Stéphane GIRARD (Inria Grenoble Rhône-Alpes) joint work Abdelaati DAOUIA (Toulouse School of Economics), & Gilles STUPFLER (University of Nottingham) December
More informationCOMPUTATION OF THE EMPIRICAL LIKELIHOOD RATIO FROM CENSORED DATA. Kun Chen and Mai Zhou 1 Bayer Pharmaceuticals and University of Kentucky
COMPUTATION OF THE EMPIRICAL LIKELIHOOD RATIO FROM CENSORED DATA Kun Chen and Mai Zhou 1 Bayer Pharmaceuticals and University of Kentucky Summary The empirical likelihood ratio method is a general nonparametric
More informationInterval Estimation for AR(1) and GARCH(1,1) Models
for AR(1) and GARCH(1,1) Models School of Mathematics Georgia Institute of Technology 2010 This talk is based on the following papers: Ngai Hang Chan, Deyuan Li and (2010). Toward a Unified of Autoregressions.
More informationand Comparison with NPMLE
NONPARAMETRIC BAYES ESTIMATOR OF SURVIVAL FUNCTIONS FOR DOUBLY/INTERVAL CENSORED DATA and Comparison with NPMLE Mai Zhou Department of Statistics, University of Kentucky, Lexington, KY 40506 USA http://ms.uky.edu/
More informationStatistics - Lecture One. Outline. Charlotte Wickham 1. Basic ideas about estimation
Statistics - Lecture One Charlotte Wickham wickham@stat.berkeley.edu http://www.stat.berkeley.edu/~wickham/ Outline 1. Basic ideas about estimation 2. Method of Moments 3. Maximum Likelihood 4. Confidence
More informationMultistate Modeling and Applications
Multistate Modeling and Applications Yang Yang Department of Statistics University of Michigan, Ann Arbor IBM Research Graduate Student Workshop: Statistics for a Smarter Planet Yang Yang (UM, Ann Arbor)
More informationInference on distributions and quantiles using a finite-sample Dirichlet process
Dirichlet IDEAL Theory/methods Simulations Inference on distributions and quantiles using a finite-sample Dirichlet process David M. Kaplan University of Missouri Matt Goldman UC San Diego Midwest Econometrics
More informationQuantile methods. Class Notes Manuel Arellano December 1, Let F (r) =Pr(Y r). Forτ (0, 1), theτth population quantile of Y is defined to be
Quantile methods Class Notes Manuel Arellano December 1, 2009 1 Unconditional quantiles Let F (r) =Pr(Y r). Forτ (0, 1), theτth population quantile of Y is defined to be Q τ (Y ) q τ F 1 (τ) =inf{r : F
More informationSTAT 730 Chapter 5: Hypothesis Testing
STAT 730 Chapter 5: Hypothesis Testing Timothy Hanson Department of Statistics, University of South Carolina Stat 730: Multivariate Analysis 1 / 28 Likelihood ratio test def n: Data X depend on θ. The
More informationAN EMPIRICAL LIKELIHOOD RATIO TEST FOR NORMALITY
Econometrics Working Paper EWP0401 ISSN 1485-6441 Department of Economics AN EMPIRICAL LIKELIHOOD RATIO TEST FOR NORMALITY Lauren Bin Dong & David E. A. Giles Department of Economics, University of Victoria
More informationSTAT 512 sp 2018 Summary Sheet
STAT 5 sp 08 Summary Sheet Karl B. Gregory Spring 08. Transformations of a random variable Let X be a rv with support X and let g be a function mapping X to Y with inverse mapping g (A = {x X : g(x A}
More informationNonparametric Inference via Bootstrapping the Debiased Estimator
Nonparametric Inference via Bootstrapping the Debiased Estimator Yen-Chi Chen Department of Statistics, University of Washington ICSA-Canada Chapter Symposium 2017 1 / 21 Problem Setup Let X 1,, X n be
More informationPost-exam 2 practice questions 18.05, Spring 2014
Post-exam 2 practice questions 18.05, Spring 2014 Note: This is a set of practice problems for the material that came after exam 2. In preparing for the final you should use the previous review materials,
More informationLecture 3. Inference about multivariate normal distribution
Lecture 3. Inference about multivariate normal distribution 3.1 Point and Interval Estimation Let X 1,..., X n be i.i.d. N p (µ, Σ). We are interested in evaluation of the maximum likelihood estimates
More informationStat 710: Mathematical Statistics Lecture 31
Stat 710: Mathematical Statistics Lecture 31 Jun Shao Department of Statistics University of Wisconsin Madison, WI 53706, USA Jun Shao (UW-Madison) Stat 710, Lecture 31 April 13, 2009 1 / 13 Lecture 31:
More informationBIO5312 Biostatistics Lecture 13: Maximum Likelihood Estimation
BIO5312 Biostatistics Lecture 13: Maximum Likelihood Estimation Yujin Chung November 29th, 2016 Fall 2016 Yujin Chung Lec13: MLE Fall 2016 1/24 Previous Parametric tests Mean comparisons (normality assumption)
More informationSTAT 135 Lab 6 Duality of Hypothesis Testing and Confidence Intervals, GLRT, Pearson χ 2 Tests and Q-Q plots. March 8, 2015
STAT 135 Lab 6 Duality of Hypothesis Testing and Confidence Intervals, GLRT, Pearson χ 2 Tests and Q-Q plots March 8, 2015 The duality between CI and hypothesis testing The duality between CI and hypothesis
More informationSOME NOTES ON HOTELLING TUBES
SOME NOTES ON HOTELLING TUBES ROGER KOENKER 1. Introduction We begin with the two examples of Johansen and Johnstone. The first is Hotelling s (1939) original example, and the second is closely related
More informationLinear Models and Estimation by Least Squares
Linear Models and Estimation by Least Squares Jin-Lung Lin 1 Introduction Causal relation investigation lies in the heart of economics. Effect (Dependent variable) cause (Independent variable) Example:
More informationInferences about a Mean Vector
Inferences about a Mean Vector Edps/Soc 584, Psych 594 Carolyn J. Anderson Department of Educational Psychology I L L I N O I S university of illinois at urbana-champaign c Board of Trustees, University
More informationLasso Maximum Likelihood Estimation of Parametric Models with Singular Information Matrices
Article Lasso Maximum Likelihood Estimation of Parametric Models with Singular Information Matrices Fei Jin 1,2 and Lung-fei Lee 3, * 1 School of Economics, Shanghai University of Finance and Economics,
More informationMedian Cross-Validation
Median Cross-Validation Chi-Wai Yu 1, and Bertrand Clarke 2 1 Department of Mathematics Hong Kong University of Science and Technology 2 Department of Medicine University of Miami IISA 2011 Outline Motivational
More informationStatement: With my signature I confirm that the solutions are the product of my own work. Name: Signature:.
MATHEMATICAL STATISTICS Homework assignment Instructions Please turn in the homework with this cover page. You do not need to edit the solutions. Just make sure the handwriting is legible. You may discuss
More informationSingle Index Quantile Regression for Heteroscedastic Data
Single Index Quantile Regression for Heteroscedastic Data E. Christou M. G. Akritas Department of Statistics The Pennsylvania State University JSM, 2015 E. Christou, M. G. Akritas (PSU) SIQR JSM, 2015
More informationConstrained estimation for binary and survival data
Constrained estimation for binary and survival data Jeremy M. G. Taylor Yong Seok Park John D. Kalbfleisch Biostatistics, University of Michigan May, 2010 () Constrained estimation May, 2010 1 / 43 Outline
More informationCOMPUTE CENSORED EMPIRICAL LIKELIHOOD RATIO BY SEQUENTIAL QUADRATIC PROGRAMMING Kun Chen and Mai Zhou University of Kentucky
COMPUTE CENSORED EMPIRICAL LIKELIHOOD RATIO BY SEQUENTIAL QUADRATIC PROGRAMMING Kun Chen and Mai Zhou University of Kentucky Summary Empirical likelihood ratio method (Thomas and Grunkmier 975, Owen 988,
More informationRegression and Statistical Inference
Regression and Statistical Inference Walid Mnif wmnif@uwo.ca Department of Applied Mathematics The University of Western Ontario, London, Canada 1 Elements of Probability 2 Elements of Probability CDF&PDF
More informationMaximum likelihood: counterexamples, examples, and open problems
Maximum likelihood: counterexamples, examples, and open problems Jon A. Wellner University of Washington visiting Vrije Universiteit, Amsterdam Talk at BeNeLuxFra Mathematics Meeting 21 May, 2005 Email:
More informationInference For High Dimensional M-estimates: Fixed Design Results
Inference For High Dimensional M-estimates: Fixed Design Results Lihua Lei, Peter Bickel and Noureddine El Karoui Department of Statistics, UC Berkeley Berkeley-Stanford Econometrics Jamboree, 2017 1/49
More informationSTATISTICS SYLLABUS UNIT I
STATISTICS SYLLABUS UNIT I (Probability Theory) Definition Classical and axiomatic approaches.laws of total and compound probability, conditional probability, Bayes Theorem. Random variable and its distribution
More informationEXPLICIT NONPARAMETRIC CONFIDENCE INTERVALS FOR THE VARIANCE WITH GUARANTEED COVERAGE
EXPLICIT NONPARAMETRIC CONFIDENCE INTERVALS FOR THE VARIANCE WITH GUARANTEED COVERAGE Joseph P. Romano Department of Statistics Stanford University Stanford, California 94305 romano@stat.stanford.edu Michael
More informationMonitoring Wafer Geometric Quality using Additive Gaussian Process
Monitoring Wafer Geometric Quality using Additive Gaussian Process Linmiao Zhang 1 Kaibo Wang 2 Nan Chen 1 1 Department of Industrial and Systems Engineering, National University of Singapore 2 Department
More information