Testing Algebraic Hypotheses
|
|
- Kelly Bryant
- 5 years ago
- Views:
Transcription
1 Testing Algebraic Hypotheses Mathias Drton Department of Statistics University of Chicago 1 / 18
2 Example: Factor analysis Multivariate normal model based on conditional independence given hidden variable: X 1 = γ 1 H + ɛ 1, X 2 = γ 2 H + ɛ 2, X 3 = γ 3 H + ɛ 3, X1 X2 X3 X4 X 4 = γ 4 H + ɛ 4 Software (e.g. factanal in R) tests goodness-of-fit using LRT and χ 2 2 -approximation H 2 / 18
3 Example: Factor analysis Histograms of 20,000 simulated p-values for sample size n = 1000: Γ = (1, 1, 1, 1) t Γ = (1, 1, 1, 0) t Γ = (1, 1, 0, 0) t Γ = (1, 0, 0, 0) t p value p value p value p value (Conditional/error variances = 1/3 = correlations = 0 or 3/4) Three types of limiting distributions? 3 / 18
4 Algebraic models Asymptotic behavior of the LRT in hidden variable models? Hidden variable models: parameter space smooth manifold Classical hidden variable models: parameter space is semi-algebraic Definition A semi-algebraic set is a finite union of the form Θ 0 = m {θ R k f (θ) = 0 for f F i and h(θ) > 0 for h H i } i=1 where F i, H i are finite collections of polynomials with real coefficients. 4 / 18
5 Example: Factor analysis Polynomially parametrized covariance matrix: ω 1 + γ1 2 γ 1 γ 2 γ 1 γ 3 γ 1 γ 4 ω 2 + γ2 2 γ 2 γ 3 γ 2 γ 4 Σ = ω 3 + γ3 2 γ 3 γ 4 ω 4 + γ 2 4 (assumed Var[H] = 1) Theorem (Tarski-Seidenberg) If g : R d R k is a polynomial map and Γ is a semi-algebraic set, then Θ 0 = g(γ) is semi-algebraic. 5 / 18
6 Likelihood ratio test Observations X (1),..., X (n) i.i.d. P θ, θ Θ R k Likelihood function where p θ (x) is density of P θ. Test for some Θ 0 Θ 1 Θ. L n : Θ R, θ n p θ (X (i) ), i=1 H 0 : θ Θ 0 vs. H 1 : θ Θ 1 \ Θ 0 Likelihood ratio test rejects H 0 for large values of the LR statistic λ n = 2 log sup θ Θ 1 L n (θ) sup θ Θ0 L n (θ).
7 Normal means Given observations and a set Θ 0 R k, test LR statistic: X (1),..., X (n) i.i.d. N (θ, Id k ), θ R k, H 0 : θ Θ 0 vs. H 1 : θ Θ 0 λ n = n inf θ Θ 0 X n θ 2 2 = inf θ Θ 0 n( X n θ 0 ) n(θ θ 0 ) 2 2 where θ 0 Θ 0 is true parameter and X n is the sample mean. Large sample distribution Squared distance between Z N (0, Id k ) and limit of n(θ 0 θ 0 ) 7 / 18
8 Normal means: Cuspidal cubic Cuspidal cubic Θ 0 = {(θ 1, θ 2 ) : θ1 3 = θ2} 2 Tangent cone at θ 0 = 0 is half-ray: TC 0 (Θ 0 ) = {θ : θ 1 0, θ 2 = 0} Mixture of chi-squares: λ n Definition (Tangent cone) { TC θ0 (Θ 0 ) = D 1 2 χ χ2 2. } θ n θ 0 lim : β n > 0, θ n Θ 0, θ n θ 0 n β n 3 8 / 18
9 Chernoff s theorem Suppose {P θ : θ Θ} is a regular exponential family with Θ R k. Let θ 0 Θ 0 Θ be true parameter point with Fisher-information I (θ 0 ). If Θ 0 is Chernoff-regular at θ 0 and n, then LR statistic λ n for H 0 : θ Θ 0 vs. H 1 : θ Θ 0 converges to min τ TC θ0 (Θ 0 ) Z I (θ 0) 1/2 τ 2 2 where Z N (0, Id k ) and I (θ 0 ) 1/2 is any matrix square root of I (θ 0 ). Chi-square distributions Chi-square distribution: distance from linear space Chi-square mixtures: distances from convex cones 9 / 18
10 What is Chernoff-regularity? Condition on how tangent cone locally approximates a set. Definition A set Θ 0 R k is Chernoff-regular at θ 0 if For all τ TC θ0 (Θ 0 ) and β n 0 there exists a sequence θ n θ 0 in Θ 0 such that θ n θ 0 lim = τ. n β n Lemma Semi-algebraic sets are everywhere Chernoff-regular. 10 / 18
11 Algebra Geometry of a semi-algebraic set Θ 0 R k expresses itself algebraically in the vanishing ideal I(Θ 0 ) = {f R[t 1,..., t k ] : f (θ) = 0 for all θ Θ 0 }. Computation with suitable finite generating sets f 1,..., f s = I(Θ 0 ), f 1,..., f s R[t 1,..., t k ] reveals singularities and provides information about tangent cones. 11 / 18
12 Cuspidal cubic Cuspidal cubic Θ 0 = {(θ 1, θ 2 ) : θ1 3 θ2 2 = 0} Singularity at zero: (θ1 3 θ2) 2 = 0 Algebraic tangent cone {θ : θ2 2 = 0} = {θ : θ 2 = 0} contains as full-dimensional subset the tangent cone: TC 0 (Θ 0 ) = {(θ 1, θ 2 ) : θ 1 0, θ 2 = 0} 12 / 18
13 An incorrect personal view of the one-factor model Singularities: / 18
14 Bootstrapping/Subsampling: 4000 simulations p value p value p value (Σ 0 = I 4 4, n = 2000, m = 100) 14 / 18
15 Wald test Model {P θ : θ Θ}, Θ R k, with asymptotically normal estimator n(ˆθ n θ 0 ) d N (0, Σ(θ 0 )), where Σ(θ 0 ) is positive definite and depends continuously on θ 0. Test polynomial constraint f (θ) = 0 using Wald statistic W n = f (ˆθ n ) 2 Var[f (ˆθ n )] = n f (ˆθ n ) 2 f (ˆθ n ) t Σ(ˆθ n ) f (ˆθ n ) Lemma (Smooth case) If f (θ 0 ) = 0 and f (θ 0 ) 0, then W n d χ 2 1. Equivalence of LRT and Wald test 15 / 18
16 General asymptotics Write f (t) = L f h (t θ 0 ), h=l where f h are homogeneous polynomials, deg(f h ) = h and f l 0. Since f (θ 0 ) = 0, the minimal degree l 1, and we define f θ0,min = f l. For any polyhomial h, define W (h, Σ) = h(z) 2 h(z) T Σ h(z), Z N (0, Σ). Lemma If f (θ 0 ) = 0, then W n d W (f θ0,min, Σ(θ 0 )). 16 / 18
17 Theorem (work in progress, with H. Xiao) (a) If h(z) = Z u 1 Z v 2 and Σ any positive definite matrix, then W (h, Σ) 1 (u + v) 2 χ2 1. (b) Let h(z) = az bZ 1Z 2 + cz2 2 and Σ = I. Always, χ2 1 d W (h, I ) d 4 χ2 2. If b 2 ac 0, then W (h, I ) 1 4 χ2 1. If b 2 ac < 0, then W (h, I ) 1 [ 4(ac b 2 ] 4 ) (a + c) 2 Z Z2 2. Note: Behavior of Wald test very different from LRT at singularities.
18 Take home Hidden variables algebraic models with ( arbitrarily ) complicated singularities Algebraic models: LR statistic always converges to distance from tangent cone; Standard bootstrap (n-out-of-n) inconsistent at singularities (e.g., see forthcoming paper with B. Williams) Subsampling/m-out-of-n bootstrap ok in pointwise asymptotic sense. In singular models, Wald LRT References, see e.g. [Drton, Sturmfels and Sullivant: Lectures on Algebraic Statistics, Oberwolfach Seminars Series, Vol. 39, Birkhäuser, Basel, 2009] 18 / 18
19 Regular exponential family Let P Θ = {P θ : θ Θ} be a family of prob. distributions on X R m that have densities p θ wrto. measure ν. We call P Θ an exponential family if there is a statistic T : X R k and functions h : Θ R k and Z : Θ R such that p θ (x) = 1 exp{ h(θ), T (x) }, x X. Z(θ) We say that P Θ is a regular exponential family (of order k) if { } H = η R k : exp{ η, T (x) } dν(x) < is an open subset of R k and h a diffeomorphism between Θ and H. X Fisher-information matrix Positive (semi-)definite matrix I (θ) with entries [( ) ( )] I (θ) ij = E θ log p θ (X ) log p θ (X ), i, j [k]. θ i θ j 18 / 18
arxiv:math/ v3 [math.st] 2 Apr 2009
The Annals of Statistics 2009, Vol. 37, No. 2, 979 1012 DOI: 10.1214/07-AOS571 c Institute of Mathematical Statistics, 2009 arxiv:math/0703360v3 [math.st] 2 Apr 2009 LIKELIHOOD RATIO TESTS AND SINGULARITIES
More informationALGEBRAIC STATISTICAL MODELS
Statistica Sinica 7(007), 73-97 ALGEBRAIC STATISTICAL MODELS Mathias Drton and Seth Sullivant University of Chicago and Harvard University Abstract: Many statistical models are algebraic in that they are
More informationarxiv: v1 [math.st] 22 Jun 2018
Hypothesis testing near singularities and boundaries arxiv:1806.08458v1 [math.st] Jun 018 Jonathan D. Mitchell, Elizabeth S. Allman, and John A. Rhodes Department of Mathematics & Statistics University
More informationStat 710: Mathematical Statistics Lecture 31
Stat 710: Mathematical Statistics Lecture 31 Jun Shao Department of Statistics University of Wisconsin Madison, WI 53706, USA Jun Shao (UW-Madison) Stat 710, Lecture 31 April 13, 2009 1 / 13 Lecture 31:
More informationComposite Hypotheses and Generalized Likelihood Ratio Tests
Composite Hypotheses and Generalized Likelihood Ratio Tests Rebecca Willett, 06 In many real world problems, it is difficult to precisely specify probability distributions. Our models for data may involve
More informationLecture 32: Asymptotic confidence sets and likelihoods
Lecture 32: Asymptotic confidence sets and likelihoods Asymptotic criterion In some problems, especially in nonparametric problems, it is difficult to find a reasonable confidence set with a given confidence
More informationLecture 17: Likelihood ratio and asymptotic tests
Lecture 17: Likelihood ratio and asymptotic tests Likelihood ratio When both H 0 and H 1 are simple (i.e., Θ 0 = {θ 0 } and Θ 1 = {θ 1 }), Theorem 6.1 applies and a UMP test rejects H 0 when f θ1 (X) f
More informationHypothesis Testing. 1 Definitions of test statistics. CB: chapter 8; section 10.3
Hypothesis Testing CB: chapter 8; section 0.3 Hypothesis: statement about an unknown population parameter Examples: The average age of males in Sweden is 7. (statement about population mean) The lowest
More information1 Glivenko-Cantelli type theorems
STA79 Lecture Spring Semester Glivenko-Cantelli type theorems Given i.i.d. observations X,..., X n with unknown distribution function F (t, consider the empirical (sample CDF ˆF n (t = I [Xi t]. n Then
More informationNotes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed
18.466 Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed 1. MLEs in exponential families Let f(x,θ) for x X and θ Θ be a likelihood function, that is, for present purposes,
More informationThe intersection axiom of
The intersection axiom of conditional independence: some new [?] results Richard D. Gill Mathematical Institute, University Leiden This version: 26 March, 2019 (X Y Z) & (X Z Y) X (Y, Z) Presented at Algebraic
More informationAn exponential family of distributions is a parametric statistical model having densities with respect to some positive measure λ of the form.
Stat 8112 Lecture Notes Asymptotics of Exponential Families Charles J. Geyer January 23, 2013 1 Exponential Families An exponential family of distributions is a parametric statistical model having densities
More informationChapter 7. Hypothesis Testing
Chapter 7. Hypothesis Testing Joonpyo Kim June 24, 2017 Joonpyo Kim Ch7 June 24, 2017 1 / 63 Basic Concepts of Testing Suppose that our interest centers on a random variable X which has density function
More informationSTATS 200: Introduction to Statistical Inference. Lecture 29: Course review
STATS 200: Introduction to Statistical Inference Lecture 29: Course review Course review We started in Lecture 1 with a fundamental assumption: Data is a realization of a random process. The goal throughout
More informationSome New Aspects of Dose-Response Models with Applications to Multistage Models Having Parameters on the Boundary
Some New Aspects of Dose-Response Models with Applications to Multistage Models Having Parameters on the Boundary Bimal Sinha Department of Mathematics & Statistics University of Maryland, Baltimore County,
More informationMathematics Ph.D. Qualifying Examination Stat Probability, January 2018
Mathematics Ph.D. Qualifying Examination Stat 52800 Probability, January 2018 NOTE: Answers all questions completely. Justify every step. Time allowed: 3 hours. 1. Let X 1,..., X n be a random sample from
More informationStatistical Data Analysis Stat 3: p-values, parameter estimation
Statistical Data Analysis Stat 3: p-values, parameter estimation London Postgraduate Lectures on Particle Physics; University of London MSci course PH4515 Glen Cowan Physics Department Royal Holloway,
More informationLecture 28: Asymptotic confidence sets
Lecture 28: Asymptotic confidence sets 1 α asymptotic confidence sets Similar to testing hypotheses, in many situations it is difficult to find a confidence set with a given confidence coefficient or level
More informationStatistical Methods for Handling Incomplete Data Chapter 2: Likelihood-based approach
Statistical Methods for Handling Incomplete Data Chapter 2: Likelihood-based approach Jae-Kwang Kim Department of Statistics, Iowa State University Outline 1 Introduction 2 Observed likelihood 3 Mean Score
More informationFinal Exam. 1. (6 points) True/False. Please read the statements carefully, as no partial credit will be given.
1. (6 points) True/False. Please read the statements carefully, as no partial credit will be given. (a) If X and Y are independent, Corr(X, Y ) = 0. (b) (c) (d) (e) A consistent estimator must be asymptotically
More informationMaster s Written Examination
Master s Written Examination Option: Statistics and Probability Spring 016 Full points may be obtained for correct answers to eight questions. Each numbered question which may have several parts is worth
More informationTesting Hypothesis. Maura Mezzetti. Department of Economics and Finance Università Tor Vergata
Maura Department of Economics and Finance Università Tor Vergata Hypothesis Testing Outline It is a mistake to confound strangeness with mystery Sherlock Holmes A Study in Scarlet Outline 1 The Power Function
More informationDA Freedman Notes on the MLE Fall 2003
DA Freedman Notes on the MLE Fall 2003 The object here is to provide a sketch of the theory of the MLE. Rigorous presentations can be found in the references cited below. Calculus. Let f be a smooth, scalar
More informationConvergence of Quantum Statistical Experiments
Convergence of Quantum Statistical Experiments M!d!lin Gu"! University of Nottingham Jonas Kahn (Paris-Sud) Richard Gill (Leiden) Anna Jen#ová (Bratislava) Statistical experiments and statistical decision
More informationSome General Types of Tests
Some General Types of Tests We may not be able to find a UMP or UMPU test in a given situation. In that case, we may use test of some general class of tests that often have good asymptotic properties.
More informationExercises Chapter 4 Statistical Hypothesis Testing
Exercises Chapter 4 Statistical Hypothesis Testing Advanced Econometrics - HEC Lausanne Christophe Hurlin University of Orléans December 5, 013 Christophe Hurlin (University of Orléans) Advanced Econometrics
More informationIntroduction Large Sample Testing Composite Hypotheses. Hypothesis Testing. Daniel Schmierer Econ 312. March 30, 2007
Hypothesis Testing Daniel Schmierer Econ 312 March 30, 2007 Basics Parameter of interest: θ Θ Structure of the test: H 0 : θ Θ 0 H 1 : θ Θ 1 for some sets Θ 0, Θ 1 Θ where Θ 0 Θ 1 = (often Θ 1 = Θ Θ 0
More informationOpen Problems in Algebraic Statistics
Open Problems inalgebraic Statistics p. Open Problems in Algebraic Statistics BERND STURMFELS UNIVERSITY OF CALIFORNIA, BERKELEY and TECHNISCHE UNIVERSITÄT BERLIN Advertisement Oberwolfach Seminar Algebraic
More informationFinal Examination Statistics 200C. T. Ferguson June 11, 2009
Final Examination Statistics 00C T. Ferguson June, 009. (a) Define: X n converges in probability to X. (b) Define: X m converges in quadratic mean to X. (c) Show that if X n converges in quadratic mean
More informationAsymptotic Approximation of Marginal Likelihood Integrals
Asymptotic Approximation of Marginal Likelihood Integrals Shaowei Lin 10 Dec 2008 Abstract We study the asymptotics of marginal likelihood integrals for discrete models using resolution of singularities
More informationChapter 7. Confidence Sets Lecture 30: Pivotal quantities and confidence sets
Chapter 7. Confidence Sets Lecture 30: Pivotal quantities and confidence sets Confidence sets X: a sample from a population P P. θ = θ(p): a functional from P to Θ R k for a fixed integer k. C(X): a confidence
More informationLet us first identify some classes of hypotheses. simple versus simple. H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided
Let us first identify some classes of hypotheses. simple versus simple H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided H 0 : θ θ 0 versus H 1 : θ > θ 0. (2) two-sided; null on extremes H 0 : θ θ 1 or
More informationMaximum Likelihood Tests and Quasi-Maximum-Likelihood
Maximum Likelihood Tests and Quasi-Maximum-Likelihood Wendelin Schnedler Department of Economics University of Heidelberg 10. Dezember 2007 Wendelin Schnedler (AWI) Maximum Likelihood Tests and Quasi-Maximum-Likelihood10.
More informationsimple if it completely specifies the density of x
3. Hypothesis Testing Pure significance tests Data x = (x 1,..., x n ) from f(x, θ) Hypothesis H 0 : restricts f(x, θ) Are the data consistent with H 0? H 0 is called the null hypothesis simple if it completely
More informationWALD TESTS OF SINGULAR HYPOTHESES. By Mathias Drton and Han Xiao University of Washington and Rutgers University
WALD TESTS OF SINGULAR HYPOTHESES By Mathias Drton and Han Xiao University of Washington and Rutgers University Motivated by the problem of testing tetrad constraints in factor analysis, we study the large-sample
More informationA Very Brief Summary of Statistical Inference, and Examples
A Very Brief Summary of Statistical Inference, and Examples Trinity Term 2009 Prof. Gesine Reinert Our standard situation is that we have data x = x 1, x 2,..., x n, which we view as realisations of random
More informationChapter 4. Theory of Tests. 4.1 Introduction
Chapter 4 Theory of Tests 4.1 Introduction Parametric model: (X, B X, P θ ), P θ P = {P θ θ Θ} where Θ = H 0 +H 1 X = K +A : K: critical region = rejection region / A: acceptance region A decision rule
More informationStatistical Inference of Moment Structures
1 Handbook of Computing and Statistics with Applications, Vol. 1 ISSN: 1871-0301 2007 Elsevier B.V. All rights reserved DOI: 10.1016/S1871-0301(06)01011-0 1 Statistical Inference of Moment Structures Alexander
More informationChapter 1: A Brief Review of Maximum Likelihood, GMM, and Numerical Tools. Joan Llull. Microeconometrics IDEA PhD Program
Chapter 1: A Brief Review of Maximum Likelihood, GMM, and Numerical Tools Joan Llull Microeconometrics IDEA PhD Program Maximum Likelihood Chapter 1. A Brief Review of Maximum Likelihood, GMM, and Numerical
More informationStatistics Ph.D. Qualifying Exam: Part I October 18, 2003
Statistics Ph.D. Qualifying Exam: Part I October 18, 2003 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. 1 2 3 4 5 6 7 8 9 10 11 12 2. Write your answer
More informationConcentration Inequalities for Random Matrices
Concentration Inequalities for Random Matrices M. Ledoux Institut de Mathématiques de Toulouse, France exponential tail inequalities classical theme in probability and statistics quantify the asymptotic
More informationHypothesis testing: theory and methods
Statistical Methods Warsaw School of Economics November 3, 2017 Statistical hypothesis is the name of any conjecture about unknown parameters of a population distribution. The hypothesis should be verifiable
More informationLecture 26: Likelihood ratio tests
Lecture 26: Likelihood ratio tests Likelihood ratio When both H 0 and H 1 are simple (i.e., Θ 0 = {θ 0 } and Θ 1 = {θ 1 }), Theorem 6.1 applies and a UMP test rejects H 0 when f θ1 (X) f θ0 (X) > c 0 for
More informationMaximum Likelihood Estimation
Chapter 8 Maximum Likelihood Estimation 8. Consistency If X is a random variable (or vector) with density or mass function f θ (x) that depends on a parameter θ, then the function f θ (X) viewed as a function
More informationIntroduction to Estimation Methods for Time Series models Lecture 2
Introduction to Estimation Methods for Time Series models Lecture 2 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 2 SNS Pisa 1 / 21 Estimators:
More informationChapter 4: Constrained estimators and tests in the multiple linear regression model (Part III)
Chapter 4: Constrained estimators and tests in the multiple linear regression model (Part III) Florian Pelgrin HEC September-December 2010 Florian Pelgrin (HEC) Constrained estimators September-December
More informationSTAT 461/561- Assignments, Year 2015
STAT 461/561- Assignments, Year 2015 This is the second set of assignment problems. When you hand in any problem, include the problem itself and its number. pdf are welcome. If so, use large fonts and
More informationComplexity of two and multi-stage stochastic programming problems
Complexity of two and multi-stage stochastic programming problems A. Shapiro School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332-0205, USA The concept
More informationNonconcave Penalized Likelihood with A Diverging Number of Parameters
Nonconcave Penalized Likelihood with A Diverging Number of Parameters Jianqing Fan and Heng Peng Presenter: Jiale Xu March 12, 2010 Jianqing Fan and Heng Peng Presenter: JialeNonconcave Xu () Penalized
More informationInformation geometry for bivariate distribution control
Information geometry for bivariate distribution control C.T.J.Dodson + Hong Wang Mathematics + Control Systems Centre, University of Manchester Institute of Science and Technology Optimal control of stochastic
More information10. Composite Hypothesis Testing. ECE 830, Spring 2014
10. Composite Hypothesis Testing ECE 830, Spring 2014 1 / 25 In many real world problems, it is difficult to precisely specify probability distributions. Our models for data may involve unknown parameters
More informationLecture 21. Hypothesis Testing II
Lecture 21. Hypothesis Testing II December 7, 2011 In the previous lecture, we dened a few key concepts of hypothesis testing and introduced the framework for parametric hypothesis testing. In the parametric
More informationGeometry of Phylogenetic Inference
Geometry of Phylogenetic Inference Matilde Marcolli CS101: Mathematical and Computational Linguistics Winter 2015 References N. Eriksson, K. Ranestad, B. Sturmfels, S. Sullivant, Phylogenetic algebraic
More informationf(x θ)dx with respect to θ. Assuming certain smoothness conditions concern differentiating under the integral the integral sign, we first obtain
0.1. INTRODUCTION 1 0.1 Introduction R. A. Fisher, a pioneer in the development of mathematical statistics, introduced a measure of the amount of information contained in an observaton from f(x θ). Fisher
More informationMaximum Likelihood Estimation
Chapter 7 Maximum Likelihood Estimation 7. Consistency If X is a random variable (or vector) with density or mass function f θ (x) that depends on a parameter θ, then the function f θ (X) viewed as a function
More informationHigh-dimensional graphical model selection: Practical and information-theoretic limits
1 High-dimensional graphical model selection: Practical and information-theoretic limits Martin Wainwright Departments of Statistics, and EECS UC Berkeley, California, USA Based on joint work with: John
More informationAlgebraic Statistics progress report
Algebraic Statistics progress report Joe Neeman December 11, 2008 1 A model for biochemical reaction networks We consider a model introduced by Craciun, Pantea and Rempala [2] for identifying biochemical
More information10-704: Information Processing and Learning Fall Lecture 24: Dec 7
0-704: Information Processing and Learning Fall 206 Lecturer: Aarti Singh Lecture 24: Dec 7 Note: These notes are based on scribed notes from Spring5 offering of this course. LaTeX template courtesy of
More informationLecture 3. G. Cowan. Lecture 3 page 1. Lectures on Statistical Data Analysis
Lecture 3 1 Probability (90 min.) Definition, Bayes theorem, probability densities and their properties, catalogue of pdfs, Monte Carlo 2 Statistical tests (90 min.) general concepts, test statistics,
More informationStatistics Ph.D. Qualifying Exam
Department of Statistics Carnegie Mellon University May 7 2008 Statistics Ph.D. Qualifying Exam You are not expected to solve all five problems. Complete solutions to few problems will be preferred to
More informationMcGill University. Faculty of Science. Department of Mathematics and Statistics. Part A Examination. Statistics: Theory Paper
McGill University Faculty of Science Department of Mathematics and Statistics Part A Examination Statistics: Theory Paper Date: 10th May 2015 Instructions Time: 1pm-5pm Answer only two questions from Section
More informationThe Uniform Weak Law of Large Numbers and the Consistency of M-Estimators of Cross-Section and Time Series Models
The Uniform Weak Law of Large Numbers and the Consistency of M-Estimators of Cross-Section and Time Series Models Herman J. Bierens Pennsylvania State University September 16, 2005 1. The uniform weak
More informationQualifying Exam in Probability and Statistics. https://www.soa.org/files/edu/edu-exam-p-sample-quest.pdf
Part : Sample Problems for the Elementary Section of Qualifying Exam in Probability and Statistics https://www.soa.org/files/edu/edu-exam-p-sample-quest.pdf Part 2: Sample Problems for the Advanced Section
More informationNonparametric Tests for Multi-parameter M-estimators
Nonparametric Tests for Multi-parameter M-estimators John Robinson School of Mathematics and Statistics University of Sydney The talk is based on joint work with John Kolassa. It follows from work over
More informationConsistency of the maximum likelihood estimator for general hidden Markov models
Consistency of the maximum likelihood estimator for general hidden Markov models Jimmy Olsson Centre for Mathematical Sciences Lund University Nordstat 2012 Umeå, Sweden Collaborators Hidden Markov models
More informationSemiparametric posterior limits
Statistics Department, Seoul National University, Korea, 2012 Semiparametric posterior limits for regular and some irregular problems Bas Kleijn, KdV Institute, University of Amsterdam Based on collaborations
More informationContents. O-minimal geometry. Tobias Kaiser. Universität Passau. 19. Juli O-minimal geometry
19. Juli 2016 1. Axiom of o-minimality 1.1 Semialgebraic sets 2.1 Structures 2.2 O-minimal structures 2. Tameness 2.1 Cell decomposition 2.2 Smoothness 2.3 Stratification 2.4 Triangulation 2.5 Trivialization
More informationparameter space Θ, depending only on X, such that Note: it is not θ that is random, but the set C(X).
4. Interval estimation The goal for interval estimation is to specify the accurary of an estimate. A 1 α confidence set for a parameter θ is a set C(X) in the parameter space Θ, depending only on X, such
More informationMixture Models and Representational Power of RBM s, DBN s and DBM s
Mixture Models and Representational Power of RBM s, DBN s and DBM s Guido Montufar Max Planck Institute for Mathematics in the Sciences, Inselstraße 22, D-04103 Leipzig, Germany. montufar@mis.mpg.de Abstract
More informationGraduate Econometrics I: Maximum Likelihood I
Graduate Econometrics I: Maximum Likelihood I Yves Dominicy Université libre de Bruxelles Solvay Brussels School of Economics and Management ECARES Yves Dominicy Graduate Econometrics I: Maximum Likelihood
More informationChernoff Index for Cox Test of Separate Parametric Families. Xiaoou Li, Jingchen Liu, and Zhiliang Ying Columbia University.
Chernoff Index for Cox Test of Separate Parametric Families Xiaoou Li, Jingchen Liu, and Zhiliang Ying Columbia University June 28, 2016 arxiv:1606.08248v1 [math.st] 27 Jun 2016 Abstract The asymptotic
More informationLecture 1: Introduction
Principles of Statistics Part II - Michaelmas 208 Lecturer: Quentin Berthet Lecture : Introduction This course is concerned with presenting some of the mathematical principles of statistical theory. One
More informationLecture 8: Information Theory and Statistics
Lecture 8: Information Theory and Statistics Part II: Hypothesis Testing and Estimation I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw December 22, 2015
More informationMISCELLANEOUS TOPICS RELATED TO LIKELIHOOD. Copyright c 2012 (Iowa State University) Statistics / 30
MISCELLANEOUS TOPICS RELATED TO LIKELIHOOD Copyright c 2012 (Iowa State University) Statistics 511 1 / 30 INFORMATION CRITERIA Akaike s Information criterion is given by AIC = 2l(ˆθ) + 2k, where l(ˆθ)
More information1 Likelihood. 1.1 Likelihood function. Likelihood & Maximum Likelihood Estimators
Likelihood & Maximum Likelihood Estimators February 26, 2018 Debdeep Pati 1 Likelihood Likelihood is surely one of the most important concepts in statistical theory. We have seen the role it plays in sufficiency,
More informationStatistical Inference
Statistical Inference Robert L. Wolpert Institute of Statistics and Decision Sciences Duke University, Durham, NC, USA. Asymptotic Inference in Exponential Families Let X j be a sequence of independent,
More informationis a Borel subset of S Θ for each c R (Bertsekas and Shreve, 1978, Proposition 7.36) This always holds in practical applications.
Stat 811 Lecture Notes The Wald Consistency Theorem Charles J. Geyer April 9, 01 1 Analyticity Assumptions Let { f θ : θ Θ } be a family of subprobability densities 1 with respect to a measure µ on a measurable
More informationTesting Statistical Hypotheses
E.L. Lehmann Joseph P. Romano Testing Statistical Hypotheses Third Edition 4y Springer Preface vii I Small-Sample Theory 1 1 The General Decision Problem 3 1.1 Statistical Inference and Statistical Decisions
More information1. Plurisubharmonic functions and currents The first part of the homework studies some properties of PSH functions.
MATH 263: PROBLEM SET 2: PSH FUNCTIONS, HORMANDER S ESTIMATES AND VANISHING THEOREMS 1. Plurisubharmonic functions and currents The first part of the homework studies some properties of PSH functions.
More informationEconomics 583: Econometric Theory I A Primer on Asymptotics
Economics 583: Econometric Theory I A Primer on Asymptotics Eric Zivot January 14, 2013 The two main concepts in asymptotic theory that we will use are Consistency Asymptotic Normality Intuition consistency:
More informationRectifiability of sets and measures
Rectifiability of sets and measures Tatiana Toro University of Washington IMPA February 7, 206 Tatiana Toro (University of Washington) Structure of n-uniform measure in R m February 7, 206 / 23 State of
More informationChapter 3: Maximum Likelihood Theory
Chapter 3: Maximum Likelihood Theory Florian Pelgrin HEC September-December, 2010 Florian Pelgrin (HEC) Maximum Likelihood Theory September-December, 2010 1 / 40 1 Introduction Example 2 Maximum likelihood
More informationThe Geometry of Cubic Maps
The Geometry of Cubic Maps John Milnor Stony Brook University (www.math.sunysb.edu) work with Araceli Bonifant and Jan Kiwi Conformal Dynamics and Hyperbolic Geometry CUNY Graduate Center, October 23,
More informationA MODIFIED LIKELIHOOD RATIO TEST FOR HOMOGENEITY IN FINITE MIXTURE MODELS
A MODIFIED LIKELIHOOD RATIO TEST FOR HOMOGENEITY IN FINITE MIXTURE MODELS Hanfeng Chen, Jiahua Chen and John D. Kalbfleisch Bowling Green State University and University of Waterloo Abstract Testing for
More informationTesting Restrictions and Comparing Models
Econ. 513, Time Series Econometrics Fall 00 Chris Sims Testing Restrictions and Comparing Models 1. THE PROBLEM We consider here the problem of comparing two parametric models for the data X, defined by
More informationResolution of Singularities in Algebraic Varieties
Resolution of Singularities in Algebraic Varieties Emma Whitten Summer 28 Introduction Recall that algebraic geometry is the study of objects which are or locally resemble solution sets of polynomial equations.
More informationOptimal exact tests for complex alternative hypotheses on cross tabulated data
Optimal exact tests for complex alternative hypotheses on cross tabulated data Daniel Yekutieli Statistics and OR Tel Aviv University CDA course 29 July 2017 Yekutieli (TAU) Optimal exact tests for complex
More informationConvergence of Multivariate Quantile Surfaces
Convergence of Multivariate Quantile Surfaces Adil Ahidar Institut de Mathématiques de Toulouse - CERFACS August 30, 2013 Adil Ahidar (Institut de Mathématiques de Toulouse Convergence - CERFACS) of Multivariate
More informationINDIAN INSTITUTE OF TECHNOLOGY BOMBAY MA205 Complex Analysis Autumn 2012
INDIAN INSTITUTE OF TECHNOLOGY BOMBAY MA205 Complex Analysis Autumn 2012 September 5, 2012 Mapping Properties Lecture 13 We shall once again return to the study of general behaviour of holomorphic functions
More informationENEE 621 SPRING 2016 DETECTION AND ESTIMATION THEORY THE PARAMETER ESTIMATION PROBLEM
c 2007-2016 by Armand M. Makowski 1 ENEE 621 SPRING 2016 DETECTION AND ESTIMATION THEORY THE PARAMETER ESTIMATION PROBLEM 1 The basic setting Throughout, p, q and k are positive integers. The setup With
More informationSTAT 135 Lab 5 Bootstrapping and Hypothesis Testing
STAT 135 Lab 5 Bootstrapping and Hypothesis Testing Rebecca Barter March 2, 2015 The Bootstrap Bootstrap Suppose that we are interested in estimating a parameter θ from some population with members x 1,...,
More informationTESTS FOR HOMOGENEITY IN NORMAL MIXTURES IN THE PRESENCE OF A STRUCTURAL PARAMETER: TECHNICAL DETAILS
TESTS FOR HOMOGENEITY IN NORMAL MIXTURES IN THE PRESENCE OF A STRUCTURAL PARAMETER: TECHNICAL DETAILS By Hanfeng Chen and Jiahua Chen 1 Bowling Green State University and University of Waterloo Abstract.
More informationLecture 8: Information Theory and Statistics
Lecture 8: Information Theory and Statistics Part II: Hypothesis Testing and I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw December 23, 2015 1 / 50 I-Hsiang
More informationInformation geometry of mirror descent
Information geometry of mirror descent Geometric Science of Information Anthea Monod Department of Statistical Science Duke University Information Initiative at Duke G. Raskutti (UW Madison) and S. Mukherjee
More informationLocation Multiplicative Error Model. Asymptotic Inference and Empirical Analysis
: Asymptotic Inference and Empirical Analysis Qian Li Department of Mathematics and Statistics University of Missouri-Kansas City ql35d@mail.umkc.edu October 29, 2015 Outline of Topics Introduction GARCH
More informationMultivariate Statistics Random Projections and Johnson-Lindenstrauss Lemma
Multivariate Statistics Random Projections and Johnson-Lindenstrauss Lemma Suppose again we have n sample points x,..., x n R p. The data-point x i R p can be thought of as the i-th row X i of an n p-dimensional
More informationLECTURE 15: COMPLETENESS AND CONVEXITY
LECTURE 15: COMPLETENESS AND CONVEXITY 1. The Hopf-Rinow Theorem Recall that a Riemannian manifold (M, g) is called geodesically complete if the maximal defining interval of any geodesic is R. On the other
More informationLecture 8 Inequality Testing and Moment Inequality Models
Lecture 8 Inequality Testing and Moment Inequality Models Inequality Testing In the previous lecture, we discussed how to test the nonlinear hypothesis H 0 : h(θ 0 ) 0 when the sample information comes
More informationModel Specification Testing in Nonparametric and Semiparametric Time Series Econometrics. Jiti Gao
Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics Jiti Gao Department of Statistics School of Mathematics and Statistics The University of Western Australia Crawley
More informationSTAT 7032 Probability Spring Wlodek Bryc
STAT 7032 Probability Spring 2018 Wlodek Bryc Created: Friday, Jan 2, 2014 Revised for Spring 2018 Printed: January 9, 2018 File: Grad-Prob-2018.TEX Department of Mathematical Sciences, University of Cincinnati,
More information