XXXV Konferencja Statystyka Matematyczna -7-11/ XII 2009
|
|
- Doreen Ashlie Glenn
- 6 years ago
- Views:
Transcription
1 XXXV Konferencja Statystyka Matematyczna -7-11/ XII
2 Statistical Inference for Image Symmetries Mirek Pawlak 2
3 OUTLINE I Problem Statement II Image Representation in the Radial Basis Domain III Semiparametric Inference for Image Symmetry 3
4 IV Testing for Image Symmetries* Testing Rotational Symmetries* Testing Radiality Testing Reflection and Joint Symmetries V References 4
5 I Problem Statement 5
6 Z ij = f ( x i, y ) j + ε ij 6
7 D p ij Δ Z ij = f ( x i, y ) j + ε ij # of data points n 2 ; Δ n 1 7
8 Problem 1: Let f L 2 ( D). Given and knowing that ( ) = f x cos 2β f x, y Z ij = f ( x i, y ) j + ε ij, 1 i, j n ( ( ) + ysin( 2β ), xsin( 2β ) y cos( 2β )) some β [ 0,π ), estimate β. 8
9 Problem 1: Let f L 2 ( D). Given and knowing that ( ) = f x cos 2β f x, y Z ij = f ( x i, y ) j + ε ij, 1 i, j n ( ( ) + ysin( 2β ), xsin( 2β ) y cos( 2β )) some β [ 0,π ), estimate β. 9
10 Problem 2: Let f L 2 ( D). Given Z ij = f ( x i, y ) j + ε ij, 1 i, j n verify whether the null hypothesis is true or not H S : f ( x, y) ( Sf )( x, y) ( Sf )( x, y): Reflectional Symmetry, Rotational Symmetry 10
11 d = 2 d = 3 d = 4 d = 8 An image becomes invariant under rotations through an angle 2π d d = Radially Symmetric Objects f ( x, y) = g( x 2 + y 2 ) 11
12 Symmetry Hermann Weyl, Symmetry, Princenton Univ. Press, J.Rosen, Symmetry in Science: An Introduction to the General Theory, Springer, J.H. Conway, H. Burgiel, and C. Goodman-Strauss, The Symmetry of Things, A K Peters, M. Livio, The Equation That Couldn t Be Solved: How Mathematical Genius Discovered the Language of Symmetry, Simon & Schuster, Livio writes passionately about the role of symmetry in human perception, arts,... 12
13 13
14 14
15 15
16 II Image Representation in the Radial Basis Domain 16
17 Radial Moments and Expansions (Zernike Basis) A pq ( f ) = f x, y D ( ) V pq ( x, y)dxdy = 2π ( ) f ρ,θ R pq ρ Degree ( ) e iqθ ρdρdθ Angular dependence Bhatia & Born: On circle polynomials of Zernike and related orthogonal sets. Proc. Cambr. Phil. Soc L 2 ( D) f ( x, y) p=0 q p p +1 π A pq f ( )V pq x, y ( ) 17
18 Invariant Properties Reflection f ( x, y) ( τ β f )( x, y) A pq ( f ) A ( pq τ β f ) = A pq i2 qβ ( f )e 18
19 Rotation f ( x, y) ( r α f )( x, y) A pq ( f ) A pq ( r α f ) = A pq ( f )e iqα 19
20 A pq ( f ) from noisy data D p ij Δ Z ij = f ( x i, y ) j + ε ij  pq ( f ) = w pq x i, y j ( x i,y j ) D ( ) Z ij w pq ( x i, y ) j = V pq ( x, y)dxdy Δ 2 V pq p ij ( x i, y ) j 20
21 EÂpq = A pq ( f ) + D pq ( Δ) + G pq ( Δ) D pq G pq ( Δ) = O( Δ) ( Δ) = O( Δ γ ) 1 < γ = *Gauss lattice points problem of a circle * 21
22 III Semiparametric Inference for Image Symmetry Estimation of symmetry parameters: the axis of symmetry( β), the degree of rotational symmetry (d) of nonparametric image function: θ = θ ( f ), f L 2 ( D). β d 22
23 Semiparametric Inference on the Axis of Reflectional Symmetry A pq ( τ β f ) = e 2iqβ A p, q ( f ) β 23
24 Contrast Function M N ( β, f ) = N p=0 p +1 π p q= p N A pq ( f ) e 2iqβ A p, q ( f ) 2 M ( β, f ) = p=0 p +1 π p q= p A pq ( f ) e 2iqβ A p, q ( f ) 2 = f τ β f 2 24
25 Assumption Suppose that f L 2 τ β ( D) is invariant under some unique reflection Hence, if τ β f = f then we have or M ( β, f ) = 0 M N ( β, f ) = 0 for all N 25
26 Uniqueness of β Lemma U: Under Assumption the solution of M N ( β, f ) = 0 is uniquely determined and must equal β large that M N ( β, f ) contains A pq ( f ) 0 q s is 1. A p1 q 1 if we choose N so { } for which the gcd of { ( f ) 0,..., A pr q r ( f ) 0}, p i N,i = 1,..,r gcd( q 1,...,q r ) = 1. 26
27 β * =
28 M N ( β, f ) based only on A 42 ( f ), A 86 ( f ) 28
29 M N ( β, f ) based only on A 51 ( f ), A 86 ( f ) 29
30 M 14 ( β, f ) = 14 p=0 p +1 π p q= p A pq ( f ) e 2iqβ A p, q ( f ) 2 30
31 A pq ( f ) = A pq ( f ) e ir pq ( f ) M N β : ( β, f ) = N p=0 p +1 π p q= p 4 A pq f ( ( )) ( ) 2 1 cos 2r pq ( f ) + 2qβ r pq ( f ) + qβ = lπ for all ( p,q) with A pq ( f ) 0. 31
32 Estimated Contrast Function ˆM N ( β) = N p=0 p +1 π p q= p  pq e 2iqβ  p, q 2 = N p=0 p +1 π p 4 Âpq q= p 2 ( 1 cos ( 2 ˆr pq + 2qβ) ) ˆβ Δ,N = arg min β [ 0,π ) ˆM N ( β) van der Vaart: Asymptotic Statistics,
33 Accuracy of ˆβ Δ,N Theorem 3.1 ( ) and be reflection invariant w.r.t. a unique axis Let f BV D β [ 0,π ). Let N be so large that β is determined as the unique zero of M N ( β, f ). Then ˆβ Δ,N β (P) as Δ 0 Proof: sup β [ 0,π ) ˆM N ( β) M N ( β, f ) 0 (P) 33
34 Theorem 3.2 ˆβ Δ,N = β + O P ( Δ) ( n 2 rate ) Proof: 0 = ˆM ( 1) ( ) N ˆβΔ,N = ˆM ( 1) ( N β ) + ˆM ( 2) ( N β )( ˆβ Δ,N β ) ˆβΔ,N β = ( 1) ˆM N ˆM N 2 ( β ) ( ) ( ) β 34
35 From Theorem 3.1: sup β 0,π [ ) ( 2) ˆM N ( 2) ( β) M N ( β, f ) 0 (P) β β (P) ( 2) ˆM ( N β ) ( 2) M N ( β, f ) = N p p +1 16q 2 A pq ( f ) 2 0 π p=0 q= p 35
36 ( 1) ( β ) Δ 1 ( ˆβΔ,N β ) ˆM Δ 1 N ( 2) M ( N β, f ) ˆM ( 1) N ( β ) = N p=0 p +1 π p 8q Âpq q= p 2 sin ( 2 ˆr pq + 2qβ ) ( f ) + qβ = lπ ( r ) pq = N p=0 p +1 π p 8q Âpq q= p ( ( ( ))) 2 sin 2 ˆr pq r pq f 36
37 N p=0 p +1 π p q= p 8q A pq ( ( ( ))) ( f ) 2 sin 2 ˆr pq r pq f  pq = A pq ( f ) + O P ( Δ) ˆr pq r pq ( f ) = O P ( Δ) 37
38 Theorem 3.3 Let f be Lip(1). Eε 4 <. Δ 1 ( ˆβΔ,N β ) N 0, ( ) M N 2 8σ 2 ( β, f ) ( 2) M N ( β, f ) = N p=0 p +1 π p q= p 16q 2 A pq ( f ) 2 38
39 Confidence Interval for β ˆβ Δ,N Φ 1 1 α ( ) 2 2Δ ˆσ ˆM N 2 ( ), ˆβ Δ,N + Φ 1 1 α ( ) 2 2Δ ˆσ ˆM N 2 ( ) ( 2 ˆM ) N = N p=0 p +1 π p q= p 16q 2 Â pq 2 ˆσ 2 = 1 4C Δ ( ) ( ) D ( x i,y j ),( x i+1,y j ), x i,y j+1 {( Z i, j Z ) 2 i+1, j + ( Z i, j Z ) 2 } i, j+1 39
40 Remark 1: f is not reflection symmetric ˆβ Δ,N β = argmin β f τ β f 2 40
41 Remark 2: Estimation d ( { 2, 3, 4,... })for images invariant under rotations through an angle 2π d? 41
42 42
43 43
44 IV Testing for Image Symmetries Testing Rotational Symmetries d = 2 - testing image symmetry w.r.t. rotation through π A pq ( f ) A pq ( r d f ) = e 2πiq /d A pq ( f ) = e πiq A pq ( f ) 44
45 The orthogonal projection f r d f 2 = p +1 1 e 2πiq/d 2 A pq f π p=0 q p ( ) 2 The test statistic (d=2) T N r 2 = N p +1 2 Â pq π p=0 p=odd q p 45
46 Theorem 4.1: A: Under H r 2 : r 2 f = f let Then for we have T N r 2 σ 2 Δ 2 a N Δ 2 N, N 7 Δ 0, as Δ 0 T N r 2 = ( ) ( ) a N N p +1 2 Â pq π p=0 p=odd q p N ( 0, 2σ 4 ) a( N ) = N ( N + 2) / 4 N even ( N +1) ( N + 3) / 4 N odd 46
47 B: Under H r 2 : r 2 f f let f C s ( D),s 2 and let Then we have N, N 3/2 Δ γ 1 0, N 2 s+1 Δ as Δ 0 T N r 2 f r 2 f 2 / 4 Δ N ( 0,σ 2 f r 2 f 2 ) 47
48 Proof: Under H r 2 r : T 2 N is a quadratic form of iid random variables (*de Jong: A CLT for generalized quadratic forms, Pr.Th.Related Fields, 1987*) Under H r 2 : T N r 2 is dominated by a linear term 48
49 Similar results exist for d = 4 - testing image symmetry w.r.t. rotation by π / 2 d = - testing image radiality, i.e., f ( x, y) = g ( ρ) Testing image mirror symmetry Joint hypothesis H τ y,r 2 : r 2 f = f AND τ y f = f H τ y,r 2 : r 2 f f OR τ y f f 49
50 V References Symmetry Hermann Weyl, Symmetry, Princenton Univ. Press, J.Rosen, Symmetry in Science: An Introduction to the General Theory, Springer, J.H. Conway, H. Burgiel, and C. Goodman-Strauss, The Symmetry of Things, A K Peters, M. Livio, The Equation That Couldn t Be Solved: How Mathematical Genius Discovered the Language of Symmetry, Simon & Schuster, Livio writes passionately about the role of symmetry in human perception, arts,... 50
51 Symmetry & Statistics Given iid ( p) sequence Z 1,..., Z n verify whether H 0 : p( z) = p( z) Y i,n = m( x ) i,n + Z i,n H 0 : p( z) = p( z) Fan & Gencay(95), Ahmad & Li (97): m ( ) - linear regression Dette et al. (02) : m ( ) - nonparametric regression 51
52 Bissantz, Holzmann, and Pawlak, Testing for image symmetries - - with application to confocal microscopy, IEEE Trans. Inform. Theory, Bissantz, Holzmann, and Pawlak, Estimating the axis of reflectional symmetry of an image, Annals of Applied Statistics, to appear. 52
CHAPTER 4. Moment Invariants for Image Symmetry Estimation and Detection. Miroslaw Pawlak
CHAPTER 4 Moment Invariants for Image Symmetry Estimation and Detection Miroslaw Pawlak We give a general framework of statistical aspects of the problem of understanding and a description of image symmetries,
More informationHypothesis Testing For Multilayer Network Data
Hypothesis Testing For Multilayer Network Data Jun Li Dept of Mathematics and Statistics, Boston University Joint work with Eric Kolaczyk Outline Background and Motivation Geometric structure of multilayer
More informationEmpirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications
Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications Fumiya Akashi Research Associate Department of Applied Mathematics Waseda University
More informationComprehensive Examination Quantitative Methods Spring, 2018
Comprehensive Examination Quantitative Methods Spring, 2018 Instruction: This exam consists of three parts. You are required to answer all the questions in all the parts. 1 Grading policy: 1. Each part
More informationQuantile Processes for Semi and Nonparametric Regression
Quantile Processes for Semi and Nonparametric Regression Shih-Kang Chao Department of Statistics Purdue University IMS-APRM 2016 A joint work with Stanislav Volgushev and Guang Cheng Quantile Response
More informationBickel Rosenblatt test
University of Latvia 28.05.2011. A classical Let X 1,..., X n be i.i.d. random variables with a continuous probability density function f. Consider a simple hypothesis H 0 : f = f 0 with a significance
More informationNETWORK-REGULARIZED HIGH-DIMENSIONAL COX REGRESSION FOR ANALYSIS OF GENOMIC DATA
Statistica Sinica 213): Supplement NETWORK-REGULARIZED HIGH-DIMENSIONAL COX REGRESSION FOR ANALYSIS OF GENOMIC DATA Hokeun Sun 1, Wei Lin 2, Rui Feng 2 and Hongzhe Li 2 1 Columbia University and 2 University
More informationLinear Regression Model. Badr Missaoui
Linear Regression Model Badr Missaoui Introduction What is this course about? It is a course on applied statistics. It comprises 2 hours lectures each week and 1 hour lab sessions/tutorials. We will focus
More informationOptimal design for inverse problems
School of Mathematics and Statistical Sciences Research Institute University of Southampton, UK Joint work with Nicolai Bissantz, Holger Dette (both Ruhr-Universität Bochum) and Edmund Jones (University
More informationLecture 15. Hypothesis testing in the linear model
14. Lecture 15. Hypothesis testing in the linear model Lecture 15. Hypothesis testing in the linear model 1 (1 1) Preliminary lemma 15. Hypothesis testing in the linear model 15.1. Preliminary lemma Lemma
More informationTesting Statistical Hypotheses
E.L. Lehmann Joseph P. Romano Testing Statistical Hypotheses Third Edition 4y Springer Preface vii I Small-Sample Theory 1 1 The General Decision Problem 3 1.1 Statistical Inference and Statistical Decisions
More informationEstimation of a quadratic regression functional using the sinc kernel
Estimation of a quadratic regression functional using the sinc kernel Nicolai Bissantz Hajo Holzmann Institute for Mathematical Stochastics, Georg-August-University Göttingen, Maschmühlenweg 8 10, D-37073
More informationMS&E 226: Small Data
MS&E 226: Small Data Lecture 15: Examples of hypothesis tests (v5) Ramesh Johari ramesh.johari@stanford.edu 1 / 32 The recipe 2 / 32 The hypothesis testing recipe In this lecture we repeatedly apply the
More informationδ -method and M-estimation
Econ 2110, fall 2016, Part IVb Asymptotic Theory: δ -method and M-estimation Maximilian Kasy Department of Economics, Harvard University 1 / 40 Example Suppose we estimate the average effect of class size
More informationNonconcave Penalized Likelihood with A Diverging Number of Parameters
Nonconcave Penalized Likelihood with A Diverging Number of Parameters Jianqing Fan and Heng Peng Presenter: Jiale Xu March 12, 2010 Jianqing Fan and Heng Peng Presenter: JialeNonconcave Xu () Penalized
More informationAsymptotic Statistics-III. Changliang Zou
Asymptotic Statistics-III Changliang Zou The multivariate central limit theorem Theorem (Multivariate CLT for iid case) Let X i be iid random p-vectors with mean µ and and covariance matrix Σ. Then n (
More informationCross-Validation with Confidence
Cross-Validation with Confidence Jing Lei Department of Statistics, Carnegie Mellon University WHOA-PSI Workshop, St Louis, 2017 Quotes from Day 1 and Day 2 Good model or pure model? Occam s razor We really
More informationSimple Linear Regression
Simple Linear Regression In simple linear regression we are concerned about the relationship between two variables, X and Y. There are two components to such a relationship. 1. The strength of the relationship.
More informationClosest Moment Estimation under General Conditions
Closest Moment Estimation under General Conditions Chirok Han and Robert de Jong January 28, 2002 Abstract This paper considers Closest Moment (CM) estimation with a general distance function, and avoids
More informationCross-Validation with Confidence
Cross-Validation with Confidence Jing Lei Department of Statistics, Carnegie Mellon University UMN Statistics Seminar, Mar 30, 2017 Overview Parameter est. Model selection Point est. MLE, M-est.,... Cross-validation
More informationProblems. Suppose both models are fitted to the same data. Show that SS Res, A SS Res, B
Simple Linear Regression 35 Problems 1 Consider a set of data (x i, y i ), i =1, 2,,n, and the following two regression models: y i = β 0 + β 1 x i + ε, (i =1, 2,,n), Model A y i = γ 0 + γ 1 x i + γ 2
More informationComputation Of Asymptotic Distribution. For Semiparametric GMM Estimators. Hidehiko Ichimura. Graduate School of Public Policy
Computation Of Asymptotic Distribution For Semiparametric GMM Estimators Hidehiko Ichimura Graduate School of Public Policy and Graduate School of Economics University of Tokyo A Conference in honor of
More informationConfidence Intervals for Low-dimensional Parameters with High-dimensional Data
Confidence Intervals for Low-dimensional Parameters with High-dimensional Data Cun-Hui Zhang and Stephanie S. Zhang Rutgers University and Columbia University September 14, 2012 Outline Introduction Methodology
More informationA large deviation principle for a RWRC in a box
A large deviation principle for a RWRC in a box 7th Cornell Probability Summer School Michele Salvi TU Berlin July 12, 2011 Michele Salvi (TU Berlin) An LDP for a RWRC in a nite box July 12, 2011 1 / 15
More informationEcon 583 Final Exam Fall 2008
Econ 583 Final Exam Fall 2008 Eric Zivot December 11, 2008 Exam is due at 9:00 am in my office on Friday, December 12. 1 Maximum Likelihood Estimation and Asymptotic Theory Let X 1,...,X n be iid random
More informationClosest Moment Estimation under General Conditions
Closest Moment Estimation under General Conditions Chirok Han Victoria University of Wellington New Zealand Robert de Jong Ohio State University U.S.A October, 2003 Abstract This paper considers Closest
More informationThe Minimum Message Length Principle for Inductive Inference
The Principle for Inductive Inference Centre for Molecular, Environmental, Genetic & Analytic (MEGA) Epidemiology School of Population Health University of Melbourne University of Helsinki, August 25,
More informationBootstrap of residual processes in regression: to smooth or not to smooth?
Bootstrap of residual processes in regression: to smooth or not to smooth? arxiv:1712.02685v1 [math.st] 7 Dec 2017 Natalie Neumeyer Ingrid Van Keilegom December 8, 2017 Abstract In this paper we consider
More informationStat 5101 Lecture Notes
Stat 5101 Lecture Notes Charles J. Geyer Copyright 1998, 1999, 2000, 2001 by Charles J. Geyer May 7, 2001 ii Stat 5101 (Geyer) Course Notes Contents 1 Random Variables and Change of Variables 1 1.1 Random
More informationAccurate Orthogonal Circular Moment Invariants of Gray-Level Images
Journal of Computer Science 7 (5): 75-722, 20 ISSN 549-3636 20 Science Publications Accurate Orthogonal Circular Moment Invariants of Gray-Level Images Khalid Mohamed Hosny Department of Computer Science,
More informationMinimum Message Length Analysis of the Behrens Fisher Problem
Analysis of the Behrens Fisher Problem Enes Makalic and Daniel F Schmidt Centre for MEGA Epidemiology The University of Melbourne Solomonoff 85th Memorial Conference, 2011 Outline Introduction 1 Introduction
More informationHigh Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data
High Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data Song Xi CHEN Guanghua School of Management and Center for Statistical Science, Peking University Department
More informationMIT Spring 2015
Regression Analysis MIT 18.472 Dr. Kempthorne Spring 2015 1 Outline Regression Analysis 1 Regression Analysis 2 Multiple Linear Regression: Setup Data Set n cases i = 1, 2,..., n 1 Response (dependent)
More informationReview of Statistics
Review of Statistics Topics Descriptive Statistics Mean, Variance Probability Union event, joint event Random Variables Discrete and Continuous Distributions, Moments Two Random Variables Covariance and
More informationIntroduction to Estimation Methods for Time Series models Lecture 2
Introduction to Estimation Methods for Time Series models Lecture 2 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 2 SNS Pisa 1 / 21 Estimators:
More informationEfficient Estimation in Convex Single Index Models 1
1/28 Efficient Estimation in Convex Single Index Models 1 Rohit Patra University of Florida http://arxiv.org/abs/1708.00145 1 Joint work with Arun K. Kuchibhotla (UPenn) and Bodhisattva Sen (Columbia)
More informationNonparametric Regression. Badr Missaoui
Badr Missaoui Outline Kernel and local polynomial regression. Penalized regression. We are given n pairs of observations (X 1, Y 1 ),...,(X n, Y n ) where Y i = r(x i ) + ε i, i = 1,..., n and r(x) = E(Y
More informationCh 3: Multiple Linear Regression
Ch 3: Multiple Linear Regression 1. Multiple Linear Regression Model Multiple regression model has more than one regressor. For example, we have one response variable and two regressor variables: 1. delivery
More informationFitting circles to scattered data: parameter estimates have no moments
arxiv:0907.0429v [math.st] 2 Jul 2009 Fitting circles to scattered data: parameter estimates have no moments N. Chernov Department of Mathematics University of Alabama at Birmingham Birmingham, AL 35294
More informationEfficiency of Profile/Partial Likelihood in the Cox Model
Efficiency of Profile/Partial Likelihood in the Cox Model Yuichi Hirose School of Mathematics, Statistics and Operations Research, Victoria University of Wellington, New Zealand Summary. This paper shows
More informationMultivariate Least Weighted Squares (MLWS)
() Stochastic Modelling in Economics and Finance 2 Supervisor : Prof. RNDr. Jan Ámos Víšek, CSc. Petr Jonáš 23 rd February 2015 Contents 1 2 3 4 5 6 7 1 1 Introduction 2 Algorithm 3 Proof of consistency
More informationGenerated Covariates in Nonparametric Estimation: A Short Review.
Generated Covariates in Nonparametric Estimation: A Short Review. Enno Mammen, Christoph Rothe, and Melanie Schienle Abstract In many applications, covariates are not observed but have to be estimated
More informationUniversity of California San Diego and Stanford University and
First International Workshop on Functional and Operatorial Statistics. Toulouse, June 19-21, 2008 K-sample Subsampling Dimitris N. olitis andjoseph.romano University of California San Diego and Stanford
More informationCorner. Corners are the intersections of two edges of sufficiently different orientations.
2D Image Features Two dimensional image features are interesting local structures. They include junctions of different types like Y, T, X, and L. Much of the work on 2D features focuses on junction L,
More informationCh 2: Simple Linear Regression
Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component
More informationEconometrics A. Simple linear model (2) Keio University, Faculty of Economics. Simon Clinet (Keio University) Econometrics A October 16, / 11
Econometrics A Keio University, Faculty of Economics Simple linear model (2) Simon Clinet (Keio University) Econometrics A October 16, 2018 1 / 11 Estimation of the noise variance σ 2 In practice σ 2 too
More informationCHAPTER 3 POTENTIALS 10/13/2016. Outlines. 1. Laplace s equation. 2. The Method of Images. 3. Separation of Variables. 4. Multipole Expansion
CHAPTER 3 POTENTIALS Lee Chow Department of Physics University of Central Florida Orlando, FL 32816 Outlines 1. Laplace s equation 2. The Method of Images 3. Separation of Variables 4. Multipole Expansion
More informationSOME NOTES ON HOTELLING TUBES
SOME NOTES ON HOTELLING TUBES ROGER KOENKER 1. Introduction We begin with the two examples of Johansen and Johnstone. The first is Hotelling s (1939) original example, and the second is closely related
More informationEstimation of Threshold Cointegration
Estimation of Myung Hwan London School of Economics December 2006 Outline Model Asymptotics Inference Conclusion 1 Model Estimation Methods Literature 2 Asymptotics Consistency Convergence Rates Asymptotic
More informationA Resampling Method on Pivotal Estimating Functions
A Resampling Method on Pivotal Estimating Functions Kun Nie Biostat 277,Winter 2004 March 17, 2004 Outline Introduction A General Resampling Method Examples - Quantile Regression -Rank Regression -Simulation
More informationApplied Econometrics (QEM)
Applied Econometrics (QEM) based on Prinicples of Econometrics Jakub Mućk Department of Quantitative Economics Jakub Mućk Applied Econometrics (QEM) Meeting #3 1 / 42 Outline 1 2 3 t-test P-value Linear
More informationA Conditional Approach to Modeling Multivariate Extremes
A Approach to ing Multivariate Extremes By Heffernan & Tawn Department of Statistics Purdue University s April 30, 2014 Outline s s Multivariate Extremes s A central aim of multivariate extremes is trying
More informationChapter 4: Modelling
Chapter 4: Modelling Exchangeability and Invariance Markus Harva 17.10. / Reading Circle on Bayesian Theory Outline 1 Introduction 2 Models via exchangeability 3 Models via invariance 4 Exercise Statistical
More informationSTAT420 Midterm Exam. University of Illinois Urbana-Champaign October 19 (Friday), :00 4:15p. SOLUTIONS (Yellow)
STAT40 Midterm Exam University of Illinois Urbana-Champaign October 19 (Friday), 018 3:00 4:15p SOLUTIONS (Yellow) Question 1 (15 points) (10 points) 3 (50 points) extra ( points) Total (77 points) Points
More informationMISCELLANEOUS TOPICS RELATED TO LIKELIHOOD. Copyright c 2012 (Iowa State University) Statistics / 30
MISCELLANEOUS TOPICS RELATED TO LIKELIHOOD Copyright c 2012 (Iowa State University) Statistics 511 1 / 30 INFORMATION CRITERIA Akaike s Information criterion is given by AIC = 2l(ˆθ) + 2k, where l(ˆθ)
More informationQuantile Regression: Inference
Quantile Regression: Inference Roger Koenker University of Illinois, Urbana-Champaign Aarhus: 21 June 2010 Roger Koenker (UIUC) Introduction Aarhus: 21.6.2010 1 / 28 Inference for Quantile Regression Asymptotics
More informationWeb Appendix for Hierarchical Adaptive Regression Kernels for Regression with Functional Predictors by D. B. Woodard, C. Crainiceanu, and D.
Web Appendix for Hierarchical Adaptive Regression Kernels for Regression with Functional Predictors by D. B. Woodard, C. Crainiceanu, and D. Ruppert A. EMPIRICAL ESTIMATE OF THE KERNEL MIXTURE Here we
More informationDelta Theorem in the Age of High Dimensions
Delta Theorem in the Age of High Dimensions Mehmet Caner Department of Economics Ohio State University December 15, 2016 Abstract We provide a new version of delta theorem, that takes into account of high
More informationInference on distributions and quantiles using a finite-sample Dirichlet process
Dirichlet IDEAL Theory/methods Simulations Inference on distributions and quantiles using a finite-sample Dirichlet process David M. Kaplan University of Missouri Matt Goldman UC San Diego Midwest Econometrics
More informationUnderstanding Regressions with Observations Collected at High Frequency over Long Span
Understanding Regressions with Observations Collected at High Frequency over Long Span Yoosoon Chang Department of Economics, Indiana University Joon Y. Park Department of Economics, Indiana University
More informationQuantile Regression for Residual Life and Empirical Likelihood
Quantile Regression for Residual Life and Empirical Likelihood Mai Zhou email: mai@ms.uky.edu Department of Statistics, University of Kentucky, Lexington, KY 40506-0027, USA Jong-Hyeon Jeong email: jeong@nsabp.pitt.edu
More informationSome distance functions in knot theory
Some distance functions in knot theory Jie CHEN Division of Mathematics, Graduate School of Information Sciences, Tohoku University 1 Introduction In this presentation, we focus on three distance functions
More informationL-momenty s rušivou regresí
L-momenty s rušivou regresí Jan Picek, Martin Schindler e-mail: jan.picek@tul.cz TECHNICKÁ UNIVERZITA V LIBERCI ROBUST 2016 J. Picek, M. Schindler, TUL L-momenty s rušivou regresí 1/26 Motivation 1 Development
More informationUncertainty Quantification for Inverse Problems. November 7, 2011
Uncertainty Quantification for Inverse Problems November 7, 2011 Outline UQ and inverse problems Review: least-squares Review: Gaussian Bayesian linear model Parametric reductions for IP Bias, variance
More informationLawrence D. Brown* and Daniel McCarthy*
Comments on the paper, An adaptive resampling test for detecting the presence of significant predictors by I. W. McKeague and M. Qian Lawrence D. Brown* and Daniel McCarthy* ABSTRACT: This commentary deals
More informationGeneralized Multivariate Rank Type Test Statistics via Spatial U-Quantiles
Generalized Multivariate Rank Type Test Statistics via Spatial U-Quantiles Weihua Zhou 1 University of North Carolina at Charlotte and Robert Serfling 2 University of Texas at Dallas Final revision for
More informationStatistical Inference of Covariate-Adjusted Randomized Experiments
1 Statistical Inference of Covariate-Adjusted Randomized Experiments Feifang Hu Department of Statistics George Washington University Joint research with Wei Ma, Yichen Qin and Yang Li Email: feifang@gwu.edu
More informationProblem Selected Scores
Statistics Ph.D. Qualifying Exam: Part II November 20, 2010 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. Problem 1 2 3 4 5 6 7 8 9 10 11 12 Selected
More informationTesting Statistical Hypotheses
E.L. Lehmann Joseph P. Romano, 02LEu1 ttd ~Lt~S Testing Statistical Hypotheses Third Edition With 6 Illustrations ~Springer 2 The Probability Background 28 2.1 Probability and Measure 28 2.2 Integration.........
More informationThe Cross Product. MATH 311, Calculus III. J. Robert Buchanan. Fall Department of Mathematics. J. Robert Buchanan The Cross Product
The Cross Product MATH 311, Calculus III J. Robert Buchanan Department of Mathematics Fall 2011 Introduction Recall: the dot product of two vectors is a scalar. There is another binary operation on vectors
More informationOptimal Estimation of a Nonsmooth Functional
Optimal Estimation of a Nonsmooth Functional T. Tony Cai Department of Statistics The Wharton School University of Pennsylvania http://stat.wharton.upenn.edu/ tcai Joint work with Mark Low 1 Question Suppose
More informationBinary choice 3.3 Maximum likelihood estimation
Binary choice 3.3 Maximum likelihood estimation Michel Bierlaire Output of the estimation We explain here the various outputs from the maximum likelihood estimation procedure. Solution of the maximum likelihood
More informationNonlinear minimization estimators in the presence of cointegrating relations
Nonlinear minimization estimators in the presence of cointegrating relations Robert M. de Jong January 31, 2000 Abstract In this paper, we consider estimation of a long-run and a short-run parameter jointly
More informationEstimation theory. Parametric estimation. Properties of estimators. Minimum variance estimator. Cramer-Rao bound. Maximum likelihood estimators
Estimation theory Parametric estimation Properties of estimators Minimum variance estimator Cramer-Rao bound Maximum likelihood estimators Confidence intervals Bayesian estimation 1 Random Variables Let
More informationSome Curiosities Arising in Objective Bayesian Analysis
. Some Curiosities Arising in Objective Bayesian Analysis Jim Berger Duke University Statistical and Applied Mathematical Institute Yale University May 15, 2009 1 Three vignettes related to John s work
More informationRandom matrix pencils and level crossings
Albeverio Fest October 1, 2018 Topics to discuss Basic level crossing problem 1 Basic level crossing problem 2 3 Main references Basic level crossing problem (i) B. Shapiro, M. Tater, On spectral asymptotics
More informationCointegration Lecture I: Introduction
1 Cointegration Lecture I: Introduction Julia Giese Nuffield College julia.giese@economics.ox.ac.uk Hilary Term 2008 2 Outline Introduction Estimation of unrestricted VAR Non-stationarity Deterministic
More informationModeling and testing long memory in random fields
Modeling and testing long memory in random fields Frédéric Lavancier lavancier@math.univ-lille1.fr Université Lille 1 LS-CREST Paris 24 janvier 6 1 Introduction Long memory random fields Motivations Previous
More informationLikelihood-based inference with missing data under missing-at-random
Likelihood-based inference with missing data under missing-at-random Jae-kwang Kim Joint work with Shu Yang Department of Statistics, Iowa State University May 4, 014 Outline 1. Introduction. Parametric
More informationDiscussion of the paper Inference for Semiparametric Models: Some Questions and an Answer by Bickel and Kwon
Discussion of the paper Inference for Semiparametric Models: Some Questions and an Answer by Bickel and Kwon Jianqing Fan Department of Statistics Chinese University of Hong Kong AND Department of Statistics
More informationIntroduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued
Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations Research
More informationManifold Learning for Subsequent Inference
Manifold Learning for Subsequent Inference Carey E. Priebe Johns Hopkins University June 20, 2018 DARPA Fundamental Limits of Learning (FunLoL) Los Angeles, California http://arxiv.org/abs/1806.01401 Key
More informationQuantile Regression: Inference
Quantile Regression: Inference Roger Koenker University of Illinois, Urbana-Champaign 5th RMetrics Workshop, Meielisalp: 28 June 2011 Roger Koenker (UIUC) Introduction Meielisalp: 28.6.2011 1 / 29 Inference
More informationDepartment of Economics, Vanderbilt University While it is known that pseudo-out-of-sample methods are not optimal for
Comment Atsushi Inoue Department of Economics, Vanderbilt University (atsushi.inoue@vanderbilt.edu) While it is known that pseudo-out-of-sample methods are not optimal for comparing models, they are nevertheless
More informationEdge Image Description Using Angular Radial Partitioning
Edge Image Description Using Angular Radial Partitioning A.Chalechale, A. Mertins and G. Naghdy IEE Proc.-Vis. Image Signal Processing, 2004 Slides by David Anthony Torres Computer Science and Engineering
More information19.1 Problem setup: Sparse linear regression
ECE598: Information-theoretic methods in high-dimensional statistics Spring 2016 Lecture 19: Minimax rates for sparse linear regression Lecturer: Yihong Wu Scribe: Subhadeep Paul, April 13/14, 2016 In
More informationBig Hypothesis Testing with Kernel Embeddings
Big Hypothesis Testing with Kernel Embeddings Dino Sejdinovic Department of Statistics University of Oxford 9 January 2015 UCL Workshop on the Theory of Big Data D. Sejdinovic (Statistics, Oxford) Big
More informationOn the Recovery of a Function on a Circular Domain
2736 IEEE ANSACTIONS ON INFORMATION THEORY, VOL. 48, NO. 10, OCTOBER 2002 On the Recovery of a Function on a Circular Domain Mirosław Pawlak, Member, IEEE, and Simon X. Liao, Member, IEEE Abstract We consider
More informationA Bootstrap Test for Conditional Symmetry
ANNALS OF ECONOMICS AND FINANCE 6, 51 61 005) A Bootstrap Test for Conditional Symmetry Liangjun Su Guanghua School of Management, Peking University E-mail: lsu@gsm.pku.edu.cn and Sainan Jin Guanghua School
More informationHigh-dimensional graphical model selection: Practical and information-theoretic limits
1 High-dimensional graphical model selection: Practical and information-theoretic limits Martin Wainwright Departments of Statistics, and EECS UC Berkeley, California, USA Based on joint work with: John
More informationInference for Non-stationary Time Series Auto Regression. By Zhou Zhou 1 University of Toronto January 21, Abstract
Inference for Non-stationary Time Series Auto Regression By Zhou Zhou 1 University of Toronto January 21, 2013 Abstract The paper considers simultaneous inference for a class of non-stationary autoregressive
More informationEconometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018
Econometrics I KS Module 2: Multivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: April 16, 2018 Alexander Ahammer (JKU) Module 2: Multivariate
More informationAsymmetric least squares estimation and testing
Asymmetric least squares estimation and testing Whitney Newey and James Powell Princeton University and University of Wisconsin-Madison January 27, 2012 Outline ALS estimators Large sample properties Asymptotic
More informationStatistical Properties of Numerical Derivatives
Statistical Properties of Numerical Derivatives Han Hong, Aprajit Mahajan, and Denis Nekipelov Stanford University and UC Berkeley November 2010 1 / 63 Motivation Introduction Many models have objective
More informationLikelihood based Statistical Inference. Dottorato in Economia e Finanza Dipartimento di Scienze Economiche Univ. di Verona
Likelihood based Statistical Inference Dottorato in Economia e Finanza Dipartimento di Scienze Economiche Univ. di Verona L. Pace, A. Salvan, N. Sartori Udine, April 2008 Likelihood: observed quantities,
More informationMaster s Written Examination
Master s Written Examination Option: Statistics and Probability Spring 05 Full points may be obtained for correct answers to eight questions Each numbered question (which may have several parts) is worth
More informationModel Selection Tutorial 2: Problems With Using AIC to Select a Subset of Exposures in a Regression Model
Model Selection Tutorial 2: Problems With Using AIC to Select a Subset of Exposures in a Regression Model Centre for Molecular, Environmental, Genetic & Analytic (MEGA) Epidemiology School of Population
More informationHypothesis Testing. Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA
Hypothesis Testing Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA An Example Mardia et al. (979, p. ) reprint data from Frets (9) giving the length and breadth (in
More informationMinimax Estimation of a nonlinear functional on a structured high-dimensional model
Minimax Estimation of a nonlinear functional on a structured high-dimensional model Eric Tchetgen Tchetgen Professor of Biostatistics and Epidemiologic Methods, Harvard U. (Minimax ) 1 / 38 Outline Heuristics
More informationQuick Review on Linear Multiple Regression
Quick Review on Linear Multiple Regression Mei-Yuan Chen Department of Finance National Chung Hsing University March 6, 2007 Introduction for Conditional Mean Modeling Suppose random variables Y, X 1,
More information