XXXV Konferencja Statystyka Matematyczna -7-11/ XII 2009

Size: px
Start display at page:

Download "XXXV Konferencja Statystyka Matematyczna -7-11/ XII 2009"

Transcription

1 XXXV Konferencja Statystyka Matematyczna -7-11/ XII

2 Statistical Inference for Image Symmetries Mirek Pawlak 2

3 OUTLINE I Problem Statement II Image Representation in the Radial Basis Domain III Semiparametric Inference for Image Symmetry 3

4 IV Testing for Image Symmetries* Testing Rotational Symmetries* Testing Radiality Testing Reflection and Joint Symmetries V References 4

5 I Problem Statement 5

6 Z ij = f ( x i, y ) j + ε ij 6

7 D p ij Δ Z ij = f ( x i, y ) j + ε ij # of data points n 2 ; Δ n 1 7

8 Problem 1: Let f L 2 ( D). Given and knowing that ( ) = f x cos 2β f x, y Z ij = f ( x i, y ) j + ε ij, 1 i, j n ( ( ) + ysin( 2β ), xsin( 2β ) y cos( 2β )) some β [ 0,π ), estimate β. 8

9 Problem 1: Let f L 2 ( D). Given and knowing that ( ) = f x cos 2β f x, y Z ij = f ( x i, y ) j + ε ij, 1 i, j n ( ( ) + ysin( 2β ), xsin( 2β ) y cos( 2β )) some β [ 0,π ), estimate β. 9

10 Problem 2: Let f L 2 ( D). Given Z ij = f ( x i, y ) j + ε ij, 1 i, j n verify whether the null hypothesis is true or not H S : f ( x, y) ( Sf )( x, y) ( Sf )( x, y): Reflectional Symmetry, Rotational Symmetry 10

11 d = 2 d = 3 d = 4 d = 8 An image becomes invariant under rotations through an angle 2π d d = Radially Symmetric Objects f ( x, y) = g( x 2 + y 2 ) 11

12 Symmetry Hermann Weyl, Symmetry, Princenton Univ. Press, J.Rosen, Symmetry in Science: An Introduction to the General Theory, Springer, J.H. Conway, H. Burgiel, and C. Goodman-Strauss, The Symmetry of Things, A K Peters, M. Livio, The Equation That Couldn t Be Solved: How Mathematical Genius Discovered the Language of Symmetry, Simon & Schuster, Livio writes passionately about the role of symmetry in human perception, arts,... 12

13 13

14 14

15 15

16 II Image Representation in the Radial Basis Domain 16

17 Radial Moments and Expansions (Zernike Basis) A pq ( f ) = f x, y D ( ) V pq ( x, y)dxdy = 2π ( ) f ρ,θ R pq ρ Degree ( ) e iqθ ρdρdθ Angular dependence Bhatia & Born: On circle polynomials of Zernike and related orthogonal sets. Proc. Cambr. Phil. Soc L 2 ( D) f ( x, y) p=0 q p p +1 π A pq f ( )V pq x, y ( ) 17

18 Invariant Properties Reflection f ( x, y) ( τ β f )( x, y) A pq ( f ) A ( pq τ β f ) = A pq i2 qβ ( f )e 18

19 Rotation f ( x, y) ( r α f )( x, y) A pq ( f ) A pq ( r α f ) = A pq ( f )e iqα 19

20 A pq ( f ) from noisy data D p ij Δ Z ij = f ( x i, y ) j + ε ij  pq ( f ) = w pq x i, y j ( x i,y j ) D ( ) Z ij w pq ( x i, y ) j = V pq ( x, y)dxdy Δ 2 V pq p ij ( x i, y ) j 20

21 EÂpq = A pq ( f ) + D pq ( Δ) + G pq ( Δ) D pq G pq ( Δ) = O( Δ) ( Δ) = O( Δ γ ) 1 < γ = *Gauss lattice points problem of a circle * 21

22 III Semiparametric Inference for Image Symmetry Estimation of symmetry parameters: the axis of symmetry( β), the degree of rotational symmetry (d) of nonparametric image function: θ = θ ( f ), f L 2 ( D). β d 22

23 Semiparametric Inference on the Axis of Reflectional Symmetry A pq ( τ β f ) = e 2iqβ A p, q ( f ) β 23

24 Contrast Function M N ( β, f ) = N p=0 p +1 π p q= p N A pq ( f ) e 2iqβ A p, q ( f ) 2 M ( β, f ) = p=0 p +1 π p q= p A pq ( f ) e 2iqβ A p, q ( f ) 2 = f τ β f 2 24

25 Assumption Suppose that f L 2 τ β ( D) is invariant under some unique reflection Hence, if τ β f = f then we have or M ( β, f ) = 0 M N ( β, f ) = 0 for all N 25

26 Uniqueness of β Lemma U: Under Assumption the solution of M N ( β, f ) = 0 is uniquely determined and must equal β large that M N ( β, f ) contains A pq ( f ) 0 q s is 1. A p1 q 1 if we choose N so { } for which the gcd of { ( f ) 0,..., A pr q r ( f ) 0}, p i N,i = 1,..,r gcd( q 1,...,q r ) = 1. 26

27 β * =

28 M N ( β, f ) based only on A 42 ( f ), A 86 ( f ) 28

29 M N ( β, f ) based only on A 51 ( f ), A 86 ( f ) 29

30 M 14 ( β, f ) = 14 p=0 p +1 π p q= p A pq ( f ) e 2iqβ A p, q ( f ) 2 30

31 A pq ( f ) = A pq ( f ) e ir pq ( f ) M N β : ( β, f ) = N p=0 p +1 π p q= p 4 A pq f ( ( )) ( ) 2 1 cos 2r pq ( f ) + 2qβ r pq ( f ) + qβ = lπ for all ( p,q) with A pq ( f ) 0. 31

32 Estimated Contrast Function ˆM N ( β) = N p=0 p +1 π p q= p  pq e 2iqβ  p, q 2 = N p=0 p +1 π p 4 Âpq q= p 2 ( 1 cos ( 2 ˆr pq + 2qβ) ) ˆβ Δ,N = arg min β [ 0,π ) ˆM N ( β) van der Vaart: Asymptotic Statistics,

33 Accuracy of ˆβ Δ,N Theorem 3.1 ( ) and be reflection invariant w.r.t. a unique axis Let f BV D β [ 0,π ). Let N be so large that β is determined as the unique zero of M N ( β, f ). Then ˆβ Δ,N β (P) as Δ 0 Proof: sup β [ 0,π ) ˆM N ( β) M N ( β, f ) 0 (P) 33

34 Theorem 3.2 ˆβ Δ,N = β + O P ( Δ) ( n 2 rate ) Proof: 0 = ˆM ( 1) ( ) N ˆβΔ,N = ˆM ( 1) ( N β ) + ˆM ( 2) ( N β )( ˆβ Δ,N β ) ˆβΔ,N β = ( 1) ˆM N ˆM N 2 ( β ) ( ) ( ) β 34

35 From Theorem 3.1: sup β 0,π [ ) ( 2) ˆM N ( 2) ( β) M N ( β, f ) 0 (P) β β (P) ( 2) ˆM ( N β ) ( 2) M N ( β, f ) = N p p +1 16q 2 A pq ( f ) 2 0 π p=0 q= p 35

36 ( 1) ( β ) Δ 1 ( ˆβΔ,N β ) ˆM Δ 1 N ( 2) M ( N β, f ) ˆM ( 1) N ( β ) = N p=0 p +1 π p 8q Âpq q= p 2 sin ( 2 ˆr pq + 2qβ ) ( f ) + qβ = lπ ( r ) pq = N p=0 p +1 π p 8q Âpq q= p ( ( ( ))) 2 sin 2 ˆr pq r pq f 36

37 N p=0 p +1 π p q= p 8q A pq ( ( ( ))) ( f ) 2 sin 2 ˆr pq r pq f  pq = A pq ( f ) + O P ( Δ) ˆr pq r pq ( f ) = O P ( Δ) 37

38 Theorem 3.3 Let f be Lip(1). Eε 4 <. Δ 1 ( ˆβΔ,N β ) N 0, ( ) M N 2 8σ 2 ( β, f ) ( 2) M N ( β, f ) = N p=0 p +1 π p q= p 16q 2 A pq ( f ) 2 38

39 Confidence Interval for β ˆβ Δ,N Φ 1 1 α ( ) 2 2Δ ˆσ ˆM N 2 ( ), ˆβ Δ,N + Φ 1 1 α ( ) 2 2Δ ˆσ ˆM N 2 ( ) ( 2 ˆM ) N = N p=0 p +1 π p q= p 16q 2 Â pq 2 ˆσ 2 = 1 4C Δ ( ) ( ) D ( x i,y j ),( x i+1,y j ), x i,y j+1 {( Z i, j Z ) 2 i+1, j + ( Z i, j Z ) 2 } i, j+1 39

40 Remark 1: f is not reflection symmetric ˆβ Δ,N β = argmin β f τ β f 2 40

41 Remark 2: Estimation d ( { 2, 3, 4,... })for images invariant under rotations through an angle 2π d? 41

42 42

43 43

44 IV Testing for Image Symmetries Testing Rotational Symmetries d = 2 - testing image symmetry w.r.t. rotation through π A pq ( f ) A pq ( r d f ) = e 2πiq /d A pq ( f ) = e πiq A pq ( f ) 44

45 The orthogonal projection f r d f 2 = p +1 1 e 2πiq/d 2 A pq f π p=0 q p ( ) 2 The test statistic (d=2) T N r 2 = N p +1 2 Â pq π p=0 p=odd q p 45

46 Theorem 4.1: A: Under H r 2 : r 2 f = f let Then for we have T N r 2 σ 2 Δ 2 a N Δ 2 N, N 7 Δ 0, as Δ 0 T N r 2 = ( ) ( ) a N N p +1 2 Â pq π p=0 p=odd q p N ( 0, 2σ 4 ) a( N ) = N ( N + 2) / 4 N even ( N +1) ( N + 3) / 4 N odd 46

47 B: Under H r 2 : r 2 f f let f C s ( D),s 2 and let Then we have N, N 3/2 Δ γ 1 0, N 2 s+1 Δ as Δ 0 T N r 2 f r 2 f 2 / 4 Δ N ( 0,σ 2 f r 2 f 2 ) 47

48 Proof: Under H r 2 r : T 2 N is a quadratic form of iid random variables (*de Jong: A CLT for generalized quadratic forms, Pr.Th.Related Fields, 1987*) Under H r 2 : T N r 2 is dominated by a linear term 48

49 Similar results exist for d = 4 - testing image symmetry w.r.t. rotation by π / 2 d = - testing image radiality, i.e., f ( x, y) = g ( ρ) Testing image mirror symmetry Joint hypothesis H τ y,r 2 : r 2 f = f AND τ y f = f H τ y,r 2 : r 2 f f OR τ y f f 49

50 V References Symmetry Hermann Weyl, Symmetry, Princenton Univ. Press, J.Rosen, Symmetry in Science: An Introduction to the General Theory, Springer, J.H. Conway, H. Burgiel, and C. Goodman-Strauss, The Symmetry of Things, A K Peters, M. Livio, The Equation That Couldn t Be Solved: How Mathematical Genius Discovered the Language of Symmetry, Simon & Schuster, Livio writes passionately about the role of symmetry in human perception, arts,... 50

51 Symmetry & Statistics Given iid ( p) sequence Z 1,..., Z n verify whether H 0 : p( z) = p( z) Y i,n = m( x ) i,n + Z i,n H 0 : p( z) = p( z) Fan & Gencay(95), Ahmad & Li (97): m ( ) - linear regression Dette et al. (02) : m ( ) - nonparametric regression 51

52 Bissantz, Holzmann, and Pawlak, Testing for image symmetries - - with application to confocal microscopy, IEEE Trans. Inform. Theory, Bissantz, Holzmann, and Pawlak, Estimating the axis of reflectional symmetry of an image, Annals of Applied Statistics, to appear. 52

CHAPTER 4. Moment Invariants for Image Symmetry Estimation and Detection. Miroslaw Pawlak

CHAPTER 4. Moment Invariants for Image Symmetry Estimation and Detection. Miroslaw Pawlak CHAPTER 4 Moment Invariants for Image Symmetry Estimation and Detection Miroslaw Pawlak We give a general framework of statistical aspects of the problem of understanding and a description of image symmetries,

More information

Hypothesis Testing For Multilayer Network Data

Hypothesis Testing For Multilayer Network Data Hypothesis Testing For Multilayer Network Data Jun Li Dept of Mathematics and Statistics, Boston University Joint work with Eric Kolaczyk Outline Background and Motivation Geometric structure of multilayer

More information

Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications

Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications Fumiya Akashi Research Associate Department of Applied Mathematics Waseda University

More information

Comprehensive Examination Quantitative Methods Spring, 2018

Comprehensive Examination Quantitative Methods Spring, 2018 Comprehensive Examination Quantitative Methods Spring, 2018 Instruction: This exam consists of three parts. You are required to answer all the questions in all the parts. 1 Grading policy: 1. Each part

More information

Quantile Processes for Semi and Nonparametric Regression

Quantile Processes for Semi and Nonparametric Regression Quantile Processes for Semi and Nonparametric Regression Shih-Kang Chao Department of Statistics Purdue University IMS-APRM 2016 A joint work with Stanislav Volgushev and Guang Cheng Quantile Response

More information

Bickel Rosenblatt test

Bickel Rosenblatt test University of Latvia 28.05.2011. A classical Let X 1,..., X n be i.i.d. random variables with a continuous probability density function f. Consider a simple hypothesis H 0 : f = f 0 with a significance

More information

NETWORK-REGULARIZED HIGH-DIMENSIONAL COX REGRESSION FOR ANALYSIS OF GENOMIC DATA

NETWORK-REGULARIZED HIGH-DIMENSIONAL COX REGRESSION FOR ANALYSIS OF GENOMIC DATA Statistica Sinica 213): Supplement NETWORK-REGULARIZED HIGH-DIMENSIONAL COX REGRESSION FOR ANALYSIS OF GENOMIC DATA Hokeun Sun 1, Wei Lin 2, Rui Feng 2 and Hongzhe Li 2 1 Columbia University and 2 University

More information

Linear Regression Model. Badr Missaoui

Linear Regression Model. Badr Missaoui Linear Regression Model Badr Missaoui Introduction What is this course about? It is a course on applied statistics. It comprises 2 hours lectures each week and 1 hour lab sessions/tutorials. We will focus

More information

Optimal design for inverse problems

Optimal design for inverse problems School of Mathematics and Statistical Sciences Research Institute University of Southampton, UK Joint work with Nicolai Bissantz, Holger Dette (both Ruhr-Universität Bochum) and Edmund Jones (University

More information

Lecture 15. Hypothesis testing in the linear model

Lecture 15. Hypothesis testing in the linear model 14. Lecture 15. Hypothesis testing in the linear model Lecture 15. Hypothesis testing in the linear model 1 (1 1) Preliminary lemma 15. Hypothesis testing in the linear model 15.1. Preliminary lemma Lemma

More information

Testing Statistical Hypotheses

Testing Statistical Hypotheses E.L. Lehmann Joseph P. Romano Testing Statistical Hypotheses Third Edition 4y Springer Preface vii I Small-Sample Theory 1 1 The General Decision Problem 3 1.1 Statistical Inference and Statistical Decisions

More information

Estimation of a quadratic regression functional using the sinc kernel

Estimation of a quadratic regression functional using the sinc kernel Estimation of a quadratic regression functional using the sinc kernel Nicolai Bissantz Hajo Holzmann Institute for Mathematical Stochastics, Georg-August-University Göttingen, Maschmühlenweg 8 10, D-37073

More information

MS&E 226: Small Data

MS&E 226: Small Data MS&E 226: Small Data Lecture 15: Examples of hypothesis tests (v5) Ramesh Johari ramesh.johari@stanford.edu 1 / 32 The recipe 2 / 32 The hypothesis testing recipe In this lecture we repeatedly apply the

More information

δ -method and M-estimation

δ -method and M-estimation Econ 2110, fall 2016, Part IVb Asymptotic Theory: δ -method and M-estimation Maximilian Kasy Department of Economics, Harvard University 1 / 40 Example Suppose we estimate the average effect of class size

More information

Nonconcave Penalized Likelihood with A Diverging Number of Parameters

Nonconcave Penalized Likelihood with A Diverging Number of Parameters Nonconcave Penalized Likelihood with A Diverging Number of Parameters Jianqing Fan and Heng Peng Presenter: Jiale Xu March 12, 2010 Jianqing Fan and Heng Peng Presenter: JialeNonconcave Xu () Penalized

More information

Asymptotic Statistics-III. Changliang Zou

Asymptotic Statistics-III. Changliang Zou Asymptotic Statistics-III Changliang Zou The multivariate central limit theorem Theorem (Multivariate CLT for iid case) Let X i be iid random p-vectors with mean µ and and covariance matrix Σ. Then n (

More information

Cross-Validation with Confidence

Cross-Validation with Confidence Cross-Validation with Confidence Jing Lei Department of Statistics, Carnegie Mellon University WHOA-PSI Workshop, St Louis, 2017 Quotes from Day 1 and Day 2 Good model or pure model? Occam s razor We really

More information

Simple Linear Regression

Simple Linear Regression Simple Linear Regression In simple linear regression we are concerned about the relationship between two variables, X and Y. There are two components to such a relationship. 1. The strength of the relationship.

More information

Closest Moment Estimation under General Conditions

Closest Moment Estimation under General Conditions Closest Moment Estimation under General Conditions Chirok Han and Robert de Jong January 28, 2002 Abstract This paper considers Closest Moment (CM) estimation with a general distance function, and avoids

More information

Cross-Validation with Confidence

Cross-Validation with Confidence Cross-Validation with Confidence Jing Lei Department of Statistics, Carnegie Mellon University UMN Statistics Seminar, Mar 30, 2017 Overview Parameter est. Model selection Point est. MLE, M-est.,... Cross-validation

More information

Problems. Suppose both models are fitted to the same data. Show that SS Res, A SS Res, B

Problems. Suppose both models are fitted to the same data. Show that SS Res, A SS Res, B Simple Linear Regression 35 Problems 1 Consider a set of data (x i, y i ), i =1, 2,,n, and the following two regression models: y i = β 0 + β 1 x i + ε, (i =1, 2,,n), Model A y i = γ 0 + γ 1 x i + γ 2

More information

Computation Of Asymptotic Distribution. For Semiparametric GMM Estimators. Hidehiko Ichimura. Graduate School of Public Policy

Computation Of Asymptotic Distribution. For Semiparametric GMM Estimators. Hidehiko Ichimura. Graduate School of Public Policy Computation Of Asymptotic Distribution For Semiparametric GMM Estimators Hidehiko Ichimura Graduate School of Public Policy and Graduate School of Economics University of Tokyo A Conference in honor of

More information

Confidence Intervals for Low-dimensional Parameters with High-dimensional Data

Confidence Intervals for Low-dimensional Parameters with High-dimensional Data Confidence Intervals for Low-dimensional Parameters with High-dimensional Data Cun-Hui Zhang and Stephanie S. Zhang Rutgers University and Columbia University September 14, 2012 Outline Introduction Methodology

More information

A large deviation principle for a RWRC in a box

A large deviation principle for a RWRC in a box A large deviation principle for a RWRC in a box 7th Cornell Probability Summer School Michele Salvi TU Berlin July 12, 2011 Michele Salvi (TU Berlin) An LDP for a RWRC in a nite box July 12, 2011 1 / 15

More information

Econ 583 Final Exam Fall 2008

Econ 583 Final Exam Fall 2008 Econ 583 Final Exam Fall 2008 Eric Zivot December 11, 2008 Exam is due at 9:00 am in my office on Friday, December 12. 1 Maximum Likelihood Estimation and Asymptotic Theory Let X 1,...,X n be iid random

More information

Closest Moment Estimation under General Conditions

Closest Moment Estimation under General Conditions Closest Moment Estimation under General Conditions Chirok Han Victoria University of Wellington New Zealand Robert de Jong Ohio State University U.S.A October, 2003 Abstract This paper considers Closest

More information

The Minimum Message Length Principle for Inductive Inference

The Minimum Message Length Principle for Inductive Inference The Principle for Inductive Inference Centre for Molecular, Environmental, Genetic & Analytic (MEGA) Epidemiology School of Population Health University of Melbourne University of Helsinki, August 25,

More information

Bootstrap of residual processes in regression: to smooth or not to smooth?

Bootstrap of residual processes in regression: to smooth or not to smooth? Bootstrap of residual processes in regression: to smooth or not to smooth? arxiv:1712.02685v1 [math.st] 7 Dec 2017 Natalie Neumeyer Ingrid Van Keilegom December 8, 2017 Abstract In this paper we consider

More information

Stat 5101 Lecture Notes

Stat 5101 Lecture Notes Stat 5101 Lecture Notes Charles J. Geyer Copyright 1998, 1999, 2000, 2001 by Charles J. Geyer May 7, 2001 ii Stat 5101 (Geyer) Course Notes Contents 1 Random Variables and Change of Variables 1 1.1 Random

More information

Accurate Orthogonal Circular Moment Invariants of Gray-Level Images

Accurate Orthogonal Circular Moment Invariants of Gray-Level Images Journal of Computer Science 7 (5): 75-722, 20 ISSN 549-3636 20 Science Publications Accurate Orthogonal Circular Moment Invariants of Gray-Level Images Khalid Mohamed Hosny Department of Computer Science,

More information

Minimum Message Length Analysis of the Behrens Fisher Problem

Minimum Message Length Analysis of the Behrens Fisher Problem Analysis of the Behrens Fisher Problem Enes Makalic and Daniel F Schmidt Centre for MEGA Epidemiology The University of Melbourne Solomonoff 85th Memorial Conference, 2011 Outline Introduction 1 Introduction

More information

High Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data

High Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data High Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data Song Xi CHEN Guanghua School of Management and Center for Statistical Science, Peking University Department

More information

MIT Spring 2015

MIT Spring 2015 Regression Analysis MIT 18.472 Dr. Kempthorne Spring 2015 1 Outline Regression Analysis 1 Regression Analysis 2 Multiple Linear Regression: Setup Data Set n cases i = 1, 2,..., n 1 Response (dependent)

More information

Review of Statistics

Review of Statistics Review of Statistics Topics Descriptive Statistics Mean, Variance Probability Union event, joint event Random Variables Discrete and Continuous Distributions, Moments Two Random Variables Covariance and

More information

Introduction to Estimation Methods for Time Series models Lecture 2

Introduction to Estimation Methods for Time Series models Lecture 2 Introduction to Estimation Methods for Time Series models Lecture 2 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 2 SNS Pisa 1 / 21 Estimators:

More information

Efficient Estimation in Convex Single Index Models 1

Efficient Estimation in Convex Single Index Models 1 1/28 Efficient Estimation in Convex Single Index Models 1 Rohit Patra University of Florida http://arxiv.org/abs/1708.00145 1 Joint work with Arun K. Kuchibhotla (UPenn) and Bodhisattva Sen (Columbia)

More information

Nonparametric Regression. Badr Missaoui

Nonparametric Regression. Badr Missaoui Badr Missaoui Outline Kernel and local polynomial regression. Penalized regression. We are given n pairs of observations (X 1, Y 1 ),...,(X n, Y n ) where Y i = r(x i ) + ε i, i = 1,..., n and r(x) = E(Y

More information

Ch 3: Multiple Linear Regression

Ch 3: Multiple Linear Regression Ch 3: Multiple Linear Regression 1. Multiple Linear Regression Model Multiple regression model has more than one regressor. For example, we have one response variable and two regressor variables: 1. delivery

More information

Fitting circles to scattered data: parameter estimates have no moments

Fitting circles to scattered data: parameter estimates have no moments arxiv:0907.0429v [math.st] 2 Jul 2009 Fitting circles to scattered data: parameter estimates have no moments N. Chernov Department of Mathematics University of Alabama at Birmingham Birmingham, AL 35294

More information

Efficiency of Profile/Partial Likelihood in the Cox Model

Efficiency of Profile/Partial Likelihood in the Cox Model Efficiency of Profile/Partial Likelihood in the Cox Model Yuichi Hirose School of Mathematics, Statistics and Operations Research, Victoria University of Wellington, New Zealand Summary. This paper shows

More information

Multivariate Least Weighted Squares (MLWS)

Multivariate Least Weighted Squares (MLWS) () Stochastic Modelling in Economics and Finance 2 Supervisor : Prof. RNDr. Jan Ámos Víšek, CSc. Petr Jonáš 23 rd February 2015 Contents 1 2 3 4 5 6 7 1 1 Introduction 2 Algorithm 3 Proof of consistency

More information

Generated Covariates in Nonparametric Estimation: A Short Review.

Generated Covariates in Nonparametric Estimation: A Short Review. Generated Covariates in Nonparametric Estimation: A Short Review. Enno Mammen, Christoph Rothe, and Melanie Schienle Abstract In many applications, covariates are not observed but have to be estimated

More information

University of California San Diego and Stanford University and

University of California San Diego and Stanford University and First International Workshop on Functional and Operatorial Statistics. Toulouse, June 19-21, 2008 K-sample Subsampling Dimitris N. olitis andjoseph.romano University of California San Diego and Stanford

More information

Corner. Corners are the intersections of two edges of sufficiently different orientations.

Corner. Corners are the intersections of two edges of sufficiently different orientations. 2D Image Features Two dimensional image features are interesting local structures. They include junctions of different types like Y, T, X, and L. Much of the work on 2D features focuses on junction L,

More information

Ch 2: Simple Linear Regression

Ch 2: Simple Linear Regression Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component

More information

Econometrics A. Simple linear model (2) Keio University, Faculty of Economics. Simon Clinet (Keio University) Econometrics A October 16, / 11

Econometrics A. Simple linear model (2) Keio University, Faculty of Economics. Simon Clinet (Keio University) Econometrics A October 16, / 11 Econometrics A Keio University, Faculty of Economics Simple linear model (2) Simon Clinet (Keio University) Econometrics A October 16, 2018 1 / 11 Estimation of the noise variance σ 2 In practice σ 2 too

More information

CHAPTER 3 POTENTIALS 10/13/2016. Outlines. 1. Laplace s equation. 2. The Method of Images. 3. Separation of Variables. 4. Multipole Expansion

CHAPTER 3 POTENTIALS 10/13/2016. Outlines. 1. Laplace s equation. 2. The Method of Images. 3. Separation of Variables. 4. Multipole Expansion CHAPTER 3 POTENTIALS Lee Chow Department of Physics University of Central Florida Orlando, FL 32816 Outlines 1. Laplace s equation 2. The Method of Images 3. Separation of Variables 4. Multipole Expansion

More information

SOME NOTES ON HOTELLING TUBES

SOME NOTES ON HOTELLING TUBES SOME NOTES ON HOTELLING TUBES ROGER KOENKER 1. Introduction We begin with the two examples of Johansen and Johnstone. The first is Hotelling s (1939) original example, and the second is closely related

More information

Estimation of Threshold Cointegration

Estimation of Threshold Cointegration Estimation of Myung Hwan London School of Economics December 2006 Outline Model Asymptotics Inference Conclusion 1 Model Estimation Methods Literature 2 Asymptotics Consistency Convergence Rates Asymptotic

More information

A Resampling Method on Pivotal Estimating Functions

A Resampling Method on Pivotal Estimating Functions A Resampling Method on Pivotal Estimating Functions Kun Nie Biostat 277,Winter 2004 March 17, 2004 Outline Introduction A General Resampling Method Examples - Quantile Regression -Rank Regression -Simulation

More information

Applied Econometrics (QEM)

Applied Econometrics (QEM) Applied Econometrics (QEM) based on Prinicples of Econometrics Jakub Mućk Department of Quantitative Economics Jakub Mućk Applied Econometrics (QEM) Meeting #3 1 / 42 Outline 1 2 3 t-test P-value Linear

More information

A Conditional Approach to Modeling Multivariate Extremes

A Conditional Approach to Modeling Multivariate Extremes A Approach to ing Multivariate Extremes By Heffernan & Tawn Department of Statistics Purdue University s April 30, 2014 Outline s s Multivariate Extremes s A central aim of multivariate extremes is trying

More information

Chapter 4: Modelling

Chapter 4: Modelling Chapter 4: Modelling Exchangeability and Invariance Markus Harva 17.10. / Reading Circle on Bayesian Theory Outline 1 Introduction 2 Models via exchangeability 3 Models via invariance 4 Exercise Statistical

More information

STAT420 Midterm Exam. University of Illinois Urbana-Champaign October 19 (Friday), :00 4:15p. SOLUTIONS (Yellow)

STAT420 Midterm Exam. University of Illinois Urbana-Champaign October 19 (Friday), :00 4:15p. SOLUTIONS (Yellow) STAT40 Midterm Exam University of Illinois Urbana-Champaign October 19 (Friday), 018 3:00 4:15p SOLUTIONS (Yellow) Question 1 (15 points) (10 points) 3 (50 points) extra ( points) Total (77 points) Points

More information

MISCELLANEOUS TOPICS RELATED TO LIKELIHOOD. Copyright c 2012 (Iowa State University) Statistics / 30

MISCELLANEOUS TOPICS RELATED TO LIKELIHOOD. Copyright c 2012 (Iowa State University) Statistics / 30 MISCELLANEOUS TOPICS RELATED TO LIKELIHOOD Copyright c 2012 (Iowa State University) Statistics 511 1 / 30 INFORMATION CRITERIA Akaike s Information criterion is given by AIC = 2l(ˆθ) + 2k, where l(ˆθ)

More information

Quantile Regression: Inference

Quantile Regression: Inference Quantile Regression: Inference Roger Koenker University of Illinois, Urbana-Champaign Aarhus: 21 June 2010 Roger Koenker (UIUC) Introduction Aarhus: 21.6.2010 1 / 28 Inference for Quantile Regression Asymptotics

More information

Web Appendix for Hierarchical Adaptive Regression Kernels for Regression with Functional Predictors by D. B. Woodard, C. Crainiceanu, and D.

Web Appendix for Hierarchical Adaptive Regression Kernels for Regression with Functional Predictors by D. B. Woodard, C. Crainiceanu, and D. Web Appendix for Hierarchical Adaptive Regression Kernels for Regression with Functional Predictors by D. B. Woodard, C. Crainiceanu, and D. Ruppert A. EMPIRICAL ESTIMATE OF THE KERNEL MIXTURE Here we

More information

Delta Theorem in the Age of High Dimensions

Delta Theorem in the Age of High Dimensions Delta Theorem in the Age of High Dimensions Mehmet Caner Department of Economics Ohio State University December 15, 2016 Abstract We provide a new version of delta theorem, that takes into account of high

More information

Inference on distributions and quantiles using a finite-sample Dirichlet process

Inference on distributions and quantiles using a finite-sample Dirichlet process Dirichlet IDEAL Theory/methods Simulations Inference on distributions and quantiles using a finite-sample Dirichlet process David M. Kaplan University of Missouri Matt Goldman UC San Diego Midwest Econometrics

More information

Understanding Regressions with Observations Collected at High Frequency over Long Span

Understanding Regressions with Observations Collected at High Frequency over Long Span Understanding Regressions with Observations Collected at High Frequency over Long Span Yoosoon Chang Department of Economics, Indiana University Joon Y. Park Department of Economics, Indiana University

More information

Quantile Regression for Residual Life and Empirical Likelihood

Quantile Regression for Residual Life and Empirical Likelihood Quantile Regression for Residual Life and Empirical Likelihood Mai Zhou email: mai@ms.uky.edu Department of Statistics, University of Kentucky, Lexington, KY 40506-0027, USA Jong-Hyeon Jeong email: jeong@nsabp.pitt.edu

More information

Some distance functions in knot theory

Some distance functions in knot theory Some distance functions in knot theory Jie CHEN Division of Mathematics, Graduate School of Information Sciences, Tohoku University 1 Introduction In this presentation, we focus on three distance functions

More information

L-momenty s rušivou regresí

L-momenty s rušivou regresí L-momenty s rušivou regresí Jan Picek, Martin Schindler e-mail: jan.picek@tul.cz TECHNICKÁ UNIVERZITA V LIBERCI ROBUST 2016 J. Picek, M. Schindler, TUL L-momenty s rušivou regresí 1/26 Motivation 1 Development

More information

Uncertainty Quantification for Inverse Problems. November 7, 2011

Uncertainty Quantification for Inverse Problems. November 7, 2011 Uncertainty Quantification for Inverse Problems November 7, 2011 Outline UQ and inverse problems Review: least-squares Review: Gaussian Bayesian linear model Parametric reductions for IP Bias, variance

More information

Lawrence D. Brown* and Daniel McCarthy*

Lawrence D. Brown* and Daniel McCarthy* Comments on the paper, An adaptive resampling test for detecting the presence of significant predictors by I. W. McKeague and M. Qian Lawrence D. Brown* and Daniel McCarthy* ABSTRACT: This commentary deals

More information

Generalized Multivariate Rank Type Test Statistics via Spatial U-Quantiles

Generalized Multivariate Rank Type Test Statistics via Spatial U-Quantiles Generalized Multivariate Rank Type Test Statistics via Spatial U-Quantiles Weihua Zhou 1 University of North Carolina at Charlotte and Robert Serfling 2 University of Texas at Dallas Final revision for

More information

Statistical Inference of Covariate-Adjusted Randomized Experiments

Statistical Inference of Covariate-Adjusted Randomized Experiments 1 Statistical Inference of Covariate-Adjusted Randomized Experiments Feifang Hu Department of Statistics George Washington University Joint research with Wei Ma, Yichen Qin and Yang Li Email: feifang@gwu.edu

More information

Problem Selected Scores

Problem Selected Scores Statistics Ph.D. Qualifying Exam: Part II November 20, 2010 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. Problem 1 2 3 4 5 6 7 8 9 10 11 12 Selected

More information

Testing Statistical Hypotheses

Testing Statistical Hypotheses E.L. Lehmann Joseph P. Romano, 02LEu1 ttd ~Lt~S Testing Statistical Hypotheses Third Edition With 6 Illustrations ~Springer 2 The Probability Background 28 2.1 Probability and Measure 28 2.2 Integration.........

More information

The Cross Product. MATH 311, Calculus III. J. Robert Buchanan. Fall Department of Mathematics. J. Robert Buchanan The Cross Product

The Cross Product. MATH 311, Calculus III. J. Robert Buchanan. Fall Department of Mathematics. J. Robert Buchanan The Cross Product The Cross Product MATH 311, Calculus III J. Robert Buchanan Department of Mathematics Fall 2011 Introduction Recall: the dot product of two vectors is a scalar. There is another binary operation on vectors

More information

Optimal Estimation of a Nonsmooth Functional

Optimal Estimation of a Nonsmooth Functional Optimal Estimation of a Nonsmooth Functional T. Tony Cai Department of Statistics The Wharton School University of Pennsylvania http://stat.wharton.upenn.edu/ tcai Joint work with Mark Low 1 Question Suppose

More information

Binary choice 3.3 Maximum likelihood estimation

Binary choice 3.3 Maximum likelihood estimation Binary choice 3.3 Maximum likelihood estimation Michel Bierlaire Output of the estimation We explain here the various outputs from the maximum likelihood estimation procedure. Solution of the maximum likelihood

More information

Nonlinear minimization estimators in the presence of cointegrating relations

Nonlinear minimization estimators in the presence of cointegrating relations Nonlinear minimization estimators in the presence of cointegrating relations Robert M. de Jong January 31, 2000 Abstract In this paper, we consider estimation of a long-run and a short-run parameter jointly

More information

Estimation theory. Parametric estimation. Properties of estimators. Minimum variance estimator. Cramer-Rao bound. Maximum likelihood estimators

Estimation theory. Parametric estimation. Properties of estimators. Minimum variance estimator. Cramer-Rao bound. Maximum likelihood estimators Estimation theory Parametric estimation Properties of estimators Minimum variance estimator Cramer-Rao bound Maximum likelihood estimators Confidence intervals Bayesian estimation 1 Random Variables Let

More information

Some Curiosities Arising in Objective Bayesian Analysis

Some Curiosities Arising in Objective Bayesian Analysis . Some Curiosities Arising in Objective Bayesian Analysis Jim Berger Duke University Statistical and Applied Mathematical Institute Yale University May 15, 2009 1 Three vignettes related to John s work

More information

Random matrix pencils and level crossings

Random matrix pencils and level crossings Albeverio Fest October 1, 2018 Topics to discuss Basic level crossing problem 1 Basic level crossing problem 2 3 Main references Basic level crossing problem (i) B. Shapiro, M. Tater, On spectral asymptotics

More information

Cointegration Lecture I: Introduction

Cointegration Lecture I: Introduction 1 Cointegration Lecture I: Introduction Julia Giese Nuffield College julia.giese@economics.ox.ac.uk Hilary Term 2008 2 Outline Introduction Estimation of unrestricted VAR Non-stationarity Deterministic

More information

Modeling and testing long memory in random fields

Modeling and testing long memory in random fields Modeling and testing long memory in random fields Frédéric Lavancier lavancier@math.univ-lille1.fr Université Lille 1 LS-CREST Paris 24 janvier 6 1 Introduction Long memory random fields Motivations Previous

More information

Likelihood-based inference with missing data under missing-at-random

Likelihood-based inference with missing data under missing-at-random Likelihood-based inference with missing data under missing-at-random Jae-kwang Kim Joint work with Shu Yang Department of Statistics, Iowa State University May 4, 014 Outline 1. Introduction. Parametric

More information

Discussion of the paper Inference for Semiparametric Models: Some Questions and an Answer by Bickel and Kwon

Discussion of the paper Inference for Semiparametric Models: Some Questions and an Answer by Bickel and Kwon Discussion of the paper Inference for Semiparametric Models: Some Questions and an Answer by Bickel and Kwon Jianqing Fan Department of Statistics Chinese University of Hong Kong AND Department of Statistics

More information

Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued

Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations Research

More information

Manifold Learning for Subsequent Inference

Manifold Learning for Subsequent Inference Manifold Learning for Subsequent Inference Carey E. Priebe Johns Hopkins University June 20, 2018 DARPA Fundamental Limits of Learning (FunLoL) Los Angeles, California http://arxiv.org/abs/1806.01401 Key

More information

Quantile Regression: Inference

Quantile Regression: Inference Quantile Regression: Inference Roger Koenker University of Illinois, Urbana-Champaign 5th RMetrics Workshop, Meielisalp: 28 June 2011 Roger Koenker (UIUC) Introduction Meielisalp: 28.6.2011 1 / 29 Inference

More information

Department of Economics, Vanderbilt University While it is known that pseudo-out-of-sample methods are not optimal for

Department of Economics, Vanderbilt University While it is known that pseudo-out-of-sample methods are not optimal for Comment Atsushi Inoue Department of Economics, Vanderbilt University (atsushi.inoue@vanderbilt.edu) While it is known that pseudo-out-of-sample methods are not optimal for comparing models, they are nevertheless

More information

Edge Image Description Using Angular Radial Partitioning

Edge Image Description Using Angular Radial Partitioning Edge Image Description Using Angular Radial Partitioning A.Chalechale, A. Mertins and G. Naghdy IEE Proc.-Vis. Image Signal Processing, 2004 Slides by David Anthony Torres Computer Science and Engineering

More information

19.1 Problem setup: Sparse linear regression

19.1 Problem setup: Sparse linear regression ECE598: Information-theoretic methods in high-dimensional statistics Spring 2016 Lecture 19: Minimax rates for sparse linear regression Lecturer: Yihong Wu Scribe: Subhadeep Paul, April 13/14, 2016 In

More information

Big Hypothesis Testing with Kernel Embeddings

Big Hypothesis Testing with Kernel Embeddings Big Hypothesis Testing with Kernel Embeddings Dino Sejdinovic Department of Statistics University of Oxford 9 January 2015 UCL Workshop on the Theory of Big Data D. Sejdinovic (Statistics, Oxford) Big

More information

On the Recovery of a Function on a Circular Domain

On the Recovery of a Function on a Circular Domain 2736 IEEE ANSACTIONS ON INFORMATION THEORY, VOL. 48, NO. 10, OCTOBER 2002 On the Recovery of a Function on a Circular Domain Mirosław Pawlak, Member, IEEE, and Simon X. Liao, Member, IEEE Abstract We consider

More information

A Bootstrap Test for Conditional Symmetry

A Bootstrap Test for Conditional Symmetry ANNALS OF ECONOMICS AND FINANCE 6, 51 61 005) A Bootstrap Test for Conditional Symmetry Liangjun Su Guanghua School of Management, Peking University E-mail: lsu@gsm.pku.edu.cn and Sainan Jin Guanghua School

More information

High-dimensional graphical model selection: Practical and information-theoretic limits

High-dimensional graphical model selection: Practical and information-theoretic limits 1 High-dimensional graphical model selection: Practical and information-theoretic limits Martin Wainwright Departments of Statistics, and EECS UC Berkeley, California, USA Based on joint work with: John

More information

Inference for Non-stationary Time Series Auto Regression. By Zhou Zhou 1 University of Toronto January 21, Abstract

Inference for Non-stationary Time Series Auto Regression. By Zhou Zhou 1 University of Toronto January 21, Abstract Inference for Non-stationary Time Series Auto Regression By Zhou Zhou 1 University of Toronto January 21, 2013 Abstract The paper considers simultaneous inference for a class of non-stationary autoregressive

More information

Econometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018

Econometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018 Econometrics I KS Module 2: Multivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: April 16, 2018 Alexander Ahammer (JKU) Module 2: Multivariate

More information

Asymmetric least squares estimation and testing

Asymmetric least squares estimation and testing Asymmetric least squares estimation and testing Whitney Newey and James Powell Princeton University and University of Wisconsin-Madison January 27, 2012 Outline ALS estimators Large sample properties Asymptotic

More information

Statistical Properties of Numerical Derivatives

Statistical Properties of Numerical Derivatives Statistical Properties of Numerical Derivatives Han Hong, Aprajit Mahajan, and Denis Nekipelov Stanford University and UC Berkeley November 2010 1 / 63 Motivation Introduction Many models have objective

More information

Likelihood based Statistical Inference. Dottorato in Economia e Finanza Dipartimento di Scienze Economiche Univ. di Verona

Likelihood based Statistical Inference. Dottorato in Economia e Finanza Dipartimento di Scienze Economiche Univ. di Verona Likelihood based Statistical Inference Dottorato in Economia e Finanza Dipartimento di Scienze Economiche Univ. di Verona L. Pace, A. Salvan, N. Sartori Udine, April 2008 Likelihood: observed quantities,

More information

Master s Written Examination

Master s Written Examination Master s Written Examination Option: Statistics and Probability Spring 05 Full points may be obtained for correct answers to eight questions Each numbered question (which may have several parts) is worth

More information

Model Selection Tutorial 2: Problems With Using AIC to Select a Subset of Exposures in a Regression Model

Model Selection Tutorial 2: Problems With Using AIC to Select a Subset of Exposures in a Regression Model Model Selection Tutorial 2: Problems With Using AIC to Select a Subset of Exposures in a Regression Model Centre for Molecular, Environmental, Genetic & Analytic (MEGA) Epidemiology School of Population

More information

Hypothesis Testing. Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA

Hypothesis Testing. Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA Hypothesis Testing Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA An Example Mardia et al. (979, p. ) reprint data from Frets (9) giving the length and breadth (in

More information

Minimax Estimation of a nonlinear functional on a structured high-dimensional model

Minimax Estimation of a nonlinear functional on a structured high-dimensional model Minimax Estimation of a nonlinear functional on a structured high-dimensional model Eric Tchetgen Tchetgen Professor of Biostatistics and Epidemiologic Methods, Harvard U. (Minimax ) 1 / 38 Outline Heuristics

More information

Quick Review on Linear Multiple Regression

Quick Review on Linear Multiple Regression Quick Review on Linear Multiple Regression Mei-Yuan Chen Department of Finance National Chung Hsing University March 6, 2007 Introduction for Conditional Mean Modeling Suppose random variables Y, X 1,

More information