Jádrové odhady regresní funkce pro korelovaná data

Size: px
Start display at page:

Download "Jádrové odhady regresní funkce pro korelovaná data"

Transcription

1 Jádrové odhady regresní funkce pro korelovaná data Ústav matematiky a statistiky MÚ Brno Finanční matematika v praxi III., Podlesí

2 Obsah Motivace Motivace

3 Motivace Co se snažíme získat?

4 Motivace Co se snažíme získat?

5 Regresní model Motivace Standardní regresní model Y i =m(x i )+ε i, i = 1,..., n, kde m - neznámá regresní funkce Y i - měřená data x i - body, ve kterých se provádí měření ε i - chyby

6 Jádro Motivace Co je to jádro?

7 Jádro Motivace Co je to jádro? Jádro K je reálná funkce splňující podmínky: K Lip[ 1, 1], K( 1) = K(1) = 0 support(k) = [ 1, 1] 1 j = x j K(x)dx = 0 j = 1 β 2 0 j = 2

8 Epanečnikovo jádro

9 Jak se používá?

10 Jak se používá? Nadaraya-Watsonův odhad regresní funkce m(x, h) = n i=1 j=1 K h (x i x) Y n i, K h (x j x) kde K h (.) = 1 h K ( ḣ ) h - vyhlazovací parametr

11 Vyhlazovací parametr Co se stane, když ho zvoĺıme špatně?

12 Vyhlazovací parametr Co se stane, když ho zvoĺıme špatně?

13 Jaká je optimální hodnota?

14 Jaká je optimální hodnota?

15 Jaká je optimální hodnota? ( σ h opt = K 2 ) (x)dx 1/5 1 nβ2 2A, A 2 = m (x) 2 dx 2 0

16 Krosvalidační metoda Jak zvolit správné h?

17 Krosvalidační metoda Jak zvolit správné h? CV (h) = 1 n n ( ) 2 m j (x j, h) Y j min, j=1 kde m j (x j, h) je odhad m(x j, h), kde je x j smazáno

18 Regresní model s korelovanými chybami Jak se náš model změní?

19 Regresní model s korelovanými chybami Jak se náš model změní? Y i =m(x i )+ε i, i = 1,..., n, kde ε i - neznámý kauzální ARMA proces, neboli E(ε i ) = 0, var(ε i ) = σ 2 cov(ε i, ε j ) = γ i j = σ 2 ρ i j, corr(ε i, ε j ) = ρ i j

20 Proč prostě nepoužijeme předchozí metodu?

21 Proč prostě nepoužijeme předchozí metodu?

22

23 Plug-in přístup Motivace Můžeme nějak využít optimální hodnotu h?

24 Plug-in přístup Motivace Můžeme nějak využít optimální hodnotu h? S = k= ( 1 S 1 h opt = K 2 ) (x)dx 1/5 nβ2 2A, 2 γ k, A 2 = 1 0 m (x) 2 dx

25 Plug-in přístup Motivace Můžeme nějak využít optimální hodnotu h? S = k= ( 1 S 1 h opt = K 2 ) (x)dx 1/5 nβ2 2A, 2 γ k, A 2 = 1 0 m (x) 2 dx ĥ PI = (Ŝ 1 1 K 2 (x)dx nβ 2 2Â2 ) 1/5

26 Jak odhadnout S a A 2?

27 Jak odhadnout S a A 2? odhad S

28 Jak odhadnout S a A 2? odhad S odhadnutím chyb pomocí nějakého počátečního vyhlazení (průměr, přehlazení,...)

29 Jak odhadnout S a A 2? odhad S odhadnutím chyb pomocí nějakého počátečního vyhlazení (průměr, přehlazení,...) - nefunguje

30 Jak odhadnout S a A 2? odhad S odhadnutím chyb pomocí nějakého počátečního vyhlazení (průměr, přehlazení,...) - nefunguje odhadnutím spektrální hustoty f (λ) = 1 2π t= e itλ γ t

31 Jak odhadnout S a A 2? odhad S odhadnutím chyb pomocí nějakého počátečního vyhlazení (průměr, přehlazení,...) - nefunguje odhadnutím spektrální hustoty odhad A 2 f (λ) = 1 2π t= e itλ γ t

32 Jak odhadnout S a A 2? odhad S odhadnutím chyb pomocí nějakého počátečního vyhlazení (průměr, přehlazení,...) - nefunguje odhadnutím spektrální hustoty f (λ) = 1 2π t= odhad A 2 pracuje se na tom - viz Koláček (2008) e itλ γ t

33 Částečná krosvalidace (PCV) Dá se nějak obejít korelace?

34 Částečná krosvalidace (PCV) Dá se nějak obejít korelace? rozdělení pozorování do g skupin tak, že vezmeme každé g-té pozorování minimalizace průměru obyčejných CV každé skupiny CV (h) = g 1 g CV k (h) min k=1

35 Částečná krosvalidace (PCV) Dá se nějak obejít korelace? rozdělení pozorování do g skupin tak, že vezmeme každé g-té pozorování minimalizace průměru obyčejných CV každé skupiny CV (h) = g 1 g CV k (h) min k=1 h minimalizující CV (h) ĥ CV = arg min CV (h) = ĥpcv (g) = g 1/5 h CV

36 Částečná krosvalidace (PCV) Dá se nějak obejít korelace? rozdělení pozorování do g skupin tak, že vezmeme každé g-té pozorování minimalizace průměru obyčejných CV každé skupiny CV (h) = g 1 g CV k (h) min k=1 h minimalizující CV (h) ĥ CV = arg min CV (h) = ĥpcv (g) = g 1/5 h CV Ale volba g závisí γ k, K, A 2

37 Úroková míra CB Kanda Interest rates in Canada Interest rate (%) Time

38 Prvních 200 měsíců Motivace 22 Plug in method PCV method

39 Prvních 150 měsíců Motivace Interes rates in Canada Plug in method PCV method

40 References Motivace Altman, N.S. Kernel Smoothing of Data With Correlated Errors Journal of the American Statistical Association, Vol.85, No.411 (Sep., 1990), pp Bowman, A.W. - Azzalini, A. Applied Smoothing Techniques for Data Analysis Clarendon Press, Oxford, 1997 Chu, C.-K. - Marron, J.S. Comparison of two bandwidth selectors with dependent errors The Annals of statistics, Vol.19, No.4 (1991), pp Härdle, W. - Vieu, P. Kernel Regression Smoothing of Time Series Journal of Time Series Analysis, Vol.13, No.3, (May, 1992), pp

41 References Motivace Herrmann, E. - Gasser, T. - Kneip, A. Choice of Bandwidth for Kernel Regression when Residuals are Correlated Biometrika, Vol.79, No.4 (Dec., 1992), pp Koláček, J. Plug-in method for nonparametric regression Computational Statistics, Vol.23, No.1 (Jan., 2008), pp Opsomer, J. - Wang, Y. - Yang, Y. Nonparametric Regression with Correlated Errors Statistical Science, Vol.16, No.2 (May, 2001), pp

42 Děkuji za pozornost

Jádrové odhady gradientu regresní funkce

Jádrové odhady gradientu regresní funkce Monika Kroupová Ivana Horová Jan Koláček Ústav matematiky a statistiky, Masarykova univerzita, Brno ROBUST 2018 Osnova Regresní model a odhad gradientu Metody pro odhad vyhlazovací matice Simulace Závěr

More information

Computation of Information Value for Credit Scoring Models

Computation of Information Value for Credit Scoring Models Jedovnice 20 Computation of Information Value for Credit Scoring Models Martin Řezáč, Jan Koláček Dept. of Mathematics and Statistics, Faculty of Science, Masaryk University Information value The special

More information

Local Polynomial Regression

Local Polynomial Regression VI Local Polynomial Regression (1) Global polynomial regression We observe random pairs (X 1, Y 1 ),, (X n, Y n ) where (X 1, Y 1 ),, (X n, Y n ) iid (X, Y ). We want to estimate m(x) = E(Y X = x) based

More information

Nonparametric Regression with Correlated Errors

Nonparametric Regression with Correlated Errors Nonparametric Regression with Correlated Errors Jean Opsomer Iowa State University Yuedong Wang University of California, Santa Barbara Yuhong Yang Iowa State University February 27, 2001 Abstract Nonparametric

More information

Econ 582 Nonparametric Regression

Econ 582 Nonparametric Regression Econ 582 Nonparametric Regression Eric Zivot May 28, 2013 Nonparametric Regression Sofarwehaveonlyconsideredlinearregressionmodels = x 0 β + [ x ]=0 [ x = x] =x 0 β = [ x = x] [ x = x] x = β The assume

More information

Segmentace textury. Jan Kybic

Segmentace textury. Jan Kybic Segmentace textury Případová studie Jan Kybic Zadání Mikroskopický obrázek segmentujte do tříd: Příčná vlákna Podélná vlákna Matrice Trhliny Zvolená metoda Deskriptorový popis Učení s učitelem ML klasifikátor

More information

Estimation of cumulative distribution function with spline functions

Estimation of cumulative distribution function with spline functions INTERNATIONAL JOURNAL OF ECONOMICS AND STATISTICS Volume 5, 017 Estimation of cumulative distribution function with functions Akhlitdin Nizamitdinov, Aladdin Shamilov Abstract The estimation of the cumulative

More information

Introduction. Linear Regression. coefficient estimates for the wage equation: E(Y X) = X 1 β X d β d = X β

Introduction. Linear Regression. coefficient estimates for the wage equation: E(Y X) = X 1 β X d β d = X β Introduction - Introduction -2 Introduction Linear Regression E(Y X) = X β +...+X d β d = X β Example: Wage equation Y = log wages, X = schooling (measured in years), labor market experience (measured

More information

Additive Isotonic Regression

Additive Isotonic Regression Additive Isotonic Regression Enno Mammen and Kyusang Yu 11. July 2006 INTRODUCTION: We have i.i.d. random vectors (Y 1, X 1 ),..., (Y n, X n ) with X i = (X1 i,..., X d i ) and we consider the additive

More information

Bayesian estimation of bandwidths for a nonparametric regression model with a flexible error density

Bayesian estimation of bandwidths for a nonparametric regression model with a flexible error density ISSN 1440-771X Australia Department of Econometrics and Business Statistics http://www.buseco.monash.edu.au/depts/ebs/pubs/wpapers/ Bayesian estimation of bandwidths for a nonparametric regression model

More information

Quantitative Economics for the Evaluation of the European Policy. Dipartimento di Economia e Management

Quantitative Economics for the Evaluation of the European Policy. Dipartimento di Economia e Management Quantitative Economics for the Evaluation of the European Policy Dipartimento di Economia e Management Irene Brunetti 1 Davide Fiaschi 2 Angela Parenti 3 9 ottobre 2015 1 ireneb@ec.unipi.it. 2 davide.fiaschi@unipi.it.

More information

Error distribution function for parametrically truncated and censored data

Error distribution function for parametrically truncated and censored data Error distribution function for parametrically truncated and censored data Géraldine LAURENT Jointly with Cédric HEUCHENNE QuantOM, HEC-ULg Management School - University of Liège Friday, 14 September

More information

O Combining cross-validation and plug-in methods - for kernel density bandwidth selection O

O Combining cross-validation and plug-in methods - for kernel density bandwidth selection O O Combining cross-validation and plug-in methods - for kernel density selection O Carlos Tenreiro CMUC and DMUC, University of Coimbra PhD Program UC UP February 18, 2011 1 Overview The nonparametric problem

More information

Introduction to Nonparametric Regression

Introduction to Nonparametric Regression Introduction to Nonparametric Regression Nathaniel E. Helwig Assistant Professor of Psychology and Statistics University of Minnesota (Twin Cities) Updated 04-Jan-2017 Nathaniel E. Helwig (U of Minnesota)

More information

Wavelet Regression Estimation in Longitudinal Data Analysis

Wavelet Regression Estimation in Longitudinal Data Analysis Wavelet Regression Estimation in Longitudinal Data Analysis ALWELL J. OYET and BRAJENDRA SUTRADHAR Department of Mathematics and Statistics, Memorial University of Newfoundland St. John s, NF Canada, A1C

More information

A Note on Data-Adaptive Bandwidth Selection for Sequential Kernel Smoothers

A Note on Data-Adaptive Bandwidth Selection for Sequential Kernel Smoothers 6th St.Petersburg Workshop on Simulation (2009) 1-3 A Note on Data-Adaptive Bandwidth Selection for Sequential Kernel Smoothers Ansgar Steland 1 Abstract Sequential kernel smoothers form a class of procedures

More information

A tour of kernel smoothing

A tour of kernel smoothing Tarn Duong Institut Pasteur October 2007 The journey up till now 1995 1998 Bachelor, Univ. of Western Australia, Perth 1999 2000 Researcher, Australian Bureau of Statistics, Canberra and Sydney 2001 2004

More information

PREWHITENING-BASED ESTIMATION IN PARTIAL LINEAR REGRESSION MODELS: A COMPARATIVE STUDY

PREWHITENING-BASED ESTIMATION IN PARTIAL LINEAR REGRESSION MODELS: A COMPARATIVE STUDY REVSTAT Statistical Journal Volume 7, Number 1, April 2009, 37 54 PREWHITENING-BASED ESTIMATION IN PARTIAL LINEAR REGRESSION MODELS: A COMPARATIVE STUDY Authors: Germán Aneiros-Pérez Departamento de Matemáticas,

More information

4 Nonparametric Regression

4 Nonparametric Regression 4 Nonparametric Regression 4.1 Univariate Kernel Regression An important question in many fields of science is the relation between two variables, say X and Y. Regression analysis is concerned with the

More information

University, Tempe, Arizona, USA b Department of Mathematics and Statistics, University of New. Mexico, Albuquerque, New Mexico, USA

University, Tempe, Arizona, USA b Department of Mathematics and Statistics, University of New. Mexico, Albuquerque, New Mexico, USA This article was downloaded by: [University of New Mexico] On: 27 September 2012, At: 22:13 Publisher: Taylor & Francis Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered

More information

Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications

Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications Fumiya Akashi Research Associate Department of Applied Mathematics Waseda University

More information

Bandwidth selection for kernel conditional density

Bandwidth selection for kernel conditional density Bandwidth selection for kernel conditional density estimation David M Bashtannyk and Rob J Hyndman 1 10 August 1999 Abstract: We consider bandwidth selection for the kernel estimator of conditional density

More information

Nonparametric Regression of Presidential Approval Rating with Correlated Observations

Nonparametric Regression of Presidential Approval Rating with Correlated Observations Nonparametric Regression of Presidential Approval Rating with Correlated Observations Andrew V. Carter Department of Statistics and Applied Probability University of California Santa Barbara Santa Barbara,

More information

arxiv: v1 [stat.me] 28 Jun 2007

arxiv: v1 [stat.me] 28 Jun 2007 Electronic Journal of Statistics Vol. 1 (7) 9 ISSN: 1935-75 DOI:.11/7-EJS SiZer for time series: A new approach to the analysis of trends arxiv:7.19v1 [stat.me] Jun 7 Vitaliana Rondonotti, Monetary Financial

More information

Density estimation Nonparametric conditional mean estimation Semiparametric conditional mean estimation. Nonparametrics. Gabriel Montes-Rojas

Density estimation Nonparametric conditional mean estimation Semiparametric conditional mean estimation. Nonparametrics. Gabriel Montes-Rojas 0 0 5 Motivation: Regression discontinuity (Angrist&Pischke) Outcome.5 1 1.5 A. Linear E[Y 0i X i] 0.2.4.6.8 1 X Outcome.5 1 1.5 B. Nonlinear E[Y 0i X i] i 0.2.4.6.8 1 X utcome.5 1 1.5 C. Nonlinearity

More information

Nonparametric Regression Härdle, Müller, Sperlich, Werwarz, 1995, Nonparametric and Semiparametric Models, An Introduction

Nonparametric Regression Härdle, Müller, Sperlich, Werwarz, 1995, Nonparametric and Semiparametric Models, An Introduction Härdle, Müller, Sperlich, Werwarz, 1995, Nonparametric and Semiparametric Models, An Introduction Tine Buch-Kromann Univariate Kernel Regression The relationship between two variables, X and Y where m(

More information

Modelling Non-linear and Non-stationary Time Series

Modelling Non-linear and Non-stationary Time Series Modelling Non-linear and Non-stationary Time Series Chapter 2: Non-parametric methods Henrik Madsen Advanced Time Series Analysis September 206 Henrik Madsen (02427 Adv. TS Analysis) Lecture Notes September

More information

Nonparametric Inference via Bootstrapping the Debiased Estimator

Nonparametric Inference via Bootstrapping the Debiased Estimator Nonparametric Inference via Bootstrapping the Debiased Estimator Yen-Chi Chen Department of Statistics, University of Washington ICSA-Canada Chapter Symposium 2017 1 / 21 Problem Setup Let X 1,, X n be

More information

DavidAllanBurt. Dissertation submitted to the Faculty of the. Virginia Polytechnic Institute and State University

DavidAllanBurt. Dissertation submitted to the Faculty of the. Virginia Polytechnic Institute and State University Bandwidth Selection Concerns for Jump Point Discontinuity Preservation in the Regression Setting Using M-smoothers and the Extension to Hypothesis Testing DavidAllanBurt Dissertation submitted to the Faculty

More information

Optimal Estimation of Derivatives in Nonparametric Regression

Optimal Estimation of Derivatives in Nonparametric Regression Journal of Machine Learning Research 17 (2016) 1-25 Submitted 12/15; Revised 4/16; Published 8/16 Optimal Estimation of Derivatives in Nonparametric Regression Wenlin Dai CEMSE Division King Abdullah University

More information

Local Polynomial Modelling and Its Applications

Local Polynomial Modelling and Its Applications Local Polynomial Modelling and Its Applications J. Fan Department of Statistics University of North Carolina Chapel Hill, USA and I. Gijbels Institute of Statistics Catholic University oflouvain Louvain-la-Neuve,

More information

Robust Nonparametric Estimation of the Intensity Function of Point Data

Robust Nonparametric Estimation of the Intensity Function of Point Data AStA 78 - Revision Robust Nonparametric Estimation of the Intensity Function of Point Data Carlo Grillenzoni University IUAV of Venice Cá Tron, Venezia, Italy (carlog@iuav.it) Abstract. Intensity functions

More information

SIMULTANEOUS CONFIDENCE BANDS AND HYPOTHESIS TESTING FOR SINGLE-INDEX MODELS

SIMULTANEOUS CONFIDENCE BANDS AND HYPOTHESIS TESTING FOR SINGLE-INDEX MODELS Statistica Sinica 24 (2014), 937-955 doi:http://dx.doi.org/10.5705/ss.2012.127 SIMULTANEOUS CONFIDENCE BANDS AND HYPOTHESIS TESTING FOR SINGLE-INDEX MODELS Gaorong Li 1, Heng Peng 2, Kai Dong 2 and Tiejun

More information

Local linear multiple regression with variable. bandwidth in the presence of heteroscedasticity

Local linear multiple regression with variable. bandwidth in the presence of heteroscedasticity Local linear multiple regression with variable bandwidth in the presence of heteroscedasticity Azhong Ye 1 Rob J Hyndman 2 Zinai Li 3 23 January 2006 Abstract: We present local linear estimator with variable

More information

df=degrees of freedom = n - 1

df=degrees of freedom = n - 1 One sample t-test test of the mean Assumptions: Independent, random samples Approximately normal distribution (from intro class: σ is unknown, need to calculate and use s (sample standard deviation)) Hypotheses:

More information

Nonparametric Methods

Nonparametric Methods Nonparametric Methods Michael R. Roberts Department of Finance The Wharton School University of Pennsylvania July 28, 2009 Michael R. Roberts Nonparametric Methods 1/42 Overview Great for data analysis

More information

BOUNDARY KERNELS FOR DISTRIBUTION FUNCTION ESTIMATION

BOUNDARY KERNELS FOR DISTRIBUTION FUNCTION ESTIMATION REVSTAT Statistical Journal Volume 11, Number 2, June 213, 169 19 BOUNDARY KERNELS FOR DISTRIBUTION FUNCTION ESTIMATION Author: Carlos Tenreiro CMUC, Department of Mathematics, University of Coimbra, Apartado

More information

arxiv: v2 [math.st] 16 Oct 2013

arxiv: v2 [math.st] 16 Oct 2013 Fourier methods for smooth distribution function estimation J.E. Chacón, P. Monfort and C. Tenreiro October 17, 213 Abstract arxiv:135.2476v2 [math.st] 16 Oct 213 The limit behavior of the optimal bandwidth

More information

Plot of λ(x) against x x. SiZer map based on local likelihood (n=500) x

Plot of λ(x) against x x. SiZer map based on local likelihood (n=500) x Local Likelihood SiZer Map Runze Li Department of Statistics Pennsylvania State University University Park, PA 682-2 Email: rli@stat.psu.edu J. S. Marron Department of Statistics University of North Carolina

More information

DEPARTMENT MATHEMATIK ARBEITSBEREICH MATHEMATISCHE STATISTIK UND STOCHASTISCHE PROZESSE

DEPARTMENT MATHEMATIK ARBEITSBEREICH MATHEMATISCHE STATISTIK UND STOCHASTISCHE PROZESSE Estimating the error distribution in nonparametric multiple regression with applications to model testing Natalie Neumeyer & Ingrid Van Keilegom Preprint No. 2008-01 July 2008 DEPARTMENT MATHEMATIK ARBEITSBEREICH

More information

On the use of Nonparametric Regression in Assessing Parametric Regression Models

On the use of Nonparametric Regression in Assessing Parametric Regression Models Penultimate version of a paper accepted in the Journal of Mathematical Psychology On the use of Nonparametric Regression in Assessing Parametric Regression Models Scott Brown and Andrew Heathcote Department

More information

ECON 721: Lecture Notes on Nonparametric Density and Regression Estimation. Petra E. Todd

ECON 721: Lecture Notes on Nonparametric Density and Regression Estimation. Petra E. Todd ECON 721: Lecture Notes on Nonparametric Density and Regression Estimation Petra E. Todd Fall, 2014 2 Contents 1 Review of Stochastic Order Symbols 1 2 Nonparametric Density Estimation 3 2.1 Histogram

More information

OFFICE OF NAVAL RESEARCH FINAL REPORT for TASK NO. NR PRINCIPAL INVESTIGATORS: Jeffrey D. Hart Thomas E. Wehrly

OFFICE OF NAVAL RESEARCH FINAL REPORT for TASK NO. NR PRINCIPAL INVESTIGATORS: Jeffrey D. Hart Thomas E. Wehrly AD-A240 830 S ~September 1 10, 1991 OFFICE OF NAVAL RESEARCH FINAL REPORT for 1 OCTOBER 1985 THROUGH 31 AUGUST 1991 CONTRACT N00014-85-K-0723 TASK NO. NR 042-551 Nonparametric Estimation of Functions Based

More information

Local Adaptive Smoothing in Kernel Regression Estimation

Local Adaptive Smoothing in Kernel Regression Estimation Clemson University TigerPrints All Theses Theses 8-009 Local Adaptive Smoothing in Kernel Regression Estimation Qi Zheng Clemson University, qiz@clemson.edu Follow this and additional works at: https://tigerprints.clemson.edu/all_theses

More information

The choice of weights in kernel regression estimation

The choice of weights in kernel regression estimation Biometrika (1990), 77, 2, pp. 377-81 Printed in Great Britain The choice of weights in kernel regression estimation BY THEO GASSER Zentralinstitut fur Seelische Gesundheit, J5, P.O.B. 5970, 6800 Mannheim

More information

Updating on the Kernel Density Estimation for Compositional Data

Updating on the Kernel Density Estimation for Compositional Data Updating on the Kernel Density Estimation for Compositional Data Martín-Fernández, J. A., Chacón-Durán, J. E., and Mateu-Figueras, G. Dpt. Informàtica i Matemàtica Aplicada, Universitat de Girona, Campus

More information

Integral approximation by kernel smoothing

Integral approximation by kernel smoothing Integral approximation by kernel smoothing François Portier Université catholique de Louvain - ISBA August, 29 2014 In collaboration with Bernard Delyon Topic of the talk: Given ϕ : R d R, estimation of

More information

Zudi Lu, Dag Tjøstheim and Qiwei Yao Spatial smoothing, Nugget effect and infill asymptotics

Zudi Lu, Dag Tjøstheim and Qiwei Yao Spatial smoothing, Nugget effect and infill asymptotics Zudi Lu, Dag Tjøstheim and Qiwei Yao Spatial smoothing, Nugget effect and infill asymptotics Article (Submitted version) (Pre-refereed) Original citation: Lu, Zudi and Tjostheim, Dag and Yao, Qiwei (2008)

More information

Smooth functions and local extreme values

Smooth functions and local extreme values Smooth functions and local extreme values A. Kovac 1 Department of Mathematics University of Bristol Abstract Given a sample of n observations y 1,..., y n at time points t 1,..., t n we consider the problem

More information

Beyond Curve Fitting? Comment on Liu, Mayer-Kress and Newell.

Beyond Curve Fitting? Comment on Liu, Mayer-Kress and Newell. Beyond Curve Fitting? Comment on Liu, Mayer-Kress and Newell. Andrew Heathcote & Scott Brown University of Newcastle, Australia University of California, Irvine Correspondence should be addressed to: Andrew

More information

Difference-based Variance Estimation in Nonparametric Regression with Repeated Measurement Data

Difference-based Variance Estimation in Nonparametric Regression with Repeated Measurement Data Difference-based Variance Estimation in Nonparametric Regression with Repeated Measurement Data Wenlin Dai 1, Yanyuan Ma, Tiejun Tong 1, and Lixing Zhu 1 1 Department of Mathematics, Hong Kong Baptist

More information

Časopis pro pěstování matematiky a fysiky

Časopis pro pěstování matematiky a fysiky Časopis pro pěstování matematiky a fysiky Norman Levinson Criteria for the limit-point case for second order linear differential operators Časopis pro pěstování matematiky a fysiky, Vol. 74 (1949), No.

More information

arxiv: v5 [stat.me] 12 Jul 2016

arxiv: v5 [stat.me] 12 Jul 2016 Reliable Prediction Intervals for Local Linear Regression Mohammad Ghasemi Hamed a,, Masoud Ebadi Kivaj b a IFSTTAR-COSYS-LIVIC, 25 Allée des Marronniers 78000 Versailles, France b Independent Researcher,

More information

3 Nonparametric Density Estimation

3 Nonparametric Density Estimation 3 Nonparametric Density Estimation Example: Income distribution Source: U.K. Family Expenditure Survey (FES) 1968-1995 Approximately 7000 British Households per year For each household many different variables

More information

OPTIMAL POINTWISE ADAPTIVE METHODS IN NONPARAMETRIC ESTIMATION 1

OPTIMAL POINTWISE ADAPTIVE METHODS IN NONPARAMETRIC ESTIMATION 1 The Annals of Statistics 1997, Vol. 25, No. 6, 2512 2546 OPTIMAL POINTWISE ADAPTIVE METHODS IN NONPARAMETRIC ESTIMATION 1 By O. V. Lepski and V. G. Spokoiny Humboldt University and Weierstrass Institute

More information

A Monte Carlo Investigation of Smoothing Methods. for Error Density Estimation in Functional Data. Analysis with an Illustrative Application to a

A Monte Carlo Investigation of Smoothing Methods. for Error Density Estimation in Functional Data. Analysis with an Illustrative Application to a A Monte Carlo Investigation of Smoothing Methods for Error Density Estimation in Functional Data Analysis with an Illustrative Application to a Chemometric Data Set A MONTE CARLO INVESTIGATION OF SMOOTHING

More information

By 3DYHOýtåHN, Wolfgang Härdle

By 3DYHOýtåHN, Wolfgang Härdle No. 2005 31 ROBUST ESTIMATION OF DIMENSION REDUCTION SPACE By 3DYHOýtåHN, Wolfgang Härdle February 2005 ISSN 0924-7815 Robust estimation of dimension reduction space P. Čížek a and W. Härdle b a Department

More information

41903: Introduction to Nonparametrics

41903: Introduction to Nonparametrics 41903: Notes 5 Introduction Nonparametrics fundamentally about fitting flexible models: want model that is flexible enough to accommodate important patterns but not so flexible it overspecializes to specific

More information

Kernel Density Estimation

Kernel Density Estimation Kernel Density Estimation and Application in Discriminant Analysis Thomas Ledl Universität Wien Contents: Aspects of Application observations: 0 Which distribution? 0?? 0.0 0. 0. 0. 0.0 0. 0. 0 0 0.0

More information

Appendix. Title. Petr Lachout MFF UK, ÚTIA AV ČR

Appendix. Title. Petr Lachout MFF UK, ÚTIA AV ČR Title ROBUST - Kráĺıky - únor, 2010 Definice Budeme se zabývat optimalizačními úlohami. Uvažujme metrický prostor X a funkci f : X R = [, + ]. Zajímá nás minimální hodnota funkce f na X ϕ (f ) = inf {f

More information

UNIVERSITÄT POTSDAM Institut für Mathematik

UNIVERSITÄT POTSDAM Institut für Mathematik UNIVERSITÄT POTSDAM Institut für Mathematik Testing the Acceleration Function in Life Time Models Hannelore Liero Matthias Liero Mathematische Statistik und Wahrscheinlichkeitstheorie Universität Potsdam

More information

Generated Covariates in Nonparametric Estimation: A Short Review.

Generated Covariates in Nonparametric Estimation: A Short Review. Generated Covariates in Nonparametric Estimation: A Short Review. Enno Mammen, Christoph Rothe, and Melanie Schienle Abstract In many applications, covariates are not observed but have to be estimated

More information

Working Paper Series

Working Paper Series CENTER FOR INTERNATIONAL ECONOMICS Working Paper Series Working Paper No. 2017-04 Data-driven local polynomial for the trend and its derivatives in economic time series Yuanhua Feng and Thomas Gries April

More information

Robust Nonparametric Smoothing of Nonstationary Time-Series

Robust Nonparametric Smoothing of Nonstationary Time-Series JSCS #3943 - Revised Robust Nonparametric Smoothing of Nonstationary Time-Series Carlo Grillenzoni University IUAV of Venice 335 Venice, ITALY (carlog@iuav.it) Abstract. Motivated by the need of extracting

More information

The Pennsylvania State University VARYING-COEFFICIENT MODELS: NEW MODELS, INFERENCE PROCEDURES AND APPLICATIONS

The Pennsylvania State University VARYING-COEFFICIENT MODELS: NEW MODELS, INFERENCE PROCEDURES AND APPLICATIONS The Pennsylvania State University The Graduate School Department of Statistics VARYING-COEFFICIENT MODELS: NEW MODELS, INFERENCE PROCEDURES AND APPLICATIONS A Thesis in Statistics by Yang Wang c 27 Yang

More information

Causal Inference Basics

Causal Inference Basics Causal Inference Basics Sam Lendle October 09, 2013 Observed data, question, counterfactuals Observed data: n i.i.d copies of baseline covariates W, treatment A {0, 1}, and outcome Y. O i = (W i, A i,

More information

USING A BIMODAL KERNEL FOR A NONPARAMETRIC REGRESSION SPECIFICATION TEST

USING A BIMODAL KERNEL FOR A NONPARAMETRIC REGRESSION SPECIFICATION TEST Statistica Sinica 25 (2015), 1145-1161 doi:http://dx.doi.org/10.5705/ss.2014.008 USING A BIMODAL KERNEL FOR A NONPARAMETRIC REGRESSION SPECIFICATION TEST Cheolyong Park 1, Tae Yoon Kim 1, Jeongcheol Ha

More information

Nonparametric Function Estimation with Infinite-Order Kernels

Nonparametric Function Estimation with Infinite-Order Kernels Nonparametric Function Estimation with Infinite-Order Kernels Arthur Berg Department of Statistics, University of Florida March 15, 2008 Kernel Density Estimation (IID Case) Let X 1,..., X n iid density

More information

arxiv: v2 [stat.me] 12 Sep 2017

arxiv: v2 [stat.me] 12 Sep 2017 1 arxiv:1704.03924v2 [stat.me] 12 Sep 2017 A Tutorial on Kernel Density Estimation and Recent Advances Yen-Chi Chen Department of Statistics University of Washington September 13, 2017 This tutorial provides

More information

Uniform confidence bands for kernel regression estimates with dependent data IN MEMORY OF F. MARMOL

Uniform confidence bands for kernel regression estimates with dependent data IN MEMORY OF F. MARMOL . Uniform confidence bands for kernel regression estimates with dependent data J. Hidalgo London School of Economics IN MEMORY OF F. MARMOL AIMS AND ESTIMATION METHODOLOGY CONDITIONS RESULTS BOOTSTRAP

More information

Convergence rates for uniform confidence intervals based on local polynomial regression estimators

Convergence rates for uniform confidence intervals based on local polynomial regression estimators Journal of Nonparametric Statistics ISSN: 1048-5252 Print) 1029-0311 Online) Journal homepage: http://www.tandfonline.com/loi/gnst20 Convergence rates for uniform confidence intervals based on local polynomial

More information

Nonparametric Regression. Badr Missaoui

Nonparametric Regression. Badr Missaoui Badr Missaoui Outline Kernel and local polynomial regression. Penalized regression. We are given n pairs of observations (X 1, Y 1 ),...,(X n, Y n ) where Y i = r(x i ) + ε i, i = 1,..., n and r(x) = E(Y

More information

CONSISTENCY OF CROSS VALIDATION FOR COMPARING REGRESSION PROCEDURES. By Yuhong Yang University of Minnesota

CONSISTENCY OF CROSS VALIDATION FOR COMPARING REGRESSION PROCEDURES. By Yuhong Yang University of Minnesota Submitted to the Annals of Statistics CONSISTENCY OF CROSS VALIDATION FOR COMPARING REGRESSION PROCEDURES By Yuhong Yang University of Minnesota Theoretical developments on cross validation CV) have mainly

More information

An Asymptotic Study of Variable Bandwidth Selection for Local Polynomial Regression with Application to Density Estimation

An Asymptotic Study of Variable Bandwidth Selection for Local Polynomial Regression with Application to Density Estimation An Asymptotic Study of Variable Bandwidth Selection for Local Polynomial Regression with Application to Density Estimation Jianqing Fant Department of Statistics University of North Carolina Chapel Hill,

More information

Alternatives to Basis Expansions. Kernels in Density Estimation. Kernels and Bandwidth. Idea Behind Kernel Methods

Alternatives to Basis Expansions. Kernels in Density Estimation. Kernels and Bandwidth. Idea Behind Kernel Methods Alternatives to Basis Expansions Basis expansions require either choice of a discrete set of basis or choice of smoothing penalty and smoothing parameter Both of which impose prior beliefs on data. Alternatives

More information

Bootstrap metody II Kernelové Odhady Hustot

Bootstrap metody II Kernelové Odhady Hustot Bootstrap metody II Kernelové Odhady Hustot Mgr. Rudolf B. Blažek, Ph.D. prof. RNDr. Roman Kotecký, DrSc. Katedra počítačových systémů Katedra teoretické informatiky Fakulta informačních technologií České

More information

Uncertainty Quantification for Inverse Problems. November 7, 2011

Uncertainty Quantification for Inverse Problems. November 7, 2011 Uncertainty Quantification for Inverse Problems November 7, 2011 Outline UQ and inverse problems Review: least-squares Review: Gaussian Bayesian linear model Parametric reductions for IP Bias, variance

More information

ESTIMATORS IN THE CONTEXT OF ACTUARIAL LOSS MODEL A COMPARISON OF TWO NONPARAMETRIC DENSITY MENGJUE TANG A THESIS MATHEMATICS AND STATISTICS

ESTIMATORS IN THE CONTEXT OF ACTUARIAL LOSS MODEL A COMPARISON OF TWO NONPARAMETRIC DENSITY MENGJUE TANG A THESIS MATHEMATICS AND STATISTICS A COMPARISON OF TWO NONPARAMETRIC DENSITY ESTIMATORS IN THE CONTEXT OF ACTUARIAL LOSS MODEL MENGJUE TANG A THESIS IN THE DEPARTMENT OF MATHEMATICS AND STATISTICS PRESENTED IN PARTIAL FULFILLMENT OF THE

More information

Nonparametric Statistics

Nonparametric Statistics Nonparametric Statistics Jessi Cisewski Yale University Astrostatistics Summer School - XI Wednesday, June 3, 2015 1 Overview Many of the standard statistical inference procedures are based on assumptions

More information

Simple Linear Regression

Simple Linear Regression Simple Linear Regression In simple linear regression we are concerned about the relationship between two variables, X and Y. There are two components to such a relationship. 1. The strength of the relationship.

More information

Additive Models: Extensions and Related Models.

Additive Models: Extensions and Related Models. Additive Models: Extensions and Related Models. Enno Mammen Byeong U. Park Melanie Schienle August 8, 202 Abstract We give an overview over smooth backfitting type estimators in additive models. Moreover

More information

Asymptotically Optimal Regression Trees

Asymptotically Optimal Regression Trees Working Paper 208:2 Department of Economics School of Economics and Management Asymptotically Optimal Regression Trees Erik Mohlin May 208 Asymptotically Optimal Regression Trees Erik Mohlin Lund University

More information

Maximum Smoothed Likelihood for Multivariate Nonparametric Mixtures

Maximum Smoothed Likelihood for Multivariate Nonparametric Mixtures Maximum Smoothed Likelihood for Multivariate Nonparametric Mixtures David Hunter Pennsylvania State University, USA Joint work with: Tom Hettmansperger, Hoben Thomas, Didier Chauveau, Pierre Vandekerkhove,

More information

On the Choice of Difference Sequence in a Unified Framework for Variance Estimation in Nonparametric Regression

On the Choice of Difference Sequence in a Unified Framework for Variance Estimation in Nonparametric Regression Statistical Science 2017, Vol. 32, No. 3, 455 468 DOI: 10.1214/17-STS613 Institute of Mathematical Statistics, 2017 On the Choice of Difference Sequence in a Unified Framework for Variance Estimation in

More information

Statistica Sinica Preprint No: SS

Statistica Sinica Preprint No: SS Statistica Sinica Preprint No: SS-017-0013 Title A Bootstrap Method for Constructing Pointwise and Uniform Confidence Bands for Conditional Quantile Functions Manuscript ID SS-017-0013 URL http://wwwstatsinicaedutw/statistica/

More information

when we observe high-frequency data with microstructure noise over a long time

when we observe high-frequency data with microstructure noise over a long time Statistical Inference for Stochastic Processes manuscript No. (will be inserted by the editor) Pre-averaged kernel estimators for the drift function of a diffusion process in the presence of microstructure

More information

Single Index Quantile Regression for Heteroscedastic Data

Single Index Quantile Regression for Heteroscedastic Data Single Index Quantile Regression for Heteroscedastic Data E. Christou M. G. Akritas Department of Statistics The Pennsylvania State University JSM, 2015 E. Christou, M. G. Akritas (PSU) SIQR JSM, 2015

More information

Goodness-of-fit tests for the cure rate in a mixture cure model

Goodness-of-fit tests for the cure rate in a mixture cure model Biometrika (217), 13, 1, pp. 1 7 Printed in Great Britain Advance Access publication on 31 July 216 Goodness-of-fit tests for the cure rate in a mixture cure model BY U.U. MÜLLER Department of Statistics,

More information

Bickel Rosenblatt test

Bickel Rosenblatt test University of Latvia 28.05.2011. A classical Let X 1,..., X n be i.i.d. random variables with a continuous probability density function f. Consider a simple hypothesis H 0 : f = f 0 with a significance

More information

Nonparametric Regression

Nonparametric Regression Nonparametric Regression Econ 674 Purdue University April 8, 2009 Justin L. Tobias (Purdue) Nonparametric Regression April 8, 2009 1 / 31 Consider the univariate nonparametric regression model: where y

More information

NADARAYA WATSON ESTIMATE JAN 10, 2006: version 2. Y ik ( x i

NADARAYA WATSON ESTIMATE JAN 10, 2006: version 2. Y ik ( x i NADARAYA WATSON ESTIMATE JAN 0, 2006: version 2 DATA: (x i, Y i, i =,..., n. ESTIMATE E(Y x = m(x by n i= ˆm (x = Y ik ( x i x n i= K ( x i x EXAMPLES OF K: K(u = I{ u c} (uniform or box kernel K(u = u

More information

Sparse Nonparametric Density Estimation in High Dimensions Using the Rodeo

Sparse Nonparametric Density Estimation in High Dimensions Using the Rodeo Sparse Nonparametric Density Estimation in High Dimensions Using the Rodeo Han Liu John Lafferty Larry Wasserman Statistics Department Computer Science Department Machine Learning Department Carnegie Mellon

More information

Kernel density estimation

Kernel density estimation Kernel density estimation Patrick Breheny October 18 Patrick Breheny STA 621: Nonparametric Statistics 1/34 Introduction Kernel Density Estimation We ve looked at one method for estimating density: histograms

More information

Optimal Ridge Detection using Coverage Risk

Optimal Ridge Detection using Coverage Risk Optimal Ridge Detection using Coverage Risk Yen-Chi Chen Department of Statistics Carnegie Mellon University yenchic@andrew.cmu.edu Shirley Ho Department of Physics Carnegie Mellon University shirleyh@andrew.cmu.edu

More information

Acceleration of some empirical means. Application to semiparametric regression

Acceleration of some empirical means. Application to semiparametric regression Acceleration of some empirical means. Application to semiparametric regression François Portier Université catholique de Louvain - ISBA November, 8 2013 In collaboration with Bernard Delyon Regression

More information

A New Test in Parametric Linear Models with Nonparametric Autoregressive Errors

A New Test in Parametric Linear Models with Nonparametric Autoregressive Errors A New Test in Parametric Linear Models with Nonparametric Autoregressive Errors By Jiti Gao 1 and Maxwell King The University of Western Australia and Monash University Abstract: This paper considers a

More information

Statistical inference on Lévy processes

Statistical inference on Lévy processes Alberto Coca Cabrero University of Cambridge - CCA Supervisors: Dr. Richard Nickl and Professor L.C.G.Rogers Funded by Fundación Mutua Madrileña and EPSRC MASDOC/CCA student workshop 2013 26th March Outline

More information

Lecture Notes 15 Prediction Chapters 13, 22, 20.4.

Lecture Notes 15 Prediction Chapters 13, 22, 20.4. Lecture Notes 15 Prediction Chapters 13, 22, 20.4. 1 Introduction Prediction is covered in detail in 36-707, 36-701, 36-715, 10/36-702. Here, we will just give an introduction. We observe training data

More information

Data-Based Choice of Histogram Bin Width. M. P. Wand. Australian Graduate School of Management. University of New South Wales.

Data-Based Choice of Histogram Bin Width. M. P. Wand. Australian Graduate School of Management. University of New South Wales. Data-Based Choice of Histogram Bin Width M. P. Wand Australian Graduate School of Management University of New South Wales 13th May, 199 Abstract The most important parameter of a histogram is the bin

More information

Function of Longitudinal Data

Function of Longitudinal Data New Local Estimation Procedure for Nonparametric Regression Function of Longitudinal Data Weixin Yao and Runze Li Abstract This paper develops a new estimation of nonparametric regression functions for

More information