2 FRED J. HICKERNELL the sample mean of the y (i) : (2) ^ 1 N The mean square error of this estimate may be written as a sum of two parts, a bias term
|
|
- Oswin Ball
- 5 years ago
- Views:
Transcription
1 GOODNESS OF FIT STATISTICS, DISCREPANCIES AND ROBUST DESIGNS FRED J. HICKERNELL Abstract. The Cramer{Von Mises goodness-of-t statistic, also known as the L 2 -star discrepancy, is the optimality criterion for an experimental design for the location model with misspecication. This connection between goodnessof-t statistics, discrepancies and experimental designs is shown to hold in greater generality. 1. Introduction Experimental designs tell the experimenter how to set the levels for various controllable factors in an experiment so as to eciently determine how these factors aect the response. Mathematically speaking, let s denote the number of factors, and let be a measurable subset of R s corresponding to the experimental domain or space of feasible levels of the factors. An experimental design is a nite set of points P. Several criteria have been proposed to choose good designs. Orthogonal designs choose the columns of the design matrix to be orthogonal, and so the information matrix is diagonal. Optimal designs minimize or maximize some function of the information matrix. The optimality criterion depends on the assumed model for the response in terms of the explanatory variables. Since the true model may not be known in advance, robust designs are of interest. For example, consider the location model with misspecication: (1) y g(x) + ; g(x) + h(x); where y denotes the response, x is the vector of factors, g(x) is some function of the factors, and denotes random noise with zero mean and variance 2. The function g(x) is decomposed into its mean value with respect to some given distribution F(x), g(x) df (x); and the misspecication, h(x). For a given design P fz (1) ; : : : ; z (N) g, one may observe the corresponding response values, y (i) g(z (i) ) + (i), and then estimate the unknown constant by Key words and phrases. Cramer { Von Mises, low discrepancy, reproducing kernel Hilbert spaces. This research was supported by a Hong Kong RGC grant 94-95/38 and HKBU FRG grant 95-96/II-01. 1
2 2 FRED J. HICKERNELL the sample mean of the y (i) : (2) ^ 1 N The mean square error of this estimate may be written as a sum of two parts, a bias term depending on the size of the misspecication, and a variance term depending on the size of the noise: i1 y (i) : (3) Ef(? ^) 2 g [Err(h)] N ; where the square root of the bias term is Err(h) h(x) df (x)? 1 N i1 h(z (i) )? 1 N i1 h(z (i) ) Err(g): For the location model, the positions of the design points aect only the bias term, and not the variance term. The bias term can be further analyzed using either a worst-case or an averagecase (Bayesian) approach. It can be shown that either approach produces an optimality criterion that is equivalent to a goodness-of-t statistic measuring how close the empirical distribution of the design, P, F P (x) 1 N z2p 1 fzxg; approximates F(x). Here 1 A is the indicator function of A, and z (z 1 ; : : : ; z s ) x (x 1 ; : : : ; x s ) means that z j x j for all j. The purpose of this article is to show this equivalence explicitly. Note that the optimality criteria or goodness-of- t statistics appearing here are called discrepancies in the numerical quadrature literature. 2. The Optimality Criterion Is a Discrepancy The rst step is to show that an optimal, robust design for the location model is one that minimizes the discrepancy. This is done by determining how large (3) can be for the average-case or worst-case h(x). For the average-case analysis the function of the factors, g(x), is assumed to be in a space of random functions A with zero mean and covariance kernel K(x; t): E g2a[g(x)] 0; E g2a[g(x)g(t)] K(x; t) 8x; t 2 C s : The mean value of the bias term in (3) is: E g2a[err(g)] 2 E g2a " g(x) df (x)? 1 N z2p K(x; t) df (x) df(t)? 2 N + 1 N 2 z;z 0 2P K(z; z 0 ) f(z) # 2 z2p K(z; t) df (t) K(x; t) d[f (x)? F P (x)] d[f(t)? F P (t)]:
3 GOODNESS OF FIT STATISTICS, DISCREPANCIES AND ROBUST DESIGNS 3 The right-hand side of this equation is called the square discrepancy, and depends on the design as well as the covariance kernel: (4) [D(P ; K)] 2 K(x; t) d[f (x)? F P (x)] d[f(t)? F P (t)]: Therefore, an optimal robust design for the location model is one that minimizes the discrepancy. Note from the formulas above that the computational work required to evaluate the discrepancy is at worst O(N 2 ), the work required to compute a double sum. The worst-case analysis assumes that the function of the factors, g(x), lies in a Hilbert space, W, with inner product h; ; i W and reproducing kernel K(x; t). The reproducing kernel is a function on, such that, (5) g(t) hg; K(; t)i W 8t 2 ; g 2 W: The reproducing kernel is always positive denite and symmetric in its arguments, that is, (6a) (6b) i;k1 K(x; t) K(t; x) 8x; t 2 ; a (i) a (k) K(x (i) ; x (k) ) 0 8a (i) 2 R; x (i) 2 : The bias term in (3) is the square of Err(g), which is a linear functional on W. By the Riesz Representation Theorem, this linear functional has a representer,, such that Err(g) h; gi for all g 2 W. Because W has a reproducing kernel, it is easy to nd this representer: (x) h; K(; x)i W Err(K(; x)): The Cauchy-Schwarz inequality then implies that (7) [Err(g)] 2 [Err(h)] 2 h; hi 2 W kk 2 W khk 2 W : This upper bound is attained when the misspecication, h, is proportional to. The rst term in (7) is just the square discrepancy using (4), since Therefore, the worst-case analysis gives (8) kk 2 W h; i W Err() [D(P ; K)] 2 : sup Ef(? ^) 2 g [D(P ; K)] g2w N : khk1 A robust design which is optimal against the worst misspecication minimizes the discrepancy. Theorem 1. Consider the location model with misspecication (1). Then E g2aef(? ^) 2 g sup Ef(? ^) 2 g [D(P ; K)] g2w N ; khk1 where A is a space of random functions with covariance kernel K, W is a Hilbert space of functions with reproducing kernel K, and D(P ; K) is the discrepancy de- ned in (4). Thus, the optimal design for this model is the one which minimizes the discrepancy. Moreover, given any continuous kernel, K, that satises conditions (6), it is possible to construct a set of functions, A, for which K is the covariance
4 4 FRED J. HICKERNELL kernel, and there exists a unique Hilbert space, W, for which K is the reproducing kernel. The proof of the rst part of this theorem is given in the paragraphs above, while the proof of the latter part is given in [6]. See [6] for a more detailed discussion of covariance and reproducing kernels. Suppose that the experimental domain is the s-dimensional unit cube, [0; 1] s, (perhaps, after suitable scaling), and that the underlying distribution, F, is the uniform distribution, F unif (x) x 1 x s : Furthermore, suppose that the covariance/reproducing kernel is chosen to be K(x; t) sy j1 [1? max(x j ; t j )] : This means that the space A consists of Brownian sheets (multidimensional generalizations of Brownian motions), and the space W consists of all functions g satisfying the s s 2 L 2 ([0; 1] s ) and gj xj 1 0 8j: Under these assumptions the discrepancy dened in (4) is: [D 2(P )] 2 [F unif (x)? F P (x)] 2 dx [0;1] s s 1? 2 sy 1? zj 2 3 N 2 z2p j1! + 1 N 2 sy z;z 0 2P j1 [1? max(z j ; z 0 j)]: This is known as the L 2 -star discrepancy in the numerical quadrature literature, and also as the Cramer-Von Mises goodness-of-t statistic [1]. The averagecase analysis for this particular kernel was done in [8] and the worst-case analysis in [9]. In the next section the connection between discrepancies and goodness-of-t statistics is generalized. 3. The Discrepancy is a Goodness-of-Fit Statistic From the denition in (4) it is clear that the discrepancy measures how far away the empirical distribution function F P is from F. Since K(x; t) is positive-denite, the discrepancy becomes small if and only if F P approximates F well. In fact, one may dene an inner product on a space of signed measures, M, in terms of the reproducing kernel. Let M be the following space of signed measures: M signed measure F (x) : K(x; t) df (x) df (t) < +1 ; and dene an inner product on M as follows: (9) hf; Gi M K(x; t) df (x) dg(t) 8F; G 2 M: In this case the discrepancy is just the norm of F? F P : D(P ; K) kf(x)? F P (x)k M :
5 GOODNESS OF FIT STATISTICS, DISCREPANCIES AND ROBUST DESIGNS 5 That is, any discrepancy is a goodness-of-t statistic that takes the form of the norm of F? F P, where the norm is induced by a certain inner product dened in terms of the kernel K. The converse is also true. Suppose M is some Hilbert space of signed measures containing all point mass measures Ffzg(x) 1 fzxg. One may then dene a kernel in terms of the inner product on M, (10) K(z; z 0 ) hffzg; Ffz 0 gi M 8z; z 0 2 : This kernel satises conditions (6) by the denition of inner product. Also, equation (9) holds automatically when F and G are measures assigning unit mass to a single point. Furthermore, equality (9) holds for any signed measures in F; G 2 M by writing F and G as limits of linear combinations of point mass measures. The results of the preceding two paragraphs give the following theorem: Theorem 2. The discrepancy as dened in (4) takes the form kf? F P k M where the norm is induced by the inner product, h; i M dened in terms of the kernel in (9). Conversely, if M is a Hilbert space of signed measures containing all measures of the form Ffzg(x) 1 fzxg, then kf? F P k M D(P ; K) for the kernel dened in (10). 4. Conclusion The previous two sections show the strong relationship between robust optimal design criteria for location models, discrepancies, and goodness-of-t statistics. There are several practical consequences of these results: i. The uniform design [2, 7] spreads design points evenly over the experimental domain by minimizing the discrepancy. Theorem 1 makes the connection between optimal design for the misspecied location model and the uniform design. ii. Any goodness-of-t statistic arising from an inner product is equivalent to the discrepancy dened in (4) by Theorem 2. The formula for the discrepancy provides a way of computing the goodness-of-t statistic in only O(N 2 ) operations. For example, the multidimensional Cramer-Von Mises goodness-of-t statistic (L 2 -star discrepancy) compares the proportion of experimental points in the box [0; x) to its volume, and may be written as: [D 2(P )] 2 [0;1]s ( [0;x) d[f unif? F P ]) 2 dx: Because the box is anchored at the origin, this statistic changes when the set of experimental points, P, is reected through the plane x j 12 passing through the center of the cube for any j. Therefore, one might wish to modify this goodness-of-t statistic to consider all boxes [t; x) [0; 1) s, that is, [D(P )] 2 [0;1] 2s ; tx ( [t;x) d[f unif? F P ]) 2 dt dx:
6 6 FRED J. HICKERNELL This L 2 -unanchored discrepancy is not easy to compute in the above form, but using Theorem 2, one can obtain the relevant kernel as K(z; z 0 ) [0;1] 2s ; tx ( [t;x) dffzg [t;x) dffz 0 g ) dt dx sy j1 [min(z j ; z 0 j)? z j z 0 j]: The formula for the corresponding discrepancy then follows from (4) as s 1 2 sy [D(P )] 2 zj (1? z? j ) + 1 sy [min(z 12 N 2 N 2 j ; zj) 0? z j zj]: 0 z2p j1 z;z 0 2P j1 This formula was obtained earlier by [5]. iii. By Theorem 2, goodness-of-t statistics may be used as discrepancies, which indicate the error of numerical quadrature. Conversely, discrepancies in the numerical quadrature literature (see, for example, [3, 4]) may be used as goodness-of-t statistics. Acknowledgments The author would like to thank Sung-Nok Chiu, Gang Wei, Min-Yu ie, and Rong-ian Yue for their valuable comments and suggestions. References 1. R. B. D'Agostino and M. A. Stephens (eds.), Goodness-of-t techniques, Marcel Dekker, New York, K. T. Fang and F. J. Hickernell, The uniform design and its applications, Bull. Inst. Internat. Statist., 50 th Session, Book 1 (1995), 333{ F. J. Hickernell, A generalized discrepancy and quadrature error bound, Math. Comp. 67 (1998), 299{ , Lattice rules: How well do they measure up?, Pseudo- and Quasi-Random Point Sets (P. Hellekalek and G. Larcher, eds.), Lecture Notes in Statistics, Springer-Verlag, New York, 1998, to appear. 5. W. J. Moroko and R. E. Caisch, Quasi-random sequences and their discrepancies, SIAM J. Sci. Comput. 15 (1994), 1251{ G. Wahba, Spline models for observational data, SIAM, Philadelphia, Y. Wang and K. T. Fang, A note on uniform distribution and experimental design, Kexue Tongbao (Chinese Sci. Bull.) 26 (1981), 485{ H. Wozniakowski, Average case complexity of multivariate integration, Bull. Amer. Math. Soc. 24 (1991), 185{ S. K. aremba, Some applications of multidimensional integration by parts, Ann. Polon. Math. 21 (1968), 85{96. address: fred@hkbu.edu.hk, Department of Mathematics, Hong Kong Baptist University, Kowloon Tong, Hong Kong
E(s 2 )-OPTIMALITY AND MINIMUM DISCREPANCY IN 2-LEVEL SUPERSATURATED DESIGNS
Statistica Sinica 12(2002), 931-939 E(s 2 )-OPTIMALITY AND MINIMUM DISCREPANCY IN 2-LEVEL SUPERSATURATED DESIGNS Min-Qian Liu and Fred J. Hickernell Tianjin University and Hong Kong Baptist University
More informationA note on optimal foldover design
Statistics & Probability Letters 62 (2003) 245 250 A note on optimal foldover design Kai-Tai Fang a;, Dennis K.J. Lin b, HongQin c;a a Department of Mathematics, Hong Kong Baptist University, Kowloon Tong,
More informationGeneralized Cramér von Mises goodness-of-fit tests for multivariate distributions
Hong Kong Baptist University HKBU Institutional Repository HKBU Staff Publication 009 Generalized Cramér von Mises goodness-of-fit tests for multivariate distributions Sung Nok Chiu Hong Kong Baptist University,
More informationTutorial on quasi-monte Carlo methods
Tutorial on quasi-monte Carlo methods Josef Dick School of Mathematics and Statistics, UNSW, Sydney, Australia josef.dick@unsw.edu.au Comparison: MCMC, MC, QMC Roughly speaking: Markov chain Monte Carlo
More informationAPPLIED MATHEMATICS REPORT AMR04/2 DIAPHONY, DISCREPANCY, SPECTRAL TEST AND WORST-CASE ERROR. J. Dick and F. Pillichshammer
APPLIED MATHEMATICS REPORT AMR4/2 DIAPHONY, DISCREPANCY, SPECTRAL TEST AND WORST-CASE ERROR J. Dick and F. Pillichshammer January, 24 Diaphony, discrepancy, spectral test and worst-case error Josef Dick
More informationLow Discrepancy Sequences in High Dimensions: How Well Are Their Projections Distributed?
Low Discrepancy Sequences in High Dimensions: How Well Are Their Projections Distributed? Xiaoqun Wang 1,2 and Ian H. Sloan 2 1 Department of Mathematical Sciences, Tsinghua University, Beijing 100084,
More informationA PIECEWISE CONSTANT ALGORITHM FOR WEIGHTED L 1 APPROXIMATION OVER BOUNDED OR UNBOUNDED REGIONS IN R s
A PIECEWISE CONSTANT ALGORITHM FOR WEIGHTED L 1 APPROXIMATION OVER BONDED OR NBONDED REGIONS IN R s FRED J. HICKERNELL, IAN H. SLOAN, AND GRZEGORZ W. WASILKOWSKI Abstract. sing Smolyak s construction [5],
More informationFall TMA4145 Linear Methods. Solutions to exercise set 9. 1 Let X be a Hilbert space and T a bounded linear operator on X.
TMA445 Linear Methods Fall 26 Norwegian University of Science and Technology Department of Mathematical Sciences Solutions to exercise set 9 Let X be a Hilbert space and T a bounded linear operator on
More informationComputation Of Asymptotic Distribution. For Semiparametric GMM Estimators. Hidehiko Ichimura. Graduate School of Public Policy
Computation Of Asymptotic Distribution For Semiparametric GMM Estimators Hidehiko Ichimura Graduate School of Public Policy and Graduate School of Economics University of Tokyo A Conference in honor of
More informationRandom and Quasi-Random Point Sets
Peter Hellekalek Gerhard Larcher (Editors) Random and Quasi-Random Point Sets With contributions by JözsefBeck Peter Hellekalek Fred J. Hickemell Gerhard Larcher Pierre L'Ecuyer Harald Niederreiter Shu
More informationReproducing Kernel Hilbert Spaces
9.520: Statistical Learning Theory and Applications February 10th, 2010 Reproducing Kernel Hilbert Spaces Lecturer: Lorenzo Rosasco Scribe: Greg Durrett 1 Introduction In the previous two lectures, we
More informationA theorem on summable families in normed groups. Dedicated to the professors of mathematics. L. Berg, W. Engel, G. Pazderski, and H.- W. Stolle.
Rostock. Math. Kolloq. 49, 51{56 (1995) Subject Classication (AMS) 46B15, 54A20, 54E15 Harry Poppe A theorem on summable families in normed groups Dedicated to the professors of mathematics L. Berg, W.
More informationAPPLIED MATHEMATICS REPORT AMR04/16 FINITE-ORDER WEIGHTS IMPLY TRACTABILITY OF MULTIVARIATE INTEGRATION. I.H. Sloan, X. Wang and H.
APPLIED MATHEMATICS REPORT AMR04/16 FINITE-ORDER WEIGHTS IMPLY TRACTABILITY OF MULTIVARIATE INTEGRATION I.H. Sloan, X. Wang and H. Wozniakowski Published in Journal of Complexity, Volume 20, Number 1,
More informationMath 702 Problem Set 10 Solutions
Math 70 Problem Set 0 Solutions Unless otherwise stated, X is a complex Hilbert space with the inner product h; i the induced norm k k. The null-space range of a linear map T W X! X are denoted by N.T
More informationConstructions of uniform designs by using resolvable packings and coverings
Discrete Mathematics 274 (2004) 25 40 www.elsevier.com/locate/disc Constructions of uniform designs by using resolvable packings and coverings Kai-Tai Fang a, Xuan Lu b, Yu Tang c, Jianxing Yin c; a Department
More informationQuasi-Monte Carlo Methods for Applications in Statistics
Quasi-Monte Carlo Methods for Applications in Statistics Weights for QMC in Statistics Vasile Sinescu (UNSW) Weights for QMC in Statistics MCQMC February 2012 1 / 24 Quasi-Monte Carlo Methods for Applications
More informationEcon 2148, fall 2017 Gaussian process priors, reproducing kernel Hilbert spaces, and Splines
Econ 2148, fall 2017 Gaussian process priors, reproducing kernel Hilbert spaces, and Splines Maximilian Kasy Department of Economics, Harvard University 1 / 37 Agenda 6 equivalent representations of the
More information460 HOLGER DETTE AND WILLIAM J STUDDEN order to examine how a given design behaves in the model g` with respect to the D-optimality criterion one uses
Statistica Sinica 5(1995), 459-473 OPTIMAL DESIGNS FOR POLYNOMIAL REGRESSION WHEN THE DEGREE IS NOT KNOWN Holger Dette and William J Studden Technische Universitat Dresden and Purdue University Abstract:
More informationQuality of Life Analysis. Goodness of Fit Test and Latent Distribution Estimation in the Mixed Rasch Model
Communications in Statistics Theory and Methods, 35: 921 935, 26 Copyright Taylor & Francis Group, LLC ISSN: 361-926 print/1532-415x online DOI: 1.18/36192551445 Quality of Life Analysis Goodness of Fit
More informationReproducing Kernel Hilbert Spaces Class 03, 15 February 2006 Andrea Caponnetto
Reproducing Kernel Hilbert Spaces 9.520 Class 03, 15 February 2006 Andrea Caponnetto About this class Goal To introduce a particularly useful family of hypothesis spaces called Reproducing Kernel Hilbert
More informationPlan of Class 4. Radial Basis Functions with moving centers. Projection Pursuit Regression and ridge. Principal Component Analysis: basic ideas
Plan of Class 4 Radial Basis Functions with moving centers Multilayer Perceptrons Projection Pursuit Regression and ridge functions approximation Principal Component Analysis: basic ideas Radial Basis
More informationFunctional Analysis: Assignment Set # 3 Spring 2009 Professor: Fengbo Hang February 25, 2009
duardo Corona Functional Analysis: Assignment Set # 3 Spring 9 Professor: Fengbo Hang February 5, 9 C6. Show that a norm that satis es the parallelogram identity: comes from a scalar product. kx + yk +
More informationKarhunen-Loève decomposition of Gaussian measures on Banach spaces
Karhunen-Loève decomposition of Gaussian measures on Banach spaces Jean-Charles Croix GT APSSE - April 2017, the 13th joint work with Xavier Bay. 1 / 29 Sommaire 1 Preliminaries on Gaussian processes 2
More informationMATH 829: Introduction to Data Mining and Analysis Support vector machines and kernels
1/12 MATH 829: Introduction to Data Mining and Analysis Support vector machines and kernels Dominique Guillot Departments of Mathematical Sciences University of Delaware March 14, 2016 Separating sets:
More informationNew Multilevel Algorithms Based on Quasi-Monte Carlo Point Sets
New Multilevel Based on Quasi-Monte Carlo Point Sets Michael Gnewuch Institut für Informatik Christian-Albrechts-Universität Kiel 1 February 13, 2012 Based on Joint Work with Jan Baldeaux (UTS Sydney)
More informationA Tilt at TILFs. Rod Nillsen University of Wollongong. This talk is dedicated to Gary H. Meisters
A Tilt at TILFs Rod Nillsen University of Wollongong This talk is dedicated to Gary H. Meisters Abstract In this talk I will endeavour to give an overview of some aspects of the theory of Translation Invariant
More informationOptimal Randomized Algorithms for Integration on Function Spaces with underlying ANOVA decomposition
Optimal Randomized on Function Spaces with underlying ANOVA decomposition Michael Gnewuch 1 University of Kaiserslautern, Germany October 16, 2013 Based on Joint Work with Jan Baldeaux (UTS Sydney) & Josef
More informationKullback-Leibler Designs
Kullback-Leibler Designs Astrid JOURDAN Jessica FRANCO Contents Contents Introduction Kullback-Leibler divergence Estimation by a Monte-Carlo method Design comparison Conclusion 2 Introduction Computer
More informationThe Learning Problem and Regularization Class 03, 11 February 2004 Tomaso Poggio and Sayan Mukherjee
The Learning Problem and Regularization 9.520 Class 03, 11 February 2004 Tomaso Poggio and Sayan Mukherjee About this class Goal To introduce a particularly useful family of hypothesis spaces called Reproducing
More informationTesting for a unit root in an ar(1) model using three and four moment approximations: symmetric distributions
Hong Kong Baptist University HKBU Institutional Repository Department of Economics Journal Articles Department of Economics 1998 Testing for a unit root in an ar(1) model using three and four moment approximations:
More informationRegularization in Reproducing Kernel Banach Spaces
.... Regularization in Reproducing Kernel Banach Spaces Guohui Song School of Mathematical and Statistical Sciences Arizona State University Comp Math Seminar, September 16, 2010 Joint work with Dr. Fred
More informationFunctions of Several Variables
Jim Lambers MAT 419/519 Summer Session 2011-12 Lecture 2 Notes These notes correspond to Section 1.2 in the text. Functions of Several Variables We now generalize the results from the previous section,
More informationECON 7335 INFORMATION, LEARNING AND EXPECTATIONS IN MACRO LECTURE 1: BASICS. 1. Bayes Rule. p(b j A)p(A) p(b)
ECON 7335 INFORMATION, LEARNING AND EXPECTATIONS IN MACRO LECTURE : BASICS KRISTOFFER P. NIMARK. Bayes Rule De nition. Bayes Rule. The probability of event A occurring conditional on the event B having
More informationOn Energy, Discrepancy and Group Invariant Measures on Measurable Subsets of Euclidean Space
On Energy, Discrepancy and Group Invariant Measures on Measurable Subsets of Euclidean Space S. B. Damelin a F. J. Hickernell b D. L. Ragozin c. Zeng d a School of Computational and Applied Mathematics,
More informationFinite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product
Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )
More informationDensity estimators for the convolution of discrete and continuous random variables
Density estimators for the convolution of discrete and continuous random variables Ursula U Müller Texas A&M University Anton Schick Binghamton University Wolfgang Wefelmeyer Universität zu Köln Abstract
More informationSYSTEMS OF ODES. mg sin ( (x)) dx 2 =
SYSTEMS OF ODES Consider the pendulum shown below. Assume the rod is of neglible mass, that the pendulum is of mass m, and that the rod is of length `. Assume the pendulum moves in the plane shown, and
More informationReproducing Kernel Hilbert Spaces
Reproducing Kernel Hilbert Spaces Lorenzo Rosasco 9.520 Class 03 February 12, 2007 About this class Goal To introduce a particularly useful family of hypothesis spaces called Reproducing Kernel Hilbert
More information1. Introduction Over the last three decades a number of model selection criteria have been proposed, including AIC (Akaike, 1973), AICC (Hurvich & Tsa
On the Use of Marginal Likelihood in Model Selection Peide Shi Department of Probability and Statistics Peking University, Beijing 100871 P. R. China Chih-Ling Tsai Graduate School of Management University
More informationON TRACTABILITY OF WEIGHTED INTEGRATION OVER BOUNDED AND UNBOUNDED REGIONS IN R s
MATHEMATICS OF COMPTATION Volume 73, Number 248, Pages 1885 1901 S 0025-5718(04)01624-2 Article electronically published on January 5, 2004 ON TRACTABILITY OF WEIGHTED INTEGRATION OVER BONDED AND NBONDED
More informationFunctional Analysis Exercise Class
Functional Analysis Exercise Class Week: December 4 8 Deadline to hand in the homework: your exercise class on week January 5. Exercises with solutions ) Let H, K be Hilbert spaces, and A : H K be a linear
More informationBERGMAN KERNEL ON COMPACT KÄHLER MANIFOLDS
BERGMAN KERNEL ON COMPACT KÄHLER MANIFOLDS SHOO SETO Abstract. These are the notes to an expository talk I plan to give at MGSC on Kähler Geometry aimed for beginning graduate students in hopes to motivate
More informationADJOINTS, ABSOLUTE VALUES AND POLAR DECOMPOSITIONS
J. OPERATOR THEORY 44(2000), 243 254 c Copyright by Theta, 2000 ADJOINTS, ABSOLUTE VALUES AND POLAR DECOMPOSITIONS DOUGLAS BRIDGES, FRED RICHMAN and PETER SCHUSTER Communicated by William B. Arveson Abstract.
More informationOle Christensen 3. October 20, Abstract. We point out some connections between the existing theories for
Frames and pseudo-inverses. Ole Christensen 3 October 20, 1994 Abstract We point out some connections between the existing theories for frames and pseudo-inverses. In particular, using the pseudo-inverse
More informationA CENTRAL LIMIT THEOREM FOR NESTED OR SLICED LATIN HYPERCUBE DESIGNS
Statistica Sinica 26 (2016), 1117-1128 doi:http://dx.doi.org/10.5705/ss.202015.0240 A CENTRAL LIMIT THEOREM FOR NESTED OR SLICED LATIN HYPERCUBE DESIGNS Xu He and Peter Z. G. Qian Chinese Academy of Sciences
More informationOn the simplest expression of the perturbed Moore Penrose metric generalized inverse
Annals of the University of Bucharest (mathematical series) 4 (LXII) (2013), 433 446 On the simplest expression of the perturbed Moore Penrose metric generalized inverse Jianbing Cao and Yifeng Xue Communicated
More informationEECS 598: Statistical Learning Theory, Winter 2014 Topic 11. Kernels
EECS 598: Statistical Learning Theory, Winter 2014 Topic 11 Kernels Lecturer: Clayton Scott Scribe: Jun Guo, Soumik Chatterjee Disclaimer: These notes have not been subjected to the usual scrutiny reserved
More informationChapter 3 Least Squares Solution of y = A x 3.1 Introduction We turn to a problem that is dual to the overconstrained estimation problems considered s
Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A. Dahleh George Verghese Department of Electrical Engineering and Computer Science Massachuasetts Institute of Technology 1 1 c Chapter
More informationTHE L 2 -HODGE THEORY AND REPRESENTATION ON R n
THE L 2 -HODGE THEORY AND REPRESENTATION ON R n BAISHENG YAN Abstract. We present an elementary L 2 -Hodge theory on whole R n based on the minimization principle of the calculus of variations and some
More informationRECONSTRUCTION OF NUMERICAL DERIVATIVES FROM SCATTERED NOISY DATA. 1. Introduction
RECONSTRUCTION OF NUMERICAL DERIVATIVES FROM SCATTERED NOISY DATA T. WEI, Y. C. HON, AND Y. B. WANG Abstract. Based on the thin plate spline approximation theory, we propose in this paper an efficient
More informationStochastic Processes
Introduction and Techniques Lecture 4 in Financial Mathematics UiO-STK4510 Autumn 2015 Teacher: S. Ortiz-Latorre Stochastic Processes 1 Stochastic Processes De nition 1 Let (E; E) be a measurable space
More informationK. NAGY Now, introduce an orthonormal system on G m called Vilenkin-like system (see [G]). The complex valued functions rk n G m! C are called general
A HARDY{LITTLEWOOD{LIKE INEQUALITY ON TWO{DIMENSIONAL COMPACT TOTALLY DISCONNECTED SPACES K. Nagy Abstract. We prove a Hardy-Littlewood type ineuality with respect to a system called Vilenkin-like system
More informationThe best expert versus the smartest algorithm
Theoretical Computer Science 34 004 361 380 www.elsevier.com/locate/tcs The best expert versus the smartest algorithm Peter Chen a, Guoli Ding b; a Department of Computer Science, Louisiana State University,
More informationLifting the Curse of Dimensionality
Lifting the Curse of Dimensionality Frances Y. Kuo and Ian H. Sloan Introduction Richard Bellman [1] coined the phrase the curse of dimensionality to describe the extraordinarily rapid growth in the difficulty
More informationDigital lattice rules
Digital lattice rules Multivariate integration and discrepancy estimates A thesis presented to The University of New South Wales in fulfilment of the thesis requirement for the degree of Doctor of Philosophy
More informationMonte Carlo Methods for Statistical Inference: Variance Reduction Techniques
Monte Carlo Methods for Statistical Inference: Variance Reduction Techniques Hung Chen hchen@math.ntu.edu.tw Department of Mathematics National Taiwan University 3rd March 2004 Meet at NS 104 On Wednesday
More informationROYAL INSTITUTE OF TECHNOLOGY KUNGL TEKNISKA HÖGSKOLAN. Department of Signals, Sensors & Systems
The Evil of Supereciency P. Stoica B. Ottersten To appear as a Fast Communication in Signal Processing IR-S3-SB-9633 ROYAL INSTITUTE OF TECHNOLOGY Department of Signals, Sensors & Systems Signal Processing
More informationS. Lototsky and B.L. Rozovskii Center for Applied Mathematical Sciences University of Southern California, Los Angeles, CA
RECURSIVE MULTIPLE WIENER INTEGRAL EXPANSION FOR NONLINEAR FILTERING OF DIFFUSION PROCESSES Published in: J. A. Goldstein, N. E. Gretsky, and J. J. Uhl (editors), Stochastic Processes and Functional Analysis,
More informationConvergence Rates of Kernel Quadrature Rules
Convergence Rates of Kernel Quadrature Rules Francis Bach INRIA - Ecole Normale Supérieure, Paris, France ÉCOLE NORMALE SUPÉRIEURE NIPS workshop on probabilistic integration - Dec. 2015 Outline Introduction
More informationGeometry on Probability Spaces
Geometry on Probability Spaces Steve Smale Toyota Technological Institute at Chicago 427 East 60th Street, Chicago, IL 60637, USA E-mail: smale@math.berkeley.edu Ding-Xuan Zhou Department of Mathematics,
More informationVector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis.
Vector spaces DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_fall17/index.html Carlos Fernandez-Granda Vector space Consists of: A set V A scalar
More informationOn the existence of higher order polynomial. lattices with large figure of merit ϱ α.
On the existence of higher order polynomial lattices with large figure of merit Josef Dick a, Peter Kritzer b, Friedrich Pillichshammer c, Wolfgang Ch. Schmid b, a School of Mathematics, University of
More informationConvergence of The Multigrid Method With A Wavelet. Abstract. This new coarse grid operator is constructed using the wavelet
Convergence of The Multigrid Method With A Wavelet Coarse Grid Operator Bjorn Engquist Erding Luo y Abstract The convergence of the two-level multigrid method with a new coarse grid operator is studied.
More informationMath 5520 Homework 2 Solutions
Math 552 Homework 2 Solutions March, 26. Consider the function fx) = 2x ) 3 if x, 3x ) 2 if < x 2. Determine for which k there holds f H k, 2). Find D α f for α k. Solution. We show that k = 2. The formulas
More informationRobust linear optimization under general norms
Operations Research Letters 3 (004) 50 56 Operations Research Letters www.elsevier.com/locate/dsw Robust linear optimization under general norms Dimitris Bertsimas a; ;, Dessislava Pachamanova b, Melvyn
More informationd(x n, x) d(x n, x nk ) + d(x nk, x) where we chose any fixed k > N
Problem 1. Let f : A R R have the property that for every x A, there exists ɛ > 0 such that f(t) > ɛ if t (x ɛ, x + ɛ) A. If the set A is compact, prove there exists c > 0 such that f(x) > c for all x
More informationPRODUCTS OF TOEPLITZ OPERATORS ON THE FOCK SPACE
PRODUCTS OF TOEPLITZ OPERATORS ON THE FOCK SPACE HONG RAE CHO, JONG-DO PARK, AND KEHE ZHU ABSTRACT. Let f and g be functions, not identically zero, in the Fock space F 2 α of. We show that the product
More informationA quasi-separation theorem for LQG optimal control with IQ constraints Andrew E.B. Lim y & John B. Moore z February 1997 Abstract We consider the dete
A quasi-separation theorem for LQG optimal control with IQ constraints Andrew E.B. Lim y & John B. Moore z February 1997 Abstract We consider the deterministic, the full observation and the partial observation
More informationPolarization constant K(n, X) = 1 for entire functions of exponential type
Int. J. Nonlinear Anal. Appl. 6 (2015) No. 2, 35-45 ISSN: 2008-6822 (electronic) http://dx.doi.org/10.22075/ijnaa.2015.252 Polarization constant K(n, X) = 1 for entire functions of exponential type A.
More informationCompanding of Memoryless Sources. Peter W. Moo and David L. Neuho. Department of Electrical Engineering and Computer Science
Optimal Compressor Functions for Multidimensional Companding of Memoryless Sources Peter W. Moo and David L. Neuho Department of Electrical Engineering and Computer Science University of Michigan, Ann
More informationMATH 5640: Fourier Series
MATH 564: Fourier Series Hung Phan, UMass Lowell September, 8 Power Series A power series in the variable x is a series of the form a + a x + a x + = where the coefficients a, a,... are real or complex
More informationBounds on expectation of order statistics from a nite population
Journal of Statistical Planning and Inference 113 (2003) 569 588 www.elsevier.com/locate/jspi Bounds on expectation of order statistics from a nite population N. Balakrishnan a;, C. Charalambides b, N.
More informationGarrett: `Bernstein's analytic continuation of complex powers' 2 Let f be a polynomial in x 1 ; : : : ; x n with real coecients. For complex s, let f
1 Bernstein's analytic continuation of complex powers c1995, Paul Garrett, garrettmath.umn.edu version January 27, 1998 Analytic continuation of distributions Statement of the theorems on analytic continuation
More informationAlternative theorems for nonlinear projection equations and applications to generalized complementarity problems
Nonlinear Analysis 46 (001) 853 868 www.elsevier.com/locate/na Alternative theorems for nonlinear projection equations and applications to generalized complementarity problems Yunbin Zhao a;, Defeng Sun
More informationLecture 2: Review of Prerequisites. Table of contents
Math 348 Fall 217 Lecture 2: Review of Prerequisites Disclaimer. As we have a textbook, this lecture note is for guidance and supplement only. It should not be relied on when preparing for exams. In this
More informationThe heat equation for the Hermite operator on the Heisenberg group
Hokkaido Mathematical Journal Vol. 34 (2005) p. 393 404 The heat equation for the Hermite operator on the Heisenberg group M. W. Wong (Received August 5, 2003) Abstract. We give a formula for the one-parameter
More informationFunctional Analysis Review
Functional Analysis Review Lorenzo Rosasco slides courtesy of Andre Wibisono 9.520: Statistical Learning Theory and Applications September 9, 2013 1 2 3 4 Vector Space A vector space is a set V with binary
More informationEstimating the sample complexity of a multi-class. discriminant model
Estimating the sample complexity of a multi-class discriminant model Yann Guermeur LIP, UMR NRS 0, Universit Paris, place Jussieu, 55 Paris cedex 05 Yann.Guermeur@lip.fr Andr Elissee and H l ne Paugam-Moisy
More informationJ. Cwik and J. Koronacki. Institute of Computer Science, Polish Academy of Sciences. to appear in. Computational Statistics and Data Analysis
A Combined Adaptive-Mixtures/Plug-In Estimator of Multivariate Probability Densities 1 J. Cwik and J. Koronacki Institute of Computer Science, Polish Academy of Sciences Ordona 21, 01-237 Warsaw, Poland
More informationOptimal global rates of convergence for interpolation problems with random design
Optimal global rates of convergence for interpolation problems with random design Michael Kohler 1 and Adam Krzyżak 2, 1 Fachbereich Mathematik, Technische Universität Darmstadt, Schlossgartenstr. 7, 64289
More informationHarmonic Analysis on the Cube and Parseval s Identity
Lecture 3 Harmonic Analysis on the Cube and Parseval s Identity Jan 28, 2005 Lecturer: Nati Linial Notes: Pete Couperus and Neva Cherniavsky 3. Where we can use this During the past weeks, we developed
More information2 M. MEGRELISHVILI AND T. SCARR the locally compact, totally disconnected groups [3]; the symmetric group S 1 on a countably innite set, with the topo
Fundamenta Mathematicae (to appear) THE EQUIVARIANT UNIVERSALITY AND COUNIVERSALITY OF THE CANTOR CUBE MICHAEL G. MEGRELISHVILI AND TZVI SCARR Abstract. Let hg; X; i be a G-space, where G is a non-archimedean
More informationMidterm 1. Every element of the set of functions is continuous
Econ 200 Mathematics for Economists Midterm Question.- Consider the set of functions F C(0, ) dened by { } F = f C(0, ) f(x) = ax b, a A R and b B R That is, F is a subset of the set of continuous functions
More informationKernel Method: Data Analysis with Positive Definite Kernels
Kernel Method: Data Analysis with Positive Definite Kernels 2. Positive Definite Kernel and Reproducing Kernel Hilbert Space Kenji Fukumizu The Institute of Statistical Mathematics. Graduate University
More informationAn introduction to some aspects of functional analysis
An introduction to some aspects of functional analysis Stephen Semmes Rice University Abstract These informal notes deal with some very basic objects in functional analysis, including norms and seminorms
More information12 CHAPTER 1. PRELIMINARIES Lemma 1.3 (Cauchy-Schwarz inequality) Let (; ) be an inner product in < n. Then for all x; y 2 < n we have j(x; y)j (x; x)
1.4. INNER PRODUCTS,VECTOR NORMS, AND MATRIX NORMS 11 The estimate ^ is unbiased, but E(^ 2 ) = n?1 n 2 and is thus biased. An unbiased estimate is ^ 2 = 1 (x i? ^) 2 : n? 1 In x?? we show that the linear
More informationComplexity and regularization issues in kernel-based learning
Complexity and regularization issues in kernel-based learning Marcello Sanguineti Department of Communications, Computer, and System Sciences (DIST) University of Genoa - Via Opera Pia 13, 16145 Genova,
More informationFUNCTIONAL ANALYSIS HAHN-BANACH THEOREM. F (m 2 ) + α m 2 + x 0
FUNCTIONAL ANALYSIS HAHN-BANACH THEOREM If M is a linear subspace of a normal linear space X and if F is a bounded linear functional on M then F can be extended to M + [x 0 ] without changing its norm.
More informationT xi (M) n i. x i b 1xi. x j. h j. x p j b 2x i
Gaussian Random Fields for Statistical Characterization of Brain Submanifolds. Sarang Joshi Department of Radiation Oncology and Biomedical Enginereing University of North Carolina at Chapel Hill Sarang
More informationOn the Behavior of the Weighted Star Discrepancy Bounds for Shifted Lattice Rules
On the Behavior of the Weighted Star Discrepancy Bounds for Shifted Lattice Rules Vasile Sinescu and Pierre L Ecuyer Abstract We examine the question of constructing shifted lattice rules of rank one with
More informationTwo-Step Iteration Scheme for Nonexpansive Mappings in Banach Space
Mathematica Moravica Vol. 19-1 (2015), 95 105 Two-Step Iteration Scheme for Nonexpansive Mappings in Banach Space M.R. Yadav Abstract. In this paper, we introduce a new two-step iteration process to approximate
More informationA MONTE CARLO ALGORITHM FOR WEIGHTED INTEGRATION OVER R d
MATHEMATICS OF COMPUTATION Volume 73, Number 246, Pages 813 825 S 25-5718(3)1564-3 Article electronically published on August 19, 23 A MONTE CARLO ALGORITHM FOR WEIGHTED INTEGRATION OVER R d PIOTR GAJDA,
More informationCONTINUATION METHODS FOR CONTRACTIVE AND NON EXPANSIVE MAPPING (FUNCTION)
CONTINUATION METHODS FOR CONTRACTIVE AND NON EXPANSIVE MAPPING (FUNCTION) Dr.Yogesh Kumar 1, Mr. Shaikh Mohammed Sirajuddin Mohammed Salimuddin 2 1 Associated Professor, Dept.of Mathematics,OPJS University,Churu,
More informationCOS 424: Interacting with Data
COS 424: Interacting with Data Lecturer: Rob Schapire Lecture #14 Scribe: Zia Khan April 3, 2007 Recall from previous lecture that in regression we are trying to predict a real value given our data. Specically,
More informationSHRINKING PROJECTION METHOD FOR A SEQUENCE OF RELATIVELY QUASI-NONEXPANSIVE MULTIVALUED MAPPINGS AND EQUILIBRIUM PROBLEM IN BANACH SPACES
U.P.B. Sci. Bull., Series A, Vol. 76, Iss. 2, 2014 ISSN 1223-7027 SHRINKING PROJECTION METHOD FOR A SEQUENCE OF RELATIVELY QUASI-NONEXPANSIVE MULTIVALUED MAPPINGS AND EQUILIBRIUM PROBLEM IN BANACH SPACES
More informationDyadic diaphony of digital sequences
Dyadic diaphony of digital sequences Friedrich Pillichshammer Abstract The dyadic diaphony is a quantitative measure for the irregularity of distribution of a sequence in the unit cube In this paper we
More informationTRANSLATION INVARIANCE OF FOCK SPACES
TRANSLATION INVARIANCE OF FOCK SPACES KEHE ZHU ABSTRACT. We show that there is only one Hilbert space of entire functions that is invariant under the action of naturally defined weighted translations.
More informationMathematical Institute, University of Utrecht. The problem of estimating the mean of an observed Gaussian innite-dimensional vector
On Minimax Filtering over Ellipsoids Eduard N. Belitser and Boris Y. Levit Mathematical Institute, University of Utrecht Budapestlaan 6, 3584 CD Utrecht, The Netherlands The problem of estimating the mean
More informationHOPF S DECOMPOSITION AND RECURRENT SEMIGROUPS. Josef Teichmann
HOPF S DECOMPOSITION AND RECURRENT SEMIGROUPS Josef Teichmann Abstract. Some results of ergodic theory are generalized in the setting of Banach lattices, namely Hopf s maximal ergodic inequality and the
More informationMax-Planck-Institut fur Mathematik in den Naturwissenschaften Leipzig Uniformly distributed measures in Euclidean spaces by Bernd Kirchheim and David Preiss Preprint-Nr.: 37 1998 Uniformly Distributed
More information