MATH 590: Meshfree Methods
|
|
- Shannon Horn
- 5 years ago
- Views:
Transcription
1 MATH 590: Meshfree Methods Chapter 2 Part 3: Native Space for Positive Definite Kernels Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2014 fasshauer@iit.edu MATH 590 Chapter 2 1
2 Outline 1 Native Spaces for Positive Definite Kernels 2 Examples of Native Spaces for Popular RBFs fasshauer@iit.edu MATH 590 Chapter 2 2
3 In this section we will show that every positive definite kernel can indeed be associated with a reproducing kernel Hilbert space its native space. First, we note that the definition of an RKHS tells us that H K (Ω) contains all functions of the form f = N c j K (, x j ) j=1 provided x j Ω. fasshauer@iit.edu MATH 590 Chapter 2 4
4 Using the properties of RKHSs established earlier along with the form of f just mentioned we have that N N f 2 H K (Ω) = f, f HK (Ω) = c i K (, x i ), c j K (, x j ) = = N i=1 j=1 N i=1 j=1 i=1 j=1 N c i c j K (, x i ), K (, x j ) HK (Ω) N c i c j K (x i, x j ) = c T Kc. H K (Ω) So for these special types of f we can easily calculate the Hilbert space norm of f. In particular, if f = s is a kernel-based interpolant, i.e., c = K 1 y, then we also have s 2 H K (Ω) = y T K T KK 1 y = y T K 1 y. fasshauer@iit.edu MATH 590 Chapter 2 5
5 Therefore, we define the (possibly infinite-dimensional) space of all linear combinations H K (Ω) = span{k (, z) : z Ω} (1) with an associated bilinear form, K given by N M N M c i K (, x i ), d j K (, z j ) = c i d j K (x i, z j ) = c T Kd. i=1 Remark j=1 K i=1 j=1 Note that this definition implies that a general element in H K (Ω) has the form (where N = is allowed) f = N c j K (, x j ). j=1 However, not only the coefficients c j, but also the specific value of N and choice of points x j will vary with f. fasshauer@iit.edu MATH 590 Chapter 2 6
6 Theorem If K : Ω Ω R is a symmetric strictly positive definite kernel, then the bilinear form, K defines an inner product on H K (Ω). Furthermore, H K (Ω) is a pre-hilbert space with reproducing kernel K. Remark A pre-hilbert space is an inner product space whose completion is a Hilbert space. fasshauer@iit.edu MATH 590 Chapter 2 7
7 Proof., K is obviously bilinear and symmetric. We just need to show that f, f K > 0 for nonzero f H K (Ω). Any such f can be written in the form Then N f = c j K (, x j ), x j Ω. j=1 N N f, f K = c i c j K (x i, x j ) > 0 i=1 j=1 since K is strictly positive definite. The reproducing property follows from f, K (, x) K = N c j K (x, x j ) = f (x). j=1 fasshauer@iit.edu MATH 590 Chapter 2 8
8 Since we just showed that H K (Ω) is a pre-hilbert space, i.e., need not be complete, we now first form the completion H K (Ω) of H K (Ω) with respect to the K -norm K ensuring that f K = f HK (Ω) for all f H K (Ω). In general, this completion will consist of equivalence classes of Cauchy sequences in H K (Ω), so that we can obtain the native space N K (Ω) of K as a space of continuous functions with the help of the point evaluation functional (which extends continuously from H K (Ω) to H K (Ω)), i.e., the (values of the) continuous functions in N K (Ω) are given via the right-hand side of δ x (f ) = f, K (, x) K, f H K (Ω). Remark The technical details concerned with this construction are discussed in [Wen05]. fasshauer@iit.edu MATH 590 Chapter 2 9
9 In summary, we now know that the native space N K (Ω) is given by (continuous functions in) the completion of H K (Ω) = span{k (, z) : z Ω} a not very intuitive definition of a function space. In the special case when we are dealing with strictly positive definite (translation invariant) functions Φ(x z) = K (x, z) and when Ω = R d we get a characterization of native spaces in terms of Fourier transforms. We present the following theorem without proof (for details see [Wen05]). fasshauer@iit.edu MATH 590 Chapter 2 10
10 Theorem Suppose Φ C(R d ) L 1 (R d ) is a real-valued strictly positive definite function. Define G = {f L 2 (R d ) C(R d ) : ˆf L 2 (R ˆΦ d )} and equip this space with the bilinear form f, g G = 1 (2π) d ˆf ˆΦ, ĝ L2 (R ˆΦ d ) = 1 (2π) d ˆf (ω)ĝ(ω) R ˆΦ(ω) d dω. Then G is a real Hilbert space with inner product, G and reproducing kernel Φ( ). Hence, G is the native space of Φ on R d, i.e., G = N Φ (R d ) and both inner products coincide. In particular, every f N Φ (R d ) can be recovered from its Fourier transform ˆf L 1 (R d ) L 2 (R d ). fasshauer@iit.edu MATH 590 Chapter 2 11
11 Mercer s theorem allows us to construct the native space/rkhs H K (Ω) for any continuous positive definite kernel K by representing the functions in H K as infinite linear combinations of the eigenfunctions ϕ n of the Hilbert Schmidt integral operator K, i.e., { } H K = f : f = c n ϕ n. Thus the eigenfunctions {ϕ n } n=1 of K provide an alternative basis for H K (Ω) instead of the standard {K (, z) : z Ω}. For any fixed x, the corresponding basis transformation is given by the Mercer series K (, z) = λ n ϕ n ϕ n (z). n=1 n=1 This shows that indeed K (, z) H K (Ω). fasshauer@iit.edu MATH 590 Chapter 2 12
12 The inner product for H K (Ω) can now be written as f, g HK (Ω) = c m ϕ m, d n ϕ n = m=1 n=1 H K (Ω) n=1 where we used the fact that the eigenfunctions are not only L 2 -orthonormal, but also orthogonal in H K (Ω), i.e., ϕ m, ϕ n HK (Ω) = δ mn λm λn. c n d n λ n, fasshauer@iit.edu MATH 590 Chapter 2 13
13 We can also verify that K is indeed the reproducing kernel of H K since the Mercer series of K and the orthogonality of the eigenfunctions imply f, K (, x) HK (Ω) = c m ϕ m, λ n ϕ n ϕ n (x) = = m=1 n=1 n=1 c n λ n ϕ n (x) λ n c n ϕ n (x) n=1 = f (x). H K (Ω) fasshauer@iit.edu MATH 590 Chapter 2 14
14 Finally (cf. [Wen05]), we can also describe the RKHS H K as { } 1 H K (Ω) = f L 2 (Ω) : f, ϕ n λ L2 (Ω) 2 < n with inner product n=1 f, g HK (Ω) = n=1 1 λ n f, ϕ n L2 (Ω) g, ϕ n L2 (Ω), f, g H K (Ω). Remark Since H K (Ω) is a subspace of L 2 (Ω) this latter interpretation corresponds to the identification of the coefficients in the eigenfunction expansion of an f H K (Ω) with the generalized Fourier coefficients of f, i.e., c n = f, ϕ n L2 (Ω). fasshauer@iit.edu MATH 590 Chapter 2 15
15 Examples of Native Spaces for Popular RBFs The theorem characterizing the native spaces of translation invariant functions on all of R d shows that these spaces can be viewed as a generalization of standard Sobolev spaces. For m > d/2 the Sobolev space W2 m can be defined as (see, e.g., [AF03]) W m 2 (Rd ) = {f L 2 (R d ) C(R d ) : ˆf ( )( )m/2 L 2 (R d )}. (2) Remark One also frequently sees the definition W m 2 (Ω) = {f L 2(Ω) C(Ω) : D α f L 2 (Ω) for all α m, α N d }, (3) which applies whenever Ω R d is a bounded domain. fasshauer@iit.edu MATH 590 Chapter 2 17
16 Examples of Native Spaces for Popular RBFs Example Using the notation r = x and modified Bessel functions of the second kind K d/2 β, the Matérn kernels have Fourier transform κ β (r) = K d/2 β(r) r d/2 β, β > d 2, ˆκ β ( ω ) = ( 1 + ω 2) β. So it can immediately be seen that their native space is N K (R d ) = W β 2 (Rd ) with β > d/2, which is why some people refer to the Matérn kernels as Sobolev splines. fasshauer@iit.edu MATH 590 Chapter 2 18
17 Examples of Native Spaces for Popular RBFs The native spaces for Gaussians is rather small. Example According to the Fourier transform characterization of the native space, for Gaussians the Fourier transform of f N Φ (Ω) must decay faster than the Fourier transform of the Gaussian (which is itself a Gaussian). The native space of Gaussians was recently characterized in [FY11] in terms of an (infinite) vector of differential operators. In fact, the native space of Gaussians is contained in the Sobolev space W m 2 (Rd ) for any m. It is known that, even though the native space of Gaussians is small, it contains the important class of so-called band-limited functions, i.e., functions whose Fourier transform is compactly supported. Band-limited functions play an important role in sampling theory. fasshauer@iit.edu MATH 590 Chapter 2 19
18 References I Appendix References [AF03] [FY11] Robert Alexander Adams and John J. F. Fournier, Sobolev Spaces, Academic Press, G. E. Fasshauer and Qi Ye, Reproducing kernels of generalized Sobolev spaces via a Green function approach with distributional operators, Numerische Mathematik 119 (2011), [Wen05] H. Wendland, Scattered Data Approximation, Cambridge Monographs on Applied and Computational Mathematics, vol. 17, Cambridge University Press, fasshauer@iit.edu MATH 590 Chapter 2 20
MATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 7: Conditionally Positive Definite Functions Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH 590 Chapter
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 9: Conditionally Positive Definite Radial Functions Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 14: The Power Function and Native Space Error Estimates Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 33: Adaptive Iteration Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH 590 Chapter 33 1 Outline 1 A
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 33: Adaptive Iteration Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH 590 Chapter 33 1 Outline 1 A
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 5: Completely Monotone and Multiply Monotone Functions Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods The Connection to Green s Kernels Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2014 fasshauer@iit.edu MATH 590 1 Outline 1 Introduction
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 2: Radial Basis Function Interpolation in MATLAB Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH 590
More informationReproducing Kernels of Generalized Sobolev Spaces via a Green Function Approach with Distributional Operators
Noname manuscript No. (will be inserted by the editor) Reproducing Kernels of Generalized Sobolev Spaces via a Green Function Approach with Distributional Operators Gregory E. Fasshauer Qi Ye Abstract
More informationReproducing Kernels of Generalized Sobolev Spaces via a Green Function Approach with Differential Operators
Reproducing Kernels of Generalized Sobolev Spaces via a Green Function Approach with Differential Operators Qi Ye Abstract In this paper we introduce a generalization of the classical L 2 ( )-based Sobolev
More informationRegularization in Reproducing Kernel Banach Spaces
.... Regularization in Reproducing Kernel Banach Spaces Guohui Song School of Mathematical and Statistical Sciences Arizona State University Comp Math Seminar, September 16, 2010 Joint work with Dr. Fred
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 1 Part 3: Radial Basis Function Interpolation in MATLAB Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2014 fasshauer@iit.edu
More informationStability of Kernel Based Interpolation
Stability of Kernel Based Interpolation Stefano De Marchi Department of Computer Science, University of Verona (Italy) Robert Schaback Institut für Numerische und Angewandte Mathematik, University of Göttingen
More informationKernel Method: Data Analysis with Positive Definite Kernels
Kernel Method: Data Analysis with Positive Definite Kernels 2. Positive Definite Kernel and Reproducing Kernel Hilbert Space Kenji Fukumizu The Institute of Statistical Mathematics. Graduate University
More informationSuperconvergence of Kernel-Based Interpolation
Superconvergence of Kernel-Based Interpolation Robert Schaback Georg-August-Universität Göttingen, Institut für Numerische und Angewandte Mathematik, Lotzestraße 16-18, D-37083 Göttingen, Germany Abstract
More informationApproximation by Conditionally Positive Definite Functions with Finitely Many Centers
Approximation by Conditionally Positive Definite Functions with Finitely Many Centers Jungho Yoon Abstract. The theory of interpolation by using conditionally positive definite function provides optimal
More informationKernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt.
SINGAPORE SHANGHAI Vol TAIPEI - Interdisciplinary Mathematical Sciences 19 Kernel-based Approximation Methods using MATLAB Gregory Fasshauer Illinois Institute of Technology, USA Michael McCourt University
More informationApplied and Computational Harmonic Analysis
Appl Comput Harmon Anal 32 (2012) 401 412 Contents lists available at ScienceDirect Applied and Computational Harmonic Analysis wwwelseviercom/locate/acha Multiscale approximation for functions in arbitrary
More informationRKHS, Mercer s theorem, Unbounded domains, Frames and Wavelets Class 22, 2004 Tomaso Poggio and Sayan Mukherjee
RKHS, Mercer s theorem, Unbounded domains, Frames and Wavelets 9.520 Class 22, 2004 Tomaso Poggio and Sayan Mukherjee About this class Goal To introduce an alternate perspective of RKHS via integral operators
More informationMeshfree Approximation Methods with MATLAB
Interdisciplinary Mathematical Sc Meshfree Approximation Methods with MATLAB Gregory E. Fasshauer Illinois Institute of Technology, USA Y f? World Scientific NEW JERSEY LONDON SINGAPORE BEIJING SHANGHAI
More informationMultivariate Interpolation with Increasingly Flat Radial Basis Functions of Finite Smoothness
Multivariate Interpolation with Increasingly Flat Radial Basis Functions of Finite Smoothness Guohui Song John Riddle Gregory E. Fasshauer Fred J. Hickernell Abstract In this paper, we consider multivariate
More informationRadial Basis Functions I
Radial Basis Functions I Tom Lyche Centre of Mathematics for Applications, Department of Informatics, University of Oslo November 14, 2008 Today Reformulation of natural cubic spline interpolation Scattered
More informationCIS 520: Machine Learning Oct 09, Kernel Methods
CIS 520: Machine Learning Oct 09, 207 Kernel Methods Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture They may or may not cover all the material discussed
More informationGreen s Functions: Taking Another Look at Kernel Approximation, Radial Basis Functions and Splines
Green s Functions: Taking Another Look at Kernel Approximation, Radial Basis Functions and Splines Gregory E. Fasshauer Abstract The theories for radial basis functions (RBFs) as well as piecewise polynomial
More information10-701/ Recitation : Kernels
10-701/15-781 Recitation : Kernels Manojit Nandi February 27, 2014 Outline Mathematical Theory Banach Space and Hilbert Spaces Kernels Commonly Used Kernels Kernel Theory One Weird Kernel Trick Representer
More informationKernel B Splines and Interpolation
Kernel B Splines and Interpolation M. Bozzini, L. Lenarduzzi and R. Schaback February 6, 5 Abstract This paper applies divided differences to conditionally positive definite kernels in order to generate
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 4: The Connection to Kriging Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2014 fasshauer@iit.edu MATH 590 Chapter 4 1 Outline
More informationElements of Positive Definite Kernel and Reproducing Kernel Hilbert Space
Elements of Positive Definite Kernel and Reproducing Kernel Hilbert Space Statistical Inference with Reproducing Kernel Hilbert Space Kenji Fukumizu Institute of Statistical Mathematics, ROIS Department
More informationReproducing Kernel Hilbert Spaces
Reproducing Kernel Hilbert Spaces Lorenzo Rosasco 9.520 Class 03 February 11, 2009 About this class Goal To introduce a particularly useful family of hypothesis spaces called Reproducing Kernel Hilbert
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 34: Improving the Condition Number of the Interpolation Matrix Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu
More informationStability constants for kernel-based interpolation processes
Dipartimento di Informatica Università degli Studi di Verona Rapporto di ricerca Research report 59 Stability constants for kernel-based interpolation processes Stefano De Marchi Robert Schaback Dipartimento
More informationReproducing Kernel Hilbert Spaces
Reproducing Kernel Hilbert Spaces Lorenzo Rosasco 9.520 Class 03 February 9, 2011 About this class Goal To introduce a particularly useful family of hypothesis spaces called Reproducing Kernel Hilbert
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Accuracy and Optimality of RKHS Methods Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2014 fasshauer@iit.edu MATH 590 1 Outline 1 Introduction
More informationHilbert Spaces: Infinite-Dimensional Vector Spaces
Hilbert Spaces: Infinite-Dimensional Vector Spaces PHYS 500 - Southern Illinois University October 27, 2016 PHYS 500 - Southern Illinois University Hilbert Spaces: Infinite-Dimensional Vector Spaces October
More informationReproducing Kernel Hilbert Spaces
9.520: Statistical Learning Theory and Applications February 10th, 2010 Reproducing Kernel Hilbert Spaces Lecturer: Lorenzo Rosasco Scribe: Greg Durrett 1 Introduction In the previous two lectures, we
More informationScattered Data Interpolation with Polynomial Precision and Conditionally Positive Definite Functions
Chapter 3 Scattered Data Interpolation with Polynomial Precision and Conditionally Positive Definite Functions 3.1 Scattered Data Interpolation with Polynomial Precision Sometimes the assumption on the
More information1 Continuity Classes C m (Ω)
0.1 Norms 0.1 Norms A norm on a linear space X is a function : X R with the properties: Positive Definite: x 0 x X (nonnegative) x = 0 x = 0 (strictly positive) λx = λ x x X, λ C(homogeneous) x + y x +
More informationDIRECT ERROR BOUNDS FOR SYMMETRIC RBF COLLOCATION
Meshless Methods in Science and Engineering - An International Conference Porto, 22 DIRECT ERROR BOUNDS FOR SYMMETRIC RBF COLLOCATION Robert Schaback Institut für Numerische und Angewandte Mathematik (NAM)
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 6: Scattered Data Interpolation with Polynomial Precision Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu
More informationPositive Definite Kernels: Opportunities and Challenges
Positive Definite Kernels: Opportunities and Challenges Michael McCourt Department of Mathematical and Statistical Sciences University of Colorado, Denver CUNY Mathematics Seminar CUNY Graduate College
More informationReproducing Kernel Hilbert Spaces
Reproducing Kernel Hilbert Spaces Lorenzo Rosasco 9.520 Class 03 February 9, 2011 About this class Goal In this class we continue our journey in the world of RKHS. We discuss the Mercer theorem which gives
More informationData fitting by vector (V,f)-reproducing kernels
Data fitting by vector (V,f-reproducing kernels M-N. Benbourhim to appear in ESAIM.Proc 2007 Abstract In this paper we propose a constructive method to build vector reproducing kernels. We define the notion
More information5.6 Nonparametric Logistic Regression
5.6 onparametric Logistic Regression Dmitri Dranishnikov University of Florida Statistical Learning onparametric Logistic Regression onparametric? Doesnt mean that there are no parameters. Just means that
More informationc Copyright by QI YE
c Copyright by QI YE May 2012 ii ACKNOWLEDGMENT I would like to express my deep and sincere gratitude to my advisor, Prof. Gregory E. Fasshauer of Illinois Institute of Technology IIT). He patiently taught
More informationFinite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product
Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )
More informationLinear Algebra. Paul Yiu. Department of Mathematics Florida Atlantic University. Fall A: Inner products
Linear Algebra Paul Yiu Department of Mathematics Florida Atlantic University Fall 2011 6A: Inner products In this chapter, the field F = R or C. We regard F equipped with a conjugation χ : F F. If F =
More informationA new stable basis for radial basis function interpolation
A new stable basis for radial basis function interpolation Stefano De Marchi and Gabriele Santin Department of Mathematics University of Padua (Italy) Abstract It is well-known that radial basis function
More informationLecture 6 January 21, 2016
MATH 6/CME 37: Applied Fourier Analysis and Winter 06 Elements of Modern Signal Processing Lecture 6 January, 06 Prof. Emmanuel Candes Scribe: Carlos A. Sing-Long, Edited by E. Bates Outline Agenda: Fourier
More informationReproducing Kernel Hilbert Spaces
Reproducing Kernel Hilbert Spaces Lorenzo Rosasco 9.520 Class 03 February 12, 2007 About this class Goal To introduce a particularly useful family of hypothesis spaces called Reproducing Kernel Hilbert
More informationRecent Results for Moving Least Squares Approximation
Recent Results for Moving Least Squares Approximation Gregory E. Fasshauer and Jack G. Zhang Abstract. We describe two experiments recently conducted with the approximate moving least squares (MLS) approximation
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 39: Non-Symmetric RBF Collocation in MATLAB Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH 590 Chapter
More informationKernel Methods. Machine Learning A W VO
Kernel Methods Machine Learning A 708.063 07W VO Outline 1. Dual representation 2. The kernel concept 3. Properties of kernels 4. Examples of kernel machines Kernel PCA Support vector regression (Relevance
More informationKernels MIT Course Notes
Kernels MIT 15.097 Course Notes Cynthia Rudin Credits: Bartlett, Schölkopf and Smola, Cristianini and Shawe-Taylor The kernel trick that I m going to show you applies much more broadly than SVM, but we
More informationKarhunen-Loève decomposition of Gaussian measures on Banach spaces
Karhunen-Loève decomposition of Gaussian measures on Banach spaces Jean-Charles Croix jean-charles.croix@emse.fr Génie Mathématique et Industriel (GMI) First workshop on Gaussian processes at Saint-Etienne
More informationINVERSE AND SATURATION THEOREMS FOR RADIAL BASIS FUNCTION INTERPOLATION
MATHEMATICS OF COMPUTATION Volume 71, Number 238, Pages 669 681 S 0025-5718(01)01383-7 Article electronically published on November 28, 2001 INVERSE AND SATURATION THEOREMS FOR RADIAL BASIS FUNCTION INTERPOLATION
More informationOn Riesz-Fischer sequences and lower frame bounds
On Riesz-Fischer sequences and lower frame bounds P. Casazza, O. Christensen, S. Li, A. Lindner Abstract We investigate the consequences of the lower frame condition and the lower Riesz basis condition
More informationMATH 350: Introduction to Computational Mathematics
MATH 350: Introduction to Computational Mathematics Chapter V: Least Squares Problems Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Spring 2011 fasshauer@iit.edu MATH
More informationMercer s Theorem, Feature Maps, and Smoothing
Mercer s Theorem, Feature Maps, and Smoothing Ha Quang Minh, Partha Niyogi, and Yuan Yao Department of Computer Science, University of Chicago 00 East 58th St, Chicago, IL 60637, USA Department of Mathematics,
More informationKernel Methods for Computational Biology and Chemistry
Kernel Methods for Computational Biology and Chemistry Jean-Philippe Vert Jean-Philippe.Vert@ensmp.fr Centre for Computational Biology Ecole des Mines de Paris, ParisTech Mathematical Statistics and Applications,
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 37: RBF Hermite Interpolation in MATLAB Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH 590 Chapter
More informationYour first day at work MATH 806 (Fall 2015)
Your first day at work MATH 806 (Fall 2015) 1. Let X be a set (with no particular algebraic structure). A function d : X X R is called a metric on X (and then X is called a metric space) when d satisfies
More informationRadial basis functions topics in slides
Radial basis functions topics in 40 +1 slides Stefano De Marchi Department of Mathematics Tullio Levi-Civita University of Padova Napoli, 22nd March 2018 Outline 1 From splines to RBF 2 Error estimates,
More informationA orthonormal basis for Radial Basis Function approximation
A orthonormal basis for Radial Basis Function approximation 9th ISAAC Congress Krakow, August 5-9, 2013 Gabriele Santin, joint work with S. De Marchi Department of Mathematics. Doctoral School in Mathematical
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 1 Part 2: Scattered Data Interpolation in R d Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2014 fasshauer@iit.edu MATH 590 Chapter
More informationENTIRE FUNCTIONS AND COMPLETENESS PROBLEMS. Lecture 3
ENTIRE FUNCTIONS AND COMPLETENESS PROBLEMS A. POLTORATSKI Lecture 3 A version of the Heisenberg Uncertainty Principle formulated in terms of Harmonic Analysis claims that a non-zero measure (distribution)
More informationMIT 9.520/6.860, Fall 2018 Statistical Learning Theory and Applications. Class 04: Features and Kernels. Lorenzo Rosasco
MIT 9.520/6.860, Fall 2018 Statistical Learning Theory and Applications Class 04: Features and Kernels Lorenzo Rosasco Linear functions Let H lin be the space of linear functions f(x) = w x. f w is one
More informationEXAMINATION: MATHEMATICAL TECHNIQUES FOR IMAGE ANALYSIS
EXAMINATION: MATHEMATICAL TECHNIQUES FOR IMAGE ANALYSIS Course code: 8D Date: Thursday April 8 th, Time: 4h 7h Place: AUD 3 Read this first! Write your name and student identification number on each paper
More informationMATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.
MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. Orthogonal sets Let V be a vector space with an inner product. Definition. Nonzero vectors v 1,v
More informationComputational Aspects of Radial Basis Function Approximation
Working title: Topics in Multivariate Approximation and Interpolation 1 K. Jetter et al., Editors c 2005 Elsevier B.V. All rights reserved Computational Aspects of Radial Basis Function Approximation Holger
More informationVectors in Function Spaces
Jim Lambers MAT 66 Spring Semester 15-16 Lecture 18 Notes These notes correspond to Section 6.3 in the text. Vectors in Function Spaces We begin with some necessary terminology. A vector space V, also
More informationKernel Principal Component Analysis
Kernel Principal Component Analysis Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr
More informationBernstein-Szegö Inequalities in Reproducing Kernel Hilbert Spaces ABSTRACT 1. INTRODUCTION
Malaysian Journal of Mathematical Sciences 6(2): 25-36 (202) Bernstein-Szegö Inequalities in Reproducing Kernel Hilbert Spaces Noli N. Reyes and Rosalio G. Artes Institute of Mathematics, University of
More informationWhat is an RKHS? Dino Sejdinovic, Arthur Gretton. March 11, 2014
What is an RKHS? Dino Sejdinovic, Arthur Gretton March 11, 2014 1 Outline Normed and inner product spaces Cauchy sequences and completeness Banach and Hilbert spaces Linearity, continuity and boundedness
More informationMATH 590: Meshfree Methods
MATH 590: Meshfree Methods Chapter 40: Symmetric RBF Collocation in MATLAB Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH 590 Chapter
More informationOrdinary Differential Equations II
Ordinary Differential Equations II February 23 2017 Separation of variables Wave eq. (PDE) 2 u t (t, x) = 2 u 2 c2 (t, x), x2 c > 0 constant. Describes small vibrations in a homogeneous string. u(t, x)
More information1 Math 241A-B Homework Problem List for F2015 and W2016
1 Math 241A-B Homework Problem List for F2015 W2016 1.1 Homework 1. Due Wednesday, October 7, 2015 Notation 1.1 Let U be any set, g be a positive function on U, Y be a normed space. For any f : U Y let
More informationConsistency Estimates for gfd Methods and Selection of Sets of Influence
Consistency Estimates for gfd Methods and Selection of Sets of Influence Oleg Davydov University of Giessen, Germany Localized Kernel-Based Meshless Methods for PDEs ICERM / Brown University 7 11 August
More informationKarhunen-Loève decomposition of Gaussian measures on Banach spaces
Karhunen-Loève decomposition of Gaussian measures on Banach spaces Jean-Charles Croix GT APSSE - April 2017, the 13th joint work with Xavier Bay. 1 / 29 Sommaire 1 Preliminaries on Gaussian processes 2
More informationMATH 532: Linear Algebra
MATH 532: Linear Algebra Chapter 5: Norms, Inner Products and Orthogonality Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Spring 2015 fasshauer@iit.edu MATH 532 1 Outline
More informationKernel Methods. Outline
Kernel Methods Quang Nguyen University of Pittsburgh CS 3750, Fall 2011 Outline Motivation Examples Kernels Definitions Kernel trick Basic properties Mercer condition Constructing feature space Hilbert
More informationBook on Gibbs Phenomenon
Book on Gibbs Phenomenon N. Atreas and C. Karanikas Deparment of Informatics Aristotle University of Thessaloniki 54-124, Thessaloniki, Greece email s: natreas@csd.auth.gr, karanika@csd.auth.gr 2 Chapter
More informationStable Parameterization Schemes for Gaussians
Stable Parameterization Schemes for Gaussians Michael McCourt Department of Mathematical and Statistical Sciences University of Colorado Denver ICOSAHOM 2014 Salt Lake City June 24, 2014 michael.mccourt@ucdenver.edu
More informationSolving the 3D Laplace Equation by Meshless Collocation via Harmonic Kernels
Solving the 3D Laplace Equation by Meshless Collocation via Harmonic Kernels Y.C. Hon and R. Schaback April 9, Abstract This paper solves the Laplace equation u = on domains Ω R 3 by meshless collocation
More informationWavelet Bi-frames with Uniform Symmetry for Curve Multiresolution Processing
Wavelet Bi-frames with Uniform Symmetry for Curve Multiresolution Processing Qingtang Jiang Abstract This paper is about the construction of univariate wavelet bi-frames with each framelet being symmetric.
More informationON DIMENSION-INDEPENDENT RATES OF CONVERGENCE FOR FUNCTION APPROXIMATION WITH GAUSSIAN KERNELS
ON DIMENSION-INDEPENDENT RATES OF CONVERGENCE FOR FUNCTION APPROXIMATION WITH GAUSSIAN KERNELS GREGORY E. FASSHAUER, FRED J. HICKERNELL, AND HENRYK WOŹNIAKOWSKI Abstract. This article studies the problem
More informationA Kernel-based Collocation Method for Elliptic Partial Differential Equations with Random Coefficients
A Kernel-based Collocation Method for Elliptic Partial Differential Equations with Random Coefficients Gregory E. Fasshauer and Qi Ye Abstract This paper is an extension of previous work where we laid
More informationD. Shepard, Shepard functions, late 1960s (application, surface modelling)
Chapter 1 Introduction 1.1 History and Outline Originally, the motivation for the basic meshfree approximation methods (radial basis functions and moving least squares methods) came from applications in
More informationSupport Vector Machines
Wien, June, 2010 Paul Hofmarcher, Stefan Theussl, WU Wien Hofmarcher/Theussl SVM 1/21 Linear Separable Separating Hyperplanes Non-Linear Separable Soft-Margin Hyperplanes Hofmarcher/Theussl SVM 2/21 (SVM)
More informationApproximately dual frames in Hilbert spaces and applications to Gabor frames
Approximately dual frames in Hilbert spaces and applications to Gabor frames Ole Christensen and Richard S. Laugesen October 22, 200 Abstract Approximately dual frames are studied in the Hilbert space
More informationKernel Methods. Jean-Philippe Vert Last update: Jan Jean-Philippe Vert (Mines ParisTech) 1 / 444
Kernel Methods Jean-Philippe Vert Jean-Philippe.Vert@mines.org Last update: Jan 2015 Jean-Philippe Vert (Mines ParisTech) 1 / 444 What we know how to solve Jean-Philippe Vert (Mines ParisTech) 2 / 444
More informationMathematics of Information Spring semester 2018
Communication Technology Laboratory Prof. Dr. H. Bölcskei Sternwartstrasse 7 CH-809 Zürich Mathematics of Information Spring semester 08 Solution to Homework Problem Overcomplete expansion in R a) Consider
More information3. Some tools for the analysis of sequential strategies based on a Gaussian process prior
3. Some tools for the analysis of sequential strategies based on a Gaussian process prior E. Vazquez Computer experiments June 21-22, 2010, Paris 21 / 34 Function approximation with a Gaussian prior Aim:
More information5 Compact linear operators
5 Compact linear operators One of the most important results of Linear Algebra is that for every selfadjoint linear map A on a finite-dimensional space, there exists a basis consisting of eigenvectors.
More informationKernels A Machine Learning Overview
Kernels A Machine Learning Overview S.V.N. Vishy Vishwanathan vishy@axiom.anu.edu.au National ICT of Australia and Australian National University Thanks to Alex Smola, Stéphane Canu, Mike Jordan and Peter
More informationNumerical Integration in Meshfree Methods
Numerical Integration in Meshfree Methods Pravin Madhavan New College University of Oxford A thesis submitted for the degree of Master of Science in Mathematical Modelling and Scientific Computing Trinity
More informationMINIMAL DEGREE UNIVARIATE PIECEWISE POLYNOMIALS WITH PRESCRIBED SOBOLEV REGULARITY
MINIMAL DEGREE UNIVARIATE PIECEWISE POLYNOMIALS WITH PRESCRIBED SOBOLEV REGULARITY Amal Al-Rashdan & Michael J. Johnson* Department of Mathematics Kuwait University P.O. Box: 5969 Safat 136 Kuwait yohnson1963@hotmail.com*
More informationA Posteriori Error Bounds for Meshless Methods
A Posteriori Error Bounds for Meshless Methods Abstract R. Schaback, Göttingen 1 We show how to provide safe a posteriori error bounds for numerical solutions of well-posed operator equations using kernel
More informationA note on SVM estimators in RKHS for the deconvolution problem
Communications for Statistical Applications and Methods 26, Vol. 23, No., 7 83 http://dx.doi.org/.535/csam.26.23..7 Print ISSN 2287-7843 / Online ISSN 2383-4757 A note on SVM estimators in RKHS for the
More informationAnalysis Preliminary Exam Workshop: Hilbert Spaces
Analysis Preliminary Exam Workshop: Hilbert Spaces 1. Hilbert spaces A Hilbert space H is a complete real or complex inner product space. Consider complex Hilbert spaces for definiteness. If (, ) : H H
More informationChapter 5 A priori error estimates for nonconforming finite element approximations 5.1 Strang s first lemma
Chapter 5 A priori error estimates for nonconforming finite element approximations 51 Strang s first lemma We consider the variational equation (51 a(u, v = l(v, v V H 1 (Ω, and assume that the conditions
More information