Quadrature using sparse grids on products of spheres

Size: px
Start display at page:

Download "Quadrature using sparse grids on products of spheres"

Transcription

1 Quadrature using sparse grids on products of spheres Paul Leopardi Mathematical Sciences Institute, Australian National University. For presentation at ANZIAM NSW/ACT Annual Meeting, Batemans Bay. Joint work with Markus Hegland, ANU. December 2009

2 Topics Weighted tensor product spaces on spheres Component-by-component construction Weighted tensor product quadrature Numerical results Accomplishments and next steps

3 Weighted tensor product spaces on spheres A product of two circles is a torus... ( Torus cycles - Wikipedia, 2005)

4 Weighted tensor product spaces on spheres Polynomials on the unit sphere Sphere S 2 := {x R 3 3 k=1 x2 k = 1}. P µ : spherical polynomials of degree at most µ. H l : spherical harmonics of degree l, dimension 2l + 1. P µ = µ l=0 H l has spherical harmonic basis {Y l,k l 0... µ, k l + 1}.

5 Weighted tensor product spaces on spheres Reproducing kernel Hilbert space H on X A reproducing kernel Hibert space H of real functions on a manifold X is a Hilbert space with inner product, and a kernel K : X X R, such that for all x X, if k x is defined by k x (y) := K(x, y) for all y X, then k x H and k x, f = f(x) for all f H.

6 Weighted tensor product spaces on spheres KS function space H (r) 1,γ on a single sphere For f L 2 (S 2 ), f(x) 2l+1 ˆf l=0 k=1 l,k Y l,k (x). For positive weight γ, Reproducing Kernel Hilbert Space H (r) 1,γ := {f : S2 R f 1,γ < }, where f 1,γ := f, f 1/2 γ and f, g 1,γ := ˆf 0,0 ĝ 0,0 + γ 1 (Kuo and Sloan, 2005) 2l+1 l=1 k=1 ( l(l + 1) )r ˆf l,k ĝ l,k.

7 Weighted tensor product spaces on spheres Reproducing kernel of H (r) 1,γ This is K (r) 1,γ (x, y) := 1 + γa r(x y), where for z [ 1, 1], 2l + 1 A r (z) := ( ) r P l (z), l(l + 1) l=1 where P is a Legendre polynomial. (Kuo and Sloan, 2005)

8 Weighted tensor product spaces on spheres The weighted tensor product space H (r) d,γ For γ := (γ 1,..., γ d ), on (S 2 ) d define the tensor product space H (r) d,γ := d j=1 H(r) 1,γ j. Reproducing kernel of H (r) d,γ is K d,γ (x, y) := d j=1 K (r) 1,γ j (x j, y j ) = d ( 1 + γj A r (x j y j ) ). j=1 (Kuo and Sloan, 2005)

9 Weighted tensor product spaces on spheres Equal weight quadrature error on H (r) d,γ Worst case error of equal weight quadrature Q m,d with m points: e 2 m,d (Q m,d) := sup f H (r) d,γ ((I Q m,d )f) 2 = m m K m 2 d,γ (x i, x h ) = m 2 m E(e 2 m,d ) = 1 ( 1 + m (Kuo and Sloan, 2005) i=1 h=1 m i=1 h=1 j=1 d ( 1 + γj A r (x i,j x h,j ) ), d ( 1 + γj A r (1) )) j=1 1 m exp ( A r (1) d ) γ j. j=1

10 Component-by-component construction Spherical designs on S 2 A spherical design of strength t on S 2 is an equal weight quadrature rule Q with m points (x 1,..., x m ), Qf := m k=1 f(x k), such that, for all p P t (S 2 ), Q p = p(y) dω(y)/ S 2. S 2 The linear programming bounds give t = O(m 1/2 ). Spherical designs of strength t are known to exist for m = O(t 3 ) and conjectured for m = (t + 1) 2. Spherical t -designs have recently been found numerically for m (t + 1) 2 /2 + O(1) for t up to 126. (Delsarte, Goethals and Seidel, 1977; Hardin and Sloane, 1996; Chen and Womersley, 2006; Womersley, 2008)

11 Component-by-component construction Construction using permutations The idea of Hesse, Kuo and Sloan, 2007 for quadrature on (S 2 ) d is to use a spherical design z = (z 1,..., z m ) of strength t for the first sphere and then successively permute the points of the design to obtain the coordinates for each subsequent sphere. The algorithm chooses permutations Π 1,..., Π d : 1... m 1... m, giving x i = (z Π1 (i),..., z Πd (i)) to ensure that the resulting squared worst case quadrature error is better than the average E(e 2 m,d ). (Hesse, Kuo and Sloan, 2007)

12 Component-by-component construction Error estimate for permutation construction Hesse, Kuo and Sloan prove that if (z 1,..., z m ) is a spherical t -design with m = O(t 2 ) or if r > 3/2 and m = O(t 3 ) for t large enough, then D 2 m := e2 m,1 γ1 =1 = 1 m 2 m A r(1) m. i=1 h=1 m A r (z Πj (i) z Πj (h)) This ensures that for m large enough, Mm,d 2, the average squared worst case error over all permutations, satisfies M 2 m,d E(e2 m,d ). (Hesse, Kuo and Sloan, 2007)

13 Weighted tensor product quadrature Weighted Korobov spaces Consider s = 1. H (1,r) 1,γ is a RKHS on the unit circle S 1, H (1,r) d,γ is a RKHS on the d -torus. This is a weighted Korobov space of periodic functions on [0, 2π) d. The Hesse, Kuo and Sloan construction in these spaces gives a rule with the same 1-dimensional projection properties as a lattice rule: the points are equally spaced. (Wasilkowski and Woźniakowski, 1999; Hesse, Kuo and Sloan, 2007)

14 Weighted tensor product quadrature The Smolyak construction on S 1 The Smolyak construction and variants have been well studied on unweighted and weighted Korobov spaces. Smolyak construction (unweighted case): For H (1,r) 1,1, define Q 1, 1 := 0 and define a sequence of equal weight rules Q 1,0, Q 1,1,... on [0, 2π), exact for trigonometric polynomials of degree t 0 = 0 < t 1 <.... Define q := Q 1,q Q 1,q 1 and for H (1,r) d,1, define Q d,q := 0 a a d q a1... ad. (Smolyak, 1963; Wasilkowski and Woźniakowski, 1995; Gerstner and Griebel, 1998)

15 Weighted tensor product quadrature The WTP variant of Smolyak on H (1,r) d,γ The WTP algorithm of Wasilkowski and Woźniakowski (1999) generalizes Smolyak by treating spaces of non-periodic functions, by allowing optimal weights, and by allowing other choices for the index sets a. For H (1,r) d,γ, define W d,n := a P n,d (γ) a1... ad, where P 1,d (γ) P 2,d (γ) N d, P n,d (γ) = n. W and W (1999) suggests to define P n,d (γ) by including the n rules a1... ad with largest norm. (Wasilkowski and Woźniakowski, 1999)

16 Weighted tensor product quadrature Optimal weight for one quadrature point (Illustration by Osborn, 2009)

17 Weighted tensor product quadrature Optimal weights for two quadrature points (Illustration by Osborn, 2009)

18 Weighted tensor product quadrature WTP rules using spherical designs For H (r) d,γ we can define a WTP rule based on spherical designs. Define a sequence of optimal weight rules Q 0, Q 1,... using unions of spherical designs of increasing strength t 0 = 0 < t 1 <... and cardinality m 0 = 1 < m 1 <.... The WTP construction then proceeds similarly to S 1. One difference between S 1 and S 2 is that the spherical designs themselves cannot be nested in general. (Wasilkowski and Woźniakowski, 1999)

19 Weighted tensor product quadrature Generic WTP algorithm for S 2 1. Begin with a sequence of spherical designs X 1, X 2,... X L, with increasing cardinality, nondecreasing strength. 2. For each h, form the optimal weight rule Q h from the point set h i=1 X i, and the difference rule h = Q h Q h Form products of the difference rules and rank them in decreasing norm (possibly weighted by the number of additional points). 4. Form WTP rules by adding product difference rules in rank order.

20 Numerical results The Hesse, Kuo and Sloan example space In Hesse, Kuo and Sloan, a numerical example is given with r = 3, γ j = 0.9 j. In other words, K d,γ (x, y) := where A 3 (z) = d j=1 l=1 K (3) 1,0.9 j (x j, y j ) = 2l + 1 ( l(l + 1) ) 3 P l (z). d ( j A 3 (x j y j ) ), j=1

21 Numerical results Error of WTP rule for S Error Error 2 Error 4 Error 8 Error Points

22 Numerical results Estimated upper bound of error of WTP rule log 10 error WTP algorithm: Upper bound on cost of given error: d=2 k, p γ =0.001, ν= log 10 cost

23 Numerical results Comparisons for 441, 961 and 2601 points 1.0 Worst case error of WTP for fixed number of points 0.8 Error HKS Dimension

24 Numerical results Weights for two quadrature points reconsidered (Illustration by Osborn, 2009)

25 Accomplishments and next steps Accomplishments Formulation of WTP algorithm for products of S 2. Implementation of WTP algorithm. Numerical results for d to 30 and up to points. Estimate for upper bound of error of WTP rule.

26 Accomplishments and next steps To do More error estimates for WTP rules. Lower bounds on error; initial rate of convergence. Improvement of WTP algorithm to obtain better initial rate of convergence. Best rate of increase of strength of spherical designs. Should it double very step? Best index sets. What is the best way to take weights into account? More numerical experiments.

Quadrature using sparse grids on products of spheres

Quadrature using sparse grids on products of spheres Quadrature using sparse grids on products of spheres Paul Leopardi Mathematical Sciences Institute, Australian National University. For presentation at 3rd Workshop on High-Dimensional Approximation UNSW,

More information

Sparse grid quadrature on products of spheres

Sparse grid quadrature on products of spheres Sparse grid quadrature on products of spheres Markus Hegland a, Paul Leopardi a, a Centre for Mathematics and its Applications, Australian National University. Abstract This paper examines sparse grid

More information

Polynomial interpolation on the sphere, reproducing kernels and random matrices

Polynomial interpolation on the sphere, reproducing kernels and random matrices Polynomial interpolation on the sphere, reproducing kernels and random matrices Paul Leopardi Mathematical Sciences Institute, Australian National University. For presentation at MASCOS Workshop on Stochastics

More information

QMC designs and covering of spheres by spherical caps

QMC designs and covering of spheres by spherical caps QMC designs and covering of spheres by spherical caps Ian H. Sloan University of New South Wales, Sydney, Australia Joint work with Johann Brauchart, Josef Dick, Ed Saff (Vanderbilt), Rob Womersley and

More information

Optimal Randomized Algorithms for Integration on Function Spaces with underlying ANOVA decomposition

Optimal Randomized Algorithms for Integration on Function Spaces with underlying ANOVA decomposition Optimal Randomized on Function Spaces with underlying ANOVA decomposition Michael Gnewuch 1 University of Kaiserslautern, Germany October 16, 2013 Based on Joint Work with Jan Baldeaux (UTS Sydney) & Josef

More information

Quasi-Monte Carlo Methods for Applications in Statistics

Quasi-Monte Carlo Methods for Applications in Statistics Quasi-Monte Carlo Methods for Applications in Statistics Weights for QMC in Statistics Vasile Sinescu (UNSW) Weights for QMC in Statistics MCQMC February 2012 1 / 24 Quasi-Monte Carlo Methods for Applications

More information

Spherical designs with close to the minimal number of points 1

Spherical designs with close to the minimal number of points 1 Spherical designs with close to the minimal number of points Robert S. Womersley School of Mathematics and Statistics, University of New South Wales, Sydney, NSW, 05, Australia Abstract In this paper we

More information

Lattice rules and sequences for non periodic smooth integrands

Lattice rules and sequences for non periodic smooth integrands Lattice rules and sequences for non periodic smooth integrands dirk.nuyens@cs.kuleuven.be Department of Computer Science KU Leuven, Belgium Joint work with Josef Dick (UNSW) and Friedrich Pillichshammer

More information

Progress in high-dimensional numerical integration and its application to stochastic optimization

Progress in high-dimensional numerical integration and its application to stochastic optimization Progress in high-dimensional numerical integration and its application to stochastic optimization W. Römisch Humboldt-University Berlin Department of Mathematics www.math.hu-berlin.de/~romisch Short course,

More information

On Infinite-Dimensional Integration in Weighted Hilbert Spaces

On Infinite-Dimensional Integration in Weighted Hilbert Spaces On Infinite-Dimensional Integration in Weighted Hilbert Spaces Sebastian Mayer Universität Bonn Joint work with M. Gnewuch (UNSW Sydney) and K. Ritter (TU Kaiserslautern). HDA 2013, Canberra, Australia.

More information

Efficient Spherical Designs with Good Geometric Properties

Efficient Spherical Designs with Good Geometric Properties Efficient Spherical Designs with Good Geometric Properties Rob Womersley, R.Womersley@unsw.edu.au School of Mathematics and Statistics, University of New South Wales 45-design with N = 1059 and symmetrtic

More information

Low-discrepancy point sets lifted to the unit sphere

Low-discrepancy point sets lifted to the unit sphere Low-discrepancy point sets lifted to the unit sphere Johann S. Brauchart School of Mathematics and Statistics, UNSW MCQMC 2012 (UNSW) February 17 based on joint work with Ed Saff (Vanderbilt) and Josef

More information

Lifting the Curse of Dimensionality

Lifting the Curse of Dimensionality Lifting the Curse of Dimensionality Frances Y. Kuo and Ian H. Sloan Introduction Richard Bellman [1] coined the phrase the curse of dimensionality to describe the extraordinarily rapid growth in the difficulty

More information

Tutorial on quasi-monte Carlo methods

Tutorial on quasi-monte Carlo methods Tutorial on quasi-monte Carlo methods Josef Dick School of Mathematics and Statistics, UNSW, Sydney, Australia josef.dick@unsw.edu.au Comparison: MCMC, MC, QMC Roughly speaking: Markov chain Monte Carlo

More information

Generated sets as sampling schemes for hyperbolic cross trigonometric polynomials

Generated sets as sampling schemes for hyperbolic cross trigonometric polynomials Generated sets as sampling schemes for hyperbolic cross trigonometric polynomials Lutz Kämmerer Chemnitz University of Technology joint work with S. Kunis and D. Potts supported by DFG-SPP 1324 1 / 16

More information

Efficient Algorithms for the Computation of Optimal Quadrature Points on Riemannian Manifolds

Efficient Algorithms for the Computation of Optimal Quadrature Points on Riemannian Manifolds Efficient Algorithms for the Computation of Optimal Quadrature Points on Riemannian Manifolds Inaugural Dissertation zur Erlangung des Akademischen Grades Doktor eines Wissenschaftszweiges doctor rerum

More information

arxiv: v3 [math.na] 18 Sep 2016

arxiv: v3 [math.na] 18 Sep 2016 Infinite-dimensional integration and the multivariate decomposition method F. Y. Kuo, D. Nuyens, L. Plaskota, I. H. Sloan, and G. W. Wasilkowski 9 September 2016 arxiv:1501.05445v3 [math.na] 18 Sep 2016

More information

Approximate Fekete points and discrete Leja points based on equal area partitions of the unit sphere

Approximate Fekete points and discrete Leja points based on equal area partitions of the unit sphere Approximate Fekete points and discrete Leja points based on equal area partitions of the unit sphere Paul Leopardi Mathematical Sciences Institute, Australian National University. For presentation at Computational

More information

Exponential Convergence and Tractability of Multivariate Integration for Korobov Spaces

Exponential Convergence and Tractability of Multivariate Integration for Korobov Spaces Exponential Convergence and Tractability of Multivariate Integration for Korobov Spaces Josef Dick, Gerhard Larcher, Friedrich Pillichshammer and Henryk Woźniakowski March 12, 2010 Abstract In this paper

More information

Spherical t ɛ -Design for Numerical Approximations on the Sphere, I

Spherical t ɛ -Design for Numerical Approximations on the Sphere, I Spherical t ɛ -Design for Numerical Approximations on the Sphere, I Xiaojun Chen Department of Applied Mathematics The Hong Kong Polytechnic University April 2015, Shanghai Jiaotong University X. Chen

More information

Orthogonal Polynomials, Quadratures & Sparse-Grid Methods for Probability Integrals

Orthogonal Polynomials, Quadratures & Sparse-Grid Methods for Probability Integrals 1/33 Orthogonal Polynomials, Quadratures & Sparse-Grid Methods for Probability Integrals Dr. Abebe Geletu May, 2010 Technische Universität Ilmenau, Institut für Automatisierungs- und Systemtechnik Fachgebiet

More information

Integration of permutation-invariant. functions

Integration of permutation-invariant. functions permutation-invariant Markus Weimar Philipps-University Marburg Joint work with Dirk Nuyens and Gowri Suryanarayana (KU Leuven, Belgium) MCQMC2014, Leuven April 06-11, 2014 un Outline Permutation-invariant

More information

Local radial basis function approximation on the sphere

Local radial basis function approximation on the sphere Local radial basis function approximation on the sphere Kerstin Hesse and Q. T. Le Gia School of Mathematics and Statistics, The University of New South Wales, Sydney NSW 05, Australia April 30, 007 Abstract

More information

New Multilevel Algorithms Based on Quasi-Monte Carlo Point Sets

New Multilevel Algorithms Based on Quasi-Monte Carlo Point Sets New Multilevel Based on Quasi-Monte Carlo Point Sets Michael Gnewuch Institut für Informatik Christian-Albrechts-Universität Kiel 1 February 13, 2012 Based on Joint Work with Jan Baldeaux (UTS Sydney)

More information

Interpolation lattices for hyperbolic cross trigonometric polynomials

Interpolation lattices for hyperbolic cross trigonometric polynomials Interpolation lattices for hyperbolic cross trigonometric polynomials Lutz Kämmerer a, Stefan Kunis b, Daniel Potts a a Chemnitz University of Technology, Faculty of Mathematics, 09107 Chemnitz, Germany

More information

APPLIED MATHEMATICS REPORT AMR04/2 DIAPHONY, DISCREPANCY, SPECTRAL TEST AND WORST-CASE ERROR. J. Dick and F. Pillichshammer

APPLIED MATHEMATICS REPORT AMR04/2 DIAPHONY, DISCREPANCY, SPECTRAL TEST AND WORST-CASE ERROR. J. Dick and F. Pillichshammer APPLIED MATHEMATICS REPORT AMR4/2 DIAPHONY, DISCREPANCY, SPECTRAL TEST AND WORST-CASE ERROR J. Dick and F. Pillichshammer January, 24 Diaphony, discrepancy, spectral test and worst-case error Josef Dick

More information

A PIECEWISE CONSTANT ALGORITHM FOR WEIGHTED L 1 APPROXIMATION OVER BOUNDED OR UNBOUNDED REGIONS IN R s

A PIECEWISE CONSTANT ALGORITHM FOR WEIGHTED L 1 APPROXIMATION OVER BOUNDED OR UNBOUNDED REGIONS IN R s A PIECEWISE CONSTANT ALGORITHM FOR WEIGHTED L 1 APPROXIMATION OVER BONDED OR NBONDED REGIONS IN R s FRED J. HICKERNELL, IAN H. SLOAN, AND GRZEGORZ W. WASILKOWSKI Abstract. sing Smolyak s construction [5],

More information

Tractability of Multivariate Problems

Tractability of Multivariate Problems Erich Novak University of Jena Chemnitz, Summer School 2010 1 Plan for the talk Example: approximation of C -functions What is tractability? Tractability by smoothness? Tractability by sparsity, finite

More information

STRONG TRACTABILITY OF MULTIVARIATE INTEGRATION USING QUASI MONTE CARLO ALGORITHMS

STRONG TRACTABILITY OF MULTIVARIATE INTEGRATION USING QUASI MONTE CARLO ALGORITHMS MATHEMATICS OF COMPUTATION Volume 72, Number 242, Pages 823 838 S 0025-5718(02)01440-0 Article electronically published on June 25, 2002 STRONG TRACTABILITY OF MULTIVARIATE INTEGRATION USING QUASI MONTE

More information

An intractability result for multiple integration. I.H.Sloan y and H.Wozniakowski yy. University of New South Wales. Australia.

An intractability result for multiple integration. I.H.Sloan y and H.Wozniakowski yy. University of New South Wales. Australia. An intractability result for multiple integration I.H.Sloan y and H.Wozniakowski yy Columbia University Computer Science Technical Report CUCS-019-96 y School of Mathematics University of ew South Wales

More information

Solving the 3D Laplace Equation by Meshless Collocation via Harmonic Kernels

Solving the 3D Laplace Equation by Meshless Collocation via Harmonic Kernels Solving the 3D Laplace Equation by Meshless Collocation via Harmonic Kernels Y.C. Hon and R. Schaback April 9, Abstract This paper solves the Laplace equation u = on domains Ω R 3 by meshless collocation

More information

Spherical designs and some generalizations : An overview

Spherical designs and some generalizations : An overview Spherical designs and some generalizations : An overview Eiichi Bannai Shanghai Jiao Tong University 2015 April 21 Workshop on spherical designs and numerical analysis Shanghai, China Spherical t-designs

More information

What s new in high-dimensional integration? designing for applications

What s new in high-dimensional integration? designing for applications What s new in high-dimensional integration? designing for applications Ian H. Sloan i.sloan@unsw.edu.au The University of New South Wales UNSW Australia ANZIAM NSW/ACT, November, 2015 The theme High dimensional

More information

A Belgian view on lattice rules

A Belgian view on lattice rules A Belgian view on lattice rules Ronald Cools Dept. of Computer Science, KU Leuven Linz, Austria, October 14 18, 2013 Atomium Brussels built in 1958 height 103m figure = 2e coin 5 10 6 in circulation Body

More information

Adapting quasi-monte Carlo methods to simulation problems in weighted Korobov spaces

Adapting quasi-monte Carlo methods to simulation problems in weighted Korobov spaces Adapting quasi-monte Carlo methods to simulation problems in weighted Korobov spaces Christian Irrgeher joint work with G. Leobacher RICAM Special Semester Workshop 1 Uniform distribution and quasi-monte

More information

Stat542 (F11) Statistical Learning. First consider the scenario where the two classes of points are separable.

Stat542 (F11) Statistical Learning. First consider the scenario where the two classes of points are separable. Linear SVM (separable case) First consider the scenario where the two classes of points are separable. It s desirable to have the width (called margin) between the two dashed lines to be large, i.e., have

More information

A continuous minimax problem for calculating minimum norm polynomial interpolation points on the sphere

A continuous minimax problem for calculating minimum norm polynomial interpolation points on the sphere ANZIAM J. 42 (E) ppc1536 C1557, 2000 C1536 A continuous minimax problem for calculating minimum norm polynomial interpolation points on the sphere Robert S. Womersley (Received 7 August 2000) Abstract

More information

ANOVA decomposition of convex piecewise linear functions

ANOVA decomposition of convex piecewise linear functions ANOVA decomposition of convex piecewise linear functions W. Römisch Abstract Piecewise linear convex functions arise as integrands in stochastic programs. They are Lipschitz continuous on their domain,

More information

Discrete Projection Methods for Integral Equations

Discrete Projection Methods for Integral Equations SUB Gttttingen 7 208 427 244 98 A 5141 Discrete Projection Methods for Integral Equations M.A. Golberg & C.S. Chen TM Computational Mechanics Publications Southampton UK and Boston USA Contents Sources

More information

c 2010 Society for Industrial and Applied Mathematics

c 2010 Society for Industrial and Applied Mathematics SIAM J. NUMER. ANAL. Vol. 48, No. 6, pp. 2135 2157 c 2010 Society for Industrial and Applied Mathematics WELL CONDITIONED SPHERICAL DESIGNS FOR INTEGRATION AND INTERPOLATION ON THE TWO-SPHERE CONGPEI AN,

More information

On positive positive-definite functions and Bochner s Theorem

On positive positive-definite functions and Bochner s Theorem On positive positive-definite functions and Bochner s Theorem Aicke Hinrichs Mathematisches Institut, Universität Jena Ernst-Abbe-Platz, 07740 Jena, Germany email: a.hinrichs@uni-jena.de Jan Vybíral RICAM,

More information

Chapter 4: Modelling

Chapter 4: Modelling Chapter 4: Modelling Exchangeability and Invariance Markus Harva 17.10. / Reading Circle on Bayesian Theory Outline 1 Introduction 2 Models via exchangeability 3 Models via invariance 4 Exercise Statistical

More information

On lower bounds for integration of multivariate permutation-invariant functions

On lower bounds for integration of multivariate permutation-invariant functions On lower bounds for of multivariate permutation-invariant functions Markus Weimar Philipps-University Marburg Oberwolfach October 2013 Research supported by Deutsche Forschungsgemeinschaft DFG (DA 360/19-1)

More information

Stochastic optimization, multivariate numerical integration and Quasi-Monte Carlo methods. W. Römisch

Stochastic optimization, multivariate numerical integration and Quasi-Monte Carlo methods. W. Römisch Stochastic optimization, multivariate numerical integration and Quasi-Monte Carlo methods W. Römisch Humboldt-University Berlin Institute of Mathematics www.math.hu-berlin.de/~romisch Chemnitzer Mathematisches

More information

MIT 9.520/6.860, Fall 2018 Statistical Learning Theory and Applications. Class 04: Features and Kernels. Lorenzo Rosasco

MIT 9.520/6.860, Fall 2018 Statistical Learning Theory and Applications. Class 04: Features and Kernels. Lorenzo Rosasco MIT 9.520/6.860, Fall 2018 Statistical Learning Theory and Applications Class 04: Features and Kernels Lorenzo Rosasco Linear functions Let H lin be the space of linear functions f(x) = w x. f w is one

More information

Low Discrepancy Sequences in High Dimensions: How Well Are Their Projections Distributed?

Low Discrepancy Sequences in High Dimensions: How Well Are Their Projections Distributed? Low Discrepancy Sequences in High Dimensions: How Well Are Their Projections Distributed? Xiaoqun Wang 1,2 and Ian H. Sloan 2 1 Department of Mathematical Sciences, Tsinghua University, Beijing 100084,

More information

Liberating the Dimension for Function Approximation and Integration

Liberating the Dimension for Function Approximation and Integration Liberating the Dimension for Function Approximation and Integration G W Wasilkowski Abstract We discuss recent results on the complexity and tractability of problems dealing with -variate functions Such

More information

Extremal systems of points and numerical integration on the sphere

Extremal systems of points and numerical integration on the sphere Advances in Computational Mathematics 21: 107 125, 2004. 2004 Kluwer Academic Publishers. Printed in the Netherlands. Extremal systems of points and numerical integration on the sphere Ian H. Sloan and

More information

Scenario generation Contents

Scenario generation Contents Scenario generation W. Römisch Humboldt-University Berlin Department of Mathematics www.math.hu-berlin.de/~romisch Page 1 of 39 Tutorial, ICSP12, Halifax, August 14, 2010 (1) Aproximation issues (2) Generation

More information

Hyperuniformity on the Sphere

Hyperuniformity on the Sphere Hyperuniformity on the Sphere Johann S. Brauchart j.brauchart@tugraz.at 14. June 2018 Week 2 Workshop MATRIX Research Program "On the Frontiers of High Dimensional Computation" MATRIX, Creswick [ 1 / 56

More information

APPLIED MATHEMATICS REPORT AMR04/16 FINITE-ORDER WEIGHTS IMPLY TRACTABILITY OF MULTIVARIATE INTEGRATION. I.H. Sloan, X. Wang and H.

APPLIED MATHEMATICS REPORT AMR04/16 FINITE-ORDER WEIGHTS IMPLY TRACTABILITY OF MULTIVARIATE INTEGRATION. I.H. Sloan, X. Wang and H. APPLIED MATHEMATICS REPORT AMR04/16 FINITE-ORDER WEIGHTS IMPLY TRACTABILITY OF MULTIVARIATE INTEGRATION I.H. Sloan, X. Wang and H. Wozniakowski Published in Journal of Complexity, Volume 20, Number 1,

More information

10-701/ Recitation : Kernels

10-701/ Recitation : Kernels 10-701/15-781 Recitation : Kernels Manojit Nandi February 27, 2014 Outline Mathematical Theory Banach Space and Hilbert Spaces Kernels Commonly Used Kernels Kernel Theory One Weird Kernel Trick Representer

More information

Quasi-Monte Carlo integration over the Euclidean space and applications

Quasi-Monte Carlo integration over the Euclidean space and applications Quasi-Monte Carlo integration over the Euclidean space and applications f.kuo@unsw.edu.au University of New South Wales, Sydney, Australia joint work with James Nichols (UNSW) Journal of Complexity 30

More information

Karhunen-Loève decomposition of Gaussian measures on Banach spaces

Karhunen-Loève decomposition of Gaussian measures on Banach spaces Karhunen-Loève decomposition of Gaussian measures on Banach spaces Jean-Charles Croix GT APSSE - April 2017, the 13th joint work with Xavier Bay. 1 / 29 Sommaire 1 Preliminaries on Gaussian processes 2

More information

Part III. Quasi Monte Carlo methods 146/349

Part III. Quasi Monte Carlo methods 146/349 Part III Quasi Monte Carlo methods 46/349 Outline Quasi Monte Carlo methods 47/349 Quasi Monte Carlo methods Let y = (y,...,y N ) be a vector of independent uniform random variables in Γ = [0,] N, u(y)

More information

QUADRATURE ON A SPHERICAL SURFACE CASPER H. L. BEENTJES. Mathematical Institute, University of Oxford, Oxford, UK

QUADRATURE ON A SPHERICAL SURFACE CASPER H. L. BEENTJES. Mathematical Institute, University of Oxford, Oxford, UK QUADRATURE O A SPHERICAL SURFACE CASPER H. L. BEETJES Mathematical Institute, University of Oxford, Oxford, UK Abstract. Approximately calculating integrals over spherical surfaces in R 3 can be done by

More information

Digital lattice rules

Digital lattice rules Digital lattice rules Multivariate integration and discrepancy estimates A thesis presented to The University of New South Wales in fulfilment of the thesis requirement for the degree of Doctor of Philosophy

More information

Uniformly bounded sets of orthonormal polynomials on the sphere

Uniformly bounded sets of orthonormal polynomials on the sphere Uniformly bounded sets of orthonormal polynomials on the sphere J. Marzo & J. Ortega-Cerdà Universitat de Barcelona October 13, 2014 Some previous results W. Rudin (80), Inner function Conjecture : There

More information

Convergence Rates of Kernel Quadrature Rules

Convergence Rates of Kernel Quadrature Rules Convergence Rates of Kernel Quadrature Rules Francis Bach INRIA - Ecole Normale Supérieure, Paris, France ÉCOLE NORMALE SUPÉRIEURE NIPS workshop on probabilistic integration - Dec. 2015 Outline Introduction

More information

Interpolation via weighted l 1 -minimization

Interpolation via weighted l 1 -minimization Interpolation via weighted l 1 -minimization Holger Rauhut RWTH Aachen University Lehrstuhl C für Mathematik (Analysis) Matheon Workshop Compressive Sensing and Its Applications TU Berlin, December 11,

More information

Online Gradient Descent Learning Algorithms

Online Gradient Descent Learning Algorithms DISI, Genova, December 2006 Online Gradient Descent Learning Algorithms Yiming Ying (joint work with Massimiliano Pontil) Department of Computer Science, University College London Introduction Outline

More information

CIS 520: Machine Learning Oct 09, Kernel Methods

CIS 520: Machine Learning Oct 09, Kernel Methods CIS 520: Machine Learning Oct 09, 207 Kernel Methods Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture They may or may not cover all the material discussed

More information

ON DIMENSION-INDEPENDENT RATES OF CONVERGENCE FOR FUNCTION APPROXIMATION WITH GAUSSIAN KERNELS

ON DIMENSION-INDEPENDENT RATES OF CONVERGENCE FOR FUNCTION APPROXIMATION WITH GAUSSIAN KERNELS ON DIMENSION-INDEPENDENT RATES OF CONVERGENCE FOR FUNCTION APPROXIMATION WITH GAUSSIAN KERNELS GREGORY E. FASSHAUER, FRED J. HICKERNELL, AND HENRYK WOŹNIAKOWSKI Abstract. This article studies the problem

More information

Fourier extension and sampling on the sphere

Fourier extension and sampling on the sphere Fourier extension and sampling on the sphere Daniel Potts Technische Universität Chemnitz Faculty of Mathematics 97 Chemnitz, Germany Email: potts@mathematiktu-chemnitzde iel Van Buggenhout KU Leuven Faculty

More information

Regularization in Reproducing Kernel Banach Spaces

Regularization in Reproducing Kernel Banach Spaces .... Regularization in Reproducing Kernel Banach Spaces Guohui Song School of Mathematical and Statistical Sciences Arizona State University Comp Math Seminar, September 16, 2010 Joint work with Dr. Fred

More information

On ANOVA expansions and strategies for choosing the anchor point

On ANOVA expansions and strategies for choosing the anchor point On ANOVA expansions and strategies for choosing the anchor point Zhen Gao and Jan S. Hesthaven August 31, 2010 Abstract The classic Lebesgue ANOVA expansion offers an elegant way to represent functions

More information

Generalization theory

Generalization theory Generalization theory Daniel Hsu Columbia TRIPODS Bootcamp 1 Motivation 2 Support vector machines X = R d, Y = { 1, +1}. Return solution ŵ R d to following optimization problem: λ min w R d 2 w 2 2 + 1

More information

arithmetic properties of weighted catalan numbers

arithmetic properties of weighted catalan numbers arithmetic properties of weighted catalan numbers Jason Chen Mentor: Dmitry Kubrak May 20, 2017 MIT PRIMES Conference background: catalan numbers Definition The Catalan numbers are the sequence of integers

More information

MATH 590: Meshfree Methods

MATH 590: Meshfree Methods MATH 590: Meshfree Methods Chapter 14: The Power Function and Native Space Error Estimates Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu

More information

Approximation of Functions Using Digital Nets

Approximation of Functions Using Digital Nets Approximation of Functions Using Digital Nets Josef Dick 1, Peter Kritzer 2, and Frances Y. Kuo 3 1 UNSW Asia, 1 Kay Siang Road, Singapore 248922. E-mail: j.dick@unswasia.edu.sg 2 Fachbereich Mathematik,

More information

Probability and combinatorics

Probability and combinatorics Texas A&M University May 1, 2012 Probability spaces. (Λ, M, P ) = measure space. Probability space: P a probability measure, P (Λ) = 1. Probability spaces. (Λ, M, P ) = measure space. Probability space:

More information

A NEARLY-OPTIMAL ALGORITHM FOR THE FREDHOLM PROBLEM OF THE SECOND KIND OVER A NON-TENSOR PRODUCT SOBOLEV SPACE

A NEARLY-OPTIMAL ALGORITHM FOR THE FREDHOLM PROBLEM OF THE SECOND KIND OVER A NON-TENSOR PRODUCT SOBOLEV SPACE JOURNAL OF INTEGRAL EQUATIONS AND APPLICATIONS Volume 27, Number 1, Spring 2015 A NEARLY-OPTIMAL ALGORITHM FOR THE FREDHOLM PROBLEM OF THE SECOND KIND OVER A NON-TENSOR PRODUCT SOBOLEV SPACE A.G. WERSCHULZ

More information

Design theory from the viewpoint of algebraic combinatorics

Design theory from the viewpoint of algebraic combinatorics Design theory from the viewpoint of algebraic combinatorics Eiichi Bannai Shanghai Jiao Tong University May 27, 2017, at 9SHCC This talk is based on the paper: Eiichi Bannai, Etsuko Bannai, Hajime Tanaka,

More information

On the Behavior of the Weighted Star Discrepancy Bounds for Shifted Lattice Rules

On the Behavior of the Weighted Star Discrepancy Bounds for Shifted Lattice Rules On the Behavior of the Weighted Star Discrepancy Bounds for Shifted Lattice Rules Vasile Sinescu and Pierre L Ecuyer Abstract We examine the question of constructing shifted lattice rules of rank one with

More information

Numerical Integration over unit sphere by using spherical t-designs

Numerical Integration over unit sphere by using spherical t-designs Numerical Integration over unit sphere by using spherical t-designs Congpei An 1 1,Institute of Computational Sciences, Department of Mathematics, Jinan University Spherical Design and Numerical Analysis

More information

Hot new directions for QMC research in step with applications

Hot new directions for QMC research in step with applications Hot new directions for QMC research in step with applications Frances Kuo f.kuo@unsw.edu.au University of New South Wales, Sydney, Australia Frances Kuo @ UNSW Australia p.1 Outline Motivating example

More information

RANDOM FIELDS AND GEOMETRY. Robert Adler and Jonathan Taylor

RANDOM FIELDS AND GEOMETRY. Robert Adler and Jonathan Taylor RANDOM FIELDS AND GEOMETRY from the book of the same name by Robert Adler and Jonathan Taylor IE&M, Technion, Israel, Statistics, Stanford, US. ie.technion.ac.il/adler.phtml www-stat.stanford.edu/ jtaylor

More information

Applied and Computational Harmonic Analysis

Applied and Computational Harmonic Analysis Appl Comput Harmon Anal 32 (2012) 401 412 Contents lists available at ScienceDirect Applied and Computational Harmonic Analysis wwwelseviercom/locate/acha Multiscale approximation for functions in arbitrary

More information

Kernel-Based Contrast Functions for Sufficient Dimension Reduction

Kernel-Based Contrast Functions for Sufficient Dimension Reduction Kernel-Based Contrast Functions for Sufficient Dimension Reduction Michael I. Jordan Departments of Statistics and EECS University of California, Berkeley Joint work with Kenji Fukumizu and Francis Bach

More information

Recall that any inner product space V has an associated norm defined by

Recall that any inner product space V has an associated norm defined by Hilbert Spaces Recall that any inner product space V has an associated norm defined by v = v v. Thus an inner product space can be viewed as a special kind of normed vector space. In particular every inner

More information

Outline of Fourier Series: Math 201B

Outline of Fourier Series: Math 201B Outline of Fourier Series: Math 201B February 24, 2011 1 Functions and convolutions 1.1 Periodic functions Periodic functions. Let = R/(2πZ) denote the circle, or onedimensional torus. A function f : C

More information

Reproducing Kernel Hilbert Spaces

Reproducing Kernel Hilbert Spaces Reproducing Kernel Hilbert Spaces Lorenzo Rosasco 9.520 Class 03 February 9, 2011 About this class Goal To introduce a particularly useful family of hypothesis spaces called Reproducing Kernel Hilbert

More information

MATH 829: Introduction to Data Mining and Analysis Support vector machines and kernels

MATH 829: Introduction to Data Mining and Analysis Support vector machines and kernels 1/12 MATH 829: Introduction to Data Mining and Analysis Support vector machines and kernels Dominique Guillot Departments of Mathematical Sciences University of Delaware March 14, 2016 Separating sets:

More information

Topics in Fourier analysis - Lecture 2.

Topics in Fourier analysis - Lecture 2. Topics in Fourier analysis - Lecture 2. Akos Magyar 1 Infinite Fourier series. In this section we develop the basic theory of Fourier series of periodic functions of one variable, but only to the extent

More information

Lecture 35: December The fundamental statistical distances

Lecture 35: December The fundamental statistical distances 36-705: Intermediate Statistics Fall 207 Lecturer: Siva Balakrishnan Lecture 35: December 4 Today we will discuss distances and metrics between distributions that are useful in statistics. I will be lose

More information

Support Vector Machines

Support Vector Machines Wien, June, 2010 Paul Hofmarcher, Stefan Theussl, WU Wien Hofmarcher/Theussl SVM 1/21 Linear Separable Separating Hyperplanes Non-Linear Separable Soft-Margin Hyperplanes Hofmarcher/Theussl SVM 2/21 (SVM)

More information

Projection Methods. (Lectures on Solution Methods for Economists IV) Jesús Fernández-Villaverde 1 and Pablo Guerrón 2 March 7, 2018

Projection Methods. (Lectures on Solution Methods for Economists IV) Jesús Fernández-Villaverde 1 and Pablo Guerrón 2 March 7, 2018 Projection Methods (Lectures on Solution Methods for Economists IV) Jesús Fernández-Villaverde 1 and Pablo Guerrón 2 March 7, 2018 1 University of Pennsylvania 2 Boston College Introduction Remember that

More information

Numerical Minimization of Potential Energies on Specific Manifolds

Numerical Minimization of Potential Energies on Specific Manifolds Numerical Minimization of Potential Energies on Specific Manifolds SIAM Conference on Applied Linear Algebra 2012 22 June 2012, Valencia Manuel Gra f 1 1 Chemnitz University of Technology, Germany, supported

More information

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )

More information

On the computation of spherical designs by a new optimization approach based on fast spherical Fourier transforms

On the computation of spherical designs by a new optimization approach based on fast spherical Fourier transforms On the computation of spherical designs by a new optimization approach based on fast spherical Fourier transforms anuel Gräf Daniel Potts In this paper we consider the problem of finding numerical spherical

More information

High-Dimensional Problems: Multivariate Linear Tensor Product Problems, Multivariate Numerical Integration, and Geometric Discrepancy

High-Dimensional Problems: Multivariate Linear Tensor Product Problems, Multivariate Numerical Integration, and Geometric Discrepancy High-Dimensional Problems: Multivariate Linear Tensor Product Problems, Multivariate Numerical Integration, and Geometric Discrepancy Habilitationsschrift vorgelegt von Michael Gnewuch Kiel 2009 1 Preface

More information

High-dimensional test for normality

High-dimensional test for normality High-dimensional test for normality Jérémie Kellner Ph.D Student University Lille I - MODAL project-team Inria joint work with Alain Celisse Rennes - June 5th, 2014 Jérémie Kellner Ph.D Student University

More information

Accuracy, Precision and Efficiency in Sparse Grids

Accuracy, Precision and Efficiency in Sparse Grids John, Information Technology Department, Virginia Tech.... http://people.sc.fsu.edu/ jburkardt/presentations/ sandia 2009.pdf... Computer Science Research Institute, Sandia National Laboratory, 23 July

More information

NEEDLET APPROXIMATION FOR ISOTROPIC RANDOM FIELDS ON THE SPHERE

NEEDLET APPROXIMATION FOR ISOTROPIC RANDOM FIELDS ON THE SPHERE NEEDLET APPROXIMATION FOR ISOTROPIC RANDOM FIELDS ON THE SPHERE Quoc T. Le Gia Ian H. Sloan Yu Guang Wang Robert S. Womersley School of Mathematics and Statistics University of New South Wales, Australia

More information

Beyond the Point Cloud: From Transductive to Semi-Supervised Learning

Beyond the Point Cloud: From Transductive to Semi-Supervised Learning Beyond the Point Cloud: From Transductive to Semi-Supervised Learning Vikas Sindhwani, Partha Niyogi, Mikhail Belkin Andrew B. Goldberg goldberg@cs.wisc.edu Department of Computer Sciences University of

More information

Divide and Conquer Kernel Ridge Regression. A Distributed Algorithm with Minimax Optimal Rates

Divide and Conquer Kernel Ridge Regression. A Distributed Algorithm with Minimax Optimal Rates : A Distributed Algorithm with Minimax Optimal Rates Yuchen Zhang, John C. Duchi, Martin Wainwright (UC Berkeley;http://arxiv.org/pdf/1305.509; Apr 9, 014) Gatsby Unit, Tea Talk June 10, 014 Outline Motivation.

More information

Adaptive sparse grids

Adaptive sparse grids ANZIAM J. 44 (E) ppc335 C353, 2003 C335 Adaptive sparse grids M. Hegland (Received 1 June 2001) Abstract Sparse grids, as studied by Zenger and Griebel in the last 10 years have been very successful in

More information

Inner Product Spaces An inner product on a complex linear space X is a function x y from X X C such that. (1) (2) (3) x x > 0 for x 0.

Inner Product Spaces An inner product on a complex linear space X is a function x y from X X C such that. (1) (2) (3) x x > 0 for x 0. Inner Product Spaces An inner product on a complex linear space X is a function x y from X X C such that (1) () () (4) x 1 + x y = x 1 y + x y y x = x y x αy = α x y x x > 0 for x 0 Consequently, (5) (6)

More information

Wavelet Frames on the Sphere for Sparse Representations in High Angular Resolution Diusion Imaging. Chen Weiqiang

Wavelet Frames on the Sphere for Sparse Representations in High Angular Resolution Diusion Imaging. Chen Weiqiang Wavelet Frames on the Sphere for Sparse Representations in High Angular Resolution Diusion Imaging Chen Weiqiang Overview 1. Introduction to High Angular Resolution Diusion Imaging (HARDI). 2. Wavelets

More information

Fourier Series. ,..., e ixn ). Conversely, each 2π-periodic function φ : R n C induces a unique φ : T n C for which φ(e ix 1

Fourier Series. ,..., e ixn ). Conversely, each 2π-periodic function φ : R n C induces a unique φ : T n C for which φ(e ix 1 Fourier Series Let {e j : 1 j n} be the standard basis in R n. We say f : R n C is π-periodic in each variable if f(x + πe j ) = f(x) x R n, 1 j n. We can identify π-periodic functions with functions on

More information