Fast algorithms based on asymptotic expansions of special functions
|
|
- Brendan Dawson
- 6 years ago
- Views:
Transcription
1 Fast algorithms based on asymptotic expansions of special functions Alex Townsend MIT Cornell University, 23rd January 2015, CAM Colloquium
2 Introduction Two trends in the computing era Tabulations Software Logarithms Gauss quadrature Special functions 1/22
3 Introduction Two trends in the computing era Tabulations Software Logarithms Gauss quadrature Special functions Classical analysis Numerical analysis = ~~ Fast multipole method Butterfly schemes Iterative algorithms Finite element method 1/22
4 Introduction A selection of my research Algebraic geometry p(x, y) q(x, y) = 0 [Nakatsukasa, Noferini, & T., 2015] K Approx. theory f(x, y) j=1 c j y r j (x) [Trefethen & T., 2014] 2/22
5 Introduction A selection of my research Algebraic geometry p(x, y) q(x, y) = 0 [Nakatsukasa, Noferini, & T., 2015] [Battels & Trefethen, 2004] K Approx. theory f(x, y) j=1 c j y r j (x) [Trefethen & T., 2014] 2/22
6 Introduction Many special functions are trigonometric-like Trigonometric functions cos(ωx), sin(ωx) Chebyshev polynomials T n (x) Legendre polynomials P n (x) Bessel functions J v (z) Airy functions Ai(x) Also, Jacobi polynomials, Hermite polynomials, parabolic cylinder functions, etc. 3/22
7 Introduction Many special functions are trigonometric-like Trigonometric functions cos(ωx), sin(ωx) Chebyshev polynomials T n (x) Legendre polynomials P n (x) Bessel functions J v (z) Airy functions Ai(x) Also, Jacobi polynomials, Hermite polynomials, parabolic cylinder functions, etc. 3/22
8 Introduction Many special functions are trigonometric-like Trigonometric functions cos(ωx), sin(ωx) Chebyshev polynomials T n (x) Legendre polynomials P n (x) Bessel functions J v (z) Airy functions Ai(x) Also, Jacobi polynomials, Hermite polynomials, parabolic cylinder functions, etc. 3/22
9 Introduction Many special functions are trigonometric-like Trigonometric functions cos(ωx), sin(ωx) Chebyshev polynomials T n (x) Legendre polynomials P n (x) Bessel functions J v (z) Airy functions Ai(x) Also, Jacobi polynomials, Hermite polynomials, parabolic cylinder functions, etc. 3/22
10 Introduction Many special functions are trigonometric-like Trigonometric functions cos(ωx), sin(ωx) Chebyshev polynomials T n (x) Legendre polynomials P n (x) Bessel functions J v (z) Airy functions Ai(x) Also, Jacobi polynomials, Hermite polynomials, parabolic cylinder functions, etc. 3/22
11 Introduction Many special functions are trigonometric-like Trigonometric functions cos(ωx), sin(ωx) Chebyshev polynomials T n (x) Legendre polynomials P n (x) Bessel functions J v (z) Airy functions Ai(x) Also, Jacobi polynomials, Hermite polynomials, parabolic cylinder functions, etc. 3/22
12 Introduction Asymptotic expansions of special functions Legendre polynomials P n (cos θ) ~ C n M 1 h m,n cos m + n + m=0 1 2 θ m (2 sin θ) m+1 2 π 2, n Thomas Stieltjes Bessel functions J 0 z ~ M 1 2 πz (cos z π 4 m=0 1 m a 2m z 2m sin(z π M 1 ( 1) m 4 ) a 2m+1 z 2m+1 ) m=0 z Hermann Hankel 4/22
13 Introduction Numerical pitfalls of an asymptotic expansionist J 0 z = M 1 2 πz (cos z π 4 m=0 1 m a 2m z 2m sin(z π M 1 ( 1) m 4 ) a 2m+1 z 2m+1 ) + R M (z) m=0 Fix M. Where is the asymptotic expansion accurate? 5/22
14 Introduction Talk outline Using asymptotics expansions of special functions: I. Computing Gauss quadrature rules. [Hale & T., 2013], [T., Trodgon, & Olver, 2015] II. Fast transforms based on asymptotic expansions. [Hale & T., 2014], [T., 2015] 6/22
15 Part I: Computing Gauss quadrature rules Part I: Computing Gauss quadrature rules P n (x) = Legendre polynomial of degree n 7/22
16 Part I: Computing Gauss quadrature rules Definition n-point quadrature rule: 1 1 f x dx n k=1 w k f x k Gauss quadrature rule: x k = kth zero of P n w k = 2(1 x k 2 ) -1 [P n (x k )] Exactly integrates polynomials of degree 2n - 1. Best possible. 2. Computed by the Golub Welsch algorithm. [Golub & Welsch, 1969] 3. In 2004: no scheme for computing Gauss rules in O(n). [Bailey, Jeyabalan, & Li, 2004] 8/22
17 Quadrature error Execution time Part I: Computing Gauss quadrature rules Gauss quadrature experiments Quadrature error Execution time n n The Golub Welsch algorithm is beautiful, but not the state-of-the-art. There is another way... 9/22
18 Part I: Computing Gauss quadrature rules Newton s method Newton s method (with asymptotics and a change of variables) Solve P n (cos θ) (sin θ) 1/2 = 0, θ (0, π). Isaac Newton 1. Evaluation scheme for P n (cos θ) (sin θ) 1/2 2. Evaluation scheme for d dθ P n( cos θ) (sin θ) 1/21/2 3. Initial guesses for cos -1 (x k ) 10/22
19 Part I: Computing Gauss quadrature rules Newton s method with asymptotics and a change of variables Newton s method (with asymptotics and a change of variables) Solve P n (cos θ) (sin θ) 1/2 = 0, θ (0, π). Isaac Newton 1. Evaluation scheme for P n (cos θ) (sin θ) 1/2 P n (x) 2. Evaluation scheme for d dθ P n( cos θ) (sin θ) 1/2 ) 1/2 3. Initial guesses for cos -1 (x k ) 10/22
20 Part I: Computing Gauss quadrature rules Newton s method with asymptotics and a change of variables Newton s method (with asymptotics and a change of variables) Solve P n (cos θ) (sin θ) 1/2 = 0, θ (0, π). Isaac Newton 1. Evaluation scheme for P n (cos θ) (sin θ) 1/2 P n (x) 2. Evaluation scheme for d dθ P n( cos θ) (sin θ) 1/2 ) 1/2 3. Initial guesses for cos -1 (x k ) 10/22
21 Part I: Computing Gauss quadrature rules Newton s method with asymptotics and a change of variables Newton s method (with asymptotics and a change of variables) Solve P n (cos θ) (sin θ) 1/2 = 0, θ (0, π). Isaac Newton 1. Evaluation scheme for P n (cos θ) (sin θ) 1/2 2. Evaluation scheme for d P dθ n( cos θ) (sin θ) 1/2 3. Initial guesses for cos -1 (x k ) P n (cos θ) (sin θ) 1/2 10/22
22 Part I: Computing Gauss quadrature rules Newton s method with asymptotics and a change of variables Newton s method (with asymptotics and a change of variables) Solve P n (cos θ) (sin θ) 1/2 = 0, θ (0, π). Isaac Newton 1. Evaluation scheme for P n (cos θ) (sin θ) 1/2 2. Evaluation scheme for d P dθ n( cos θ) (sin θ) 1/2 3. Initial guesses for cos -1 (x k ) P n (cos θ) (sin θ) 1/2 10/22
23 Part I: Computing Gauss quadrature rules Newton s method with asymptotics and a change of variables Newton s method (with asymptotics and a change of variables) Solve P n (cos θ) (sin θ) 1/2 = 0, θ (0, π). Isaac Newton 1. Evaluation scheme for P n (cos θ) (sin θ) 1/2 2. Evaluation scheme for d P dθ n( cos θ) (sin θ) 1/2 3. Initial guesses for cos -1 (x k ) P n (cos θ) (sin θ) 1/2 10/22
24 Part I: Computing Gauss quadrature rules Evaluation scheme for P n Interior (in grey region): P n (cos θ) (sin θ) 1/2 P n (cos θ)(sin θ) 1/2 C n M 1 h m,n cos m + n + m=0 1 2 θ m (2 sin θ) m π 2 Boundary: M 1 Am (θ) M 1 Bm (θ) P n (cos θ)(sin θ) 1/2 θ 1 2(J 0 (ρθ) m=0 ρ 2m + θj 1(ρθ) m=0 ρ 2m+1), ρ = n Theorem init 1 For ε > 0, n 200, and θ k = (k 2 ) π n [Baratella & Gatteschi, 1988], Newton converges and the nodes are computed to an accuracy of O(ε) in O(nlog(1/ε)) operations. 11/22
25 Part I: Computing Gauss quadrature rules Evaluation scheme for P n Interior (in grey region): P n (cos θ) (sin θ) 1/2 P n (cos θ)(sin θ) 1/2 C n M 1 h m,n cos m + n + m=0 1 2 θ m (2 sin θ) m π 2 Boundary: M 1 Am (θ) M 1 Bm (θ) P n (cos θ)(sin θ) 1/2 θ 1 2(J 0 (ρθ) m=0 ρ 2m + θj 1(ρθ) m=0 ρ 2m+1), ρ = n Theorem init 1 For ε > 0, n 200, and θ k = (k 2 ) π n [Baratella & Gatteschi, 1988], Newton converges and the nodes are computed to an accuracy of O(ε) in O(nlog(1/ε)) operations. 11/22
26 Part I: Computing Gauss quadrature rules Evaluation scheme for P n Interior (in grey region): P n (cos θ) (sin θ) 1/2 P n (cos θ)(sin θ) 1/2 C n M 1 h m,n cos m + n + m=0 1 2 θ m (2 sin θ) m π 2 Boundary: M 1 Am (θ) M 1 Bm (θ) P n (cos θ)(sin θ) 1/2 θ 1 2(J 0 (ρθ) m=0 ρ 2m + θj 1(ρθ) m=0 ρ 2m+1), ρ = n Theorem For n 200 and θ k init = (k 1 2 ) π n [Baratella & Gatteschi, 1988], Newton converges to the nodes in O(n) operations. 11/22
27 Max error Part I: Computing Gauss quadrature rules Initial guesses for the nodes Interior: Use Tricomi s Max error in the initial guesses initial guesses. [Tricomi, 1950] Boundary: Use Olver s initial guesses. [Olver, 1974] Ignace Bogaert There are now better initial guesses. [Bogaert, 2014] 12/22
28 Part I: Computing Gauss quadrature rules The race to compute high-order Gauss quadrature The race to compute high-order Gauss quadrature [T., 2015] 13/22
29 Quadrature error Part I: Computing Gauss quadrature rules Applications 1. Psychological: Gauss quadrature rules are cheap. 2. Experimental mathematics: High precision quadratures. [Bailey, Jeyabalan, & Li, 2004] 3. Cosmic microwave background: Noise removal by L 2 -projection. 1 1 dx x 2 Generically, composite rules converge algebraically. 14/22
30 Part II: Fast transforms based on asymptotic expansions Part II: Fast transforms based on asymptotic expansions P N c = P 0 cos θ 0 P cos θ 0 P 0 cos θ P cos θ c 1 c, θ k = kπ N 1 15/22
31 Part II: Fast transforms based on asymptotic expansions Fast transforms as evaluation schemes DFT f k = cn z n n=0 k, z k = e 2πik/N DCT f k = cn cos(nθ k ), θ k = kπ n=0 z 2 z 1 z 0 DCT f k = cn T n=0 n (cosθ k ) DLT f k = cn P n=0 n (cosθ k ) θ 0 θ 1 DHT f k = cn J v j v,n r k, r k = j v,n n=0 j v,n, j v,n = nth root of J v z 16/22
32 Part II: Fast transforms based on asymptotic expansions Fast transforms as evaluation schemes DFT f k = cn z n n=0 k, z k = e 2πik/N DCT f k = cn cos(nθ k ), θ k = kπ n=0 z 2 z 1 z 0 DCT f k = cn T n=0 n (cosθ k ) DLT f k = cn P n=0 n (cosθ k ) θ 0 θ 1 DHT f k = cn J v j v,n r k, r k = j v,n n=0 j v,n, j v,n = nth root of J v z 16/22
33 Part II: Fast transforms based on asymptotic expansions Fast transforms as evaluation schemes DFT f k = cn z n n=0 k, z k = e 2πik/N DCT f k = cn cos(nθ k ), θ k = kπ n=0 z 2 z 1 z 0 DCT f k = cn T n=0 n (cosθ k ) DLT f k = cn P n=0 n (cosθ k ) θ 0 θ 1 DHT f k = cn J v j v,n r k, r k = j v,n n=0 j v,n, j v,n = nth root of J v z 16/22
34 Part II: Fast transforms based on asymptotic expansions Fast transforms as evaluation schemes DFT f k = cn z n n=0 k, z k = e 2πik/N DCT f k = cn cos(nθ k ), θ k = kπ n=0 z 2 z 1 z 0 DCT f k = cn T n=0 n (cosθ k ) DLT f k = cn P n=0 n (cosθ k ) θ 0 θ 1 DHT f k = cn J v j v,n r k, r k = j v,n n=0 j v,n, j v,n = nth root of J v z 16/22
35 Part II: Fast transforms based on asymptotic expansions Related work James Cooley Leslie Greengard Emmanuel Candes Daniel Potts Ahmed, Tukey, Gauss, Gentleman, Natarajan, Rao Alpert, Barnes, Hut, Martinsson, Rokhlin, Mohlenkamp, Tygert Boag, Demanet, Michielssen, O Neil, Ying Driscoll, Healy, Steidl, Tasche Many others: Candel, Cree, Johnson, Mori, Orszag, Suda, Sugihara, Takami, etc. Fast transforms are very important. 17/22
36 Part II: Fast transforms based on asymptotic expansions Asymptotic expansions as a matrix decomposition The asymptotic expansion P n (cos θ k ) = C n 1 M 1 cos m + n + 2 θ k m + 1 π 2 2 h m,n (2 sin θ k ) m + 1/2 + R M,n (θ k ) m=0 gives a matrix decomposition (sum of diagonally scaled DCTs and DSTs): P N = M 1 m=0 D u m C ND Chm + D vm S N D Chm + R M,N P N = P ASY N + R M,N 18/22
37 Part II: Fast transforms based on asymptotic expansions Be careful and stay safe Error curve: R M,n θ k = ε Fix M. Where is the asymptotic expansion accurate? R M,N = R M,n (θ k ) 2C n h M,n (2 sin θ k ) M+1/2 19/22
38 Part II: Fast transforms based on asymptotic expansions Partitioning and balancing competing costs Theorem The matrix-vector product f = P N c can be computed in O (N((log N) 2 / log log N) operations. 0 1 α too small 20/22
39 Part II: Fast transforms based on asymptotic expansions Partitioning and balancing competing costs Theorem The matrix-vector product f = P N c can be computed in O(N((log N) 2 / log log N) operations. 0 1 α too small 20/22
40 Part II: Fast transforms based on asymptotic expansions Partitioning and balancing competing costs Theorem The matrix-vector product f = P N c can be computed in O(N((log N) 2 / log log N) operations. 0 1 α too small 20/22
41 Part II: Fast transforms based on asymptotic expansions Partitioning and balancing competing costs Theorem The matrix-vector product f = P N c can be computed in O(N((log N) 2 / log log N) operations. 0 1 α too large 20/22
42 Part II: Fast transforms based on asymptotic expansions Partitioning and balancing competing costs Theorem The matrix-vector product f = P N c can be computed in O(N((log N) 2 / log log N) operations. 0 1 α = O (1/ log N) P N (j) c P N EVAL c O ( N (log N)2 log log N ) O (N (log N) 2 log log N ) 20/22
43 Execution time Part II: Fast transforms based on asymptotic expansions Numerical results 10 0 Direct approach Using asymptotics Modification of rough signals N x No precomputation. 1 1 P n x e iωt dx = i m 2π ω J m+ 1 ( ω) 2 21/22
44 Execution time Future work Fast spherical harmonic transform Spherical harmonic transform: Existing approaches 10 4 Precomputation Fast transform Direct approach f θ, φ = l α l m P l m (cos θ)e imφ 10 2 l=0 m= l 10 0 [Mohlenkamp, 1999] 10-2 [Rokhlin & Tygert, 2006] [Tygert, 2008] N 10 5 A new generation of fast algorithms with no precomputation. 22/22
45 Thank you
46 References D. H. Bailey, K. Jeyabalan, and X. S. Li, A comparison of three high-precision quadrature schemes, P. Baratella and I. Gatteschi, The bounds for the error term of an asymptotic approximation of Jacobi polynomials, Lecture notes in Mathematics, Z. Battels and L. N. Trefethen, An extension of Matlab to continuous functions and operators, SISC, I. Bogaert, Iteration-free computation of Gauss Legendre quadrature nodes and weights, SISC, G. H. Golub and J. H. Welsch, Calculation of Gauss quadrature rules, Math. Comput., N. Hale and A. Townsend, Fast and accurate computation of Gauss Legendre and Gauss Jacobi quadrature nodes and weights, SISC, N. Hale and A. Townsend, A fast, simple, and stable Chebyshev Legendre transform using an asymptotic formula, SISC, Y. Nakatsukasa, V. Noferini, and A. Townsend, Computing the common zeros of two bivariate functions via Bezout resultants, Numerische Mathematik, 2014.
47 References F. W. J. Olver, Asymptotics and Special Functions, Academic Press, New York, A. Townsend and L. N. Trefethen, An extension of Chebfun to two dimensions, SISC, A. Townsend, T. Trogdon, and S. Olver, Fast computation of Gauss quadrature nodes and weights on the whole real line, to appear in IMA Numer. Anal., A. Townsend, The race to compute high-order Gauss quadrature, SIAM News, A. Townsend, A fast analysis-based discrete Hankel transform using asymptotics expansions, submitted, F. G. Tricomi, Sugli zeri dei polinomi sferici ed ultrasferici, Ann. Mat. Pura. Appl., 1950.
A fast Chebyshev Legendre transform using an asymptotic formula
A fast Chebyshev Legendre transform using an asymptotic formula Alex Townsend MIT (Joint work with ick Hale) SIAM OPSFA, 5th June 2015 Introduction What is the Chebyshev Legendre transform? Suppose we
More informationA fast analysis-based discrete Hankel transform using asymptotic expansions
A fast analysis-based discrete Hankel transform using asymptotic expansions Alex Townsend MIT IMA Leslie Fox Prize Meeting, 22nd June, 2015 Based on: T., A fast analysis-based discrete Hankel transform
More informationComputing Gauss-Jacobi quadrature rules
.... Computing Gauss-Jacobi quadrature rules Alex Townsend Joint work with Nick Hale NA Internal Seminar Trinity Term 2012 . Gauss Jacobi Quadrature An n-point Gauss Jacobi quadrature rule: 1 1 w(x)f (x)dx
More informationComputing the common zeros of two bivariate functions via Bézout resultants Colorado State University, 26th September 2013
Work supported by supported by EPSRC grant EP/P505666/1. Computing the common zeros of two bivariate functions via Bézout resultants Colorado State University, 26th September 2013 Alex Townsend PhD student
More informationResearch Statement. James Bremer Department of Mathematics, University of California, Davis
Research Statement James Bremer Department of Mathematics, University of California, Davis Email: bremer@math.ucdavis.edu Webpage: https.math.ucdavis.edu/ bremer I work in the field of numerical analysis,
More informationKey words. Hankel transform, Bessel functions, asymptotic expansions, fast Fourier transform
A FAST AALYSIS-BASED DISCRETE HAKEL TRASFORM USIG ASYMPTOTIC EXPASIOS ALEX TOWSED Abstract. A fast and numerically stable algorithm is described for computing the discrete Hankel transform of order 0 as
More informationFast Algorithms for Spherical Harmonic Expansions
Fast Algorithms for Spherical Harmonic Expansions Vladimir Rokhlin and Mark Tygert Research Report YALEU/DCS/RR-1309 December 17, 004 Abstract An algorithm is introduced for the rapid evaluation at appropriately
More informationDownloaded 08/07/13 to Redistribution subject to SIAM license or copyright; see
SIAM J. SCI. COMPUT. Vol. 35, No., pp. A65 A674 c 03 Society for Industrial and Applied Mathematics FAST AND ACCURATE COMPUTATION OF GAUSS LEGENDRE AND GAUSS JACOBI QUADRATURE NODES AND WEIGHTS NICHOLAS
More informationRecurrence Relations and Fast Algorithms
Recurrence Relations and Fast Algorithms Mark Tygert Research Report YALEU/DCS/RR-343 December 29, 2005 Abstract We construct fast algorithms for decomposing into and reconstructing from linear combinations
More informationContents. I Basic Methods 13
Preface xiii 1 Introduction 1 I Basic Methods 13 2 Convergent and Divergent Series 15 2.1 Introduction... 15 2.1.1 Power series: First steps... 15 2.1.2 Further practical aspects... 17 2.2 Differential
More informationFast and Accurate Computation of Gauss-Legendre and Gauss-Jacobi Quadrature Nodes and Weights N. Hale A. Townsend
Fast and Accurate Computation of Gauss-Legendre and Gauss-Jacobi Quadrature Nodes and Weights by N. Hale A. Townsend OCCAM Preprint Number /79 FAST AND ACCURATE COMPUTATION OF GAUSS LEGENDRE AND GAUSS
More informationTowards a Faster Spherical Harmonic transform
Towards a Faster Spherical Harmonic transform Nathanaël Schaeffer LGIT / CNRS / Université Joseph Fourier IUGG CMG, Pisa, 7 May 2010 N. Schaeffer (LGIT/CNRS/UJF) Towards a faster SHT IUGG CMG, Pisa, 7
More informationc 2006 Society for Industrial and Applied Mathematics
SIAM J. SCI. COMPUT. Vol. 7, No. 6, pp. 1903 198 c 006 Society for Industrial and Applied Mathematics FAST ALGORITHMS FOR SPHERICAL HARMONIC EXPANSIONS VLADIMIR ROKHLIN AND MARK TYGERT Abstract. An algorithm
More informationA fast and well-conditioned spectral method: The US method
A fast and well-conditioned spectral method: The US method Alex Townsend University of Oxford Leslie Fox Prize, 24th of June 23 Partially based on: S. Olver & T., A fast and well-conditioned spectral method,
More informationITERATION-FREE COMPUTATION OF GAUSS-LEGENDRE QUADRATURE NODES AND WEIGHTS
ITERATION-FREE COMPUTATION OF GAUSS-LEGENDRE QUADRATURE NODES AND WEIGHTS I. BOGAERT Abstract. Gauss-Legendre quadrature rules are of considerable theoretical and practical interest because of their role
More informationA FAST SPHERICAL HARMONICS TRANSFORM ALGORITHM
MATHEMATICS OF COMPUTATION Volume 71, Number 238, Pages 703 715 S 0025-5718(01)01386-2 Article electronically published on November 28, 2001 A FAST SPHERICAL HARMONICS TRANSFORM ALGORITHM REIJI SUDA AND
More informationarxiv: v1 [math.na] 20 Oct 2014
FAST COMPUTATION OF GAUSS QUADRATURE NODES AND WEIGHTS ON THE WHOLE REAL LINE ALEX TOWNSEND, THOMAS TROGDON, AND SHEEHAN OLVER arxiv:1410.586v1 [math.na] 0 Oct 014 Abstract. A fast and accurate algorithm
More informationA Riemann Hilbert approach to Jacobi operators and Gaussian quadrature
A Riemann Hilbert approach to Jacobi operators and Gaussian quadrature Thomas Trogdon trogdon@cims.nyu.edu Courant Institute of Mathematical Sciences New York University 251 Mercer St. New York, NY, 112,
More informationFast algorithms for Jacobi expansions via nonoscillatory phase functions
Fast algorithms for Jacobi expansions via nonoscillatory phase functions James Bremer a, Haizhao Yang b a Department of Mathematics, University of California, Davis b Department of Mathematics, National
More informationQuadrature Formula for Computed Tomography
Quadrature Formula for Computed Tomography orislav ojanov, Guergana Petrova August 13, 009 Abstract We give a bivariate analog of the Micchelli-Rivlin quadrature for computing the integral of a function
More informationSparse Fourier Transform via Butterfly Algorithm
Sparse Fourier Transform via Butterfly Algorithm Lexing Ying Department of Mathematics, University of Texas, Austin, TX 78712 December 2007, revised June 2008 Abstract This paper introduces a fast algorithm
More informationIndex. for Ɣ(a, z), 39. convergent asymptotic representation, 46 converging factor, 40 exponentially improved, 39
Index Abramowitz function computed by Clenshaw s method, 74 absolute error, 356 Airy function contour integral for, 166 Airy functions algorithm, 359 asymptotic estimate of, 18 asymptotic expansions, 81,
More informationFast Structured Spectral Methods
Spectral methods HSS structures Fast algorithms Conclusion Fast Structured Spectral Methods Yingwei Wang Department of Mathematics, Purdue University Joint work with Prof Jie Shen and Prof Jianlin Xia
More informationA Fast Spherical Filter with Uniform Resolution
JOURNAL OF COMPUTATIONAL PHYSICS 136, 580 584 (1997) ARTICLE NO. CP975782 A Fast Spherical Filter with Uniform Resolution Rüdiger Jakob-Chien*, and Bradley K. Alpert *Department of Computer Science & Engineering,
More informationETNA Kent State University
Electronic Transactions on Numerical Analysis. Volume 35, pp. 148-163, 2009. Copyright 2009,. ISSN 1068-9613. ETNA SPHERICAL QUADRATURE FORMULAS WITH EQUALLY SPACED NODES ON LATITUDINAL CIRCLES DANIELA
More informationarxiv: v1 [math.na] 4 Nov 2015
ON WELL-CONDITIONED SPECTRAL COLLOCATION AND SPECTRAL METHODS BY THE INTEGRAL REFORMULATION KUI DU arxiv:529v [mathna 4 Nov 25 Abstract Well-conditioned spectral collocation and spectral methods have recently
More informationFourier extension and sampling on the sphere
Fourier extension and sampling on the sphere Daniel Potts Technische Universität Chemnitz Faculty of Mathematics 97 Chemnitz, Germany Email: potts@mathematiktu-chemnitzde iel Van Buggenhout KU Leuven Faculty
More informationPHYS 404 Lecture 1: Legendre Functions
PHYS 404 Lecture 1: Legendre Functions Dr. Vasileios Lempesis PHYS 404 - LECTURE 1 DR. V. LEMPESIS 1 Legendre Functions physical justification Legendre functions or Legendre polynomials are the solutions
More informationComparison of Clenshaw-Curtis and Gauss Quadrature
WDS'11 Proceedings of Contributed Papers, Part I, 67 71, 211. ISB 978-8-7378-184-2 MATFYZPRESS Comparison of Clenshaw-Curtis and Gauss Quadrature M. ovelinková Charles University, Faculty of Mathematics
More informationFast Algorithms for the Computation of Oscillatory Integrals
Fast Algorithms for the Computation of Oscillatory Integrals Emmanuel Candès California Institute of Technology EPSRC Symposium Capstone Conference Warwick Mathematics Institute, July 2009 Collaborators
More informationSolutions to Laplace s Equation in Cylindrical Coordinates and Numerical solutions. ρ + (1/ρ) 2 V
Solutions to Laplace s Equation in Cylindrical Coordinates and Numerical solutions Lecture 8 1 Introduction Solutions to Laplace s equation can be obtained using separation of variables in Cartesian and
More informationTen things you should know about quadrature. Nick Trefethen, Vanderbilt, Wed. 28 May 8:35 PM
Ten things you should know about quadrature Nick Trefethen, Vanderbilt, Wed. 28 May 2014 @ 8:35 PM 1. If the integrand is analytic, Gauss quadrature converges geometrically. f is analytic and bounded by
More informationReconstruction of sparse Legendre and Gegenbauer expansions
Reconstruction of sparse Legendre and Gegenbauer expansions Daniel Potts Manfred Tasche We present a new deterministic algorithm for the reconstruction of sparse Legendre expansions from a small number
More informationInstructions for Matlab Routines
Instructions for Matlab Routines August, 2011 2 A. Introduction This note is devoted to some instructions to the Matlab routines for the fundamental spectral algorithms presented in the book: Jie Shen,
More informationMATH20602 Numerical Analysis 1
M\cr NA Manchester Numerical Analysis MATH20602 Numerical Analysis 1 Martin Lotz School of Mathematics The University of Manchester Manchester, January 27, 2014 Outline General Course Information Introduction
More informationMATH20602 Numerical Analysis 1
M\cr NA Manchester Numerical Analysis MATH20602 Numerical Analysis 1 Martin Lotz School of Mathematics The University of Manchester Manchester, February 1, 2016 Outline General Course Information Introduction
More informationA Fast Algorithm for Spherical Grid Rotations and its Application to Singular Quadrature
A Fast Algorithm for Spherical Grid Rotations and its Application to Singular Quadrature Zydrunas Gimbutas Shravan Veerapaneni September 11, 2013 Abstract We present a fast and accurate algorithm for evaluating
More informationarxiv: v3 [math.na] 30 Nov 2012
arxiv:1202.0154v3 [math.na] 30 Nov 2012 Explicit barycentric weights for polynomial interpolation in the roots or extrema of classical orthogonal polynomials Haiyong Wang, Daan Huybrechs and Stefan Vandewalle
More informationContinuous analogues of matrix factorizations NASC seminar, 9th May 2014
Continuous analogues of matrix factorizations NSC seminar, 9th May 2014 lex Townsend DPhil student Mathematical Institute University of Oxford (joint work with Nick Trefethen) Many thanks to Gil Strang,
More informationFast Multipole Methods for The Laplace Equation. Outline
Fast Multipole Methods for The Laplace Equation Ramani Duraiswami Nail Gumerov Outline 3D Laplace equation and Coulomb potentials Multipole and local expansions Special functions Legendre polynomials Associated
More informationNumerical Analysis Preliminary Exam 10 am to 1 pm, August 20, 2018
Numerical Analysis Preliminary Exam 1 am to 1 pm, August 2, 218 Instructions. You have three hours to complete this exam. Submit solutions to four (and no more) of the following six problems. Please start
More informationThe spectral transform method
The spectral transform method by Nils Wedi European Centre for Medium-Range Weather Forecasts wedi@ecmwf.int Advanced Numerical Methods for Earth-System Modelling Slide 1 Advanced Numerical Methods for
More informationSparse and Fast Fourier Transforms in Biomedical Imaging
Sparse and Fast Fourier Transforms in Biomedical Imaging Stefan Kunis 1 1 joint work with Ines Melzer, TU Chemnitz and Helmholtz Center Munich, supported by DFG and Helmholtz association Outline 1 Trigonometric
More informationTen things you should know about quadrature
Ten things you should know about quadrature Nick Trefethen, March 2016 With thanks to André Weideman for #2, #5, #8, #9 Nick Hale for #4, #5, #7, #8 Nick Higham for #5, #8 Folkmar Bornemann for #6. 1/26
More informationKrylov Subspace Methods for the Evaluation of Matrix Functions. Applications and Algorithms
Krylov Subspace Methods for the Evaluation of Matrix Functions. Applications and Algorithms 2. First Results and Algorithms Michael Eiermann Institut für Numerische Mathematik und Optimierung Technische
More informationb n x n + b n 1 x n b 1 x + b 0
Math Partial Fractions Stewart 7.4 Integrating basic rational functions. For a function f(x), we have examined several algebraic methods for finding its indefinite integral (antiderivative) F (x) = f(x)
More informationChapter 4. Solution of Non-linear Equation. Module No. 1. Newton s Method to Solve Transcendental Equation
Numerical Analysis by Dr. Anita Pal Assistant Professor Department of Mathematics National Institute of Technology Durgapur Durgapur-713209 email: anita.buie@gmail.com 1 . Chapter 4 Solution of Non-linear
More informationThe automatic solution of PDEs using a global spectral method
The automatic solution of PDEs using a global spectral method 2014 CBMS-NSF Conference, 29th June 2014 Alex Townsend PhD student University of Oxford (with Sheehan Olver) Supervised by Nick Trefethen,
More informationSpherical Wave Approach (SWA) for the electromagnetic modelling of 3D GPR scenarios. Nicola Tedeschi
Spherical Wave Approach (SWA) for the electromagnetic modelling of 3D GPR scenarios Nicola Tedeschi Outline Solutions of the vector wave equation Spherical wave approach Spherical reflected and transmitted
More informationCalculation of Highly Oscillatory Integrals by Quadrature Method
Calculation of Highly Oscillatory Integrals by Quadrature Methods Krishna Thapa Texas A&M University, College Station, TX May 18, 211 Outline Purpose Why Filon Type Quadrature Methods Our Expectations
More informationSolution of Matrix Eigenvalue Problem
Outlines October 12, 2004 Outlines Part I: Review of Previous Lecture Part II: Review of Previous Lecture Outlines Part I: Review of Previous Lecture Part II: Standard Matrix Eigenvalue Problem Other Forms
More informationExplicit construction of rectangular differentiation matrices
IMA Journal of Numerical Analysis (206) 36, 68 632 doi:0.093/imanum/drv03 Advance Access publication on April 26, 205 Explicit construction of rectangular differentiation matrices Kuan Xu Mathematical
More informationSpeeding up numerical computations via conformal maps
Speeding up numerical computations via conformal maps Nick Trefethen, Oxford University Thanks to Nick Hale, Nick Higham and Wynn Tee 1/35 SIAM 1997 SIAM 2000 Cambridge 2003 2/35 Princeton 2005 Bornemann
More informationSection 5.2 Series Solution Near Ordinary Point
DE Section 5.2 Series Solution Near Ordinary Point Page 1 of 5 Section 5.2 Series Solution Near Ordinary Point We are interested in second order homogeneous linear differential equations with variable
More informationTwo hours. To be provided by Examinations Office: Mathematical Formula Tables. THE UNIVERSITY OF MANCHESTER. 29 May :45 11:45
Two hours MATH20602 To be provided by Examinations Office: Mathematical Formula Tables. THE UNIVERSITY OF MANCHESTER NUMERICAL ANALYSIS 1 29 May 2015 9:45 11:45 Answer THREE of the FOUR questions. If more
More informationChapter 5 Fast Multipole Methods
Computational Electromagnetics; Chapter 1 1 Chapter 5 Fast Multipole Methods 5.1 Near-field and far-field expansions Like the panel clustering, the Fast Multipole Method (FMM) is a technique for the fast
More informationGauss Hermite interval quadrature rule
Computers and Mathematics with Applications 54 (2007) 544 555 www.elsevier.com/locate/camwa Gauss Hermite interval quadrature rule Gradimir V. Milovanović, Alesandar S. Cvetović Department of Mathematics,
More informationIntroduction. Chapter One
Chapter One Introduction The aim of this book is to describe and explain the beautiful mathematical relationships between matrices, moments, orthogonal polynomials, quadrature rules and the Lanczos and
More informationChebfun and numerical quadrature
SCIENCE CHINA Mathematics. ARTICLES. doi: 1.17/s11425-12-4474-z Chebfun and numerical quadrature HALE Nicholas & TREFETHEN Lloyd N. Mathematical Institute, University of Oxford, Oxford OX1 3LB, UK Email:
More informationFinal Year M.Sc., Degree Examinations
QP CODE 569 Page No Final Year MSc, Degree Examinations September / October 5 (Directorate of Distance Education) MATHEMATICS Paper PM 5: DPB 5: COMPLEX ANALYSIS Time: 3hrs] [Max Marks: 7/8 Instructions
More informationFastMMLib: a generic Fast Multipole Method library. Eric DARRIGRAND. IRMAR Université de Rennes 1
FastMMLib: a generic Fast Multipole Method library Eric DARRIGRAND joint work with Yvon LAFRANCHE IRMAR Université de Rennes 1 Outline Introduction to FMM Historically SVD principle A first example of
More informationAlex Townsend Cornell University
Continuous analogues of Krylov methods for differential operators Alex Townsend Cornell University townsend@cornell.edu Joint work with: Marc Aurèle Gilles Based on Continuous analogues of Krylov methods
More informationGaussian interval quadrature rule for exponential weights
Gaussian interval quadrature rule for exponential weights Aleksandar S. Cvetković, a, Gradimir V. Milovanović b a Department of Mathematics, Faculty of Mechanical Engineering, University of Belgrade, Kraljice
More informationCOMPUTATION OF BESSEL AND AIRY FUNCTIONS AND OF RELATED GAUSSIAN QUADRATURE FORMULAE
BIT 6-85//41-11 $16., Vol. 4, No. 1, pp. 11 118 c Swets & Zeitlinger COMPUTATION OF BESSEL AND AIRY FUNCTIONS AND OF RELATED GAUSSIAN QUADRATURE FORMULAE WALTER GAUTSCHI Department of Computer Sciences,
More informationA generalized Prony method for sparse approximation
A generalized Prony method for sparse approximation Gerlind Plonka and Thomas Peter Institute for Numerical and Applied Mathematics University of Göttingen Dolomites Research Week on Approximation September
More informationMean Convergence of Interpolation at Zeros of Airy Functions
Mean Convergence of Interpolation at Zeros of Airy Functions D. S. Lubinsky Abstract The classical Erdős-Turán theorem established mean convergence of Lagrange interpolants at zeros of orthogonal polynomials.
More informationJacobi-Angelesco multiple orthogonal polynomials on an r-star
M. Leurs Jacobi-Angelesco m.o.p. 1/19 Jacobi-Angelesco multiple orthogonal polynomials on an r-star Marjolein Leurs, (joint work with Walter Van Assche) Conference on Orthogonal Polynomials and Holomorphic
More informationHOW TO DEVELOP A TOP- TEN ALGORITHM IN THE 21ST CENTURY
HOW TO DEVELOP A TOP- TEN ALGORITHM IN THE 21ST CENTURY Alex Townsend Cornell University (A talk for fun. Audience participation encouraged.) DONGARRA S TOP10 LIST FROM 20TH CENTURY 1946: The Metropolis
More informationChebfun2: Exploring Constant Coefficient PDEs on Rectangles
Chebfun2: Exploring Constant Coefficient PDEs on Rectangles Alex Townsend Oxford University with Sheehan Olver, Sydney University FUN13 workshop, 11th of April 2013 Alex Townsend Constant coefficient PDEs
More informationx x2 2 + x3 3 x4 3. Use the divided-difference method to find a polynomial of least degree that fits the values shown: (b)
Numerical Methods - PROBLEMS. The Taylor series, about the origin, for log( + x) is x x2 2 + x3 3 x4 4 + Find an upper bound on the magnitude of the truncation error on the interval x.5 when log( + x)
More informationFast variants of the Golub and Welsch algorithm for symmetric weight functions
Fast variants of the Golub and Welsch algorithm for symmetric weight functions Gérard Meurant 3 rue du sergent Bauchat, 7512 Paris, France Alvise Sommariva University of Padua, Italy. Abstract In this
More informationA FAST SOLVER FOR ELLIPTIC EQUATIONS WITH HARMONIC COEFFICIENT APPROXIMATIONS
Proceedings of ALGORITMY 2005 pp. 222 229 A FAST SOLVER FOR ELLIPTIC EQUATIONS WITH HARMONIC COEFFICIENT APPROXIMATIONS ELENA BRAVERMAN, MOSHE ISRAELI, AND ALEXANDER SHERMAN Abstract. Based on a fast subtractional
More informationLecture 1: Introduction
CBMS Conference on Fast Direct Solvers Dartmouth College June June 7, 4 Lecture : Introduction Gunnar Martinsson The University of Colorado at Boulder Research support by: Many thanks to everyone who made
More informationNumerical Analysis Comprehensive Exam Questions
Numerical Analysis Comprehensive Exam Questions 1. Let f(x) = (x α) m g(x) where m is an integer and g(x) C (R), g(α). Write down the Newton s method for finding the root α of f(x), and study the order
More informationINTEGRAL TRANSFORMS and THEIR APPLICATIONS
INTEGRAL TRANSFORMS and THEIR APPLICATIONS Lokenath Debnath Professor and Chair of Mathematics and Professor of Mechanical and Aerospace Engineering University of Central Florida Orlando, Florida CRC Press
More informationOn Multivariate Newton Interpolation at Discrete Leja Points
On Multivariate Newton Interpolation at Discrete Leja Points L. Bos 1, S. De Marchi 2, A. Sommariva 2, M. Vianello 2 September 25, 2011 Abstract The basic LU factorization with row pivoting, applied to
More information(f(x) P 3 (x)) dx. (a) The Lagrange formula for the error is given by
1. QUESTION (a) Given a nth degree Taylor polynomial P n (x) of a function f(x), expanded about x = x 0, write down the Lagrange formula for the truncation error, carefully defining all its elements. How
More informationON INTERPOLATION AND INTEGRATION IN FINITE-DIMENSIONAL SPACES OF BOUNDED FUNCTIONS
COMM. APP. MATH. AND COMP. SCI. Vol., No., ON INTERPOLATION AND INTEGRATION IN FINITE-DIMENSIONAL SPACES OF BOUNDED FUNCTIONS PER-GUNNAR MARTINSSON, VLADIMIR ROKHLIN AND MARK TYGERT We observe that, under
More informationA Numerical Solution of the Lax s 7 th -order KdV Equation by Pseudospectral Method and Darvishi s Preconditioning
Int. J. Contemp. Math. Sciences, Vol. 2, 2007, no. 22, 1097-1106 A Numerical Solution of the Lax s 7 th -order KdV Equation by Pseudospectral Method and Darvishi s Preconditioning M. T. Darvishi a,, S.
More informationLecture 4.6: Some special orthogonal functions
Lecture 4.6: Some special orthogonal functions Matthew Macauley Department of Mathematical Sciences Clemson University http://www.math.clemson.edu/~macaule/ Math 4340, Advanced Engineering Mathematics
More informationStability of Krylov Subspace Spectral Methods
Stability of Krylov Subspace Spectral Methods James V. Lambers Department of Energy Resources Engineering Stanford University includes joint work with Patrick Guidotti and Knut Sølna, UC Irvine Margot
More informationOrthogonal polynomials
Orthogonal polynomials Gérard MEURANT October, 2008 1 Definition 2 Moments 3 Existence 4 Three-term recurrences 5 Jacobi matrices 6 Christoffel-Darboux relation 7 Examples of orthogonal polynomials 8 Variable-signed
More informationReconstruction of sparse Legendre and Gegenbauer expansions
BIT Numer Math 06 56:09 043 DOI 0.007/s0543-05-0598- Reconstruction of sparse Legendre and Gegenbauer expansions Daniel Potts Manfred Tasche Received: 6 March 04 / Accepted: 8 December 05 / Published online:
More informationAutomatica, 33(9): , September 1997.
A Parallel Algorithm for Principal nth Roots of Matrices C. K. Koc and M. _ Inceoglu Abstract An iterative algorithm for computing the principal nth root of a positive denite matrix is presented. The algorithm
More informationRecall that any inner product space V has an associated norm defined by
Hilbert Spaces Recall that any inner product space V has an associated norm defined by v = v v. Thus an inner product space can be viewed as a special kind of normed vector space. In particular every inner
More informationSECTION A. f(x) = ln(x). Sketch the graph of y = f(x), indicating the coordinates of any points where the graph crosses the axes.
SECTION A 1. State the maximal domain and range of the function f(x) = ln(x). Sketch the graph of y = f(x), indicating the coordinates of any points where the graph crosses the axes. 2. By evaluating f(0),
More informationFFTs for the 2-Sphere Improvements and Variations
FFTs for the -Sphere Improvements and Variations D.M. Healy Jr., D. Rockmore and P. J. Kostelec Department of Mathematics Dartmouth College Hanover, NH 03755 Sean S. B. Moore BBN Systems and Technologies
More informationOn the remainder term of Gauss Radau quadratures for analytic functions
Journal of Computational and Applied Mathematics 218 2008) 281 289 www.elsevier.com/locate/cam On the remainder term of Gauss Radau quadratures for analytic functions Gradimir V. Milovanović a,1, Miodrag
More informationPositive Denite Matrix. Ya Yan Lu 1. Department of Mathematics. City University of Hong Kong. Kowloon, Hong Kong. Abstract
Computing the Logarithm of a Symmetric Positive Denite Matrix Ya Yan Lu Department of Mathematics City University of Hong Kong Kowloon, Hong Kong Abstract A numerical method for computing the logarithm
More informationSPECIAL FUNCTIONS OF MATHEMATICS FOR ENGINEERS
SPECIAL FUNCTIONS OF MATHEMATICS FOR ENGINEERS Second Edition LARRY C. ANDREWS OXFORD UNIVERSITY PRESS OXFORD TOKYO MELBOURNE SPIE OPTICAL ENGINEERING PRESS A Publication of SPIE The International Society
More informationMATH 350: Introduction to Computational Mathematics
MATH 350: Introduction to Computational Mathematics Chapter V: Least Squares Problems Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Spring 2011 fasshauer@iit.edu MATH
More informationarxiv: v1 [cs.lg] 26 Jul 2017
Updating Singular Value Decomposition for Rank One Matrix Perturbation Ratnik Gandhi, Amoli Rajgor School of Engineering & Applied Science, Ahmedabad University, Ahmedabad-380009, India arxiv:70708369v
More informationQuadrature Based Approximations of Non-integer Order Integrator on Finite Integration Interval
Quadrature Based Approximations of Non-integer Order Integrator on Finite Integration Interval Jerzy Baranowski Abstract Implementation of non-integer order systems is the subject of an ongoing research.
More informationThe Fast Multipole Method: Numerical Implementation
Journal of Computational Physics 160, 195 240 (2000) doi:10.1006/jcph.2000.6451, available online at http://www.idealibrary.com on The Fast Multipole Method: Numerical Implementation Eric Darve Center
More informationNumerical Integration (Quadrature) Another application for our interpolation tools!
Numerical Integration (Quadrature) Another application for our interpolation tools! Integration: Area under a curve Curve = data or function Integrating data Finite number of data points spacing specified
More informationNumerische Mathematik
Numer. Math. (1998) 80: 39 59 Numerische Mathematik c Springer-Verlag 1998 Electronic Edition Numerical integration over a disc. A new Gaussian quadrature formula Borislav Bojanov 1,, Guergana Petrova,
More informationA Spectral Time-Domain Method for Computational Electrodynamics
A Spectral Time-Domain Method for Computational Electrodynamics James V. Lambers Abstract Block Krylov subspace spectral (KSS) methods have previously been applied to the variable-coefficient heat equation
More informationMultipole-Based Preconditioners for Sparse Linear Systems.
Multipole-Based Preconditioners for Sparse Linear Systems. Ananth Grama Purdue University. Supported by the National Science Foundation. Overview Summary of Contributions Generalized Stokes Problem Solenoidal
More information12.0 Properties of orthogonal polynomials
12.0 Properties of orthogonal polynomials In this section we study orthogonal polynomials to use them for the construction of quadrature formulas investigate projections on polynomial spaces and their
More informationarxiv: v3 [math.na] 30 Nov 2016
Fast Fourier Transforms for Spherical Gauss-Laguerre Basis Functions Jürgen Prestin and Christian Wüler arxiv:164.514v3 [math.na] 3 Nov 216 Abstract Spherical Gauss-Laguerre (SGL) basis functions, i.e.,
More information