Efficient Spherical Designs with Good Geometric Properties
|
|
- Miranda Williamson
- 5 years ago
- Views:
Transcription
1 Efficient Spherical Designs with Good Geometric Properties Rob Womersley, School of Mathematics and Statistics, University of New South Wales 45-design with N = 1059 and symmetrtic 45-deisgn with N = 1038 (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
2 Outline 1 Spherical designs Spheres and point sets Aims Spherical polynomials Number of points 2 Characterizations Nonlinear equations Variational characterizations Examples Evaluating A t,n,ψ (X N ) Degrees of freedom for S 2 Numerical results 3 Geometric properties Mesh norm Separation Mesh ratio 4 Conclusions (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
3 Spherical designs Spheres and point sets Unit sphere Unit sphere S d = { } x R d+1 : x = 1 Sets of points X N = {x 1,...,x N } S d d+1 x y = x i y i, x 2 = x x i=1 Distance Euclidean distance: x,y S d, x y 2 = 2(1 x y) Geodesic distance: x,y S d, dist(x,y) = arccos(x y) Can choose points or given points (scattered data) Want sequences of point sets X N, often as part of integration/approximation problem (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
4 Spherical designs Spheres and point sets Geometric quality of point set Spherical cap centre z S d, radius α { } C(z;α) = x S d : dist(x,z) α Separation (twice packing radius): δ XN = min i j Mesh norm (covering radius): Mesh ratio: ρ XN = 2h X N δ XN 1 h XN = max x S d dist(x i,x j ) min dist(x,x j) j=1,...,n Desire: ρ XN c (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
5 Spherical designs Aims Aims Numerical integration (cubature) Q N (f) := N w j f(x j ) I(f) := f(x)dω(x) S d j=1 Equal weights w j = S d /N,j = 1,...,N (Quasi Monte-Carlo rules) Degree of precision t if exact for all polynomials of degree t Spherical t-design is a set X N of N points such that 1 N N j=1 p(x j ) = 1 S d p(x)dω(x) p P t (S d ), S d N point, equal weight w j = Sd N Efficient: Low number of points N cubature rule, degree of precision t Good geometric properties: Quasi-uniform: Mesh ratio ρ X c (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
6 Spherical designs Spherical polynomials Spherical Polynomials Space P t P t ( S d ) of spherical polynomials of degree at most t Dimension of space of homogeneous harmonic polynomials of degree l Z(d,0) = 1; Z(d,l) = (2l+d 1)Γ(l+d 1), Γ(d)Γ(l+1) Orthonormal basis Y l,k, l = 0,1,2,..., k = 1,...,Z(d,l) Dimension P t ( S d ) is D(d,t) = Z(d+1,t) t d Addition Theorem Z(d,l) k=1 Y l,k (x)y l,k (y) = Z(d,l) S d Normalized Gegenbauer polynomial P (d+1) l Jacobi polynomial P (α,β) l (z) for z [ 1,1] P (d+1) l (x y), 2,d 2 2 ) (z) P (d 2 2,d 2 2 ) l (1) P(d 2 l (z) = (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
7 Spherical designs Number of points Spherical t-designs Number of points N Delsarte, Goethals and Seidel (1977)N point t-design on S d 2 ( d+m) N N d if t = 2m+1, (d,t) := ( d+m ) ( d + d+m 1 ) d if t = 2m. Positive weight cubature, degree of precision t = N dimp t/2 (S d ) On S 2 : N (2,t) = (t+1)(t+3)/4 for t odd; (t+2) 2 /4 for t even Improved by Yudin (1997) by exponential factor (e/4) d+1 as t. Bannai and Damerell (1979, 1980) Tight spherical t-designs if achieve lower bounds Cannot exist on S 2 except for t = 1,2,3,5 Seymour and Zaslavsky (1984) t-designs exist for N sufficiently large Bondarenko, Radchenko and Viazovska (2011, 2013, 2015) On S d spherical t-designs exist for N c d t d well-separated spherical t-designs exist for N c d td (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
8 Spherical designs Number of points Existence Results for S 2 Bajnok (1991)construction with N = O(t 3 ) n points z 1,...,z n, t-design on [ 1,1] Regular m-gon at latitudes z j N = mn point t-design if m t+1 Korevaar and Meyers (1993) N = O(t 3 ) Both depend on t-designs for interval [ 1, 1] Set of n points z j [ 1,1]: 2 n n p(z j ) = j=1 1 1 Equal weights = n = O(t 2 ) points Survey Gautschi (2004) p(z)dz p P t ([ 1,1]) Tensor product constructions based on 1-D existence result (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
9 Spherical designs Number of points Evidence for S 2 Hardin and Sloane (1996) Summary of known results for S 2 Conjecture N = t2 2 (1+o(1)) N = (t+1) 2 = dim ( P t (S 2 ) ) Start from extremal (maximum determinant) points Sloan, W. (2004) Under-determined system of equations Use interval methods to verify a nearby solution Chen and W. (2006) Chen, Frommer, Lang (2009) An, Chen, Sloan, W. (2010) (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
10 Spherical designs Number of points Number of points, dimension of space D(d,t) = dimension of space of polynomials of degree t on S d DGS lower bound N (d,t) Ratio of leading terms of D(d,t)/N (d,t) = 2 d Efficient if N < D(d,t) d N (d,t) N D(d,t) 2 t 2 4 +t+o(1) (t+1)2 3 t t2 8 +O(t) t 3 3 +O(t2 ) 4 t t3 12 +O(t2 ) t O(t3 ) 5 t t O(t3 ) t O(t4 ) (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
11 Spherical designs Number of points Spherical Harmonic Basis matrix Spherical Harmonic Basis matrix [ Y0,1 e T Y = Ŷ ] R D(d,t) N Rows = basis functions, Columns = points e = (1,1,...,1) T R N Consider case N D(d,t) Gram matrix Addition Theorem implies t G ii = G = Y T Y = Y 2 0,1 eet +ŶT Ŷ R N N l=0 Z(d, l) S d P (d+1) l (x i x i ) = D(d,t) S d Fixed diagonal elements so trace(g) = ND(d,t) S d constant (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
12 Characterizations Nonlinear equations Spherical designs nonlinear equations Delsarte, Goethals and Seidel (1977) X N = {x 1,...,x N } S d is a spherical t-design if and only if r l,k (X N ) := N Y l,k (x j ) = 0 j=1 for k = 1,...,Z(d,l), l = 1,...,t. Constant (l = 0) polynomial Y 0,1 = 1/ S d not included in (12) Integral of all spherical harmonics of degree l 1 is zero Weyl sums: In matrix form r(x N ) := Ŷe = 0 e = (1,...,1) T R N Ŷ R D(d,t) 1 N, Spherical harmonic basis matrix excluding first row (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
13 Characterizations Variational characterizations Polynomials with positive Legendre coefficients Polynomial ψ t P t [ 1,1] with positive coefficients ψ t (z) := t l=1 a t,l P (τ,τ) l (z), a t,l > 0 for l = 1,...,t. P (τ,τ) l (z) for z [ 1,1] Jacobi polynomial, parameter τ = d ψ t(z)dz = 0 Variational form A t,n,ψ (X N ) := 1 N 2 N i=1 j=1 N ψ t (x i x j ) (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
14 Characterizations Variational characterizations Spherical designs variational characterizations t 1, X N = {x 1,...,x N } S d, Then 0 A t,n,ψ (X N ) t a t,l = ψ t (1) 1 A t,n,ψ := ( S d ) N A t,n,ψ (x 1,...,x N )dω(x 1 ) dω(x N ) = ψ t(1) S d S d N X N is a spherical design if and only if l=1 A t,n,ψ (X N ) = 0. Weighted sum of squares, strictly positive coefficients A t,n,ψ (X N ) = Sd N 2 t l=1 Z(d,l) a t,l (r l,k (X N )) 2 Z(d, l) A t,n,ψ (X N ) = 0 X N spherical t-design Global min A t,n,ψ (X N ) > 0 = no spherical t-design with N points (Shanghai Jiao Tong University) Efficient spherical designs April, / 34 k=1
15 Characterizations Examples Examples Grabner and Tichy (1993) Cohn and Kumar (2007) Sloan and W. (2009) P (1,0) t ψ t (z) = z t +z t 1 a t,0 { 1 t t odd, a t,0 = 1 t+1 t even. ψ t (z) = (1+z) t 2t t+1. ψ t (z) = 1 4π P(1,0) t (z) 1 = Jacobi polynomial t Z(d,l)P l (z) (Shanghai Jiao Tong University) Efficient spherical designs April, / 34 l=1
16 Characterizations Evaluating A t,n,ψ (X N ) Evaluating A t,n,ψ (X N ) Matrix Ψ: Ψ ij = ψ t (x i x j ), i,j = 1,...,N Spherical t-design D(d, t) 1 equations Diagonal matrix D of weights r := Ŷe = 0, Ψ = S d ŶT DŶ ( ) at,l D = diag,k = 1,...,Z(d,l),l = 1,...,t Z(d,l) Any symmetric positive definite D possible Minimize A t,n,ψ (X N ) = 1 N 2eT Ψe = Sd N 2 et Ŷ T DŶe = Sd N 2 rt Dr (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
17 Characterizations Evaluating A t,n,ψ (X N ) Evaluating A t,n,ψ (X N ) using Ψ N by N matrix Ψ ij = ψ t (x i x j ) Constant diagonal elements ψ t (1) = t l=1 a t,l Matrix Ψ for a t,l = Z(d,l) D = I Advantages: simple, (trivially) parallel Issue: cancelation errors in summing off diagonal elements (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
18 Characterizations Degrees of freedom for S 2 Degrees of freedom for S 2 Spherical parametrization, normalization = n = 2N 3 variables m = dim(p t ) 1 = (t+1) 2 1 equations Threshold n m = N N(2,t) := (t+1) 2 )/2 +1 N less than twice the DGS lower bound N 2N (2,t) N(2,t) = t, Sum of squares for t = 19, varying N, N(2,19) = Residual SSQ r T r for t = Number of points N (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
19 Characterizations Degrees of freedom for S 2 Symmetric designs Exploit symmetry to reduce conditions: Sobolev (1962) Symmetric: N even, x X N x X N Equal weights, l odd = Y l,k integrated exactly Constraints from even degrees t, t odd m = (t 1)/2 k=1 2(2k)+1 = (t 1)(t+2) 2 N = 2K points = 2K 3 = N 3 degrees of freedom Degrees of freedom number of equations = t 2 +t+4 N N(2,t) := 2 4 Slightly less than N(2,t) 2N (2,t) N(2,t) = 3 2 t { 3 2 if mod (t,4) = 1, 1 2 if mod (t,4) = 3. (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
20 Characterizations Degrees of freedom for S 2 Degrees of freedom S d S d R d+1 : Spherical parametrization = d variables N points x j,j = 1,...,N = Nd variables Orthogonal invariance = Qx j so d(d+1)/2 zero elements Number of variables n = Nd d(d+1)/2 Number of equations for t-design m = t Z(d,l) = Z(d+1,t) 1 l=1 Number of variables number of conditions = N(d,t) Symmetric point set (both x j, x j in set) automatically integrates odd degree polynomial = N(d,t) (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
21 Characterizations Degrees of freedom for S 2 Number of points, dimension of space D(d,t) = dimension of space of polynomials of degree t on S d DGS lower bound N (d,t) N(d,t) ensures n m N(d,t) ensures symmetric point set has n m Ratio of leading terms of D(d,t)/ N(d,t) = d d N (d,t) N(d,t) N(d,t) D(d,t) 2 t 2 4 +t+o(1) t t 2 +O(1) t 2 2 +t+o(1) (t+1)2 3 t t2 8 +O(t) t t2 3 +O(t) t t2 2 +O(t) t 3 3 +O(t2 ) 4 t t3 12 +O(t2 ) t t3 8 +O(t2 ) t t3 6 +O(t2 ) t O(t3 ) 5 t t O(t3 ) t t4 30 +)(t3 ) t t4 24 +)(t3 ) t O(t4 ) (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
22 Characterizations Degrees of freedom for S 2 Least squares Spherical parametrization of variables x R n Residuals r : R n R m, m = t l=1 Z(d,l) Number of points chosen so n = m or n = m+1. Sum of squares objective f(x) = r(x) T r(x) = m i=1 [r i(x)] 2 Jacobian A(x) R m n Gradient f(x) = 2A(x)r(x) Hessian 2 f(x) = 2A(x) T A(x)+2 m i=1 r i(x) 2 r i (x) r(x ) = 0 and A(x ) rank n = strict (isloated) global minimum n > m have some freedom Algorithm: Levenberg-Marquardt (A T A+λI)d = A T r Issues Singular Jacobians A(x) Stuck with f(x) = 0 but f(x) > 0, perhaps small Different solutions: depends on starting point, algorithm parameters,... (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
23 Characterizations Numerical results Spherical designs - numerical results Use N = N(2,t), = t odd, n = m, t even, n = m+1 Rounding error limits achievable accuracy in A t,n Both A t,n,ψ (X N ), r T r order of rounding error = what confidence? t = 180 = N(2,t) = 16382, m = 32760, n = Residual ssq for spherical t-designs Degree t (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
24 Characterizations Numerical results Spherical designs - rate of convergence Rate of convergence: t = 45, N = 1059, m = 2115, n = 2115 SSQ for t = 45, N = 1059, m = 2115, n = Sum of squares Iterations (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
25 Characterizations Numerical results Spherical designs - Jacobian singular values Jacobian singular values: t = 45, N = 1059, m = 2115, n = Jacobian singular values: t = 45, N = 1059, m = 2115, n = (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
26 Characterizations Numerical results Symmetric spherical designs - numerical results For t odd, use N = N(2,t) mod (t,4) = 3 = n = m, mod (t,4) = 1 = n = m+1 t = 277 = N(2,t) = 38506, m = 38502, n = Symmetric spherical t-designs, SSQ Degree t (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
27 Geometric properties Mesh norm Mesh norm Mesh norm (covering radius) h XN = max x S 2 min dist(x,x j) c cov j=1,...,n N Yudin (1995) Mesh norm h given by largest zero z t = cos(h) of P (1,0) (z) Reimer (2003) extended to any positive weight cubature rule with degree of precision t Spherical t desgins, Mesh norm Mesh norm h(x N ) N Number of points N (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
28 Geometric properties Separation Separation Separation (twice packing radius) δ XN = min i j dist(x i,x j ) c pack N Union of two spherical t-designs is a spherical t-design X N QX N is 2N point spherical t-design with arbitrary separation N < 2N, N < 2N so cannot occur If N sufficiently small get separation? Spherical t desgins, Separation Separation δ(x N ) N Number of points N (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
29 Geometric properties Mesh ratio Mesh ratio Mesh ratio ρ XN = 2h X N Covering radius = δ XN Packing radius 1 ρ XN bounded = X N quasi-uniform Spherical t-designs with N points 2 Spherical t-designs, Mesh ratio Degree t (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
30 Geometric properties Mesh ratio Mesh ratio - Symmetric t-designs Mesh ratio for symmetric t-designs with N points 2 Symmetric spherical t-designs, Mesh ratio Degree t Converge to different spherical designs from different starting points If n = m, r = 0 and σ n (A ) > 0 = strict global minimizer If n = m+1 use freedom to reduce mesh ratio (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
31 Geometric properties Mesh ratio Reducing mesh ratio - one degree of freedom Symmetric 53-design: n v = 1431, n c = 1430, tangent to r = 0, SSQ Symmetric 53-design: n v = 1431, n c = 1430, tangent to r = 0, RHO (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
32 Geometric properties Mesh ratio Reducing mesh ratio - isolated zero Symmetric 55-design, n v = 1539, n c = 1539, σ 1538 = 1.46e-01, SSQ Symmetric 55-design, n v = 1539, n c = 1539, σ 1538 = 1.46e-01, RHO (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
33 Geometric properties Mesh ratio Starting points Close to spherical design (low sums of squares) Good mesh ratio Generalized spiral points Equal area points 9000 Symmetric equal areas points: SSQ 2 Symmetric equal areas points: Mesh ratio Degree t (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
34 Conclusions Conclusions Efficient sets of (numerical) t-designs for S 2 Equal weight cubature rule, degree of precision t with N = (t 2 +2t)/2+O(1) points for t = 1,...,180 Symmetric equal weight cubature rule, degree of precision t with N = (t 2 +t)/2+o(1) points for t = 1,...,277 Good geometric properties: mesh norm, separation, mesh ratio < 1.8 Larger N: Use extra degrees of freedom to satisfy other criteria Issues Rounding errors in evaluating criteria, speed of extended precision Convergence difficulties with close to singular Jacobians No proof of nearby exact spherical designs when N < (t+1) 2 No proof of existence for all t There exist t-designs with N < N(d,t); special symmetries Calculation by optimization for each t, N Finding points sets with better mesh ratio ad-hoc Point sets X N not nested Higher dimensions d (Shanghai Jiao Tong University) Efficient spherical designs April, / 34
Spherical designs with close to the minimal number of points 1
Spherical designs with close to the minimal number of points Robert S. Womersley School of Mathematics and Statistics, University of New South Wales, Sydney, NSW, 05, Australia Abstract In this paper we
More informationQMC designs and covering of spheres by spherical caps
QMC designs and covering of spheres by spherical caps Ian H. Sloan University of New South Wales, Sydney, Australia Joint work with Johann Brauchart, Josef Dick, Ed Saff (Vanderbilt), Rob Womersley and
More informationSpherical t ɛ -Design for Numerical Approximations on the Sphere, I
Spherical t ɛ -Design for Numerical Approximations on the Sphere, I Xiaojun Chen Department of Applied Mathematics The Hong Kong Polytechnic University April 2015, Shanghai Jiaotong University X. Chen
More informationNumerical Integration over unit sphere by using spherical t-designs
Numerical Integration over unit sphere by using spherical t-designs Congpei An 1 1,Institute of Computational Sciences, Department of Mathematics, Jinan University Spherical Design and Numerical Analysis
More informationSpherical designs and some generalizations : An overview
Spherical designs and some generalizations : An overview Eiichi Bannai Shanghai Jiao Tong University 2015 April 21 Workshop on spherical designs and numerical analysis Shanghai, China Spherical t-designs
More informationc 2010 Society for Industrial and Applied Mathematics
SIAM J. NUMER. ANAL. Vol. 48, No. 6, pp. 2135 2157 c 2010 Society for Industrial and Applied Mathematics WELL CONDITIONED SPHERICAL DESIGNS FOR INTEGRATION AND INTERPOLATION ON THE TWO-SPHERE CONGPEI AN,
More informationLinear Algebra Massoud Malek
CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product
More informationPolynomial interpolation on the sphere, reproducing kernels and random matrices
Polynomial interpolation on the sphere, reproducing kernels and random matrices Paul Leopardi Mathematical Sciences Institute, Australian National University. For presentation at MASCOS Workshop on Stochastics
More informationQuadrature using sparse grids on products of spheres
Quadrature using sparse grids on products of spheres Paul Leopardi Mathematical Sciences Institute, Australian National University. For presentation at ANZIAM NSW/ACT Annual Meeting, Batemans Bay. Joint
More informationLow-discrepancy point sets lifted to the unit sphere
Low-discrepancy point sets lifted to the unit sphere Johann S. Brauchart School of Mathematics and Statistics, UNSW MCQMC 2012 (UNSW) February 17 based on joint work with Ed Saff (Vanderbilt) and Josef
More informationComputational Methods. Least Squares Approximation/Optimization
Computational Methods Least Squares Approximation/Optimization Manfred Huber 2011 1 Least Squares Least squares methods are aimed at finding approximate solutions when no precise solution exists Find the
More informationOn Euclidean designs and potential energy
On Euclidean designs and potential energy Tsuyoshi Miezaki Department of Mathematics Oita National College of Technology Oita, 870 0152, Japan miezaki@oita-ct.ac.jp Makoto Tagami Department of Mechanical
More informationDelsarte-Yudin LP method and Universal Lower Bound on energy
Peter Dragnev, IPFW Delsarte-Yudin LP method and Universal Lower Bound on energy Peter Dragnev Indiana University-Purdue University Fort Wayne Joint work with: P. Boyvalenkov (BAS); D. Hardin, E. Saff
More informationMATH 304 Linear Algebra Lecture 18: Orthogonal projection (continued). Least squares problems. Normed vector spaces.
MATH 304 Linear Algebra Lecture 18: Orthogonal projection (continued). Least squares problems. Normed vector spaces. Orthogonality Definition 1. Vectors x,y R n are said to be orthogonal (denoted x y)
More informationApproximate Fekete points and discrete Leja points based on equal area partitions of the unit sphere
Approximate Fekete points and discrete Leja points based on equal area partitions of the unit sphere Paul Leopardi Mathematical Sciences Institute, Australian National University. For presentation at Computational
More informationMATH 304 Linear Algebra Lecture 19: Least squares problems (continued). Norms and inner products.
MATH 304 Linear Algebra Lecture 19: Least squares problems (continued). Norms and inner products. Orthogonal projection Theorem 1 Let V be a subspace of R n. Then any vector x R n is uniquely represented
More informationQuadrature using sparse grids on products of spheres
Quadrature using sparse grids on products of spheres Paul Leopardi Mathematical Sciences Institute, Australian National University. For presentation at 3rd Workshop on High-Dimensional Approximation UNSW,
More informationLEGENDRE POLYNOMIALS AND APPLICATIONS. We construct Legendre polynomials and apply them to solve Dirichlet problems in spherical coordinates.
LEGENDRE POLYNOMIALS AND APPLICATIONS We construct Legendre polynomials and apply them to solve Dirichlet problems in spherical coordinates.. Legendre equation: series solutions The Legendre equation is
More informationNumerical Analysis Comprehensive Exam Questions
Numerical Analysis Comprehensive Exam Questions 1. Let f(x) = (x α) m g(x) where m is an integer and g(x) C (R), g(α). Write down the Newton s method for finding the root α of f(x), and study the order
More informationNumerical Minimization of Potential Energies on Specific Manifolds
Numerical Minimization of Potential Energies on Specific Manifolds SIAM Conference on Applied Linear Algebra 2012 22 June 2012, Valencia Manuel Gra f 1 1 Chemnitz University of Technology, Germany, supported
More informationQUADRATURE ON A SPHERICAL SURFACE CASPER H. L. BEENTJES. Mathematical Institute, University of Oxford, Oxford, UK
QUADRATURE O A SPHERICAL SURFACE CASPER H. L. BEETJES Mathematical Institute, University of Oxford, Oxford, UK Abstract. Approximately calculating integrals over spherical surfaces in R 3 can be done by
More informationManning & Schuetze, FSNLP (c) 1999,2000
558 15 Topics in Information Retrieval (15.10) y 4 3 2 1 0 0 1 2 3 4 5 6 7 8 Figure 15.7 An example of linear regression. The line y = 0.25x + 1 is the best least-squares fit for the four points (1,1),
More informationFitting Linear Statistical Models to Data by Least Squares II: Weighted
Fitting Linear Statistical Models to Data by Least Squares II: Weighted Brian R. Hunt and C. David Levermore University of Maryland, College Park Math 420: Mathematical Modeling April 21, 2014 version
More informationLocal radial basis function approximation on the sphere
Local radial basis function approximation on the sphere Kerstin Hesse and Q. T. Le Gia School of Mathematics and Statistics, The University of New South Wales, Sydney NSW 05, Australia April 30, 007 Abstract
More informationCALCULUS ON MANIFOLDS. 1. Riemannian manifolds Recall that for any smooth manifold M, dim M = n, the union T M =
CALCULUS ON MANIFOLDS 1. Riemannian manifolds Recall that for any smooth manifold M, dim M = n, the union T M = a M T am, called the tangent bundle, is itself a smooth manifold, dim T M = 2n. Example 1.
More information1. Let r, s, t, v be the homogeneous relations defined on the set M = {2, 3, 4, 5, 6} by
Seminar 1 1. Which ones of the usual symbols of addition, subtraction, multiplication and division define an operation (composition law) on the numerical sets N, Z, Q, R, C? 2. Let A = {a 1, a 2, a 3 }.
More informationPositive Definite Matrix
1/29 Chia-Ping Chen Professor Department of Computer Science and Engineering National Sun Yat-sen University Linear Algebra Positive Definite, Negative Definite, Indefinite 2/29 Pure Quadratic Function
More informationUnconstrained optimization
Chapter 4 Unconstrained optimization An unconstrained optimization problem takes the form min x Rnf(x) (4.1) for a target functional (also called objective function) f : R n R. In this chapter and throughout
More informationFFTs in Graphics and Vision. Homogenous Polynomials and Irreducible Representations
FFTs in Graphics and Vision Homogenous Polynomials and Irreducible Representations 1 Outline The 2π Term in Assignment 1 Homogenous Polynomials Representations of Functions on the Unit-Circle Sub-Representations
More informationMath 291-2: Final Exam Solutions Northwestern University, Winter 2016
Math 29-2: Final Exam Solutions Northwestern University, Winter 206 Determine whether each of the following statements is true or false f it is true, explain why; if it is false, give a counterexample
More informationOrthogonal Transformations
Orthogonal Transformations Tom Lyche University of Oslo Norway Orthogonal Transformations p. 1/3 Applications of Qx with Q T Q = I 1. solving least squares problems (today) 2. solving linear equations
More informationMethods that avoid calculating the Hessian. Nonlinear Optimization; Steepest Descent, Quasi-Newton. Steepest Descent
Nonlinear Optimization Steepest Descent and Niclas Börlin Department of Computing Science Umeå University niclas.borlin@cs.umu.se A disadvantage with the Newton method is that the Hessian has to be derived
More informationMATH 4211/6211 Optimization Constrained Optimization
MATH 4211/6211 Optimization Constrained Optimization Xiaojing Ye Department of Mathematics & Statistics Georgia State University Xiaojing Ye, Math & Stat, Georgia State University 0 Constrained optimization
More informationDiscrepancies of Point Sequences on the Sphere and Numerical Integration
Discrepancies of Point Sequences on the Sphere and umerical Integration Peter J. Grabner, Bernhard Klinger and Robert F. Tichy Abstract Several concepts of discrepancy for point sequences on the d-dimensional
More informationMathematical Tripos Part IA Lent Term Example Sheet 1. Calculate its tangent vector dr/du at each point and hence find its total length.
Mathematical Tripos Part IA Lent Term 205 ector Calculus Prof B C Allanach Example Sheet Sketch the curve in the plane given parametrically by r(u) = ( x(u), y(u) ) = ( a cos 3 u, a sin 3 u ) with 0 u
More informationSpherical Designs in Four Dimensions (Extended Abstract)
Spherical Designs in Four Dimensions (Extended Abstract) N. J. A. Sloane AT&T Shannon Labs Florham Park NJ 07932-097 USA njas@research.att.com R. H. Hardin 227 Glenn Drive Pataskala OH 43062 USA rhh@cadence.com
More informationLinear Algebra Practice Problems
Linear Algebra Practice Problems Page of 7 Linear Algebra Practice Problems These problems cover Chapters 4, 5, 6, and 7 of Elementary Linear Algebra, 6th ed, by Ron Larson and David Falvo (ISBN-3 = 978--68-78376-2,
More informationNumerical solution of Least Squares Problems 1/32
Numerical solution of Least Squares Problems 1/32 Linear Least Squares Problems Suppose that we have a matrix A of the size m n and the vector b of the size m 1. The linear least square problem is to find
More informationSparse grid quadrature on products of spheres
Sparse grid quadrature on products of spheres Markus Hegland a, Paul Leopardi a, a Centre for Mathematics and its Applications, Australian National University. Abstract This paper examines sparse grid
More information256 Summary. D n f(x j ) = f j+n f j n 2n x. j n=1. α m n = 2( 1) n (m!) 2 (m n)!(m + n)!. PPW = 2π k x 2 N + 1. i=0?d i,j. N/2} N + 1-dim.
56 Summary High order FD Finite-order finite differences: Points per Wavelength: Number of passes: D n f(x j ) = f j+n f j n n x df xj = m α m dx n D n f j j n= α m n = ( ) n (m!) (m n)!(m + n)!. PPW =
More informationPhysics 411 Lecture 7. Tensors. Lecture 7. Physics 411 Classical Mechanics II
Physics 411 Lecture 7 Tensors Lecture 7 Physics 411 Classical Mechanics II September 12th 2007 In Electrodynamics, the implicit law governing the motion of particles is F α = m ẍ α. This is also true,
More informationKernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt.
SINGAPORE SHANGHAI Vol TAIPEI - Interdisciplinary Mathematical Sciences 19 Kernel-based Approximation Methods using MATLAB Gregory Fasshauer Illinois Institute of Technology, USA Michael McCourt University
More informationNumerical Methods I Non-Square and Sparse Linear Systems
Numerical Methods I Non-Square and Sparse Linear Systems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fall 2014 September 25th, 2014 A. Donev (Courant
More informationImplicit Functions, Curves and Surfaces
Chapter 11 Implicit Functions, Curves and Surfaces 11.1 Implicit Function Theorem Motivation. In many problems, objects or quantities of interest can only be described indirectly or implicitly. It is then
More informationLaplace s Equation. Chapter Mean Value Formulas
Chapter 1 Laplace s Equation Let be an open set in R n. A function u C 2 () is called harmonic in if it satisfies Laplace s equation n (1.1) u := D ii u = 0 in. i=1 A function u C 2 () is called subharmonic
More informationHyperuniformity on the Sphere
Hyperuniformity on the Sphere Johann S. Brauchart j.brauchart@tugraz.at 14. June 2018 Week 2 Workshop MATRIX Research Program "On the Frontiers of High Dimensional Computation" MATRIX, Creswick [ 1 / 56
More informationNumerical Methods - Numerical Linear Algebra
Numerical Methods - Numerical Linear Algebra Y. K. Goh Universiti Tunku Abdul Rahman 2013 Y. K. Goh (UTAR) Numerical Methods - Numerical Linear Algebra I 2013 1 / 62 Outline 1 Motivation 2 Solving Linear
More informationLecture 17 Methods for System of Linear Equations: Part 2. Songting Luo. Department of Mathematics Iowa State University
Lecture 17 Methods for System of Linear Equations: Part 2 Songting Luo Department of Mathematics Iowa State University MATH 481 Numerical Methods for Differential Equations Songting Luo ( Department of
More informationDesign theory from the viewpoint of algebraic combinatorics
Design theory from the viewpoint of algebraic combinatorics Eiichi Bannai Shanghai Jiao Tong University May 27, 2017, at 9SHCC This talk is based on the paper: Eiichi Bannai, Etsuko Bannai, Hajime Tanaka,
More informationMODULE 8 Topics: Null space, range, column space, row space and rank of a matrix
MODULE 8 Topics: Null space, range, column space, row space and rank of a matrix Definition: Let L : V 1 V 2 be a linear operator. The null space N (L) of L is the subspace of V 1 defined by N (L) = {x
More informationModule 2: Reflecting on One s Problems
MATH55 Module : Reflecting on One s Problems Main Math concepts: Translations, Reflections, Graphs of Equations, Symmetry Auxiliary ideas: Working with quadratics, Mobius maps, Calculus, Inverses I. Transformations
More informationCOMP 558 lecture 18 Nov. 15, 2010
Least squares We have seen several least squares problems thus far, and we will see more in the upcoming lectures. For this reason it is good to have a more general picture of these problems and how to
More informationLinear Algebra. Session 12
Linear Algebra. Session 12 Dr. Marco A Roque Sol 08/01/2017 Example 12.1 Find the constant function that is the least squares fit to the following data x 0 1 2 3 f(x) 1 0 1 2 Solution c = 1 c = 0 f (x)
More informationQualifying Exams I, Jan where µ is the Lebesgue measure on [0,1]. In this problems, all functions are assumed to be in L 1 [0,1].
Qualifying Exams I, Jan. 213 1. (Real Analysis) Suppose f j,j = 1,2,... and f are real functions on [,1]. Define f j f in measure if and only if for any ε > we have lim µ{x [,1] : f j(x) f(x) > ε} = j
More informationMATH 205C: STATIONARY PHASE LEMMA
MATH 205C: STATIONARY PHASE LEMMA For ω, consider an integral of the form I(ω) = e iωf(x) u(x) dx, where u Cc (R n ) complex valued, with support in a compact set K, and f C (R n ) real valued. Thus, I(ω)
More informationProgramming, numerics and optimization
Programming, numerics and optimization Lecture C-3: Unconstrained optimization II Łukasz Jankowski ljank@ippt.pan.pl Institute of Fundamental Technological Research Room 4.32, Phone +22.8261281 ext. 428
More informationMath Introduction to Numerical Analysis - Class Notes. Fernando Guevara Vasquez. Version Date: January 17, 2012.
Math 5620 - Introduction to Numerical Analysis - Class Notes Fernando Guevara Vasquez Version 1990. Date: January 17, 2012. 3 Contents 1. Disclaimer 4 Chapter 1. Iterative methods for solving linear systems
More informationApplied Mathematics 205. Unit II: Numerical Linear Algebra. Lecturer: Dr. David Knezevic
Applied Mathematics 205 Unit II: Numerical Linear Algebra Lecturer: Dr. David Knezevic Unit II: Numerical Linear Algebra Chapter II.3: QR Factorization, SVD 2 / 66 QR Factorization 3 / 66 QR Factorization
More informationg(t) = f(x 1 (t),..., x n (t)).
Reading: [Simon] p. 313-333, 833-836. 0.1 The Chain Rule Partial derivatives describe how a function changes in directions parallel to the coordinate axes. Now we shall demonstrate how the partial derivatives
More informationCS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares
CS 542G: Robustifying Newton, Constraints, Nonlinear Least Squares Robert Bridson October 29, 2008 1 Hessian Problems in Newton Last time we fixed one of plain Newton s problems by introducing line search
More informationWritten Examination
Division of Scientific Computing Department of Information Technology Uppsala University Optimization Written Examination 202-2-20 Time: 4:00-9:00 Allowed Tools: Pocket Calculator, one A4 paper with notes
More informationProduct of P-polynomial association schemes
Product of P-polynomial association schemes Ziqing Xiang Shanghai Jiao Tong University Nov 19, 2013 1 / 20 P-polynomial association scheme Definition 1 P-polynomial association scheme A = (X, {A i } 0
More informationThe nonsmooth Newton method on Riemannian manifolds
The nonsmooth Newton method on Riemannian manifolds C. Lageman, U. Helmke, J.H. Manton 1 Introduction Solving nonlinear equations in Euclidean space is a frequently occurring problem in optimization and
More informationECEN 615 Methods of Electric Power Systems Analysis Lecture 18: Least Squares, State Estimation
ECEN 615 Methods of Electric Power Systems Analysis Lecture 18: Least Squares, State Estimation Prof. om Overbye Dept. of Electrical and Computer Engineering exas A&M University overbye@tamu.edu Announcements
More informationExtremal systems of points and numerical integration on the sphere
Advances in Computational Mathematics 21: 107 125, 2004. 2004 Kluwer Academic Publishers. Printed in the Netherlands. Extremal systems of points and numerical integration on the sphere Ian H. Sloan and
More informationEE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 17
EE/ACM 150 - Applications of Convex Optimization in Signal Processing and Communications Lecture 17 Andre Tkacenko Signal Processing Research Group Jet Propulsion Laboratory May 29, 2012 Andre Tkacenko
More informationA continuous minimax problem for calculating minimum norm polynomial interpolation points on the sphere
ANZIAM J. 42 (E) ppc1536 C1557, 2000 C1536 A continuous minimax problem for calculating minimum norm polynomial interpolation points on the sphere Robert S. Womersley (Received 7 August 2000) Abstract
More informationMathematics of Physics and Engineering II: Homework problems
Mathematics of Physics and Engineering II: Homework problems Homework. Problem. Consider four points in R 3 : P (,, ), Q(,, 2), R(,, ), S( + a,, 2a), where a is a real number. () Compute the coordinates
More informationConceptual Questions for Review
Conceptual Questions for Review Chapter 1 1.1 Which vectors are linear combinations of v = (3, 1) and w = (4, 3)? 1.2 Compare the dot product of v = (3, 1) and w = (4, 3) to the product of their lengths.
More informationYURI LEVIN, MIKHAIL NEDIAK, AND ADI BEN-ISRAEL
Journal of Comput. & Applied Mathematics 139(2001), 197 213 DIRECT APPROACH TO CALCULUS OF VARIATIONS VIA NEWTON-RAPHSON METHOD YURI LEVIN, MIKHAIL NEDIAK, AND ADI BEN-ISRAEL Abstract. Consider m functions
More informationMath 5630: Iterative Methods for Systems of Equations Hung Phan, UMass Lowell March 22, 2018
1 Linear Systems Math 5630: Iterative Methods for Systems of Equations Hung Phan, UMass Lowell March, 018 Consider the system 4x y + z = 7 4x 8y + z = 1 x + y + 5z = 15. We then obtain x = 1 4 (7 + y z)
More information13. Nonlinear least squares
L. Vandenberghe ECE133A (Fall 2018) 13. Nonlinear least squares definition and examples derivatives and optimality condition Gauss Newton method Levenberg Marquardt method 13.1 Nonlinear least squares
More informationAlgebra C Numerical Linear Algebra Sample Exam Problems
Algebra C Numerical Linear Algebra Sample Exam Problems Notation. Denote by V a finite-dimensional Hilbert space with inner product (, ) and corresponding norm. The abbreviation SPD is used for symmetric
More informationIterative methods for Linear System
Iterative methods for Linear System JASS 2009 Student: Rishi Patil Advisor: Prof. Thomas Huckle Outline Basics: Matrices and their properties Eigenvalues, Condition Number Iterative Methods Direct and
More informationwhich arises when we compute the orthogonal projection of a vector y in a subspace with an orthogonal basis. Hence assume that P y = A ij = x j, x i
MODULE 6 Topics: Gram-Schmidt orthogonalization process We begin by observing that if the vectors {x j } N are mutually orthogonal in an inner product space V then they are necessarily linearly independent.
More informationThe Conjugate Gradient Method
CHAPTER The Conjugate Gradient Method Exercise.: A-norm Let A = LL be a Cholesy factorization of A, i.e.l is lower triangular with positive diagonal elements. The A-norm then taes the form x A = p x T
More informationOrthogonality. 6.1 Orthogonal Vectors and Subspaces. Chapter 6
Chapter 6 Orthogonality 6.1 Orthogonal Vectors and Subspaces Recall that if nonzero vectors x, y R n are linearly independent then the subspace of all vectors αx + βy, α, β R (the space spanned by x and
More informationSphere packing, lattice packing, and related problems
Sphere packing, lattice packing, and related problems Abhinav Kumar Stony Brook April 25, 2018 Sphere packings Definition A sphere packing in R n is a collection of spheres/balls of equal size which do
More informationChapter 3 Numerical Methods
Chapter 3 Numerical Methods Part 2 3.2 Systems of Equations 3.3 Nonlinear and Constrained Optimization 1 Outline 3.2 Systems of Equations 3.3 Nonlinear and Constrained Optimization Summary 2 Outline 3.2
More informationLecture 1: Review of linear algebra
Lecture 1: Review of linear algebra Linear functions and linearization Inverse matrix, least-squares and least-norm solutions Subspaces, basis, and dimension Change of basis and similarity transformations
More informationLeast Squares. Tom Lyche. October 26, Centre of Mathematics for Applications, Department of Informatics, University of Oslo
Least Squares Tom Lyche Centre of Mathematics for Applications, Department of Informatics, University of Oslo October 26, 2010 Linear system Linear system Ax = b, A C m,n, b C m, x C n. under-determined
More informationLecture 6. Regularized least-squares and minimum-norm methods 6 1
Regularized least-squares and minimum-norm methods 6 1 Lecture 6 Regularized least-squares and minimum-norm methods EE263 Autumn 2004 multi-objective least-squares regularized least-squares nonlinear least-squares
More informationExact Solutions of the Einstein Equations
Notes from phz 6607, Special and General Relativity University of Florida, Fall 2004, Detweiler Exact Solutions of the Einstein Equations These notes are not a substitute in any manner for class lectures.
More informationThe \(D_4\) Root System is Not Universally Optimal
The \D_4\) Root System is Not Universally Optimal The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters. Citation Published Version
More informationProblem 1. CS205 Homework #2 Solutions. Solution
CS205 Homework #2 s Problem 1 [Heath 3.29, page 152] Let v be a nonzero n-vector. The hyperplane normal to v is the (n-1)-dimensional subspace of all vectors z such that v T z = 0. A reflector is a linear
More informationWeighted G 1 -Multi-Degree Reduction of Bézier Curves
Vol. 7, No. 2, 216 Weighted G 1 -Multi-Degree Reduction of Bézier Curves Abedallah Rababah Department of Mathematics, Jordan University of Science and Technology Irbid 2211 Jordan Salisu Ibrahim Department
More informationPreliminary Linear Algebra 1. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 100
Preliminary Linear Algebra 1 Copyright c 2012 Dan Nettleton (Iowa State University) Statistics 611 1 / 100 Notation for all there exists such that therefore because end of proof (QED) Copyright c 2012
More information5.2 The Levi-Civita Connection on Surfaces. 1 Parallel transport of vector fields on a surface M
5.2 The Levi-Civita Connection on Surfaces In this section, we define the parallel transport of vector fields on a surface M, and then we introduce the concept of the Levi-Civita connection, which is also
More information1 Directional Derivatives and Differentiability
Wednesday, January 18, 2012 1 Directional Derivatives and Differentiability Let E R N, let f : E R and let x 0 E. Given a direction v R N, let L be the line through x 0 in the direction v, that is, L :=
More informationHow curvature shapes space
How curvature shapes space Richard Schoen University of California, Irvine - Hopf Lecture, ETH, Zürich - October 30, 2017 The lecture will have three parts: Part 1: Heinz Hopf and Riemannian geometry Part
More informationMath 302 Outcome Statements Winter 2013
Math 302 Outcome Statements Winter 2013 1 Rectangular Space Coordinates; Vectors in the Three-Dimensional Space (a) Cartesian coordinates of a point (b) sphere (c) symmetry about a point, a line, and a
More informationShort note on compact operators - Monday 24 th March, Sylvester Eriksson-Bique
Short note on compact operators - Monday 24 th March, 2014 Sylvester Eriksson-Bique 1 Introduction In this note I will give a short outline about the structure theory of compact operators. I restrict attention
More informationWRT in 2D: Poisson Example
WRT in 2D: Poisson Example Consider 2 u f on [, L x [, L y with u. WRT: For all v X N, find u X N a(v, u) such that v u dv v f dv. Follows from strong form plus integration by parts: ( ) 2 u v + 2 u dx
More informationReconstruction of full rank algebraic branching programs
Reconstruction of full rank algebraic branching programs Vineet Nair Joint work with: Neeraj Kayal, Chandan Saha, Sebastien Tavenas 1 Arithmetic circuits 2 Reconstruction problem f(x) Q[X] is an m-variate
More informationSpectra of Multiplication Operators as a Numerical Tool. B. Vioreanu and V. Rokhlin Technical Report YALEU/DCS/TR-1443 March 3, 2011
We introduce a numerical procedure for the construction of interpolation and quadrature formulae on bounded convex regions in the plane. The construction is based on the behavior of spectra of certain
More informationA Sobolev trust-region method for numerical solution of the Ginz
A Sobolev trust-region method for numerical solution of the Ginzburg-Landau equations Robert J. Renka Parimah Kazemi Department of Computer Science & Engineering University of North Texas June 6, 2012
More informationMathematical Economics: Lecture 9
Mathematical Economics: Lecture 9 Yu Ren WISE, Xiamen University October 17, 2011 Outline 1 Chapter 14: Calculus of Several Variables New Section Chapter 14: Calculus of Several Variables Partial Derivatives
More informationLecture 7: Positive Semidefinite Matrices
Lecture 7: Positive Semidefinite Matrices Rajat Mittal IIT Kanpur The main aim of this lecture note is to prepare your background for semidefinite programming. We have already seen some linear algebra.
More informationUniform approximation on the sphere by least squares polynomials
Uniform approximation on the sphere by least squares polynomials Woula Themistoclakis Marc Van Barel August 7, 8 Abstract The paper concerns the uniform polynomial approximation of a function f, continuous
More informationMATH 369 Linear Algebra
Assignment # Problem # A father and his two sons are together 00 years old. The father is twice as old as his older son and 30 years older than his younger son. How old is each person? Problem # 2 Determine
More information