APPENDIX B GRAM-SCHMIDT PROCEDURE OF ORTHOGONALIZATION. Let V be a finite dimensional inner product space spanned by basis vector functions

Similar documents
Best approximation in the 2-norm

Math 255 Honors: Gram-Schmidt Orthogonalization on the Space of Polynomials

Curve Fitting and Approximation

Hilbert Spaces: Infinite-Dimensional Vector Spaces

12.0 Properties of orthogonal polynomials

Power Series Solutions to the Legendre Equation

Advanced Computational Fluid Dynamics AA215A Lecture 2 Approximation Theory. Antony Jameson

Section 7.5 Inner Product Spaces

Approximation theory

Introduction to Orthogonal Polynomials: Definition and basic properties

Inner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:

Inverses. Stephen Boyd. EE103 Stanford University. October 28, 2017

Solutions: Problem Set 3 Math 201B, Winter 2007

ELE/MCE 503 Linear Algebra Facts Fall 2018

Legendre s Equation. PHYS Southern Illinois University. October 18, 2016

Numerical Methods I Orthogonal Polynomials

MATH 115A: SAMPLE FINAL SOLUTIONS

There are two things that are particularly nice about the first basis

Math 261 Lecture Notes: Sections 6.1, 6.2, 6.3 and 6.4 Orthogonal Sets and Projections

MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.

Power Series Solutions to the Legendre Equation

Math Real Analysis II

This ODE arises in many physical systems that we shall investigate. + ( + 1)u = 0. (λ + s)x λ + s + ( + 1) a λ. (s + 1)(s + 2) a 0

Class notes: Approximation

A brief introduction to finite element methods

Definition 1. A set V is a vector space over the scalar field F {R, C} iff. there are two operations defined on V, called vector addition

The Gram-Schmidt Process 1

The Gram Schmidt Process

The Gram Schmidt Process

Functional equations for Feynman integrals

Lectures notes. Rheology and Fluid Dynamics

10 Orthogonality Orthogonal subspaces

Journal of Computational and Applied Mathematics

Orthogonal Polynomials and Gaussian Quadrature

Kernel Principal Component Analysis

Linear Algebra. and

Inner Product Spaces

Mathematics Department Stanford University Math 61CM/DM Inner products

Exam questions with full solutions

Numerical integration formulas of degree two

Solutions to Second In-Class Exam: Math 401 Section 0201, Professor Levermore Friday, 16 April 2010

which arises when we compute the orthogonal projection of a vector y in a subspace with an orthogonal basis. Hence assume that P y = A ij = x j, x i

Method of Finite Elements I

Approximation Theory

Mathematical Methods wk 1: Vectors

Mathematical Methods wk 1: Vectors

Hilbert Spaces. Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space.

Vector Spaces. Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms.

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product

MAT Linear Algebra Collection of sample exams

Linear Algebra. Session 12

Lecture 4 Orthonormal vectors and QR factorization

Tutorial 6 - MUB and Complex Inner Product

Real Variables # 10 : Hilbert Spaces II

Linear Algebra (Review) Volker Tresp 2018

8.2 Discrete Least Squares Approximation

MATH 167: APPLIED LINEAR ALGEBRA Least-Squares

CAAM 336 DIFFERENTIAL EQUATIONS IN SCI AND ENG Examination 1

Chapter 6 Inner product spaces

BMT 2016 Orthogonal Polynomials 12 March Welcome to the power round! This year s topic is the theory of orthogonal polynomials.

Math 520 Exam 2 Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008

Interpolation. 1. Judd, K. Numerical Methods in Economics, Cambridge: MIT Press. Chapter

Methods of Mathematical Physics X1 Homework 2 - Solutions

Orthonormal Bases; Gram-Schmidt Process; QR-Decomposition

Vectors. Vectors and the scalar multiplication and vector addition operations:

MA 1B ANALYTIC - HOMEWORK SET 7 SOLUTIONS

Note on Chebyshev Regression

MTH 309Y 37. Inner product spaces. = a 1 b 1 + a 2 b a n b n

14 EE 2402 Engineering Mathematics III Solutions to Tutorial 3 1. For n =0; 1; 2; 3; 4; 5 verify that P n (x) is a solution of Legendre's equation wit

Linear algebra II Homework #1 solutions A = This means that every eigenvector with eigenvalue λ = 1 must have the form

MODULE 8 Topics: Null space, range, column space, row space and rank of a matrix

Orthogonal Polynomial Ensembles

Physics 331 Introduction to Numerical Techniques in Physics

Your first day at work MATH 806 (Fall 2015)

Contents. Appendix D (Inner Product Spaces) W-51. Index W-63

SMOOTH APPROXIMATION OF DATA WITH APPLICATIONS TO INTERPOLATING AND SMOOTHING. Karel Segeth Institute of Mathematics, Academy of Sciences, Prague

Function Space and Convergence Types

f(x) f( x) f a (x) = } form an orthonormal basis. Similarly, for the space A, { sin(nx)

Notes on basis changes and matrix diagonalization

Functional Analysis Exercise Class

i x i y i

Chapter 7 Wavelets and Multiresolution Processing

REAL ANALYSIS II HOMEWORK 3. Conway, Page 49

Linear Algebra Massoud Malek

Appendix A. Cubic Spline

Solutions to the Exercises * on Linear Algebra

MATH3383. Quantum Mechanics. Appendix D: Hermite Equation; Orthogonal Polynomials

MATH Linear Algebra

Examples of solutions to the examination in Computational Physics (FYTN03), October 24, 2016

Linearization coefficients for orthogonal polynomials. Michael Anshelevich

96 CHAPTER 4. HILBERT SPACES. Spaces of square integrable functions. Take a Cauchy sequence f n in L 2 so that. f n f m 1 (b a) f n f m 2.

Orthonormal vector polynomials in a unit circle, Part I: basis set derived from gradients of Zernike polynomials

Problem Max. Possible Points Total

Constant Amplitude and Zero Autocorrelation Sequences and Single Pixel Camera Imaging

Practice Final Exam Solutions for Calculus II, Math 1502, December 5, 2013

Vectors in Function Spaces

Vector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis.

Reduction to the associated homogeneous system via a particular solution

MATH 260 LINEAR ALGEBRA EXAM III Fall 2014

9. Numerical linear algebra background

Transcription:

301 APPENDIX B GRAM-SCHMIDT PROCEDURE OF ORTHOGONALIZATION Let V be a finite dimensional inner product space spanned by basis vector functions {w 1, w 2,, w n }. According to the Gram-Schmidt Process an orthogonal set of basis functions {φ 1, φ 2,, φ n } can be constructed from any basis functions {w 1, w 2,, w n } by following three steps: 1. Initially there is no constraining condition on the first basis element φ 1 therefore we can choose φ 1 = w 1. 2. The second basis vector, orthogonal to the first one, can be constructed by satisfying the following condition: φ 2, φ 1 = 0 (B.1) Further, if we write: φ 2 = w 2 cφ 1 (B.2) then we can determine the following value of unknown scalar constant c by substituting this expression for φ 2 in orthogonality condition, given by equation (B.1): c = w 2, φ 1 φ 1, φ 1 (B.3) 3. Continuing the procedure listed in step 2, we can write φ k as: φ k = w k c 1 φ 1 c 2 φ 2 c k 1 φ k 1 (B.4) where, the unknown constants c 1, c 2,, c k 1 can be determined by satisfying

302 following orthogonality conditions: φ k, φ j = 0 For j = 1, 2,, k 1 (B.5) Since, φ 1, φ 2,, φ k 1 are already orthogonal to each other therefore the scalar constant c j can be written as: c j = w k, φ j φ j, φ j (B.6) Therefore, finally we have following general Gram-Schmidt formula for constructing the orthogonal basis vectors φ 1, φ 2,, φ n : φ k = w k k 1 j=1 w k,φ j φ j,φ j φ j, For k = 1, 2,, n (B.7) To construct the orthogonal polynomials of degree n with respect to weight function, 1 x 2 (3 2 x ) on closed interval [ 1, 1], we need to apply the Gram-Schmidt procedure to non-orthogonal monomial basis 1, x, x 2,, x n. First of all, we compute the general expression for x k, x l : x k, x l = 1 1 x k+l (1 x 2 (3 2 x ))dx = 2 k+l+1 6 k+l+3 + 4 k+l+2 k + l is even 0 k + l is odd (B.8) According to this formula, monomials of odd degree are orthogonal to monomials of even degree. Now, if p 0 (x), p 1 (x), denote the resulting orthogonal polynomials then we can begin the process of Gram-Schmidt orthogonalization by letting: φ 0 (x) = 1 (B.9) According to equation (B.7), the next orthogonal polynomial is φ 1 (x) = x x, p 0 p 0, p 0 p 0(x) = x (B.10)

303 Further, recursively using the Gram-Schmidt formula given by equation (B.7), we can generate the orthogonal polynomials given in Table XII, including the recursive form given for φ n (x). In appendix C, we describe an alternative recurrence relation to generate these orthogonal polynomials.

304 APPENDIX C THREE TERM RECURRENCE RELATION TO GENERATE ORTHOGONAL POLYNOMIALS Let V n be a finite dimensional inner product space spanned by orthogonal basis vector functions {φ 1, φ 2,, φ n }, where φ n represent a polynomial of degree n. Next, since xφ(x) V n+1, therefore, there exist numbers c 0, c 1,, c n+1 such that following is true: n+1 xφ n (x) = c i,n φ i (x) (C.1) i=0 Since, φ 0, φ 1,, φ n are orthogonal to each other with respect to weight function w(x), we see that c k,n = 1 µ 2 k xφ n (x)φ k (x)w(x)dx = 1 µ 2 k xv n, φ k, k = 0, 1,, n + 1 (C.2) Where,.,. denotes the inner product defined by weight function w(x) and µ k = φ k, φ k. Further, notice that for k n 2, xv k (x) V n 1 and hence, c k,n = 0, 0 k n 2 and Eq. (C.1) reduces to: xφ n (x) = c n 1,n φ n 1 (x) + c n,n φ n (x) + c n+1,n φ n+1 (x) (C.3) Now, let us assume that and b n are leading coefficients of basis function φ n (x). Hence, from Eq. (C.1), we get: = c n+1,n +1, b n = c n,n + c n+1,n b n+1 (C.4) Also, substituting for k = n 1 in Eq. (C.2), we get c n 1,n = 1 xφ µ 2 n, φ n 1 = n 1 µ2 n c µ 2 n,n 1 n 1 (C.5)

305 Now, from Eqs. (C.4) and (C.5), we get: c n+1,n = +1, c n,n = b n b n+1 +1, c n 1,n = µ2 n µ 2 n 1 1 (C.6) Now, substituting for various c is from Eq. (C.6) in Eq. (C.3), we get following three term recurrence relation: xφ n (x) = a ( n bn φ n+1 (x) + b ) n+1 φ n (x) + +1 +1 µ2 n µ 2 n 1 1 φ n 1 (x) (C.7) Finally, From Eq. (C.7), it is clear that given a sequence of numbers { } and {b n }, one can construct orthogonal polynomials to given weight function w(x). That means, the orthogonal polynomial φ n (x) is unique up to ormalizing factor. In appendix D, we give a more detailed proof of this statement.

306 APPENDIX D UNIQUENESS OF ORTHOGONAL POLYNOMIALS In this appendix, we prove that orthogonal polynomials which satisfy the orthogonality condition of Eq. (3.28) are unique up to ormalizing factor. Let {φ i (x)} and { φ i (x)} are two sets of polynomials which satisfies the following orthogonality condition: φ i (x), φ j (x) φ i (x), φ j (x) 1 1 1 1 w(x)φ i (x)φ j (x)dx = k i δ ij w(x) φ i (x) φ j (x)dx = k i δ ij (D.1) (D.2) Since, φ n (x) is a polynomial of degree n, therefore, we can write it as a linear combination of polynomials {φ 0, φ 1,, φ n } as: φ n (x) = n c i,n φ i (x) i=1 (D.3) Note, by Eq. (D.1) c i,n = 0 for k < n and therefore, φ(x) and φ(x) should be proportional to each other. However, if the leading coefficient of the polynomial φ n (x) is constrained to be one then it is apparent that φ n (x) = φ n (x).