MATH 220: INNER PRODUCT SPACES, SYMMETRIC OPERATORS, ORTHOGONALITY

Size: px
Start display at page:

Download "MATH 220: INNER PRODUCT SPACES, SYMMETRIC OPERATORS, ORTHOGONALITY"

Transcription

1 MATH 22: INNER PRODUCT SPACES, SYMMETRIC OPERATORS, ORTHOGONALITY When discussing separation of variables, we noted that at the last step we need to express the inhomogeneous initial or boundary data as a superposition of functions arising in the process of separation of variables. For instance, for the Dirichlet problem u =, u D = h, we had to express h as (1) h(θ) = A + R n (A n cos(nθ) + B n sin(nθ)), n=1 i.e. we had to find constants A n and B n so that this expression holds. The basic framework for this is inner product spaces, which we now discuss. Definition 1. An inner product on a complex vector space V is a map such that (i).,. is linear in the first slot:.,. : V V C c 1 v 1 + c 2 v 2, w = c 1 v 1, w + c 2 v 2, w, c 1, c 2 C, v 1, v 2, w V, (ii).,. is Hermitian symmetric: v, w = w, v, with the bar denoting complex conjugate, (iii).,. is positive definite: v V v, v, and v, v = v =. A vector space with an inner product is also called an inner product space. While one should write (V,..,. ) to specify the inner product space, one typically says merely that V is an inner product space when the inner product is understood. For real vector spaces, one makes essentially the same definition, except that, as the complex conjugate does not make sense, one simply has symmetry: V real vector space v, w = w, v, v, w V. We also introduce the notation for the norm associated to this inner product: v = v, v 1/2, where the square root is the unique non-negative square root of a non-negative number (see (iii)). Thus, v, v = v 2. We note some examples: (i) V = R n, with inner product x, y = x j y j, where x = (x 1,..., x n ), y = (y 1,..., y n ). Thus x 2 = n j=1 x2 j. j=1 1

2 2 (ii) V = C n, with inner product x, y = x j y j, j=1 where x = (x 1,..., x n ), y = (y 1,..., y n ). Thus x 2 = n j=1 x j 2, which explains why we need Hermitian symmetry for complex vector spaces. (iii) V = R n, with inner product x, y = a j x j y j, j=1 where x = (x 1,..., x n ), y = (y 1,..., y n ), a j > for all j. Thus x 2 = n j=1 a jx 2 j. (iv) V = C () (complex valued continuous functions on the closure of ), where is a bounded domain in R n, with inner product f, g = f(x) g(x). Thus, f 2 = f(x) 2. We often write f L 2 = f L2 () for this norm. (v) V = C (), as above, with inner product f, g = f(x) g(x) a(x), where a C (), a > is fixed. Thus, f 2 = f(x) 2 a(x). We may write f L 2 (,a(x) ) for this norm. (vi) Let N > n/2, let V = {f C (R n ) : (1 + x ) N f is bounded}, with the inner product f, g = f(x) g(x). R n Note that the integral converges under this decay assumption. Thus, f 2 = f(x) 2. R n We often write f L 2 = f L2 (R n ) for this norm. A few properties on inner products should be observed immediately. First, the inner product is conjugate-linear in the second variable (which simply means linear if the vector space is real): v, c 1 w 1 + c 2 w 2 = c 1 w 1 + c 2 w 2, v = c 1 w 1, v + c 2 w 2, v = c 1 w 1, v + c 2 w 2, v = c 1 v, w 1 + c 2 v, w 2. A map V V C which is linear in the first variable and conjugate-linear in the second variable is called sesquilinear. Second, by (ii), if v V then v, v = v, v, so v, v is real. Thus, (iii) is the statement that this real number is non-negative, and it is actually positive if v. Also, by linearity, denoting the vector in V by V (usually we simply denote this by, but here this care clarifies the calculation), V, v = V, v = V, v =, v V,

3 3 and by Hermitian symmetry then We also note a useful properties of. : so v, V = V, v =. cv 2 = cv, cv = c v, cv = cc v, v = c 2 v 2, c C, v V, cv = c v. This property of. is called absolute homogeneity (of degree 1). One concept that is tremendously useful in inner product spaces is orthogonality: Definition 2. Suppose V is an inner product space. For v, w V we say that v is orthogonal to w if v, w =. Note that v, w = if and only of w, v =, so v is orthogonal to w if and only if w is orthogonal to v so we often say simply that v and w are orthogonal. As an illustration of its use, let s prove Pythagoras theorem: Lemma.1. Suppose V is an inner product space, v, w V and v and w are orthogonal. Then v + w 2 = v 2 + w 2 = v w 2. Proof. Since v w = v+( w), the statement about v w follows from the statement for v + w and w = w. Now, v+w, v+w = v, v+w + w, v+w = v, v + v, w + w, v + w, w = v, v + w, w by the orthogonality of v and w, proving the result. One use of orthogonality is the following: Lemma.2. Suppose v, w V, w. Then there exist unique v, v V such that v = v + v, v = cw for some c C and v, w =. Proof. If v = v + v then taking the inner product with w and using v = cw we deduce v, w = cw, w + v, w = c w 2, so as w, v, w c = w 2. Thus, v = cw and v = v cw, giving uniqueness. On the other hand, if we let c = v, w w 2, v = cw, v = v cw, then v + v = v and v = cw are satisfied, so we merely need to check v, w =. But v, w v, w = v, w c w, w = v, w w 2 w 2 =, so the desired vectors v and v indeed exist. One calls v the orthogonal projection of v to the span of w. The inner product can be used to define a notion of convergence: Definition 3. We say that a sequence v j converges to v in V if v j v as j.

4 4 In order to make this a useful tool, we need to be able to estimate the inner product using the norm. This is achieved by the Cauchy-Schwarz inequality, which we already mentioned when discussing energy estimates: Lemma.3. In an inner product space V, v, w v w, v, w V. Proof. If w =, then both sides vanish, so we may assume w. Write v = v +v as in Lemma.2, so v, w v = cw, c = w 2. Then by Pythagoras theorem, using v, v = c w, v =, v 2 = v 2 + v 2 v 2 = c 2 w 2 = v, w 2 w 2. Multiplying through by w 2 and taking the non-negative square root completes the proof of the lemma. A useful consequence of the Cauchy-Schwarz inequality is the triangle inequality for the norm: Lemma.4. In an inner product space V, v + w v + w. Proof. One only needs to prove the equivalent estimate where one takes the square of both sides: v + w 2 v v w + w 2. But v +w 2 = v +w, v +w = v 2 + v, w + w, v + w 2 v 2 +2 v w + w 2, where the last inequality is the Cauchy-Schwarz inequality. Recall that in general, if one has a vector space V, one defines the notion of a norm on it as follows: Definition 4. Suppose V is a vector space. A norm on V is a map. : V R such that (i) (positive definiteness) v for all v V, and v = if and only if v =. (ii) (absolute homogeneity) cv = c v, v V, and c a scalar (so c R or c C, depending on whether V is real or complex), (iii) (triangle inequality) v + w v + w for all v, w V. Thus, Lemma.4 shows that the map. : V R we defined on an inner product space is indeed a norm in this sense, i.e. our use of the word norm was justified. Some examples of a normed vector space where the norm does not come from an inner product are: (i) V = C () (complex valued continuous functions on the closure of ), where is a bounded domain in R n, and f C = sup f(x) ; x

5 5 (ii) V = C () (complex valued continuous functions on the closure of ), where is a bounded domain in R n, with norm f L 1 = f(x). Note that in a normed vector space, with convergence defined as for inner product spaces, the vector space operations are (jointly) continuous: Lemma.5. If V is a normed vector space, v j v, w j w in V and c j c in the scalars, then c j v j cv and v j + w j v + w in V. Proof. Consider the sequence {v j + w j } j=1 first. Then (v j + w j ) (v + w) = (v j v) + (w j w) v j v + w j w as v j v, w j w. Similarly, c j v j cv = (c j v j c j v) + (c j v cv) c j v j c j v + c j v cv = c j (v j v) + (c j c)v = c j v j v + c j c v since convergent sequences in R or C are bounded. We used in the proof that convergent sequences in the scalars are bounded; this is also true for convergent sequences in a normed vector space V. Namely, if v j v in V, then for j sufficiently large, v j v 1, hence v j = (v j v) + v v j v + v v + 1. Thus, for all but finitely many j, v j v + 1, hence the sequence { v j } j=1 is bounded. We can now show that the inner product is jointly continuous with respect to the notion of convergence we discussed: Lemma.6. Suppose that V is an inner product space. If v j, w j V, and v j v, w j w in V then v j, w j v, w. Proof. We have Thus, v j, w j v, w = v j, w j v j, w + v j, w v, w = v j, w j w + v j v, w. v j, w j v, w v j, w j w + v j v, w v j w j w + v j v w since { v j } j=1 is bounded. Suppose now that we have a sequence of orthogonal non-zero vectors {x j } j=1 in an inner product space V, and suppose that v = c j x j, j=1 i.e. this sum converges to v, which, recall, means that with v N = N j=1 c jx j, v N v as N. Then, by the continuity of the inner product, for any w, v, w = c j x j, w. j=1 Applying this with w = x k, all inner products on the right hand side but the one with j = k vanish, and we deduce that v, x k = c k x k 2,

6 6 hence (2) c k = v, x k x k 2. As these orthogonal collections of vectors are so useful, we make a definition. Definition 5. An orthogonal set S of vectors in an inner product space V is a subset of V consisting of non-zero vectors such that if x, x S and x x then x is orthogonal to x. Now, one could check easily by an explicit computation that the functions we have considered, in terms of which we would like to express our initial or boundary data, are orthogonal to each other. Thus, if we can write our data as an infinite linear combination of these functions, then the coefficients can be determined easily. For instance, if we want to write h(θ) = a + a n cos(nθ) + b n sin(nθ), n=1 where we consider the inner product on functions on S 1 to be given by then we must have h, 1 a = 1 2 = a n = b n = f, g = 2π f(θ) g(θ) dθ, 2π h(θ) dθ 2π = 1 1 dθ 2π 2π h(θ) cos(nθ) dθ 2π cos 2 (nθ) dθ = 1 π 2π h(θ) sin(nθ) dθ 2π = 1 sin 2 (nθ) dθ π 2π 2π 2π h(θ) dθ, h(θ) cos(nθ) dθ, h(θ) sin(nθ) dθ. Here we used the computation cos(2nθ) = 2 cos 2 (nθ) 1, so cos 2 (nθ) = 1 2 (cos(2nθ)+ 1), and thus 2π cos 2 (nθ) dθ = 1 2 2π (cos(2nθ) + 1) dθ = 1 4n sin(2nθ) 2π θ 2π = π, with a similar result with cosine replaced by sine. In particular, returning to (1), we deduce that A = 1 2π A n = 1 πr n B n = 1 πr n 2π 2π 2π h(θ) dθ, h(θ) cos(nθ) dθ, h(θ) sin(nθ) dθ. We of course need to discuss whether we can indeed write h in this form, but before this we should give a conceptual reason why the functions we considered are automatically orthogonal to each other. For this purpose we need to consider symmetric operators on V. Indeed, the operators A we want to consider are not defined on all of V (or if we define A on V, it will not map V to itself), so we have to enlarge our framework.

7 7 So we consider operators defined on a linear subspace D of V. In order to make this definition well-behaved, we need to assume that D is dense in V, i.e. if v V then there exists v j D such that v j v. Definition 6. A linear operator A : D V is called symmetric if for all v, w D. Av, w = v, Aw Recall that an eigenvector of A is an element v of D such that Av = λv for some λ C; λ is then an eigenvalue of A. Lemma.7. Suppose A : D V is symmetric. Then all eigenvalues of A are real, and eigenvectors corresponding to distinct eigenvalues are orthogonal to each other. Proof. Suppose that λ is an eigenvalue of A, so for some v D, v, Av = λv. Then λ v 2 = λv, v = Av, v = v, Av = v, λv = λ v 2, so dividing through by v 2 we deduce that λ = λ, so λ is real. Now suppose that λ and µ are eigenvalues of A (so they are both real), and Av = λv, Aw = µw. Then λ v, w = λv, w = Av, w = v, Aw = v, µw = µ v, w. If λ µ then rearranging and dividing by λ µ gives v, w =, as claimed. Now, the operator A = d2 dθ defined for functions f C 2 (S 1 ) (which, recall, 2 can be identified with 2π-periodic functions on R), is symmetric, since Af, g = 2π f (θ)g(θ) dθ = f (θ)g(θ) 2π = f(θ)g (θ) 2π 2π 2π + f(θ)g (θ) dθ = f, Ag, f (θ)g (θ) dθ where the boundary terms vanishes due to periodicity. A similar computation for the operator A = d2 defined for functions f C 2 ([, l]) gives 2 Af, g = l f (x)g(x) = f (x)g(x) l + l l = f (x)g(x) l + f(x)g (x) l f(x)g (x) ( ) = f(x)g (x) f (x)g(x) l + f, Ag f (x)g (x) Thus, the operator A is symmetric provided we restrict it to a domain D so that the boundary terms vanish. For instance, (i) A = d2 defined for functions f C 2 ([, l]) such that f() = = f(l) 2 (Dirichlet boundary condition) is symmetric, (ii) A = d2 defined for functions f C 2 ([, l]) such that f () = = f (l) 2 (Neumann boundary condition) is symmetric, (iii) A = d2 defined for functions f C 2 ([, l]) such that f () af() = 2 and f (l) bf(l) = for some given a, b R (Robin boundary condition) is symmetric.

8 8 As another example, the operator A = i d defined on C1 functions which are 2l-periodic, mapping into C ([, 2l]) with the standard inner product, is symmetric since Af, g = 2l if (x)g(x) = if(x)g(x) 2l + i As a consequence, we deduce: 2l f(x)g (x) = f, Ag. Corollary.8. The following sets of functions are all orthogonal to each other in the respective vector spaces. (i) In V = C ([, l]), with the standard inner product, ( nπx ) f n (x) = sin, n 1, n Z. l (ii) In V = C ([, l]), with the standard inner product, ( nπx ) f (x) = 1, f n (x) = cos, n 1, n Z. l (iii) In V = C ([, 2l]), with the standard inner product, f n (x) = e inπx/l, n Z. (iv) In V = C ([, 2l]), with the standard inner product, ( nπx ) f (x) = 1, f n (x) = cos, n 1, n Z, g n (x) = sin l ( nπx l ), n 1, n Z. Proof. These are all consequences of being eigenfunctions of symmetric operators, namely: (i) A = d2, with Dirichlet boundary condition, the eigenvalue of f 2 n is λ n = n 2 π 2 l, 2 (ii) A = d2, with Neumann boundary condition, the eigenvalue of f 2 n is λ n = n2 π 2 l, 2 (iii) A = i d, on 2l-periodic C1 functions, the eigenvalue of f n is λ n = nπ l, (iv) A = d2, on 2l-periodic C 2 functions, the eigenvalue of f 2 n is λ n = n2 π 2 l 2 which is also the eigenvalue of g n. Thus, in all cases but the last the functions are eigenfunctions of a symmetric operator with distinct eigenvalues, hence are orthogonal. In the last case, we have all of the claimed orthogonality by the same argument, except the orthogonality of f n to g n. This can be seen easily, however, as the cosines are even around x = l, while the sines are odd around x = l, so the product is odd, hence its integral over the interval [, 2l], which is symmetric around l, vanishes. We also have the following general symmetry result for the Laplacian: Proposition.9. Let be a bounded domain with smooth boundary, V = C ( ). The Laplacian, defined on any one of the following domains: (i) (Dirichlet) D = {f C 2 () : f = }, (ii) (Neumann) D = {f C 2 f () ( : n ) = }, (iii) (Robin) D = {f C 2 () : f n af = }, is symmetric. Here, in case (iii), a is a given continuous function on.

9 9 Proof. We recall Green s identity, (f g ( f)g) = Replacing g by g, we have (f g ( f)g) = ( f g n f ) n g ds(x). ( f g n f ) n g ds(x). Under each of the conditions listed above, the right hand side vanishes. Thus, f g = ( f)g, so is symmetric. We recall how Green s identity is proved: consider the vector field f g. By the divergence theorem, and similarly div(f g) = div(g f) = f ˆn g ds(x) = g f n ds(x). f g n ds(x), Subtracting these two yields ( f g n f ) n g ds(x) = (div(f g) div(g f)) = (f g + f g g f g f) = (f g ( f)g), as claimed. We still need to discuss whether any v in V can be written as a stated linear combination. This is in general not the case: for instance, if V = R 2, and x 1 = (1, ), then {x 1 } is an orthogonal set of non-zero vectors, but not every element of V can be written as a linear combination of {x 1 } (i.e. is not, in general, a multiple of x 1 ): we need another vector, such as x 2 = (, 1). We thus make the following definition. Definition 7. Suppose V is an inner product space. We say that an orthogonal set {x n } n=1 is complete if for every v V there exist scalars c n such that v = n=1 c nx n. Note that, as discussed before, if the c n exist, they are automatically unique: they are determined by (2). In fact, we can always define a series by the formula (2): given v V, let (3) v n = c k x k, c k = v, x k x k 2 ; the question is whether v n v. The coefficients c k in (3) may be called the generalized Fourier coefficients of v. Note that v n has the useful property that v v n is orthogonal to x j for 1 j n. Indeed, v v n, x j = v, x j c k x k, x j = c j c j =, j n,

10 1 hence v v n is also orthogonal to any vector of the form n b kx k, i.e. to the linear span of {x 1,..., x n }, in particular to v n itself. Thus, by Pythagoras theorem, we have v 2 = v v n 2 + v n 2 v n 2 = c j c k x j, x k = c k 2 x k 2. j, This is Bessel s inequality. Thus, we deduce that for any v V, the generalized Fourier coefficients satisfy c k 2 x k 2 v 2, hence, as these partial sums form a bounded monotone increasing (which, recall, means non-decreasing) sequence, c k 2 x k 2 converges, and as v 2 is an upper bound for the partial sums, the limit is v 2. If this limit is v 2, then we deduce that v v n as n, so with the converse being clear we conclude the following: Lemma.1. Suppose V is an inner product space. An orthogonal set {x n } n=1 is complete if and only if for every v V the generalized Fourier coefficients satisfy c k 2 x k 2 = v 2. This may be called Bessel s equality. Now, let s compute v n a kx k 2, where a k C. This is best done by writing v = v + v, where v = c k x k, the c k being the generalized Fourier coefficients, for then v is orthogonal to all x k, and hence v a k x k 2 = v + (c k a k )x k 2 = v 2 + c k a k 2 x k 2. In particular, v a k x k 2 v 2, and equality holds if and only of a k = c k for k = 1,..., n. This is the least squares approximation: Proposition.11. Given v V, and an orthogonal set {x 1,..., x n }, the choice of a k that minimizes the error v n a kx k 2 of the approximation of v by n a kx k is given by the generalized Fourier coefficients, c k. Thus, even if the generalized Fourier series c kx k does not converge to the function, its partial sums give the best possible approximations of v in the precise sense of this Proposition. We now actually turn to completeness statements. We prove in the next lecture that all of the orthogonal sets listed in Corollary.8 are complete. Moreover, for the Laplacian we have the following result, which is beyond our tools in this class:

11 11 Theorem.12. Suppose is a bounded domain in R n with smooth boundary. For the Laplacian, defined on the subspace D of C () given by (i), (ii) or (iii) of Proposition.9, the eigenspace for each eigenvalue λ R is finite dimensional, the eigenvalues can be arranged in an increasing sequence, tending to infinity, λ 1 λ 2..., and choosing an orthogonal basis x k,j, j = 1,..., N k, of the λ j -eigenspace, the orthogonal set {x k,j : k Z, k 1, j = 1,..., N k } is complete. The analogue of this theorem for variable coefficient symmetric elliptic second order differential operators with appropriate boundary conditions is also valid. There is one more issue that should be observed. For the generalized Fourier series of v as in (3), and for n < m, m (4) v n v m 2 = c k 2 x k 2. k=n+1 Since c k 2 x k 2 converges, the differences of the partial sums, on the right hand side of (4), go to as n, m. Thus, by (4), the same holds for the differences of the partial sums of c kx k. In an ideal world, this ought to imply that the series c kx k converges. However, this need not be a case. Definition 8. Suppose that V is a normed vector space. We say that a sequence {v n } n=1 is a Cauchy sequence if v n v m as n, m. Explicitly, this means that given any ɛ > there is N > such that for n, m N, v n v m < ɛ, i.e. beyond a certain point, all elements of the sequence are within ɛ of each other. We say that a normed vector space V is complete if every Cauchy sequence converges. Thus, we see that for any inner product space and any orthogonal set inside it, the generalized Fourier series for any v V is Cauchy. If V is complete, it will thus converge to some v V (not necessarily to v though: recall the R 2 example). Now, an example of a complete normed vector space is, for as above, V = C () with the C -norm: f C = sup f(x). x Unfortunately, an example of an incomplete normed vector space is V = C () with the L 2 -norm, i.e. our inner product space. It turns out that every incomplete normed vector space V can be completed, i.e. there is a complete normed vector space ˆV and an inclusion map ι : V ˆV which is linear such that for v V, ι(v) ˆV = v V, and such that for any v ˆV, there is a sequence {v n } n=1 in V such that ι(v n ) v in ˆV (i.e. the image of V under ι is dense in ˆV ). This completion is (essentially) unique. Note that if {v n } n=1 is Cauchy in V, then {ι(v n )} n=1 is Cauchy in ˆV, so it converges. Moreover, ι is one-to-one, so one can simply think of elements of V as elements of ˆV. It is also useful to note that if V is an inner product space, then so is ˆV. The actual construction of completion is very similar to how the real numbers are constructed from the rationals. There are Cauchy sequences of rationals which do not converge inside Q, for instance, take truncated decimal expressions for 2. One constructs R by considering the set of such Cauchy sequences, more precisely equivalence classes of Cauchy sequences: two Cauchy sequences {v n } n=1 and {v n} n=1

12 12 are equivalent if v n v n as n. For instance, in the case of R, one wants the decimal and binary expansions of 2 to be equivalent, i.e. give the same element of R, namely 2, which is exactly what is accomplished. We thus make a bold definition. Suppose that is a bounded domain in R n. We let L 2 () be the completion ˆV of V = C () in the L 2 ()-norm. Thus, L 2 () is a complete inner product space, and C () can be regarded as a subset of L 2 (). Similarly, we let L 1 () be the completion ˆV of V = C () in the L 1 ()-norm, which is thus a complete normed vector space. We also let L 2 (R n ) be the completion ˆV of V N = {f C (R n ) : (1 + x ) N f is bounded}, with the inner product f, g = f(x) g(x), R n where we fixed some N > n/2. It is straightforward to show that the completion is independent of the choice of such an N, for if n/2 < N < N, then any element of V N can be approximated by elements of V N in the L 2 (R n )-norm. While this definition of L 2 () may sound radical indeed, elements of L 2 () are actually distributions, i.e. very familiar objects. First, note that if φ Cc (), f L 2 (), we can define ι f (φ) = f, φ. By Cauchy-Schwarz, we have ι f (φ) f L 2 φ L 2 = f L 2( φ 2 ) 1/2 f L 2( 1 ) 1/2 sup φ(x), x so ι f is indeed a distribution, i.e. it is continuous Cc () C (linearity being clear). If f C (), this agrees with the usual definition since then f, φ = fφ. Thus, ι : L 2 () D (). In order to be able to consider L 2 () a subset of D (), we also need that ι is injective. But this is easy to see: first, for f L 2 () there is a sequence φ n Cc () such that φ n f in L 2 (). Indeed, the existence of such a sequence with φ n replaced by f n C () follows from the definition of L 2 () as a completion, so one merely needs to check that the f n can be approximated within, say, 1/n, in L 2 -norm by some φ n, but this is straightforward, and now all integrals are simply Riemann integrals. Now, for this sequence φ n, by the continuity of the inner product, f, φ n f, f = f 2 L 2. Now, if f, then the right hand side is non-zero, so in particular for sufficiently large n, ι f (φ n ) = f, φ n, showing that ι f is not the zero distribution, so ι is injective. Hence we can indeed simply think of L 2 () as a subspace of distributions. We also remark that if V is an inner product space, and {x n } n=1 is a complete orthogonal set in V, then it is also complete in the completion ˆV of V : this follows immediately since for v V we can take a sequence v n V such that v n v, and use that the generalized Fourier series of v n converges to v n, as well as the fact that the generalized Fourier series of v converges to some v to show that v = v.

Mathematics Department Stanford University Math 61CM/DM Inner products

Mathematics Department Stanford University Math 61CM/DM Inner products Mathematics Department Stanford University Math 61CM/DM Inner products Recall the definition of an inner product space; see Appendix A.8 of the textbook. Definition 1 An inner product space V is a vector

More information

Math 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces.

Math 350 Fall 2011 Notes about inner product spaces. In this notes we state and prove some important properties of inner product spaces. Math 350 Fall 2011 Notes about inner product spaces In this notes we state and prove some important properties of inner product spaces. First, recall the dot product on R n : if x, y R n, say x = (x 1,...,

More information

Vectors in Function Spaces

Vectors in Function Spaces Jim Lambers MAT 66 Spring Semester 15-16 Lecture 18 Notes These notes correspond to Section 6.3 in the text. Vectors in Function Spaces We begin with some necessary terminology. A vector space V, also

More information

Elements of linear algebra

Elements of linear algebra Elements of linear algebra Elements of linear algebra A vector space S is a set (numbers, vectors, functions) which has addition and scalar multiplication defined, so that the linear combination c 1 v

More information

Recall that any inner product space V has an associated norm defined by

Recall that any inner product space V has an associated norm defined by Hilbert Spaces Recall that any inner product space V has an associated norm defined by v = v v. Thus an inner product space can be viewed as a special kind of normed vector space. In particular every inner

More information

Ordinary Differential Equations II

Ordinary Differential Equations II Ordinary Differential Equations II February 23 2017 Separation of variables Wave eq. (PDE) 2 u t (t, x) = 2 u 2 c2 (t, x), x2 c > 0 constant. Describes small vibrations in a homogeneous string. u(t, x)

More information

CONVERGENCE OF THE FOURIER SERIES

CONVERGENCE OF THE FOURIER SERIES CONVERGENCE OF THE FOURIER SERIES SHAW HAGIWARA Abstract. The Fourier series is a expression of a periodic, integrable function as a sum of a basis of trigonometric polynomials. In the following, we first

More information

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )

More information

Definition 1. A set V is a vector space over the scalar field F {R, C} iff. there are two operations defined on V, called vector addition

Definition 1. A set V is a vector space over the scalar field F {R, C} iff. there are two operations defined on V, called vector addition 6 Vector Spaces with Inned Product Basis and Dimension Section Objective(s): Vector Spaces and Subspaces Linear (In)dependence Basis and Dimension Inner Product 6 Vector Spaces and Subspaces Definition

More information

Hilbert spaces. 1. Cauchy-Schwarz-Bunyakowsky inequality

Hilbert spaces. 1. Cauchy-Schwarz-Bunyakowsky inequality (October 29, 2016) Hilbert spaces Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ [This document is http://www.math.umn.edu/ garrett/m/fun/notes 2016-17/03 hsp.pdf] Hilbert spaces are

More information

Recitation 1 (Sep. 15, 2017)

Recitation 1 (Sep. 15, 2017) Lecture 1 8.321 Quantum Theory I, Fall 2017 1 Recitation 1 (Sep. 15, 2017) 1.1 Simultaneous Diagonalization In the last lecture, we discussed the situations in which two operators can be simultaneously

More information

Hilbert Spaces. Contents

Hilbert Spaces. Contents Hilbert Spaces Contents 1 Introducing Hilbert Spaces 1 1.1 Basic definitions........................... 1 1.2 Results about norms and inner products.............. 3 1.3 Banach and Hilbert spaces......................

More information

Mathematical Methods wk 1: Vectors

Mathematical Methods wk 1: Vectors Mathematical Methods wk : Vectors John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from http://www-thphysphysicsoxacuk/people/johnmagorrian/mm

More information

Mathematical Methods wk 1: Vectors

Mathematical Methods wk 1: Vectors Mathematical Methods wk : Vectors John Magorrian, magog@thphysoxacuk These are work-in-progress notes for the second-year course on mathematical methods The most up-to-date version is available from http://www-thphysphysicsoxacuk/people/johnmagorrian/mm

More information

SPECTRAL PROPERTIES OF THE LAPLACIAN ON BOUNDED DOMAINS

SPECTRAL PROPERTIES OF THE LAPLACIAN ON BOUNDED DOMAINS SPECTRAL PROPERTIES OF THE LAPLACIAN ON BOUNDED DOMAINS TSOGTGEREL GANTUMUR Abstract. After establishing discrete spectra for a large class of elliptic operators, we present some fundamental spectral properties

More information

Functional Analysis MATH and MATH M6202

Functional Analysis MATH and MATH M6202 Functional Analysis MATH 36202 and MATH M6202 1 Inner Product Spaces and Normed Spaces Inner Product Spaces Functional analysis involves studying vector spaces where we additionally have the notion of

More information

Functional Analysis. Franck Sueur Metric spaces Definitions Completeness Compactness Separability...

Functional Analysis. Franck Sueur Metric spaces Definitions Completeness Compactness Separability... Functional Analysis Franck Sueur 2018-2019 Contents 1 Metric spaces 1 1.1 Definitions........................................ 1 1.2 Completeness...................................... 3 1.3 Compactness......................................

More information

08a. Operators on Hilbert spaces. 1. Boundedness, continuity, operator norms

08a. Operators on Hilbert spaces. 1. Boundedness, continuity, operator norms (February 24, 2017) 08a. Operators on Hilbert spaces Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ [This document is http://www.math.umn.edu/ garrett/m/real/notes 2016-17/08a-ops

More information

I teach myself... Hilbert spaces

I teach myself... Hilbert spaces I teach myself... Hilbert spaces by F.J.Sayas, for MATH 806 November 4, 2015 This document will be growing with the semester. Every in red is for you to justify. Even if we start with the basic definition

More information

4 Hilbert spaces. The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan

4 Hilbert spaces. The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan Wir müssen wissen, wir werden wissen. David Hilbert We now continue to study a special class of Banach spaces,

More information

6 Inner Product Spaces

6 Inner Product Spaces Lectures 16,17,18 6 Inner Product Spaces 6.1 Basic Definition Parallelogram law, the ability to measure angle between two vectors and in particular, the concept of perpendicularity make the euclidean space

More information

Vector Spaces. Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms.

Vector Spaces. Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms. Vector Spaces Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms. For each two vectors a, b ν there exists a summation procedure: a +

More information

Inner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:

Inner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold: Inner products Definition: An inner product on a real vector space V is an operation (function) that assigns to each pair of vectors ( u, v) in V a scalar u, v satisfying the following axioms: 1. u, v

More information

MATH COURSE NOTES - CLASS MEETING # Introduction to PDEs, Spring 2018 Professor: Jared Speck

MATH COURSE NOTES - CLASS MEETING # Introduction to PDEs, Spring 2018 Professor: Jared Speck MATH 8.52 COURSE NOTES - CLASS MEETING # 6 8.52 Introduction to PDEs, Spring 208 Professor: Jared Speck Class Meeting # 6: Laplace s and Poisson s Equations We will now study the Laplace and Poisson equations

More information

Notions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy

Notions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy Banach Spaces These notes provide an introduction to Banach spaces, which are complete normed vector spaces. For the purposes of these notes, all vector spaces are assumed to be over the real numbers.

More information

MATH COURSE NOTES - CLASS MEETING # Introduction to PDEs, Fall 2011 Professor: Jared Speck

MATH COURSE NOTES - CLASS MEETING # Introduction to PDEs, Fall 2011 Professor: Jared Speck MATH 8.52 COURSE NOTES - CLASS MEETING # 6 8.52 Introduction to PDEs, Fall 20 Professor: Jared Speck Class Meeting # 6: Laplace s and Poisson s Equations We will now study the Laplace and Poisson equations

More information

Hilbert Spaces. Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space.

Hilbert Spaces. Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space. Hilbert Spaces Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space. Vector Space. Vector space, ν, over the field of complex numbers,

More information

Final: Solutions Math 118A, Fall 2013

Final: Solutions Math 118A, Fall 2013 Final: Solutions Math 118A, Fall 2013 1. [20 pts] For each of the following PDEs for u(x, y), give their order and say if they are nonlinear or linear. If they are linear, say if they are homogeneous or

More information

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra. DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1

More information

MATH 131P: PRACTICE FINAL SOLUTIONS DECEMBER 12, 2012

MATH 131P: PRACTICE FINAL SOLUTIONS DECEMBER 12, 2012 MATH 3P: PRACTICE FINAL SOLUTIONS DECEMBER, This is a closed ook, closed notes, no calculators/computers exam. There are 6 prolems. Write your solutions to Prolems -3 in lue ook #, and your solutions to

More information

Eigenvalues and Eigenfunctions of the Laplacian

Eigenvalues and Eigenfunctions of the Laplacian The Waterloo Mathematics Review 23 Eigenvalues and Eigenfunctions of the Laplacian Mihai Nica University of Waterloo mcnica@uwaterloo.ca Abstract: The problem of determining the eigenvalues and eigenvectors

More information

FFTs in Graphics and Vision. The Laplace Operator

FFTs in Graphics and Vision. The Laplace Operator FFTs in Graphics and Vision The Laplace Operator 1 Outline Math Stuff Symmetric/Hermitian Matrices Lagrange Multipliers Diagonalizing Symmetric Matrices The Laplacian Operator 2 Linear Operators Definition:

More information

Linear Algebra Massoud Malek

Linear Algebra Massoud Malek CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product

More information

Topics in Fourier analysis - Lecture 2.

Topics in Fourier analysis - Lecture 2. Topics in Fourier analysis - Lecture 2. Akos Magyar 1 Infinite Fourier series. In this section we develop the basic theory of Fourier series of periodic functions of one variable, but only to the extent

More information

Functional Analysis Review

Functional Analysis Review Outline 9.520: Statistical Learning Theory and Applications February 8, 2010 Outline 1 2 3 4 Vector Space Outline A vector space is a set V with binary operations +: V V V and : R V V such that for all

More information

Fourier Series. 1. Review of Linear Algebra

Fourier Series. 1. Review of Linear Algebra Fourier Series In this section we give a short introduction to Fourier Analysis. If you are interested in Fourier analysis and would like to know more detail, I highly recommend the following book: Fourier

More information

Math 328 Course Notes

Math 328 Course Notes Math 328 Course Notes Ian Robertson March 3, 2006 3 Properties of C[0, 1]: Sup-norm and Completeness In this chapter we are going to examine the vector space of all continuous functions defined on the

More information

Consequences of Orthogonality

Consequences of Orthogonality Consequences of Orthogonality Philippe B. Laval KSU Today Philippe B. Laval (KSU) Consequences of Orthogonality Today 1 / 23 Introduction The three kind of examples we did above involved Dirichlet, Neumann

More information

MATH 115A: SAMPLE FINAL SOLUTIONS

MATH 115A: SAMPLE FINAL SOLUTIONS MATH A: SAMPLE FINAL SOLUTIONS JOE HUGHES. Let V be the set of all functions f : R R such that f( x) = f(x) for all x R. Show that V is a vector space over R under the usual addition and scalar multiplication

More information

Lecture 16: Bessel s Inequality, Parseval s Theorem, Energy convergence

Lecture 16: Bessel s Inequality, Parseval s Theorem, Energy convergence Introductory lecture notes on Partial Differential Equations - c Anthony Peirce. ot to be copied, used, or revised without explicit written permission from the copyright owner. ecture 6: Bessel s Inequality,

More information

1 Math 241A-B Homework Problem List for F2015 and W2016

1 Math 241A-B Homework Problem List for F2015 and W2016 1 Math 241A-B Homework Problem List for F2015 W2016 1.1 Homework 1. Due Wednesday, October 7, 2015 Notation 1.1 Let U be any set, g be a positive function on U, Y be a normed space. For any f : U Y let

More information

MATH 426, TOPOLOGY. p 1.

MATH 426, TOPOLOGY. p 1. MATH 426, TOPOLOGY THE p-norms In this document we assume an extended real line, where is an element greater than all real numbers; the interval notation [1, ] will be used to mean [1, ) { }. 1. THE p

More information

j=1 [We will show that the triangle inequality holds for each p-norm in Chapter 3 Section 6.] The 1-norm is A F = tr(a H A).

j=1 [We will show that the triangle inequality holds for each p-norm in Chapter 3 Section 6.] The 1-norm is A F = tr(a H A). Math 344 Lecture #19 3.5 Normed Linear Spaces Definition 3.5.1. A seminorm on a vector space V over F is a map : V R that for all x, y V and for all α F satisfies (i) x 0 (positivity), (ii) αx = α x (scale

More information

3 Orthogonality and Fourier series

3 Orthogonality and Fourier series 3 Orthogonality and Fourier series We now turn to the concept of orthogonality which is a key concept in inner product spaces and Hilbert spaces. We start with some basic definitions. Definition 3.1. Let

More information

On the spectrum of the Laplacian

On the spectrum of the Laplacian On the spectrum of the Laplacian S. Kesavan Institute of Mathematical Sciences, CIT Campus, Taramani, Chennai - 600113. kesh@imsc.res.in July 1, 2013 S. Kesavan (IMSc) Spectrum of the Laplacian July 1,

More information

Solutions Final Exam May. 14, 2014

Solutions Final Exam May. 14, 2014 Solutions Final Exam May. 14, 2014 1. Determine whether the following statements are true or false. Justify your answer (i.e., prove the claim, derive a contradiction or give a counter-example). (a) (10

More information

The following definition is fundamental.

The following definition is fundamental. 1. Some Basics from Linear Algebra With these notes, I will try and clarify certain topics that I only quickly mention in class. First and foremost, I will assume that you are familiar with many basic

More information

Class Meeting # 2: The Diffusion (aka Heat) Equation

Class Meeting # 2: The Diffusion (aka Heat) Equation MATH 8.52 COURSE NOTES - CLASS MEETING # 2 8.52 Introduction to PDEs, Fall 20 Professor: Jared Speck Class Meeting # 2: The Diffusion (aka Heat) Equation The heat equation for a function u(, x (.0.). Introduction

More information

Math Linear Algebra II. 1. Inner Products and Norms

Math Linear Algebra II. 1. Inner Products and Norms Math 342 - Linear Algebra II Notes 1. Inner Products and Norms One knows from a basic introduction to vectors in R n Math 254 at OSU) that the length of a vector x = x 1 x 2... x n ) T R n, denoted x,

More information

MATH 51H Section 4. October 16, Recall what it means for a function between metric spaces to be continuous:

MATH 51H Section 4. October 16, Recall what it means for a function between metric spaces to be continuous: MATH 51H Section 4 October 16, 2015 1 Continuity Recall what it means for a function between metric spaces to be continuous: Definition. Let (X, d X ), (Y, d Y ) be metric spaces. A function f : X Y is

More information

1. General Vector Spaces

1. General Vector Spaces 1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule

More information

Dot Products. K. Behrend. April 3, Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem.

Dot Products. K. Behrend. April 3, Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem. Dot Products K. Behrend April 3, 008 Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem. Contents The dot product 3. Length of a vector........................

More information

General Inner Product and The Fourier Series

General Inner Product and The Fourier Series A Linear Algebra Approach Department of Mathematics University of Puget Sound 4-20-14 / Spring Semester Outline 1 2 Inner Product The inner product is an algebraic operation that takes two vectors and

More information

y 2 . = x 1y 1 + x 2 y x + + x n y n 2 7 = 1(2) + 3(7) 5(4) = 3. x x = x x x2 n.

y 2 . = x 1y 1 + x 2 y x + + x n y n 2 7 = 1(2) + 3(7) 5(4) = 3. x x = x x x2 n. 6.. Length, Angle, and Orthogonality In this section, we discuss the defintion of length and angle for vectors and define what it means for two vectors to be orthogonal. Then, we see that linear systems

More information

Example 9 Algebraic Evaluation for Example 1

Example 9 Algebraic Evaluation for Example 1 A Basic Principle Consider the it f(x) x a If you have a formula for the function f and direct substitution gives the indeterminate form 0, you may be able to evaluate the it algebraically. 0 Principle

More information

Math 489AB A Very Brief Intro to Fourier Series Fall 2008

Math 489AB A Very Brief Intro to Fourier Series Fall 2008 Math 489AB A Very Brief Intro to Fourier Series Fall 8 Contents Fourier Series. The coefficients........................................ Convergence......................................... 4.3 Convergence

More information

Spectral Theory, with an Introduction to Operator Means. William L. Green

Spectral Theory, with an Introduction to Operator Means. William L. Green Spectral Theory, with an Introduction to Operator Means William L. Green January 30, 2008 Contents Introduction............................... 1 Hilbert Space.............................. 4 Linear Maps

More information

1 Separation of Variables

1 Separation of Variables Jim ambers ENERGY 281 Spring Quarter 27-8 ecture 2 Notes 1 Separation of Variables In the previous lecture, we learned how to derive a PDE that describes fluid flow. Now, we will learn a number of analytical

More information

Advanced Computational Fluid Dynamics AA215A Lecture 2 Approximation Theory. Antony Jameson

Advanced Computational Fluid Dynamics AA215A Lecture 2 Approximation Theory. Antony Jameson Advanced Computational Fluid Dynamics AA5A Lecture Approximation Theory Antony Jameson Winter Quarter, 6, Stanford, CA Last revised on January 7, 6 Contents Approximation Theory. Least Squares Approximation

More information

Solutions Final Exam May. 14, 2014

Solutions Final Exam May. 14, 2014 Solutions Final Exam May. 14, 2014 1. (a) (10 points) State the formal definition of a Cauchy sequence of real numbers. A sequence, {a n } n N, of real numbers, is Cauchy if and only if for every ɛ > 0,

More information

Real Analysis Notes. Thomas Goller

Real Analysis Notes. Thomas Goller Real Analysis Notes Thomas Goller September 4, 2011 Contents 1 Abstract Measure Spaces 2 1.1 Basic Definitions........................... 2 1.2 Measurable Functions........................ 2 1.3 Integration..............................

More information

Index. C 2 ( ), 447 C k [a,b], 37 C0 ( ), 618 ( ), 447 CD 2 CN 2

Index. C 2 ( ), 447 C k [a,b], 37 C0 ( ), 618 ( ), 447 CD 2 CN 2 Index advection equation, 29 in three dimensions, 446 advection-diffusion equation, 31 aluminum, 200 angle between two vectors, 58 area integral, 439 automatic step control, 119 back substitution, 604

More information

Linear Algebra. Paul Yiu. Department of Mathematics Florida Atlantic University. Fall A: Inner products

Linear Algebra. Paul Yiu. Department of Mathematics Florida Atlantic University. Fall A: Inner products Linear Algebra Paul Yiu Department of Mathematics Florida Atlantic University Fall 2011 6A: Inner products In this chapter, the field F = R or C. We regard F equipped with a conjugation χ : F F. If F =

More information

MATH 124B: HOMEWORK 2

MATH 124B: HOMEWORK 2 MATH 24B: HOMEWORK 2 Suggested due date: August 5th, 26 () Consider the geometric series ( ) n x 2n. (a) Does it converge pointwise in the interval < x

More information

Physics 250 Green s functions for ordinary differential equations

Physics 250 Green s functions for ordinary differential equations Physics 25 Green s functions for ordinary differential equations Peter Young November 25, 27 Homogeneous Equations We have already discussed second order linear homogeneous differential equations, which

More information

10.2-3: Fourier Series.

10.2-3: Fourier Series. 10.2-3: Fourier Series. 10.2-3: Fourier Series. O. Costin: Fourier Series, 10.2-3 1 Fourier series are very useful in representing periodic functions. Examples of periodic functions. A function is periodic

More information

Undergraduate Notes in Mathematics. Arkansas Tech University Department of Mathematics

Undergraduate Notes in Mathematics. Arkansas Tech University Department of Mathematics Undergraduate Notes in Mathematics Arkansas Tech University Department of Mathematics An Introductory Single Variable Real Analysis: A Learning Approach through Problem Solving Marcel B. Finan c All Rights

More information

Elementary linear algebra

Elementary linear algebra Chapter 1 Elementary linear algebra 1.1 Vector spaces Vector spaces owe their importance to the fact that so many models arising in the solutions of specific problems turn out to be vector spaces. The

More information

Here we used the multiindex notation:

Here we used the multiindex notation: Mathematics Department Stanford University Math 51H Distributions Distributions first arose in solving partial differential equations by duality arguments; a later related benefit was that one could always

More information

21 Laplace s Equation and Harmonic Functions

21 Laplace s Equation and Harmonic Functions 2 Laplace s Equation and Harmonic Functions 2. Introductory Remarks on the Laplacian operator Given a domain Ω R d, then 2 u = div(grad u) = in Ω () is Laplace s equation defined in Ω. If d = 2, in cartesian

More information

Overview of Fourier Series (Sect. 6.2). Origins of the Fourier Series.

Overview of Fourier Series (Sect. 6.2). Origins of the Fourier Series. Overview of Fourier Series (Sect. 6.2. Origins of the Fourier Series. Periodic functions. Orthogonality of Sines and Cosines. Main result on Fourier Series. Origins of the Fourier Series. Summary: Daniel

More information

LINEAR ALGEBRA W W L CHEN

LINEAR ALGEBRA W W L CHEN LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008. This chapter is available free to all individuals, on the understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,

More information

Math Tune-Up Louisiana State University August, Lectures on Partial Differential Equations and Hilbert Space

Math Tune-Up Louisiana State University August, Lectures on Partial Differential Equations and Hilbert Space Math Tune-Up Louisiana State University August, 2008 Lectures on Partial Differential Equations and Hilbert Space 1. A linear partial differential equation of physics We begin by considering the simplest

More information

INNER PRODUCT SPACE. Definition 1

INNER PRODUCT SPACE. Definition 1 INNER PRODUCT SPACE Definition 1 Suppose u, v and w are all vectors in vector space V and c is any scalar. An inner product space on the vectors space V is a function that associates with each pair of

More information

Variational Formulations

Variational Formulations Chapter 2 Variational Formulations In this chapter we will derive a variational (or weak) formulation of the elliptic boundary value problem (1.4). We will discuss all fundamental theoretical results that

More information

NORMS ON SPACE OF MATRICES

NORMS ON SPACE OF MATRICES NORMS ON SPACE OF MATRICES. Operator Norms on Space of linear maps Let A be an n n real matrix and x 0 be a vector in R n. We would like to use the Picard iteration method to solve for the following system

More information

FUNCTIONAL ANALYSIS LECTURE NOTES: ADJOINTS IN HILBERT SPACES

FUNCTIONAL ANALYSIS LECTURE NOTES: ADJOINTS IN HILBERT SPACES FUNCTIONAL ANALYSIS LECTURE NOTES: ADJOINTS IN HILBERT SPACES CHRISTOPHER HEIL 1. Adjoints in Hilbert Spaces Recall that the dot product on R n is given by x y = x T y, while the dot product on C n is

More information

L p Functions. Given a measure space (X, µ) and a real number p [1, ), recall that the L p -norm of a measurable function f : X R is defined by

L p Functions. Given a measure space (X, µ) and a real number p [1, ), recall that the L p -norm of a measurable function f : X R is defined by L p Functions Given a measure space (, µ) and a real number p [, ), recall that the L p -norm of a measurable function f : R is defined by f p = ( ) /p f p dµ Note that the L p -norm of a function f may

More information

14 Fourier analysis. Read: Boas Ch. 7.

14 Fourier analysis. Read: Boas Ch. 7. 14 Fourier analysis Read: Boas Ch. 7. 14.1 Function spaces A function can be thought of as an element of a kind of vector space. After all, a function f(x) is merely a set of numbers, one for each point

More information

Representation theory and quantum mechanics tutorial Spin and the hydrogen atom

Representation theory and quantum mechanics tutorial Spin and the hydrogen atom Representation theory and quantum mechanics tutorial Spin and the hydrogen atom Justin Campbell August 3, 2017 1 Representations of SU 2 and SO 3 (R) 1.1 The following observation is long overdue. Proposition

More information

Topics in Harmonic Analysis Lecture 1: The Fourier transform

Topics in Harmonic Analysis Lecture 1: The Fourier transform Topics in Harmonic Analysis Lecture 1: The Fourier transform Po-Lam Yung The Chinese University of Hong Kong Outline Fourier series on T: L 2 theory Convolutions The Dirichlet and Fejer kernels Pointwise

More information

Vector Spaces. Commutativity of +: u + v = v + u, u, v, V ; Associativity of +: u + (v + w) = (u + v) + w, u, v, w V ;

Vector Spaces. Commutativity of +: u + v = v + u, u, v, V ; Associativity of +: u + (v + w) = (u + v) + w, u, v, w V ; Vector Spaces A vector space is defined as a set V over a (scalar) field F, together with two binary operations, i.e., vector addition (+) and scalar multiplication ( ), satisfying the following axioms:

More information

Sturm-Liouville Theory

Sturm-Liouville Theory LECTURE 5 Sturm-Liouville Theory In the three preceing lectures I emonstrate the utility of Fourier series in solving PDE/BVPs. As we ll now see, Fourier series are just the tip of the iceberg of the theory

More information

Thus f is continuous at x 0. Matthew Straughn Math 402 Homework 6

Thus f is continuous at x 0. Matthew Straughn Math 402 Homework 6 Matthew Straughn Math 402 Homework 6 Homework 6 (p. 452) 14.3.3, 14.3.4, 14.3.5, 14.3.8 (p. 455) 14.4.3* (p. 458) 14.5.3 (p. 460) 14.6.1 (p. 472) 14.7.2* Lemma 1. If (f (n) ) converges uniformly to some

More information

Continuity. Chapter 4

Continuity. Chapter 4 Chapter 4 Continuity Throughout this chapter D is a nonempty subset of the real numbers. We recall the definition of a function. Definition 4.1. A function from D into R, denoted f : D R, is a subset of

More information

Review of Linear Algebra

Review of Linear Algebra Review of Linear Algebra VBS/MRC Review of Linear Algebra 0 Ok, the Questions Why does algebra sound like cobra? Why do they say abstract algebra? Why bother about all this abstract stuff? What is a vector,

More information

Linear Algebra I. Ronald van Luijk, 2015

Linear Algebra I. Ronald van Luijk, 2015 Linear Algebra I Ronald van Luijk, 2015 With many parts from Linear Algebra I by Michael Stoll, 2007 Contents Dependencies among sections 3 Chapter 1. Euclidean space: lines and hyperplanes 5 1.1. Definition

More information

GQE ALGEBRA PROBLEMS

GQE ALGEBRA PROBLEMS GQE ALGEBRA PROBLEMS JAKOB STREIPEL Contents. Eigenthings 2. Norms, Inner Products, Orthogonality, and Such 6 3. Determinants, Inverses, and Linear (In)dependence 4. (Invariant) Subspaces 3 Throughout

More information

2. Review of Linear Algebra

2. Review of Linear Algebra 2. Review of Linear Algebra ECE 83, Spring 217 In this course we will represent signals as vectors and operators (e.g., filters, transforms, etc) as matrices. This lecture reviews basic concepts from linear

More information

Math 302 Outcome Statements Winter 2013

Math 302 Outcome Statements Winter 2013 Math 302 Outcome Statements Winter 2013 1 Rectangular Space Coordinates; Vectors in the Three-Dimensional Space (a) Cartesian coordinates of a point (b) sphere (c) symmetry about a point, a line, and a

More information

MATH 5640: Fourier Series

MATH 5640: Fourier Series MATH 564: Fourier Series Hung Phan, UMass Lowell September, 8 Power Series A power series in the variable x is a series of the form a + a x + a x + = where the coefficients a, a,... are real or complex

More information

Notes on Integrable Functions and the Riesz Representation Theorem Math 8445, Winter 06, Professor J. Segert. f(x) = f + (x) + f (x).

Notes on Integrable Functions and the Riesz Representation Theorem Math 8445, Winter 06, Professor J. Segert. f(x) = f + (x) + f (x). References: Notes on Integrable Functions and the Riesz Representation Theorem Math 8445, Winter 06, Professor J. Segert Evans, Partial Differential Equations, Appendix 3 Reed and Simon, Functional Analysis,

More information

Continuity. Chapter 4

Continuity. Chapter 4 Chapter 4 Continuity Throughout this chapter D is a nonempty subset of the real numbers. We recall the definition of a function. Definition 4.1. A function from D into R, denoted f : D R, is a subset of

More information

MATH 117 LECTURE NOTES

MATH 117 LECTURE NOTES MATH 117 LECTURE NOTES XIN ZHOU Abstract. This is the set of lecture notes for Math 117 during Fall quarter of 2017 at UC Santa Barbara. The lectures follow closely the textbook [1]. Contents 1. The set

More information

Inner product spaces. Layers of structure:

Inner product spaces. Layers of structure: Inner product spaces Layers of structure: vector space normed linear space inner product space The abstract definition of an inner product, which we will see very shortly, is simple (and by itself is pretty

More information

Projection Theorem 1

Projection Theorem 1 Projection Theorem 1 Cauchy-Schwarz Inequality Lemma. (Cauchy-Schwarz Inequality) For all x, y in an inner product space, [ xy, ] x y. Equality holds if and only if x y or y θ. Proof. If y θ, the inequality

More information

Linear Operators, Eigenvalues, and Green s Operator

Linear Operators, Eigenvalues, and Green s Operator Chapter 10 Linear Operators, Eigenvalues, and Green s Operator We begin with a reminder of facts which should be known from previous courses. 10.1 Inner Product Space A vector space is a collection of

More information

David Hilbert was old and partly deaf in the nineteen thirties. Yet being a diligent

David Hilbert was old and partly deaf in the nineteen thirties. Yet being a diligent Chapter 5 ddddd dddddd dddddddd ddddddd dddddddd ddddddd Hilbert Space The Euclidean norm is special among all norms defined in R n for being induced by the Euclidean inner product (the dot product). A

More information

Mathematics 324 Riemann Zeta Function August 5, 2005

Mathematics 324 Riemann Zeta Function August 5, 2005 Mathematics 324 Riemann Zeta Function August 5, 25 In this note we give an introduction to the Riemann zeta function, which connects the ideas of real analysis with the arithmetic of the integers. Define

More information

LEGENDRE POLYNOMIALS AND APPLICATIONS. We construct Legendre polynomials and apply them to solve Dirichlet problems in spherical coordinates.

LEGENDRE POLYNOMIALS AND APPLICATIONS. We construct Legendre polynomials and apply them to solve Dirichlet problems in spherical coordinates. LEGENDRE POLYNOMIALS AND APPLICATIONS We construct Legendre polynomials and apply them to solve Dirichlet problems in spherical coordinates.. Legendre equation: series solutions The Legendre equation is

More information