Functional Analysis Exercise Class

Similar documents
Functional Analysis Exercise Class

Functional Analysis Exercise Class

Applied Analysis (APPM 5440): Final exam 1:30pm 4:00pm, Dec. 14, Closed books.

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product

Inner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:

Functional Analysis HW #5

Hilbert Spaces. Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space.

Vector Spaces. Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms.

I teach myself... Hilbert spaces

Mathematical Methods wk 1: Vectors

Mathematical Methods wk 1: Vectors

Vectors in Function Spaces

5 Compact linear operators

Linear Algebra. Paul Yiu. Department of Mathematics Florida Atlantic University. Fall A: Inner products

MAT Linear Algebra Collection of sample exams

Functional Analysis Exercise Class

The following definition is fundamental.

Recall that any inner product space V has an associated norm defined by

David Hilbert was old and partly deaf in the nineteen thirties. Yet being a diligent

Section 7.5 Inner Product Spaces

Exercises * on Linear Algebra

Chapter 1. Preliminaries. The purpose of this chapter is to provide some basic background information. Linear Space. Hilbert Space.

Linear Algebra Massoud Malek

Your first day at work MATH 806 (Fall 2015)

Hilbert Spaces: Infinite-Dimensional Vector Spaces

Functional Analysis F3/F4/NVP (2005) Homework assignment 2

Real Analysis, 2nd Edition, G.B.Folland Elements of Functional Analysis

2. Review of Linear Algebra

LINEAR ALGEBRA QUESTION BANK

Part 1a: Inner product, Orthogonality, Vector/Matrix norm

MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.

Inner Product Spaces An inner product on a complex linear space X is a function x y from X X C such that. (1) (2) (3) x x > 0 for x 0.

Linear Analysis Lecture 5

Math 24 Spring 2012 Sample Homework Solutions Week 8

1. General Vector Spaces

Vector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis.

x 3y 2z = 6 1.2) 2x 4y 3z = 8 3x + 6y + 8z = 5 x + 3y 2z + 5t = 4 1.5) 2x + 8y z + 9t = 9 3x + 5y 12z + 17t = 7

j=1 [We will show that the triangle inequality holds for each p-norm in Chapter 3 Section 6.] The 1-norm is A F = tr(a H A).

Further Mathematical Methods (Linear Algebra) 2002

1 Inner Product Space

CHAPTER II HILBERT SPACES

CHAPTER VIII HILBERT SPACES

Math 4377/6308 Advanced Linear Algebra I Dr. Vaughn Climenhaga, PGH 651A HOMEWORK 3

Prof. M. Saha Professor of Mathematics The University of Burdwan West Bengal, India

Introduction to Signal Spaces

4 Hilbert spaces. The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan

2.4 Hilbert Spaces. Outline

Solutions: Problem Set 3 Math 201B, Winter 2007

Math Linear Algebra II. 1. Inner Products and Norms

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.

Lecture 3: Review of Linear Algebra

Your first day at work MATH 806 (Fall 2015)

Lecture 3: Review of Linear Algebra

REAL AND COMPLEX ANALYSIS

Exercise Solutions to Functional Analysis

HILBERT SPACES AND THE RADON-NIKODYM THEOREM. where the bar in the first equation denotes complex conjugation. In either case, for any x V define

Further Mathematical Methods (Linear Algebra) 2002

Recall: Dot product on R 2 : u v = (u 1, u 2 ) (v 1, v 2 ) = u 1 v 1 + u 2 v 2, u u = u u 2 2 = u 2. Geometric Meaning:

Functional Analysis. Franck Sueur Metric spaces Definitions Completeness Compactness Separability...

Elementary linear algebra

Analysis Preliminary Exam Workshop: Hilbert Spaces

The Gram-Schmidt Process 1

Math 5520 Homework 2 Solutions

Fourier and Wavelet Signal Processing

Orthonormal Bases; Gram-Schmidt Process; QR-Decomposition

MATH 167: APPLIED LINEAR ALGEBRA Chapter 3

Real Analysis Notes. Thomas Goller

Functional Analysis (2006) Homework assignment 2

1 Functional Analysis

Topics in Fourier analysis - Lecture 2.

Real and Complex Analysis, 3rd Edition, W.Rudin Elementary Hilbert Space Theory

Math Real Analysis II

THE PROBLEMS FOR THE SECOND TEST FOR BRIEF SOLUTIONS

Lecture Notes 1: Vector spaces

1 Definition and Basic Properties of Compa Operator

Elements of Positive Definite Kernel and Reproducing Kernel Hilbert Space

MTH 503: Functional Analysis

Solutions to Homework #3, Math 116

Theorem (4.11). Let M be a closed subspace of a Hilbert space H. For any x, y E, the parallelogram law applied to x/2 and y/2 gives.

MATH NEW HOMEWORK AND SOLUTIONS TO PREVIOUS HOMEWORKS AND EXAMS

GQE ALGEBRA PROBLEMS

Functional Analysis. Martin Brokate. 1 Normed Spaces 2. 2 Hilbert Spaces The Principle of Uniform Boundedness 32

Bases in Banach spaces

Mathematics Department Stanford University Math 61CM/DM Inner products

i x i y i

Functional Analysis. AMAT 617 University of Calgary Winter semester Lecturer: Gilad Gour Notes taken by Mark Girard.

Problem Set 1. Homeworks will graded based on content and clarity. Please show your work clearly for full credit.

Solutions to the Exercises * on Linear Algebra

4.4. Orthogonality. Note. This section is awesome! It is very geometric and shows that much of the geometry of R n holds in Hilbert spaces.

Best approximation in the 2-norm

Functional Analysis Review

MA 1B ANALYTIC - HOMEWORK SET 7 SOLUTIONS

Math 413/513 Chapter 6 (from Friedberg, Insel, & Spence)

MATH 5640: Fourier Series

Methods of Mathematical Physics X1 Homework 2 - Solutions

Math 209B Homework 2

2. Dual space is essential for the concept of gradient which, in turn, leads to the variational analysis of Lagrange multipliers.

Inner Product Spaces

3 Orthogonality and Fourier series

Class notes: Approximation

Transcription:

Functional Analysis Exercise Class Week: December 4 8 Deadline to hand in the homework: your exercise class on week January 5. Exercises with solutions ) Let H, K be Hilbert spaces, and A : H K be a linear operator. Show that and x max{ y, x : y H, y } max{ y, x : y H, y }, x H, A sup{ y, Ax : x H, x, y K, y } sup{ y, Ax : x H, x, y K, y }. Solution: If x or A then all the claims are trivial, hence for the rest we assume that x and A. By the Cauchy-Schwarz inequality, y, x y x x when y, and hence sup{ y, x : y H, y } sup{ y, x : y H, y } x. On the other hand, choosing y : x/ x, we get y, x x x, x x x the suprema in both expressions above are attained and give x. Consequently, sup{ y, Ax : x H, x, y K, y } sup {sup{ y, Ax : y K, y } : x H, x } sup { Ax : x H, x } A, and the other expression follows the same way. x, and hence ) Show that there exists an inner product on l p : l p N, K) such that x p x, x for every x l p if and only if p. Hint: Use the characterization via the parallelogram identity.) Solution: For every i N, let e i j) : δ i,j. Let i, j N be such that i j. Then e i e j, and e i + e j + e i e j p + p.

Hence, e i + e j + e i e j e i + e j ) p 4 p. This shows that for p, there is no such inner product. For p, define x, y : xi)yi). i N This sum is finite by the Hölder inequality with p q ), and it is easily seen to give a sesquilinear form on l. Obviously, x : x, x i N xi) x, as required. 3) Let {x i } i I be a set of non-zero pairwise orthogonal vectors in an inner product space. Show that {x i } i I is linearly independent. Solution: Assume that there exist i,..., i r and λ,..., λ r K such that r j λ jx ij. For every k,..., r, r r r λ j x ij, x ik λ j xij, x ik λ j δ k,j x ik λ k x ik, j and hence λ... λ r. j 4) Show that if x,..., x n, are pairwise orthogonal vectors in an inner product space i.e., x i, x j for i j) then n n x i x i. i i j Solution: We have n n x i x i, i i n n n x i x i, x j δ i,j x i i i,j i,j n x i. i 5) Let H be a Hilbert space, and {x n } n N H be an orthogonal system, i.e., x n, x m for every n m. Show that x n is convergent x n < +, and then x n x n. Show that the if the x n are not pairwise orthogonal then + x n < + does not imply the convergence of + x n, and even if the infinite sum is covergent, the identity + x n + x n need not hold.

Solution: For every N N, let s N : N x n. Let N, M N, and assume without loss of generality that N M. Then s N s M M nn+ x n M nn+ x n. Hence, s N ) n N is convergent it is Cauchy + x n < +, where the first equivalence is due to the completeness of the space. Assume that the limit s : lim N + x n : + x n exists. Since the norm is continuous, we have x n lim s N N N + lim s N lim x n x n, N + N + where we used Exercise 4) for the third equality. Consider now a non-zero vector x, and let x n : x, n N. Then n x n x + However, for N < M, we have s N s M M nn+ n < +. x n x M nn+ n x M nn+ ). n Keeping N fixed, the above expression converges to + as M +. Hence the sequence s N : N x n is not Cauchy, and thus not convergent, either. Even if + x n is convergent, the identity + x n + x n need not hold, as one can check with just two non-orthogonal vectors i.e., x, x but x n n > ). 6) Let {e n } n N be an orthonormal system in a Hilbert space H, and let c n K, n N. Show that c n x n is convergent c n < +, and then c n x n c n. Solution: Let x n : c n e n ; then x n, x m δ n,m c n, and the statement is immediate from Exercise 5). 3

7) Let {e n } n N {} be an orthonormal system in a Hilbert space H, and for every t, ), let x t : n t n e n..) Show that the above sum is convergent, and the set {x t } t,) is linearly independent. Conclude that every infinite-dimensional Hilbert space is at least of continuum dimension. Hint: Connect the problem to the Vandermonde determinant.) Solution: With c n : t n, n N {}, we have n c n n t n t, and hence the convergence of.) follows from Exercise 6). t,..., t r, ) and λ,..., λ r K such that r r ) λ i x ti λ i t n i e n. i n i Assume that there exist Then + r ) λ i t n i e n, e m i r λ i t m i i for every m N. Writing it in matrix form for m,..., r, we get... λ t t... t r λ t t... t r λ 3.... t r t r... t r r λ r The matrix above is the so-called Vandermonde matrix, the determinant of which is i<j r t j t i ) if all the t i are different. Hence, λ... λ r. This shows that {x t } t,) is linearly independent. Assume that H is a Hilbert space of infinite algebraic dimension. Then there exists a linearly independent set {x n } n N of countably infinite cardinality. Applying the Gram- Schmidt orthogonalization process to this set, we get an orthonormal system {e n } n N. From this we can construct a linearly independent set {x t } t,) by the above procedure. Hence, the dimension of H is at least continuum. 8) Let e n, n N, be an orthonormal system in a Hilbert product space, and for every finite subset I N, let H I be the subspace generated by e i, i I. Show that if x + c ne n then its projection onto H I is given by i I c ie i. 4

Solution: Obviously, e i, i I, is an orthonormal basis in H I. According to what was shown in the lecture, the projection P I x of x onto H I is given by P I x i I e i x, e i. By the continuity of the inner product, + x, e i c n e n, e i c n e n, e i from which the statement follows. 9) Let f, g : π fx)gx) dx for every f, g C[, ], R). a) Show that.,. is an inner product on C[, ], R). b) Show that { π, π cos nx, } sin nx : n N π is an orthonormal system in C[, ], R). c) Determine π min cos x α sinx) β cosx) ) dx, α,β R c n δ n,i c i, and give the values of α, β where the minimum is reached. Hint: Use the addition formulas sinx±y) sin x cos y±cos x sin y, cosx+y) cos x cos y sin x sin y.) Solution: a) The linearity of the integral yields that.,. is sesquilinear, and it is hermitian, as Finally, f, g f, f π π fx)gx) dx fx) dx, π gx)fx) dx g, f. and it is equal to if and only if f, due to continuity. 5

b) Let e x) π, e n x) : π cos nx, and e n+ x) : π sin nx, n N. We only show that e n+, e m+ δ n,m ; the proof for the other cases goes the same way. Note that we have and hence sinnx) sinmx) cosn m)x cosn + m)x, π e n+, e m+ sinnx) sinmx) dx π π cosn m)x cosn + m)x dx π π cosn m)x dx π δ n,m, as required. c) Note that we have π m : min cos x α sinx) β cosx) ) dx min f αe 5 + βe 4 ), α,β R α,β R where fx) : cos x. By definition, the minimum is attained for the α, β such that αe 5 + βe 4 is the projection P f of f onto the subspace spanned by e 4, e 5, i.e., Note that α f, e 5, β f, e 4. and hence cos x) + cosx) π π e + e 4, α f, e 5, β f, e 4 Moreover, for the optimal α, β we have π, P f e 4. π min cos x α sinx) β cosx) ) dx α,β R f P f π e π 4 e π. 6

Homework with solution ) Let H be an inner product space. Show that a sequence x n ) n N converges to an x H if and only if i) x n x as n + ; ii) for every y H, y, x n y, x as n +. Solution: Convergence of x n to x implies i) and ii) due to the continuity of the norm and the inner product. Assume now that i) and ii) hold. Then x n x x n + x x n, x x, x n n + x + x x, x x, x, i.e., x n x as n +. ) Let C[, ], K) be equipped with the inner product f, g : fx)gx) dx. Find the projection of the function fx) : sin x to the subspace of all polynomial functions of degree at most. Using this result, find the optimal a, b where min a,b K is attained. sin πx ) a bx Hint: Construct an orthonormal basis in the given subspace.) Solution: Let f x), f x) x, x [, ]. Our aim is to construct an orthonormal basis {e, e } in span{f, f }. Note that f has norm, and we can choose e : f. To obtain f, we use Gram-Schmidt orthogonalization, that yields f f, e e )x) x x dx x, and f f, e e e. Let e : f / f, where f x ) dx x x + ) dx 4 3 + 4, and hence e x) x ). Then {e, e } is an ONB in span{f, f }. The projection P of any function g onto span{f, f } is given by P g g, e e + g, e e gt) dt + x ) [,] For g α x) sin αx we get sin αt dt [ cos αt] /α cos α)/α, [,] t sin αt dt cos α α + sin α α, [,] 7 gt) [,] t ) dt.

and hence P g α )x) cos α α In particular, for α we get α + sin α α cos α + x 6). α + sin cos P sin)x) cos + x 6) 4 + cos 6 sin + x 6 + sin 6 cos ), ) and for α π/, P g π/ )x) π + x 6)4 π π 8π 4 π 48 π + x. π We have min a,b K sin πx ) a bx min gπ/ af bf a,b K min g span{f,f } and the mimimum is reached at P g π/. Thus, the optimal a, b are given by gπ/ g, a 8π 4 π, b 48 π π. Scores: e : point, e : 3 points, correct application of the projection formula: 3 points, correct formula for the projection of sin: point, correct formula for the projection of g π/ : point, optimal a, b: points. 8