Prof. M. Saha Professor of Mathematics The University of Burdwan West Bengal, India
|
|
- Kellie Thomasina Young
- 5 years ago
- Views:
Transcription
1 CHAPTER 9 BY Prof. M. Saha Professor of Mathematics The University of Burdwan West Bengal, India mantusaha.bu@gmail.com
2 Introduction and Objectives In the preceding chapters, we discussed normed linear spaces and Banach spaces. These spaces has linear properties as well as metric properties. Although the norm on a linear space generalizes the elementary concept of the length of a vector, but the main geometric concept other than the length of a vector is the angle between two vectors, In this chapter, we take the opportunity to study linear spaces having an inner product, a generalization of the usual dot product on finite dimensional linear spaces. The concept of an inner product in a linear space leads to an inner product space and a complete inner product space which is called a Hilbert space. The theory of Hilbert Spaces does not deal with angles in general. Most interestingly, it helps us to introduce an idea of perpendicularity for two vectors and the geometry deals in various fundamental aspects with Euclidean geometry. The basics of the theory of Hilbert spaces was given by in 1912 by the work of German mathematician D. Hilbert ( ) on integral equations. However, an axiomatic basis of the theory was given by famous mathematician J. Von Neumann ( ). However, Hilbert spaces are the simplest type of infinite dimensional Banach spaces to tackle a remarkable role in functional analysis. This chapter is divided into four modules. Module 1 ideals with the introduction of inner product spaces and Hilbert spaces with some examples. Some basic properties are given in it. Module 2 is concerned with the conception of orthogonal and orthonormal vectors in a Hilbert space. Some basic result are shown.. Module 3 is devoted mainly with very fundamental results on inner product spaces. Module 4 is discussed on some fundamental results on the Hilbert spaces particularly on approximation theory of convex subsets of a Hilbert spaces. Module 5 is emphasized on infinite series are those convergence in Hilbert spaces. Also with an introduction of isometric isomorphism property between two infinite dimensional Hilbert spaces an important theorem namely Reisz Fischer s Theorem has been stated. 2
3 Module-1: Inner Product Spaces Definition 9.1.1: Let, X be a linear space over a field of complex numbers. If for every pair (x, y) X X there corresponds a scalar denoted by x, y called inner product of x and y of X such that the following properties hold. (IP.1) x, y = y, x where (x, y) X X and complex number. denotes the conjugate of the (IP.2) for all α C, αx, y = α x, y, (x, y) X X. (IP.3) for all x, y, z X x + y, z = x, z + y, z. (IP.4) x, x 0 and x, x = 0 iff x = θ. Then (X,. ) is called an inner product space or pre-hilbert space. Remark 9.1.1: The following properties hold in an inner product space. Let X be an inner product space then, (i) for all α, β C, αx + βy, z) = α x, z + β y, z x, y, z X. (ii) for all α C x, αy = ᾱ x, y x, y X (iii) for all α, β C x, y, z X. x, αy + βz = ᾱ x, y + β x, z. 3
4 Remark 9.1.2: Inner product induces a norm. For this we proceed as follows: Proof: Let X be an inner product space. Take x X Define x = + x, x (9.1.1) Now, x 0 as x, x 0 by (IP.4). Also, x = 0 iff x = θ by (IP.4) Take α C so, αx 2 = αx, αx, α X = αᾱ x, x, x X = α 2 x 2, x X so αx = = α x, x X To prove the triangle inequality we first state and prove Cauchy Schwarz Inequality. Cauchy Schwarz Inequality: Proof: If y = θ X then the result follows trivially. Let y θ X. Then for every scalars λ C, x + λy, x + λy 0 x, y x y x, y X (9.1.2) = x, x + x, λy + λy, x + λy, λy 0 (By (IP.3)) = x, x + λ x, y + λ y, x + λy 2 0 = x 2 + λ x, y + λ x, y + λ 2 y 2 0 Take x, y λ = y, y So, x 2 x, y x, y x, y x, y x, y 2 + y 2 0. y 2 y 2 y 4 So, x 2 x, y 2 y 2 x, y 2 y 2 + x, y 2 y 2 0 4
5 So x 2 x, y 2 0 y 2 = x 2 y 2 x, y 2 = x y x, y So x, y x y Sometimes this inequality is abbreviated as C-S inequality. We see that equality sign will hold if and only if in above derivation x + λy, x + λy = 0 = x + λy 2 = 0 = x + λy = θ X, i.e x and y are linearly dependent. We shall now prove triangle inequality for norm. Now x, y X. Now, x + y 2 = x + y, x + y = x, x + x, y + y, x + y, y = x 2 + y 2 + x, y + y, x So, x + y 2 = x 2 + y 2 + x, y + y, x x 2 + y 2 + x, y + y, x = So, x + y x + y. x 2 + y x y ( ) 2 x + y Hence, inner product induces a norm and consequently every inner product space is a normed linear space. Remark 9.1.3: So every inner product space is a metric space and the metric induced by inner product is defined as follows: for all x, y X define d : X X R by d(x, y) = x y = + x y, x y (9.1.3) Theorem 9.1.1: Every inner product function is a continuous function. (Equivalently, if f : X X C defined by f(x, y) = x, y, continuous). x, y X then f is Proof: Let X be an inner product space. Define f : X X C by f(x, y) = x, y, x, y X. Now take {x n } and {y n } be a sequence in X such that x n x as 5
6 n and y n y as n. So, x n x 0 as n and y n y 0 as n. As, x n x as n then, x n x as n. So, { x n } are bounded. So, there exists a constant M > 0 such that x n M, n. Now, x n, y n x, y = x n, y n x n, y + x n, y x, y = x n, y n y + x n x, y x n, y n y + x n x, y x n y n y + x n x y [By C-S inequality (9.1.2)] M y n y + x n x y 0 as n i.e x n, y n x, y as n, implying that f(x n, y n ) f(x, y) as n. So, f is continuous. Theorem (Parallelogram Law): Let X be an inner product space and let x, y X. Then, x + y 2 + x y 2 = 2 ( x 2 + y 2) Proof: x + y 2 = x + y, x + y = x, x + x, y + y, x + y, y = x 2 + y 2 + x, y + y, x (9.1.4) and x y 2 = x y, x y = x, x + x, y + y, x + y, y = x 2 + y 2 x, y y, x (9.1.5) Adding (9.1.4) and (9.1.5) we get x + y 2 + x y 2 = 2 ( x 2 + y 2) Theorem (Polarization Identity): Let X be an inner product space, let x, y X. Then x, y = 1 ] [ x + y 2 x y 2 + i x iy 2 i x iy 2 (9.1.6) 4 6
7 Proof: Now, x + y 2 = x 2 + y 2 + x, y + y, x (9.1.7) x y 2 = x 2 + y 2 x, y y, x (9.1.8) Replacing y by iy in (9.1.7) and (9.1.8) x + iy 2 = x 2 + iy 2 + x, iy + iy, x = x 2 + y 2 i x, y + i y, x (9.1.9) x iy 2 = x 2 + iy 2 x, iy iy, x = x 2 + y 2 + i x, y i y, x (9.1.10) (9.1.7) (9.1.8) + i(9.1.9) i(9.1.10), we get (9.1.6). Hence the result. Theorem 9.1.4: Let X be an inner product space. Then (i) Every Cauchy sequence is bounded (ii) If {x n } and {y n } are two Cauchy sequences in X then { x n, y n } is also a Cauchy sequence in C and hence convergence in C. Proof: (i) Let, {x n } be a Cauchy sequences in X. Then for ε = 1 there exists a positive integer N such that, x n x m < 1, whenever, n, m N. In particular, x n x N < 1, whenever n N. Now, x n x n x N + x N < 1 + x N n N. { } Let, M = max x 1, x 2,, x N 1, x N + 1 so, x n M bounded. (ii) Let {x n }, {y n } be two Cauchy sequences in X. So, x n x m 0 as n, m and y n y m 0 as n, m. n so, {x n } is Also, by (i) x n M for all n and for some M > 0. Similarly y n K, for some K > 0 and n. Now, x n, y n x m, y m = x n, y n x n, y m + x n, y m x m, y m = x n, y n y m + x n x m, y m x n, y n y m + x n x m, y n 7
8 x n y n y m + x n x m y n (By C-S inequality) M y n y m + K x n + x m 0 as n, m. So, { x n, y n } is a Cauchy sequences of scalars in C. As C is complete, { x n, y n } is convergent in C. Definition 9.1.2: A complete inner product space is called a Hilbert space i.e. an inner product space X which is complete with respect to a metric d : X X R induced by the inner product, on X X i.e. d(x, y) = x y, x y 1/2 x, y X. Theorem 9.1.5: A Banach space X is a Hilbert space if and only if parallelogram law holds in it. Proof: We know that every Hilbert space X is a Banach space where parallelogram law holds in it. Conversely suppose that X is a Banach space where parallelogram law holds. Without loss of generality we can assume a function, whose range is R. For all x, y X. Define, : X X R by x, y = 1 ] [ x + y 2 x y 2 4 (9.1.11) i.e. for real inner product space we start with (9.1.11) and sometimes we write R x, y = 1 4[ x + y 2 x y 2], x, y X. Clearly x, y = y, x as x, y is real. Also x, x 0 x X and x, x = 0 iff x = 0. So, (IP.1) and (IP.4) holds. Now, for u, v, w X u + v + w 2 + u + v w 2 = 2 ( u + v 2 + w 2) (9.1.12) u v + w 2 + u v w 2 = 2 ( u v 2 + w 2) (9.1.13) By (9.1.12) (9.1.13) we get u + v + w 2 + u + v w 2 u v + w 2 + u v w 2 = 2 ( u + v 2 u v 2) = 4 [ u + w, v + u w, v ] = 2.4 u, v = u + w, v + u w, v = 2 u, v (9.1.14) Put, u = w 2u, v = 2 u, v (9.1.15) 8
9 Again put, x 1 = u + w, x 2 = u w, x 3 = v then from (9.1.14) we get So, (IP.3) holds. x 1, x 3 + x 2, x 3 = 2 u, v = 2u, v (by (9.1.15)) From (9.1.16) for x 1, x 2, x 3, x 4 X, = x 1 + x 2, x 3 (9.1.16) x 1 + x 2 + x 3, x 4 = x 1 + x 2, x 4 + x 3, x 4 = x 1, x 4 + x 2, x 4 + x 3, x 4 Put x 1 = x 2 = x 3 = x, x 4 = y i.e. 3x, y = 3 x, y. So, by Principle of Mathematical Induction for any positive integer n nx, y = n x, y x, y X (9.1.17) Now, x, y = 1 ] [ x + y 2 x y 2 4 = 1 [ ] x + y 2 + y x 2 = x, y (9.1.18) 4 Take, n = m (m > 0) nx, y = mx, y = m( x), y = m x, y (by (9.1.17)) = m x, y (by (9.1.18)) = n x, y So (9.1.17) is also true for any negative integer. Thus λx, y = λ x, y, when λ is either positive integer or a negative integer. Take λ = p/q = a rational number where,, gcd(p, q) = 1 and p and q are integer. p Now λx, y = q x, y p So q λx, y = q q x, y = px, y = p x, y = λx, y = p x, y q p = q x, y = p x, y (9.1.19) q 9
10 Let, λ be any real. So there exists a sequence of rationals {r n } such that r n λ as n. So, r n x, y = r n x, y λ x.y as n Now, r n x, y λx, y = (r n λ)x, y (r n λ)x y (by C-S inequality (9.1.2)) = r n λ x y 0 as n r n x, y λx, y as n. So, λx, y = λ x, y x, y X. So, (IP.2) holds. So, X is an inner product space with respect to (9.1.11) consequently, X is a Hilbert space. Note: For a complete inner product space we start with Rl x, y = 1 [ x + 4 y 2 x y 2 ], Im x, y = 1 [ x + 4 iy 2 x iy 2 ], x, y X and the proof is similar to the proof of real inner product space. (Readers can verify it) Example 9.1.1: The Euclidean space R n is a Hilbert space. Solution: Let x = (ζ 1, ζ 2,, ζ n ) and y = (η 1, η 2,, η n ) be two element of R n. We define the inner product of x and y by (x, y) = ζ 1 η 1 + ζ 2 η ζ n η n. Then x = x, x = (ζ1 2 + ζ ζn) It may be easily verified that all the inner product axioms are satisfied in R n and the Euclidean metric d is obtained by d(x, y) = n x y = x y, x y 1 2 = (ζ i η i ) 2. With respect to this metric we can at once see that R n is complete so as to make R n, a Hilbert space. i=1 Example 9.1.2: The Euclidean space C n is a Hilbert space. Solution: Let x = (ζ 1, ζ 2,, ζ n ) and y = (η 1, η 2,, η n ) be two elements of C n. We define the inner product of x and y by x, y = ζ 1 η 1 + ζ 2 η ζ n η n. Then x = x, x = ( ζ ζ ζ n 2 ) 1 2. It may be easily verified that all the inner product axioms are satisfied in C n and the Euclidean metric d is obtained by n d(x, y) = x y = x y, x y 1 2 = (ζ i η i ) 2. With respect to this metric we can at once see that C n is complete so as to make C n, a Hilbert space. i=1 Example 9.1.3: The space l 2 is a Hilbert space. 10
11 Solution: Let x = {ζ i } and y = {η i } be elements of l 2. We define the inner product of x and y by x, y = ζ i η i convergence of the series on the right hand side follows i=1 from the fact that x l 2 and ζ i η i ζ i 2 + η i Then x = ( ) 1 2 x, x = ζ i. It can be easily shown that all the inner product i=1 axioms (IP.1) -(IP.4) are satisfied in l 2. The metric d of l 2 is defined by d(x, y) = ( n ) 1 x y = x y, x y 1 2 = ζ i η i 2 2. With respect to this metric we can at i=1 once see that l 2 is complete so as to make l 2 a Hilbert space. But for 1 p <, following example. l p (p 2 is not a Hilbert space. It can be shown by the Example 9.1.4: For 1 p <, l p (p 2) is not an inner product space and hence not a Hilbert space. Solution: Let x = (1, 1, 0, 0, ) l p and y = (1, 1, 0, 0, ) l p. Then x = y = 2 1 p does not hold. and x + y = x y = 2. Now we see that if p 2, the parallelogram law Hence 1 p < l p (p 2) is not an inner product space and consequently it is not a Hilbert space. Example 9.1.5: The space c[a, b] of all real valued continuous in the closed interval [a, b] is not an inner product space with respect to sup norm and hence not a Hilbert space. Solution: Here the norm defined by x = sup x(t). Take x(t) = 1, t [a, b] and a t b y(t) = t a, t [a, b]. Then x = 1, y = 1, x + y = 2, x y = 1. By simple b a calculations we see that parallelogram law does not hold in it. Hence c[a, b] is not a Hilbert space. Example 9.1.6: The space L 2 [a, b], the space of all square integrable functions over [a, b] is a Hilbert space. Solution: Define the inner product on L 2 [a, b] by x, y = b x(t)y(t) dt, x, y a b L 2 [a, b] and the norm on L 2 [a, b] is given by x = z x(t) 2 dt. Also with respect 11
12 to this norm it can be shown that L 2 [a, b] is complete with respect to a metric defined by So L 2 [a, b] is a Hilbert space. [ b d(x, y) = a ] 1 x(t) y(t) 2 2 dt. 12
Chapter 1. Preliminaries. The purpose of this chapter is to provide some basic background information. Linear Space. Hilbert Space.
Chapter 1 Preliminaries The purpose of this chapter is to provide some basic background information. Linear Space Hilbert Space Basic Principles 1 2 Preliminaries Linear Space The notion of linear space
More informationLinear Normed Spaces (cont.) Inner Product Spaces
Linear Normed Spaces (cont.) Inner Product Spaces October 6, 017 Linear Normed Spaces (cont.) Theorem A normed space is a metric space with metric ρ(x,y) = x y Note: if x n x then x n x, and if {x n} is
More informationI teach myself... Hilbert spaces
I teach myself... Hilbert spaces by F.J.Sayas, for MATH 806 November 4, 2015 This document will be growing with the semester. Every in red is for you to justify. Even if we start with the basic definition
More informationCHAPTER II HILBERT SPACES
CHAPTER II HILBERT SPACES 2.1 Geometry of Hilbert Spaces Definition 2.1.1. Let X be a complex linear space. An inner product on X is a function, : X X C which satisfies the following axioms : 1. y, x =
More informationElementary linear algebra
Chapter 1 Elementary linear algebra 1.1 Vector spaces Vector spaces owe their importance to the fact that so many models arising in the solutions of specific problems turn out to be vector spaces. The
More informationDavid Hilbert was old and partly deaf in the nineteen thirties. Yet being a diligent
Chapter 5 ddddd dddddd dddddddd ddddddd dddddddd ddddddd Hilbert Space The Euclidean norm is special among all norms defined in R n for being induced by the Euclidean inner product (the dot product). A
More informationFinite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product
Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )
More informationMAT 771 FUNCTIONAL ANALYSIS HOMEWORK 3. (1) Let V be the vector space of all bounded or unbounded sequences of complex numbers.
MAT 771 FUNCTIONAL ANALYSIS HOMEWORK 3 (1) Let V be the vector space of all bounded or unbounded sequences of complex numbers. (a) Define d : V V + {0} by d(x, y) = 1 ξ j η j 2 j 1 + ξ j η j. Show that
More informationFunctional Analysis. Martin Brokate. 1 Normed Spaces 2. 2 Hilbert Spaces The Principle of Uniform Boundedness 32
Functional Analysis Martin Brokate Contents 1 Normed Spaces 2 2 Hilbert Spaces 2 3 The Principle of Uniform Boundedness 32 4 Extension, Reflexivity, Separation 37 5 Compact subsets of C and L p 46 6 Weak
More informationLecture # 3 Orthogonal Matrices and Matrix Norms. We repeat the definition an orthogonal set and orthornormal set.
Lecture # 3 Orthogonal Matrices and Matrix Norms We repeat the definition an orthogonal set and orthornormal set. Definition A set of k vectors {u, u 2,..., u k }, where each u i R n, is said to be an
More informationSpectral Theory, with an Introduction to Operator Means. William L. Green
Spectral Theory, with an Introduction to Operator Means William L. Green January 30, 2008 Contents Introduction............................... 1 Hilbert Space.............................. 4 Linear Maps
More informationThe following definition is fundamental.
1. Some Basics from Linear Algebra With these notes, I will try and clarify certain topics that I only quickly mention in class. First and foremost, I will assume that you are familiar with many basic
More informationIntroduction to Signal Spaces
Introduction to Signal Spaces Selin Aviyente Department of Electrical and Computer Engineering Michigan State University January 12, 2010 Motivation Outline 1 Motivation 2 Vector Space 3 Inner Product
More informationAnother consequence of the Cauchy Schwarz inequality is the continuity of the inner product.
. Inner product spaces 1 Theorem.1 (Cauchy Schwarz inequality). If X is an inner product space then x,y x y. (.) Proof. First note that 0 u v v u = u v u v Re u,v. (.3) Therefore, Re u,v u v (.) for all
More informationFurther Mathematical Methods (Linear Algebra) 2002
Further Mathematical Methods (Linear Algebra) 22 Solutions For Problem Sheet 3 In this Problem Sheet, we looked at some problems on real inner product spaces. In particular, we saw that many different
More information5 Compact linear operators
5 Compact linear operators One of the most important results of Linear Algebra is that for every selfadjoint linear map A on a finite-dimensional space, there exists a basis consisting of eigenvectors.
More informationHilbert Spaces. Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space.
Hilbert Spaces Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space. Vector Space. Vector space, ν, over the field of complex numbers,
More informationInner Product Spaces An inner product on a complex linear space X is a function x y from X X C such that. (1) (2) (3) x x > 0 for x 0.
Inner Product Spaces An inner product on a complex linear space X is a function x y from X X C such that (1) () () (4) x 1 + x y = x 1 y + x y y x = x y x αy = α x y x x > 0 for x 0 Consequently, (5) (6)
More informationFunctional Analysis MATH and MATH M6202
Functional Analysis MATH 36202 and MATH M6202 1 Inner Product Spaces and Normed Spaces Inner Product Spaces Functional analysis involves studying vector spaces where we additionally have the notion of
More informationChapter 1. Complex Numbers. Dr. Pulak Sahoo
Chapter 1 Complex Numbers BY Dr. Pulak Sahoo Assistant Professor Department of Mathematics University Of Kalyani West Bengal, India E-mail : sahoopulak1@gmail.com 1 Module-1: Basic Ideas 1 Introduction
More information2. Review of Linear Algebra
2. Review of Linear Algebra ECE 83, Spring 217 In this course we will represent signals as vectors and operators (e.g., filters, transforms, etc) as matrices. This lecture reviews basic concepts from linear
More informationVectors in Function Spaces
Jim Lambers MAT 66 Spring Semester 15-16 Lecture 18 Notes These notes correspond to Section 6.3 in the text. Vectors in Function Spaces We begin with some necessary terminology. A vector space V, also
More informationPROBLEMS. (b) (Polarization Identity) Show that in any inner product space
1 Professor Carl Cowen Math 54600 Fall 09 PROBLEMS 1. (Geometry in Inner Product Spaces) (a) (Parallelogram Law) Show that in any inner product space x + y 2 + x y 2 = 2( x 2 + y 2 ). (b) (Polarization
More informationApplied Analysis (APPM 5440): Final exam 1:30pm 4:00pm, Dec. 14, Closed books.
Applied Analysis APPM 44: Final exam 1:3pm 4:pm, Dec. 14, 29. Closed books. Problem 1: 2p Set I = [, 1]. Prove that there is a continuous function u on I such that 1 ux 1 x sin ut 2 dt = cosx, x I. Define
More informationFUNCTIONAL ANALYSIS-NORMED SPACE
MAT641- MSC Mathematics, MNIT Jaipur FUNCTIONAL ANALYSIS-NORMED SPACE DR. RITU AGARWAL MALAVIYA NATIONAL INSTITUTE OF TECHNOLOGY JAIPUR 1. Normed space Norm generalizes the concept of length in an arbitrary
More informationFunctional Analysis. Franck Sueur Metric spaces Definitions Completeness Compactness Separability...
Functional Analysis Franck Sueur 2018-2019 Contents 1 Metric spaces 1 1.1 Definitions........................................ 1 1.2 Completeness...................................... 3 1.3 Compactness......................................
More informationCHAPTER VIII HILBERT SPACES
CHAPTER VIII HILBERT SPACES DEFINITION Let X and Y be two complex vector spaces. A map T : X Y is called a conjugate-linear transformation if it is a reallinear transformation from X into Y, and if T (λx)
More informationInner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:
Inner products Definition: An inner product on a real vector space V is an operation (function) that assigns to each pair of vectors ( u, v) in V a scalar u, v satisfying the following axioms: 1. u, v
More informationIntroduction and Preliminaries
Chapter 1 Introduction and Preliminaries This chapter serves two purposes. The first purpose is to prepare the readers for the more systematic development in later chapters of methods of real analysis
More informationVector Spaces. Commutativity of +: u + v = v + u, u, v, V ; Associativity of +: u + (v + w) = (u + v) + w, u, v, w V ;
Vector Spaces A vector space is defined as a set V over a (scalar) field F, together with two binary operations, i.e., vector addition (+) and scalar multiplication ( ), satisfying the following axioms:
More informationCambridge University Press The Mathematics of Signal Processing Steven B. Damelin and Willard Miller Excerpt More information
Introduction Consider a linear system y = Φx where Φ can be taken as an m n matrix acting on Euclidean space or more generally, a linear operator on a Hilbert space. We call the vector x a signal or input,
More informationLecture Notes in Functional Analysis
Lecture Notes in Functional Analysis Please report any mistakes, misprints or comments to aulikowska@mimuw.edu.pl LECTURE 1 Banach spaces 1.1. Introducton to Banach Spaces Definition 1.1. Let X be a K
More informationLecture 4 Lebesgue spaces and inequalities
Lecture 4: Lebesgue spaces and inequalities 1 of 10 Course: Theory of Probability I Term: Fall 2013 Instructor: Gordan Zitkovic Lecture 4 Lebesgue spaces and inequalities Lebesgue spaces We have seen how
More information1 Inner Product Space
Ch - Hilbert Space 1 4 Hilbert Space 1 Inner Product Space Let E be a complex vector space, a mapping (, ) : E E C is called an inner product on E if i) (x, x) 0 x E and (x, x) = 0 if and only if x = 0;
More informationMathematics of Information Spring semester 2018
Communication Technology Laboratory Prof. Dr. H. Bölcskei Sternwartstrasse 7 CH-809 Zürich Mathematics of Information Spring semester 08 Solution to Homework Problem Overcomplete expansion in R a) Consider
More information4 Hilbert spaces. The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan
The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan Wir müssen wissen, wir werden wissen. David Hilbert We now continue to study a special class of Banach spaces,
More informationAn introduction to some aspects of functional analysis
An introduction to some aspects of functional analysis Stephen Semmes Rice University Abstract These informal notes deal with some very basic objects in functional analysis, including norms and seminorms
More informationInner Product and Orthogonality
Inner Product and Orthogonality P. Sam Johnson October 3, 2014 P. Sam Johnson (NITK) Inner Product and Orthogonality October 3, 2014 1 / 37 Overview In the Euclidean space R 2 and R 3 there are two concepts,
More informationTypical Problem: Compute.
Math 2040 Chapter 6 Orhtogonality and Least Squares 6.1 and some of 6.7: Inner Product, Length and Orthogonality. Definition: If x, y R n, then x y = x 1 y 1 +... + x n y n is the dot product of x and
More informationProjection Theorem 1
Projection Theorem 1 Cauchy-Schwarz Inequality Lemma. (Cauchy-Schwarz Inequality) For all x, y in an inner product space, [ xy, ] x y. Equality holds if and only if x y or y θ. Proof. If y θ, the inequality
More information6 Inner Product and Hilbert Spaces
6 Inner Product and Hilbert Spaces 6. Motivation Of the different p-norms on R n, p = 2 is special. This is because the 2-norm (λ, λ 2,..., λ n ) 2 = λ 2 + λ2 2 + + λ2 n comes from the an inner product
More information2) Let X be a compact space. Prove that the space C(X) of continuous real-valued functions is a complete metric space.
University of Bergen General Functional Analysis Problems with solutions 6 ) Prove that is unique in any normed space. Solution of ) Let us suppose that there are 2 zeros and 2. Then = + 2 = 2 + = 2. 2)
More informationHilbert spaces. 1. Cauchy-Schwarz-Bunyakowsky inequality
(October 29, 2016) Hilbert spaces Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ [This document is http://www.math.umn.edu/ garrett/m/fun/notes 2016-17/03 hsp.pdf] Hilbert spaces are
More informationExercise Solutions to Functional Analysis
Exercise Solutions to Functional Analysis Note: References refer to M. Schechter, Principles of Functional Analysis Exersize that. Let φ,..., φ n be an orthonormal set in a Hilbert space H. Show n f n
More informationl(y j ) = 0 for all y j (1)
Problem 1. The closed linear span of a subset {y j } of a normed vector space is defined as the intersection of all closed subspaces containing all y j and thus the smallest such subspace. 1 Show that
More informationRudiments of Hilbert Space Theory
Rudiments of Hilbert Space Theory Tom Potter Tom Potter August 31, 2015, last revised: August 2018 Copyright Registration No. 1124049 Contents Preface 2 1 Preliminaries: Limits, Sup, Limsup 3 1.1 Double
More informationy 2 . = x 1y 1 + x 2 y x + + x n y n 2 7 = 1(2) + 3(7) 5(4) = 3. x x = x x x2 n.
6.. Length, Angle, and Orthogonality In this section, we discuss the defintion of length and angle for vectors and define what it means for two vectors to be orthogonal. Then, we see that linear systems
More informationMTH 503: Functional Analysis
MTH 53: Functional Analysis Semester 1, 215-216 Dr. Prahlad Vaidyanathan Contents I. Normed Linear Spaces 4 1. Review of Linear Algebra........................... 4 2. Definition and Examples...........................
More informationLINEAR ALGEBRA W W L CHEN
LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008. This chapter is available free to all individuals, on the understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,
More informationFunctional Analysis F3/F4/NVP (2005) Homework assignment 2
Functional Analysis F3/F4/NVP (25) Homework assignment 2 All students should solve the following problems:. Section 2.7: Problem 8. 2. Let x (t) = t 2 e t/2, x 2 (t) = te t/2 and x 3 (t) = e t/2. Orthonormalize
More informationSOME FUNDAMENTAL THEOREMS IN BANACH SPACES AND HILBERT SPACES
SOME FUNDAMENTAL THEOREMS IN BANACH SPACES AND HILBERT SPACES Sanjay Kumar Department of Mathematics Central University of Jammu, India sanjaykmath@gmail.com Sanjay Kumar (Central University of Jammu)
More informationHilbert Spaces. Contents
Hilbert Spaces Contents 1 Introducing Hilbert Spaces 1 1.1 Basic definitions........................... 1 1.2 Results about norms and inner products.............. 3 1.3 Banach and Hilbert spaces......................
More informationSPACES: FROM ANALYSIS TO GEOMETRY AND BACK
SPACES: FROM ANALYSIS TO GEOMETRY AND BACK MASS 2011 LECTURE NOTES 1. Lecture 1 (8/22/11): Introduction There are many problems in analysis which involve constructing a function with desirable properties
More informationReal Analysis, 2nd Edition, G.B.Folland Elements of Functional Analysis
Real Analysis, 2nd Edition, G.B.Folland Chapter 5 Elements of Functional Analysis Yung-Hsiang Huang 5.1 Normed Vector Spaces 1. Note for any x, y X and a, b K, x+y x + y and by ax b y x + b a x. 2. It
More informationFunctional Analysis Exercise Class
Functional Analysis Exercise Class Week: December 4 8 Deadline to hand in the homework: your exercise class on week January 5. Exercises with solutions ) Let H, K be Hilbert spaces, and A : H K be a linear
More information08a. Operators on Hilbert spaces. 1. Boundedness, continuity, operator norms
(February 24, 2017) 08a. Operators on Hilbert spaces Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ [This document is http://www.math.umn.edu/ garrett/m/real/notes 2016-17/08a-ops
More informationa. Define a function called an inner product on pairs of points x = (x 1, x 2,..., x n ) and y = (y 1, y 2,..., y n ) in R n by
Real Analysis Homework 1 Solutions 1. Show that R n with the usual euclidean distance is a metric space. Items a-c will guide you through the proof. a. Define a function called an inner product on pairs
More informationFunctional Analysis. AMAT 617 University of Calgary Winter semester Lecturer: Gilad Gour Notes taken by Mark Girard.
Functional Analysis AMAT 617 University of Calgary Winter semester 2014 Lecturer: Gilad Gour Notes taken by Mark Girard April 12, 2014 Contents 1 Lecture 1 4 1.1 Normed Spaces.......................................
More informationLinear Algebra Review
January 29, 2013 Table of contents Metrics Metric Given a space X, then d : X X R + 0 and z in X if: d(x, y) = 0 is equivalent to x = y d(x, y) = d(y, x) d(x, y) d(x, z) + d(z, y) is a metric is for all
More informationGeometrical Constants and. Norm Inequalities in Banach Spaces
Geometrical Constants and Norm Inequalities in Banach Spaces Hiroyasu Mizuguchi Doctoral Program in Fundamental Sciences Graduate School of Science and Technology Niigata University March 013 Contents
More informationQuick Review of Matrix and Real Linear Algebra
Division of the Humanities and Social Sciences Quick Review of Matrix and Real Linear Algebra KC Border Subject to constant revision Last major revision: December 12, 2016 Contents 1 Scalar fields 1 2
More informationConvex Analysis and Economic Theory Winter 2018
Division of the Humanities and Social Sciences Ec 181 KC Border Convex Analysis and Economic Theory Winter 2018 Topic 0: Vector spaces 0.1 Basic notation Here are some of the fundamental sets and spaces
More informationMathematical foundations - linear algebra
Mathematical foundations - linear algebra Andrea Passerini passerini@disi.unitn.it Machine Learning Vector space Definition (over reals) A set X is called a vector space over IR if addition and scalar
More informationGeometric interpretation of signals: background
Geometric interpretation of signals: background David G. Messerschmitt Electrical Engineering and Computer Sciences University of California at Berkeley Technical Report No. UCB/EECS-006-9 http://www.eecs.berkeley.edu/pubs/techrpts/006/eecs-006-9.html
More informationYour first day at work MATH 806 (Fall 2015)
Your first day at work MATH 806 (Fall 2015) 1. Let X be a set (with no particular algebraic structure). A function d : X X R is called a metric on X (and then X is called a metric space) when d satisfies
More informationChapter 2. Vectors and Vector Spaces
2.1. Operations on Vectors 1 Chapter 2. Vectors and Vector Spaces Section 2.1. Operations on Vectors Note. In this section, we define several arithmetic operations on vectors (especially, vector addition
More informationFUNCTIONAL ANALYSIS HAHN-BANACH THEOREM. F (m 2 ) + α m 2 + x 0
FUNCTIONAL ANALYSIS HAHN-BANACH THEOREM If M is a linear subspace of a normal linear space X and if F is a bounded linear functional on M then F can be extended to M + [x 0 ] without changing its norm.
More informationPart 1a: Inner product, Orthogonality, Vector/Matrix norm
Part 1a: Inner product, Orthogonality, Vector/Matrix norm September 19, 2018 Numerical Linear Algebra Part 1a September 19, 2018 1 / 16 1. Inner product on a linear space V over the number field F A map,
More information1 Functional Analysis
1 Functional Analysis 1 1.1 Banach spaces Remark 1.1. In classical mechanics, the state of some physical system is characterized as a point x in phase space (generalized position and momentum coordinates).
More informationFunctions of Several Variables
Jim Lambers MAT 419/519 Summer Session 2011-12 Lecture 2 Notes These notes correspond to Section 1.2 in the text. Functions of Several Variables We now generalize the results from the previous section,
More informationA Brief Introduction to Functional Analysis
A Brief Introduction to Functional Analysis Sungwook Lee Department of Mathematics University of Southern Mississippi sunglee@usm.edu July 5, 2007 Definition 1. An algebra A is a vector space over C with
More information1. Let A R be a nonempty set that is bounded from above, and let a be the least upper bound of A. Show that there exists a sequence {a n } n N
Applied Analysis prelim July 15, 216, with solutions Solve 4 of the problems 1-5 and 2 of the problems 6-8. We will only grade the first 4 problems attempted from1-5 and the first 2 attempted from problems
More informationHomework I, Solutions
Homework I, Solutions I: (15 points) Exercise on lower semi-continuity: Let X be a normed space and f : X R be a function. We say that f is lower semi - continuous at x 0 if for every ε > 0 there exists
More information11691 Review Guideline Real Analysis. Real Analysis. - According to Principles of Mathematical Analysis by Walter Rudin (Chapter 1-4)
Real Analysis - According to Principles of Mathematical Analysis by Walter Rudin (Chapter 1-4) 1 The Real and Complex Number Set: a collection of objects. Proper subset: if A B, then call A a proper subset
More informationEuclidean Space. This is a brief review of some basic concepts that I hope will already be familiar to you.
Euclidean Space This is a brief review of some basic concepts that I hope will already be familiar to you. There are three sets of numbers that will be especially important to us: The set of all real numbers,
More informationON GENERALIZED n-inner PRODUCT SPACES
Novi Sad J Math Vol 41, No 2, 2011, 73-80 ON GENERALIZED n-inner PRODUCT SPACES Renu Chugh 1, Sushma Lather 2 Abstract The primary purpose of this paper is to derive a generalized (n k) inner product with
More informationA SYNOPSIS OF HILBERT SPACE THEORY
A SYNOPSIS OF HILBERT SPACE THEORY Below is a summary of Hilbert space theory that you find in more detail in any book on functional analysis, like the one Akhiezer and Glazman, the one by Kreiszig or
More informationLinear Algebra Massoud Malek
CSUEB Linear Algebra Massoud Malek Inner Product and Normed Space In all that follows, the n n identity matrix is denoted by I n, the n n zero matrix by Z n, and the zero vector by θ n An inner product
More informationVector Spaces. Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms.
Vector Spaces Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms. For each two vectors a, b ν there exists a summation procedure: a +
More informationConvex Analysis and Economic Theory Winter 2018
Division of the Humanities and Social Sciences Ec 181 KC Border Convex Analysis and Economic Theory Winter 2018 Supplement A: Mathematical background A.1 Extended real numbers The extended real number
More informationINNER PRODUCT SPACE. Definition 1
INNER PRODUCT SPACE Definition 1 Suppose u, v and w are all vectors in vector space V and c is any scalar. An inner product space on the vectors space V is a function that associates with each pair of
More informationNotions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy
Banach Spaces These notes provide an introduction to Banach spaces, which are complete normed vector spaces. For the purposes of these notes, all vector spaces are assumed to be over the real numbers.
More informationReal Analysis Notes. Thomas Goller
Real Analysis Notes Thomas Goller September 4, 2011 Contents 1 Abstract Measure Spaces 2 1.1 Basic Definitions........................... 2 1.2 Measurable Functions........................ 2 1.3 Integration..............................
More information1. General Vector Spaces
1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule
More informationElements of Positive Definite Kernel and Reproducing Kernel Hilbert Space
Elements of Positive Definite Kernel and Reproducing Kernel Hilbert Space Statistical Inference with Reproducing Kernel Hilbert Space Kenji Fukumizu Institute of Statistical Mathematics, ROIS Department
More informationSelçuk Demir WS 2017 Functional Analysis Homework Sheet
Selçuk Demir WS 2017 Functional Analysis Homework Sheet 1. Let M be a metric space. If A M is non-empty, we say that A is bounded iff diam(a) = sup{d(x, y) : x.y A} exists. Show that A is bounded iff there
More informationAnalysis II Lecture notes
Analysis II Lecture notes Christoph Thiele (lectures 11,12 by Roland Donninger lecture 22 by Diogo Oliveira e Silva) Summer term 2015 Universität Bonn July 5, 2016 Contents 1 Analysis in several variables
More informationOverview of normed linear spaces
20 Chapter 2 Overview of normed linear spaces Starting from this chapter, we begin examining linear spaces with at least one extra structure (topology or geometry). We assume linearity; this is a natural
More informationFourier and Wavelet Signal Processing
Ecole Polytechnique Federale de Lausanne (EPFL) Audio-Visual Communications Laboratory (LCAV) Fourier and Wavelet Signal Processing Martin Vetterli Amina Chebira, Ali Hormati Spring 2011 2/25/2011 1 Outline
More informationDefinitions and Properties of R N
Definitions and Properties of R N R N as a set As a set R n is simply the set of all ordered n-tuples (x 1,, x N ), called vectors. We usually denote the vector (x 1,, x N ), (y 1,, y N ), by x, y, or
More information1 Background and Review Material
1 Background and Review Material 1.1 Vector Spaces Let V be a nonempty set and consider the following two operations on elements of V : (x,y) x + y maps V V V (addition) (1.1) (α, x) αx maps F V V (scalar
More informationInner product spaces. Layers of structure:
Inner product spaces Layers of structure: vector space normed linear space inner product space The abstract definition of an inner product, which we will see very shortly, is simple (and by itself is pretty
More informationFunctional Analysis, Math 7320 Lecture Notes from August taken by Yaofeng Su
Functional Analysis, Math 7320 Lecture Notes from August 30 2016 taken by Yaofeng Su 1 Essentials of Topology 1.1 Continuity Next we recall a stronger notion of continuity: 1.1.1 Definition. Let (X, d
More informationHilbert Space Methods Used in a First Course in Quantum Mechanics A Recap WHY ARE WE HERE? QUOTE FROM WIKIPEDIA
Hilbert Space Methods Used in a First Course in Quantum Mechanics A Recap Larry Susanka Table of Contents Why Are We Here? The Main Vector Spaces Notions of Convergence Topological Vector Spaces Banach
More informationIntroduction to Linear Algebra, Second Edition, Serge Lange
Introduction to Linear Algebra, Second Edition, Serge Lange Chapter I: Vectors R n defined. Addition and scalar multiplication in R n. Two geometric interpretations for a vector: point and displacement.
More informationThe Geometric Tools of Hilbert Spaces
The Geometric Tools of Hilbert Spaces Erlendur Karlsson February 2009 c 2009 by Erlendur Karlsson All rights reserved No part of this manuscript is to be reproduced without the writen consent of the author
More informationNormed Vector Spaces and Double Duals
Normed Vector Spaces and Double Duals Mathematics 481/525 In this note we look at a number of infinite-dimensional R-vector spaces that arise in analysis, and we consider their dual and double dual spaces
More information1. If 1, ω, ω 2, -----, ω 9 are the 10 th roots of unity, then (1 + ω) (1 + ω 2 ) (1 + ω 9 ) is A) 1 B) 1 C) 10 D) 0
4 INUTES. If, ω, ω, -----, ω 9 are the th roots of unity, then ( + ω) ( + ω ) ----- ( + ω 9 ) is B) D) 5. i If - i = a + ib, then a =, b = B) a =, b = a =, b = D) a =, b= 3. Find the integral values for
More informationMath 341: Convex Geometry. Xi Chen
Math 341: Convex Geometry Xi Chen 479 Central Academic Building, University of Alberta, Edmonton, Alberta T6G 2G1, CANADA E-mail address: xichen@math.ualberta.ca CHAPTER 1 Basics 1. Euclidean Geometry
More informationBest approximation in the 2-norm
Best approximation in the 2-norm Department of Mathematical Sciences, NTNU september 26th 2012 Vector space A real vector space V is a set with a 0 element and three operations: Addition: x, y V then x
More information