Gaussian Hilbert spaces

Size: px
Start display at page:

Download "Gaussian Hilbert spaces"

Transcription

1 Gaussian Hilbert spaces Jordan Bell Department of Mathematics, University of Toronto July 11, Gaussian measures Let γ be a Borel probability measure on. For a, if γ = δ a then we call γ a Gaussian measure with mean a and variance 0. f σ > 0 and γ has density p(t, a, σ ) = ( 1 exp πσ ) (t a) σ, t, with respect to Lebesgue measure λ 1 on, then we call γ a Gaussian measure with mean a and variance σ. A Borel probability measure γ on n is called Gaussian if for each ξ ( n ), the pushforward measure ξ γ is a Gaussian measure on. The characteristic function of a Borel probability measure µ on n is µ(y) = e i y,x dµ(x), y n. n We call a linear operator C L ( n ) positive when Cx, x 0 for all x n. 1 t can be proved that a Borel probability measure γ on n is Gaussian if and only if there is some a n and some positive self-adjoint C L ( n ) such that γ(y) = exp (i y, a 1 ) Cy, y, y n. We say that γ has mean a and covariance operator C. f C is invertible (which is equivalent to Cx, x > 0 for all nonzero x n ), then the density of γ with respect to Lebesgue measure λ n on n is ( 1 x (π)n det C exp 1 C 1 (x a), x a ), n. 1 We remark that n is a real Hilbert space, and differently than a complex Hilbert space it need not be true that a positive linear operator is self-adjoint. Theorem 5. 1

2 The standard Gaussian measure on n, denoted γ n, is the Gaussian measure on n with mean 0 and covariance operator : dγ n (x) = (π) n/ exp ( 1 ) x, x dλ n (x), where λ n is Lebesgue measure on n. Throughout the remainder of this note, when we speak of Gaussian measures we assume unless we say otherwise that they have mean 0. Let be the positive integers. For nonempty subsets J and K of with J K, let π K,J : K J be the projection map, and for i let π i = π,{i}. For a topological space X, let B X be the Borel σ-algebra of X. f B i B for each i and {i : B i } is finite, we call B i i a cylinder set. The σ-algebra generated by the collection of all cylinder sets is called the product σ-algebra, and is denoted by B. The product measure γ = i γ 1 is the unique probability measure 3 on the product σ-algebra B such that for each cylinder set i B i, ( ) γ B i = γ 1 (B i ). i i Because is countable and is a second-countable topological space, the Borel σ-algebra of, with the product topology, is equal to the product σ-algebra on : 4 B = B. Thus γ is a Borel probability measure on. On the one hand, is a real vector space. On the other hand, with the product topology it is a topological space. t can be proved that with the separating family of seminorms { π i : i } it is a Fréchet space, 5 whose topology (the product topology) is induced by the complete translation invariant metric d(x, y) = i x i y i 1 + x i y i, x, y. i We remark that because is a countable product of second-countable topological spaces, it is itself a second-countable topological space, and so is separable Theorem 7. 5 Charalambos D. Aliprantis and Kim C. Border, nfinite Dimensional Analysis: A Hitchhiker s Guide, third ed., p. 07, Example 5.78.

3 The dual space of, denoted ( ), is the collection of continuous linear maps. t turns out that the dual space ( ) of is equal to the collection of those x such that {i : π i (x) 0} is finite, 6 with the dual pair x, y = x i y i, x, y ( ). i 3 Gaussian Hilbert spaces Because is a second-countable topological space, its Borel σ-algebra B is countably generated, and because γ is a probability measure on B it is a fortiori σ-finite, so the real Hilbert space L (γ ) is separable. 7 Let H be a real separable Hilbert space, with inner product, and norm, let e i, i, be an orthonormal basis for H, and let V be the linear span of this basis. n particular, V is a dense linear subspace of H. For v V, define φ(v) = i v, e i π i. Using we calculate 8 x i dγ 1 (x i ) = 0, x i dγ 1 (x i ) = 1, φ(v) L (γ ) = φ(v)(x) dγ (x) = v, e i π i (x) dγ (x) i + v, e i v, e j π i (x)π j (x)dγ (x) i = i = v, v, e i showing that φ : V L (γ ) is a linear isometry. Because (i) V is a dense linear subspace of H, (ii) the operator φ : V L (γ ) is bounded, and (iii) L (γ ) is a Hilbert space, there is a unique bounded linear operator Φ : H L (γ ) whose restriction to V is equal to φ. 9 For v H there is a sequence v n in V that tends to v, and because Φ is continuous and : H is continuous, Φ(v) = lim n Φ(v n) = lim n φ(v n) = lim n v n = v, 6 Charalambos D. Aliprantis and Kim C. Border, nfinite Dimensional Analysis: A Hitchhiker s Guide, third ed., p. 58, Theorem Donald L. Cohn, Measure Theory, second ed., p. 10, Proposition Walter udin, Functional Analysis, second ed., p. 39, Exercise 19. 3

4 showing that Φ is a linear isometry. Define F : H C by F (v) = exp(iφ(v)(x))dγ (x). Because e is e it s t, and using the Cauchy-Schwarz inequality, for v, w H, F (v) F (w) exp(iφ(v)(x)) exp(iφ(w)(x)) dγ (x) Φ(v)(x) Φ(w)(x) dγ (x) = Φ(v w)(x) dγ (x) Φ(v w) L (γ ) = v w, which shows in particular that F is continuous. For v V, let v = {i : v, e i } 0, which is finite. We calculate using Fubini s theorem ( F (v) = exp i ) v, e i π i (x) dγ (x) i = exp(i v, e i π i (x))dγ (x) i = i v = exp(i v, e i t)dγ 1 (t) γ 1 ( v, e i ) i v = ( 1 ) v, e i i v exp = exp ( 1 v ). For v H (, there is a sequence v n V that tends to v, and because F and w exp 1 w ) are continuous, F (v) = lim F (v n) = lim ( exp 1 ) v n = exp ( 1 ) n n v. That is, for all v H, exp(iφ(v)(x))dγ (x) = exp 4 ( 1 v ).

5 For distinct v 1,..., v n H, write X = Φ(v 1 ) Φ(v n ), which is measurable n, and let µ be the pushforward measure of γ by X, namely the joint distribution of the random variables Φ(v 1 ),..., Φ(v n ). For y n we calculate using the change of variables theorem 10 and Fubini s theorem µ(y) = e i y,u dµ(u) n = e i y,x(x) dγ (x) = e i(y1φ(v1)(x)+ +ynφ(vn)(x)) dγ (x) = e iφ(y1v1+ +ynvn)(x) dγ (x) = exp ( 1 ) y 1v y n v n = exp 1 v i, v j y i y j, i,j which shows that µ is a Gaussian measure on n with covariance matrix C i,j = v i, v j. 11 Thus {Φ(v)} v H is a stochastic process with sample space (, B, γ ), index set H, and state space, which we call the Gaussian process with covariance,. Let T be a separable metric space and suppose that c : T T is continuous and that for any t 1,..., t n T, {c(t i, t j )} is a symmetric positive semidefinite matrix. For each t T let δ t be a formal symbol, and let V be the linear span of {δ t : t T }. For v, w V, there are distinct t 1,..., t n T and real numbers α 1,..., α n, β 1,..., β n such that v = n i=1 α iδ ti and w = n i=1 β iδ ti, and we define For a, [av, w] = [v, w] = (aα i )β j c(t i, t j ) = a α i β j c(t i, t j ). α i β j c(t i, t j ) = a[v, w]. For u, v, w V there are distinct t 1,..., t n T and real numbers α 1,..., α n, β 1,..., β n, γ 1,..., γ n such that v = n i=1 α iδ ti, w = n i=1 β iδ ti, u = n i=1 γ iδ ti, and [u + v, w] = (α i + γ i )β j c(t i, t j ) = [u, w] + [v, w]. 10 Charalambos D. Aliprantis and Kim C. Border, nfinite Dimensional Analysis: A Hitchhiker s Guide, third ed., p. 484, Theorem See Barry Simon, Functional ntegration and Quantum Physics, p. 16, Theorem.3A. 5

6 Because {c(t i, t j )} is symmetric, [v, w] = [w, v]. matrix {c(t i, t j )} is positive semidefinite, [v, v] = α i α j c(t i, t j ) 0. Finally, because the This establishes that [, ] is a positive semidefinite inner product on V. Then v = [v, v], v = α i α j c(t i, t j ), is a seminorm on V, and N = {v V : v = 0} is a closed linear subspace of V. Let V/N = {v + N : v V }, For v, w V and r, s N, because r = 0 and s = 0, by the Cauchy-Schwarz inequality (which is indeed true for a positive semidefinite inner product) 1 we have [v, s] v s = 0 and [r, w] r w = 0, hence [v + r, w + s] = [v, w] + [v, s] + [r, w] + [r, s] = [v, w]. Therefore it makes sense to define v + N, w + N = [v, w]. f v + N, w + N = 0 then [v, v] = 0, i.e. v = 0 and so v N, i.e. v +N = 0 V/N, and therefore, is an inner product on V/N. Then there is a Hilbert space (H,, ) and a linear isometry i : V/N H whose image is a dense subset of H, called a completion of V/H, and this completion is unique up to a unique isomorphism of Hilbert spaces. 13 T is separable so it has a countable dense subset S. For t T, either t S or t S. f t S, there is a sequence of distinct s k in S that tends to t, and because c is continuous, δ sk δ t = c(s k, s k ) c(s k, t) c(t, s k )+c(t, t) c(t, t) c(t, t) c(t, t)+c(t, t), so δ sk δ t in V, which shows that δ : T V is continuous. Let W be the Q-linear span of {δ s : s S}. W is countable, and it follows from the above that W is dense in V. Define π : V V/N by π(v) = v + N, which is an onto continuous linear map. Then the image of W under i π : V H is dense in H, thus (H,, ) is a separable Hilbert space. Now let {Φ(v)} v H be the Gaussian process with covariance,, and define q : T L (γ ) by q = Φ i π δ. 1 A. Ya. Helemskii, Lectures and Exercises on Functional Analysis, p. 68, Theorem A. Ya. Helemskii, Lectures and Exercises on Functional Analysis, p. 17, Proposition 3. 6

7 For distinct t 1,..., t n T, the vectors v j = (i π δ)(t j ) H, 1 j n, are distinct. Then (Φ(v 1 ) Φ(v n )) γ is the Gaussian measure on n with covariance matrix C i,j = v i, v j = (i π δ)(t i ), (i π δ)(t j ) = [δ ti, δ tj ] = c(t i, t j ). That is, the joint distribution of the random variables q t1,..., q tn is the Gaussian measure on n with covariance matrix C i,j = c(t i, t j ). 7

Jointly measurable and progressively measurable stochastic processes

Jointly measurable and progressively measurable stochastic processes Jointly measurable and progressively measurable stochastic processes Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto June 18, 2015 1 Jointly measurable stochastic processes

More information

Integral operators. Jordan Bell Department of Mathematics, University of Toronto. April 22, X F x(y)dµ(y) x N c 1 0 x N 1

Integral operators. Jordan Bell Department of Mathematics, University of Toronto. April 22, X F x(y)dµ(y) x N c 1 0 x N 1 Integral operators Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto April 22, 2016 1 Product measures Let (, A, µ be a σ-finite measure space. Then with A A the product

More information

Positive definite functions, completely monotone functions, the Bernstein-Widder theorem, and Schoenberg s theorem

Positive definite functions, completely monotone functions, the Bernstein-Widder theorem, and Schoenberg s theorem Positive definite functions, completely monotone functions, the Bernstein-Widder theorem, and Schoenberg s theorem Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto June

More information

The Kolmogorov continuity theorem, Hölder continuity, and the Kolmogorov-Chentsov theorem

The Kolmogorov continuity theorem, Hölder continuity, and the Kolmogorov-Chentsov theorem The Kolmogorov continuity theorem, Hölder continuity, and the Kolmogorov-Chentsov theorem Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto June 11, 2015 1 Modifications

More information

The Kolmogorov extension theorem

The Kolmogorov extension theorem The Kolmogorov extension theorem Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto June 21, 2014 1 σ-algebras and semirings If X is a nonempty set, an algebra of sets on

More information

The weak topology of locally convex spaces and the weak-* topology of their duals

The weak topology of locally convex spaces and the weak-* topology of their duals The weak topology of locally convex spaces and the weak-* topology of their duals Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto April 3, 2014 1 Introduction These notes

More information

j=1 [We will show that the triangle inequality holds for each p-norm in Chapter 3 Section 6.] The 1-norm is A F = tr(a H A).

j=1 [We will show that the triangle inequality holds for each p-norm in Chapter 3 Section 6.] The 1-norm is A F = tr(a H A). Math 344 Lecture #19 3.5 Normed Linear Spaces Definition 3.5.1. A seminorm on a vector space V over F is a map : V R that for all x, y V and for all α F satisfies (i) x 0 (positivity), (ii) αx = α x (scale

More information

Stone-Čech compactification of Tychonoff spaces

Stone-Čech compactification of Tychonoff spaces The Stone-Čech compactification of Tychonoff spaces Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto June 27, 2014 1 Completely regular spaces and Tychonoff spaces A topological

More information

MAT 578 FUNCTIONAL ANALYSIS EXERCISES

MAT 578 FUNCTIONAL ANALYSIS EXERCISES MAT 578 FUNCTIONAL ANALYSIS EXERCISES JOHN QUIGG Exercise 1. Prove that if A is bounded in a topological vector space, then for every neighborhood V of 0 there exists c > 0 such that tv A for all t > c.

More information

Hermite functions. Jordan Bell Department of Mathematics, University of Toronto. September 9, 2015

Hermite functions. Jordan Bell Department of Mathematics, University of Toronto. September 9, 2015 Hermite functions Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto September 9, 25 Locally convex spaces If V is a vector space and {p α : α A} is a separating family

More information

HILBERT SPACES AND THE RADON-NIKODYM THEOREM. where the bar in the first equation denotes complex conjugation. In either case, for any x V define

HILBERT SPACES AND THE RADON-NIKODYM THEOREM. where the bar in the first equation denotes complex conjugation. In either case, for any x V define HILBERT SPACES AND THE RADON-NIKODYM THEOREM STEVEN P. LALLEY 1. DEFINITIONS Definition 1. A real inner product space is a real vector space V together with a symmetric, bilinear, positive-definite mapping,

More information

Orthonormal Bases Fall Consider an inner product space V with inner product f, g and norm

Orthonormal Bases Fall Consider an inner product space V with inner product f, g and norm 8.03 Fall 203 Orthonormal Bases Consider an inner product space V with inner product f, g and norm f 2 = f, f Proposition (Continuity) If u n u 0 and v n v 0 as n, then u n u ; u n, v n u, v. Proof. Note

More information

Notions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy

Notions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy Banach Spaces These notes provide an introduction to Banach spaces, which are complete normed vector spaces. For the purposes of these notes, all vector spaces are assumed to be over the real numbers.

More information

A Brief Introduction to Functional Analysis

A Brief Introduction to Functional Analysis A Brief Introduction to Functional Analysis Sungwook Lee Department of Mathematics University of Southern Mississippi sunglee@usm.edu July 5, 2007 Definition 1. An algebra A is a vector space over C with

More information

Ir O D = D = ( ) Section 2.6 Example 1. (Bottom of page 119) dim(v ) = dim(l(v, W )) = dim(v ) dim(f ) = dim(v )

Ir O D = D = ( ) Section 2.6 Example 1. (Bottom of page 119) dim(v ) = dim(l(v, W )) = dim(v ) dim(f ) = dim(v ) Section 3.2 Theorem 3.6. Let A be an m n matrix of rank r. Then r m, r n, and, by means of a finite number of elementary row and column operations, A can be transformed into the matrix ( ) Ir O D = 1 O

More information

Compact operators on Banach spaces

Compact operators on Banach spaces Compact operators on Banach spaces Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto November 12, 2017 1 Introduction In this note I prove several things about compact

More information

4th Preparation Sheet - Solutions

4th Preparation Sheet - Solutions Prof. Dr. Rainer Dahlhaus Probability Theory Summer term 017 4th Preparation Sheet - Solutions Remark: Throughout the exercise sheet we use the two equivalent definitions of separability of a metric space

More information

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product Chapter 4 Hilbert Spaces 4.1 Inner Product Spaces Inner Product Space. A complex vector space E is called an inner product space (or a pre-hilbert space, or a unitary space) if there is a mapping (, )

More information

4 Hilbert spaces. The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan

4 Hilbert spaces. The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan The proof of the Hilbert basis theorem is not mathematics, it is theology. Camille Jordan Wir müssen wissen, wir werden wissen. David Hilbert We now continue to study a special class of Banach spaces,

More information

The Lindeberg central limit theorem

The Lindeberg central limit theorem The Lindeberg central limit theorem Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto May 29, 205 Convergence in distribution We denote by P d the collection of Borel probability

More information

Functional Analysis Review

Functional Analysis Review Outline 9.520: Statistical Learning Theory and Applications February 8, 2010 Outline 1 2 3 4 Vector Space Outline A vector space is a set V with binary operations +: V V V and : R V V such that for all

More information

CHAPTER VIII HILBERT SPACES

CHAPTER VIII HILBERT SPACES CHAPTER VIII HILBERT SPACES DEFINITION Let X and Y be two complex vector spaces. A map T : X Y is called a conjugate-linear transformation if it is a reallinear transformation from X into Y, and if T (λx)

More information

Real Analysis Notes. Thomas Goller

Real Analysis Notes. Thomas Goller Real Analysis Notes Thomas Goller September 4, 2011 Contents 1 Abstract Measure Spaces 2 1.1 Basic Definitions........................... 2 1.2 Measurable Functions........................ 2 1.3 Integration..............................

More information

Semicontinuous functions and convexity

Semicontinuous functions and convexity Semicontinuous functions and convexity Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto April 3, 2014 1 Lattices If (A, ) is a partially ordered set and S is a subset

More information

Five Mini-Courses on Analysis

Five Mini-Courses on Analysis Christopher Heil Five Mini-Courses on Analysis Metrics, Norms, Inner Products, and Topology Lebesgue Measure and Integral Operator Theory and Functional Analysis Borel and Radon Measures Topological Vector

More information

Analysis Preliminary Exam Workshop: Hilbert Spaces

Analysis Preliminary Exam Workshop: Hilbert Spaces Analysis Preliminary Exam Workshop: Hilbert Spaces 1. Hilbert spaces A Hilbert space H is a complete real or complex inner product space. Consider complex Hilbert spaces for definiteness. If (, ) : H H

More information

Elements of Positive Definite Kernel and Reproducing Kernel Hilbert Space

Elements of Positive Definite Kernel and Reproducing Kernel Hilbert Space Elements of Positive Definite Kernel and Reproducing Kernel Hilbert Space Statistical Inference with Reproducing Kernel Hilbert Space Kenji Fukumizu Institute of Statistical Mathematics, ROIS Department

More information

Aliprantis, Border: Infinite-dimensional Analysis A Hitchhiker s Guide

Aliprantis, Border: Infinite-dimensional Analysis A Hitchhiker s Guide aliprantis.tex May 10, 2011 Aliprantis, Border: Infinite-dimensional Analysis A Hitchhiker s Guide Notes from [AB2]. 1 Odds and Ends 2 Topology 2.1 Topological spaces Example. (2.2) A semimetric = triangle

More information

Functional Analysis. Franck Sueur Metric spaces Definitions Completeness Compactness Separability...

Functional Analysis. Franck Sueur Metric spaces Definitions Completeness Compactness Separability... Functional Analysis Franck Sueur 2018-2019 Contents 1 Metric spaces 1 1.1 Definitions........................................ 1 1.2 Completeness...................................... 3 1.3 Compactness......................................

More information

Functional Analysis II held by Prof. Dr. Moritz Weber in summer 18

Functional Analysis II held by Prof. Dr. Moritz Weber in summer 18 Functional Analysis II held by Prof. Dr. Moritz Weber in summer 18 General information on organisation Tutorials and admission for the final exam To take part in the final exam of this course, 50 % of

More information

08a. Operators on Hilbert spaces. 1. Boundedness, continuity, operator norms

08a. Operators on Hilbert spaces. 1. Boundedness, continuity, operator norms (February 24, 2017) 08a. Operators on Hilbert spaces Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ [This document is http://www.math.umn.edu/ garrett/m/real/notes 2016-17/08a-ops

More information

Hilbert Spaces. Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space.

Hilbert Spaces. Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space. Hilbert Spaces Hilbert space is a vector space with some extra structure. We start with formal (axiomatic) definition of a vector space. Vector Space. Vector space, ν, over the field of complex numbers,

More information

Chapter 8 Integral Operators

Chapter 8 Integral Operators Chapter 8 Integral Operators In our development of metrics, norms, inner products, and operator theory in Chapters 1 7 we only tangentially considered topics that involved the use of Lebesgue measure,

More information

Recall that any inner product space V has an associated norm defined by

Recall that any inner product space V has an associated norm defined by Hilbert Spaces Recall that any inner product space V has an associated norm defined by v = v v. Thus an inner product space can be viewed as a special kind of normed vector space. In particular every inner

More information

Contents. Preface for the Instructor. Preface for the Student. xvii. Acknowledgments. 1 Vector Spaces 1 1.A R n and C n 2

Contents. Preface for the Instructor. Preface for the Student. xvii. Acknowledgments. 1 Vector Spaces 1 1.A R n and C n 2 Contents Preface for the Instructor xi Preface for the Student xv Acknowledgments xvii 1 Vector Spaces 1 1.A R n and C n 2 Complex Numbers 2 Lists 5 F n 6 Digression on Fields 10 Exercises 1.A 11 1.B Definition

More information

Hilbert Spaces: Infinite-Dimensional Vector Spaces

Hilbert Spaces: Infinite-Dimensional Vector Spaces Hilbert Spaces: Infinite-Dimensional Vector Spaces PHYS 500 - Southern Illinois University October 27, 2016 PHYS 500 - Southern Illinois University Hilbert Spaces: Infinite-Dimensional Vector Spaces October

More information

Gaussian Random Fields

Gaussian Random Fields Gaussian Random Fields Mini-Course by Prof. Voijkan Jaksic Vincent Larochelle, Alexandre Tomberg May 9, 009 Review Defnition.. Let, F, P ) be a probability space. Random variables {X,..., X n } are called

More information

Projection-valued measures and spectral integrals

Projection-valued measures and spectral integrals Projection-valued measures and spectral integrals Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto April 16, 2014 Abstract The purpose of these notes is to precisely define

More information

Functional Analysis Exercise Class

Functional Analysis Exercise Class Functional Analysis Exercise Class Week: December 4 8 Deadline to hand in the homework: your exercise class on week January 5. Exercises with solutions ) Let H, K be Hilbert spaces, and A : H K be a linear

More information

Kernel Method: Data Analysis with Positive Definite Kernels

Kernel Method: Data Analysis with Positive Definite Kernels Kernel Method: Data Analysis with Positive Definite Kernels 2. Positive Definite Kernel and Reproducing Kernel Hilbert Space Kenji Fukumizu The Institute of Statistical Mathematics. Graduate University

More information

9 Brownian Motion: Construction

9 Brownian Motion: Construction 9 Brownian Motion: Construction 9.1 Definition and Heuristics The central limit theorem states that the standard Gaussian distribution arises as the weak limit of the rescaled partial sums S n / p n of

More information

PROBLEMS. (b) (Polarization Identity) Show that in any inner product space

PROBLEMS. (b) (Polarization Identity) Show that in any inner product space 1 Professor Carl Cowen Math 54600 Fall 09 PROBLEMS 1. (Geometry in Inner Product Spaces) (a) (Parallelogram Law) Show that in any inner product space x + y 2 + x y 2 = 2( x 2 + y 2 ). (b) (Polarization

More information

Your first day at work MATH 806 (Fall 2015)

Your first day at work MATH 806 (Fall 2015) Your first day at work MATH 806 (Fall 2015) 1. Let X be a set (with no particular algebraic structure). A function d : X X R is called a metric on X (and then X is called a metric space) when d satisfies

More information

1. General Vector Spaces

1. General Vector Spaces 1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule

More information

Elementary linear algebra

Elementary linear algebra Chapter 1 Elementary linear algebra 1.1 Vector spaces Vector spaces owe their importance to the fact that so many models arising in the solutions of specific problems turn out to be vector spaces. The

More information

Lecture 5. Ch. 5, Norms for vectors and matrices. Norms for vectors and matrices Why?

Lecture 5. Ch. 5, Norms for vectors and matrices. Norms for vectors and matrices Why? KTH ROYAL INSTITUTE OF TECHNOLOGY Norms for vectors and matrices Why? Lecture 5 Ch. 5, Norms for vectors and matrices Emil Björnson/Magnus Jansson/Mats Bengtsson April 27, 2016 Problem: Measure size of

More information

Gaussian Processes. 1. Basic Notions

Gaussian Processes. 1. Basic Notions Gaussian Processes 1. Basic Notions Let T be a set, and X : {X } T a stochastic process, defined on a suitable probability space (Ω P), that is indexed by T. Definition 1.1. We say that X is a Gaussian

More information

1.4 The Jacobian of a map

1.4 The Jacobian of a map 1.4 The Jacobian of a map Derivative of a differentiable map Let F : M n N m be a differentiable map between two C 1 manifolds. Given a point p M we define the derivative of F at p by df p df (p) : T p

More information

GAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM

GAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM GAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM STEVEN P. LALLEY 1. GAUSSIAN PROCESSES: DEFINITIONS AND EXAMPLES Definition 1.1. A standard (one-dimensional) Wiener process (also called Brownian motion)

More information

1 Basics of vector space

1 Basics of vector space Linear Algebra- Review And Beyond Lecture 1 In this lecture, we will talk about the most basic and important concept of linear algebra vector space. After the basics of vector space, I will introduce dual

More information

Lecture 3: Review of Linear Algebra

Lecture 3: Review of Linear Algebra ECE 83 Fall 2 Statistical Signal Processing instructor: R Nowak Lecture 3: Review of Linear Algebra Very often in this course we will represent signals as vectors and operators (eg, filters, transforms,

More information

MATH MEASURE THEORY AND FOURIER ANALYSIS. Contents

MATH MEASURE THEORY AND FOURIER ANALYSIS. Contents MATH 3969 - MEASURE THEORY AND FOURIER ANALYSIS ANDREW TULLOCH Contents 1. Measure Theory 2 1.1. Properties of Measures 3 1.2. Constructing σ-algebras and measures 3 1.3. Properties of the Lebesgue measure

More information

Hilbert Space Methods Used in a First Course in Quantum Mechanics A Recap WHY ARE WE HERE? QUOTE FROM WIKIPEDIA

Hilbert Space Methods Used in a First Course in Quantum Mechanics A Recap WHY ARE WE HERE? QUOTE FROM WIKIPEDIA Hilbert Space Methods Used in a First Course in Quantum Mechanics A Recap Larry Susanka Table of Contents Why Are We Here? The Main Vector Spaces Notions of Convergence Topological Vector Spaces Banach

More information

I teach myself... Hilbert spaces

I teach myself... Hilbert spaces I teach myself... Hilbert spaces by F.J.Sayas, for MATH 806 November 4, 2015 This document will be growing with the semester. Every in red is for you to justify. Even if we start with the basic definition

More information

Lecture 3: Review of Linear Algebra

Lecture 3: Review of Linear Algebra ECE 83 Fall 2 Statistical Signal Processing instructor: R Nowak, scribe: R Nowak Lecture 3: Review of Linear Algebra Very often in this course we will represent signals as vectors and operators (eg, filters,

More information

Your first day at work MATH 806 (Fall 2015)

Your first day at work MATH 806 (Fall 2015) Your first day at work MATH 806 (Fall 2015) 1. Let X be a set (with no particular algebraic structure). A function d : X X R is called a metric on X (and then X is called a metric space) when d satisfies

More information

MET Workshop: Exercises

MET Workshop: Exercises MET Workshop: Exercises Alex Blumenthal and Anthony Quas May 7, 206 Notation. R d is endowed with the standard inner product (, ) and Euclidean norm. M d d (R) denotes the space of n n real matrices. When

More information

1 Definition and Basic Properties of Compa Operator

1 Definition and Basic Properties of Compa Operator 1 Definition and Basic Properties of Compa Operator 1.1 Let X be a infinite dimensional Banach space. Show that if A C(X ), A does not have bounded inverse. Proof. Denote the unit ball of X by B and the

More information

Part II Probability and Measure

Part II Probability and Measure Part II Probability and Measure Theorems Based on lectures by J. Miller Notes taken by Dexter Chua Michaelmas 2016 These notes are not endorsed by the lecturers, and I have modified them (often significantly)

More information

(1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define

(1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define Homework, Real Analysis I, Fall, 2010. (1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define ρ(f, g) = 1 0 f(x) g(x) dx. Show that

More information

Overview of normed linear spaces

Overview of normed linear spaces 20 Chapter 2 Overview of normed linear spaces Starting from this chapter, we begin examining linear spaces with at least one extra structure (topology or geometry). We assume linearity; this is a natural

More information

CHAPTER V DUAL SPACES

CHAPTER V DUAL SPACES CHAPTER V DUAL SPACES DEFINITION Let (X, T ) be a (real) locally convex topological vector space. By the dual space X, or (X, T ), of X we mean the set of all continuous linear functionals on X. By the

More information

Functional Analysis. Martin Brokate. 1 Normed Spaces 2. 2 Hilbert Spaces The Principle of Uniform Boundedness 32

Functional Analysis. Martin Brokate. 1 Normed Spaces 2. 2 Hilbert Spaces The Principle of Uniform Boundedness 32 Functional Analysis Martin Brokate Contents 1 Normed Spaces 2 2 Hilbert Spaces 2 3 The Principle of Uniform Boundedness 32 4 Extension, Reflexivity, Separation 37 5 Compact subsets of C and L p 46 6 Weak

More information

SPECTRAL THEOREM FOR COMPACT SELF-ADJOINT OPERATORS

SPECTRAL THEOREM FOR COMPACT SELF-ADJOINT OPERATORS SPECTRAL THEOREM FOR COMPACT SELF-ADJOINT OPERATORS G. RAMESH Contents Introduction 1 1. Bounded Operators 1 1.3. Examples 3 2. Compact Operators 5 2.1. Properties 6 3. The Spectral Theorem 9 3.3. Self-adjoint

More information

MA677 Assignment #3 Morgan Schreffler Due 09/19/12 Exercise 1 Using Hölder s inequality, prove Minkowski s inequality for f, g L p (R d ), p 1:

MA677 Assignment #3 Morgan Schreffler Due 09/19/12 Exercise 1 Using Hölder s inequality, prove Minkowski s inequality for f, g L p (R d ), p 1: Exercise 1 Using Hölder s inequality, prove Minkowski s inequality for f, g L p (R d ), p 1: f + g p f p + g p. Proof. If f, g L p (R d ), then since f(x) + g(x) max {f(x), g(x)}, we have f(x) + g(x) p

More information

THEOREMS, ETC., FOR MATH 515

THEOREMS, ETC., FOR MATH 515 THEOREMS, ETC., FOR MATH 515 Proposition 1 (=comment on page 17). If A is an algebra, then any finite union or finite intersection of sets in A is also in A. Proposition 2 (=Proposition 1.1). For every

More information

In terms of measures: Exercise 1. Existence of a Gaussian process: Theorem 2. Remark 3.

In terms of measures: Exercise 1. Existence of a Gaussian process: Theorem 2. Remark 3. 1. GAUSSIAN PROCESSES A Gaussian process on a set T is a collection of random variables X =(X t ) t T on a common probability space such that for any n 1 and any t 1,...,t n T, the vector (X(t 1 ),...,X(t

More information

Topological vectorspaces

Topological vectorspaces (July 25, 2011) Topological vectorspaces Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ Natural non-fréchet spaces Topological vector spaces Quotients and linear maps More topological

More information

Functional Analysis I

Functional Analysis I Functional Analysis I Course Notes by Stefan Richter Transcribed and Annotated by Gregory Zitelli Polar Decomposition Definition. An operator W B(H) is called a partial isometry if W x = X for all x (ker

More information

MAT 771 FUNCTIONAL ANALYSIS HOMEWORK 3. (1) Let V be the vector space of all bounded or unbounded sequences of complex numbers.

MAT 771 FUNCTIONAL ANALYSIS HOMEWORK 3. (1) Let V be the vector space of all bounded or unbounded sequences of complex numbers. MAT 771 FUNCTIONAL ANALYSIS HOMEWORK 3 (1) Let V be the vector space of all bounded or unbounded sequences of complex numbers. (a) Define d : V V + {0} by d(x, y) = 1 ξ j η j 2 j 1 + ξ j η j. Show that

More information

ELEMENTS OF PROBABILITY THEORY

ELEMENTS OF PROBABILITY THEORY ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable

More information

Lecture Notes on Operator Algebras. John M. Erdman Portland State University. Version March 12, 2011

Lecture Notes on Operator Algebras. John M. Erdman Portland State University. Version March 12, 2011 Lecture Notes on Operator Algebras John M. Erdman Portland State University Version March 12, 2011 c 2010 John M. Erdman E-mail address: erdman@pdx.edu Contents Chapter 1. LINEAR ALGEBRA AND THE SPECTRAL

More information

The Gram matrix in inner product modules over C -algebras

The Gram matrix in inner product modules over C -algebras The Gram matrix in inner product modules over C -algebras Ljiljana Arambašić (joint work with D. Bakić and M.S. Moslehian) Department of Mathematics University of Zagreb Applied Linear Algebra May 24 28,

More information

About Grupo the Mathematical de Investigación Foundation of Quantum Mechanics

About Grupo the Mathematical de Investigación Foundation of Quantum Mechanics About Grupo the Mathematical de Investigación Foundation of Quantum Mechanics M. Victoria Velasco Collado Departamento de Análisis Matemático Universidad de Granada (Spain) Operator Theory and The Principles

More information

Hilbert spaces. 1. Cauchy-Schwarz-Bunyakowsky inequality

Hilbert spaces. 1. Cauchy-Schwarz-Bunyakowsky inequality (October 29, 2016) Hilbert spaces Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ [This document is http://www.math.umn.edu/ garrett/m/fun/notes 2016-17/03 hsp.pdf] Hilbert spaces are

More information

Bindel, Fall 2016 Matrix Computations (CS 6210) Notes for

Bindel, Fall 2016 Matrix Computations (CS 6210) Notes for 1 Logistics Notes for 2016-08-29 General announcement: we are switching from weekly to bi-weekly homeworks (mostly because the course is much bigger than planned). If you want to do HW but are not formally

More information

An introduction to some aspects of functional analysis

An introduction to some aspects of functional analysis An introduction to some aspects of functional analysis Stephen Semmes Rice University Abstract These informal notes deal with some very basic objects in functional analysis, including norms and seminorms

More information

Exercise Solutions to Functional Analysis

Exercise Solutions to Functional Analysis Exercise Solutions to Functional Analysis Note: References refer to M. Schechter, Principles of Functional Analysis Exersize that. Let φ,..., φ n be an orthonormal set in a Hilbert space H. Show n f n

More information

Peter Hochs. Strings JC, 11 June, C -algebras and K-theory. Peter Hochs. Introduction. C -algebras. Group. C -algebras.

Peter Hochs. Strings JC, 11 June, C -algebras and K-theory. Peter Hochs. Introduction. C -algebras. Group. C -algebras. and of and Strings JC, 11 June, 2013 and of 1 2 3 4 5 of and of and Idea of 1 Study locally compact Hausdorff topological spaces through their algebras of continuous functions. The product on this algebra

More information

Bernstein s inequality and Nikolsky s inequality for R d

Bernstein s inequality and Nikolsky s inequality for R d Bernstein s inequality and Nikolsky s inequality for d Jordan Bell jordan.bell@gmail.com Department of athematics University of Toronto February 6 25 Complex Borel measures and the Fourier transform Let

More information

Fourier transforms, I

Fourier transforms, I (November 28, 2016) Fourier transforms, I Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ [This document is http://www.math.umn.edu/ garrett/m/fun/notes 2016-17/Fourier transforms I.pdf]

More information

21 Gaussian spaces and processes

21 Gaussian spaces and processes Tel Aviv University, 2010 Gaussian measures : infinite dimension 1 21 Gaussian spaces and processes 21a Gaussian spaces: finite dimension......... 1 21b Toward Gaussian random processes....... 2 21c Random

More information

MATHS 730 FC Lecture Notes March 5, Introduction

MATHS 730 FC Lecture Notes March 5, Introduction 1 INTRODUCTION MATHS 730 FC Lecture Notes March 5, 2014 1 Introduction Definition. If A, B are sets and there exists a bijection A B, they have the same cardinality, which we write as A, #A. If there exists

More information

Vector Spaces. Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms.

Vector Spaces. Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms. Vector Spaces Vector space, ν, over the field of complex numbers, C, is a set of elements a, b,..., satisfying the following axioms. For each two vectors a, b ν there exists a summation procedure: a +

More information

Vector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis.

Vector spaces. DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis. Vector spaces DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_fall17/index.html Carlos Fernandez-Granda Vector space Consists of: A set V A scalar

More information

Vectors in Function Spaces

Vectors in Function Spaces Jim Lambers MAT 66 Spring Semester 15-16 Lecture 18 Notes These notes correspond to Section 6.3 in the text. Vectors in Function Spaces We begin with some necessary terminology. A vector space V, also

More information

Tools from Lebesgue integration

Tools from Lebesgue integration Tools from Lebesgue integration E.P. van den Ban Fall 2005 Introduction In these notes we describe some of the basic tools from the theory of Lebesgue integration. Definitions and results will be given

More information

LECTURE 7. k=1 (, v k)u k. Moreover r

LECTURE 7. k=1 (, v k)u k. Moreover r LECTURE 7 Finite rank operators Definition. T is said to be of rank r (r < ) if dim T(H) = r. The class of operators of rank r is denoted by K r and K := r K r. Theorem 1. T K r iff T K r. Proof. Let T

More information

Lecture Notes. Functional Analysis in Applied Mathematics and Engineering. by Klaus Engel. University of L Aquila Faculty of Engineering

Lecture Notes. Functional Analysis in Applied Mathematics and Engineering. by Klaus Engel. University of L Aquila Faculty of Engineering Lecture Notes Functional Analysis in Applied Mathematics and Engineering by Klaus Engel University of L Aquila Faculty of Engineering 2012-2013 http://univaq.it/~engel ( = %7E) (Preliminary Version of

More information

Real Analysis, 2nd Edition, G.B.Folland Elements of Functional Analysis

Real Analysis, 2nd Edition, G.B.Folland Elements of Functional Analysis Real Analysis, 2nd Edition, G.B.Folland Chapter 5 Elements of Functional Analysis Yung-Hsiang Huang 5.1 Normed Vector Spaces 1. Note for any x, y X and a, b K, x+y x + y and by ax b y x + b a x. 2. It

More information

Solutions: Problem Set 4 Math 201B, Winter 2007

Solutions: Problem Set 4 Math 201B, Winter 2007 Solutions: Problem Set 4 Math 2B, Winter 27 Problem. (a Define f : by { x /2 if < x

More information

What is an RKHS? Dino Sejdinovic, Arthur Gretton. March 11, 2014

What is an RKHS? Dino Sejdinovic, Arthur Gretton. March 11, 2014 What is an RKHS? Dino Sejdinovic, Arthur Gretton March 11, 2014 1 Outline Normed and inner product spaces Cauchy sequences and completeness Banach and Hilbert spaces Linearity, continuity and boundedness

More information

Chapter 3: Baire category and open mapping theorems

Chapter 3: Baire category and open mapping theorems MA3421 2016 17 Chapter 3: Baire category and open mapping theorems A number of the major results rely on completeness via the Baire category theorem. 3.1 The Baire category theorem 3.1.1 Definition. A

More information

OPERATOR SEMIGROUPS. Lecture 3. Stéphane ATTAL

OPERATOR SEMIGROUPS. Lecture 3. Stéphane ATTAL Lecture 3 OPRATOR SMIGROUPS Stéphane ATTAL Abstract This lecture is an introduction to the theory of Operator Semigroups and its main ingredients: different types of continuity, associated generator, dual

More information

Mathematical foundations - linear algebra

Mathematical foundations - linear algebra Mathematical foundations - linear algebra Andrea Passerini passerini@disi.unitn.it Machine Learning Vector space Definition (over reals) A set X is called a vector space over IR if addition and scalar

More information

A Concise Course on Stochastic Partial Differential Equations

A Concise Course on Stochastic Partial Differential Equations A Concise Course on Stochastic Partial Differential Equations Michael Röckner Reference: C. Prevot, M. Röckner: Springer LN in Math. 1905, Berlin (2007) And see the references therein for the original

More information

Measure, Integration & Real Analysis

Measure, Integration & Real Analysis v Measure, Integration & Real Analysis preliminary edition 10 August 2018 Sheldon Axler Dedicated to Paul Halmos, Don Sarason, and Allen Shields, the three mathematicians who most helped me become a mathematician.

More information

REAL AND COMPLEX ANALYSIS

REAL AND COMPLEX ANALYSIS REAL AND COMPLE ANALYSIS Third Edition Walter Rudin Professor of Mathematics University of Wisconsin, Madison Version 1.1 No rights reserved. Any part of this work can be reproduced or transmitted in any

More information

Lecture 4: Harmonic forms

Lecture 4: Harmonic forms Lecture 4: Harmonic forms Jonathan Evans 29th September 2010 Jonathan Evans () Lecture 4: Harmonic forms 29th September 2010 1 / 15 Jonathan Evans () Lecture 4: Harmonic forms 29th September 2010 2 / 15

More information

Inner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:

Inner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold: Inner products Definition: An inner product on a real vector space V is an operation (function) that assigns to each pair of vectors ( u, v) in V a scalar u, v satisfying the following axioms: 1. u, v

More information