Stat 643 Review of Probability Results (Cressie)
|
|
- Theodore Simon
- 5 years ago
- Views:
Transcription
1 Stat 643 Review of Probability Results (Cressie) Probability Space: ( HTT,, ) H is the set of outcomes T is a 5-algebra; subsets of H T is a probability measure mapping from T onto [0,] Measurable Space: ( HT, ) Random Variable: Suppose ( HT,, T ) is a probability space and let : H Ä be measurable (ie, { = H : ( = ) Ÿ!} T) Then is said to be a random variable (rv) Integral of a Measurable Function: Suppose ( HT,, ) is a measure space (ie, maps from T onto [0,_]) and 0 is a measurable mapping Then ' 0 is defined as a limit of integrals of simple (ie, step) functions: Write: 0œ0 + 0, where 0 +, 0 0 If ' 0 + _ and ' 0 _ then the integral is said to be finite If ' 0 + ' œ_œ 0, then the integral is said not to exist; otherwise it is said to exist The measurable function 0 is said to be integrableif ' 0 exists and is finite Notation: If is a rv on ( HT,, T ), write E( ) for ' T Important Convergence Theorems Let ( HT,, ) be a measure space and ( U, ) be the measurable space of real numbers with the Borel 5- algebra U In the following,, 0, { 08} 8>, and { 8} 8> denote measurable functions from ( HT, ) into ( U, ) Fatou's Lemma: If 08 0 as (), for all 8, then ' liminf 0 8 Ÿ liminf ' 0 8 Monotone Convergence Theorem: Suppose that as (), 0 Ÿ08 Å 0 Then ' 0 8 Å ' 0 Dominated Convergence Theorem: Suppose that as (), 08 Ä0 as and 08 Ÿfor all 8 If ' _, then 0 is integrable and lim ' 0 8 œ ' 0 Extended Dominated Convergence Theorem: Suppose that (i) 0 Ä0 as (), Äas () 8 8 (ii) 0 Ÿ as () and ' _, for all (iii) lim ' 8 œ ' _
2 Then, lim ' 0 8 œ ' 0 _ Note: Dominated convergence is a special case with 8 œ for all 8 Scheffe's Theorem: Suppose 08 0 and 0 0 as () Let / 8( E ) ' 0 8 E and /( E ) ' 0 be measures on ( HT,, ) with / ( H ) œ /H ( ) _, for all 8 If 0 Ä0as (), then 8 8 (i) sup{ / 8( E ) /( E) : E T} Ä 0, as and (ii) ' Ä 0, as Uniform Integrability The sequence of measurable functions { 0 8 } 8> is called uniformly integrable (wrt ) if lim sup ' 0 - { 0 > } 08 œ 8 - Ä_8> E Theorem: Suppose that H ( ) _, 08 Ä0 as (), and the sequence { 08} 8> is uniformly integrable Then { 0 : 8 }, 0 are all integrable and ' 0 Ä ' Various Forms of Convergence for rv's as Almost sure convergence: 8 Ä if T ( lim 8 œ ) œ T Convergence in probability: 8 Ä if lim T ( 8 %) œ 0, a % 0 L: Convergence in L p : 8 Ä if for ' : 8 T _, ' : T _, lim ' : 8 T œ0 eg, :œ corresponds to convergence in the mean :œ2 corresponds to convergence in mean square Jensen's Inequality: Let (,,) w be a random vector (ie, a measurable mapping from ( HT,, T) to (, U ), where U is the 5 -algebra of Borel sets in ) Suppose H as, where H is a convex set in, and E( ) _ (Recall that (" # + â + # ) /2 ) Define w E( ) (E( ),,E()) Let 9 : H Ä, where 9 is convex (ie, 9! ( B (! ) C) Ÿ!9( B) (!9 ) ( C)) Then E( 9( )) 9(E( )) Corollary: If < is concave then E( < ()) Ÿ < (E()) ( < is concave iff < is convex) Radon-Niodym Theorem Definition: A signed measure on a measurable space ( HT, ) is a mapping : T Ä ( _,_] such that (st) 9 ( ) œ 0 and (- E ) œ!( E ), (*) M 3 3 M 2
3 where M is countable and { E 3 } are disjoint The equality in (*) is taen to mean that the summation converges absolutely if ( - E 3 ) is finite, and diverges otherwise 3 M Jordan Decomposition: A signed measure can be written as œ +, where + and are measures Definition: + Example: Let be a rv st ' T _ Then is a signed measure ' E ( E ) T ; E T _ = Definition: A measure is a 5-finite measure if b disjoint { E } st H œ -E and ( E ) _ ; 3œ,2, Definition: A [signed] measure is said to be absolutely continuous (ac) with respect to a [signed] measure / if /( E) œ 0 Ê ( E) œ 0 [ / ( E) œ 0 Ê ( E) œ 0] Write << / Definition: Two measurable mappings 0 and on ( HT,, ) are said to be equivalent if ( 0Á) œ 0 Radon-Niodym (R-N) Theorem () Let ( HT,, T) be a probability space and a signed measure st << T Then b rv, unique up to equivalence ( T ), st ( E) œ ' E T, ae T, where ' T _ (2) Let ( HT/,, ) be a measure space, where / is 5 -finite, and let be a signed measure st << / Then b measurable mapping 0, unique up to equivalence (/), st ( E) œ ' E 0 /, ae T, where ' 0 / _ Notes: (i) When ( HT,, T) is a probability space, T is trivially 5-finite and so () is just a special case of (2) (ii) When is a measure, 0 in (2) (and thus in ()) is nonnegative Notation: in () or 0 in (2) is called the Radon-Niodym derivative and is denoted as /d T in () or // in (2) Conditional Expectations Let ( HT,, T ) be a probability space and a rv st is integrable Let V T be a sub 5- algebra (ie, V is a 5-algebra contained in T ) Define a signed measure on ( HV, ) by: 3
4 ' G (C) T ; G V Definition: Let T V be the probability measure on V given by TV( G) œtg ( ) ; ag V Then, << T V and for any V -measurable rv ] (ie, ] (( _,!]) V, a! ), ']T œ ']T V Definition: A function : H Ä is called (a version of) the conditional expectation of given V if (i) is V-measurable (ii) ' T œ ' T, ag V G G Note: The R-N Theorem guarantees the existence of the conditional expectation because ( G) œ ' G TV, where is the R-N derivative T ; ie, V ( G) œ T The rv on V is unique up to equivalence Notation: œ E( V ) Notes: (i) If is V -measurable (ie, (( _,!]) V, a! ) then E( V) œ as ( T ) (ii) If V œ { 9H, }, then E( V) œ E( ) (iii) Suppose ] is another rv on ( HT,, T ) and define U( ]) {] ( F): F U} to be the 5-algebra generated by ] Then write E( U( ])) as E( ] ) (iv) The conditional expectation of smooths" the rv Suppose is T- measurable on ( HTT,, ) Then: Sub 5-algebra: { 9H, } V T E( ) : E( ) E( V) as smoothest" smooth" roughest" Conditional Monotone Convergence Theorem: If 8 0, 8 Å as ( T ), then E( 8V ) Å E( V) as ( T) Conditional Dominated Convergence Theorem: If 8 Ä as ( T ), 8 Ÿ] as ( T) and E( ] ) _, then lim E( ) E( ) as ( ) 8 V œ V T ' G 4
5 Conditional Jensen's Inequality: Let 9 : H Ä, where 9 is convex and H is a convex subset of Let be a rv on ( HT,, T ) st H as ( T ) Suppose E( 9( ) ) _ Then E( 9( ) V) 9(E( V)) as ( T ) Regular Conditional Probability Let E T and ME be the indicator function of M Then E( ME V) is a V-measurable rv that has some properties of a probability on sets E T Notice that T( =, E ) E( ME V )( = ) is a mapping from H T onto [0,] Definition: Given a probability space ( HT,, T ), < : H T Ä [0,] is called a regular conditional probability on T given V if (i) for each fixed = H, <= (, ) is a probability measure on ( HT, ), (ii) for each fixed E T, < ( E, ) is V-measurable, and (iii) for every E T, ' G <= (, ET ) ( = ) œte G ( ), ag V Note: Although E( M E V) satisfies (ii) and (iii), it does not necessarily satisfy (i) Theorem: If ( HT,, T) œ (, U, T), then a regular conditional probability on U given V exists and is given by <= (, E) œ E( V )( = ) M E Change of Variable Theorem: Let 0: ( HT,, ) Ä * * * * ( H, T,/) and : ( H, T,/) Ä ( U, ) be two measurable functions, where * * /( E ) ( 0 ( E )) is the measure induced by 0 on ( H *, T * ) Then ' ' ' * * * / œ * 0 œ * 0 ( ( = )), ae T, E 0 ( E ) 0 ( E ) in the sense that if one of the integrals exists then so does the other and they are equal Probability versus Statistics Probability is concerned with rv's : ( HT,,P) Ä ( U, ) Now induces a probability measure T on ( U, ) through T ( F ) T ( ( F)), af U Statistics focuses on the triple ( U,, T ) and essentially forgets about ( HT,, T ) More generally, does not have to be a rv on ( U, ) but could be some more general random quantity Then data could be thought of simply as a measurable mapping into ( U,, T ) Example: œ and U œ U : Then is a random vector More complicated and U are needed when is, say, a random set Definition: A statistic is a measurable mapping : ( U,, T ) Ä ( g, Y) Note: T induces a T : T ( J ) T ( ( J)), aj Y 5
6 Notation: U0 U( ) { ( J): J Y}, the 5-algebra generated by Then U0 U is a sub 5-algebra Lehmann's Theorem (TSH, p 42): A real valued U-measurable function 9 is U0-measurable iff b a real-valued Y-measurable function < : ( g, Y ) ( U, ) st Ä 9 ( B) œ < ( B ( )), ab, where is a statistic mapping into ( g, Y) and U œ U( ) 0 Partitioning the Sample Space Suppose is the sample space and is a statistic Then defines a partition of as follows: For BC,, Band C are in the same member of the partition (write BµC) iff B ( ) œc ( ) Notice that two different" statistics can generate the same partition, eg, ( B) œ! B and ( B) œ! B / = 3= It is tempting to characterize a statistic's behavior via its partition of but, for technical reasons, it does not necessarily generate the 5-algebra of interest, namely U( ) In general, if U( ) œ U( ) then we say the two statistics, are the same 2 2 Change of Variable Formula Involving a Statistic Suppose ( U,, T ) Ä ( g, Y, T ) Ä ( U, ) Then, ' ( ( )) ( ) ' () ();, ( J) B T B œ J >T > J Y in the sense that if one integral exists then so does the other and they are equal Proof: Assume Jœ g, the whole space First let œm for some J Y Then J B ( ( )) œm ( B ( )) œm ( B) J ( J ) 6
7 Thus, since œ ( g ), ' ( ( )) ( ) ' B T B œ M ( BT ) ( B) ( J ) œt ( ( J )) œt ' g ( J ) œ M () >T () > J ' g œ >T () () > The same result is obtained when J is not g Therefore, the result is true for indictor functions, so true for simple functions, and hence true for limits of simple functions Probability Version of Change of Variables Formula Suppose Then, ( HT,, T) Ä ( U,, T ) Ä ( U, ) ' H ( ( )) ( ) ' = T = œ BT ( ) ( B), which is nown as the law of the unconscious statistician Change of Variables and the R-N Derivative Suppose T <<, where is some 5-finite measure on ( U, ) Define 0B ( ) (T /)( B); B, which recall is a U-measurable mapping; ie, T ( F) œ ' 0 Then, for st ' T ( B ) T ( B) _, the change of variable formula gives Further, E( ( )) ' H ( ( = ))T( = ) F œ ' BT ( ) ( B) ' BT ( ) ( B) œ ' B0B ( ) ( ) ( B) 7
8 This last equality is true for ( ) œm F( ), because ' T œ ' M FT œt ( F) œ ' 0 F œ ' MF0 œ ' 0 Hence it is true for simple functions, and so it is true for limits of simple functions Example: is Lebesgue measure Write B" as shorthand for ( B) For example, if ' 2 2 BT B _ œ ' 2 ( ), then E( ) B0BB ( ), where 0B ( ) is the R-N derivative of T wrt ; 0 is commonly called the probability density function 8
Homework 11. Solutions
Homework 11. Solutions Problem 2.3.2. Let f n : R R be 1/n times the characteristic function of the interval (0, n). Show that f n 0 uniformly and f n µ L = 1. Why isn t it a counterexample to the Lebesgue
More informationIf Y and Y 0 satisfy (1-2), then Y = Y 0 a.s.
20 6. CONDITIONAL EXPECTATION Having discussed at length the limit theory for sums of independent random variables we will now move on to deal with dependent random variables. An important tool in this
More informationBrownian Motion and Conditional Probability
Math 561: Theory of Probability (Spring 2018) Week 10 Brownian Motion and Conditional Probability 10.1 Standard Brownian Motion (SBM) Brownian motion is a stochastic process with both practical and theoretical
More information3 Integration and Expectation
3 Integration and Expectation 3.1 Construction of the Lebesgue Integral Let (, F, µ) be a measure space (not necessarily a probability space). Our objective will be to define the Lebesgue integral R fdµ
More informationI. ANALYSIS; PROBABILITY
ma414l1.tex Lecture 1. 12.1.2012 I. NLYSIS; PROBBILITY 1. Lebesgue Measure and Integral We recall Lebesgue measure (M411 Probability and Measure) λ: defined on intervals (a, b] by λ((a, b]) := b a (so
More informationLecture 2: Random Variables and Expectation
Econ 514: Probability and Statistics Lecture 2: Random Variables and Expectation Definition of function: Given sets X and Y, a function f with domain X and image Y is a rule that assigns to every x X one
More information18.175: Lecture 3 Integration
18.175: Lecture 3 Scott Sheffield MIT Outline Outline Recall definitions Probability space is triple (Ω, F, P) where Ω is sample space, F is set of events (the σ-algebra) and P : F [0, 1] is the probability
More information( f ^ M _ M 0 )dµ (5.1)
47 5. LEBESGUE INTEGRAL: GENERAL CASE Although the Lebesgue integral defined in the previous chapter is in many ways much better behaved than the Riemann integral, it shares its restriction to bounded
More informationSTAT 7032 Probability Spring Wlodek Bryc
STAT 7032 Probability Spring 2018 Wlodek Bryc Created: Friday, Jan 2, 2014 Revised for Spring 2018 Printed: January 9, 2018 File: Grad-Prob-2018.TEX Department of Mathematical Sciences, University of Cincinnati,
More informationLebesgue-Radon-Nikodym Theorem
Lebesgue-Radon-Nikodym Theorem Matt Rosenzweig 1 Lebesgue-Radon-Nikodym Theorem In what follows, (, A) will denote a measurable space. We begin with a review of signed measures. 1.1 Signed Measures Definition
More informationLebesgue Integration: A non-rigorous introduction. What is wrong with Riemann integration?
Lebesgue Integration: A non-rigorous introduction What is wrong with Riemann integration? xample. Let f(x) = { 0 for x Q 1 for x / Q. The upper integral is 1, while the lower integral is 0. Yet, the function
More informationTHEOREMS, ETC., FOR MATH 515
THEOREMS, ETC., FOR MATH 515 Proposition 1 (=comment on page 17). If A is an algebra, then any finite union or finite intersection of sets in A is also in A. Proposition 2 (=Proposition 1.1). For every
More informationMATH31011/MATH41011/MATH61011: FOURIER ANALYSIS AND LEBESGUE INTEGRATION. Chapter 2: Countability and Cantor Sets
MATH31011/MATH41011/MATH61011: FOURIER ANALYSIS AND LEBESGUE INTEGRATION Chapter 2: Countability and Cantor Sets Countable and Uncountable Sets The concept of countability will be important in this course
More informationChapter 1: Probability Theory Lecture 1: Measure space, measurable function, and integration
Chapter 1: Probability Theory Lecture 1: Measure space, measurable function, and integration Random experiment: uncertainty in outcomes Ω: sample space: a set containing all possible outcomes Definition
More informationChapter 6 Expectation and Conditional Expectation. Lectures Definition 6.1. Two random variables defined on a probability space are said to be
Chapter 6 Expectation and Conditional Expectation Lectures 24-30 In this chapter, we introduce expected value or the mean of a random variable. First we define expectation for discrete random variables
More informationPart V. 17 Introduction: What are measures and why measurable sets. Lebesgue Integration Theory
Part V 7 Introduction: What are measures and why measurable sets Lebesgue Integration Theory Definition 7. (Preliminary). A measure on a set is a function :2 [ ] such that. () = 2. If { } = is a finite
More informationNotes on Measure, Probability and Stochastic Processes. João Lopes Dias
Notes on Measure, Probability and Stochastic Processes João Lopes Dias Departamento de Matemática, ISEG, Universidade de Lisboa, Rua do Quelhas 6, 1200-781 Lisboa, Portugal E-mail address: jldias@iseg.ulisboa.pt
More information2 Measure Theory. 2.1 Measures
2 Measure Theory 2.1 Measures A lot of this exposition is motivated by Folland s wonderful text, Real Analysis: Modern Techniques and Their Applications. Perhaps the most ubiquitous measure in our lives
More informationFUNDAMENTALS OF REAL ANALYSIS by. IV.1. Differentiation of Monotonic Functions
FUNDAMNTALS OF RAL ANALYSIS by Doğan Çömez IV. DIFFRNTIATION AND SIGND MASURS IV.1. Differentiation of Monotonic Functions Question: Can we calculate f easily? More eplicitly, can we hope for a result
More informationProbability and Random Processes
Probability and Random Processes Lecture 7 Conditional probability and expectation Decomposition of measures Mikael Skoglund, Probability and random processes 1/13 Conditional Probability A probability
More informationMATHS 730 FC Lecture Notes March 5, Introduction
1 INTRODUCTION MATHS 730 FC Lecture Notes March 5, 2014 1 Introduction Definition. If A, B are sets and there exists a bijection A B, they have the same cardinality, which we write as A, #A. If there exists
More information2 (Bonus). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?
MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due 9/5). Prove that every countable set A is measurable and µ(a) = 0. 2 (Bonus). Let A consist of points (x, y) such that either x or y is
More informationChapter 1: Probability Theory Lecture 1: Measure space and measurable function
Chapter 1: Probability Theory Lecture 1: Measure space and measurable function Random experiment: uncertainty in outcomes Ω: sample space: a set containing all possible outcomes Definition 1.1 A collection
More informationSummary of Real Analysis by Royden
Summary of Real Analysis by Royden Dan Hathaway May 2010 This document is a summary of the theorems and definitions and theorems from Part 1 of the book Real Analysis by Royden. In some areas, such as
More informationSection Signed Measures: The Hahn and Jordan Decompositions
17.2. Signed Measures 1 Section 17.2. Signed Measures: The Hahn and Jordan Decompositions Note. If measure space (X, M) admits measures µ 1 and µ 2, then for any α,β R where α 0,β 0, µ 3 = αµ 1 + βµ 2
More information3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?
MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due ). Show that the open disk x 2 + y 2 < 1 is a countable union of planar elementary sets. Show that the closed disk x 2 + y 2 1 is a countable
More informationAdvanced Probability
Advanced Probability Perla Sousi October 10, 2011 Contents 1 Conditional expectation 1 1.1 Discrete case.................................. 3 1.2 Existence and uniqueness............................ 3 1
More informationIntroduction and Preliminaries
Chapter 1 Introduction and Preliminaries This chapter serves two purposes. The first purpose is to prepare the readers for the more systematic development in later chapters of methods of real analysis
More informationIntegration on Measure Spaces
Chapter 3 Integration on Measure Spaces In this chapter we introduce the general notion of a measure on a space X, define the class of measurable functions, and define the integral, first on a class of
More informationRS Chapter 1 Random Variables 6/5/2017. Chapter 1. Probability Theory: Introduction
Chapter 1 Probability Theory: Introduction Basic Probability General In a probability space (Ω, Σ, P), the set Ω is the set of all possible outcomes of a probability experiment. Mathematically, Ω is just
More informationMATH MEASURE THEORY AND FOURIER ANALYSIS. Contents
MATH 3969 - MEASURE THEORY AND FOURIER ANALYSIS ANDREW TULLOCH Contents 1. Measure Theory 2 1.1. Properties of Measures 3 1.2. Constructing σ-algebras and measures 3 1.3. Properties of the Lebesgue measure
More informationMeasure and integration
Chapter 5 Measure and integration In calculus you have learned how to calculate the size of different kinds of sets: the length of a curve, the area of a region or a surface, the volume or mass of a solid.
More information(1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define
Homework, Real Analysis I, Fall, 2010. (1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define ρ(f, g) = 1 0 f(x) g(x) dx. Show that
More informationPart II Probability and Measure
Part II Probability and Measure Theorems Based on lectures by J. Miller Notes taken by Dexter Chua Michaelmas 2016 These notes are not endorsed by the lecturers, and I have modified them (often significantly)
More informationThe Lebesgue Integral
The Lebesgue Integral Brent Nelson In these notes we give an introduction to the Lebesgue integral, assuming only a knowledge of metric spaces and the iemann integral. For more details see [1, Chapters
More information1 Stochastic Dynamic Programming
1 Stochastic Dynamic Programming Formally, a stochastic dynamic program has the same components as a deterministic one; the only modification is to the state transition equation. When events in the future
More information5 Measure theory II. (or. lim. Prove the proposition. 5. For fixed F A and φ M define the restriction of φ on F by writing.
5 Measure theory II 1. Charges (signed measures). Let (Ω, A) be a σ -algebra. A map φ: A R is called a charge, (or signed measure or σ -additive set function) if φ = φ(a j ) (5.1) A j for any disjoint
More informationTheorem 1.7 [Bayes' Law]: Assume that,,, are mutually disjoint events in the sample space s.t.. Then Pr( )
Theorem 1.7 [Bayes' Law]: Assume that,,, are mutually disjoint events in the sample space s.t.. Then Pr Pr = Pr Pr Pr() Pr Pr. We are given three coins and are told that two of the coins are fair and the
More informationLecture 3: Expected Value. These integrals are taken over all of Ω. If we wish to integrate over a measurable subset A Ω, we will write
Lecture 3: Expected Value 1.) Definitions. If X 0 is a random variable on (Ω, F, P), then we define its expected value to be EX = XdP. Notice that this quantity may be. For general X, we say that EX exists
More informationThree hours THE UNIVERSITY OF MANCHESTER. 24th January
Three hours MATH41011 THE UNIVERSITY OF MANCHESTER FOURIER ANALYSIS AND LEBESGUE INTEGRATION 24th January 2013 9.45 12.45 Answer ALL SIX questions in Section A (25 marks in total). Answer THREE of the
More informationConstruction of a general measure structure
Chapter 4 Construction of a general measure structure We turn to the development of general measure theory. The ingredients are a set describing the universe of points, a class of measurable subsets along
More information(2) E M = E C = X\E M
10 RICHARD B. MELROSE 2. Measures and σ-algebras An outer measure such as µ is a rather crude object since, even if the A i are disjoint, there is generally strict inequality in (1.14). It turns out to
More informationLectures 22-23: Conditional Expectations
Lectures 22-23: Conditional Expectations 1.) Definitions Let X be an integrable random variable defined on a probability space (Ω, F 0, P ) and let F be a sub-σ-algebra of F 0. Then the conditional expectation
More informationStanford Mathematics Department Math 205A Lecture Supplement #4 Borel Regular & Radon Measures
2 1 Borel Regular Measures We now state and prove an important regularity property of Borel regular outer measures: Stanford Mathematics Department Math 205A Lecture Supplement #4 Borel Regular & Radon
More information+ 2x sin x. f(b i ) f(a i ) < ɛ. i=1. i=1
Appendix To understand weak derivatives and distributional derivatives in the simplest context of functions of a single variable, we describe without proof some results from real analysis (see [7] and
More informationL p Spaces and Convexity
L p Spaces and Convexity These notes largely follow the treatments in Royden, Real Analysis, and Rudin, Real & Complex Analysis. 1. Convex functions Let I R be an interval. For I open, we say a function
More information1/12/05: sec 3.1 and my article: How good is the Lebesgue measure?, Math. Intelligencer 11(2) (1989),
Real Analysis 2, Math 651, Spring 2005 April 26, 2005 1 Real Analysis 2, Math 651, Spring 2005 Krzysztof Chris Ciesielski 1/12/05: sec 3.1 and my article: How good is the Lebesgue measure?, Math. Intelligencer
More informationNotes on the Lebesgue Integral by Francis J. Narcowich November, 2013
Notes on the Lebesgue Integral by Francis J. Narcowich November, 203 Introduction In the definition of the Riemann integral of a function f(x), the x-axis is partitioned and the integral is defined in
More informationRandom Process Lecture 1. Fundamentals of Probability
Random Process Lecture 1. Fundamentals of Probability Husheng Li Min Kao Department of Electrical Engineering and Computer Science University of Tennessee, Knoxville Spring, 2016 1/43 Outline 2/43 1 Syllabus
More informationChapter 4. Measure Theory. 1. Measure Spaces
Chapter 4. Measure Theory 1. Measure Spaces Let X be a nonempty set. A collection S of subsets of X is said to be an algebra on X if S has the following properties: 1. X S; 2. if A S, then A c S; 3. if
More information36-752: Lecture 1. We will use measures to say how large sets are. First, we have to decide which sets we will measure.
0 0 0 -: Lecture How is this course different from your earlier probability courses? There are some problems that simply can t be handled with finite-dimensional sample spaces and random variables that
More informationThe goal of this chapter is to study linear systems of ordinary differential equations: dt,..., dx ) T
1 1 Linear Systems The goal of this chapter is to study linear systems of ordinary differential equations: ẋ = Ax, x(0) = x 0, (1) where x R n, A is an n n matrix and ẋ = dx ( dt = dx1 dt,..., dx ) T n.
More informationThe Hahn-Banach and Radon-Nikodym Theorems
The Hahn-Banach and Radon-Nikodym Theorems 1. Signed measures Definition 1. Given a set Hand a 5-field of sets Y, we define a set function. À Y Ä to be a signed measure if it has all the properties of
More informationAlmost Sure Convergence of a Sequence of Random Variables
Almost Sure Convergence of a Sequence of Random Variables (...for people who haven t had measure theory.) 1 Preliminaries 1.1 The Measure of a Set (Informal) Consider the set A IR 2 as depicted below.
More information0.1 Uniform integrability
Copyright c 2009 by Karl Sigman 0.1 Uniform integrability Given a sequence of rvs {X n } for which it is known apriori that X n X, n, wp1. for some r.v. X, it is of great importance in many applications
More informationChapter 8. General Countably Additive Set Functions. 8.1 Hahn Decomposition Theorem
Chapter 8 General Countably dditive Set Functions In Theorem 5.2.2 the reader saw that if f : X R is integrable on the measure space (X,, µ) then we can define a countably additive set function ν on by
More informationCHAPTER 6. Differentiation
CHPTER 6 Differentiation The generalization from elementary calculus of differentiation in measure theory is less obvious than that of integration, and the methods of treating it are somewhat involved.
More informationHILBERT SPACES AND THE RADON-NIKODYM THEOREM. where the bar in the first equation denotes complex conjugation. In either case, for any x V define
HILBERT SPACES AND THE RADON-NIKODYM THEOREM STEVEN P. LALLEY 1. DEFINITIONS Definition 1. A real inner product space is a real vector space V together with a symmetric, bilinear, positive-definite mapping,
More informationMath 5051 Measure Theory and Functional Analysis I Homework Assignment 3
Math 551 Measure Theory and Functional Analysis I Homework Assignment 3 Prof. Wickerhauser Due Monday, October 12th, 215 Please do Exercises 3*, 4, 5, 6, 8*, 11*, 17, 2, 21, 22, 27*. Exercises marked with
More informationII - REAL ANALYSIS. This property gives us a way to extend the notion of content to finite unions of rectangles: we define
1 Measures 1.1 Jordan content in R N II - REAL ANALYSIS Let I be an interval in R. Then its 1-content is defined as c 1 (I) := b a if I is bounded with endpoints a, b. If I is unbounded, we define c 1
More informationReminder Notes for the Course on Measures on Topological Spaces
Reminder Notes for the Course on Measures on Topological Spaces T. C. Dorlas Dublin Institute for Advanced Studies School of Theoretical Physics 10 Burlington Road, Dublin 4, Ireland. Email: dorlas@stp.dias.ie
More informationINTRODUCTION TO MEASURE THEORY AND LEBESGUE INTEGRATION
1 INTRODUCTION TO MEASURE THEORY AND LEBESGUE INTEGRATION Eduard EMELYANOV Ankara TURKEY 2007 2 FOREWORD This book grew out of a one-semester course for graduate students that the author have taught at
More informationRecall that if X is a compact metric space, C(X), the space of continuous (real-valued) functions on X, is a Banach space with the norm
Chapter 13 Radon Measures Recall that if X is a compact metric space, C(X), the space of continuous (real-valued) functions on X, is a Banach space with the norm (13.1) f = sup x X f(x). We want to identify
More informationU e = E (U\E) e E e + U\E e. (1.6)
12 1 Lebesgue Measure 1.2 Lebesgue Measure In Section 1.1 we defined the exterior Lebesgue measure of every subset of R d. Unfortunately, a major disadvantage of exterior measure is that it does not satisfy
More informationconsists of two disjoint copies of X n, each scaled down by 1,
Homework 4 Solutions, Real Analysis I, Fall, 200. (4) Let be a topological space and M be a σ-algebra on which contains all Borel sets. Let m, µ be two positive measures on M. Assume there is a constant
More informationProblem set 1, Real Analysis I, Spring, 2015.
Problem set 1, Real Analysis I, Spring, 015. (1) Let f n : D R be a sequence of functions with domain D R n. Recall that f n f uniformly if and only if for all ɛ > 0, there is an N = N(ɛ) so that if n
More information4 Expectation & the Lebesgue Theorems
STA 7: Probability & Measure Theory Robert L. Wolpert 4 Expectation & the Lebesgue Theorems Let X and {X n : n N} be random variables on the same probability space (Ω,F,P). If X n (ω) X(ω) for each ω Ω,
More informationMEASURE THEORY AND LEBESGUE INTEGRAL 15
MASUR THORY AND LBSGU INTGRAL 15 Proof. Let 2Mbe such that µ() = 0, and f 1 (x) apple f 2 (x) apple and f n (x) =f(x) for x 2 c.settingg n = c f n and g = c f, we observe that g n = f n a.e. and g = f
More informationEconomics 574 Appendix to 13 Ways
University of Illinois Spring 2017 Department of Economics Roger Koenker Economics 574 ppendix to 13 Ways This ppendix provides an overview of some of the background that is left undeveloped in 13 Ways
More informationLebesgue measure and integration
Chapter 4 Lebesgue measure and integration If you look back at what you have learned in your earlier mathematics courses, you will definitely recall a lot about area and volume from the simple formulas
More information212a1214Daniell s integration theory.
212a1214 Daniell s integration theory. October 30, 2014 Daniell s idea was to take the axiomatic properties of the integral as the starting point and develop integration for broader and broader classes
More informationReal Analysis Qualifying Exam May 14th 2016
Real Analysis Qualifying Exam May 4th 26 Solve 8 out of 2 problems. () Prove the Banach contraction principle: Let T be a mapping from a complete metric space X into itself such that d(tx,ty) apple qd(x,
More informationMATH 418: Lectures on Conditional Expectation
MATH 418: Lectures on Conditional Expectation Instructor: r. Ed Perkins, Notes taken by Adrian She Conditional expectation is one of the most useful tools of probability. The Radon-Nikodym theorem enables
More informationLecture 3: Probability Measures - 2
Lecture 3: Probability Measures - 2 1. Continuation of measures 1.1 Problem of continuation of a probability measure 1.2 Outer measure 1.3 Lebesgue outer measure 1.4 Lebesgue continuation of an elementary
More informationProblem Set. Problem Set #1. Math 5322, Fall March 4, 2002 ANSWERS
Problem Set Problem Set #1 Math 5322, Fall 2001 March 4, 2002 ANSWRS i All of the problems are from Chapter 3 of the text. Problem 1. [Problem 2, page 88] If ν is a signed measure, is ν-null iff ν () 0.
More information+ = x. ± if x > 0. if x < 0, x
2 Set Functions Notation Let R R {, + } and R + {x R : x 0} {+ }. Here + and are symbols satisfying obvious conditions: for any real number x R : < x < +, (± + (± x + (± (± + x ±, (± (± + and (± (, ± if
More information02. Measure and integral. 1. Borel-measurable functions and pointwise limits
(October 3, 2017) 02. Measure and integral Paul Garrett garrett@math.umn.edu http://www.math.umn.edu/ garrett/ [This document is http://www.math.umn.edu/ garrett/m/real/notes 2017-18/02 measure and integral.pdf]
More informationReal Analysis, 2nd Edition, G.B.Folland Signed Measures and Differentiation
Real Analysis, 2nd dition, G.B.Folland Chapter 3 Signed Measures and Differentiation Yung-Hsiang Huang 3. Signed Measures. Proof. The first part is proved by using addivitiy and consider F j = j j, 0 =.
More informationMTH 404: Measure and Integration
MTH 404: Measure and Integration Semester 2, 2012-2013 Dr. Prahlad Vaidyanathan Contents I. Introduction....................................... 3 1. Motivation................................... 3 2. The
More information7 About Egorov s and Lusin s theorems
Tel Aviv University, 2013 Measure and category 62 7 About Egorov s and Lusin s theorems 7a About Severini-Egorov theorem.......... 62 7b About Lusin s theorem............... 64 7c About measurable functions............
More informationA Note on the Convergence of Random Riemann and Riemann-Stieltjes Sums to the Integral
Gen. Math. Notes, Vol. 22, No. 2, June 2014, pp.1-6 ISSN 2219-7184; Copyright c ICSRS Publication, 2014 www.i-csrs.org Available free online at http://www.geman.in A Note on the Convergence of Random Riemann
More informationChapter 5. Measurable Functions
Chapter 5. Measurable Functions 1. Measurable Functions Let X be a nonempty set, and let S be a σ-algebra of subsets of X. Then (X, S) is a measurable space. A subset E of X is said to be measurable if
More informationA Measure and Integral over Unbounded Sets
A Measure and Integral over Unbounded Sets As presented in Chaps. 2 and 3, Lebesgue s theory of measure and integral is limited to functions defined over bounded sets. There are several ways of introducing
More information4 Expectation & the Lebesgue Theorems
STA 205: Probability & Measure Theory Robert L. Wolpert 4 Expectation & the Lebesgue Theorems Let X and {X n : n N} be random variables on a probability space (Ω,F,P). If X n (ω) X(ω) for each ω Ω, does
More informationMeasures. 1 Introduction. These preliminary lecture notes are partly based on textbooks by Athreya and Lahiri, Capinski and Kopp, and Folland.
Measures These preliminary lecture notes are partly based on textbooks by Athreya and Lahiri, Capinski and Kopp, and Folland. 1 Introduction Our motivation for studying measure theory is to lay a foundation
More informationFundamental Inequalities, Convergence and the Optional Stopping Theorem for Continuous-Time Martingales
Fundamental Inequalities, Convergence and the Optional Stopping Theorem for Continuous-Time Martingales Prakash Balachandran Department of Mathematics Duke University April 2, 2008 1 Review of Discrete-Time
More informationReview of Multi-Calculus (Study Guide for Spivak s CHAPTER ONE TO THREE)
Review of Multi-Calculus (Study Guide for Spivak s CHPTER ONE TO THREE) This material is for June 9 to 16 (Monday to Monday) Chapter I: Functions on R n Dot product and norm for vectors in R n : Let X
More informationMeasurable functions are approximately nice, even if look terrible.
Tel Aviv University, 2015 Functions of real variables 74 7 Approximation 7a A terrible integrable function........... 74 7b Approximation of sets................ 76 7c Approximation of functions............
More informationvan Rooij, Schikhof: A Second Course on Real Functions
vanrooijschikhof.tex April 25, 2018 van Rooij, Schikhof: A Second Course on Real Functions Notes from [vrs]. Introduction A monotone function is Riemann integrable. A continuous function is Riemann integrable.
More informationIntegral Jensen inequality
Integral Jensen inequality Let us consider a convex set R d, and a convex function f : (, + ]. For any x,..., x n and λ,..., λ n with n λ i =, we have () f( n λ ix i ) n λ if(x i ). For a R d, let δ a
More informationST5215: Advanced Statistical Theory
Department of Statistics & Applied Probability Thursday, August 15, 2011 Lecture 2: Measurable Function and Integration Measurable function f : a function from Ω to Λ (often Λ = R k ) Inverse image of
More informationLebesgue Integration on R n
Lebesgue Integration on R n The treatment here is based loosely on that of Jones, Lebesgue Integration on Euclidean Space We give an overview from the perspective of a user of the theory Riemann integration
More informationWeak convergence. Amsterdam, 13 November Leiden University. Limit theorems. Shota Gugushvili. Generalities. Criteria
Weak Leiden University Amsterdam, 13 November 2013 Outline 1 2 3 4 5 6 7 Definition Definition Let µ, µ 1, µ 2,... be probability measures on (R, B). It is said that µ n converges weakly to µ, and we then
More informationREVIEW OF ESSENTIAL MATH 346 TOPICS
REVIEW OF ESSENTIAL MATH 346 TOPICS 1. AXIOMATIC STRUCTURE OF R Doğan Çömez The real number system is a complete ordered field, i.e., it is a set R which is endowed with addition and multiplication operations
More informationChapter 6. Integration. 1. Integrals of Nonnegative Functions. a j µ(e j ) (ca j )µ(e j ) = c X. and ψ =
Chapter 6. Integration 1. Integrals of Nonnegative Functions Let (, S, µ) be a measure space. We denote by L + the set of all measurable functions from to [0, ]. Let φ be a simple function in L +. Suppose
More informationAPPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2.
APPENDIX A Background Mathematics A. Linear Algebra A.. Vector algebra Let x denote the n-dimensional column vector with components 0 x x 2 B C @. A x n Definition 6 (scalar product). The scalar product
More informationTheorem 2.1 (Caratheodory). A (countably additive) probability measure on a field has an extension. n=1
Chapter 2 Probability measures 1. Existence Theorem 2.1 (Caratheodory). A (countably additive) probability measure on a field has an extension to the generated σ-field Proof of Theorem 2.1. Let F 0 be
More informationFinal. due May 8, 2012
Final due May 8, 2012 Write your solutions clearly in complete sentences. All notation used must be properly introduced. Your arguments besides being correct should be also complete. Pay close attention
More information1 Sequences of events and their limits
O.H. Probability II (MATH 2647 M15 1 Sequences of events and their limits 1.1 Monotone sequences of events Sequences of events arise naturally when a probabilistic experiment is repeated many times. For
More informationThe Caratheodory Construction of Measures
Chapter 5 The Caratheodory Construction of Measures Recall how our construction of Lebesgue measure in Chapter 2 proceeded from an initial notion of the size of a very restricted class of subsets of R,
More information