Product measure and Fubini s theorem
|
|
- Johnathan Turner
- 5 years ago
- Views:
Transcription
1 Chapter 7 Product measure and Fubini s theorem This is based on [Billingsley, Section 18]. 1. Product spaces Suppose (Ω 1, F 1 ) and (Ω 2, F 2 ) are two probability spaces. In a product space Ω = Ω 1 Ω 2, a measurable rectangle is A 1 A 2 where A 1 F 1 and A 2 F 2. We define F 1 F 2 as the σ-field generated by measurable rectangles. Example 7.1. B(R) B(R) = B(R 2 ) Theorem 7.1. (i) If E F 1 F 2 then for each ω 1 Ω 1 the set is in F 2. Similarly, the section E 1 (ω 2 ) F 1. E 2 (ω 1 ) = {ω 2 Ω 2 : (ω 1, ω 2 ) E} (ii) if f : Ω R is measurable, then for each ω 1 Ω 1 the function ω 2 f(ω 1, ω 2 ) is measurable. Proof. Fix ω 1 Ω 1. Consider the mapping T : Ω 2 Ω given by T (ω 2 ) = (ω 1, ω 2 ). If E = A 1 A 2 is a measurable rectangle, then T 1 (E) is either or A 2. So T is measurable, and T 1 (E) F 2 for all E F 1 F 2. Now g(ω 2 ) = f T (ω 2 ) is a measurable mapping as a composition of measurable functions. 2. Product measure Suppose P 1, P 2 are probability measures on F 1 and F 2 respectively. By Theorem 7.1, the function ω 1 P 2 (E 2 (ω 1 )) is well defined. The collection L of subsets E of Ω 1 Ω 2 for which this function is F 1 -measurable is a λ-system. The collection of measurable rectangles E = A 1 A 2 is a π-system, and for such E the function is 83
2 84 7. Product measure and Fubini s theorem P 2 (E 2 (ω 1 )) = I A1 (ω 1 )P 2 (A 2 ), so it is measurable. Therefore, ω 1 P 2 (E 2 (ω 1 ) is measurable for all E F 1 F 2. Since this is non-negative and bounded function, we can define (7.1) P (E) := P 2 (E 2 (ω 1 )P 1 (dω 1 ) Ω 1 and (7.2) P (E) := P 1 (E 1 (ω 2 )P 2 (dω 2 ) Ω 2 It is clear that both P and P are probability measures. convergence theorem for the integrals.) (Continuity follows from monotone We note that for measurable rectangles P (A 1 A 2 ) = P (A 1 A 2 ) = P 1 (A 1 )P 2 (A 2 ). Since the class of sets E for which P = P is a λ-system, this means that P = P. The common value is the product measure P = P 1 P 2. Note that the above construction gives inductively a product measure on Ω 1 Ω n. In particular, it implies a finite version of Theorem 4.7. Theorem 7.2. If F 1, F 2,..., F n are cumulative distribution functions then there exists a probability space (Ω, F, P ) and a sequence X 1, X 2,..., X n of independent random variables such that X k has cumulative distribution function F k. 3. Fubini s Theorem Theorem 7.3. If f : Ω = Ω 1 Ω 2 R is non-negative then the functions ω 2 Ω 1 f(ω 1, ω 2 )P 1 (dω 1 ) and ω 1 Ω 2 f(ω 1, ω 2 )P 2 (dω 2 ) are measurable and (7.3) ( ) ( ) f(ω 1, ω 2 )d(p 1 P 2 ) = f(ω 1, ω 2 )P 1 (dω 1 ) P 2 (dω 2 ) = f(ω 1, ω 2 )P 2 (dω 2 ) P 1 (dω 1 ) Ω Ω 1 Ω 2 If f is P 1 P 2 -integrable, then (7.3) holds. Ω 2 Sketch of the proof. For f = I E, formula (7.3) is just the definition of the product measure. By linearity, the same formula holds for simple f. Now if f n f are simple, then functions Ω 1 f n (ω 1, ω 2 )P 1 (dω 1 ) are non-decreasing, so monotone convergence theorem (Theorem 6.4) gives (7.3). This ends the first part of the proof (the Tonelli s theorem). We omit the proof of the second part 1. Fubini s theorem is often a powerful computational tool. The following example illustrates its power and the value of the limit will be needed later on. Ω 1 1 After the standard decomposition f = f + f one needs to integrate over the set Ω 2 = {ω 2 : Ω 1 f(ω 1, ω 2 ) P 1 (dω 1 ) < } which may be smaller than Ω 2 but has P 2 -measure 1.
3 3. Fubini s Theorem 85 Example 7.2. The function f(x, u) = sin xe ux is integrable on (, t) (, ) as (by Tonelli s theorem) t ( ) t e ux sin x sin x du dx = dx t x By Fubini s theorem, t sin x t ( x dx = ) e ux sin xdu dx = = ( t ) e ux sin xdx du u 2 ( 1 e ut (u sin t + cos t) ) du Thus by the Lebesgue dominated convergence theorem lim t t (Omitted in 218) = π 2 s s sin t + t cos t e t 2 + s 2 ds sin x x dx = π/ Integration by parts. If F, G have no common points of discontinuity in (a, b] then G(x)dF (x) = F (b)g(b) F (a)g(a) F (x)g(dx) Proof. Write (a, b] (a, b] = + where = {(x, y) : a < y x b} and + = {(x, y) : a < x y b}. The product measure is (F (b) F (a))(g(b) G(a) = P ((a, b] (a, b]) = P ( ) + P ( + ) P ( + ) We note that + = {(x, x) : a < x b}. By Fubini s theorem P ( + ) = (F ({x})g(dx) = as F, G have no common point-mass atoms. The formula is now a calculation, using P ( ) = P ( + ) = (G(x) G(a))F (dx) (F (y) F (a))g(dy) 3.2. Tail integration formula. Formula (5.9) and its various generalizations are easy to derive from Fubini s theorem: if X then X p = pt p 1 I t<x dt so (7.4) E(X p ) = p t p 1 P (X > t)dt
4 86 7. Product measure and Fubini s theorem This formula holds true also in the non-integrable case - both sides are then Convolutions. Suppose X 1, X 2 are independent random variables with cumulative distribution functions F 1, F 2. Then the cumulative distribution function F X1 +X 2 (x) = P (X 1 + X 2 x) is given by (7.5) F X1 +X 2 (x) = F 1 (x u)f 2 (du) Proof. P (X 1 +X 2 x) = I u+v x P 1 P 2 (du, dv) = R 2 R R ( ) I u+v x P 1 (du) P 2 (dv) = R R F 1 (x v)p 2 (dv) Required Exercises Exercise 7.1. Suppose lim n n 2 P ( X > n) <. Prove that E X < Exercise 7.2. Suppose P ( X > n) 1/2 n for all n. Prove that there exists δ > such that Ee δ X <. Exercise 7.3. Use (7.5) to compute the cumulative distribution function for the sum of two independent uniform U(, 1) random variables. (Then differentiate to compute the density.) Exercise 7.4. Use (7.5) to compute the cumulative distribution function for the sum of two independent exponential (λ = 1) random variables. (Then differentiate to compute the density.) Exercise 7.5. Use Fubini s theorem (not tail integration formula from Theorem 6.2) to show that if X then E X = 1 P (X > t)dt (t + 1) 2 Then re-derive the same result from Theorem 6.2. Exercise 7.6. Use Fubini s theorem (not tail integration formula from Theorem 6.2) to show that if X then Ee X = 1 + Then re-derive the same result from Theorem 6.2. e t P (X > t)dt Additional Exercises Exercise 7.7. Use Fubini s Theorem to show that R (F (x + a) F (x))dx = a Exercise 7.8. Prove that for non-negative X and s > we have E(exp(sX)) = 1+s e st P (X > t)dt. Exercise 7.9. If F is continuous, prove that F (x)f (dx) = 1/2.
5 Bibliography [Billingsley] P. Billingsley, Probability and Measure IIIrd edition [Durrett] R. Durrett, Probability: Theory and Examples, Edition 4.1 (online) [Gut] A. Gut, Probability: a graduate course [Resnik] S. Resnik, A Probability Path, Birkhause 1998 [Proschan-Shaw] S M. Proschan and P. Shaw, Essential of Probability Theory for Statistitcians, CRC Press 216 [Varadhan] S.R.S. Varadhan, Probability Theory, (online pdf from 2) 135
6
7 Index L 1 metric, 11 L 2 metric, 11 L p-norm, 67 λ-system, 25 π-system, 25 σ-field, 16 σ-field generated by X, 45 distribution of a random variable, 46 Bernoulli random variables, 5 Binomial distribution, 17, 81 bivariate cumulative distribution function, 3 Bonferroni s correction, 18 Boole s inequality, 18 Borel σ-field, 45 Borel sigma-field, 16 Cantelli s inequality, 74 cardinality, 9 Cauchy distribution, 115 Cauchy-Schwarz inequality, 66 centered, 72 Central Limit Theorem, 119 characteristic function, 111 characteristic function continuity theorem, 115 Characteristic functions uniqueness, 114 Characteristic functions inversion formula, 114 Chebyshev s inequality, 65 complex numbers, 11 conjugate exponents, 68 continuity condition, 14 converge in L p, 69 converge in mean square, 69 convergence in distribution, 53, 11 converges in distribution, 125 converges in probability, 5 converges pointwise, 7 converges uniformly, 7 converges with probability one, 51 convex function, 66 copula, 56 correlation coefficient, 67 countable additivity, 14 covariance matrix, 128 cumulative distribution function, 26, 47 cylindrical sets, 32, 33 cyllindircal sets, 32 DeMorgan s law, 8 density function, 29, 82 diadic interval, 133 discrete random variable, 81 discrete random variables, 49 equal in distribution, 47 events, 13, 17 expected value, 62, 77 Exponential distribution, 82 exponential distribution, 29 Fatou s lemma, 79 field, 13 finite dimensional distributions, 32 finitely-additive probability measure, 14 Fubini s Theorem, 88 Geometric distribution, 81 Hölder s inequality, 68, 83 inclusion-exclusion, 18 independent σ-fields, 37 independent events, 37 independent identically distributed, 5 independent random variables, 48 indicator functions, 9 induced measure, 46 infinite number of tosses of a coin, 133 integrable, 77 intersection, 8 Jensen s inequality, 66 joint cumulative distribution function, 3 joint distribution of random variables, 47 Kolmogorov s maximal inequality, 93 Kolmogorov s one series theorem, 94
8 138 Index Kolmogorov s three series theorem, 95 Kolmogorov s two series theorem, 95 Kolmogorov s zero-one law, 93 Kolmogorov-Smirnov metric, 1, 11 Kronecker s Lemma, 95 Lévy distance, 17 law of X, 46 Lebesgue s dominated convergence theorem, 79, 8 Lebesgue s dominated convergence theorem used, 81, 92, 13, 116 Levy s metric, 11 Levy s theorem, 96 Lindeberg condition, 121 Lyapunov s condition, 122 Lyapunov s inequality, 66 marginal cumulative distribution functions, 3 Markov s inequality, 65 maximal inequality, Etemadi s, 96 maximal inequality,kolmogorov s, 93 mean square convergence, 84 measurable function, 45 measurable rectangle, 87 metric, 1 metric space, 1 Minkowki s inequality, 67 Minkowski s inequality, 83 moment generating function, 64, 85 moments, 63 Monotone Convergence Theorem, 77 multivariate normal, 127 multivariate normal distribution, 128 multivariate random variable, 45 Skorohod s theorem, 13 Slutsky s Theorem, 12 Standard normal density, 82 stochastic process with continuous trajectories, 47 stochastic processes, 46 stochastically bounded, 57 symmetric distribution, 98 tail σ-field, 38 Tail integration formula, 89 Taylor polynomials, 19 tight, 57 tight probability measure, 19 Tonelli s theorem, 88 total variation metric, 11 truncation of r.v., 56 uncorrelated, 72 uniform continuous, 28 Uniform density, 82 uniform discrete, 28 uniform singular, 28 uniformly integrable, 8, 15 union, 8 variance, 64 Waserstein distance, 11 weak convergence, 53 weak law of large numbers, 72 zero-one law, 38, 93 negative binomial distribution, 18 normal distribution, 29 Poisson distribution, 18, 81 Polya s distribution, 18 Portmanteau Theorem, 13 power set, 7 probability, 13 probability measure, 14 probability space, 13, 17 product measure, 88 quantile function, 48, 13 random element, 45 random variable, 45 random vector, 45 sample space, 13 Scheffe s theorem, 11 section, 87 semi-algebra, 15 semi-ring, 15 sigma-field generated by A, 16 simple random variable, 61 simple random variables, 49
STAT 7032 Probability. Wlodek Bryc
STAT 7032 Probability Wlodek Bryc Revised for Spring 2019 Printed: January 14, 2019 File: Grad-Prob-2019.TEX Department of Mathematical Sciences, University of Cincinnati, Cincinnati, OH 45221 E-mail address:
More informationTheorem 2.1 (Caratheodory). A (countably additive) probability measure on a field has an extension. n=1
Chapter 2 Probability measures 1. Existence Theorem 2.1 (Caratheodory). A (countably additive) probability measure on a field has an extension to the generated σ-field Proof of Theorem 2.1. Let F 0 be
More informationThe main results about probability measures are the following two facts:
Chapter 2 Probability measures The main results about probability measures are the following two facts: Theorem 2.1 (extension). If P is a (continuous) probability measure on a field F 0 then it has a
More informationSTAT 7032 Probability Spring Wlodek Bryc
STAT 7032 Probability Spring 2018 Wlodek Bryc Created: Friday, Jan 2, 2014 Revised for Spring 2018 Printed: January 9, 2018 File: Grad-Prob-2018.TEX Department of Mathematical Sciences, University of Cincinnati,
More informationPart II Probability and Measure
Part II Probability and Measure Theorems Based on lectures by J. Miller Notes taken by Dexter Chua Michaelmas 2016 These notes are not endorsed by the lecturers, and I have modified them (often significantly)
More informationProbability and Measure
Part II Year 2018 2017 2016 2015 2014 2013 2012 2011 2010 2009 2008 2007 2006 2005 2018 84 Paper 4, Section II 26J Let (X, A) be a measurable space. Let T : X X be a measurable map, and µ a probability
More information2 (Bonus). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?
MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due 9/5). Prove that every countable set A is measurable and µ(a) = 0. 2 (Bonus). Let A consist of points (x, y) such that either x or y is
More informationProbability Theory I: Syllabus and Exercise
Probability Theory I: Syllabus and Exercise Narn-Rueih Shieh **Copyright Reserved** This course is suitable for those who have taken Basic Probability; some knowledge of Real Analysis is recommended( will
More information3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?
MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due ). Show that the open disk x 2 + y 2 < 1 is a countable union of planar elementary sets. Show that the closed disk x 2 + y 2 1 is a countable
More informationNotation. General. Notation Description See. Sets, Functions, and Spaces. a b & a b The minimum and the maximum of a and b
Notation General Notation Description See a b & a b The minimum and the maximum of a and b a + & a f S u The non-negative part, a 0, and non-positive part, (a 0) of a R The restriction of the function
More information18.175: Lecture 3 Integration
18.175: Lecture 3 Scott Sheffield MIT Outline Outline Recall definitions Probability space is triple (Ω, F, P) where Ω is sample space, F is set of events (the σ-algebra) and P : F [0, 1] is the probability
More informationPart IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More information1.1 Review of Probability Theory
1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,
More informationSTA 711: Probability & Measure Theory Robert L. Wolpert
STA 711: Probability & Measure Theory Robert L. Wolpert 6 Independence 6.1 Independent Events A collection of events {A i } F in a probability space (Ω,F,P) is called independent if P[ i I A i ] = P[A
More informationEE514A Information Theory I Fall 2013
EE514A Information Theory I Fall 2013 K. Mohan, Prof. J. Bilmes University of Washington, Seattle Department of Electrical Engineering Fall Quarter, 2013 http://j.ee.washington.edu/~bilmes/classes/ee514a_fall_2013/
More informationWeek 2. Review of Probability, Random Variables and Univariate Distributions
Week 2 Review of Probability, Random Variables and Univariate Distributions Probability Probability Probability Motivation What use is Probability Theory? Probability models Basis for statistical inference
More informationMTH 404: Measure and Integration
MTH 404: Measure and Integration Semester 2, 2012-2013 Dr. Prahlad Vaidyanathan Contents I. Introduction....................................... 3 1. Motivation................................... 3 2. The
More informationPart IA Probability. Theorems. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Theorems Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationMATHS 730 FC Lecture Notes March 5, Introduction
1 INTRODUCTION MATHS 730 FC Lecture Notes March 5, 2014 1 Introduction Definition. If A, B are sets and there exists a bijection A B, they have the same cardinality, which we write as A, #A. If there exists
More informationNorthwestern University Department of Electrical Engineering and Computer Science
Northwestern University Department of Electrical Engineering and Computer Science EECS 454: Modeling and Analysis of Communication Networks Spring 2008 Probability Review As discussed in Lecture 1, probability
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationExpectation. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda
Expectation DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall16 Carlos Fernandez-Granda Aim Describe random variables with a few numbers: mean, variance,
More informationSTAT 712 MATHEMATICAL STATISTICS I
STAT 72 MATHEMATICAL STATISTICS I Fall 207 Lecture Notes Joshua M. Tebbs Department of Statistics University of South Carolina c by Joshua M. Tebbs TABLE OF CONTENTS Contents Probability Theory. Set Theory......................................2
More informationCourse: ESO-209 Home Work: 1 Instructor: Debasis Kundu
Home Work: 1 1. Describe the sample space when a coin is tossed (a) once, (b) three times, (c) n times, (d) an infinite number of times. 2. A coin is tossed until for the first time the same result appear
More informationMultiple Random Variables
Multiple Random Variables Joint Probability Density Let X and Y be two random variables. Their joint distribution function is F ( XY x, y) P X x Y y. F XY ( ) 1, < x
More informationReview of Probabilities and Basic Statistics
Alex Smola Barnabas Poczos TA: Ina Fiterau 4 th year PhD student MLD Review of Probabilities and Basic Statistics 10-701 Recitations 1/25/2013 Recitation 1: Statistics Intro 1 Overview Introduction to
More informationExpectation. DS GA 1002 Probability and Statistics for Data Science. Carlos Fernandez-Granda
Expectation DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Aim Describe random variables with a few numbers: mean,
More informationLarge Sample Theory. Consider a sequence of random variables Z 1, Z 2,..., Z n. Convergence in probability: Z n
Large Sample Theory In statistics, we are interested in the properties of particular random variables (or estimators ), which are functions of our data. In ymptotic analysis, we focus on describing the
More information1* (10 pts) Let X be a random variable with P (X = 1) = P (X = 1) = 1 2
Math 736-1 Homework Fall 27 1* (1 pts) Let X be a random variable with P (X = 1) = P (X = 1) = 1 2 and let Y be a standard normal random variable. Assume that X and Y are independent. Find the distribution
More informationIEOR 6711: Stochastic Models I SOLUTIONS to the First Midterm Exam, October 7, 2008
IEOR 6711: Stochastic Models I SOLUTIONS to the First Midterm Exam, October 7, 2008 Justify your answers; show your work. 1. A sequence of Events. (10 points) Let {B n : n 1} be a sequence of events in
More informationThe Central Limit Theorem: More of the Story
The Central Limit Theorem: More of the Story Steven Janke November 2015 Steven Janke (Seminar) The Central Limit Theorem:More of the Story November 2015 1 / 33 Central Limit Theorem Theorem (Central Limit
More information4 Sums of Independent Random Variables
4 Sums of Independent Random Variables Standing Assumptions: Assume throughout this section that (,F,P) is a fixed probability space and that X 1, X 2, X 3,... are independent real-valued random variables
More informationChapter 3: Random Variables 1
Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationMATH MEASURE THEORY AND FOURIER ANALYSIS. Contents
MATH 3969 - MEASURE THEORY AND FOURIER ANALYSIS ANDREW TULLOCH Contents 1. Measure Theory 2 1.1. Properties of Measures 3 1.2. Constructing σ-algebras and measures 3 1.3. Properties of the Lebesgue measure
More informationCharacteristic Functions and the Central Limit Theorem
Chapter 6 Characteristic Functions and the Central Limit Theorem 6.1 Characteristic Functions 6.1.1 Transforms and Characteristic Functions. There are several transforms or generating functions used in
More informationChapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University
Chapter 3, 4 Random Variables ENCS6161 - Probability and Stochastic Processes Concordia University ENCS6161 p.1/47 The Notion of a Random Variable A random variable X is a function that assigns a real
More informationSTAT 302 Introduction to Probability Learning Outcomes. Textbook: A First Course in Probability by Sheldon Ross, 8 th ed.
STAT 302 Introduction to Probability Learning Outcomes Textbook: A First Course in Probability by Sheldon Ross, 8 th ed. Chapter 1: Combinatorial Analysis Demonstrate the ability to solve combinatorial
More information3 Integration and Expectation
3 Integration and Expectation 3.1 Construction of the Lebesgue Integral Let (, F, µ) be a measure space (not necessarily a probability space). Our objective will be to define the Lebesgue integral R fdµ
More informationReal Analysis Notes. Thomas Goller
Real Analysis Notes Thomas Goller September 4, 2011 Contents 1 Abstract Measure Spaces 2 1.1 Basic Definitions........................... 2 1.2 Measurable Functions........................ 2 1.3 Integration..............................
More informationProbability: Handout
Probability: Handout Klaus Pötzelberger Vienna University of Economics and Business Institute for Statistics and Mathematics E-mail: Klaus.Poetzelberger@wu.ac.at Contents 1 Axioms of Probability 3 1.1
More information(1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define
Homework, Real Analysis I, Fall, 2010. (1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define ρ(f, g) = 1 0 f(x) g(x) dx. Show that
More informationContinuous Random Variables
1 / 24 Continuous Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 27, 2013 2 / 24 Continuous Random Variables
More informationChapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory
Chapter 1 Statistical Reasoning Why statistics? Uncertainty of nature (weather, earth movement, etc. ) Uncertainty in observation/sampling/measurement Variability of human operation/error imperfection
More informationStochastic Processes. Winter Term Paolo Di Tella Technische Universität Dresden Institut für Stochastik
Stochastic Processes Winter Term 2016-2017 Paolo Di Tella Technische Universität Dresden Institut für Stochastik Contents 1 Preliminaries 5 1.1 Uniform integrability.............................. 5 1.2
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationReview (Probability & Linear Algebra)
Review (Probability & Linear Algebra) CE-725 : Statistical Pattern Recognition Sharif University of Technology Spring 2013 M. Soleymani Outline Axioms of probability theory Conditional probability, Joint
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationMath 416 Lecture 3. The average or mean or expected value of x 1, x 2, x 3,..., x n is
Math 416 Lecture 3 Expected values The average or mean or expected value of x 1, x 2, x 3,..., x n is x 1 x 2... x n n x 1 1 n x 2 1 n... x n 1 n 1 n x i p x i where p x i 1 n is the probability of x i
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More informationChapter 1. Sets and probability. 1.3 Probability space
Random processes - Chapter 1. Sets and probability 1 Random processes Chapter 1. Sets and probability 1.3 Probability space 1.3 Probability space Random processes - Chapter 1. Sets and probability 2 Probability
More informationHILBERT SPACES AND THE RADON-NIKODYM THEOREM. where the bar in the first equation denotes complex conjugation. In either case, for any x V define
HILBERT SPACES AND THE RADON-NIKODYM THEOREM STEVEN P. LALLEY 1. DEFINITIONS Definition 1. A real inner product space is a real vector space V together with a symmetric, bilinear, positive-definite mapping,
More informationSummary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016
8. For any two events E and F, P (E) = P (E F ) + P (E F c ). Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 Sample space. A sample space consists of a underlying
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More information6. Brownian Motion. Q(A) = P [ ω : x(, ω) A )
6. Brownian Motion. stochastic process can be thought of in one of many equivalent ways. We can begin with an underlying probability space (Ω, Σ, P) and a real valued stochastic process can be defined
More informationHomework 11. Solutions
Homework 11. Solutions Problem 2.3.2. Let f n : R R be 1/n times the characteristic function of the interval (0, n). Show that f n 0 uniformly and f n µ L = 1. Why isn t it a counterexample to the Lebesgue
More informationMATH 6605: SUMMARY LECTURE NOTES
MATH 6605: SUMMARY LECTURE NOTES These notes summarize the lectures on weak convergence of stochastic processes. If you see any typos, please let me know. 1. Construction of Stochastic rocesses A stochastic
More informationChapter 3: Random Variables 1
Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationBASICS OF PROBABILITY
October 10, 2018 BASICS OF PROBABILITY Randomness, sample space and probability Probability is concerned with random experiments. That is, an experiment, the outcome of which cannot be predicted with certainty,
More informationMidterm Examination. STA 205: Probability and Measure Theory. Wednesday, 2009 Mar 18, 2:50-4:05 pm
Midterm Examination STA 205: Probability and Measure Theory Wednesday, 2009 Mar 18, 2:50-4:05 pm This is a closed-book examination. You may use a single sheet of prepared notes, if you wish, but you may
More informationLebesgue Integration on R n
Lebesgue Integration on R n The treatment here is based loosely on that of Jones, Lebesgue Integration on Euclidean Space We give an overview from the perspective of a user of the theory Riemann integration
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationI. ANALYSIS; PROBABILITY
ma414l1.tex Lecture 1. 12.1.2012 I. NLYSIS; PROBBILITY 1. Lebesgue Measure and Integral We recall Lebesgue measure (M411 Probability and Measure) λ: defined on intervals (a, b] by λ((a, b]) := b a (so
More informationExercises. T 2T. e ita φ(t)dt.
Exercises. Set #. Construct an example of a sequence of probability measures P n on R which converge weakly to a probability measure P but so that the first moments m,n = xdp n do not converge to m = xdp.
More information1 Independent increments
Tel Aviv University, 2008 Brownian motion 1 1 Independent increments 1a Three convolution semigroups........... 1 1b Independent increments.............. 2 1c Continuous time................... 3 1d Bad
More informationconditional cdf, conditional pdf, total probability theorem?
6 Multiple Random Variables 6.0 INTRODUCTION scalar vs. random variable cdf, pdf transformation of a random variable conditional cdf, conditional pdf, total probability theorem expectation of a random
More information1 Probability space and random variables
1 Probability space and random variables As graduate level, we inevitably need to study probability based on measure theory. It obscures some intuitions in probability, but it also supplements our intuition,
More informationGAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM
GAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM STEVEN P. LALLEY 1. GAUSSIAN PROCESSES: DEFINITIONS AND EXAMPLES Definition 1.1. A standard (one-dimensional) Wiener process (also called Brownian motion)
More informationNotes 1 : Measure-theoretic foundations I
Notes 1 : Measure-theoretic foundations I Math 733-734: Theory of Probability Lecturer: Sebastien Roch References: [Wil91, Section 1.0-1.8, 2.1-2.3, 3.1-3.11], [Fel68, Sections 7.2, 8.1, 9.6], [Dur10,
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationNotes on Measure, Probability and Stochastic Processes. João Lopes Dias
Notes on Measure, Probability and Stochastic Processes João Lopes Dias Departamento de Matemática, ISEG, Universidade de Lisboa, Rua do Quelhas 6, 1200-781 Lisboa, Portugal E-mail address: jldias@iseg.ulisboa.pt
More informationSection 2: Classes of Sets
Section 2: Classes of Sets Notation: If A, B are subsets of X, then A \ B denotes the set difference, A \ B = {x A : x B}. A B denotes the symmetric difference. A B = (A \ B) (B \ A) = (A B) \ (A B). Remarks
More informationProbability. Lecture Notes. Adolfo J. Rumbos
Probability Lecture Notes Adolfo J. Rumbos October 20, 204 2 Contents Introduction 5. An example from statistical inference................ 5 2 Probability Spaces 9 2. Sample Spaces and σ fields.....................
More informationL p Spaces and Convexity
L p Spaces and Convexity These notes largely follow the treatments in Royden, Real Analysis, and Rudin, Real & Complex Analysis. 1. Convex functions Let I R be an interval. For I open, we say a function
More informationBrownian Motion. Chapter Stochastic Process
Chapter 1 Brownian Motion 1.1 Stochastic Process A stochastic process can be thought of in one of many equivalent ways. We can begin with an underlying probability space (Ω, Σ,P and a real valued stochastic
More informationSTAT 3610: Review of Probability Distributions
STAT 3610: Review of Probability Distributions Mark Carpenter Professor of Statistics Department of Mathematics and Statistics August 25, 2015 Support of a Random Variable Definition The support of a random
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationLecture 4: Fourier Transforms.
1 Definition. Lecture 4: Fourier Transforms. We now come to Fourier transforms, which we give in the form of a definition. First we define the spaces L 1 () and L 2 (). Definition 1.1 The space L 1 ()
More informationRS Chapter 1 Random Variables 6/5/2017. Chapter 1. Probability Theory: Introduction
Chapter 1 Probability Theory: Introduction Basic Probability General In a probability space (Ω, Σ, P), the set Ω is the set of all possible outcomes of a probability experiment. Mathematically, Ω is just
More informationProbability and Measure
Chapter 4 Probability and Measure 4.1 Introduction In this chapter we will examine probability theory from the measure theoretic perspective. The realisation that measure theory is the foundation of probability
More informationBrownian motion. Samy Tindel. Purdue University. Probability Theory 2 - MA 539
Brownian motion Samy Tindel Purdue University Probability Theory 2 - MA 539 Mostly taken from Brownian Motion and Stochastic Calculus by I. Karatzas and S. Shreve Samy T. Brownian motion Probability Theory
More information2. Variance and Higher Moments
1 of 16 7/16/2009 5:45 AM Virtual Laboratories > 4. Expected Value > 1 2 3 4 5 6 2. Variance and Higher Moments Recall that by taking the expected value of various transformations of a random variable,
More information1 Stat 605. Homework I. Due Feb. 1, 2011
The first part is homework which you need to turn in. The second part is exercises that will not be graded, but you need to turn it in together with the take-home final exam. 1 Stat 605. Homework I. Due
More informationFormulas for probability theory and linear models SF2941
Formulas for probability theory and linear models SF2941 These pages + Appendix 2 of Gut) are permitted as assistance at the exam. 11 maj 2008 Selected formulae of probability Bivariate probability Transforms
More informationReal Analysis Problems
Real Analysis Problems Cristian E. Gutiérrez September 14, 29 1 1 CONTINUITY 1 Continuity Problem 1.1 Let r n be the sequence of rational numbers and Prove that f(x) = 1. f is continuous on the irrationals.
More informationBrief Review of Probability
Maura Department of Economics and Finance Università Tor Vergata Outline 1 Distribution Functions Quantiles and Modes of a Distribution 2 Example 3 Example 4 Distributions Outline Distribution Functions
More informationLecture Notes for MA 623 Stochastic Processes. Ionut Florescu. Stevens Institute of Technology address:
Lecture Notes for MA 623 Stochastic Processes Ionut Florescu Stevens Institute of Technology E-mail address: ifloresc@stevens.edu 2000 Mathematics Subject Classification. 60Gxx Stochastic Processes Abstract.
More informationRandom variables. DS GA 1002 Probability and Statistics for Data Science.
Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities
More information1. Probability Measure and Integration Theory in a Nutshell
1. Probability Measure and Integration Theory in a Nutshell 1.1. Measurable Space and Measurable Functions Definition 1.1. A measurable space is a tuple (Ω, F) where Ω is a set and F a σ-algebra on Ω,
More informationExpectation of Random Variables
1 / 19 Expectation of Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 13, 2015 2 / 19 Expectation of Discrete
More informationProbability Models. 4. What is the definition of the expectation of a discrete random variable?
1 Probability Models The list of questions below is provided in order to help you to prepare for the test and exam. It reflects only the theoretical part of the course. You should expect the questions
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationThe random variable 1
The random variable 1 Contents 1. Definition 2. Distribution and density function 3. Specific random variables 4. Functions of one random variable 5. Mean and variance 2 The random variable A random variable
More informationarxiv: v1 [math.pr] 24 Aug 2018
On a class of norms generated by nonnegative integrable distributions arxiv:180808200v1 [mathpr] 24 Aug 2018 Michael Falk a and Gilles Stupfler b a Institute of Mathematics, University of Würzburg, Würzburg,
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 8 10/1/2008 CONTINUOUS RANDOM VARIABLES
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 8 10/1/2008 CONTINUOUS RANDOM VARIABLES Contents 1. Continuous random variables 2. Examples 3. Expected values 4. Joint distributions
More informationChapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance.
Chapter 2 Random Variable CLO2 Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance. 1 1. Introduction In Chapter 1, we introduced the concept
More informationChapter 6 Expectation and Conditional Expectation. Lectures Definition 6.1. Two random variables defined on a probability space are said to be
Chapter 6 Expectation and Conditional Expectation Lectures 24-30 In this chapter, we introduce expected value or the mean of a random variable. First we define expectation for discrete random variables
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationSUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416)
SUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416) D. ARAPURA This is a summary of the essential material covered so far. The final will be cumulative. I ve also included some review problems
More information18.175: Lecture 8 Weak laws and moment-generating/characteristic functions
18.175: Lecture 8 Weak laws and moment-generating/characteristic functions Scott Sheffield MIT 18.175 Lecture 8 1 Outline Moment generating functions Weak law of large numbers: Markov/Chebyshev approach
More information