Probability Theory. Exercise Sheet 4. ETH Zurich HS 2017

Similar documents
f(1), and so, if f is continuous, f(x) = f(1)x.

Lecture 10: Bounded Linear Operators and Orthogonality in Hilbert Spaces

7.1 Convergence of sequences of random variables

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

Singular Continuous Measures by Michael Pejic 5/14/10

MATH301 Real Analysis (2008 Fall) Tutorial Note #7. k=1 f k (x) converges pointwise to S(x) on E if and

A PROBABILITY PROBLEM

MATH 413 FINAL EXAM. f(x) f(y) M x y. x + 1 n

HOMEWORK #4 - MA 504

7.1 Convergence of sequences of random variables

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1

1+x 1 + α+x. x = 2(α x2 ) 1+x

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number

Jacobi symbols. p 1. Note: The Jacobi symbol does not necessarily distinguish between quadratic residues and nonresidues. That is, we could have ( a

ECE 901 Lecture 4: Estimation of Lipschitz smooth functions

MATH 312 Midterm I(Spring 2015)

1.2 AXIOMATIC APPROACH TO PROBABILITY AND PROPERTIES OF PROBABILITY MEASURE 1.2 AXIOMATIC APPROACH TO PROBABILITY AND

Fall 2013 MTH431/531 Real analysis Section Notes

Stanford Statistics 311/Electrical Engineering 377

Measure and Measurable Functions

MATH 31B: MIDTERM 2 REVIEW

Queueing Theory II. Summary. M/M/1 Output process Networks of Queue Method of Stages. General Distributions

MATH 112: HOMEWORK 6 SOLUTIONS. Problem 1: Rudin, Chapter 3, Problem s k < s k < 2 + s k+1

M17 MAT25-21 HOMEWORK 5 SOLUTIONS

REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS

LECTURE 8: ASYMPTOTICS I

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.

Sequences and Series of Functions

arxiv: v1 [math.st] 12 Dec 2018

Lecture 3 : Random variables and their distributions

Convergence of random variables. (telegram style notes) P.J.C. Spreij

MAS111 Convergence and Continuity

ANSWERS TO MIDTERM EXAM # 2

Lecture 19: Convergence

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5

Ratio of Two Random Variables: A Note on the Existence of its Moments

2 Banach spaces and Hilbert spaces

Chapter 6 Infinite Series

ST5215: Advanced Statistical Theory

Math Solutions to homework 6

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

1 Lecture 2: Sequence, Series and power series (8/14/2012)

LECTURE 21. DISCUSSION OF MIDTERM EXAM. θ [0, 2π). f(θ) = π θ 2

Math 341 Lecture #31 6.5: Power Series

Lecture Notes for Analysis Class

Probability and Random Processes

MATH4822E FOURIER ANALYSIS AND ITS APPLICATIONS

lim za n n = z lim a n n.

If a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero?

Seunghee Ye Ma 8: Week 5 Oct 28

1 Convergence in Probability and the Weak Law of Large Numbers

Solutions of Homework 2.

Lecture Chapter 6: Convergence of Random Sequences

Statistics for Applications Fall Problem Set 7

Math 61CM - Solutions to homework 3

PRELIM PROBLEM SOLUTIONS

1 Introduction. 1.1 Notation and Terminology

Exponential Functions and Taylor Series

McGill University Math 354: Honors Analysis 3 Fall 2012 Solutions to selected problems

HOMEWORK I: PREREQUISITES FROM MATH 727

Solutions for Math 411 Assignment #2 1

A Proof of Birkhoff s Ergodic Theorem

Theorem 3. A subset S of a topological space X is compact if and only if every open cover of S by open sets in X has a finite subcover.

Distribution of Random Samples & Limit theorems

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction

HOMEWORK #10 SOLUTIONS

Large Sample Theory. Convergence. Central Limit Theorems Asymptotic Distribution Delta Method. Convergence in Probability Convergence in Distribution

Introduction to Probability. Ariel Yadin

Learning Theory for Conditional Risk Minimization: Supplementary Material

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables

MATH 10550, EXAM 3 SOLUTIONS

STA Object Data Analysis - A List of Projects. January 18, 2018

Sieve Estimators: Consistency and Rates of Convergence

174. A Tauberian Theorem for (J,,fin) Summability*)

Supplementary Material

Ma 530 Infinite Series I

2.1. Convergence in distribution and characteristic functions.

Math 128A: Homework 1 Solutions

Ma 530 Introduction to Power Series

Exponential Functions and Taylor Series

Lecture Outline. 2 Separating Hyperplanes. 3 Banach Mazur Distance An Algorithmist s Toolkit October 22, 2009

5 Birkhoff s Ergodic Theorem

Lecture 15: Density estimation

University of Colorado Denver Dept. Math. & Stat. Sciences Applied Analysis Preliminary Exam 13 January 2012, 10:00 am 2:00 pm. Good luck!

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

Section 13.3 Area and the Definite Integral

Introduction to Probability. Ariel Yadin. Lecture 7

Notes 19 : Martingale CLT

Topologie. Musterlösungen

10/ Statistical Machine Learning Homework #1 Solutions

Axioms of Measure Theory

f n (x) f m (x) < ɛ/3 for all x A. By continuity of f n and f m we can find δ > 0 such that d(x, x 0 ) < δ implies that

Math 113, Calculus II Winter 2007 Final Exam Solutions

Assignment 5: Solutions

Additional Notes on Power Series

MTH 246 TEST 3 April 4, 2014

MA131 - Analysis 1. Workbook 9 Series III

FINAL EXAMINATION IN FOUNDATION OF ANALYSIS (TMA4225)

Transcription:

ETH Zurich HS 2017 D-MATH, D-PHYS Prof. A.-S. Szita Coordiator Yili Wag Probability Theory Exercise Sheet 4 Exercise 4.1 Let X ) N be a sequece of i.i.d. rado variables i a probability space Ω, A, P ). Defie the two sequeces of rado variables Y ) N ad M ) N by Y := i 1 i X i ad M := ax 1 i X i a) Let X 1 be uiforly distributed o the iterval [0, 1]. Show that Y coverges i distributio to a expoetial rado variable Z with paraeter 1, i.e., the desity of Z is e x 1 [0, ) x), x R. b) Let X 1 be expoetially distributed with paraeter 1. Show that M log coverges i distributio to a rado variable Z with Gubel distributio, i.e. the desity of Z is e x exp e x ), x R. Solutio 4.1 a) Take y R. For y < 0, because the expoetial distributio is cocetrated o [0, ), we have that P [Y y] = 0 = P [Z y] for all N. Hece without loss of geerality we assue y 0. It follows that for all y: P [Y y] = P = 1 [ Y y ] = P ] P [ X i > y { } X i y = 1 P = 1 1 y ). Now let, we hece obtai that y li P [Y y] = 1 e y = e x 1 [0, ) x) dx. { X i > y } 1 / 7

b) Take y R. The for all e y we have that: P [M log y] = P [M y + log ] = P {X i y + log } = P [X i y + log ] = }{{} =1 e y log =1 e y 1 e y ). Now let, we hece obtai that y li P [M log y] = exp e y ) = e x exp e x ) dx. 2 / 7

Exercise 4.2 a) Let X ) N be a sequece of real rado variables covergig i probability to a rado variable X. Show that X ) N coverges to X i distributio. b) The coverse does ot hold i geeral. Istead, show that if the sequece X ) N coverges i distributio to a costat rado variable X = c, the X ) N coverges i probability to c. Solutio 4.2 a) We deote the distributio fuctios of X ad X by F ad F respectively. We have to show that li F y) = F y) for cotiuity poits y of F. So, let y R be a cotiuity poit of F ad let ε > 0. By the cotiuity of F i y there is a δ > 0 such that F y) ε F x) F y) + ε, x [y δ, y + δ]. 1) Sice the X coverge to X i probability, there is a N N such that Now, for N, ad so that Thus, P [ X X > δ ] ε, N. 2) F y) = P [X y] P [{X y + δ} { X X > δ}] P [X y + δ] + P [ X X > δ] 2) F y + δ) + ε 1) F y) + 2ε F y) = P [X y] P [{X y δ} \ { X X > δ}] P [X y δ] P [ X X > δ] 2) F y δ) ε 1) F y) 2ε, F y) 2ε F y) F y) + 2ε. F y) 2ε li if F y) li sup F y) F y) + 2ε. But this holds for all ε > 0, so we are doe. b) We assue that for a c R The costat c has distributio fuctio X c i distributio. 3) F x) = 1 [c, ), 3 / 7

which is cotiuous except i c. So we kow fro 3) 0 if z < c, F z) = P [X z] 1 if z > c. 4) We wat to show that for all ε > 0 li P [ X c ε] = 0. Now, so that P [ X c ε] = P [X c ε] + P [X c + ε], li P [ X c ε] li P [X c ε] + li P [X c + ε]. By 4), we have li P [X c ε] = 0 for all ε > 0. Furtherore P [X c + ε] = 1 P [X < c + ε] 1 P [ X c + ε ]. 2 Thus, li P [X c + ε] 1 li [X P c + ε ] 4) = 0. 2 4 / 7

Exercise 4.3 a) Let f be a ot ecessarily Borel-easurable) fuctio fro R to R. Show that the set of discotiuities of f, defied as is Borel-easurable. U f := { x R f is discotiuous i x }, b) Assue that X X i distributio. Let f be easurable ad bouded, such that P [X U f ] = 0. Use 2.2.13) 2.2.14) fro the lecture otes to show that we have E[fX )] E[fX)]. c) Let f be easurable ad bouded o [0, 1], with U f of Lebesgue easure 0. Show that the correspodig Riea sus coverge to the itegral of f, i.e. Solutio 4.3 a) Let f : R R ad 1 f k=1 ) k 1 fx)dx. 0 V ɛ,δ := { x R y, z x δ, x + δ) s.t. fy) fz) ɛ }. i) Clai: V ɛ,δ is ope. Let x V ɛ,δ. The there are y, z x δ, x + δ) such that fy) fz) ɛ. We set r := δ ax { y x, z x } > 0. x x r, x+r) it holds that y x y x + x x < y x +r δ, ad siilarly for z. Fro this it follows that y, z x δ, x+δ) ad fy) fz) ɛ, which gives x V ɛ,δ. So x r, x + r) V ɛ,δ, ad the clai follows. ii) Clai: U f = V 1, 1. Let x U f. The there is a N, such that N y x 1, x + 1 ) s.t. fx) fy) 1. We assue that for soe N, x V 1, 1,. The there are y, z x 1, x + 1 ) so that fy) fz) 1. Fro this it follows that either fy) fx) 1 1 2 or fz) fx) 2 ust hold. I other words N, such that N y x 1, x + 1 ) : fy) fx) 1 2, which iplies that f is discotiuous i x. 5 / 7

Sice the V 1, 1 are ope, they are Borel easurable. Ad sice ay σ algebra is closed uder coutable uios ad itersectios, U f = V 1, 1 ust also be Borel easurable. b) By 2.2.13) 2.2.14) of the lecture otes, there exist Y d = X, ad Y d = X, such that Y Y, P -alost surely o a probability space Ω, F, P ). Of course, we also have fy ) = d fx ), ad fy ) = d fx), so that we have E[fX )] = E [fy )], ad E[fX)] = E [fy )], where we deote by E the expectatio w.r.t. P. Thus, it suffices to show that E [fy )] E [fy )]. 5) Now, sice Y Y, P -alost surely, we have a set N, with P N) = 0, such that O the other had, we have { } ω Y ω) Y ω) N = Ω. 6) {ω Y ω) Y ω)} {ω f cot. i Y ω), Y ω) Y ω)} {ω f discot. i Y ω)} {ω fy ω)) fy ω))} {ω Y ω) U f }. Cosequetly, it follows fro equatio 6) that we have {ω fy ω)) fy ω))} {ω Y ω) U f } N = Ω. But, by assuptio P Y U f ) = P X U f ) = 0 recall that Y ad X have the sae distributio). Therefore, we get fy ) fy ), P -alost surely. Fially f is a bouded fuctio, so by the Doiated Covergece Theore equatio 5) holds. c) Let λ be the Lebesgue easure o [0, 1], ad, for all a [0, 1], let δ a deote the Dirac delta easure o [0, 1]. Let X, 1, be rado variables with distributio 1 k=1 δ k. Note that E[fX )] = 1 ) k f. Let X be a uifor rado variable o [0, 1], hece it has distributio λ, ad we ote that E[fX)] = Thus, it suffices to show that we have E[fX )] 1 0 k=1 fx)λdx). E[fX)]. 7) Sice by assuptio P [X U f ] = λu f ) = 0, part b) iplies that equatio 7) is a cosequece of the followig: X d X. 8) 6 / 7

To show equatio 8), ote that for all N, 0, a < 0, [a] P [X a] =, 0 a 1, 1, 1 < a. Sice we have a 1 [a] a, we get [a] obtai, for 0 a 1, P [X a] a, for all 0 a 1. Thus, we λ[0, a]) = P [X a], which iplies equatio 8), by defiitio. Cases for a < 0 ad a > 1 are trivially verified.) Subissio deadlie: 13:15, Oct. 24. Locatio: Durig exercise class or i the tray outside of HG E 65. Office hours Präsez): Mo. ad Thu., 12:00-13:00 i HG G 32.6. Class assiget: Studets Tie & Date Roo Assistat A-Gr Tue 13-14 HG F 26.5 Yili Wag He-Lag Tue 13-14 ML H 41.1 Agelo Abächerli Laz-Sa Tue 14-15 HG F 26.5 Vicezo Igazio Sch-Zh Tue 14-15 ML H 41.1 Lukas Goo 7 / 7