Introduction to Empirical Processes and Semiparametric Inference Lecture 09: Stochastic Convergence, Continued
|
|
- Catherine Kelly
- 6 years ago
- Views:
Transcription
1 Introduction to Empirical Processes and Semiparametric Inference Lecture 09: Stochastic Convergence, Continued Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations Research University of North Carolina-Chapel Hill 1
2 Stochastic Convergence Today, we will discuss the following basic concepts: Spaces of Bounded Functions Other Modes of Convergence Continuous Mapping Revisited Outer Almost Sure Representation Theorem Example: The Cramér-von Mises Statistic 2
3 Spaces of Bounded Functions Now we consider stochastic processes X n with index set T. The natural metric space for weak convergence in this setting is l (T ). 3
4 A nice feature of this setting is the fact that asymptotic measurability of X n follows from asymptotic measurability of X n (t) for each t T : Lemma Let the sequence of maps X n in l (T ) be asymptotically tight. Then X n is asymptotically measurable if and only if X n (t) is asymptotically measurable for each t T. 4
5 Theorem The sequence X n converges to a tight limit in l (T ) if and only if X n is asymptotically tight and all finite-dimensional marginals converge weakly to limits. Moreover, if X n is asymptotically tight and all of its finite-dimensional marginals (X n (t 1 ),..., X n (t k )) converge weakly to the marginals (X(t 1 ),..., X(t k )) of a stochastic process X, then there is a version of X such that X n X and X resides in UC(T, ρ) for some semimetric ρ making T totally bounded. 5
6 Recall from Chapter 2: Theorem 2.1. X n converges weakly to a tight X in l (T ) if and only if: (i) For all finite {t 1,..., t k } T, the multivariate distribution of {X n (t 1 ),..., X n (t k )} converges to that of {X(t 1 ),..., X(t k )}. (ii) There exists a semimetric ρ for which T is totally bounded and { } lim lim sup P sup X n (s) X n (t) > ɛ δ 0 n s,t T with ρ(s,t)<δ = 0, for all ɛ > 0. 6
7 The proof of Theorem 2.1 (which we omit) shows that whenever X n X and X is tight, any semimetric ρ defining a σ-compact set UC(T, ρ) with pr(x UC(T, ρ)) = 1 will also result in X n being uniformly ρ-equicontinuous in probability. What is not clear at this point is the converse: that any semimetric ρ which enables uniform asymptotic equicontinuity will also define a σ-compact set UC(T, ρ ) wherein X resides with probability 1. 7
8 The following theorem settles this question: Theorem Assume X n X in l (T ), and let ρ be a semimetric making (T, ρ) totally bounded. TFAE: (i) X n is asymptotically uniformly ρ-equicontinuous in probability. (ii) pr(x UC(T, ρ)) = 1. 8
9 An interesting consequence of Theorems 2.1 and 7.19, in conjunction with Lemma 7.4, happens when X n X in l (T ) and X is a tight Gaussian process. Recall from Section 7.1 the semimetric for any p (0, ). ρ p (s, t) (E X(s) X(t) p ) 1/(p 1), 9
10 Then for any p (0, ), (T, ρ p ) is totally bounded, the sample paths of X are ρ p -continuous, and X n is asymptotically uniformly ρ p -equicontinuous in probability. While any value of p (0, ) will work, the choice p = 2 (the standard deviation metric) is often the most convenient to work with. 10
11 We now point out an equivalent but sometimes easier to work with condition for X n to be asymptotically uniformly ρ-equicontinuous in probability: Lemma Let X n be a sequence of stochastic processes indexed by T. TFAE: (i) There exists a semimetric ρ making T totally bounded and for which X n is uniformly ρ-equicontinuous in probability. (ii) For every ɛ, η > 0, there exists a finite partition T = k i=1 T i such that lim sup n P ( sup 1 i k sup s,t T i X n (s) X n (t) > ɛ ) < η. 11
12 Other Modes of Convergence Recall from Chapter 2 the following modes of convergence: convergence in probability: X n every ɛ > 0. P X if P {d(x n, X) > ɛ} 0 for outer almost sure convergence: X n as X if there exists a sequence n of measurable random variables such that d(x n, X) n and P {lim sup n n = 0} = 1. 12
13 We now introduce two additional modes of convergence which can be useful in some settings: almost uniform convergence: X n converges almost uniformly to X if, for every ɛ > 0, there exists a measurable set A such that pr(a) 1 ɛ and d(x n, X) 0 uniformly on A. almost sure convergence: X n converges almost surely to X if P ( lim n d(x n, X) = 0) = 1. 13
14 Note that an important distinction between almost sure and outer almost sure convergence is that, in the latter mode, there must exist a measurable majorant of d(x n, X) which goes to zero. This distinction is quite important because almost sure convergence does not in general imply convergence in probability when d(x n, X) is not measurable. For this reason, we do generally not use the almost sure convergence mode except rarely. 14
15 Here are key relationships among the three remaining modes: Lemma Let X n, X : Ω D be maps with X Borel measurable. Then (i) X n as X implies X n P X. (ii) X n P X if and only if every subsequence X n has a further subsequence X n such that X n as X. (iii) X n as X if and only if X n converges almost uniformly to X if and only if sup m n d(x m, X) P 0. Since almost uniform convergence and outer almost sure convergence are equivalent for sequences, we will not use the almost uniform mode much. 15
16 The next lemma describes several important relationships between weak convergence and convergence in probability. Before presenting it, we need to extend the definition of convergence in probability in the setting where the limit is a constant to allow the probability spaces involved to change with n as is already permitted for weak convergence. We denote this modified convergence X n P c, and distinguish it from the previous form of convergence in probability only by context. 16
17 Lemma Let X n, Y n : Ω n D be maps, X : Ω D be Borel measurable, and c D be a constant. Then (i) If X n X and d(x n, Y n ) P 0, then Y n X. (ii) X P n X implies X n X. (iii) X P n c if and only if X n c. 17
18 Proof. We first prove (i). Let F D be closed, and fix ɛ > 0. Then lim sup n P (Y n F ) = lim sup n lim sup n P (X F ɛ ). P (Y n F, d(x n, Y n ) ɛ) P (X n F ɛ ) The result follows by letting ɛ 0. 18
19 Now assume X n P X. Since X X, d(x, X n ) P 0 implies X n X by (i). This follows by taking in (i) X n = X and Y n = X n. Thus (ii) follows. 19
20 We now prove (iii). X n P c implies X n c by (ii). Now assume X n c, and fix ɛ > 0. 20
21 Note that P (d(x n, c) ɛ) = P (X n B(c, ɛ)), where B(c, ɛ) is the open ɛ-ball around c D. By the portmanteau theorem, lim sup n P (X n B(c, ɛ)) pr(x B(c, ɛ)) = 0. Thus X n P c since ɛ is arbitrary, and (iii) follows. 21
22 Continuous Mapping Revisited We now present a generalized continuous mapping theorem for sequences of maps g n which converge to g. For example, suppose T is high dimensional. The computational burden of computing the supremum of X n (t) over T may be reduced by choosing a finite mesh T n which closely approximates T. 22
23 Theorem 7.24 (Extended continuous mapping). Let D n D and g n : D n E satisfy the following: if x n x with x n D n for all n 1 and x D 0, then g n (x n ) g(x), where D 0 D and g : D 0 E. Let X n be maps taking values in D n, and let X be Borel measurable and separable with P (X D 0 ) = 1. Then (i) X n X implies g n (X n ) g(x). (ii) X n P X implies g n (X n ) P g(x). (iii) X n as X implies g n (X n ) as g(x). 23
24 The following alternative theorem does not require separability of X and is a supplement to Theorem 7.7: Theorem Let g : D E be continuous at all points in D 0 D, and let X be Borel measurable with P (X D 0 ) = 1. Then (i) X n P X implies g(x n ) P g(x). (ii) X n as X implies g(x n ) as g(x). 24
25 Outer Almost Sure Representation Theorem We now present a useful outer almost sure representation result for weak convergence. Such representations allow the transformation of certain weak convergence problems into problems about convergence of fixed sequences. We give an illustration of this approach in the sketch of the proof of Proposition 7.27 below. 25
26 Theorem Let X n : Ω n D be a sequence of maps, and let X be Borel measurable and separable. If X n X, then there exists a probability space ( Ω, Ã, P ) and maps X n : Ω D with (i) Xn as X ; (i) E f( X n ) = E f(x n ), for every bounded f : D R and all 1 n. Moreover, Xn can be chosen to be equal to X n φ n, for all 1 n, where the φ n : Ω Ω n are measurable and perfect maps and P n = P φ 1 n. 26
27 Recall our previous discussion about perfect maps. In the setting of the above theorem, if the X n are constructed from the perfect maps φ n, then [ f( X n )] = [f(xn )] φ n for all bounded f : D R. Thus the equivalence between X n and X n can be made much stronger than simply equivalence in law. 27
28 The following proposition can be useful in studying weak convergence of certain statistics which can be expressed as stochastic integrals. For example, the Wilcoxon and Cramér-von Mises statistics can be expressed in this way. Proposition Let X n, G n D[a, b] be stochastic processes with X n X and G n P G in D[a, b], where X has continuous sample paths, G is fixed, and G n and G have total variation bounded by K <. Then ( ) in D[a, b]. a X n (s)dg n (s) ( ) a X(s)dG(s) 28
29 Sketch of Proof. First, Slutsky s theorem and Lemma 7.23 establish that (X n, G n ) (X, G). Next, Theorem 7.26 tells us that there exists a new probability space and processes X n, X, Gn and G which have the same outer integrals for bounded functions as X n, X, G n and G, respectively, but which also satisfy ( X n, G n ) as ( X, G). 29
30 Fix ɛ > 0. By the continuity of the sample paths of X over the compact [a, b] (which can include extended reals), we have that there exists an integer 1 m < and a partition of [a, b], a = t 0 < t 1 < < t m = b, where max 1 j m sup X(s) X(t) ɛ. s,t (t j 1,t j ] 30
31 Define X m D[a, b] such that Xm (a) = X(a) and X m (t) m 1{t j 1 < t t j } X(t j ), j=1 for t (a, b]. Note that the integral of interest evaluated at t = a is zero since the set (a, a] is empty. 31
32 We now have, for any t (a, b], that t X n (s)d G n (s) a b a b t a X n (s) X(s) a t a t a X m (s) X(s) X m (s) X m (s) X(s) X(s)d G(s) d G n (s) d G n (s) { d G n (s) d G(s)} d G(s) Note that the first term 0, while the second and fourth terms are bounded by Kɛ. 32
33 By definition of Xm, the third term equals m j=1 X(t j ) (t j 1,t j ] (a,t] { d G n (s) d G(s)} 0. m X G n G Thus all four parts summed are asymptotically bounded by 2Kɛ. 33
34 Since ɛ was arbitrary, we conclude that ( ) a X n (s)d G n (s) as ( ) a X(s)d G(s). Now part (ii) of Lemma 7.23 yields that we can replace the outer almost sure convergence with week convergence. This now implies weak convergence in the original probability space, and the proof is complete. 34
35 Example: The Cramér-von Mises Statistic Let X 1,..., X n be i.i.d. real random variables with continuous distribution F and corresponding empirical process ˆF n. The Cramér-von Mises Statistic for testing the null hypothesis H 0 : F = F 0 has the form: T n = n ( ) 2 ˆFn (t) F 0 (t) d ˆFn (t). 35
36 In this case, X n = n ( ˆFn F 0 ) 2, G n = ˆF n, and [a, b] = [, ]. Standard empirical process results yield that when F = F 0 (i.e., under the null), X n X and G n P G in D[a, b], where X(t) = B 2 (F 0 (t)), B is a standard Brownian bridage, and G = F 0. Note that X has continuous sample paths and the total variation of G n and G is at most 1. 36
37 Thus all of the conditions of Proposition 7.27 are met, and thus T n 1 0 B 2 (t)dt, which is a pivotal limit. The distribution of this pivotal can be written as an infinite series which is not difficult to compute (see, e.g., Tolmatz, 2001, Annals of Probability): the critical value for α = 0.05 is approximately (I think). 37
Introduction to Empirical Processes and Semiparametric Inference Lecture 08: Stochastic Convergence
Introduction to Empirical Processes and Semiparametric Inference Lecture 08: Stochastic Convergence Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations
More informationIntroduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued
Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations Research
More informationIntroduction to Empirical Processes and Semiparametric Inference Lecture 12: Glivenko-Cantelli and Donsker Results
Introduction to Empirical Processes and Semiparametric Inference Lecture 12: Glivenko-Cantelli and Donsker Results Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics
More informationEmpirical Processes: General Weak Convergence Theory
Empirical Processes: General Weak Convergence Theory Moulinath Banerjee May 18, 2010 1 Extended Weak Convergence The lack of measurability of the empirical process with respect to the sigma-field generated
More informationIntroduction to Empirical Processes and Semiparametric Inference Lecture 13: Entropy Calculations
Introduction to Empirical Processes and Semiparametric Inference Lecture 13: Entropy Calculations Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations Research
More informationTheoretical Statistics. Lecture 17.
Theoretical Statistics. Lecture 17. Peter Bartlett 1. Asymptotic normality of Z-estimators: classical conditions. 2. Asymptotic equicontinuity. 1 Recall: Delta method Theorem: Supposeφ : R k R m is differentiable
More informationMATH 6605: SUMMARY LECTURE NOTES
MATH 6605: SUMMARY LECTURE NOTES These notes summarize the lectures on weak convergence of stochastic processes. If you see any typos, please let me know. 1. Construction of Stochastic rocesses A stochastic
More informationHomework # , Spring Due 14 May Convergence of the empirical CDF, uniform samples
Homework #3 36-754, Spring 27 Due 14 May 27 1 Convergence of the empirical CDF, uniform samples In this problem and the next, X i are IID samples on the real line, with cumulative distribution function
More informationWeak convergence and Brownian Motion. (telegram style notes) P.J.C. Spreij
Weak convergence and Brownian Motion (telegram style notes) P.J.C. Spreij this version: December 8, 2006 1 The space C[0, ) In this section we summarize some facts concerning the space C[0, ) of real
More informationConvergence of Feller Processes
Chapter 15 Convergence of Feller Processes This chapter looks at the convergence of sequences of Feller processes to a iting process. Section 15.1 lays some ground work concerning weak convergence of processes
More information1 Weak Convergence in R k
1 Weak Convergence in R k Byeong U. Park 1 Let X and X n, n 1, be random vectors taking values in R k. These random vectors are allowed to be defined on different probability spaces. Below, for the simplicity
More informationMeasure and Integration: Solutions of CW2
Measure and Integration: s of CW2 Fall 206 [G. Holzegel] December 9, 206 Problem of Sheet 5 a) Left (f n ) and (g n ) be sequences of integrable functions with f n (x) f (x) and g n (x) g (x) for almost
More informationIntroduction to Empirical Processes and Semiparametric Inference Lecture 22: Preliminaries for Semiparametric Inference
Introduction to Empirical Processes and Semiparametric Inference Lecture 22: Preliminaries for Semiparametric Inference Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics
More informationLecture Notes on Metric Spaces
Lecture Notes on Metric Spaces Math 117: Summer 2007 John Douglas Moore Our goal of these notes is to explain a few facts regarding metric spaces not included in the first few chapters of the text [1],
More informationSDS : Theoretical Statistics
SDS 384 11: Theoretical Statistics Lecture 1: Introduction Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin https://psarkar.github.io/teaching Manegerial Stuff
More informationChapter 5. Weak convergence
Chapter 5 Weak convergence We will see later that if the X i are i.i.d. with mean zero and variance one, then S n / p n converges in the sense P(S n / p n 2 [a, b])! P(Z 2 [a, b]), where Z is a standard
More informationLecture 2: Convergence of Random Variables
Lecture 2: Convergence of Random Variables Hyang-Won Lee Dept. of Internet & Multimedia Eng. Konkuk University Lecture 2 Introduction to Stochastic Processes, Fall 2013 1 / 9 Convergence of Random Variables
More information7 Complete metric spaces and function spaces
7 Complete metric spaces and function spaces 7.1 Completeness Let (X, d) be a metric space. Definition 7.1. A sequence (x n ) n N in X is a Cauchy sequence if for any ɛ > 0, there is N N such that n, m
More information1 Topology Definition of a topology Basis (Base) of a topology The subspace topology & the product topology on X Y 3
Index Page 1 Topology 2 1.1 Definition of a topology 2 1.2 Basis (Base) of a topology 2 1.3 The subspace topology & the product topology on X Y 3 1.4 Basic topology concepts: limit points, closed sets,
More informationMath 328 Course Notes
Math 328 Course Notes Ian Robertson March 3, 2006 3 Properties of C[0, 1]: Sup-norm and Completeness In this chapter we are going to examine the vector space of all continuous functions defined on the
More informationAnalysis III. Exam 1
Analysis III Math 414 Spring 27 Professor Ben Richert Exam 1 Solutions Problem 1 Let X be the set of all continuous real valued functions on [, 1], and let ρ : X X R be the function ρ(f, g) = sup f g (1)
More informationd(x n, x) d(x n, x nk ) + d(x nk, x) where we chose any fixed k > N
Problem 1. Let f : A R R have the property that for every x A, there exists ɛ > 0 such that f(t) > ɛ if t (x ɛ, x + ɛ) A. If the set A is compact, prove there exists c > 0 such that f(x) > c for all x
More informationMath 117: Infinite Sequences
Math 7: Infinite Sequences John Douglas Moore November, 008 The three main theorems in the theory of infinite sequences are the Monotone Convergence Theorem, the Cauchy Sequence Theorem and the Subsequence
More informationconverges as well if x < 1. 1 x n x n 1 1 = 2 a nx n
Solve the following 6 problems. 1. Prove that if series n=1 a nx n converges for all x such that x < 1, then the series n=1 a n xn 1 x converges as well if x < 1. n For x < 1, x n 0 as n, so there exists
More informationis a Borel subset of S Θ for each c R (Bertsekas and Shreve, 1978, Proposition 7.36) This always holds in practical applications.
Stat 811 Lecture Notes The Wald Consistency Theorem Charles J. Geyer April 9, 01 1 Analyticity Assumptions Let { f θ : θ Θ } be a family of subprobability densities 1 with respect to a measure µ on a measurable
More informationDraft. Advanced Probability Theory (Fall 2017) J.P.Kim Dept. of Statistics. Finally modified at November 28, 2017
Fall 207 Dept. of Statistics Finally modified at November 28, 207 Preface & Disclaimer This note is a summary of the lecture Advanced Probability Theory 326.729A held at Seoul National University, Fall
More informationMore Empirical Process Theory
More Empirical Process heory 4.384 ime Series Analysis, Fall 2008 Recitation by Paul Schrimpf Supplementary to lectures given by Anna Mikusheva October 24, 2008 Recitation 8 More Empirical Process heory
More informationChapter 6. Convergence. Probability Theory. Four different convergence concepts. Four different convergence concepts. Convergence in probability
Probability Theory Chapter 6 Convergence Four different convergence concepts Let X 1, X 2, be a sequence of (usually dependent) random variables Definition 1.1. X n converges almost surely (a.s.), or with
More informationMetric Spaces. Exercises Fall 2017 Lecturer: Viveka Erlandsson. Written by M.van den Berg
Metric Spaces Exercises Fall 2017 Lecturer: Viveka Erlandsson Written by M.van den Berg School of Mathematics University of Bristol BS8 1TW Bristol, UK 1 Exercises. 1. Let X be a non-empty set, and suppose
More informationANALYSIS WORKSHEET II: METRIC SPACES
ANALYSIS WORKSHEET II: METRIC SPACES Definition 1. A metric space (X, d) is a space X of objects (called points), together with a distance function or metric d : X X [0, ), which associates to each pair
More informationThe Heine-Borel and Arzela-Ascoli Theorems
The Heine-Borel and Arzela-Ascoli Theorems David Jekel October 29, 2016 This paper explains two important results about compactness, the Heine- Borel theorem and the Arzela-Ascoli theorem. We prove them
More informationMaths 212: Homework Solutions
Maths 212: Homework Solutions 1. The definition of A ensures that x π for all x A, so π is an upper bound of A. To show it is the least upper bound, suppose x < π and consider two cases. If x < 1, then
More informationBrownian Motion. 1 Definition Brownian Motion Wiener measure... 3
Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................
More informationREAL AND COMPLEX ANALYSIS
REAL AND COMPLE ANALYSIS Third Edition Walter Rudin Professor of Mathematics University of Wisconsin, Madison Version 1.1 No rights reserved. Any part of this work can be reproduced or transmitted in any
More informationDefinition 6.1. A metric space (X, d) is complete if every Cauchy sequence tends to a limit in X.
Chapter 6 Completeness Lecture 18 Recall from Definition 2.22 that a Cauchy sequence in (X, d) is a sequence whose terms get closer and closer together, without any limit being specified. In the Euclidean
More informationAsymptotic Statistics-VI. Changliang Zou
Asymptotic Statistics-VI Changliang Zou Kolmogorov-Smirnov distance Example (Kolmogorov-Smirnov confidence intervals) We know given α (0, 1), there is a well-defined d = d α,n such that, for any continuous
More informationFall f(x)g(x) dx. The starting place for the theory of Fourier series is that the family of functions {e inx } n= is orthonormal, that is
18.103 Fall 2013 1. Fourier Series, Part 1. We will consider several function spaces during our study of Fourier series. When we talk about L p ((, π)), it will be convenient to include the factor 1/ in
More informationTHE INVERSE FUNCTION THEOREM
THE INVERSE FUNCTION THEOREM W. PATRICK HOOPER The implicit function theorem is the following result: Theorem 1. Let f be a C 1 function from a neighborhood of a point a R n into R n. Suppose A = Df(a)
More informationSTAT Sample Problem: General Asymptotic Results
STAT331 1-Sample Problem: General Asymptotic Results In this unit we will consider the 1-sample problem and prove the consistency and asymptotic normality of the Nelson-Aalen estimator of the cumulative
More informationTheoretical Statistics. Lecture 1.
1. Organizational issues. 2. Overview. 3. Stochastic convergence. Theoretical Statistics. Lecture 1. eter Bartlett 1 Organizational Issues Lectures: Tue/Thu 11am 12:30pm, 332 Evans. eter Bartlett. bartlett@stat.
More informationSOME CONVERSE LIMIT THEOREMS FOR EXCHANGEABLE BOOTSTRAPS
SOME CONVERSE LIMIT THEOREMS OR EXCHANGEABLE BOOTSTRAPS Jon A. Wellner University of Washington The bootstrap Glivenko-Cantelli and bootstrap Donsker theorems of Giné and Zinn (990) contain both necessary
More informationFiltrations, Markov Processes and Martingales. Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition
Filtrations, Markov Processes and Martingales Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition David pplebaum Probability and Statistics Department,
More informationConsequences of Continuity
Consequences of Continuity James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University October 4, 2017 Outline 1 Domains of Continuous Functions 2 The
More informationStat 8112 Lecture Notes Weak Convergence in Metric Spaces Charles J. Geyer January 23, Metric Spaces
Stat 8112 Lecture Notes Weak Convergence in Metric Spaces Charles J. Geyer January 23, 2013 1 Metric Spaces Let X be an arbitrary set. A function d : X X R is called a metric if it satisfies the folloing
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More information1 The Glivenko-Cantelli Theorem
1 The Glivenko-Cantelli Theorem Let X i, i = 1,..., n be an i.i.d. sequence of random variables with distribution function F on R. The empirical distribution function is the function of x defined by ˆF
More informationWeak convergence. Amsterdam, 13 November Leiden University. Limit theorems. Shota Gugushvili. Generalities. Criteria
Weak Leiden University Amsterdam, 13 November 2013 Outline 1 2 3 4 5 6 7 Definition Definition Let µ, µ 1, µ 2,... be probability measures on (R, B). It is said that µ n converges weakly to µ, and we then
More informationProbability and Measure
Probability and Measure Robert L. Wolpert Institute of Statistics and Decision Sciences Duke University, Durham, NC, USA Convergence of Random Variables 1. Convergence Concepts 1.1. Convergence of Real
More informationSUMMARY OF RESULTS ON PATH SPACES AND CONVERGENCE IN DISTRIBUTION FOR STOCHASTIC PROCESSES
SUMMARY OF RESULTS ON PATH SPACES AND CONVERGENCE IN DISTRIBUTION FOR STOCHASTIC PROCESSES RUTH J. WILLIAMS October 2, 2017 Department of Mathematics, University of California, San Diego, 9500 Gilman Drive,
More informationMATH 51H Section 4. October 16, Recall what it means for a function between metric spaces to be continuous:
MATH 51H Section 4 October 16, 2015 1 Continuity Recall what it means for a function between metric spaces to be continuous: Definition. Let (X, d X ), (Y, d Y ) be metric spaces. A function f : X Y is
More informationElementary Analysis Math 140D Fall 2007
Elementary Analysis Math 140D Fall 2007 Bernard Russo Contents 1 Friday September 28, 2007 1 1.1 Course information............................ 1 1.2 Outline of the course........................... 1
More informationStochastic Convergence, Delta Method & Moment Estimators
Stochastic Convergence, Delta Method & Moment Estimators Seminar on Asymptotic Statistics Daniel Hoffmann University of Kaiserslautern Department of Mathematics February 13, 2015 Daniel Hoffmann (TU KL)
More informationn E(X t T n = lim X s Tn = X s
Stochastic Calculus Example sheet - Lent 15 Michael Tehranchi Problem 1. Let X be a local martingale. Prove that X is a uniformly integrable martingale if and only X is of class D. Solution 1. If If direction:
More informationProblem set 1, Real Analysis I, Spring, 2015.
Problem set 1, Real Analysis I, Spring, 015. (1) Let f n : D R be a sequence of functions with domain D R n. Recall that f n f uniformly if and only if for all ɛ > 0, there is an N = N(ɛ) so that if n
More informationExercises from other sources REAL NUMBERS 2,...,
Exercises from other sources REAL NUMBERS 1. Find the supremum and infimum of the following sets: a) {1, b) c) 12, 13, 14, }, { 1 3, 4 9, 13 27, 40 } 81,, { 2, 2 + 2, 2 + 2 + } 2,..., d) {n N : n 2 < 10},
More informationMost Continuous Functions are Nowhere Differentiable
Most Continuous Functions are Nowhere Differentiable Spring 2004 The Space of Continuous Functions Let K = [0, 1] and let C(K) be the set of all continuous functions f : K R. Definition 1 For f C(K) we
More informationWeek 5 Lectures 13-15
Week 5 Lectures 13-15 Lecture 13 Definition 29 Let Y be a subset X. A subset A Y is open in Y if there exists an open set U in X such that A = U Y. It is not difficult to show that the collection of all
More informationSerena Doria. Department of Sciences, University G.d Annunzio, Via dei Vestini, 31, Chieti, Italy. Received 7 July 2008; Revised 25 December 2008
Journal of Uncertain Systems Vol.4, No.1, pp.73-80, 2010 Online at: www.jus.org.uk Different Types of Convergence for Random Variables with Respect to Separately Coherent Upper Conditional Probabilities
More informationMath 209B Homework 2
Math 29B Homework 2 Edward Burkard Note: All vector spaces are over the field F = R or C 4.6. Two Compactness Theorems. 4. Point Set Topology Exercise 6 The product of countably many sequentally compact
More informationREAL VARIABLES: PROBLEM SET 1. = x limsup E k
REAL VARIABLES: PROBLEM SET 1 BEN ELDER 1. Problem 1.1a First let s prove that limsup E k consists of those points which belong to infinitely many E k. From equation 1.1: limsup E k = E k For limsup E
More information9 Sequences of Functions
9 Sequences of Functions 9.1 Pointwise convergence and uniform convergence Let D R d, and let f n : D R be functions (n N). We may think of the functions f 1, f 2, f 3,... as forming a sequence of functions.
More informationSTAT 7032 Probability Spring Wlodek Bryc
STAT 7032 Probability Spring 2018 Wlodek Bryc Created: Friday, Jan 2, 2014 Revised for Spring 2018 Printed: January 9, 2018 File: Grad-Prob-2018.TEX Department of Mathematical Sciences, University of Cincinnati,
More informationEconomics 204 Fall 2011 Problem Set 2 Suggested Solutions
Economics 24 Fall 211 Problem Set 2 Suggested Solutions 1. Determine whether the following sets are open, closed, both or neither under the topology induced by the usual metric. (Hint: think about limit
More informationANALYSIS QUALIFYING EXAM FALL 2016: SOLUTIONS. = lim. F n
ANALYSIS QUALIFYING EXAM FALL 206: SOLUTIONS Problem. Let m be Lebesgue measure on R. For a subset E R and r (0, ), define E r = { x R: dist(x, E) < r}. Let E R be compact. Prove that m(e) = lim m(e /n).
More informationThe main results about probability measures are the following two facts:
Chapter 2 Probability measures The main results about probability measures are the following two facts: Theorem 2.1 (extension). If P is a (continuous) probability measure on a field F 0 then it has a
More information1 Glivenko-Cantelli type theorems
STA79 Lecture Spring Semester Glivenko-Cantelli type theorems Given i.i.d. observations X,..., X n with unknown distribution function F (t, consider the empirical (sample CDF ˆF n (t = I [Xi t]. n Then
More informationJae Gil Choi and Young Seo Park
Kangweon-Kyungki Math. Jour. 11 (23), No. 1, pp. 17 3 TRANSLATION THEOREM ON FUNCTION SPACE Jae Gil Choi and Young Seo Park Abstract. In this paper, we use a generalized Brownian motion process to define
More informationEconomics 620, Lecture 8: Asymptotics I
Economics 620, Lecture 8: Asymptotics I Nicholas M. Kiefer Cornell University Professor N. M. Kiefer (Cornell University) Lecture 8: Asymptotics I 1 / 17 We are interested in the properties of estimators
More informationProbability Models of Information Exchange on Networks Lecture 5
Probability Models of Information Exchange on Networks Lecture 5 Elchanan Mossel (UC Berkeley) July 25, 2013 1 / 22 Informational Framework Each agent receives a private signal X i which depends on S.
More information4 Countability axioms
4 COUNTABILITY AXIOMS 4 Countability axioms Definition 4.1. Let X be a topological space X is said to be first countable if for any x X, there is a countable basis for the neighborhoods of x. X is said
More informationRandom Process Lecture 1. Fundamentals of Probability
Random Process Lecture 1. Fundamentals of Probability Husheng Li Min Kao Department of Electrical Engineering and Computer Science University of Tennessee, Knoxville Spring, 2016 1/43 Outline 2/43 1 Syllabus
More informationLarge Sample Theory. Consider a sequence of random variables Z 1, Z 2,..., Z n. Convergence in probability: Z n
Large Sample Theory In statistics, we are interested in the properties of particular random variables (or estimators ), which are functions of our data. In ymptotic analysis, we focus on describing the
More informationStochastic Differential Equations.
Chapter 3 Stochastic Differential Equations. 3.1 Existence and Uniqueness. One of the ways of constructing a Diffusion process is to solve the stochastic differential equation dx(t) = σ(t, x(t)) dβ(t)
More informationLarge Deviations for Small-Noise Stochastic Differential Equations
Chapter 22 Large Deviations for Small-Noise Stochastic Differential Equations This lecture is at once the end of our main consideration of diffusions and stochastic calculus, and a first taste of large
More informationFilters in Analysis and Topology
Filters in Analysis and Topology David MacIver July 1, 2004 Abstract The study of filters is a very natural way to talk about convergence in an arbitrary topological space, and carries over nicely into
More informationIntroduction to Topology
Introduction to Topology Randall R. Holmes Auburn University Typeset by AMS-TEX Chapter 1. Metric Spaces 1. Definition and Examples. As the course progresses we will need to review some basic notions about
More informationLarge Deviations for Small-Noise Stochastic Differential Equations
Chapter 21 Large Deviations for Small-Noise Stochastic Differential Equations This lecture is at once the end of our main consideration of diffusions and stochastic calculus, and a first taste of large
More informationTheorem 2.1 (Caratheodory). A (countably additive) probability measure on a field has an extension. n=1
Chapter 2 Probability measures 1. Existence Theorem 2.1 (Caratheodory). A (countably additive) probability measure on a field has an extension to the generated σ-field Proof of Theorem 2.1. Let F 0 be
More informationbe the set of complex valued 2π-periodic functions f on R such that
. Fourier series. Definition.. Given a real number P, we say a complex valued function f on R is P -periodic if f(x + P ) f(x) for all x R. We let be the set of complex valued -periodic functions f on
More informationCHAPTER 9. Embedding theorems
CHAPTER 9 Embedding theorems In this chapter we will describe a general method for attacking embedding problems. We will establish several results but, as the main final result, we state here the following:
More information7 Convergence in R d and in Metric Spaces
STA 711: Probability & Measure Theory Robert L. Wolpert 7 Convergence in R d and in Metric Spaces A sequence of elements a n of R d converges to a limit a if and only if, for each ǫ > 0, the sequence a
More informationMath 118B Solutions. Charles Martin. March 6, d i (x i, y i ) + d i (y i, z i ) = d(x, y) + d(y, z). i=1
Math 8B Solutions Charles Martin March 6, Homework Problems. Let (X i, d i ), i n, be finitely many metric spaces. Construct a metric on the product space X = X X n. Proof. Denote points in X as x = (x,
More informationConvergence Concepts of Random Variables and Functions
Convergence Concepts of Random Variables and Functions c 2002 2007, Professor Seppo Pynnonen, Department of Mathematics and Statistics, University of Vaasa Version: January 5, 2007 Convergence Modes Convergence
More informationConsequences of Continuity
Consequences of Continuity James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University October 4, 2017 Outline Domains of Continuous Functions The Intermediate
More informationMetric Spaces and Topology
Chapter 2 Metric Spaces and Topology From an engineering perspective, the most important way to construct a topology on a set is to define the topology in terms of a metric on the set. This approach underlies
More informationAnalysis III Theorems, Propositions & Lemmas... Oh My!
Analysis III Theorems, Propositions & Lemmas... Oh My! Rob Gibson October 25, 2010 Proposition 1. If x = (x 1, x 2,...), y = (y 1, y 2,...), then is a distance. ( d(x, y) = x k y k p Proposition 2. In
More informationExtremogram and ex-periodogram for heavy-tailed time series
Extremogram and ex-periodogram for heavy-tailed time series 1 Thomas Mikosch University of Copenhagen Joint work with Richard A. Davis (Columbia) and Yuwei Zhao (Ulm) 1 Zagreb, June 6, 2014 1 2 Extremal
More informationGeometric inference for measures based on distance functions The DTM-signature for a geometric comparison of metric-measure spaces from samples
Distance to Geometric inference for measures based on distance functions The - for a geometric comparison of metric-measure spaces from samples the Ohio State University wan.252@osu.edu 1/31 Geometric
More informationDISTRIBUTION OF EIGENVALUES OF REAL SYMMETRIC PALINDROMIC TOEPLITZ MATRICES AND CIRCULANT MATRICES
DISTRIBUTION OF EIGENVALUES OF REAL SYMMETRIC PALINDROMIC TOEPLITZ MATRICES AND CIRCULANT MATRICES ADAM MASSEY, STEVEN J. MILLER, AND JOHN SINSHEIMER Abstract. Consider the ensemble of real symmetric Toeplitz
More informationLarge Deviations for Weakly Dependent Sequences: The Gärtner-Ellis Theorem
Chapter 34 Large Deviations for Weakly Dependent Sequences: The Gärtner-Ellis Theorem This chapter proves the Gärtner-Ellis theorem, establishing an LDP for not-too-dependent processes taking values in
More informationCourse 212: Academic Year Section 1: Metric Spaces
Course 212: Academic Year 1991-2 Section 1: Metric Spaces D. R. Wilkins Contents 1 Metric Spaces 3 1.1 Distance Functions and Metric Spaces............. 3 1.2 Convergence and Continuity in Metric Spaces.........
More informationIndividual confidence intervals for true solutions to stochastic variational inequalities
. manuscript o. 2will be inserted by the editor Michael Lamm et al. Individual confidence intervals for true solutions to stochastic variational inequalities Michael Lamm Shu Lu Amarjit Budhiraja. Received:
More informationGeneral Theory of Large Deviations
Chapter 30 General Theory of Large Deviations A family of random variables follows the large deviations principle if the probability of the variables falling into bad sets, representing large deviations
More informationThe Arzelà-Ascoli Theorem
John Nachbar Washington University March 27, 2016 The Arzelà-Ascoli Theorem The Arzelà-Ascoli Theorem gives sufficient conditions for compactness in certain function spaces. Among other things, it helps
More informationLecture 2: A crash course in Real Analysis
EE5110: Probability Foundations for Electrical Engineers July-November 2015 Lecture 2: A crash course in Real Analysis Lecturer: Dr. Krishna Jagannathan Scribe: Sudharsan Parthasarathy This lecture is
More informationLecture 2: CDF and EDF
STAT 425: Introduction to Nonparametric Statistics Winter 2018 Instructor: Yen-Chi Chen Lecture 2: CDF and EDF 2.1 CDF: Cumulative Distribution Function For a random variable X, its CDF F () contains all
More informationL p Functions. Given a measure space (X, µ) and a real number p [1, ), recall that the L p -norm of a measurable function f : X R is defined by
L p Functions Given a measure space (, µ) and a real number p [, ), recall that the L p -norm of a measurable function f : R is defined by f p = ( ) /p f p dµ Note that the L p -norm of a function f may
More informationProblem List MATH 5143 Fall, 2013
Problem List MATH 5143 Fall, 2013 On any problem you may use the result of any previous problem (even if you were not able to do it) and any information given in class up to the moment the problem was
More informationMcGill University Math 354: Honors Analysis 3
Practice problems McGill University Math 354: Honors Analysis 3 not for credit Problem 1. Determine whether the family of F = {f n } functions f n (x) = x n is uniformly equicontinuous. 1st Solution: The
More information1 Definition of the Riemann integral
MAT337H1, Introduction to Real Analysis: notes on Riemann integration 1 Definition of the Riemann integral Definition 1.1. Let [a, b] R be a closed interval. A partition P of [a, b] is a finite set of
More information