F (x) = P [X x[. DF1 F is nondecreasing. DF2 F is right-continuous
|
|
- Randall Hamilton
- 6 years ago
- Views:
Transcription
1 7: /4/ TOPIC Distribution functions their inverses This section develops properties of probability distribution functions their inverses Two main topics are the so-called probability integral transformation inverse probability transformation Distribution unctions Let X be a real-valued rom variable defined on a sample space Ω The distribution function (df ) of X is the function X from R := (, ) to [, ] defined by := P [ ω Ω : X(ω) x ] P [ X x ] Here are a couple of examples which motivate Theorem below The symbol is to be read as distributed as : df of X Uniform on {, /, } x df of X Uniform on [, ] x Theorem (Properties of ) or any rom variable X, the distribution function of X has these properties: D is nondecreasing; D is right-continuous; D lim x = lim x = Moreover for each x R, D4 (x ) := lim w x, w<x (w) = P [ X < x ], D5 jump of at x := (x ) = P [ X = x ] Proof I will prove D D, leave the rest to you as Exercise = P [X x[ D is nondecreasing D is right-continuous D x y = (y): Indeed, suppose x y Then the event A := {X x} is contained in the event B := {X y}, so = P [A] P [B] (y) D x n x = (x n ) Indeed, suppose x, x, is an infinite sequence of real numbers that decrease down to x Then the events A n := {X x n } shrink down to the event A := {X x} By a property of probability measures (see (5), below), (x n ) = P [A n ] decreases down to P [A] = A special case This section discusses inverse dfs the probability integral inverse probability transformations under the simplifying assumption that the distribution function of X is continuous strictly increasing, as illustrated below: u x (u) or u (, ), let (u) be defined as in the picture, ie, (u) is the unique number ξ such that (ξ) = u By a result in analysis, (u) is continuous strictly increasing in u Consider now the rom variable (X), whose value at a sample point ω is ( X(ω) ) = P [ ω : X(ω ) X(ω) ], the probability of observing a new value for X no greater than the value X(ω) at h or < u <, we have (X) u X = ( (X) ) (u), so P [ (X) u ] = P [ X (u) ] = ( (u) ) = u () This implies that (X) is uniformly distributed over (, ): in symbols, (X) U for U Uniform(,) R
2 (): (X) U Uniform(,) () has implications for statistics, in the context of hypothesis testing Think of X as a test statistic for the simple hypothesis H that the data are distributed according to P, with the alternative A such that you ought to reject H when X is too far to the left or an observed value x of X, = P [X x] is the chance of getting a result as extreme, or more so, than the one at h In statistics, this quantity is called the p-value Small p-values argue against H ( thus in favor of A); in decision theory you reject H ( accept A) if the p-value is sufficiently small, say 5 () says that when H is in fact true, repeated tests will produce p-values that are uniformly distributed over (, ); by chance alone, you ll get a p-value less than 5 ( mistakenly reject H) about time in Now let U be a rom variable uniformly distributed over (, ) consider the rom variable (U) or x R, (U) x U = ( (U) ), so P [ (U) x ] = P [ U ] = = P [ X x ] () Since this is true for all x, (U) X have the same distribution: (U) X This result has implications for rom number generation Namely, if you can somehow generate a uniform variable U, then (U) will be distributed like X In principle this method can always be used to simulate X, but it is efficient only when is easy to compute When that s not the case, one can often get an efficient algorithm by using some result from distribution theory The transformation from X to (X) is called the probability integral transformation (PIT), whereas the transformation from U to (U) is called the inverse probability transformation (IPT) In what follows we are going to study the PIT IPT in the general case, where may be discontinuous not strictly increasing Inverse distribution functions Let be an arbitrary probability distribution function Since the graph of can have jumps flat spots, there is no true inverse to in the usual sense One can define a kind of inverse to, as follows Refer to the figure below: u u u (u ) x (u ) (u ) As a first attempt, try taking (u) to be that x such that u = This definition works for u = u, but it doesn t work for u = u, for which there is a whole range of x s such that u = As a second attempt, try taking (u) to be the smallest x such that u = This works for u = u u, but it doesn t work for u = u, since there are no x s such that u = As a third attempt, try taking (u) to be the smallest x such that u This works for u = u u u We make this the general definition: more precisely we take (u) := inf{ x R : u } () for u (, ); here inf sts for infimum, or greatest lower bound To better underst () fix u (, ) consider the set I := {x R : u } Note that: I is nonempty, because u < as x ; I is an interval extending out to +, because is nondecreasing; I has a finite left-endpoint, say ξ, because u > as x ; ξ I, because is right-continuous The last claim follows from x n := ξ + /n I for all integers n = u (x n ) for all n = u lim n (x n ) = (ξ) = ξ I 4
3 7: /4/ To summarize, I = { x R : u } is a left-closed right-semiinfinite interval (u) = ξ is its finite left endpoint This gives Theorem Let be a probability distribution function let : (, ) R be defined by (u) = inf{x R : u } The infimum here is attained: (u) is in fact the smallest x R such that u (4) Moreover, for any u (, ) x R, one has u (u) x (5) Relation (5) is called the switching formula (S) (5) has an obvious counterpart: u > (u) > x; (6) But watch out! If is changed to < throughout (5), or if > is changed to throughout (6), the resulting assertions may not hold: see Exercises 8 In these notes, when invoking (5) (6), I will always write the u-thing on the left the x-thing on the right only use the valid inequalities > The theorem below gives the main properties of To motivate them, here is the graph of (u) versus u for the on the preceding page (the scales are different, though): (u ) (u ) (u ) u u u Note that this is nondecreasing left-continuous As is the case for any nondecreasing function, (u+) := lim v u, v>u (v) (7) exists for each u 5 (): (u) = inf{ x R : u } (S): u (u) x Theorem (Properties of ) Let be a probability distribution function let be defined by () for < u < Then ID is nondecreasing; ID is left-continuous; ID lim u (u) = inf{ x R : > } lim u (u) = sup{ x R : < } ID4 for each u (, ) x R with < <, ( ( (u)) ) u ( (u) ), (8) ( ) x ( ()+ ) (9) Proof ID < u v < = (u) (v): This follows easily (show how!) from the definition of It also follows from the switching formula: (v) (v) = v ( (v) ) (by the S) = u ( (v) ) (since u v) = (u) (v) (S again) ID: u n u = (u n ) (u) The assumption is u n u n+ for all n u = lim n u n Since is nondecreasing, we have (u n ) (u n+ ) (u) for all n, so L := lim n (u n ) exists satisfies L (u) To get the opposite inequality, consider an x R with (u) > x Then u > (by the S) = u n > for all large n (since u n u) = (u n ) > x for all large n (S again) = L > x (since L = lim n (u n )) Now let x tend up to (u) to conclude L (u), as desired 6
4 (): (u) = inf{ x R : u } (S): u (u) x (8): ( (u) ) u ( (u) ) (9): ( ) x ( + ) ID: This result is not so important, so I ll leave it to you as Exercise (8) holds The inequality on the right follows directly from the S, as in the proof of ID To get the inequality on the left, set x = (u); we need to show u (x ) or this let ξ < x Then (u) > ξ (since x = (u)) = u > (ξ) (by the S) Letting ξ tend up to x shows that u (x ), as desired (9) holds The argument for this is similar to that for (8); I ll leave it to Exercise 4 Relations (8) (9) specify the extent to which are inverses Note that the inequalities in these relations can be strict, as in the following cases: u (x ) (8) x := (u) u := (9) (u) x (u+) In view of ID ID4, is called the left-continuous inverse to ID4 the preceding examples yield this corollary: Theorem 4 Let be the left-continuous inverse to the df Then ( (u) ) = u for all u (, ) iff is continuous, () { ( ) } = x for all x A := { x R : < < } () iff is strictly increasing over A (): (u) = inf{ x R : u } (S): u (u) x The inverse probability transformation We saw earlier (see () ()) that if the df of a rom variable X is continuous strictly increasing, then (i) (X) is uniformly distributed over (, ),, conversely, (ii) if U is uniformly distributed over (, ), then (U) X The following theorem says that (ii) without any conditions on (i) is not always true, but there are some things that can be said; we ll deal with that in the next subsection Theorem 5 (The IPT Theorem) Let X be a rom variable with df left-continuous inverse df If U (, ), then (U) X Proof or each x R, we have (U) x U by the switching formula Thus P [ (U) x ] = P [ U ] = = P [ X x ] Since this is true for all x R, (U) X Example Suppose X takes the values, /, with probability / each The graphs of are as follows: Df of X x (u) Inverse df u It is clear that if U Uniform(, ), then (U) takes the values, /, with probability / each, just as X does 7 8
5 7: /4/ (8): ( (u) ) u ( (u) ) U Uniform = IPT (U) (): or X, P [ (X) u ] u for all u (, ) The probability integral transformation The second half of the following theorem gives a necessary sufficient condition for (X) to be uniformly distributed over (, ) Theorem 6 (The PIT Theorem) Let X be a rom variable with df Then P [ (X) u ] u for all u (, ) () Moreover P [ (X) u ] = u for all u (, ) is continuous () Proof Let U Uniform(, ) let be the left-continuous inverse to By the IPT, X (U), so (X) ( (U) ) () holds In general, ( (U) ) U by (8) Thus for all u (, ), Example As in the preceding example, suppose X takes the values, /, with probability / each Then Y := (X) takes the values /, /, with probability / each The graphs of the df of X the df G of Y are as follows: Df of X x G(y) Df G of Y = (X) y The graph of G shows that G(y) y for all y (, ), as () asserts The proof of the PIT Theorem illustrates a useful technique if you want to prove something about the distribution of a rom variable X with df, try representing X as (U) for a uniform rom variable U P [ (X) u ] = P [ ( (U) ) u ] P [ U u ] = u () holds If is continuous, then U = ( (U) ) by (8), so (X) ( (U) ) = U Uniform(,) On the other h, if is not continuous, then there exists an x R such that < (x ) = P [ X = x ] P [ (X) = ] But P [ U = ] =, so (X) U 9
6 Exercises The following definitions results are needed for Exercise Suppose (x n ) n= is an infinite sequence of real numbers x is a real number One writes x n x to mean x n x n+ for all n lim n x n = x x n x to mean x n x n+ for all n lim n x n = x Similarly, if (A n ) n= is an infinite sequence of events A is an event, one writes A n A to mean A n A n+ for all n A = A n A to mean A n A n+ for all n A = One of the properties of a probability measure P is that n= A n, n= A n A n A = P [A n ] P [A] (4) A n A = P [A n ] P [A] (5) Properties (4) (5) are called respectively continuity from below continuity from above Exercise Complete the proof of Theorem, using (4) (5) to verify properties D D4 Exercise Let be the left-continuous inverse to a df Show by examples that (u) < x does not imply u < that u < does not imply (u) < x Exercise Prove ID [Hint: put L = lim u (u) ξ = inf(a) for A = { x R : > } Note that L ξ may be Deduce L ξ from the fact that L x for each x A (why?) Deduce L ξ from the fact that (u) A for each u > (why?)] Exercise 4 Prove (9) Exercise 5 Let be a df such that < < for all x R let be the left-continuous inverse to Show that ( ( (u) )) = (u) for all u (, ) (6) ( ( )) = for all x R Exercise 6 Prove Theorem 4 (7) Exercise 7 Inequality () has an important implication for p- values What is that? Exercise 8 Let X be a rom variable with df left-continuous inverse df (a) Show that for x R < u <, one has u (x ) (u+) x, (8) with (x ) defined as in D4 (u+) defined by (7) (b) Use part (a) to show that for < u <, (u+) = sup{ x : u (x ) } (9) [Hint for (a): use the switching formula v > (w) (v) > w, noting for example that u (x ) u (w) for all w < x] Unfornately the jumps of complicate what would otherwise be a simple theory orturnately, though, don t have too many jumps according to the following exercise, there are at most countably many of them Exercise 9 Let B be a subinterval of R (B doesn t have to be a proper subinterval; the case B = R is allowed) Let f be a non-
7 7: /4/ decreasing mapping from B into R (or example, f might be a df, defined on B = R, or an inverse df, defined on B = (, )) Put D f := {x B : f is discontinuous at x}, () C f := D c f = {x B : f is continuous at x} () (a) Show that D f is countable (b) Use part (a) to show that C f is dense in B [Hint for (a): irst show that for any closed bounded subinterval A of B any number ɛ >, there are at most finitely many points x A such that the jump f(x+) f(x ) of f at x exceeds ɛ] The following exercise plays an important role in the theory of convergence of probability distributions The main point is that () implies (4) Similar reasoning shows that, conversely, (4) implies (); you don t have to give the argument for that Exercise Let,,, n,, be dfs with corresponding left-continuous inverse dfs,,, n,, Suppose that lim n n (x) = for all continuity points x of () (a) Suppose that u (, ) that w is a continuity point of with (u) > w Use the switching formula to show that n(u) > w for all large n (b) Suppose that u (, ) that y is a continuity point of with (u+) < y Show that n(u) y for all large n (c) Use parts (a) (b) of this exercise part (b) of the preceeding exercise to show that for each u (, ), one has (u) lim inf n n(u) lim sup n n(u) (u+) () (d) Use part (c) to show that lim n n(u) = (u) for all continuity points u of (4) (e) Show by example that if u is not a continuity point of, then n(u) may not converge as n
1. Supremum and Infimum Remark: In this sections, all the subsets of R are assumed to be nonempty.
1. Supremum and Infimum Remark: In this sections, all the subsets of R are assumed to be nonempty. Let E be a subset of R. We say that E is bounded above if there exists a real number U such that x U for
More informationX n D X lim n F n (x) = F (x) for all x C F. lim n F n(u) = F (u) for all u C F. (2)
14:17 11/16/2 TOPIC. Convergence in distribution and related notions. This section studies the notion of the so-called convergence in distribution of real random variables. This is the kind of convergence
More information2.4 The Extreme Value Theorem and Some of its Consequences
2.4 The Extreme Value Theorem and Some of its Consequences The Extreme Value Theorem deals with the question of when we can be sure that for a given function f, (1) the values f (x) don t get too big or
More information2.2 Some Consequences of the Completeness Axiom
60 CHAPTER 2. IMPORTANT PROPERTIES OF R 2.2 Some Consequences of the Completeness Axiom In this section, we use the fact that R is complete to establish some important results. First, we will prove that
More informationPart 2 Continuous functions and their properties
Part 2 Continuous functions and their properties 2.1 Definition Definition A function f is continuous at a R if, and only if, that is lim f (x) = f (a), x a ε > 0, δ > 0, x, x a < δ f (x) f (a) < ε. Notice
More informationHomework 1 (revised) Solutions
Homework 1 (revised) Solutions 1. Textbook, 1.1.1, # 1.1.2 (p. 24) Let S be an ordered set. Let A be a non-empty finite subset. Then A is bounded and sup A, inf A A Solution. The hint was: Use induction,
More informationMATH 102 INTRODUCTION TO MATHEMATICAL ANALYSIS. 1. Some Fundamentals
MATH 02 INTRODUCTION TO MATHEMATICAL ANALYSIS Properties of Real Numbers Some Fundamentals The whole course will be based entirely on the study of sequence of numbers and functions defined on the real
More informationEconomics 204 Summer/Fall 2011 Lecture 5 Friday July 29, 2011
Economics 204 Summer/Fall 2011 Lecture 5 Friday July 29, 2011 Section 2.6 (cont.) Properties of Real Functions Here we first study properties of functions from R to R, making use of the additional structure
More informationSet, functions and Euclidean space. Seungjin Han
Set, functions and Euclidean space Seungjin Han September, 2018 1 Some Basics LOGIC A is necessary for B : If B holds, then A holds. B A A B is the contraposition of B A. A is sufficient for B: If A holds,
More informationIf g is also continuous and strictly increasing on J, we may apply the strictly increasing inverse function g 1 to this inequality to get
18:2 1/24/2 TOPIC. Inequalities; measures of spread. This lecture explores the implications of Jensen s inequality for g-means in general, and for harmonic, geometric, arithmetic, and related means in
More informationMORE ON CONTINUOUS FUNCTIONS AND SETS
Chapter 6 MORE ON CONTINUOUS FUNCTIONS AND SETS This chapter can be considered enrichment material containing also several more advanced topics and may be skipped in its entirety. You can proceed directly
More informationSuppose R is an ordered ring with positive elements P.
1. The real numbers. 1.1. Ordered rings. Definition 1.1. By an ordered commutative ring with unity we mean an ordered sextuple (R, +, 0,, 1, P ) such that (R, +, 0,, 1) is a commutative ring with unity
More informationg 2 (x) (1/3)M 1 = (1/3)(2/3)M.
COMPACTNESS If C R n is closed and bounded, then by B-W it is sequentially compact: any sequence of points in C has a subsequence converging to a point in C Conversely, any sequentially compact C R n is
More informationMATH 131A: REAL ANALYSIS (BIG IDEAS)
MATH 131A: REAL ANALYSIS (BIG IDEAS) Theorem 1 (The Triangle Inequality). For all x, y R we have x + y x + y. Proposition 2 (The Archimedean property). For each x R there exists an n N such that n > x.
More informationSupremum and Infimum
Supremum and Infimum UBC M0 Lecture Notes by Philip D. Loewen The Real Number System. Work hard to construct from the axioms a set R with special elements O and I, and a subset P R, and mappings A: R R
More informationStandard forms for writing numbers
Standard forms for writing numbers In order to relate the abstract mathematical descriptions of familiar number systems to the everyday descriptions of numbers by decimal expansions and similar means,
More informationHW 4 SOLUTIONS. , x + x x 1 ) 2
HW 4 SOLUTIONS The Way of Analysis p. 98: 1.) Suppose that A is open. Show that A minus a finite set is still open. This follows by induction as long as A minus one point x is still open. To see that A
More informationU e = E (U\E) e E e + U\E e. (1.6)
12 1 Lebesgue Measure 1.2 Lebesgue Measure In Section 1.1 we defined the exterior Lebesgue measure of every subset of R d. Unfortunately, a major disadvantage of exterior measure is that it does not satisfy
More informationIowa State University. Instructor: Alex Roitershtein Summer Homework #5. Solutions
Math 50 Iowa State University Introduction to Real Analysis Department of Mathematics Instructor: Alex Roitershtein Summer 205 Homework #5 Solutions. Let α and c be real numbers, c > 0, and f is defined
More informationREVIEW OF ESSENTIAL MATH 346 TOPICS
REVIEW OF ESSENTIAL MATH 346 TOPICS 1. AXIOMATIC STRUCTURE OF R Doğan Çömez The real number system is a complete ordered field, i.e., it is a set R which is endowed with addition and multiplication operations
More informationA LITTLE REAL ANALYSIS AND TOPOLOGY
A LITTLE REAL ANALYSIS AND TOPOLOGY 1. NOTATION Before we begin some notational definitions are useful. (1) Z = {, 3, 2, 1, 0, 1, 2, 3, }is the set of integers. (2) Q = { a b : aεz, bεz {0}} is the set
More informationMAT137 - Term 2, Week 2
MAT137 - Term 2, Week 2 This lecture will assume you have watched all of the videos on the definition of the integral (but will remind you about some things). Today we re talking about: More on the definition
More informationProof. We indicate by α, β (finite or not) the end-points of I and call
C.6 Continuous functions Pag. 111 Proof of Corollary 4.25 Corollary 4.25 Let f be continuous on the interval I and suppose it admits non-zero its (finite or infinite) that are different in sign for x tending
More informationMATH5011 Real Analysis I. Exercise 1 Suggested Solution
MATH5011 Real Analysis I Exercise 1 Suggested Solution Notations in the notes are used. (1) Show that every open set in R can be written as a countable union of mutually disjoint open intervals. Hint:
More information2. The Concept of Convergence: Ultrafilters and Nets
2. The Concept of Convergence: Ultrafilters and Nets NOTE: AS OF 2008, SOME OF THIS STUFF IS A BIT OUT- DATED AND HAS A FEW TYPOS. I WILL REVISE THIS MATE- RIAL SOMETIME. In this lecture we discuss two
More informationIn N we can do addition, but in order to do subtraction we need to extend N to the integers
Chapter The Real Numbers.. Some Preliminaries Discussion: The Irrationality of 2. We begin with the natural numbers N = {, 2, 3, }. In N we can do addition, but in order to do subtraction we need to extend
More informationHOMEWORK ASSIGNMENT 6
HOMEWORK ASSIGNMENT 6 DUE 15 MARCH, 2016 1) Suppose f, g : A R are uniformly continuous on A. Show that f + g is uniformly continuous on A. Solution First we note: In order to show that f + g is uniformly
More informationProblem List MATH 5143 Fall, 2013
Problem List MATH 5143 Fall, 2013 On any problem you may use the result of any previous problem (even if you were not able to do it) and any information given in class up to the moment the problem was
More informationSpring 2014 Advanced Probability Overview. Lecture Notes Set 1: Course Overview, σ-fields, and Measures
36-752 Spring 2014 Advanced Probability Overview Lecture Notes Set 1: Course Overview, σ-fields, and Measures Instructor: Jing Lei Associated reading: Sec 1.1-1.4 of Ash and Doléans-Dade; Sec 1.1 and A.1
More informationMATH 117 LECTURE NOTES
MATH 117 LECTURE NOTES XIN ZHOU Abstract. This is the set of lecture notes for Math 117 during Fall quarter of 2017 at UC Santa Barbara. The lectures follow closely the textbook [1]. Contents 1. The set
More informationChapter 1 The Real Numbers
Chapter 1 The Real Numbers In a beginning course in calculus, the emphasis is on introducing the techniques of the subject;i.e., differentiation and integration and their applications. An advanced calculus
More information5.4 Continuity: Preliminary Notions
5.4. CONTINUITY: PRELIMINARY NOTIONS 181 5.4 Continuity: Preliminary Notions 5.4.1 Definitions The American Heritage Dictionary of the English Language defines continuity as an uninterrupted succession,
More informationProblem set 1, Real Analysis I, Spring, 2015.
Problem set 1, Real Analysis I, Spring, 015. (1) Let f n : D R be a sequence of functions with domain D R n. Recall that f n f uniformly if and only if for all ɛ > 0, there is an N = N(ɛ) so that if n
More informationPrinciple of Mathematical Induction
Advanced Calculus I. Math 451, Fall 2016, Prof. Vershynin Principle of Mathematical Induction 1. Prove that 1 + 2 + + n = 1 n(n + 1) for all n N. 2 2. Prove that 1 2 + 2 2 + + n 2 = 1 n(n + 1)(2n + 1)
More informationUndergraduate Notes in Mathematics. Arkansas Tech University Department of Mathematics
Undergraduate Notes in Mathematics Arkansas Tech University Department of Mathematics An Introductory Single Variable Real Analysis: A Learning Approach through Problem Solving Marcel B. Finan c All Rights
More informationSelected solutions for Homework 9
Math 424 B / 574 B Due Wednesday, Dec 09 Autumn 2015 Selected solutions for Homework 9 This file includes solutions only to those problems we did not have time to cover in class. We need the following
More informationEC9A0: Pre-sessional Advanced Mathematics Course. Lecture Notes: Unconstrained Optimisation By Pablo F. Beker 1
EC9A0: Pre-sessional Advanced Mathematics Course Lecture Notes: Unconstrained Optimisation By Pablo F. Beker 1 1 Infimum and Supremum Definition 1. Fix a set Y R. A number α R is an upper bound of Y if
More informationconvergence theorem in abstract set up. Our proof produces a positive integrable function required unlike other known
https://sites.google.com/site/anilpedgaonkar/ profanilp@gmail.com 218 Chapter 5 Convergence and Integration In this chapter we obtain convergence theorems. Convergence theorems will apply to various types
More informationCauchy Sequences. x n = 1 ( ) 2 1 1, . As you well know, k! n 1. 1 k! = e, = k! k=0. k = k=1
Cauchy Sequences The Definition. I will introduce the main idea by contrasting three sequences of rational numbers. In each case, the universal set of numbers will be the set Q of rational numbers; all
More informationMAT 570 REAL ANALYSIS LECTURE NOTES. Contents. 1. Sets Functions Countability Axiom of choice Equivalence relations 9
MAT 570 REAL ANALYSIS LECTURE NOTES PROFESSOR: JOHN QUIGG SEMESTER: FALL 204 Contents. Sets 2 2. Functions 5 3. Countability 7 4. Axiom of choice 8 5. Equivalence relations 9 6. Real numbers 9 7. Extended
More informationImportant Properties of R
Chapter 2 Important Properties of R The purpose of this chapter is to explain to the reader why the set of real numbers is so special. By the end of this chapter, the reader should understand the difference
More informationMeasure and Integration: Concepts, Examples and Exercises. INDER K. RANA Indian Institute of Technology Bombay India
Measure and Integration: Concepts, Examples and Exercises INDER K. RANA Indian Institute of Technology Bombay India Department of Mathematics, Indian Institute of Technology, Bombay, Powai, Mumbai 400076,
More informationStructure of R. Chapter Algebraic and Order Properties of R
Chapter Structure of R We will re-assemble calculus by first making assumptions about the real numbers. All subsequent results will be rigorously derived from these assumptions. Most of the assumptions
More informationn [ F (b j ) F (a j ) ], n j=1(a j, b j ] E (4.1)
1.4. CONSTRUCTION OF LEBESGUE-STIELTJES MEASURES In this section we shall put to use the Carathéodory-Hahn theory, in order to construct measures with certain desirable properties first on the real line
More informationConsequences of the Completeness Property
Consequences of the Completeness Property Philippe B. Laval KSU Today Philippe B. Laval (KSU) Consequences of the Completeness Property Today 1 / 10 Introduction In this section, we use the fact that R
More informationIn N we can do addition, but in order to do subtraction we need to extend N to the integers
Chapter 1 The Real Numbers 1.1. Some Preliminaries Discussion: The Irrationality of 2. We begin with the natural numbers N = {1, 2, 3, }. In N we can do addition, but in order to do subtraction we need
More informationMetric Spaces and Topology
Chapter 2 Metric Spaces and Topology From an engineering perspective, the most important way to construct a topology on a set is to define the topology in terms of a metric on the set. This approach underlies
More informationPrinciples of Real Analysis I Fall VII. Sequences of Functions
21-355 Principles of Real Analysis I Fall 2004 VII. Sequences of Functions In Section II, we studied sequences of real numbers. It is very useful to consider extensions of this concept. More generally,
More informationTHE RADIUS OF CONVERGENCE FORMULA. a n (z c) n, f(z) =
THE RADIUS OF CONVERGENCE FORMULA Every complex power series, f(z) = (z c) n, n=0 has a radius of convergence, nonnegative-real or infinite, R = R(f) [0, + ], that describes the convergence of the series,
More informationMA103 Introduction to Abstract Mathematics Second part, Analysis and Algebra
206/7 MA03 Introduction to Abstract Mathematics Second part, Analysis and Algebra Amol Sasane Revised by Jozef Skokan, Konrad Swanepoel, and Graham Brightwell Copyright c London School of Economics 206
More informationCHAPTER I THE RIESZ REPRESENTATION THEOREM
CHAPTER I THE RIESZ REPRESENTATION THEOREM We begin our study by identifying certain special kinds of linear functionals on certain special vector spaces of functions. We describe these linear functionals
More informationMath 104: Homework 7 solutions
Math 04: Homework 7 solutions. (a) The derivative of f () = is f () = 2 which is unbounded as 0. Since f () is continuous on [0, ], it is uniformly continous on this interval by Theorem 9.2. Hence for
More informationCLASSICAL PROBABILITY MODES OF CONVERGENCE AND INEQUALITIES
CLASSICAL PROBABILITY 2008 2. MODES OF CONVERGENCE AND INEQUALITIES JOHN MORIARTY In many interesting and important situations, the object of interest is influenced by many random factors. If we can construct
More informationCHAPTER 8: EXPLORING R
CHAPTER 8: EXPLORING R LECTURE NOTES FOR MATH 378 (CSUSM, SPRING 2009). WAYNE AITKEN In the previous chapter we discussed the need for a complete ordered field. The field Q is not complete, so we constructed
More information5.5 Deeper Properties of Continuous Functions
5.5. DEEPER PROPERTIES OF CONTINUOUS FUNCTIONS 195 5.5 Deeper Properties of Continuous Functions 5.5.1 Intermediate Value Theorem and Consequences When one studies a function, one is usually interested
More information- Well-characterized problems, min-max relations, approximate certificates. - LP problems in the standard form, primal and dual linear programs
LP-Duality ( Approximation Algorithms by V. Vazirani, Chapter 12) - Well-characterized problems, min-max relations, approximate certificates - LP problems in the standard form, primal and dual linear programs
More informationLECTURE 10: REVIEW OF POWER SERIES. 1. Motivation
LECTURE 10: REVIEW OF POWER SERIES By definition, a power series centered at x 0 is a series of the form where a 0, a 1,... and x 0 are constants. For convenience, we shall mostly be concerned with the
More informationDue date: Monday, February 6, 2017.
Modern Analysis Homework 3 Solutions Due date: Monday, February 6, 2017. 1. If A R define A = {x R : x A}. Let A be a nonempty set of real numbers, assume A is bounded above. Prove that A is bounded below
More informationIntroductory Analysis 2 Spring 2010 Exam 1 February 11, 2015
Introductory Analysis 2 Spring 21 Exam 1 February 11, 215 Instructions: You may use any result from Chapter 2 of Royden s textbook, or from the first four chapters of Pugh s textbook, or anything seen
More informationMATH 140B - HW 5 SOLUTIONS
MATH 140B - HW 5 SOLUTIONS Problem 1 (WR Ch 7 #8). If I (x) = { 0 (x 0), 1 (x > 0), if {x n } is a sequence of distinct points of (a,b), and if c n converges, prove that the series f (x) = c n I (x x n
More informationLebesgue Integration on R n
Lebesgue Integration on R n The treatment here is based loosely on that of Jones, Lebesgue Integration on Euclidean Space We give an overview from the perspective of a user of the theory Riemann integration
More informationProbability and Measure
Probability and Measure Robert L. Wolpert Institute of Statistics and Decision Sciences Duke University, Durham, NC, USA Convergence of Random Variables 1. Convergence Concepts 1.1. Convergence of Real
More informationADVANCED CALCULUS - MTH433 LECTURE 4 - FINITE AND INFINITE SETS
ADVANCED CALCULUS - MTH433 LECTURE 4 - FINITE AND INFINITE SETS 1. Cardinal number of a set The cardinal number (or simply cardinal) of a set is a generalization of the concept of the number of elements
More information5.1 Increasing and Decreasing Functions. A function f is decreasing on an interval I if and only if: for all x 1, x 2 I, x 1 < x 2 = f(x 1 ) > f(x 2 )
5.1 Increasing and Decreasing Functions increasing and decreasing functions; roughly DEFINITION increasing and decreasing functions Roughly, a function f is increasing if its graph moves UP, traveling
More informationNotions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy
Banach Spaces These notes provide an introduction to Banach spaces, which are complete normed vector spaces. For the purposes of these notes, all vector spaces are assumed to be over the real numbers.
More informationThe Arzelà-Ascoli Theorem
John Nachbar Washington University March 27, 2016 The Arzelà-Ascoli Theorem The Arzelà-Ascoli Theorem gives sufficient conditions for compactness in certain function spaces. Among other things, it helps
More informationScalar multiplication and addition of sequences 9
8 Sequences 1.2.7. Proposition. Every subsequence of a convergent sequence (a n ) n N converges to lim n a n. Proof. If (a nk ) k N is a subsequence of (a n ) n N, then n k k for every k. Hence if ε >
More informationSequences. We know that the functions can be defined on any subsets of R. As the set of positive integers
Sequences We know that the functions can be defined on any subsets of R. As the set of positive integers Z + is a subset of R, we can define a function on it in the following manner. f: Z + R f(n) = a
More informationMathematical Methods for Physics and Engineering
Mathematical Methods for Physics and Engineering Lecture notes for PDEs Sergei V. Shabanov Department of Mathematics, University of Florida, Gainesville, FL 32611 USA CHAPTER 1 The integration theory
More informationContinuity. Matt Rosenzweig
Continuity Matt Rosenzweig Contents 1 Continuity 1 1.1 Rudin Chapter 4 Exercises........................................ 1 1.1.1 Exercise 1............................................. 1 1.1.2 Exercise
More informationCopyright 2010 Pearson Education, Inc. Publishing as Prentice Hall.
.1 Limits of Sequences. CHAPTER.1.0. a) True. If converges, then there is an M > 0 such that M. Choose by Archimedes an N N such that N > M/ε. Then n N implies /n M/n M/N < ε. b) False. = n does not converge,
More informationDivision of the Humanities and Social Sciences. Supergradients. KC Border Fall 2001 v ::15.45
Division of the Humanities and Social Sciences Supergradients KC Border Fall 2001 1 The supergradient of a concave function There is a useful way to characterize the concavity of differentiable functions.
More informationIntroduction to Real Analysis Alternative Chapter 1
Christopher Heil Introduction to Real Analysis Alternative Chapter 1 A Primer on Norms and Banach Spaces Last Updated: March 10, 2018 c 2018 by Christopher Heil Chapter 1 A Primer on Norms and Banach Spaces
More informationMath 172 HW 1 Solutions
Math 172 HW 1 Solutions Joey Zou April 15, 2017 Problem 1: Prove that the Cantor set C constructed in the text is totally disconnected and perfect. In other words, given two distinct points x, y C, there
More informationSequence convergence, the weak T-axioms, and first countability
Sequence convergence, the weak T-axioms, and first countability 1 Motivation Up to now we have been mentioning the notion of sequence convergence without actually defining it. So in this section we will
More information6.2 Deeper Properties of Continuous Functions
6.2. DEEPER PROPERTIES OF CONTINUOUS FUNCTIONS 69 6.2 Deeper Properties of Continuous Functions 6.2. Intermediate Value Theorem and Consequences When one studies a function, one is usually interested in
More informationMAS221 Analysis Semester Chapter 2 problems
MAS221 Analysis Semester 1 2018-19 Chapter 2 problems 20. Consider the sequence (a n ), with general term a n = 1 + 3. Can you n guess the limit l of this sequence? (a) Verify that your guess is plausible
More informationSome Background Material
Chapter 1 Some Background Material In the first chapter, we present a quick review of elementary - but important - material as a way of dipping our toes in the water. This chapter also introduces important
More informationConvex Analysis and Economic Theory AY Elementary properties of convex functions
Division of the Humanities and Social Sciences Ec 181 KC Border Convex Analysis and Economic Theory AY 2018 2019 Topic 6: Convex functions I 6.1 Elementary properties of convex functions We may occasionally
More informationLecture 21. Hypothesis Testing II
Lecture 21. Hypothesis Testing II December 7, 2011 In the previous lecture, we dened a few key concepts of hypothesis testing and introduced the framework for parametric hypothesis testing. In the parametric
More informationReal Analysis - Notes and After Notes Fall 2008
Real Analysis - Notes and After Notes Fall 2008 October 29, 2008 1 Introduction into proof August 20, 2008 First we will go through some simple proofs to learn how one writes a rigorous proof. Let start
More informationNumerical Sequences and Series
Numerical Sequences and Series Written by Men-Gen Tsai email: b89902089@ntu.edu.tw. Prove that the convergence of {s n } implies convergence of { s n }. Is the converse true? Solution: Since {s n } is
More informationMeasure and integration
Chapter 5 Measure and integration In calculus you have learned how to calculate the size of different kinds of sets: the length of a curve, the area of a region or a surface, the volume or mass of a solid.
More informationMath 328 Course Notes
Math 328 Course Notes Ian Robertson March 3, 2006 3 Properties of C[0, 1]: Sup-norm and Completeness In this chapter we are going to examine the vector space of all continuous functions defined on the
More informationABSTRACT INTEGRATION CHAPTER ONE
CHAPTER ONE ABSTRACT INTEGRATION Version 1.1 No rights reserved. Any part of this work can be reproduced or transmitted in any form or by any means. Suggestions and errors are invited and can be mailed
More informationReal Analysis Math 131AH Rudin, Chapter #1. Dominique Abdi
Real Analysis Math 3AH Rudin, Chapter # Dominique Abdi.. If r is rational (r 0) and x is irrational, prove that r + x and rx are irrational. Solution. Assume the contrary, that r+x and rx are rational.
More informationExercises for Unit VI (Infinite constructions in set theory)
Exercises for Unit VI (Infinite constructions in set theory) VI.1 : Indexed families and set theoretic operations (Halmos, 4, 8 9; Lipschutz, 5.3 5.4) Lipschutz : 5.3 5.6, 5.29 5.32, 9.14 1. Generalize
More informationContinuity. Chapter 4
Chapter 4 Continuity Throughout this chapter D is a nonempty subset of the real numbers. We recall the definition of a function. Definition 4.1. A function from D into R, denoted f : D R, is a subset of
More information7 About Egorov s and Lusin s theorems
Tel Aviv University, 2013 Measure and category 62 7 About Egorov s and Lusin s theorems 7a About Severini-Egorov theorem.......... 62 7b About Lusin s theorem............... 64 7c About measurable functions............
More informationBasic Definitions: Indexed Collections and Random Functions
Chapter 1 Basic Definitions: Indexed Collections and Random Functions Section 1.1 introduces stochastic processes as indexed collections of random variables. Section 1.2 builds the necessary machinery
More informationReal Analysis Comprehensive Exam Fall A(k, ε) is of Lebesgue measure zero.
Real Analysis Comprehensive Exam Fall 2002 by XYC Good luck! [1] For ε>0andk>0, denote by A(k, ε) thesetofx Rsuch that x p q 1 for any integers p, q with q 0. k q 2+ε Show that R \ k=1 A(k, ε) is of Lebesgue
More informationContinuity. Chapter 4
Chapter 4 Continuity Throughout this chapter D is a nonempty subset of the real numbers. We recall the definition of a function. Definition 4.1. A function from D into R, denoted f : D R, is a subset of
More informationMA 1124 Solutions 14 th May 2012
MA 1124 Solutions 14 th May 2012 1 (a) Use True/False Tables to prove (i) P = Q Q = P The definition of P = Q is given by P Q P = Q T T T T F F F T T F F T So Q P Q = P F F T T F F F T T T T T Since the
More informationIntroduction to Proofs in Analysis. updated December 5, By Edoh Y. Amiran Following the outline of notes by Donald Chalice INTRODUCTION
Introduction to Proofs in Analysis updated December 5, 2016 By Edoh Y. Amiran Following the outline of notes by Donald Chalice INTRODUCTION Purpose. These notes intend to introduce four main notions from
More informationAustin Mohr Math 704 Homework 6
Austin Mohr Math 704 Homework 6 Problem 1 Integrability of f on R does not necessarily imply the convergence of f(x) to 0 as x. a. There exists a positive continuous function f on R so that f is integrable
More informationConvex Optimization Notes
Convex Optimization Notes Jonathan Siegel January 2017 1 Convex Analysis This section is devoted to the study of convex functions f : B R {+ } and convex sets U B, for B a Banach space. The case of B =
More informationExercise 2. Prove that [ 1, 1] is the set of all the limit points of ( 1, 1] = {x R : 1 <
Math 316, Intro to Analysis Limits of functions We are experts at taking limits of sequences as the indexing parameter gets close to infinity. What about limits of functions as the independent variable
More informationHandout 2 (Correction of Handout 1 plus continued discussion/hw) Comments and Homework in Chapter 1
22M:132 Fall 07 J. Simon Handout 2 (Correction of Handout 1 plus continued discussion/hw) Comments and Homework in Chapter 1 Chapter 1 contains material on sets, functions, relations, and cardinality that
More information1 Definition of the Riemann integral
MAT337H1, Introduction to Real Analysis: notes on Riemann integration 1 Definition of the Riemann integral Definition 1.1. Let [a, b] R be a closed interval. A partition P of [a, b] is a finite set of
More informationWe have been going places in the car of calculus for years, but this analysis course is about how the car actually works.
Analysis I We have been going places in the car of calculus for years, but this analysis course is about how the car actually works. Copier s Message These notes may contain errors. In fact, they almost
More information