Richard DiSalvo. Dr. Elmer. Mathematical Foundations of Economics. Fall/Spring,
|
|
- Jasmine Dickerson
- 6 years ago
- Views:
Transcription
1 The Finite Dimensional Normed Linear Space Theorem Richard DiSalvo Dr. Elmer Mathematical Foundations of Economics Fall/Spring, The claim that follows, which I have called the nite-dimensional normed linear space theorem, essentially says that all such spaces are topologically R n with the Euclidean norm. This means that in many cases the intuition we obtain in R, R 2, and R 3 by imagining intervals, circles, and spheres, respectively, will carry over into not only higher dimension R n but also any vector space that has nite dimension. Throughout this discussion I assume that all scalars for forming linear combinations in this nite dimensional linear space are real numbers (I have heard of complex vector spaces, but in this mathematical foundations for economics independent study we are solely concerned with real vector spaces). By nite-dimensional normed linear space I mean a set X of vectors along with addition of vectors and scalar multiplication satisfying the usual axioms for a vector space ( e.g., X is closed under arbitrary linear combinations of its elements), and a norm function : X R satisfying the usual axioms of a norm (e.g., the triangle inequality), with the induced distance function on X dened in the usual way: ρ X (x, y) = x y. Finally, by nite dimensional, I mean that there exists a nite set of vectors {x, x 2,..., } X that are linearly independent and span X (every vector in X can be written as a linear combination of vectors in {x, x 2,..., }, and none of the x i are redundant). A standard example of such a vector space is X = R 3 with Euclidean norm and basis {e, e 2, e 3 } = {(, 0, 0), (0,, 0), (0, 0, )}. These assumptions force X to be highly structured. In particular, it can be shown that every open ball in X is simply a translation and rescaling of the unit open ball centered around the origin. So the metric on X is, in this context, determined entirely by the shape of its unit ball. For example, the Euclidean norm has this unit ball be the normal sphere; the taxicab norm leads to a diamond-shape; the sup norm has its unit ball a cube. Within this context, we have the following. Claim (The Finite-Dimensional Normed Linear Space Theorem ):. Any nite-dimensional normed linear space is complete (Cauchy convergent for sequences in that space). 2. In any nite-dimensional normed linear space, a set is compact if and only if it is closed and bounded (Compact Closed & Bounded. Interestingly, in some applied contexts (when e.g. the linear space will always be R n ) this is used as the denition for compact set.). 3. All norms on a nite dimensional normed linear space induce the same topology on that space; that is, all norms dene (through their induced metric) the same open sets on that space. ( I.e., it does not matter what norms are used for purposes of answering the question what are the open sets, and consequently answering questions of what are the closed sets, bounded sets, what sequences convergent and to what limiting vectors, and all other questions that are dened in terms of open sets.) I followed the exercises on pages 22 through 25 of the following in order to develop these arguments: Carter, Michael. Foundations of Mathematical Economics. Cambridge: MIT Press, 200.
2 Lemma (the ratio of the total representation magnitude and the magnitude of any vector in a normed linear space is bounded): 2 Let S = {x, x 2,..., } be a linearly independent set of vectors in a normed linear space. Then there is a real number c > 0 such that for every x lins x c ( α + α α n ) where x is expressed as x = α x + α 2 x α n. Proof: Suppose for the sake of contradiction that c > 0, w lin{x, x 2,..., } such that w < c ( α + α α n ), where w = α x + α 2 x α n. Step. Since the above is true for all positive c, it is true for all c in the descending set { m m N}. So let us consider the sequence { m } m=. For every term in this aforementioned sequence we are guaranteed (by the supposition) a w m lins such that w m < αm + αm αm n m where the αi m s are taken from the basis representation for w m. Choose any particular list of these w m to dene the sequence {w m }. 3 I seek to push the sequence of norms { w m } to tend to 0, but it is not clear that I can do that with the sum α m + α2 m + + αn m in the numerator of each norm. But I can dene another sequence {y m }, to be: given the chosen {w m } sequence, let y m = α m w + αm αm m ( m), where the α i s are n taken from the basis representation for w m. Then the norm of each term in the sequence {y m } is y m = α + α α n w m < α α + α2 + + αn + α α n m = m, again where the am i s are from the basis representation for w m. Consequently, {y n } denes a sequence of vectors with corresponding sequence of norms y m < m 0 (as m ). Step 2. My expression for {y m } can be written as y m = β m x + β2 m x βn m where the sum of the absolute values of the betas satises n i= βm i =.4 For each m, for each i =, 2, 3,..., n, we must then have βi m (simply because the sum of these numbers is and they are all positive, so none of 2 Comment: My statement here is an expression of a rewriting the claim as: M > 0 (where M = in the statement of c the claim) such that for any x 0, M α + α α n x Of course another way to express the thing is that there is a real number c > 0 small enough so that for any x 0 c x α + α α n it is clear that there must be a small enough choice of c (or large enough choice of M) that works globally in a particular given linear space using a particular basis. - Comment: To build my intuition, I tried nding such a c in R 2. Take, for example, the basis {(, 0), (0, )} for R 2. Then (x, y) R 2 is expressed as (x, y) = x(, 0)+y(0, ) by this basis. I used the Euclidean norm of (x, y), that is (x, y) = x 2 + y 2. Given any xed k = (x, y), then it is intuitively clear that to maximize x + y we must choose (x, y) to be on a 45 degree ray emanating from the origin. Since the same situation occurs in all four directions, we might as well suppose that x and y are on the positive 45 degree ray, and so x = y 0. In such a case then (x, y) = x 2 and x + y = 2x. We want to choose c so as to ensure that (x, y) c( x + y ), and this argument shows that in the worst case this expression will look like (for a given (x, y)) (x, y) = x 2 c(2x) = 2 2c (the inequality is denitely true if x = 0), and so it would suce to take c to be 2 2 (or 2 ). In three space (but same context), my intuition leads me to believe that a worst case would be again all coordinates being the same, resting upon the 45 degree ray in the positive octant. In such a case the expression boils down to x 3 3cx, which would be satised if 3 3c, that is, we can take c = 3 3 = 3. The pattern is interesting enough to make a conjecturethat taking c = n will work in the statement of the lemma in R n normed with Euclidean measurement using the standard basis vectors as our linearly independent spanning set. The lemma, of course, is much more general, since it deals with arbitrary normed linear spaces and arbitrary spanning sets. 3 That is, {x m} is a sequence that corresponds to the sequence { } in that each term xm in the {xm} sequence lists vectors m that are assumed to contradict the lemma we're trying to show when c is taken to be m. 4 They satisfy this sum because I dened each y m from the term w m by dividing w m by the exact necessary scalar for this to happen. To be more precise, let w m = α m x + α m 2 x α m n xn be the basis representation for the mth term in the w sequence. 2
3 them can be bigger than ). The weights on the basis vectors used to write each term in the sequence {y m } individually dene sequences of real numbers, which we may denote {βi k} k=, i =, 2, 3,..., n. Each of these coordinate sequences is bounded (by in particular). We proceed as follows. Since the rst coordinate sequence, {β k }, is bounded, the Bolzano-Weierstrass theorem guarantees that it has a convergence subsequence. Then let p(m) be the strictly increasing sequence of natural numbers such that the subsequence {β p(m) } of the rst coordinate sequence converges. Denote the limit of this sequence by β. Apply p( ) to form sequence: y p(m) = β p(m) x + β p(m) 2 x βn p(m) we know that the rst coordinate sequence of this new sequence converges to β, but we know little about the others so far. Yet, they are subsequences of their original coordinate sequences, and so they are bounded sequences of real numbers! So we are now guaranteed, again by the Bolzano-Weierstrass theorem, that the sequence of real numbers β p(m) 2 has a convergent subsequence. Let q be the function from the range of p(m) into the positive integers such that β q(p(m)) 2 converges to β 2. Now, apply this this function q to each of the coordinate sequences of y p(m) 's basis representation, obtaining a new sequence y q(p(m)) dened by: y q(p(m)) = β q(p(m)) x + β q(p(m)) 2 x βn q(p(m)) Note that now β q(p(m)), being a subsequence of the convergent sequence β p(m), must still converge to β. Also, now have have pinned down the second coordinate, so that it converges to β 2. Continue this process. That is, the third coordinate sequence {β q(p(m)) 3 } in the above sequence of vectors is a bounded sequence of real numbers and therefore has a convergent subsequence. Use the mapping which gives this convergent subsequence, which is from the range of q(p(m)) into N, in order to restrict every coordinate sequence so that the third coordinate sequence converges. Note that rst and second coordinate sequences still converge. We can repeat this argument, n times in total, until every coordinate sequence converges. Let ym = β sm x + β sm 2 x βn sm be the sequence of vectors thus obtained. Step 3. Now ym is a subsequence of y m. Since every term in the sequence y m had the property that the sum of the absolute values of the weights in the basis representation was, then every term in the sequence ym has this property as well. The sequence { β sm + βsm βsm n } = {} converges to. We know that if the sequence {β sm } converges to β, then the sequence { β sm } converges to β. We also know that if we have any set of sequences all of which converge individually, then their sum converges to the sum of the individual limits. So then the sequence { β sm + βsm βsm n } must converge to β + β2 + + βn. Since the limit of a sequence is unique, then in fact β + β2 + + βn =. So the sequence ym converges to the vector y = β x + β 2 x β n where not all of the β i can be zero, since the sum of the absolute values of these coecients is. Now we have it. We know y m 0. Therefore, ym 0. Hence ym 0. Yet, {ym} converges to a vector which is a weighing of the basis vectors such that at least one weight must be nonzero. Therefore, {ym} actually does not converge to the zero vector. So there must always exist such a constant c, as claimed. Then we dened y m by y m = α m + αm αm n wm = α m + αm αm n (αm x + α m 2 x α m n ) In the n = 2 case, saying that the absolute values of the betas sum to is the same as saying in the expression for y m above: α α + α 2 + α 2 α + α 2 = α + α 2 α + α 2 = It's clear that this argument can be generalized for arbitrary n N. 3
4 Claim (): 5 Every nite-dimensional normed linear space is complete. Proof: Let X be a nite dimensional normed linear space of dimension n. We must show that any arbitrary Cauchy sequence in X converges in X. Let {x m } be an arbitrary Cauchy sequence in X. Let {x, x 2,..., } be a basis for X. Then each term x m has a unique representation: x m = α m x + α m 2 x α m n Let c be the constant guaranteed by the previous lemma. That is, let c be that constant so that for any x X, the product of c times the sum of the absolute value of the weights in the basis representation of x (by the basis I specied in the rst paragraph above) is no greater than the norm of x. Since {x m } is a Cauchy sequence in X, for any cɛ > 0 there exists an N N such that, for all integers r, m N, x m x r < cɛ Substituting the representations for x m and x r by the basis vectors, we obtain: (α m x + α m 2 x α m n ) (α r x + α r 2x α r n ) < cɛ some manipulation, and we obtain: [α m α r ] x + [α m 2 α r 2] x [α m n α r n] < cɛ By the lemma we know that the constant c satises: c ( α m α r + α m 2 α r α m n α r n ) < [α m α r ] x + [α m 2 α r 2] x [α m n α r n] < cɛ so that α m α r + α m 2 α r α m n α r n < cɛ/c = ɛ Now consider αi m αi r for any i =, 2,..., n. It is clear that this, being a term in the sum of all positive terms of the left hand side, is at least as small as the right hand side of the above inequality. Therefore, we can say for any i, αi m αi r α m α r + α2 m α2 r + + αn m αn r < ɛ This shows that given any ɛ > 0 we can nd a positive integer N so that for all m, r N the distance between the ith weight in the basis representation for x m and the ith weight in the basis representation for x r is strictly smaller than ɛ. That is, for each i, for any ɛ > 0, N N such that, for all m, r N, α m i α r i < ɛ Therefore each sequences of weights {α m i } m=, i =, 2, 3,..., n, (which we called the coordinate sequences in the lemma) are themselves Cauchy sequences of real numbers. Since R is complete, for each i, each such sequence {α m i } converges in R to some α i R. Dene x = α x + α 2 x α n. Then x X. It is clear that x m x, since each of the coordinates in the basis representation for x m converges to the corresponding coordinate of x. This shows that every Cauchy sequence in X converges. Therefore, X is complete. 5 Comment: This argument rests on the fact that R is complete. In order to get this into the game, we heavily rely on that we've been taking our scalars from R. Given that we can target any point in our linear space by weighting a nite basis for that space, we can in fact think of our points as, essentially, these weights. Which is to say, our points are eectively in R n. The argument just expresses these thoughts more formally. 4
5 Claim (2): In a nite dimensional normed linear space, a set is compact if and only if it is closed and bounded. Proof: The proof that any compact set is both closed and bounded is on page 6 of Carter; I do not repeat the argument. That the converse holds in any nite dimensional normed linear space is the result I seek to show here. Let S be a closed and bounded subset of a nite-dimensional normed linear space X. Let X have the basis {x, x 2,..., }. Let {x m } be a sequence in S. We want to show that {x m } has a convergent subsequence (sequential compactness). Let x m = α m x + α m 2 x α m n denote the basis representation of x m. Since S is bounded, then it is contained in an open ball. But in a normed linear space, every open ball is merely a translation and rescaling of the unit ball. So say S is contained in the open ball x 0 + rb, where r > 0 is a real number representing the scaling of the unit ball B, and x 0 is the translation of the unit ball. Then the magnitude of any vector in S can be no greater than M = x 0 + r. Therefore any term x m S has x m M, and so by the lemma there is a constant c such that c α m i c ( α m + α m α m n ) < x m M for any i =, 2, 3,..., n; that is, αi m < M/c. Since M/c is a constant, this shows that each coordinate sequence {αi m} of the sequence {xm } is bounded. We are going to apply the same argument as in the lemma. Since the coordinate sequence {αi m} is a bounded sequence of real numbers it has a convergent subsequence {α p(m) i } that converges to α. Construct the subsequence formed by selecting coordinates: x p(m) = α p(m) x + α p(m) 2 x αn p(m) such that α p(m) α, and who knows what the other coordinate sequences doexcept that they are bounded sequences of real numbers and therefore have convergent subsequences. So repeat the argument for the sequence {α p(m) 2 }, so that for some function q( ), α q(p(m)) 2 α 2. Continuing in this way we obtain a subsequence of {x m }, call it {x m } whose coordinate scalars converge to the vector (α,..., α n ). Let x = α x + α 2 x α n. Then x m x because every coordinate in the former converges to the corresponding coordinate of the latter. Since S is closed, every convergent sequence whose terms all come from S converges to an element of S, so x S. Therefore the arbitrary sequence {x m } in S has a subsequence which converges in S. Hence, S is compact. 6 6 Speaking of convergence, the following conjecture arose when I was experimenting with some norms on R 2. I have not proven it. Conjecture: the sequence of norms { x 2n } n= converges to x, where x p = p x p + xp xp n x = max{ x, x 2,..., } Comment: Looking at this conjecture a half of a year later, it seems even better to conjecture that p lim x p + x 2 p + + x p n p = max{ x, x 2,..., } Well, the CES production function looks like: p α x p + α 2x ρ αnxρ n where the x i 0 and the α i > 0. As p, this function converges to min{x, x 2,..., } (this was proven by Dr. Elmer in February for the case n = 2). But the p-norm is just this production function with p >. 5
6 Lemma (exercise.22): 7 Let a and b be two norms on a given linear space X. Assume there are positive constants A and B so that for any x X, x a A x b x b B x a (I'm thinking of A as a number that will always stretch the vector x to greater magnitude when measured in norm b than it is when measured by norm A; and similarly for the number B.) Then the two norms a and b are topologically equivalent, by which I mean (not having studied any formal topology) that any open ball around a vector x that we construct by using norm a contains within it an open ball around x constructed using norm b, and the converse. Consequently every open set in X under a is open when X is analyzed under b, and the converse. Hence, all things dened in terms of the open sets on X, will result in the same notions, regardless of which norm we use. Proof: Let B a r (x) be an arbitrary open ball of radius r around the point x X constructed using norm a. Since every open ball in a normed linear space is the same as a rescaling and translation of the unit open ball, we may write B a r (x) = x + rb a for unit ball B a = {x x a < }. Consider A Bb = {x x b < A } = {x A x b < }. Now whenever x A Bb, then A x b <, and we know by the given equations that x a A x b <, hence x B a. Therefore A Bb B a. Then x + r A Bb x + rb a. Therefore any open ball under norm a has within it an open ball under norm b. On the other hand, if B b r(x) is an arbitrary open ball around x using norm b, then B Ba = {x x a < B } = {x B x a < } B b, and so x + r B Ba works as a suitable open ball contained within B b r(x), as desired. 7 Comment: I recall once seeing the hypotheses of this lemma taken as the denition of two norms being equivalent. It is sometimes phrased as: C, D, positive constants, so that x X: C x a x b D x a but dividing over and breaking these inequality into two parts leads to the assumption I have made. Intuitively, the phrasing above leads to this characterization: given any x, if you measure the magnitude of x using b, then, there is a constant quantity D you can stretch x by to make it at least as large as its magnitude under b, under norm a; and there is a constant quantity C you can squash x by in order to make its magnitude smaller under norm a than it is under norm b. Because C and D are constants, we can do this globally in the linear space; and so, any open ball under b will both be contained in, and contain within it, and open ball under norm a. This is enough for us to conclude that the norms are topologically equivalent, since then all the open sets under norm a will be the same under norm b, and that is all we need to dene the topological properties of X. [Note that these intuitive characterizations rest on the norm axiom: cx = c x = c x for c > 0, and cx is a rescaling of x.] 6
7 Claim (exercise.23): In a nite dimensional linear space, any two norms are topologically equivalent. Proof: Let a and b be two arbitrary norms in a nite dimensional linear space X with dim X = n. I will show that the previous lemma holds between these two norms using the lemma proven at the beginning of this paper, thus showing that these two norms are in fact topologically equivalent (as discussed). Let x X be arbitrary. Let {x, x 2, x 3,..., } be a basis for X. Then x = α x + α 2 x α n for unique α i 's. 8 We know by our initial lemma that there are constants c a and c b such that x a c a [ α + α α n ] on the other hand by the triangle inequality x b c b [ α + α α n ] x a = α x + α 2 x α n a α x a + α 2 x 2 a + + α n a max i n { x i a } n α i i= x b = α x + α 2 x α n b α x b + α 2 x 2 b + + α n b max i n { x i b } n α i Let k a = max i n { x i a } and k b = max i n { x i b }. 9 For simplicity of notation, let n i= α i = M. Then the above four statements say: k a M x a c a M k b M x b c b M By using the diagonals of these inequalities we obtain the result we need. Since the above implies: k a M x a i= then rearranging we obtain: through similar logic we may obtain: Let ka c b = A and k b c a = B. Then we have: x b c b M k a c b x b x a k b c a x a x b x a A x b these A, B are the constants we sought. x b B x a 8 Comment: A hurdle (maybe) for understanding this argument is to realize that, given any x and basis set for X, the representation-by-basis for x is completely unrelated to the norm on X. The point (, 2) = (, 0) + 2(0, ) in R 2, regardless of whether our norm is Euclidean, taxicab, sup, etc. This is invariant to norm, but the constants c a and c b are clearly not (we xed the norm in the lemma where we obtained these constants, and we showed that they must exist for any norm, but they are denitely functions of the norm we choose). 9 Comment: The maximum norms in the basis set plays a pivotal role in this proof. They exist because we are in nite dimensional space. 7
1 Topology Definition of a topology Basis (Base) of a topology The subspace topology & the product topology on X Y 3
Index Page 1 Topology 2 1.1 Definition of a topology 2 1.2 Basis (Base) of a topology 2 1.3 The subspace topology & the product topology on X Y 3 1.4 Basic topology concepts: limit points, closed sets,
More informationLecture 4: Completion of a Metric Space
15 Lecture 4: Completion of a Metric Space Closure vs. Completeness. Recall the statement of Lemma??(b): A subspace M of a metric space X is closed if and only if every convergent sequence {x n } X satisfying
More informationFUNCTIONAL ANALYSIS-NORMED SPACE
MAT641- MSC Mathematics, MNIT Jaipur FUNCTIONAL ANALYSIS-NORMED SPACE DR. RITU AGARWAL MALAVIYA NATIONAL INSTITUTE OF TECHNOLOGY JAIPUR 1. Normed space Norm generalizes the concept of length in an arbitrary
More informationMATH 51H Section 4. October 16, Recall what it means for a function between metric spaces to be continuous:
MATH 51H Section 4 October 16, 2015 1 Continuity Recall what it means for a function between metric spaces to be continuous: Definition. Let (X, d X ), (Y, d Y ) be metric spaces. A function f : X Y is
More informationLecture 3. Econ August 12
Lecture 3 Econ 2001 2015 August 12 Lecture 3 Outline 1 Metric and Metric Spaces 2 Norm and Normed Spaces 3 Sequences and Subsequences 4 Convergence 5 Monotone and Bounded Sequences Announcements: - Friday
More informationLinear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space
Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) Contents 1 Vector Spaces 1 1.1 The Formal Denition of a Vector Space.................................. 1 1.2 Subspaces...................................................
More informationMetric spaces and metrizability
1 Motivation Metric spaces and metrizability By this point in the course, this section should not need much in the way of motivation. From the very beginning, we have talked about R n usual and how relatively
More informationExercise Solutions to Functional Analysis
Exercise Solutions to Functional Analysis Note: References refer to M. Schechter, Principles of Functional Analysis Exersize that. Let φ,..., φ n be an orthonormal set in a Hilbert space H. Show n f n
More information2.3 Some Properties of Continuous Functions
2.3 Some Properties of Continuous Functions In this section we look at some properties, some quite deep, shared by all continuous functions. They are known as the following: 1. Preservation of sign property
More informationPart III. 10 Topological Space Basics. Topological Spaces
Part III 10 Topological Space Basics Topological Spaces Using the metric space results above as motivation we will axiomatize the notion of being an open set to more general settings. Definition 10.1.
More informationAPPLICATIONS IN FIXED POINT THEORY. Matthew Ray Farmer. Thesis Prepared for the Degree of MASTER OF ARTS UNIVERSITY OF NORTH TEXAS.
APPLICATIONS IN FIXED POINT THEORY Matthew Ray Farmer Thesis Prepared for the Degree of MASTER OF ARTS UNIVERSITY OF NORTH TEXAS December 2005 APPROVED: Elizabeth M. Bator, Major Professor Paul Lewis,
More informationMath 320-2: Midterm 2 Practice Solutions Northwestern University, Winter 2015
Math 30-: Midterm Practice Solutions Northwestern University, Winter 015 1. Give an example of each of the following. No justification is needed. (a) A metric on R with respect to which R is bounded. (b)
More informationProblem Set 2: Solutions Math 201A: Fall 2016
Problem Set 2: s Math 201A: Fall 2016 Problem 1. (a) Prove that a closed subset of a complete metric space is complete. (b) Prove that a closed subset of a compact metric space is compact. (c) Prove that
More informationFUNCTIONAL ANALYSIS LECTURE NOTES: COMPACT SETS AND FINITE-DIMENSIONAL SPACES. 1. Compact Sets
FUNCTIONAL ANALYSIS LECTURE NOTES: COMPACT SETS AND FINITE-DIMENSIONAL SPACES CHRISTOPHER HEIL 1. Compact Sets Definition 1.1 (Compact and Totally Bounded Sets). Let X be a metric space, and let E X be
More informationCS 6820 Fall 2014 Lectures, October 3-20, 2014
Analysis of Algorithms Linear Programming Notes CS 6820 Fall 2014 Lectures, October 3-20, 2014 1 Linear programming The linear programming (LP) problem is the following optimization problem. We are given
More informationDS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.
DS-GA 1002 Lecture notes 0 Fall 2016 Linear Algebra These notes provide a review of basic concepts in linear algebra. 1 Vector spaces You are no doubt familiar with vectors in R 2 or R 3, i.e. [ ] 1.1
More informationPart V. 17 Introduction: What are measures and why measurable sets. Lebesgue Integration Theory
Part V 7 Introduction: What are measures and why measurable sets Lebesgue Integration Theory Definition 7. (Preliminary). A measure on a set is a function :2 [ ] such that. () = 2. If { } = is a finite
More informationExistence and Uniqueness
Chapter 3 Existence and Uniqueness An intellect which at a certain moment would know all forces that set nature in motion, and all positions of all items of which nature is composed, if this intellect
More information2.4 The Extreme Value Theorem and Some of its Consequences
2.4 The Extreme Value Theorem and Some of its Consequences The Extreme Value Theorem deals with the question of when we can be sure that for a given function f, (1) the values f (x) don t get too big or
More informationVector Space Basics. 1 Abstract Vector Spaces. 1. (commutativity of vector addition) u + v = v + u. 2. (associativity of vector addition)
Vector Space Basics (Remark: these notes are highly formal and may be a useful reference to some students however I am also posting Ray Heitmann's notes to Canvas for students interested in a direct computational
More information5.4 Continuity: Preliminary Notions
5.4. CONTINUITY: PRELIMINARY NOTIONS 181 5.4 Continuity: Preliminary Notions 5.4.1 Definitions The American Heritage Dictionary of the English Language defines continuity as an uninterrupted succession,
More informationMath 328 Course Notes
Math 328 Course Notes Ian Robertson March 3, 2006 3 Properties of C[0, 1]: Sup-norm and Completeness In this chapter we are going to examine the vector space of all continuous functions defined on the
More informationTopological properties
CHAPTER 4 Topological properties 1. Connectedness Definitions and examples Basic properties Connected components Connected versus path connected, again 2. Compactness Definition and first examples Topological
More informationEcon Lecture 3. Outline. 1. Metric Spaces and Normed Spaces 2. Convergence of Sequences in Metric Spaces 3. Sequences in R and R n
Econ 204 2011 Lecture 3 Outline 1. Metric Spaces and Normed Spaces 2. Convergence of Sequences in Metric Spaces 3. Sequences in R and R n 1 Metric Spaces and Metrics Generalize distance and length notions
More informationLecture Notes on Metric Spaces
Lecture Notes on Metric Spaces Math 117: Summer 2007 John Douglas Moore Our goal of these notes is to explain a few facts regarding metric spaces not included in the first few chapters of the text [1],
More informationBolzano Weierstrass Theorems I
Bolzano Weierstrass Theorems I James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University September 8, 2017 Outline The Bolzano Weierstrass Theorem Extensions
More informationLocally convex spaces, the hyperplane separation theorem, and the Krein-Milman theorem
56 Chapter 7 Locally convex spaces, the hyperplane separation theorem, and the Krein-Milman theorem Recall that C(X) is not a normed linear space when X is not compact. On the other hand we could use semi
More informationLecture Notes in Advanced Calculus 1 (80315) Raz Kupferman Institute of Mathematics The Hebrew University
Lecture Notes in Advanced Calculus 1 (80315) Raz Kupferman Institute of Mathematics The Hebrew University February 7, 2007 2 Contents 1 Metric Spaces 1 1.1 Basic definitions...........................
More informationMetric Spaces and Topology
Chapter 2 Metric Spaces and Topology From an engineering perspective, the most important way to construct a topology on a set is to define the topology in terms of a metric on the set. This approach underlies
More informationADDENDUM B: CONSTRUCTION OF R AND THE COMPLETION OF A METRIC SPACE
ADDENDUM B: CONSTRUCTION OF R AND THE COMPLETION OF A METRIC SPACE ANDREAS LEOPOLD KNUTSEN Abstract. These notes are written as supplementary notes for the course MAT11- Real Analysis, taught at the University
More information2. Two binary operations (addition, denoted + and multiplication, denoted
Chapter 2 The Structure of R The purpose of this chapter is to explain to the reader why the set of real numbers is so special. By the end of this chapter, the reader should understand the difference between
More informationThe Heine-Borel and Arzela-Ascoli Theorems
The Heine-Borel and Arzela-Ascoli Theorems David Jekel October 29, 2016 This paper explains two important results about compactness, the Heine- Borel theorem and the Arzela-Ascoli theorem. We prove them
More informationNOTES ON EXISTENCE AND UNIQUENESS THEOREMS FOR ODES
NOTES ON EXISTENCE AND UNIQUENESS THEOREMS FOR ODES JONATHAN LUK These notes discuss theorems on the existence, uniqueness and extension of solutions for ODEs. None of these results are original. The proofs
More informationThus f is continuous at x 0. Matthew Straughn Math 402 Homework 6
Matthew Straughn Math 402 Homework 6 Homework 6 (p. 452) 14.3.3, 14.3.4, 14.3.5, 14.3.8 (p. 455) 14.4.3* (p. 458) 14.5.3 (p. 460) 14.6.1 (p. 472) 14.7.2* Lemma 1. If (f (n) ) converges uniformly to some
More informationContents. 2.1 Vectors in R n. Linear Algebra (part 2) : Vector Spaces (by Evan Dummit, 2017, v. 2.50) 2 Vector Spaces
Linear Algebra (part 2) : Vector Spaces (by Evan Dummit, 2017, v 250) Contents 2 Vector Spaces 1 21 Vectors in R n 1 22 The Formal Denition of a Vector Space 4 23 Subspaces 6 24 Linear Combinations and
More informationSequences. Chapter 3. n + 1 3n + 2 sin n n. 3. lim (ln(n + 1) ln n) 1. lim. 2. lim. 4. lim (1 + n)1/n. Answers: 1. 1/3; 2. 0; 3. 0; 4. 1.
Chapter 3 Sequences Both the main elements of calculus (differentiation and integration) require the notion of a limit. Sequences will play a central role when we work with limits. Definition 3.. A Sequence
More informationTechinical Proofs for Nonlinear Learning using Local Coordinate Coding
Techinical Proofs for Nonlinear Learning using Local Coordinate Coding 1 Notations and Main Results Denition 1.1 (Lipschitz Smoothness) A function f(x) on R d is (α, β, p)-lipschitz smooth with respect
More informationMidterm 1. Every element of the set of functions is continuous
Econ 200 Mathematics for Economists Midterm Question.- Consider the set of functions F C(0, ) dened by { } F = f C(0, ) f(x) = ax b, a A R and b B R That is, F is a subset of the set of continuous functions
More informationSet, functions and Euclidean space. Seungjin Han
Set, functions and Euclidean space Seungjin Han September, 2018 1 Some Basics LOGIC A is necessary for B : If B holds, then A holds. B A A B is the contraposition of B A. A is sufficient for B: If A holds,
More informationOverview of normed linear spaces
20 Chapter 2 Overview of normed linear spaces Starting from this chapter, we begin examining linear spaces with at least one extra structure (topology or geometry). We assume linearity; this is a natural
More informationWe are going to discuss what it means for a sequence to converge in three stages: First, we define what it means for a sequence to converge to zero
Chapter Limits of Sequences Calculus Student: lim s n = 0 means the s n are getting closer and closer to zero but never gets there. Instructor: ARGHHHHH! Exercise. Think of a better response for the instructor.
More informationUpper and Lower Bounds on the Number of Faults. a System Can Withstand Without Repairs. Cambridge, MA 02139
Upper and Lower Bounds on the Number of Faults a System Can Withstand Without Repairs Michel Goemans y Nancy Lynch z Isaac Saias x Laboratory for Computer Science Massachusetts Institute of Technology
More information5 Compact linear operators
5 Compact linear operators One of the most important results of Linear Algebra is that for every selfadjoint linear map A on a finite-dimensional space, there exists a basis consisting of eigenvectors.
More informationIntroduction to Topology
Introduction to Topology Randall R. Holmes Auburn University Typeset by AMS-TEX Chapter 1. Metric Spaces 1. Definition and Examples. As the course progresses we will need to review some basic notions about
More informationCopyright 2010 Pearson Education, Inc. Publishing as Prentice Hall.
.1 Limits of Sequences. CHAPTER.1.0. a) True. If converges, then there is an M > 0 such that M. Choose by Archimedes an N N such that N > M/ε. Then n N implies /n M/n M/N < ε. b) False. = n does not converge,
More informationIntroduction to Real Analysis
Introduction to Real Analysis Joshua Wilde, revised by Isabel Tecu, Takeshi Suzuki and María José Boccardi August 13, 2013 1 Sets Sets are the basic objects of mathematics. In fact, they are so basic that
More informationSome Background Material
Chapter 1 Some Background Material In the first chapter, we present a quick review of elementary - but important - material as a way of dipping our toes in the water. This chapter also introduces important
More informationAfter taking the square and expanding, we get x + y 2 = (x + y) (x + y) = x 2 + 2x y + y 2, inequality in analysis, we obtain.
Lecture 1: August 25 Introduction. Topology grew out of certain questions in geometry and analysis about 100 years ago. As Wikipedia puts it, the motivating insight behind topology is that some geometric
More informationEconomics 204 Summer/Fall 2011 Lecture 5 Friday July 29, 2011
Economics 204 Summer/Fall 2011 Lecture 5 Friday July 29, 2011 Section 2.6 (cont.) Properties of Real Functions Here we first study properties of functions from R to R, making use of the additional structure
More informationA TOUR OF LINEAR ALGEBRA FOR JDEP 384H
A TOUR OF LINEAR ALGEBRA FOR JDEP 384H Contents Solving Systems 1 Matrix Arithmetic 3 The Basic Rules of Matrix Arithmetic 4 Norms and Dot Products 5 Norms 5 Dot Products 6 Linear Programming 7 Eigenvectors
More information4.3 - Linear Combinations and Independence of Vectors
- Linear Combinations and Independence of Vectors De nitions, Theorems, and Examples De nition 1 A vector v in a vector space V is called a linear combination of the vectors u 1, u,,u k in V if v can be
More informationMath 117: Topology of the Real Numbers
Math 117: Topology of the Real Numbers John Douglas Moore November 10, 2008 The goal of these notes is to highlight the most important topics presented in Chapter 3 of the text [1] and to provide a few
More informationTopological properties of Z p and Q p and Euclidean models
Topological properties of Z p and Q p and Euclidean models Samuel Trautwein, Esther Röder, Giorgio Barozzi November 3, 20 Topology of Q p vs Topology of R Both R and Q p are normed fields and complete
More informationImmerse Metric Space Homework
Immerse Metric Space Homework (Exercises -2). In R n, define d(x, y) = x y +... + x n y n. Show that d is a metric that induces the usual topology. Sketch the basis elements when n = 2. Solution: Steps
More informationLecture 16 : Definitions, theorems, proofs. MTH299 Transition to Formal Mathematics Michigan State University 1 / 8
Lecture 16 : Definitions, theorems, proofs MTH299 Transition to Formal Mathematics Michigan State University 1 / 8 Meanings Definition : an explanation of the mathematical meaning of a word. Theorem :
More informationMATH 324 Summer 2011 Elementary Number Theory. Notes on Mathematical Induction. Recall the following axiom for the set of integers.
MATH 4 Summer 011 Elementary Number Theory Notes on Mathematical Induction Principle of Mathematical Induction Recall the following axiom for the set of integers. Well-Ordering Axiom for the Integers If
More informationDefinition 2.1. A metric (or distance function) defined on a non-empty set X is a function d: X X R that satisfies: For all x, y, and z in X :
MATH 337 Metric Spaces Dr. Neal, WKU Let X be a non-empty set. The elements of X shall be called points. We shall define the general means of determining the distance between two points. Throughout we
More informationAn Introduction to Complex Analysis and Geometry John P. D Angelo, Pure and Applied Undergraduate Texts Volume 12, American Mathematical Society, 2010
An Introduction to Complex Analysis and Geometry John P. D Angelo, Pure and Applied Undergraduate Texts Volume 12, American Mathematical Society, 2010 John P. D Angelo, Univ. of Illinois, Urbana IL 61801.
More informationDuke University, Department of Electrical and Computer Engineering Optimization for Scientists and Engineers c Alex Bronstein, 2014
Duke University, Department of Electrical and Computer Engineering Optimization for Scientists and Engineers c Alex Bronstein, 2014 Linear Algebra A Brief Reminder Purpose. The purpose of this document
More informationMA651 Topology. Lecture 9. Compactness 2.
MA651 Topology. Lecture 9. Compactness 2. This text is based on the following books: Topology by James Dugundgji Fundamental concepts of topology by Peter O Neil Elements of Mathematics: General Topology
More informationMetric Spaces Math 413 Honors Project
Metric Spaces Math 413 Honors Project 1 Metric Spaces Definition 1.1 Let X be a set. A metric on X is a function d : X X R such that for all x, y, z X: i) d(x, y) = d(y, x); ii) d(x, y) = 0 if and only
More informationA metric space is a set S with a given distance (or metric) function d(x, y) which satisfies the conditions
1 Distance Reading [SB], Ch. 29.4, p. 811-816 A metric space is a set S with a given distance (or metric) function d(x, y) which satisfies the conditions (a) Positive definiteness d(x, y) 0, d(x, y) =
More information5 Banach Algebras. 5.1 Invertibility and the Spectrum. Robert Oeckl FA NOTES 5 19/05/2010 1
Robert Oeckl FA NOTES 5 19/05/2010 1 5 Banach Algebras 5.1 Invertibility and the Spectrum Suppose X is a Banach space. Then we are often interested in (continuous) operators on this space, i.e, elements
More information1.3 Linear Dependence & span K
( ) Conversely, suppose that every vector v V can be expressed uniquely as v = u +w for u U and w W. Then, the existence of this expression for each v V is simply the statement that V = U +W. Moreover,
More informationCourse 212: Academic Year Section 1: Metric Spaces
Course 212: Academic Year 1991-2 Section 1: Metric Spaces D. R. Wilkins Contents 1 Metric Spaces 3 1.1 Distance Functions and Metric Spaces............. 3 1.2 Convergence and Continuity in Metric Spaces.........
More informationTOPOLOGICAL EQUIVALENCE OF LINEAR ORDINARY DIFFERENTIAL EQUATIONS
TOPOLOGICAL EQUIVALENCE OF LINEAR ORDINARY DIFFERENTIAL EQUATIONS ALEX HUMMELS Abstract. This paper proves a theorem that gives conditions for the topological equivalence of linear ordinary differential
More informationConsequences of Continuity
Consequences of Continuity James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University October 4, 2017 Outline 1 Domains of Continuous Functions 2 The
More information2 Metric Spaces Definitions Exotic Examples... 3
Contents 1 Vector Spaces and Norms 1 2 Metric Spaces 2 2.1 Definitions.......................................... 2 2.2 Exotic Examples...................................... 3 3 Topologies 4 3.1 Open Sets..........................................
More informationmeans is a subset of. So we say A B for sets A and B if x A we have x B holds. BY CONTRAST, a S means that a is a member of S.
1 Notation For those unfamiliar, we have := means equal by definition, N := {0, 1,... } or {1, 2,... } depending on context. (i.e. N is the set or collection of counting numbers.) In addition, means for
More informationSequences. Limits of Sequences. Definition. A real-valued sequence s is any function s : N R.
Sequences Limits of Sequences. Definition. A real-valued sequence s is any function s : N R. Usually, instead of using the notation s(n), we write s n for the value of this function calculated at n. We
More informationLecture 2: Vector Spaces, Metric Spaces
CCS Discrete II Professor: Padraic Bartlett Lecture 2: Vector Spaces, Metric Spaces Week 2 UCSB 2015 1 Vector Spaces, Informally The two vector spaces 1 you re probably the most used to working with, from
More informationMH 7500 THEOREMS. (iii) A = A; (iv) A B = A B. Theorem 5. If {A α : α Λ} is any collection of subsets of a space X, then
MH 7500 THEOREMS Definition. A topological space is an ordered pair (X, T ), where X is a set and T is a collection of subsets of X such that (i) T and X T ; (ii) U V T whenever U, V T ; (iii) U T whenever
More informationEconomics Noncooperative Game Theory Lectures 3. October 15, 1997 Lecture 3
Economics 8117-8 Noncooperative Game Theory October 15, 1997 Lecture 3 Professor Andrew McLennan Nash Equilibrium I. Introduction A. Philosophy 1. Repeated framework a. One plays against dierent opponents
More informationMath 361: Homework 1 Solutions
January 3, 4 Math 36: Homework Solutions. We say that two norms and on a vector space V are equivalent or comparable if the topology they define on V are the same, i.e., for any sequence of vectors {x
More informationg 2 (x) (1/3)M 1 = (1/3)(2/3)M.
COMPACTNESS If C R n is closed and bounded, then by B-W it is sequentially compact: any sequence of points in C has a subsequence converging to a point in C Conversely, any sequentially compact C R n is
More informationLINEAR ALGEBRA: THEORY. Version: August 12,
LINEAR ALGEBRA: THEORY. Version: August 12, 2000 13 2 Basic concepts We will assume that the following concepts are known: Vector, column vector, row vector, transpose. Recall that x is a column vector,
More informations P = f(ξ n )(x i x i 1 ). i=1
Compactness and total boundedness via nets The aim of this chapter is to define the notion of a net (generalized sequence) and to characterize compactness and total boundedness by this important topological
More informationWeek 2: Sequences and Series
QF0: Quantitative Finance August 29, 207 Week 2: Sequences and Series Facilitator: Christopher Ting AY 207/208 Mathematicians have tried in vain to this day to discover some order in the sequence of prime
More informationIntroduction to Real Analysis Alternative Chapter 1
Christopher Heil Introduction to Real Analysis Alternative Chapter 1 A Primer on Norms and Banach Spaces Last Updated: March 10, 2018 c 2018 by Christopher Heil Chapter 1 A Primer on Norms and Banach Spaces
More informationNumerical Sequences and Series
Numerical Sequences and Series Written by Men-Gen Tsai email: b89902089@ntu.edu.tw. Prove that the convergence of {s n } implies convergence of { s n }. Is the converse true? Solution: Since {s n } is
More informationSome Background Math Notes on Limsups, Sets, and Convexity
EE599 STOCHASTIC NETWORK OPTIMIZATION, MICHAEL J. NEELY, FALL 2008 1 Some Background Math Notes on Limsups, Sets, and Convexity I. LIMITS Let f(t) be a real valued function of time. Suppose f(t) converges
More informationEconomics 204 Fall 2011 Problem Set 2 Suggested Solutions
Economics 24 Fall 211 Problem Set 2 Suggested Solutions 1. Determine whether the following sets are open, closed, both or neither under the topology induced by the usual metric. (Hint: think about limit
More informationHausdorff Measure. Jimmy Briggs and Tim Tyree. December 3, 2016
Hausdorff Measure Jimmy Briggs and Tim Tyree December 3, 2016 1 1 Introduction In this report, we explore the the measurement of arbitrary subsets of the metric space (X, ρ), a topological space X along
More informationNORMS ON SPACE OF MATRICES
NORMS ON SPACE OF MATRICES. Operator Norms on Space of linear maps Let A be an n n real matrix and x 0 be a vector in R n. We would like to use the Picard iteration method to solve for the following system
More informationRoots of Unity, Cyclotomic Polynomials and Applications
Swiss Mathematical Olympiad smo osm Roots of Unity, Cyclotomic Polynomials and Applications The task to be done here is to give an introduction to the topics in the title. This paper is neither complete
More informationFunctional Analysis HW #3
Functional Analysis HW #3 Sangchul Lee October 26, 2015 1 Solutions Exercise 2.1. Let D = { f C([0, 1]) : f C([0, 1])} and define f d = f + f. Show that D is a Banach algebra and that the Gelfand transform
More informationMetric Spaces Math 413 Honors Project
Metric Spaces Math 413 Honors Project 1 Metric Spaces Definition 1.1 Let X be a set. A metric on X is a function d : X X R such that for all x, y, z X: i) d(x, y) = d(y, x); ii) d(x, y) = 0 if and only
More informationConnectedness. Proposition 2.2. The following are equivalent for a topological space (X, T ).
Connectedness 1 Motivation Connectedness is the sort of topological property that students love. Its definition is intuitive and easy to understand, and it is a powerful tool in proofs of well-known results.
More informationMATH 426, TOPOLOGY. p 1.
MATH 426, TOPOLOGY THE p-norms In this document we assume an extended real line, where is an element greater than all real numbers; the interval notation [1, ] will be used to mean [1, ) { }. 1. THE p
More informationLecture Notes 1: Vector spaces
Optimization-based data analysis Fall 2017 Lecture Notes 1: Vector spaces In this chapter we review certain basic concepts of linear algebra, highlighting their application to signal processing. 1 Vector
More informationNotions such as convergent sequence and Cauchy sequence make sense for any metric space. Convergent Sequences are Cauchy
Banach Spaces These notes provide an introduction to Banach spaces, which are complete normed vector spaces. For the purposes of these notes, all vector spaces are assumed to be over the real numbers.
More informationMath General Topology Fall 2012 Homework 1 Solutions
Math 535 - General Topology Fall 2012 Homework 1 Solutions Definition. Let V be a (real or complex) vector space. A norm on V is a function : V R satisfying: 1. Positivity: x 0 for all x V and moreover
More informationTHE INVERSE FUNCTION THEOREM
THE INVERSE FUNCTION THEOREM W. PATRICK HOOPER The implicit function theorem is the following result: Theorem 1. Let f be a C 1 function from a neighborhood of a point a R n into R n. Suppose A = Df(a)
More informationCompact operators on Banach spaces
Compact operators on Banach spaces Jordan Bell jordan.bell@gmail.com Department of Mathematics, University of Toronto November 12, 2017 1 Introduction In this note I prove several things about compact
More informationMath 117: Continuity of Functions
Math 117: Continuity of Functions John Douglas Moore November 21, 2008 We finally get to the topic of ɛ δ proofs, which in some sense is the goal of the course. It may appear somewhat laborious to use
More informationINTRODUCTION TO NETS. limits to coincide, since it can be deduced: i.e. x
INTRODUCTION TO NETS TOMMASO RUSSO 1. Sequences do not describe the topology The goal of this rst part is to justify via some examples the fact that sequences are not sucient to describe a topological
More informationMetric Spaces. DEF. If (X; d) is a metric space and E is a nonempty subset, then (E; d) is also a metric space, called a subspace of X:
Metric Spaces DEF. A metric space X or (X; d) is a nonempty set X together with a function d : X X! [0; 1) such that for all x; y; and z in X : 1. d (x; y) 0 with equality i x = y 2. d (x; y) = d (y; x)
More informationLebesgue Measure on R n
CHAPTER 2 Lebesgue Measure on R n Our goal is to construct a notion of the volume, or Lebesgue measure, of rather general subsets of R n that reduces to the usual volume of elementary geometrical sets
More informationRearrangements and polar factorisation of countably degenerate functions G.R. Burton, School of Mathematical Sciences, University of Bath, Claverton D
Rearrangements and polar factorisation of countably degenerate functions G.R. Burton, School of Mathematical Sciences, University of Bath, Claverton Down, Bath BA2 7AY, U.K. R.J. Douglas, Isaac Newton
More informationNotes on nets and convergence in topology
Topology I Humboldt-Universität zu Berlin C. Wendl / F. Schmäschke Summer Semester 2017 Notes on nets and convergence in topology Nets generalize the notion of sequences so that certain familiar results
More information