Derivatives of Functions from R n to R m
|
|
- Lindsey Dorsey
- 5 years ago
- Views:
Transcription
1 Derivatives of Functions from R n to R m Marc H Mehlman Department of Mathematics University of New Haven 20 October Matrices Definition 11 A m n matrix, A, is an array of numbers having m rows and n columns The element of A in the i th row and j th column is denoted by A ij Scalar multiplication of a matrix is accomplished componentwise, ie (ka) ij = ka ij Matrix addition (or subtraction) of two matrices of the same dimensions is also defined componentwise, ie (A + B) ij = A ij + B ij Matrix addition is not defined between matrices of different dimensions Matrix multiplication between an m n matrix, A, and an n p matrix, B, produces an m p matrix, AB The element of AB in the i th row and j th column is obtained by taking the dot product of the i th row of A and the j th column of B, ie, [AB] ij = n A ik B kj = (i th row of A) (j th column of B) k=1 Example 12 [ ] = [ ] 1
2 While matrix multiplication need not be commutative, it is associative and it does obey the distributive laws Convention 13 In the following discussions, vectors x R n will be considered as n 1 matrices, ie, column vectors Definition 14 A function f : R n R m is a linear transformation (sometimes referred to as just linear) iff for every x, y R n and c R, 1 f( x + y) = f( x) + f( y) 2 f(c x) = cf( x) The following proposition is stated without proof, thought the proof is not hard Proposition 15 Let f : R n R m be a linear transformation Then 1 f( ) is continuous and there exists N > 0 (depending on f) such that f( x) N x for all x R n 2 Matrix multiplication is linear, ie, if A is an m n matrix then g( x) def = A x is a linear transformation 3 There exists an m n matrix A such that f( x) = A x 2
3 2 Derivatives Assume m = n = 1, that is f : R R as in Calc I Then f f(x) f(x 0 ) (x 0 ) = f f(x) f(x 0 ) (x 0 ) = 0 x x0 x x 0 x x0 x x [ 0 ] x x0 x x0 f (x 0 ) f(x) f(x 0) = 0 x x [ 0 f (x 0 )(x x 0 ) f(x) f(x 0) x x 0 x x 0 ] = 0 f (x 0 )(x x 0 ) (f(x) f(x 0 ) = 0 x x0 x x 0 f (x 0 )(x x 0 ) (f(x) f(x 0 ) x x0 x x 0 = 0 This suggests: Definition 21 Let f : R n R m The Fréchet Derivative (Jacobian matrix or just Derivative) at x 0 is the m n matrix, Df (if it exists), that satisfies, Df( x x 0 ) (f( x) f) x x 0 = 0 (1) Actually the above definition is potentially flawed since in saying the m n matrix, Df (if it exists) it was implied that there can be at most one m n matrix that satisfies (1) Thus one needs the following theorem which states that a solution to (1) is unique Theorem 22 A solution, Df, to (1) is unique 3
4 Proof If A is a m n matrix that also satisfies (1) then, 0 x x0 Df( x x 0 ) A( x x 0 ) [Df( x x 0 ) (f( x) f)] [A( x x 0 ) (f( x) f)] = x x0 Df( x x 0 ) (f( x) f) A( x x 0 ) (f( x) f) + x x0 x x0 = 0 Thus for any y R n one observes that ( x 0 +t y) x 0 = t y and t 0 x 0 +t y x 0 Thus 0 = x x0 Df( x x 0 ) A( x x 0 ) Df(t y) A(t y) = t 0 t y Df y A y = t 0 y = Df( x 0) y A y y This implies that Df y = A y for all y R n which in turns implies that Df = A, which is what we wanted to show Example 23 If m = n = 1, that is f : R R, then Df(x 0 ) is just f (x 0 ) (the good old Calculus I derivative) since Df(x 0 )(x x 0 ) (f(x) f(x 0 )) = x x 0 x x 0 x x0 Df(x 0) f(x) f(x 0) x x 0 = 0 which implies that Df(x 0 ) = x x0 f(x) f(x 0 ) x x 0 = f (x 0 ) Lemma 24 Let f : R n R m be differentiable at x 0 Then there exists a function λ : R n R m such that f( x) = f + Df( x x 0 ) + λ( x) (2) where x x0 λ( x) = 0 Proof Define λ( x) def = (f( x) f( x 0)) Df( x x 0 ) 4
5 Then λ( ) satisfies (2) and x x0 λ( x) = 0 by (1) Since the λ( x) x x 0 is negligible near x 0, local to x 0 the function f can be thought of as a linear transformation plus a transformation If x 0 = 0 and f( 0) = 0 there is no translation and for small x, one sees that f( x) Df( 0) x, ie, locally the function can be approximated with the linear transformation x Df( 0) x Corollary 25 Let f : R n R m be differentiable at x 0 Then there exists an δ > 0 and an M > 0 so that < δ f( x) f( x 0) < M (3) Proof Defining λ( ) as in (2), let δ > 0 be such that < δ 0 λ( x) < 1 Then for < δ ( ) f( x) f x x0 = Df( x) + λ( x) Letting N be as in Proposition 15, ( ) f( x) f x x0 = Df( x) + λ( x) ( ) x x0 Df( x) + λ( x) N x x 0 + δ = N + δ We now let M = N + δ Theorem 26 (Chain Rule) If g : R n R p is differentiable at x 0 R n and f : R p R m is differentiable at g R p then (f g)( ) is differentiable at x 0 and furthermore, D(f g) = Df(g) Dg (4) 5
6 Proof Look at 0 Df(g( x 0)) Dg( x x 0 ) (f(g( x)) f(g)) = Df(g( x 0)) [Dg( x x 0 ) (g( x) g) + (g( x) g)] (f(g( x)) f(g)) Df(g( x 0)) [g( x) g] (f(g( x)) f(g)) + Df(g( x 0))(Dg( x x 0 )) (g( x) g) We now need to show that the two terms in the last line above go to zero as x x 0 For the first term, by Corollary 25 one can find a δ 0 > 0 and a M > 0 so that < δ 0 g( x) g( x 0) < M Given an ɛ > 0, Df(g)( y g) (f( y) f(g) y g y f(g) implies that there exists δ 1 > 0 so that y g < δ 1 Df(g( x 0))( y g) (f( y) f(g)) y f(g) = 0 < ɛ M Df(g)( y g) (f( y) f(g)) < ɛ M y f(g( x 0)) Since g( ) is differentiable, it is continuous so we can chose δ 2 > 0 so that < δ 2 g( x) g < δ 1 6
7 Letting δ def = min{δ 0, δ 2 } we can conclude that for < δ, Df(g) [g( x) g] (f(g( x)) f(g)) ɛ [g( x) g( x M 0)] ɛ g( x) g M ɛ M M = ɛ Since ɛ was arbitrary, the first term goes to zero For the second term, let N be as in Proposition 15 with x 0 replaced with g Then Df(g) [Dg( x x 0 ) (g( x) g)] x x 0 N [Dg( x x 0 ) (g( x) g)] x x0 = Dg( x x 0 ) (g( x) g) N = N0 = 0 x x0 Example 27 Assume m = n = p = 1, that is f, g : R R Then (4) and Example 23 gives us the ordinary chain rule, (f g) (x 0 ) = f (g(x 0 ))g (x 0 ) Definition 28 Any function f : R n R m can be written as f( x) = (f 1 ( x),, f m ( x)) where f j : R n R for 1 j m are the coordinate functions of f( ) Theorem 29 Let f : R n R m be a function where f( x) = (f 1 ( x),, f m ( x)) where f i : R n R for 1 i m If all of the partial derivatives, f i x j ( x) exist and are continuous at x 0, then Df exists and furthermore, f 1 f x 1 1 x n Df = (5) f m f x 1 m x n Proof First lets assume that m = 1, ie, f : R n R Let x 0 = x 01,, x 0n R n and let 1 j n Define g : R R n by g(x) = x 01,, x 0(j 1), x, x 0(j+1),, x 0n 7
8 where g(x) is x 0 except for the j th coordinate which is x Thus f 0 = (f g) (x 0j ) = Df(g(x 0j )) Dg(x 0j ) = Df = [Df] 1j x j 1 0 and we have shown (5) for m = 1 Now suppose that m is any positive integer and f : R n R m Using the case proved above, it suffices to show that f 1 f x 1 1 x n ( x x 0 ) (f( x) f) f m f x 1 m x m x x 0 Df 1 ( x 0 )( x x 0 ) f 1 ( x) f 1 Df m ( x 0 )( x x 0 ) f m ( x) f m = x x0 Df 1 ( x 0 )( x x 0 ) (f 1 ( x) f 1 ) Df m ( x 0 )( x x 0 ) (f m ( x) f m ) = x x0 m j=1 Df j( x 0 )( x x 0 ) (f j ( x) f j ) x x0 m Df j ( x 0 )( x x 0 ) (f j ( x) f j ) = x x 0 j=1 = 0 Example 210 Let f(x, y) = (x 2 + y, x cos(y), yx 2 ) and g(x, y) = (xy, x y 2 ) Then 8
9 since Df(x, y) = 2x 1 cos(y) x sin(y) 2xy x 2, one has D(f g)(x, y) = Df(g(x, y)) Dg(x, y) = Df(xy, x y 2 ) Dg(x, y) 2xy 1 [ ] = cos(x y 2 ) xy sin(x y 2 ) y x 2xy(x y 2 ) x 2 y 2 1 2y 2xy x 2 y 2y = y cos(x y 2 ) xy sin(x y 2 ) x cos(x y 2 ) 2xy 2 sin(x y 2 ) 2xy 2 (x y 2 ) + x 2 y 2 2x 2 y(x y 2 ) 2x 2 y 3 3 Derivatives: Another Viewpoint When considering the function f : R n R m consider a control panel with n levers in front of you These levers control m cranes in the distance Moving the j th lever up can cause more than one crane to move When the levers are in x 0 R n position, f k x j measures the movement in the k th crane when pushing the j th lever When the levers are in x 0 position, the dynamics of the entire apparatus is described by the set of partials { } fk : 1 k m & 1 j n (6) x j The matrix derivative, Df = f 1 x 1 f m x 1 f 1 x n f m x n can be thought of a bookkeeper s way of organizing the partials The m n matrix derivative contains all the information given by (6) In addition, the bookkeepers way of organizing the partials is particularly fortunate in that D(f g) corresponds 9
10 to Df(g) Dg, ie, the one dimensional chain rule formula works here too, with matrix multiplication taking the place of ordinary multiplication This alternate way of view the Fréchet derivative is accurate as far as it goes, but it is not how most mathematicians picture the Fréchet derivative because this bookkeeper s viewpoint does not encompasses all the important aspects of the Fréchet derivative Lost here is the notion of the Fréchet derivative, Df, being the linear transformation that best approximates f( ) at x 0 Indeed, one needs Definition 21 to obtain Lemma 24 used in the next section 4 Differentials Lemma 24 tells us that when x R n is close to x 0 R n then Df( x x 0 ) (f( x) f) 0 f( x) f + Df( x x 0 ) (7) This is quite good since the error, by Lemma 24 is just λ( x) x x 0, a quantity that goes to zero doubly fast as x x 0 If f : R n R, one is thus led to: Definition 41 Given the points x 0 = x 01,, x 0n R n and x = x 1,, x n R n and the differentiable function f : R n R, the quantity Df( x x 0 ) = f x1 (x 1 x 01 ) + + f xn (x n x 0n ) is called the total differential of f( ) and is written as df def = f x1 dx f xn dx n where dx j def = x j x 0j If f : R n R, (7) becomes f( x) f + df One can show that the above equation is just another way of saying that a function can locally be approximated with its tangent plane 10
11 Equation (7) is very useful as seen in the following example Example 42 Let f(x, y) = x 2 + y 2 Find an approximate answer for f(305, 396) Solution: Let (x 0, y 0 ) = (3, 4) Then f x (x, y) = 1 2 (x2 + y 2 ) 1 2 2x f y (x, y) = 1 2 (x2 + y 2 ) 1 2 2y Thus using (7) f(305, 396) f(3, 4)+ [ f x (3, 4) f y (3, 4) ] [ ] = 5+ [ ] [ ] = 4998 Using a calculator one has f(305, 396) = , so our approximation is quite good! 5 Specific Instances of Chain Rule The remaining theorems in this section are just, in truth, examples of the multivariate chain rule They are mentioned here as theorems solely to be consistent with our book Theorem 51 Let f(x, y) = z be a differentiable function Let x : R R and y : R R also be differentiable functions Then letting h(t) def = f(x(t), y(t)) one has h (t) = f x (x(t), y(t))x (t) + f y (x(t), y(t))y (t) Proof Let g(t) def = (x(t), y(t)) Then g : R R 2 and h (t) = (f g) (t) = D(f g)(t) = Df(g(t)) Dg(t) = [ f x (x(t), y(t)) f y (x(t), y(t)) ] [ ] x (t) y (t) = f x (x(t), y(t))x (t) + f y (x(t), y(t))y (t) 11
12 Theorem 52 Let f(x, y, z) = w be a differentiable function Let x, y, z : R R be differentiable functions Then letting h(t) def = f(x(t), y(t), z(t)) one has h (t) = f x (x(t), y(t), z(t))x (t) + f y (x(t), y(t), z(t))y (t) + f z (x(t), y(t), z(t))z (t) Proof See the proof of Theorem 51 Theorem 53 Let f : R 2 R and x, y : R 2 R be differentiable functions Then letting h(s, t) def = f(x(s, t), y(s, t)) one has h s (s, t) = f x (x(s, t), y(s, t))x s (s, t) + f y (x(s, t), y(s, t))y s (s, t) h t (s, t) = f x (x(s, t), y(s, t))x t (s, t) + f y (x(s, t), y(s, t))y t (s, t) Proof Let g(s, t) def = (x(s, t), y(s, t)) Then g : R 2 R 2 and [ hs (x(s, t), y(s, t)) h t (x(s, t), y(s, t)) ] = Dh(s, t) = D(f g)(s, t) = Df(g(s, t)) Dg(s, t) = [ f x (x(s, t), y(s, t)) f y (x(s, t), y(s, t)) ] [ x s (s, t) x t (s, t) y s (s, t) y t (s, t) After computing the above matrix multiplication, the theorem is proved by comparing the components of the first and last matrices above ] 6 Summary Definition 61 Given f : R n R m, the m n matrix, Df, that satisfies Df( x x 0 ) (f( x) f) x x 0 = 0, is called the Fréchet Derivative of f( ) at x 0 Theorem 62 (Chain Rule) If g : R n R p is differentiable at x 0 R n and f : R p R m is differentiable at g R p then (f g)( ) is differentiable at x 0 and furthermore, D(f g) = Df(g) Dg 12
13 Theorem 63 Let f : R n R m be a function where f( x) = (f 1 ( x),, f m ( x)) where f i : R n R for 1 i m If all of the partial derivatives, f i x j ( x) exist and are continuous at x 0, then Df exists and furthermore, f 1 f x 1 1 x n Df = f m f x 1 m x n From Lemma 24 we have the important fact that f( x) f + Df( x x 0 ) This motivates us to present the following definition Definition 64 Given the points x 0 = x 01,, x 0n R n and x = x 1,, x n R n and the differentiable function f : R n R, the quantity Df( x x 0 ) = f x1 (x 1 x 01 ) + + f xn (x n x 0n ) is called the total differential of f( ) and is written as df def = f x1 dx f xn dx n where dx j def = x j x 0j And finally we have the three following special cases of the multivariate chain rule: Theorem 65 Let f(x, y) = z be a differentiable function Let x : R R and y : R R also be differentiable functions Then letting h(t) def = f(x(t), y(t)) one has h (t) = f x (x(t), y(t))x (t) + f y (x(t), y(t))y (t) Theorem 66 Let f(x, y, z) = w be a differentiable function Let x, y, z : R R be differentiable functions Then letting h(t) def = f(x(t), y(t), z(t)) one has h (t) = f x (x(t), y(t), z(t))x (t) + f y (x(t), y(t), z(t))y (t) + f z (x(t), y(t), z(t))z (t) 13
14 Theorem 67 Let f : R 2 R and x, y : R 2 R be differentiable functions Then letting h(s, t) def = f(x(s, t), y(s, t)) one has h s (s, t) = f x (x(s, t), y(s, t))x s (s, t) + f y (x(s, t), y(s, t))y s (s, t) h t (s, t) = f x (x(s, t), y(s, t))x t (s, t) + f y (x(s, t), y(s, t))y t (s, t) 7 Exercises Let f : R 2 R 3, let g : R 3 R 2, let h : R 2 R and let j : R R 2 be such that f(x, y) def = (x, xy, x sin(y)) g(1, π/3, 3/2) = (π/3, 3/4) [ ] Dg(x, y, z) = z 2 0 2xz h(x, y) j(x) l(x, y) def = x 2 + y + cx def = (2x 1, 3 cos(x)) def = (h g f)(x, y) 1 Letting k(t) def = h(2t 1, 3 cos(t)), what is k (0)? 2 What is D(h j)(0)? 3 What is Df(1, π/3)? 4 What is D(g f)(1, π/3)? 5 Given that l y (1, π/3) = 6, what is c? Hint: look at Dl(1, π/3) 6 Find the approximate length of the largest stick that will fit in a box of length 201, width 197, and height 102 using differentials Compare this to the actual length 14
15 References [1] James R Munkres Analysis on Manifolds Addison-Wesley, Redwood City, 1991 [2] Michael Spivak Calculus on Manifolds Benjamin, New York,
g(t) = f(x 1 (t),..., x n (t)).
Reading: [Simon] p. 313-333, 833-836. 0.1 The Chain Rule Partial derivatives describe how a function changes in directions parallel to the coordinate axes. Now we shall demonstrate how the partial derivatives
More informationSec. 1.1: Basics of Vectors
Sec. 1.1: Basics of Vectors Notation for Euclidean space R n : all points (x 1, x 2,..., x n ) in n-dimensional space. Examples: 1. R 1 : all points on the real number line. 2. R 2 : all points (x 1, x
More informationMATH The Chain Rule Fall 2016 A vector function of a vector variable is a function F: R n R m. In practice, if x 1, x n is the input,
MATH 20550 The Chain Rule Fall 2016 A vector function of a vector variable is a function F: R n R m. In practice, if x 1, x n is the input, F(x 1,, x n ) F 1 (x 1,, x n ),, F m (x 1,, x n ) where each
More informationNote: Every graph is a level set (why?). But not every level set is a graph. Graphs must pass the vertical line test. (Level sets may or may not.
Curves in R : Graphs vs Level Sets Graphs (y = f(x)): The graph of f : R R is {(x, y) R y = f(x)} Example: When we say the curve y = x, we really mean: The graph of the function f(x) = x That is, we mean
More informationNOTES ON MULTIVARIABLE CALCULUS: DIFFERENTIAL CALCULUS
NOTES ON MULTIVARIABLE CALCULUS: DIFFERENTIAL CALCULUS SAMEER CHAVAN Abstract. This is the first part of Notes on Multivariable Calculus based on the classical texts [6] and [5]. We present here the geometric
More information25. Chain Rule. Now, f is a function of t only. Expand by multiplication:
25. Chain Rule The Chain Rule is present in all differentiation. If z = f(x, y) represents a two-variable function, then it is plausible to consider the cases when x and y may be functions of other variable(s).
More informationTHE INVERSE FUNCTION THEOREM
THE INVERSE FUNCTION THEOREM W. PATRICK HOOPER The implicit function theorem is the following result: Theorem 1. Let f be a C 1 function from a neighborhood of a point a R n into R n. Suppose A = Df(a)
More informationThe Derivative. Appendix B. B.1 The Derivative of f. Mappings from IR to IR
Appendix B The Derivative B.1 The Derivative of f In this chapter, we give a short summary of the derivative. Specifically, we want to compare/contrast how the derivative appears for functions whose domain
More informationFebruary 11, 2019 LECTURE 5: THE RULES OF DIFFERENTIATION.
February 11, 2019 LECTURE 5: THE RULES OF DIFFERENTIATION 110211 HONORS MULTIVARIABLE CALCULUS PROFESSOR RICHARD BROWN Synopsis Here, we bring back the rules for differentiation used to derive new functions
More informationContents. 2 Partial Derivatives. 2.1 Limits and Continuity. Calculus III (part 2): Partial Derivatives (by Evan Dummit, 2017, v. 2.
Calculus III (part 2): Partial Derivatives (by Evan Dummit, 2017, v 260) Contents 2 Partial Derivatives 1 21 Limits and Continuity 1 22 Partial Derivatives 5 23 Directional Derivatives and the Gradient
More informationg(2, 1) = cos(2π) + 1 = = 9
1. Let gx, y 2x 2 cos2πy 2 + y 2. You can use the fact that Dg2, 1 [8 2]. a Find an equation for the tangent plane to the graph z gx, y at the point 2, 1. There are two key parts to this problem. The first,
More informationReview of Multi-Calculus (Study Guide for Spivak s CHAPTER ONE TO THREE)
Review of Multi-Calculus (Study Guide for Spivak s CHPTER ONE TO THREE) This material is for June 9 to 16 (Monday to Monday) Chapter I: Functions on R n Dot product and norm for vectors in R n : Let X
More informationREVIEW OF DIFFERENTIAL CALCULUS
REVIEW OF DIFFERENTIAL CALCULUS DONU ARAPURA 1. Limits and continuity To simplify the statements, we will often stick to two variables, but everything holds with any number of variables. Let f(x, y) be
More informationDefinition 5.1. A vector field v on a manifold M is map M T M such that for all x M, v(x) T x M.
5 Vector fields Last updated: March 12, 2012. 5.1 Definition and general properties We first need to define what a vector field is. Definition 5.1. A vector field v on a manifold M is map M T M such that
More informationMulti Variable Calculus
Multi Variable Calculus Joshua Wilde, revised by Isabel Tecu, Takeshi Suzuki and María José Boccardi August 3, 03 Functions from R n to R m So far we have looked at functions that map one number to another
More informationTHEODORE VORONOV DIFFERENTIABLE MANIFOLDS. Fall Last updated: November 26, (Under construction.)
4 Vector fields Last updated: November 26, 2009. (Under construction.) 4.1 Tangent vectors as derivations After we have introduced topological notions, we can come back to analysis on manifolds. Let M
More informationSection x7 +
Difference Equations to Differential Equations Section 5. Polynomial Approximations In Chapter 3 we discussed the problem of finding the affine function which best approximates a given function about some
More informationChain Rule. MATH 311, Calculus III. J. Robert Buchanan. Spring Department of Mathematics
3.33pt Chain Rule MATH 311, Calculus III J. Robert Buchanan Department of Mathematics Spring 2019 Single Variable Chain Rule Suppose y = g(x) and z = f (y) then dz dx = d (f (g(x))) dx = f (g(x))g (x)
More informationMA2AA1 (ODE s): The inverse and implicit function theorem
MA2AA1 (ODE s): The inverse and implicit function theorem Sebastian van Strien (Imperial College) February 3, 2013 Differential Equations MA2AA1 Sebastian van Strien (Imperial College) 0 Some of you did
More informationThe theory of manifolds Lecture 2
The theory of manifolds Lecture 2 Let X be a subset of R N, Y a subset of R n and f : X Y a continuous map. We recall Definition 1. f is a C map if for every p X, there exists a neighborhood, U p, of p
More informationM311 Functions of Several Variables. CHAPTER 1. Continuity CHAPTER 2. The Bolzano Weierstrass Theorem and Compact Sets CHAPTER 3.
M311 Functions of Several Variables 2006 CHAPTER 1. Continuity CHAPTER 2. The Bolzano Weierstrass Theorem and Compact Sets CHAPTER 3. Differentiability 1 2 CHAPTER 1. Continuity If (a, b) R 2 then we write
More informationMath 212-Lecture 8. The chain rule with one independent variable
Math 212-Lecture 8 137: The multivariable chain rule The chain rule with one independent variable w = f(x, y) If the particle is moving along a curve x = x(t), y = y(t), then the values that the particle
More informationThe Inverse Function Theorem 1
John Nachbar Washington University April 11, 2014 1 Overview. The Inverse Function Theorem 1 If a function f : R R is C 1 and if its derivative is strictly positive at some x R, then, by continuity of
More informationMATH 31BH Homework 5 Solutions
MATH 3BH Homework 5 Solutions February 4, 204 Problem.8.2 (a) Let x t f y = x 2 + y 2 + 2z 2 and g(t) = t 2. z t 3 Then by the chain rule a a a D(g f) b = Dg f b Df b c c c = [Dg(a 2 + b 2 + 2c 2 )] [
More informationDifferentiation. f(x + h) f(x) Lh = L.
Analysis in R n Math 204, Section 30 Winter Quarter 2008 Paul Sally, e-mail: sally@math.uchicago.edu John Boller, e-mail: boller@math.uchicago.edu website: http://www.math.uchicago.edu/ boller/m203 Differentiation
More information1 Functions of Several Variables Some Examples Level Curves / Contours Functions of More Variables... 6
Contents 1 Functions of Several Variables 1 1.1 Some Examples.................................. 2 1.2 Level Curves / Contours............................. 4 1.3 Functions of More Variables...........................
More informationMathematical Economics: Lecture 9
Mathematical Economics: Lecture 9 Yu Ren WISE, Xiamen University October 17, 2011 Outline 1 Chapter 14: Calculus of Several Variables New Section Chapter 14: Calculus of Several Variables Partial Derivatives
More informationd(x n, x) d(x n, x nk ) + d(x nk, x) where we chose any fixed k > N
Problem 1. Let f : A R R have the property that for every x A, there exists ɛ > 0 such that f(t) > ɛ if t (x ɛ, x + ɛ) A. If the set A is compact, prove there exists c > 0 such that f(x) > c for all x
More informationIowa State University. Instructor: Alex Roitershtein Summer Homework #5. Solutions
Math 50 Iowa State University Introduction to Real Analysis Department of Mathematics Instructor: Alex Roitershtein Summer 205 Homework #5 Solutions. Let α and c be real numbers, c > 0, and f is defined
More informationz x = f x (x, y, a, b), z y = f y (x, y, a, b). F(x, y, z, z x, z y ) = 0. This is a PDE for the unknown function of two independent variables.
Chapter 2 First order PDE 2.1 How and Why First order PDE appear? 2.1.1 Physical origins Conservation laws form one of the two fundamental parts of any mathematical model of Continuum Mechanics. These
More informationSection 3.5 The Implicit Function Theorem
Section 3.5 The Implicit Function Theorem THEOREM 11 (Special Implicit Function Theorem): Suppose that F : R n+1 R has continuous partial derivatives. Denoting points in R n+1 by (x, z), where x R n and
More informationWeek 4: Differentiation for Functions of Several Variables
Week 4: Differentiation for Functions of Several Variables Introduction A functions of several variables f : U R n R is a rule that assigns a real number to each point in U, a subset of R n, For the next
More informationSeveral variables. x 1 x 2. x n
Several variables Often we have not only one, but several variables in a problem The issues that come up are somewhat more complex than for one variable Let us first start with vector spaces and linear
More informationHow to Use Calculus Like a Physicist
How to Use Calculus Like a Physicist Physics A300 Fall 2004 The purpose of these notes is to make contact between the abstract descriptions you may have seen in your calculus classes and the applications
More informationx 1. x n i + x 2 j (x 1, x 2, x 3 ) = x 1 j + x 3
Version: 4/1/06. Note: These notes are mostly from my 5B course, with the addition of the part on components and projections. Look them over to make sure that we are on the same page as regards inner-products,
More informationDifferentiation in higher dimensions
Capter 2 Differentiation in iger dimensions 2.1 Te Total Derivative Recall tat if f : R R is a 1-variable function, and a R, we say tat f is differentiable at x = a if and only if te ratio f(a+) f(a) tends
More informationLecture Notes on Metric Spaces
Lecture Notes on Metric Spaces Math 117: Summer 2007 John Douglas Moore Our goal of these notes is to explain a few facts regarding metric spaces not included in the first few chapters of the text [1],
More information4 Partial Differentiation
4 Partial Differentiation Many equations in engineering, physics and mathematics tie together more than two variables. For example Ohm s Law (V = IR) and the equation for an ideal gas, PV = nrt, which
More informationSMSTC (2017/18) Geometry and Topology 2.
SMSTC (2017/18) Geometry and Topology 2 Lecture 1: Differentiable Functions and Manifolds in R n Lecturer: Diletta Martinelli (Notes by Bernd Schroers) a wwwsmstcacuk 11 General remarks In this lecture
More informationMAT 473 Intermediate Real Analysis II
MAT 473 Intermediate Real Analysis II John Quigg Spring 2009 revised February 5, 2009 Derivatives Here our purpose is to give a rigorous foundation of the principles of differentiation in R n. Much of
More informationf(x) f(z) c x z > 0 1
INVERSE AND IMPLICIT FUNCTION THEOREMS I use df x for the linear transformation that is the differential of f at x.. INVERSE FUNCTION THEOREM Definition. Suppose S R n is open, a S, and f : S R n is a
More informationPartial Derivatives for Math 229. Our puropose here is to explain how one computes partial derivatives. We will not attempt
Partial Derivatives for Math 229 Our puropose here is to explain how one computes partial derivatives. We will not attempt to explain how they arise or why one would use them; that is left to other courses
More informationImplicit Functions, Curves and Surfaces
Chapter 11 Implicit Functions, Curves and Surfaces 11.1 Implicit Function Theorem Motivation. In many problems, objects or quantities of interest can only be described indirectly or implicitly. It is then
More informationSome suggested repetition for the course MAA508
Some suggested repetition for the course MAA58 Linus Carlsson, Karl Lundengård, Johan Richter July, 14 Contents Introduction 1 1 Basic algebra and trigonometry Univariate calculus 5 3 Linear algebra 8
More informationLecture 13 - Wednesday April 29th
Lecture 13 - Wednesday April 29th jacques@ucsdedu Key words: Systems of equations, Implicit differentiation Know how to do implicit differentiation, how to use implicit and inverse function theorems 131
More informationMath 361: Homework 1 Solutions
January 3, 4 Math 36: Homework Solutions. We say that two norms and on a vector space V are equivalent or comparable if the topology they define on V are the same, i.e., for any sequence of vectors {x
More information3.1. Derivations. Let A be a commutative k-algebra. Let M be a left A-module. A derivation of A in M is a linear map D : A M such that
ALGEBRAIC GROUPS 33 3. Lie algebras Now we introduce the Lie algebra of an algebraic group. First, we need to do some more algebraic geometry to understand the tangent space to an algebraic variety at
More informationMath 480 The Vector Space of Differentiable Functions
Math 480 The Vector Space of Differentiable Functions The vector space of differentiable functions. Let C (R) denote the set of all infinitely differentiable functions f : R R. Then C (R) is a vector space,
More informationINTRODUCTION TO ALGEBRAIC GEOMETRY
INTRODUCTION TO ALGEBRAIC GEOMETRY WEI-PING LI 1 Preliminary of Calculus on Manifolds 11 Tangent Vectors What are tangent vectors we encounter in Calculus? (1) Given a parametrised curve α(t) = ( x(t),
More informationParametric Equations, Function Composition and the Chain Rule: A Worksheet
Parametric Equations, Function Composition and the Chain Rule: A Worksheet Prof.Rebecca Goldin Oct. 8, 003 1 Parametric Equations We have seen that the graph of a function f(x) of one variable consists
More informationODEs Cathal Ormond 1
ODEs Cathal Ormond 2 1. Separable ODEs Contents 2. First Order ODEs 3. Linear ODEs 4. 5. 6. Chapter 1 Separable ODEs 1.1 Definition: An ODE An Ordinary Differential Equation (an ODE) is an equation whose
More informationMATH 251 Final Examination May 3, 2017 FORM A. Name: Student Number: Section:
MATH 5 Final Examination May 3, 07 FORM A Name: Student Number: Section: This exam has 6 questions for a total of 50 points. In order to obtain full credit for partial credit problems, all work must be
More informationVANDERBILT UNIVERSITY. MATH 2300 MULTIVARIABLE CALCULUS Practice Test 1 Solutions
VANDERBILT UNIVERSITY MATH 2300 MULTIVARIABLE CALCULUS Practice Test 1 Solutions Directions. This practice test should be used as a study guide, illustrating the concepts that will be emphasized in the
More informationMultiple Choice Answers. MA 114 Calculus II Spring 2013 Final Exam 1 May Question
MA 114 Calculus II Spring 2013 Final Exam 1 May 2013 Name: Section: Last 4 digits of student ID #: This exam has six multiple choice questions (six points each) and five free response questions with points
More informationX. Linearization and Newton s Method
163 X. Linearization and Newton s Method ** linearization ** X, Y nls s, f : G X Y. Given y Y, find z G s.t. fz = y. Since there is no assumption about f being linear, we might as well assume that y =.
More informationBROUWER FIXED POINT THEOREM. Contents 1. Introduction 1 2. Preliminaries 1 3. Brouwer fixed point theorem 3 Acknowledgments 8 References 8
BROUWER FIXED POINT THEOREM DANIELE CARATELLI Abstract. This paper aims at proving the Brouwer fixed point theorem for smooth maps. The theorem states that any continuous (smooth in our proof) function
More informationLECTURE 5: SMOOTH MAPS. 1. Smooth Maps
LECTURE 5: SMOOTH MAPS 1. Smooth Maps Recall that a smooth function on a smooth manifold M is a function f : M R so that for any chart 1 {ϕ α, U α, V α } of M, the function f ϕ 1 α is a smooth function
More informationChapter 8: Taylor s theorem and L Hospital s rule
Chapter 8: Taylor s theorem and L Hospital s rule Theorem: [Inverse Mapping Theorem] Suppose that a < b and f : [a, b] R. Given that f (x) > 0 for all x (a, b) then f 1 is differentiable on (f(a), f(b))
More informationLecture notes for Math Multivariable Calculus
Lecture notes for Math 417-517 Multivariable alculus J. Dimock Dept. of Mathematics SUNY at Buffalo Buffalo, NY 14260 December 4, 2012 ontents 1 multivariable calculus 3 1.1 vectors....................................
More informationMath 117: Continuity of Functions
Math 117: Continuity of Functions John Douglas Moore November 21, 2008 We finally get to the topic of ɛ δ proofs, which in some sense is the goal of the course. It may appear somewhat laborious to use
More informationMATHEMATICAL ECONOMICS: OPTIMIZATION. Contents
MATHEMATICAL ECONOMICS: OPTIMIZATION JOÃO LOPES DIAS Contents 1. Introduction 2 1.1. Preliminaries 2 1.2. Optimal points and values 2 1.3. The optimization problems 3 1.4. Existence of optimal points 4
More informationSometimes the domains X and Z will be the same, so this might be written:
II. MULTIVARIATE CALCULUS The first lecture covered functions where a single input goes in, and a single output comes out. Most economic applications aren t so simple. In most cases, a number of variables
More informationSection 3.7. Rolle s Theorem and the Mean Value Theorem
Section.7 Rolle s Theorem and the Mean Value Theorem The two theorems which are at the heart of this section draw connections between the instantaneous rate of change and the average rate of change of
More informationMath 321 Final Exam. 1. Do NOT write your answers on these sheets. Nothing written on the test papers will be graded.
Math 31 Final Exam Instructions 1 Do NOT write your answers on these sheets Nothing written on the test papers will be graded Please begin each section of questions on a new sheet of paper 3 Do not write
More informationSARD S THEOREM ALEX WRIGHT
SARD S THEOREM ALEX WRIGHT Abstract. A proof of Sard s Theorem is presented, and applications to the Whitney Embedding and Immersion Theorems, the existence of Morse functions, and the General Position
More informationM4P52 Manifolds, 2016 Problem Sheet 1
Problem Sheet. Let X and Y be n-dimensional topological manifolds. Prove that the disjoint union X Y is an n-dimensional topological manifold. Is S S 2 a topological manifold? 2. Recall that that the discrete
More informationFebruary 4, 2019 LECTURE 4: THE DERIVATIVE.
February 4, 29 LECTURE 4: THE DERIVATIVE 2 HONORS MULTIVARIABLE CALCULUS PROFESSOR RICHARD BROWN Synopsis Today, we finish our discussion on its and pass through the concept of continuity Really, there
More informationn f(k) k=1 means to evaluate the function f(k) at k = 1, 2,..., n and add up the results. In other words: n f(k) = f(1) + f(2) f(n). 1 = 2n 2.
Handout on induction and written assignment 1. MA113 Calculus I Spring 2007 Why study mathematical induction? For many students, mathematical induction is an unfamiliar topic. Nonetheless, this is an important
More informationDefinition 3 (Continuity). A function f is continuous at c if lim x c f(x) = f(c).
Functions of Several Variables A function of several variables is just what it sounds like. It may be viewed in at least three different ways. We will use a function of two variables as an example. z =
More informationChapter 3a Topics in differentiation. Problems in differentiation. Problems in differentiation. LC Abueg: mathematical economics
Chapter 3a Topics in differentiation Lectures in Mathematical Economics L Cagandahan Abueg De La Salle University School of Economics Problems in differentiation Problems in differentiation Problem 1.
More informationMATH 423/ Note that the algebraic operations on the right hand side are vector subtraction and scalar multiplication.
MATH 423/673 1 Curves Definition: The velocity vector of a curve α : I R 3 at time t is the tangent vector to R 3 at α(t), defined by α (t) T α(t) R 3 α α(t + h) α(t) (t) := lim h 0 h Note that the algebraic
More information21-256: Partial differentiation
21-256: Partial differentiation Clive Newstead, Thursday 5th June 2014 This is a summary of the important results about partial derivatives and the chain rule that you should know. Partial derivatives
More information1. Nonlinear Equations. This lecture note excerpted parts from Michael Heath and Max Gunzburger. f(x) = 0
Numerical Analysis 1 1. Nonlinear Equations This lecture note excerpted parts from Michael Heath and Max Gunzburger. Given function f, we seek value x for which where f : D R n R n is nonlinear. f(x) =
More informationDRAFT - Math 101 Lecture Note - Dr. Said Algarni
2 Limits 2.1 The Tangent Problems The word tangent is derived from the Latin word tangens, which means touching. A tangent line to a curve is a line that touches the curve and a secant line is a line that
More informationLecture 5: Functions : Images, Compositions, Inverses
Lecture 5: Functions : Images, Compositions, Inverses 1 Functions We have all seen some form of functions in high school. For example, we have seen polynomial, exponential, logarithmic, trigonometric functions
More informationf(s)ds, i.e. to write down the general solution in
1. First order ODEs. Simplest examples. Existence and uniqueness theorem Example 1.1. Consider the equation (1.1) x (t) = 1 This is an equation because there is an unknown: the function x(t). This is a
More informationOptimization and Calculus
Optimization and Calculus To begin, there is a close relationship between finding the roots to a function and optimizing a function. In the former case, we solve for x. In the latter, we solve: g(x) =
More informationMATH 105: PRACTICE PROBLEMS FOR CHAPTER 3: SPRING 2010
MATH 105: PRACTICE PROBLEMS FOR CHAPTER 3: SPRING 010 INSTRUCTOR: STEVEN MILLER (SJM1@WILLIAMS.EDU Question 1 : Compute the partial derivatives of order 1 order for: (1 f(x, y, z = e x+y cos(x sin(y. Solution:
More informationTHE WAVE EQUATION. F = T (x, t) j + T (x + x, t) j = T (sin(θ(x, t)) + sin(θ(x + x, t)))
THE WAVE EQUATION The aim is to derive a mathematical model that describes small vibrations of a tightly stretched flexible string for the one-dimensional case, or of a tightly stretched membrane for the
More informationFebruary 27, 2019 LECTURE 10: VECTOR FIELDS.
February 27, 209 LECTURE 0: VECTOR FIELDS 02 HONORS MULTIVARIABLE CALCULUS PROFESSOR RICHARD BROWN Synopsis Vector fields, as geometric objects and/or functions, provide a backbone in which all of physics
More informationChapter 1 of Calculus ++ : Differential calculus with several variables
Chapter 1 of Calculus ++ : Differential calculus with several variables Gradients, Hessians and Jacobians for functions of two variables by Eric A Carlen Professor of Mathematics Georgia Tech Spring 2006
More informationExercises for Multivariable Differential Calculus XM521
This document lists all the exercises for XM521. The Type I (True/False) exercises will be given, and should be answered, online immediately following each lecture. The Type III exercises are to be done
More informationChapter 4. The First Fundamental Form (Induced Metric)
Chapter 4. The First Fundamental Form (Induced Metric) We begin with some definitions from linear algebra. Def. Let V be a vector space (over IR). A bilinear form on V is a map of the form B : V V IR which
More informationn=0 ( 1)n /(n + 1) converges, but not
Math 07H Topics for the third exam (and beyond) (Technically, everything covered on the first two exams plus...) Absolute convergence and alternating series A series a n converges absolutely if a n converges.
More informationCourse Summary Math 211
Course Summary Math 211 table of contents I. Functions of several variables. II. R n. III. Derivatives. IV. Taylor s Theorem. V. Differential Geometry. VI. Applications. 1. Best affine approximations.
More informationMultiple Choice Answers. MA 113 Calculus I Spring 2018 Exam 2 Tuesday, 6 March Question
MA 113 Calculus I Spring 2018 Exam 2 Tuesday, 6 March 2018 Name: Section: Last 4 digits of student ID #: This exam has 12 multiple choice questions (five points each) and 4 free response questions (ten
More information10. Smooth Varieties. 82 Andreas Gathmann
82 Andreas Gathmann 10. Smooth Varieties Let a be a point on a variety X. In the last chapter we have introduced the tangent cone C a X as a way to study X locally around a (see Construction 9.20). It
More informationSample Questions Exam II, FS2009 Paulette Saab Calculators are neither needed nor allowed.
Sample Questions Exam II, FS2009 Paulette Saab Calculators are neither needed nor allowed. Part A: (SHORT ANSWER QUESTIONS) Do the following problems. Write the answer in the space provided. Only the answers
More informationTANGENT VECTORS. THREE OR FOUR DEFINITIONS.
TANGENT VECTORS. THREE OR FOUR DEFINITIONS. RMONT We define and try to understand the tangent space of a manifold Q at a point q, as well as vector fields on a manifold. The tangent space at q Q is a real
More informationMAT137 Calculus! Lecture 6
MAT137 Calculus! Lecture 6 Today: 3.2 Differentiation Rules; 3.3 Derivatives of higher order. 3.4 Related rates 3.5 Chain Rule 3.6 Derivative of Trig. Functions Next: 3.7 Implicit Differentiation 4.10
More informationThe Heine-Borel and Arzela-Ascoli Theorems
The Heine-Borel and Arzela-Ascoli Theorems David Jekel October 29, 2016 This paper explains two important results about compactness, the Heine- Borel theorem and the Arzela-Ascoli theorem. We prove them
More informationJUST THE MATHS UNIT NUMBER PARTIAL DIFFERENTIATION 1 (Partial derivatives of the first order) A.J.Hobson
JUST THE MATHS UNIT NUMBER 14.1 PARTIAL DIFFERENTIATION 1 (Partial derivatives of the first order) by A.J.Hobson 14.1.1 Functions of several variables 14.1.2 The definition of a partial derivative 14.1.3
More informationMath 111: Calculus. David Perkinson
Math : Calculus David Perkinson Fall 207 Contents Week, Monday: Introduction: derivatives, integrals, and the fundamental theorem. 5 Week, Wednesday: Average speed, instantaneous speed. Definition of the
More informationVector Calculus lecture notes
Vector Calculus lecture notes Thomas Baird December 13, 21 Contents 1 Geometry of R 3 2 1.1 Coordinate Systems............................... 2 1.1.1 Distance................................. 3 1.1.2 Surfaces.................................
More information3 Applications of partial differentiation
Advanced Calculus Chapter 3 Applications of partial differentiation 37 3 Applications of partial differentiation 3.1 Stationary points Higher derivatives Let U R 2 and f : U R. The partial derivatives
More information1.1 Single Variable Calculus versus Multivariable Calculus Rectangular Coordinate Systems... 4
MATH2202 Notebook 1 Fall 2015/2016 prepared by Professor Jenny Baglivo Contents 1 MATH2202 Notebook 1 3 1.1 Single Variable Calculus versus Multivariable Calculus................... 3 1.2 Rectangular Coordinate
More informationALGEBRAIC GROUPS: PART III
ALGEBRAIC GROUPS: PART III EYAL Z. GOREN, MCGILL UNIVERSITY Contents 10. The Lie algebra of an algebraic group 47 10.1. Derivations 47 10.2. The tangent space 47 10.2.1. An intrinsic algebraic definition
More information2. Lie groups as manifolds. SU(2) and the three-sphere. * version 1.4 *
. Lie groups as manifolds. SU() and the three-sphere. * version 1.4 * Matthew Foster September 1, 017 Contents.1 The Haar measure 1. The group manifold for SU(): S 3 3.3 Left- and right- group translations
More informationSelected Solutions. where cl(ω) are the cluster points of Ω and Ω are the set of boundary points.
Selected Solutions Section 9 (Open and Closed Sets) 9K. Let Ω R p. The original problem asks: Show a point belongs to Ω if and only if it is an interior point. Let nt(ω) be the set of all interior point
More informationMetric Spaces and Topology
Chapter 2 Metric Spaces and Topology From an engineering perspective, the most important way to construct a topology on a set is to define the topology in terms of a metric on the set. This approach underlies
More information