REVIEW OF DIFFERENTIAL CALCULUS
|
|
- Vincent Russell
- 5 years ago
- Views:
Transcription
1 REVIEW OF DIFFERENTIAL CALCULUS DONU ARAPURA 1. Limits and continuity To simplify the statements, we will often stick to two variables, but everything holds with any number of variables. Let f(x, y) be a real valued function defined on open subset of R 2. The it f(x, y) = L (x,y) (a,b) means that f(x, y) is approximately L whenever (x, y) is close to (a, b). The precise meaning is as follows. If we specified ɛ > 0 (say ɛ = ), then we could pick a tolerance δ > 0 which would guarantee that f(x, y) L < ɛ (i.e. f(x, y) agrees with L up to the first 3 digits for ɛ = ) whenever the distance between (x, y) and (a, b) is less than δ. Here are a few examples. Example 1.1. Consider (x,y) (0,0) x 2 x 2 + y 2 Along the x-axis (y = 0), the fraction is identically 1. Which means that the it would have to be 1 if it existed. However, along the y-axis (x = 0), the fraction is identically 0. So the it would have to be 0 if it existed. The two statements are contradictory, so we must conclude that it does not exist. Example 1.2. Consider (x,y) (0,0) x 3 x 2 + y 2 The same sort of analysis, would show that the its along the x and y axes are both zero. This leads us to suspect the answer is 0, but it is not enough to draw a definite conclusion. Instead, we the definition. Given ɛ > 0, we have to find δ > 0 so that x 3 x 2 + y 2 < ɛ when (x, y) < δ. If we rewrite this using polar coordinates, we get x 3 x 2 + y 2 = r 3 cos 3 θ r 2 = r cos3 θ r 3 while (x, y) = r. Observing that r 3 < r when r < 1, shows that we can take δ = ɛ if ɛ < 1 and (say) δ = 1 2 otherwise. Date: February 14,
2 2 DONU ARAPURA A function f(x, y) is continuous at (a, b) if f(x, y) (x,y) (a,b) exists and equals f(a, b). It is continuous if it is so at each point of its domain. Most of the basic of functions are continuous. Theorem 1.3. The following are functions of one or two variables are continuous (1) f(x, y) = x + y, (x, y) R 2 (2) f(x, y) = xy, (x, y) R 2 (3) f(x, y) = x y, (x, y) R2, y 0 (4) exp(x) = e x, x R (5) sin x, x R (6) cos x, x R (7) log x, x > 0 (we always use log = log e = ln). The next theorem will allow us to build more complicated continous functiobns from continuous parts. Theorem 1.4. If f(y 1,, y m ), g 1 (x 1,, x n ), are continuous. Then so is Example 1.5. Check that f(g 1 (x 1,, x n ),, g m (x 1,, x n )) f(x, y) = { sin(x 2 +y 2 ) x 2 +y 2 if (x, y) (0, 0) 1 if (x, y) = (0, 0) is continuous on R 2. For the solution, we introduce the auxillary function { sin(t) g(t) = t if t 0 1 if t = 0 This is clearly continous for t 0 by the above theorems. It is also continuous at t = 0, because we have t 0 g(t) = 1 by L Hopital s rule. Therefore f(x, y) = g(x 2 + y 2 ) is continuous everywhere. 2. Differentiability Given a function f(x, y), the partial derivatives x (x f(x 0 + h, y 0 ) f(x 0, y 0 ) 0, y 0 ) = f x (x 0, y 0 ) = h 0 h y (x f(x 0, y 0 + h) f(x 0, y 0 ) 0, y 0 ) = f y (x 0, y 0 ) = h 0 h These are slopes of the curves obtained by slicing z = f(x, y) parallel to the x and y axes. We say that f is differentiable, if near any point p = (x 0, y 0, f(x 0, y 0 )) the graph z = f(x, y) can approximated by a plane passing through p. In other words, there exists quantities A, B such that we may write with f(x, y) = f(x 0, y 0 ) + A(x x 0 ) + B(y y 0 ) + remainder (x,y) (x 0,y 0) remainder (x, y) (x 0, y 0 ) = 0
3 REVIEW OF DIFFERENTIAL CALCULUS 3 An equivalent way to express the last condition is that for every ɛ > 0 remainder < ɛ (x, y) (x 0, y 0 ) when the distance (x, y) (x 0, y 0 ) is small enough. The idea is that as the distance (x, y) (x 0, y 0 ) goes to zero, the remainder goes to zero at an even faster rate. We can see that the coefficients are nothing but the partial derivatives A = x (x 0, y 0 ), B = y (x 0, y 0 ) There is a stronger condition which is generally easier to check. f is called continuously differentiable or C 1 if it and its partial derivatives exist and are continuous. Theorem 2.1. A C 1 function is differentiable. Example 2.2. Check that f(x, y) = e x + cos xy is C 1. An easy calculation show that f x = e x y sin xy and f y = x sin xy. These functions are easily seen to be continous using the previous criteria. Example 2.3. Let f(x, y) = The partials are xy x2 +y 2 with f(x, y) = 0 is continuous (check this). x = y 3 (x 2 + y 2 ) 3/2 y = x 3 (x 2 + y 2 ) 3/2 But these are not continuous at the origin (check). So f is not C 1. More work shows that it is not differentiable either. 3. Chain rule In one variable, if y = f(x), x = g(t) where f and g are differentiable, then the chain rule says dy dt = dy dx dx dt Rewriting this in functional notation (f g) (t) = f (g(t))g (t) should convince you that there is more to it than just canceling dx. Let us start with the simplest analogue for several variables. Theorem 3.1. Suppose that z = f(x, y), x = g(t), y = h(t), where the functions are differentiable. Then dz dt = z dx x dt + z dz y dt Proof. In outline, g(t + t) = g(t) + g (t) t + R 1 h(t + t) = h(t) + h (t) t + R 2 where the remainders R i / t 0 as 0. Using differentiability of f, we can see that f(g(t+ t), h(t+ t)) = f(g(t), h(t))+f x (g(t), h(t))g (t) t+f y (g(t), h(t))h (t) t+r 3
4 4 DONU ARAPURA where R 3 / t 0. This implies f(g(t + t), h(t + t)) f(g(t), h(t)) t = f x(g(t), h(t))g (t) t + f y (g(t), h(t))h (t) t + R 3 t f x (g(t), h(t))g (t) + f y (g(t), h(t))h (t) To state the general form, let F : R n R m be a vector valued function. This can be written out as F (x 1, x n ) = (f 1 (x 1,, x n ), f 2 (x 1,, x n ), ) where the f i are scalar valued functions. The matrix or Jacobian derivative 1 1 x 1 x 2 DF = 2 2 x 1 x 2 This is an m n matrix valued function. We say that F is differentiable if F (v + h) = F (v) + DF (v)h + remainder where, as before, the remainder goes to 0 as h 0 at the same rate or faster. Also to be clear v, h R n are vectors. The expression DF (v)h means, first evaluate the function DF at v, and then multiply the resulting matrix with h. Theorem 3.2 (Chain rule). Given differentiable functions F : R n R m and G : R m R p, the function G F (v) = G(F (v)) is also differentiable. Its derivative and D(G F )(v) = DG(F (v))df (v) To see what this means more concretely, write where and Then the chain rule says that ( ) y1 y 1 u 1 u 2 y 2 = u 1 x i = f i (u 1,, u n ) y i = g i (x 1,, x m ) F (u 1,, u n ) = (f 1 (u 1,, u n ), ) G(x 1,, x m ) = (g 1 (x 1,, x m ), ) ) ( ) x 2 x1 x 1 u 1 u 2 x x 1 2 u 1 ( y1 y 1 x 1 y 2 This can be written out as a series of equations y i u j = y i x 1 x 1 u j + y i x 2 x 2 u j + y i x n x n u j
5 REVIEW OF DIFFERENTIAL CALCULUS 5 4. gradient Given f(x 1, x 2, ), the matrix derivative is usually called the gradient f = Df = (,, ) x 1 x 2 To understand what this means, let us work in the plane. Given a unit vector v = (v 1, v 2 ) R 2, the directional derivative of f along v at (x 0, y 0 ) is f(x + v 1 h, y + v 2 h) f(x, y) h 0 h This is the slope of the curve obtained by cutting the surface z = f(x, y) by a line parallel to v. Theorem 4.1. If f is differentiable, then the direction derivative of f along v is f v = x v 1 + y v 2 Proof. The directional derivative can be rewritten as dz dt, where x = x 0 + v 1 t, y = y 0 + v 2 t. Therefore chain rules shows that dz dt = dx x dt + dy y dt = x v 1 + y v 2 Given a unit vector v making angle θ with f, the directional derivative f v = f cos θ is maximized when θ = 0. We can summarize this as Corollary 4.2. The gradient f points in the direction where f increases the fastest, and f points in the direction where f decreases the fastest. Theorem 4.3. The gradient f(x 0, y 0, z) gives a normal to the surface f(x, y, z) = c at (x 0, y 0, z 0 ). Proof. We have to show that f v = 0 for any tangent vector v to the surface at (x 0, y 0, z 0 ). Such a vector is the tangent vector to some curve C lying on the surface. We can parameterize it by x = g(t), y = h(t), z = k(t) with (x 0, y 0, z 0 ) corresponding to t = 0. Since C lies on the surface f(g(t), h(t), k(t)) = c Differentiating both sides and using the chain rule gives dx x dt + dy y dt + g dz t dt = 0 We can write this as f v = 0 which is what we wanted to prove. 5. Second order derivatives Given z = f(x, y), the second order partial derivatives are defined by x 2 = 2 z x 2 = f xx = z xx = ( ) x x x y = 2 z x y = f yx = z yx = x ( y )
6 6 DONU ARAPURA y x = 2 z x y = f xy = z xy = ( ) y x ( ) y y 2 = 2 f y 2 = f yy = z yy = y A similar story holds for more than two variables. A function f(x 1, x 2, ) is twice continuously differentiable or C 2 if its partial derivatives up to second order exist and are continuous. Theorem 5.1. If f(x 1, x 2, ) is C 2 then the mixed partials are equal x j x i = 2 f x i x j Proof. We just outline the proof for f(x, y). We have = x 0 = x y = f y (x + x, y) f y (x, y) x 0 x [ 1 f(x + x, y + y) f(x + x, y) x y 0 y y 0 x 0 y 0 By a similar argument y 0 x 0 ] f(x, y + y) f(x, y) y 1 [f(x + x, y + y) f(x + x, y) f(x, y + y) + f(x, y)] x y y x = 1 [f(x + x, y + y) f(x + x, y) f(x, y + y) + f(x, y)] x y If we could interchange the it symbols we would be done. As a general rule, this is not always possible. However, in our case, using the C 2 condition it can be shown that both expressions coincide with ( x, y) (0,0) 1 x y [f(x + x, y + y) f(x + x, y) f(x, y + y) + f(x, y)] If f(x, y) is C 2, then we have a Taylor expansion [ ] [ ] f(x, y) = f(a, b) + (a, b) (x a) + (a, b) (y b) + 1 x y 2 [ 2 ] f + (a, b) (x a)(y b) + 1 y x 2 [ 2 ] f (a, b) (y b) 2 + R y2 [ 2 ] f (a, b) (x a) 2 x2 To be useful, we need to know that remainder R is small when (x, y) is close to (a, b). Here is the precise statement. Theorem 5.2. The remainder R satisfies (x,y) (a,b) R (x, y) (a, b) 2 0
7 REVIEW OF DIFFERENTIAL CALCULUS 7 Proof. Let g(t) = f(a + t(x a), b + t(y b)). This is a C 2 function. So by the usual Taylor formula for one variable, (1) g(t) = g(0) + g (0)t g (0)t 2 + R where R/t 2 0 as t 0. By the chain rule g (t) = f x (a + t(x a), b + t(y b))(x a) + f y (a + t(x a), b + t(x b))(y b) g (t) = f xx (a + t(x a), b + t(y b))(x a) 2 + Substituting into (1) and setting t = 1, gives the two variable Taylor expansion where the remainder behaves as stated. 6. Maxima-Minima Partial derivatives can be used to determine maxima and minima. Given a C 1 function on R n, a critical point is where the gradient is zero. We have the following basic fact: Theorem 6.1. If f is C 1 function on R n with a local maximum or minimum at a point, then this is a critical point. Proof. Let us assume that n = 2 and call the point (a, b). Let z = f(x, y) be the graph. By calculus of one variable the slope of the curves z = f(x, b) and z = f(a, y) are zero (a, b). This means that partial derivatives are zero at (a, b). Example 6.2. Let f(x, y) = sin x sin y. Setting f x = cos x sin y = 0 and f y = sin x cos y = 0 gives infinitely many solutions (0, 0), (π/2, π/2), To proceed further, we need the second derivative test. Now suppose that (a, b) = (0, 0) is a critical point. Then Taylor s formula reduces to f(x, y) = f(0, 0) + 1 [ fxx (0, 0)x 2 + 2f xy (0, 0)xy + f yy (0, 0)y 2] + R 2 where the remainder R is small in the sense of theorem 5.2. Let us rewrite the quadratic part (in square brackets) as Q(x, y) = Ax 2 + 2Bxy + Cy 2 We want to assume that this quadratic function is nondegenerate in the sense that it Q(x, y) 0 unless (x, y) = (0, 0). Then it will dominate the remainder, so it controls how f(x, y) behaves close to (0, 0). Suppose for now that A 0. Then we can complete the square Ax 2 + 2Bxy + Cy 2 = A(x + B A y)2 + 1 A (AC B2 )y 2 Notice that AC B 2 cannot be zero because of our nondegeneracy condition. It follows that if A > 0 and the discriminant AC B 2 > 0, then we always have Q(x, y) > 0, if (x, y) (0, 0) Therefore we have local minimum at (0, 0). If A < 0 and AC B 2 > 0, then Q(x, y) < 0, if (x, y) (0, 0)
8 8 DONU ARAPURA Therefore we have a local maximum at (0, 0). Finally, suppose that AC B < 0, then signs of the coefficients of A(x + B A y)2 + 1 A (AC B2 )y 2 are opposite. This means that we have a saddle point at (0, 0). With a bit more work, we can see that this conclusion holds even if A = 0. To summarize: Theorem 6.3. If (a, b) is the critical point of a C 2 function f(x, y). Then (1) It is a local minimum of f xx (a, b) > 0 and f xx (0, 0)f yy (0, 0) f xy (0, 0) 2 > 0. (2) It is a local minimum of f xx (a, b) < 0 and f xx (0, 0)f yy (0, 0) f xy (0, 0) 2 > 0. (3) It is a saddle point if f xx (0, 0)f yy (0, 0) f xy (0, 0) 2 < 0. (4) If f xx (0, 0)f yy (0, 0) f xy (0, 0) 2 = 0, Q is degenerate, so the test gives no information. Example 6.4. To finish example 6.2. Let f(x, y) = sin x sin y, f xx = sin x sin y, f xy = cos x cos y, f yy = sin x sin y. At (0, 0), the discriminant f xx (0, 0)f yy (0, 0) f xy (0, 0) 2 = 1, so this is a saddle point. At (π/2, π/2), f xx (π/2, π/2) = 1 and the discriminant is 1, so this gives a local maximum. To finish the story, we have to explain how the second derivative test works in more than two variables. If f(x 1,, x n ) is C 2, we have a Taylor expansion n f(x 1,, x n ) = f(0,, 0) + (0,, 0)x i x i n n i=1 j=1 i=1 x i x j (0,, 0)x i x j + R where we are expanding around the origin for simplicity. The remainder R goes to zero fast as (x 1,, x n ) (0,, 0). Let us write h ij = Q(x 1,, x n ) = f x i x j (0,, 0) n i=1 j=1 n h ij x i x j Then the h ij forms an n n matrix H, called the Hessian; more precisely it is the Hessian evaluated at (0,, 0). We know that h ij = h ji by equality of mixed partials. Therefore H is a symmetric matrix. The last condition can be expressed by saying that H is equal to its transpose H T. The function Q, or matrix H, is called nondegenerate if Q(x 1,, x n ) 0 when (x 1,, x n ) is nonzero, positive definite if Q(x 1,, x n ) > 0 when (x 1,, x n ) is nonzero, negative definite if Q(x 1,, x n ) < 0 when (x 1,, x n ) is nonzero, Now suppose (0,, 0) is a critical point, then Taylor s formula becomes f(x 1,, x n ) = f(0,, 0) Q(x 1,, x n ) + R When Q is nondegenerate, it controls the behaviour near the critical point. Here is the general second derivative test. Theorem 6.5. If H is the Hessian evaluated at critical point of f, then
9 REVIEW OF DIFFERENTIAL CALCULUS 9 (1) if H is positive definite, the point is local minimum, (2) if H is negative definite, the point is local minimum, (3) in all other cases, either H is nondegenerate and the point is a saddle point, or else H is degenerate and the test is inconclusive. In order to turn this into a useful test, we need a method for checking when a matrix H is positive or negative definite. If H is a diagonal matrix then there is an obvious criterion: it is positive definite exactly when the diagonal entries are all positive. To extend this to general matrices, we recall a definition from linear algebra. A real or complex number λ is called an eigenvalue of H if there is a nonzero n 1 column vector v, called an eigenvector, such that Hv = λv There is a standard method for finding the eigenvalues for a matrix which can be found in any book on linear algebra. Or else on can do this numerically using a computer. The following result is a consequence of the spectral theorem in linear algebra. Theorem 6.6. If H is a real symmetric matrix, then all its eigenvalues are real. H is positive definite (respectively negative definite) if and only all its eigenvalues are positive (respectively negative). This leads to a practical test to find maxima and minima when combined with previous theorem.
Calculus 2502A - Advanced Calculus I Fall : Local minima and maxima
Calculus 50A - Advanced Calculus I Fall 014 14.7: Local minima and maxima Martin Frankland November 17, 014 In these notes, we discuss the problem of finding the local minima and maxima of a function.
More informationContents. 2 Partial Derivatives. 2.1 Limits and Continuity. Calculus III (part 2): Partial Derivatives (by Evan Dummit, 2017, v. 2.
Calculus III (part 2): Partial Derivatives (by Evan Dummit, 2017, v 260) Contents 2 Partial Derivatives 1 21 Limits and Continuity 1 22 Partial Derivatives 5 23 Directional Derivatives and the Gradient
More informationDefinition 3 (Continuity). A function f is continuous at c if lim x c f(x) = f(c).
Functions of Several Variables A function of several variables is just what it sounds like. It may be viewed in at least three different ways. We will use a function of two variables as an example. z =
More informationMA102: Multivariable Calculus
MA102: Multivariable Calculus Rupam Barman and Shreemayee Bora Department of Mathematics IIT Guwahati Differentiability of f : U R n R m Definition: Let U R n be open. Then f : U R n R m is differentiable
More informationChapter 2: Unconstrained Extrema
Chapter 2: Unconstrained Extrema Math 368 c Copyright 2012, 2013 R Clark Robinson May 22, 2013 Chapter 2: Unconstrained Extrema 1 Types of Sets Definition For p R n and r > 0, the open ball about p of
More informationOR MSc Maths Revision Course
OR MSc Maths Revision Course Tom Byrne School of Mathematics University of Edinburgh t.m.byrne@sms.ed.ac.uk 15 September 2017 General Information Today JCMB Lecture Theatre A, 09:30-12:30 Mathematics revision
More informationThe Derivative. Appendix B. B.1 The Derivative of f. Mappings from IR to IR
Appendix B The Derivative B.1 The Derivative of f In this chapter, we give a short summary of the derivative. Specifically, we want to compare/contrast how the derivative appears for functions whose domain
More information3.5 Quadratic Approximation and Convexity/Concavity
3.5 Quadratic Approximation and Convexity/Concavity 55 3.5 Quadratic Approximation and Convexity/Concavity Overview: Second derivatives are useful for understanding how the linear approximation varies
More information3 Applications of partial differentiation
Advanced Calculus Chapter 3 Applications of partial differentiation 37 3 Applications of partial differentiation 3.1 Stationary points Higher derivatives Let U R 2 and f : U R. The partial derivatives
More informationPRACTICE PROBLEMS FOR MIDTERM I
Problem. Find the limits or explain why they do not exist (i) lim x,y 0 x +y 6 x 6 +y ; (ii) lim x,y,z 0 x 6 +y 6 +z 6 x +y +z. (iii) lim x,y 0 sin(x +y ) x +y Problem. PRACTICE PROBLEMS FOR MIDTERM I
More information4 Partial Differentiation
4 Partial Differentiation Many equations in engineering, physics and mathematics tie together more than two variables. For example Ohm s Law (V = IR) and the equation for an ideal gas, PV = nrt, which
More informationMTH4101 CALCULUS II REVISION NOTES. 1. COMPLEX NUMBERS (Thomas Appendix 7 + lecture notes) ax 2 + bx + c = 0. x = b ± b 2 4ac 2a. i = 1.
MTH4101 CALCULUS II REVISION NOTES 1. COMPLEX NUMBERS (Thomas Appendix 7 + lecture notes) 1.1 Introduction Types of numbers (natural, integers, rationals, reals) The need to solve quadratic equations:
More informationHW3 - Due 02/06. Each answer must be mathematically justified. Don t forget your name. 1 2, A = 2 2
HW3 - Due 02/06 Each answer must be mathematically justified Don t forget your name Problem 1 Find a 2 2 matrix B such that B 3 = A, where A = 2 2 If A was diagonal, it would be easy: we would just take
More informationSystems of Linear ODEs
P a g e 1 Systems of Linear ODEs Systems of ordinary differential equations can be solved in much the same way as discrete dynamical systems if the differential equations are linear. We will focus here
More informationMath 5BI: Problem Set 6 Gradient dynamical systems
Math 5BI: Problem Set 6 Gradient dynamical systems April 25, 2007 Recall that if f(x) = f(x 1, x 2,..., x n ) is a smooth function of n variables, the gradient of f is the vector field f(x) = ( f)(x 1,
More informationTaylor Series and stationary points
Chapter 5 Taylor Series and stationary points 5.1 Taylor Series The surface z = f(x, y) and its derivatives can give a series approximation for f(x, y) about some point (x 0, y 0 ) as illustrated in Figure
More informationStudy Guide/Practice Exam 3
Study Guide/Practice Exam 3 This study guide/practice exam covers only the material since exam. The final exam, however, is cumulative so you should be sure to thoroughly study earlier material. The distribution
More informationSolutions to Dynamical Systems 2010 exam. Each question is worth 25 marks.
Solutions to Dynamical Systems exam Each question is worth marks [Unseen] Consider the following st order differential equation: dy dt Xy yy 4 a Find and classify all the fixed points of Hence draw the
More informationSIMPLE MULTIVARIATE OPTIMIZATION
SIMPLE MULTIVARIATE OPTIMIZATION 1. DEFINITION OF LOCAL MAXIMA AND LOCAL MINIMA 1.1. Functions of variables. Let f(, x ) be defined on a region D in R containing the point (a, b). Then a: f(a, b) is a
More informationLecture 6 Positive Definite Matrices
Linear Algebra Lecture 6 Positive Definite Matrices Prof. Chun-Hung Liu Dept. of Electrical and Computer Engineering National Chiao Tung University Spring 2017 2017/6/8 Lecture 6: Positive Definite Matrices
More information(x + 3)(x 1) lim(x + 3) = 4. lim. (x 2)( x ) = (x 2)(x + 2) x + 2 x = 4. dt (t2 + 1) = 1 2 (t2 + 1) 1 t. f(x) = lim 3x = 6,
Math 140 MT1 Sample C Solutions Tyrone Crisp 1 (B): First try direct substitution: you get 0. So try to cancel common factors. We have 0 x 2 + 2x 3 = x 1 and so the it as x 1 is equal to (x + 3)(x 1),
More informationMATH Max-min Theory Fall 2016
MATH 20550 Max-min Theory Fall 2016 1. Definitions and main theorems Max-min theory starts with a function f of a vector variable x and a subset D of the domain of f. So far when we have worked with functions
More informationg(t) = f(x 1 (t),..., x n (t)).
Reading: [Simon] p. 313-333, 833-836. 0.1 The Chain Rule Partial derivatives describe how a function changes in directions parallel to the coordinate axes. Now we shall demonstrate how the partial derivatives
More informationFIRST-ORDER SYSTEMS OF ORDINARY DIFFERENTIAL EQUATIONS III: Autonomous Planar Systems David Levermore Department of Mathematics University of Maryland
FIRST-ORDER SYSTEMS OF ORDINARY DIFFERENTIAL EQUATIONS III: Autonomous Planar Systems David Levermore Department of Mathematics University of Maryland 4 May 2012 Because the presentation of this material
More information11 a 12 a 21 a 11 a 22 a 12 a 21. (C.11) A = The determinant of a product of two matrices is given by AB = A B 1 1 = (C.13) and similarly.
C PROPERTIES OF MATRICES 697 to whether the permutation i 1 i 2 i N is even or odd, respectively Note that I =1 Thus, for a 2 2 matrix, the determinant takes the form A = a 11 a 12 = a a 21 a 11 a 22 a
More informationModule Two: Differential Calculus(continued) synopsis of results and problems (student copy)
Module Two: Differential Calculus(continued) synopsis of results and problems (student copy) Srikanth K S 1 Syllabus Taylor s and Maclaurin s theorems for function of one variable(statement only)- problems.
More informationFIXED POINT ITERATIONS
FIXED POINT ITERATIONS MARKUS GRASMAIR 1. Fixed Point Iteration for Non-linear Equations Our goal is the solution of an equation (1) F (x) = 0, where F : R n R n is a continuous vector valued mapping in
More informationThis exam will be over material covered in class from Monday 14 February through Tuesday 8 March, corresponding to sections in the text.
Math 275, section 002 (Ultman) Spring 2011 MIDTERM 2 REVIEW The second midterm will be held in class (1:40 2:30pm) on Friday 11 March. You will be allowed one half of one side of an 8.5 11 sheet of paper
More informationChapter 4. Inverse Function Theorem. 4.1 The Inverse Function Theorem
Chapter 4 Inverse Function Theorem d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d d dd d d d d This chapter
More informationTEST CODE: MMA (Objective type) 2015 SYLLABUS
TEST CODE: MMA (Objective type) 2015 SYLLABUS Analytical Reasoning Algebra Arithmetic, geometric and harmonic progression. Continued fractions. Elementary combinatorics: Permutations and combinations,
More informationFunctions of Several Variables
Functions of Several Variables The Unconstrained Minimization Problem where In n dimensions the unconstrained problem is stated as f() x variables. minimize f()x x, is a scalar objective function of vector
More informationNote: Every graph is a level set (why?). But not every level set is a graph. Graphs must pass the vertical line test. (Level sets may or may not.
Curves in R : Graphs vs Level Sets Graphs (y = f(x)): The graph of f : R R is {(x, y) R y = f(x)} Example: When we say the curve y = x, we really mean: The graph of the function f(x) = x That is, we mean
More informationBasics of Calculus and Algebra
Monika Department of Economics ISCTE-IUL September 2012 Basics of linear algebra Real valued Functions Differential Calculus Integral Calculus Optimization Introduction I A matrix is a rectangular array
More informationWeek 4: Differentiation for Functions of Several Variables
Week 4: Differentiation for Functions of Several Variables Introduction A functions of several variables f : U R n R is a rule that assigns a real number to each point in U, a subset of R n, For the next
More informationMath 600 Day 1: Review of advanced Calculus
Math 600 Day 1: Review of advanced Calculus Ryan Blair University of Pennsylvania Thursday September 8, 2010 Ryan Blair (U Penn) Math 600 Day 1: Review of advanced Calculus Thursday September 8, 2010 1
More informationChapter 7. Extremal Problems. 7.1 Extrema and Local Extrema
Chapter 7 Extremal Problems No matter in theoretical context or in applications many problems can be formulated as problems of finding the maximum or minimum of a function. Whenever this is the case, advanced
More informationIntroduction to gradient descent
6-1: Introduction to gradient descent Prof. J.C. Kao, UCLA Introduction to gradient descent Derivation and intuitions Hessian 6-2: Introduction to gradient descent Prof. J.C. Kao, UCLA Introduction Our
More informationDEPARTMENT OF MATHEMATICS AND STATISTICS UNIVERSITY OF MASSACHUSETTS. MATH 233 SOME SOLUTIONS TO EXAM 2 Fall 2018
DEPARTMENT OF MATHEMATICS AND STATISTICS UNIVERSITY OF MASSACHUSETTS MATH 233 SOME SOLUTIONS TO EXAM 2 Fall 208 Version A refers to the regular exam and Version B to the make-up. Version A. A particle
More informationTranspose & Dot Product
Transpose & Dot Product Def: The transpose of an m n matrix A is the n m matrix A T whose columns are the rows of A. So: The columns of A T are the rows of A. The rows of A T are the columns of A. Example:
More informationGradient Descent. Dr. Xiaowei Huang
Gradient Descent Dr. Xiaowei Huang https://cgi.csc.liv.ac.uk/~xiaowei/ Up to now, Three machine learning algorithms: decision tree learning k-nn linear regression only optimization objectives are discussed,
More informationTangent spaces, normals and extrema
Chapter 3 Tangent spaces, normals and extrema If S is a surface in 3-space, with a point a S where S looks smooth, i.e., without any fold or cusp or self-crossing, we can intuitively define the tangent
More informationTEST CODE: MIII (Objective type) 2010 SYLLABUS
TEST CODE: MIII (Objective type) 200 SYLLABUS Algebra Permutations and combinations. Binomial theorem. Theory of equations. Inequalities. Complex numbers and De Moivre s theorem. Elementary set theory.
More informationTHE NATIONAL UNIVERSITY OF IRELAND, CORK COLÁISTE NA hollscoile, CORCAIGH UNIVERSITY COLLEGE, CORK. Summer Examination 2009.
OLLSCOIL NA héireann, CORCAIGH THE NATIONAL UNIVERSITY OF IRELAND, CORK COLÁISTE NA hollscoile, CORCAIGH UNIVERSITY COLLEGE, CORK Summer Examination 2009 First Engineering MA008 Calculus and Linear Algebra
More informationTangent Planes, Linear Approximations and Differentiability
Jim Lambers MAT 80 Spring Semester 009-10 Lecture 5 Notes These notes correspond to Section 114 in Stewart and Section 3 in Marsden and Tromba Tangent Planes, Linear Approximations and Differentiability
More informationChapter 11. Taylor Series. Josef Leydold Mathematical Methods WS 2018/19 11 Taylor Series 1 / 27
Chapter 11 Taylor Series Josef Leydold Mathematical Methods WS 2018/19 11 Taylor Series 1 / 27 First-Order Approximation We want to approximate function f by some simple function. Best possible approximation
More informationOptimization and Calculus
Optimization and Calculus To begin, there is a close relationship between finding the roots to a function and optimizing a function. In the former case, we solve for x. In the latter, we solve: g(x) =
More informationThe Theory of Second Order Linear Differential Equations 1 Michael C. Sullivan Math Department Southern Illinois University
The Theory of Second Order Linear Differential Equations 1 Michael C. Sullivan Math Department Southern Illinois University These notes are intended as a supplement to section 3.2 of the textbook Elementary
More informationMath 291-3: Lecture Notes Northwestern University, Spring 2016
Math 291-3: Lecture Notes Northwestern University, Spring 216 Written by Santiago Cañez These are lecture notes for Math 291-3, the third quarter of MENU: Intensive Linear Algebra and Multivariable Calculus,
More informationWe denote the derivative at x by DF (x) = L. With respect to the standard bases of R n and R m, DF (x) is simply the matrix of partial derivatives,
The derivative Let O be an open subset of R n, and F : O R m a continuous function We say F is differentiable at a point x O, with derivative L, if L : R n R m is a linear transformation such that, for
More informationCalculus for the Life Sciences II Assignment 6 solutions. f(x, y) = 3π 3 cos 2x + 2 sin 3y
Calculus for the Life Sciences II Assignment 6 solutions Find the tangent plane to the graph of the function at the point (0, π f(x, y = 3π 3 cos 2x + 2 sin 3y Solution: The tangent plane of f at a point
More informationTranspose & Dot Product
Transpose & Dot Product Def: The transpose of an m n matrix A is the n m matrix A T whose columns are the rows of A. So: The columns of A T are the rows of A. The rows of A T are the columns of A. Example:
More informationEcon 204 (2015) - Final 08/19/2015
Econ 04 (015 - Final 08/19/015 Instructions: This is a closed book exam. You have 3 hours. The weight of each question is indicated next to it. Write clearly, explain your answers, and be concise. You
More information446 CHAP. 8 NUMERICAL OPTIMIZATION. Newton's Search for a Minimum of f(x,y) Newton s Method
446 CHAP. 8 NUMERICAL OPTIMIZATION Newton's Search for a Minimum of f(xy) Newton s Method The quadratic approximation method of Section 8.1 generated a sequence of seconddegree Lagrange polynomials. It
More informationAn Overly Simplified and Brief Review of Differential Equation Solution Methods. 1. Some Common Exact Solution Methods for Differential Equations
An Overly Simplified and Brief Review of Differential Equation Solution Methods We will be dealing with initial or boundary value problems. A typical initial value problem has the form y y 0 y(0) 1 A typical
More informationMATH 307: Problem Set #3 Solutions
: Problem Set #3 Solutions Due on: May 3, 2015 Problem 1 Autonomous Equations Recall that an equilibrium solution of an autonomous equation is called stable if solutions lying on both sides of it tend
More informationChapter 4: Partial differentiation
Chapter 4: Partial differentiation It is generally the case that derivatives are introduced in terms of functions of a single variable. For example, y = f (x), then dy dx = df dx = f. However, most of
More informationReview for the Final Exam
Math 171 Review for the Final Exam 1 Find the limits (4 points each) (a) lim 4x 2 3; x x (b) lim ( x 2 x x 1 )x ; (c) lim( 1 1 ); x 1 ln x x 1 sin (x 2) (d) lim x 2 x 2 4 Solutions (a) The limit lim 4x
More informationConvex Functions and Optimization
Chapter 5 Convex Functions and Optimization 5.1 Convex Functions Our next topic is that of convex functions. Again, we will concentrate on the context of a map f : R n R although the situation can be generalized
More informationMultivariable Calculus
2 Multivariable Calculus 2.1 Limits and Continuity Problem 2.1.1 (Fa94) Let the function f : R n R n satisfy the following two conditions: (i) f (K ) is compact whenever K is a compact subset of R n. (ii)
More information8. Diagonalization.
8. Diagonalization 8.1. Matrix Representations of Linear Transformations Matrix of A Linear Operator with Respect to A Basis We know that every linear transformation T: R n R m has an associated standard
More informationa x a y = a x+y a x a = y ax y (a x ) r = a rx and log a (xy) = log a (x) + log a (y) log a ( x y ) = log a(x) log a (y) log a (x r ) = r log a (x).
You should prepare the following topics for our final exam. () Pre-calculus. (2) Inverses. (3) Algebra of Limits. (4) Derivative Formulas and Rules. (5) Graphing Techniques. (6) Optimization (Maxima and
More informationNOTES ON MULTIVARIABLE CALCULUS: DIFFERENTIAL CALCULUS
NOTES ON MULTIVARIABLE CALCULUS: DIFFERENTIAL CALCULUS SAMEER CHAVAN Abstract. This is the first part of Notes on Multivariable Calculus based on the classical texts [6] and [5]. We present here the geometric
More information(x 3)(x + 5) = (x 3)(x 1) = x + 5. sin 2 x e ax bx 1 = 1 2. lim
SMT Calculus Test Solutions February, x + x 5 Compute x x x + Answer: Solution: Note that x + x 5 x x + x )x + 5) = x )x ) = x + 5 x x + 5 Then x x = + 5 = Compute all real values of b such that, for fx)
More information2tdt 1 y = t2 + C y = which implies C = 1 and the solution is y = 1
Lectures - Week 11 General First Order ODEs & Numerical Methods for IVPs In general, nonlinear problems are much more difficult to solve than linear ones. Unfortunately many phenomena exhibit nonlinear
More informationSOLUTIONS TO THE FINAL EXAM. December 14, 2010, 9:00am-12:00 (3 hours)
SOLUTIONS TO THE 18.02 FINAL EXAM BJORN POONEN December 14, 2010, 9:00am-12:00 (3 hours) 1) For each of (a)-(e) below: If the statement is true, write TRUE. If the statement is false, write FALSE. (Please
More informationHigher Mathematics Course Notes
Higher Mathematics Course Notes Equation of a Line (i) Collinearity: (ii) Gradient: If points are collinear then they lie on the same straight line. i.e. to show that A, B and C are collinear, show that
More informationM311 Functions of Several Variables. CHAPTER 1. Continuity CHAPTER 2. The Bolzano Weierstrass Theorem and Compact Sets CHAPTER 3.
M311 Functions of Several Variables 2006 CHAPTER 1. Continuity CHAPTER 2. The Bolzano Weierstrass Theorem and Compact Sets CHAPTER 3. Differentiability 1 2 CHAPTER 1. Continuity If (a, b) R 2 then we write
More informationChapter 3a Topics in differentiation. Problems in differentiation. Problems in differentiation. LC Abueg: mathematical economics
Chapter 3a Topics in differentiation Lectures in Mathematical Economics L Cagandahan Abueg De La Salle University School of Economics Problems in differentiation Problems in differentiation Problem 1.
More informationChapter 4. Several-variable calculus. 4.1 Derivatives of Functions of Several Variables Functions of Several Variables
Chapter 4 Several-variable calculus 4.1 Derivatives of Functions of Several Variables 4.1.1 Functions of Several Variables ² A function f of n variables (x 1,x 2,...,x n ) in R n is an entity that operates
More informationAnalysis II - few selective results
Analysis II - few selective results Michael Ruzhansky December 15, 2008 1 Analysis on the real line 1.1 Chapter: Functions continuous on a closed interval 1.1.1 Intermediate Value Theorem (IVT) Theorem
More informationLINEAR ALGEBRA BOOT CAMP WEEK 4: THE SPECTRAL THEOREM
LINEAR ALGEBRA BOOT CAMP WEEK 4: THE SPECTRAL THEOREM Unless otherwise stated, all vector spaces in this worksheet are finite dimensional and the scalar field F is R or C. Definition 1. A linear operator
More informationMaxima and Minima. (a, b) of R if
Maxima and Minima Definition Let R be any region on the xy-plane, a function f (x, y) attains its absolute or global, maximum value M on R at the point (a, b) of R if (i) f (x, y) M for all points (x,
More informationEngg. Math. I. Unit-I. Differential Calculus
Dr. Satish Shukla 1 of 50 Engg. Math. I Unit-I Differential Calculus Syllabus: Limits of functions, continuous functions, uniform continuity, monotone and inverse functions. Differentiable functions, Rolle
More informationMath 350 Solutions for Final Exam Page 1. Problem 1. (10 points) (a) Compute the line integral. F ds C. z dx + y dy + x dz C
Math 35 Solutions for Final Exam Page Problem. ( points) (a) ompute the line integral F ds for the path c(t) = (t 2, t 3, t) with t and the vector field F (x, y, z) = xi + zj + xk. (b) ompute the line
More informationDerivatives in 2D. Outline. James K. Peterson. November 9, Derivatives in 2D! Chain Rule
Derivatives in 2D James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University November 9, 2016 Outline Derivatives in 2D! Chain Rule Let s go back to
More informationLagrange Multipliers
Optimization with Constraints As long as algebra and geometry have been separated, their progress have been slow and their uses limited; but when these two sciences have been united, they have lent each
More informationMATH The Chain Rule Fall 2016 A vector function of a vector variable is a function F: R n R m. In practice, if x 1, x n is the input,
MATH 20550 The Chain Rule Fall 2016 A vector function of a vector variable is a function F: R n R m. In practice, if x 1, x n is the input, F(x 1,, x n ) F 1 (x 1,, x n ),, F m (x 1,, x n ) where each
More informationSolutions to old Exam 3 problems
Solutions to old Exam 3 problems Hi students! I am putting this version of my review for the Final exam review here on the web site, place and time to be announced. Enjoy!! Best, Bill Meeks PS. There are
More informationSolutions to Sample Questions for Final Exam
olutions to ample Questions for Final Exam Find the points on the surface xy z 3 that are closest to the origin. We use the method of Lagrange Multipliers, with f(x, y, z) x + y + z for the square of the
More informationDynamical Systems. August 13, 2013
Dynamical Systems Joshua Wilde, revised by Isabel Tecu, Takeshi Suzuki and María José Boccardi August 13, 2013 Dynamical Systems are systems, described by one or more equations, that evolve over time.
More informationDifferentiation - Quick Review From Calculus
Differentiation - Quick Review From Calculus Philippe B. Laval KSU Current Semester Philippe B. Laval (KSU) Differentiation - Quick Review From Calculus Current Semester 1 / 13 Introduction In this section,
More informationExercises for Multivariable Differential Calculus XM521
This document lists all the exercises for XM521. The Type I (True/False) exercises will be given, and should be answered, online immediately following each lecture. The Type III exercises are to be done
More informationx 1. x n i + x 2 j (x 1, x 2, x 3 ) = x 1 j + x 3
Version: 4/1/06. Note: These notes are mostly from my 5B course, with the addition of the part on components and projections. Look them over to make sure that we are on the same page as regards inner-products,
More informationSTEP Support Programme. Pure STEP 1 Questions
STEP Support Programme Pure STEP 1 Questions 2012 S1 Q4 1 Preparation Find the equation of the tangent to the curve y = x at the point where x = 4. Recall that x means the positive square root. Solve the
More informationLecture 10. Econ August 21
Lecture 10 Econ 2001 2015 August 21 Lecture 10 Outline 1 Derivatives and Partial Derivatives 2 Differentiability 3 Tangents to Level Sets Calculus! This material will not be included in today s exam. Announcement:
More informationEC /11. Math for Microeconomics September Course, Part II Lecture Notes. Course Outline
LONDON SCHOOL OF ECONOMICS Professor Leonardo Felli Department of Economics S.478; x7525 EC400 20010/11 Math for Microeconomics September Course, Part II Lecture Notes Course Outline Lecture 1: Tools for
More information4 Differential Equations
Advanced Calculus Chapter 4 Differential Equations 65 4 Differential Equations 4.1 Terminology Let U R n, and let y : U R. A differential equation in y is an equation involving y and its (partial) derivatives.
More information7a3 2. (c) πa 3 (d) πa 3 (e) πa3
1.(6pts) Find the integral x, y, z d S where H is the part of the upper hemisphere of H x 2 + y 2 + z 2 = a 2 above the plane z = a and the normal points up. ( 2 π ) Useful Facts: cos = 1 and ds = ±a sin
More informationFaculty of Engineering, Mathematics and Science School of Mathematics
Faculty of Engineering, Mathematics and Science School of Mathematics GROUPS Trinity Term 06 MA3: Advanced Calculus SAMPLE EXAM, Solutions DAY PLACE TIME Prof. Larry Rolen Instructions to Candidates: Attempt
More informationA Note on Two Different Types of Matrices and Their Applications
A Note on Two Different Types of Matrices and Their Applications Arjun Krishnan I really enjoyed Prof. Del Vecchio s Linear Systems Theory course and thought I d give something back. So I ve written a
More information8.7 MacLaurin Polynomials
8.7 maclaurin polynomials 67 8.7 MacLaurin Polynomials In this chapter you have learned to find antiderivatives of a wide variety of elementary functions, but many more such functions fail to have an antiderivative
More informationMathematic 108, Fall 2015: Solutions to assignment #7
Mathematic 08, Fall 05: Solutions to assignment #7 Problem # Suppose f is a function with f continuous on the open interval I and so that f has a local maximum at both x = a and x = b for a, b I with a
More informationChapter 1 Vector Spaces
Chapter 1 Vector Spaces Per-Olof Persson persson@berkeley.edu Department of Mathematics University of California, Berkeley Math 110 Linear Algebra Vector Spaces Definition A vector space V over a field
More informationCalculus I Review Solutions
Calculus I Review Solutions. Compare and contrast the three Value Theorems of the course. When you would typically use each. The three value theorems are the Intermediate, Mean and Extreme value theorems.
More informationNumerical Optimization
Numerical Optimization Unit 2: Multivariable optimization problems Che-Rung Lee Scribe: February 28, 2011 (UNIT 2) Numerical Optimization February 28, 2011 1 / 17 Partial derivative of a two variable function
More informationMath 291-2: Final Exam Solutions Northwestern University, Winter 2016
Math 29-2: Final Exam Solutions Northwestern University, Winter 206 Determine whether each of the following statements is true or false f it is true, explain why; if it is false, give a counterexample
More informationHigher order derivative
2 Î 3 á Higher order derivative Î 1 Å Iterated partial derivative Iterated partial derivative Suppose f has f/ x, f/ y and ( f ) = 2 f x x x 2 ( f ) = 2 f x y x y ( f ) = 2 f y x y x ( f ) = 2 f y y y
More informationSeptember Math Course: First Order Derivative
September Math Course: First Order Derivative Arina Nikandrova Functions Function y = f (x), where x is either be a scalar or a vector of several variables (x,..., x n ), can be thought of as a rule which
More information8.5 Taylor Polynomials and Taylor Series
8.5. TAYLOR POLYNOMIALS AND TAYLOR SERIES 50 8.5 Taylor Polynomials and Taylor Series Motivating Questions In this section, we strive to understand the ideas generated by the following important questions:
More informationMath 118, Fall 2014 Final Exam
Math 8, Fall 4 Final Exam True or false Please circle your choice; no explanation is necessary True There is a linear transformation T such that T e ) = e and T e ) = e Solution Since T is linear, if T
More information