Gradient Descent etc.
|
|
- Cory Holt
- 5 years ago
- Views:
Transcription
1 1 Gradient Descent etc EE 13: Networked estimation and control Prof Kan) I DERIVATIVE Consider f : R R x fx) Te derivative is defined as d fx) = lim dx fx + ) fx) Te cain rule states tat if d d f gx) ) = dx dx fx) x gx) How do we arrive to te cain rule from te definition? Consider z = fx y) x = gt) y = t) Ten d dx gx) d dt fx y) = d dx dt dx fx y) + d dy fx y) dt dy = d fx y)dx dx dt + d fx y)dy dy dt II DERIVATIVE AND DESCENT Consider f : R R Te derivative is defined as fx) d fx + ɛ) fx) fx) = lim dx ɛ ɛ fx + ɛ) fx) + ɛ fx) Hence if fx) > ten f decreases to te left In oter words if ɛ is a small enoug positive number f x ɛsign fx)) ) < fx) It implies tat an algoritm were x is updated as x x ɛsign fx)) moves in te direction of decreasing fx) A plausible suc algoritm is x k+1 = x k ɛ fx k ) wic is called gradient descent It does work for a small enoug ɛ but wat is a proper bound?
2 III CONVEX FUNCTIONS A convex function f : R R is suc tat x 1 x 2 R and t [ 1] ftx t)x 2 ) tfx 1 ) + 1 t)fx 2 ) Let f be te derivative of f First f may not be differentiable everywere eg x A differentiable function of one variable is convex on an interval if and only if its derivative is monotonically non-decreasing on tat interval For te basic case of a differentiable function from a subset of) te real numbers to te real numbers convex is equivalent to increasing at an increasing rate A differentiable function of one variable is convex on an interval if and only if te function lies above all of its tangents: fx) fy) + f y)x y) for all x and y in te interval In particular if f c) = ten c is a global minimum of fx) Tangent: Suppose tat a curve is given as te grap of a function y = fx) To find te tangent line at te point p = a fa)) consider anoter nearby point q = a+ fa+)) on te curve Te slope of te secant line passing troug p and q is equal to te difference quotient Hence te line can be defined as As we get y fa) = fa + ) fa) a + a fa + ) fa) x a) y fa) = f a)x a) y = fa) + f a)x a) As an example consider fx) = x 2 Ten te tangent at a point a R is defined by te line: y = a 2 + 2ax a) = a 2 + 2ax 2a 2 = a 2 + 2ax 2
3 IV METHOD OF STEEPEST DESCENT Convex: A convex function f : R n R is suc tat x 1 x 2 R n and t [ 1] ftx t)x 2 ) tfx 1 ) + 1 t)fx 2 ) A function f : R n R wit Lipscitz-continuous gradient is suc tat for some L > Suc a function is also called L-smoot Lemma 1 If f is L-smoot ten fx) fy) 2 L x y x y R n fx) fy) fy) x y) L 2 x y 2 2 Proof Consider gt) = fy + tx y)) We ave g) = fy) g1) = fx) and We ave g t) = fy + tx y)) x y) g t)dt = g1) g) fx) fy) fy) x y) = g1) g) fy) x y) = fy + tx y)) x y)dt fy) x y)dt fy + tx y)) x y) fy) x y)) dt [by Caucy-Scwartz] Finally we ave and te proof follows = fy + tx y)) fy) ) x y) dt fy + tx y)) fy) 2 x y 2 dt L y + tx y) y 2 x y 2 dt L x y 2 2 L 2 x y 2 2 t dt fx) fy) fy) x y) L 2 x y 2 2 If f is strongly-convex wit constant m > ten 2 f mi is positive semidefinite If f is L-smoot ten 2 f LI is negative semidefinite 3
4 ttp://wwwstatcmuedu/ ryantibs/convexopt-f13/scribes/lec6pdf Teorem 1 Let f : R n R be convex and differentiable wit a Lipscitz-continuous gradient wit constant L > Ten if we run gradient descent for k iterations wit a fixed stepsize ɛ 1/L it will yield a solution x k suc tat fx k ) fx ) x x 2 2 2ɛk Proof Since f as a Lipscitz-continuous gradient we ave from Lemma 1: fy) fx) + fx) y x) L y x 2 2 Let us plug in te gradient descent update: y = x k+1 = x k ɛ fx k ) to obtain: fx k+1 ) fx k ) + fx k ) x k+1 x k ) L x k+1 x k 2 2 fx k ) + fx k ) ɛ fx k )) L ɛ fx k) 2 2 fx k ) ɛ fx k ) Lɛ2 fx k ) 2 2 ) 1 fx k ) + 2 Lɛ 1 ɛ fx k ) 2 2 ɛ 1 L fx k+1 ) fx k ) 1 2 ɛ fx k) 2 2 1) wic sows tat fx k ) decreases at every k unless fx k ) = true wen x k = x because f is convex and differentiable Since f is convex it lies above all of its tangents and) we ave fx ) fx) + fx) x x) wic leads to From earlier we ave fx k+1 ) fx k ) 1 2 ɛ fx k) 2 2 fx k ) fx ) + fx k ) x k x ) fx ) + fx k ) x k x ) 1 2 ɛ fx k) 2 2 fx k+1 ) fx ) fx k ) x k x ) 1 2 ɛ fx k) ɛ fx k ) x k x ) ɛ 2 fx k ) 2 2 2ɛ 1 2ɛ fx k ) x k x ) ɛ 2 fx k ) 2 2 x k x 2 2 2ɛ }{{} + x k x xk x ɛ fx k ) x k x 2 ) 2 2ɛ ) ) 4
5 Continuing: fx k+1 ) fx ) 1 2ɛ Sum bot sides over k = K 1: Consider K 1 k= fx k+1 ) fx )) 1 2ɛ 1 2ɛ xk x 2 2 x k+1 x 2 ) 2 K 1 k= xk x 2 2 x k+1 x 2 ) 2 x x 2 2 x 1 x 2 2+ x 1 x 2 2 x 2 x x K 1 x 2 2 x K x 2 2) = 1 x x 2 2 x K x 2 ) 2 2ɛ 1 x x 2 ) 2 2ɛ Kfx K ) fx )) = fx K ) + fx K ) + + fx K ) Kfx ) Finally we obtain fx K ) + fx K 1 ) + + fx 1 ) Kfx ) [see 1)] K 1 ) = fx k+1 ) Kfx ) k= K 1 = k= 1 2ɛ fx k+1 ) fx ) x x 2 ) 2 ) and te teorem follows fx K ) fx ) x x 2 2 2ɛK 5
6 V GRADIENT For f : R n R we generalize derivative wit a gradient f were x 1 fx) f = x n fx) 6
7 VI PARTIAL DERIVATIVE Consider f : R 2 R were R 2 is indexed by x and y Ten for some a b) R 2 partial derivative of f wit respect to x at te point a b) is defined as fa b) = lim x Let us expand te notation to a vector a R 2 : Hence for an arbitrary direction u R 2 : fa + b) fa b) fa + 1 ) fa) fa) = lim x fa) = lim u fa + u) fa) notice owever tat te direction is not scaled ere In oter words te definition canges for 2u unless we trow in a normalization on te direction Directional derivative is denoted as: u fa) = u fa) 7
8 VII DIRECTIONAL DERIVATIVE: FORMAL Definition 1 Directional derivative) Consider a function: f : R n derivative of f in an arbitrary direction u R n is given by u fa) = fa) = lim u fa + u) fa) R Te directional fa 1 + u 1 a 2 + u 2 a n + u n ) fa 1 a 2 a n ) = lim Lemma 2 Te directional derivative is given by u fx) = u fx) Proof Consider f : R 2 R for convenience Let R 2 be indexed by x y) Fix an arbitrary point x y ) R 2 and an arbitrary direction a b) R 2 At tis point define gz) = fx + za y + zb) As g is a function of a single variable z we can define leading to g z) d gz) = lim dz gz + ) gz) g ) d dz gz) g) g) fx + a y + b) fx y ) z= = lim = lim = ab) fx y ) 2) by definition We tus ave g ) = ab) fx y ) Now let x = x + za and y = y + zb Ten gz) = fx y) We ave g z) = d dz gz) = d dx fx y) = fx y) dz x dz + dy fx y) y dz = x fx y) a + fx y) b y Wit z = we get x = x and y = y and Combine 2) and 3) to get ab) fx y ) = generalizes to u fx) = wic completes te proof g ) = x fx y ) a + y fx y ) b 3) x fx y ) a + y fx y ) b Te above fx)u fx)u n = u f = u f = f u x 1 x n 8
9 Lemma 3 Te maximum value of te directional derivative u fx) is in te direction of te gradient Proof Directional derivative is a dot product wic is max wen te angle of te cosine is Lemma 4 Te gradient vector is ortogonal to te level yper-)curve fx) = c at te point x Proof 9
10 VIII DIRECTIONAL DERIVATIVE Consider f : R n R Te scalar notion of derivative does not apply and te derivative must be specified along a particular direction in R n ie te rate of cange of f in a direction u It is defined as fx + αu) fx) u fx) = lim α α Te gradient of a function in an arbitrary direction u is given by u fx) = u fx) u 2 = u u = 1 Consider a function f wit domain R 3 ie over tree variables x 1 x 2 x 3 Te tree principal directions of tis space are tus e 1 e 2 e 3 If we coose u 1 to be e 1 ten e1 fx) = x 1 fx) Because we ave already specified a particular direction te directional derivative is a scalar We furter ave u fx) = u fx) = u fx) = u fx) cos θ were θ is te angle between te gradient vector and te direction u Te directional derivative tus is te maximum wen θ = ie wen u is along te direction of te gradient; tis is were f increases te most Similarly te directional derivative is te minimum wen θ = π ie wen u is opposite to te direction of te gradient; tis is were f decreases te most A Example Consider fx 1 x 2 ) = 4x x2 2 For any value fx 1 x 2 ) = c R te function becomes 4x x 2 2 = c and is an ellipse in R2 Te gradient of tis function is x 1 fx) fx) = x n fx) = 8x 1 2x 2 1
Notes: DERIVATIVES. Velocity and Other Rates of Change
Notes: DERIVATIVES Velocity and Oter Rates of Cange I. Average Rate of Cange A.) Def.- Te average rate of cange of f(x) on te interval [a, b] is f( b) f( a) b a secant ( ) ( ) m troug a, f ( a ) and b,
More informationThe Derivative as a Function
Section 2.2 Te Derivative as a Function 200 Kiryl Tsiscanka Te Derivative as a Function DEFINITION: Te derivative of a function f at a number a, denoted by f (a), is if tis limit exists. f (a) f(a + )
More informationLecture XVII. Abstract We introduce the concept of directional derivative of a scalar function and discuss its relation with the gradient operator.
Lecture XVII Abstract We introduce te concept of directional derivative of a scalar function and discuss its relation wit te gradient operator. Directional derivative and gradient Te directional derivative
More informationLesson 6: The Derivative
Lesson 6: Te Derivative Def. A difference quotient for a function as te form f(x + ) f(x) (x + ) x f(x + x) f(x) (x + x) x f(a + ) f(a) (a + ) a Notice tat a difference quotient always as te form of cange
More informationTangent Lines-1. Tangent Lines
Tangent Lines- Tangent Lines In geometry, te tangent line to a circle wit centre O at a point A on te circle is defined to be te perpendicular line at A to te line OA. Te tangent lines ave te special property
More informationThe Derivative The rate of change
Calculus Lia Vas Te Derivative Te rate of cange Knowing and understanding te concept of derivative will enable you to answer te following questions. Let us consider a quantity wose size is described by
More informationMath 212-Lecture 9. For a single-variable function z = f(x), the derivative is f (x) = lim h 0
3.4: Partial Derivatives Definition Mat 22-Lecture 9 For a single-variable function z = f(x), te derivative is f (x) = lim 0 f(x+) f(x). For a function z = f(x, y) of two variables, to define te derivatives,
More informationDEFINITION OF A DERIVATIVE
DEFINITION OF A DERIVATIVE Section 2.1 Calculus AP/Dual, Revised 2017 viet.dang@umbleisd.net 2.1: Definition of a Derivative 1 DEFINITION A. Te derivative of a function allows you to find te SLOPE OF THE
More informationFunction Composition and Chain Rules
Function Composition and s James K. Peterson Department of Biological Sciences and Department of Matematical Sciences Clemson University Marc 8, 2017 Outline 1 Function Composition and Continuity 2 Function
More informationMAT 1339-S14 Class 2
MAT 1339-S14 Class 2 July 07, 2014 Contents 1 Rate of Cange 1 1.5 Introduction to Derivatives....................... 1 2 Derivatives 5 2.1 Derivative of Polynomial function.................... 5 2.2 Te
More informationf a h f a h h lim lim
Te Derivative Te derivative of a function f at a (denoted f a) is f a if tis it exists. An alternative way of defining f a is f a x a fa fa fx fa x a Note tat te tangent line to te grap of f at te point
More information1. Questions (a) through (e) refer to the graph of the function f given below. (A) 0 (B) 1 (C) 2 (D) 4 (E) does not exist
Mat 1120 Calculus Test 2. October 18, 2001 Your name Te multiple coice problems count 4 points eac. In te multiple coice section, circle te correct coice (or coices). You must sow your work on te oter
More informationSection 15.6 Directional Derivatives and the Gradient Vector
Section 15.6 Directional Derivatives and te Gradient Vector Finding rates of cange in different directions Recall tat wen we first started considering derivatives of functions of more tan one variable,
More informationContinuity. Example 1
Continuity MATH 1003 Calculus and Linear Algebra (Lecture 13.5) Maoseng Xiong Department of Matematics, HKUST A function f : (a, b) R is continuous at a point c (a, b) if 1. x c f (x) exists, 2. f (c)
More informationTHE IDEA OF DIFFERENTIABILITY FOR FUNCTIONS OF SEVERAL VARIABLES Math 225
THE IDEA OF DIFFERENTIABILITY FOR FUNCTIONS OF SEVERAL VARIABLES Mat 225 As we ave seen, te definition of derivative for a Mat 111 function g : R R and for acurveγ : R E n are te same, except for interpretation:
More informationHOMEWORK HELP 2 FOR MATH 151
HOMEWORK HELP 2 FOR MATH 151 Here we go; te second round of omework elp. If tere are oters you would like to see, let me know! 2.4, 43 and 44 At wat points are te functions f(x) and g(x) = xf(x)continuous,
More informationMATH CALCULUS I 2.1: Derivatives and Rates of Change
MATH 12002 - CALCULUS I 2.1: Derivatives and Rates of Cange Professor Donald L. Wite Department of Matematical Sciences Kent State University D.L. Wite (Kent State University) 1 / 1 Introduction Our main
More informationSection 2.1 The Definition of the Derivative. We are interested in finding the slope of the tangent line at a specific point.
Popper 6: Review of skills: Find tis difference quotient. f ( x ) f ( x) if f ( x) x Answer coices given in audio on te video. Section.1 Te Definition of te Derivative We are interested in finding te slope
More information2.11 That s So Derivative
2.11 Tat s So Derivative Introduction to Differential Calculus Just as one defines instantaneous velocity in terms of average velocity, we now define te instantaneous rate of cange of a function at a point
More informationSolution. Solution. f (x) = (cos x)2 cos(2x) 2 sin(2x) 2 cos x ( sin x) (cos x) 4. f (π/4) = ( 2/2) ( 2/2) ( 2/2) ( 2/2) 4.
December 09, 20 Calculus PracticeTest s Name: (4 points) Find te absolute extrema of f(x) = x 3 0 on te interval [0, 4] Te derivative of f(x) is f (x) = 3x 2, wic is zero only at x = 0 Tus we only need
More information1 Lecture 13: The derivative as a function.
1 Lecture 13: Te erivative as a function. 1.1 Outline Definition of te erivative as a function. efinitions of ifferentiability. Power rule, erivative te exponential function Derivative of a sum an a multiple
More information11.6 DIRECTIONAL DERIVATIVES AND THE GRADIENT VECTOR
SECTION 11.6 DIRECTIONAL DERIVATIVES AND THE GRADIENT VECTOR 633 wit speed v o along te same line from te opposite direction toward te source, ten te frequenc of te sound eard b te observer is were c is
More informationDifferentiation Rules and Formulas
Differentiation Rules an Formulas Professor D. Olles December 1, 01 1 Te Definition of te Derivative Consier a function y = f(x) tat is continuous on te interval a, b]. Ten, te slope of te secant line
More informationClick here to see an animation of the derivative
Differentiation Massoud Malek Derivative Te concept of derivative is at te core of Calculus; It is a very powerful tool for understanding te beavior of matematical functions. It allows us to optimize functions,
More informationSection 2.7 Derivatives and Rates of Change Part II Section 2.8 The Derivative as a Function. at the point a, to be. = at time t = a is
Mat 180 www.timetodare.com Section.7 Derivatives and Rates of Cange Part II Section.8 Te Derivative as a Function Derivatives ( ) In te previous section we defined te slope of te tangent to a curve wit
More informationName: Answer Key No calculators. Show your work! 1. (21 points) All answers should either be,, a (finite) real number, or DNE ( does not exist ).
Mat - Final Exam August 3 rd, Name: Answer Key No calculators. Sow your work!. points) All answers sould eiter be,, a finite) real number, or DNE does not exist ). a) Use te grap of te function to evaluate
More informationA.P. CALCULUS (AB) Outline Chapter 3 (Derivatives)
A.P. CALCULUS (AB) Outline Capter 3 (Derivatives) NAME Date Previously in Capter 2 we determined te slope of a tangent line to a curve at a point as te limit of te slopes of secant lines using tat point
More information1 The concept of limits (p.217 p.229, p.242 p.249, p.255 p.256) 1.1 Limits Consider the function determined by the formula 3. x since at this point
MA00 Capter 6 Calculus and Basic Linear Algebra I Limits, Continuity and Differentiability Te concept of its (p.7 p.9, p.4 p.49, p.55 p.56). Limits Consider te function determined by te formula f Note
More information. Compute the following limits.
Today: Tangent Lines and te Derivative at a Point Warmup:. Let f(x) =x. Compute te following limits. f( + ) f() (a) lim f( +) f( ) (b) lim. Let g(x) = x. Compute te following limits. g(3 + ) g(3) (a) lim
More information1. Consider the trigonometric function f(t) whose graph is shown below. Write down a possible formula for f(t).
. Consider te trigonometric function f(t) wose grap is sown below. Write down a possible formula for f(t). Tis function appears to be an odd, periodic function tat as been sifted upwards, so we will use
More information2.1 THE DEFINITION OF DERIVATIVE
2.1 Te Derivative Contemporary Calculus 2.1 THE DEFINITION OF DERIVATIVE 1 Te grapical idea of a slope of a tangent line is very useful, but for some uses we need a more algebraic definition of te derivative
More informationMVT and Rolle s Theorem
AP Calculus CHAPTER 4 WORKSHEET APPLICATIONS OF DIFFERENTIATION MVT and Rolle s Teorem Name Seat # Date UNLESS INDICATED, DO NOT USE YOUR CALCULATOR FOR ANY OF THESE QUESTIONS In problems 1 and, state
More informationDifferentiation in higher dimensions
Capter 2 Differentiation in iger dimensions 2.1 Te Total Derivative Recall tat if f : R R is a 1-variable function, and a R, we say tat f is differentiable at x = a if and only if te ratio f(a+) f(a) tends
More informationHow to Find the Derivative of a Function: Calculus 1
Introduction How to Find te Derivative of a Function: Calculus 1 Calculus is not an easy matematics course Te fact tat you ave enrolled in suc a difficult subject indicates tat you are interested in te
More informationDepartment of Mathematics, K.T.H.M. College, Nashik F.Y.B.Sc. Calculus Practical (Academic Year )
F.Y.B.Sc. Calculus Practical (Academic Year 06-7) Practical : Graps of Elementary Functions. a) Grap of y = f(x) mirror image of Grap of y = f(x) about X axis b) Grap of y = f( x) mirror image of Grap
More informationMath Spring 2013 Solutions to Assignment # 3 Completion Date: Wednesday May 15, (1/z) 2 (1/z 1) 2 = lim
Mat 311 - Spring 013 Solutions to Assignment # 3 Completion Date: Wednesday May 15, 013 Question 1. [p 56, #10 (a)] 4z Use te teorem of Sec. 17 to sow tat z (z 1) = 4. We ave z 4z (z 1) = z 0 4 (1/z) (1/z
More informationHigher Derivatives. Differentiable Functions
Calculus 1 Lia Vas Higer Derivatives. Differentiable Functions Te second derivative. Te derivative itself can be considered as a function. Te instantaneous rate of cange of tis function is te second derivative.
More informationFunction Composition and Chain Rules
Function Composition an Cain Rules James K. Peterson Department of Biological Sciences an Department of Matematical Sciences Clemson University November 2, 2018 Outline Function Composition an Continuity
More informationMAT 145. Type of Calculator Used TI-89 Titanium 100 points Score 100 possible points
MAT 15 Test #2 Name Solution Guide Type of Calculator Used TI-89 Titanium 100 points Score 100 possible points Use te grap of a function sown ere as you respond to questions 1 to 8. 1. lim f (x) 0 2. lim
More informationPolynomial Functions. Linear Functions. Precalculus: Linear and Quadratic Functions
Concepts: definition of polynomial functions, linear functions tree representations), transformation of y = x to get y = mx + b, quadratic functions axis of symmetry, vertex, x-intercepts), transformations
More informationENGI Gradient, Divergence, Curl Page 5.01
ENGI 940 5.0 - Gradient, Divergence, Curl Page 5.0 5. e Gradient Operator A brief review is provided ere for te gradient operator in bot Cartesian and ortogonal non-cartesian coordinate systems. Sections
More informationAnalytic Functions. Differentiable Functions of a Complex Variable
Analytic Functions Differentiable Functions of a Complex Variable In tis capter, we sall generalize te ideas for polynomials power series of a complex variable we developed in te previous capter to general
More informationLIMITS AND DERIVATIVES CONDITIONS FOR THE EXISTENCE OF A LIMIT
LIMITS AND DERIVATIVES Te limit of a function is defined as te value of y tat te curve approaces, as x approaces a particular value. Te limit of f (x) as x approaces a is written as f (x) approaces, as
More informationUNIVERSITY OF MANITOBA DEPARTMENT OF MATHEMATICS MATH 1510 Applied Calculus I FIRST TERM EXAMINATION - Version A October 12, :30 am
DEPARTMENT OF MATHEMATICS MATH 1510 Applied Calculus I October 12, 2016 8:30 am LAST NAME: FIRST NAME: STUDENT NUMBER: SIGNATURE: (I understand tat ceating is a serious offense DO NOT WRITE IN THIS TABLE
More informationMTH-112 Quiz 1 Name: # :
MTH- Quiz Name: # : Please write our name in te provided space. Simplif our answers. Sow our work.. Determine weter te given relation is a function. Give te domain and range of te relation.. Does te equation
More informationPoisson Equation in Sobolev Spaces
Poisson Equation in Sobolev Spaces OcMountain Dayligt Time. 6, 011 Today we discuss te Poisson equation in Sobolev spaces. It s existence, uniqueness, and regularity. Weak Solution. u = f in, u = g on
More information. If lim. x 2 x 1. f(x+h) f(x)
Review of Differential Calculus Wen te value of one variable y is uniquely determined by te value of anoter variable x, ten te relationsip between x and y is described by a function f tat assigns a value
More informationINTRODUCTION TO CALCULUS LIMITS
Calculus can be divided into two ke areas: INTRODUCTION TO CALCULUS Differential Calculus dealing wit its, rates of cange, tangents and normals to curves, curve sketcing, and applications to maima and
More informationNUMERICAL DIFFERENTIATION. James T. Smith San Francisco State University. In calculus classes, you compute derivatives algebraically: for example,
NUMERICAL DIFFERENTIATION James T Smit San Francisco State University In calculus classes, you compute derivatives algebraically: for example, f( x) = x + x f ( x) = x x Tis tecnique requires your knowing
More informationExample: f(x) = x 3. 1, x > 0 0, x 0. Example: g(x) =
2.1 Instantaneous rate of cange, or, an informal introduction to derivatives Let a, b be two different values in te domain of f. Te average rate of cange of f between a and b is f(b) f(a) b a. Geometrically,
More informationContinuity and Differentiability Worksheet
Continuity and Differentiability Workseet (Be sure tat you can also do te grapical eercises from te tet- Tese were not included below! Typical problems are like problems -3, p. 6; -3, p. 7; 33-34, p. 7;
More informationSection 3: The Derivative Definition of the Derivative
Capter 2 Te Derivative Business Calculus 85 Section 3: Te Derivative Definition of te Derivative Returning to te tangent slope problem from te first section, let's look at te problem of finding te slope
More information(a) At what number x = a does f have a removable discontinuity? What value f(a) should be assigned to f at x = a in order to make f continuous at a?
Solutions to Test 1 Fall 016 1pt 1. Te grap of a function f(x) is sown at rigt below. Part I. State te value of eac limit. If a limit is infinite, state weter it is or. If a limit does not exist (but is
More informationExam 1 Review Solutions
Exam Review Solutions Please also review te old quizzes, and be sure tat you understand te omework problems. General notes: () Always give an algebraic reason for your answer (graps are not sufficient),
More informationPractice Problem Solutions: Exam 1
Practice Problem Solutions: Exam 1 1. (a) Algebraic Solution: Te largest term in te numerator is 3x 2, wile te largest term in te denominator is 5x 2 3x 2 + 5. Tus lim x 5x 2 2x 3x 2 x 5x 2 = 3 5 Numerical
More informationSection 3.1: Derivatives of Polynomials and Exponential Functions
Section 3.1: Derivatives of Polynomials and Exponential Functions In previous sections we developed te concept of te derivative and derivative function. Te only issue wit our definition owever is tat it
More informationDerivatives. if such a limit exists. In this case when such a limit exists, we say that the function f is differentiable.
Derivatives 3. Derivatives Definition 3. Let f be a function an a < b be numbers. Te average rate of cange of f from a to b is f(b) f(a). b a Remark 3. Te average rate of cange of a function f from a to
More informationLogarithmic functions
Roberto s Notes on Differential Calculus Capter 5: Derivatives of transcendental functions Section Derivatives of Logaritmic functions Wat ou need to know alread: Definition of derivative and all basic
More informationSolutions to the Multivariable Calculus and Linear Algebra problems on the Comprehensive Examination of January 31, 2014
Solutions to te Multivariable Calculus and Linear Algebra problems on te Compreensive Examination of January 3, 24 Tere are 9 problems ( points eac, totaling 9 points) on tis portion of te examination.
More informationMain Points: 1. Limit of Difference Quotients. Prep 2.7: Derivatives and Rates of Change. Names of collaborators:
Name: Section: Names of collaborators: Main Points:. Definition of derivative as limit of difference quotients. Interpretation of derivative as slope of grap. Interpretation of derivative as instantaneous
More information4. The slope of the line 2x 7y = 8 is (a) 2/7 (b) 7/2 (c) 2 (d) 2/7 (e) None of these.
Mat 11. Test Form N Fall 016 Name. Instructions. Te first eleven problems are wort points eac. Te last six problems are wort 5 points eac. For te last six problems, you must use relevant metods of algebra
More informationIntegral Calculus, dealing with areas and volumes, and approximate areas under and between curves.
Calculus can be divided into two ke areas: Differential Calculus dealing wit its, rates of cange, tangents and normals to curves, curve sketcing, and applications to maima and minima problems Integral
More informationContinuity and Differentiability of the Trigonometric Functions
[Te basis for te following work will be te definition of te trigonometric functions as ratios of te sides of a triangle inscribed in a circle; in particular, te sine of an angle will be defined to be te
More information2.8 The Derivative as a Function
.8 Te Derivative as a Function Typically, we can find te derivative of a function f at many points of its domain: Definition. Suppose tat f is a function wic is differentiable at every point of an open
More informationIntroduction to Derivatives
Introduction to Derivatives 5-Minute Review: Instantaneous Rates and Tangent Slope Recall te analogy tat we developed earlier First we saw tat te secant slope of te line troug te two points (a, f (a))
More informationMath 242: Principles of Analysis Fall 2016 Homework 7 Part B Solutions
Mat 22: Principles of Analysis Fall 206 Homework 7 Part B Solutions. Sow tat f(x) = x 2 is not uniformly continuous on R. Solution. Te equation is equivalent to f(x) = 0 were f(x) = x 2 sin(x) 3. Since
More informationMath 1210 Midterm 1 January 31st, 2014
Mat 110 Midterm 1 January 1st, 01 Tis exam consists of sections, A and B. Section A is conceptual, wereas section B is more computational. Te value of every question is indicated at te beginning of it.
More informationKey Concepts. Important Techniques. 1. Average rate of change slope of a secant line. You will need two points ( a, the formula: to find value
AB Calculus Unit Review Key Concepts Average and Instantaneous Speed Definition of Limit Properties of Limits One-sided and Two-sided Limits Sandwic Teorem Limits as x ± End Beaviour Models Continuity
More informationTest 2 Review. 1. Find the determinant of the matrix below using (a) cofactor expansion and (b) row reduction. A = 3 2 =
Test Review Find te determinant of te matrix below using (a cofactor expansion and (b row reduction Answer: (a det + = (b Observe R R R R R R R R R Ten det B = (((det Hence det Use Cramer s rule to solve:
More information1 Calculus. 1.1 Gradients and the Derivative. Q f(x+h) f(x)
Calculus. Gradients and te Derivative Q f(x+) δy P T δx R f(x) 0 x x+ Let P (x, f(x)) and Q(x+, f(x+)) denote two points on te curve of te function y = f(x) and let R denote te point of intersection of
More informationApplications of the van Trees inequality to non-parametric estimation.
Brno-06, Lecture 2, 16.05.06 D/Stat/Brno-06/2.tex www.mast.queensu.ca/ blevit/ Applications of te van Trees inequality to non-parametric estimation. Regular non-parametric problems. As an example of suc
More informationMA119-A Applied Calculus for Business Fall Homework 4 Solutions Due 9/29/ :30AM
MA9-A Applied Calculus for Business 006 Fall Homework Solutions Due 9/9/006 0:0AM. #0 Find te it 5 0 + +.. #8 Find te it. #6 Find te it 5 0 + + = (0) 5 0 (0) + (0) + =.!! r + +. r s r + + = () + 0 () +
More informationUniversity Mathematics 2
University Matematics 2 1 Differentiability In tis section, we discuss te differentiability of functions. Definition 1.1 Differentiable function). Let f) be a function. We say tat f is differentiable at
More informationNumerical Differentiation
Numerical Differentiation Finite Difference Formulas for te first derivative (Using Taylor Expansion tecnique) (section 8.3.) Suppose tat f() = g() is a function of te variable, and tat as 0 te function
More informationFinding and Using Derivative The shortcuts
Calculus 1 Lia Vas Finding and Using Derivative Te sortcuts We ave seen tat te formula f f(x+) f(x) (x) = lim 0 is manageable for relatively simple functions like a linear or quadratic. For more complex
More informationMATH1901 Differential Calculus (Advanced)
MATH1901 Dierential Calculus (Advanced) Capter 3: Functions Deinitions : A B A and B are sets assigns to eac element in A eactl one element in B A is te domain o te unction B is te codomain o te unction
More informationMathematics 5 Worksheet 11 Geometry, Tangency, and the Derivative
Matematics 5 Workseet 11 Geometry, Tangency, and te Derivative Problem 1. Find te equation of a line wit slope m tat intersects te point (3, 9). Solution. Te equation for a line passing troug a point (x
More informationMath Module Preliminary Test Solutions
SSEA Summer 207 Mat Module Preliminar Test Solutions. [3 points] Find all values of tat satisf =. Solution: = ( ) = ( ) = ( ) =. Tis means ( ) is positive. Tat is, 0, wic implies. 2. [6 points] Find all
More informationPolynomial Interpolation
Capter 4 Polynomial Interpolation In tis capter, we consider te important problem of approximatinga function fx, wose values at a set of distinct points x, x, x,, x n are known, by a polynomial P x suc
More informationMath 161 (33) - Final exam
Name: Id #: Mat 161 (33) - Final exam Fall Quarter 2015 Wednesday December 9, 2015-10:30am to 12:30am Instructions: Prob. Points Score possible 1 25 2 25 3 25 4 25 TOTAL 75 (BEST 3) Read eac problem carefully.
More informationMATH 155A FALL 13 PRACTICE MIDTERM 1 SOLUTIONS. needs to be non-zero, thus x 1. Also 1 +
MATH 55A FALL 3 PRACTICE MIDTERM SOLUTIONS Question Find te domain of te following functions (a) f(x) = x3 5 x +x 6 (b) g(x) = x+ + x+ (c) f(x) = 5 x + x 0 (a) We need x + x 6 = (x + 3)(x ) 0 Hence Dom(f)
More informationLesson 4 - Limits & Instantaneous Rates of Change
Lesson Objectives Lesson 4 - Limits & Instantaneous Rates of Cange SL Topic 6 Calculus - Santowski 1. Calculate an instantaneous rate of cange using difference quotients and limits. Calculate instantaneous
More informationOrder of Accuracy. ũ h u Ch p, (1)
Order of Accuracy 1 Terminology We consider a numerical approximation of an exact value u. Te approximation depends on a small parameter, wic can be for instance te grid size or time step in a numerical
More informationMATH 1A Midterm Practice September 29, 2014
MATH A Midterm Practice September 9, 04 Name: Problem. (True/False) If a function f : R R is injective, ten f as an inverse. Solution: True. If f is injective, ten it as an inverse since tere does not
More informationSome Review Problems for First Midterm Mathematics 1300, Calculus 1
Some Review Problems for First Midterm Matematics 00, Calculus. Consider te trigonometric function f(t) wose grap is sown below. Write down a possible formula for f(t). Tis function appears to be an odd,
More informationA SHORT INTRODUCTION TO BANACH LATTICES AND
CHAPTER A SHORT INTRODUCTION TO BANACH LATTICES AND POSITIVE OPERATORS In tis capter we give a brief introduction to Banac lattices and positive operators. Most results of tis capter can be found, e.g.,
More information1 1. Rationalize the denominator and fully simplify the radical expression 3 3. Solution: = 1 = 3 3 = 2
MTH - Spring 04 Exam Review (Solutions) Exam : February 5t 6:00-7:0 Tis exam review contains questions similar to tose you sould expect to see on Exam. Te questions included in tis review, owever, are
More information5.1 We will begin this section with the definition of a rational expression. We
Basic Properties and Reducing to Lowest Terms 5.1 We will begin tis section wit te definition of a rational epression. We will ten state te two basic properties associated wit rational epressions and go
More informationDerivatives and Rates of Change
Section.1 Derivatives and Rates of Cange 2016 Kiryl Tsiscanka Derivatives and Rates of Cange Measuring te Rate of Increase of Blood Alcool Concentration Biomedical scientists ave studied te cemical and
More informationJANE PROFESSOR WW Prob Lib1 Summer 2000
JANE PROFESSOR WW Prob Lib Summer 2000 Sample WeBWorK problems. WeBWorK assignment Derivatives due 2//06 at 2:00 AM..( pt) If f x 9, find f 0. 2.( pt) If f x 7x 27, find f 5. 3.( pt) If f x 7 4x 5x 2,
More informationy = 3 2 x 3. The slope of this line is 3 and its y-intercept is (0, 3). For every two units to the right, the line rises three units vertically.
Mat 2 - Calculus for Management and Social Science. Understanding te basics of lines in te -plane is crucial to te stud of calculus. Notes Recall tat te and -intercepts of a line are were te line meets
More informationPrecalculus Test 2 Practice Questions Page 1. Note: You can expect other types of questions on the test than the ones presented here!
Precalculus Test 2 Practice Questions Page Note: You can expect oter types of questions on te test tan te ones presented ere! Questions Example. Find te vertex of te quadratic f(x) = 4x 2 x. Example 2.
More informationBob Brown Math 251 Calculus 1 Chapter 3, Section 1 Completed 1 CCBC Dundalk
Bob Brown Mat 251 Calculus 1 Capter 3, Section 1 Completed 1 Te Tangent Line Problem Te idea of a tangent line first arises in geometry in te context of a circle. But before we jump into a discussion of
More information5. (a) Find the slope of the tangent line to the parabola y = x + 2x
MATH 141 090 Homework Solutions Fall 00 Section.6: Pages 148 150 3. Consider te slope of te given curve at eac of te five points sown (see text for figure). List tese five slopes in decreasing order and
More information1 Solutions to the in class part
NAME: Solutions to te in class part. Te grap of a function f is given. Calculus wit Analytic Geometry I Exam, Friday, August 30, 0 SOLUTIONS (a) State te value of f(). (b) Estimate te value of f( ). (c)
More informationDerivative as Instantaneous Rate of Change
43 Derivative as Instantaneous Rate of Cange Consider a function tat describes te position of a racecar moving in a straigt line away from some starting point Let y s t suc tat t represents te time in
More informationPreface. Here are a couple of warnings to my students who may be here to get a copy of what happened on a day that you missed.
Preface Here are my online notes for my course tat I teac ere at Lamar University. Despite te fact tat tese are my class notes, tey sould be accessible to anyone wanting to learn or needing a refreser
More informationREVIEW LAB ANSWER KEY
REVIEW LAB ANSWER KEY. Witout using SN, find te derivative of eac of te following (you do not need to simplify your answers): a. f x 3x 3 5x x 6 f x 3 3x 5 x 0 b. g x 4 x x x notice te trick ere! x x g
More information2.3 More Differentiation Patterns
144 te derivative 2.3 More Differentiation Patterns Polynomials are very useful, but tey are not te only functions we need. Tis section uses te ideas of te two previous sections to develop tecniques for
More informationUsing the definition of the derivative of a function is quite tedious. f (x + h) f (x)
Derivative Rules Using te efinition of te erivative of a function is quite teious. Let s prove some sortcuts tat we can use. Recall tat te efinition of erivative is: Given any number x for wic te limit
More information