Variational Methods & Optimal Control
|
|
- Rudolph Montgomery
- 5 years ago
- Views:
Transcription
1 Variational Methods & Optimal Control lecture 02 Matthew Roughan Discipline of Applied Mathematics School of Mathematical Sciences University of Adelaide April 14, 2016 Variational Methods & Optimal Control: lecture 02 p.1/29
2 Revision, part ii Extrema of functions of multiple variables. Taylor s theorem and the chain rule in N-D. Hessians and classification of extrema. Variational Methods & Optimal Control: lecture 02 p.2/29
3 Extrema of functions of one variable Local extrema have f (x)=0 includes maxima, minima, and stationary points of inflection sin 2 (x) x Variational Methods & Optimal Control: lecture 02 p.3/29
4 Classification of extrema Local extrema have f (x)=0 f (x)>0 local minima f (x)<0 local maxima f (x)=0 it might be a stationary point of inflection, depending on higher order derivatives, e.g. x 4. local max stationary point local min Variational Methods & Optimal Control: lecture 02 p.4/29
5 Functions of n variables Let Ω be a closed region of IR n, i.e. Ω IR n Let x=(x 1,x 2,...,x n ) Ω Let f : Ω IR A local minima if f( ) is point x such that there exists δ>0 where f(ˆx) f(x) for any ˆx B(x;δ). A global minima of f( ) on Ω is point x such that f(ˆx) f(x) for any ˆx Ω. Variational Methods & Optimal Control: lecture 02 p.5/29
6 2D example 1 f(x 1,x 2 )=x 2 1 x2 2 + x3 1 local maximum at( 2/3,0) saddle point at(0,0) Variational Methods & Optimal Control: lecture 02 p.6/29
7 2D example 2 f(x 1,x 2 )=r 1/2r 2, where r= x x2 2 global maxima on curve r= 1 local minima at r=0 Variational Methods & Optimal Control: lecture 02 p.7/29
8 2D example 3 f(x 1,x 2 )=x 3 2 3x2 1 x 2 Monkey saddle at(0,0) Variational Methods & Optimal Control: lecture 02 p.8/29
9 The Chain rule The derivative of a function f(x 1,x 2 ) along a line described parametrically by(x 1 (t),x 2 (t)) d f = f dx 1 x 1 + f dx 2 x 2 Another way to think of this is as the directional derivative formed from the dot product of grad and the direction of the line, e.g., d f = f dx ( f =, f ) x 1 x 2 ( dx1, dx ) 2 Variational Methods & Optimal Control: lecture 02 p.9/29
10 Chain Rule for more variables The chain rule (for a function of more than one variable) f(x)= f(x 1,x 2,...,x n ), where we want to find the derivative of a function f(x) along a line described parametrically by(x 1 (t),x 2 (t),...,x n (t)) then we take or alternatively df = d f = f dx 1 x 1 + f dx 2 x 2 f dx n + + x n ( f, f,..., f ) (. dx1 x 1 x 2 x n, dx 2,..., dx ) n = f. dx Variational Methods & Optimal Control: lecture 02 p.10/29
11 A graphical example For a function of two variables f(x,y) we get 3 d f = f x dx + f y dy f(x,y) = x+y x = cost y = sint z y Variational Methods x & Optimal Control: lecture 02 p.11/29
12 A graphical example For a function of two variables f(x,y) we get d f = f x dx + f y dy f(x,y) = x+y x = cost y = sint z df y Variational Methods x & Optimal Control: lecture 02 p.11/29
13 A graphical example For a function of two variables f(x,y) we get d f = f x dx + f y dy f(x,y) = x+y x = cost y = sint z df dx dy df y Variational Methods x & Optimal Control: lecture 02 p.11/29
14 Chain Rule Derivation By the definition df = lim ε 0 f(x(t+ ε),y(t+ ε)) f(x(t),y(t)) ε But note that from Taylor s theorem x(t+ ε)=x(t)+εx (t)+o(ε 2 ). As we consider the limit as ε 0 we may ignore the O(ε 2 ) term, to get df = lim ε 0 f(x(t)+εx (t),y(t)+εy (t)) f(x(t),y(t)) ε Variational Methods & Optimal Control: lecture 02 p.12/29
15 Chain Rule Derivation df f(x(t)+εx (t),y(t)+εy (t)) f(x(t),y(t)) = lim ε 0 ε f(x(t)+εx (t),y(t)+εy (t)) f(x(t),y(t)+εy (t)) = lim ε 0 ε f(x(t),y(t)+εy (t)) f(x(t),y(t)) +lim ε 0 ε = x f(x(t)+εx (t),y(t)+εy (t)) f(x(t),y(t)+εy (t)) (t)lim ε 0 εx (t) +y (t)lim ε 0 f(x(t),y(t)+εy (t)) f(x(t),y(t)) εy (t) Variational Methods & Optimal Control: lecture 02 p.13/29
16 Chain Rule Derivation df = x (t)lim ε 0 f(x(t)+εx (t),y(t)+εy (t)) f(x(t),y(t)+εy (t)) εx (t) = x (t) lim εx 0 +y (t)lim ε 0 f(x(t),y(t)+εy (t)) f(x(t),y(t)) εy (t) +y (t) lim εy 0 = x (t) f x + y (t) f y f(x(t)+ε x,y(t)+εy (t)) f(x(t),y(t)+εy (t)) ε x f(x(t),y(t)+ε y ) f(x(t),y(t)) ε y which is the chain rule! Variational Methods & Optimal Control: lecture 02 p.14/29
17 Chain Rule special case When we only have one variable, we simple want to calculate the derivative of a function f of another function x, e.g. d f(x(t))= df dx dx Another way of writing this is d f(x(t))= f [x(t)]x (t), which is the form you learnt in 1st year. Variational Methods & Optimal Control: lecture 02 p.15/29
18 Taylor s theorem in 2D f f f(x 1 + δx 1,x 2 + δx 2 )= f(x 1,x 2 )+δx 1 + δx 2 x 1 x [ δx 2 2 f 2 f 1 2 x δx 1 δx 2 + δx 2 2 ] f 2 x 1 x 2 x2 2 + Write(δx 1,δx 2 )=ε (η 1,η 2 ) f(x+εη)= f(x)+ε ( f f η 1 + η 2 x 1 x 2 + ε2 2 [ η f x 2 1 ) 2 f + 2η 1 η 2 + η 2 2 f 2 x 1 x 2 x2 2 ] + O(ε 3 ) Variational Methods & Optimal Control: lecture 02 p.16/29
19 Taylor s theorem in N-D f(x+δx)= f(x)+ n f δx i + 1 i=1 x i 2 n i, j=1 2 f x i x j δx i δx j + O(δx 3 ) f(x+δx)= f(x)+δx T f(x)+ 1 2 δxt H(x)δx+O(δx 3 ) Where H(x) is the Hessian matrix H(x)= 2 f x f x 2 x 1. 2 f x n x 1 2 f x 1 x 2 2 f x f x n x 2 2 f x 1 x n 2 f x 2 x n. 2 f x 2 n Variational Methods & Optimal Control: lecture 02 p.17/29
20 Maxima of N variables If a smooth function f(x) has a local extrema at x then f(x)= ( f, f,..., f ) T = 0 x 1 x 2 x n A sufficient condition for the extrema x to be a local minimum is for the quadratic form Q(δx 1,...,δx n )=δx T H(x)δx= to be strictly positive definite. n i=1 n j=1 2 f x i x j δx i δx j Variational Methods & Optimal Control: lecture 02 p.18/29
21 Quadratic forms A quadratic form Q(x)= a i j x i x j = x T Ax i, j is said to be positive definite if Q(x)>0 for all x 0. A quadratic form is positive definite iff every eigenvalue of A is greater than zero. A quadratic form is positive definite if all the principal minors in the top-left corner of A are positive, in other words a 11 a a 11 a 12 a a 11 > 0, a 21 a 22 > 0, a 21 a 22 a 23 > 0, a 31 a 32 a 33 Variational Methods & Optimal Control: lecture 02 p.19/29
22 Notes on maxima and minima maxima of f(x) are minima of f(x). haven t said anything about non-differentiable functions if continuous in the interval, must achieve maximum (minimum) in the interval Variational Methods & Optimal Control: lecture 02 p.20/29
23 Calculus of variations We are not maximizing the value of a function. We are maximizing a functional a function of a function Can think of it as an -dimensional max. problem. can choose between different functions function sits in -dimensional vector space This might take some effort. Variational Methods & Optimal Control: lecture 02 p.21/29
24 Functionals A Functional maps an element of a vector space (e.g. a space containing functions) to a real number, e.g. F : S IR. Example Functionals F{y(x)} = y(0) F{y(x)} = max{y(x)} x F{y(x)} = dy dx x=1 F{y(x)} = y(0)+y(1) F{y(x)} = N a n y(n) n=0 Variational Methods & Optimal Control: lecture 02 p.22/29
25 Integral functionals Previous functionals not very interesting. Easy to find y(x) which minimizes these. Integral functionals are more interesting. Example integral functionals F{y} = F{y} = F{y} = b a b a b a y(x)dx f(x)y(x)dx 1+ ( ) 2 dy dx dx Variational Methods & Optimal Control: lecture 02 p.23/29
26 Some simple cases F{y} = df dε If a and b are fixed then b(ε) a(ε) y(x, ε)dx = y(b,ε) db dε y(a,ε)da dε + b(ε) a(ε) y(x, ε) dx ε da dε db dε = 0 = 0 and so the derivative of the integral becomes the integral of the derivative. Variational Methods & Optimal Control: lecture 02 p.24/29
27 Crude Brachystochrone Brachystochrone involves the functional F{y}= x1 x 0 1+y 2 Let us guess that the brachystochrone takes the form y y(x,ε)=(1 x) ε We could calculate the derivative WRT ε as above and compute the stationary points by finding df dε = 0 dx Variational Methods & Optimal Control: lecture 02 p.25/29
28 Crude Brachystochrone 1.5 (1 x), total time = 2.00 wire velocity 1.5 (1 x). 4, total time = (1 x). 25, total time = wire velocity 1 wire velocity x x x Variational Methods & Optimal Control: lecture 02 p.26/29
29 Crude Brachystochrone 2 descent time ε = ε but what if the family of curves doesn t contain the maximum? Variational Methods & Optimal Control: lecture 02 p.27/29
30 Extra bits Variational Methods & Optimal Control: lecture 02 p.28/29
31 Notation f(x) : S IR denotes a function that maps the set S IR n to a real number. n f x n i denotes the nth partial derivative of f(x), with respect to x i. the ε-neighborhood under the Euclidean norm is B(x;ε)={ ˆx IR n ˆx x 2 < ε} The Euclidean norm in IR n is x 2 = n i=1 x 2 i F{y} denotes a functional of the function y(x). Variational Methods & Optimal Control: lecture 02 p.29/29
Variational Methods & Optimal Control
Variational Methods & Optimal Control lecture 12 Matthew Roughan Discipline of Applied Mathematics School of Mathematical Sciences University of Adelaide April 14, 216
More informationCalculus 2502A - Advanced Calculus I Fall : Local minima and maxima
Calculus 50A - Advanced Calculus I Fall 014 14.7: Local minima and maxima Martin Frankland November 17, 014 In these notes, we discuss the problem of finding the local minima and maxima of a function.
More informationMA102: Multivariable Calculus
MA102: Multivariable Calculus Rupam Barman and Shreemayee Bora Department of Mathematics IIT Guwahati Differentiability of f : U R n R m Definition: Let U R n be open. Then f : U R n R m is differentiable
More informationOR MSc Maths Revision Course
OR MSc Maths Revision Course Tom Byrne School of Mathematics University of Edinburgh t.m.byrne@sms.ed.ac.uk 15 September 2017 General Information Today JCMB Lecture Theatre A, 09:30-12:30 Mathematics revision
More informationVariational Methods and Optimal Control
Variational Methods and Optimal Control A/Prof. Matthew Roughan July 26, 2010 lecture01 Introduction What is the point of this course? Revision Example 1: The money pit. Example 2: Catenary: shape of a
More informationVANDERBILT UNIVERSITY. MATH 2300 MULTIVARIABLE CALCULUS Practice Test 1 Solutions
VANDERBILT UNIVERSITY MATH 2300 MULTIVARIABLE CALCULUS Practice Test 1 Solutions Directions. This practice test should be used as a study guide, illustrating the concepts that will be emphasized in the
More informationThe Derivative. Appendix B. B.1 The Derivative of f. Mappings from IR to IR
Appendix B The Derivative B.1 The Derivative of f In this chapter, we give a short summary of the derivative. Specifically, we want to compare/contrast how the derivative appears for functions whose domain
More informationREVIEW OF DIFFERENTIAL CALCULUS
REVIEW OF DIFFERENTIAL CALCULUS DONU ARAPURA 1. Limits and continuity To simplify the statements, we will often stick to two variables, but everything holds with any number of variables. Let f(x, y) be
More informationARE202A, Fall 2005 CONTENTS. 1. Graphical Overview of Optimization Theory (cont) Separating Hyperplanes 1
AREA, Fall 5 LECTURE #: WED, OCT 5, 5 PRINT DATE: OCTOBER 5, 5 (GRAPHICAL) CONTENTS 1. Graphical Overview of Optimization Theory (cont) 1 1.4. Separating Hyperplanes 1 1.5. Constrained Maximization: One
More informationSeptember Math Course: First Order Derivative
September Math Course: First Order Derivative Arina Nikandrova Functions Function y = f (x), where x is either be a scalar or a vector of several variables (x,..., x n ), can be thought of as a rule which
More information1 Overview. 2 A Characterization of Convex Functions. 2.1 First-order Taylor approximation. AM 221: Advanced Optimization Spring 2016
AM 221: Advanced Optimization Spring 2016 Prof. Yaron Singer Lecture 8 February 22nd 1 Overview In the previous lecture we saw characterizations of optimality in linear optimization, and we reviewed the
More information14.7: Maxima and Minima
14.7: Maxima and Minima Marius Ionescu October 29, 2012 Marius Ionescu () 14.7: Maxima and Minima October 29, 2012 1 / 13 Local Maximum and Local Minimum Denition Marius Ionescu () 14.7: Maxima and Minima
More informationMAT 122 Homework 7 Solutions
MAT 1 Homework 7 Solutions Section 3.3, Problem 4 For the function w = (t + 1) 100, we take the inside function to be z = t + 1 and the outside function to be z 100. The derivative of the inside function
More informationTaylor Series and stationary points
Chapter 5 Taylor Series and stationary points 5.1 Taylor Series The surface z = f(x, y) and its derivatives can give a series approximation for f(x, y) about some point (x 0, y 0 ) as illustrated in Figure
More informationP1 Calculus II. Partial Differentiation & Multiple Integration. Prof David Murray. dwm/courses/1pd
P1 2017 1 / 39 P1 Calculus II Partial Differentiation & Multiple Integration Prof David Murray david.murray@eng.ox.ac.uk www.robots.ox.ac.uk/ dwm/courses/1pd 4 lectures, MT 2017 P1 2017 2 / 39 Motivation
More informationLESSON 23: EXTREMA OF FUNCTIONS OF 2 VARIABLES OCTOBER 25, 2017
LESSON : EXTREMA OF FUNCTIONS OF VARIABLES OCTOBER 5, 017 Just like with functions of a single variable, we want to find the minima (plural of minimum) and maxima (plural of maximum) of functions of several
More informationFunctions. A function is a rule that gives exactly one output number to each input number.
Functions A function is a rule that gives exactly one output number to each input number. Why it is important to us? The set of all input numbers to which the rule applies is called the domain of the function.
More informationMath 180, Final Exam, Fall 2007 Problem 1 Solution
Problem Solution. Differentiate with respect to x. Write your answers showing the use of the appropriate techniques. Do not simplify. (a) x 27 x 2/3 (b) (x 2 2x + 2)e x (c) ln(x 2 + 4) (a) Use the Power
More informationMTH4100 Calculus I. Week 6 (Thomas Calculus Sections 3.5 to 4.2) Rainer Klages. School of Mathematical Sciences Queen Mary, University of London
MTH4100 Calculus I Week 6 (Thomas Calculus Sections 3.5 to 4.2) Rainer Klages School of Mathematical Sciences Queen Mary, University of London Autumn 2008 R. Klages (QMUL) MTH4100 Calculus 1 Week 6 1 /
More informationFaculty of Engineering, Mathematics and Science School of Mathematics
Faculty of Engineering, Mathematics and Science School of Mathematics GROUPS Trinity Term 06 MA3: Advanced Calculus SAMPLE EXAM, Solutions DAY PLACE TIME Prof. Larry Rolen Instructions to Candidates: Attempt
More informationLecture 8: Maxima and Minima
Lecture 8: Maxima and Minima Rafikul Alam Department of Mathematics IIT Guwahati Local extremum of f : R n R Let f : U R n R be continuous, where U is open. Then f has a local maximum at p if there exists
More informationLecture 2 - Unconstrained Optimization Definition[Global Minimum and Maximum]Let f : S R be defined on a set S R n. Then
Lecture 2 - Unconstrained Optimization Definition[Global Minimum and Maximum]Let f : S R be defined on a set S R n. Then 1. x S is a global minimum point of f over S if f (x) f (x ) for any x S. 2. x S
More informationLecture 5: September 12
10-725/36-725: Convex Optimization Fall 2015 Lecture 5: September 12 Lecturer: Lecturer: Ryan Tibshirani Scribes: Scribes: Barun Patra and Tyler Vuong Note: LaTeX template courtesy of UC Berkeley EECS
More informationMath 5BI: Problem Set 6 Gradient dynamical systems
Math 5BI: Problem Set 6 Gradient dynamical systems April 25, 2007 Recall that if f(x) = f(x 1, x 2,..., x n ) is a smooth function of n variables, the gradient of f is the vector field f(x) = ( f)(x 1,
More informationMathematics for Economics ECON MA/MSSc in Economics-2017/2018. Dr. W. M. Semasinghe Senior Lecturer Department of Economics
Mathematics for Economics ECON 53035 MA/MSSc in Economics-2017/2018 Dr. W. M. Semasinghe Senior Lecturer Department of Economics MATHEMATICS AND STATISTICS LERNING OUTCOMES: By the end of this course unit
More informationMath (P)refresher Lecture 8: Unconstrained Optimization
Math (P)refresher Lecture 8: Unconstrained Optimization September 2006 Today s Topics : Quadratic Forms Definiteness of Quadratic Forms Maxima and Minima in R n First Order Conditions Second Order Conditions
More informationSection 4.2. Types of Differentiation
42 Types of Differentiation 1 Section 42 Types of Differentiation Note In this section we define differentiation of various structures with respect to a scalar, a vector, and a matrix Definition Let vector
More informationPartial Derivatives. w = f(x, y, z).
Partial Derivatives 1 Functions of Several Variables So far we have focused our attention of functions of one variable. These functions model situations in which a variable depends on another independent
More information4 Partial Differentiation
4 Partial Differentiation Many equations in engineering, physics and mathematics tie together more than two variables. For example Ohm s Law (V = IR) and the equation for an ideal gas, PV = nrt, which
More informationVector Derivatives and the Gradient
ECE 275AB Lecture 10 Fall 2008 V1.1 c K. Kreutz-Delgado, UC San Diego p. 1/1 Lecture 10 ECE 275A Vector Derivatives and the Gradient ECE 275AB Lecture 10 Fall 2008 V1.1 c K. Kreutz-Delgado, UC San Diego
More informationOptimization: Problem Set Solutions
Optimization: Problem Set Solutions Annalisa Molino University of Rome Tor Vergata annalisa.molino@uniroma2.it Fall 20 Compute the maxima minima or saddle points of the following functions a. f(x y) =
More informationThe Inverse Function Theorem 1
John Nachbar Washington University April 11, 2014 1 Overview. The Inverse Function Theorem 1 If a function f : R R is C 1 and if its derivative is strictly positive at some x R, then, by continuity of
More informationSecond Order ODEs. Second Order ODEs. In general second order ODEs contain terms involving y, dy But here only consider equations of the form
Second Order ODEs Second Order ODEs In general second order ODEs contain terms involving y, dy But here only consider equations of the form A d2 y dx 2 + B dy dx + Cy = 0 dx, d2 y dx 2 and F(x). where
More informationMath 207 Honors Calculus III Final Exam Solutions
Math 207 Honors Calculus III Final Exam Solutions PART I. Problem 1. A particle moves in the 3-dimensional space so that its velocity v(t) and acceleration a(t) satisfy v(0) = 3j and v(t) a(t) = t 3 for
More informationMA261-A Calculus III 2006 Fall Midterm 2 Solutions 11/8/2006 8:00AM ~9:15AM
MA6-A Calculus III 6 Fall Midterm Solutions /8/6 8:AM ~9:5AM. Find the it xy cos y (x;y)(;) 3x + y, if it exists, or show that the it does not exist. Assume that x. The it becomes (;y)(;) y cos y 3 + y
More informationMath Maximum and Minimum Values, I
Math 213 - Maximum and Minimum Values, I Peter A. Perry University of Kentucky October 8, 218 Homework Re-read section 14.7, pp. 959 965; read carefully pp. 965 967 Begin homework on section 14.7, problems
More informationExercises for Multivariable Differential Calculus XM521
This document lists all the exercises for XM521. The Type I (True/False) exercises will be given, and should be answered, online immediately following each lecture. The Type III exercises are to be done
More informationCalculus - II Multivariable Calculus. M.Thamban Nair. Department of Mathematics Indian Institute of Technology Madras
Calculus - II Multivariable Calculus M.Thamban Nair epartment of Mathematics Indian Institute of Technology Madras February 27 Revised: January 29 Contents Preface v 1 Functions of everal Variables 1 1.1
More informationEC /11. Math for Microeconomics September Course, Part II Lecture Notes. Course Outline
LONDON SCHOOL OF ECONOMICS Professor Leonardo Felli Department of Economics S.478; x7525 EC400 20010/11 Math for Microeconomics September Course, Part II Lecture Notes Course Outline Lecture 1: Tools for
More informationMATH 105: PRACTICE PROBLEMS FOR CHAPTER 3: SPRING 2010
MATH 105: PRACTICE PROBLEMS FOR CHAPTER 3: SPRING 010 INSTRUCTOR: STEVEN MILLER (SJM1@WILLIAMS.EDU Question 1 : Compute the partial derivatives of order 1 order for: (1 f(x, y, z = e x+y cos(x sin(y. Solution:
More informationHigher order derivative
2 Î 3 á Higher order derivative Î 1 Å Iterated partial derivative Iterated partial derivative Suppose f has f/ x, f/ y and ( f ) = 2 f x x x 2 ( f ) = 2 f x y x y ( f ) = 2 f y x y x ( f ) = 2 f y y y
More informationComputational Optimization. Mathematical Programming Fundamentals 1/25 (revised)
Computational Optimization Mathematical Programming Fundamentals 1/5 (revised) If you don t know where you are going, you probably won t get there. -from some book I read in eight grade If you do get there,
More informationAB CALCULUS SEMESTER A REVIEW Show all work on separate paper. (b) lim. lim. (f) x a. for each of the following functions: (b) y = 3x 4 x + 2
AB CALCULUS Page 1 of 6 NAME DATE 1. Evaluate each it: AB CALCULUS Show all work on separate paper. x 3 x 9 x 5x + 6 x 0 5x 3sin x x 7 x 3 x 3 5x (d) 5x 3 x +1 x x 4 (e) x x 9 3x 4 6x (f) h 0 sin( π 6
More informationEC9A0: Pre-sessional Advanced Mathematics Course. Lecture Notes: Unconstrained Optimisation By Pablo F. Beker 1
EC9A0: Pre-sessional Advanced Mathematics Course Lecture Notes: Unconstrained Optimisation By Pablo F. Beker 1 1 Infimum and Supremum Definition 1. Fix a set Y R. A number α R is an upper bound of Y if
More informationThis exam will be over material covered in class from Monday 14 February through Tuesday 8 March, corresponding to sections in the text.
Math 275, section 002 (Ultman) Spring 2011 MIDTERM 2 REVIEW The second midterm will be held in class (1:40 2:30pm) on Friday 11 March. You will be allowed one half of one side of an 8.5 11 sheet of paper
More informationFunctions of Several Variables
Functions of Several Variables The Unconstrained Minimization Problem where In n dimensions the unconstrained problem is stated as f() x variables. minimize f()x x, is a scalar objective function of vector
More information12.1 Taylor Polynomials In Two-Dimensions: Nonlinear Approximations of F(x,y) Polynomials in Two-Variables. Taylor Polynomials and Approximations.
Week 12 Lecture Overheads Math2080 Week 12 Page 1 12.1 Taylor Polynomials In Two-Dimensions: Nonlinear Approximations of F(x,y) Polynomials in Two-Variables. Taylor Polynomials and Approximations. 12.2
More informationMAT 211 Final Exam. Spring Jennings. Show your work!
MAT 211 Final Exam. pring 215. Jennings. how your work! Hessian D = f xx f yy (f xy ) 2 (for optimization). Polar coordinates x = r cos(θ), y = r sin(θ), da = r dr dθ. ylindrical coordinates x = r cos(θ),
More informationMath 2204 Multivariable Calculus Chapter 14: Partial Derivatives Sec. 14.7: Maximum and Minimum Values
Math 2204 Multivariable Calculus Chapter 14: Partial Derivatives Sec. 14.7: Maximum and Minimum Values I. Review from 1225 A. Definitions 1. Local Extreme Values (Relative) a. A function f has a local
More informationSTUDY MATERIALS. (The content of the study material is the same as that of Chapter I of Mathematics for Economic Analysis II of 2011 Admn.
STUDY MATERIALS MATHEMATICAL TOOLS FOR ECONOMICS III (The content of the study material is the same as that of Chapter I of Mathematics for Economic Analysis II of 2011 Admn.) & MATHEMATICAL TOOLS FOR
More informationMultivariable Calculus and Matrix Algebra-Summer 2017
Multivariable Calculus and Matrix Algebra-Summer 017 Homework 4 Solutions Note that the solutions below are for the latest version of the problems posted. For those of you who worked on an earlier version
More information21-256: Partial differentiation
21-256: Partial differentiation Clive Newstead, Thursday 5th June 2014 This is a summary of the important results about partial derivatives and the chain rule that you should know. Partial derivatives
More informationAdvanced Calculus Notes. Michael P. Windham
Advanced Calculus Notes Michael P. Windham February 25, 2008 Contents 1 Basics 5 1.1 Euclidean Space R n............................ 5 1.2 Functions................................. 7 1.2.1 Sets and functions........................
More informationAbsolute Maxima and Minima Section 12.11
Absolute Maxima and Minima Section 1.11 Definition (a) A set in the plane is called a closed set if it contains all of its boundary points. (b) A set in the plane is called a bounded set if it is contained
More informationMechanical Systems II. Method of Lagrange Multipliers
Mechanical Systems II. Method of Lagrange Multipliers Rafael Wisniewski Aalborg University Abstract. So far our approach to classical mechanics was limited to finding a critical point of a certain functional.
More informationUniversity of Alberta. Math 214 Sample Exam Math 214 Solutions
University of Alberta Math 14 Sample Exam Math 14 Solutions 1. Test the following series for convergence or divergence (a) ( n +n+1 3n +n+1 )n, (b) 3 n (n +1) (c) SOL: n!, arccos( n n +1 ), (a) ( n +n+1
More informationMATH 5720: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 2018
MATH 57: Unconstrained Optimization Hung Phan, UMass Lowell September 13, 18 1 Global and Local Optima Let a function f : S R be defined on a set S R n Definition 1 (minimizers and maximizers) (i) x S
More information2015 Math Camp Calculus Exam Solution
015 Math Camp Calculus Exam Solution Problem 1: x = x x +5 4+5 = 9 = 3 1. lim We also accepted ±3, even though it is not according to the prevailing convention 1. x x 4 x+4 =. lim 4 4+4 = 4 0 = 4 0 = We
More informationCE 191: Civil and Environmental Engineering Systems Analysis. LEC 05 : Optimality Conditions
CE 191: Civil and Environmental Engineering Systems Analysis LEC : Optimality Conditions Professor Scott Moura Civil & Environmental Engineering University of California, Berkeley Fall 214 Prof. Moura
More informationAn Overview of Mathematics for Thermodynamics
CHEM 331 Physical Chemistry Revision 1.1 An Overview of Mathematics for Thermodynamics It is assumed you come to this Physical Chemistry I course with a solid background in Calculus. However, that background
More informationAnnouncements. Topics: Homework: - sections , 6.1 (extreme values) * Read these sections and study solved examples in your textbook!
Announcements Topics: - sections 5.2 5.7, 6.1 (extreme values) * Read these sections and study solved examples in your textbook! Homework: - review lecture notes thoroughly - work on practice problems
More informationIntroduction to gradient descent
6-1: Introduction to gradient descent Prof. J.C. Kao, UCLA Introduction to gradient descent Derivation and intuitions Hessian 6-2: Introduction to gradient descent Prof. J.C. Kao, UCLA Introduction Our
More informationCalculus of Variations Summer Term 2015
Calculus of Variations Summer Term 2015 Lecture 12 Universität des Saarlandes 17. Juni 2015 c Daria Apushkinskaya (UdS) Calculus of variations lecture 12 17. Juni 2015 1 / 31 Purpose of Lesson Purpose
More informationNonlinear equations and optimization
Notes for 2017-03-29 Nonlinear equations and optimization For the next month or so, we will be discussing methods for solving nonlinear systems of equations and multivariate optimization problems. We will
More informationMATH 2053 Calculus I Review for the Final Exam
MATH 05 Calculus I Review for the Final Exam (x+ x) 9 x 9 1. Find the limit: lim x 0. x. Find the limit: lim x + x x (x ).. Find lim x (x 5) = L, find such that f(x) L < 0.01 whenever 0 < x
More informationReview of Optimization Methods
Review of Optimization Methods Prof. Manuela Pedio 20550 Quantitative Methods for Finance August 2018 Outline of the Course Lectures 1 and 2 (3 hours, in class): Linear and non-linear functions on Limits,
More informationMATH 200 WEEK 5 - WEDNESDAY DIRECTIONAL DERIVATIVE
WEEK 5 - WEDNESDAY DIRECTIONAL DERIVATIVE GOALS Be able to compute a gradient vector, and use it to compute a directional derivative of a given function in a given direction. Be able to use the fact that
More informationLecture Notes for MATH6106. March 25, 2010
Lecture Notes for MATH66 March 25, 2 Contents Vectors 4. Points in Space.......................... 4.2 Distance between Points..................... 4.3 Scalars and Vectors........................ 5.4 Vectors
More informationProblem Worth Score Total 14
MATH 241, Fall 14 Extra Credit Preparation for Final Name: INSTRUCTIONS: Write legibly. Indicate your answer clearly. Revise and clean up solutions. Do not cross anything out. Rewrite the page, I will
More informationUnconstrained minimization of smooth functions
Unconstrained minimization of smooth functions We want to solve min x R N f(x), where f is convex. In this section, we will assume that f is differentiable (so its gradient exists at every point), and
More informationStrain Transformation equations
Strain Transformation equations R. Chandramouli Associate Dean-Research SASTRA University, Thanjavur-613 401 Joint Initiative of IITs and IISc Funded by MHRD Page 1 of 8 Table of Contents 1. Stress transformation
More information446 CHAP. 8 NUMERICAL OPTIMIZATION. Newton's Search for a Minimum of f(x,y) Newton s Method
446 CHAP. 8 NUMERICAL OPTIMIZATION Newton's Search for a Minimum of f(xy) Newton s Method The quadratic approximation method of Section 8.1 generated a sequence of seconddegree Lagrange polynomials. It
More informationMath 16A Second Midterm 6 Nov NAME (1 pt): Name of Neighbor to your left (1 pt): Name of Neighbor to your right (1 pt):
Math 16A Second Mierm 6 Nov 2008 NAME (1 pt): TA (1 pt): Name of Neighbor to your left (1 pt): Name of Neighbor to your right (1 pt): Instructions: This is a closed book, closed notes, closed calculator,
More informationMATH Midterm 1 Sample 4
1. (15 marks) (a) (4 marks) Given the function: f(x, y) = arcsin x 2 + y, find its first order partial derivatives at the point (0, 3). Simplify your answers. Solution: Compute the first order partial
More informationImplicit Functions, Curves and Surfaces
Chapter 11 Implicit Functions, Curves and Surfaces 11.1 Implicit Function Theorem Motivation. In many problems, objects or quantities of interest can only be described indirectly or implicitly. It is then
More informationISE I Brief Lecture Notes
ISE I Brief Lecture Notes 1 Partial Differentiation 1.1 Definitions Let f(x, y) be a function of two variables. The partial derivative f/ x is the function obtained by differentiating f with respect to
More information2.10 Saddles, Nodes, Foci and Centers
2.10 Saddles, Nodes, Foci and Centers In Section 1.5, a linear system (1 where x R 2 was said to have a saddle, node, focus or center at the origin if its phase portrait was linearly equivalent to one
More informationNeural Network Training
Neural Network Training Sargur Srihari Topics in Network Training 0. Neural network parameters Probabilistic problem formulation Specifying the activation and error functions for Regression Binary classification
More informationCalculus Example Exam Solutions
Calculus Example Exam Solutions. Limits (8 points, 6 each) Evaluate the following limits: p x 2 (a) lim x 4 We compute as follows: lim p x 2 x 4 p p x 2 x +2 x 4 p x +2 x 4 (x 4)( p x + 2) p x +2 = p 4+2
More informationMATHEMATICAL ECONOMICS: OPTIMIZATION. Contents
MATHEMATICAL ECONOMICS: OPTIMIZATION JOÃO LOPES DIAS Contents 1. Introduction 2 1.1. Preliminaries 2 1.2. Optimal points and values 2 1.3. The optimization problems 3 1.4. Existence of optimal points 4
More informationChapter 2: Unconstrained Extrema
Chapter 2: Unconstrained Extrema Math 368 c Copyright 2012, 2013 R Clark Robinson May 22, 2013 Chapter 2: Unconstrained Extrema 1 Types of Sets Definition For p R n and r > 0, the open ball about p of
More informationDifferentiation. f(x + h) f(x) Lh = L.
Analysis in R n Math 204, Section 30 Winter Quarter 2008 Paul Sally, e-mail: sally@math.uchicago.edu John Boller, e-mail: boller@math.uchicago.edu website: http://www.math.uchicago.edu/ boller/m203 Differentiation
More informationMidterm 1 Solutions Thursday, February 26
Math 59 Dr. DeTurck Midterm 1 Solutions Thursday, February 26 1. First note that since f() = f( + ) = f()f(), we have either f() = (in which case f(x) = f(x + ) = f(x)f() = for all x, so c = ) or else
More informationModule Two: Differential Calculus(continued) synopsis of results and problems (student copy)
Module Two: Differential Calculus(continued) synopsis of results and problems (student copy) Srikanth K S 1 Syllabus Taylor s and Maclaurin s theorems for function of one variable(statement only)- problems.
More informationTest 3 Review. y f(a) = f (a)(x a) y = f (a)(x a) + f(a) L(x) = f (a)(x a) + f(a)
MATH 2250 Calculus I Eric Perkerson Test 3 Review Sections Covered: 3.11, 4.1 4.6. Topics Covered: Linearization, Extreme Values, The Mean Value Theorem, Consequences of the Mean Value Theorem, Concavity
More informationPart IA Differential Equations
Part IA Differential Equations Based on lectures by M. G. Worster Notes taken by Dexter Chua Michaelmas 2014 These notes are not endorsed by the lecturers, and I have modified them (often significantly)
More informationMTH4101 CALCULUS II REVISION NOTES. 1. COMPLEX NUMBERS (Thomas Appendix 7 + lecture notes) ax 2 + bx + c = 0. x = b ± b 2 4ac 2a. i = 1.
MTH4101 CALCULUS II REVISION NOTES 1. COMPLEX NUMBERS (Thomas Appendix 7 + lecture notes) 1.1 Introduction Types of numbers (natural, integers, rationals, reals) The need to solve quadratic equations:
More informationMTAEA Differentiation
School of Economics, Australian National University February 5, 2010 Basic Properties of the Derivative. Secant Tangent Applet l 3 l 2 l 1 a a 3 a 2 a 1 Figure: The derivative of f at a is the limiting
More informationEngg. Math. I. Unit-I. Differential Calculus
Dr. Satish Shukla 1 of 50 Engg. Math. I Unit-I Differential Calculus Syllabus: Limits of functions, continuous functions, uniform continuity, monotone and inverse functions. Differentiable functions, Rolle
More informationEC /11. Math for Microeconomics September Course, Part II Problem Set 1 with Solutions. a11 a 12. x 2
LONDON SCHOOL OF ECONOMICS Professor Leonardo Felli Department of Economics S.478; x7525 EC400 2010/11 Math for Microeconomics September Course, Part II Problem Set 1 with Solutions 1. Show that the general
More informationReview for the Final Exam
Math 171 Review for the Final Exam 1 Find the limits (4 points each) (a) lim 4x 2 3; x x (b) lim ( x 2 x x 1 )x ; (c) lim( 1 1 ); x 1 ln x x 1 sin (x 2) (d) lim x 2 x 2 4 Solutions (a) The limit lim 4x
More information1 Functions of Several Variables Some Examples Level Curves / Contours Functions of More Variables... 6
Contents 1 Functions of Several Variables 1 1.1 Some Examples.................................. 2 1.2 Level Curves / Contours............................. 4 1.3 Functions of More Variables...........................
More informationMath 263 Assignment #4 Solutions. 0 = f 1 (x,y,z) = 2x 1 0 = f 2 (x,y,z) = z 2 0 = f 3 (x,y,z) = y 1
Math 263 Assignment #4 Solutions 1. Find and classify the critical points of each of the following functions: (a) f(x,y,z) = x 2 + yz x 2y z + 7 (c) f(x,y) = e x2 y 2 (1 e x2 ) (b) f(x,y) = (x + y) 3 (x
More information3.5 Quadratic Approximation and Convexity/Concavity
3.5 Quadratic Approximation and Convexity/Concavity 55 3.5 Quadratic Approximation and Convexity/Concavity Overview: Second derivatives are useful for understanding how the linear approximation varies
More informationOptimality Conditions
Chapter 2 Optimality Conditions 2.1 Global and Local Minima for Unconstrained Problems When a minimization problem does not have any constraints, the problem is to find the minimum of the objective function.
More information1. Introduction. 2. Outlines
1. Introduction Graphs are beneficial because they summarize and display information in a manner that is easy for most people to comprehend. Graphs are used in many academic disciplines, including math,
More informationLECTURE 22: SWARM INTELLIGENCE 3 / CLASSICAL OPTIMIZATION
15-382 COLLECTIVE INTELLIGENCE - S19 LECTURE 22: SWARM INTELLIGENCE 3 / CLASSICAL OPTIMIZATION TEACHER: GIANNI A. DI CARO WHAT IF WE HAVE ONE SINGLE AGENT PSO leverages the presence of a swarm: the outcome
More informationAppendix 3. Derivatives of Vectors and Vector-Valued Functions DERIVATIVES OF VECTORS AND VECTOR-VALUED FUNCTIONS
Appendix 3 Derivatives of Vectors and Vector-Valued Functions Draft Version 1 December 2000, c Dec. 2000, B. Walsh and M. Lynch Please email any comments/corrections to: jbwalsh@u.arizona.edu DERIVATIVES
More informationz 2 = 1 4 (x 2) + 1 (y 6)
MA 5 Fall 007 Exam # Review Solutions. Consider the function fx, y y x. a Sketch the domain of f. For the domain, need y x 0, i.e., y x. - - - 0 0 - - - b Sketch the level curves fx, y k for k 0,,,. The
More information4.1 Analysis of functions I: Increase, decrease and concavity
4.1 Analysis of functions I: Increase, decrease and concavity Definition Let f be defined on an interval and let x 1 and x 2 denote points in that interval. a) f is said to be increasing on the interval
More information