Math 273b: Calculus of Variations

Size: px
Start display at page:

Download "Math 273b: Calculus of Variations"

Transcription

1 Math 273b: Calcls of Variations Yacob Kreh Homework #3 [1] Consier the 1D length fnctional minimization problem min F 1 1 L, or min 1 + 2, for twice ifferentiable fnctions : [, 1] R with bonary conitions, 1 1. a Show that the fnctional F is conve. b Formally compte the Gatea-ifferential an then obtain the Eler Lagrange eqation associate with the minimization. c Fin the eact soltion of the problem. Soltion: a To prove conveity of F, first prove it for L. Start by ifferentiating L twice. We get >

2 Yacob Kreh 2 This proves that L is conve an so, F λ + 1 λv 1 Lλ + 1 λv 1 λl + 1 λlv λf + 1 λf v. So F is conve. b To compte the Gatea erivative, consier an arbitrary smooth v sch that v v1 an an arbitrary ɛ >. We see we get F + ɛv F lim ɛ ɛ lim ɛ lim ɛ lim ɛ 1 v ɛv ɛ ɛv ɛ ɛv v v As v vanishes at bonaries, we are left with 1 ɛv v minimizing, the Gatea erivative mst vanish for all v, that is 1 for all fnctions v which implies v. Since we are v Differentiating leas to so we get. This is the Eler Lagrange Eqation for this problem. c Since the secon erivative vanishes, the fnction mst be linear, an since only one line passes throgh, an 1,1, we get that the niqe soltion to the 1D length minimization is. [2] Let A : R n R n be a linear self-ajoint operator, b R n, an consier the qaratic fnction for R n Show that the three statements i inf{q : R n } > ii A O an b ImA. q : A, 2 b,.

3 Yacob Kreh 3 iii the problem inf{q : R n } > has a soltion are eqivalent. When they hol, characterize the set of minimm points of q, in terms of the pseo-inverse of A. Soltion: i ii We o this by contrapositive, sppose that A is not positive semi-efinite, then A has a negative eigenvale c < with some fie eigenvector, i.e. A c. Consier α α. Now look at q α A α, α 2 b, α T αa α 2b T α c α 2 2b T α cα 2 2 αb T. As c 2 an b T are fie, call these 1 < an 2, we can make q α 1 α α as negative as we want as it is qaratic in α with negative leaing coefficient, ths inf{q}. This proves inf{q} > implies A. Net assme b ImA. Consier an orthonormal basis for A {v i } with eigenvales { }. We have that there oes not eist a soltion to b i v i b A A i v i i v i which means j sch that b j bt λ j. Let α αv j. Now we have q α A α, α 2 b, α, α 2 b i v i, α 2αb j, this can be mae as positive or negative as we want as it is linear in α. Ths again inf{q} >. This proves inf{q} > implies b ImA. ii iii As A we have that there eists an orthonormal eigenbasis {v i } whose eigenvales are all non-negative. Let s arrange the eigenvales in ecreasing orer repeate eigenvales are fine, any orer is okay an so we have that the first k eigenvales are positive an the last n k are, where n k is the imension of the kernel. We also have that b b i v i ImA an so we know that b i for i > k. Evalating q we get A, 2 b, A i v i, i v i 2 b i v i, i v i λi i 2 2 b i i i 2 2 b i i. Notice that we only nee to sm p to k as for i > k, b i. Ths we have that q k i 2 2b i i. This is jst a sm of qaratic polynomial in k variables with positive leaing coefficients, an it can be minimize by minimizing each separately as can be seen partial ifferentiation techniqes. We fin that setting i b i for i k is the minimizer, with i free in the other coorinates as they will vanish. Ths inf{q} > has a soltion. iii i Trivial. To constrct the pseo-inverse of A, let U be the n k matri whose colmns are the eigenvectors with nonzero eigenvales an D the iagonal k k matri consisting of those nonzero eigenvales. The pseo-inverse is then UD 1 U T. Or soltion set is UD 1 U T b + KerA. We note that U T b projects b onto to basis of the first k eigenvectors, which is jst a basis transformation since b is in the image of A so the projection oes not lose any information, we jst get the b i terms from the epansion b k b i v i. Then mltiplication by D 1 precisely gives b i an mtliplication by U gives s k b i v i. The pseo-inverse gives the soltion from the soltion set that minimizes, becase it oes not a anything from the kernel.

4 Yacob Kreh 4 [3] Comptation of the Eler-Lagrange eqation. a Consier the minimization problem inf F L,,, with, 1 1 given constants, an L a sfficiently smooth fnction. Obtain formally the Eler-Lagrange eqation of the minimization problem that is satisfie by a smooth optimal. Hint: Consier smooth test fnctions v, sch that v v 1. Since is a minimizer, we mst have F F + εv for all sch sfficiently smooth fnctions v an every real ɛ. Apply integration by parts to obtain the esire reslt. Yo shol obtain a secon-orer ifferential eqation. b Let now, t be a smooth soltion of the time-epenent partial ifferential eqation PDE t L,, L,,, with, on, 1 an, t U, 1, t U 1 for t. Show that the fnction Et F, t is ecreasing in time, where F 1 L,,. Soltion: a We want to minimize F, that is, if is the minimizer F F + w for all fnctions w sch that w vanishes at the bonary. So let s assme is sch a minimizer of F, now consier a smooth test fnction v sch that v v 1 an an ɛ >. Let s eamine Gɛ 1 L, +ɛv, +ɛv. We shol have that this Gɛ attains a minimm at ɛ, which we prove by taking erivative. Gɛ ɛ ɛ L, + ɛv, + ɛv where we have a total erivative. Let Lɛ L, + ɛv, + ɛv an L L,, an we get ɛ Lɛ Lɛ + ɛv Lɛ + ɛ ɛ + ɛv + + ɛv Lɛ ɛ + ɛv v Lɛ + ɛv + Lɛ v. + ɛv Now we can set ɛ an this integral shol vanish. That is, we get v L L + v. 3

5 Yacob Kreh 5 An integration by parts gives L v L v L 1. However, we know that v vanishes at the bonary, an since v is an arbitrary smooth fnction, L L. That is to say, the minimizer of satisfies that above secon orer ifferential eqation. b We want to show E is ecreasing in time. This is eqivalent to show E. t We have that E F t t t L,, t,, t where. Compting the total erivative as above we get L,, t,, t t L t t + L t + t L t + L t L t L 2. t L + t L 1 4 Where we se integration by parts an the fact that is constant in time at an 1, which meant the bonary term vanishe. Ths the energy E ecreases in time.

n s n Z 0 on complex-valued functions on the circle. Then sgn n + 1 ) n + 1 2) s

n s n Z 0 on complex-valued functions on the circle. Then sgn n + 1 ) n + 1 2) s . What is the eta invariant? The eta invariant was introce in the famos paper of Atiyah, Patoi, an Singer see [], in orer to proce an inex theorem for manifols with bonary. The eta invariant of a linear

More information

Logarithmic, Exponential and Other Transcendental Functions

Logarithmic, Exponential and Other Transcendental Functions Logarithmic, Eponential an Other Transcenental Fnctions 5: The Natral Logarithmic Fnction: Differentiation The Definition First, yo mst know the real efinition of the natral logarithm: ln= t (where > 0)

More information

A Note on Irreducible Polynomials and Identity Testing

A Note on Irreducible Polynomials and Identity Testing A Note on Irrecible Polynomials an Ientity Testing Chanan Saha Department of Compter Science an Engineering Inian Institte of Technology Kanpr Abstract We show that, given a finite fiel F q an an integer

More information

18-660: Numerical Methods for Engineering Design and Optimization

18-660: Numerical Methods for Engineering Design and Optimization 8-66: Nmerical Methos for Engineering Design an Optimization in Li Department of ECE Carnegie Mellon University Pittsbrgh, PA 53 Slie Overview Geometric Problems Maximm inscribe ellipsoi Minimm circmscribe

More information

HOMEWORK 2 SOLUTIONS

HOMEWORK 2 SOLUTIONS HOMEWORK 2 SOLUTIONS PHIL SAAD 1. Carroll 1.4 1.1. A qasar, a istance D from an observer on Earth, emits a jet of gas at a spee v an an angle θ from the line of sight of the observer. The apparent spee

More information

A. Incorrect! The letter t does not appear in the expression of the given integral

A. Incorrect! The letter t does not appear in the expression of the given integral AP Physics C - Problem Drill 1: The Funamental Theorem of Calculus Question No. 1 of 1 Instruction: (1) Rea the problem statement an answer choices carefully () Work the problems on paper as neee (3) Question

More information

Solution to Tutorial 8

Solution to Tutorial 8 Soltion to Ttorial 8 01/013 Semester I MA464 Game Theory Ttor: Xiang Sn October, 01 1 eview A perfect Bayesian eqilibrim consists of strategies an beliefs satisfying eqirements 1 throgh 4. eqirement 1:

More information

Formal Methods for Deriving Element Equations

Formal Methods for Deriving Element Equations Formal Methods for Deriving Element Eqations And the importance of Shape Fnctions Formal Methods In previos lectres we obtained a bar element s stiffness eqations sing the Direct Method to obtain eact

More information

Mehmet Pakdemirli* Precession of a Planet with the Multiple Scales Lindstedt Poincare Technique (2)

Mehmet Pakdemirli* Precession of a Planet with the Multiple Scales Lindstedt Poincare Technique (2) Z. Natrforsch. 05; aop Mehmet Pakemirli* Precession of a Planet with the Mltiple Scales Linstet Poincare Techniqe DOI 0.55/zna-05-03 Receive May, 05; accepte Jly 5, 05 Abstract: The recently evelope mltiple

More information

The Linear Quadratic Regulator

The Linear Quadratic Regulator 10 The Linear Qadratic Reglator 10.1 Problem formlation This chapter concerns optimal control of dynamical systems. Most of this development concerns linear models with a particlarly simple notion of optimality.

More information

Conditions for Approaching the Origin without Intersecting the x-axis in the Liénard Plane

Conditions for Approaching the Origin without Intersecting the x-axis in the Liénard Plane Filomat 3:2 (27), 376 377 https://doi.org/.2298/fil7276a Pblished by Faclty of Sciences and Mathematics, University of Niš, Serbia Available at: http://www.pmf.ni.ac.rs/filomat Conditions for Approaching

More information

Approximate Solution of Convection- Diffusion Equation by the Homotopy Perturbation Method

Approximate Solution of Convection- Diffusion Equation by the Homotopy Perturbation Method Gen. Math. Notes, Vol. 1, No., December 1, pp. 18-114 ISSN 19-7184; Copyright ICSRS Pblication, 1 www.i-csrs.org Available free online at http://www.geman.in Approximate Soltion of Convection- Diffsion

More information

Section 7.4: Integration of Rational Functions by Partial Fractions

Section 7.4: Integration of Rational Functions by Partial Fractions Section 7.4: Integration of Rational Fnctions by Partial Fractions This is abot as complicated as it gets. The Method of Partial Fractions Ecept for a few very special cases, crrently we have no way to

More information

EC5555 Economics Masters Refresher Course in Mathematics September 2013

EC5555 Economics Masters Refresher Course in Mathematics September 2013 EC5555 Economics Masters Reresher Course in Mathematics September 3 Lecture 5 Unconstraine Optimization an Quaratic Forms Francesco Feri We consier the unconstraine optimization or the case o unctions

More information

Homework 5 Solutions

Homework 5 Solutions Q Homework Soltions We know that the colmn space is the same as span{a & a ( a * } bt we want the basis Ths we need to make a & a ( a * linearly independent So in each of the following problems we row

More information

7. Differentiation of Trigonometric Function

7. Differentiation of Trigonometric Function 7. Differentiation of Trigonoetric Fnction RADIAN MEASURE. Let s enote the length of arc AB intercepte y the central angle AOB on a circle of rais r an let S enote the area of the sector AOB. (If s is

More information

Calculus of Variations

Calculus of Variations Calculus of Variations Lagrangian formalism is the main tool of theoretical classical mechanics. Calculus of Variations is a part of Mathematics which Lagrangian formalism is base on. In this section,

More information

The Scalar Conservation Law

The Scalar Conservation Law The Scalar Conservation Law t + f() = 0 = conserved qantity, f() =fl d dt Z b a (t, ) d = Z b a t (t, ) d = Z b a f (t, ) d = f (t, a) f (t, b) = [inflow at a] [otflow at b] f((a)) f((b)) a b Alberto Bressan

More information

Complementing the Lagrangian Density of the E. M. Field and the Surface Integral of the p-v Vector Product

Complementing the Lagrangian Density of the E. M. Field and the Surface Integral of the p-v Vector Product Applie Mathematics,,, 5-9 oi:.436/am..4 Pblishe Online Febrary (http://www.scirp.org/jornal/am) Complementing the Lagrangian Density of the E. M. Fiel an the Srface Integral of the p- Vector Proct Abstract

More information

II. First variation of functionals

II. First variation of functionals II. First variation of functionals The erivative of a function being zero is a necessary conition for the etremum of that function in orinary calculus. Let us now tackle the question of the equivalent

More information

Math 180, Exam 2, Fall 2012 Problem 1 Solution. (a) The derivative is computed using the Chain Rule twice. 1 2 x x

Math 180, Exam 2, Fall 2012 Problem 1 Solution. (a) The derivative is computed using the Chain Rule twice. 1 2 x x . Fin erivatives of the following functions: (a) f() = tan ( 2 + ) ( ) 2 (b) f() = ln 2 + (c) f() = sin() Solution: Math 80, Eam 2, Fall 202 Problem Solution (a) The erivative is compute using the Chain

More information

FEA Solution Procedure

FEA Solution Procedure EA Soltion Procedre (demonstrated with a -D bar element problem) EA Procedre for Static Analysis. Prepare the E model a. discretize (mesh) the strctre b. prescribe loads c. prescribe spports. Perform calclations

More information

Computerized tomography. CT Reconstruction. Physics of beam attenuation. Physics of beam attenuation

Computerized tomography. CT Reconstruction. Physics of beam attenuation. Physics of beam attenuation Compterize tomograph Compterize tomograph (CT) is a metho for sing x-ra images to reconstrct a spatiall aring ensit fnction. CT Reconstrction First generation CT scanner 1 2 Phsics of beam attenation CT

More information

A NEW ENTROPY FORMULA AND GRADIENT ESTIMATES FOR THE LINEAR HEAT EQUATION ON STATIC MANIFOLD

A NEW ENTROPY FORMULA AND GRADIENT ESTIMATES FOR THE LINEAR HEAT EQUATION ON STATIC MANIFOLD International Jornal of Analysis an Applications ISSN 91-8639 Volme 6, Nmber 1 014, 1-17 http://www.etamaths.com A NEW ENTROPY FORULA AND GRADIENT ESTIATES FOR THE LINEAR HEAT EQUATION ON STATIC ANIFOLD

More information

MAXIMUM AND ANTI-MAXIMUM PRINCIPLES FOR THE P-LAPLACIAN WITH A NONLINEAR BOUNDARY CONDITION. 1. Introduction. ν = λ u p 2 u.

MAXIMUM AND ANTI-MAXIMUM PRINCIPLES FOR THE P-LAPLACIAN WITH A NONLINEAR BOUNDARY CONDITION. 1. Introduction. ν = λ u p 2 u. 2005-Ojda International Conference on Nonlinear Analysis. Electronic Jornal of Differential Eqations, Conference 14, 2006, pp. 95 107. ISSN: 1072-6691. URL: http://ejde.math.txstate.ed or http://ejde.math.nt.ed

More information

Partial Differential Equations with Applications

Partial Differential Equations with Applications Universit of Leeds MATH 33 Partial Differential Eqations with Applications Eamples to spplement Chapter on First Order PDEs Eample (Simple linear eqation, k + = 0, (, 0) = ϕ(), k a constant.) The characteristic

More information

The Principle of Least Action and Designing Fiber Optics

The Principle of Least Action and Designing Fiber Optics University of Southampton Department of Physics & Astronomy Year 2 Theory Labs The Principle of Least Action an Designing Fiber Optics 1 Purpose of this Moule We will be intereste in esigning fiber optic

More information

Diagonalization of Matrices Dr. E. Jacobs

Diagonalization of Matrices Dr. E. Jacobs Diagonalization of Matrices Dr. E. Jacobs One of the very interesting lessons in this course is how certain algebraic techniques can be use to solve ifferential equations. The purpose of these notes is

More information

Control Systems

Control Systems 6.5 Control Systems Last Time: Introdction Motivation Corse Overview Project Math. Descriptions of Systems ~ Review Classification of Systems Linear Systems LTI Systems The notion of state and state variables

More information

x = c of N if the limit of f (x) = L and the right-handed limit lim f ( x)

x = c of N if the limit of f (x) = L and the right-handed limit lim f ( x) Limit We say the limit of f () as approaches c equals L an write, lim L. One-Sie Limits (Left an Right-Hane Limits) Suppose a function f is efine near but not necessarily at We say that f has a left-hane

More information

Complex Variables. For ECON 397 Macroeconometrics Steve Cunningham

Complex Variables. For ECON 397 Macroeconometrics Steve Cunningham Comple Variables For ECON 397 Macroeconometrics Steve Cnningham Open Disks or Neighborhoods Deinition. The set o all points which satis the ineqalit

More information

Desert Mountain H. S. Math Department Summer Work Packet

Desert Mountain H. S. Math Department Summer Work Packet Corse #50-51 Desert Montain H. S. Math Department Smmer Work Packet Honors/AP/IB level math corses at Desert Montain are for stents who are enthsiastic learners of mathematics an whose work ethic is of

More information

Table of Common Derivatives By David Abraham

Table of Common Derivatives By David Abraham Prouct an Quotient Rules: Table of Common Derivatives By Davi Abraham [ f ( g( ] = [ f ( ] g( + f ( [ g( ] f ( = g( [ f ( ] g( g( f ( [ g( ] Trigonometric Functions: sin( = cos( cos( = sin( tan( = sec

More information

Section 7.1: Integration by Parts

Section 7.1: Integration by Parts Section 7.1: Integration by Parts 1. Introuction to Integration Techniques Unlike ifferentiation where there are a large number of rules which allow you (in principle) to ifferentiate any function, the

More information

(a) 82 (b) 164 (c) 81 (d) 162 (e) 624 (f) 625 None of these. (c) 12 (d) 15 (e)

(a) 82 (b) 164 (c) 81 (d) 162 (e) 624 (f) 625 None of these. (c) 12 (d) 15 (e) Math 2 (Calculus I) Final Eam Form A KEY Multiple Choice. Fill in the answer to each problem on your computer-score answer sheet. Make sure your name, section an instructor are on that sheet.. Approimate

More information

Homogeneous Liner Systems with Constant Coefficients

Homogeneous Liner Systems with Constant Coefficients Homogeneos Liner Systems with Constant Coefficients Jly, 06 The object of stdy in this section is where A is a d d constant matrix whose entries are real nmbers. As before, we will look to the exponential

More information

Math 263 Assignment #3 Solutions. 1. A function z = f(x, y) is called harmonic if it satisfies Laplace s equation:

Math 263 Assignment #3 Solutions. 1. A function z = f(x, y) is called harmonic if it satisfies Laplace s equation: Math 263 Assignment #3 Soltions 1. A fnction z f(x, ) is called harmonic if it satisfies Laplace s eqation: 2 + 2 z 2 0 Determine whether or not the following are harmonic. (a) z x 2 + 2. We se the one-variable

More information

Math 1271 Solutions for Fall 2005 Final Exam

Math 1271 Solutions for Fall 2005 Final Exam Math 7 Solutions for Fall 5 Final Eam ) Since the equation + y = e y cannot be rearrange algebraically in orer to write y as an eplicit function of, we must instea ifferentiate this relation implicitly

More information

Adaptive partial state feedback control of the DC-to-DC Ćuk converter

Adaptive partial state feedback control of the DC-to-DC Ćuk converter 5 American Control Conference Jne 8-, 5. Portlan, OR, USA FrC7.4 Aaptive partial state feeback control of the DC-to-DC Ćk converter Hgo Rorígez, Romeo Ortega an Alessanro Astolfi Abstract The problem of

More information

2.13 Variation and Linearisation of Kinematic Tensors

2.13 Variation and Linearisation of Kinematic Tensors Section.3.3 Variation an Linearisation of Kinematic ensors.3. he Variation of Kinematic ensors he Variation In this section is reviewe the concept of the variation, introce in Part I, 8.5. he variation

More information

Optimization via the Hamilton-Jacobi-Bellman Method: Theory and Applications

Optimization via the Hamilton-Jacobi-Bellman Method: Theory and Applications Optimization via the Hamilton-Jacobi-Bellman Method: Theory and Applications Navin Khaneja lectre notes taken by Christiane Koch Jne 24, 29 1 Variation yields a classical Hamiltonian system Sppose that

More information

Math 342 Partial Differential Equations «Viktor Grigoryan

Math 342 Partial Differential Equations «Viktor Grigoryan Math 342 Partial Differential Equations «Viktor Grigoryan 6 Wave equation: solution In this lecture we will solve the wave equation on the entire real line x R. This correspons to a string of infinite

More information

Essentials of optimal control theory in ECON 4140

Essentials of optimal control theory in ECON 4140 Essentials of optimal control theory in ECON 4140 Things yo need to know (and a detail yo need not care abot). A few words abot dynamic optimization in general. Dynamic optimization can be thoght of as

More information

Elements of Coordinate System Transformations

Elements of Coordinate System Transformations B Elements of Coordinate System Transformations Coordinate system transformation is a powerfl tool for solving many geometrical and kinematic problems that pertain to the design of gear ctting tools and

More information

NEURAL CONTROL OF NONLINEAR SYSTEMS: A REFERENCE GOVERNOR APPROACH

NEURAL CONTROL OF NONLINEAR SYSTEMS: A REFERENCE GOVERNOR APPROACH NEURAL CONTROL OF NONLINEAR SYSTEMS: A REFERENCE GOVERNOR APPROACH L. Schnitman Institto Tecnológico e Aeronática.8-900 - S.J. os Campos, SP Brazil leizer@ele.ita.cta.br J.A.M. Felippe e Soza Universiae

More information

Schrödinger s equation.

Schrödinger s equation. Physics 342 Lecture 5 Schröinger s Equation Lecture 5 Physics 342 Quantum Mechanics I Wenesay, February 3r, 2010 Toay we iscuss Schröinger s equation an show that it supports the basic interpretation of

More information

Mathematics 116 HWK 25a Solutions 8.6 p610

Mathematics 116 HWK 25a Solutions 8.6 p610 Mathematics 6 HWK 5a Solutions 8.6 p6 Problem, 8.6, p6 Fin a power series representation for the function f() = etermine the interval of convergence. an Solution. Begin with the geometric series = + +

More information

The derivative of a function f(x) is another function, defined in terms of a limiting expression: f(x + δx) f(x)

The derivative of a function f(x) is another function, defined in terms of a limiting expression: f(x + δx) f(x) Y. D. Chong (2016) MH2801: Complex Methos for the Sciences 1. Derivatives The erivative of a function f(x) is another function, efine in terms of a limiting expression: f (x) f (x) lim x δx 0 f(x + δx)

More information

1 The space of linear transformations from R n to R m :

1 The space of linear transformations from R n to R m : Math 540 Spring 20 Notes #4 Higher deriaties, Taylor s theorem The space of linear transformations from R n to R m We hae discssed linear transformations mapping R n to R m We can add sch linear transformations

More information

Math 242: Principles of Analysis Fall 2016 Homework 7 Part B Solutions

Math 242: Principles of Analysis Fall 2016 Homework 7 Part B Solutions Mat 22: Principles of Analysis Fall 206 Homework 7 Part B Solutions. Sow tat f(x) = x 2 is not uniformly continuous on R. Solution. Te equation is equivalent to f(x) = 0 were f(x) = x 2 sin(x) 3. Since

More information

Image and Multidimensional Signal Processing

Image and Multidimensional Signal Processing Image and Mltidimensional Signal Processing Professor William Hoff Dept of Electrical Engineering &Compter Science http://inside.mines.ed/~whoff/ Forier Transform Part : D discrete transforms 2 Overview

More information

PDE Notes, Lecture #11

PDE Notes, Lecture #11 PDE Notes, Lecture # from Professor Jalal Shatah s Lectures Febuary 9th, 2009 Sobolev Spaces Recall that for u L loc we can efine the weak erivative Du by Du, φ := udφ φ C0 If v L loc such that Du, φ =

More information

Math 19 Sample Final Exam Solutions

Math 19 Sample Final Exam Solutions SSEA Summer 2017 Math 19 Sample Final Exam Solutions 1. [10 points] For what value of the constant k will the function: ) 1 x 2 sin, x < 0 fx) = x, x + k coskx), x 0 be continuous at x = 0? Explain your

More information

Homework 2 Solutions EM, Mixture Models, PCA, Dualitys

Homework 2 Solutions EM, Mixture Models, PCA, Dualitys Homewor Solutions EM, Mixture Moels, PCA, Dualitys CMU 0-75: Machine Learning Fall 05 http://www.cs.cmu.eu/~bapoczos/classes/ml075_05fall/ OUT: Oct 5, 05 DUE: Oct 9, 05, 0:0 AM An EM algorithm for a Mixture

More information

Chapter 2 Difficulties associated with corners

Chapter 2 Difficulties associated with corners Chapter Difficlties associated with corners This chapter is aimed at resolving the problems revealed in Chapter, which are cased b corners and/or discontinos bondar conditions. The first section introdces

More information

G y 0nx (n. G y d = I nu N (5) (6) J uu 2 = and. J ud H1 H

G y 0nx (n. G y d = I nu N (5) (6) J uu 2 = and. J ud H1 H 29 American Control Conference Hatt Regenc Riverfront, St Lois, MO, USA Jne 1-12, 29 WeC112 Conve initialization of the H 2 -optimal static otpt feeback problem Henrik Manm, Sigr Skogesta, an Johannes

More information

B-469 Simplified Copositive and Lagrangian Relaxations for Linearly Constrained Quadratic Optimization Problems in Continuous and Binary Variables

B-469 Simplified Copositive and Lagrangian Relaxations for Linearly Constrained Quadratic Optimization Problems in Continuous and Binary Variables B-469 Simplified Copositive and Lagrangian Relaxations for Linearly Constrained Qadratic Optimization Problems in Continos and Binary Variables Naohiko Arima, Snyong Kim and Masakaz Kojima October 2012,

More information

Theorem (Change of Variables Theorem):

Theorem (Change of Variables Theorem): Avance Higher Notes (Unit ) Prereqisites: Integrating (a + b) n, sin (a + b) an cos (a + b); erivatives of tan, sec, cosec, cot, e an ln ; sm/ifference rles; areas ner an between crves. Maths Applications:

More information

Assignment Fall 2014

Assignment Fall 2014 Assignment 5.086 Fall 04 De: Wednesday, 0 December at 5 PM. Upload yor soltion to corse website as a zip file YOURNAME_ASSIGNMENT_5 which incldes the script for each qestion as well as all Matlab fnctions

More information

by using the derivative rules. o Building blocks: d

by using the derivative rules. o Building blocks: d Calculus for Business an Social Sciences - Prof D Yuen Eam Review version /9/01 Check website for any poste typos an upates Eam is on Sections, 5, 6,, 1,, Derivatives Rules Know how to fin the formula

More information

QF101: Quantitative Finance September 5, Week 3: Derivatives. Facilitator: Christopher Ting AY 2017/2018. f ( x + ) f(x) f(x) = lim

QF101: Quantitative Finance September 5, Week 3: Derivatives. Facilitator: Christopher Ting AY 2017/2018. f ( x + ) f(x) f(x) = lim QF101: Quantitative Finance September 5, 2017 Week 3: Derivatives Facilitator: Christopher Ting AY 2017/2018 I recoil with ismay an horror at this lamentable plague of functions which o not have erivatives.

More information

Approximate Solution for the System of Non-linear Volterra Integral Equations of the Second Kind by using Block-by-block Method

Approximate Solution for the System of Non-linear Volterra Integral Equations of the Second Kind by using Block-by-block Method Astralian Jornal of Basic and Applied Sciences, (1): 114-14, 008 ISSN 1991-8178 Approximate Soltion for the System of Non-linear Volterra Integral Eqations of the Second Kind by sing Block-by-block Method

More information

A generalized Alon-Boppana bound and weak Ramanujan graphs

A generalized Alon-Boppana bound and weak Ramanujan graphs A generalized Alon-Boppana bond and weak Ramanjan graphs Fan Chng Department of Mathematics University of California, San Diego La Jolla, CA, U.S.A. fan@csd.ed Sbmitted: Feb 0, 206; Accepted: Jne 22, 206;

More information

Calculus of Variations

Calculus of Variations 16.323 Lecture 5 Calculus of Variations Calculus of Variations Most books cover this material well, but Kirk Chapter 4 oes a particularly nice job. x(t) x* x*+ αδx (1) x*- αδx (1) αδx (1) αδx (1) t f t

More information

Math 115 Section 018 Course Note

Math 115 Section 018 Course Note Course Note 1 General Functions Definition 1.1. A function is a rule that takes certain numbers as inputs an assigns to each a efinite output number. The set of all input numbers is calle the omain of

More information

Integration Review. May 11, 2013

Integration Review. May 11, 2013 Integration Review May 11, 2013 Goals: Review the funamental theorem of calculus. Review u-substitution. Review integration by parts. Do lots of integration eamples. 1 Funamental Theorem of Calculus In

More information

Lecture 3. (2) Last time: 3D space. The dot product. Dan Nichols January 30, 2018

Lecture 3. (2) Last time: 3D space. The dot product. Dan Nichols January 30, 2018 Lectre 3 The dot prodct Dan Nichols nichols@math.mass.ed MATH 33, Spring 018 Uniersity of Massachsetts Janary 30, 018 () Last time: 3D space Right-hand rle, the three coordinate planes 3D coordinate system:

More information

Chapter 2 Derivatives

Chapter 2 Derivatives Chapter Derivatives Section. An Intuitive Introuction to Derivatives Consier a function: Slope function: Derivative, f ' For each, the slope of f is the height of f ' Where f has a horizontal tangent line,

More information

Problem set 2: Solutions Math 207B, Winter 2016

Problem set 2: Solutions Math 207B, Winter 2016 Problem set : Solutions Math 07B, Winter 016 1. A particle of mass m with position x(t) at time t has potential energy V ( x) an kinetic energy T = 1 m x t. The action of the particle over times t t 1

More information

FRÉCHET KERNELS AND THE ADJOINT METHOD

FRÉCHET KERNELS AND THE ADJOINT METHOD PART II FRÉCHET KERNES AND THE ADJOINT METHOD 1. Setp of the tomographic problem: Why gradients? 2. The adjoint method 3. Practical 4. Special topics (sorce imaging and time reversal) Setp of the tomographic

More information

Function Spaces. 1 Hilbert Spaces

Function Spaces. 1 Hilbert Spaces Function Spaces A function space is a set of functions F that has some structure. Often a nonparametric regression function or classifier is chosen to lie in some function space, where the assume structure

More information

Designing Information Devices and Systems II Fall 2017 Note Theorem: Existence and Uniqueness of Solutions to Differential Equations

Designing Information Devices and Systems II Fall 2017 Note Theorem: Existence and Uniqueness of Solutions to Differential Equations EECS 6B Designing Information Devices an Systems II Fall 07 Note 3 Secon Orer Differential Equations Secon orer ifferential equations appear everywhere in the real worl. In this note, we will walk through

More information

A Single Species in One Spatial Dimension

A Single Species in One Spatial Dimension Lectre 6 A Single Species in One Spatial Dimension Reading: Material similar to that in this section of the corse appears in Sections 1. and 13.5 of James D. Mrray (), Mathematical Biology I: An introction,

More information

Section 2.7 Derivatives of powers of functions

Section 2.7 Derivatives of powers of functions Section 2.7 Derivatives of powers of functions (3/19/08) Overview: In this section we iscuss the Chain Rule formula for the erivatives of composite functions that are forme by taking powers of other functions.

More information

1 Lecture 20: Implicit differentiation

1 Lecture 20: Implicit differentiation Lecture 20: Implicit ifferentiation. Outline The technique of implicit ifferentiation Tangent lines to a circle Derivatives of inverse functions by implicit ifferentiation Examples.2 Implicit ifferentiation

More information

Witten s Proof of Morse Inequalities

Witten s Proof of Morse Inequalities Witten s Proof of Morse Inequalities by Igor Prokhorenkov Let M be a smooth, compact, oriente manifol with imension n. A Morse function is a smooth function f : M R such that all of its critical points

More information

Sturm-Liouville Theory

Sturm-Liouville Theory LECTURE 5 Sturm-Liouville Theory In the three preceing lectures I emonstrate the utility of Fourier series in solving PDE/BVPs. As we ll now see, Fourier series are just the tip of the iceberg of the theory

More information

Lecture 6: Calculus. In Song Kim. September 7, 2011

Lecture 6: Calculus. In Song Kim. September 7, 2011 Lecture 6: Calculus In Song Kim September 7, 20 Introuction to Differential Calculus In our previous lecture we came up with several ways to analyze functions. We saw previously that the slope of a linear

More information

Assignment 1. g i (x 1,..., x n ) dx i = 0. i=1

Assignment 1. g i (x 1,..., x n ) dx i = 0. i=1 Assignment 1 Golstein 1.4 The equations of motion for the rolling isk are special cases of general linear ifferential equations of constraint of the form g i (x 1,..., x n x i = 0. i=1 A constraint conition

More information

Applications of the Wronskian to ordinary linear differential equations

Applications of the Wronskian to ordinary linear differential equations Physics 116C Fall 2011 Applications of the Wronskian to orinary linear ifferential equations Consier a of n continuous functions y i (x) [i = 1,2,3,...,n], each of which is ifferentiable at least n times.

More information

Introduction to the Vlasov-Poisson system

Introduction to the Vlasov-Poisson system Introuction to the Vlasov-Poisson system Simone Calogero 1 The Vlasov equation Consier a particle with mass m > 0. Let x(t) R 3 enote the position of the particle at time t R an v(t) = ẋ(t) = x(t)/t its

More information

Unit #6 - Families of Functions, Taylor Polynomials, l Hopital s Rule

Unit #6 - Families of Functions, Taylor Polynomials, l Hopital s Rule Unit # - Families of Functions, Taylor Polynomials, l Hopital s Rule Some problems an solutions selecte or aapte from Hughes-Hallett Calculus. Critical Points. Consier the function f) = 54 +. b) a) Fin

More information

A Computational Study with Finite Element Method and Finite Difference Method for 2D Elliptic Partial Differential Equations

A Computational Study with Finite Element Method and Finite Difference Method for 2D Elliptic Partial Differential Equations Applied Mathematics, 05, 6, 04-4 Pblished Online November 05 in SciRes. http://www.scirp.org/jornal/am http://d.doi.org/0.46/am.05.685 A Comptational Stdy with Finite Element Method and Finite Difference

More information

REAL ANALYSIS I HOMEWORK 5

REAL ANALYSIS I HOMEWORK 5 REAL ANALYSIS I HOMEWORK 5 CİHAN BAHRAN The questions are from Stein an Shakarchi s text, Chapter 3. 1. Suppose ϕ is an integrable function on R with R ϕ(x)x = 1. Let K δ(x) = δ ϕ(x/δ), δ > 0. (a) Prove

More information

A generalized Alon-Boppana bound and weak Ramanujan graphs

A generalized Alon-Boppana bound and weak Ramanujan graphs A generalized Alon-Boppana bond and weak Ramanjan graphs Fan Chng Abstract A basic eigenvale bond de to Alon and Boppana holds only for reglar graphs. In this paper we give a generalized Alon-Boppana bond

More information

Notes on Homological Algebra

Notes on Homological Algebra Notes on Homological Algebra Marisz Wodzicki December 1, 2016 x 1 Fondations 1.1 Preliminaries 1.1.1 A tacit assmption is that A, B,..., are abelian categories, i.e., additive categories with kernels,

More information

Outline. MS121: IT Mathematics. Differentiation Rules for Differentiation: Part 1. Outline. Dublin City University 4 The Quotient Rule

Outline. MS121: IT Mathematics. Differentiation Rules for Differentiation: Part 1. Outline. Dublin City University 4 The Quotient Rule MS2: IT Mathematics Differentiation Rules for Differentiation: Part John Carroll School of Mathematical Sciences Dublin City University Pattern Observe You may have notice the following pattern when we

More information

x f(x) x f(x) approaching 1 approaching 0.5 approaching 1 approaching 0.

x f(x) x f(x) approaching 1 approaching 0.5 approaching 1 approaching 0. Engineering Mathematics 2 26 February 2014 Limits of functions Consier the function 1 f() = 1. The omain of this function is R + \ {1}. The function is not efine at 1. What happens when is close to 1?

More information

Derivatives and the Product Rule

Derivatives and the Product Rule Derivatives an the Prouct Rule James K. Peterson Department of Biological Sciences an Department of Mathematical Sciences Clemson University January 28, 2014 Outline Differentiability Simple Derivatives

More information

Throughput Maximization for Tandem Lines with Two Stations and Flexible Servers

Throughput Maximization for Tandem Lines with Two Stations and Flexible Servers Throghpt Maximization for Tanem Lines with Two Stations an Flexible Servers Sigrún Anraóttir an Hayriye Ayhan School of Instrial an Systems Engineering Georgia Institte of Technology Atlanta GA 30332-0205

More information

Final Exam Study Guide and Practice Problems Solutions

Final Exam Study Guide and Practice Problems Solutions Final Exam Stuy Guie an Practice Problems Solutions Note: These problems are just some of the types of problems that might appear on the exam. However, to fully prepare for the exam, in aition to making

More information

A Macroscopic Traffic Data Assimilation Framework Based on Fourier-Galerkin Method and Minimax Estimation

A Macroscopic Traffic Data Assimilation Framework Based on Fourier-Galerkin Method and Minimax Estimation A Macroscopic Traffic Data Assimilation Framework Based on Forier-Galerkin Method and Minima Estimation Tigran T. Tchrakian and Sergiy Zhk Abstract In this paper, we propose a new framework for macroscopic

More information

G j dq i + G j. q i. = a jt. and

G j dq i + G j. q i. = a jt. and Lagrange Multipliers Wenesay, 8 September 011 Sometimes it is convenient to use reunant coorinates, an to effect the variation of the action consistent with the constraints via the metho of Lagrange unetermine

More information

Problem Sheet 2: Eigenvalues and eigenvectors and their use in solving linear ODEs

Problem Sheet 2: Eigenvalues and eigenvectors and their use in solving linear ODEs Problem Sheet 2: Eigenvalues an eigenvectors an their use in solving linear ODEs If you fin any typos/errors in this problem sheet please email jk28@icacuk The material in this problem sheet is not examinable

More information

and from it produce the action integral whose variation we set to zero:

and from it produce the action integral whose variation we set to zero: Lagrange Multipliers Monay, 6 September 01 Sometimes it is convenient to use reunant coorinates, an to effect the variation of the action consistent with the constraints via the metho of Lagrange unetermine

More information

Geometry of Span (continued) The Plane Spanned by u and v

Geometry of Span (continued) The Plane Spanned by u and v Geometric Description of Span Geometr of Span (contined) 2 Geometr of Span (contined) 2 Span {} Span {, } 2 Span {} 2 Geometr of Span (contined) 2 b + 2 The Plane Spanned b and If a plane is spanned b

More information

TRAVELLING WAVES. Morteza Fotouhi Sharif Univ. of Technology

TRAVELLING WAVES. Morteza Fotouhi Sharif Univ. of Technology TRAVELLING WAVES Morteza Fotohi Sharif Univ. of Technology Mini Math NeroScience Mini Math NeroScience Agst 28 REACTION DIFFUSION EQUATIONS U = DU + f ( U ) t xx x t > U n D d 1 = d j > d n 2 Travelling

More information

Optimal Operation by Controlling the Gradient to Zero

Optimal Operation by Controlling the Gradient to Zero Optimal Operation by Controlling the Graient to Zero Johannes Jäschke Sigr Skogesta Department of Chemical Engineering, Norwegian University of Science an Technology, NTNU, Tronheim, Norway (e-mail: {jaschke}{skoge}@chemeng.ntn.no)

More information

THE ACCURATE ELEMENT METHOD: A NEW PARADIGM FOR NUMERICAL SOLUTION OF ORDINARY DIFFERENTIAL EQUATIONS

THE ACCURATE ELEMENT METHOD: A NEW PARADIGM FOR NUMERICAL SOLUTION OF ORDINARY DIFFERENTIAL EQUATIONS THE PUBISHING HOUSE PROCEEDINGS O THE ROMANIAN ACADEMY, Series A, O THE ROMANIAN ACADEMY Volume, Number /, pp. 6 THE ACCURATE EEMENT METHOD: A NEW PARADIGM OR NUMERICA SOUTION O ORDINARY DIERENTIA EQUATIONS

More information

x f(x) x f(x) approaching 1 approaching 0.5 approaching 1 approaching 0.

x f(x) x f(x) approaching 1 approaching 0.5 approaching 1 approaching 0. Engineering Mathematics 2 26 February 2014 Limits of functions Consier the function 1 f() = 1. The omain of this function is R + \ {1}. The function is not efine at 1. What happens when is close to 1?

More information