Pseudospectral Methods For Op2mal Control. Jus2n Ruths March 27, 2009

Similar documents
Bellman s Curse of Dimensionality

Reduced Models for Process Simula2on and Op2miza2on

3.3 Increasing & Decreasing Functions and The First Derivative Test

Least Squares Parameter Es.ma.on

Last Lecture Recap UVA CS / Introduc8on to Machine Learning and Data Mining. Lecture 3: Linear Regression

Some thoughts on linearity, nonlinearity, and partial separability

A Time Marching Scheme for Solving Volume Integral Equa9ons on Nonlinear Sca<erers

From average to instantaneous rates of change. (and a diversion on con4nuity and limits)

Numerical Integra/on

UVA CS 4501: Machine Learning. Lecture 6: Linear Regression Model with Dr. Yanjun Qi. University of Virginia

Gradient Descent for High Dimensional Systems

Methodological Foundations of Biomedical Informatics (BMSC-GA 4449) Optimization

12.0 Properties of orthogonal polynomials

Bias/variance tradeoff, Model assessment and selec+on

Stochas(c Dual Ascent Linear Systems, Quasi-Newton Updates and Matrix Inversion

Numerical Methods in Physics

Sec$on The Use of Exponen$al Weigh$ng Exponen$al weigh$ng of a sequence x(n) is defined by. (equa$on 13.70)

SPECTRAL METHODS: ORTHOGONAL POLYNOMIALS

Par$al Fac$on Decomposi$on. Academic Resource Center

A Gauss Lobatto quadrature method for solving optimal control problems

Modeling radiocarbon in the Earth System. Radiocarbon summer school 2012

Exponen'al func'ons and exponen'al growth. UBC Math 102

Chapter 4. Fourier Analysis for Con5nuous-Time Signals and Systems Chapter Objec5ves

Quantum Energy Inequali1es

ECE 8440 Unit 17. Parks- McClellan Algorithm

Some Advances on Isogeometric Analysis at KAUST

The BCS Model. Sara Changizi. This presenta5on closely follows parts of chapter 6 in Ring & Schuck The nuclear many body problem.

Modelling of Equipment, Processes, and Systems

Varia%onal principles. Op%mality in nature. and. Andrej Cherkaev Department of Mathema%cs University of Utah USAG November 2013.

The DFT. Star+ng from Chapter 3, DFT of atoms and molecules, Parr & Lee 1989

(5.5) Multistep Methods

Preface. 2 Linear Equations and Eigenvalue Problem 22

Con$nuous Op$miza$on: The "Right" Language for Fast Graph Algorithms? Aleksander Mądry

A Legendre Computational Matrix Method for Solving High-Order Fractional Differential Equations

Algorithms, Graph Theory, and the Solu7on of Laplacian Linear Equa7ons. Daniel A. Spielman Yale University

Introduction. Chapter One

Rational Chebyshev pseudospectral method for long-short wave equations

1462. Jacobi pseudo-spectral Galerkin method for second kind Volterra integro-differential equations with a weakly singular kernel

MA2501 Numerical Methods Spring 2015

256 Summary. D n f(x j ) = f j+n f j n 2n x. j n=1. α m n = 2( 1) n (m!) 2 (m n)!(m + n)!. PPW = 2π k x 2 N + 1. i=0?d i,j. N/2} N + 1-dim.

COMP 562: Introduction to Machine Learning

Least Mean Squares Regression. Machine Learning Fall 2017

7. Quantum Monte Carlo (QMC)

PART IV Spectral Methods

Regression.

Numerical Integration (Quadrature) Another application for our interpolation tools!

Image Processing 1 (IP1) Bildverarbeitung 1

Instructions for Matlab Routines

1. Introduc9on 2. Bivariate Data 3. Linear Analysis of Data

The deriva*ve. Analy*c, geometric, computa*onal. UBC Math 102

Computer Graphics Keyframing and Interpola8on

The Conjugate Gradient Method

Computer Vision. Pa0ern Recogni4on Concepts Part I. Luis F. Teixeira MAP- i 2012/13

A new class of highly accurate differentiation schemes based on the prolate spheroidal wave functions

Method of Finite Elements I

Effec%ve Field Theory of Dissipa%ve Fluids

Introduction to the FDTD method

Introduction. Finite and Spectral Element Methods Using MATLAB. Second Edition. C. Pozrikidis. University of Massachusetts Amherst, USA

Quadrature approaches to the solution of two point boundary value problems

REGRESSION AND CORRELATION ANALYSIS

Least Square Es?ma?on, Filtering, and Predic?on: ECE 5/639 Sta?s?cal Signal Processing II: Linear Es?ma?on

Machine Learning and Data Mining. Linear regression. Prof. Alexander Ihler

Polynomials and Gröbner Bases

Binary black holes and gravita4onal waves: Introduc4on to SpEC

Announcements. Topics: Work On: - sec0ons 1.2 and 1.3 * Read these sec0ons and study solved examples in your textbook!

Fields, wave and electromagne3c pulses. fields, waves <- > par0cles pulse <- > bunch (finite in 0me),

Priors in Dependency network learning

Fairness with Indivisible Goods: Solu6on Concepts and Algorithms

Numerical Analysis. A Comprehensive Introduction. H. R. Schwarz University of Zürich Switzerland. with a contribution by

Scientific Computing: An Introductory Survey

Bioelectrical Circuits: Lecture 9

STA 4273H: Sta-s-cal Machine Learning

BASIC EXAM ADVANCED CALCULUS/LINEAR ALGEBRA

Fundamentals of Data Assimila1on

From Completing the Squares and Orthogonal Projection to Finite Element Methods

Performance and Quality Analysis of Interpolation Methods for Coupling

Algorithms, Graph Theory, and Linear Equa9ons in Laplacians. Daniel A. Spielman Yale University

A THEORETICAL INTRODUCTION TO NUMERICAL ANALYSIS

Deriva'on of The Kalman Filter. Fred DePiero CalPoly State University EE 525 Stochas'c Processes

CS 6140: Machine Learning Spring What We Learned Last Week 2/26/16

Math S1201 Calculus 3 Chapters

LECTURE 16 GAUSS QUADRATURE In general for Newton-Cotes (equispaced interpolation points/ data points/ integration points/ nodes).

Example 3.3 Moving-average filter

The par/cle-hole picture

Legendre Pseudospectral Approximations of Optimal Control Problems

Applied Linear Algebra

CS 6140: Machine Learning Spring What We Learned Last Week. Survey 2/26/16. VS. Model

Improved Lebesgue constants on the triangle

Direct Optimal Control and Costate Estimation Using Least Square Method

CS 6140: Machine Learning Spring 2016

Electronic Structure Calcula/ons: Density Func/onal Theory. and. Predic/ng Cataly/c Ac/vity

Chapter 4: Interpolation and Approximation. October 28, 2005

Numerical Analysis Preliminary Exam 10 am to 1 pm, August 20, 2018

NUMERICAL MATHEMATICS AND COMPUTING

Announcements. Topics: Homework: - sec0ons 1.2, 1.3, and 2.1 * Read these sec0ons and study solved examples in your textbook!

CSCI1950 Z Computa3onal Methods for Biology Lecture 24. Ben Raphael April 29, hgp://cs.brown.edu/courses/csci1950 z/ Network Mo3fs

Recall that any inner product space V has an associated norm defined by

Two common difficul:es with HW 2: Problem 1c: v = r n ˆr

Numerical Integra/on

Transcription:

Pseudospectral Methods For Op2mal Control Jus2n Ruths March 27, 2009

Introduc2on Pseudospectral methods arose to find solu2ons to Par2al Differen2al Equa2ons Recently adapted for Op2mal Control Key Ideas (N ~ # of discre2za2ons) Orthogonal basis func2ons leads to spectral accuracy Coefficients decrease faster than 1/N k, for any k Special recursive defini2ons for deriva2ves of orthogonal polynomials lead to wri2ng dynamics as algebraic rela2ons Non uniform node spacing allows for op2mal numerical integra2on through Gauss quadrature

Op2mal Control Controls: State: Endpoint Constraints: Cost Func2on: Dynamics: Path Constraints: Op2mal control addresses deriving control laws for minimiza2on problems Applica2ons wide spread disciplines Indirect methods Calculus of Varia2ons Maximum Principle Difficult to scale up to larger, more complex problems Direct methods Reduce to nonlinear programming problem

Challenges of Op2mal Control Controls: State: unknown func2ons We would like to transform op2mal control problems into constrained op2miza2on problems Endpoint Constraints: Cost Func2on: Dynamics: Path Constraints: Integrate a nonlinear func2on of unknown variables. Only in rare cases is an analy2c expression for this integral possible. Analy2c expressions for evolved dynamics are, in general, not available.

Pseudospectral Conversion Op#mal Control Controls: Interpola2on Pseudospectral Methods Controls: State: Interpola2on State: Endpoint Constraints: Endpoint Constraints: Cost Func2on: Quadrature Cost Func2on: Dynamics: Spectral Deriva2ves Dynamics: Path Constraints: Path Constraints:

Discre2za2on

Discre2za2on

Polynomial Approxima2on Weierstrass (1889) Set of polynomials is a dense subspace in the space of con2nuous func2ons on [ 1,1] with uniform norm Equioscilla2on Theorem & Corollary For posi2ve N, the best approxima2ng polynomial to a con2nuous func2on on [ 1,1] exists, is unique, and interpolates the func2on at N+1 points

Polynomial Approxima2on Given N+1 nodes and con2nuous func2on the N order interpola2ng polynomial is unique, Any interpola2ng polynomial can be represented by the basis of Lagrange polynomials

Lagrange Polynomials Since at the discre2za2on nodes, Now this interpola2on approxima2on is totally specified by the func2on values at the N+1 discre2za2on nodes.

Lagrange Polynomials, N=7

Node Selec2on Polynomial interpola2on is sensi2ve to node selec2on Gauss Lobogo (GL) nodes are close to op2mal Uniform Spaced Nodes GL Spaced Nodes

Op2mal Nodes

Op2mal Nodes Uniform GL N=10 N=16

Orthogonal Polynomials Weight func2on: Inner product: Given a weight func2on, can create orthogonal basis Orthogonalizing non nega2ve powers of t w.r.t. a weight func2on results in a set of orthogonal polynomials

Spectral Approxima2on Given a family of orthogonal polynomials, Use of these orthogonal polynomials leads to spectral accuracy k th coefficient decays faster than k 1/q, for any q Analogous to Fourier series for periodic func2on

Spectral Approxima2on Recursive defini2on of deriva2ve Using orthogonal polynomials, can express deriva2ves as algebraic rela2ons Lagrange basis s2ll benefits from algebraic rela2ons for deriva2ves

Legendre Polynomials, N=7

Gauss Lobago Quadrature Includes endpoints useful for imposing boundary condi2ons Given: Family of orthogonal polynomials: Corresponding weight func2on: N > 0 Nodes are N+1 zeros of: Is exact for (2N 1) order polynomials GL nodes facilitate discre#za#on & numerical integra#on

Spectral Colloca2on Conversion Discrete inner product preserves orthogonality

Spectral vs. Pseudospectral N+1 condi2ons, requiring Spectral approxima2ons Galerkin & Tau: Colloca2on (interpola2on):

Elements of Pseudospectral Methods GL Nodes are op2mal for interpola2on & quadrature Interpola2on GL Nodes Quadraure p N Spectral Nodes are extrema of orthogonal polynomials

Approxima2on, N = 3

Approxima2on, N = 7

Approxima2on, N = 14

Approxima2on, N = 21

Pseudospectral Conversion Op#mal Control Controls: Pseudospectral Methods Controls: State: State: Endpoint Constraints: Endpoint Constraints: Cost Func2on: Cost Func2on: Dynamics: Dynamics: Path Constraints: Path Constraints:

Pseudospectral Preliminaries Physical 2me domain: [0, T] Computa2onal 2me domain: [ 1,1] Pseudospectral Methods Controls: State: Legendre vs. Chebyshev Polynomials Both are Jacobi type polynomials Endpoint Constraints: Cost Func2on: Dynamics: Path Constraints:

Pseudospectral Discre2za2on Pseudospectral Methods Controls: State: Endpoint Constraints: Cost Func2on: Dynamics: Path Constraints: Decision Variables: n x (N+1) m x (N+1)

Pseudospectral Quadrature Note: For Legendre polynomials Pseudospectral Methods Controls: State: Endpoint Constraints: Cost Func2on: Dynamics: Path Constraints: Note: Interpola2on polynomial uses Lagrange polynomials, deriva2ve rule is less obvious

Ex: Single Spin Op2miza2on

Ex: Single Spin Op2miza2on

Ex: Single Spin Opt

Ex: Spin Transfer

Ex: Spin Transfer

Ex: Ensemble Spin Op2miza2on

Discre2za2on & Sampling

Discre2za2on & Sampling

Op2mal Sampling n samples N discre2za2ons

Future Work Bilinear system dynamics Convergence Adapta2ons Op2mal sampling Two dimensional pseudospectral method Selec2ve excita2on pulses

Challenges Difficulty dealing with discon2nui2es Knonng methods Succumbs to locally op2mal solu2ons Computa2onal load Costate discrepancy in Legendre PS at endpts Gauss pseudospectral method

QUESTIONS & COMMENTS