A Brief Perspective on Process Optimization

Size: px
Start display at page:

Download "A Brief Perspective on Process Optimization"

Transcription

1 A Brief Perspective on Process Optimization L. T. Biegler Carnegie Mellon University November, 2007 Annual AIChE Meeting Salt Lake City, UT

2 Overview Introduction Main Themes Modeling Levels Closed Models PDEs and ROMs NLPs and Model Integration LDPE Eample Fully Open Models Challenge Problem: NMPC Conclusions 2

3 Optimization in Design, Logistics and Control MILP MINLP Global LP,QP NLP HENS MENS Separations Reactors Equipment Design Process Flowsheeting Planning Scheduling Real-time optimization Linear MPC Nonlinear MPC Hybrid 3

4 Hierarchy for Optimization Models 1. Fully Open Completely declarative smooth models First, second derivatives cheap to calculate Solved with Newton-type type methods 2. Semi-closed procedural models solved efficiently (e.g., DAE integrators) can be differentiated efficiently 3. Closed Procedural models, comple, special purpose solvers Smooth Difficult to differentiate 4

5 Hierarchy of Nonlinear Programming Formulations and Model Intrusion Full Space Formulation Open Interior Point Adjoint Sens & SAND Adjoint Compute Efficiency Semi-Closed Direct Sensitivities Finite Differences SQP rsqp Black Bo DFO Closed Variables/Constraints 5

6 Closed Optimization Models Only function information available. Gradient and Hessian information cannot be obtained eactly Nested iterative calculations in model (round-off error due to convergence tolerences) How can these models be used for optimization? Derivative Free Optimization NOMAD, DFO, UOBYQA Strong convergence theory, successful on difficult problems Reduced order models convert to approimate models in analytic form (manageable size) Closed Detailed Models Î Fully Open Simple Models allows integration with models from other levels 6

7 Challenge for Process Optimization FutureGen Power Cycle (DOE/NETL) PDE/CFD: Gas Turbine, Gasifier DAE: H2/CO2 Separation: PSA Algebraic: Rest of Flowsheet 7

8 Advanced Process Engineering Cosimulation (Zitney and Syamlal, 2002) Detailed CFD Models Multiphase, reactive flow Specialized solution procedures Model requires ~ CPU h Smooth responses epected but derivatives not available Few (<10) optimization variables Goal: ROM for integration with other model equations 8

9 Optimal Operation for Gas Separation (Jiang, Fo, B., 2004) Pressure Swing Adsorption in FutureGen Cycle Need for high purity H2 Possible technology to capture CO2 Respond quickly to changes in process demand Large, highly nonlinear dynamic separation Eamples Large-scale H2/CO Separation 5 beds, 11 steps, > 10 4 variables with dense Jacobians,, 10 4 DAEs Simulated Moving Bed Separation 6 columns, 4 zones, > 100 variables/ DAEs with dense Jacobians 9

10 Black Bo Optimization (Closed Models) + Easy to interface + Easily applied to legacy codes, closed models - Repeated model solutions - Failure prone, no constraint handling in model - Derivatives by finite difference (if at all) Optimization Min Φ() s.t. g() 0 p u(t) (PD)AE Model F(z, z, u, p, t) = 0 - (Fully Open) Reduced Order Models (ROMs) for optimization formulations Proper Orthogonal Decomposition (Karhunen, Loeve ) PCA-based ROMs (Willco( Willco, ) 10

11 PSA Optimization 4 step Methane/Hydrogen Separation PSA Model: 3200 DAEs (several CPU hrs to optimize) POD Model Reduction: reduced to just 200 DAEs DAEs in ROM were converted to algebraic equations by temporal discretization (simultaneous approach) The resultant non-linear program (NLP) was solved using IPOPT solver in AMPL: optimum obtained in 3 CPU min 11

12 PSA/ROM Optimization Results Profiles for gas-phase methane mole fraction Adsorption Depressurization Rigorous Model ROM Rigorous Model ROM Desorption Hydrogen recovery increased from 10.9% to 16.3% Performance criteria from rigorous model match ROM (high product purities) Pressurization Rigorous Model ROM Rigorous Model ROM 12

13 ROM Sufficiently Accurate for Optimization? Create ROM for CFD Model Solve ROM-based optimization s.t.. Trust Region Sufficient Decrease In CFD Model? Converged? Stop Tighten Trust Region Apply ROM-Based Trust Region Strategy (Fahl-Sachs, Kunisch-Volkwein Volkwein, Gratton- Sartenaer-Toint Toint ) TR model based on ROM optimization ROM matches functions/gradients 13

14 Fully Open Optimization Models Eact first (and higher!) derivatives available Single model solution no nested calculations Basis for etending NLP strategies to MINLP, global optimization NLP Min Φ() s.t. c() = 0 L U Which NLP algorithms should be used? Fast convergence properties Low compleity in dealing with etending to large-scale systems Eploit structures of model and optimization formulations Essential for many time-critical optimizations (RTO, NMPC, DRTO) 14

15 Decision Pyramid for Process Operations Real-time Optimization and Advanced Process Control Fewer discrete decisions Many nonlinearities Frequent, on-line time-critical solutions Higher level decisions must be feasible Performance communicated for higher level decisions Planning Feasibility Scheduling Site-wide Optimization Real-time Optimization Model Predictive Control Regulatory Control Performance MPC APC Off-line (open loop) On-line (closed loop) 15

16 Dynamic Real-time Optimization Integrate On-line Optimization/Control with Off-line Planning Consistent, first-principle models Consistent, long-range, multi-stage planning Increase in computational compleity Time-critical calculations Applications Batch processes Grade transitions Cyclic reactors (coking, regeneration ) Cyclic processes (PSA, SMB ) Feasibility Planning Scheduling Site-wide Optimization Performance Continuous processes are never in steady state: Real-time Optimization Feed changes Model Predictive Control Nonstandard operations Regulatory Control Optimal disturbance rejections Simulation environments and first principle dynamic models are widely used for off-line studies Can these results be implemented directly on-line for large-scale systems? 8 16

17 Dynamic Optimization Engines Evolution of NLP Solvers: Î for dynamic optimization, control and estimation SQP rsqp Full-space Barrier E.g., E.g, SNOPT IPOPT NPSOL- and Simultaneous Multiple Sequential Shooting dynamic Dynamic - over optimization 100 over Optimization d.f.s 1 but 000 over over variables variables and and constraints and constraints Object Oriented Codes tailored to structure, sparse linear algebra and computer architecture (e.g., IPOPT 3.3) 17

18 LD P E Plant- Multistage Dynamic Optimization E t h y l e n e 2 7 b a r s / 2 5 C 1. 5 b a r s / 4 0 C T o r c h 6 b a r s / 4 0 C P u r g e B u t a n e 6 b a r s / 4 0 C P R I M A R Y C O M P R E S S O R b a r s / 4 0 C 5 6 b a r s / 4 0 C H Y P E R - C O M P R E S S O R 2 4 b a r s / 4 0 C L O W P R E S S U R E R E C Y C L E b a r s 4 0 C H I G H P R E S S U R E R E C Y C L E b a r s 4 0 C b a r s 8 5 C T U B U L A R R E A C T O R P r e h e a t i n g Z o n e R e a c t i o n Z o n e b a r s C L D V a l v e C o o l i n g Z o n e C Planning Scheduling Site-wide Optimization Real-time Optimization Model Predictive Control Regulatory Control 1. 5 b a r s 4 0 C b a r s 4 0 C W a e s O i l s 2. 5 b a r s C L D P H i g h P r e s s u r e S e p a r a t o r L o w P r e s s u r e S e p a r a t o r High pressure reaction (>2000 atm) through mile-long reactor coil Highly nonlinear model with 1000 s of chemical species (moment models) 18

19 Large-Scale Parameter Estimation Initiator(s) Monomer Comonomer NZ z z z z Material & Energy Physical Properties Zone Transitions 500 ODEs 1000 AEs 8 Stiffness + Highly Nonlinear + Parametric Sensitivity + Algebraic Coupling 19

20 Large-Scale Parameter Estimation Comple Kinetic Mechanisms ~ 35 Elementary Reactions ~100 Kinetic Parameters 20

21 Large-Scale Parameter Estimation Parameter Estimation for Industrial Applications Use Rigorous Model to Match Plant Data Directly Start with Standard Least-Squares Formulation Least-Squares Rigorous Reactor Model Special Case of Multi-Stage Dynamic Optimization Problem Solve using Simultaneous Collocation-Based Approach 1 data set 6 data sets 500 ODEs ODEs 1000 AEs 6000 AEs21

22 Multi-zone Reactor Parameter Estimation Data Sets: Operating Conditions and Properties for Different Grades Match: Temperature Profiles and Product Properties On-line Adjusting Parameters Æ Track Evolution of Disturbances Kinetic Parameters Æ Apply to Rigorous Models Add Data for Process Inputs (EVM) Æ remove additional uncertainties Single Data Set (On-line Adjusting Parameters) Multiple Data Sets (On-line Adjusting Parameters + Kinetics) EVM (On-line Adjusting Parameters + Kinetics + Process Inputs) 22

23 Large-Scale Parameter Estimation Improved Match of Reactor Temperatures Profile 23

24 Industrial Case Study Results - Reactor Overall Monomer Conversion ( up to 20 Different Grades ) Plant Conversion (%) Predicted Conversion (%) Avg. Conversion Deviation Base Model 12.1 % New Model 2.5 % EVM Results % 24

25 IPOPT Factorization Byproduct W k + Σ A k T k + δ I 1 A k δ I 2 KKT matri factored by indefinite symmetric factorization Without regularization at solution Î sufficient second order conditions and uniquely estimated parameters Reduced Hessian cheaply available to calculate confidence regions 25

26 Parameter Estimation in Parallel Architectures Eploit Structure of KKT Matri Laird, B Direct Factorization MA27 Memory Bottlenecks Factorization Time Scales Superlinearly with Data sets Block-bordered Diagonal Structure Coarse-Grained Parallelization using Schur Complement Decomposition IPOPT 3. architecture supports tailored structured decompositions 26

27 Parameter Estimation in Parallel Architectures Computational Results LDPE Reactor EVM Problem 27

28 On-line Issues: Model Predictive Control (NMPC) Zavala, Laird, B. (2006, 2007) NMPC Estimation and Control d : disturbances u : manipulated variables y sp : set points Process NMPC Controller z = F( z, y, u, p, d) 0 = G( z, y, u, p, d) z : differential states y : algebraic states Model Updater z = F( z, y, u, p, d) 0 = G( z, y, u, p, d) Why NMPC? Track a profile evolve from linear dynamic models (MPC) Severe nonlinear dynamics (e.g, sign changes in gains) Operate process over wide range (e.g., startup and shutdown) NMPC Subproblem min u s.t. J z ( l + 1 ( = k z 0 = ( Bounds f )) ( k = z ) l N l = 0,u l ϕ ( )) z l,u l ) + E ( Challenge: Computational Delay Æ Performance and Stability? z N ) 28

29 Nonlinear Model Predictive Control Parametric Problem 29

30 30 Advanced Step NMPC Advanced Step NMPC Combine advanced step with sensitivity to solve NLP in background (between steps) not on-line Solve P(z ) in background (between t 0 and t 1 ) Sensitivity to updated problem to get (z 0, u 0 ) Solve P(z +1 ) in background with new (z 0, u 0 ) υ ν λ = K X V A I A W k k T k k k [ 0 0 0

31 Industrial Case Study Grade Transition Control Process Model: 289 ODEs, 100 AEs Simultaneous Collocation-Based Approach 27,135 constraints, 9630 LB & UB Off-line Solution with IPOPT Feedback Every 6 min 31

32 Nonlinear Model Predictive Control Grade Transition to Reduce MW of LDPE Ideal NMPC controller - computational delay not considered Time delays as disturbances in NMPC Optimal Feedback Policy Æ (On-line Computation 351 CPU s) 32

33 Nonlinear Model Predictive Control Optimal Policy vs. NLP Sensitivity -Shifted Æ (On-line Computation 1.04 CPU s) Very Fast Close-to-Optimal Feedback Large-Scale Rigorous Models Analogous Strategy Developed for Moving Horizon Estimation 33

34 Summary Optimization plays a central role in all aspects of chemical process engineering Challenging Real-World Applications Modeling-design-control-operations Conflict between detailed models (off-line analysis) and time critical computation (on-line optimization) Challenge to develop efficient optimization strategies with multiple model levels Closed -- Semi-closed Fully Open Advanced algorithms needed to integrate optimization models Across process systems Across operating time scales Across functionalities 34

35 Related Papers at this Conference (and more details) Reduced Order Optimization Models 429a Reduced-Order Model for Dynamic Optimization of Pressure Swing Adsorption A. Agarwal, L. T. Biegler, S. E. Zitney 398c Advanced Process Engineering Co-Simulation Using CFD-Based Reduced Order Models, Y-D Lang, L. T. Biegler, S. Munteanu, J. Madsen, S. E. Zitney Open Optimization Models and Parallel Decomposition 149d Efficient Parallel Solution of Dae Constrained Optimization Problems with Loosely Coupled Algebraic Components, C. D. Laird, V. M. Zavala, L. T. Biegler 531a Modeling and Optimization of Polymer Electrolyte Membrane Fuel Cells, P. Jain, L. T. Biegler, M. S. Jhon Fast NMPC and MHE 149b A Moving Horizon Estimation Algorithm Based on NLP Sensitivity, V. M. Zavala, L. T. Biegler 256a Stability and Performance Analysis of Nlp Sensitivity-Based NMPC Controllers, V. M. Zavala, L. T. Biegler 35

36 Acknowledgements Funding US Department of Energy EonMobil Upstream Research Corporation US National Science Foundation Center for Advanced Process Decision-making (CMU) Research Colleagues Anshul Agarwal Parag Jain Carl Laird Yi-dong Lang Andreas Wächter Victor Zavala Steve Zitney 36

Dynamic Real-Time Optimization: Linking Off-line Planning with On-line Optimization

Dynamic Real-Time Optimization: Linking Off-line Planning with On-line Optimization Dynamic Real-Time Optimization: Linking Off-line Planning with On-line Optimization L. T. Biegler and V. Zavala Chemical Engineering Department Carnegie Mellon University Pittsburgh, PA 15213 April 12,

More information

A Trust-region Algorithm for the Optimization of PSA Processes using Reduced-order Modeling

A Trust-region Algorithm for the Optimization of PSA Processes using Reduced-order Modeling A Trust-region Algorithm for the Optimization of PSA Processes using Reduced-order Modeling Anshul Agarwal Advisor: Lorenz T. Biegler CAPD Annual Review Meeting March 7, 2010 Pressure Swing Adsorption

More information

Real-Time Implementation of Nonlinear Predictive Control

Real-Time Implementation of Nonlinear Predictive Control Real-Time Implementation of Nonlinear Predictive Control Michael A. Henson Department of Chemical Engineering University of Massachusetts Amherst, MA WebCAST October 2, 2008 1 Outline Limitations of linear

More information

Real-Time Optimization

Real-Time Optimization Real-Time Optimization w Plant APC RTO c(x, u, p) = 0 On line optimization Steady state model for states (x) Supply setpoints (u) to APC (control system) Model mismatch, measured and unmeasured disturbances

More information

Computational Strategies for the Optimal Operation of Large-Scale Chemical Processes

Computational Strategies for the Optimal Operation of Large-Scale Chemical Processes Carnegie Mellon University Computational Strategies for the Optimal Operation of Large-Scale Chemical Processes A DISSERTATION Submitted to the Graduate School in Partial Fulfillment of the Requirements

More information

Hot-Starting NLP Solvers

Hot-Starting NLP Solvers Hot-Starting NLP Solvers Andreas Wächter Department of Industrial Engineering and Management Sciences Northwestern University waechter@iems.northwestern.edu 204 Mixed Integer Programming Workshop Ohio

More information

A Two-Stage Algorithm for Multi-Scenario Dynamic Optimization Problem

A Two-Stage Algorithm for Multi-Scenario Dynamic Optimization Problem A Two-Stage Algorithm for Multi-Scenario Dynamic Optimization Problem Weijie Lin, Lorenz T Biegler, Annette M. Jacobson March 8, 2011 EWO Annual Meeting Outline Project review and problem introduction

More information

Efficient Numerical Methods for Nonlinear MPC and Moving Horizon Estimation

Efficient Numerical Methods for Nonlinear MPC and Moving Horizon Estimation Efficient Numerical Methods for Nonlinear MPC and Moving Horizon Estimation Moritz Diehl, Hans Joachim Ferreau, and Niels Haverbeke Optimization in Engineering Center (OPTEC) and ESAT-SCD, K.U. Leuven,

More information

Real-Time Feasibility of Nonlinear Predictive Control for Semi-batch Reactors

Real-Time Feasibility of Nonlinear Predictive Control for Semi-batch Reactors European Symposium on Computer Arded Aided Process Engineering 15 L. Puigjaner and A. Espuña (Editors) 2005 Elsevier Science B.V. All rights reserved. Real-Time Feasibility of Nonlinear Predictive Control

More information

ARTICLE IN PRESS. Computers and Chemical Engineering xxx (2008) xxx xxx. Contents lists available at ScienceDirect. Computers and Chemical Engineering

ARTICLE IN PRESS. Computers and Chemical Engineering xxx (2008) xxx xxx. Contents lists available at ScienceDirect. Computers and Chemical Engineering Computers and Chemical Engineering xxx (2008) xxx xxx 1 Contents lists available at ScienceDirect Computers and Chemical Engineering journal homepage: www.elsevier.com/locate/compchemeng 1 2 3 4 5 6 7

More information

What s New in Active-Set Methods for Nonlinear Optimization?

What s New in Active-Set Methods for Nonlinear Optimization? What s New in Active-Set Methods for Nonlinear Optimization? Philip E. Gill Advances in Numerical Computation, Manchester University, July 5, 2011 A Workshop in Honor of Sven Hammarling UCSD Center for

More information

Optimizing Economic Performance using Model Predictive Control

Optimizing Economic Performance using Model Predictive Control Optimizing Economic Performance using Model Predictive Control James B. Rawlings Department of Chemical and Biological Engineering Second Workshop on Computational Issues in Nonlinear Control Monterey,

More information

Direct Methods. Moritz Diehl. Optimization in Engineering Center (OPTEC) and Electrical Engineering Department (ESAT) K.U.

Direct Methods. Moritz Diehl. Optimization in Engineering Center (OPTEC) and Electrical Engineering Department (ESAT) K.U. Direct Methods Moritz Diehl Optimization in Engineering Center (OPTEC) and Electrical Engineering Department (ESAT) K.U. Leuven Belgium Overview Direct Single Shooting Direct Collocation Direct Multiple

More information

Optimization of Batch Processes

Optimization of Batch Processes Integrated Scheduling and Dynamic Optimization of Batch Processes Yisu Nie and Lorenz T. Biegler Center for Advanced Process Decision-making Department of Chemical Engineering Carnegie Mellon University

More information

Numerical Optimal Control Overview. Moritz Diehl

Numerical Optimal Control Overview. Moritz Diehl Numerical Optimal Control Overview Moritz Diehl Simplified Optimal Control Problem in ODE path constraints h(x, u) 0 initial value x0 states x(t) terminal constraint r(x(t )) 0 controls u(t) 0 t T minimize

More information

Model-based On-Line Optimization Framework for Semi-batch Polymerization Reactors

Model-based On-Line Optimization Framework for Semi-batch Polymerization Reactors Preprints of the 9th International Symposium on Advanced Control of Chemical Processes The International Federation of Automatic Control MoA1.1 Model-based On-Line Optimization Framework for Semi-batch

More information

Implicitly and Explicitly Constrained Optimization Problems for Training of Recurrent Neural Networks

Implicitly and Explicitly Constrained Optimization Problems for Training of Recurrent Neural Networks Implicitly and Explicitly Constrained Optimization Problems for Training of Recurrent Neural Networks Carl-Johan Thore Linköping University - Division of Mechanics 581 83 Linköping - Sweden Abstract. Training

More information

Survey of NLP Algorithms. L. T. Biegler Chemical Engineering Department Carnegie Mellon University Pittsburgh, PA

Survey of NLP Algorithms. L. T. Biegler Chemical Engineering Department Carnegie Mellon University Pittsburgh, PA Survey of NLP Algorithms L. T. Biegler Chemical Engineering Department Carnegie Mellon University Pittsburgh, PA NLP Algorithms - Outline Problem and Goals KKT Conditions and Variable Classification Handling

More information

Academic Editor: Dominique Bonvin Received: 26 November 2016; Accepted: 13 February 2017; Published: 27 February 2017

Academic Editor: Dominique Bonvin Received: 26 November 2016; Accepted: 13 February 2017; Published: 27 February 2017 Article Sensitivity-Based Economic NMPC with a Path-Following Approach Eka Suwartadi 1, Vyacheslav Kungurtsev 2 and Johannes Jäschke 1, * 1 Department of Chemical Engineering, Norwegian University of Science

More information

Nonlinear Programming: Concepts, Algorithms and Applications

Nonlinear Programming: Concepts, Algorithms and Applications Nonlinear Programming: Concepts, Algorithms and Applications L. T. Biegler Chemical Engineering Department Carnegie Mellon University Pittsburgh, PA Nonlinear Programming and Process Optimization Introduction

More information

Numerical Nonlinear Optimization with WORHP

Numerical Nonlinear Optimization with WORHP Numerical Nonlinear Optimization with WORHP Christof Büskens Optimierung & Optimale Steuerung London, 8.9.2011 Optimization & Optimal Control Nonlinear Optimization WORHP Concept Ideas Features Results

More information

An Inexact Sequential Quadratic Optimization Method for Nonlinear Optimization

An Inexact Sequential Quadratic Optimization Method for Nonlinear Optimization An Inexact Sequential Quadratic Optimization Method for Nonlinear Optimization Frank E. Curtis, Lehigh University involving joint work with Travis Johnson, Northwestern University Daniel P. Robinson, Johns

More information

Closed-loop Formulation for Nonlinear Dynamic Real-time Optimization

Closed-loop Formulation for Nonlinear Dynamic Real-time Optimization Preprint, 11th IFAC Symposium on Dynamics and Control of Process Systems, including Biosystems Closed-loop Formulation for Nonlinear Dynamic Real-time Optimization Mohammad Zamry Jamaludin Christopher

More information

CBE495 LECTURE IV MODEL PREDICTIVE CONTROL

CBE495 LECTURE IV MODEL PREDICTIVE CONTROL What is Model Predictive Control (MPC)? CBE495 LECTURE IV MODEL PREDICTIVE CONTROL Professor Dae Ryook Yang Fall 2013 Dept. of Chemical and Biological Engineering Korea University * Some parts are from

More information

Advanced Strategies for Optimal Design and Operation of. Pressure Swing Adsorption Processes. Submitted in partial fulfillment of the requirements for

Advanced Strategies for Optimal Design and Operation of. Pressure Swing Adsorption Processes. Submitted in partial fulfillment of the requirements for Advanced Strategies for Optimal Design and Operation of Pressure Swing Adsorption Processes Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Chemical Engineering

More information

Numerical approximation for optimal control problems via MPC and HJB. Giulia Fabrini

Numerical approximation for optimal control problems via MPC and HJB. Giulia Fabrini Numerical approximation for optimal control problems via MPC and HJB Giulia Fabrini Konstanz Women In Mathematics 15 May, 2018 G. Fabrini (University of Konstanz) Numerical approximation for OCP 1 / 33

More information

Nonlinear Optimization for Optimal Control Part 2. Pieter Abbeel UC Berkeley EECS. From linear to nonlinear Model-predictive control (MPC) POMDPs

Nonlinear Optimization for Optimal Control Part 2. Pieter Abbeel UC Berkeley EECS. From linear to nonlinear Model-predictive control (MPC) POMDPs Nonlinear Optimization for Optimal Control Part 2 Pieter Abbeel UC Berkeley EECS Outline From linear to nonlinear Model-predictive control (MPC) POMDPs Page 1! From Linear to Nonlinear We know how to solve

More information

Large-Scale Non-Linear Dynamic Optimization For Combining Applications of Optimal Scheduling and Control

Large-Scale Non-Linear Dynamic Optimization For Combining Applications of Optimal Scheduling and Control Brigham Young University BYU ScholarsArchive All Theses and Dissertations 2018-12-01 Large-Scale Non-Linear Dynamic Optimization For Combining Applications of Optimal Scheduling and Control Logan Daniel

More information

In Situ Adaptive Tabulation for Real-Time Control

In Situ Adaptive Tabulation for Real-Time Control In Situ Adaptive Tabulation for Real-Time Control J. D. Hedengren T. F. Edgar The University of Teas at Austin 2004 American Control Conference Boston, MA Outline Model reduction and computational reduction

More information

Integration of Scheduling and Control Operations

Integration of Scheduling and Control Operations Integration of Scheduling and Control Operations Antonio Flores T. with colaborations from: Sebastian Terrazas-Moreno, Miguel Angel Gutierrez-Limon, Ignacio E. Grossmann Universidad Iberoamericana, México

More information

Efficient Moving Horizon Estimation of DAE Systems. John D. Hedengren Thomas F. Edgar The University of Texas at Austin TWMCC Feb 7, 2005

Efficient Moving Horizon Estimation of DAE Systems. John D. Hedengren Thomas F. Edgar The University of Texas at Austin TWMCC Feb 7, 2005 Efficient Moving Horizon Estimation of DAE Systems John D. Hedengren Thomas F. Edgar The University of Teas at Austin TWMCC Feb 7, 25 Outline Introduction: Moving Horizon Estimation (MHE) Eplicit Solution

More information

Some Recent Advances in Mixed-Integer Nonlinear Programming

Some Recent Advances in Mixed-Integer Nonlinear Programming Some Recent Advances in Mixed-Integer Nonlinear Programming Andreas Wächter IBM T.J. Watson Research Center Yorktown Heights, New York andreasw@us.ibm.com SIAM Conference on Optimization 2008 Boston, MA

More information

Trust-Region SQP Methods with Inexact Linear System Solves for Large-Scale Optimization

Trust-Region SQP Methods with Inexact Linear System Solves for Large-Scale Optimization Trust-Region SQP Methods with Inexact Linear System Solves for Large-Scale Optimization Denis Ridzal Department of Computational and Applied Mathematics Rice University, Houston, Texas dridzal@caam.rice.edu

More information

Contents. Preface... xi. Introduction...

Contents. Preface... xi. Introduction... Contents Preface... xi Introduction... xv Chapter 1. Computer Architectures... 1 1.1. Different types of parallelism... 1 1.1.1. Overlap, concurrency and parallelism... 1 1.1.2. Temporal and spatial parallelism

More information

The use of second-order information in structural topology optimization. Susana Rojas Labanda, PhD student Mathias Stolpe, Senior researcher

The use of second-order information in structural topology optimization. Susana Rojas Labanda, PhD student Mathias Stolpe, Senior researcher The use of second-order information in structural topology optimization Susana Rojas Labanda, PhD student Mathias Stolpe, Senior researcher What is Topology Optimization? Optimize the design of a structure

More information

A New Penalty-SQP Method

A New Penalty-SQP Method Background and Motivation Illustration of Numerical Results Final Remarks Frank E. Curtis Informs Annual Meeting, October 2008 Background and Motivation Illustration of Numerical Results Final Remarks

More information

Click to edit Master title style

Click to edit Master title style Click to edit Master title style APOPT and BPOPT: New NLP and MINLP Solvers for Differential Algebraic Systems with Benchmark Testing John D. Hedengren Jose L. Mojica Brigham Young University Kody M. Powell

More information

Numerical Optimization. Review: Unconstrained Optimization

Numerical Optimization. Review: Unconstrained Optimization Numerical Optimization Finding the best feasible solution Edward P. Gatzke Department of Chemical Engineering University of South Carolina Ed Gatzke (USC CHE ) Numerical Optimization ECHE 589, Spring 2011

More information

Block Condensing with qpdunes

Block Condensing with qpdunes Block Condensing with qpdunes Dimitris Kouzoupis Rien Quirynen, Janick Frasch and Moritz Diehl Systems control and optimization laboratory (SYSCOP) TEMPO summer school August 5, 215 Dimitris Kouzoupis

More information

Slovak University of Technology in Bratislava Institute of Information Engineering, Automation, and Mathematics PROCEEDINGS

Slovak University of Technology in Bratislava Institute of Information Engineering, Automation, and Mathematics PROCEEDINGS Slovak University of Technology in Bratislava Institute of Information Engineering, Automation, and Mathematics PROCEEDINGS of the 18 th International Conference on Process Control Hotel Titris, Tatranská

More information

Constrained Nonlinear Optimization Algorithms

Constrained Nonlinear Optimization Algorithms Department of Industrial Engineering and Management Sciences Northwestern University waechter@iems.northwestern.edu Institute for Mathematics and its Applications University of Minnesota August 4, 2016

More information

MS&E 318 (CME 338) Large-Scale Numerical Optimization

MS&E 318 (CME 338) Large-Scale Numerical Optimization Stanford University, Management Science & Engineering (and ICME) MS&E 318 (CME 338) Large-Scale Numerical Optimization Instructor: Michael Saunders Spring 2015 Notes 11: NPSOL and SNOPT SQP Methods 1 Overview

More information

Efficient Handling of the Implicit Constraints Problem for the ASPEN MINLP Synthesizer

Efficient Handling of the Implicit Constraints Problem for the ASPEN MINLP Synthesizer 2006 Ind. Eng. Chem. Res. 1993,32, 2006-2011 Efficient Handling of the Implicit Constraints Problem for the ASPEN MINLP Synthesizer U. M. Diwekar' and E. S. Rubin Environmental Institute h Department of

More information

Dynamics of forced and unsteady-state processes

Dynamics of forced and unsteady-state processes Dynamics of forced and unsteady-state processes Davide Manca Lesson 3 of Dynamics and Control of Chemical Processes Master Degree in Chemical Engineering Davide Manca Dynamics and Control of Chemical Processes

More information

Large-Scale Nonlinear Optimization with Inexact Step Computations

Large-Scale Nonlinear Optimization with Inexact Step Computations Large-Scale Nonlinear Optimization with Inexact Step Computations Andreas Wächter IBM T.J. Watson Research Center Yorktown Heights, New York andreasw@us.ibm.com IPAM Workshop on Numerical Methods for Continuous

More information

Trajectory Planning and Collision Detection for Robotics Applications

Trajectory Planning and Collision Detection for Robotics Applications Trajectory Planning and Collision Detection for Robotics Applications joint work with Rene Henrion, Dietmar Homberg, Chantal Landry (WIAS) Institute of Mathematics and Applied Computing Department of Aerospace

More information

Index. calculus of variations, 247 car problem, 229, 238 cascading tank problem, 356 catalyst mixing problem, 240

Index. calculus of variations, 247 car problem, 229, 238 cascading tank problem, 356 catalyst mixing problem, 240 Index A-stable, 255 absolute value, 338 absolutely stable, 255 absorption, 202 active constraints, 72 active set strongly active set, 73 weakly active set, 73 active set strategy, 134 Adams, 256 Adams

More information

Carnegie Mellon University

Carnegie Mellon University Carnegie Mellon University CARNEGIE INSTITUTE OF TECHNOLOGY THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF Doctor of Philosophy TITLE Advanced-multi-step and Economically

More information

FAULT-TOLERANT CONTROL OF CHEMICAL PROCESS SYSTEMS USING COMMUNICATION NETWORKS. Nael H. El-Farra, Adiwinata Gani & Panagiotis D.

FAULT-TOLERANT CONTROL OF CHEMICAL PROCESS SYSTEMS USING COMMUNICATION NETWORKS. Nael H. El-Farra, Adiwinata Gani & Panagiotis D. FAULT-TOLERANT CONTROL OF CHEMICAL PROCESS SYSTEMS USING COMMUNICATION NETWORKS Nael H. El-Farra, Adiwinata Gani & Panagiotis D. Christofides Department of Chemical Engineering University of California,

More information

IBM Research Report. A Feasibility Pump for Mixed Integer Nonlinear Programs

IBM Research Report. A Feasibility Pump for Mixed Integer Nonlinear Programs RC386 (W060-09) February, 006 Mathematics IBM Research Report A Feasibility Pump for Mied Integer Nonlinear Programs Pierre Bonami, Gérard Cornuéjols, Andrea Lodi*, François Margot Tepper School of Business

More information

MS&E 318 (CME 338) Large-Scale Numerical Optimization

MS&E 318 (CME 338) Large-Scale Numerical Optimization Stanford University, Management Science & Engineering (and ICME) MS&E 318 (CME 338) Large-Scale Numerical Optimization 1 Origins Instructor: Michael Saunders Spring 2015 Notes 9: Augmented Lagrangian Methods

More information

1 Computing with constraints

1 Computing with constraints Notes for 2017-04-26 1 Computing with constraints Recall that our basic problem is minimize φ(x) s.t. x Ω where the feasible set Ω is defined by equality and inequality conditions Ω = {x R n : c i (x)

More information

Mixed-Integer Nonlinear Decomposition Toolbox for Pyomo (MindtPy)

Mixed-Integer Nonlinear Decomposition Toolbox for Pyomo (MindtPy) Mario R. Eden, Marianthi Ierapetritou and Gavin P. Towler (Editors) Proceedings of the 13 th International Symposium on Process Systems Engineering PSE 2018 July 1-5, 2018, San Diego, California, USA 2018

More information

Recent Adaptive Methods for Nonlinear Optimization

Recent Adaptive Methods for Nonlinear Optimization Recent Adaptive Methods for Nonlinear Optimization Frank E. Curtis, Lehigh University involving joint work with James V. Burke (U. of Washington), Richard H. Byrd (U. of Colorado), Nicholas I. M. Gould

More information

Chapter 6. Nonlinear Equations. 6.1 The Problem of Nonlinear Root-finding. 6.2 Rate of Convergence

Chapter 6. Nonlinear Equations. 6.1 The Problem of Nonlinear Root-finding. 6.2 Rate of Convergence Chapter 6 Nonlinear Equations 6. The Problem of Nonlinear Root-finding In this module we consider the problem of using numerical techniques to find the roots of nonlinear equations, f () =. Initially we

More information

Software for Integer and Nonlinear Optimization

Software for Integer and Nonlinear Optimization Software for Integer and Nonlinear Optimization Sven Leyffer, leyffer@mcs.anl.gov Mathematics & Computer Science Division Argonne National Laboratory Roger Fletcher & Jeff Linderoth Advanced Methods and

More information

Multidisciplinary System Design Optimization (MSDO)

Multidisciplinary System Design Optimization (MSDO) oday s opics Multidisciplinary System Design Optimization (MSDO) Approimation Methods Lecture 9 6 April 004 Design variable lining Reduced-Basis Methods Response Surface Approimations Kriging Variable-Fidelity

More information

A convex QP solver based on block-lu updates

A convex QP solver based on block-lu updates Block-LU updates p. 1/24 A convex QP solver based on block-lu updates PP06 SIAM Conference on Parallel Processing for Scientific Computing San Francisco, CA, Feb 22 24, 2006 Hanh Huynh and Michael Saunders

More information

CHAPTER 2: QUADRATIC PROGRAMMING

CHAPTER 2: QUADRATIC PROGRAMMING CHAPTER 2: QUADRATIC PROGRAMMING Overview Quadratic programming (QP) problems are characterized by objective functions that are quadratic in the design variables, and linear constraints. In this sense,

More information

Facing New Products Demand through Simultaneous Structural and Operational Decisions in the Design of the Control Recipe

Facing New Products Demand through Simultaneous Structural and Operational Decisions in the Design of the Control Recipe Facing New Products Demand through Simultaneous Structural and Operational Decisions in the Design of the Control Recipe Marta Moreno-Benito, Antonio Espuña* Chemical Engineering Department, Univesitat

More information

Optimization in Process Systems Engineering

Optimization in Process Systems Engineering Optimization in Process Systems Engineering M.Sc. Jan Kronqvist Process Design & Systems Engineering Laboratory Faculty of Science and Engineering Åbo Akademi University Most optimization problems in production

More information

Constrained optimization: direct methods (cont.)

Constrained optimization: direct methods (cont.) Constrained optimization: direct methods (cont.) Jussi Hakanen Post-doctoral researcher jussi.hakanen@jyu.fi Direct methods Also known as methods of feasible directions Idea in a point x h, generate a

More information

An Inexact Newton Method for Nonlinear Constrained Optimization

An Inexact Newton Method for Nonlinear Constrained Optimization An Inexact Newton Method for Nonlinear Constrained Optimization Frank E. Curtis Numerical Analysis Seminar, January 23, 2009 Outline Motivation and background Algorithm development and theoretical results

More information

Implementation of a KKT-based active-set QP solver

Implementation of a KKT-based active-set QP solver Block-LU updates p. 1/27 Implementation of a KKT-based active-set QP solver ISMP 2006 19th International Symposium on Mathematical Programming Rio de Janeiro, Brazil, July 30 August 4, 2006 Hanh Huynh

More information

Unconstrained Multivariate Optimization

Unconstrained Multivariate Optimization Unconstrained Multivariate Optimization Multivariate optimization means optimization of a scalar function of a several variables: and has the general form: y = () min ( ) where () is a nonlinear scalar-valued

More information

An Active-Set Quadratic Programming Method Based On Sequential Hot-Starts

An Active-Set Quadratic Programming Method Based On Sequential Hot-Starts An Active-Set Quadratic Programg Method Based On Sequential Hot-Starts Travis C. Johnson, Christian Kirches, and Andreas Wächter October 7, 203 Abstract A new method for solving sequences of quadratic

More information

Algorithms and Methods for Fast Model Predictive Control

Algorithms and Methods for Fast Model Predictive Control Algorithms and Methods for Fast Model Predictive Control Technical University of Denmark Department of Applied Mathematics and Computer Science 13 April 2016 Background: Model Predictive Control Model

More information

Kinetic Modeling for a Semi-Interpenetrating Polymer Network (SIPN) Process

Kinetic Modeling for a Semi-Interpenetrating Polymer Network (SIPN) Process Kinetic Modeling for a Semi-Interpenetrating Polymer Network (SIPN) Process Weijie Lin Advisor: Lorenz T. Biegler, Annette Jacobson Chemical Engineering Department Carnegie Mellon University, Pittsburgh,

More information

5 Handling Constraints

5 Handling Constraints 5 Handling Constraints Engineering design optimization problems are very rarely unconstrained. Moreover, the constraints that appear in these problems are typically nonlinear. This motivates our interest

More information

Mixed Integer Bilevel Optimization through Multi-parametric Programming

Mixed Integer Bilevel Optimization through Multi-parametric Programming Mied Integer Bilevel Optimization through Multi-parametric Programg S. Avraamidou 1,2, N. A. Diangelakis 1,2 and E. N. Pistikopoulos 2,3 1 Centre for Process Systems Engineering, Department of Chemical

More information

Real-Time Optimization (RTO)

Real-Time Optimization (RTO) Real-Time Optimization (RTO) In previous chapters we have emphasized control system performance for disturbance and set-point changes. Now we will be concerned with how the set points are specified. In

More information

CONSTRAINED OPTIMIZATION LARS IMSLAND

CONSTRAINED OPTIMIZATION LARS IMSLAND Introduction to course TTK16 Mixed integer optimization in energy and oil and gas systems CONSTRAINED OPTIMIZATION LARS IMSLAND TTK16 overview This introduction lecture One week intensive course Starting

More information

Robust Process Control by Dynamic Stochastic Programming

Robust Process Control by Dynamic Stochastic Programming Konrad-Zuse-Zentrum für Informationstechnik Berlin Takustraße 7 D-14195 Berlin-Dahlem Germany MARC C. STEINBACH Robust Process Control by Dynamic Stochastic Programming ZIB-Report 04-20 (May 2004) ROBUST

More information

An Inexact Newton Method for Optimization

An Inexact Newton Method for Optimization New York University Brown Applied Mathematics Seminar, February 10, 2009 Brief biography New York State College of William and Mary (B.S.) Northwestern University (M.S. & Ph.D.) Courant Institute (Postdoc)

More information

A Fast Heuristic for GO and MINLP

A Fast Heuristic for GO and MINLP A Fast Heuristic for GO and MINLP John W. Chinneck, M. Shafique, Systems and Computer Engineering Carleton University, Ottawa, Canada Introduction Goal: Find a good quality GO/MINLP solution quickly. Trade

More information

Time scale separation and the link between open-loop and closed-loop dynamics

Time scale separation and the link between open-loop and closed-loop dynamics Time scale separation and the link between open-loop and closed-loop dynamics Antonio Araújo a Michael Baldea b Sigurd Skogestad a,1 Prodromos Daoutidis b a Department of Chemical Engineering Norwegian

More information

Modeling and Optimization of Semi- Interpenetrating Polymer Network (SIPN) Particle Process

Modeling and Optimization of Semi- Interpenetrating Polymer Network (SIPN) Particle Process Modeling and Optimization of Semi- Interpenetrating Polymer Network (SIPN) Particle Process Weijie Lin, Lorenz T. Biegler, Annette Jacobson Chemical Engineering Department Carnegie Mellon University, Pittsburgh,

More information

Deterministic Global Optimization Algorithm and Nonlinear Dynamics

Deterministic Global Optimization Algorithm and Nonlinear Dynamics Deterministic Global Optimization Algorithm and Nonlinear Dynamics C. S. Adjiman and I. Papamichail Centre for Process Systems Engineering Department of Chemical Engineering and Chemical Technology Imperial

More information

A Trust-region-based Sequential Quadratic Programming Algorithm

A Trust-region-based Sequential Quadratic Programming Algorithm Downloaded from orbit.dtu.dk on: Oct 19, 2018 A Trust-region-based Sequential Quadratic Programming Algorithm Henriksen, Lars Christian; Poulsen, Niels Kjølstad Publication date: 2010 Document Version

More information

Optimization Algorithms for Integration of Design, Control, and Scheduling for Chemical Processes Subject to Disturbances and Uncertainty

Optimization Algorithms for Integration of Design, Control, and Scheduling for Chemical Processes Subject to Disturbances and Uncertainty Optimization Algorithms for Integration of Design, Control, and Scheduling for Chemical Processes Subject to Disturbances and Uncertainty by Robert Koller A thesis presented to the University of Waterloo

More information

= V I = Bus Admittance Matrix. Chapter 6: Power Flow. Constructing Ybus. Example. Network Solution. Triangular factorization. Let

= V I = Bus Admittance Matrix. Chapter 6: Power Flow. Constructing Ybus. Example. Network Solution. Triangular factorization. Let Chapter 6: Power Flow Network Matrices Network Solutions Newton-Raphson Method Fast Decoupled Method Bus Admittance Matri Let I = vector of currents injected into nodes V = vector of node voltages Y bus

More information

How to simulate in Simulink: DAE, DAE-EKF, MPC & MHE

How to simulate in Simulink: DAE, DAE-EKF, MPC & MHE How to simulate in Simulink: DAE, DAE-EKF, MPC & MHE Tamal Das PhD Candidate IKP, NTNU 24th May 2017 Outline 1 Differential algebraic equations (DAE) 2 Extended Kalman filter (EKF) for DAE 3 Moving horizon

More information

Dynamic Real-Time Optimization via Tracking of the Necessary Conditions of Optimality

Dynamic Real-Time Optimization via Tracking of the Necessary Conditions of Optimality Dynamic Real-Time Optimization via Tracking of the Necessary Conditions of Optimality D. Bonvin and B. Srinivasan + Laboratoire d Automatique EPFL, Lausanne, Switzerland + Department of Chemical Engineering

More information

A Lifted Linear Programming Branch-and-Bound Algorithm for Mixed Integer Conic Quadratic Programs

A Lifted Linear Programming Branch-and-Bound Algorithm for Mixed Integer Conic Quadratic Programs A Lifted Linear Programming Branch-and-Bound Algorithm for Mied Integer Conic Quadratic Programs Juan Pablo Vielma Shabbir Ahmed George L. Nemhauser H. Milton Stewart School of Industrial and Systems Engineering

More information

Inexact Solution of NLP Subproblems in MINLP

Inexact Solution of NLP Subproblems in MINLP Ineact Solution of NLP Subproblems in MINLP M. Li L. N. Vicente April 4, 2011 Abstract In the contet of conve mied-integer nonlinear programming (MINLP, we investigate how the outer approimation method

More information

Proper Orthogonal Decomposition (POD)

Proper Orthogonal Decomposition (POD) Intro Results Problem etras Proper Orthogonal Decomposition () Advisor: Dr. Sorensen CAAM699 Department of Computational and Applied Mathematics Rice University September 5, 28 Outline Intro Results Problem

More information

Preface Acknowledgments

Preface Acknowledgments Contents Preface Acknowledgments xi xix Chapter 1: Brief review of static optimization methods 1 1.1. Introduction: Significance of Mathematical Models 1 1.2. Unconstrained Problems 4 1.3. Equality Constraints

More information

Introduction to unconstrained optimization - direct search methods

Introduction to unconstrained optimization - direct search methods Introduction to unconstrained optimization - direct search methods Jussi Hakanen Post-doctoral researcher jussi.hakanen@jyu.fi Structure of optimization methods Typically Constraint handling converts the

More information

A robust multilevel approximate inverse preconditioner for symmetric positive definite matrices

A robust multilevel approximate inverse preconditioner for symmetric positive definite matrices DICEA DEPARTMENT OF CIVIL, ENVIRONMENTAL AND ARCHITECTURAL ENGINEERING PhD SCHOOL CIVIL AND ENVIRONMENTAL ENGINEERING SCIENCES XXX CYCLE A robust multilevel approximate inverse preconditioner for symmetric

More information

Constrained Minimization and Multigrid

Constrained Minimization and Multigrid Constrained Minimization and Multigrid C. Gräser (FU Berlin), R. Kornhuber (FU Berlin), and O. Sander (FU Berlin) Workshop on PDE Constrained Optimization Hamburg, March 27-29, 2008 Matheon Outline Successive

More information

Direct and indirect methods for optimal control problems and applications in engineering

Direct and indirect methods for optimal control problems and applications in engineering Direct and indirect methods for optimal control problems and applications in engineering Matthias Gerdts Computational Optimisation Group School of Mathematics The University of Birmingham gerdtsm@maths.bham.ac.uk

More information

An introduction to PDE-constrained optimization

An introduction to PDE-constrained optimization An introduction to PDE-constrained optimization Wolfgang Bangerth Department of Mathematics Texas A&M University 1 Overview Why partial differential equations? Why optimization? Examples of PDE optimization

More information

A Framework for Modeling and Optimizing Dynamic Systems Under Uncertainty

A Framework for Modeling and Optimizing Dynamic Systems Under Uncertainty A Framework for Modeling and Optimizing Dynamic Systems Under Uncertainty Bethany Nicholson John D. Siirola Center for Computing Research Sandia National Laboratories Albuquerque, NM USA FOCAPO January

More information

Logic-Based Outer-Approximation Algorithm for Solving Discrete-Continuous Dynamic Optimization Problems

Logic-Based Outer-Approximation Algorithm for Solving Discrete-Continuous Dynamic Optimization Problems Logic-Based Outer-Approximation Algorithm for Solving Discrete-Continuous Dynamic Optimization Problems Ruben Ruiz-Femenia,Antonio Flores-Tlacuahuac, Ignacio E. Grossmann Department of Chemical Engineering

More information

Nonlinear State Estimation Methods Overview and Application to PET Polymerization

Nonlinear State Estimation Methods Overview and Application to PET Polymerization epartment of Biochemical and Chemical Engineering Process ynamics Group () onlinear State Estimation Methods Overview and Polymerization Paul Appelhaus Ralf Gesthuisen Stefan Krämer Sebastian Engell The

More information

IP-PCG An interior point algorithm for nonlinear constrained optimization

IP-PCG An interior point algorithm for nonlinear constrained optimization IP-PCG An interior point algorithm for nonlinear constrained optimization Silvia Bonettini (bntslv@unife.it), Valeria Ruggiero (rgv@unife.it) Dipartimento di Matematica, Università di Ferrara December

More information

On Perspective Functions, Vanishing Constraints, and Complementarity Programming

On Perspective Functions, Vanishing Constraints, and Complementarity Programming On Perspective Functions, Vanishing Constraints, and Complementarity Programming Fast Mixed-Integer Nonlinear Feedback Control Christian Kirches 1, Sebastian Sager 2 1 Interdisciplinary Center for Scientific

More information

Real-time Constrained Nonlinear Optimization for Maximum Power Take-off of a Wave Energy Converter

Real-time Constrained Nonlinear Optimization for Maximum Power Take-off of a Wave Energy Converter Real-time Constrained Nonlinear Optimization for Maximum Power Take-off of a Wave Energy Converter Thomas Bewley 23 May 2014 Southern California Optimization Day Summary 1 Introduction 2 Nonlinear Model

More information

An Introduction to Optimal Control of Partial Differential Equations with Real-life Applications

An Introduction to Optimal Control of Partial Differential Equations with Real-life Applications An Introduction to Optimal Control of Partial Differential Equations with Real-life Applications Hans Josef Pesch Chair of Mathematics in Engineering Sciences University of Bayreuth, Bayreuth, Germany

More information

AM 205: lecture 19. Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods

AM 205: lecture 19. Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods AM 205: lecture 19 Last time: Conditions for optimality, Newton s method for optimization Today: survey of optimization methods Quasi-Newton Methods General form of quasi-newton methods: x k+1 = x k α

More information