Optimal dynamic operation of chemical processes: current opportunities

Similar documents
Optimal dynamic operation of chemical processes: Assessment of the last 20 years and current research opportunities

Overview of Models for Automated Process Control

In search of the unreachable setpoint

Coordinating multiple optimization-based controllers: new opportunities and challenges

Coordinating multiple optimization-based controllers: new opportunities and challenges

Cooperation-based optimization of industrial supply chains

Optimizing Economic Performance using Model Predictive Control

Quis custodiet ipsos custodes?

Distributed model predictive control of large-scale systems

Nonlinear Stochastic Modeling and State Estimation of Weakly Observable Systems: Application to Industrial Polymerization Processes

State Estimation of Linear and Nonlinear Dynamic Systems

An overview of distributed model predictive control (MPC)

Controlling Large-Scale Systems with Distributed Model Predictive Control

Online monitoring of MPC disturbance models using closed-loop data

Course on Model Predictive Control Part II Linear MPC design

Postface to Model Predictive Control: Theory and Design

On the Inherent Robustness of Suboptimal Model Predictive Control

MATH4406 (Control Theory) Unit 6: The Linear Quadratic Regulator (LQR) and Model Predictive Control (MPC) Prepared by Yoni Nazarathy, Artem

On the Inherent Robustness of Suboptimal Model Predictive Control

A FAST, EASILY TUNED, SISO, MODEL PREDICTIVE CONTROLLER. Gabriele Pannocchia,1 Nabil Laachi James B. Rawlings

EE C128 / ME C134 Feedback Control Systems

Outline. 1 Linear Quadratic Problem. 2 Constraints. 3 Dynamic Programming Solution. 4 The Infinite Horizon LQ Problem.

Introduction to Model Predictive Control. Dipartimento di Elettronica e Informazione

Course on Model Predictive Control Part III Stability and robustness

Theory in Model Predictive Control :" Constraint Satisfaction and Stability!

Nonlinear Model Predictive Control Tools (NMPC Tools)

Economic Model Predictive Control Historical Perspective and Recent Developments and Industrial Examples

Dynamic Real-Time Optimization: Linking Off-line Planning with On-line Optimization

Outline. Model Predictive Control: Current Status and Future Challenges. Separation of the control problem. Separation of the control problem

Regional Solution of Constrained LQ Optimal Control

The Partial Enumeration Method for Model Predictive Control: Algorithm and Examples

A Globally Stabilizing Receding Horizon Controller for Neutrally Stable Linear Systems with Input Constraints 1

Stochastic Tube MPC with State Estimation

A tutorial overview on theory and design of offset-free MPC algorithms

IMPLEMENTATIONS OF TRACKING MULTIPARAMETRIC PREDICTIVE CONTROLLER. Pregelj Boštjan, Gerkšič Samo. Jozef Stefan Institute, Ljubljana, Slovenia

Prashant Mhaskar, Nael H. El-Farra & Panagiotis D. Christofides. Department of Chemical Engineering University of California, Los Angeles

FAULT-TOLERANT CONTROL OF CHEMICAL PROCESS SYSTEMS USING COMMUNICATION NETWORKS. Nael H. El-Farra, Adiwinata Gani & Panagiotis D.

Robustness of MPC and Disturbance Models for Multivariable Ill-conditioned Processes

CBE495 LECTURE IV MODEL PREDICTIVE CONTROL

Model Predictive Controller of Boost Converter with RLE Load

UCLA Chemical Engineering. Process & Control Systems Engineering Laboratory

SIMULATION OF TURNING RATES IN TRAFFIC SYSTEMS

MODEL PREDICTIVE CONTROL FUNDAMENTALS

Whither discrete time model predictive control?

4F3 - Predictive Control

MODEL PREDICTIVE CONTROL

Constrained State Estimation Using the Unscented Kalman Filter

Application of Autocovariance Least-Squares Methods to Laboratory Data

4F3 - Predictive Control

Model predictive control of industrial processes. Vitali Vansovitš

Dynamic Operability for the Calculation of Transient Output Constraints for Non-Square Linear Model Predictive Controllers

arxiv: v1 [cs.sy] 2 Oct 2018

MPC for tracking periodic reference signals

State Estimation of Linear and Nonlinear Dynamic Systems

Optimization Problems in Model Predictive Control

Improved Crude Oil Processing Using Second-Order Volterra Models and Nonlinear Model Predictive Control

On the Stabilization of Neutrally Stable Linear Discrete Time Systems

Distributed and Real-time Predictive Control

OPTIMAL CONTROL WITH DISTURBANCE ESTIMATION

State Estimation using Moving Horizon Estimation and Particle Filtering

A Candidate to Replace PID Control: SISO-Constrained LQ Control

Closed-loop Behavior of Nonlinear Model Predictive Control

Model Predictive Control Short Course Regulation

State Regulator. Advanced Control. design of controllers using pole placement and LQ design rules

Real-Time Implementation of Nonlinear Predictive Control

COMPUTATIONAL DELAY IN NONLINEAR MODEL PREDICTIVE CONTROL. Rolf Findeisen Frank Allgöwer

Learning Model Predictive Control for Iterative Tasks: A Computationally Efficient Approach for Linear System

Closed-loop Formulation for Nonlinear Dynamic Real-time Optimization

Outline. Linear regulation and state estimation (LQR and LQE) Linear differential equations. Discrete time linear difference equations

Economic MPC and Real-time Decision Making with Application to Large-Scale HVAC Energy Systems

Donald J Chmielewski and Benjamin P Omell. Department of Chemical & Biological Engineering Illinois Institute of Technology. Energy Value ($/MWhr)

Ciência e Natura ISSN: Universidade Federal de Santa Maria Brasil

ARTICLE IN PRESS Systems & Control Letters ( )

Online Model Predictive Torque Control for Permanent Magnet Synchronous Motors

HPMPC - A new software package with efficient solvers for Model Predictive Control

Achieving State Estimation Equivalence for Misassigned Disturbances in Offset-Free Model Predictive Control

Principles of Optimal Control Spring 2008

Real-Time Feasibility of Nonlinear Predictive Control for Semi-batch Reactors

Constrained Linear Quadratic Optimal Control

Practical Implementations of Advanced Process Control for Linear Systems

An Introduction to Model-based Predictive Control (MPC) by

Adaptive Nonlinear Model Predictive Control with Suboptimality and Stability Guarantees

Here represents the impulse (or delta) function. is an diagonal matrix of intensities, and is an diagonal matrix of intensities.

LINEAR TIME VARYING TERMINAL LAWS IN MPQP

PREDICTIVE CONTROL OF NONLINEAR SYSTEMS. Received February 2008; accepted May 2008

PROCESS DESIGN AND CONTROL Offset-Free Tracking of Model Predictive Control with Model Mismatch: Experimental Results

Giulio Betti, Marcello Farina and Riccardo Scattolini

State Estimation of Linear and Nonlinear Dynamic Systems

Active Fault Diagnosis for Uncertain Systems

Improved MPC Design based on Saturating Control Laws

IMPROVED MPC DESIGN BASED ON SATURATING CONTROL LAWS

Journal of Process Control

Application of Dynamic Matrix Control To a Boiler-Turbine System

Intermediate Process Control CHE576 Lecture Notes # 2

NONLINEAR RECEDING HORIZON CONTROL OF QUADRUPLE-TANK SYSTEM AND REAL-TIME IMPLEMENTATION. Received August 2011; revised December 2011

Chapter 2 Optimal Control Problem

On robustness of suboptimal min-max model predictive control *

MPC Infeasibility Handling

MODEL PREDICTIVE CONTROL and optimization

Optimal Control. Lecture 18. Hamilton-Jacobi-Bellman Equation, Cont. John T. Wen. March 29, Ref: Bryson & Ho Chapter 4.

Transcription:

Optimal dynamic operation of chemical processes: current opportunities James B. Rawlings Department of Chemical and Biological Engineering August 6, 29 Westhollow Research Center Shell Rawlings Current opportunities / 48

Outline Introductory overview to Model Predictive Control (MPC) 2 Industrial impact of these ideas 3 Recent developments Distributed MPC Large-scale systems and partial enumeration Tools for controller commissioning Optimizing economics Continuous time MPC 4 Conclusions and future outlook 5 Further Reading Rawlings Current opportunities 2 / 48

The model predictive control framework Measurement MH Estimate MPC control Forecast t time Reconcile the past Forecast the future sensors y actuators u Rawlings Current opportunities 3 / 48

Predictive control Measurement MH Estimate MPC control Forecast t time Reconcile the past Forecast the future sensors y actuators u min u(t) T y sp g(x, u) 2 Q + u sp u 2 R dt ẋ = f (x, u) x() = x (given) y = g(x, u) Rawlings Current opportunities 4 / 48

State estimation Measurement MH Estimate MPC control Forecast t time Reconcile the past Forecast the future sensors y actuators u min x,w(t) T y g(x, u) 2 R + ẋ f (x, u) 2 Q dt ẋ = f (x, u) + w (process noise) y = g(x, u) + v (measurement noise) Rawlings Current opportunities 5 / 48

Industrial practice of MPC Planning and Scheduling Steady State Optimization Validation Model Update Reconciliation Two layer structure Steady-state layer RTO optimizes steady state model Optimal setpoints passed to dynamic layer Controller Plant Rawlings Current opportunities 6 / 48

Industrial practice of MPC Planning and Scheduling Steady State Optimization Validation Controller Plant Model Update Reconciliation Two layer structure Steady-state layer RTO optimizes steady state model Optimal setpoints passed to dynamic layer Dynamic layer Controller tracks the setpoints Linear MPC (replaces multiloop PID) Rawlings Current opportunities 6 / 48

Large industrial success story! Linear MPC and ethylene manufacturing Number of MPC applications in ethylene: 8 to 2 Rawlings Current opportunities 7 / 48

Large industrial success story! Linear MPC and ethylene manufacturing Number of MPC applications in ethylene: 8 to 2 Credits 5 to 8 M$/yr (27) Rawlings Current opportunities 7 / 48

Large industrial success story! Linear MPC and ethylene manufacturing Number of MPC applications in ethylene: 8 to 2 Credits 5 to 8 M$/yr (27) Achieved primarily by increased on-spec product, decreased energy use Rawlings Current opportunities 7 / 48

Large industrial success story! Linear MPC and ethylene manufacturing Number of MPC applications in ethylene: 8 to 2 Credits 5 to 8 M$/yr (27) Achieved primarily by increased on-spec product, decreased energy use Eastman Chemical experience with MPC First MPC implemented in 996 Rawlings Current opportunities 7 / 48

Large industrial success story! Linear MPC and ethylene manufacturing Number of MPC applications in ethylene: 8 to 2 Credits 5 to 8 M$/yr (27) Achieved primarily by increased on-spec product, decreased energy use Eastman Chemical experience with MPC First MPC implemented in 996 Currently 55-6 MPC applications of varying complexity Rawlings Current opportunities 7 / 48

Large industrial success story! Linear MPC and ethylene manufacturing Number of MPC applications in ethylene: 8 to 2 Credits 5 to 8 M$/yr (27) Achieved primarily by increased on-spec product, decreased energy use Eastman Chemical experience with MPC First MPC implemented in 996 Currently 55-6 MPC applications of varying complexity 3-5 M$/year increased profit due to increased throughput (28) Rawlings Current opportunities 7 / 48

Large industrial success story! Linear MPC and ethylene manufacturing Number of MPC applications in ethylene: 8 to 2 Credits 5 to 8 M$/yr (27) Achieved primarily by increased on-spec product, decreased energy use Eastman Chemical experience with MPC First MPC implemented in 996 Currently 55-6 MPC applications of varying complexity 3-5 M$/year increased profit due to increased throughput (28) Praxair experience with MPC Praxair currently has more than 5 MPC installations Rawlings Current opportunities 7 / 48

Large industrial success story! Linear MPC and ethylene manufacturing Number of MPC applications in ethylene: 8 to 2 Credits 5 to 8 M$/yr (27) Achieved primarily by increased on-spec product, decreased energy use Eastman Chemical experience with MPC First MPC implemented in 996 Currently 55-6 MPC applications of varying complexity 3-5 M$/year increased profit due to increased throughput (28) Praxair experience with MPC Praxair currently has more than 5 MPC installations 6 M$/year increased profit (28) Rawlings Current opportunities 7 / 48

Impact for 3 ethylene plants (Starks and Arrieta, 27) Hydrocarbons AC&O 7 We re Doing it For the Money $6,, $6,, $5,, $5,, $4,, $4,, $3,, $3,, $2,, $2,, $,, $,, $ $ Q 2 3Q 2 Q 2 3Q 2 Q 22 3Q 22 Q 23 3Q 23 Q 24 3Q 24 Q 25 3Q 25 Q26 3Q26 Cumulative Quarterly Advanced Control & Optimization Rawlings Current opportunities 8 / 48

Maintaining technology (Starks and Arrieta, 27) Hydrocarbons AC&O Challenges (continued ) 26 Average DMC Service Factors (per plant) DMC Service Factor (%).% 8.% 6.% 4.% 2.%.% A B C D E F G H I J K L M Plant Plants L & M experienced APC personnel changes Advanced Control & Optimization Rawlings Current opportunities 9 / 48

Broader industrial impact (Qin and Badgwell, 23) Area Aspen Honeywell Adersa PCL MDC Total Technology Hi-Spec Refining 2 48 28 25 985 Petrochemicals 45 8-2 55 Chemicals 2 3 2 44 Pulp and Paper 8 5 - - 68 Air & Gas - - - Utility - - 4 4 Mining/Metallurgy 8 6 7 6 37 Food Processing - - 4 5 Polymer 7 - - - 7 Furnaces - - 42 3 45 Aerospace/Defense - - 3-3 Automotive - - 7-7 Unclassified 4 4 45 26 45 6 Total 833 696 438 25 45 4542 First App. DMC:985 PCT:984 IDCOM:973 PCL: SMOC: IDCOM-M:987 RMPCT:99 HIECON:986 984 988 OPC:987 Largest App 63x283 225x85-3x2 - Rawlings Current opportunities / 48

Are all the problems solved? Some questions to consider Has the application base stopped growing? Rawlings Current opportunities / 48

Are all the problems solved? Some questions to consider Has the application base stopped growing? Is the technology mature? Rawlings Current opportunities / 48

Are all the problems solved? Some questions to consider Has the application base stopped growing? Is the technology mature? Is the theory complete? Rawlings Current opportunities / 48

Are all the problems solved? Some questions to consider Has the application base stopped growing? Is the technology mature? Is the theory complete? Do we have tools to decompose large-scale systems into manageable problems? Rawlings Current opportunities / 48

Are all the problems solved? Some questions to consider Has the application base stopped growing? Is the technology mature? Is the theory complete? Do we have tools to decompose large-scale systems into manageable problems? Do we have tools to optimize dynamic economic operation? Rawlings Current opportunities / 48

Are all the problems solved? Some questions to consider Has the application base stopped growing? Is the technology mature? Is the theory complete? Do we have tools to decompose large-scale systems into manageable problems? Do we have tools to optimize dynamic economic operation? Do we have tools to commission and maintain the controllers? Rawlings Current opportunities / 48

Are all the problems solved? Some questions to consider Has the application base stopped growing? Is the technology mature? Is the theory complete? Do we have tools to decompose large-scale systems into manageable problems? Do we have tools to optimize dynamic economic operation? Do we have tools to commission and maintain the controllers? Can we handle fast systems? Rawlings Current opportunities / 48

Has the application base stopped growing? European Commission DG information Society & Media Monitoring and control: today's market, its evolution till 22 and the impact of ICT on these Workshop: 9 th of October 28 A report & a presentation prepared by: Available for download: http://www.decision.eu/smart27.htm EC DG INFSO SMART Rawlings 27/47 Current opportunities 2 / 48

A report & a presentation prepared by: Has the application base stopped growing? Available for download: http://www.decision.eu/smart27.htm 23 EC DG INFSO SMART 27/47 Monitoring and control: today's market, its evolution till 22 and the impact of ICT on these WORKSHOP: Brussels the 9th of October 28 3. Worldwide Monitoring & Control Market The worldwide market for Monitoring & Control products and solutions is around 88 billion euros. This represents 8% of total ICT expenditures worldwide. In the field of ICT, this is comparable to: the whole semiconductor industry world revenues; twice the world mobile phone manufacturers revenues. Total world: 87,9 bn 35% Services, with more than 5% of the market value, have the biggest share. The 3 larger sub markets represent together over billion euros, namely: integration, installation & training services with 38 billion euros; control hardware with 36 billion euros; maintenance, repair & overall services with 3 billion euros. 53% 2% Hardware Soft Services Definitions - bundle OS & drivers included in hardware - application development included in services The 3 larger application markets are Vehicles, Process and Manufacturing industries. Europe represents 32 % of the world total market value. A report & a presentation prepared by: Available for download: http://www.decision.eu/smart27.htm 24 Rawlings Current opportunities 3 / 48

Is the theory complete? 45 4 MPC 35 3 papers year 25 2 5 5 965 97 975 98 985 99 995 2 25 year Rawlings Current opportunities 4 / 48

Is the theory complete? 4 2 MPC FB Control Chem Engr papers year 8 6 4 2 965 97 975 98 985 99 995 2 25 year Rawlings Current opportunities 5 / 48

Ratio of MPC papers to feedback control papers.4.35 MPC/FB Control.3.25.2.5..5 965 97 975 98 985 99 995 2 25 Rawlings Current opportunities 6 / 48

Distributed MPC Decomposing large-scale systems Rawlings Current opportunities 7 / 48

Decomposing large-scale systems Material flow Energy flow Rawlings Current opportunities 8 / 48

MPC at the large scale Decentralized Control Traditional approach Wealth of literature from the early 97 s on improved decentralized control a Well-known that poor performance may result if the interconnections are not negligible a (Sandell Jr. et al., 978; Šiljak, 99; Lunze, 992) Rawlings Current opportunities 9 / 48

MPC at the large scale Decentralized Control Traditional approach Wealth of literature from the early 97 s on improved decentralized control a Well-known that poor performance may result if the interconnections are not negligible a (Sandell Jr. et al., 978; Šiljak, 99; Lunze, 992) Centralized Control Steady increase in available computational power has provided the opportunity for centralized control Many practitioners view centralized control of large, networked systems as impractical and unrealistic Rawlings Current opportunities 9 / 48

Cooperative control as suboptimal MPC Properties established by suboptimal MPC theory Stability: Given a feasible initial condition, adding the stability constraint u i d i x i () gives nominal closed-loop stability for any number of information exchanges (Venkat et al., 26a) and (Venkat et al., 26b) Rawlings Current opportunities 2 / 48

Cooperative control as suboptimal MPC Properties established by suboptimal MPC theory Stability: Given a feasible initial condition, adding the stability constraint u i d i x i () gives nominal closed-loop stability for any number of information exchanges Cost decrease: Plant-wide objective is decreased at each iterate (Venkat et al., 26a) and (Venkat et al., 26b) Rawlings Current opportunities 2 / 48

Cooperative control as suboptimal MPC Properties established by suboptimal MPC theory Stability: Given a feasible initial condition, adding the stability constraint u i d i x i () gives nominal closed-loop stability for any number of information exchanges Cost decrease: Plant-wide objective is decreased at each iterate Convergence: Cooperative MPC produces centralized control performance at the limit of infinite iterates (Venkat et al., 26a) and (Venkat et al., 26b) Rawlings Current opportunities 2 / 48

Distributed MPC publications G. Pannocchia, S. J. Wright, B. T. Stewart, and J. B. Rawlings. Efficient cooperative distributed MPC using partial enumeration. In ADCHEM 29, International Symposium on Advanced Control of Chemical Processes, Istanbul, Turkey, July 2-5, 29. J. B. Rawlings and B. T. Stewart. Coordinating multiple optimization-based controllers: new opportunities and challenges. J. Proc. Cont., 8:839 845, 28. B. T. Stewart, A. N. Venkat, J. B. Rawlings, S. J. Wright, and G. Pannocchia. Cooperative distributed model predictive control. Submitted for publication in Sys. Cont. Let., July 29. A. N. Venkat, J. B. Rawlings, and S. J. Wright. Stability and optimality of distributed, linear MPC. Part : state feedback. Technical Report 26 3, TWMCC, Department of Chemical and Biological Engineering, University of Wisconsin Madison (Available at http://jbrwww.che.wisc.edu/tech-reports.html), October 26a. A. N. Venkat, J. B. Rawlings, and S. J. Wright. Stability and optimality of distributed, linear MPC. Part 2: output feedback. Technical Report 26 4, TWMCC, Department of Chemical and Biological Engineering, University of Wisconsin Madison (Available at http://jbrwww.che.wisc.edu/tech-reports.html), October 26b. Rawlings Current opportunities 2 / 48

Large-scale systems and partial enumeration Unconstrained solution: LQ regulator (Kalman, 96) Constrained solution: MPC u = Kx u = K i x + b i in which i enumerates different possible active sets for the inequality constraints (Bemporad et al., 22) There are 3 mn different active sets u u u u. u 2. u. u u m u Rawlings Current opportunities 22 / 48

The active set table u = K i x + b i Rawlings Current opportunities 23 / 48

The active set table N = 2 u = K i x + b i i constraint set K i b i {u, u} u 2 {u, } u 3 {u, u} u 4 {, u} K 4 b 4 5 {, } K 5 b 5 6 {, u} K 6 b 6 7 {u, u} u 8 {u, } u 9 {u, u} u Rawlings Current opportunities 23 / 48

The active set table u = K i x + b i N = 2 N = 4 i constraint set K i b i {u, u} u 2 {u, } u 3 {u, u} u 4 {, u} K 4 b 4 5 {, } K 5 b 5 6 {, u} K 6 b 6 7 {u, u} u 8 {u, } u 9 {u, u} u i constraint set K i b i {u, u, u, u} u 2 {u, u, u, } u 3 {u, u, u, u} u 4 {,,, u} K 4 b 4 4 {,,, } K 4 b 4 42 {,,, u} K 42 b 42 79 {u, u, u, u} u 8 {u, u, u, } u 8 {u, u, u, u} u Rawlings Current opportunities 23 / 48

The computational challenge of large scale centralized MPC On-line QP solution may not be practical for large-scale applications Rawlings Current opportunities 24 / 48

The computational challenge of large scale centralized MPC On-line QP solution may not be practical for large-scale applications Computation time may be too long Rawlings Current opportunities 24 / 48

The computational challenge of large scale centralized MPC On-line QP solution may not be practical for large-scale applications Computation time may be too long Full enumeration is not possible! Rawlings Current opportunities 24 / 48

The computational challenge of large scale centralized MPC On-line QP solution may not be practical for large-scale applications Computation time may be too long Full enumeration is not possible! Typical large-sized applications: m = 5, N = 5, 9 m = 32, N = 5, 229 Rawlings Current opportunities 24 / 48

The computational challenge of large scale centralized MPC On-line QP solution may not be practical for large-scale applications Computation time may be too long Full enumeration is not possible! Typical large-sized applications: m = 5, N = 5, 9 m = 32, N = 5, 229 Consider partial enumeration Rawlings Current opportunities 24 / 48

Partial Enumeration Conjecture: In practice, the state might visit relatively few different active constraints! SO... don t do the calculations for all possible active sets. Instead: Initialize by calculating and storing the table only for likely active sets; Given ˆx, search through the table and see if one of them is optimal; If so, use that control; If not, is there a feasible (suboptimal) solution? If so, use this one; If not, solve the MPC QP problem with small N and add this solution to the table; Make room in the table by deleting the entry that was used least recently. Rawlings Current opportunities 25 / 48

Initializing the Table Choose a size for the table, and initialize its contents in a training period. Add disturbances during training period to ensure that useful parts of the active-set space are sampled. Larger disturbances tend to cause saturation of some inputs. Saturation causes more active sets to be interesting because of small variations in the timepoint at which a constraint becomes active/inactive. Rawlings Current opportunities 26 / 48

Computational Results: Problem Copolymerization reactor: 5 inputs, 8 states, 4 outputs, horizon N = 5. 9 possible active sets. Rawlings Current opportunities 27 / 48

Computational Results: Problem Copolymerization reactor: 5 inputs, 8 states, 4 outputs, horizon N = 5. 9 possible active sets. Training period: 288 sample intervals (2 days, -minute intervals), 2 random disturbances applied. Visited a total of 376 active sets during this time. Validation period: 432 sample intervals (3 days), 3 random disturbances. Considered tables of sizes 5,, and 2. Rawlings Current opportunities 27 / 48

CPU time and suboptimality ratio of four solvers TAB5 TAB TAB2 qpsol Max time (s).44.278.463.56 Mean time (s).75.98.29.2 Active sets visited 77 84 877 Suboptimality.9.88.94 Rawlings Current opportunities 28 / 48

Partial enumeration publications G. Pannocchia, J. B. Rawlings, and S. J. Wright. Fast, large-scale model predictive control by partial enumeration. Automatica, 43:852 86, 27. G. Pannocchia, S. J. Wright, B. T. Stewart, and J. B. Rawlings. Efficient cooperative distributed MPC using partial enumeration. In ADCHEM 29, International Symposium on Advanced Control of Chemical Processes, Istanbul, Turkey, July 2-5, 29. Rawlings Current opportunities 29 / 48

Controller Commissioning Obtaining Q and R from Data Xf, Ff X D X X 2 Condenser y Model discretized with t k = k t: 2 3 d dt 6 4 X D. X B 7 5 {z } x(t)» y (t k ) = y 2 = F (x(t), u(t) ) {z} X f,f f» x(t k ) X N X B Reboiler Measurements are only X D, X B at the discretization times y 2 Rawlings Current opportunities 3 / 48

Controller Commissioning Obtaining Q and R from Data X D X X 2 Condenser y Model discretized with t k = k t: x k+ = f (x k, u k ) + g(x k, u k )w k [ ] [ ] y y 2 = x k k Xf, Ff w X N X B Reboiler Measurements are only X D, X B at the discretization times Noise w k affects all the states y 2 Rawlings Current opportunities 3 / 48

Controller Commissioning Obtaining Q and R from Data X D X X 2 Condenser v y Model discretized with t k = k t: x k+ = f (x k, u k ) + g(x k, u k )w k [ ] [ ] [ ] y v y 2 = x k + v 2 k k Xf, Ff w v 2 y 2 X N X B Reboiler Measurements are only X D, X B at the discretization times Noise w k affects all the states Noise v k corrupts the measurements Rawlings Current opportunities 3 / 48

Motivation for Using Autocovariances Xf, Ff X D X X 2 Condenser v y Idea of Autocovariances The state noise w k gets propagated in time The measurement noise v k appears only at the sampling times and is not propagated in time w X N X B Taking autocovariances of data at different time lags gives covariances of w k and v k v 2 Reboiler y 2 Rawlings Current opportunities 3 / 48

Motivation for Using Autocovariances Xf, Ff X D X X 2 Condenser v y Idea of Autocovariances The state noise w k gets propagated in time The measurement noise v k appears only at the sampling times and is not propagated in time w X N X B Taking autocovariances of data at different time lags gives covariances of w k and v k v 2 y 2 Reboiler Let w k, v k have zero means and covariances Q and R Rawlings Current opportunities 3 / 48

Mathematical Formulation of the ALS Linear State-Space Model: x k+ = Ax k + Gw k w k N(, Q) y k = Cx k + v k v k N(, R) Model (A, C, G) known from the linearization, finite set of measurements: {y,..., y k } given. Only unknowns are noises w k and v k. Rawlings Current opportunities 32 / 48

Mathematical Formulation of the ALS Linear State-Space Model: x k+ = Ax k + Gw k w k N(, Q) y k = Cx k + v k v k N(, R) Model (A, C, G) known from the linearization, finite set of measurements: {y,..., y k } given. Only unknowns are noises w k and v k. y k = Cx k y k+ = CAx k + CGw k y k+2 = CA 2 x k +CAGw k +CGw k+ Rawlings Current opportunities 32 / 48

Mathematical Formulation of the ALS Linear State-Space Model: x k+ = Ax k + Gw k w k N(, Q) y k = Cx k + v k v k N(, R) Model (A, C, G) known from the linearization, finite set of measurements: {y,..., y k } given. Only unknowns are noises w k and v k. y k = Cx k + v k y k+ = CAx k + CGw k + v k+ y k+2 = CA 2 x k +CAGw k +CGw k+ +v k+2 Rawlings Current opportunities 32 / 48

Mathematical Formulation of the ALS Linear State-Space Model: x k+ = Ax k + Gw k w k N(, Q) y k = Cx k + v k v k N(, R) Model (A, C, G) known from the linearization, finite set of measurements: {y,..., y k } given. Only unknowns are noises w k and v k. y k = Cx k + v k y k+ = CAx k + CGw k + v k+ E[y k y k ] = R y k+2 = CA 2 x k +CAGw k +CGw k+ +v k+2 Rawlings Current opportunities 32 / 48

Mathematical Formulation of the ALS Linear State-Space Model: x k+ = Ax k + Gw k w k N(, Q) y k = Cx k + v k v k N(, R) Model (A, C, G) known from the linearization, finite set of measurements: {y,..., y k } given. Only unknowns are noises w k and v k. y k = Cx k + v k y k+ = CAx k + CGw k + v k+ y k+2 = CA 2 x k +CAGw k +CGw k+ +v k+2 E[y k y k ] = R E[y k+2 y k+ ] = CAGQG C Rawlings Current opportunities 32 / 48

The Autocovariance Least-Squares (ALS) Problem Skipping a lot of algebra, we can write: Autocovariance Least Squares [ ] Φ = min Q,R A (Q)s N ˆb (R) s 2 A least-squares problem in a vector of unknowns, Q, R Rawlings Current opportunities 33 / 48

The Autocovariance Least-Squares (ALS) Problem Skipping a lot of algebra, we can write: Autocovariance Least Squares [ ] Φ = min Q,R A (Q)s N ˆb (R) s 2 A least-squares problem in a vector of unknowns, Q, R 2 Form A N from known system matrices Rawlings Current opportunities 33 / 48

The Autocovariance Least-Squares (ALS) Problem Skipping a lot of algebra, we can write: Autocovariance Least Squares [ ] Φ = min Q,R A (Q)s N ˆb (R) s 2 A least-squares problem in a vector of unknowns, Q, R 2 Form A N from known system matrices 3 ˆb is a vector containing the estimated correlations from data ˆb = y k y k T. k= y k+n y k s Rawlings Current opportunities 33 / 48

State estimation using (Q, R) from ALS Efficient software developed for ALS Rawlings Current opportunities 34 / 48

State estimation using (Q, R) from ALS Efficient software developed for ALS Data requirements for (Q, R) identification are reasonable Rawlings Current opportunities 34 / 48

State estimation using (Q, R) from ALS Efficient software developed for ALS Data requirements for (Q, R) identification are reasonable Industrial testing underway Rawlings Current opportunities 34 / 48

State estimation using (Q, R) from ALS Efficient software developed for ALS Data requirements for (Q, R) identification are reasonable Industrial testing underway Preliminary results from Eastman chemical cracking furnace and Aspentech evaluation are encouraging Rawlings Current opportunities 34 / 48

Distributed MPC publications B. J. Odelson, M. R. Rajamani, and J. B. Rawlings. A new autocovariance least-squares method for estimating noise covariances. Automatica, 42(2): 33 38, February 26. M. R. Rajamani and J. B. Rawlings. Estimation of the disturbance structure from data using semidefinite programming and optimal weighting. Automatica, 45: 42 48, 29. M. R. Rajamani, J. B. Rawlings, and S. J. Qin. Achieving state estimation equivalence for misassigned disturbances in offset-free model predictive control. AIChE J., 55(2):396 47, February 29. Rawlings Current opportunities 35 / 48

Optimizing economics: Current industrial practice Planning and Scheduling Steady State Optimization Validation Model Update Reconciliation Two layer structure Drawbacks Controller Plant Rawlings Current opportunities 36 / 48

Optimizing economics: Current industrial practice Planning and Scheduling Steady State Optimization Validation Controller Plant Model Update Reconciliation Two layer structure Drawbacks Inconsistent models Re-identify linear model as setpoint changes Time scale separation may not hold Economics unavailable in dynamic layer Rawlings Current opportunities 36 / 48

Optimizing economics: what s desirable? Profit -4-2 Input (u) 2 4-4 -2 2 4 State (x) Rawlings Current opportunities 37 / 48

Optimizing economics: what s desirable? Profit -4-2 Input (u) 2 4-4 -2 2 4 State (x) Rawlings Current opportunities 37 / 48

Economics MPC publications D. Angeli, R. Amrit, and J. B. Rawlings. Receding horizon cost optimization for overly constrained nonlinear plants. In Proceedings of the Conference on Decision and Control, Shanghai, China, December 29. J. B. Rawlings and R. Amrit. Optimizing process economic performance using model predictive control. In L. Magni, D. M. Raimondo, and F. Allgöwer, editors, Nonlinear Model Predictive Control, volume 384 of Lecture Notes in Control and Information Sciences, pages 9 38, Berlin, 29. Springer. L. Würth, J. B. Rawlings, and W. Marquardt. Economic dynamic real-time optimization and nonlinear model-predictive control on infinite horizons. In ADCHEM 29, International Symposium on Advanced Control of Chemical Processes, Istanbul, Turkey, July 2-5, 29. Rawlings Current opportunities 38 / 48

Continuous-time system and input parameterization We consider linear time-invariant continuous-time systems ẋ = Ax + Bu () V (x, u) = 2 ( x Qx + u Ru ) dt (2) u s u s s 2 u 2 2 Kx t t t 2 t 3 t N Rawlings Current opportunities 39 / 48

Relative error between CT and DT systems 2 P Π 2/ P 2 3 4 5 6 7 8 9.. ZOH FFOH PWLH Rawlings Current opportunities 4 / 48

Open-loop unstable system 7 u y 2-2 3 4 5 6 7 8 t CLQR Sat-LQR 2 3 4 5 6 7 8 t Decision Time 6 5 4 3 2.2.4.6.8 t/t N Rawlings Current opportunities 4 / 48

System with slow and fast modes u 4 y - 2 - -2-3 2 3 4 5 t CLQR Sat-LQR 2 3 4 5 t Decision Time 2.2.4.6.8 t/t N Rawlings Current opportunities 42 / 48

Computation time for infinite horizon CT solution FFOH-CLQR Algorithm µ V II (x ) V (x ) V (x ) N CPU-time (ms) 2 7.689 4 2.2 3.883 4 24.4 4 4.926 8 96 7.5 5 4.926 8 96 7.5 6 4.926 8 96 7.5 7 8.84 9 92 44. 8.468 9 384 444 Rawlings Current opportunities 43 / 48

Continuous time MPC publications G. Pannocchia, J. B. Rawlings, D. Q. Mayne, and W. Marquardt. On computing the solutions to the continuous time constrained linear quadratic regulator, July 29a. Accepted for publication in IEEE Trans. Auto. Cont. G. Pannocchia, J. B. Rawlings, D. Q. Mayne, and W. Marquardt. Computation of the infinite horizon continuous time constrained linear quadratic regulator. In ADCHEM 29, International Symposium on Advanced Control of Chemical Processes, Istanbul, Turkey, July 2-5, 29b. Rawlings Current opportunities 44 / 48

Conclusions Optimal dynamic operation of chemical processes has undergone a total transformation in the last 2 years. Rawlings Current opportunities 45 / 48

Conclusions Optimal dynamic operation of chemical processes has undergone a total transformation in the last 2 years. Both in theory and in practice. Rawlings Current opportunities 45 / 48

Conclusions Optimal dynamic operation of chemical processes has undergone a total transformation in the last 2 years. Both in theory and in practice. The currently available theory splits the problem into state estimation and regulation. Rawlings Current opportunities 45 / 48

Conclusions Optimal dynamic operation of chemical processes has undergone a total transformation in the last 2 years. Both in theory and in practice. The currently available theory splits the problem into state estimation and regulation. Both are posed and solved as online optimization problems. Rawlings Current opportunities 45 / 48

Conclusions Optimal dynamic operation of chemical processes has undergone a total transformation in the last 2 years. Both in theory and in practice. The currently available theory splits the problem into state estimation and regulation. Both are posed and solved as online optimization problems. Basic properties have been established. Rawlings Current opportunities 45 / 48

Conclusions Optimal dynamic operation of chemical processes has undergone a total transformation in the last 2 years. Both in theory and in practice. The currently available theory splits the problem into state estimation and regulation. Both are posed and solved as online optimization problems. Basic properties have been established. The economic impact of the technology is large. Rawlings Current opportunities 45 / 48

Future Outlook Distributed MPC. Rawlings Current opportunities 46 / 48

Future Outlook Distributed MPC. Basic properties of cooperative MPC have been established. Ready for industrial testing. Rawlings Current opportunities 46 / 48

Future Outlook Distributed MPC. Basic properties of cooperative MPC have been established. Ready for industrial testing. 2 Partial enumeration. Rawlings Current opportunities 46 / 48

Future Outlook Distributed MPC. Basic properties of cooperative MPC have been established. Ready for industrial testing. 2 Partial enumeration. Tested on large examples. Ready for industrial testing. Rawlings Current opportunities 46 / 48

Future Outlook Distributed MPC. Basic properties of cooperative MPC have been established. Ready for industrial testing. 2 Partial enumeration. Tested on large examples. Ready for industrial testing. 3 Controller commissioning. Rawlings Current opportunities 46 / 48

Future Outlook Distributed MPC. Basic properties of cooperative MPC have been established. Ready for industrial testing. 2 Partial enumeration. Tested on large examples. Ready for industrial testing. 3 Controller commissioning. ALS properties established and efficient prototype software developed. Has had some industrial testing. Rawlings Current opportunities 46 / 48

Future Outlook Distributed MPC. Basic properties of cooperative MPC have been established. Ready for industrial testing. 2 Partial enumeration. Tested on large examples. Ready for industrial testing. 3 Controller commissioning. ALS properties established and efficient prototype software developed. Has had some industrial testing. 4 Optimizing dynamic economic objective. Rawlings Current opportunities 46 / 48

Future Outlook Distributed MPC. Basic properties of cooperative MPC have been established. Ready for industrial testing. 2 Partial enumeration. Tested on large examples. Ready for industrial testing. 3 Controller commissioning. ALS properties established and efficient prototype software developed. Has had some industrial testing. 4 Optimizing dynamic economic objective. Early stages. Theory finished for linear models and convex cost functions. Extensions to nonlinear models and nonconvex cost functions under study. Rawlings Current opportunities 46 / 48

Future Outlook Distributed MPC. Basic properties of cooperative MPC have been established. Ready for industrial testing. 2 Partial enumeration. Tested on large examples. Ready for industrial testing. 3 Controller commissioning. ALS properties established and efficient prototype software developed. Has had some industrial testing. 4 Optimizing dynamic economic objective. Early stages. Theory finished for linear models and convex cost functions. Extensions to nonlinear models and nonconvex cost functions under study. 5 Continuous time MPC. Rawlings Current opportunities 46 / 48

Future Outlook Distributed MPC. Basic properties of cooperative MPC have been established. Ready for industrial testing. 2 Partial enumeration. Tested on large examples. Ready for industrial testing. 3 Controller commissioning. ALS properties established and efficient prototype software developed. Has had some industrial testing. 4 Optimizing dynamic economic objective. Early stages. Theory finished for linear models and convex cost functions. Extensions to nonlinear models and nonconvex cost functions under study. 5 Continuous time MPC. Algorithm developed and tested on examples. Theory for convergence and closed-loop stability under development now. Rawlings Current opportunities 46 / 48

Acknowledgments Don Bartusiak, ExxonMobil Tom Badgwell, Aspentech Jim Downs, Eastman Chemical Larry Megan, Praxair Rahul Bindlish, Dow Financial support from NSF #CTS-82536, 93835 and Texas Wisconsin California Control Consortium (TWCCC) members Rawlings Current opportunities 47 / 48

Further reading A. Bemporad, M. Morari, V. Dua, and E. N. Pistikopoulos. The explicit linear quadratic regulator for constrained systems. Automatica, 38():3 2, 22. R. E. Kalman. Contributions to the theory of optimal control. Bull. Soc. Math. Mex., 5:2 9, 96. J. Lunze. Feedback Control of Large Scale Systems. Prentice-Hall, London, U.K., 992. S. J. Qin and T. A. Badgwell. A survey of industrial model predictive control technology. Control Eng. Prac., (7):733 764, 23. N. R. Sandell Jr., P. Varaiya, M. Athans, and M. Safonov. Survey of decentralized control methods for larger scale systems. IEEE Trans. Auto. Cont., 23(2):8 28, 978. D. D. Šiljak. Decentralized Control of Complex Systems. Academic Press, London, 99. ISBN -2-64343-. D. M. Starks and E. Arrieta. Maintaining AC&O applications, sustaining the gain. In Proceedings of National AIChE Spring Meeting, Houston, Texas, April 27. Rawlings Current opportunities 48 / 48