A Homogeneous and Self-Dual Interior-Point Linear Programming Algorithm for Economic Model Predictive Control

Size: px
Start display at page:

Download "A Homogeneous and Self-Dual Interior-Point Linear Programming Algorithm for Economic Model Predictive Control"

Transcription

1 SUBMITTED FOR IEEE TRANSACTIONS ON AUTOMATIC CONTROL AUGUST A Homogeneous and Self-Dual Interior-Point Linear Programming Algorithm for Economic Model Predictive Control Leo Emil Sokoler Gianluca Frison Anders Skajaa Rasmus Halvgaard John Bagterp Jørgensen Abstract We develop an efficient homogeneous and self-dual interior-point method (IPM) for the linear programs arising in economic model predictive control (MPC) of constrained linear systems with linear objective functions. The algorithm is based on a Riccati iteration procedure which is adapted to the linear system of equations solved in homogeneous and self-dual IPMs. Fast convergence is further achieved by means of a recent warm-start strategy for homogeneous and self-dual IPMs. We implement the algorithm in MATLAB and C. Its performance is tested using a conceptual power management case study. Closed loop simulations show that 1) the proposed algorithm is significantly faster than several state-of-the-art IPMs based on sparse linear algebra and 2) warm-start reduces the average number of iterations by 35-4%. Index Terms Optimization algorithms Linear programming algorithms Predictive control for linear systems Riccati iterations Energy systems I. INTRODUCTION In economic MPC of linear systems with a linear objective function and linear constraints the constrained optimal control problem can be posed as a linear program (LP). As the optimization problem is solved online the performance and reliability of the optimization algorithm solving the LP is important. In this paper we develop a homogeneous and selfdual variant of Mehrotra s predictor-corrector method [1] [2] for economic MPC that combines the following performance improving components: Riccati Iteration Procedure: We speed-up the most time consuming numerical operations using a Riccati iteration procedure. Warm-Start: We implement a warm-start strategy for the homogeneous and self-dual IPMs. [3] reports that this method reduces the number of iterations by 3-75% based on the NETLIB collection of test problems. Riccati-based IPMs have been developed for set-point based MPC with an l 2 -penalty [4] [6] and with an l 1 -penalty [7]. A Riccati iteration procedure has not previously been combined with the homogeneous and self-dual model. The homogeneous and self-dual model has become widely adopted by state-ofthe-art IPMs for linear and conic programming. This paper is organized as follows. Section II formulates the control law associated with economic MPC as the solution to a highly The authors are with the Department of Applied Mathematics and Computer Science Technical University of Denmark DK-28 Kgs. Lyngby Denmark. L. E. Sokoler and A. Skajaa are also affiliated with DONG Energy DK-282 Gentofte Denmark ( {leso giaf andsk rhal jbjo}@dtu.dk) structured LP. Section III introduces the homogeneous and self-dual model. This section also provides a Riccati iteration procedure for solving the structured linear system that occurs in every iteration of an IPM for solving the LP. Section IV discusses warm-start. Section V compares a MATLAB and C implementation of the proposed algorithm denoted LPempc to several state-of-the-art IPMs using a simple power management case study 1. Concluding remarks are given in Section VI. II. OPTIMAL CONTROL PROBLEM We consider linear state space systems in the form x k+1 = Ax k + Bu k + Ed k d k N( R d ) (1a) y k = C y x k + e k e k N( R e ) (1b) z k = C z x k (1c) where x N(ˆx P ). (A B C y C z E) are the state space matrices x k R nx is the state vector u k R nu is the input vector y k R ny is the measurement vector z k R nz is the output vector d k is the process noise vector and e k is the measurement noise vector. We use bold letters to denote stochastic variables. In this paper the Economic MPC optimal control problem is defined to optimize the control actions of (1) with respect to a linear economic objective function input limits input-rate limits and soft output limits. Evaluation of this control law requires the solution to the LP min. uˆxẑρ s.t. j N p T k+ju k+j + q T k+j+1ρ k+j+1 (2a) ˆx k+j+1 k = Aˆx k+j k + Bu k+j j N (2b) ẑ k+j k = C z ˆx k+j k j N 1 (2c) u k+j u k+j u k+j j N (2d) u k+j u k+j u k+j 1 u k+j j N (2e) z k+j ρ k+j ẑ k+j k z k+j + ρ k+j j N 1 (2f) ρ k+j j N 1 (2g) where N i := { + i 1 + i... N 1 + i} with N being the length of the prediction and control horizon. The problem data are the state-space matrices (A B C z ) the filtered 1 Software and implementation details are available via dtu.dk/ jbjo/publications

2 SUBMITTED FOR IEEE TRANSACTIONS ON AUTOMATIC CONTROL AUGUST estimate ˆx k k the input limits (u k+j u k+j ) the inputrate limits ( u k+j u k+j ) the output limits (z k+j z k+j ) the input prices p k+j and the price for violating the output constraints q k+j. Note that for compact notation the optimization variables in (2) are written as u ˆx ẑ and ρ where u = [ u T k u T k+1 uk+n 1] T T and similarly for ˆx ẑ and ρ. The filtered estimate ˆx k k := E[x k Y k ] is the conditional expectation of x k given the observations Y k := [ ] y T y1 T y2 T... yk T T. We obtain this value using the Kalman filter. By augmenting the state-space system such that [ ] [ ] A ˆxk A := ˆx k := B := E := we can express (2e) as u k 1 [ ] B I [ E ] C z := [ C z ] C y := [ C y ] u k+j u k+j Dx k u k+j j N in which D := [ I ]. This formulation simplifies later computations considerably. To keep the notation simple we assume that k = and write ˆx j := ˆx +j for conditional expressions. The problem data is collected in the structures g F b H and c and (2) is put into the form min. ts {g T t F t = b Ht + s = c s }. (3) As an example consider the case for N = 2 t := [ ] u T ˆx T 1 ρ T 1 u T 1 ˆx T 2 ρ T T 2 g := [ ] p T q1 T p T 1 q2 T T and [ ] [ ] B I Aˆx F b := A B I I u I u 1 I u I u 1 I ũ D I u 1 [ ] H c := I ũ D I u 1 C z I z 1 C z I z 2 C z I z 1 C z I z 2 I I where ũ := u + Dˆx and ũ := u + Dˆx. The problem (2) can thus be posed as a highly structured LP with n := N(n u + n x + n z ) variables m E := Nn x equality constraints and m I := N(4n u + 3n z ) inequality constraints. Note that we have eliminated ẑ j from the optimization problem using the linear relation (2c). III. HOMOGENEOUS AND SELF-DUAL INTERIOR-POINT The dual of the LP (3) is METHOD max vw { bt v c T w F T v H T w = g w } (4) where v R m E and w R m I are dual variables corresponding to the Lagrange multipliers for the equality constraints and the inequality constraint of (3) respectively. We assume that F has full row rank. This is always the case for the problem (3). Homogeneous and self-dual IPMs solve (3) and (4) indirectly. The idea is to construct a related LP with properties that are useful for IPMs. Aside from an inherent ability to detect infeasibility recent advances show that IPMs based on the homogeneous and self-dual model can be warm-started efficiently [3]. We refer to [8] [1] for proofs and details. Introduce a new set of optimization variables ( t ṽ w s) and the additional scalar variables ( τ κ). Then the self-dual and homogeneous problem associated with (3) and (4) may be stated as the linear feasibility problem find t ṽ w s τ κ s.t. F T ṽ + H T w + g τ = b τ F t = c τ H t s = g T t b T ṽ c T w + κ = (5a) (5b) (5c) (5d) (5e) ( w s τ κ) (5f) Proposition 1 shows that the solution to (3) and (4) can be obtained by solving (5). Proposition 1: The linear feasibility problem (5) always has a strict complimentary solution ( t ṽ w s τ κ ) satisfying s j w j = for j = m I and τ κ =. For such a solution one of the following conditions hold 1) τ > κ = : The scaled solution (t v w s ) = ( t ṽ w s )/ τ is a primal-dual optimal solution to (3) and (4). 2) τ = κ > : The problem (3) is infeasible or unbounded; either b T ṽ c T w > (primal infeasible) or g T t < (dual infeasible). Proof: See [1] [11]. A. Riccati Iteration Procedure for Economic MPC Let k denote a particular iteration number. The necessary and sufficient optimality conditions for (5) are ( w s κ τ) and F T ṽ + H T w + g τ b τ F t c τ H t s g T t b T ṽ c T w + κ = W S1 (6) mi τ κ W is a diagonal matrix with the elements of w in its diagonal and similarly for S. Moreover 1 mi is the column vector of all ones of size m I. The main computational bottleneck in

3 SUBMITTED FOR IEEE TRANSACTIONS ON AUTOMATIC CONTROL AUGUST finding a point that satisfies the optimality conditions using a homogeneous and self-dual IPM is solving a linear system of equations (in each iteration of the IPM) [1] [2]. For an arbitrary right hand side we can solve this linear system of equations as F T ṽ + H T w + g τ = r 1 b τ F t = r 2 c τ H t s = r 3 g T t + b T ṽ + c T w κ = r 4 W s + S w = r 5 κ τ + τ κ = r 6. (7a) (7b) (7c) (7d) (7e) (7f) The system (7) is different from the system solved in standard IPMs. The Riccati iteration procedures proposed in [4] [6] can therefore not be applied directly to solve the system (7). Proposition 2 shows that a solution to (7) can be computed by solving a reduced linear system of equations (8) and a number of computationally inexpensive operations. Proposition 3 shows that the reduced system can be solved using a Riccati iteration procedure that scales as O(N(n u +n x +n z ) 3 ). The procedure eliminates variables from the reduced linear system (9) such that it can be expressed in a form (11) that often occurs in optimal control problems. Riccati iterations solve the resulting system efficiently by exploiting its structure [4] [6]. The complexity of solving the system (7) directly using sparse linear algebra routines is linear to quadratic in N while a general purpose solver using dense linear algebra scales cubically [12]. If the number of states n x is large compared to the number of inputs n u condensing methods are more efficient than Riccati-based solvers [5]. Note that it is convenient to have an algorithm that scales linearly in the prediction horizon N as stability of MPC schemes often may be achieved by selecting a sufficiently large value of N [13] [14]. Reference [15] provides details on a predictor-corrector IPM [1] [2] LPempc that utilizes a C implementation (with calls to BLAS and LAPACK) of the numerical procedure presented in Proposition 2 and Proposition 3. To speed-up the numerical computations and reduce the storage requirements LPempc handles operations involving the structured matrices F and H as specialized linear algebra routines. Proposition 2: The solution to (7) can be obtained by solving F T H T F H 1 W S and subsequent computation of f 1 h 1 f 2 h 2 = f 3 h 3 r 1 r 2 r 3 τ = r 6 τ(g T f 1 + b T f 2 + c T f 3 ) κ + τ(g T h 1 + b T h 2 + c T h 3 ) t = f 1 + h 1 τ ṽ = f 2 + h 2 τ w = f 3 + h 3 τ κ = g T t + b T ṽ + c T w r 4 s = W 1 (r C S w) g b (8) c where r 3 := r 3 + W 1 r 5 and r 6 := r 6 + τr 4. Proof: See [11]. Proposition 3: System (8) can be solved in O(N(n u +n x + n z ) 3 ) operations using a Riccati iteration procedure. Proof: For a single arbitrary right hand side we may write the system (8) as F T H T F t r D ṽ = r E. (9) 1 H W S w Denote the Lagrange multipliers associated with the inequality constraints (2d) and (2g) as η δ υ ω γ ζ and ξ where η := [ η T η T 1... η T N 1] T and similarly for δ υ γ ζ and ξ. The multipliers (η δ) are associated with the input limits (2d) (υ ω) are associated with the input-rate limits (2e) (γ ζ) are associated with the output limits (2f) and ξ is associated with the non-negative constraints (2g). The system variables are written in the form t = [ u T ˆx T 1 ρ T 1... u T N 1 ˆx T N ρt N ] T ṽ = [ ṽ T ṽ T 1... ṽ T N 1] T w = [ η T δ T υ T ω T γ T ζ T ξ T ] T. Accordingly we partition the right hand side such that r D = [ r T u r T x1 r T w1... r T un 1 r T xn rt wn ] T r E = [ Rv T Rv1 T... RvN 1] T T r I = [ ] rη T rδ T rυ T rω T rγ T rζ T rξ T T and write the diagonal matrix W 1 S in terms of diagonal submatrices W 1 ( S = diag Σ T η Σ T δ Σ T υ Σ T ω Σ T γ Σ T ζ Σ T ) ξ. The linear system of equations (9) can now be stated in the form η i δ i + υ i ω i + B T ṽ i = r ui i N r I u i + Σ ηi η i = r ηi i N u i + Σ δi δ i = r δi i N u i + D ˆx i + Σ υi υ i = r υi i Ñ u i D ˆx i + Σ ωi ω i = r ωi i Ñ ˆx i+1 A ˆx i B u i = R vi i Ñ ρ i C z ˆx i + Σ γi γ i = r γi i N 1 ρ i + C z ˆx i + Σ ζi ζ i = r ζi i N 1 ρ i + Σ ξi ξ i = r ξi i N 1 γ i ζ i ξ i = r wi i N 1 ṽ i + C T z ( γ i+1 ζ i+1 ) + A T ṽ i +D T (ω i υ i ) = r xi i Ñ with Ñ := N \ {} and the special cases u + Σ υ υ = r υ u + Σ ω ω = r ω ˆx 1 B u = R v ṽ N 1 + C T z ( γ N ζ N ) = r xn.

4 SUBMITTED FOR IEEE TRANSACTIONS ON AUTOMATIC CONTROL AUGUST The Lagrange multipliers associated with the inequality constrains η δ υ ω γ ζ and ξ are eliminated from the equations above. This is computationally inexpensive as the matrices to be inverted in the process are all diagonal. The reduced set of equations are B T ṽ + U u = R u (1a) B T ṽ i + U i u i + G i ˆx i = R ui i Ñ (1b) ˆx 1 + B u = R v (1c) ˆx i+1 + A ˆx i + B u i = R vi i Ñ (1d) W i ρ i + M T i ˆx i = R wi i N 1 (1e) ṽ i 1 + M i ρ i + X i ˆx i +G T i u i + A T ṽ i = R xi i Ñ (1f) ṽ N 1 + M N ρ N + X N ˆx N = R xn where we have defined (1g) U i := Σ 1 ηi + Σ 1 δi + Σ 1 ωi + Σ 1 υi i N G i := (Σ 1 )D i Ñ ωi + Σ 1 υi W i := Σ 1 ζi + Σ 1 ξi + Σ 1 γi i N 1 M i := C T z (Σ 1 ζi Σ 1 γi ) i N 1 X i := Cz T (Σ 1 ζi + Σ 1 υi )C z + D T (Σ 1 X N := Cz T (Σ 1 ζn + Σ 1 υn )C z and γi + Σ 1 ωi )D i Ñ R ui := r ui + r δi + r ωi r ηi r υi i N R vi := R vi i N R wi := r wi 1 + r ζi 1 + r ξi + r γi i N 1 R xi := r xi + Cz T ( r ζi r γi ) + D T ( r υi r ωi ) i Ñ R xn := r xn + C T z ( r ζn r γn ). Finally r δi := Σ 1 δi r δi. In a similar way we have defined r ωi r ηi r υi r ζi r ξi and r γi. Solving (1e) for ρ i and substituting into the remaining equations of (1) yields B T ṽ + U u = R u B T ṽ i + U i u i + G i ˆx i = R ui ˆx 1 + B u = R v ˆx i+1 + A ˆx i + B u i = R vi ṽ i 1 + X i ˆx i + G T i u i + A T ṽ i = R xi ṽ N 1 + X N ˆx N = R xn i Ñ i Ñ i Ñ where X i := X i M i W 1 i Mi T and R xi := R xi M i W 1 i R wi. As an example let N = 3. In this case the equations above may be arranged as U B T u R u B I ṽ R v I X 1 G T 1 A T ˆx 1 R x1 G 1 U 1 B T u 1 R u1 A B I ṽ 1 = R v1 (11) I X 2 G T 2 A T ˆx 2 R x2 G 2 U 2 B T u 2 R u2 A B I ṽ 2 R v2 I X 3 ˆx 3 R x3 This system can be solved by a Riccati iteration procedure in O(N(n u + n x + n z ) 3 ) operations [4] [6] [7]. IV. WARM-START We apply the warm-start strategy of [3] to pick an initial point for the homogeneous and self-dual IPM. The method combines a guess of the solution (candidate point) ( t v w s) with the standard starting point ( 1 mi 1 mi 1 1). An important feature of the homogeneous and self-dual model is that the the standard starting point is perfectly centralized with respect to the central path [3]. This makes warm-start work well for IPMs based on the homogeneous and self-dual model. The initial point in [3] is defined as w = λ w + (1 λ)1 mi s =λ s + (1 λ)1 mi t = λ t ṽ =λ v τ = 1 κ =( w ) T s /m I where λ [ 1] is a tuning parameter. When λ = the initial point becomes the standard starting point and for λ = 1 the initial point becomes the candidate point. In MPC applications the optimal control problem is solved in a receding horizon manner. A good choice of the candidate point at time k can therefore be constructed using the solution from the previous time step. As an example consider the solution of (3) and (4) at time step k = for N = 3 t := [ u T ˆx T 1 ρ T 1 u T 1 ˆx T 2 ρ T 2 u T 2 ˆx T 3 ρ T 3 ] T. The following candidate point is then used at time step k = 1 t := [ ] u T 1 ˆx T 2 ρ T 2 u T 2 ˆx T 3 ρ T 3 u T 2 ˆx T 3 ρ T T 3. Similarly we left-shift the slack variables s and the dual variables v and w to construct s v and w. V. POWER MANAGEMENT CASE STUDY In this section we compare LPempc against IPMs from the following software packages: Gurobi SeDuMi MOSEK LIPSOL GLPK. These state-of-the-art IPMs are mainly written in low-level language such as FORTRAN and C and rely on sparse linear algebra that are specifically tailored to the solution of large-scale sparse linear and conic programs. We also include the simplex method provided by CPLEX in our comparisons as well as FORCES that is an IPM based on automatic code generation [16]. All solvers are called from MATLAB using MEX interfaces. We have performed our simulations using an Intel(R) Core(TM) i5-252m 2.5GHz with 4 GB RAM running a 64-bit Ubuntu LTS operating system. The test system is a system of m generic power generating units in the form introduced in [17]. For i = m Y i (s) = 1 (τ i s + 1) 3 (U i(s) + D i (s)) + E i (s). (12) D i (s) is the process noise E i (s) is the measurement noise U i (s) is the power set-point and Y i (s) is the power production. The total production from the m power generating units is the sum Z(s) = m i=1 1 (τ is+1) 3 (U i (s) + D i (s)). We convert the

5 SUBMITTED FOR IEEE TRANSACTIONS ON AUTOMATIC CONTROL AUGUST production [MW] TABLE I CASE STUDY PARAMETERS τ i p k u k u k u k u k Power Plant Power Plant Plant 1 Plant 2 z: Total z min / z max #iterations #iterations λ σ #iterations 2 1 LPempc (cold started) LPempc (warm started) time [sec] Fig. 2. Number of iterations as a function of the tuning parameter λ and the noise parameter σ. Each box-plot has been generated based on an entire closed-loop simulation. In the top plot we have fixed σ = 1 and in the bottom plot λ =.99. Fig. 1. Closed-loop simulation of a power system controlled by economic MPC. Warm-start (λ =.99) yields a significant reduction in the number of iterations. transfer function model into the state space form (1) using a sampling time of T s = 5 seconds. In the resulting model structure u k R nu is the n u power set-points y k R ny is the measured power production and z k R nz is the total power production. Note that n u = n y = m and n z = 1. It is assumed that d k N( σi) and e k N( σi). A. Simulations An example with two power generating units is considered; a cheap/slow unit and an expensive/fast unit. This conflict between response time and operating costs represents a common situation in the power industry where large thermal power plants often produce a majority of the electricity while the use of units with faster dynamics such as diesel generators and gas turbines are limited to critical peak periods. The controller objective is to coordinate the most cost-efficient power production respecting capacity constraints and a timevarying electricity demand. It is assumed that full information about the initial state is given x ( ) and that the penalty of violating the output constraints is q k = 1 4 for all time steps. Table I lists the system and controller parameters. We set the prediction horizon to N = 8 time steps. It has been verified by simulation that the controller is stable for this value of N. Fig. 1 shows a closed-loop simulation with σ = 1. The figure illustrates the power production of each power generating unit. The cheap unit produces 97% of the energy while the expensive unit is activated only to compensate for the power imbalances otherwise caused by the slow unit. Fig. 1 also shows that warm-start yields a significant reduction in the number of iterations. On average the number of iterations is reduced by approximately 37%. cpu time [sec] LPempc Gurobi CPLEX MOSEK SeDuMi LIPSOL FORCES GLPK horizon length nr. of units (a) Increasing N and fixed m = 32. (b) Increasing m and fixed N = 32. Fig. 3. CPU-time for the different solvers as a function of the horizon N length and the number of power generators m. Fig. 2 shows a number of box-plots used to select the warmstart parameter λ. The case λ = corresponds to a cold-start. For all values of λ warm-start reduces the average number of iterations. We have chosen λ =.99 for our controller. This value of λ yields an initial point which is both close to the candidate point and lies well inside the interior of the non-negative orthant ( w s κ τ). Fig. 2 shows that for λ =.99 the number of iterations is reduced even when the variance of the process and measurement noise is increased significantly. Fig. 3 plots the computation time for solving the LP (2) as a function of the number of power generating units m and the length of the horizon N. The figure shows that LPmpc is faster than all other solvers with a significant margin. In addition to the algorithms included in Fig. 3 the problem (2) was solved using the code generation based IPM CVXGEN [18]. For problems larger than m = 4 and N = 12 code generation in CVXGEN fails due to the problem size. Therefore we have not included results for CVXGEN in our benchmark. In general code generation based solvers such as CVXGEN and cpu time [sec]

6 SUBMITTED FOR IEEE TRANSACTIONS ON AUTOMATIC CONTROL AUGUST cpu time [sec] LPempc (c) LPempc (w) Gurobi MOSEK SeDuMi CPLEX time [sec] Fig. 4. CPU-time for solving (2) with 15 power generating units and a prediction horizon of 2 time steps. We observe that warm-starting reduces the average number of iterations by approximately 4%. FORCES are most competitive for small-dimensional problems [16]. Fig. 4 shows CPU-timings for a closed-loop simulation with 15 power generating units and a prediction horizon of N = 2 time steps. Only the most competitive solvers are included. In this simulation LPempc is up to an order of magnitude faster than CPLEX Gurobi SeDuMi and MOSEK depending on the problem data. On average LPempc is approximately 5 times faster than Gurobi 6 times faster than MOSEK 19 times faster than SeDuMi and 22 times faster than CPLEX. VI. CONCLUSIONS In this paper we have developed a computationally efficient IPM for economic MPC of linear systems with a linear objective function and linear constraints. The algorithm combines the homogeneous and self-dual model and a Riccati iteration procedure specifically tailored to MPC. This is a significant contribution since existing Riccati iteration procedures for MPC are not directly applicable to the homogeneous and selfdual model that has become widely adopted by state-of-theart IPMs for linear programming. We have also implemented and tested a recent warm-start strategy for homogeneous and self-dual IPMs that has not previously been used in MPC applications. Our simulations show that this strategy reduces the average number of iterations by 35-4% and that a MATLAB and C implementation of the proposed algorithm LPempc is significantly faster than several state-of-the-art IPMs as well as automatic code generation based IPMs for MPC. In a conceptual power management case study LPempc is up to an order of magnitude faster than CPLEX Gurobi SeDuMi and MOSEK. This is important since the computing time of solving the optimal control problem is critical in MPC applications. The simulation results also show that the difference in computing time becomes larger with the problem size as LPempc scales in a favorable way. ACKNOWLEDGEMENT This work was funded in part by 1) the Danish Ministry of Higher Education and Science in the industrial PhD project Stochastic MPC with Applications in Smart Energy Systems ( ); 2) the Southern Denmark Growth Forum and the European Regional Development Fund in the project Smart & Cool ; and 3) The Danish Council for Strategic Research in the project CITIES - Centre for IT-Intelligent Energy Systems in Cities (135-27B). REFERENCES [1] S. Mehrotra On the Implementation of a Primal-Dual Interior Point Method SIAM Journal on Optimization vol. 2 no. 4 pp [2] J. Nocedal and S. Wright Numerical Optimization ser. Springer Series in Operations Research and Financial Engineering. Springer 26. [3] A. Skajaa E. D. Andersen and Y. Ye Warmstarting the homogeneous and self-dual interior point method for linear and conic quadratic problems Mathematical Programming Computation vol. 5 no. 1 pp [4] C. V. Rao S. J. Wright and J. B. Rawlings Application of Interior- Point Methods to Model Predictive Control Journal of Optimization Theory and Applications vol. 99 no. 3 pp [5] J. B. Jørgensen G. Frison N. F. Gade-Nielsen and B. Dammann Numerical Methods for Solution of the Extended Linear Quadratic Control Problem in 4th IFAC Nonlinear Model Predictive Control Conference 212 pp [6] J. B. Jørgensen J. B. Rawlings and S. B. Jørgensen Numerical Methods for Large-Scale Moving Horizon Estimation and Control in International Symposium on Dynamics and Control Process Systems (DYCOPS) vol [7] L. Vandenberghe S. Boyd and M. Nouralishahi Robust linear programming and optimal control in Proceedings of the 15th IFAC World Congress vol pp [8] E. D. Andersen J. Gondzio C. Meszaros and X. Xu Implementation of Interior Point Methods for Large Scale Linear Programming Ecole des Hautes Etudes Commerciales Universite de Geneve Papers [9] X. Xu P.-F. Hung and Y. Ye A simplified homogeneous and selfdual linear programming algorithm and its implementation Annals of Operations Research vol. 62 no. 1 pp [1] Y. Ye M. J. Todd and S. Mizuno An O( nl)-iteration Homogeneous and Self-Dual Linear Programming Algorithm Mathematics of Operations Research vol. 19 no. 1 pp [11] E. D. Andersen C. Roos and T. Terlaky On implementing a primaldual interior-point method for conic quadratic optimization Mathematical Programming vol. 95 no. 2 pp [12] V. M. Zavala and L. T. Biegler Nonlinear Model Predictive Control in Control Nonlinear Programming Strategies for State Estimation and Model Predictive ser. Lecture Notes in Control and Information Sciences L. Magni D. M. Raimondo and F. Allgöwer Eds. Springer Berlin Heidelberg 29 vol. 384 pp [13] M. Diehl R. Amrit and J. B. Rawlings A Lyapunov Function for Economic Optimizing Model Predictive Control IEEE Transactions on Automatic Control vol. 56 no. 3 pp [14] L. Grüne Economic receding horizon control without terminal constraints Automatica vol. 49 no. 3 pp [15] L. E. Sokoler G. Frison A. Skajaa R. Halvgaard and J. B. Jørgensen A Homogeneous and Self-Dual Interior-Point Linear Programming Algorithm for Economic Model Predictive Control Department of Applied Mathematics and Computer Science Technical University of Denmark Tech. Rep [Online]. Available: jbjo/dtu MPC html [16] A. Domahidi A. Zgraggen M. N. Zeilinger M. Morari and C. N. Jones Efficient Interior Point Methods for Multistage Problems Arising in Receding Horizon Control in 51st IEEE Conference on Decision and Control (CDC) 212 pp [17] K. Edlund T. Mølbak and J. D. Bendtsen Simple models for modelbased portfolio load balancing controller synthesis in 6th IFAC Symposium on Power Plants and Power Systems Control 29 pp [18] J. Mattingley and S. Boyd CVXGEN: a code generator for embedded convex optimization Optimization and Engineering vol. 13 no. 1 pp

A Homogeneous and Self-Dual Interior-Point Linear Programming Algorithm for Economic Model Predictive Control

A Homogeneous and Self-Dual Interior-Point Linear Programming Algorithm for Economic Model Predictive Control SUBMITTED FOR IEEE TRANSACTIONS ON AUTOMATIC CONTROL SEPTEMBER 24 213 1 A Homogeneous and Self-Dual Interior-Point Linear Programming Algorithm for Economic Model Predictive Control Leo Emil Sooler Gianluca

More information

Real-Time Optimization for Economic Model Predictive Control

Real-Time Optimization for Economic Model Predictive Control Downloaded from orbit.dtu.dk on: Sep 1 218 Real-Time Optimization for Economic Model Predictive Control Sokoler Leo Emil; Edlund Kristian; Frison Gianluca; Skajaa Anders; Jørgensen John Bagterp Published

More information

A Dantzig-Wolfe Decomposition Algorithm for Economic MPC of Distributed Energy Systems

A Dantzig-Wolfe Decomposition Algorithm for Economic MPC of Distributed Energy Systems A Dantzig-Wolfe Decomposition Algorithm for Economic MPC of Distributed Energy Systems Leo Emil Sokoler, Laura Standardi Kristian Edlund John Bagterp Jørgensen DONG Energy, DK-2820 Gentofte, Denmark (kried@dongenergydk)

More information

HPMPC - A new software package with efficient solvers for Model Predictive Control

HPMPC - A new software package with efficient solvers for Model Predictive Control - A new software package with efficient solvers for Model Predictive Control Technical University of Denmark CITIES Second General Consortium Meeting, DTU, Lyngby Campus, 26-27 May 2015 Introduction Model

More information

Distributed and Real-time Predictive Control

Distributed and Real-time Predictive Control Distributed and Real-time Predictive Control Melanie Zeilinger Christian Conte (ETH) Alexander Domahidi (ETH) Ye Pu (EPFL) Colin Jones (EPFL) Challenges in modern control systems Power system: - Frequency

More information

Economic MPC for large and distributed energy systems

Economic MPC for large and distributed energy systems Economic MPC for large and distributed energy systems WP4 Laura Standardi, Niels Kjølstad Poulsen, John Bagterp Jørgensen August 15, 2014 1 / 34 Outline Introduction and motivation Problem definition Economic

More information

FINITE HORIZON ROBUST MODEL PREDICTIVE CONTROL USING LINEAR MATRIX INEQUALITIES. Danlei Chu, Tongwen Chen, Horacio J. Marquez

FINITE HORIZON ROBUST MODEL PREDICTIVE CONTROL USING LINEAR MATRIX INEQUALITIES. Danlei Chu, Tongwen Chen, Horacio J. Marquez FINITE HORIZON ROBUST MODEL PREDICTIVE CONTROL USING LINEAR MATRIX INEQUALITIES Danlei Chu Tongwen Chen Horacio J Marquez Department of Electrical and Computer Engineering University of Alberta Edmonton

More information

Course on Model Predictive Control Part II Linear MPC design

Course on Model Predictive Control Part II Linear MPC design Course on Model Predictive Control Part II Linear MPC design Gabriele Pannocchia Department of Chemical Engineering, University of Pisa, Italy Email: g.pannocchia@diccism.unipi.it Facoltà di Ingegneria,

More information

Theory in Model Predictive Control :" Constraint Satisfaction and Stability!

Theory in Model Predictive Control : Constraint Satisfaction and Stability! Theory in Model Predictive Control :" Constraint Satisfaction and Stability Colin Jones, Melanie Zeilinger Automatic Control Laboratory, EPFL Example: Cessna Citation Aircraft Linearized continuous-time

More information

Practical Implementations of Advanced Process Control for Linear Systems

Practical Implementations of Advanced Process Control for Linear Systems Downloaded from orbitdtudk on: Jul 01, 2018 Practical Implementations of Advanced Process Control for Linear Systems Knudsen, Jørgen K H ; Huusom, Jakob Kjøbsted; Jørgensen, John Bagterp Published in:

More information

On the Inherent Robustness of Suboptimal Model Predictive Control

On the Inherent Robustness of Suboptimal Model Predictive Control On the Inherent Robustness of Suboptimal Model Predictive Control James B. Rawlings, Gabriele Pannocchia, Stephen J. Wright, and Cuyler N. Bates Department of Chemical & Biological Engineering Computer

More information

FPGA Implementation of a Predictive Controller

FPGA Implementation of a Predictive Controller FPGA Implementation of a Predictive Controller SIAM Conference on Optimization 2011, Darmstadt, Germany Minisymposium on embedded optimization Juan L. Jerez, George A. Constantinides and Eric C. Kerrigan

More information

Fast Model Predictive Control with Soft Constraints

Fast Model Predictive Control with Soft Constraints European Control Conference (ECC) July 7-9,, Zürich, Switzerland. Fast Model Predictive Control with Soft Constraints Arthur Richards Department of Aerospace Engineering, University of Bristol Queens Building,

More information

On Generalized Primal-Dual Interior-Point Methods with Non-uniform Complementarity Perturbations for Quadratic Programming

On Generalized Primal-Dual Interior-Point Methods with Non-uniform Complementarity Perturbations for Quadratic Programming On Generalized Primal-Dual Interior-Point Methods with Non-uniform Complementarity Perturbations for Quadratic Programming Altuğ Bitlislioğlu and Colin N. Jones Abstract This technical note discusses convergence

More information

On the Inherent Robustness of Suboptimal Model Predictive Control

On the Inherent Robustness of Suboptimal Model Predictive Control On the Inherent Robustness of Suboptimal Model Predictive Control James B. Rawlings, Gabriele Pannocchia, Stephen J. Wright, and Cuyler N. Bates Department of Chemical and Biological Engineering and Computer

More information

Distributed Model Predictive Control for Smart Energy Systems

Distributed Model Predictive Control for Smart Energy Systems JOURNAL OF L A TEX CLASS FILES, VOL. 11, NO. 4, DECEMBER 214 1 Distributed Model Predictive Control for Smart Energy Systems Rasmus Halvgaard, Lieven Vandenberghe, Niels K. Poulsen, Henrik Madsen, and

More information

Fast Algorithms for SDPs derived from the Kalman-Yakubovich-Popov Lemma

Fast Algorithms for SDPs derived from the Kalman-Yakubovich-Popov Lemma Fast Algorithms for SDPs derived from the Kalman-Yakubovich-Popov Lemma Venkataramanan (Ragu) Balakrishnan School of ECE, Purdue University 8 September 2003 European Union RTN Summer School on Multi-Agent

More information

SVM May 2007 DOE-PI Dianne P. O Leary c 2007

SVM May 2007 DOE-PI Dianne P. O Leary c 2007 SVM May 2007 DOE-PI Dianne P. O Leary c 2007 1 Speeding the Training of Support Vector Machines and Solution of Quadratic Programs Dianne P. O Leary Computer Science Dept. and Institute for Advanced Computer

More information

Efficient Convex Optimization for Linear MPC

Efficient Convex Optimization for Linear MPC Efficient Convex Optimization for Linear MPC Stephen J Wright Abstract MPC formulations with linear dynamics and quadratic objectives can be solved efficiently by using a primal-dual interior-point framework,

More information

Sparse quadratic regulator

Sparse quadratic regulator 213 European Control Conference ECC) July 17-19, 213, Zürich, Switzerland. Sparse quadratic regulator Mihailo R. Jovanović and Fu Lin Abstract We consider a control design problem aimed at balancing quadratic

More information

Stochastic Tube MPC with State Estimation

Stochastic Tube MPC with State Estimation Proceedings of the 19th International Symposium on Mathematical Theory of Networks and Systems MTNS 2010 5 9 July, 2010 Budapest, Hungary Stochastic Tube MPC with State Estimation Mark Cannon, Qifeng Cheng,

More information

On implementing a primal-dual interior-point method for conic quadratic optimization

On implementing a primal-dual interior-point method for conic quadratic optimization On implementing a primal-dual interior-point method for conic quadratic optimization E. D. Andersen, C. Roos, and T. Terlaky December 18, 2000 Abstract Conic quadratic optimization is the problem of minimizing

More information

Optimizing Economic Performance using Model Predictive Control

Optimizing Economic Performance using Model Predictive Control Optimizing Economic Performance using Model Predictive Control James B. Rawlings Department of Chemical and Biological Engineering Second Workshop on Computational Issues in Nonlinear Control Monterey,

More information

IMPROVED MPC DESIGN BASED ON SATURATING CONTROL LAWS

IMPROVED MPC DESIGN BASED ON SATURATING CONTROL LAWS IMPROVED MPC DESIGN BASED ON SATURATING CONTROL LAWS D. Limon, J.M. Gomes da Silva Jr., T. Alamo and E.F. Camacho Dpto. de Ingenieria de Sistemas y Automática. Universidad de Sevilla Camino de los Descubrimientos

More information

Postface to Model Predictive Control: Theory and Design

Postface to Model Predictive Control: Theory and Design Postface to Model Predictive Control: Theory and Design J. B. Rawlings and D. Q. Mayne August 19, 2012 The goal of this postface is to point out and comment upon recent MPC papers and issues pertaining

More information

Constrained State Estimation Using the Unscented Kalman Filter

Constrained State Estimation Using the Unscented Kalman Filter 16th Mediterranean Conference on Control and Automation Congress Centre, Ajaccio, France June 25-27, 28 Constrained State Estimation Using the Unscented Kalman Filter Rambabu Kandepu, Lars Imsland and

More information

Controlling the level of sparsity in MPC

Controlling the level of sparsity in MPC Controlling the level of sparsity in MPC Daniel Axehill Linköping University Post Print N.B.: When citing this work, cite the original article. Original Publication: Daniel Axehill. Controlling the level

More information

MPC Infeasibility Handling

MPC Infeasibility Handling MPC Handling Thomas Wiese, TU Munich, KU Leuven supervised by H.J. Ferreau, Prof. M. Diehl (both KUL) and Dr. H. Gräb (TUM) October 9, 2008 1 / 42 MPC General MPC Strategies 2 / 42 Linear Discrete-Time

More information

Real Time Economic Dispatch for Power Networks: A Distributed Economic Model Predictive Control Approach

Real Time Economic Dispatch for Power Networks: A Distributed Economic Model Predictive Control Approach Real Time Economic Dispatch for Power Networks: A Distributed Economic Model Predictive Control Approach Johannes Köhler, Matthias A. Müller, Na Li, Frank Allgöwer Abstract Fast power fluctuations pose

More information

Linear Programming: Simplex

Linear Programming: Simplex Linear Programming: Simplex Stephen J. Wright 1 2 Computer Sciences Department, University of Wisconsin-Madison. IMA, August 2016 Stephen Wright (UW-Madison) Linear Programming: Simplex IMA, August 2016

More information

Block Structured Preconditioning within an Active-Set Method for Real-Time Optimal Control

Block Structured Preconditioning within an Active-Set Method for Real-Time Optimal Control MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Block Structured Preconditioning within an Active-Set Method for Real-Time Optimal Control Quirynen, R.; Knyazev, A.; Di Cairano, S. TR2018-081

More information

On robustness of suboptimal min-max model predictive control *

On robustness of suboptimal min-max model predictive control * Manuscript received June 5, 007; revised Sep., 007 On robustness of suboptimal min-max model predictive control * DE-FENG HE, HAI-BO JI, TAO ZHENG Department of Automation University of Science and Technology

More information

Sparse Optimization Lecture: Basic Sparse Optimization Models

Sparse Optimization Lecture: Basic Sparse Optimization Models Sparse Optimization Lecture: Basic Sparse Optimization Models Instructor: Wotao Yin July 2013 online discussions on piazza.com Those who complete this lecture will know basic l 1, l 2,1, and nuclear-norm

More information

Algorithms and Methods for Fast Model Predictive Control

Algorithms and Methods for Fast Model Predictive Control Algorithms and Methods for Fast Model Predictive Control Technical University of Denmark Department of Applied Mathematics and Computer Science 13 April 2016 Background: Model Predictive Control Model

More information

MS&E 318 (CME 338) Large-Scale Numerical Optimization

MS&E 318 (CME 338) Large-Scale Numerical Optimization Stanford University, Management Science & Engineering (and ICME) MS&E 318 (CME 338) Large-Scale Numerical Optimization 1 Origins Instructor: Michael Saunders Spring 2015 Notes 9: Augmented Lagrangian Methods

More information

Distributed Model Predictive Control for Smart Energy Systems

Distributed Model Predictive Control for Smart Energy Systems IEEE TRANSACTIONS ON SMART GRID, VOL. 7, NO. 3, MAY 2016 1675 Distributed Model Predictive Control for Smart Energy Systems Rasmus Halvgaard, Lieven Vandenberghe, Niels Kølstad Poulsen, Henrik Madsen,

More information

Thermal Storage Power Balancing with Model Predictive Control

Thermal Storage Power Balancing with Model Predictive Control 213 European Control Conference (ECC) July 17-19, 213, Zürich, Switzerland. Thermal Storage Power Balancing with Model Predictive Control Rasmus Halvgaard, Niels K. Poulsen, Henrik Madsen and John B. Jørgensen

More information

Applications. Stephen J. Stoyan, Maged M. Dessouky*, and Xiaoqing Wang

Applications. Stephen J. Stoyan, Maged M. Dessouky*, and Xiaoqing Wang Introduction to Large-Scale Linear Programming and Applications Stephen J. Stoyan, Maged M. Dessouky*, and Xiaoqing Wang Daniel J. Epstein Department of Industrial and Systems Engineering, University of

More information

A FULL-NEWTON STEP INFEASIBLE-INTERIOR-POINT ALGORITHM COMPLEMENTARITY PROBLEMS

A FULL-NEWTON STEP INFEASIBLE-INTERIOR-POINT ALGORITHM COMPLEMENTARITY PROBLEMS Yugoslav Journal of Operations Research 25 (205), Number, 57 72 DOI: 0.2298/YJOR3055034A A FULL-NEWTON STEP INFEASIBLE-INTERIOR-POINT ALGORITHM FOR P (κ)-horizontal LINEAR COMPLEMENTARITY PROBLEMS Soodabeh

More information

An Infeasible Interior-Point Algorithm with full-newton Step for Linear Optimization

An Infeasible Interior-Point Algorithm with full-newton Step for Linear Optimization An Infeasible Interior-Point Algorithm with full-newton Step for Linear Optimization H. Mansouri M. Zangiabadi Y. Bai C. Roos Department of Mathematical Science, Shahrekord University, P.O. Box 115, Shahrekord,

More information

From Convex Optimization to Linear Matrix Inequalities

From Convex Optimization to Linear Matrix Inequalities Dep. of Information Engineering University of Pisa (Italy) From Convex Optimization to Linear Matrix Inequalities eng. Sergio Grammatico grammatico.sergio@gmail.com Class of Identification of Uncertain

More information

A Generalized Homogeneous and Self-Dual Algorithm. for Linear Programming. February 1994 (revised December 1994)

A Generalized Homogeneous and Self-Dual Algorithm. for Linear Programming. February 1994 (revised December 1994) A Generalized Homogeneous and Self-Dual Algorithm for Linear Programming Xiaojie Xu Yinyu Ye y February 994 (revised December 994) Abstract: A generalized homogeneous and self-dual (HSD) infeasible-interior-point

More information

Adaptive Nonlinear Model Predictive Control with Suboptimality and Stability Guarantees

Adaptive Nonlinear Model Predictive Control with Suboptimality and Stability Guarantees Adaptive Nonlinear Model Predictive Control with Suboptimality and Stability Guarantees Pontus Giselsson Department of Automatic Control LTH Lund University Box 118, SE-221 00 Lund, Sweden pontusg@control.lth.se

More information

Nonlinear Model Predictive Control Tools (NMPC Tools)

Nonlinear Model Predictive Control Tools (NMPC Tools) Nonlinear Model Predictive Control Tools (NMPC Tools) Rishi Amrit, James B. Rawlings April 5, 2008 1 Formulation We consider a control system composed of three parts([2]). Estimator Target calculator Regulator

More information

POLYNOMIAL OPTIMIZATION WITH SUMS-OF-SQUARES INTERPOLANTS

POLYNOMIAL OPTIMIZATION WITH SUMS-OF-SQUARES INTERPOLANTS POLYNOMIAL OPTIMIZATION WITH SUMS-OF-SQUARES INTERPOLANTS Sercan Yıldız syildiz@samsi.info in collaboration with Dávid Papp (NCSU) OPT Transition Workshop May 02, 2017 OUTLINE Polynomial optimization and

More information

Optimality, Duality, Complementarity for Constrained Optimization

Optimality, Duality, Complementarity for Constrained Optimization Optimality, Duality, Complementarity for Constrained Optimization Stephen Wright University of Wisconsin-Madison May 2014 Wright (UW-Madison) Optimality, Duality, Complementarity May 2014 1 / 41 Linear

More information

Implementation of Warm-Start Strategies in Interior-Point Methods for Linear Programming in Fixed Dimension

Implementation of Warm-Start Strategies in Interior-Point Methods for Linear Programming in Fixed Dimension Implementation of Warm-Start Strategies in Interior-Point Methods for Linear Programming in Fixed Dimension Elizabeth John E. Alper Yıldırım May 11, 2006 Abstract We implement several warm-start strategies

More information

Accelerating interior point methods with GPUs for smart grid systems

Accelerating interior point methods with GPUs for smart grid systems Downloaded from orbit.dtu.dk on: Dec 18, 2017 Accelerating interior point methods with GPUs for smart grid systems Gade-Nielsen, Nicolai Fog Publication date: 2011 Document Version Publisher's PDF, also

More information

A Globally Stabilizing Receding Horizon Controller for Neutrally Stable Linear Systems with Input Constraints 1

A Globally Stabilizing Receding Horizon Controller for Neutrally Stable Linear Systems with Input Constraints 1 A Globally Stabilizing Receding Horizon Controller for Neutrally Stable Linear Systems with Input Constraints 1 Ali Jadbabaie, Claudio De Persis, and Tae-Woong Yoon 2 Department of Electrical Engineering

More information

Constraint Qualification Failure in Action

Constraint Qualification Failure in Action Constraint Qualification Failure in Action Hassan Hijazi a,, Leo Liberti b a The Australian National University, Data61-CSIRO, Canberra ACT 2601, Australia b CNRS, LIX, Ecole Polytechnique, 91128, Palaiseau,

More information

Convex Optimization Overview (cnt d)

Convex Optimization Overview (cnt d) Conve Optimization Overview (cnt d) Chuong B. Do November 29, 2009 During last week s section, we began our study of conve optimization, the study of mathematical optimization problems of the form, minimize

More information

Warmstarting the Homogeneous and Self-Dual Interior Point Method for Linear and Conic Quadratic Problems

Warmstarting the Homogeneous and Self-Dual Interior Point Method for Linear and Conic Quadratic Problems Mathematical Programming Computation manuscript No. (will be inserted by the editor) Warmstarting the Homogeneous and Self-Dual Interior Point Method for Linear and Conic Quadratic Problems Anders Skajaa

More information

Algorithms for Constrained Optimization

Algorithms for Constrained Optimization 1 / 42 Algorithms for Constrained Optimization ME598/494 Lecture Max Yi Ren Department of Mechanical Engineering, Arizona State University April 19, 2015 2 / 42 Outline 1. Convergence 2. Sequential quadratic

More information

Computational Finance

Computational Finance Department of Mathematics at University of California, San Diego Computational Finance Optimization Techniques [Lecture 2] Michael Holst January 9, 2017 Contents 1 Optimization Techniques 3 1.1 Examples

More information

Linear programs, convex polyhedra, extreme points

Linear programs, convex polyhedra, extreme points MVE165/MMG631 Extreme points of convex polyhedra; reformulations; basic feasible solutions; the simplex method Ann-Brith Strömberg 2015 03 27 Linear programs, convex polyhedra, extreme points A linear

More information

Nonlinear Model Predictive Control for Periodic Systems using LMIs

Nonlinear Model Predictive Control for Periodic Systems using LMIs Marcus Reble Christoph Böhm Fran Allgöwer Nonlinear Model Predictive Control for Periodic Systems using LMIs Stuttgart, June 29 Institute for Systems Theory and Automatic Control (IST), University of Stuttgart,

More information

A Polynomial Column-wise Rescaling von Neumann Algorithm

A Polynomial Column-wise Rescaling von Neumann Algorithm A Polynomial Column-wise Rescaling von Neumann Algorithm Dan Li Department of Industrial and Systems Engineering, Lehigh University, USA Cornelis Roos Department of Information Systems and Algorithms,

More information

An Inexact Sequential Quadratic Optimization Method for Nonlinear Optimization

An Inexact Sequential Quadratic Optimization Method for Nonlinear Optimization An Inexact Sequential Quadratic Optimization Method for Nonlinear Optimization Frank E. Curtis, Lehigh University involving joint work with Travis Johnson, Northwestern University Daniel P. Robinson, Johns

More information

Perfect and Imperfect Competition in Electricity Markets

Perfect and Imperfect Competition in Electricity Markets Perfect and Imperfect Competition in Electricity Marets DTU CEE Summer School 2018 June 25-29, 2018 Contact: Vladimir Dvorin (vladvo@eletro.dtu.d) Jalal Kazempour (seyaz@eletro.dtu.d) Deadline: August

More information

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs

Introduction to Mathematical Programming IE406. Lecture 10. Dr. Ted Ralphs Introduction to Mathematical Programming IE406 Lecture 10 Dr. Ted Ralphs IE406 Lecture 10 1 Reading for This Lecture Bertsimas 4.1-4.3 IE406 Lecture 10 2 Duality Theory: Motivation Consider the following

More information

High-Performance Small-Scale Solvers for Moving Horizon Estimation

High-Performance Small-Scale Solvers for Moving Horizon Estimation Downloaded from orbit.dtu.dk on: Oct 14, 218 High-Performance Small-Scale Solvers for Moving Horizon Estimation Frison, Gianluca; Vukov, Milan ; Poulsen, Niels Kjølstad; Diehl, Moritz ; Jørgensen, John

More information

Chap6 Duality Theory and Sensitivity Analysis

Chap6 Duality Theory and Sensitivity Analysis Chap6 Duality Theory and Sensitivity Analysis The rationale of duality theory Max 4x 1 + x 2 + 5x 3 + 3x 4 S.T. x 1 x 2 x 3 + 3x 4 1 5x 1 + x 2 + 3x 3 + 8x 4 55 x 1 + 2x 2 + 3x 3 5x 4 3 x 1 ~x 4 0 If we

More information

Interior-Point and Augmented Lagrangian Algorithms for Optimization and Control

Interior-Point and Augmented Lagrangian Algorithms for Optimization and Control Interior-Point and Augmented Lagrangian Algorithms for Optimization and Control Stephen Wright University of Wisconsin-Madison May 2014 Wright (UW-Madison) Constrained Optimization May 2014 1 / 46 In This

More information

Inexact Newton Methods and Nonlinear Constrained Optimization

Inexact Newton Methods and Nonlinear Constrained Optimization Inexact Newton Methods and Nonlinear Constrained Optimization Frank E. Curtis EPSRC Symposium Capstone Conference Warwick Mathematics Institute July 2, 2009 Outline PDE-Constrained Optimization Newton

More information

Fast ADMM for Sum of Squares Programs Using Partial Orthogonality

Fast ADMM for Sum of Squares Programs Using Partial Orthogonality Fast ADMM for Sum of Squares Programs Using Partial Orthogonality Antonis Papachristodoulou Department of Engineering Science University of Oxford www.eng.ox.ac.uk/control/sysos antonis@eng.ox.ac.uk with

More information

arxiv: v1 [cs.sy] 2 Oct 2018

arxiv: v1 [cs.sy] 2 Oct 2018 Non-linear Model Predictive Control of Conically Shaped Liquid Storage Tanks arxiv:1810.01119v1 [cs.sy] 2 Oct 2018 5 10 Abstract Martin Klaučo, L uboš Čirka Slovak University of Technology in Bratislava,

More information

Numerical Methods for Model Predictive Control. Jing Yang

Numerical Methods for Model Predictive Control. Jing Yang Numerical Methods for Model Predictive Control Jing Yang Kongens Lyngby February 26, 2008 Technical University of Denmark Informatics and Mathematical Modelling Building 321, DK-2800 Kongens Lyngby, Denmark

More information

15-780: LinearProgramming

15-780: LinearProgramming 15-780: LinearProgramming J. Zico Kolter February 1-3, 2016 1 Outline Introduction Some linear algebra review Linear programming Simplex algorithm Duality and dual simplex 2 Outline Introduction Some linear

More information

Agenda. Interior Point Methods. 1 Barrier functions. 2 Analytic center. 3 Central path. 4 Barrier method. 5 Primal-dual path following algorithms

Agenda. Interior Point Methods. 1 Barrier functions. 2 Analytic center. 3 Central path. 4 Barrier method. 5 Primal-dual path following algorithms Agenda Interior Point Methods 1 Barrier functions 2 Analytic center 3 Central path 4 Barrier method 5 Primal-dual path following algorithms 6 Nesterov Todd scaling 7 Complexity analysis Interior point

More information

Contraction Methods for Convex Optimization and monotone variational inequalities No.12

Contraction Methods for Convex Optimization and monotone variational inequalities No.12 XII - 1 Contraction Methods for Convex Optimization and monotone variational inequalities No.12 Linearized alternating direction methods of multipliers for separable convex programming Bingsheng He Department

More information

The Ongoing Development of CSDP

The Ongoing Development of CSDP The Ongoing Development of CSDP Brian Borchers Department of Mathematics New Mexico Tech Socorro, NM 87801 borchers@nmt.edu Joseph Young Department of Mathematics New Mexico Tech (Now at Rice University)

More information

Efficient robust optimization for robust control with constraints Paul Goulart, Eric Kerrigan and Danny Ralph

Efficient robust optimization for robust control with constraints Paul Goulart, Eric Kerrigan and Danny Ralph Efficient robust optimization for robust control with constraints p. 1 Efficient robust optimization for robust control with constraints Paul Goulart, Eric Kerrigan and Danny Ralph Efficient robust optimization

More information

Block Condensing with qpdunes

Block Condensing with qpdunes Block Condensing with qpdunes Dimitris Kouzoupis Rien Quirynen, Janick Frasch and Moritz Diehl Systems control and optimization laboratory (SYSCOP) TEMPO summer school August 5, 215 Dimitris Kouzoupis

More information

Primal-dual relationship between Levenberg-Marquardt and central trajectories for linearly constrained convex optimization

Primal-dual relationship between Levenberg-Marquardt and central trajectories for linearly constrained convex optimization Primal-dual relationship between Levenberg-Marquardt and central trajectories for linearly constrained convex optimization Roger Behling a, Clovis Gonzaga b and Gabriel Haeser c March 21, 2013 a Department

More information

ESTIMATES ON THE PREDICTION HORIZON LENGTH IN MODEL PREDICTIVE CONTROL

ESTIMATES ON THE PREDICTION HORIZON LENGTH IN MODEL PREDICTIVE CONTROL ESTIMATES ON THE PREDICTION HORIZON LENGTH IN MODEL PREDICTIVE CONTROL K. WORTHMANN Abstract. We are concerned with model predictive control without stabilizing terminal constraints or costs. Here, our

More information

Hot-Starting NLP Solvers

Hot-Starting NLP Solvers Hot-Starting NLP Solvers Andreas Wächter Department of Industrial Engineering and Management Sciences Northwestern University waechter@iems.northwestern.edu 204 Mixed Integer Programming Workshop Ohio

More information

DUAL REGULARIZED TOTAL LEAST SQUARES SOLUTION FROM TWO-PARAMETER TRUST-REGION ALGORITHM. Geunseop Lee

DUAL REGULARIZED TOTAL LEAST SQUARES SOLUTION FROM TWO-PARAMETER TRUST-REGION ALGORITHM. Geunseop Lee J. Korean Math. Soc. 0 (0), No. 0, pp. 1 0 https://doi.org/10.4134/jkms.j160152 pissn: 0304-9914 / eissn: 2234-3008 DUAL REGULARIZED TOTAL LEAST SQUARES SOLUTION FROM TWO-PARAMETER TRUST-REGION ALGORITHM

More information

Support Vector Machines

Support Vector Machines EE 17/7AT: Optimization Models in Engineering Section 11/1 - April 014 Support Vector Machines Lecturer: Arturo Fernandez Scribe: Arturo Fernandez 1 Support Vector Machines Revisited 1.1 Strictly) Separable

More information

Convex Optimization Overview (cnt d)

Convex Optimization Overview (cnt d) Convex Optimization Overview (cnt d) Chuong B. Do October 6, 007 1 Recap During last week s section, we began our study of convex optimization, the study of mathematical optimization problems of the form,

More information

An Inexact Newton Method for Optimization

An Inexact Newton Method for Optimization New York University Brown Applied Mathematics Seminar, February 10, 2009 Brief biography New York State College of William and Mary (B.S.) Northwestern University (M.S. & Ph.D.) Courant Institute (Postdoc)

More information

III. Applications in convex optimization

III. Applications in convex optimization III. Applications in convex optimization nonsymmetric interior-point methods partial separability and decomposition partial separability first order methods interior-point methods Conic linear optimization

More information

Constrained Nonlinear Optimization Algorithms

Constrained Nonlinear Optimization Algorithms Department of Industrial Engineering and Management Sciences Northwestern University waechter@iems.northwestern.edu Institute for Mathematics and its Applications University of Minnesota August 4, 2016

More information

Lecture 15 Newton Method and Self-Concordance. October 23, 2008

Lecture 15 Newton Method and Self-Concordance. October 23, 2008 Newton Method and Self-Concordance October 23, 2008 Outline Lecture 15 Self-concordance Notion Self-concordant Functions Operations Preserving Self-concordance Properties of Self-concordant Functions Implications

More information

Fast model predictive control based on linear input/output models and bounded-variable least squares

Fast model predictive control based on linear input/output models and bounded-variable least squares 7 IEEE 56th Annual Conference on Decision and Control (CDC) December -5, 7, Melbourne, Australia Fast model predictive control based on linear input/output models and bounded-variable least squares Nilay

More information

Moving Horizon Filter for Monotonic Trends

Moving Horizon Filter for Monotonic Trends 43rd IEEE Conference on Decision and Control December 4-7, 2004 Atlantis, Paradise Island, Bahamas ThA.3 Moving Horizon Filter for Monotonic Trends Sikandar Samar Stanford University Dimitry Gorinevsky

More information

A FAST, EASILY TUNED, SISO, MODEL PREDICTIVE CONTROLLER. Gabriele Pannocchia,1 Nabil Laachi James B. Rawlings

A FAST, EASILY TUNED, SISO, MODEL PREDICTIVE CONTROLLER. Gabriele Pannocchia,1 Nabil Laachi James B. Rawlings A FAST, EASILY TUNED, SISO, MODEL PREDICTIVE CONTROLLER Gabriele Pannocchia, Nabil Laachi James B. Rawlings Department of Chemical Engineering Univ. of Pisa Via Diotisalvi 2, 5626 Pisa (Italy) Department

More information

Lecture 5. Theorems of Alternatives and Self-Dual Embedding

Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 1 Lecture 5. Theorems of Alternatives and Self-Dual Embedding IE 8534 2 A system of linear equations may not have a solution. It is well known that either Ax = c has a solution, or A T y = 0, c

More information

Congestion Management in a Smart Grid via Shadow Prices

Congestion Management in a Smart Grid via Shadow Prices Congestion Management in a Smart Grid via Shadow Prices Benjamin Biegel, Palle Andersen, Jakob Stoustrup, Jan Bendtsen Systems of Systems October 23, 2012 1 This presentation use of distributed Receding

More information

FIR Filters for Stationary State Space Signal Models

FIR Filters for Stationary State Space Signal Models Proceedings of the 17th World Congress The International Federation of Automatic Control FIR Filters for Stationary State Space Signal Models Jung Hun Park Wook Hyun Kwon School of Electrical Engineering

More information

MPC for tracking periodic reference signals

MPC for tracking periodic reference signals MPC for tracking periodic reference signals D. Limon T. Alamo D.Muñoz de la Peña M.N. Zeilinger C.N. Jones M. Pereira Departamento de Ingeniería de Sistemas y Automática, Escuela Superior de Ingenieros,

More information

Static Output Feedback Stabilisation with H Performance for a Class of Plants

Static Output Feedback Stabilisation with H Performance for a Class of Plants Static Output Feedback Stabilisation with H Performance for a Class of Plants E. Prempain and I. Postlethwaite Control and Instrumentation Research, Department of Engineering, University of Leicester,

More information

SPARSE SECOND ORDER CONE PROGRAMMING FORMULATIONS FOR CONVEX OPTIMIZATION PROBLEMS

SPARSE SECOND ORDER CONE PROGRAMMING FORMULATIONS FOR CONVEX OPTIMIZATION PROBLEMS Journal of the Operations Research Society of Japan 2008, Vol. 51, No. 3, 241-264 SPARSE SECOND ORDER CONE PROGRAMMING FORMULATIONS FOR CONVEX OPTIMIZATION PROBLEMS Kazuhiro Kobayashi Sunyoung Kim Masakazu

More information

CS6375: Machine Learning Gautam Kunapuli. Support Vector Machines

CS6375: Machine Learning Gautam Kunapuli. Support Vector Machines Gautam Kunapuli Example: Text Categorization Example: Develop a model to classify news stories into various categories based on their content. sports politics Use the bag-of-words representation for this

More information

4F3 - Predictive Control

4F3 - Predictive Control 4F3 Predictive Control - Lecture 3 p 1/21 4F3 - Predictive Control Lecture 3 - Predictive Control with Constraints Jan Maciejowski jmm@engcamacuk 4F3 Predictive Control - Lecture 3 p 2/21 Constraints on

More information

Short title: Total FETI. Corresponding author: Zdenek Dostal, VŠB-Technical University of Ostrava, 17 listopadu 15, CZ Ostrava, Czech Republic

Short title: Total FETI. Corresponding author: Zdenek Dostal, VŠB-Technical University of Ostrava, 17 listopadu 15, CZ Ostrava, Czech Republic Short title: Total FETI Corresponding author: Zdenek Dostal, VŠB-Technical University of Ostrava, 17 listopadu 15, CZ-70833 Ostrava, Czech Republic mail: zdenek.dostal@vsb.cz fax +420 596 919 597 phone

More information

Penalty and Barrier Methods General classical constrained minimization problem minimize f(x) subject to g(x) 0 h(x) =0 Penalty methods are motivated by the desire to use unconstrained optimization techniques

More information

18. Primal-dual interior-point methods

18. Primal-dual interior-point methods L. Vandenberghe EE236C (Spring 213-14) 18. Primal-dual interior-point methods primal-dual central path equations infeasible primal-dual method primal-dual method for self-dual embedding 18-1 Symmetric

More information

On Optimal Frame Conditioners

On Optimal Frame Conditioners On Optimal Frame Conditioners Chae A. Clark Department of Mathematics University of Maryland, College Park Email: cclark18@math.umd.edu Kasso A. Okoudjou Department of Mathematics University of Maryland,

More information

Interior Point Methods. We ll discuss linear programming first, followed by three nonlinear problems. Algorithms for Linear Programming Problems

Interior Point Methods. We ll discuss linear programming first, followed by three nonlinear problems. Algorithms for Linear Programming Problems AMSC 607 / CMSC 764 Advanced Numerical Optimization Fall 2008 UNIT 3: Constrained Optimization PART 4: Introduction to Interior Point Methods Dianne P. O Leary c 2008 Interior Point Methods We ll discuss

More information

A Warm-start Interior-point Method for Predictive Control

A Warm-start Interior-point Method for Predictive Control A Warm-start Interior-point Method for Predictive Control Amir Shahzad Eric C Kerrigan George A Constantinides Department of Electrical and Electronic Engineering, Imperial College London, SW7 2AZ, UK

More information