Complexity of 10 Decision Problems in Continuous Time Dynamical Systems. Amir Ali Ahmadi IBM Watson Research Center

Similar documents
Complexity of ten decision problems in continuous time dynamical systems

Stability of Polynomial Differential Equations: Complexity and Converse Lyapunov Questions

Computation of the Joint Spectral Radius with Optimization Techniques

Optimization over Nonnegative Polynomials: Algorithms and Applications. Amir Ali Ahmadi Princeton, ORFE

DSOS/SDOS Programming: New Tools for Optimization over Nonnegative Polynomials

Complexity of Deciding Convexity in Polynomial Optimization

On the Difficulty of Deciding Asymptotic Stability of Cubic Homogeneous Vector Fields

Iterative LP and SOCP-based. approximations to. sum of squares programs. Georgina Hall Princeton University. Joint work with:

Converse Results on Existence of Sum of Squares Lyapunov Functions

Lyapunov stability ORDINARY DIFFERENTIAL EQUATIONS

ORF 523. Finish approximation algorithms + Limits of computation & undecidability + Concluding remarks

SOS-Convex Lyapunov Functions with Applications to Nonlinear Switched Systems

On Complexity of Lyapunov Functions for Switched Linear Systems

V&V MURI Overview Caltech, October 2008

6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC

Robust and Optimal Control, Spring 2015

9. Interpretations, Lifting, SOS and Moments

Optimization-based Modeling and Analysis Techniques for Safety-Critical Software Verification

Lower bounds on the size of semidefinite relaxations. David Steurer Cornell

Positive semidefinite rank

Control Design along Trajectories with Sums of Squares Programming

Towards Scalable Algorithms with Formal Guarantees for Lyapunov Analysis of Control Systems via Algebraic Optimization

6-1 Computational Complexity

Convex sets, conic matrix factorizations and conic rank lower bounds

STABILITY ANALYSIS AND CONTROL DESIGN

Limits of Computation + Course Recap

Robust-to-Dynamics Linear Programming

Polynomial-time reductions. We have seen several reductions:

approximation algorithms I

Joint spectral characteristics

On the Complexity of Testing Attainment of the Optimal Value in Nonlinear Optimization

EE363 homework 7 solutions

Sum-of-Squares Method, Tensor Decomposition, Dictionary Learning

Nonlinear Control. Nonlinear Control Lecture # 3 Stability of Equilibrium Points

Convex Optimization. (EE227A: UC Berkeley) Lecture 28. Suvrit Sra. (Algebra + Optimization) 02 May, 2013

Semidefinite Programming

Analysis and synthesis: a complexity perspective

Limits of Computation + Course Recap

On the efficient approximability of constraint satisfaction problems

Limits of Computation + Course Recap

SPECTRAHEDRA. Bernd Sturmfels UC Berkeley

SDP Relaxations for MAXCUT

Semidefinite programming lifts and sparse sums-of-squares

How hard is it to find a good solution?

Ranks of Real Symmetric Tensors

Lec3p1, ORF363/COS323

Lift-and-Project Techniques and SDP Hierarchies

JOINT SPECTRAL RADIUS AND PATH-COMPLETE GRAPH LYAPUNOV FUNCTIONS

Integer Quadratic Programming is in NP

Hybrid Systems - Lecture n. 3 Lyapunov stability

Computational Complexity in Numerical Optimization

2 P vs. NP and Diagonalization

Convex computation of the region of attraction for polynomial control systems

The degree of a function is the highest exponent in the expression

Chapter 4E - Combinations of Functions

Nondeterministic Turing Machines

Converse Lyapunov theorem and Input-to-State Stability

Lecture 15: A Brief Look at PCP

1 Strict local optimality in unconstrained optimization

Outline. Input to state Stability. Nonlinear Realization. Recall: _ Space. _ Space: Space of all piecewise continuous functions

Control and synchronization in systems coupled via a complex network

JOINT SPECTRAL RADIUS AND PATH-COMPLETE GRAPH LYAPUNOV FUNCTIONS

Comp487/587 - Boolean Formulas

Introduction to Semidefinite Programming I: Basic properties a

Proving Unsatisfiability in Non-linear Arithmetic by Duality

Lecture 4. Chapter 4: Lyapunov Stability. Eugenio Schuster. Mechanical Engineering and Mechanics Lehigh University.

NP Complete Problems. COMP 215 Lecture 20

Fast ADMM for Sum of Squares Programs Using Partial Orthogonality

Topic # /31 Feedback Control Systems. Analysis of Nonlinear Systems Lyapunov Stability Analysis

Convergence Rate of Nonlinear Switched Systems

Semi-definite representibility. For fun and profit

A positive definite polynomial Hessian that does not factor

Algebraic Techniques for Switching Systems

Precalculus. How to do with no calculator 1a)

arxiv: v1 [math.ds] 23 Apr 2017

Convex algebraic geometry, optimization and applications

Dimension reduction for semidefinite programming

Approximation Preserving Reductions

Stability lectures. Stability of Linear Systems. Stability of Linear Systems. Stability of Continuous Systems. EECE 571M/491M, Spring 2008 Lecture 5

Approximating Maximum Constraint Satisfaction Problems

Global stabilization of feedforward systems with exponentially unstable Jacobian linearization

Convexity and SOS-Convexity

On the Computational Hardness of Graph Coloring

ALGEBRA 2. Background Knowledge/Prior Skills Knows what operation properties hold for operations with matrices

Estimating the Region of Attraction of Ordinary Differential Equations by Quantified Constraint Solving

Equivariant semidefinite lifts and sum of squares hierarchies

1 Robust optimization

SPECTRAHEDRA. Bernd Sturmfels UC Berkeley

Nonlinear Control as Program Synthesis (A Starter)

Nonlinear Control. Nonlinear Control Lecture # 8 Time Varying and Perturbed Systems

Global Analysis of Piecewise Linear Systems Using Impact Maps and Surface Lyapunov Functions

Lecture 1: Asymptotic Complexity. 1 These slides include material originally prepared by Dr.Ron Cytron, Dr. Jeremy Buhler, and Dr. Steve Cole.

Answers to the CSCE 551 Final Exam, April 30, 2008

Agenda. Applications of semidefinite programming. 1 Control and system theory. 2 Combinatorial and nonconvex optimization

Chapter III. Stability of Linear Systems

4. Algebra and Duality

Approximation of the joint spectral radius of a set of matrices using sum of squares

Topics in Complexity Theory

Computation of CPA Lyapunov functions

Lecture Note 5: Semidefinite Programming for Stability Analysis

Transcription:

Complexity of 10 Decision Problems in Continuous Time Dynamical Systems Amir Ali Ahmadi IBM Watson Research Center Anirudha Majumdar MIT Russ Tedrake MIT 1

Given a polynomial vector field: Decide if the origin is locally (or globally) asymptotically stable. Example. How difficult is this problem? We study the complexity of testing 10 of the most basic qualitative properties of ODEs in control, such as the one above 2

Linear systems: pretty much the only well-understood case d=1 (linear systems): decidable, and polynomial time Iff A is Hurwitz (i.e., eigenvalues of A have negative real part) Quadratic Lyapunov functions always exist A polynomial time algorithm is the following: Solve Check if P is positive definite (e.g. by checking positivity of all n leading principal minors)

What about higher degree? Classical converse Lyapunov theorem: a.s. C 1 Lyapunov function, but how to find one? Numerous computational techniques available: Lyapunov s linearization test, polytopic Lyapunov functions (LP), piecewise quadratic Lyapunov functions (SDP), polynomial Lyapunov functions (SOS), None known to be exact ugly things can happen to innocent vector fields: GAS, but no polynomial Lyapunov function (of any degree) exists! [AAA, Krstic, Parrilo- CDC 12] Can there be any easily checkable necessary and sufficient condition? 4

Thm: Deciding (local or global) asymptotic stability of cubic vector fields is strongly NP-hard. [AAA - ACC 12] Implication: Unless P=NP, there cannot be any polynomial time (or even pseudo-polynomial time) algorithm. (In particular suggests that the tests based on polynomiallysized convex programs can never be exact.)

Our NP-hardness results in this paper 1. Inclusion of the unit ball in region of attraction (d=3) 2. Invariance of the unit ball (d=3) 3. Invariance of a quartic semialgebraic set (d=1) 4. Boundedness of trajectories (d=3) 5. Stability in the sense of Lyapunov (d=4) 6. Local attractivity (d=3) 7. Local collision avoidance (d=4) 8. Existence of a quadratic Lyapunov function (d=3) 9. Existence of a stabilizing control law (d=3) 10. Local asymptotic stability for trigonometric vector fields (d=4) 6

We only prove #10 here Thm: Deciding asymptotic stability of quartic trigonometric vector fields is strongly NP-hard. Reduction from: ONE-IN-THREE 3SAT (satisfiable) (unsatisfiable) Goal: Design a quartic trig differential equation which is a.s. iff ONE-IN-THREE 3SAT has no solution

Sketch of the reduction Lemma: is locally positive definite if and only if the ONE-IN-THREE 3SAT instance is unsatisfiable. 8

Lemma we will use Lemma: If the ONE-IN-THREE 3SAT instance is unsatisfiable, there exists a neighborhood around the origin in which does not vanish. cannot happen 9

Sketch of the reduction (cont d) Thm: Let be as before. Then, is locally asymptotically stable if and only if is locally positive definite. Proof: Apply Lyapunov s theorem does not vanish locally because must be locally positive semidefinite because If were to vanish, its gradient would vanish also 10

Proof summary ONE-IN-THREE 3SAT Local positivity of a quartic trigonometric function Asymptotic stability of a quartic trig vector field 11

Summary of NP-hardness results 1. Inclusion of the unit ball in region of attraction (d=3) 2. Invariance of the unit ball (d=3) 3. Invariance of a quartic semialgebraic set (d=1) 4. Boundedness of trajectories (d=3) 5. Stability in the sense of Lyapunov (d=4) 6. Local attractivity (d=3) 7. Local collision avoidance (d=4) 8. Existence of a quadratic Lyapunov function (d=3) 9. Existence of a stabilizing control law (d=3) 10. Local asymptotic stability for trigonometric vector fields (d=4) 12

Note: decidability is not known Conjecture of Arnold (1976): asymptotic stability of polynomial vector fields is undecidable. Obviously, there is a connection between complexity of the problem and the type of Lyapunov functions we can expect Fact: Existence of polynomial Lyapunov functions, together with a computable upper bound on their degree, implies decidability (quantifier elimination) Similarly, negative time complexity results rule out existence of polynomial Lyapunov functions that we can efficiently search for 13

Discrete and combinatorial domain A two-way bridge Continuous dynamics domain 3SAT TSP 14

Thank you for your attention! Questions? Want to know more? http://aaa.lids.mit.edu/ 15