New applications of moment-sos hierarchies

Size: px
Start display at page:

Download "New applications of moment-sos hierarchies"

Transcription

1 New applications of moment-sos hierarchies Victor Magron, Postdoc LAAS-CNRS 13 August 2014 専攻談話会 ( セミナー ) Tokyo Institute of Technology Dept. of Math. & Comput. Sci. y b sin( par + b) b 1 1 b1 b2 par + b3 = par 500 b2 b3 par + b3 b par b2 par b 1 V. Magron New applications of moment-sos hierarchies 1 / 42

2 Personal Background : Master s thesis at Tokyo University Hierarchical Domain Decomposition methods Collaboration with S. Yoshimura Sensei and Sugimoto : PhD at Ecole Polytechnique 2014 now: Postdoc at LAAS-CNRS V. Magron New applications of moment-sos hierarchies 2 / 42

3 Errors and Proofs Mathematicians want to eliminate all the uncertainties on their results. Why? M. Lecat, Erreurs des Mathématiciens des origines à nos jours, pages of errors! (Euler, Fermat, Sylvester,... ) V. Magron New applications of moment-sos hierarchies 3 / 42

4 Errors and Proofs Possible workaround: proof assistants COQ (Coquand, Huet 1984) HOL-LIGHT (Harrison, Gordon 1980) Built in top of OCAML V. Magron New applications of moment-sos hierarchies 3 / 42

5 Computer Science and Mathematics PhD on Formal Proofs for Global Optimization: Templates and Sums of Squares Collaboration with: Benjamin Werner (LIX Polytechnique) Stéphane Gaubert (Maxplus Team CMAP/INRIA Polytechnique) Xavier Allamigeon (Maxplus Team) V. Magron New applications of moment-sos hierarchies 4 / 42

6 Complex Proofs Complex mathematical proofs / mandatory computation K. Appel and W. Haken, Every Planar Map is Four-Colorable, T. Hales, A Proof of the Kepler Conjecture, V. Magron New applications of moment-sos hierarchies 5 / 42

7 From Oranges Stack... Kepler Conjecture (1611): The maximal density of sphere packings in 3D-space is π 18 Face-centered cubic Packing Hexagonal Compact Packing V. Magron New applications of moment-sos hierarchies 6 / 42

8 ...to Flyspeck Nonlinear Inequalities The proof of T. Hales (1998) contains mathematical and computational parts Computation: check thousands of nonlinear inequalities Robert MacPherson, editor of The Annals of Mathematics: [...] the mathematical community will have to get used to this state of affairs. Flyspeck [Hales 06]: Formal Proof of Kepler Conjecture V. Magron New applications of moment-sos hierarchies 7 / 42

9 ...to Flyspeck Nonlinear Inequalities The proof of T. Hales (1998) contains mathematical and computational parts Computation: check thousands of nonlinear inequalities Robert MacPherson, editor of The Annals of Mathematics: [...] the mathematical community will have to get used to this state of affairs. Flyspeck [Hales 06]: Formal Proof of Kepler Conjecture Project Completion last Sunday by the Flyspeck team!! V. Magron New applications of moment-sos hierarchies 7 / 42

10 A Simple Example In the computational part: Multivariate Polynomials: x := x 1 x 4 ( x 1 + x 2 + x 3 x 4 + x 5 + x 6 ) + x 2 x 5 (x 1 x 2 + x 3 + x 4 x 5 + x 6 ) + x 3 x 6 (x 1 + x 2 x 3 + x 4 + x 5 x 6 ) x 2 (x 3 x 4 + x 1 x 6 ) x 5 (x 1 x 3 + x 4 x 6 ) V. Magron New applications of moment-sos hierarchies 8 / 42

11 A Simple Example In the computational part: Semialgebraic functions: composition of polynomials with,, +,,, /, sup, inf,... p(x) := 4 x q(x) := 4x 1 x r(x) := p(x)/ q(x) l(x) := π ( x 2 + x 3 + x 5 + x 6 8.0) ( x ) ( x 1 2.0) V. Magron New applications of moment-sos hierarchies 8 / 42

12 A Simple Example In the computational part: Transcendental functions T : composition of semialgebraic functions with arctan, exp, sin, +,,,... V. Magron New applications of moment-sos hierarchies 8 / 42

13 A Simple Example In the computational part: Feasible set K := [4, ] 3 [6.3504, 8] [4, ] 2 Lemma from Flyspeck: ( p(x) ) x K, arctan + l(x) 0 q(x) V. Magron New applications of moment-sos hierarchies 8 / 42

14 Existing Formal Frameworks Formal proofs for Global Optimization: Bernstein polynomial methods [Zumkeller s PhD 08] SMT methods [Gao et al. 12] Interval analysis and Sums of squares V. Magron New applications of moment-sos hierarchies 9 / 42

15 Existing Formal Frameworks Interval analysis Certified interval arithmetic in COQ [Melquiond 12] Taylor methods in HOL Light [Solovyev thesis 13] Formal verification of floating-point operations robust but subject to the Curse of Dimensionality V. Magron New applications of moment-sos hierarchies 9 / 42

16 Existing Formal Frameworks Lemma from Flyspeck: ( 4 x ) x K, arctan + l(x) 0 4x1 x Dependency issue using Interval Calculus: One can bound 4 x/ 4x 1 x and l(x) separately Too coarse lower bound: 0.87 Subdivide K to prove the inequality K 3 K = K 1 K 0 K 4 K 2 V. Magron New applications of moment-sos hierarchies 9 / 42

17 Existing Formal Frameworks Sums of squares techniques Formalized in HOL-LIGHT [Harrison 07] COQ [Besson 07] Precise methods but scalibility and robustness issues (numerical) but powerful: global optimality certificates without branching not so robust: handles moderate size problems Restricted to polynomials V. Magron New applications of moment-sos hierarchies 9 / 42

18 Existing Formal Frameworks Approximation theory: Chebyshev/Taylor models mandatory for non-polynomial problems hard to combine with SOS techniques (degree of approximation) V. Magron New applications of moment-sos hierarchies 9 / 42

19 Existing Formal Frameworks Can we develop a new approach with both keeping the respective strength of interval and precision of SOS? Proving Flyspeck Inequalities is challenging: medium-size and tight V. Magron New applications of moment-sos hierarchies 9 / 42

20 New Framework (in my PhD thesis) Certificates for lower bounds of Global Optimization Problems using SOS and new ingredients in Global Optimization: Maxplus approximation (Optimal Control) Nonlinear templates (Static Analysis) Verification of these certificates inside COQ V. Magron New applications of moment-sos hierarchies 10 / 42

21 New Framework (in my PhD thesis) Software Implementation NLCertify: lines of OCAML code 4000 lines of COQ code V. Magron New applications of moment-sos hierarchies 10 / 42

22 Introduction Moment-SOS relaxations and Maxplus approximation Formal Nonlinear Optimization Approximating Pareto curves Polynomial image of semialgebraic sets Program Analysis with Polynomial Templates Conclusion

23 Moment-SOS relaxations Semialgebraic set K := {x R n : g 1 (x) 0,..., g m (x) 0} p := min p(x): NP hard x K Sums of squares Σ[x] Q(K) := { } σ 0 (x) + m j=1 σ j(x)g j (x), with σ j Σ[x] V. Magron New applications of moment-sos hierarchies 11 / 42

24 Moment-SOS relaxations M + (K): space of probability measures supported on K Polynomial Optimization Problems (POP) (Primal) (Dual) inf p dµ = sup λ K s.t. µ M + (K) s.t. λ R, p λ Q(K) V. Magron New applications of moment-sos hierarchies 11 / 42

25 Moment-SOS relaxations Truncated quadratic module Q k (K) := Q(K) R 2k [x] Polynomial Optimization Problems (POP) (Moment) (SOS) inf p dµ sup λ K s.t. µ M + (K) s.t. λ R, p λ Q k (K) V. Magron New applications of moment-sos hierarchies 11 / 42

26 Practical Computation Hierarchy { of SOS relaxations: } λ k := sup λ : p λ Q k (K) λ Convergence guarantees λ k p [Lasserre 01] Can be computed with SOS solvers (CSDP, SDPA) Extension to semialgebraic functions r(x) = p(x)/ q(x) [Lasserre-Putinar 10] V. Magron New applications of moment-sos hierarchies 12 / 42

27 Practical Computation Caprasse Problem x [ 0.5, 0.5] 4, x 1 x x 2x 2 3 x 4 + 4x 1 x 3 x x 2x x 1 x 3 + 4x x 2x 4 10x scale_pol = true: scaled on [0, 1] 4 relax_order = 2: SOS of degree at most 4 bound_squares_variables = true: rsedundant constraints x 2 1 1,..., x2 4 1 V. Magron New applications of moment-sos hierarchies 12 / 42

28 The General Informal Framework Given K a compact set and f a transcendental function, bound f = inf x K f (x) and prove f 0 f is underestimated by a semialgebraic function f sa Reduce the problem f sa := inf x K f sa (x) to a polynomial optimization problem (POP) V. Magron New applications of moment-sos hierarchies 13 / 42

29 Maxplus Approximation Initially introduced to solve Optimal Control Problems [Fleming-McEneaney 00] Curse of dimensionality reduction [McEaneney Kluberg, Gaubert-McEneaney-Qu 11, Qu 13]. Allowed to solve instances of dim up to 15 (inaccessible by grid methods) In our context: approximate transcendental functions V. Magron New applications of moment-sos hierarchies 14 / 42

30 Maxplus Approximation Definition Let γ 0. A function φ : R n R is said to be γ-semiconvex if the function x φ(x) + γ 2 x 2 2 is convex. y par + a 1 par + a 2 arctan par a 2 m a 1 a 2 M a par a 1 V. Magron New applications of moment-sos hierarchies 14 / 42

31 Nonlinear Function Representation Exact parsimonious maxplus representations y a V. Magron New applications of moment-sos hierarchies 15 / 42

32 Nonlinear Function Representation Exact parsimonious maxplus representations y a V. Magron New applications of moment-sos hierarchies 15 / 42

33 Nonlinear Function Representation Abstract syntax tree representations of multivariate transcendental functions: leaves are semialgebraic functions of A nodes are univariate functions of D or binary operations V. Magron New applications of moment-sos hierarchies 15 / 42

34 Nonlinear Function Representation For the Simple Example from Flyspeck: + l(x) arctan r(x) V. Magron New applications of moment-sos hierarchies 15 / 42

35 Maxplus Optimization Algorithm First iteration: + y arctan l(x) arctan r(x) m a 1 par a 1 M a 1 1 control point {a 1 } SOS Computation: m 1 = V. Magron New applications of moment-sos hierarchies 16 / 42

36 Maxplus Optimization Algorithm Second iteration: + y arctan l(x) arctan r(x) m a 2 par a 2 a 1 par a 1 M a 2 2 control points {a 1, a 2 }: m 2 = V. Magron New applications of moment-sos hierarchies 16 / 42

37 Maxplus Optimization Algorithm Third iteration: y + arctan l(x) arctan r(x) m a 2 a 3 par a 2 par par a 3 a 1 a a 1 M 3 3 control points {a 1, a 2, a 3 }: m 3 = 0.04 V. Magron New applications of moment-sos hierarchies 16 / 42

38 Maxplus Optimization Algorithm Input: tree t, box K, SOS relaxation order k, precision p Output: bounds m and M, approximations t 2 and t+ 2 1: if t A then t := t, t + := t 2: else if u := root(t) D with child c then 3: m c, M c, c, c + := samp_approx(c, K, k, p) 4: I := [m c, M c ] 5: u, u + := unary_approx(u, I, c, p) 6: t, t + := compose_approx(u, u, u +, I, c, c + ) 7: else if bop := root(t) with children c 1 and c 2 then 8: m i, M i, c i, c + i := samp_approx(c i, K, k, p) for i {1, 2} 9: t, t + := compose_bop(c 1, c+ 1, c 2, c+ 2, bop, [m 2, M 2 ]) 10: end 11: return min_sa(t, K, k), max_sa(t +, K, k), t, t + V. Magron New applications of moment-sos hierarchies 17 / 42

39 Contributions Published: X. Allamigeon, S. Gaubert, V. Magron, and B. Werner. Certification of inequalities involving transcendental functions: combining sdp and max-plus approximation, ECC Conference X. Allamigeon, S. Gaubert, V. Magron, and B. Werner. Certification of bounds of non-linear functions: the templates method, CICM Conference, In revision: X. Allamigeon, S. Gaubert, V. Magron, and B. Werner. Certification of Real Inequalities Templates and Sums of Squares, arxiv: , V. Magron New applications of moment-sos hierarchies 18 / 42

40 Introduction Moment-SOS relaxations and Maxplus approximation Formal Nonlinear Optimization Approximating Pareto curves Polynomial image of semialgebraic sets Program Analysis with Polynomial Templates Conclusion

41 The General Formal Framework We check the correctness of SOS certificates for POP We build certificates to prove interval bounds for semialgebraic functions We bound formally transcendental functions with semialgebraic approximations V. Magron New applications of moment-sos hierarchies 19 / 42

42 Formal SOS bounds When q Q(K), σ 0,..., σ m is a positivity certificate for q Check symbolic polynomial equalities q = q in COQ Existing tactic ring [Grégoire-Mahboubi 05] Polynomials coefficients: arbitrary-size rationals bigq [Grégoire-Théry 06] Much simpler to verify certificates using sceptical approach Extends also to semialgebraic functions V. Magron New applications of moment-sos hierarchies 20 / 42

43 Benchmarks for Flyspeck Inequalities Inequality #boxes Time Time s 2218 s s s Comparable with Taylor interval methods in HOL-LIGHT [Hales-Solovyev 13] Bottleneck of informal optimizer is SOS solver 22 times slower! = Current bottleneck is to check polynomial equalities V. Magron New applications of moment-sos hierarchies 21 / 42

44 Contribution For more details on the formal side: X. Allamigeon, S. Gaubert, V. Magron and B. Werner. Formal Proofs for Nonlinear Optimization. Submitted for publication, arxiv: V. Magron New applications of moment-sos hierarchies 22 / 42

45 Introduction Moment-SOS relaxations and Maxplus approximation Formal Nonlinear Optimization Approximating Pareto curves Polynomial image of semialgebraic sets Program Analysis with Polynomial Templates Conclusion

46 Bicriteria Optimization Problems Let f 1, f 2 R d [x] two conflicting criteria Let S := {x R n : g 1 (x) 0,..., g m (x) 0} a semialgebraic set { } (P) min (f 1(x) f 2 (x)) x S Assumption The image space R 2 is partially ordered in a natural way (R 2 + is the ordering cone). V. Magron New applications of moment-sos hierarchies 23 / 42

47 Bicriteria Optimization Problems g 1 := (x 1 2) 3 /2 x , g 2 := x 1 x 2 + 8( x 1 + x ) , S := {x R 2 : g 1 (x) 0, g 2 (x) 0}. f 1 := (x 1 + x 2 7.5) 2 /4 + ( x 1 + x 2 + 3) 2, f 2 := (x 1 1) 2 /4 + (x 2 4) 2 /4. V. Magron New applications of moment-sos hierarchies 23 / 42

48 Parametric sublevel set approximation Inspired by previous research on multiobjective linear optimization [Gorissen-den Hertog 12] Workaround: reduce P to a parametric POP (P λ ) : f (λ) := min x S { f 2(x) : f 1 (x) λ }, V. Magron New applications of moment-sos hierarchies 24 / 42

49 A Hierarchy of Polynomial underestimators Moment-SOS approach [Lasserre 10]: (D d ) max q R 2d [λ] 2d q k /(1 + k) k=0 s.t. f 2 (x) q(λ) Q 2d (K). The hierarchy (D d ) provides a sequence (q d ) of polynomial underestimators of f (λ). lim d 1 0 (f (λ) q d (λ))dλ = 0 V. Magron New applications of moment-sos hierarchies 25 / 42

50 A Hierarchy of Polynomial underestimators Degree 4 V. Magron New applications of moment-sos hierarchies 26 / 42

51 A Hierarchy of Polynomial underestimators Degree 6 V. Magron New applications of moment-sos hierarchies 26 / 42

52 A Hierarchy of Polynomial underestimators Degree 8 V. Magron New applications of moment-sos hierarchies 26 / 42

53 Contributions Numerical schemes that avoid computing finitely many points. Pareto curve approximation with polynomials, convergence guarantees in L 1 -norm V. Magron, D. Henrion, J.B. Lasserre. Approximating Pareto Curves using Semidefinite Relaxations. Operations Research Letters. arxiv: , April V. Magron New applications of moment-sos hierarchies 27 / 42

54 Introduction Moment-SOS relaxations and Maxplus approximation Formal Nonlinear Optimization Approximating Pareto curves Polynomial image of semialgebraic sets Program Analysis with Polynomial Templates Conclusion

55 Approximation of sets defined with Let B R m be the unit ball and assume that f (S) B. Another point of view: f (S) = {y B : x S s.t. h(x, y) 0}, with h(x, y) := y f (x) 2 2. Approximate f (S) as closely as desired by a sequence of sets of the form : F d f := {y B : q d (y) 0}, for some polynomials q d R 2d [y]. V. Magron New applications of moment-sos hierarchies 28 / 42

56 A hierarchy of outer approximations of f (S) Let K = S B, g 0 := 1 and Q d (K) be the d-truncated quadratic module generated by g 0,..., g m : Q d (K) = { m } σ l (x, y)g l (x), with σ l Σ d vl [x, y] l=0 Define H(y) := min x S h(x, y) Hierarchy of Semidefinite programs: ρ d := } min (H q)dy : h q Q d (K) q R 2d [y],σ l { B Yet another SOS program with an optimal solution q d R 2d [y]!. V. Magron New applications of moment-sos hierarchies 29 / 42

57 A hierarchy of outer approximations of f (S) From the definition of q d, the sublevel sets F d f := {y B : q d (y) 0} f (S), provide a sequence of certified outer approximations of f (S). It comes from the following: (x, y) K, q d (y) h(x, y) y, q d (y) H(y). V. Magron New applications of moment-sos hierarchies 30 / 42

58 Strong convergence property Theorem 1 The sequence of underestimators (q d ) d d0 converges to H w.r.t the L 1 (B)-norm: lim H q d dy = 0. d B V. Magron New applications of moment-sos hierarchies 31 / 42

59 Strong convergence property Theorem 1 The sequence of underestimators (q d ) d d0 converges to H w.r.t the L 1 (B)-norm: lim H q d dy = 0. d B 2 lim d vol(fd f \f (S)) = 0. V. Magron New applications of moment-sos hierarchies 31 / 42

60 Approximation for polynomial image of semialgebraic sets Image of the unit ball S := {x R 2 : x 2 2 1} by f (x) := (x 1 + x 1 x 2, x 2 x 3 1 )/2 Degree 4 V. Magron New applications of moment-sos hierarchies 32 / 42

61 Approximation for polynomial image of semialgebraic sets Image of the unit ball S := {x R 2 : x 2 2 1} by f (x) := (x 1 + x 1 x 2, x 2 x 3 1 )/2 Degree 4 V. Magron New applications of moment-sos hierarchies 32 / 42

62 Approximation for polynomial image of semialgebraic sets Image of the unit ball S := {x R 2 : x 2 2 1} by f (x) := (x 1 + x 1 x 2, x 2 x 3 1 )/2 Degree 6 V. Magron New applications of moment-sos hierarchies 32 / 42

63 Approximation for polynomial image of semialgebraic sets Image of the unit ball S := {x R 2 : x 2 2 1} by f (x) := (x 1 + x 1 x 2, x 2 x 3 1 )/2 Degree 8 V. Magron New applications of moment-sos hierarchies 32 / 42

64 Semialgebraic set projections f (S) = (x 1, x 2 ): projection on R 2 of the semialgebraic set S := {x R 3 : x 2 2 1, 1/4 (x 1 + 1/2) 2 x 2 2 0, 1/9 (x 1 1/2) 4 x 4 2 0} Degree 4 V. Magron New applications of moment-sos hierarchies 33 / 42

65 Semialgebraic set projections f (S) = (x 1, x 2 ): projection on R 2 of the semialgebraic set S := {x R 3 : x 2 2 1, 1/4 (x 1 + 1/2) 2 x 2 2 0, 1/9 (x 1 1/2) 4 x 4 2 0} Degree 6 V. Magron New applications of moment-sos hierarchies 33 / 42

66 Semialgebraic set projections f (S) = (x 1, x 2 ): projection on R 2 of the semialgebraic set S := {x R 3 : x 2 2 1, 1/4 (x 1 + 1/2) 2 x 2 2 0, 1/9 (x 1 1/2) 4 x 4 2 0} Degree 8 V. Magron New applications of moment-sos hierarchies 33 / 42

67 Support function of a closed convex set Let S be the unit ball and q R[x] being convex on S. f := q q is the support function of the convex set f (S) q(x) := x x x 2 1 x /2(x x 2 2) (x 1 x 2 + x 1 + x 2 ) V. Magron New applications of moment-sos hierarchies 34 / 42

68 Support function of a closed convex set q(x) := x x x 2 1 x /2(x x 2 2) (x 1 x 2 + x 1 + x 2 ) Degree 4 V. Magron New applications of moment-sos hierarchies 34 / 42

69 Support function of a closed convex set q(x) := x x x 2 1 x /2(x x 2 2) (x 1 x 2 + x 1 + x 2 ) Degree 8 V. Magron New applications of moment-sos hierarchies 34 / 42

70 Approximating Pareto curves Back our previous nonconvex example: Degree 2 V. Magron New applications of moment-sos hierarchies 35 / 42

71 Approximating Pareto curves Back our previous nonconvex example: Degree 4 V. Magron New applications of moment-sos hierarchies 35 / 42

72 Approximating Pareto curves Back our previous nonconvex example: Degree 8 V. Magron New applications of moment-sos hierarchies 35 / 42

73 Approximating Pareto curves Zoom on the region which is hard to approximate: Degree 8 V. Magron New applications of moment-sos hierarchies 36 / 42

74 Approximating Pareto curves Zoom on the region which is hard to approximate: Degree 10 V. Magron New applications of moment-sos hierarchies 36 / 42

75 Semialgebraic image of semialgebraic sets Image of the unit ball S := {x R 2 : x 2 2 1} by f (x) := (min(x 1 + x 1 x 2, x 2 1), x 2 x 3 1 )/3 Degree 2 V. Magron New applications of moment-sos hierarchies 37 / 42

76 Semialgebraic image of semialgebraic sets Image of the unit ball S := {x R 2 : x 2 2 1} by f (x) := (min(x 1 + x 1 x 2, x 2 1), x 2 x 3 1 )/3 Degree 4 V. Magron New applications of moment-sos hierarchies 37 / 42

77 Semialgebraic image of semialgebraic sets Image of the unit ball S := {x R 2 : x 2 2 1} by f (x) := (min(x 1 + x 1 x 2, x 2 1), x 2 x 3 1 )/3 Degree 6 V. Magron New applications of moment-sos hierarchies 37 / 42

78 Semialgebraic image of semialgebraic sets Image of the unit ball S := {x R 2 : x 2 2 1} by f (x) := (min(x 1 + x 1 x 2, x 2 1), x 2 x 3 1 )/3 Degree 8 V. Magron New applications of moment-sos hierarchies 37 / 42

79 Introduction Moment-SOS relaxations and Maxplus approximation Formal Nonlinear Optimization Approximating Pareto curves Polynomial image of semialgebraic sets Program Analysis with Polynomial Templates Conclusion

80 One-loop with Conditional Branching r, s, T i, T e R[x] x 0 X 0, with X 0 semialgebraic set x = x 0 ; while (r(x) 0){ if (s(x) 0){ x = T i (x); } else { x = T e (x); } } V. Magron New applications of moment-sos hierarchies 38 / 42

81 Bounding Template using SOS Sufficient condition to get bounding inductive invariant: α := min q R[x] sup q(x) x X 0 s.t. q q T i 0, q q T e 0, q Nontrivial correlations via polynomial templates q(x) {x : q(x) α} X k k N V. Magron New applications of moment-sos hierarchies 39 / 42

82 Bounds for k N X k X 0 := [0.9, 1.1] [0, 0.2] r(x) := 1 s(x) := 1 x 2 1 x 2 2 T i (x) := (x x 3 2, x3 1 + x2 2) T e (x) := ( 1 2 x x3 2, 3 5 x x2 2) Degree 6 V. Magron New applications of moment-sos hierarchies 40 / 42

83 Bounds for k N X k X 0 := [0.9, 1.1] [0, 0.2] r(x) := 1 s(x) := 1 x 2 1 x 2 2 T i (x) := (x x 3 2, x3 1 + x2 2) T e (x) := ( 1 2 x x3 2, 3 5 x x2 2) Degree 8 V. Magron New applications of moment-sos hierarchies 40 / 42

84 Bounds for k N X k X 0 := [0.9, 1.1] [0, 0.2] r(x) := 1 s(x) := 1 x 2 1 x 2 2 T i (x) := (x x 3 2, x3 1 + x2 2) T e (x) := ( 1 2 x x3 2, 3 5 x x2 2) Degree 10 V. Magron New applications of moment-sos hierarchies 40 / 42

85 Introduction Moment-SOS relaxations and Maxplus approximation Formal Nonlinear Optimization Approximating Pareto curves Polynomial image of semialgebraic sets Program Analysis with Polynomial Templates Conclusion

86 Conclusion Formal nonlinear optimization: NLCertify Safe solutions for challenging problems, e.g. Flyspeck Approximation of Pareto Curves, images and projections of semialgebraic sets Program Analysis with polynomial templates V. Magron New applications of moment-sos hierarchies 41 / 42

87 Conclusion Further research: OCAML API Alternative Polynomials bounds using geometric programming (T. de Wolff, S. Iliman) COQ tactic Improve formal polynomial checker Programs analysis with transcendental assignments/conditions V. Magron New applications of moment-sos hierarchies 41 / 42

88 Conclusion Further research: Generalized problem of moments (Moment) (SOS) inf p 0 dµ sup λ 0 + λ i b i K i s.t. p i dµ b i s.t. λ 0, λ i 0, K µ M + (K) p 0 λ 0 i λ i p i Q k (K) Formal bounds using SDP and ring V. Magron New applications of moment-sos hierarchies 41 / 42

89 End Thank you for your attention!

Formal Proofs, Program Analysis and Moment-SOS Relaxations

Formal Proofs, Program Analysis and Moment-SOS Relaxations Formal Proofs, Program Analysis and Moment-SOS Relaxations Victor Magron, Postdoc LAAS-CNRS 15 July 2014 Imperial College Department of Electrical and Electronic Eng. y b sin( par + b) b 1 1 b1 b2 par

More information

Semialgebraic Relaxations using Moment-SOS Hierarchies

Semialgebraic Relaxations using Moment-SOS Hierarchies Semialgebraic Relaxations using Moment-SOS Hierarchies Victor Magron, Postdoc LAAS-CNRS 17 September 2014 SIERRA Seminar Laboratoire d Informatique de l Ecole Normale Superieure y b sin( par + b) b 1 1

More information

Certified Roundoff Error Bounds using Semidefinite Programming

Certified Roundoff Error Bounds using Semidefinite Programming Certified Roundoff Error Bounds using Semidefinite Programming Victor Magron, CNRS VERIMAG joint work with G. Constantinides and A. Donaldson INRIA Mescal Team Seminar 19 November 2015 Victor Magron Certified

More information

arxiv: v2 [math.oc] 16 Oct 2014

arxiv: v2 [math.oc] 16 Oct 2014 Noname manuscript No. (will be inserted by the editor) Certification of Real Inequalities Templates and Sums of Squares Xavier Allamigeon Stéphane Gaubert Victor Magron Benjamin Werner arxiv:1403.5899v2

More information

arxiv: v1 [math.oc] 26 Jul 2013

arxiv: v1 [math.oc] 26 Jul 2013 Certification of inequalities involving transcendental functions: combining SDP and max-plus approximation Xavier ALLAMIGEON 1, Stéphane GAUBERT 2, Victor MAGRON 3 and Benjamin WERNER 4 arxiv:1307.7002v1

More information

Approximating Pareto Curves using Semidefinite Relaxations

Approximating Pareto Curves using Semidefinite Relaxations Approximating Pareto Curves using Semidefinite Relaxations Victor Magron, Didier Henrion,,3 Jean-Bernard Lasserre, arxiv:44.477v [math.oc] 6 Jun 4 June 7, 4 Abstract We consider the problem of constructing

More information

arxiv: v1 [cs.sc] 10 Jul 2013

arxiv: v1 [cs.sc] 10 Jul 2013 Certification of Bounds of Non-linear Functions: the Templates Method Xavier Allamigeon 1, Stéphane Gaubert 2, Victor Magron 3, and Benjamin Werner 4 arxiv:1307.3231v1 [cs.sc] 10 Jul 2013 1 INRIA and CMAP,

More information

The moment-lp and moment-sos approaches

The moment-lp and moment-sos approaches The moment-lp and moment-sos approaches LAAS-CNRS and Institute of Mathematics, Toulouse, France CIRM, November 2013 Semidefinite Programming Why polynomial optimization? LP- and SDP- CERTIFICATES of POSITIVITY

More information

6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC

6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC 6-1 The Positivstellensatz P. Parrilo and S. Lall, ECC 2003 2003.09.02.10 6. The Positivstellensatz Basic semialgebraic sets Semialgebraic sets Tarski-Seidenberg and quantifier elimination Feasibility

More information

Convergence rates of moment-sum-of-squares hierarchies for volume approximation of semialgebraic sets

Convergence rates of moment-sum-of-squares hierarchies for volume approximation of semialgebraic sets Convergence rates of moment-sum-of-squares hierarchies for volume approximation of semialgebraic sets Milan Korda 1, Didier Henrion,3,4 Draft of December 1, 016 Abstract Moment-sum-of-squares hierarchies

More information

Sum of Squares Relaxations for Polynomial Semi-definite Programming

Sum of Squares Relaxations for Polynomial Semi-definite Programming Sum of Squares Relaxations for Polynomial Semi-definite Programming C.W.J. Hol, C.W. Scherer Delft University of Technology, Delft Center of Systems and Control (DCSC) Mekelweg 2, 2628CD Delft, The Netherlands

More information

On Polynomial Optimization over Non-compact Semi-algebraic Sets

On Polynomial Optimization over Non-compact Semi-algebraic Sets On Polynomial Optimization over Non-compact Semi-algebraic Sets V. Jeyakumar, J.B. Lasserre and G. Li Revised Version: April 3, 2014 Communicated by Lionel Thibault Abstract The optimal value of a polynomial

More information

Convex Optimization & Parsimony of L p-balls representation

Convex Optimization & Parsimony of L p-balls representation Convex Optimization & Parsimony of L p -balls representation LAAS-CNRS and Institute of Mathematics, Toulouse, France IMA, January 2016 Motivation Unit balls associated with nonnegative homogeneous polynomials

More information

Towards Solving Bilevel Optimization Problems in Quantum Information Theory

Towards Solving Bilevel Optimization Problems in Quantum Information Theory Towards Solving Bilevel Optimization Problems in Quantum Information Theory ICFO-The Institute of Photonic Sciences and University of Borås 22 January 2016 Workshop on Linear Matrix Inequalities, Semidefinite

More information

Convex Optimization. (EE227A: UC Berkeley) Lecture 28. Suvrit Sra. (Algebra + Optimization) 02 May, 2013

Convex Optimization. (EE227A: UC Berkeley) Lecture 28. Suvrit Sra. (Algebra + Optimization) 02 May, 2013 Convex Optimization (EE227A: UC Berkeley) Lecture 28 (Algebra + Optimization) 02 May, 2013 Suvrit Sra Admin Poster presentation on 10th May mandatory HW, Midterm, Quiz to be reweighted Project final report

More information

Convergence under Subdivision and Complexity of Polynomial Minimization in the Simplicial Bernstein Basis

Convergence under Subdivision and Complexity of Polynomial Minimization in the Simplicial Bernstein Basis Convergence under Subdivision and Complexity of Polynomial Minimization in the Simplicial Bernstein Basis Richard Leroy IRMAR, University of Rennes 1 richard.leroy@ens-cachan.org Abstract In this article,

More information

Computer Proof Assistants and Univalent Foundations of Mathematics

Computer Proof Assistants and Univalent Foundations of Mathematics Nov. 16, 2014, CMA2014, Kuwait. Computer Proof Assistants and Univalent Foundations of Mathematics by Vladimir Voevodsky from the Institute for Advanced Study in Princeton, NJ. Kepler s Conjecture. In

More information

Strong duality in Lasserre s hierarchy for polynomial optimization

Strong duality in Lasserre s hierarchy for polynomial optimization Strong duality in Lasserre s hierarchy for polynomial optimization arxiv:1405.7334v1 [math.oc] 28 May 2014 Cédric Josz 1,2, Didier Henrion 3,4,5 Draft of January 24, 2018 Abstract A polynomial optimization

More information

Advanced SDPs Lecture 6: March 16, 2017

Advanced SDPs Lecture 6: March 16, 2017 Advanced SDPs Lecture 6: March 16, 2017 Lecturers: Nikhil Bansal and Daniel Dadush Scribe: Daniel Dadush 6.1 Notation Let N = {0, 1,... } denote the set of non-negative integers. For α N n, define the

More information

Semidefinite Programming

Semidefinite Programming Semidefinite Programming Notes by Bernd Sturmfels for the lecture on June 26, 208, in the IMPRS Ringvorlesung Introduction to Nonlinear Algebra The transition from linear algebra to nonlinear algebra has

More information

A new look at nonnegativity on closed sets

A new look at nonnegativity on closed sets A new look at nonnegativity on closed sets LAAS-CNRS and Institute of Mathematics, Toulouse, France IPAM, UCLA September 2010 Positivstellensatze for semi-algebraic sets K R n from the knowledge of defining

More information

LMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009

LMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009 LMI MODELLING 4. CONVEX LMI MODELLING Didier HENRION LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ Universidad de Valladolid, SP March 2009 Minors A minor of a matrix F is the determinant of a submatrix

More information

arxiv: v1 [cs.lo] 8 Jan 2013

arxiv: v1 [cs.lo] 8 Jan 2013 Formal Verification of Nonlinear Inequalities with Taylor Interval Approximations Alexey Solovyev and Thomas C. Hales arxiv:1301.1702v1 [cs.lo] 8 Jan 2013 Department of Mathematics, University of Pittsburgh,

More information

arxiv: v1 [math.oc] 31 Jan 2017

arxiv: v1 [math.oc] 31 Jan 2017 CONVEX CONSTRAINED SEMIALGEBRAIC VOLUME OPTIMIZATION: APPLICATION IN SYSTEMS AND CONTROL 1 Ashkan Jasour, Constantino Lagoa School of Electrical Engineering and Computer Science, Pennsylvania State University

More information

COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS. Didier HENRION henrion

COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS. Didier HENRION   henrion COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS Didier HENRION www.laas.fr/ henrion October 2006 Geometry of LMI sets Given symmetric matrices F i we want to characterize the shape in R n of the LMI set F

More information

Comparison of Lasserre s measure based bounds for polynomial optimization to bounds obtained by simulated annealing

Comparison of Lasserre s measure based bounds for polynomial optimization to bounds obtained by simulated annealing Comparison of Lasserre s measure based bounds for polynomial optimization to bounds obtained by simulated annealing Etienne de lerk Monique Laurent March 2, 2017 Abstract We consider the problem of minimizing

More information

How to generate weakly infeasible semidefinite programs via Lasserre s relaxations for polynomial optimization

How to generate weakly infeasible semidefinite programs via Lasserre s relaxations for polynomial optimization CS-11-01 How to generate weakly infeasible semidefinite programs via Lasserre s relaxations for polynomial optimization Hayato Waki Department of Computer Science, The University of Electro-Communications

More information

I.3. LMI DUALITY. Didier HENRION EECI Graduate School on Control Supélec - Spring 2010

I.3. LMI DUALITY. Didier HENRION EECI Graduate School on Control Supélec - Spring 2010 I.3. LMI DUALITY Didier HENRION henrion@laas.fr EECI Graduate School on Control Supélec - Spring 2010 Primal and dual For primal problem p = inf x g 0 (x) s.t. g i (x) 0 define Lagrangian L(x, z) = g 0

More information

Solving Global Optimization Problems with Sparse Polynomials and Unbounded Semialgebraic Feasible Sets

Solving Global Optimization Problems with Sparse Polynomials and Unbounded Semialgebraic Feasible Sets Solving Global Optimization Problems with Sparse Polynomials and Unbounded Semialgebraic Feasible Sets V. Jeyakumar, S. Kim, G. M. Lee and G. Li June 6, 2014 Abstract We propose a hierarchy of semidefinite

More information

Convex computation of the region of attraction for polynomial control systems

Convex computation of the region of attraction for polynomial control systems Convex computation of the region of attraction for polynomial control systems Didier Henrion LAAS-CNRS Toulouse & CTU Prague Milan Korda EPFL Lausanne Region of Attraction (ROA) ẋ = f (x,u), x(t) X, u(t)

More information

4. Algebra and Duality

4. Algebra and Duality 4-1 Algebra and Duality P. Parrilo and S. Lall, CDC 2003 2003.12.07.01 4. Algebra and Duality Example: non-convex polynomial optimization Weak duality and duality gap The dual is not intrinsic The cone

More information

Moments and Positive Polynomials for Optimization II: LP- VERSUS SDP-relaxations

Moments and Positive Polynomials for Optimization II: LP- VERSUS SDP-relaxations Moments and Positive Polynomials for Optimization II: LP- VERSUS SDP-relaxations LAAS-CNRS and Institute of Mathematics, Toulouse, France Tutorial, IMS, Singapore 2012 LP-relaxations LP- VERSUS SDP-relaxations

More information

Semidefinite approximations of projections and polynomial images of semialgebraic sets

Semidefinite approximations of projections and polynomial images of semialgebraic sets Semidefinite approximations of projections and polynomial images of semialgebraic sets Victor Magron 1 Didier Henrion 2,3,4 Jean-Bernard Lasserre 2,3 October 17, 2014 Abstract Given a compact semialgebraic

More information

9. Interpretations, Lifting, SOS and Moments

9. Interpretations, Lifting, SOS and Moments 9-1 Interpretations, Lifting, SOS and Moments P. Parrilo and S. Lall, CDC 2003 2003.12.07.04 9. Interpretations, Lifting, SOS and Moments Polynomial nonnegativity Sum of squares (SOS) decomposition Eample

More information

Representations of Positive Polynomials: Theory, Practice, and

Representations of Positive Polynomials: Theory, Practice, and Representations of Positive Polynomials: Theory, Practice, and Applications Dept. of Mathematics and Computer Science Emory University, Atlanta, GA Currently: National Science Foundation Temple University

More information

Fast ADMM for Sum of Squares Programs Using Partial Orthogonality

Fast ADMM for Sum of Squares Programs Using Partial Orthogonality Fast ADMM for Sum of Squares Programs Using Partial Orthogonality Antonis Papachristodoulou Department of Engineering Science University of Oxford www.eng.ox.ac.uk/control/sysos antonis@eng.ox.ac.uk with

More information

Moments and Positive Polynomials for Optimization II: LP- VERSUS SDP-relaxations

Moments and Positive Polynomials for Optimization II: LP- VERSUS SDP-relaxations Moments and Positive Polynomials for Optimization II: LP- VERSUS SDP-relaxations LAAS-CNRS and Institute of Mathematics, Toulouse, France EECI Course: February 2016 LP-relaxations LP- VERSUS SDP-relaxations

More information

Lecture Note 5: Semidefinite Programming for Stability Analysis

Lecture Note 5: Semidefinite Programming for Stability Analysis ECE7850: Hybrid Systems:Theory and Applications Lecture Note 5: Semidefinite Programming for Stability Analysis Wei Zhang Assistant Professor Department of Electrical and Computer Engineering Ohio State

More information

Approximate Optimal Designs for Multivariate Polynomial Regression

Approximate Optimal Designs for Multivariate Polynomial Regression Approximate Optimal Designs for Multivariate Polynomial Regression Fabrice Gamboa Collaboration with: Yohan de Castro, Didier Henrion, Roxana Hess, Jean-Bernard Lasserre Universität Potsdam 16th of February

More information

Optimization-based Modeling and Analysis Techniques for Safety-Critical Software Verification

Optimization-based Modeling and Analysis Techniques for Safety-Critical Software Verification Optimization-based Modeling and Analysis Techniques for Safety-Critical Software Verification Mardavij Roozbehani Eric Feron Laboratory for Information and Decision Systems Department of Aeronautics and

More information

arxiv: v2 [cs.lo] 18 Oct 2014

arxiv: v2 [cs.lo] 18 Oct 2014 Polynomial Template Generation using Sum-of-Squares Programming Assalé Adjé 1,a and Victor Magron 2,b arxiv:1409.3941v2 [cs.lo] 18 Oct 2014 1 Onera, the French Aerospace Lab, France. Université de Toulouse,

More information

Interactive Theorem Proving in Industry

Interactive Theorem Proving in Industry 1 Interactive Theorem Proving in Industry John Harrison Intel Corporation 16 April 2012 2 Milner on automation and interaction I wrote an automatic theorem prover in Swansea for myself and became shattered

More information

Linear conic optimization for nonlinear optimal control

Linear conic optimization for nonlinear optimal control Linear conic optimization for nonlinear optimal control Didier Henrion 1,2,3, Edouard Pauwels 1,2 Draft of July 15, 2014 Abstract Infinite-dimensional linear conic formulations are described for nonlinear

More information

The Trust Region Subproblem with Non-Intersecting Linear Constraints

The Trust Region Subproblem with Non-Intersecting Linear Constraints The Trust Region Subproblem with Non-Intersecting Linear Constraints Samuel Burer Boshi Yang February 21, 2013 Abstract This paper studies an extended trust region subproblem (etrs in which the trust region

More information

Optimization over Polynomials with Sums of Squares and Moment Matrices

Optimization over Polynomials with Sums of Squares and Moment Matrices Optimization over Polynomials with Sums of Squares and Moment Matrices Monique Laurent Centrum Wiskunde & Informatica (CWI), Amsterdam and University of Tilburg Positivity, Valuations and Quadratic Forms

More information

SPECTRA - a Maple library for solving linear matrix inequalities in exact arithmetic

SPECTRA - a Maple library for solving linear matrix inequalities in exact arithmetic SPECTRA - a Maple library for solving linear matrix inequalities in exact arithmetic Didier Henrion Simone Naldi Mohab Safey El Din Version 1.0 of November 5, 2016 Abstract This document briefly describes

More information

Robust and Optimal Control, Spring 2015

Robust and Optimal Control, Spring 2015 Robust and Optimal Control, Spring 2015 Instructor: Prof. Masayuki Fujita (S5-303B) G. Sum of Squares (SOS) G.1 SOS Program: SOS/PSD and SDP G.2 Duality, valid ineqalities and Cone G.3 Feasibility/Optimization

More information

Formal verification for numerical methods

Formal verification for numerical methods Formal verification for numerical methods Ioana Paşca PhD thesis at INRIA Sophia Antipolis, Marelle Team Advisor: Yves Bertot 1 7 1 Robots 2 7 Robots efficiency 2 7 Robots efficiency safety 2 7 Inside

More information

A ten page introduction to conic optimization

A ten page introduction to conic optimization CHAPTER 1 A ten page introduction to conic optimization This background chapter gives an introduction to conic optimization. We do not give proofs, but focus on important (for this thesis) tools and concepts.

More information

LECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE

LECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE LECTURE 25: REVIEW/EPILOGUE LECTURE OUTLINE CONVEX ANALYSIS AND DUALITY Basic concepts of convex analysis Basic concepts of convex optimization Geometric duality framework - MC/MC Constrained optimization

More information

V&V MURI Overview Caltech, October 2008

V&V MURI Overview Caltech, October 2008 V&V MURI Overview Caltech, October 2008 Pablo A. Parrilo Laboratory for Information and Decision Systems Massachusetts Institute of Technology Goals!! Specification, design, and certification!! Coherent

More information

A General Framework for Convex Relaxation of Polynomial Optimization Problems over Cones

A General Framework for Convex Relaxation of Polynomial Optimization Problems over Cones Research Reports on Mathematical and Computing Sciences Series B : Operations Research Department of Mathematical and Computing Sciences Tokyo Institute of Technology 2-12-1 Oh-Okayama, Meguro-ku, Tokyo

More information

arxiv: v1 [math.oc] 9 Sep 2015

arxiv: v1 [math.oc] 9 Sep 2015 CONTAINMENT PROBLEMS FOR PROJECTIONS OF POLYHEDRA AND SPECTRAHEDRA arxiv:1509.02735v1 [math.oc] 9 Sep 2015 KAI KELLNER Abstract. Spectrahedra are affine sections of the cone of positive semidefinite matrices

More information

Hilbert s 17th Problem to Semidefinite Programming & Convex Algebraic Geometry

Hilbert s 17th Problem to Semidefinite Programming & Convex Algebraic Geometry Hilbert s 17th Problem to Semidefinite Programming & Convex Algebraic Geometry Rekha R. Thomas University of Washington, Seattle References Monique Laurent, Sums of squares, moment matrices and optimization

More information

An explicit construction of distinguished representations of polynomials nonnegative over finite sets

An explicit construction of distinguished representations of polynomials nonnegative over finite sets An explicit construction of distinguished representations of polynomials nonnegative over finite sets Pablo A. Parrilo Automatic Control Laboratory Swiss Federal Institute of Technology Physikstrasse 3

More information

Ranks of Real Symmetric Tensors

Ranks of Real Symmetric Tensors Ranks of Real Symmetric Tensors Greg Blekherman SIAM AG 2013 Algebraic Geometry of Tensor Decompositions Real Symmetric Tensor Decompositions Let f be a form of degree d in R[x 1,..., x n ]. We would like

More information

Non-Convex Optimization via Real Algebraic Geometry

Non-Convex Optimization via Real Algebraic Geometry Non-Convex Optimization via Real Algebraic Geometry Constantine Caramanis Massachusetts Institute of Technology November 29, 2001 The following paper represents the material from a collection of different

More information

Example: feasibility. Interpretation as formal proof. Example: linear inequalities and Farkas lemma

Example: feasibility. Interpretation as formal proof. Example: linear inequalities and Farkas lemma 4-1 Algebra and Duality P. Parrilo and S. Lall 2006.06.07.01 4. Algebra and Duality Example: non-convex polynomial optimization Weak duality and duality gap The dual is not intrinsic The cone of valid

More information

Semidefinite Relaxations Approach to Polynomial Optimization and One Application. Li Wang

Semidefinite Relaxations Approach to Polynomial Optimization and One Application. Li Wang Semidefinite Relaxations Approach to Polynomial Optimization and One Application Li Wang University of California, San Diego Institute for Computational and Experimental Research in Mathematics September

More information

Optimization based robust control

Optimization based robust control Optimization based robust control Didier Henrion 1,2 Draft of March 27, 2014 Prepared for possible inclusion into The Encyclopedia of Systems and Control edited by John Baillieul and Tariq Samad and published

More information

The moment-lp and moment-sos approaches in optimization

The moment-lp and moment-sos approaches in optimization The moment-lp and moment-sos approaches in optimization LAAS-CNRS and Institute of Mathematics, Toulouse, France Workshop Linear Matrix Inequalities, Semidefinite Programming and Quantum Information Theory

More information

Exact SDP Relaxations for Classes of Nonlinear Semidefinite Programming Problems

Exact SDP Relaxations for Classes of Nonlinear Semidefinite Programming Problems Exact SDP Relaxations for Classes of Nonlinear Semidefinite Programming Problems V. Jeyakumar and G. Li Revised Version:August 31, 2012 Abstract An exact semidefinite linear programming (SDP) relaxation

More information

4. Convex optimization problems

4. Convex optimization problems Convex Optimization Boyd & Vandenberghe 4. Convex optimization problems optimization problem in standard form convex optimization problems quasiconvex optimization linear optimization quadratic optimization

More information

Polynomial level-set methods for nonlinear dynamical systems analysis

Polynomial level-set methods for nonlinear dynamical systems analysis Proceedings of the Allerton Conference on Communication, Control and Computing pages 64 649, 8-3 September 5. 5.7..4 Polynomial level-set methods for nonlinear dynamical systems analysis Ta-Chung Wang,4

More information

arxiv: v1 [cs.lo] 24 Mar 2015

arxiv: v1 [cs.lo] 24 Mar 2015 Property-based Polynomial Invariant Generation using Sums-of-Squares Optimization Assalé Adjé 1,a and Pierre-Loïc Garoche 1,a and Victor Magron 2,b arxiv:1503.07025v1 [cs.lo] 24 Mar 2015 1 Onera, the French

More information

Detecting global optimality and extracting solutions in GloptiPoly

Detecting global optimality and extracting solutions in GloptiPoly Detecting global optimality and extracting solutions in GloptiPoly Didier HENRION 1,2 Jean-Bernard LASSERRE 1 1 LAAS-CNRS Toulouse 2 ÚTIA-AVČR Prague Part 1 Description of GloptiPoly Brief description

More information

Research Reports on Mathematical and Computing Sciences

Research Reports on Mathematical and Computing Sciences ISSN 1342-2804 Research Reports on Mathematical and Computing Sciences Sums of Squares and Semidefinite Programming Relaxations for Polynomial Optimization Problems with Structured Sparsity Hayato Waki,

More information

Non-linear Interpolant Generation and Its Application to Program Verification

Non-linear Interpolant Generation and Its Application to Program Verification Non-linear Interpolant Generation and Its Application to Program Verification Naijun Zhan State Key Laboratory of Computer Science, Institute of Software, CAS Joint work with Liyun Dai, Ting Gan, Bow-Yaw

More information

Semidefinite Programming Basics and Applications

Semidefinite Programming Basics and Applications Semidefinite Programming Basics and Applications Ray Pörn, principal lecturer Åbo Akademi University Novia University of Applied Sciences Content What is semidefinite programming (SDP)? How to represent

More information

1 Number Systems and Errors 1

1 Number Systems and Errors 1 Contents 1 Number Systems and Errors 1 1.1 Introduction................................ 1 1.2 Number Representation and Base of Numbers............. 1 1.2.1 Normalized Floating-point Representation...........

More information

Semidefinite Approximations of Reachable Sets for Discrete-time Polynomial Systems

Semidefinite Approximations of Reachable Sets for Discrete-time Polynomial Systems Semidefinite Approximations of Reachable Sets for Discrete-time Polynomial Systems arxiv:1703.05085v2 [math.oc] 13 Feb 2018 Victor Magron 1 Pierre-Loic Garoche 2 Didier Henrion 3,4 Xavier Thirioux 5 September

More information

Minimum Ellipsoid Bounds for Solutions of Polynomial Systems via Sum of Squares

Minimum Ellipsoid Bounds for Solutions of Polynomial Systems via Sum of Squares Journal of Global Optimization (2005) 33: 511 525 Springer 2005 DOI 10.1007/s10898-005-2099-2 Minimum Ellipsoid Bounds for Solutions of Polynomial Systems via Sum of Squares JIAWANG NIE 1 and JAMES W.

More information

Analysis and synthesis: a complexity perspective

Analysis and synthesis: a complexity perspective Analysis and synthesis: a complexity perspective Pablo A. Parrilo ETH ZürichZ control.ee.ethz.ch/~parrilo Outline System analysis/design Formal and informal methods SOS/SDP techniques and applications

More information

CONVEXITY IN SEMI-ALGEBRAIC GEOMETRY AND POLYNOMIAL OPTIMIZATION

CONVEXITY IN SEMI-ALGEBRAIC GEOMETRY AND POLYNOMIAL OPTIMIZATION CONVEXITY IN SEMI-ALGEBRAIC GEOMETRY AND POLYNOMIAL OPTIMIZATION JEAN B. LASSERRE Abstract. We review several (and provide new) results on the theory of moments, sums of squares and basic semi-algebraic

More information

Convex computation of the region of attraction of polynomial control systems

Convex computation of the region of attraction of polynomial control systems Convex computation of the region of attraction of polynomial control systems Didier Henrion 1,2,3, Milan Korda 4 Draft of July 15, 213 Abstract We address the long-standing problem of computing the region

More information

Strange Behaviors of Interior-point Methods. for Solving Semidefinite Programming Problems. in Polynomial Optimization

Strange Behaviors of Interior-point Methods. for Solving Semidefinite Programming Problems. in Polynomial Optimization CS-08-02 Strange Behaviors of Interior-point Methods for Solving Semidefinite Programming Problems in Polynomial Optimization Hayato Waki, Maho Nakata, and Masakazu Muramatsu Department of Computer Science,

More information

Inner approximations of the region of attraction for polynomial dynamical systems

Inner approximations of the region of attraction for polynomial dynamical systems Inner approimations of the region of attraction for polynomial dynamical systems Milan Korda, Didier Henrion 2,3,4, Colin N. Jones October, 22 Abstract hal-74798, version - Oct 22 In a previous work we

More information

Network Utility Maximization With Nonconcave Utilities Using Sum-of-Squares Method

Network Utility Maximization With Nonconcave Utilities Using Sum-of-Squares Method Proceedings of the 44th IEEE Conference on Decision and Control, and the European Control Conference 2005 Seville, Spain, December 2-5, 2005 MoC4.6 Network Utility Maximization With Nonconcave Utilities

More information

An Introduction to Proof Assistants

An Introduction to Proof Assistants An Introduction to Proof Assistants Patrick Schnider Student Seminar in Combinatorics: Mathematical Software, ETH Zürich 1 Motivation The development of proof assistants was motivated by the use of computers

More information

Semidefinite Programming

Semidefinite Programming Semidefinite Programming Basics and SOS Fernando Mário de Oliveira Filho Campos do Jordão, 2 November 23 Available at: www.ime.usp.br/~fmario under talks Conic programming V is a real vector space h, i

More information

MIT Algebraic techniques and semidefinite optimization February 14, Lecture 3

MIT Algebraic techniques and semidefinite optimization February 14, Lecture 3 MI 6.97 Algebraic techniques and semidefinite optimization February 4, 6 Lecture 3 Lecturer: Pablo A. Parrilo Scribe: Pablo A. Parrilo In this lecture, we will discuss one of the most important applications

More information

Lecture 6 Verification of Hybrid Systems

Lecture 6 Verification of Hybrid Systems Lecture 6 Verification of Hybrid Systems Ufuk Topcu Nok Wongpiromsarn Richard M. Murray AFRL, 25 April 2012 Outline: A hybrid system model Finite-state abstractions and use of model checking Deductive

More information

Abstract Interpretation with Higher-Dimensional Ellipsoids and Conic Extrapolation

Abstract Interpretation with Higher-Dimensional Ellipsoids and Conic Extrapolation Abstract Interpretation with Higher-Dimensional Ellipsoids and Conic Extrapolation or potatoes & ice cream cones Mendes Oulamara, Arnaud Venet Computer Aided Verification, 2015 July 22, 2015 ÉCOLE NORMALE

More information

Optimization over Nonnegative Polynomials: Algorithms and Applications. Amir Ali Ahmadi Princeton, ORFE

Optimization over Nonnegative Polynomials: Algorithms and Applications. Amir Ali Ahmadi Princeton, ORFE Optimization over Nonnegative Polynomials: Algorithms and Applications Amir Ali Ahmadi Princeton, ORFE INFORMS Optimization Society Conference (Tutorial Talk) Princeton University March 17, 2016 1 Optimization

More information

Copositive Programming and Combinatorial Optimization

Copositive Programming and Combinatorial Optimization Copositive Programming and Combinatorial Optimization Franz Rendl http://www.math.uni-klu.ac.at Alpen-Adria-Universität Klagenfurt Austria joint work with I.M. Bomze (Wien) and F. Jarre (Düsseldorf) IMA

More information

Minimum volume semialgebraic sets for robust estimation

Minimum volume semialgebraic sets for robust estimation Minimum volume semialgebraic sets for robust estimation Fabrizio Dabbene 1, Didier Henrion 2,3,4 October 31, 2018 arxiv:1210.3183v1 [math.oc] 11 Oct 2012 Abstract Motivated by problems of uncertainty propagation

More information

Convex optimization problems. Optimization problem in standard form

Convex optimization problems. Optimization problem in standard form Convex optimization problems optimization problem in standard form convex optimization problems linear optimization quadratic optimization geometric programming quasiconvex optimization generalized inequality

More information

Why is Deep Learning so effective?

Why is Deep Learning so effective? Ma191b Winter 2017 Geometry of Neuroscience The unreasonable effectiveness of deep learning This lecture is based entirely on the paper: Reference: Henry W. Lin and Max Tegmark, Why does deep and cheap

More information

Computer Algebra and Formal Proof

Computer Algebra and Formal Proof James 1 University of Bath J.H.@bath.ac.uk 21 July 2017 1 Thanks to EU H2020-FETOPEN-2016-2017-CSA project SC 2 (712689) and the Isaac Newton Institute through EPSRC K/032208/1 Computer Algebra Systems

More information

What do you think are the qualities of a good theorem? it solves an open problem (Name one..? )

What do you think are the qualities of a good theorem? it solves an open problem (Name one..? ) What do you think are the qualities of a good theorem? Aspects of "good" theorems: short surprising elegant proof applied widely: it solves an open problem (Name one..? ) creates a new field might be easy

More information

POLYNOMIAL OPTIMIZATION WITH SUMS-OF-SQUARES INTERPOLANTS

POLYNOMIAL OPTIMIZATION WITH SUMS-OF-SQUARES INTERPOLANTS POLYNOMIAL OPTIMIZATION WITH SUMS-OF-SQUARES INTERPOLANTS Sercan Yıldız syildiz@samsi.info in collaboration with Dávid Papp (NCSU) OPT Transition Workshop May 02, 2017 OUTLINE Polynomial optimization and

More information

Lecture 20: November 1st

Lecture 20: November 1st 10-725: Optimization Fall 2012 Lecture 20: November 1st Lecturer: Geoff Gordon Scribes: Xiaolong Shen, Alex Beutel Note: LaTeX template courtesy of UC Berkeley EECS dept. Disclaimer: These notes have not

More information

QUADRATIC MAJORIZATION 1. INTRODUCTION

QUADRATIC MAJORIZATION 1. INTRODUCTION QUADRATIC MAJORIZATION JAN DE LEEUW 1. INTRODUCTION Majorization methods are used extensively to solve complicated multivariate optimizaton problems. We refer to de Leeuw [1994]; Heiser [1995]; Lange et

More information

Module 04 Optimization Problems KKT Conditions & Solvers

Module 04 Optimization Problems KKT Conditions & Solvers Module 04 Optimization Problems KKT Conditions & Solvers Ahmad F. Taha EE 5243: Introduction to Cyber-Physical Systems Email: ahmad.taha@utsa.edu Webpage: http://engineering.utsa.edu/ taha/index.html September

More information

Region of attraction approximations for polynomial dynamical systems

Region of attraction approximations for polynomial dynamical systems Region of attraction approximations for polynomial dynamical systems Milan Korda EPFL Lausanne Didier Henrion LAAS-CNRS Toulouse & CTU Prague Colin N. Jones EPFL Lausanne Region of Attraction (ROA) ẋ(t)

More information

The Formal Proof Susan Gillmor and Samantha Rabinowicz Project for MA341: Appreciation of Number Theory Boston University Summer Term

The Formal Proof Susan Gillmor and Samantha Rabinowicz Project for MA341: Appreciation of Number Theory Boston University Summer Term The Formal Proof Susan Gillmor and Samantha Rabinowicz Project for MA341: Appreciation of Number Theory Boston University Summer Term 1 2009 Instructor: Kalin Kostadinov The Formal Proof 2 A proof verifies

More information

Moments and convex optimization for analysis and control of nonlinear partial differential equations

Moments and convex optimization for analysis and control of nonlinear partial differential equations Moments and convex optimization for analysis and control of nonlinear partial differential equations Milan Korda 1, Didier Henrion 2,3,4, Jean Bernard Lasserre 2 April 19, 2018 Abstract This work presents

More information

Fast Algorithms for SDPs derived from the Kalman-Yakubovich-Popov Lemma

Fast Algorithms for SDPs derived from the Kalman-Yakubovich-Popov Lemma Fast Algorithms for SDPs derived from the Kalman-Yakubovich-Popov Lemma Venkataramanan (Ragu) Balakrishnan School of ECE, Purdue University 8 September 2003 European Union RTN Summer School on Multi-Agent

More information

approximation algorithms I

approximation algorithms I SUM-OF-SQUARES method and approximation algorithms I David Steurer Cornell Cargese Workshop, 201 meta-task encoded as low-degree polynomial in R x example: f(x) = i,j n w ij x i x j 2 given: functions

More information

An Introduction to Differential Algebra

An Introduction to Differential Algebra An Introduction to Differential Algebra Alexander Wittig1, P. Di Lizia, R. Armellin, et al. 1 ESA Advanced Concepts Team (TEC-SF) SRL, Milan Dinamica Outline 1 Overview Five Views of Differential Algebra

More information