COUNTING INTEGER POINTS IN POLYHEDRA. Alexander Barvinok
|
|
- Collin Howard
- 6 years ago
- Views:
Transcription
1 COUNTING INTEGER POINTS IN POLYHEDRA Alexander Barvinok Papers are available at barvinok/papers.html Let P R d be a polytope. We want to compute (exactly or approximately) the number P Z d of integer points in P. P Typeset by AMS-TEX
2 PART I: EXACT COUNTING IN FIXED DIMENSION Rational polyhedra P = (ξ,...,ξ d ) : d a ij ξ j b i, i =,...,n, j= where a ij,b i Z. The input size of P: L(P) = n(d+)+ ij log 2 ( a ij +) + i log 2 ( b i +), the number of bits needed to define P. 2
3 Generating functions m x m P We consider the sum m P Z d x m, where The motivating example x m = x µ xµ d d for m = (µ,...,µ d ) n m= x m = xn+ x m x The sum over the integer points on an interval. m n 3
4 Theorem. Let us fix d. There exists a polynomial time algorithm, which, given a rational polyhedron P R d without lines, computes the generating function f(p,x) = m P Z d x m in the form f(p,x) = i I ǫ i x v i ( x u i ) ( x u id), where ǫ i {,}, v i Z d, u ij Z d \{}. The complexity of the algorithm is L O(d), where L = L(P) is the input size of P. In particular, I = L O(d). Proved in 993 (with L O(d2) bound) and then again in
5 Having computed we can Applications f(p,x) = m P Z d x m, ) efficiently count P Z d, the number of integer points in a given rational polytope P. Carefully substitute x =... = x d = into f(p,x); 2) solve integer programming problems of optimizing a given linear function on the set P Z d of integer points in P. There are at least two implementations: LattE (lattice point enumerator) by J. De Loera et al., now subsumed by LattE macchiato by M. Köppe, and barvinok by S. Verdoolaege latte skimo/barvinok 5
6 Reducing polyhedra to cones Some ideas of the proof We can represent the polyhedron as a hyperplane section of a higher-dimensional cone. P P K We have P = K H, where P R d, K R d+, and H R d+ is an affine hyperplane identified with R d. Consequently, we have f(p,x) = f(k, x) x, where x = (x,x d+). d+ xd+ = 6
7 Dealing with cones: unimodular cones A cone K R d generated by a basis u,...,u d of Z d is called unimodular. For such a cone, we have f(k,x) = m K Z d x m = ( x u ) ( x u d). P Integer points in the non-negative orthant. m Z d + x m = ( x ) ( x d ). A unimodular cone differs from the non-negative orthant by a unimodular transformation. The main construction (993): For any fixed d there is a polynomial time algorithm which decomposes a given rational cone K R d into a combination of unimodular cones K i : [K] = i I ǫ i [K i ], where ǫ i {,}, K i are unimodular cones, and { if x R d [A] : R d R, [A](x) = otherwise is the indicator of a set A. 7
8 Example: continued fractions in dimension 2 Suppose that K R 2 is generated by (,) and (3,64). First, we compute 64 3 = = = Hence 64/3 = [5;3,2,4]. Now we compute the convergents: [5;3,2] = = 37 7,[5;3] = 5+ 3 = 6 3, [5] = 5. 8
9 Then we do cutting and pasting of cones: (3, 6) (7, 37) + (3, 6) (, 5) + (, 5) (3, 64) (3, 64) = (7, 37) Let K be the cone generated by (,) and (,). Starting with K, we cut the cone generated by (,) and (,5); paste the cone generated by (, 5) and (3, 6); cut the cone generated by (3, 6) and (7, 37); paste the cone generated by (7, 37) and (3, 64) to finally get K generated by (,) and (3,64). The four cones we cut and paste are unimodular. So we get f(k,x) = ( x )( x 2 ) ( x 2 )( x x 5 2 ) + ( x x 5 2 )( x3 x6 2 ) ( x 3 x6 2 )( x7 x37 2 ) + ( x 7 x37 2 )( x3 x64 2 ). 9
10 Higher dimensions For K generated by linearly independent u,...,u d Z d, let indk be the volume of the parallelepiped spanned by u,...,u d (so indk = if and only if K is unimodular). Using Minkowski s Convex Body Theorem, compute w Z d \{} such that w = d α i u i where α i (indk) /d. i= Let K i be the cone generated by u,...,u i,w,u i+,...,u d. Then [K] = d ǫ i [K i ] i= +indicators of lower-dimensional cones, where ǫ i {,} and Now iterate. indk i (indk) d d. = + + u 3 u 3 u 3 u u 2 u u 2 w u 2 w u w u 3 u 2 w u u u 2 w u 3 = + + u w u u 2 2 w u 3 u 2 u 3 u w w u u 3
11 PART II : APPROXIMATE COUNTING IN HIGHER DIMENSIONS We assume that P is defined by a system of linear equations Ax = b and inequalities so the picture looks more like this x, P Here A = (a ij ) is an integer k n matrix of rank k < n and b is an integer n-vector. k integer entries * * * * * * * * * * * * n Let Λ = Ax : x Z n be the lattice in Z k. Unless b Λ, we have P Z n =. A
12 Joint work with J.A. Hartigan (Yale). Let us consider the function The Gaussian formula g(ξ) = (ξ +)ln(ξ +) ξlnξ for ξ x Let us solve the optimization problem: Find max g(x) = n g(ξ j ) j= Subject to: x = (ξ,...,ξ n ) P. Since g is strictly concave, the maximum point z = (ζ,...,ζ n ) is unique and can be found efficiently by interior point methods, for example. Computing z is easy both in theory and in practice. Let us compute a k k matrix Q = (q ij ) by q ij = n ( ) a im a jm ζ 2 m +ζ m. m= We approximate the number of integer points in P by P Z n e g(z) detλ (2π) k/2 (detq) /2. 2
13 A couple of examples Let us compute the number of 4 4 non-negative integer matrices with row sums 22, 25, 93 and 64 and column sums 8, 286, 7 and * * * * * * * * * * * * * * * * The number of such matrices is We have n = 6 variables and k = 7 equations (one equation can be thrown out). The Gaussian formula overestimates by about 6%. J. De Loera computed more examples. Here is one of them: the exact number of arrays of non-negative integers with the sums [3, 22, 87], [5, 3, 77], [42,87,] along the affine coordinate hyperplanes is The Gaussian formula gives the relative error of.85% Herewe have n = 27 variablesand k = 7 equations (two equationscan be thrown out). 3
14 The (first level of) intuition A random variable x is geometric if Pr { x = m } = pq m for m =,,... where p+q = and p,q >. We have Ex = q p and varx = q p 2. Conversely, if Ex = z then p = +z, q = z +z and varx = z 2 +z. Theorem. Let P R n be a polytope that is the intersection of an affine subspace in R n and the non-negative orthant R n +. Suppose that P has a non-empty interior (contains a point with strictly positive coordinates). Then the strictly concave function g(x) = n ) ((ξ j +)ln(ξ j +) ξ j lnξ j j= attains its maximum on P at a unique point z = (ζ,...,ζ n ) with positive coordinates. Suppose that x,...,x n are independent geometric random variables with expectations ζ,...,ζ n and let X = (x,...,x n ). Then the probability mass function of X is constant on P Z n and equal to e g(z) at every x P Z n. In particular, P Z n = e g(z) Pr { X P }. 4
15 Now, suppose that P = { } x : Ax = b, x. Let Y = AX, that is, Y = (y,...,y k ), where n y i = a ij x j. j= Theorem implies that We note that and that P Z n = e g(z) Pr { Y = b }. EY = b cov(y i,y j ) = n a im a jm varx k = m= n ( ) a im a jm ζ 2 m +ζ m. Now, weobservethaty isthesumofnindependent randomvectorsx j A j, wherea j is the j-th column of A, so we make a leap of faith and assume that the distribution of Y in the vicinity of its expectation is close to the distribution of a Gaussian random vector Y with the same expectation b and the covariance matrix Q. m= b Hence it is not unreasonable to assume that Pr { Y = b } Pr { Y b+fundamental domain of Λ } detλ (2π) k/2 (detq) /2. 5
16 More intuition from statistics and statistical physics In 957, E.T. Jaynes formulated a general principle. Let Ω be a large but finite probability space with an unknown measure µ, let f,...,f k : Ω R be random variables with known expectations Ef i = α i for i =,...,k and let g : Ω R be yet another random variable. Then to compute or estimate Eg one should assume that µ is the probability measure on Ω of the largest entropy such that that Ef i = α i for i =,...,k. Works great for the Maxwell-Boltzmann distribution. In 963, I.J. Good argued that the null hypothesis concerning an unknown probability distribution from a given class should be the one stating that the distribution is the maximum entropy distribution in the class. In our case, Ω is the set Z n + of non-negative integer vectors, f i are the linear equationsdefining polytopep, and µisthecounting probabilitymeasure onp Z n +. We approximate µ by the maximum entropy distribution on Z n + subject to the constraints Ef i = α i, where f i are the linear equations defining P. Fact: Among all distributions on Z + with a given expectation, the geometric distribution has the maximum entropy. The entropy of a geometric distribution with expectation x is g(x) = (x+)ln(x+) xlnx. A S Let us choose a maximum entropy distribution among all probability distributions on a given set S R n with the expectation in a given affine subspace A. It is not hard to argue that the conditional distribution on S A must be uniform. 6
17 Multi-way transportation polytopes and multi-way contingency tables Transportationpolytopes. Letuschoosepositiver,...,r m andc,...,c n such that r +...+r m = c +...+c n = N. The polytope P of non-negative m n matrices (x ij ) with row sums r,...,r m and column sums c,...,c n is called a (two-index) transportation polytope. We have dimp = (m )(n ). Suppose r i and c j are integer. Integer points in P are called (two-way) contingency tables. ν-way transportation polytopes. Let us fix an integer ν 2. The polytope P of ν-dimensional k... k ν arrays (x j...j ν ) with prescribed sectional sums j k... j i k i j i+ k i+... j ν k ν are called ν-way transportation polytopes. x j...j i,j,j i+...j ν As long as the natural balance conditions are met, P is a polytope with dimp = k k ν (k +...+k ν )+ν. Integer points in P are called ν-way contingency tables. 7
18 Some results Fix ν and let k,...,k ν grow roughly proportionately. We proved: The number of integer points in P is asymptotically Gaussian provided ν 5. We suspect it is Gaussian already for ν 3. In particular, the number of non-negative integer k k magic cubes, that is, contingency tables with all sectional sums equal to r = αk ν is ( ) ((α+) +o() α+ α α) k ν ( 2πα 2 +2πα ) (kν ν+)/2 k (ν ν 2 )(k )/2 as k +, provided ν 5, r is integer and α is separated away from ; For ν = 2, the asymptotic of the number of integer contingency tables with equalrowsumsandequalcolumnsumswasrecentlycomputedbye.r.canfieldand B. McKay. It is differs from the Gaussian estimate by a constant factor (generally, greater than ). This corresponds to the Edgeworth correction to the Gaussian distribution. 8
19 The curious case of ν = 2 The Gaussian formula should be multiplied by the correction factor, computed as follows. Let Z = (z ij ) be the matrix maximizing g(x) = ij ((x ij +)ln(x ij +) x ij lnx ij ) on the polytope of non-negative m n matrices with row sums (r,...,r m ) and column sums (c,...,c n ). Let us consider the quadratic form q : R m+n R: Let q(s,t) = 2 ( ) z 2 ij +z ij (si +t j ) 2 for (s,t) = (s,...,s m ;t,...,t n ). ij u =,...,;,..., }{{}}{{} m times n times and let L R m+n be any hyperplane not containing u. Then the restriction of q onto L is strictly positive definite and we consider the Gaussian probability measure on L with the density proportional to e q. Let us define random variables f,h : L R by Let f(s,t) = z ij (z ij +)(2z ij +)(s i +t j ) 3 6 h(s,t) = 24 Then the correction factor is ij and z ij (z ij +) ( zij 2 +6z ij + ) (s i +t j ) 4 ij for (s,t) = (s,...,s m ;t,...,t n ). µ = Ef 2 and ν = Eh. exp { µ } 2 +ν. 9
20 Ramifications: counting - points in polytopes A similar approach works for the set P {,} n of points with - coordinates in P R n, where P is defined by the system { } P = x : Ax = b, x. Here A = (a ij ) is a k n integer matrix of rank k < n and b Z k. Let Λ = A(Z n ) Z k. The geometric distribution is replaced by the Bernoulli distribution and function g(ξ) = (ξ +)ln(ξ +) ξlnξ is replaced by the standard entropy function h(x) = ξln ξ +( ξ)ln ξ for ξ We solve a convex optimization problem: Find max h(x) = x n h(ξ j ) j= Subject to: x = (ξ,...,ξ n ) P. Since h is strictly concave, the maximum point z = (ζ,...,ζ n ) is unique and can be found efficiently by interior point methods, for example. We compute the k d matrix Q = (q ij ) by The Gaussian formula: q ij = n ( a im a jm ζm ζm) 2. m= P {,} n e h(z) detλ (2π) k/2 (detq) /2. 2
Alexander Barvinok and J.A. Hartigan. January 2010
MAXIMUM ENTROPY GAUSSIAN APPROXIMATIONS FOR THE NUMBER OF INTEGER POINTS AND VOLUMES OF POLYTOPES Alexander Barvinok and J.A. Hartigan January 200 We describe a maximum entropy approach for computing volumes
More informationAlexander Barvinok August 2008
WHAT DOES A RANDOM CONTINGENCY TABLE LOOK LIKE? Alexander Barvinok August 2008 Abstract. Let R = (r,..., r m and C = (c,..., c n be positive integer vectors such that r +... + r m = c +... + c n. We consider
More informationHW1 solutions. 1. α Ef(x) β, where Ef(x) is the expected value of f(x), i.e., Ef(x) = n. i=1 p if(a i ). (The function f : R R is given.
HW1 solutions Exercise 1 (Some sets of probability distributions.) Let x be a real-valued random variable with Prob(x = a i ) = p i, i = 1,..., n, where a 1 < a 2 < < a n. Of course p R n lies in the standard
More information1 Maximal Lattice-free Convex Sets
47-831: Advanced Integer Programming Lecturer: Amitabh Basu Lecture 3 Date: 03/23/2010 In this lecture, we explore the connections between lattices of R n and convex sets in R n. The structures will prove
More informationChapter 1. Preliminaries
Introduction This dissertation is a reading of chapter 4 in part I of the book : Integer and Combinatorial Optimization by George L. Nemhauser & Laurence A. Wolsey. The chapter elaborates links between
More informationLinear Algebra Review: Linear Independence. IE418 Integer Programming. Linear Algebra Review: Subspaces. Linear Algebra Review: Affine Independence
Linear Algebra Review: Linear Independence IE418: Integer Programming Department of Industrial and Systems Engineering Lehigh University 21st March 2005 A finite collection of vectors x 1,..., x k R n
More informationKey Things We Learned Last Time. IE418 Integer Programming. Proving Facets Way #2 Indirect. A More Abstract Example
Key Things We Learned Last Time IE48: Integer Programming Department of Industrial and Systems Engineering Lehigh University 8th March 5 A face F is said to be a facet of P if dim(f ) = dim(p ). All facets
More informationLecture 1: Entropy, convexity, and matrix scaling CSE 599S: Entropy optimality, Winter 2016 Instructor: James R. Lee Last updated: January 24, 2016
Lecture 1: Entropy, convexity, and matrix scaling CSE 599S: Entropy optimality, Winter 2016 Instructor: James R. Lee Last updated: January 24, 2016 1 Entropy Since this course is about entropy maximization,
More information3. Vector spaces 3.1 Linear dependence and independence 3.2 Basis and dimension. 5. Extreme points and basic feasible solutions
A. LINEAR ALGEBRA. CONVEX SETS 1. Matrices and vectors 1.1 Matrix operations 1.2 The rank of a matrix 2. Systems of linear equations 2.1 Basic solutions 3. Vector spaces 3.1 Linear dependence and independence
More informationOptimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16: Linear programming. Optimization Problems
Optimization WS 13/14:, by Y. Goldstein/K. Reinert, 9. Dezember 2013, 16:38 2001 Linear programming Optimization Problems General optimization problem max{z(x) f j (x) 0,x D} or min{z(x) f j (x) 0,x D}
More informationNonlinear Programming Models
Nonlinear Programming Models Fabio Schoen 2008 http://gol.dsi.unifi.it/users/schoen Nonlinear Programming Models p. Introduction Nonlinear Programming Models p. NLP problems minf(x) x S R n Standard form:
More informationMathematics 530. Practice Problems. n + 1 }
Department of Mathematical Sciences University of Delaware Prof. T. Angell October 19, 2015 Mathematics 530 Practice Problems 1. Recall that an indifference relation on a partially ordered set is defined
More informationLMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009
LMI MODELLING 4. CONVEX LMI MODELLING Didier HENRION LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ Universidad de Valladolid, SP March 2009 Minors A minor of a matrix F is the determinant of a submatrix
More informationExtreme Abridgment of Boyd and Vandenberghe s Convex Optimization
Extreme Abridgment of Boyd and Vandenberghe s Convex Optimization Compiled by David Rosenberg Abstract Boyd and Vandenberghe s Convex Optimization book is very well-written and a pleasure to read. The
More informationEnumerating integer points in polytopes: applications to number theory. Matthias Beck San Francisco State University math.sfsu.
Enumerating integer points in polytopes: applications to number theory Matthias Beck San Francisco State University math.sfsu.edu/beck It takes a village to count integer points. Alexander Barvinok Outline
More informationThe Triangle Closure is a Polyhedron
The Triangle Closure is a Polyhedron Amitabh Basu Robert Hildebrand Matthias Köppe November 7, 21 Abstract Recently, cutting planes derived from maximal lattice-free convex sets have been studied intensively
More informationTRISTRAM BOGART AND REKHA R. THOMAS
SMALL CHVÁTAL RANK TRISTRAM BOGART AND REKHA R. THOMAS Abstract. We introduce a new measure of complexity of integer hulls of rational polyhedra called the small Chvátal rank (SCR). The SCR of an integer
More informationInteger Quadratic Programming is in NP
Alberto Del Pia 1 Santanu S. Dey 2 Marco Molinaro 2 1 IBM T. J. Watson Research Center, Yorktown Heights. 2 School of Industrial and Systems Engineering, Atlanta Outline 1 4 Program: Definition Definition
More informationSampling Contingency Tables
Sampling Contingency Tables Martin Dyer Ravi Kannan John Mount February 3, 995 Introduction Given positive integers and, let be the set of arrays with nonnegative integer entries and row sums respectively
More informationLinear and non-linear programming
Linear and non-linear programming Benjamin Recht March 11, 2005 The Gameplan Constrained Optimization Convexity Duality Applications/Taxonomy 1 Constrained Optimization minimize f(x) subject to g j (x)
More informationInteger Programming ISE 418. Lecture 12. Dr. Ted Ralphs
Integer Programming ISE 418 Lecture 12 Dr. Ted Ralphs ISE 418 Lecture 12 1 Reading for This Lecture Nemhauser and Wolsey Sections II.2.1 Wolsey Chapter 9 ISE 418 Lecture 12 2 Generating Stronger Valid
More informationEhrhart polynome: how to compute the highest degree coefficients and the knapsack problem.
Ehrhart polynome: how to compute the highest degree coefficients and the knapsack problem. Velleda Baldoni Università di Roma Tor Vergata Optimization, Moment Problems and Geometry I, IMS at NUS, Singapore-
More informationWeighted Ehrhart polynomials and intermediate sums on polyhedra
Weighted Ehrhart polynomials and intermediate sums on polyhedra Nicole BERLINE Centre de mathématiques Laurent Schwartz, Ecole polytechnique, France Inverse Moment Problems NUS-IMS, Dec 17, 2013 with Velleda
More informationCounting with rational generating functions
Counting with rational generating functions Sven Verdoolaege and Kevin Woods May 10, 007 Abstract We examine two different ways of encoding a counting function, as a rational generating function and explicitly
More informationMinimizing Cubic and Homogeneous Polynomials over Integers in the Plane
Minimizing Cubic and Homogeneous Polynomials over Integers in the Plane Alberto Del Pia Department of Industrial and Systems Engineering & Wisconsin Institutes for Discovery, University of Wisconsin-Madison
More informationLattice closures of polyhedra
Lattice closures of polyhedra Sanjeeb Dash IBM Research sanjeebd@us.ibm.com Oktay Günlük IBM Research gunluk@us.ibm.com October 27, 2016 Diego A. Morán R. Universidad Adolfo Ibañez diego.moran@uai.cl Abstract
More information10 Years BADGeometry: Progress and Open Problems in Ehrhart Theory
10 Years BADGeometry: Progress and Open Problems in Ehrhart Theory Matthias Beck (San Francisco State University) math.sfsu.edu/beck Thanks To... 10 Years BADGeometry: Progress and Open Problems in Ehrhart
More informationMAT-INF4110/MAT-INF9110 Mathematical optimization
MAT-INF4110/MAT-INF9110 Mathematical optimization Geir Dahl August 20, 2013 Convexity Part IV Chapter 4 Representation of convex sets different representations of convex sets, boundary polyhedra and polytopes:
More informationA strongly polynomial algorithm for linear systems having a binary solution
A strongly polynomial algorithm for linear systems having a binary solution Sergei Chubanov Institute of Information Systems at the University of Siegen, Germany e-mail: sergei.chubanov@uni-siegen.de 7th
More informationInteger Programming, Part 1
Integer Programming, Part 1 Rudi Pendavingh Technische Universiteit Eindhoven May 18, 2016 Rudi Pendavingh (TU/e) Integer Programming, Part 1 May 18, 2016 1 / 37 Linear Inequalities and Polyhedra Farkas
More informationHermite normal form: Computation and applications
Integer Points in Polyhedra Gennady Shmonin Hermite normal form: Computation and applications February 24, 2009 1 Uniqueness of Hermite normal form In the last lecture, we showed that if B is a rational
More informationARCS IN FINITE PROJECTIVE SPACES. Basic objects and definitions
ARCS IN FINITE PROJECTIVE SPACES SIMEON BALL Abstract. These notes are an outline of a course on arcs given at the Finite Geometry Summer School, University of Sussex, June 26-30, 2017. Let K denote an
More informationGeometry of log-concave Ensembles of random matrices
Geometry of log-concave Ensembles of random matrices Nicole Tomczak-Jaegermann Joint work with Radosław Adamczak, Rafał Latała, Alexander Litvak, Alain Pajor Cortona, June 2011 Nicole Tomczak-Jaegermann
More informationOn John type ellipsoids
On John type ellipsoids B. Klartag Tel Aviv University Abstract Given an arbitrary convex symmetric body K R n, we construct a natural and non-trivial continuous map u K which associates ellipsoids to
More information3. Linear Programming and Polyhedral Combinatorics
Massachusetts Institute of Technology 18.433: Combinatorial Optimization Michel X. Goemans February 28th, 2013 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the introductory
More informationLattices and Hermite normal form
Integer Points in Polyhedra Lattices and Hermite normal form Gennady Shmonin February 17, 2009 1 Lattices Let B = { } b 1,b 2,...,b k be a set of linearly independent vectors in n-dimensional Euclidean
More informationA Criterion for the Stochasticity of Matrices with Specified Order Relations
Rend. Istit. Mat. Univ. Trieste Vol. XL, 55 64 (2009) A Criterion for the Stochasticity of Matrices with Specified Order Relations Luca Bortolussi and Andrea Sgarro Abstract. We tackle the following problem:
More informationThe partial-fractions method for counting solutions to integral linear systems
The partial-fractions method for counting solutions to integral linear systems Matthias Beck, MSRI www.msri.org/people/members/matthias/ arxiv: math.co/0309332 Vector partition functions A an (m d)-integral
More informationIntroduction to Semidefinite Programming I: Basic properties a
Introduction to Semidefinite Programming I: Basic properties and variations on the Goemans-Williamson approximation algorithm for max-cut MFO seminar on Semidefinite Programming May 30, 2010 Semidefinite
More informationLecture 6: Gaussian Channels. Copyright G. Caire (Sample Lectures) 157
Lecture 6: Gaussian Channels Copyright G. Caire (Sample Lectures) 157 Differential entropy (1) Definition 18. The (joint) differential entropy of a continuous random vector X n p X n(x) over R is: Z h(x
More informationLecture 2: Lattices and Bases
CSE 206A: Lattice Algorithms and Applications Spring 2007 Lecture 2: Lattices and Bases Lecturer: Daniele Micciancio Scribe: Daniele Micciancio Motivated by the many applications described in the first
More informationOn mixed-integer sets with two integer variables
On mixed-integer sets with two integer variables Sanjeeb Dash IBM Research sanjeebd@us.ibm.com Santanu S. Dey Georgia Inst. Tech. santanu.dey@isye.gatech.edu September 8, 2010 Oktay Günlük IBM Research
More informationCutting Plane Methods I
6.859/15.083 Integer Programming and Combinatorial Optimization Fall 2009 Cutting Planes Consider max{wx : Ax b, x integer}. Cutting Plane Methods I Establishing the optimality of a solution is equivalent
More informationLattice closures of polyhedra
Lattice closures of polyhedra Sanjeeb Dash IBM Research sanjeebd@us.ibm.com Oktay Günlük IBM Research gunluk@us.ibm.com April 10, 2017 Diego A. Morán R. Universidad Adolfo Ibañez diego.moran@uai.cl Abstract
More informationSupport Vector Machines and Kernel Methods
2018 CS420 Machine Learning, Lecture 3 Hangout from Prof. Andrew Ng. http://cs229.stanford.edu/notes/cs229-notes3.pdf Support Vector Machines and Kernel Methods Weinan Zhang Shanghai Jiao Tong University
More informationCSL361 Problem set 4: Basic linear algebra
CSL361 Problem set 4: Basic linear algebra February 21, 2017 [Note:] If the numerical matrix computations turn out to be tedious, you may use the function rref in Matlab. 1 Row-reduced echelon matrices
More informationMixed-integer linear representability, disjunctions, and variable elimination
Mixed-integer linear representability, disjunctions, and variable elimination Amitabh Basu Kipp Martin Christopher Thomas Ryan Guanyi Wang December 19, 2016 Abstract Jeroslow and Lowe gave an exact geometric
More informationGeometric problems. Chapter Projection on a set. The distance of a point x 0 R n to a closed set C R n, in the norm, is defined as
Chapter 8 Geometric problems 8.1 Projection on a set The distance of a point x 0 R n to a closed set C R n, in the norm, is defined as dist(x 0,C) = inf{ x 0 x x C}. The infimum here is always achieved.
More informationThe Triangle Closure is a Polyhedron
The Triangle Closure is a Polyhedron Amitabh Basu Robert Hildebrand Matthias Köppe January 8, 23 Abstract Recently, cutting planes derived from maximal lattice-free convex sets have been studied intensively
More informationCombinatorial Reciprocity Theorems
Combinatorial Reciprocity Theorems Matthias Beck San Francisco State University math.sfsu.edu/beck Based on joint work with Thomas Zaslavsky Binghamton University (SUNY) In mathematics you don t understand
More informationLecture 22: Section 4.7
Lecture 22: Section 47 Shuanglin Shao December 2, 213 Row Space, Column Space, and Null Space Definition For an m n, a 11 a 12 a 1n a 21 a 22 a 2n A = a m1 a m2 a mn, the vectors r 1 = [ a 11 a 12 a 1n
More informationarxiv:math/ v2 [math.co] 9 Oct 2008
arxiv:math/070866v2 [math.co] 9 Oct 2008 A GENERATING FUNCTION FOR ALL SEMI-MAGIC SQUARES AND THE VOLUME OF THE BIRKHOFF POLYTOPE J.A. DE LOERA, F. LIU, AND R. YOSHIDA Abstract. We present a multivariate
More informationIntroduction to Decision Sciences Lecture 6
Introduction to Decision Sciences Lecture 6 Andrew Nobel September 21, 2017 Functions Functions Given: Sets A and B, possibly different Definition: A function f : A B is a rule that assigns every element
More informationLinear Programming. Larry Blume Cornell University, IHS Vienna and SFI. Summer 2016
Linear Programming Larry Blume Cornell University, IHS Vienna and SFI Summer 2016 These notes derive basic results in finite-dimensional linear programming using tools of convex analysis. Most sources
More informationTop Ehrhart coefficients of integer partition problems
Top Ehrhart coefficients of integer partition problems Jesús A. De Loera Department of Mathematics University of California, Davis Joint Math Meetings San Diego January 2013 Goal: Count the solutions
More informationLattice Point Enumeration via Rational Functions, and Applications to Optimization and Statistics
Lattice Point Enumeration via Rational Functions, and Applications to Optimization and Statistics By Peter Huggins HONORS THESIS Submitted in partial satisfaction of the requirements for the degree of
More informationEE/ACM Applications of Convex Optimization in Signal Processing and Communications Lecture 17
EE/ACM 150 - Applications of Convex Optimization in Signal Processing and Communications Lecture 17 Andre Tkacenko Signal Processing Research Group Jet Propulsion Laboratory May 29, 2012 Andre Tkacenko
More information3. Probability and Statistics
FE661 - Statistical Methods for Financial Engineering 3. Probability and Statistics Jitkomut Songsiri definitions, probability measures conditional expectations correlation and covariance some important
More informationOn the Rational Polytopes with Chvátal Rank 1
On the Rational Polytopes with Chvátal Rank 1 Gérard Cornuéjols Dabeen Lee Yanjun Li December 2016, revised May 2018 Abstract We study the following problem: given a rational polytope with Chvátal rank
More informationConvex Optimization and Modeling
Convex Optimization and Modeling Convex Optimization Fourth lecture, 05.05.2010 Jun.-Prof. Matthias Hein Reminder from last time Convex functions: first-order condition: f(y) f(x) + f x,y x, second-order
More informationMATH 323 Linear Algebra Lecture 12: Basis of a vector space (continued). Rank and nullity of a matrix.
MATH 323 Linear Algebra Lecture 12: Basis of a vector space (continued). Rank and nullity of a matrix. Basis Definition. Let V be a vector space. A linearly independent spanning set for V is called a basis.
More informationCSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming
CSCI 1951-G Optimization Methods in Finance Part 01: Linear Programming January 26, 2018 1 / 38 Liability/asset cash-flow matching problem Recall the formulation of the problem: max w c 1 + p 1 e 1 = 150
More information15.083J/6.859J Integer Optimization. Lecture 10: Solving Relaxations
15.083J/6.859J Integer Optimization Lecture 10: Solving Relaxations 1 Outline The key geometric result behind the ellipsoid method Slide 1 The ellipsoid method for the feasibility problem The ellipsoid
More informationLinear algebra for computational statistics
University of Seoul May 3, 2018 Vector and Matrix Notation Denote 2-dimensional data array (n p matrix) by X. Denote the element in the ith row and the jth column of X by x ij or (X) ij. Denote by X j
More informationLMI Methods in Optimal and Robust Control
LMI Methods in Optimal and Robust Control Matthew M. Peet Arizona State University Lecture 02: Optimization (Convex and Otherwise) What is Optimization? An Optimization Problem has 3 parts. x F f(x) :
More informationCOURSE ON LMI PART I.2 GEOMETRY OF LMI SETS. Didier HENRION henrion
COURSE ON LMI PART I.2 GEOMETRY OF LMI SETS Didier HENRION www.laas.fr/ henrion October 2006 Geometry of LMI sets Given symmetric matrices F i we want to characterize the shape in R n of the LMI set F
More information3. Linear Programming and Polyhedral Combinatorics
Massachusetts Institute of Technology 18.453: Combinatorial Optimization Michel X. Goemans April 5, 2017 3. Linear Programming and Polyhedral Combinatorics Summary of what was seen in the introductory
More information8. Geometric problems
8. Geometric problems Convex Optimization Boyd & Vandenberghe extremal volume ellipsoids centering classification placement and facility location 8 Minimum volume ellipsoid around a set Löwner-John ellipsoid
More informationMinimal inequalities for an infinite relaxation of integer programs
Minimal inequalities for an infinite relaxation of integer programs Amitabh Basu Carnegie Mellon University, abasu1@andrew.cmu.edu Michele Conforti Università di Padova, conforti@math.unipd.it Gérard Cornuéjols
More information[POLS 8500] Review of Linear Algebra, Probability and Information Theory
[POLS 8500] Review of Linear Algebra, Probability and Information Theory Professor Jason Anastasopoulos ljanastas@uga.edu January 12, 2017 For today... Basic linear algebra. Basic probability. Programming
More informationCSCI : Optimization and Control of Networks. Review on Convex Optimization
CSCI7000-016: Optimization and Control of Networks Review on Convex Optimization 1 Convex set S R n is convex if x,y S, λ,µ 0, λ+µ = 1 λx+µy S geometrically: x,y S line segment through x,y S examples (one
More informationIn English, this means that if we travel on a straight line between any two points in C, then we never leave C.
Convex sets In this section, we will be introduced to some of the mathematical fundamentals of convex sets. In order to motivate some of the definitions, we will look at the closest point problem from
More informationNotes on the decomposition result of Karlin et al. [2] for the hierarchy of Lasserre by M. Laurent, December 13, 2012
Notes on the decomposition result of Karlin et al. [2] for the hierarchy of Lasserre by M. Laurent, December 13, 2012 We present the decomposition result of Karlin et al. [2] for the hierarchy of Lasserre
More informationAn algebraic perspective on integer sparse recovery
An algebraic perspective on integer sparse recovery Lenny Fukshansky Claremont McKenna College (joint work with Deanna Needell and Benny Sudakov) Combinatorics Seminar USC October 31, 2018 From Wikipedia:
More informationA Brief Review on Convex Optimization
A Brief Review on Convex Optimization 1 Convex set S R n is convex if x,y S, λ,µ 0, λ+µ = 1 λx+µy S geometrically: x,y S line segment through x,y S examples (one convex, two nonconvex sets): A Brief Review
More informationElementary maths for GMT
Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1
More informationAnalysis and Linear Algebra. Lectures 1-3 on the mathematical tools that will be used in C103
Analysis and Linear Algebra Lectures 1-3 on the mathematical tools that will be used in C103 Set Notation A, B sets AcB union A1B intersection A\B the set of objects in A that are not in B N. Empty set
More informationCommon-Knowledge / Cheat Sheet
CSE 521: Design and Analysis of Algorithms I Fall 2018 Common-Knowledge / Cheat Sheet 1 Randomized Algorithm Expectation: For a random variable X with domain, the discrete set S, E [X] = s S P [X = s]
More informationLecture 1. 1 Conic programming. MA 796S: Convex Optimization and Interior Point Methods October 8, Consider the conic program. min.
MA 796S: Convex Optimization and Interior Point Methods October 8, 2007 Lecture 1 Lecturer: Kartik Sivaramakrishnan Scribe: Kartik Sivaramakrishnan 1 Conic programming Consider the conic program min s.t.
More informationOrganization of a Modern Compiler. Middle1
Organization of a Modern Compiler Source Program Front-end syntax analysis + type-checking + symbol table High-level Intermediate Representation (loops,array references are preserved) Middle1 loop-level
More informationDM559 Linear and Integer Programming. Lecture 2 Systems of Linear Equations. Marco Chiarandini
DM559 Linear and Integer Programming Lecture Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1. Outline 1. 3 A Motivating Example You are organizing
More informationSemidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 2
Semidefinite and Second Order Cone Programming Seminar Fall 2001 Lecture 2 Instructor: Farid Alizadeh Scribe: Xuan Li 9/17/2001 1 Overview We survey the basic notions of cones and cone-lp and give several
More information9. Geometric problems
9. Geometric problems EE/AA 578, Univ of Washington, Fall 2016 projection on a set extremal volume ellipsoids centering classification 9 1 Projection on convex set projection of point x on set C defined
More informationLecture 7: Positive Semidefinite Matrices
Lecture 7: Positive Semidefinite Matrices Rajat Mittal IIT Kanpur The main aim of this lecture note is to prepare your background for semidefinite programming. We have already seen some linear algebra.
More informationDS-GA 1002 Lecture notes 10 November 23, Linear models
DS-GA 2 Lecture notes November 23, 2 Linear functions Linear models A linear model encodes the assumption that two quantities are linearly related. Mathematically, this is characterized using linear functions.
More informationSYMBOL EXPLANATION EXAMPLE
MATH 4310 PRELIM I REVIEW Notation These are the symbols we have used in class, leading up to Prelim I, and which I will use on the exam SYMBOL EXPLANATION EXAMPLE {a, b, c, } The is the way to write the
More informationLecture 3: Lagrangian duality and algorithms for the Lagrangian dual problem
Lecture 3: Lagrangian duality and algorithms for the Lagrangian dual problem Michael Patriksson 0-0 The Relaxation Theorem 1 Problem: find f := infimum f(x), x subject to x S, (1a) (1b) where f : R n R
More information(1) is an invertible sheaf on X, which is generated by the global sections
7. Linear systems First a word about the base scheme. We would lie to wor in enough generality to cover the general case. On the other hand, it taes some wor to state properly the general results if one
More information12. Interior-point methods
12. Interior-point methods Convex Optimization Boyd & Vandenberghe inequality constrained minimization logarithmic barrier function and central path barrier method feasibility and phase I methods complexity
More informationSome Properties of Convex Hulls of Integer Points Contained in General Convex Sets
Some Properties of Convex Hulls of Integer Points Contained in General Convex Sets Santanu S. Dey and Diego A. Morán R. H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute
More informationNonlinear Discrete Optimization
Nonlinear Discrete Optimization Technion Israel Institute of Technology http://ie.technion.ac.il/~onn Billerafest 2008 - conference in honor of Lou Billera's 65th birthday (Update on Lecture Series given
More informationFinite-Dimensional Cones 1
John Nachbar Washington University March 28, 2018 1 Basic Definitions. Finite-Dimensional Cones 1 Definition 1. A set A R N is a cone iff it is not empty and for any a A and any γ 0, γa A. Definition 2.
More informationLecture 1 Introduction
L. Vandenberghe EE236A (Fall 2013-14) Lecture 1 Introduction course overview linear optimization examples history approximate syllabus basic definitions linear optimization in vector and matrix notation
More informationweb: HOMEWORK 1
MAT 207 LINEAR ALGEBRA I 2009207 Dokuz Eylül University, Faculty of Science, Department of Mathematics Instructor: Engin Mermut web: http://kisideuedutr/enginmermut/ HOMEWORK VECTORS IN THE n-dimensional
More informationACO Comprehensive Exam October 18 and 19, Analysis of Algorithms
Consider the following two graph problems: 1. Analysis of Algorithms Graph coloring: Given a graph G = (V,E) and an integer c 0, a c-coloring is a function f : V {1,,...,c} such that f(u) f(v) for all
More informationLinear algebra I Homework #1 due Thursday, Oct. 5
Homework #1 due Thursday, Oct. 5 1. Show that A(5,3,4), B(1,0,2) and C(3, 4,4) are the vertices of a right triangle. 2. Find the equation of the plane that passes through the points A(2,4,3), B(2,3,5),
More informationAlgebraic and Geometric ideas in the theory of Discrete Optimization
Algebraic and Geometric ideas in the theory of Discrete Optimization Jesús A. De Loera, UC Davis Three Lectures based on the book: Algebraic & Geometric Ideas in the Theory of Discrete Optimization (SIAM-MOS
More informationMSRI Summer Graduate Workshop: Algebraic, Geometric, and Combinatorial Methods for Optimization. Part IV
MSRI Summer Graduate Workshop: Algebraic, Geometric, and Combinatorial Methods for Optimization Part IV Geometry of Numbers and Rational Generating Function Techniques for Integer Programming Matthias
More informationMATHEMATICAL PROGRAMMING I
MATHEMATICAL PROGRAMMING I Books There is no single course text, but there are many useful books, some more mathematical, others written at a more applied level. A selection is as follows: Bazaraa, Jarvis
More informationGrothendieck s Inequality
Grothendieck s Inequality Leqi Zhu 1 Introduction Let A = (A ij ) R m n be an m n matrix. Then A defines a linear operator between normed spaces (R m, p ) and (R n, q ), for 1 p, q. The (p q)-norm of A
More information