Minimax Problems. Daniel P. Palomar. Hong Kong University of Science and Technolgy (HKUST)
|
|
- Rosanna York
- 6 years ago
- Views:
Transcription
1 Mini Problems Daniel P. Palomar Hong Kong University of Science and Technolgy (HKUST) ELEC547 - Convex Optimization Fall , HKUST, Hong Kong
2 Outline of Lecture Introduction Matrix games Bilinear problems Robust LP Convex-concave games Lagrange game Summary Daniel P. Palomar 1
3 Introduction Games are optimization problems with more than one decision maker (or player, using the terminology of game theory), often with conflicting goals. The general theory of games is complicated, but some classes of games are closely related to convex optimization and have a nice theory. Game theory goes back to the mid-1990s (1947 book by von Neumann and Morgenstein and Nash theorem in 1950). Daniel P. Palomar 2
4 Foreword by Nash in 2008 JSAC Special Issue Daniel P. Palomar 3
5 Matrix Game A matrix game is a two-player zero-sum discrete game that can be described by a payoff matrix. Player 1 chooses his strategy (index k) to minimize the payoff P kl. Player 2 chooses his strategy (index l) to imize the payoff P kl. Pure strategies: each user is allowed to choose only one strategy. Mixed strategies: each user is allowed to randomize over a set of strategies. Daniel P. Palomar 4
6 Pure-Strategy Matrix Game Player 1 can expect that, for a given choice k, player 2 will choose the largest entry in row k. This means that he has to choose the row with the minimum largest entry: min k l P kl. Similarly, player 2 expects that, for a given choice l, player 1 will choose the smallest entry in column l. He will then choose the column with the imum smalles entry: l min k P kl. But, which one is the correct formulation? Are they the same? Daniel P. Palomar 5
7 Pure-Strategy Matrix Game (II) In general, the two formulations lead to different results. However, we can show that one is smaller than the other. Lemma: l min k P kl min k l P kl. Proof. min ey ex f (x, ỹ) ex min ey f ( x, ỹ) min ey f ( x,y) ex x,y f ( x, ỹ). Daniel P. Palomar 6
8 Pure-Strategy Matrix Game (II) But, in general, for pure-strategy matrix games l min k P kl min k l P kl. This is related to the concept of Nash equilibrium (NE). If the game admits a NE, then l min k P kl = min k l P kl. Nash famous theorem shows that for games with N players, under some conditions, a NE exists. Daniel P. Palomar 7
9 Mixed-Strategy Matrix Game Now consider that each player chooses a strategy with some probability (independent of the other user). Suppose that u and v are the mixed strategies for players 1 and 2. The expected payoff is i,j u i v j P ij = u T Pv. Reasoning as before, player 1 will choose u as the solution to min u v u T Pv s.t. u 0, 1 T u = 1 v 0, 1 T v = 1. Daniel P. Palomar 8
10 Mixed-Strategy Matrix Game (II) Since v u T Pv = i [ P T u ], we can rewrite the problem as i [ min P T u ] u i i s.t. u 0, 1 T u = 1 or, in epigraph form, (P 1 ) minimize t u,t subject to u 0, 1 T u = 1 t1 P T u. Daniel P. Palomar 9
11 Mixed-Strategy Matrix Game (III) Similarly, for player 2 we have (P 2 ) imize u,µ µ subject to v 0, 1 T v = 1 Pv µ1. Since -min min-, p 2 p 1. We can interpret the difference p 1 p 2 as the advantage conferred on a player by knowing the opponent s strategy. Daniel P. Palomar 10
12 Mixed-Strategy Matrix Game (IV) In this case, however, we have a stronger characterization: Theorem: For feasible mixed-strategy matrix games: p 1 = p 2. Proof. Let s find the dual of problem P 1. The Lagrangian is L (t,u; λ, σ, µ) = t + λ T ( P T u t1 ) σ T u µ ( 1 T u 1 ) ( ) = t 1 λ T 1 + (Pλ σ µ1) T u + µ, Daniel P. Palomar 11
13 Mixed-Strategy Matrix Game (V) Proof. (cont d) the dual function is g (λ, σ, µ) = { µ if λ T 1 = 1 and Pλ = σ + µ1 µ1 otherwise, and the dual problem is imize λ,µ µ subject to λ 0, 1 T λ = 1 Pλ µ1 which happens to be problem P 2. The result follows because problems P 1 and P 2 are dual of each other and strong duality holds (since the LPs are feasible). Daniel P. Palomar 12
14 Bilinear Problems Consider the following bilinear problem (more general than the mixed-strategy matrix game): min x s.t. x T Py y Ax b Cy d. Again, -min min-, but do we have equality? In this case, we cannot proceed as before since [ y P T x ]. i i x T Py Daniel P. Palomar 13
15 Bilinear Problems (I) Sometimes, depending on the problem structure, the inner imization can be solved in closed form (like in the application of worst-case robust beamforming design). In general, however, the inner imization does not have a closed form as it is an LP and we know that LPs do not have closed-form solutions (except in particular cases). We can resort to duality to deal with the inner imization y x T Py s.t. Cy d. Daniel P. Palomar 14
16 Bilinear Problems (II) Lemma: The dual problem of the inner imization is min λ s.t. d T λ P T x = c T λ λ 0. Proof. The Lagrangian is L (y;λ) = ( P T x ) T y + λ T (d Cy) = ( P T x C T λ ) T y + d T λ, the dual function is g (λ) = { d T λ if P T x = C T λ otherwise, and the dual problem follows. Daniel P. Palomar 15
17 Bilinear Problems (III) We are now ready to rewrite the mini problem in the more convenient form of a minimization problem: Lemma: The original mini problem (assuming feasibility of the inner imization) can be rewritten as the following LP: (Mini-LP) minimize x,λ subject to d T λ P T x = C T λ λ 0 Ax b. Proof. Since the original problem has a nonempty feasible set, strong duality holds and the primal value is equal to the dual value. Daniel P. Palomar 16
18 Bilinear Problems (IV) Let s deal now with the imin formulation (as opposed to the mini): y s.t. min x T Py x Ax b Cy d. Lemma: The dual problem of the inner minimization is ν b T ν s.t. Py + A T ν = 0 ν 0. Daniel P. Palomar 17
19 Bilinear Problems (V) Lemma: The original imin problem (assuming feasibility of the inner minimization) can be rewritten as the following LP: (Maximin-LP) imize b T ν y,ν subject to Py + A T ν = 0 ν 0 Cy d. So far, we have been able to rewrite the imin and mini problems as LPs. Daniel P. Palomar 18
20 Bilinear Problems (VI) At this point, however, we don t know yet if imin equals mini, which is answered in the next result: Theorem: For feasible bilinear problems: -min = min-. Proof. It follows by showing that (Mini-LP) and (Maximin-LP) are dual of each other and strong duality for feasible LPs. Let s find the dual of (Mini-LP). The Lagrangian is L (x,λ; ν,σ,µ) = d T λ + ν T (Ax b) σ T λ + µ ( T P T x C T λ ) = (d σ Cµ) T λ + ( A T ν + Pµ ) T x b T ν, Daniel P. Palomar 19
21 Bilinear Problems (VII) Proof. (cont d) the dual function is g (ν, σ, µ) = { b T ν if d Cµ = σ 0 and A T ν + Pµ = 0 otherwise, and the dual problem is which is identical to (Maximin-LP). imize b T ν ν,µ subject to Pµ + A T ν = 0 ν 0 d Cµ Daniel P. Palomar 20
22 Robust LP An LP is of the form: minimize c T x x subject to a T i x + b i 0 i = 1,,m. The parameters of the problem c, (a i,b i ) for i = 1,,m are usually assumed to be perfectly known. In real applications, however, there may be uncertainty in these parameters. This leads to robust optimization. We will next consider the case where knowledge of the parameter a i is imperfect: a i A i where the uncertainty set A i is known. Daniel P. Palomar 21
23 Robust LP (I) The uncertainty set can be modeled in different ways, e.g., as an ellipsoid (as in the application of robust beamforming) or as a polyhedron. We will model A i as an affine transformation of a polyhedron: A i = {a i = ā i + B i u i, D i u i d i }. The robust LP (to imperfect knowledge of a i ) is then minimize x subject to c T x sup (ā i + B i u i ) T x + b i 0 i = 1,,m u i U i where U i = {u i D i u i d i }. Daniel P. Palomar 22
24 Robust LP (II) We can now rewrite the robust formulation as minimize c T x x subject to f i (x) 0 i = 1,,m where f i (x) is the optimal value of ( ) imize x T B i ui + ( ā T u i x + b ) i i subject to D i u i d i whose dual problem is minimize z i d T i z i + ( ā T i x + b ) i subject to D T i z i = B T i x z i 0. Daniel P. Palomar 23
25 Robust LP (III) Now, from strong duality, the dual value equals the imum value f i (x). Therefore, we have the following result: Theorem: The robust LP can be rewritten as the following LP: minimize c T x x,{z i } subject to d T i z i + ( ā T i x + b i) 0 i = 1,,m D T i z i = B T i x z i 0. Daniel P. Palomar 24
26 Convex-Concave Games Consider now a more general game where the payoff function is f (x,y) with player 1 minimizing over x and player 2 imizing over y. We already know that y min f (x,y) min x x y f (x,y). We say that (x,y ) is a solution of the game (Nash equilibrium or saddle point) if f (x,y) f (x,y ) f (x,y ) x,y. In words: at a saddle point, neither player can do better by unilaterally changing his strategy. Daniel P. Palomar 25
27 Convex-Concave Games (I) Convex-concave problems have been extensively characterized and we now state two of the nicest results: Lemma: If f is convex-concave (and some other conditions), then a saddle-point exists. Lemma: If a saddle-point exists, then -min = min-. Proof. From the existence of a saddle-point, we have f (x,y ) = min x f (x,y ) y min x f (x,y) as well as f (x,y ) = y f (x,y) min x y f (x,y), Daniel P. Palomar 26
28 Convex-Concave Games (II) Proof. (cont d) which implies y min x f (x,y) min x y f (x,y). This combined with the well-known inequality y min x f (x,y) min x y f (x,y) shows that y min x f (x,y) = min x y f (x,y). Daniel P. Palomar 27
29 Lagrange Game We will now study a very particular game related to Lagrange duality. Consider the Lagrangian of a general optimization problem: L(x;λ) = f 0 (x) + m λ i f i (x). i=1 Observe that sup λ 0 L(x;λ) = { f0 (x) if f i (x) 0 i = 1,,m + otherwise Daniel P. Palomar 28
30 Lagrange Game (I) Therefore, we can express the optimal value of the primal problem as p = inf sup L(x;λ). x λ 0 On the other hand, by definition of dual function (as infimum of the Lagrangian), we have d = sup λ 0 g (λ) = sup λ 0 inf x L(x;λ). Thus, from the fact that -min min-, we have i.e., weak duality holds! d p, Daniel P. Palomar 29
31 Lagrange Game (II) Recall that -min = min- for a convex-concave function. Now, if the primal problem is convex, then the Lagrangian L(x;λ) is convex in x and concave (linear in fact) in λ. Thus (caution: additional assumptions are needed as the dual feasible set is not compact), i.e., strong duality holds. d = p, Daniel P. Palomar 30
32 Summary We have explored mini problems (two-player zero-sum games). In practice, mini formulations appear in robust optimization. In some cases, a saddle-point or Nash equilibrium exists and then -min = min-. Different ways to deal with mini problems: 1) use specific numerical methods for mini problems, 2) solve in closed-form the inner im., 3) rewrite the inner im. as the dual minimiz., 4) use a technique like the S-lemma to get rid of the inner im. Game theory considers the more general and complicated case of N players. Daniel P. Palomar 31
33 References on Mini R. T. Rockafellar, Convex Analysis, 2nd ed. Princeton, NJ: Princeton Univ. Press, D. P. Bertsekas, A. Nedic, and A. E. Ozdaglar, Convex Analysis and Optimization, Athena Scientific, Belmont, MA, Daniel P. Palomar, John M. Cioffi, and Miguel A. Lagunas, Uniform Power Allocation in MIMO Channels: A Game-Theoretic Approach, IEEE Trans. on Information Theory, vol. 49, no. 7, July Antonio Pascual-Iserte, Daniel P. Palomar, Ana Pérez-Neira, Miguel A. Lagunas, A Robust Maximim Approach for MIMO Comm. with Imperfect CSI Based on Convex Optimization, IEEE Trans. on Signal Processing, vol. 54, no. 1, Jan Jiaheng Wang and Daniel P. Palomar, Worst-Case Robust Transmission in MIMO Channels with Imperfect CSIT, IEEE Trans. on Signal Processing, vol. 57, no. 8, pp , Aug Daniel P. Palomar 32
34 References on Game Theory J. Osborne and A. Rubinstein, A Course in Game Theory, MIT Press, Gesualdo Scutari, Daniel P. Palomar, and Sergio Barbarossa, Competitive Design of Multiuser MIMO Systems based on Game Theory: A Unified View, IEEE JSAC: Special Issue on Game Theory, vol. 25, no. 7, Sept Gesualdo Scutari, Daniel P. Palomar, and Sergio Barbarossa, Optimal Linear Precoding Strategies for Wideband Noncooperative Systems Based on Game Theory, IEEE Trans. on Signal Processing, vol. 56, no. 3, March Gesualdo Scutari, Daniel P. Palomar, and Sergio Barbarossa, Asynchronous Iterative Water- Filling for Gaussian Frequency-Selective Interference Channels, IEEE Trans. on Information Theory, vol. 54, no. 7, July Gesualdo Scutari, Daniel P. Palomar, and Sergio Barbarossa, Cognitive MIMO Radio: A Competitive Optimality Design Based on Subspace Projections, IEEE Signal Processing Magazine, Nov Daniel P. Palomar 33
Primal/Dual Decomposition Methods
Primal/Dual Decomposition Methods Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2018-19, HKUST, Hong Kong Outline of Lecture Subgradients
More informationMultiuser Downlink Beamforming: Rank-Constrained SDP
Multiuser Downlink Beamforming: Rank-Constrained SDP Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2018-19, HKUST, Hong Kong Outline of Lecture
More informationLagrange Duality. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST)
Lagrange Duality Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2017-18, HKUST, Hong Kong Outline of Lecture Lagrangian Dual function Dual
More informationGame Theory. Greg Plaxton Theory in Programming Practice, Spring 2004 Department of Computer Science University of Texas at Austin
Game Theory Greg Plaxton Theory in Programming Practice, Spring 2004 Department of Computer Science University of Texas at Austin Bimatrix Games We are given two real m n matrices A = (a ij ), B = (b ij
More informationSum-Power Iterative Watefilling Algorithm
Sum-Power Iterative Watefilling Algorithm Daniel P. Palomar Hong Kong University of Science and Technolgy (HKUST) ELEC547 - Convex Optimization Fall 2009-10, HKUST, Hong Kong November 11, 2009 Outline
More informationPart IB Optimisation
Part IB Optimisation Theorems Based on lectures by F. A. Fischer Notes taken by Dexter Chua Easter 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after
More informationMULTI-INPUT multi-output (MIMO) channels, usually
3086 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 57, NO. 8, AUGUST 2009 Worst-Case Robust MIMO Transmission With Imperfect Channel Knowledge Jiaheng Wang, Student Member, IEEE, and Daniel P. Palomar,
More informationOptimality, Duality, Complementarity for Constrained Optimization
Optimality, Duality, Complementarity for Constrained Optimization Stephen Wright University of Wisconsin-Madison May 2014 Wright (UW-Madison) Optimality, Duality, Complementarity May 2014 1 / 41 Linear
More informationApplications of Robust Optimization in Signal Processing: Beamforming and Power Control Fall 2012
Applications of Robust Optimization in Signal Processing: Beamforg and Power Control Fall 2012 Instructor: Farid Alizadeh Scribe: Shunqiao Sun 12/09/2012 1 Overview In this presentation, we study the applications
More informationZero-Sum Games Public Strategies Minimax Theorem and Nash Equilibria Appendix. Zero-Sum Games. Algorithmic Game Theory.
Public Strategies Minimax Theorem and Nash Equilibria Appendix 2013 Public Strategies Minimax Theorem and Nash Equilibria Appendix Definition Definition A zero-sum game is a strategic game, in which for
More informationEnhanced Fritz John Optimality Conditions and Sensitivity Analysis
Enhanced Fritz John Optimality Conditions and Sensitivity Analysis Dimitri P. Bertsekas Laboratory for Information and Decision Systems Massachusetts Institute of Technology March 2016 1 / 27 Constrained
More informationConvex Optimization and Modeling
Convex Optimization and Modeling Duality Theory and Optimality Conditions 5th lecture, 12.05.2010 Jun.-Prof. Matthias Hein Program of today/next lecture Lagrangian and duality: the Lagrangian the dual
More informationLECTURE 10 LECTURE OUTLINE
LECTURE 10 LECTURE OUTLINE Min Common/Max Crossing Th. III Nonlinear Farkas Lemma/Linear Constraints Linear Programming Duality Convex Programming Duality Optimality Conditions Reading: Sections 4.5, 5.1,5.2,
More informationIntroduction to Convex Optimization
Introduction to Convex Optimization Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2018-19, HKUST, Hong Kong Outline of Lecture Optimization
More informationECE Optimization for wireless networks Final. minimize f o (x) s.t. Ax = b,
ECE 788 - Optimization for wireless networks Final Please provide clear and complete answers. PART I: Questions - Q.. Discuss an iterative algorithm that converges to the solution of the problem minimize
More informationGame Theoretic Solutions for Precoding Strategies over the Interference Channel
Game Theoretic Solutions for Precoding Strategies over the Interference Channel Jie Gao, Sergiy A. Vorobyov, and Hai Jiang Department of Electrical & Computer Engineering, University of Alberta, Canada
More informationOptimization for Communications and Networks. Poompat Saengudomlert. Session 4 Duality and Lagrange Multipliers
Optimization for Communications and Networks Poompat Saengudomlert Session 4 Duality and Lagrange Multipliers P Saengudomlert (2015) Optimization Session 4 1 / 14 24 Dual Problems Consider a primal convex
More informationToday: Linear Programming (con t.)
Today: Linear Programming (con t.) COSC 581, Algorithms April 10, 2014 Many of these slides are adapted from several online sources Reading Assignments Today s class: Chapter 29.4 Reading assignment for
More informationDuality. Geoff Gordon & Ryan Tibshirani Optimization /
Duality Geoff Gordon & Ryan Tibshirani Optimization 10-725 / 36-725 1 Duality in linear programs Suppose we want to find lower bound on the optimal value in our convex problem, B min x C f(x) E.g., consider
More informationCourse Notes for EE227C (Spring 2018): Convex Optimization and Approximation
Course otes for EE7C (Spring 018): Conve Optimization and Approimation Instructor: Moritz Hardt Email: hardt+ee7c@berkeley.edu Graduate Instructor: Ma Simchowitz Email: msimchow+ee7c@berkeley.edu October
More informationAlternative Decompositions for Distributed Maximization of Network Utility: Framework and Applications
Alternative Decompositions for Distributed Maximization of Network Utility: Framework and Applications Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization
More information6.254 : Game Theory with Engineering Applications Lecture 7: Supermodular Games
6.254 : Game Theory with Engineering Applications Lecture 7: Asu Ozdaglar MIT February 25, 2010 1 Introduction Outline Uniqueness of a Pure Nash Equilibrium for Continuous Games Reading: Rosen J.B., Existence
More informationLecture 7: Weak Duality
EE 227A: Conve Optimization and Applications February 7, 2012 Lecture 7: Weak Duality Lecturer: Laurent El Ghaoui 7.1 Lagrange Dual problem 7.1.1 Primal problem In this section, we consider a possibly
More informationThe Lagrangian L : R d R m R r R is an (easier to optimize) lower bound on the original problem:
HT05: SC4 Statistical Data Mining and Machine Learning Dino Sejdinovic Department of Statistics Oxford Convex Optimization and slides based on Arthur Gretton s Advanced Topics in Machine Learning course
More informationConvex Optimization M2
Convex Optimization M2 Lecture 3 A. d Aspremont. Convex Optimization M2. 1/49 Duality A. d Aspremont. Convex Optimization M2. 2/49 DMs DM par email: dm.daspremont@gmail.com A. d Aspremont. Convex Optimization
More informationprinceton univ. F 13 cos 521: Advanced Algorithm Design Lecture 17: Duality and MinMax Theorem Lecturer: Sanjeev Arora
princeton univ F 13 cos 521: Advanced Algorithm Design Lecture 17: Duality and MinMax Theorem Lecturer: Sanjeev Arora Scribe: Today we first see LP duality, which will then be explored a bit more in the
More informationLagrange duality. The Lagrangian. We consider an optimization program of the form
Lagrange duality Another way to arrive at the KKT conditions, and one which gives us some insight on solving constrained optimization problems, is through the Lagrange dual. The dual is a maximization
More informationMIMO Cognitive Radio: A Game Theoretical Approach Gesualdo Scutari, Member, IEEE, and Daniel P. Palomar, Senior Member, IEEE
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 58, NO. 2, FEBRUARY 2010 761 MIMO Cognitive Radio: A Game Theoretical Approach Gesualdo Scutari, Member, IEEE, and Daniel P. Palomar, Senior Member, IEEE Abstract
More informationTheory and Internet Protocols
Game Lecture 2: Linear Programming and Zero Sum Nash Equilibrium Xiaotie Deng AIMS Lab Department of Computer Science Shanghai Jiaotong University September 26, 2016 1 2 3 4 Standard Form (P) Outline
More informationConvex Functions. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST)
Convex Functions Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2017-18, HKUST, Hong Kong Outline of Lecture Definition convex function Examples
More informationGame Theory and its Applications to Networks - Part I: Strict Competition
Game Theory and its Applications to Networks - Part I: Strict Competition Corinne Touati Master ENS Lyon, Fall 200 What is Game Theory and what is it for? Definition (Roger Myerson, Game Theory, Analysis
More informationLecture 10: Duality in Linear Programs
10-725/36-725: Convex Optimization Spring 2015 Lecture 10: Duality in Linear Programs Lecturer: Ryan Tibshirani Scribes: Jingkun Gao and Ying Zhang Disclaimer: These notes have not been subjected to the
More informationNear-Potential Games: Geometry and Dynamics
Near-Potential Games: Geometry and Dynamics Ozan Candogan, Asuman Ozdaglar and Pablo A. Parrilo January 29, 2012 Abstract Potential games are a special class of games for which many adaptive user dynamics
More informationConvex Optimization & Lagrange Duality
Convex Optimization & Lagrange Duality Chee Wei Tan CS 8292 : Advanced Topics in Convex Optimization and its Applications Fall 2010 Outline Convex optimization Optimality condition Lagrange duality KKT
More informationConvex Optimization Theory. Chapter 5 Exercises and Solutions: Extended Version
Convex Optimization Theory Chapter 5 Exercises and Solutions: Extended Version Dimitri P. Bertsekas Massachusetts Institute of Technology Athena Scientific, Belmont, Massachusetts http://www.athenasc.com
More informationEE364a Review Session 5
EE364a Review Session 5 EE364a Review announcements: homeworks 1 and 2 graded homework 4 solutions (check solution to additional problem 1) scpd phone-in office hours: tuesdays 6-7pm (650-723-1156) 1 Complementary
More informationDuality in Linear Programs. Lecturer: Ryan Tibshirani Convex Optimization /36-725
Duality in Linear Programs Lecturer: Ryan Tibshirani Convex Optimization 10-725/36-725 1 Last time: proximal gradient descent Consider the problem x g(x) + h(x) with g, h convex, g differentiable, and
More informationNonlinear Programming
Nonlinear Programming Kees Roos e-mail: C.Roos@ewi.tudelft.nl URL: http://www.isa.ewi.tudelft.nl/ roos LNMB Course De Uithof, Utrecht February 6 - May 8, A.D. 2006 Optimization Group 1 Outline for week
More informationConvex Optimization, Game Theory, and Variational Inequality Theory in Multiuser Communication Systems
Convex Optimization, Game Theory, and Variational Inequality Theory in Multiuser Communication Systems Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) Gesualdo Scutari State University
More informationAlgorithmic Game Theory and Applications. Lecture 4: 2-player zero-sum games, and the Minimax Theorem
Algorithmic Game Theory and Applications Lecture 4: 2-player zero-sum games, and the Minimax Theorem Kousha Etessami 2-person zero-sum games A finite 2-person zero-sum (2p-zs) strategic game Γ, is a strategic
More informationLecture 6: Conic Optimization September 8
IE 598: Big Data Optimization Fall 2016 Lecture 6: Conic Optimization September 8 Lecturer: Niao He Scriber: Juan Xu Overview In this lecture, we finish up our previous discussion on optimality conditions
More informationPolynomial games and sum of squares optimization
Proceedings of the 45th IEEE Conference on Decision & Control Manchester Grand Hyatt Hotel San Diego, CA, USA, December 13-15, 2006 Polynomial games and sum of squares optimization Pablo A Parrilo Laboratory
More informationIEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 26, NO. 7, SEPTEMBER
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 26, NO. 7, SEPTEMBER 2008 1089 Competitive Design of Multiuser MIMO Systems Based on Game Theory: A Unified View Gesualdo Scutari, Member, IEEE, Daniel
More informationDuality (Continued) min f ( x), X R R. Recall, the general primal problem is. The Lagrangian is a function. defined by
Duality (Continued) Recall, the general primal problem is min f ( x), xx g( x) 0 n m where X R, f : X R, g : XR ( X). he Lagrangian is a function L: XR R m defined by L( xλ, ) f ( x) λ g( x) Duality (Continued)
More informationNash Bargaining in Beamforming Games with Quantized CSI in Two-user Interference Channels
Nash Bargaining in Beamforming Games with Quantized CSI in Two-user Interference Channels Jung Hoon Lee and Huaiyu Dai Department of Electrical and Computer Engineering, North Carolina State University,
More informationUniform Power Allocation in MIMO Channels: A Game-Theoretic Approach
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 49, NO. 7, JULY 2003 1707 Uniform Power Allocation in MIMO Channels: A Game-Theoretic Approach Daniel Pérez Palomar, Student Member, IEEE, John M. Cioffi,
More informationMassachusetts Institute of Technology 6.854J/18.415J: Advanced Algorithms Friday, March 18, 2016 Ankur Moitra. Problem Set 6
Massachusetts Institute of Technology 6.854J/18.415J: Advanced Algorithms Friday, March 18, 2016 Ankur Moitra Problem Set 6 Due: Wednesday, April 6, 2016 7 pm Dropbox Outside Stata G5 Collaboration policy:
More informationOptimum Power Allocation in Fading MIMO Multiple Access Channels with Partial CSI at the Transmitters
Optimum Power Allocation in Fading MIMO Multiple Access Channels with Partial CSI at the Transmitters Alkan Soysal Sennur Ulukus Department of Electrical and Computer Engineering University of Maryland,
More informationOptimal Linear Precoding Strategies for Wideband Non-Cooperative Systems based on Game Theory-Part II: Algorithms
Optimal Linear Precoding Strategies for Wideband Non-Cooperative Systems based on Game Theory-Part II: Algorithms Gesualdo Scutari 1, Daniel P. Palomar 2, and Sergio Barbarossa 1 E-mail: {scutari,sergio}@infocom.uniroma1.it,
More information6.254 : Game Theory with Engineering Applications Lecture 8: Supermodular and Potential Games
6.254 : Game Theory with Engineering Applications Lecture 8: Supermodular and Asu Ozdaglar MIT March 2, 2010 1 Introduction Outline Review of Supermodular Games Reading: Fudenberg and Tirole, Section 12.3.
More informationNear-Potential Games: Geometry and Dynamics
Near-Potential Games: Geometry and Dynamics Ozan Candogan, Asuman Ozdaglar and Pablo A. Parrilo September 6, 2011 Abstract Potential games are a special class of games for which many adaptive user dynamics
More informationPower Control via Stackelberg Game for Small-Cell Networks
1 Power Control via Stacelberg Game for Small-Cell Networs Yanxiang Jiang, Member, IEEE, Hui Ge, Mehdi Bennis, Senior Member, IEEE, Fu-Chun Zheng, Senior Member, IEEE, and Xiaohu You, Fellow, IEEE arxiv:1802.04775v1
More informationDuality, Achievable Rates, and Sum-Rate Capacity of Gaussian MIMO Broadcast Channels
2658 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 49, NO 10, OCTOBER 2003 Duality, Achievable Rates, and Sum-Rate Capacity of Gaussian MIMO Broadcast Channels Sriram Vishwanath, Student Member, IEEE, Nihar
More informationConvex Optimization Theory. Chapter 4 Exercises and Solutions: Extended Version
Convex Optimization Theory Chapter 4 Exercises and Solutions: Extended Version Dimitri P. Bertsekas Massachusetts Institute of Technology Athena Scientific, Belmont, Massachusetts http://www.athenasc.com
More informationLectures 6, 7 and part of 8
Lectures 6, 7 and part of 8 Uriel Feige April 26, May 3, May 10, 2015 1 Linear programming duality 1.1 The diet problem revisited Recall the diet problem from Lecture 1. There are n foods, m nutrients,
More informationConvex Optimization Boyd & Vandenberghe. 5. Duality
5. Duality Convex Optimization Boyd & Vandenberghe Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized
More informationDuality. Lagrange dual problem weak and strong duality optimality conditions perturbation and sensitivity analysis generalized inequalities
Duality Lagrange dual problem weak and strong duality optimality conditions perturbation and sensitivity analysis generalized inequalities Lagrangian Consider the optimization problem in standard form
More informationJørgen Tind, Department of Statistics and Operations Research, University of Copenhagen, Universitetsparken 5, 2100 Copenhagen O, Denmark.
DUALITY THEORY Jørgen Tind, Department of Statistics and Operations Research, University of Copenhagen, Universitetsparken 5, 2100 Copenhagen O, Denmark. Keywords: Duality, Saddle point, Complementary
More informationNetwork Calculus. A General Framework for Interference Management and Resource Allocation. Martin Schubert
Network Calculus A General Framework for Interference Management and Resource Allocation Martin Schubert Fraunhofer Institute for Telecommunications HHI, Berlin, Germany Fraunhofer German-Sino Lab for
More informationA Unified Analysis of Nonconvex Optimization Duality and Penalty Methods with General Augmenting Functions
A Unified Analysis of Nonconvex Optimization Duality and Penalty Methods with General Augmenting Functions Angelia Nedić and Asuman Ozdaglar April 16, 2006 Abstract In this paper, we study a unifying framework
More informationZero sum games Proving the vn theorem. Zero sum games. Roberto Lucchetti. Politecnico di Milano
Politecnico di Milano General form Definition A two player zero sum game in strategic form is the triplet (X, Y, f : X Y R) f (x, y) is what Pl1 gets from Pl2, when they play x, y respectively. Thus g
More informationOn the relation between concavity cuts and the surrogate dual for convex maximization problems
On the relation between concavity cuts and the surrogate dual for convex imization problems Marco Locatelli Dipartimento di Ingegneria Informatica, Università di Parma Via G.P. Usberti, 181/A, 43124 Parma,
More informationHow to Take the Dual of a Linear Program
How to Take the Dual of a Linear Program Sébastien Lahaie January 12, 2015 This is a revised version of notes I wrote several years ago on taking the dual of a linear program (LP), with some bug and typo
More informationGame Theory: Lecture 2
Game Theory: Lecture 2 Tai-Wei Hu June 29, 2011 Outline Two-person zero-sum games normal-form games Minimax theorem Simplex method 1 2-person 0-sum games 1.1 2-Person Normal Form Games A 2-person normal
More information14. Duality. ˆ Upper and lower bounds. ˆ General duality. ˆ Constraint qualifications. ˆ Counterexample. ˆ Complementary slackness.
CS/ECE/ISyE 524 Introduction to Optimization Spring 2016 17 14. Duality ˆ Upper and lower bounds ˆ General duality ˆ Constraint qualifications ˆ Counterexample ˆ Complementary slackness ˆ Examples ˆ Sensitivity
More informationORIE 6300 Mathematical Programming I August 25, Lecture 2
ORIE 6300 Mathematical Programming I August 25, 2016 Lecturer: Damek Davis Lecture 2 Scribe: Johan Bjorck Last time, we considered the dual of linear programs in our basic form: max(c T x : Ax b). We also
More informationLinear and non-linear programming
Linear and non-linear programming Benjamin Recht March 11, 2005 The Gameplan Constrained Optimization Convexity Duality Applications/Taxonomy 1 Constrained Optimization minimize f(x) subject to g j (x)
More informationCompetitive Design of Multiuser MIMO Systems based on Game Theory: A Unified View
JOURNAL OF SELECTED AREAS IN COMMUNICATIONS, VOL.?, NO.?, SEPTEMBER 2008 1 Competitive Design of Multiuser MIMO Systems based on Game Theory: A Unified View Gesualdo Scutari, Member, IEEE, Daniel P. Palomar,
More informationDistributed power allocation for D2D communications underlaying/overlaying OFDMA cellular networks
Distributed power allocation for D2D communications underlaying/overlaying OFDMA cellular networks Marco Moretti, Andrea Abrardo Dipartimento di Ingegneria dell Informazione, University of Pisa, Italy
More informationOperations Research Letters
Operations Research Letters 37 (2009) 1 6 Contents lists available at ScienceDirect Operations Research Letters journal homepage: www.elsevier.com/locate/orl Duality in robust optimization: Primal worst
More informationChapter 2: Linear Programming Basics. (Bertsimas & Tsitsiklis, Chapter 1)
Chapter 2: Linear Programming Basics (Bertsimas & Tsitsiklis, Chapter 1) 33 Example of a Linear Program Remarks. minimize 2x 1 x 2 + 4x 3 subject to x 1 + x 2 + x 4 2 3x 2 x 3 = 5 x 3 + x 4 3 x 1 0 x 3
More informationOptimization for Machine Learning
Optimization for Machine Learning (Problems; Algorithms - A) SUVRIT SRA Massachusetts Institute of Technology PKU Summer School on Data Science (July 2017) Course materials http://suvrit.de/teaching.html
More informationJoint FEC Encoder and Linear Precoder Design for MIMO Systems with Antenna Correlation
Joint FEC Encoder and Linear Precoder Design for MIMO Systems with Antenna Correlation Chongbin Xu, Peng Wang, Zhonghao Zhang, and Li Ping City University of Hong Kong 1 Outline Background Mutual Information
More informationSHARING a common frequency band using multiple carriers
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 25, NO. 6, AUGUST 2007 1091 Convergence of Iterative Waterfilling Algorithm for Gaussian Interference Channels Kenneth W. Shum, Member IEEE, Kin-Kwong
More informationSpectrum Sharing Games on the Interference Channel
Spectrum Sharing Games on the Interference Channel Mehdi Bennis +, Mael Le Treust, Samson Lasaulce, Merouane Debbah and Jorma Lilleberg + Centre for Wireless Communications, University of Oulu, Oulu, Finland
More informationLINEAR PROGRAMMING III
LINEAR PROGRAMMING III ellipsoid algorithm combinatorial optimization matrix games open problems Lecture slides by Kevin Wayne Last updated on 7/25/17 11:09 AM LINEAR PROGRAMMING III ellipsoid algorithm
More informationQoS Constrained Robust MIMO Transceiver Design Under Unknown Interference
2012 7th International ICST Conference on Communications and Networking in China CHINACOM) 1 os Constrained Robust MIMO Transceiver Design Under Unknown Interference Xin He, Jianwu Chen, and Yik-Chung
More informationHandout 8: Dealing with Data Uncertainty
MFE 5100: Optimization 2015 16 First Term Handout 8: Dealing with Data Uncertainty Instructor: Anthony Man Cho So December 1, 2015 1 Introduction Conic linear programming CLP, and in particular, semidefinite
More informationEE/AA 578, Univ of Washington, Fall Duality
7. Duality EE/AA 578, Univ of Washington, Fall 2016 Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized
More informationLecture 9 Tuesday, 4/20/10. Linear Programming
UMass Lowell Computer Science 91.503 Analysis of Algorithms Prof. Karen Daniels Spring, 2010 Lecture 9 Tuesday, 4/20/10 Linear Programming 1 Overview Motivation & Basics Standard & Slack Forms Formulating
More informationExtended Monotropic Programming and Duality 1
March 2006 (Revised February 2010) Report LIDS - 2692 Extended Monotropic Programming and Duality 1 by Dimitri P. Bertsekas 2 Abstract We consider the problem minimize f i (x i ) subject to x S, where
More informationMotivating examples Introduction to algorithms Simplex algorithm. On a particular example General algorithm. Duality An application to game theory
Instructor: Shengyu Zhang 1 LP Motivating examples Introduction to algorithms Simplex algorithm On a particular example General algorithm Duality An application to game theory 2 Example 1: profit maximization
More informationA Geometric Framework for Nonconvex Optimization Duality using Augmented Lagrangian Functions
A Geometric Framework for Nonconvex Optimization Duality using Augmented Lagrangian Functions Angelia Nedić and Asuman Ozdaglar April 15, 2006 Abstract We provide a unifying geometric framework for the
More informationHW1 solutions. 1. α Ef(x) β, where Ef(x) is the expected value of f(x), i.e., Ef(x) = n. i=1 p if(a i ). (The function f : R R is given.
HW1 solutions Exercise 1 (Some sets of probability distributions.) Let x be a real-valued random variable with Prob(x = a i ) = p i, i = 1,..., n, where a 1 < a 2 < < a n. Of course p R n lies in the standard
More informationLecture: Duality.
Lecture: Duality http://bicmr.pku.edu.cn/~wenzw/opt-2016-fall.html Acknowledgement: this slides is based on Prof. Lieven Vandenberghe s lecture notes Introduction 2/35 Lagrange dual problem weak and strong
More informationClassification and Support Vector Machine
Classification and Support Vector Machine Yiyong Feng and Daniel P. Palomar The Hong Kong University of Science and Technology (HKUST) ELEC 5470 - Convex Optimization Fall 2017-18, HKUST, Hong Kong Outline
More informationMS-E2140. Lecture 1. (course book chapters )
Linear Programming MS-E2140 Motivations and background Lecture 1 (course book chapters 1.1-1.4) Linear programming problems and examples Problem manipulations and standard form Graphical representation
More informationLecture 7 Duality II
L. Vandenberghe EE236A (Fall 2013-14) Lecture 7 Duality II sensitivity analysis two-person zero-sum games circuit interpretation 7 1 Sensitivity analysis purpose: extract from the solution of an LP information
More informationLecture Notes 3: Duality
Algorithmic Methods 1/11/21 Professor: Yossi Azar Lecture Notes 3: Duality Scribe:Moran Bar-Gat 1 Introduction In this lecture we will present the dual concept, Farkas s Lema and their relation to the
More information5. Duality. Lagrangian
5. Duality Convex Optimization Boyd & Vandenberghe Lagrange dual problem weak and strong duality geometric interpretation optimality conditions perturbation and sensitivity analysis examples generalized
More informationAlgorithmic Game Theory and Applications. Lecture 7: The LP Duality Theorem
Algorithmic Game Theory and Applications Lecture 7: The LP Duality Theorem Kousha Etessami recall LP s in Primal Form 1 Maximize c 1 x 1 + c 2 x 2 +... + c n x n a 1,1 x 1 + a 1,2 x 2 +... + a 1,n x n
More informationApplications of Linear Programming
Applications of Linear Programming lecturer: András London University of Szeged Institute of Informatics Department of Computational Optimization Lecture 9 Non-linear programming In case of LP, the goal
More informationThe Relation Between Pseudonormality and Quasiregularity in Constrained Optimization 1
October 2003 The Relation Between Pseudonormality and Quasiregularity in Constrained Optimization 1 by Asuman E. Ozdaglar and Dimitri P. Bertsekas 2 Abstract We consider optimization problems with equality,
More informationA Robust von Neumann Minimax Theorem for Zero-Sum Games under Bounded Payoff Uncertainty
A Robust von Neumann Minimax Theorem for Zero-Sum Games under Bounded Payoff Uncertainty V. Jeyakumar, G.Y. Li and G. M. Lee Revised Version: January 20, 2011 Abstract The celebrated von Neumann minimax
More informationA Review of Linear Programming
A Review of Linear Programming Instructor: Farid Alizadeh IEOR 4600y Spring 2001 February 14, 2001 1 Overview In this note we review the basic properties of linear programming including the primal simplex
More informationDuality. for The New Palgrave Dictionary of Economics, 2nd ed. Lawrence E. Blume
Duality for The New Palgrave Dictionary of Economics, 2nd ed. Lawrence E. Blume Headwords: CONVEXITY, DUALITY, LAGRANGE MULTIPLIERS, PARETO EFFICIENCY, QUASI-CONCAVITY 1 Introduction The word duality is
More informationIntroduction to Convex Analysis Microeconomics II - Tutoring Class
Introduction to Convex Analysis Microeconomics II - Tutoring Class Professor: V. Filipe Martins-da-Rocha TA: Cinthia Konichi April 2010 1 Basic Concepts and Results This is a first glance on basic convex
More informationSecond-order cone programming formulation for two player zero-sum game with chance constraints
Second-order cone programming formulation for two player zero-sum game with chance constraints Vikas Vikram Singh a, Abdel Lisser a a Laboratoire de Recherche en Informatique Université Paris Sud, 91405
More informationminimize x x2 2 x 1x 2 x 1 subject to x 1 +2x 2 u 1 x 1 4x 2 u 2, 5x 1 +76x 2 1,
4 Duality 4.1 Numerical perturbation analysis example. Consider the quadratic program with variables x 1, x 2, and parameters u 1, u 2. minimize x 2 1 +2x2 2 x 1x 2 x 1 subject to x 1 +2x 2 u 1 x 1 4x
More informationLagrangian Duality and Convex Optimization
Lagrangian Duality and Convex Optimization David Rosenberg New York University February 11, 2015 David Rosenberg (New York University) DS-GA 1003 February 11, 2015 1 / 24 Introduction Why Convex Optimization?
More information