Lecture 1. Stochastic Optimization: Introduction. January 8, 2018
|
|
- Cory Bond
- 5 years ago
- Views:
Transcription
1 Lecture 1 Stochastic Optimization: Introduction January 8, 2018
2 Optimization Concerned with mininmization/maximization of mathematical functions Often subject to constraints Euler ( ): Nothing at all takes place in the universe in which some rule of the maximum or minimum does not apply. Important tool in the analysis/design/control/simulation of physical, economic, chemical and biological systems Model apply algorithm check solution Stochastic Optimization 1
3 Unconstrained optimization Unconstrained X is defined as X R n minimize x R n f(x) Examples: f(x) = x 3 3x 2. Important application: Data fitting and regression Stochastic Optimization 2
4 Unconstrained optimization: An example Given a data set {y i, x i1,..., x ip } n p=1 (n records, with the dependent variable y i and independent variable x i1,..., x ip ). The linear regression model assumes that the relationship between the dependent variable y and the independent variables x i is linear. This relation is captured as follows: y i = x i0 + p j=1 β p x ip + ɛ i, i = 1,..., n where ɛ i denotes a random variable. More compactly, we may state this as follows: y = Xβ + ɛ, where y y 1. y n, X x T 1. x T n. Stochastic Optimization 3
5 Then the least-squares estimator β is defined as follows: β = argmin β Xβ y 2. Stochastic Optimization 4
6 Convex optimization Convex minimize x R n f(x) subject to x X, where X is a convex set and f is a convex function. Definition 1 (Convexity of sets and functions) A set X R n is a convex set if x 1, x 2 X then (λx 1 + (1 λ)x 2 ) X for all λ [0, 1]. A function f is said to be convex if f(λx 1 + (1 λ)x 2 ) λf(x 1 ) + (1 λ)f(x 2 ), λ [0, 1]. Stochastic Optimization 5
7 A function f is said to be strictly convex if f(λx 1 + (1 λ)x 2 ) < λf(x 1 ) + (1 λ)f(x 2 ), λ [0, 1]. A function f is said to be strongly convex with parameter µ if f(λx 1 +(1 λ)x 2 ) λf(x 1 )+(1 λ)f(x 2 ) 1 2 µλ(1 λ) x 1 x 2 2, λ [0, 1] Note that in the above definition f does not need to be differentiable. Definition 2 (Convexity of differentiable functions) Consider a differentiable function f : R n R. A function f is said to be convex if f(x 2 ) f(x 1 ) + x f(x 1 ) T (x 2 x 1 ), x 1, x 2 R n. Stochastic Optimization 6
8 A function f is said to be strongly convex with parameter µ if ( x f(x 1 ) x f(x 2 )) T (x 1 x 2 ) µ x 1 x 2 2, x 1, x 2 R n. Any local solution of (Convex) is a global solution Examples of convex sets: 1. Linear constraints: X {x : Ax = b, x 0} 2. Convex quadratic constraints: X {x : N i=1 (x i a i ) 2 b}. Examples of convex functions: 1. f(x) = e x. 2. f(x) = 1 2 xt Qx + c T x, where Q 0. Application: Controller design, constrained least-squares, etc. Stochastic Optimization 7
9 Nonlinear program NLP minimize x X f(x) f : Objective function is a possibly nonconvex function x R n : Decision variables X R n is a possibly nonconvex set f : X R Applications: Nonlinear regression, process control in chemical engineering, etc.: Stochastic Optimization 8
10 Discrete optimization Discrete minimize x R n f(x) subject to x Z. Z is a finite set implying that x can take on discrete values e.g. x {0, 1}. Sometimes x 1 R, x 2 {0, 1}; the resulting problem is called a mixed-integer problem Applications: facility location problems, unit commitment problems Stochastic Optimization 9
11 Convex optimization relevance in this course Stochastic optimization captures a broad class of problems, including convex, nonconvex (time permitting), and discrete optimization problems (not considered here). In this course, we focus on the following: Convex stochastic optimization problems (including stochastic programs with recourse) Monotone stochastic variational inequality problems (subsumes stochastic convex optimization and captures stochastic Nash games, stochastic contact problems, stochastic traffic equilibrium problems) Robust optimization problems Applications: Statistical learning problems Convexity is crucial and will be leveraged extensively during the course!! Stochastic Optimization 10
12 Problems complicated by uncertainty In the aforementioned (deterministic) problems, parameters are known with certainty. Specifically, given a function f(x; ξ), we consider two possibilities: ξ is a random variable. Our focus is then on solving the following: min x X E[f(x, ξ)] (Stoch-Opt) ξ is unavailable and instead we have that ξ U (where U is an uncertainty set). A problem of interest is then: min x X max ξ U f(x, ξ) (Robust-Opt) Stochastic Optimization 11
13 We motivate this line of questioning by considering the classical newsvendor problem Stochastic Optimization 12
14 A short detour Probability Spaces Throughout this course, we will be utilizing the notion of a probability space (Ω, F, P). This mathematical construct captures processes (either real or synthetic) that are characterized by randomness. This space is constructed for a particular such process and on every occasion this process is examined, both the set of outcomes and the associated probabilities are the same. The sample-space Ω is a nonempty set that denotes the set of outcomes. This represents a single execution of the experiment. The σ-algebra F denotes the set of events where each event is a set containing zero or more outcomes. Stochastic Optimization 13
15 The assigmnent of probabilities to the events is captured by P. Once the space (Ω, F, P) is established, then nature selects an outcome ω from Ω. As a consequence, all events that contain ω as one of its outcomes are said to have occurred. If nature selects outcomes infinitely often, then the relative frequencies of occurrence of a particular event corresponds with the value specified by the probability measure P. Stochastic Optimization 14
16 Properties of F: Ω F F closed under complementation: A F = (Ω\A) F. F is closed under countable unions A i F for i = 1, 2..., implies that ( i=1 A i ) F. Properties of P. The probability measure P : F [0, 1] such that P is P is countably additive: If {A i } i=1 F denotes a countable collection of pairwise disjoint sets (A i A j = for i j), then P( i=1a i ) = i=1 P(A i ). The measure of the sample-space is one or P(Ω) = 1. Stochastic Optimization 15
17 A short detour Probability Spaces: II Example 1. Single coin toss Ω {H, T }. The σ algebra F contains 2 2 = 4 events F {{}, {H}, {T }, {H, T }}. Furthermore, P({}) = 0,P({H}) = 0.5, P({T }) = 0.5, and P({H, T }) = 1. Example 2. Double coin toss Ω {HH, HT, T H, T T }. Stochastic Optimization 16
18 The σ algebra F contains 2 4 = 16 events F {{}, {HH}, {T T }, {HT }, {T H}, {HH, T T }, {HH, HT }, {HH, T H} {HT, T T }, {HT, T H}, {T H, T T }, {HH, HT, T H}, {HH, HT, T T }, {HH, T H, T T }, {HT, T H, T T } {HH, T H, HT, HH}}. Furthermore, P({}) = 0,P(A 1 ) = 0.25, P(A 2 ) = 0.5, P(A 3 ) = Stochastic Optimization 17
19 0.75, and P({HH, T H, HT, HH}) = 1, where A 1 {HH, HT, T H, T T } A 2 {{HH, T T }, {HH, HT }, {HH, T H}, {HT, T T }, {HT, T H}, {T H, T T }, A 3 {{HH, HT, T H}, {HH, HT, T T }, {HH, T H, T T }, {HT, T H, T T } Stochastic Optimization 18
20 Random variables Given a probability space (Ω, F, P), a random variable represents a function on a sample-space with measurable values. Specifically, X is a random variable defined as X : Ω E, where E is a measurable space. Consequently, P(X S) = P(ω Ω X(ω) S). Example: Coin-tossing. Define X(ω) as follows: X(ω) = 100, ω = H 100, ω = T. Stochastic Optimization 19
21 Example: The Newsvendor Problem Suppose a company has to decide its order quantity x, given a demand d The cost is given by f(x, d) cx + b[d x] + }{{} back-order cost + h[x d] +, } {{ } holding cost where b is back-order penalty and h is holding cost In such an instance, the firm will solve the problem: min x 0 f(x). Stochastic Optimization 20
22 The Newsvendor Problem More specifically, suppose, demand is a random variable, defined as d ω d(ω) where d : Ω R + is a random variable, Ω is the sample space Furthermore, suppose (Ω, F, P) denotes the associated probability space where P denotes the probability distribution function Then the (random) cost associated with demand d ω is given by f(x; ω) cx + b[d ω x] + }{{} back-order cost + h[x d ω ] +, } {{ } holding cost We assume for the present that P is known; then, the firm may Stochastic Optimization 21
23 minimize its expected costs (averaged) given by min x 0 E[f(x; ω)], where E[ ] is the expectation with respect to P Stochastic Optimization 22
24 The Newsvendor Problem This is an instance of a two-stage problem with recourse First-stage decision: Order quantity x Second-stage ω specific recourse decisions: y ω = [d ω x] + and z ω = [x d ω ] +. Recourse decisions can be taken upon revelation of uncertainty; firststage decisions have to be taken prior to this revelation Stochastic Optimization 23
25 A Scenario-based Approach In practice, analytical solutions of this problem are complicated by the presence of an expectation (integral) One avenue: a scenario-based approach requires obtaining K samples from Ω, denoted by d(ω 1 ),..., d(ω K ) or d 1,..., d K. The recourse-based problem is then given by minimize K k=1 subject to x 0. p k f(x; ω k ) Stochastic Optimization 24
26 Note that f(x; ω) = cx + b[d ω x] + + h[x d ω ] + = max ((c b)x + bd ω, (c + h)x hd ω ). minimize x,v 1,...,v K subject to K k=1 p k v k v k (c b)x + bd k, v k (c + h)x hd k, x 0 k = 1,..., K k = 1,..., K This is a linear program with one possible challenge; as K grows, it becomes increasingly difficult to solve directly Stochastic Optimization 25
27 A two-stage linear program Consider the newsvendor problem again. It can be written as follows: minimize subject to x 0. cx + E[Q(x; ω)] where Q(x; ω) is the optimal value of the following recourse problem: Q(x; ω) minimize [by ω + hz ω ] subject to y ω d ω x, z ω x d ω, y ω, z ω 0. Stochastic Optimization 26
28 The problem Q(x; ω) represents the cost of responding to the uncertainty captured by realization ω and given the first-stage decision x This motivates a canonical form for the two-stage stochastic linear program: minimize subject to c T x + E[Q(x; ξ)] Ax = b x 0. where Q(x; ξ) is the optimal value of the following second-stage Stochastic Optimization 27
29 recourse problem: Q(x; ξ) minimize q T y ξ subject to T x + W y ξ = h y ξ 0, and ξ := (q, T, W, h) represents the data of the second-stage problem We define Q(x), the cost of recourse, as follows: Q(x) E[Q(x; ω)]. Stochastic Optimization 28
30 A general model for stochastic optimization A general model for stochastic optimization problems is given by the following. Given a random variable ξ : Ω R d and a function f : X R d R, then the stochastic optimization problem requires an x such that Stoch-opt minimize x E[f(x, ξ)] subject to x X. This model includes the case where f(x, ξ) = c T x + Q(x, ξ) as a special case. Stochastic Optimization 29
31 Analysis of two-stage stochastic programming 1. Properties of Q(x; ξ) (polyhedral, convex, etc.) 2. Expected recourse costs Q(x) Discrete distributions General distributions (convexity, continuity, Lipschitz continuity etc.) 3. Optimality conditions 4. Extensions to convex regimes 5. Nonanticipativity 6. Value of perfect information Stochastic Optimization 30
32 Decomposition methods for two-stage stochastic programming 1. Cutting-plane methods 2. Extensions to convex nonlinear regimes 3. Dual decomposition methods Stochastic Optimization 31
33 Monte-Carlo Sampling methods for convex stochastic optimization 1. Stochastic decomposition schemes for two-stage stochastic linear programs with general distributions 2. Sample-average approximation methods Consistency of estimators Convergence rates 3. Stochastic approximation methods Almost-sure convergence of iterates Non-asymptotic rates of convergence Stochastic Optimization 32
34 Robust optimization problems Stochastic optimization relies on the availability of a distribution function. In many settings, this is not available; instead, we have access to a set for the uncertain parameter In such instance, one avenue lies in solving a robust optimization problem Consider a linear optimization problem: min x { c T x : Ax b, x 0 }. The uncertain linear optimization problem is given by { min x { c T x : Ax b, x 0 }} (c,b,a) U Stochastic Optimization 33
35 where U denotes the uncertainty set associated with the data. The robust counterpart of this problem is given by min x { ĉ(x) = sup (c,b,a) U { c T x : Ax b, x 0, (c, b, A) U }}. This is effectively a problem in which the robust value of the objective is minimized over all robust feasible solutions; a robust feasible solution is defined as an x such that Ax b, x 0, (A, b) U. It can be seen that feasibility requirements lead to a semi-infinite optimization problem; in other words, there is an infinite number of constraints of the form Ax b, one for every (A, b) U. In Stochastic Optimization 34
36 addition, the objective is of a min-max form, leading to a challenging optimization problem Under some conditions on the uncertainty set, the robust optimization problem can be recast as a convex optimization problem and is deemed to be tractable. The first part of our study in robust optimization will analyze the development of tractable robust counterparts for a diverse set of uncertainty sets. In the second part of this topic, we will examine how chance constraints and their amobiguous variants can be captured via a tractable problem. Stochastic Optimization 35
37 Stochastic variational inequality problems Consider the convex optimization problem given by min x X f(x), (Opt) where f : X R is a continuously differentiable function and X is a closed and convex set. Then x is a solution to (Opt) if and only if x is a solution to a variational inequality problem, denoted by VI(X, x f). It may be recalled that VI(X, F ) requires an x X such that (y x) T F (x) 0, y X. Stochastic Optimization 36
38 Consider the stochastic generalization of (Opt) given by min x X E[f(x, ξ)], (SOpt) where f : X R d R is a convex function and E[.] denotes the ecpectation with respect to a probability distribution P. The necessary and sufficienty conditions of optimality of this problem are given by VI(X, F ) where F (x) E[ x f(x, ξ)]. Variational inequality problems can capture the equilibrium conditions of optimization problems and convex Nash games. Additionally, they emerge in modeling a variety of problems including traffic equilibrium problems, contact problems (in structural design), pricing of American options, etc. Unfortunately, approaches for stochastic convex optimization cannot be directly expected to function on variational inequality problems. Stochastic Optimization 37
39 Instead, we extend stochastic approximation schemes to accommodate monotone stochastic variational inequality problems. Recall that a map F is monotone over X if for all x, y X, we have that (y x) T (F (y) F (x)) 0. Stochastic Optimization 38
Optimization Tools in an Uncertain Environment
Optimization Tools in an Uncertain Environment Michael C. Ferris University of Wisconsin, Madison Uncertainty Workshop, Chicago: July 21, 2008 Michael Ferris (University of Wisconsin) Stochastic optimization
More informationStochastic Optimization One-stage problem
Stochastic Optimization One-stage problem V. Leclère September 28 2017 September 28 2017 1 / Déroulement du cours 1 Problèmes d optimisation stochastique à une étape 2 Problèmes d optimisation stochastique
More informationHandout 1: Introduction to Dynamic Programming. 1 Dynamic Programming: Introduction and Examples
SEEM 3470: Dynamic Optimization and Applications 2013 14 Second Term Handout 1: Introduction to Dynamic Programming Instructor: Shiqian Ma January 6, 2014 Suggested Reading: Sections 1.1 1.5 of Chapter
More informationIntroduction to Game Theory: Simple Decisions Models
Introduction to Game Theory: Simple Decisions Models John C.S. Lui Department of Computer Science & Engineering The Chinese University of Hong Kong John C.S. Lui (CUHK) Advanced Topics in Network Analysis
More informationLecture 11: Random Variables
EE5110: Probability Foundations for Electrical Engineers July-November 2015 Lecture 11: Random Variables Lecturer: Dr. Krishna Jagannathan Scribe: Sudharsan, Gopal, Arjun B, Debayani The study of random
More informationMath 273a: Optimization Basic concepts
Math 273a: Optimization Basic concepts Instructor: Wotao Yin Department of Mathematics, UCLA Spring 2015 slides based on Chong-Zak, 4th Ed. Goals of this lecture The general form of optimization: minimize
More informationMathematical Optimization Models and Applications
Mathematical Optimization Models and Applications Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye Chapters 1, 2.1-2,
More informationLecture 3. Optimization Problems and Iterative Algorithms
Lecture 3 Optimization Problems and Iterative Algorithms January 13, 2016 This material was jointly developed with Angelia Nedić at UIUC for IE 598ns Outline Special Functions: Linear, Quadratic, Convex
More informationMathematical Preliminaries
Chapter 33 Mathematical Preliminaries In this appendix, we provide essential definitions and key results which are used at various points in the book. We also provide a list of sources where more details
More informationOn deterministic reformulations of distributionally robust joint chance constrained optimization problems
On deterministic reformulations of distributionally robust joint chance constrained optimization problems Weijun Xie and Shabbir Ahmed School of Industrial & Systems Engineering Georgia Institute of Technology,
More informationLecture 2: Random Variables and Expectation
Econ 514: Probability and Statistics Lecture 2: Random Variables and Expectation Definition of function: Given sets X and Y, a function f with domain X and image Y is a rule that assigns to every x X one
More informationChance Constrained Programming
IE 495 Lecture 22 Chance Constrained Programming Prof. Jeff Linderoth April 21, 2003 April 21, 2002 Stochastic Programming Lecture 22 Slide 1 Outline HW Fixes Chance Constrained Programming Is Hard Main
More informationFundamentals. CS 281A: Statistical Learning Theory. Yangqing Jia. August, Based on tutorial slides by Lester Mackey and Ariel Kleiner
Fundamentals CS 281A: Statistical Learning Theory Yangqing Jia Based on tutorial slides by Lester Mackey and Ariel Kleiner August, 2011 Outline 1 Probability 2 Statistics 3 Linear Algebra 4 Optimization
More informationApplications of Linear Programming
Applications of Linear Programming lecturer: András London University of Szeged Institute of Informatics Department of Computational Optimization Lecture 9 Non-linear programming In case of LP, the goal
More informationOptimality, Duality, Complementarity for Constrained Optimization
Optimality, Duality, Complementarity for Constrained Optimization Stephen Wright University of Wisconsin-Madison May 2014 Wright (UW-Madison) Optimality, Duality, Complementarity May 2014 1 / 41 Linear
More informationLecture 7 Monotonicity. September 21, 2008
Lecture 7 Monotonicity September 21, 2008 Outline Introduce several monotonicity properties of vector functions Are satisfied immediately by gradient maps of convex functions In a sense, role of monotonicity
More information1: PROBABILITY REVIEW
1: PROBABILITY REVIEW Marek Rutkowski School of Mathematics and Statistics University of Sydney Semester 2, 2016 M. Rutkowski (USydney) Slides 1: Probability Review 1 / 56 Outline We will review the following
More informationProbability and Measure
Probability and Measure Robert L. Wolpert Institute of Statistics and Decision Sciences Duke University, Durham, NC, USA Convergence of Random Variables 1. Convergence Concepts 1.1. Convergence of Real
More informationDiscrete Probability. Mark Huiskes, LIACS Probability and Statistics, Mark Huiskes, LIACS, Lecture 2
Discrete Probability Mark Huiskes, LIACS mark.huiskes@liacs.nl Probability: Basic Definitions In probability theory we consider experiments whose outcome depends on chance or are uncertain. How do we model
More informationMathematical Economics. Lecture Notes (in extracts)
Prof. Dr. Frank Werner Faculty of Mathematics Institute of Mathematical Optimization (IMO) http://math.uni-magdeburg.de/ werner/math-ec-new.html Mathematical Economics Lecture Notes (in extracts) Winter
More informationLecture 2: Convex Sets and Functions
Lecture 2: Convex Sets and Functions Hyang-Won Lee Dept. of Internet & Multimedia Eng. Konkuk University Lecture 2 Network Optimization, Fall 2015 1 / 22 Optimization Problems Optimization problems are
More information1 Strict local optimality in unconstrained optimization
ORF 53 Lecture 14 Spring 016, Princeton University Instructor: A.A. Ahmadi Scribe: G. Hall Thursday, April 14, 016 When in doubt on the accuracy of these notes, please cross check with the instructor s
More informationStochastic Approximation Approaches to the Stochastic Variational Inequality Problem
JOURNAL OF L A TEX CLASS FILES, VOL. 6, NO., JANUARY 2007 Stochastic Approximation Approaches to the Stochastic Variational Inequality Problem Houyuan Jiang and Huifu Xu Abstract Stochastic approximation
More informationRecap of Basic Probability Theory
02407 Stochastic Processes? Recap of Basic Probability Theory Uffe Høgsbro Thygesen Informatics and Mathematical Modelling Technical University of Denmark 2800 Kgs. Lyngby Denmark Email: uht@imm.dtu.dk
More informationORIGINS OF STOCHASTIC PROGRAMMING
ORIGINS OF STOCHASTIC PROGRAMMING Early 1950 s: in applications of Linear Programming unknown values of coefficients: demands, technological coefficients, yields, etc. QUOTATION Dantzig, Interfaces 20,1990
More informationLecture 2: Convergence of Random Variables
Lecture 2: Convergence of Random Variables Hyang-Won Lee Dept. of Internet & Multimedia Eng. Konkuk University Lecture 2 Introduction to Stochastic Processes, Fall 2013 1 / 9 Convergence of Random Variables
More informationInformation Theory and Communication
Information Theory and Communication Ritwik Banerjee rbanerjee@cs.stonybrook.edu c Ritwik Banerjee Information Theory and Communication 1/8 General Chain Rules Definition Conditional mutual information
More information6.262: Discrete Stochastic Processes 2/2/11. Lecture 1: Introduction and Probability review
6.262: Discrete Stochastic Processes 2/2/11 Lecture 1: Introduction and Probability review Outline: Probability in the real world Probability as a branch of mathematics Discrete stochastic processes Processes
More informationModeling Uncertainty in Linear Programs: Stochastic and Robust Linear Programming
Modeling Uncertainty in Linear Programs: Stochastic and Robust Programming DGA PhD Student - PhD Thesis EDF-INRIA 10 November 2011 and motivations In real life, Linear Programs are uncertain for several
More informationNonlinear Programming Models
Nonlinear Programming Models Fabio Schoen 2008 http://gol.dsi.unifi.it/users/schoen Nonlinear Programming Models p. Introduction Nonlinear Programming Models p. NLP problems minf(x) x S R n Standard form:
More informationQuiz Discussion. IE417: Nonlinear Programming: Lecture 12. Motivation. Why do we care? Jeff Linderoth. 16th March 2006
Quiz Discussion IE417: Nonlinear Programming: Lecture 12 Jeff Linderoth Department of Industrial and Systems Engineering Lehigh University 16th March 2006 Motivation Why do we care? We are interested in
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 3 9/10/2008 CONDITIONING AND INDEPENDENCE
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 3 9/10/2008 CONDITIONING AND INDEPENDENCE Most of the material in this lecture is covered in [Bertsekas & Tsitsiklis] Sections 1.3-1.5
More informationConvex Optimization. (EE227A: UC Berkeley) Lecture 28. Suvrit Sra. (Algebra + Optimization) 02 May, 2013
Convex Optimization (EE227A: UC Berkeley) Lecture 28 (Algebra + Optimization) 02 May, 2013 Suvrit Sra Admin Poster presentation on 10th May mandatory HW, Midterm, Quiz to be reweighted Project final report
More informationSWFR ENG 4TE3 (6TE3) COMP SCI 4TE3 (6TE3) Continuous Optimization Algorithm. Convex Optimization. Computing and Software McMaster University
SWFR ENG 4TE3 (6TE3) COMP SCI 4TE3 (6TE3) Continuous Optimization Algorithm Convex Optimization Computing and Software McMaster University General NLO problem (NLO : Non Linear Optimization) (N LO) min
More informationRecap of Basic Probability Theory
02407 Stochastic Processes Recap of Basic Probability Theory Uffe Høgsbro Thygesen Informatics and Mathematical Modelling Technical University of Denmark 2800 Kgs. Lyngby Denmark Email: uht@imm.dtu.dk
More informationSelected Examples of CONIC DUALITY AT WORK Robust Linear Optimization Synthesis of Linear Controllers Matrix Cube Theorem A.
. Selected Examples of CONIC DUALITY AT WORK Robust Linear Optimization Synthesis of Linear Controllers Matrix Cube Theorem A. Nemirovski Arkadi.Nemirovski@isye.gatech.edu Linear Optimization Problem,
More informationA Stochastic-Oriented NLP Relaxation for Integer Programming
A Stochastic-Oriented NLP Relaxation for Integer Programming John Birge University of Chicago (With Mihai Anitescu (ANL/U of C), Cosmin Petra (ANL)) Motivation: The control of energy systems, particularly
More informationLecture 3. Discrete Random Variables
Math 408 - Mathematical Statistics Lecture 3. Discrete Random Variables January 23, 2013 Konstantin Zuev (USC) Math 408, Lecture 3 January 23, 2013 1 / 14 Agenda Random Variable: Motivation and Definition
More informationarxiv: v3 [math.oc] 25 Apr 2018
Problem-driven scenario generation: an analytical approach for stochastic programs with tail risk measure Jamie Fairbrother *, Amanda Turner *, and Stein W. Wallace ** * STOR-i Centre for Doctoral Training,
More informationSet-based Min-max and Min-min Robustness for Multi-objective Robust Optimization
Proceedings of the 2017 Industrial and Systems Engineering Research Conference K. Coperich, E. Cudney, H. Nembhard, eds. Set-based Min-max and Min-min Robustness for Multi-objective Robust Optimization
More informationChapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University
Chapter 3, 4 Random Variables ENCS6161 - Probability and Stochastic Processes Concordia University ENCS6161 p.1/47 The Notion of a Random Variable A random variable X is a function that assigns a real
More informationLebesgue measure on R is just one of many important measures in mathematics. In these notes we introduce the general framework for measures.
Measures In General Lebesgue measure on R is just one of many important measures in mathematics. In these notes we introduce the general framework for measures. Definition: σ-algebra Let X be a set. A
More informationLecture 6: The Pigeonhole Principle and Probability Spaces
Lecture 6: The Pigeonhole Principle and Probability Spaces Anup Rao January 17, 2018 We discuss the pigeonhole principle and probability spaces. Pigeonhole Principle The pigeonhole principle is an extremely
More informationCHAPTER 2: QUADRATIC PROGRAMMING
CHAPTER 2: QUADRATIC PROGRAMMING Overview Quadratic programming (QP) problems are characterized by objective functions that are quadratic in the design variables, and linear constraints. In this sense,
More informationSample Spaces, Random Variables
Sample Spaces, Random Variables Moulinath Banerjee University of Michigan August 3, 22 Probabilities In talking about probabilities, the fundamental object is Ω, the sample space. (elements) in Ω are denoted
More informationStochastic Integer Programming
IE 495 Lecture 20 Stochastic Integer Programming Prof. Jeff Linderoth April 14, 2003 April 14, 2002 Stochastic Programming Lecture 20 Slide 1 Outline Stochastic Integer Programming Integer LShaped Method
More informationAppendix A : Introduction to Probability and stochastic processes
A-1 Mathematical methods in communication July 5th, 2009 Appendix A : Introduction to Probability and stochastic processes Lecturer: Haim Permuter Scribe: Shai Shapira and Uri Livnat The probability of
More informationNear-Potential Games: Geometry and Dynamics
Near-Potential Games: Geometry and Dynamics Ozan Candogan, Asuman Ozdaglar and Pablo A. Parrilo September 6, 2011 Abstract Potential games are a special class of games for which many adaptive user dynamics
More informationStochastic Programming Math Review and MultiPeriod Models
IE 495 Lecture 5 Stochastic Programming Math Review and MultiPeriod Models Prof. Jeff Linderoth January 27, 2003 January 27, 2003 Stochastic Programming Lecture 5 Slide 1 Outline Homework questions? I
More informationStability-based generation of scenario trees for multistage stochastic programs
Stability-based generation of scenario trees for multistage stochastic programs H. Heitsch and W. Römisch Humboldt-University Berlin Institute of Mathematics 10099 Berlin, Germany http://www.math.hu-berlin.de/~romisch
More informationLecture Note 1: Introduction to optimization. Xiaoqun Zhang Shanghai Jiao Tong University
Lecture Note 1: Introduction to optimization Xiaoqun Zhang Shanghai Jiao Tong University Last updated: September 23, 2017 1.1 Introduction 1. Optimization is an important tool in daily life, business and
More informationReinforcement Learning
Reinforcement Learning March May, 2013 Schedule Update Introduction 03/13/2015 (10:15-12:15) Sala conferenze MDPs 03/18/2015 (10:15-12:15) Sala conferenze Solving MDPs 03/20/2015 (10:15-12:15) Aula Alpha
More informationOptimization for Machine Learning
Optimization for Machine Learning (Problems; Algorithms - A) SUVRIT SRA Massachusetts Institute of Technology PKU Summer School on Data Science (July 2017) Course materials http://suvrit.de/teaching.html
More informationLecture 9 Monotone VIs/CPs Properties of cones and some existence results. October 6, 2008
Lecture 9 Monotone VIs/CPs Properties of cones and some existence results October 6, 2008 Outline Properties of cones Existence results for monotone CPs/VIs Polyhedrality of solution sets Game theory:
More informationSemidefinite and Second Order Cone Programming Seminar Fall 2012 Project: Robust Optimization and its Application of Robust Portfolio Optimization
Semidefinite and Second Order Cone Programming Seminar Fall 2012 Project: Robust Optimization and its Application of Robust Portfolio Optimization Instructor: Farid Alizadeh Author: Ai Kagawa 12/12/2012
More informationHomework 3. Convex Optimization /36-725
Homework 3 Convex Optimization 10-725/36-725 Due Friday October 14 at 5:30pm submitted to Christoph Dann in Gates 8013 (Remember to a submit separate writeup for each problem, with your name at the top)
More informationJUSTIN HARTMANN. F n Σ.
BROWNIAN MOTION JUSTIN HARTMANN Abstract. This paper begins to explore a rigorous introduction to probability theory using ideas from algebra, measure theory, and other areas. We start with a basic explanation
More informationSolution Methods for Stochastic Programs
Solution Methods for Stochastic Programs Huseyin Topaloglu School of Operations Research and Information Engineering Cornell University ht88@cornell.edu August 14, 2010 1 Outline Cutting plane methods
More informationLecture 8 Plus properties, merit functions and gap functions. September 28, 2008
Lecture 8 Plus properties, merit functions and gap functions September 28, 2008 Outline Plus-properties and F-uniqueness Equation reformulations of VI/CPs Merit functions Gap merit functions FP-I book:
More informationCONVERGENCE ANALYSIS OF SAMPLING-BASED DECOMPOSITION METHODS FOR RISK-AVERSE MULTISTAGE STOCHASTIC CONVEX PROGRAMS
CONVERGENCE ANALYSIS OF SAMPLING-BASED DECOMPOSITION METHODS FOR RISK-AVERSE MULTISTAGE STOCHASTIC CONVEX PROGRAMS VINCENT GUIGUES Abstract. We consider a class of sampling-based decomposition methods
More informationSOME HISTORY OF STOCHASTIC PROGRAMMING
SOME HISTORY OF STOCHASTIC PROGRAMMING Early 1950 s: in applications of Linear Programming unknown values of coefficients: demands, technological coefficients, yields, etc. QUOTATION Dantzig, Interfaces
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationProbability Theory and Simulation Methods
Feb 28th, 2018 Lecture 10: Random variables Countdown to midterm (March 21st): 28 days Week 1 Chapter 1: Axioms of probability Week 2 Chapter 3: Conditional probability and independence Week 4 Chapters
More informationIntroduction to Nonlinear Stochastic Programming
School of Mathematics T H E U N I V E R S I T Y O H F R G E D I N B U Introduction to Nonlinear Stochastic Programming Jacek Gondzio Email: J.Gondzio@ed.ac.uk URL: http://www.maths.ed.ac.uk/~gondzio SPS
More informationComplexity of two and multi-stage stochastic programming problems
Complexity of two and multi-stage stochastic programming problems A. Shapiro School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332-0205, USA The concept
More informationConvex Optimization and Modeling
Convex Optimization and Modeling Convex Optimization Fourth lecture, 05.05.2010 Jun.-Prof. Matthias Hein Reminder from last time Convex functions: first-order condition: f(y) f(x) + f x,y x, second-order
More informationEE376A: Homework #3 Due by 11:59pm Saturday, February 10th, 2018
Please submit the solutions on Gradescope. EE376A: Homework #3 Due by 11:59pm Saturday, February 10th, 2018 1. Optimal codeword lengths. Although the codeword lengths of an optimal variable length code
More informationWeek 12-13: Discrete Probability
Week 12-13: Discrete Probability November 21, 2018 1 Probability Space There are many problems about chances or possibilities, called probability in mathematics. When we roll two dice there are possible
More informationLMI Methods in Optimal and Robust Control
LMI Methods in Optimal and Robust Control Matthew M. Peet Arizona State University Lecture 02: Optimization (Convex and Otherwise) What is Optimization? An Optimization Problem has 3 parts. x F f(x) :
More informationF (x) = P [X x[. DF1 F is nondecreasing. DF2 F is right-continuous
7: /4/ TOPIC Distribution functions their inverses This section develops properties of probability distribution functions their inverses Two main topics are the so-called probability integral transformation
More informationLecture 1: Introduction
EE 227A: Convex Optimization and Applications January 17 Lecture 1: Introduction Lecturer: Anh Pham Reading assignment: Chapter 1 of BV 1. Course outline and organization Course web page: http://www.eecs.berkeley.edu/~elghaoui/teaching/ee227a/
More informationLecture 2: Review of Basic Probability Theory
ECE 830 Fall 2010 Statistical Signal Processing instructor: R. Nowak, scribe: R. Nowak Lecture 2: Review of Basic Probability Theory Probabilistic models will be used throughout the course to represent
More informationStatistics for Financial Engineering Session 2: Basic Set Theory March 19 th, 2006
Statistics for Financial Engineering Session 2: Basic Set Theory March 19 th, 2006 Topics What is a set? Notations for sets Empty set Inclusion/containment and subsets Sample spaces and events Operations
More informationMATHEMATICAL ECONOMICS: OPTIMIZATION. Contents
MATHEMATICAL ECONOMICS: OPTIMIZATION JOÃO LOPES DIAS Contents 1. Introduction 2 1.1. Preliminaries 2 1.2. Optimal points and values 2 1.3. The optimization problems 3 1.4. Existence of optimal points 4
More informationProbability. Lecture Notes. Adolfo J. Rumbos
Probability Lecture Notes Adolfo J. Rumbos October 20, 204 2 Contents Introduction 5. An example from statistical inference................ 5 2 Probability Spaces 9 2. Sample Spaces and σ fields.....................
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More informationUNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems
UNDERGROUND LECTURE NOTES 1: Optimality Conditions for Constrained Optimization Problems Robert M. Freund February 2016 c 2016 Massachusetts Institute of Technology. All rights reserved. 1 1 Introduction
More informationIntroduction and Preliminaries
Chapter 1 Introduction and Preliminaries This chapter serves two purposes. The first purpose is to prepare the readers for the more systematic development in later chapters of methods of real analysis
More informationLecture 4: Convex Functions, Part I February 1
IE 521: Convex Optimization Instructor: Niao He Lecture 4: Convex Functions, Part I February 1 Spring 2017, UIUC Scribe: Shuanglong Wang Courtesy warning: These notes do not necessarily cover everything
More information6.207/14.15: Networks Lecture 10: Introduction to Game Theory 2
6.207/14.15: Networks Lecture 10: Introduction to Game Theory 2 Daron Acemoglu and Asu Ozdaglar MIT October 14, 2009 1 Introduction Outline Mixed Strategies Existence of Mixed Strategy Nash Equilibrium
More informationOn a class of minimax stochastic programs
On a class of minimax stochastic programs Alexander Shapiro and Shabbir Ahmed School of Industrial & Systems Engineering Georgia Institute of Technology 765 Ferst Drive, Atlanta, GA 30332. August 29, 2003
More informationConstrained Optimization and Lagrangian Duality
CIS 520: Machine Learning Oct 02, 2017 Constrained Optimization and Lagrangian Duality Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture. They may or may
More information18.175: Lecture 2 Extension theorems, random variables, distributions
18.175: Lecture 2 Extension theorems, random variables, distributions Scott Sheffield MIT Outline Extension theorems Characterizing measures on R d Random variables Outline Extension theorems Characterizing
More informationIntroduction and Math Preliminaries
Introduction and Math Preliminaries Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/ yyye Appendices A, B, and C, Chapter
More informationStochastic Programming: Optimization When Uncertainty Matters
INFORMS New Orleans 2005 c 2005 INFORMS isbn 0000-0000 doi 10.1287/educ.1053.0000 Chapter 1 Stochastic Programming: Optimization When Uncertainty Matters Julia L. Higle Dept. of Systems and Industrial
More informationFinancial Optimization ISE 347/447. Lecture 21. Dr. Ted Ralphs
Financial Optimization ISE 347/447 Lecture 21 Dr. Ted Ralphs ISE 347/447 Lecture 21 1 Reading for This Lecture C&T Chapter 16 ISE 347/447 Lecture 21 2 Formalizing: Random Linear Optimization Consider the
More informationLecture Note 5: Semidefinite Programming for Stability Analysis
ECE7850: Hybrid Systems:Theory and Applications Lecture Note 5: Semidefinite Programming for Stability Analysis Wei Zhang Assistant Professor Department of Electrical and Computer Engineering Ohio State
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More information6.207/14.15: Networks Lecture 11: Introduction to Game Theory 3
6.207/14.15: Networks Lecture 11: Introduction to Game Theory 3 Daron Acemoglu and Asu Ozdaglar MIT October 19, 2009 1 Introduction Outline Existence of Nash Equilibrium in Infinite Games Extensive Form
More informationProbability Theory. Probability and Statistics for Data Science CSE594 - Spring 2016
Probability Theory Probability and Statistics for Data Science CSE594 - Spring 2016 What is Probability? 2 What is Probability? Examples outcome of flipping a coin (seminal example) amount of snowfall
More informationRS Chapter 1 Random Variables 6/5/2017. Chapter 1. Probability Theory: Introduction
Chapter 1 Probability Theory: Introduction Basic Probability General In a probability space (Ω, Σ, P), the set Ω is the set of all possible outcomes of a probability experiment. Mathematically, Ω is just
More informationConvex Optimization Notes
Convex Optimization Notes Jonathan Siegel January 2017 1 Convex Analysis This section is devoted to the study of convex functions f : B R {+ } and convex sets U B, for B a Banach space. The case of B =
More informationProbability Theory Review
Cogsci 118A: Natural Computation I Lecture 2 (01/07/10) Lecturer: Angela Yu Probability Theory Review Scribe: Joseph Schilz Lecture Summary 1. Set theory: terms and operators In this section, we provide
More informationLecture 4: Probability and Discrete Random Variables
Error Correcting Codes: Combinatorics, Algorithms and Applications (Fall 2007) Lecture 4: Probability and Discrete Random Variables Wednesday, January 21, 2009 Lecturer: Atri Rudra Scribe: Anonymous 1
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationOn the Power of Robust Solutions in Two-Stage Stochastic and Adaptive Optimization Problems
MATHEMATICS OF OPERATIONS RESEARCH Vol. xx, No. x, Xxxxxxx 00x, pp. xxx xxx ISSN 0364-765X EISSN 156-5471 0x xx0x 0xxx informs DOI 10.187/moor.xxxx.xxxx c 00x INFORMS On the Power of Robust Solutions in
More informationPart IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationProblem Set 0 Solutions
CS446: Machine Learning Spring 2017 Problem Set 0 Solutions Handed Out: January 25 th, 2017 Handed In: NONE 1. [Probability] Assume that the probability of obtaining heads when tossing a coin is λ. a.
More informationEE C128 / ME C134 Feedback Control Systems
EE C128 / ME C134 Feedback Control Systems Lecture Additional Material Introduction to Model Predictive Control Maximilian Balandat Department of Electrical Engineering & Computer Science University of
More information