Stability of Stochastic Programming Problems

Size: px
Start display at page:

Download "Stability of Stochastic Programming Problems"

Transcription

1 Stability of Stochastic Programming Problems W. Römisch Humboldt-University Berlin Institute of Mathematics Berlin, Germany Page 1 of 35 Spring School Stochastic Programming, Bergamo, April 13, 2007

2 : 1. Introduction 2. General quantitative stability results 3. Two-stage stochastic programs Stability with respect to Fortet-Mourier metrics Consequences for discrete approximations Consequences for scenario reduction 4. Two-stage mixed-integer stochastic programs 5. Chance constrained stochastic programs 6. Multi-stage stochastic programs Page 2 of 35

3 1. Introduction Consider the stochastic programming model { } min f 0 (ξ, x)p (dξ) : x M(P ) M(P ) := { x X : } f j (ξ, x)p (dξ) 0, j = 1,..., d where f j from R m to the extended reals R are normal integrands, X is a nonempty closed subset of R m, is a closed subset of R s and P is a Borel probability measure on. (f is a normal integrand if it is Borel measurable and f(ξ,.) is lower semicontinuous ξ.) Let P() the set of all Borel probability measures on and by v(p ) = inf f 0 (ξ, x)p (dξ) (optimal value) x M(P ) { } S ε (P ) = x M(P ) : f 0 (ξ, x)p (dξ) v(p ) + ε S(P ) = S 0 (P ) = arg min f 0 (ξ, x)p (dξ) (solution set). x M(P ) Page 3 of 35

4 The underlying probability distribution P is often incompletely known in applied models and/or has to be approximated (estimated, discretized). stability behaviour of stochastic programs becomes important when changing (perturbing, estimating, approximating) P P(). Here, stability refers to (quantitative) continuity properties of the optimal value function v(.) and of the set-valued mapping S ε (.) at P, where both are regarded as mappings given on certain subset of P() equipped with some convergence of probability measures and some probability metric, respectively. (The corresponding subset of probability measures is determined such that certain moment conditions are satisfied that are related to growth properties of the integrands f j with respect to ξ.) Page 4 of 35 Examples: Two-stage stochastic programs, chance constrained stochastic programs. Survey: W. Römisch: Stability of stochastic programming problems, in: Stochastic Programming (A. Ruszczynski, A. Shapiro eds.), Handbook, Elsevier, 2003.

5 Weak convergence in P() P n w P iff f(ξ)p n (dξ) f(ξ)p (dξ) ( f C b ()), iff P n ({ξ z}) P ({ξ z}) at continuity points z of P ({ξ }). Probability metrics on P() (Monographs: Rachev 91, Rachev/Rüschendorf 98) Metrics with ζ-structure: { } d F (P, Q) = sup f(ξ)p (dξ) f(ξ)q(dξ) : f F where F is a suitable set of measurable functions from to R and P, Q are probability measures in some set P F on which d F is finite. Page 5 of 35 Examples (of F): Sets of locally Lipschitzian functions on or of piecewise (locally) Lipschitzian functions. There exist canonical sets F and metrics d F for each specific class of stochastic programs!

6 2. General quantitative stability results To simplify matters, let X be compact (otherwise, consider localizations). F := {f j (., x) : x X, j = 0,..., d}, P F := {Q P() : inf f j(ξ, x)q(dξ) >, x X f j (ξ, x)q(dξ) <, j = 0,..., d}, sup x X and the probability (semi-) metric on P F : d F (P, Q) = sup max x X j=0,...,d f j (ξ, x)(p Q)(dξ). Lemma: The functions (x, Q) on X P F. f j (ξ, x)q(dξ) are lower semicontinuous Page 6 of 35

7 Theorem: (Rachev-Römisch 02) If d 1, let the function x f 0(ξ, x)p (dξ) be Lipschitz continuous on X, and, let the function (x, y) d ( x, { x X : }) f j (ξ, x)p (dξ) y j, j = 1,..., d be locally Lipschitz continuous around ( x, 0) for every x S(P ) (regularity condition). Then there exist constants L, δ > 0 such that v(p ) v(q) Ld F (P, Q) S(Q) S(P ) + Ψ P (Ld F (P, Q))B holds for all Q P F with d F (P, Q) < δ. Page 7 of 35 Here Ψ P (η) := η + ψ 1 (η) and ψ : R + R + { } ψ(τ):=min f 0 (ξ, x)p (dξ) v(p ):d(x, S(P )) τ, x M(P ). (Proof by appealing to general perturbation results of Klatte 94 and Rockafellar/Wets 98.)

8 Convex case and d := 0: Assume that f 0 (ξ, ) is convex on R m ξ. Theorem: (Römisch-Wets 06) Then there exist constants L, ε > 0 such that dl (S ε (P ), S ε (Q)) L ε d F(P, Q) for every ε (0, ε) and Q P F such that d F (P, Q) < ε. Here, dl is the Pompeiu-Hausdorff distance of nonempty closed subsets of R m, i.e., dl (C, D) = inf{η 0 : C D + ηb, D C + ηb}. Page 8 of 35 Proof using a perturbation result by Rockafellar/Wets 98.

9 The (semi-) distance d F plays the role of a minimal probability metric implying quantitative stability. Furthermore, the result remains valid when bounding d F from above by another distance and when reducing the set P F to a subset on which this distance is defined and finite. Idea: Enlarge F, but maintain the analytical (e.g., (dis)continuity) properties of f j (, x), j = 0,..., d! This idea may lead to well-known probability metrics, for which a well developed theory is available! Page 9 of 35

10 Example: (Fortet-Mourier-type metrics) We consider the following classes of locally Lipschitz continuous functions (on ) F H := {f : R : f(ξ) f( ξ) max{1, H( ξ ), H( ξ )} ξ ξ, ξ, ξ } are of particular interest, where H : R + R + is nondecreasing, H(0) = 0. The corresponding distances are d FH (P, Q) = sup f(ξ)p (dξ) f(ξ)q(dξ) =: ζ H(P, Q) f F H are so-called Fortet-Mourier-type metrics defined on P H ():={Q P(): max{1, H( ξ )} ξ Q(dξ) < } Important special case: H(t) := t p 1 for p 1. The corresponding classes of functions and measures, and the distances are denoted by F p, P p () and ζ p, respectively. (Convergence with respect to ζ p means weak conergence of the probability measures and convergence of the p-th order moments (Rachev 91)) Page 10 of 35

11 Application: Convergence of empirical estimates Let P P() and let ξ 1, ξ 2,..., ξ n,... be independent, identically distributed -valued random variables on some probability space (Ω, A, P) having the common distribution P. Let P n (ω) := 1 n n i=1 δ ξ i (ω) be the empirical measures n N. We consider the empirical estimates or sample average approximation (replacing P by P n ( )): { } 1 n min f 0 (ξ i, x) : x X, 1 n f j (ξ i, x) 0, j = 1,..., d n n i=1 i=1 Then results on the convergence in probability of and, hence, of d F (P, P n ( )) v(p ) v(p n ( )) may be obtained using the general stability results, empirical process theory and covering numbers for F as subsets of L p (, P ). Page 11 of 35

12 3. Two-stage stochastic programming models We consider the two-stage stochastic program { } min c, x + ˆΦ(ξ, x)p (dξ) : x X, where ˆΦ(ξ, x) := inf{ q(ξ), y : y Y, W (ξ)y = h(ξ) T (ξ)x} P := Pξ 1 P() is the probability distribution of the random vector ξ, c R m, X R m is a bounded polyhedron, q(ξ) R m, Y R m is a polyhedral cone, W (ξ) a r m-matrix, h(ξ) R r and T (ξ) a r m-matrix. Page 12 of 35 We assume that q(ξ), h(ξ), W (ξ) and T (ξ) are affine functions of ξ (e.g., some of their components or elements are random).

13 Example:(two-stage model with simple recourse) m = s = 1, d = 0, f 0 (ξ, x) := max{0, ξ x}, := R, X := [ 1, 1], P := δ 0 (unit mass at 0), P n := (1 1 n )δ n δ n 2, n N. { x, x [ 1, 0) f 0(ξ, x)p (dξ) = 0, x [0, 1] v(p ) = 0, S(P ) = [0, 1], f 0(ξ, x)p n (dξ) = (1 1 n ) max{0, x} + 1 n max{0, n2 x} v(p n ) = n 1 n, S(P n) = {1} (n N). Note: P n w P, but first order moments do not converge! f(ξ)p n(dξ) = (1 1 n )f(0) + 1 n f(n2 ) f(0), f C b (). But, ξ P n(dξ) = 1 n n2 = n (n N) and ξ P (dξ) = 0 Page 13 of 35

14 Structural properties of two-stage models We consider the infimum function of the parametrized linear (secondstage) program and the dual feasible set of the second-stage program, namely, Φ(ξ, u, t):=inf{ u, y :W (ξ)y = t, y Y } ((ξ, u, t) R m R r ) D(ξ) := {z R r :W (ξ) z q(ξ) Y } (ξ ), where W (ξ) is the transposed of W (ξ) and Y the polar cone of Y (i.e., Y = {y : y, y 0, y Y }). Then we have ˆΦ(ξ, x)=φ(ξ, q(ξ), h(ξ) T (ξ)x)=sup{ h(ξ) T (ξ)x, z :z D(ξ)}. Page 14 of 35 Theorem: (Walkup/Wets 69) For any ξ, the function Φ(ξ,, ) is finite and continuous on the polyhedral set D(ξ) W (ξ)y. Furthermore, the function Φ(ξ, u, ) is piecewise linear convex on the polyhedral set W (ξ)y for fixed u D(ξ), and Φ(ξ,, t) is piecewise linear concave on D(ξ) for fixed t W (ξ)y.

15 Assumptions: (A1) relatively complete recourse: for any (ξ, x) X, h(ξ) T (ξ)x W (ξ)y ; (A2) dual feasibility: D(ξ) holds for all ξ. Note that (A1) is satisfied if W (ξ)y = R r (complete recourse). In general, (A1) and (A2) impose a condition on the support of P. Proposition: Then the deterministic equivalent of the two-stage model represents a finite convex program (with polyhedral constraints) if the integrals Φ(ξ, q(ξ), h(ξ) T (ξ)x)p (dξ) are finite for all x X. For fixed recourse (W (ξ) W ), it suffices to assume ξ 2 P (dξ) <. Convex subdifferentials, optimality conditions, conditions for differentiability, duality results are well known. (Ruszczyński/Shapiro, Handbook, 2003) Page 15 of 35

16 Towards stability We define the integrand f 0 : R m R by c, x +Φ(ξ, q(ξ), h(ξ) T (ξ)x) if h(ξ) T (ξ)x f 0 (ξ, x)= W (ξ)y, D(ξ), + otherwise, and note that f 0 is a convex random lsc function with X dom f 0 if (A1) and (A2) are satisfied. The two-stage stochastic program can thus be expressed as { } min f 0 (ξ, x)p (dξ) : x X. Then the general stability theory applies! Simple examples of two-stage stochastic programs show that, in general, the set-valued mapping S(.) is not inner semicontinuous at P. Furthermore, explicit descriptions of conditioning functions ψ P of stochastic programs (like linear or quadratic growth at solution sets) are only known in some specific cases. Page 16 of 35

17 Stability w.r.t. the Fortet-Mourier metric ζ H Proposition: Suppose the stochastic program satisfies (A1) and (A2). Assume that the mapping ξ D(ξ) is bounded-valued and there exists a constant L > 0, and a nondecreasing function h : R + R + with h(0) = 0 such that dl (D(ξ), D( ξ)) L max{1, h( ξ ), h( ξ )} ξ ξ holds for all ξ, ξ. Then there exist ˆL > 0 such that f 0 (ξ, x) f 0 ( ξ, x) ˆL max{1, H( ξ ), H( ξ )} ξ ξ f 0 (ξ, x) f 0 (ξ, x) ˆL max{1, H( ξ ) ξ } x x for all ξ, ξ, x, x X, where H is defined by H(t) := h(t)t, t R +. Page 17 of 35 Note that h(t) = { 1, fixed recourse t k, lower diagonal randomness with k blocks.

18 Discrete approximations of two-stage stochastic programs Replace the (original) probability measure P by measures P n having (finite) discrete support {ξ 1,..., ξ n } (n N), i.e., n P n = p i δ ξi, and insert it into the infinite-dimensional stochastic program: n min{ c, x + p i q(ξ i ), y i : x X, y i Y, i = 1,..., n, i=1 i=1 W (ξ 1 )y 1 +T (ξ 1 )x = h(ξ 1 ) W (ξ 2 )y 2 +T (ξ 2 )x =.... = h(ξ 2 ). W (ξ n )y n +T (ξ n )x = h(ξ n )} Hence, we arrive at a (finite-dimensional) large scale block-structured linear program which allows for specific decomposition methods. (Ruszczyński/Shapiro, Handbook, 2003) Page 18 of 35

19 How to choose the discrete approximation? The quantitative stability results suggest to determine P n such that it forms the best approximation of P with respect to the semidistance d F or the probability metric ζ p, i.e., given n N solve ( ) } min {ζ p P, 1 n δ ξi : ξ i, i = 1,..., n n i=1 Such best approximations Pn = 1 n n i=1 δ ξi are known as optimal quantizations of the probability distribution P (Graf/Luschgy, Lecture Notes Math ). Page 19 of 35 Convergence properties of optimal quantizations in case of the l p - minimal metrics (or Wasserstein metrics) ( { p, l p (P, Q):= inf ξ ξ p η(dξ, d ξ) π 1 η = P, π 2 η = Q})1 are already known. Here, π i is the projection onto the i-th component. Note that ζ p (P, Q) (1 + ξ p (P + Q)(dξ)) p 1 p l p (P, Q).

20 Scenario reduction We consider discrete distributions P with scenarios ξ i and probabilities p i, i = 1,..., N, and Q being supported by a given subset of scenarios ξ j, j J {1,..., N}, of P. Optimal reduction of a given scenario set J: The best approximation of P with respect to ζ r by such a distribution Q exists and is denoted by Q. It has the distance D J := ζ r (P, Q ) = min ζ r(p, Q) = p i min ĉr(ξ i, ξ j ) Q j J i J = n 1 p i min{ c r (ξ lk, ξ lk+1 ) : n N, l k {1,..., N}, i J k=1 l 1 = i, l n = j J} and the probabilities qj = p j + p i, j J, where i J j J j := {i J : j = j(i)} and j(i) arg min ĉr(ξ i, ξ j ), i J. j J (Dupačová-Gröwe-Kuska-Römisch 03, Heitsch-Römisch 07) Page 20 of 35

21 We needed the following notation: c r (ξ, ξ) := max{1, ξ r 1, ξ r 1 } ξ ξ (ξ, ξ ). Proposition: (Rachev/Rüschendorf 98) { } ζ r (P, Q) = inf ĉ r (ξ, ξ)η(dξ, d ξ):π 1 η =P, π 2 η =Q where ĉ r c r and ĉ r is the metric (reduced cost) { k 1 } ĉ r (ξ, ξ) := inf c r (ξ li, ξ li+1 ) : k N, ξ li, ξ l1 = ξ, ξ lk = ξ. i=1 Determining the optimal scenario index set with prescribed cardinality n is, however, a combinatorial optimization problem of set covering type: Page 21 of 35 min{d J = i J p i min j J ĉr(ξ i, ξ j ) : J {1,..., N}, #J = N n} Hence, the problem of finding the optimal set J to delete is N P- hard and polynomial time solution algorithms do not exist.

22 Fast reduction heuristic Starting point (n = 1): min u {1,...,N} N p k ĉ r (ξ k, ξ u ) k=1 Algorithm: (Forward selection) Step [0]: Step [i]: Step [n+1]: J [0] := {1,..., N}. u i arg min u J [i 1] J [i] := J [i 1] \ {u i }. k J [i 1] \{u} Optimal redistribution. p k min ĉ r (ξ k, ξ j ), j J [i 1] \{u} Page 22 of 35

23 Example: (Electrical load scenario tree) 1000 (Mean shifted ternary) Load scenario tree (729 scenarios) Page 23 of <Start Animation>

24 Reduced load scenario tree obtained by the forward selection method (15 scenarios) Page 24 of

25 4. Chance constrained stochastic programs We consider the chance constrained model min{ c, x : x X, P ({ξ : T (ξ)x h(ξ)}) p}, where c R m, X and are polyhedra in R m and R s, respectively, p (0, 1), P P(), and the right-hand side h(ξ) R d and the (d, m)-matrix T (ξ) are affine functions of ξ. By specifying the general (semi-) distance we obtain d F (P, Q) := sup max x X j=0,1 f j (x, ξ)(p Q)(dξ) = sup P (H(x)) Q(H(x)), x X where f 0 (ξ, x) = c, x, f 1 (ξ, x) = p χ H(x) (ξ) and H(x) = {ξ : T (ξ)x h(ξ)} (polyhedral subsets of ). The relevant probability metrics are polyhedral discrepancies: α ph (P, Q) = sup P (B) Q(B) B B ph () Page 25 of 35

26 5. Two-stage mixed-integer stochastic programs { } min c, x + Φ(q(ξ), h(ξ) T (ξ)x)p (dξ) : x X, where Φ is given by Φ(u, t) := inf { u 1, y + u 2, ȳ : W y + W ȳ t, y Z ˆm, ȳ R m} for all pairs (u, t) R ˆm+ m R r, and c R m, X is a closed subset of R m, a polyhedron in R s, W and W are (r, ˆm)- and (r, m)-matrices, respectively, q(ξ) R ˆm+ m, h(ξ) R r, and the (r, m)-matrix T (ξ) are affine functions of ξ, and P P 2 (). Probability metric on P 2 (): { ζ 2,ph (P, Q) := sup f(ξ)(p Q)(dξ) f F } 2() B B ph () B Cα ph (P, Q) s+1 1 (if is bounded) Here, the set F 2 () contains all functions f : R such that f(ξ) max{1, ξ } ξ, f(ξ) f( ξ) max{1, ξ, ξ } ξ ξ. Page 26 of 35

27 6. Multistage stochastic programs Let {ξ t } T t=1 be a discrete-time stochastic data process defined on some probability space (Ω, A, P) and with ξ 1 deterministic. The stochastic decision x t at period t is assumed to be measurable with respect to A t (ξ) := σ(ξ 1,..., ξ t ) (nonanticipativity). Multistage stochastic optimization model: [ ] T x t X t, t = 1,..., T, min E b t (ξ t ), x t x t is A t (ξ)-measurable, t = 1,..., T, t=1 A t,0 x t + A t,1 (ξ t )x t 1 = h t (ξ t ), t = 2,., T where X 1 is bounded polyhedral and X t, t = 2,..., T, are polyhedral cones, the vectors b t ( ), h t ( ) and A t,1 ( ) are affine functions of ξ t, where ξ varies in a polyhedral set. Page 27 of 35 If the process {ξ t } T t=1 has a finite number of scenarios, they exhibit a scenario tree structure.

28 To have the model well defined, we assume x L r (Ω, A, P; R m ) and ξ L r (Ω, A, P; R s ), where r 1 and r := r r 1, if only costs are random r, if only right-hand sides are random 2, if costs and right-hand sides are random, if all technology matrices are random and r = T. Then nonanticipativity may be expressed as x N r (ξ) N r (ξ) = {x T t=1l r (Ω, A, P; R m t ) : x t = E[x t A t (ξ)], t}, i.e., as a subspace constraint, by using the conditional expectation E[ A t (ξ)] with respect to the σ-algebra A t (ξ). Page 28 of 35 For T = 2 we have N r (ξ) = R m 1 L r (Ω, A, P; R m 2). infinite-dimensional optimization problem

29 Example: (Optimal purchase under uncertainty) The decisions x t correspond to the amounts to be purchased at each time period with uncertain prices are ξ t, t = 1,..., T, and such that a prescribed amount a is achieved at the end of a given time horizon. The problem is of the form [ T ] min E ξ t x t t=1 (x t, s t ) X t = R 2 +, (x t, s t ) is (ξ 1,..., ξ t )-measurable, s t s t 1 = x t, t = 2,..., T, s 1 = 0, s T = a., where the state variable s t corresponds to the amount at time t. Page 29 of 35 Let T := 3 and ξ ε denote the stochastic price process having the two scenarios ξ 1 ε = (3, 2 + ε, 3) (ε (0, 1)) and ξ 2 ε = (3, 2, 1) each endowed with probability 1 2. Let ξ denote the approximation of ξ ε given by the two scenarios ξ 1 = (3, 2, 3) and ξ 2 = (3, 2, 1) with the same probabilities 1 2.

30 2+ε We obtain Scenario trees for ξ ε (left) and ξ v(ξ ε ) = ε ((2 + ε)a + a) = 2 2 a v( ξ) = 2a, but ξ ε ξ (0 + ε + 0) ( ) = ε 2. Hence, the multistage stochastic purchasing model is not stable with respect to 1. Page 30 of 35

31 Quantitative Stability Let F denote the objective function defined on L r (Ω, A, P; R s ) L r (Ω, A, P; R m ) R by F (ξ, x) := E[ T t=1 b t(ξ t ), x t ], let X t (x t 1 ; ξ t ) := {x t X t : A t,0 x t + A t,1 (ξ t )x t 1 = h t (ξ t )} denote the t-th feasibility set for every t = 2,..., T and X (ξ) := {x L r (Ω, F, P; R m ) : x 1 X 1, x t X t (x t 1 ; ξ t )} the set of feasible elements with input ξ. Then the multistage stochastic program may be rewritten as min{f (ξ, x) : x X (ξ) N r (ξ)}. Let v(ξ) denote its optimal value and, for any α 0, S α (ξ) := {x X (ξ) N r (ξ) : F (ξ, x) v(ξ) + α} S(ξ) := S 0 (ξ) denote the α-approximate solution set and the solution set of the stochastic program with input ξ. Page 31 of 35

32 Assumptions: (A1) ξ L r (Ω, A, P; R s ) for some r 1. (A2) There exists a δ > 0 such that for any ξ L r (Ω, A, P; R s ) with ξ ξ r δ, any t = 2,..., T and any x 1 X 1, x τ X τ (x τ 1 ; ξ τ ), τ = 2,..., t 1, the set X t (x t 1 ; ξ t ) is nonempty (relatively complete recourse locally around ξ). (A3) Assume that the optimal values v( ξ) are finite if ξ ξ r δ and that the objective function F is level-bounded locally uniformly at ξ, i.e., for some α > 0 there exists a bounded subset B of L r (Ω, A, P; R m ) such that S α ( ξ) is contained in B if ξ ξ r δ. Page 32 of 35

33 Theorem: (Heitsch-Römisch-Strugarek 06) Let (A1) (A3) be satisfied and X 1 be bounded. Then there exist positive constants L and δ such that v(ξ) v( ξ) L( ξ ξ r + d f,t 1 (ξ, ξ)) holds for all ξ L r (Ω, A, P; R s ) with ξ ξ r δ. If 1 < r < and (ξ (n) ) converges to ξ in L r and with respect to d f,t, then any sequence x n S(ξ (n) ), n N, contains a subsequence converging weakly in L r to some element of S(ξ). Here, d f,τ (ξ, ξ) denotes the filtration distance of ξ and ξ defined by d f,τ (ξ, ξ) := sup x r 1 τ E[x t A t (ξ)] E[x t A t ( ξ)] r. t=2 Remark: For T = 2 we obtain the same result for the optimal values as in the two-stage case! However, we obtain weak convergence of subsequences of (random) second-stage solutions, too! Page 33 of 35

34 Consequences for designing scenario trees If ξ tr is a scenario tree process approximating ξ, one has to take care that ξ ξ tr r and d f,t (ξ, ξ tr ) are small. This is achieved for the generation of scenario trees by recursive scenario reduction (Heitsch-Römisch 05). Page 34 of 35 t = 1 t = 2 t = 3 t = 4 t = 5 t = 1 t = 2 t = 3 t = 4 t = 5 <Start Animation> Are there specific approximations ξ of ξ such that an estimate of the form v(ξ) v( ξ) L ξ ξ r is valid? Recently, such approximations ξ were characterized by Küchler 07! The conditions on ξ and approximation schemes developed by Kuhn 05, Pennanen 05, Mirkov-Pflug 07 also avoid filtration distances.

35 References: Dupačová, J., Gröwe-Kuska, N., Römisch, W.: Scenario reduction in stochastic programming: An approach using probability metrics, Mathematical Programming 95 (2003), Heitsch, H., Römisch, W., Strugarek, C.: Stability of multistage stochastic programs, SIAM Journal Optimization 17 (2006), Heitsch, H., Römisch, W.: Scenario tree modelling for multistage stochastic programs, Preprint 296, DFG Research Center Matheon, Berlin 2005, and submitted. Heitsch, H., Römisch, W.: Stability and scenario trees for multistage stochastic programs, Preprint 324, DFG Research Center Matheon, Berlin 2006, and submitted to Stochastic Programming - The State of the Art (G. Dantzig, G. Infanger eds.). Heitsch, H., Römisch, W.: A note on scenario reduction for two-stage stochastic programs, Operations Research Letters (2007) (to appear). Page 35 of 35 Henrion, R., Römisch, W.: Hölder and Lipschitz stability of solution sets in programs with probabilistic constraints, Mathematical Programming 100 (2004), Rachev, S. T., Römisch, W.: Quantitative stability in stochastic programming: The method of probability metrics, Mathematics of Operations Research 27 (2002), Römisch, W., Wets, R. J-B: Stability of ε-approximate solutions to convex stochastic programs, SIAM Journal Optimization (to appear) Römisch, W., Vigerske, S.: Quantitative stability of fully random mixed-integer two-stage stochastic programs, Preprint 367, DFG Research Center Matheon, Berlin 2007, and submitted.

Jitka Dupačová and scenario reduction

Jitka Dupačová and scenario reduction Jitka Dupačová and scenario reduction W. Römisch Humboldt-University Berlin Institute of Mathematics http://www.math.hu-berlin.de/~romisch Session in honor of Jitka Dupačová ICSP 2016, Buzios (Brazil),

More information

Scenario Reduction: Old and New Results

Scenario Reduction: Old and New Results Scenario Reduction: Old and New Results W. Römisch Humboldt-University Berlin Institute of Mathematics 10099 Berlin, Germany http://www.math.hu-berlin.de/~romisch (H. Heitsch, R. Henrion, C. Küchler) Workshop

More information

A note on scenario reduction for two-stage stochastic programs

A note on scenario reduction for two-stage stochastic programs A note on scenario reduction for two-stage stochastic programs Holger Heitsch a and Werner Römisch a a Humboldt-University Berlin, Institute of Mathematics, 199 Berlin, Germany We extend earlier work on

More information

Scenario generation in stochastic programming with application to energy systems

Scenario generation in stochastic programming with application to energy systems Scenario generation in stochastic programming with application to energy systems W. Römisch Humboldt-University Berlin Institute of Mathematics www.math.hu-berlin.de/~romisch SESO 2017 International Thematic

More information

Stability-based generation of scenario trees for multistage stochastic programs

Stability-based generation of scenario trees for multistage stochastic programs Stability-based generation of scenario trees for multistage stochastic programs H. Heitsch and W. Römisch Humboldt-University Berlin Institute of Mathematics 10099 Berlin, Germany http://www.math.hu-berlin.de/~romisch

More information

Scenario generation in stochastic programming

Scenario generation in stochastic programming Scenario generation in stochastic programming Werner Römisch Humboldt-University Berlin, Institute of Mathematics, 10099 Berlin, Germany, romisch@math.hu-berlin.de Abstract Stability-based methods for

More information

Stability of optimization problems with stochastic dominance constraints

Stability of optimization problems with stochastic dominance constraints Stability of optimization problems with stochastic dominance constraints D. Dentcheva and W. Römisch Stevens Institute of Technology, Hoboken Humboldt-University Berlin www.math.hu-berlin.de/~romisch SIAM

More information

Stochastic Programming: From statistical data to optimal decisions

Stochastic Programming: From statistical data to optimal decisions Stochastic Programming: From statistical data to optimal decisions W. Römisch Humboldt-University Berlin Department of Mathematics (K. Emich, H. Heitsch, A. Möller) Page 1 of 24 6th International Conference

More information

Approximation of stochastic optimization problems and scenario generation

Approximation of stochastic optimization problems and scenario generation Approximation of stochastic optimization problems and scenario generation W. Römisch Humboldt-University Berlin Institute of Mathematics 10099 Berlin, Germany http://www.math.hu-berlin.de/~romisch Page

More information

Stochastic Programming: Tutorial Part II

Stochastic Programming: Tutorial Part II Stochastic Programming: Tutorial Part II W. Römisch Humboldt-University Berlin Institute of Mathematics 10099 Berlin, Germany http://www.math.hu-berlin.de/~romisch Page 1 of 77 Optimization: Computation,

More information

Scenario generation Contents

Scenario generation Contents Scenario generation W. Römisch Humboldt-University Berlin Department of Mathematics www.math.hu-berlin.de/~romisch Page 1 of 39 Tutorial, ICSP12, Halifax, August 14, 2010 (1) Aproximation issues (2) Generation

More information

Optimal scenario generation and reduction in stochastic programming

Optimal scenario generation and reduction in stochastic programming Noname manuscript No. (will be inserted by the editor) Optimal scenario generation and reduction in stochastic programming R. Henrion W. Römisch the date of receipt and acceptance should be inserted later

More information

Probability metrics and the stability of stochastic programs with recourse

Probability metrics and the stability of stochastic programs with recourse Probability metrics and the stability of stochastic programs with recourse Michal Houda Charles University, Faculty of Mathematics and Physics, Prague, Czech Republic. Abstract In stochastic optimization

More information

Quantitative Stability of Two Stage Linear Second-order Conic Stochastic Programs with Full Random Recourse

Quantitative Stability of Two Stage Linear Second-order Conic Stochastic Programs with Full Random Recourse Quantitative Stability of Two Stage Linear Second-order Conic Stochastic Programs with Full Random Recourse Qingsong Duan, Mengwei Xu, Shaoyan Guo, and Liwei Zhang October 7, 2017 Abstract In this paper,

More information

Stochastic optimization, multivariate numerical integration and Quasi-Monte Carlo methods. W. Römisch

Stochastic optimization, multivariate numerical integration and Quasi-Monte Carlo methods. W. Römisch Stochastic optimization, multivariate numerical integration and Quasi-Monte Carlo methods W. Römisch Humboldt-University Berlin Institute of Mathematics www.math.hu-berlin.de/~romisch Chemnitzer Mathematisches

More information

Conditioning of linear-quadratic two-stage stochastic programming problems

Conditioning of linear-quadratic two-stage stochastic programming problems Conditioning of linear-quadratic two-stage stochastic programming problems W. Römisch Humboldt-University Berlin Institute of Mathematics http://www.math.hu-berlin.de/~romisch (K. Emich, R. Henrion) (WIAS

More information

Scenario Generation in Stochastic Programming with Application to Optimizing Electricity Portfolios under Uncertainty

Scenario Generation in Stochastic Programming with Application to Optimizing Electricity Portfolios under Uncertainty Scenario Generation in Stochastic Programming with Application to Optimizing Electricity Portfolios under Uncertainty W. Römisch Humboldt-University Berlin Department of Mathematics www.math.hu-berlin.de/~romisch

More information

DISCREPANCY DISTANCES AND SCENARIO REDUCTION IN TWO-STAGE STOCHASTIC MIXED-INTEGER PROGRAMMING. René Henrion. Christian Küchler.

DISCREPANCY DISTANCES AND SCENARIO REDUCTION IN TWO-STAGE STOCHASTIC MIXED-INTEGER PROGRAMMING. René Henrion. Christian Küchler. JOURNAL OF INDUSTRIAL AND Website: http://aimsciences.org MANAGEMENT OPTIMIZATION Volume 4, Number 2, May 2008 pp. 363 384 DISCREPANCY DISTANCES AND SCENARIO REDUCTION IN TWO-STAGE STOCHASTIC MIXED-INTEGER

More information

Scenario tree generation for multi-stage stochastic programs

Scenario tree generation for multi-stage stochastic programs Scenario tree generation for multi-stage stochastic programs Holger Heitsch 1 and Werner Römisch 2 1 Humboldt University Berlin, Institute of Mathematics, 10099 Berlin, Germany, heitsch@math.hu-berlin.de

More information

Some Properties of the Augmented Lagrangian in Cone Constrained Optimization

Some Properties of the Augmented Lagrangian in Cone Constrained Optimization MATHEMATICS OF OPERATIONS RESEARCH Vol. 29, No. 3, August 2004, pp. 479 491 issn 0364-765X eissn 1526-5471 04 2903 0479 informs doi 10.1287/moor.1040.0103 2004 INFORMS Some Properties of the Augmented

More information

On duality theory of conic linear problems

On duality theory of conic linear problems On duality theory of conic linear problems Alexander Shapiro School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 3332-25, USA e-mail: ashapiro@isye.gatech.edu

More information

ANOVA decomposition of convex piecewise linear functions

ANOVA decomposition of convex piecewise linear functions ANOVA decomposition of convex piecewise linear functions W. Römisch Abstract Piecewise linear convex functions arise as integrands in stochastic programs. They are Lipschitz continuous on their domain,

More information

arxiv: v2 [math.oc] 10 May 2017

arxiv: v2 [math.oc] 10 May 2017 Conic Programming Reformulations of Two-Stage Distributionally Robust Linear Programs over Wasserstein Balls arxiv:1609.07505v2 [math.oc] 10 May 2017 Grani A. Hanasusanto 1 and Daniel Kuhn 2 1 Graduate

More information

CONVERGENCE ANALYSIS OF SAMPLING-BASED DECOMPOSITION METHODS FOR RISK-AVERSE MULTISTAGE STOCHASTIC CONVEX PROGRAMS

CONVERGENCE ANALYSIS OF SAMPLING-BASED DECOMPOSITION METHODS FOR RISK-AVERSE MULTISTAGE STOCHASTIC CONVEX PROGRAMS CONVERGENCE ANALYSIS OF SAMPLING-BASED DECOMPOSITION METHODS FOR RISK-AVERSE MULTISTAGE STOCHASTIC CONVEX PROGRAMS VINCENT GUIGUES Abstract. We consider a class of sampling-based decomposition methods

More information

Convergence Analysis for Distributionally Robust Optimization and Equilibrium Problems*

Convergence Analysis for Distributionally Robust Optimization and Equilibrium Problems* MATHEMATICS OF OPERATIONS RESEARCH Vol. 00, No. 0, Xxxxx 0000, pp. 000 000 issn 0364-765X eissn 1526-5471 00 0000 0001 INFORMS doi 10.1287/xxxx.0000.0000 c 0000 INFORMS Authors are encouraged to submit

More information

EMPIRICAL ESTIMATES IN STOCHASTIC OPTIMIZATION VIA DISTRIBUTION TAILS

EMPIRICAL ESTIMATES IN STOCHASTIC OPTIMIZATION VIA DISTRIBUTION TAILS K Y BERNETIKA VOLUM E 46 ( 2010), NUMBER 3, P AGES 459 471 EMPIRICAL ESTIMATES IN STOCHASTIC OPTIMIZATION VIA DISTRIBUTION TAILS Vlasta Kaňková Classical optimization problems depending on a probability

More information

Operations Research Letters. On a time consistency concept in risk averse multistage stochastic programming

Operations Research Letters. On a time consistency concept in risk averse multistage stochastic programming Operations Research Letters 37 2009 143 147 Contents lists available at ScienceDirect Operations Research Letters journal homepage: www.elsevier.com/locate/orl On a time consistency concept in risk averse

More information

Scenario estimation and generation

Scenario estimation and generation October 10, 2004 The one-period case Distances of Probability Measures Tensor products of trees Tree reduction A decision problem is subject to uncertainty Uncertainty is represented by probability To

More information

Quantitative Stability Analysis for Minimax Distributionally Robust Risk Optimization

Quantitative Stability Analysis for Minimax Distributionally Robust Risk Optimization Noname manuscript No. (will be inserted by the editor) Quantitative Stability Analysis for Minimax Distributionally Robust Risk Optimization Alois Pichler Huifu Xu January 11, 2017 Abstract This paper

More information

Werner Romisch. Humboldt University Berlin. Abstract. Perturbations of convex chance constrained stochastic programs are considered the underlying

Werner Romisch. Humboldt University Berlin. Abstract. Perturbations of convex chance constrained stochastic programs are considered the underlying Stability of solutions to chance constrained stochastic programs Rene Henrion Weierstrass Institute for Applied Analysis and Stochastics D-7 Berlin, Germany and Werner Romisch Humboldt University Berlin

More information

Lipschitz and differentiability properties of quasi-concave and singular normal distribution functions

Lipschitz and differentiability properties of quasi-concave and singular normal distribution functions Ann Oper Res (2010) 177: 115 125 DOI 10.1007/s10479-009-0598-0 Lipschitz and differentiability properties of quasi-concave and singular normal distribution functions René Henrion Werner Römisch Published

More information

VARIATIONAL THEORY FOR OPTIMIZATION UNDER STOCHASTIC AMBIGUITY

VARIATIONAL THEORY FOR OPTIMIZATION UNDER STOCHASTIC AMBIGUITY SIAM J. OPTIM. Vol. 27, No. 2, pp. 1118 1149 c 2017 Work carried out by an employee of the US Government VARIATIONAL THEORY FOR OPTIMIZATION UNDER STOCHASTIC AMBIGUITY JOHANNES O. ROYSET AND ROGER J.-B.

More information

Convergence of Stationary Points of Sample Average Two-Stage Stochastic Programs: A Generalized Equation Approach

Convergence of Stationary Points of Sample Average Two-Stage Stochastic Programs: A Generalized Equation Approach MATHEMATICS OF OPERATIONS RESEARCH Vol. 36, No. 3, August 2011, pp. 568 592 issn 0364-765X eissn 1526-5471 11 3603 0568 doi 10.1287/moor.1110.0506 2011 INFORMS Convergence of Stationary Points of Sample

More information

Decomposition in Multistage Stochastic Programming and a Constraint Integer Programming Approach to Mixed-Integer Nonlinear Programming

Decomposition in Multistage Stochastic Programming and a Constraint Integer Programming Approach to Mixed-Integer Nonlinear Programming Decomposition in Multistage Stochastic Programming and a Constraint Integer Programming Approach to Mixed-Integer Nonlinear Programming D I S S E R T A T I O N zur Erlangung des akademischen Grades Dr.

More information

(1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define

(1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define Homework, Real Analysis I, Fall, 2010. (1) Consider the space S consisting of all continuous real-valued functions on the closed interval [0, 1]. For f, g S, define ρ(f, g) = 1 0 f(x) g(x) dx. Show that

More information

Weierstraß-Institut. für Angewandte Analysis und Stochastik. Leibniz-Institut im Forschungsverbund Berlin e. V. Preprint ISSN

Weierstraß-Institut. für Angewandte Analysis und Stochastik. Leibniz-Institut im Forschungsverbund Berlin e. V. Preprint ISSN Weierstraß-Institut für Angewandte Analysis und Stochastik Leibniz-Institut im Forschungsverbund Berlin e. V. Preprint ISSN 2198-5855 Are Quasi-Monte Carlo algorithms efficient for two-stage stochastic

More information

MIDAS: A Mixed Integer Dynamic Approximation Scheme

MIDAS: A Mixed Integer Dynamic Approximation Scheme MIDAS: A Mixed Integer Dynamic Approximation Scheme Andy Philpott, Faisal Wahid, Frédéric Bonnans May 7, 2016 Abstract Mixed Integer Dynamic Approximation Scheme (MIDAS) is a new sampling-based algorithm

More information

Quadratic Two-Stage Stochastic Optimization with Coherent Measures of Risk

Quadratic Two-Stage Stochastic Optimization with Coherent Measures of Risk Noname manuscript No. (will be inserted by the editor) Quadratic Two-Stage Stochastic Optimization with Coherent Measures of Risk Jie Sun Li-Zhi Liao Brian Rodrigues Received: date / Accepted: date Abstract

More information

Scenario Reduction for Risk-Averse Stochastic Programs

Scenario Reduction for Risk-Averse Stochastic Programs Scenario Reduction for Risk-Averse Stochastic Programs Sebastián Arpón 1, Tito Homem-de-Mello 1, Bernardo Pagnoncelli 1 1 School of Business, Universidad Adolfo Ibañez, Santiago, Chile Abstract In this

More information

On the Scenario-Tree Optimal-Value Error for Stochastic Programming Problems

On the Scenario-Tree Optimal-Value Error for Stochastic Programming Problems On the Scenario-Tree Optimal-Value Error for Stochastic Programming Problems Julien Keutchayan David Munger Michel Gendreau January 2017 CIRRELT-2017-05 On the Scenario-Tree Optimal-Value Error for Stochastic

More information

Decomposability and time consistency of risk averse multistage programs

Decomposability and time consistency of risk averse multistage programs Decomposability and time consistency of risk averse multistage programs arxiv:1806.01497v1 [math.oc] 5 Jun 2018 A. Shapiro School of Industrial and Systems Engineering Georgia Institute of Technology Atlanta,

More information

On Approximations and Stability in Stochastic Programming

On Approximations and Stability in Stochastic Programming On Approximations and Stability in Stochastic Programming Peter Kall Abstract It has become an accepted approach to attack stochastic programming problems by approximating the given probability distribution

More information

Asymptotics of minimax stochastic programs

Asymptotics of minimax stochastic programs Asymptotics of minimax stochastic programs Alexander Shapiro Abstract. We discuss in this paper asymptotics of the sample average approximation (SAA) of the optimal value of a minimax stochastic programming

More information

Chance constrained optimization - applications, properties and numerical issues

Chance constrained optimization - applications, properties and numerical issues Chance constrained optimization - applications, properties and numerical issues Dr. Abebe Geletu Ilmenau University of Technology Department of Simulation and Optimal Processes (SOP) May 31, 2012 This

More information

Stochastic Programming: Basic Theory

Stochastic Programming: Basic Theory Stochastic Programming: Basic Theory John R. Birge John.Birge@ChicagoBooth.edu www.chicagobooth.edu/fac/john.birge JRBirge ICSP, Bergamo, July 2013 1 Goals Provide background on the basics of stochastic

More information

Lecture 1. Stochastic Optimization: Introduction. January 8, 2018

Lecture 1. Stochastic Optimization: Introduction. January 8, 2018 Lecture 1 Stochastic Optimization: Introduction January 8, 2018 Optimization Concerned with mininmization/maximization of mathematical functions Often subject to constraints Euler (1707-1783): Nothing

More information

Risk-Averse Dynamic Optimization. Andrzej Ruszczyński. Research supported by the NSF award CMMI

Risk-Averse Dynamic Optimization. Andrzej Ruszczyński. Research supported by the NSF award CMMI Research supported by the NSF award CMMI-0965689 Outline 1 Risk-Averse Preferences 2 Coherent Risk Measures 3 Dynamic Risk Measurement 4 Markov Risk Measures 5 Risk-Averse Control Problems 6 Solution Methods

More information

Optimization Problems with Probabilistic Constraints

Optimization Problems with Probabilistic Constraints Optimization Problems with Probabilistic Constraints R. Henrion Weierstrass Institute Berlin 10 th International Conference on Stochastic Programming University of Arizona, Tucson Recommended Reading A.

More information

Robustness in Stochastic Programs with Risk Constraints

Robustness in Stochastic Programs with Risk Constraints Robustness in Stochastic Programs with Risk Constraints Dept. of Probability and Mathematical Statistics, Faculty of Mathematics and Physics Charles University, Prague, Czech Republic www.karlin.mff.cuni.cz/~kopa

More information

UNCERTAINTY FUNCTIONAL DIFFERENTIAL EQUATIONS FOR FINANCE

UNCERTAINTY FUNCTIONAL DIFFERENTIAL EQUATIONS FOR FINANCE Surveys in Mathematics and its Applications ISSN 1842-6298 (electronic), 1843-7265 (print) Volume 5 (2010), 275 284 UNCERTAINTY FUNCTIONAL DIFFERENTIAL EQUATIONS FOR FINANCE Iuliana Carmen Bărbăcioru Abstract.

More information

On deterministic reformulations of distributionally robust joint chance constrained optimization problems

On deterministic reformulations of distributionally robust joint chance constrained optimization problems On deterministic reformulations of distributionally robust joint chance constrained optimization problems Weijun Xie and Shabbir Ahmed School of Industrial & Systems Engineering Georgia Institute of Technology,

More information

Topics in Stochastic Programming

Topics in Stochastic Programming Topics in Stochastic Programming Alexander Shapiro School of Industrial & Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive, Atlanta, GA 30332. Contents 1 Introduction 1 2 Two Stage

More information

WEAK LOWER SEMI-CONTINUITY OF THE OPTIMAL VALUE FUNCTION AND APPLICATIONS TO WORST-CASE ROBUST OPTIMAL CONTROL PROBLEMS

WEAK LOWER SEMI-CONTINUITY OF THE OPTIMAL VALUE FUNCTION AND APPLICATIONS TO WORST-CASE ROBUST OPTIMAL CONTROL PROBLEMS WEAK LOWER SEMI-CONTINUITY OF THE OPTIMAL VALUE FUNCTION AND APPLICATIONS TO WORST-CASE ROBUST OPTIMAL CONTROL PROBLEMS ROLAND HERZOG AND FRANK SCHMIDT Abstract. Sufficient conditions ensuring weak lower

More information

Introduction to Stochastic Optimization Part 4: Multi-stage decision

Introduction to Stochastic Optimization Part 4: Multi-stage decision Introduction to Stochastic Optimization Part 4: Multi-stage decision problems April 23, 29 The problem ξ = (ξ,..., ξ T ) a multivariate time series process (e.g. future interest rates, future asset prices,

More information

1. Introduction. Consider the following parameterized optimization problem:

1. Introduction. Consider the following parameterized optimization problem: SIAM J. OPTIM. c 1998 Society for Industrial and Applied Mathematics Vol. 8, No. 4, pp. 940 946, November 1998 004 NONDEGENERACY AND QUANTITATIVE STABILITY OF PARAMETERIZED OPTIMIZATION PROBLEMS WITH MULTIPLE

More information

Some SDEs with distributional drift Part I : General calculus. Flandoli, Franco; Russo, Francesco; Wolf, Jochen

Some SDEs with distributional drift Part I : General calculus. Flandoli, Franco; Russo, Francesco; Wolf, Jochen Title Author(s) Some SDEs with distributional drift Part I : General calculus Flandoli, Franco; Russo, Francesco; Wolf, Jochen Citation Osaka Journal of Mathematics. 4() P.493-P.54 Issue Date 3-6 Text

More information

On a class of minimax stochastic programs

On a class of minimax stochastic programs On a class of minimax stochastic programs Alexander Shapiro and Shabbir Ahmed School of Industrial & Systems Engineering Georgia Institute of Technology 765 Ferst Drive, Atlanta, GA 30332. August 29, 2003

More information

On Kusuoka Representation of Law Invariant Risk Measures

On Kusuoka Representation of Law Invariant Risk Measures MATHEMATICS OF OPERATIONS RESEARCH Vol. 38, No. 1, February 213, pp. 142 152 ISSN 364-765X (print) ISSN 1526-5471 (online) http://dx.doi.org/1.1287/moor.112.563 213 INFORMS On Kusuoka Representation of

More information

Optimization and Optimal Control in Banach Spaces

Optimization and Optimal Control in Banach Spaces Optimization and Optimal Control in Banach Spaces Bernhard Schmitzer October 19, 2017 1 Convex non-smooth optimization with proximal operators Remark 1.1 (Motivation). Convex optimization: easier to solve,

More information

A CHARACTERIZATION OF STRICT LOCAL MINIMIZERS OF ORDER ONE FOR STATIC MINMAX PROBLEMS IN THE PARAMETRIC CONSTRAINT CASE

A CHARACTERIZATION OF STRICT LOCAL MINIMIZERS OF ORDER ONE FOR STATIC MINMAX PROBLEMS IN THE PARAMETRIC CONSTRAINT CASE Journal of Applied Analysis Vol. 6, No. 1 (2000), pp. 139 148 A CHARACTERIZATION OF STRICT LOCAL MINIMIZERS OF ORDER ONE FOR STATIC MINMAX PROBLEMS IN THE PARAMETRIC CONSTRAINT CASE A. W. A. TAHA Received

More information

3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure?

3 (Due ). Let A X consist of points (x, y) such that either x or y is a rational number. Is A measurable? What is its Lebesgue measure? MA 645-4A (Real Analysis), Dr. Chernov Homework assignment 1 (Due ). Show that the open disk x 2 + y 2 < 1 is a countable union of planar elementary sets. Show that the closed disk x 2 + y 2 1 is a countable

More information

Supplementary Material

Supplementary Material ec1 Supplementary Material EC.1. Measures in D(S, µ, Ψ) Are Less Dispersed Lemma EC.1. Given a distributional set D(S, µ, Ψ) with S convex and a random vector ξ such that its distribution F D(S, µ, Ψ),

More information

ON THE ESSENTIAL BOUNDEDNESS OF SOLUTIONS TO PROBLEMS IN PIECEWISE LINEAR-QUADRATIC OPTIMAL CONTROL. R.T. Rockafellar*

ON THE ESSENTIAL BOUNDEDNESS OF SOLUTIONS TO PROBLEMS IN PIECEWISE LINEAR-QUADRATIC OPTIMAL CONTROL. R.T. Rockafellar* ON THE ESSENTIAL BOUNDEDNESS OF SOLUTIONS TO PROBLEMS IN PIECEWISE LINEAR-QUADRATIC OPTIMAL CONTROL R.T. Rockafellar* Dedicated to J-L. Lions on his 60 th birthday Abstract. Primal and dual problems of

More information

Dynamic Generation of Scenario Trees

Dynamic Generation of Scenario Trees Dynamic Generation of Scenario Trees Georg Ch. Pflug and Alois Pichler June 16, 015 Abstract We present new algorithms for the dynamic generation of scenario trees for multistage stochastic optimization.

More information

Airline Network Revenue Management by Multistage Stochastic Programming

Airline Network Revenue Management by Multistage Stochastic Programming Airline Network Revenue Management by Multistage Stochastic Programming K. Emich, H. Heitsch, A. Möller, W. Römisch Humboldt-University Berlin, Department of Mathematics Page 1 of 18 GOR-Arbeitsgruppe

More information

Inverse Stochastic Dominance Constraints Duality and Methods

Inverse Stochastic Dominance Constraints Duality and Methods Duality and Methods Darinka Dentcheva 1 Andrzej Ruszczyński 2 1 Stevens Institute of Technology Hoboken, New Jersey, USA 2 Rutgers University Piscataway, New Jersey, USA Research supported by NSF awards

More information

Convexity of chance constraints with dependent random variables: the use of copulae

Convexity of chance constraints with dependent random variables: the use of copulae Convexity of chance constraints with dependent random variables: the use of copulae René Henrion 1 and Cyrille Strugarek 2 1 Weierstrass Institute for Applied Analysis and Stochastics, 10117 Berlin, Germany.

More information

Complexity of two and multi-stage stochastic programming problems

Complexity of two and multi-stage stochastic programming problems Complexity of two and multi-stage stochastic programming problems A. Shapiro School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332-0205, USA The concept

More information

Extremal Solutions of Differential Inclusions via Baire Category: a Dual Approach

Extremal Solutions of Differential Inclusions via Baire Category: a Dual Approach Extremal Solutions of Differential Inclusions via Baire Category: a Dual Approach Alberto Bressan Department of Mathematics, Penn State University University Park, Pa 1682, USA e-mail: bressan@mathpsuedu

More information

A Two-Stage Moment Robust Optimization Model and its Solution Using Decomposition

A Two-Stage Moment Robust Optimization Model and its Solution Using Decomposition A Two-Stage Moment Robust Optimization Model and its Solution Using Decomposition Sanjay Mehrotra and He Zhang July 23, 2013 Abstract Moment robust optimization models formulate a stochastic problem with

More information

A Concise Course on Stochastic Partial Differential Equations

A Concise Course on Stochastic Partial Differential Equations A Concise Course on Stochastic Partial Differential Equations Michael Röckner Reference: C. Prevot, M. Röckner: Springer LN in Math. 1905, Berlin (2007) And see the references therein for the original

More information

Distributionally robust simple integer recourse

Distributionally robust simple integer recourse Distributionally robust simple integer recourse Weijun Xie 1 and Shabbir Ahmed 2 1 Department of Industrial and Systems Engineering, Virginia Tech, Blacksburg, VA 24061 2 School of Industrial & Systems

More information

A Geometric Framework for Nonconvex Optimization Duality using Augmented Lagrangian Functions

A Geometric Framework for Nonconvex Optimization Duality using Augmented Lagrangian Functions A Geometric Framework for Nonconvex Optimization Duality using Augmented Lagrangian Functions Angelia Nedić and Asuman Ozdaglar April 15, 2006 Abstract We provide a unifying geometric framework for the

More information

Optimization Tools in an Uncertain Environment

Optimization Tools in an Uncertain Environment Optimization Tools in an Uncertain Environment Michael C. Ferris University of Wisconsin, Madison Uncertainty Workshop, Chicago: July 21, 2008 Michael Ferris (University of Wisconsin) Stochastic optimization

More information

OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS

OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS APPLICATIONES MATHEMATICAE 29,4 (22), pp. 387 398 Mariusz Michta (Zielona Góra) OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS Abstract. A martingale problem approach is used first to analyze

More information

Weak convergence and Brownian Motion. (telegram style notes) P.J.C. Spreij

Weak convergence and Brownian Motion. (telegram style notes) P.J.C. Spreij Weak convergence and Brownian Motion (telegram style notes) P.J.C. Spreij this version: December 8, 2006 1 The space C[0, ) In this section we summarize some facts concerning the space C[0, ) of real

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Instructor: Moritz Hardt Email: hardt+ee227c@berkeley.edu Graduate Instructor: Max Simchowitz Email: msimchow+ee227c@berkeley.edu

More information

Stability Analysis for Mathematical Programs with Distributionally Robust Chance Constraint

Stability Analysis for Mathematical Programs with Distributionally Robust Chance Constraint Stability Analysis for Mathematical Programs with Distributionally Robust Chance Constraint Shaoyan Guo, Huifu Xu and Liwei Zhang September 24, 2015 Abstract. Stability analysis for optimization problems

More information

Robust Duality in Parametric Convex Optimization

Robust Duality in Parametric Convex Optimization Robust Duality in Parametric Convex Optimization R.I. Boţ V. Jeyakumar G.Y. Li Revised Version: June 20, 2012 Abstract Modelling of convex optimization in the face of data uncertainty often gives rise

More information

THEOREMS, ETC., FOR MATH 515

THEOREMS, ETC., FOR MATH 515 THEOREMS, ETC., FOR MATH 515 Proposition 1 (=comment on page 17). If A is an algebra, then any finite union or finite intersection of sets in A is also in A. Proposition 2 (=Proposition 1.1). For every

More information

Individual confidence intervals for true solutions to stochastic variational inequalities

Individual confidence intervals for true solutions to stochastic variational inequalities . manuscript o. 2will be inserted by the editor Michael Lamm et al. Individual confidence intervals for true solutions to stochastic variational inequalities Michael Lamm Shu Lu Amarjit Budhiraja. Received:

More information

arxiv: v2 [math.oc] 18 Nov 2017

arxiv: v2 [math.oc] 18 Nov 2017 DASC: A DECOMPOSITION ALGORITHM FOR MULTISTAGE STOCHASTIC PROGRAMS WITH STRONGLY CONVEX COST FUNCTIONS arxiv:1711.04650v2 [math.oc] 18 Nov 2017 Vincent Guigues School of Applied Mathematics, FGV Praia

More information

On Kusuoka representation of law invariant risk measures

On Kusuoka representation of law invariant risk measures On Kusuoka representation of law invariant risk measures Alexander Shapiro School of Industrial & Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive, Atlanta, GA 3332. Abstract. In this

More information

DELTA METHOD, INFINITE DIMENSIONAL

DELTA METHOD, INFINITE DIMENSIONAL DELTA METHOD, INFINITE DIMENSIONAL Let T n be a sequence of statistics with values in some linear topological space D converging to some θ D. Examples are the empirical distribution function in the Skorohod

More information

Fenchel-Moreau Conjugates of Inf-Transforms and Application to Stochastic Bellman Equation

Fenchel-Moreau Conjugates of Inf-Transforms and Application to Stochastic Bellman Equation Fenchel-Moreau Conjugates of Inf-Transforms and Application to Stochastic Bellman Equation Jean-Philippe Chancelier and Michel De Lara CERMICS, École des Ponts ParisTech First Conference on Discrete Optimization

More information

ON A CLASS OF NONSMOOTH COMPOSITE FUNCTIONS

ON A CLASS OF NONSMOOTH COMPOSITE FUNCTIONS MATHEMATICS OF OPERATIONS RESEARCH Vol. 28, No. 4, November 2003, pp. 677 692 Printed in U.S.A. ON A CLASS OF NONSMOOTH COMPOSITE FUNCTIONS ALEXANDER SHAPIRO We discuss in this paper a class of nonsmooth

More information

Distributionally Robust Stochastic Optimization with Wasserstein Distance

Distributionally Robust Stochastic Optimization with Wasserstein Distance Distributionally Robust Stochastic Optimization with Wasserstein Distance Rui Gao DOS Seminar, Oct 2016 Joint work with Anton Kleywegt School of Industrial and Systems Engineering Georgia Tech What is

More information

2 Infinite products and existence of compactly supported φ

2 Infinite products and existence of compactly supported φ 415 Wavelets 1 Infinite products and existence of compactly supported φ Infinite products.1 Infinite products a n need to be defined via limits. But we do not simply say that a n = lim a n N whenever the

More information

Duality and optimality conditions in stochastic optimization and mathematical finance

Duality and optimality conditions in stochastic optimization and mathematical finance Duality and optimality conditions in stochastic optimization and mathematical finance Sara Biagini Teemu Pennanen Ari-Pekka Perkkiö April 25, 2015 Abstract This article studies convex duality in stochastic

More information

Lagrange Relaxation: Introduction and Applications

Lagrange Relaxation: Introduction and Applications 1 / 23 Lagrange Relaxation: Introduction and Applications Operations Research Anthony Papavasiliou 2 / 23 Contents 1 Context 2 Applications Application in Stochastic Programming Unit Commitment 3 / 23

More information

On a Class of Multidimensional Optimal Transportation Problems

On a Class of Multidimensional Optimal Transportation Problems Journal of Convex Analysis Volume 10 (2003), No. 2, 517 529 On a Class of Multidimensional Optimal Transportation Problems G. Carlier Université Bordeaux 1, MAB, UMR CNRS 5466, France and Université Bordeaux

More information

Semidefinite and Second Order Cone Programming Seminar Fall 2012 Project: Robust Optimization and its Application of Robust Portfolio Optimization

Semidefinite and Second Order Cone Programming Seminar Fall 2012 Project: Robust Optimization and its Application of Robust Portfolio Optimization Semidefinite and Second Order Cone Programming Seminar Fall 2012 Project: Robust Optimization and its Application of Robust Portfolio Optimization Instructor: Farid Alizadeh Author: Ai Kagawa 12/12/2012

More information

ON THE REGULARITY OF ONE PARAMETER TRANSFORMATION GROUPS IN BARRELED LOCALLY CONVEX TOPOLOGICAL VECTOR SPACES

ON THE REGULARITY OF ONE PARAMETER TRANSFORMATION GROUPS IN BARRELED LOCALLY CONVEX TOPOLOGICAL VECTOR SPACES Communications on Stochastic Analysis Vol. 9, No. 3 (2015) 413-418 Serials Publications www.serialspublications.com ON THE REGULARITY OF ONE PARAMETER TRANSFORMATION GROUPS IN BARRELED LOCALLY CONVEX TOPOLOGICAL

More information

Convex relaxations of chance constrained optimization problems

Convex relaxations of chance constrained optimization problems Convex relaxations of chance constrained optimization problems Shabbir Ahmed School of Industrial & Systems Engineering, Georgia Institute of Technology, 765 Ferst Drive, Atlanta, GA 30332. May 12, 2011

More information

DUALITY, OPTIMALITY CONDITIONS AND PERTURBATION ANALYSIS

DUALITY, OPTIMALITY CONDITIONS AND PERTURBATION ANALYSIS 1 DUALITY, OPTIMALITY CONDITIONS AND PERTURBATION ANALYSIS Alexander Shapiro 1 School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332-0205, USA, E-mail: ashapiro@isye.gatech.edu

More information

Robust and Stochastic Optimization Notes. Kevin Kircher, Cornell MAE

Robust and Stochastic Optimization Notes. Kevin Kircher, Cornell MAE Robust and Stochastic Optimization Notes Kevin Kircher, Cornell MAE These are partial notes from ECE 6990, Robust and Stochastic Optimization, as taught by Prof. Eilyan Bitar at Cornell University in the

More information

Birgit Rudloff Operations Research and Financial Engineering, Princeton University

Birgit Rudloff Operations Research and Financial Engineering, Princeton University TIME CONSISTENT RISK AVERSE DYNAMIC DECISION MODELS: AN ECONOMIC INTERPRETATION Birgit Rudloff Operations Research and Financial Engineering, Princeton University brudloff@princeton.edu Alexandre Street

More information

Lecture Note 5: Semidefinite Programming for Stability Analysis

Lecture Note 5: Semidefinite Programming for Stability Analysis ECE7850: Hybrid Systems:Theory and Applications Lecture Note 5: Semidefinite Programming for Stability Analysis Wei Zhang Assistant Professor Department of Electrical and Computer Engineering Ohio State

More information

A model for dynamic chance constraints in hydro power reservoir management

A model for dynamic chance constraints in hydro power reservoir management A model for dynamic chance constraints in hydro power reservoir management L. Andrieu, R. Henrion, W. Römisch January 18, 2009 2000 Mathematics Subject Classification. 90C15, 90B05. Keywords: dynamic chance

More information

Applied Analysis (APPM 5440): Final exam 1:30pm 4:00pm, Dec. 14, Closed books.

Applied Analysis (APPM 5440): Final exam 1:30pm 4:00pm, Dec. 14, Closed books. Applied Analysis APPM 44: Final exam 1:3pm 4:pm, Dec. 14, 29. Closed books. Problem 1: 2p Set I = [, 1]. Prove that there is a continuous function u on I such that 1 ux 1 x sin ut 2 dt = cosx, x I. Define

More information