Scenario estimation and generation
|
|
- Warren Poole
- 5 years ago
- Views:
Transcription
1 October 10, 2004
2 The one-period case Distances of Probability Measures Tensor products of trees Tree reduction
3 A decision problem is subject to uncertainty Uncertainty is represented by probability To reduce computational complexity, a discrete probability with only few mass points is preferred The discrete probability distribution representing uncertainty is called the scenario model.
4 The two phases of scenario generation Phase 1. Find the correct (appropriate, reasonable) probability distribution - the uncertainty model Phase 2. Find a scenario model, such that the information loss going from the uncertainty model to the scenario model is small Phase 1 is done by Statistical Estimation Expert opinion Regulator s rules Any combination of the above
5 Multistage decisions and multistage scenarios ξ 1,..., ξ T a multivariate time series process (e.g. future interest rates, future asset prices, etc.) F 0,... F T 1 a filtration
6 x 0,..., x T 1 decisions observation of observation of observation of the r.v. ξ 1 the r.v. ξ 2 the r.v. ξ 3 = 0 t = t 1 t = t 2 t = t 3 decision decision decision decision x 0 x 1 x 2 x 3
7 The success of the strategy is expressed in terms of a cost function H(x 0, ξ 1, x 1,..., x T 1, ξ T ) The final objective is to minimize a functional F of the cost success function, such as the expectation, a quantile or some other functional F[H(x 0, ξ 1, x 1,..., x T 1, ξ T )] Minimize in x 0, x 1 (ξ 1 ),..., x T 1 (ξ 1,..., ξ T 1 ) : F[H(x 0, ξ 1,..., x T 1, ξ T )] under the information constraints as well as other constraints Information (measurability) constraints x 0 = a constant F 0 measurable x 1 = x 1 (ξ 1 ) F 1 measurable. x T 1 = x T 1 (ξ 1, ξ 2,..., ξ T 1 ) F T 1 measurable
8 Stochastic processes See a stochastic process ξ 1,..., ξ T as a random element in R T See a stochastic process and a sequence of transition probabilities P{ξ 1 A 1 }, P{ξ 2 A 2 ξ 1 }, P{ξ 3 A 3 ξ 1, ξ 2 },... Only the second view models the information structure along with the uncertainty structure.
9 The one-period case Distances of Probability Measures Tree Approximations The transition probability view of a stochastic process leads to tree processes in the discrete world. A stochastic process ν 1,..., ν T is a tree process, if all conditional distributions P{ν 1,..., ν t 1 ν t } are degenerated or - equivalenty - σ(ν t ) = σ(ν 1, ν 2,..., ν t ). Every stochastic process is a function of a tree process. v 1 4 p 4 1 v p 4 v p 5 5 p 5 v p 6 6 p 6 v 0 v 2 v p p 7 v p 8 8 p 8 v 9 3 v 3 9 p p v p p 10
10 The one-period case Distances of Probability Measures The approximating problem Minimize in x 0, x 1 ( ξ 1 ),..., x T 1 ( ξ 1,..., ξ T 1 ) : F[H(x 0, ξ 1,..., x T 1, ξ T )] under the information constraints as well as other constraints Information (measurability) constraints x 0 = a constant F 0 measurable x 1 = x 1 ( ξ 1 ) F 1 measurable x 2 = x 2 ( ξ 1, ξ 2 ) F 2 measurable. x T 1 = x T 1 ( ξ 1, ξ 2,..., ξ T 1 ) F T 1 measurable Error= min(,, ) min(,, ).
11 The one-period case Distances of Probability Measures The one-period case G original distribution function G discrete approximation G : values v 1 v 2 v m probabilities p 1 p 2 p m
12 The one-period case Distances of Probability Measures Distances of Probability measures Let H be a family of functions. Define a semidistance by d H (G 1, G 2 ) = sup{ h(w) dg 1 (w) h(w) dg 2 (w) : h H}.. If H is the class of the indicator functions 1l A of all measurable sets, the variational distance is obtained d V (G 1, G 2 ) = sup{ 1l A (u) d[g 1 G 2 ](u) : A measurable}. If H is the class of indicator functions of half-unbounded rectangles in R k the Kolmogorov-Smirnov distance is obtained d KS (G 1, G 2 ) = sup{ G 1 (x) G 2 (x) : x R k }.
13 The one-period case Distances of Probability Measures If H is the class of Lipschitz-continuous functions with Lipschitz-constant 1 the Wasserstein distance is obtained. d W (G 1, G 2 ) = sup{ h dg 1 hdg 2 : h(u) h(v) u v }. If Hc is the class of Lipschitz functions of order p, the Fortet-Mourier distance is obtained. d FMp (G 1, G 2 ) = sup{ h dg 1 hdg 2 : L p (h) 1 where L p (f ) = inf{l : h(u) h(v) L u v max(1, u p 1, v p 1 )}.
14 The one-period case Distances of Probability Measures Suppose that the stochastic optimization problem is to maximize h(x, u) dg(u). If H is a family of functions containing the functions {h(x, ) : x X}. Then defining a semidistance as d H (G 1, G 2 ) = sup{ h(w) dg 1 (w) h(w) dg 2 (w) : h H}. entails that Error sup x h(x, w) dg 1 (w) Typical integrands are of the form h(x, w) dg 2 (w) d H (G 1, G 2 ). u i α i (x)[c i (x) u d i (x)] + i.e. they are Lipschitz in u.
15 The one-period case Distances of Probability Measures KS-distance and W-distance: A comparison Let ξ 1 G 1, ξ 2 G 2 d KS (G 1, G 2 ) = sup{ G 1 (u) G 2 (u) } x = sup{ P(ξ 1 u) P(ξ 2 u) }. Hlawka-Koksma Inequality: h(u) dg 1 (u) h(u) dg 2 (u) d KS (G 1, G 2 ) V (h). where V (h) is the total variation of h V (h) = sup{ i h(z i ) h(z i 1 : z 1 < z 2 < < z n, n arbitrary }.
16 The one-period case Distances of Probability Measures If K is a monotonic function, then d KS (K(ξ 1 ), K(ξ 2 )) = d KS (ξ 1, ξ 2 ). Therefore, using the quantile transform, the problem reduces to approximate the uniform [0,1] distribution. If u 1 u 2 u m p 1 p 2 p m approximates the uniform [0,1] distribution with d KS distance ɛ, then G 1 (u 1 ) G 1 (u 2 ) G 1 (u m ) p 1 p 2 p m approximates G also with d KS distance ɛ.
17 The one-period case Distances of Probability Measures The optimal approximation of a continuous distribution G by a distribution sitting on mass points v 1,..., v n with probabilities p 1,..., p n w.r.t. the KS distance is given by The distance is 1/n. z i = G 1 ( 2i 1 2n ), p i = 1/n
18 The one-period case Distances of Probability Measures Other KS approximations The Monte Carlo method If U i is a sequence of i.i.d. random variables from a uniform [0,1], then distribution G n sitting on points v i = G 1 (U i ) with masses 1/n satisfies P{sup G(v) G n (v) ɛ/ n} 58 exp( 2ɛ 2 ). v (Dvoretzky, Kiefer, Wolfowitz inequality) The Quasi Monte Carlo method A sequence u i is called a low discrepancy sequence in [0,1] (e.g. the Sobol sequence), if the KS distance between the uniform distribution and the empirical distribution based on (u i ) is O(log(n)/n). Then with v i = G 1 (u i ) with masses 1/n we have d KS (G, G n ) C log n n for all n.
19 The one-period case Distances of Probability Measures The W-distance and the facility location problem d W (G 1, G 2 ) = sup{ h dg 1 hdg 2 : h(u) h(v) u v }. Theorem (Kantorovich-Rubinstein). Dual version of Wasserstein-distance: d W (G 1, G 2 ) = inf{e( X Y : (X, Y ) is a bivariate r.v. with given marginal distribution functions G 1 and G 2 }.
20 The one-period case Distances of Probability Measures Remark If both measures sit on a finite number of mass points {v 1, v 2,... }, then d W (G 1, G 2 ) is the optimal value of the following linear optimization problem: Minimize i,j κ ijr ij i κ ij = µ j for all j j κ ij = ν i for all i Here µ i resp. ν i is the mass sitting on v i and r i,j = v i v j. Interpretation as an optimal mass transportation problem:
21 The one-period case Distances of Probability Measures For an infinite space, it is in general impossible to find the explicit form of the joint distribution of X and Y which minimizes E( X Y ). For the case k = 1 and for a convex function ψ, the explicit solution of the mass transportation problem is known: Lemma.(Dall Aglio (1972)) inf{e(ψ(x Y ) : (X, Y ) is a bivariate r.v. with marginals G 1 and G 2 } = 1 0 ψ(g (u) G (u)) du. Corollary. The Wasserstein distance on R 1 satisfies d W (G 1, G 2 ) = G1 1 1 (u) G2 (u) du = G 1 (u) G 2 (u) du. 2
22 The one-period case Distances of Probability Measures An example Suppose we want to approximate the t-distribution with 2 degrees of freedom by a probability measure sitting on five points. Using the KS- distance one gets the solution G 1 value probability Using the Wasserstein distance one gets G 2 value probability
23 The one-period case Distances of Probability Measures Example (continued)- A newsboy problem Consider the family of functions w h(w, a) = [w a] [w a]. We have plotted a h(w, a) dg(w) (solid) a h(w, a) d G 1 (w) (dotted), a h(w, a) d G 2 (w) (dashed). One sees that G 2 gives a better approximation and the location of the minimum is also closer to the true one
24 The one-period case Distances of Probability Measures Finding the WD approximation Calculating a W-distance minimal n-point approximation G n of a distribution G equals solving a transportation problem. The goal is find the set of borders B b i, i = 1,..., n + 1 which solve the problem minimize n i=1 bi+1 b i g(x) v i d(x) The ith transportation-center v i can be calculated as follows: v i = G 1 ( 1 2 bi+1 b i bi g(x) dx g(x) dx) b 1
25 The one-period case Distances of Probability Measures Global Optimization Branch and Bound can be applied to calculate the global minimum. Divide search space into N sections and create the B&B tree recursively: Set the first border b 2 to all N n + 1 positions, these form subproblems with n 1 transportation centers. This method lowers the dimension of the problem. Upper bounds are evaluated at the leaves of the B&B tree and the lower bounds can be calculated by finding the minimum possible transportation cost within two borders. Local Optimization Meta-heuristics may be applied to find local minima much faster. E.g. a combination of iterative local search with simulated annealing: 1. Generate initial set of borders B (e.g. KS-distance optimal borders) 2. Move border b x which best improves the optimal value of problem. 3. If no border can be moved improving the optimal value, start simulated annealing (Randomly choose a border, if movement improves the optimal value, move it, otherwise draw random number and decide whether to move it or not, lower temperature,...)
26 The one-period case Distances of Probability Measures Approximation: Fortet-Mourier distance Via transformation approximable with Wasserstein distance minimization: { χ p u u 1 (u) = sign(u) u p u > 1 Choose p: Transform G with χ p G 1/p = G χ 1/p Approximate G 1/p by G 1/p with min(wasserstein) Backtransformation: G = G 1/p χ p
27 The one-period case Distances of Probability Measures Approximation methods: Summary Full Monte Carlo Quasi Monte Carlo Moment matching KS-approximation Wasserstein and Fortet-Mourier Approximation some more
28 The one-period case Distances of Probability Measures Moment matching? Advantage: Easy to do. Moments do not characterize the distribution. The moment distance d(g, G) = sup k u k dg(u) u k d G(u) is not a distance
29 Tensor products of trees Tree reduction Phase 1: Estimation and simulation of paths Parametric approach: Use data, estimate (time-series) model, simulate paths over whole time/all stages t = 4 t = 3 t = 2 t = 1 t = 0 t = 1 t = 2 Dow Jones Industrial: n = 10 simulated GARCH(1,1) paths
30 Tensor products of trees Tree reduction Phase 2: Generating multi-variate, multi-period trees Step 1. Approximate data in the first stage (e.g. Wasserstein distance) t = 0 t = 1 t = 2 t = 3
31 Tensor products of trees Tree reduction Generating multi-variate, multi-period trees Step 2. For subsequent stages use paths conditional to predecessor t = 0 t = 1 t = 2 t = 3
32 Tensor products of trees Tree reduction Generating multi-variate, multi-period trees Step 3. Iterate through the whole tree t = 0 t = 1 t = 2 t = 3
33 Tensor products of trees Tree reduction Mathematics behind Let P t (A t x t 1 ) be the conditional probability of ξ t A t given the past ξ (t 1) = (ξ 1,..., ξ (t 1) ) = x t 1 = (x 1,..., x t 1 ). Let P another such probability, again dissected into its chain of conditional probabilities. We define d(p, P) = d(p 1, P 1 ) + T t=2 sup d(p t ( x (t 1) ), P t ( x (t 1) )). x (t 1) where d is the Wasserstein distance. For an empirical measure (or any finitely supported measure), the conditional probability does only exist except for finitely many conditions. However we define the distance as zero, if the conditional distribution is not defined. d does not fulfill the triangle inequality. However, d reflects the information structure. Notice that the usual empirical does not converge w.r.t. d, only the tree empirical does.
34 Tensor products of trees Tree reduction Empricals and tree empiricals Ordinary empirical and tree empirical
35 Tensor products of trees Tree reduction Tensor products of tree processes Suppose that (ξ (1) t ) and (ξ (2) t ) are two tree processes. There is just one way of constructing the joint tree process (ξ (1) t, ξ (2) t ) such that the two components are independent. However, more often one needs to construct a joint process with given correlation.
36 Tensor products of trees Tree reduction Joint distributions with given marginals and given rrelation Constructing a joint distribution Q with given marginals X = (x i, p 1i ), Y = (y i, p 2i ) and given correlation ρ can be calculated such that an additional (tree) reduction is obtained by solving the non-linear program minimize subject to m n i=1 j=1 η(q ij) m i=1 q ij = p 1j j = 1,..., n n j=1 q ij = p 2i i = 1,..., m m i=1 n j=1 q ijx i y j = E(X )E(Y ) ρ Var(X )Var(Y ) with η(x) = { 0 if x = 0, M if x > 0.
37 Tensor products of trees Tree reduction An example Two asset categories, first stage, 3 nodes each. Stocks x i p i Bonds x i p i Joint distribution with ρ = 0.4 and reduction: Bonds / Stocks
38 Tensor products of trees Tree reduction Tree reduction Distance based tree reduction (Dupacova, Groewe, Roemisch; Heitsch) EVPI based tree reduction (Dempster, Thompson, Consigli)
39 Tensor products of trees Tree reduction Distance based tree reduction Rule: If two branches of the tree are closer in distance than some threshold, collapse the two.
40 Tensor products of trees Tree reduction EVPI based tree reduction EVPI = Feasible minimum - Clairvoyant s minimum Feasible minimum = min{f[h(x 0, ξ 1,..., x T 1, ξ T )] : x 0, x 1 ( ξ 1 ),..., x T 1 ( ξ 1,..., ξ T 1 )} Clairvoynt s minimum = min{f[h(x 0, ξ 1,..., x T 1, ξ T )] : x 0 ( ξ 1,..., ξ T 1 ),..., x T 1 ( ξ 1,..., ξ T 1 )} EVPI may be defined for every subtree (given the optimal decision in earlier stages). This EVPI process is a supermartingale. However, there is no relation between the EVPI s of full (finer) model and a reduced (coarser) model.
41 Tensor products of trees Tree reduction EVPI EVPI
42 Empirical convergence of central moments (1) Data: Weekly data of DJI and 10-year T-Bonds: 01/ /1999 Approximation: Wasserstein, Monte Carlo, Sobol Sequence, Moment matching x First and second central moment approximation (n = 2 : 35)
43 Empirical convergence of central moments (2) 6 x x Third and fourth central moment approximation (n = 2 : 35) Moment matching (Kaut [2003]) started to match at n = 15 : 20.
44 Approximation errors: Single-stage portfolio selection Mathematical models M Risk functionals F: CVaR α : inf{a α E[Y a]+ : a R} Mean Absolute Deviation (MAD): n i=1 x i E(X ) Approximation methods S: Moment matching (Høyland et al. [2003]) Probability distance minimization (Wasserstein distance) Quasi-random sampling (Low discrepancy series: Sobol sequence)
45 Risk measures: Linear programming formulations Mean Absolute Deviation [Konno/Yamazaki 1991][Feinstein/Thapa 1993] maximize subject to E(x, ξ) S s=1 p sz s z s S s=1 p sz s s = 1,..., S x X Conditional Value at Risk [Rockafellar/Uryasev 1999][Uryasev 2000] maximize γ 1 S 1 α s=1 p sz s subject to z s S s=1 p sz s s = 1,..., S x T e E(x, ξ) x X Portfolio constraints X : A a=1 x a 1, a : max(x a ) = 0.5,...
46 Empirical results 13 (somewhat randomly selected) assets: AOL, C, CSCO, DIS, EMC, GE, HPQ, MOT, NT, PFE, SUNW, WMT, XOM Weekly data from January 1993 to January Rolling horizon: asset allocation, backtracking Optimize MAD and CVaR with full data and approximations
47 Empirical results: MAD Example (Asset Allocation): Data 01/ /1995, n = 50 aol aol c xom c csco dis xom csco dis sunw wmt emc emc pfe hpq mot nt pfe nt mot hpq sunw wmt ge Full dataset ge Wasserstein xom sunw wmt pfe nt aol xom wmt mot sunw pfe aol hpq nt c mot csco emc dis c ge Moment matching csco dis emc ge hpq Sobol sequence
48 Empirical results: CVaR α Example (Asset Allocation): Data 01/ /2001, α = 0.1, n = 50 mot emc hpq ge dis cscoc aol xom nt mothpq csco emc dis ge caol xom nt pfe wmt wmt pfe sunw Full dataset sunw Wasserstein csco xom aol c aol xom wmt emc dis ge sunw c pfe wmt csco hpq nt dis sunw mot pfe nt Moment matching emc ge hpq mot Sobol
49 Scenario Generation and Backtracking (1) Expected Shortfall α = 0.4, n = Complete Dataset Wasserstein Moment Matching Crude Monte Carlo
50 Scenario Generation and Backtracking (2) Mean Absolute Deviation (MAD), n = Complete Dataset Wasserstein Moment Matching Crude Monte Carlo
51 Scenario Generation and Backtracking (3) Expected Shortfall α = 0.4, n = 20 - Moment Matching failed, substituted with Quasi Random Sampling Complete Dataset Wasserstein Quasi Monte Carlo Crude Monte Carlo
52 Scenario Generation and Backtracking (4) Mean Absolute Deviation (MAD), n = 20 - Moment Matching failed, substituted with Quasi Random Sampling Complete Dataset Wasserstein Quasi Monte Carlo Crude Monte Carlo
53 Scenario Generation and Backtracking (5) Expected Shortfall α = 0.4, n = Complete Dataset Wasserstein Moment Matching Crude Monte Carlo
54 Scenario Generation and Backtracking (6) Mean Absolute Deviation (MAD), n = Complete Dataset Wasserstein Moment Matching Crude Monte Carlo
Introduction to Stochastic Optimization Part 4: Multi-stage decision
Introduction to Stochastic Optimization Part 4: Multi-stage decision problems April 23, 29 The problem ξ = (ξ,..., ξ T ) a multivariate time series process (e.g. future interest rates, future asset prices,
More informationAmbiguity in portfolio optimization
May/June 2006 Introduction: Risk and Ambiguity Frank Knight Risk, Uncertainty and Profit (1920) Risk: the decision-maker can assign mathematical probabilities to random phenomena Uncertainty: randomness
More informationStability of Stochastic Programming Problems
Stability of Stochastic Programming Problems W. Römisch Humboldt-University Berlin Institute of Mathematics 10099 Berlin, Germany http://www.math.hu-berlin.de/~romisch Page 1 of 35 Spring School Stochastic
More informationScenario Reduction: Old and New Results
Scenario Reduction: Old and New Results W. Römisch Humboldt-University Berlin Institute of Mathematics 10099 Berlin, Germany http://www.math.hu-berlin.de/~romisch (H. Heitsch, R. Henrion, C. Küchler) Workshop
More informationStability-based generation of scenario trees for multistage stochastic programs
Stability-based generation of scenario trees for multistage stochastic programs H. Heitsch and W. Römisch Humboldt-University Berlin Institute of Mathematics 10099 Berlin, Germany http://www.math.hu-berlin.de/~romisch
More informationJitka Dupačová and scenario reduction
Jitka Dupačová and scenario reduction W. Römisch Humboldt-University Berlin Institute of Mathematics http://www.math.hu-berlin.de/~romisch Session in honor of Jitka Dupačová ICSP 2016, Buzios (Brazil),
More informationInformation theoretic perspectives on learning algorithms
Information theoretic perspectives on learning algorithms Varun Jog University of Wisconsin - Madison Departments of ECE and Mathematics Shannon Channel Hangout! May 8, 2018 Jointly with Adrian Tovar-Lopez
More informationScenario generation in stochastic programming
Scenario generation in stochastic programming Werner Römisch Humboldt-University Berlin, Institute of Mathematics, 10099 Berlin, Germany, romisch@math.hu-berlin.de Abstract Stability-based methods for
More informationScenario generation in stochastic programming with application to energy systems
Scenario generation in stochastic programming with application to energy systems W. Römisch Humboldt-University Berlin Institute of Mathematics www.math.hu-berlin.de/~romisch SESO 2017 International Thematic
More informationStability of optimization problems with stochastic dominance constraints
Stability of optimization problems with stochastic dominance constraints D. Dentcheva and W. Römisch Stevens Institute of Technology, Hoboken Humboldt-University Berlin www.math.hu-berlin.de/~romisch SIAM
More informationAsymptotic distribution of the sample average value-at-risk
Asymptotic distribution of the sample average value-at-risk Stoyan V. Stoyanov Svetlozar T. Rachev September 3, 7 Abstract In this paper, we prove a result for the asymptotic distribution of the sample
More informationBirgit Rudloff Operations Research and Financial Engineering, Princeton University
TIME CONSISTENT RISK AVERSE DYNAMIC DECISION MODELS: AN ECONOMIC INTERPRETATION Birgit Rudloff Operations Research and Financial Engineering, Princeton University brudloff@princeton.edu Alexandre Street
More informationMean-field dual of cooperative reproduction
The mean-field dual of systems with cooperative reproduction joint with Tibor Mach (Prague) A. Sturm (Göttingen) Friday, July 6th, 2018 Poisson construction of Markov processes Let (X t ) t 0 be a continuous-time
More informationRobustness and bootstrap techniques in portfolio efficiency tests
Robustness and bootstrap techniques in portfolio efficiency tests Dept. of Probability and Mathematical Statistics, Charles University, Prague, Czech Republic July 8, 2013 Motivation Portfolio selection
More informationReformulation of chance constrained problems using penalty functions
Reformulation of chance constrained problems using penalty functions Martin Branda Charles University in Prague Faculty of Mathematics and Physics EURO XXIV July 11-14, 2010, Lisbon Martin Branda (MFF
More informationGeneralized quantiles as risk measures
Generalized quantiles as risk measures Bellini, Klar, Muller, Rosazza Gianin December 1, 2014 Vorisek Jan Introduction Quantiles q α of a random variable X can be defined as the minimizers of a piecewise
More informationA note on scenario reduction for two-stage stochastic programs
A note on scenario reduction for two-stage stochastic programs Holger Heitsch a and Werner Römisch a a Humboldt-University Berlin, Institute of Mathematics, 199 Berlin, Germany We extend earlier work on
More informationProbability metrics and the stability of stochastic programs with recourse
Probability metrics and the stability of stochastic programs with recourse Michal Houda Charles University, Faculty of Mathematics and Physics, Prague, Czech Republic. Abstract In stochastic optimization
More informationDynamic Risk Measures and Nonlinear Expectations with Markov Chain noise
Dynamic Risk Measures and Nonlinear Expectations with Markov Chain noise Robert J. Elliott 1 Samuel N. Cohen 2 1 Department of Commerce, University of South Australia 2 Mathematical Insitute, University
More informationP (A G) dp G P (A G)
First homework assignment. Due at 12:15 on 22 September 2016. Homework 1. We roll two dices. X is the result of one of them and Z the sum of the results. Find E [X Z. Homework 2. Let X be a r.v.. Assume
More informationData-Driven Risk-Averse Two-Stage Stochastic Program with ζ-structure Probability Metrics
Data-Driven Risk-Averse Two-Stage Stochastic Program with ζ-structure Probability Metrics Chaoyue Zhao and Yongpei Guan Department of Industrial and Systems Engineering University of Florida, Gainesville,
More informationLecture Quantitative Finance Spring Term 2015
on bivariate Lecture Quantitative Finance Spring Term 2015 Prof. Dr. Erich Walter Farkas Lecture 07: April 2, 2015 1 / 54 Outline on bivariate 1 2 bivariate 3 Distribution 4 5 6 7 8 Comments and conclusions
More informationAggregate Risk. MFM Practitioner Module: Quantitative Risk Management. John Dodson. February 6, Aggregate Risk. John Dodson.
MFM Practitioner Module: Quantitative Risk Management February 6, 2019 As we discussed last semester, the general goal of risk measurement is to come up with a single metric that can be used to make financial
More informationScenario generation Contents
Scenario generation W. Römisch Humboldt-University Berlin Department of Mathematics www.math.hu-berlin.de/~romisch Page 1 of 39 Tutorial, ICSP12, Halifax, August 14, 2010 (1) Aproximation issues (2) Generation
More informationIf g is also continuous and strictly increasing on J, we may apply the strictly increasing inverse function g 1 to this inequality to get
18:2 1/24/2 TOPIC. Inequalities; measures of spread. This lecture explores the implications of Jensen s inequality for g-means in general, and for harmonic, geometric, arithmetic, and related means in
More informationComplexity of two and multi-stage stochastic programming problems
Complexity of two and multi-stage stochastic programming problems A. Shapiro School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332-0205, USA The concept
More informationHW1 solutions. 1. α Ef(x) β, where Ef(x) is the expected value of f(x), i.e., Ef(x) = n. i=1 p if(a i ). (The function f : R R is given.
HW1 solutions Exercise 1 (Some sets of probability distributions.) Let x be a real-valued random variable with Prob(x = a i ) = p i, i = 1,..., n, where a 1 < a 2 < < a n. Of course p R n lies in the standard
More informationStochastic Programming: From statistical data to optimal decisions
Stochastic Programming: From statistical data to optimal decisions W. Römisch Humboldt-University Berlin Department of Mathematics (K. Emich, H. Heitsch, A. Möller) Page 1 of 24 6th International Conference
More informationChapter 2: Fundamentals of Statistics Lecture 15: Models and statistics
Chapter 2: Fundamentals of Statistics Lecture 15: Models and statistics Data from one or a series of random experiments are collected. Planning experiments and collecting data (not discussed here). Analysis:
More informationIntroduction to Algorithmic Trading Strategies Lecture 10
Introduction to Algorithmic Trading Strategies Lecture 10 Risk Management Haksun Li haksun.li@numericalmethod.com www.numericalmethod.com Outline Value at Risk (VaR) Extreme Value Theory (EVT) References
More informationDynamic Generation of Scenario Trees
Dynamic Generation of Scenario Trees Georg Ch. Pflug and Alois Pichler June 16, 015 Abstract We present new algorithms for the dynamic generation of scenario trees for multistage stochastic optimization.
More informationORIGINS OF STOCHASTIC PROGRAMMING
ORIGINS OF STOCHASTIC PROGRAMMING Early 1950 s: in applications of Linear Programming unknown values of coefficients: demands, technological coefficients, yields, etc. QUOTATION Dantzig, Interfaces 20,1990
More informationLecture 2. We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales.
Lecture 2 1 Martingales We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales. 1.1 Doob s inequality We have the following maximal
More informationCONTAGION VERSUS FLIGHT TO QUALITY IN FINANCIAL MARKETS
EVA IV, CONTAGION VERSUS FLIGHT TO QUALITY IN FINANCIAL MARKETS Jose Olmo Department of Economics City University, London (joint work with Jesús Gonzalo, Universidad Carlos III de Madrid) 4th Conference
More informationCS229T/STATS231: Statistical Learning Theory. Lecturer: Tengyu Ma Lecture 11 Scribe: Jongho Kim, Jamie Kang October 29th, 2018
CS229T/STATS231: Statistical Learning Theory Lecturer: Tengyu Ma Lecture 11 Scribe: Jongho Kim, Jamie Kang October 29th, 2018 1 Overview This lecture mainly covers Recall the statistical theory of GANs
More informationLecture 21: Convergence of transformations and generating a random variable
Lecture 21: Convergence of transformations and generating a random variable If Z n converges to Z in some sense, we often need to check whether h(z n ) converges to h(z ) in the same sense. Continuous
More informationAn Alternative Method for Estimating and Simulating Maximum Entropy Densities
An Alternative Method for Estimating and Simulating Maximum Entropy Densities Jae-Young Kim and Joonhwan Lee Seoul National University May, 8 Abstract This paper proposes a method of estimating and simulating
More informationScenario Grouping and Decomposition Algorithms for Chance-constrained Programs
Scenario Grouping and Decomposition Algorithms for Chance-constrained Programs Siqian Shen Dept. of Industrial and Operations Engineering University of Michigan Joint work with Yan Deng (UMich, Google)
More informationStein s method and zero bias transformation: Application to CDO pricing
Stein s method and zero bias transformation: Application to CDO pricing ESILV and Ecole Polytechnique Joint work with N. El Karoui Introduction CDO a portfolio credit derivative containing 100 underlying
More informationMathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio ( )
Mathematical Methods for Neurosciences. ENS - Master MVA Paris 6 - Master Maths-Bio (2014-2015) Etienne Tanré - Olivier Faugeras INRIA - Team Tosca October 22nd, 2014 E. Tanré (INRIA - Team Tosca) Mathematical
More informationMultistage stochastic programs: Time-consistency, time-inconsistency and martingale bounds
Multistage stochastic programs: Time-consistency, time-inconsistency and martingale bounds Georg Ch. Pflug, joint work with Raimund Kovacevic and Alois Pichler April 2016 The time-consistency problem Many
More informationMotivation General concept of CVaR Optimization Comparison. VaR and CVaR. Přemysl Bejda.
VaR and CVaR Přemysl Bejda premyslbejda@gmail.com 2014 Contents 1 Motivation 2 General concept of CVaR 3 Optimization 4 Comparison Contents 1 Motivation 2 General concept of CVaR 3 Optimization 4 Comparison
More informationCVaR distance between univariate probability distributions and approximation problems
https://doi.org/10.1007/s10479-017-2732-8 S.I.: RISK MANAGEMENT APPROACHES IN ENGINEERING APPLICATIONS CVaR distance between univariate probability distributions and approximation problems Konstantin Pavlikov
More informationAsymptotic Statistics-VI. Changliang Zou
Asymptotic Statistics-VI Changliang Zou Kolmogorov-Smirnov distance Example (Kolmogorov-Smirnov confidence intervals) We know given α (0, 1), there is a well-defined d = d α,n such that, for any continuous
More informationOptimization Problems with Probabilistic Constraints
Optimization Problems with Probabilistic Constraints R. Henrion Weierstrass Institute Berlin 10 th International Conference on Stochastic Programming University of Arizona, Tucson Recommended Reading A.
More informationThree hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER.
Three hours To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER EXTREME VALUES AND FINANCIAL RISK Examiner: Answer QUESTION 1, QUESTION
More informationTime Series Models for Measuring Market Risk
Time Series Models for Measuring Market Risk José Miguel Hernández Lobato Universidad Autónoma de Madrid, Computer Science Department June 28, 2007 1/ 32 Outline 1 Introduction 2 Competitive and collaborative
More informationarxiv: v3 [math.oc] 25 Apr 2018
Problem-driven scenario generation: an analytical approach for stochastic programs with tail risk measure Jamie Fairbrother *, Amanda Turner *, and Stein W. Wallace ** * STOR-i Centre for Doctoral Training,
More informationEMPIRICAL ESTIMATES IN STOCHASTIC OPTIMIZATION VIA DISTRIBUTION TAILS
K Y BERNETIKA VOLUM E 46 ( 2010), NUMBER 3, P AGES 459 471 EMPIRICAL ESTIMATES IN STOCHASTIC OPTIMIZATION VIA DISTRIBUTION TAILS Vlasta Kaňková Classical optimization problems depending on a probability
More informationLecture 35: December The fundamental statistical distances
36-705: Intermediate Statistics Fall 207 Lecturer: Siva Balakrishnan Lecture 35: December 4 Today we will discuss distances and metrics between distributions that are useful in statistics. I will be lose
More informationBacktesting Marginal Expected Shortfall and Related Systemic Risk Measures
Backtesting Marginal Expected Shortfall and Related Systemic Risk Measures Denisa Banulescu 1 Christophe Hurlin 1 Jérémy Leymarie 1 Olivier Scaillet 2 1 University of Orleans 2 University of Geneva & Swiss
More informationSimple Consumption / Savings Problems (based on Ljungqvist & Sargent, Ch 16, 17) Jonathan Heathcote. updated, March The household s problem X
Simple Consumption / Savings Problems (based on Ljungqvist & Sargent, Ch 16, 17) subject to for all t Jonathan Heathcote updated, March 2006 1. The household s problem max E β t u (c t ) t=0 c t + a t+1
More informationRevisiting some results on the sample complexity of multistage stochastic programs and some extensions
Revisiting some results on the sample complexity of multistage stochastic programs and some extensions M.M.C.R. Reaiche IMPA, Rio de Janeiro, RJ, Brazil March 17, 2016 Abstract In this work we present
More informationSelected Exercises on Expectations and Some Probability Inequalities
Selected Exercises on Expectations and Some Probability Inequalities # If E(X 2 ) = and E X a > 0, then P( X λa) ( λ) 2 a 2 for 0 < λ
More informationSolutions of the Financial Risk Management Examination
Solutions of the Financial Risk Management Examination Thierry Roncalli January 9 th 03 Remark The first five questions are corrected in TR-GDR and in the document of exercise solutions, which is available
More informationScenario Reduction for Risk-Averse Stochastic Programs
Scenario Reduction for Risk-Averse Stochastic Programs Sebastián Arpón 1, Tito Homem-de-Mello 1, Bernardo Pagnoncelli 1 1 School of Business, Universidad Adolfo Ibañez, Santiago, Chile Abstract In this
More informationA Conditional Approach to Modeling Multivariate Extremes
A Approach to ing Multivariate Extremes By Heffernan & Tawn Department of Statistics Purdue University s April 30, 2014 Outline s s Multivariate Extremes s A central aim of multivariate extremes is trying
More informationPortfolio optimization with stochastic dominance constraints
Charles University in Prague Faculty of Mathematics and Physics Portfolio optimization with stochastic dominance constraints December 16, 2014 Contents Motivation 1 Motivation 2 3 4 5 Contents Motivation
More informationGeneralized Hypothesis Testing and Maximizing the Success Probability in Financial Markets
Generalized Hypothesis Testing and Maximizing the Success Probability in Financial Markets Tim Leung 1, Qingshuo Song 2, and Jie Yang 3 1 Columbia University, New York, USA; leung@ieor.columbia.edu 2 City
More informationValid Inequalities and Restrictions for Stochastic Programming Problems with First Order Stochastic Dominance Constraints
Valid Inequalities and Restrictions for Stochastic Programming Problems with First Order Stochastic Dominance Constraints Nilay Noyan Andrzej Ruszczyński March 21, 2006 Abstract Stochastic dominance relations
More informationDependence. Practitioner Course: Portfolio Optimization. John Dodson. September 10, Dependence. John Dodson. Outline.
Practitioner Course: Portfolio Optimization September 10, 2008 Before we define dependence, it is useful to define Random variables X and Y are independent iff For all x, y. In particular, F (X,Y ) (x,
More informationConcentration inequalities for non-lipschitz functions
Concentration inequalities for non-lipschitz functions University of Warsaw Berkeley, October 1, 2013 joint work with Radosław Adamczak (University of Warsaw) Gaussian concentration (Sudakov-Tsirelson,
More informationScenario Generation in Stochastic Programming with Application to Optimizing Electricity Portfolios under Uncertainty
Scenario Generation in Stochastic Programming with Application to Optimizing Electricity Portfolios under Uncertainty W. Römisch Humboldt-University Berlin Department of Mathematics www.math.hu-berlin.de/~romisch
More informationWorst-Case Violation of Sampled Convex Programs for Optimization with Uncertainty
Worst-Case Violation of Sampled Convex Programs for Optimization with Uncertainty Takafumi Kanamori and Akiko Takeda Abstract. Uncertain programs have been developed to deal with optimization problems
More informationRobust Growth-Optimal Portfolios
Robust Growth-Optimal Portfolios! Daniel Kuhn! Chair of Risk Analytics and Optimization École Polytechnique Fédérale de Lausanne rao.epfl.ch 4 Technology Stocks I 4 technology companies: Intel, Cisco,
More informationSharp bounds on the VaR for sums of dependent risks
Paul Embrechts Sharp bounds on the VaR for sums of dependent risks joint work with Giovanni Puccetti (university of Firenze, Italy) and Ludger Rüschendorf (university of Freiburg, Germany) Mathematical
More informationStochastic Dual Dynamic Programming with CVaR Risk Constraints Applied to Hydrothermal Scheduling. ICSP 2013 Bergamo, July 8-12, 2012
Stochastic Dual Dynamic Programming with CVaR Risk Constraints Applied to Hydrothermal Scheduling Luiz Carlos da Costa Junior Mario V. F. Pereira Sérgio Granville Nora Campodónico Marcia Helena Costa Fampa
More informationCombinatorial Data Mining Method for Multi-Portfolio Stochastic Asset Allocation
Combinatorial for Stochastic Asset Allocation Ran Ji, M.A. Lejeune Department of Decision Sciences July 8, 2013 Content Class of Models with Downside Risk Measure Class of Models with of multiple portfolios
More informationConcentration inequalities for Feynman-Kac particle models. P. Del Moral. INRIA Bordeaux & IMB & CMAP X. Journées MAS 2012, SMAI Clermond-Ferrand
Concentration inequalities for Feynman-Kac particle models P. Del Moral INRIA Bordeaux & IMB & CMAP X Journées MAS 2012, SMAI Clermond-Ferrand Some hyper-refs Feynman-Kac formulae, Genealogical & Interacting
More informationCoherent Risk Measures. Acceptance Sets. L = {X G : X(ω) < 0, ω Ω}.
So far in this course we have used several different mathematical expressions to quantify risk, without a deeper discussion of their properties. Coherent Risk Measures Lecture 11, Optimisation in Finance
More informationCVaR and Examples of Deviation Risk Measures
CVaR and Examples of Deviation Risk Measures Jakub Černý Department of Probability and Mathematical Statistics Stochastic Modelling in Economics and Finance November 10, 2014 1 / 25 Contents CVaR - Dual
More informationUncertainty in energy system models
Uncertainty in energy system models Amy Wilson Durham University May 2015 Table of Contents 1 Model uncertainty 2 3 Example - generation investment 4 Conclusion Model uncertainty Contents 1 Model uncertainty
More informationTesting Downside-Risk Efficiency Under Distress
Testing Downside-Risk Efficiency Under Distress Jesus Gonzalo Universidad Carlos III de Madrid Jose Olmo City University of London XXXIII Simposio Analisis Economico 1 Some key lines Risk vs Uncertainty.
More informationOptimization Tools in an Uncertain Environment
Optimization Tools in an Uncertain Environment Michael C. Ferris University of Wisconsin, Madison Uncertainty Workshop, Chicago: July 21, 2008 Michael Ferris (University of Wisconsin) Stochastic optimization
More informationStochastic Optimization One-stage problem
Stochastic Optimization One-stage problem V. Leclère September 28 2017 September 28 2017 1 / Déroulement du cours 1 Problèmes d optimisation stochastique à une étape 2 Problèmes d optimisation stochastique
More informationUpper bound for optimal value of risk averse multistage problems
Upper bound for optimal value of risk averse multistage problems Lingquan Ding School of Industrial and Systems Engineering Georgia Institute of Technology Atlanta, GA 30332-0205 Alexander Shapiro School
More informationNormal Approximation for Hierarchical Structures
Normal Approximation for Hierarchical Structures Larry Goldstein University of Southern California July 1, 2004 Abstract Given F : [a, b] k [a, b] and a non-constant X 0 with P (X 0 [a, b]) = 1, define
More informationBacktesting Marginal Expected Shortfall and Related Systemic Risk Measures
and Related Systemic Risk Measures Denisa Banulescu, Christophe Hurlin, Jérémy Leymarie, Olivier Scaillet, ACPR Chair "Regulation and Systemic Risk" - March 24, 2016 Systemic risk The recent nancial crisis
More informationMonte Carlo Methods. Leon Gu CSD, CMU
Monte Carlo Methods Leon Gu CSD, CMU Approximate Inference EM: y-observed variables; x-hidden variables; θ-parameters; E-step: q(x) = p(x y, θ t 1 ) M-step: θ t = arg max E q(x) [log p(y, x θ)] θ Monte
More informationIntroduction & Random Variables. John Dodson. September 3, 2008
& September 3, 2008 Statistics Statistics Statistics Course Fall sequence modules portfolio optimization Bill Barr fixed-income markets Chris Bemis calibration & simulation introductions flashcards how
More informationDistirbutional robustness, regularizing variance, and adversaries
Distirbutional robustness, regularizing variance, and adversaries John Duchi Based on joint work with Hongseok Namkoong and Aman Sinha Stanford University November 2017 Motivation We do not want machine-learned
More informationVaR vs. Expected Shortfall
VaR vs. Expected Shortfall Risk Measures under Solvency II Dietmar Pfeifer (2004) Risk measures and premium principles a comparison VaR vs. Expected Shortfall Dependence and its implications for risk measures
More informationRevisiting some results on the complexity of multistage stochastic programs and some extensions
Revisiting some results on the complexity of multistage stochastic programs and some extensions M.M.C.R. Reaiche IMPA, Rio de Janeiro, RJ, Brazil October 30, 2015 Abstract In this work we present explicit
More informationThe Instability of Correlations: Measurement and the Implications for Market Risk
The Instability of Correlations: Measurement and the Implications for Market Risk Prof. Massimo Guidolin 20254 Advanced Quantitative Methods for Asset Pricing and Structuring Winter/Spring 2018 Threshold
More informationLecture 1. Stochastic Optimization: Introduction. January 8, 2018
Lecture 1 Stochastic Optimization: Introduction January 8, 2018 Optimization Concerned with mininmization/maximization of mathematical functions Often subject to constraints Euler (1707-1783): Nothing
More information1. Stochastic Processes and filtrations
1. Stochastic Processes and 1. Stoch. pr., A stochastic process (X t ) t T is a collection of random variables on (Ω, F) with values in a measurable space (S, S), i.e., for all t, In our case X t : Ω S
More informationQuantifying Stochastic Model Errors via Robust Optimization
Quantifying Stochastic Model Errors via Robust Optimization IPAM Workshop on Uncertainty Quantification for Multiscale Stochastic Systems and Applications Jan 19, 2016 Henry Lam Industrial & Operations
More informationKernel Methods. Lecture 4: Maximum Mean Discrepancy Thanks to Karsten Borgwardt, Malte Rasch, Bernhard Schölkopf, Jiayuan Huang, Arthur Gretton
Kernel Methods Lecture 4: Maximum Mean Discrepancy Thanks to Karsten Borgwardt, Malte Rasch, Bernhard Schölkopf, Jiayuan Huang, Arthur Gretton Alexander J. Smola Statistical Machine Learning Program Canberra,
More informationConditional Sampling for Max Stable Random Fields
Conditional Sampling for Max Stable Random Fields Yizao Wang Department of Statistics, the University of Michigan April 30th, 0 th GSPC at Duke University, Durham, North Carolina Joint work with Stilian
More informationMiloš Kopa. Decision problems with stochastic dominance constraints
Decision problems with stochastic dominance constraints Motivation Portfolio selection model Mean risk models max λ Λ m(λ r) νr(λ r) or min λ Λ r(λ r) s.t. m(λ r) µ r is a random vector of assets returns
More informationA simple graphical method to explore tail-dependence in stock-return pairs
A simple graphical method to explore tail-dependence in stock-return pairs Klaus Abberger, University of Konstanz, Germany Abstract: For a bivariate data set the dependence structure can not only be measured
More informationVincent Guigues FGV/EMAp, Rio de Janeiro, Brazil 1.1 Comparison of the confidence intervals from Section 3 and from [18]
Online supplementary material for the paper: Multistep stochastic mirror descent for risk-averse convex stochastic programs based on extended polyhedral risk measures Vincent Guigues FGV/EMAp, -9 Rio de
More informationChance constrained optimization - applications, properties and numerical issues
Chance constrained optimization - applications, properties and numerical issues Dr. Abebe Geletu Ilmenau University of Technology Department of Simulation and Optimal Processes (SOP) May 31, 2012 This
More informationRobust Backtesting Tests for Value-at-Risk Models
Robust Backtesting Tests for Value-at-Risk Models Jose Olmo City University London (joint work with Juan Carlos Escanciano, Indiana University) Far East and South Asia Meeting of the Econometric Society
More information1. Introduction. In this paper we consider stochastic optimization problems of the form
O RATES OF COVERGECE FOR STOCHASTIC OPTIMIZATIO PROBLEMS UDER O-I.I.D. SAMPLIG TITO HOMEM-DE-MELLO Abstract. In this paper we discuss the issue of solving stochastic optimization problems by means of sample
More informationMaximum Mean Discrepancy
Maximum Mean Discrepancy Thanks to Karsten Borgwardt, Malte Rasch, Bernhard Schölkopf, Jiayuan Huang, Arthur Gretton Alexander J. Smola Statistical Machine Learning Program Canberra, ACT 0200 Australia
More informationExplicit Bounds for the Distribution Function of the Sum of Dependent Normally Distributed Random Variables
Explicit Bounds for the Distribution Function of the Sum of Dependent Normally Distributed Random Variables Walter Schneider July 26, 20 Abstract In this paper an analytic expression is given for the bounds
More informationOptimization of nonstandard risk functionals
21.7.2005 Risk functionals Properties Dual properties A collection of risk functionals Algorithms Properties Dual properties A collection of risk functionals Acceptability functionals - Basic properties
More informationScientific Computing: Monte Carlo
Scientific Computing: Monte Carlo Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course MATH-GA.2043 or CSCI-GA.2112, Spring 2012 April 5th and 12th, 2012 A. Donev (Courant Institute)
More informationTwo hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER.
Two hours MATH38181 To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER EXTREME VALUES AND FINANCIAL RISK Examiner: Answer any FOUR
More information