Uncertainty Quantification in Computational Science
|
|
- William Morton
- 5 years ago
- Views:
Transcription
1 DTU Lecture I Uncertainty Quantification in Computational Science Jan S Hesthaven Brown University Jan.Hesthaven@Brown.edu
2 Objective of lectures The main objective of these lectures are To offer an overview of Uncertainty Quantification (UQ) and discuss its importance in modern predictive computational science. To introduce Polynomial Chaos (PC) as an attractive and efficient way of dealing with such challenges in the context of complex dynamical systems. To provide enough background to allow the audience to evaluate the importance within their own research area To inspire and suggest interesting research directions
3 The global picture Lecture 1 - Introduction to UQ Motivation, terminology, background, Wiener chaos expansions. Lecture II - Stochastic Galerkin methods Formulation, extensions, polynomial chaos, and examples. Lecture III - Stochastic Collocation methods Motivation, formulation, high-d integration, and examples. Lecture IV - Extensions, challenges, and open questions Geometric uncertainty, ANOVA expansions, and discussion of open questions. Thank you for taking the time
4 The local picture A few examples to motivate the need for UQ Classification of types of uncertainty Probability 101 Overview of classic computational techniques to deal with uncertainty. The Wiener Chaos expansion Summary
5 Motivation for UQ - V&V Consider the classic problem of Verification and Validation (V&V) in computational science Verification - the need to make sure the problem is solved correctly : Convergence, constructed solutions, analysis, stability etc Validation - the need to make sure the right problem is solved : Comparison against other codes, experimental data etc While the former is well known, the latter quickly gets dicey - and a source of trouble!
6 Motivation for UQ - V&V Imagine this outcome All are pleased and happy Imagine instead this outcome Let the blame game begin
7 Motivation for UQ - V&V.. but what is/could really be going on? Imagine the problem is sensitive in some way We could simply be solving different problem due to - initial conditions - boundary conditions - parameters
8 Motivation for UQ - unmeassuables Many types of problem have inaccessible or unmeasurable parameters and characterization Biological systems Modeling of complex environments Micro/nano scale materials One can question the value of deterministic modeling of such systems - but then what?
9 Motivation for UQ - optimization/design In computer assisted optimization and design, one seeks to minimize a cost-function min x Ω J(x, µ) Why is this problematic? A better approach may be min x Ω E[J(x, µ)] + κvar(j(x, µ)).. but this requires us to be able to evaluate the impact of the parametric uncertainty - quickly.
10 Motivation for UQ Suggests that we need to re-evaluate our computational approach to achieve a true predictive capability
11 Motivation for UQ We need to consider a more complex situation This raises important questions such as How do we do this reliably? What is the cost? Do we need to develop everything from bottom up?
12 A little terminology Before embarking on this, let us revisit the sources of uncertainty and how we can hope to control them Uncertainty can be caused by a number of things Initial and boundary conditions Geometries Parametric variations Modeling errors Sources etc
13 A little terminology Aleatory uncertainty is inherent variation of the physical system and the environment - variability, irreducible uncertainty, random uncertainty etc Examples: Rapid variations in parameters, inherent randomness in a microstructure etc Epistemic uncertainty is caused by insufficient knowledge of parameters or processes - subjective uncertainty, reducible uncertainty, model uncertainty Examples: Insufficient experimental results, poor understanding of system, microstructure etc
14 A little terminology With the need to consider systems subject to both types of uncertainty, there is no alternative but to model the uncertainty in some way Aleatory uncertainty is often modeled by some assumed probability measure. Epistemic uncertainty is more problematic as it is grounded in insufficient knowledge of the system. It is often modeled by intervals of possible values... but it is, in principle, reducible at added cost.
15 Probability 101 Before we continue, let us make sure we recall the necessary background and terminology. The outcome of experiment is an event - Ex: Flipping a coin gives head or tails. We assign a number to the outcome to recover a Random variable - Ex: The event space, the empty set, and a number of set combinations is called the -field - called We assign probabilities to measure likelyhood of the outcome of the random variables - Ex: X(ω) [0, 1] X = X(ω) P (ω : X(ω) = 0) = P (ω : X(ω) = 1) = 0.5 σ ω Ω Ω = {head, tail} F P (ω : X(ω)) [0, 1]
16 Probability 101 Definition 2.4 (Probability space). Aprobabilityspaceisatriplet(, F,P) where is a countable event space, F 2 is the σ -field of, andp is a probability measure such that 1. 0 P(A) 1, A F. 2. P( ) = For A 1,A 2,... F and A i A j =, i = j, ( ) P A i = P(A i ). i=1 Definition 2.5 (Distribution function). The probability distribution F X (x) =P (X x) =P ({ω : X(ω) x}), x R The probability density F X (x) = f X (x) 0, x f X (y) dy f X (y) dy =1 i=1
17 Probability 101 We can now more appropriately define The mean or expectation µ X = E[X] = xf X dx E[g(X)] = g(x)f X dx The variance σ 2 X = var(x) = The m th moment E[X m ]= The standard deviation (x µ X ) 2 f X dx x m f X dx σ 2 X = E[X 2 ] µ 2 X
18 Probability 101 Let us recall a couple of widely used densities The normal/gaussian distribution - N(µ, σ 2 ) N f X (x) = [ 1 exp (x µ)2 2πσ 2 2σ [ ] 2 ], The uniform distribution - U(a, b) f X (x) = { 1 b a, x (a, b), 0, otherwise, de.
19 Probability 101 The last concepts we will recall are The correlation between two random variables is corr(x 1,X 2 ) = cov(x 1,X 2 ) 1 corr(x σ X1 σ 1,X 2 ) 1. X2 cient. Animmediatefactfollow ables are uncorrelated if cor cov(x 1,X 2 )=E[(X 1 µ X1 )(X 2 µ X2 )] They are uncorrelated if corr(x 1,X 2 )=0 The variables are independent if P(A 1 A 2 ) = P(A 1 )P (A 2 ). f X1,X 2 (x 1,x 2 )=f X1 (x 1 )f X2 (x 2 ) Independence Uncorrelated
20 Classic methods for UQ Let us now - finally - return to the quest at hand: How do we account for the impact of the uncertainty on the output of a dynamical system To briefly recall a few classic methods, let us consider the following problem (α, β) (α, β) du dt (t, ω) = α(ω)u, u(t, ω) : [0,T] Ω R independent then du(t, ω) dt dependent then u(0, ω) = β(ω), u(t, X 1,X 2 ) : [0,T] R 2 R = X 1 u, u(0, ω) =X 2 u(t, X, g(x)) : [0,T] R R du(t, ω) dt = Xu, u(0, ω) = g(x)
21 Monte Carlo methods The truly classic and simple approach 1. Create M iid s from the assumed distribution - (α (i), β (i) ) 2. Solve problem for each set of iid s - 3. Compute required statistics - u (i) (t) =u(t, X (i) ) ū(t) = 1 M u(t, X (i) ) E[u] M As samples are based on iid s, the central limit theorem implies ū(t) E[u] 1 M i=1 This result is both the curse and the strength The convergence is slow, i.e., expensive for good accuracy The convergence does not depend on dimension Note: Lots of games in town to improve
22 Moment methods Consider the following equation µ(t) =E[u] dµ dt The unknown can be computed de[αu] dt.. and can be continued = E[α 2 u], µ(0) = E[αβ] = E[αu], µ(0) = E[β] Tempting dµ dt = E[α]µ, µ(0) = E[β] µ k = E[α k u] dµ k dt = µ k+1, µ k (0) = E[α k β] but the closure problem remains - often solved by assuming µ k+1 = g(µ 0,...,µ k ) Accuracy is unclear in model Complex for a large problem
23 Perturbation methods Let us assume that The perturbation method c ɛ = O(α(ω)) σ α 1. power series of, Then we can express the solution as u(t, ω) = u 0 (t) + α(ω)u 1 (t) + α 2 (ω)u 2 (t) +, Matching orders in the expansion yields : = : = O(1): du 0 dt = 0, O(ɛ): du 1 dt = u 0, O(ɛ 2 ): du 2 dt = u 1, Only applies for small variance(s) Derivation is problem specific
24 Challenges in classic methods There are serious problems with these methods Moment/Perturbation methods are too complex and intrusive to serve as a general tool. Monte Carlo methods are flexible/ general - the convergence rate is problematic: 1 digit requires 100 simulations How can be strive to improve this? MC approximates the density using piecewise constant samples - resulting in the slow pointwise convergence
25 Challenges in classic methods But recall the context here - we will Make assumption on the nature of the aleatory uncertainty through the input variables. Make some assumptions on the character of the epistemic uncertainty, possibly using just uniformly distributed variables. These are random variables with a smooth density From an approximation standpoint, using piecewise constant functions to represent a smooth function is a poor choice
26 Detour on global expansions Consider the smooth period function Using a Fourier series P N u(x) = û n = 1 2π n N/2 2π 0 û n e inx, u(x)e inx dx P N u u(x) N = 16 N = 8 N = 4 re u(x) = u P N u cos(x). N = 4 N = 8 N = 16 N = 32 N = x/2p Figure 2.1 Rigorous theory confirms that x/2p u P 2N u W q p [0,2π] s identity yields C N r q u W r p [0,2π]. u P 2N u L C 1 q N q 1 2 Challenge: How to take advantage of this for UQ? u (q) L 2 [0,2π].
27 The Wiener Chaos expansion Define the space of square integrable functions L 2 F X = {f : I R E[f 2 ] < } Provided f L 2 F X f(x) = n=0 we have ˆf n Φ n (X) ˆf n = 1 γ n E[f(X)Φ n (X)] γ n = E[Φ 2 n(x)] Where the basis - the Chaos Polynomial - satisfies E[Φ m (X)Φ n (X)] = Φ m (X(x))Φ n (X(x)) df X (x) =γ n δ mn Basis depends on the distribution of the random variable!
28 The Wiener Chaos expansion Consider Gaussian variables with f X (x) = 1 2π e x2 /2 The corresponding polynomials are the Hermite Polynomials H 0 (X) =1,H 1 (X) =X, H 2 (X) =X 2 1, H 3 (X) =X 3 3X
29 The Wiener Chaos expansion If we now consider the truncated expansion N P N f(x) = ˆf n Φ n (X) n=0 then strong convergence follows directly from classic theory f P N f L 2 FX 0, N If we now consider a more general problem Z N = N n=0 X L 2 â n Φ n (X) F X Z L 2 F Z Weak convergence can be achieved by defining â n = 1 E X [F 1 Z γ (F X(X))Φ n (X)] n We can use one random variable to approximate another
30 The Wiener Chaos expansion Xiu, exact 1st order 3rd order 5th order exact 1st order 3rd order 5th order It is clear that choosing the right basis -- associated with the nature of the random variable -- is key to performance This the advantage and the curse -- as we shall see
31 The Wiener Chaos expansion The extension to multiple random variables follows Define F Xi (x i )=P(X i x i ) X =(X 1,...,X d ) F X = F X1... F Xd and the multi-dimensional polynomial chaos x i I Xi Φ i (X) =Φ i1 (X 1 )... Φ id (X d ) i N E[Φ i (X)Φ j (X)] = Φ i (x)φ j (x) df X (x) =γ i δ ij γ i = E[Φ 2 i ] The homogeneous Chaos expansion is f N (X) = N i =0 ˆf i Φ i (X) P d N dim P d N = N + d N = (N + d)! N!d! The curse of dimension shows its face!
32 The Wiener Chaos expansion Assuming the Chaos expansion is known, we need statistics N f N (X) = ˆf i Φ i (X) P d N i =0 The expectation follows from µ = E[f] E[f N ]= N i =0 ˆf i Φ i df X = ˆf 0 In a similar fashion, the variance is N var(f) =E[(f µ) 2 )] γ ˆf 2 i i i >0 Other moments can be obtained in a similar fashion. Functions of the expansion can also be estimated through Monte Carlo sampling
33 Summary We have achieved quite a bit Motivated the need for UQ in Computational Science Discussed in some detail the shortcomings of classic methods such as Monte Carlo methods. Realizing that smoothness in the behavior of the random variables should be explored.. and introduced the Chaos expansion to achieve this We have still to use this insight to solve differential equations - and demonstrate the promised benefits
Lecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationEstimating functional uncertainty using polynomial chaos and adjoint equations
0. Estimating functional uncertainty using polynomial chaos and adjoint equations February 24, 2011 1 Florida State University, Tallahassee, Florida, Usa 2 Moscow Institute of Physics and Technology, Moscow,
More informationChapter 4. Chapter 4 sections
Chapter 4 sections 4.1 Expectation 4.2 Properties of Expectations 4.3 Variance 4.4 Moments 4.5 The Mean and the Median 4.6 Covariance and Correlation 4.7 Conditional Expectation SKIP: 4.8 Utility Expectation
More informationIf we want to analyze experimental or simulated data we might encounter the following tasks:
Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction
More informationNorthwestern University Department of Electrical Engineering and Computer Science
Northwestern University Department of Electrical Engineering and Computer Science EECS 454: Modeling and Analysis of Communication Networks Spring 2008 Probability Review As discussed in Lecture 1, probability
More informationFast Numerical Methods for Stochastic Computations
Fast AreviewbyDongbinXiu May 16 th,2013 Outline Motivation 1 Motivation 2 3 4 5 Example: Burgers Equation Let us consider the Burger s equation: u t + uu x = νu xx, x [ 1, 1] u( 1) =1 u(1) = 1 Example:
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Lecture 9: Sensitivity Analysis ST 2018 Tobias Neckel Scientific Computing in Computer Science TUM Repetition of Previous Lecture Sparse grids in Uncertainty Quantification
More informationQuick Tour of Basic Probability Theory and Linear Algebra
Quick Tour of and Linear Algebra Quick Tour of and Linear Algebra CS224w: Social and Information Network Analysis Fall 2011 Quick Tour of and Linear Algebra Quick Tour of and Linear Algebra Outline Definitions
More informationStochastic Spectral Approaches to Bayesian Inference
Stochastic Spectral Approaches to Bayesian Inference Prof. Nathan L. Gibson Department of Mathematics Applied Mathematics and Computation Seminar March 4, 2011 Prof. Gibson (OSU) Spectral Approaches to
More informationNumerical Methods I Monte Carlo Methods
Numerical Methods I Monte Carlo Methods Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course G63.2010.001 / G22.2420-001, Fall 2010 Dec. 9th, 2010 A. Donev (Courant Institute) Lecture
More informationScientific Computing: Monte Carlo
Scientific Computing: Monte Carlo Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course MATH-GA.2043 or CSCI-GA.2112, Spring 2012 April 5th and 12th, 2012 A. Donev (Courant Institute)
More informationContinuous Random Variables
1 / 24 Continuous Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 27, 2013 2 / 24 Continuous Random Variables
More informationReview of Probability Theory
Review of Probability Theory Arian Maleki and Tom Do Stanford University Probability theory is the study of uncertainty Through this class, we will be relying on concepts from probability theory for deriving
More informationBASICS OF PROBABILITY
October 10, 2018 BASICS OF PROBABILITY Randomness, sample space and probability Probability is concerned with random experiments. That is, an experiment, the outcome of which cannot be predicted with certainty,
More information1: PROBABILITY REVIEW
1: PROBABILITY REVIEW Marek Rutkowski School of Mathematics and Statistics University of Sydney Semester 2, 2016 M. Rutkowski (USydney) Slides 1: Probability Review 1 / 56 Outline We will review the following
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 14: Continuous random variables Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/
More informationMultilevel stochastic collocations with dimensionality reduction
Multilevel stochastic collocations with dimensionality reduction Ionut Farcas TUM, Chair of Scientific Computing in Computer Science (I5) 27.01.2017 Outline 1 Motivation 2 Theoretical background Uncertainty
More informationPart IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationMATH4210 Financial Mathematics ( ) Tutorial 7
MATH40 Financial Mathematics (05-06) Tutorial 7 Review of some basic Probability: The triple (Ω, F, P) is called a probability space, where Ω denotes the sample space and F is the set of event (σ algebra
More informationDimension-adaptive sparse grid for industrial applications using Sobol variances
Master of Science Thesis Dimension-adaptive sparse grid for industrial applications using Sobol variances Heavy gas flow over a barrier March 11, 2015 Ad Dimension-adaptive sparse grid for industrial
More informationProbability. Paul Schrimpf. January 23, Definitions 2. 2 Properties 3
Probability Paul Schrimpf January 23, 2018 Contents 1 Definitions 2 2 Properties 3 3 Random variables 4 3.1 Discrete........................................... 4 3.2 Continuous.........................................
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationChapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University
Chapter 3, 4 Random Variables ENCS6161 - Probability and Stochastic Processes Concordia University ENCS6161 p.1/47 The Notion of a Random Variable A random variable X is a function that assigns a real
More informationPCMI Introduction to Random Matrix Theory Handout # REVIEW OF PROBABILITY THEORY. Chapter 1 - Events and Their Probabilities
PCMI 207 - Introduction to Random Matrix Theory Handout #2 06.27.207 REVIEW OF PROBABILITY THEORY Chapter - Events and Their Probabilities.. Events as Sets Definition (σ-field). A collection F of subsets
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationwhere r n = dn+1 x(t)
Random Variables Overview Probability Random variables Transforms of pdfs Moments and cumulants Useful distributions Random vectors Linear transformations of random vectors The multivariate normal distribution
More informationLecture Notes 5 Convergence and Limit Theorems. Convergence with Probability 1. Convergence in Mean Square. Convergence in Probability, WLLN
Lecture Notes 5 Convergence and Limit Theorems Motivation Convergence with Probability Convergence in Mean Square Convergence in Probability, WLLN Convergence in Distribution, CLT EE 278: Convergence and
More informationChapter 2: Random Variables
ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:
More informationJUSTIN HARTMANN. F n Σ.
BROWNIAN MOTION JUSTIN HARTMANN Abstract. This paper begins to explore a rigorous introduction to probability theory using ideas from algebra, measure theory, and other areas. We start with a basic explanation
More informationUniversity of Regina. Lecture Notes. Michael Kozdron
University of Regina Statistics 252 Mathematical Statistics Lecture Notes Winter 2005 Michael Kozdron kozdron@math.uregina.ca www.math.uregina.ca/ kozdron Contents 1 The Basic Idea of Statistics: Estimating
More informationStochastic Collocation Methods for Polynomial Chaos: Analysis and Applications
Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Dongbin Xiu Department of Mathematics, Purdue University Support: AFOSR FA955-8-1-353 (Computational Math) SF CAREER DMS-64535
More informationDeterministic. Deterministic data are those can be described by an explicit mathematical relationship
Random data Deterministic Deterministic data are those can be described by an explicit mathematical relationship Deterministic x(t) =X cos r! k m t Non deterministic There is no way to predict an exact
More informationE X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl.
E X A M Course code: Course name: Number of pages incl. front page: 6 MA430-G Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours Resources allowed: Notes: Pocket calculator,
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More informationLecture Notes 3 Convergence (Chapter 5)
Lecture Notes 3 Convergence (Chapter 5) 1 Convergence of Random Variables Let X 1, X 2,... be a sequence of random variables and let X be another random variable. Let F n denote the cdf of X n and let
More informationExpectation, variance and moments
Expectation, variance and moments John Appleby Contents Expectation and variance Examples 3 Moments and the moment generating function 4 4 Examples of moment generating functions 5 5 Concluding remarks
More informationSystem Identification
System Identification Arun K. Tangirala Department of Chemical Engineering IIT Madras July 27, 2013 Module 3 Lecture 1 Arun K. Tangirala System Identification July 27, 2013 1 Objectives of this Module
More informationLecture 1: August 28
36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 1: August 28 Our broad goal for the first few lectures is to try to understand the behaviour of sums of independent random
More informationLecture 2: Review of Basic Probability Theory
ECE 830 Fall 2010 Statistical Signal Processing instructor: R. Nowak, scribe: R. Nowak Lecture 2: Review of Basic Probability Theory Probabilistic models will be used throughout the course to represent
More informationProbability Review. Yutian Li. January 18, Stanford University. Yutian Li (Stanford University) Probability Review January 18, / 27
Probability Review Yutian Li Stanford University January 18, 2018 Yutian Li (Stanford University) Probability Review January 18, 2018 1 / 27 Outline 1 Elements of probability 2 Random variables 3 Multiple
More informationRandom Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R
In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample
More informationNONLOCALITY AND STOCHASTICITY TWO EMERGENT DIRECTIONS FOR APPLIED MATHEMATICS. Max Gunzburger
NONLOCALITY AND STOCHASTICITY TWO EMERGENT DIRECTIONS FOR APPLIED MATHEMATICS Max Gunzburger Department of Scientific Computing Florida State University North Carolina State University, March 10, 2011
More informationRandom Variables. Cumulative Distribution Function (CDF) Amappingthattransformstheeventstotherealline.
Random Variables Amappingthattransformstheeventstotherealline. Example 1. Toss a fair coin. Define a random variable X where X is 1 if head appears and X is if tail appears. P (X =)=1/2 P (X =1)=1/2 Example
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 8 10/1/2008 CONTINUOUS RANDOM VARIABLES
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 8 10/1/2008 CONTINUOUS RANDOM VARIABLES Contents 1. Continuous random variables 2. Examples 3. Expected values 4. Joint distributions
More information1 Review of Probability
1 Review of Probability Random variables are denoted by X, Y, Z, etc. The cumulative distribution function (c.d.f.) of a random variable X is denoted by F (x) = P (X x), < x
More informationA Polynomial Chaos Approach to Robust Multiobjective Optimization
A Polynomial Chaos Approach to Robust Multiobjective Optimization Silvia Poles 1, Alberto Lovison 2 1 EnginSoft S.p.A., Optimization Consulting Via Giambellino, 7 35129 Padova, Italy s.poles@enginsoft.it
More informationA Stochastic Collocation based. for Data Assimilation
A Stochastic Collocation based Kalman Filter (SCKF) for Data Assimilation Lingzao Zeng and Dongxiao Zhang University of Southern California August 11, 2009 Los Angeles Outline Introduction SCKF Algorithm
More informationPerhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows.
Chapter 5 Two Random Variables In a practical engineering problem, there is almost always causal relationship between different events. Some relationships are determined by physical laws, e.g., voltage
More informationCourse: ESO-209 Home Work: 1 Instructor: Debasis Kundu
Home Work: 1 1. Describe the sample space when a coin is tossed (a) once, (b) three times, (c) n times, (d) an infinite number of times. 2. A coin is tossed until for the first time the same result appear
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationLecture 6 Basic Probability
Lecture 6: Basic Probability 1 of 17 Course: Theory of Probability I Term: Fall 2013 Instructor: Gordan Zitkovic Lecture 6 Basic Probability Probability spaces A mathematical setup behind a probabilistic
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationLecture 7. Sums of random variables
18.175: Lecture 7 Sums of random variables Scott Sheffield MIT 18.175 Lecture 7 1 Outline Definitions Sums of random variables 18.175 Lecture 7 2 Outline Definitions Sums of random variables 18.175 Lecture
More informationCME 106: Review Probability theory
: Probability theory Sven Schmit April 3, 2015 1 Overview In the first half of the course, we covered topics from probability theory. The difference between statistics and probability theory is the following:
More informationStatistical and Learning Techniques in Computer Vision Lecture 1: Random Variables Jens Rittscher and Chuck Stewart
Statistical and Learning Techniques in Computer Vision Lecture 1: Random Variables Jens Rittscher and Chuck Stewart 1 Motivation Imaging is a stochastic process: If we take all the different sources of
More informationAn Empirical Chaos Expansion Method for Uncertainty Quantification
An Empirical Chaos Expansion Method for Uncertainty Quantification Melvin Leok and Gautam Wilkins Abstract. Uncertainty quantification seeks to provide a quantitative means to understand complex systems
More informationA Brief Analysis of Central Limit Theorem. SIAM Chapter Florida State University
1 / 36 A Brief Analysis of Central Limit Theorem Omid Khanmohamadi (okhanmoh@math.fsu.edu) Diego Hernán Díaz Martínez (ddiazmar@math.fsu.edu) Tony Wills (twills@math.fsu.edu) Kouadio David Yao (kyao@math.fsu.edu)
More informationLecture 2 : CS6205 Advanced Modeling and Simulation
Lecture 2 : CS6205 Advanced Modeling and Simulation Lee Hwee Kuan 21 Aug. 2013 For the purpose of learning stochastic simulations for the first time. We shall only consider probabilities on finite discrete
More informationPerformance Evaluation of Generalized Polynomial Chaos
Performance Evaluation of Generalized Polynomial Chaos Dongbin Xiu, Didier Lucor, C.-H. Su, and George Em Karniadakis 1 Division of Applied Mathematics, Brown University, Providence, RI 02912, USA, gk@dam.brown.edu
More informationCSCI-6971 Lecture Notes: Monte Carlo integration
CSCI-6971 Lecture otes: Monte Carlo integration Kristopher R. Beevers Department of Computer Science Rensselaer Polytechnic Institute beevek@cs.rpi.edu February 21, 2006 1 Overview Consider the following
More information8 STOCHASTIC SIMULATION
8 STOCHASTIC SIMULATIO 59 8 STOCHASTIC SIMULATIO Whereas in optimization we seek a set of parameters x to minimize a cost, or to maximize a reward function J( x), here we pose a related but different question.
More informationFormulas for probability theory and linear models SF2941
Formulas for probability theory and linear models SF2941 These pages + Appendix 2 of Gut) are permitted as assistance at the exam. 11 maj 2008 Selected formulae of probability Bivariate probability Transforms
More information3 Multiple Discrete Random Variables
3 Multiple Discrete Random Variables 3.1 Joint densities Suppose we have a probability space (Ω, F,P) and now we have two discrete random variables X and Y on it. They have probability mass functions f
More informationSobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis
Sobol-Hoeffding decomposition Application to Global SA Computation of the SI Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis Olivier Le Maître with Colleague & Friend Omar
More informationSpectral Representation of Random Processes
Spectral Representation of Random Processes Example: Represent u(t,x,q) by! u K (t, x, Q) = u k (t, x) k(q) where k(q) are orthogonal polynomials. Single Random Variable:! Let k (Q) be orthogonal with
More informationChapter 3: Random Variables 1
Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More information[POLS 8500] Review of Linear Algebra, Probability and Information Theory
[POLS 8500] Review of Linear Algebra, Probability and Information Theory Professor Jason Anastasopoulos ljanastas@uga.edu January 12, 2017 For today... Basic linear algebra. Basic probability. Programming
More informationconditional cdf, conditional pdf, total probability theorem?
6 Multiple Random Variables 6.0 INTRODUCTION scalar vs. random variable cdf, pdf transformation of a random variable conditional cdf, conditional pdf, total probability theorem expectation of a random
More informationPart IA Probability. Theorems. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Theorems Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More information1 Probability theory. 2 Random variables and probability theory.
Probability theory Here we summarize some of the probability theory we need. If this is totally unfamiliar to you, you should look at one of the sources given in the readings. In essence, for the major
More informationPolynomial chaos expansions for sensitivity analysis
c DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Polynomial chaos expansions for sensitivity analysis B. Sudret Chair of Risk, Safety & Uncertainty
More informationDS-GA 1002 Lecture notes 2 Fall Random variables
DS-GA 12 Lecture notes 2 Fall 216 1 Introduction Random variables Random variables are a fundamental tool in probabilistic modeling. They allow us to model numerical quantities that are uncertain: the
More informationSTOR Lecture 16. Properties of Expectation - I
STOR 435.001 Lecture 16 Properties of Expectation - I Jan Hannig UNC Chapel Hill 1 / 22 Motivation Recall we found joint distributions to be pretty complicated objects. Need various tools from combinatorics
More information3. Review of Probability and Statistics
3. Review of Probability and Statistics ECE 830, Spring 2014 Probabilistic models will be used throughout the course to represent noise, errors, and uncertainty in signal processing problems. This lecture
More informationLecture Notes 2 Random Variables. Discrete Random Variables: Probability mass function (pmf)
Lecture Notes 2 Random Variables Definition Discrete Random Variables: Probability mass function (pmf) Continuous Random Variables: Probability density function (pdf) Mean and Variance Cumulative Distribution
More informationEcon 508B: Lecture 5
Econ 508B: Lecture 5 Expectation, MGF and CGF Hongyi Liu Washington University in St. Louis July 31, 2017 Hongyi Liu (Washington University in St. Louis) Math Camp 2017 Stats July 31, 2017 1 / 23 Outline
More information3. Probability and Statistics
FE661 - Statistical Methods for Financial Engineering 3. Probability and Statistics Jitkomut Songsiri definitions, probability measures conditional expectations correlation and covariance some important
More informationHierarchical Parallel Solution of Stochastic Systems
Hierarchical Parallel Solution of Stochastic Systems Second M.I.T. Conference on Computational Fluid and Solid Mechanics Contents: Simple Model of Stochastic Flow Stochastic Galerkin Scheme Resulting Equations
More informationIntroduction to Uncertainty Quantification in Computational Science Handout #3
Introduction to Uncertainty Quantification in Computational Science Handout #3 Gianluca Iaccarino Department of Mechanical Engineering Stanford University June 29 - July 1, 2009 Scuola di Dottorato di
More informationChapter 3: Random Variables 1
Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.
More informationExperiences with Model Reduction and Interpolation
Experiences with Model Reduction and Interpolation Paul Constantine Stanford University, Sandia National Laboratories Qiqi Wang (MIT) David Gleich (Purdue) Emory University March 7, 2012 Joe Ruthruff (SNL)
More informationPolynomial chaos expansions for structural reliability analysis
DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Polynomial chaos expansions for structural reliability analysis B. Sudret & S. Marelli Incl.
More informationSparse polynomial chaos expansions in engineering applications
DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Sparse polynomial chaos expansions in engineering applications B. Sudret G. Blatman (EDF R&D,
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More informationAnnouncements. Proposals graded
Announcements Proposals graded Kevin Jamieson 2018 1 Bayesian Methods Machine Learning CSE546 Kevin Jamieson University of Washington November 1, 2018 2018 Kevin Jamieson 2 MLE Recap - coin flips Data:
More informationECE353: Probability and Random Processes. Lecture 7 -Continuous Random Variable
ECE353: Probability and Random Processes Lecture 7 -Continuous Random Variable Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu Continuous
More informationStochastic Mode Reduction in Large Deterministic Systems
Stochastic Mode Reduction in Large Deterministic Systems I. Timofeyev University of Houston With A. J. Majda and E. Vanden-Eijnden; NYU Related Publications: http://www.math.uh.edu/ ilya Plan Mode-Elimination
More informationAppendix A : Introduction to Probability and stochastic processes
A-1 Mathematical methods in communication July 5th, 2009 Appendix A : Introduction to Probability and stochastic processes Lecturer: Haim Permuter Scribe: Shai Shapira and Uri Livnat The probability of
More informationChapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance.
Chapter 2 Random Variable CLO2 Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance. 1 1. Introduction In Chapter 1, we introduced the concept
More informationRandom variables. DS GA 1002 Probability and Statistics for Data Science.
Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities
More informationPart II Probability and Measure
Part II Probability and Measure Theorems Based on lectures by J. Miller Notes taken by Dexter Chua Michaelmas 2016 These notes are not endorsed by the lecturers, and I have modified them (often significantly)
More informationFE 5204 Stochastic Differential Equations
Instructor: Jim Zhu e-mail:zhu@wmich.edu http://homepages.wmich.edu/ zhu/ January 20, 2009 Preliminaries for dealing with continuous random processes. Brownian motions. Our main reference for this lecture
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationCS145: Probability & Computing
CS45: Probability & Computing Lecture 5: Concentration Inequalities, Law of Large Numbers, Central Limit Theorem Instructor: Eli Upfal Brown University Computer Science Figure credits: Bertsekas & Tsitsiklis,
More informationExpectation. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda
Expectation DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall16 Carlos Fernandez-Granda Aim Describe random variables with a few numbers: mean, variance,
More information18.175: Lecture 15 Characteristic functions and central limit theorem
18.175: Lecture 15 Characteristic functions and central limit theorem Scott Sheffield MIT Outline Characteristic functions Outline Characteristic functions Characteristic functions Let X be a random variable.
More informationStatistics and Econometrics I
Statistics and Econometrics I Random Variables Shiu-Sheng Chen Department of Economics National Taiwan University October 5, 2016 Shiu-Sheng Chen (NTU Econ) Statistics and Econometrics I October 5, 2016
More informationFundamental Tools - Probability Theory II
Fundamental Tools - Probability Theory II MSc Financial Mathematics The University of Warwick September 29, 2015 MSc Financial Mathematics Fundamental Tools - Probability Theory II 1 / 22 Measurable random
More information