Simultaneous Robust Design and Tolerancing of Compressor Blades

Size: px
Start display at page:

Download "Simultaneous Robust Design and Tolerancing of Compressor Blades"

Transcription

1 Simultaneous Robust Design and Tolerancing of Compressor Blades Eric Dow Aerospace Computational Design Laboratory Department of Aeronautics and Astronautics Massachusetts Institute of Technology GTL Seminar October 1, 2013

2 Motivation Geometric variability is unavoidable and undesirable Illustration of manufacturing variability (from [Garzon, 2003]) Impact of geometric variability can be reduced Robust design: change the nominal design Tolerancing: change the level of variability Current design and tolerancing methods are sequential A Design B C Minimum Cost Tolerance 2

3 Performance Impacts of Geometric Variability Geometric variability introduces both variability and mean shift into compressor performance Illustration of performance mean shift and variability (from [Lavainne, 2003]) Mean adiabatic eciency of a ank-milled integrally bladed rotor (IBR) reduced by approximately 1% [Garzon and Darmofal, 2003] 3

4 Research Objectives 1 Develop a framework for simultaneous robust design and tolerance optimization that incorporates manufacturing and operating costs 2 Develop an approach for probabilistic sensitivity analysis of performance with respect to the level of variability 3 Demonstrate framework eectiveness for design and tolerancing of turbomachinery compressor blades 4

5 The Pitfalls of Single-point Optimization Single-point optimized designs often perform poorly away from design point Polars for baseline and optimized DAE-11 airfoil (from [Drela, 1998]) Optimizer exploits ow features to improve performance at design point Small changes in ow features away from design point may degrade performance Adding additional design parameters does not improve o-design performance (it actually gets worse!) 5

6 Robust Design Optimization Robust optimization: determine design whose performance is relatively unchanged when the system is perturbed as a result of variability Cost Single-point Robust Design Variable Probabilistic robust multi-objective: minimize some combination of the mean and variance of the cost Solution approaches can be gradient-based or derivative-free Computationally expensive: typically involves evaluating performance at a large number of conditions 6

7 Modelling Variability: Random Fields Random eld: a collection of random variables that are indexed by a spatial variable Well-suited for modelling spatially distributed variability Parameters can be chosen to model observed behavior (correlation length, non-stationarity, smoothness) Gaussian random elds: uniquely characterized by mean and covariance e(s) 0 e(s) s s (a) Smooth random eld (b) Non-smooth random eld 7

8 The Karhunen-Loève Expansion Simulate e(s, ω) using the Karhunen-Loève (K-L) expansion: e(s, ω) = ē(s) + λi φ i (s)ξ i (ω) i=1 C(s 1, s 2)φ i (s 2)ds 2 = λ i φ i (s 1) D ξ i (ω) N (0, 1), i.i.d λ φ(s) s (a) K-L eigenvalues (b) K-L eigenfunctions Truncate K-L expansion according to the decay of the eigenvalues: N KL e(s, ω) = ē(s) + λi φ i (s)ξ i (ω) i=1 8

9 Non-stationary Random Fields Covariance kernel consists of a xed correlation function spatially variance standard deviation (, C s1 s2 ρ(s1, s2 ) and σ(s ): ) = σ(s1 )σ(s2 )ρ(s1, s2 ) Stationary e(s) σ(s) s s s Non-stationary e(s) σ(s) s

10 Random Field Model of Manufacturing Variability Manufacturing variability is modeled using a non-stationary Gaussian random eld, characterized by its mean ē(s) and covariance C(s 1, s 2) Map random eld to blade surface through arclength Manufactured blade surface constructed by perturbing design intent geometry in the normal direction: x(s, ω) = x d (s) + e(s, ω)ˆn(s) Baseline Manufactured e(s) s (a) Error eld realization (b) Error eld mapped to blade 10

11 Relating Tolerances to Variance Simulate the eect of spatially varying manufacturing tolerances using a spatially varying variance σ 2 (s) Small σ 2 strict tolerances (a) Loose tolerances (b) Strict tolerances (): design intent geometry (- - -): design intent geometry +/- 2σ(s) 11

12 Performance and Manufacturing Costs Choose blade design and manufacturing tolerances that minimize overall cost C perf (d, σ): economic value of aerodynamic performance per blade Proportional to the moments of the performance of the system: C perf (d, σ) = k me[η(ω; d, σ)] + k v Var[η(ω; d, σ)] C man(σ): manufacturing cost per blade Monotonically decreasing function of allowed geometric variability 1 C man(σ) = k man Ω s σ(s) ds 12

13 Optimization Statement Optimal design (d ) and manufacturing tolerances (σ ) determined by minimizing sum of manufacturing and operating costs Mean pressure ratio Π is constrained above minimum allowable value Π (d, σ ) = argmin C perf (d, σ) + C man(σ) s.t. E[Π(d, σ, ω)] Π Gradient-based optimization: use sensitivity information to choose search directions Sequential Quadratic Programming (SQP) 13

14 Model Problem of Interest In the absence of variability, nominal design variables d determines the PDE solution u Nominal Design Variables d PDE Solution u(y; d) 14

15 Model Problem of Interest In the absence of variability, nominal design variables d determines the PDE solution u Random eld e(s, ω) introduces random noise to the solution Correlation Structure ρ Nominal Design Variables d Random Field e(s, ω; σ) PDE Solution u(y, u(y; ω; d, d) σ) Standard Deviation σ 14

16 Model Problem of Interest In the absence of variability, nominal design variables d determines the PDE solution u Random eld e(s, ω) introduces random noise to the solution System performance characterized by the moments of functionals F (u) of the solution, e.g. E[F ] and Var[F (u)] Correlation Structure ρ Nominal Design Variables d Random Field e(s, ω; σ) PDE Solution u(y, u(y; ω; d, d) σ) Performance Moments E[F (u(y, ω; d, σ))] Standard Deviation σ 14

17 Monte Carlo Method Monte Carlo method: approximate moments using sample average Sample i.i.d. Gaussian and construct error eld through K-L N KL e(s, ω) = ē(s) + λi φ i (s)ξ i (ω) i=1 Perturb geometry according to error eld x(s, ω) = x d (s) + e(s, ω)ˆn(s) Compute ow solution for perturbed geometry Compute performance quantities of interest for each sample geometry E[F ] 1 N MC F n N MC n=1 Requires a large number of samples as error is O(N 1/2 MC ) 15

18 From Design and Tolerances to Mean Performance Design Intent Geometry x d (s; d) Random Field 1 e 1 (s, ω 1 ; σ) Geometry Realization 1 x 1 (s, ω 1 ; d, σ) CFD Geometry 1 Performance η 1 (ω 1, d, σ) Correlation Structure ρ ω 1 Karhunen-Loève Expansion φ i (s), λ i ω 2 Random Field 2 e 2 (s, ω 2 ; σ) Geometry Realization 2 x 2 (s, ω 2 ; d, σ) CFD Geometry 2 Performance η 2 (ω 2, d, σ) Performance Moments E[η(d, σ)] Standard Deviation σ ω NMC.. Random Field N MC e NMC (s, ω NMC ; σ) Geometry Realization N MC x NMC (s, ω NMC ; d, σ) CFD Geometry N MC Performance η NMC (ω NMC, d, σ) 16

19 Sensitivity Analysis Overview Gradient based optimization: need to compute E[F ] (Sensitivity of mean performance to nominal design) d i E[F ] (Sensitivity of mean performance to tolerances) σ i Pathwise sensitivity: exchange dierentiation and integration [ ] [ ] [ ] E[F ] F E[F ] F F e = E = E = E d i d i σ i σ i e σ i Shape sensitivities F / d i and F / e can be computed with Adjoint method Direct sensitivity method Finite dierence/complex step method Sample path sensitivity e/ σ i derived from the K-L expansion 17

20 Pathwise Sensitivity Analysis Objective function is some moment of a performance quantity of interest J = E[F (e(σ i, ξ))] = F (e(σ i, ξ)) p Ξ (ξ) dξ Exchange dierentiation and integration: [ ] J F e F e = p Ξ (ξ) dξ = E σ i e σ i e σ i Key idea: x random numbers and perturb sample realizations Pros: well-suited to handle spatially distributed uncertainty Cons: requires continuous F (excludes failure probability sensitivities) 18

21 Monte Carlo and Pathwise Sensitivities Recall Monte Carlo approximation: E[F ] 1 N MC F n N MC n=1 Pathwise sensitivity analysis: exchange dierentiation and summation E[F ] 1 N MC F n E[F ] 1 d i N MC d i σ i N MC n=1 N MC n=1 F n σ i F n/ σ i is computed for xed realization, i.e. xed ξ in the K-L expansion N KL e(s, ω; σ) = ē(s) + λi φ i (s)ξ i (ω) i=1 19

22 Sample Path Sensitivity For each realization of the random eld, compute sensitivity of random eld e with respect to each σ j Karhunen-Loève eigenvalues/eigenvectors are dierentiable functions of σ: N KL e(s, ω; σ) = ē(s) + λi φ i (s)ξ i (ω) e(s, ω; σ) σ j = N KL i=1 φ i σ j i=1 ( 1 2 λ i φ i + ) φ i λ i ξ i (ω) λ i σ j σ j λ i σ j = φ T i C σ j φ i = (C λ i I ) + C σ j φ i These derivatives exist if the eigenvalues have algebraic multiplicity of one 20

23 Sample Path Sensitivity Holding xed ξ in K-L expansion ensures that δσ(s) small e(s) and e(s) + δe δσ(s) are close δσ e e(s) + e σ δσ(s) σ(s) + δσ(s) 0.8 σ (s ) e (s ) e(s) σ(s) s Initial and perturbed standard deviation s Initial and perturbed error eld x d x d + e x d + e + δe Initial and perturbed manufactured blade 21

24 Subsonic Cascade Example MISES: coupled inviscid/viscous ow solver Blade shape parameterized with Chebyshev polynomials Shape sensitivities computed using nite dierences Baseline (no geometric variability): Π 0 = 1.089, θ 0 = Manufacturing variability modeled using a squared exponential kernel with σ(s) = ) s1 s2 2 C(s 1, s 2) = σ(s 1)σ(s 2) exp ( 2L 2 L = 2/20 E[θ] = E[Π] = Mean pressure ratio constrained to be above Π = Performance cost function only includes mean eciency 22

25 Subsonic Cascade Results Optimal design attains lower loss coecient and allows more variability Performance cost function (Cperf ) is reduced by 6% Tolerance cost function (Cman) is reduced by 47% (a) Baseline and optimized blade (b) Optimal σ(s) distribution 23

26 Summary and Future Work New framework for simultaneous robust design and tolerancing Manufacturing and operating costs incorporated into optimization Create a feedback loop between designers and manufacturers Novel probabilistic sensitivity analysis of performance to level of variability Optimal blade performs better and is cheaper to manufacture Future Work More accurate/ecient shape sensitivities: direct sensitivity method Transonic compressor optimization Investigate solution quality 24

27 Questions? 25

28 Pathwise Sensitivity Sucient Conditions for Unbiasedness (Following Glasserman[Glasserman, 2004]) Assume output Y is a function of m random variables: Pathwise estimate is unbiased if [ ] Y (θ + h) Y (θ) E lim h 0 h Y (θ) = f (X 1(θ),..., X m(θ)) = f (X (θ)) = lim h 0 E [ ] Y (θ + h) Y (θ) h (A1) X i (θ) exists w.p. 1, i = 1,..., m (A2) Denote D f R m as the set where f is dierentiable and require P(X (θ) D F ) = 1 Then Y (θ) exists w.p. 1 and is given by Y (θ) = m i=1 θ Θ f X i (X (θ))x i (θ) 26

29 Pathwise Sensitivity Sucient Conditions for Unbiasedness (A3) The function f is Lipschitz continuous, i.e. k f s.t. x, y R m f (x) f (y) k f x y (A4) There exist random variables k i, i = 1,..., m, s.t. θ 1, θ 2 Θ, and E[k i ] < X i (θ 2) X i (θ 1) k i θ 2 θ 1 Conditions (A3) and (A4) imply that Y is almost surely Lipschitz continuous in θ: Y (θ 2) Y (θ 1) k Y θ 2 θ 1 Thus, we have Y (θ + h) Y (θ) h k Y The interchange of expectation and dierentiation are then justied by the DCT 27

30 Adjoint Method Consider an objective function F that depends on the solution u of some PDE, which in turn depends on some parameter p: which we linearize F = F (u; p) δf = F T δu + F T δp u p The PDE solution satises a residual equation R(u; p) = 0 which can be linearized to give [ ] [ ] R R δu + δp = 0 u p 28

31 Adjoint Method Introduce the adjoint state ψ (Lagrange multiplier), and treat the linearized residual equation as a constraint T δf = F u ( F = u δu + F T δp ψ T p ]) T ψ T [ R u If the adjoint state ψ is chosen to satisfy [ ] T R ψ = F =0 [ R δu + p ([ { ] }} ] ){ R δp u ( [ ]) F T δu + ψ T R δp p p u u then the sensitivity gradient can be computed as ( [ ]) F F T p = ψ T R p p Cost is 2N MC ow solutions (vs 2N MC [N d + N σ] ow solutions for FD) 29

32 Eigenvalue Level Repulsion: von Neumann-Wigner Theorem The codimension of the set of positive denite matrices with repeated eigenvalues is greater than one The space of all SPD n n matrices forms a linear space of dimension N = n(n + 1)/2. Two ways to count this: sum of diagonal and elements above diagonal, or... n dimensions corresponding to the eigenvalues (n 1) dimensions corresponding to rst eigenvector subject to φ 1 = 1 (n 2) dimensions corresponding to second eigenvector subject to φ 2 = 1 and φ T 1 φ 2 = 0... Single dimension corresponding to the second to last eigenvector Final eigenvector is uniquely determined by all others n + n (n i) = n + n(n 1)/2 = n(n + 1)/2 = N i=1 30

33 Eigenvalue Level Repulsion: von Neumann-Wigner Theorem Now consider the space of all SPD n n matrices with exactly two eigenvalues that are equal The space of real SPD n n matrices with more than two equal eigenalues is certainly no larger than this space Similar counting approach n 1 dimensions corresponding to the eigenvalues (n 1) dimensions corresponding to rst simple eigenvector subject to φ 1 = 1 (n 2) dimensions corresponding to second simple eigenvector subject to φ 2 = 1 and φ T 1 φ 2 = 0... Two dimensions corresponding to the last simple eigenvector Eigenspace corresponding to equal eigenvalues is uniquely determined n 2 (n 1) + (n i) = N 2 Starting from a random matrix and moving in a random direction will almost surely result in simple eigenvalues i=1 31

34 Antithetic Variates Consider estimating the mean M = E[F (ξ)], ξ = (ξ 1,..., ξ NKL ) with two samples: ˆM = F (ξ 1) + F (ξ 2 ) F1 + F2 = 2 2 with estimator variance If F (ξ) is monotone, choose Var( ˆM) = Var(F 1) + Var(F 2) + 2Cov(F 1, F 2) 4 ξ 1 = ξ 2 then Cov(F 1, F 2) < 0 and variance is reduced Quantities of interest and their sensitivities are nearly linear when level of uncertainty is small 32

35 References I [Drela, 1998] Drela, M. (1998). Frontiers of Computational Fluid Dynamics 1998, chapter 19, Pros and cons of airfoil optimization, pages World Scientic Publishing. [Garzon, 2003] Garzon, V. E. (2003). Probabilistic Aerothermal Design of Compressor Airfoils. PhD dissertation, Massachusetts Institute of Technology, Department of Aeronautics and Astronautics. [Garzon and Darmofal, 2003] Garzon, V. E. and Darmofal, D. (2003). Impact of geometric variability on axial compressor performance. Journal of Turbomachinery, 125(4): [Glasserman, 2004] Glasserman, P. (2004). Monte Carlo Methods in Financial Engineering, chapter 7, Estimating Sensitivities, pages Springer Verlag, New York. [Lavainne, 2003] Lavainne, J. (2003). Sensitivity of a Compressor Repeating-Stage to Geometry Variation. Master's dissertation, Massachusetts Institute of Technology, Department of Aeronautics and Astronautics. 33

Dinesh Kumar, Mehrdad Raisee and Chris Lacor

Dinesh Kumar, Mehrdad Raisee and Chris Lacor Dinesh Kumar, Mehrdad Raisee and Chris Lacor Fluid Mechanics and Thermodynamics Research Group Vrije Universiteit Brussel, BELGIUM dkumar@vub.ac.be; m_raisee@yahoo.com; chris.lacor@vub.ac.be October, 2014

More information

Probabilistic Aerothermal Design of Compressor Airfoils. Victor E. Garzon

Probabilistic Aerothermal Design of Compressor Airfoils. Victor E. Garzon Probabilistic Aerothermal Design of Compressor Airfoils by Victor E. Garzon B.S., University of Kentucky (1994) M.S., University of Kentucky (1998) Submitted to the Department of Aeronautics and Astronautics

More information

Probabilistic Aerothermal Design of Compressor Airfoils. Victor E. Garzon

Probabilistic Aerothermal Design of Compressor Airfoils. Victor E. Garzon Probabilistic Aerothermal Design of Compressor Airfoils by Victor E. Garzon B.S., University of Kentucky (1994) M.S., University of Kentucky (1998) Submitted to the Department of Aeronautics and Astronautics

More information

Polynomial Chaos and Karhunen-Loeve Expansion

Polynomial Chaos and Karhunen-Loeve Expansion Polynomial Chaos and Karhunen-Loeve Expansion 1) Random Variables Consider a system that is modeled by R = M(x, t, X) where X is a random variable. We are interested in determining the probability of the

More information

Experiences with Model Reduction and Interpolation

Experiences with Model Reduction and Interpolation Experiences with Model Reduction and Interpolation Paul Constantine Stanford University, Sandia National Laboratories Qiqi Wang (MIT) David Gleich (Purdue) Emory University March 7, 2012 Joe Ruthruff (SNL)

More information

New Developments in LS-OPT - Robustness Studies

New Developments in LS-OPT - Robustness Studies 5. LS-DYNA - Anwenderforum, Ulm 2006 Robustheit / Optimierung I New Developments in LS-OPT - Robustness Studies Ken Craig, Willem Roux 2, Nielen Stander 2 Multidisciplinary Design Optimization Group University

More information

Multigrid and stochastic sparse-grids techniques for PDE control problems with random coefficients

Multigrid and stochastic sparse-grids techniques for PDE control problems with random coefficients Multigrid and stochastic sparse-grids techniques for PDE control problems with random coefficients Università degli Studi del Sannio Dipartimento e Facoltà di Ingegneria, Benevento, Italia Random fields

More information

Linear Regression and Its Applications

Linear Regression and Its Applications Linear Regression and Its Applications Predrag Radivojac October 13, 2014 Given a data set D = {(x i, y i )} n the objective is to learn the relationship between features and the target. We usually start

More information

The Choice of Representative Volumes for Random Materials

The Choice of Representative Volumes for Random Materials The Choice of Representative Volumes for Random Materials Julian Fischer IST Austria 13.4.2018 Effective properties of random materials Material with random microstructure Effective large-scale description?

More information

ACTIVE SUBSPACE METHODS IN THEORY AND PRACTICE: APPLICATIONS TO KRIGING SURFACES

ACTIVE SUBSPACE METHODS IN THEORY AND PRACTICE: APPLICATIONS TO KRIGING SURFACES ACTIVE SUBSPACE METHODS IN THEORY AND PRACTICE: APPLICATIONS TO KRIGING SURFACES PAUL G. CONSTANTINE, ERIC DOW, AND QIQI WANG Abstract. Many multivariate functions encountered in practical engineering

More information

Karhunen-Loève Approximation of Random Fields Using Hierarchical Matrix Techniques

Karhunen-Loève Approximation of Random Fields Using Hierarchical Matrix Techniques Institut für Numerische Mathematik und Optimierung Karhunen-Loève Approximation of Random Fields Using Hierarchical Matrix Techniques Oliver Ernst Computational Methods with Applications Harrachov, CR,

More information

Multivariate Gaussian Random Fields with SPDEs

Multivariate Gaussian Random Fields with SPDEs Multivariate Gaussian Random Fields with SPDEs Xiangping Hu Daniel Simpson, Finn Lindgren and Håvard Rue Department of Mathematics, University of Oslo PASI, 214 Outline The Matérn covariance function and

More information

Solving the steady state diffusion equation with uncertainty Final Presentation

Solving the steady state diffusion equation with uncertainty Final Presentation Solving the steady state diffusion equation with uncertainty Final Presentation Virginia Forstall vhfors@gmail.com Advisor: Howard Elman elman@cs.umd.edu Department of Computer Science May 6, 2012 Problem

More information

Implementation of Sparse Wavelet-Galerkin FEM for Stochastic PDEs

Implementation of Sparse Wavelet-Galerkin FEM for Stochastic PDEs Implementation of Sparse Wavelet-Galerkin FEM for Stochastic PDEs Roman Andreev ETH ZÜRICH / 29 JAN 29 TOC of the Talk Motivation & Set-Up Model Problem Stochastic Galerkin FEM Conclusions & Outlook Motivation

More information

Stochastic Solvers for the Euler Equations

Stochastic Solvers for the Euler Equations 43rd AIAA Aerospace Sciences Meeting and Exhibit 1-13 January 5, Reno, Nevada 5-873 Stochastic Solvers for the Euler Equations G. Lin, C.-H. Su and G.E. Karniadakis Division of Applied Mathematics Brown

More information

Uncertainty Management and Quantification in Industrial Analysis and Design

Uncertainty Management and Quantification in Industrial Analysis and Design Uncertainty Management and Quantification in Industrial Analysis and Design www.numeca.com Charles Hirsch Professor, em. Vrije Universiteit Brussel President, NUMECA International The Role of Uncertainties

More information

Quantifying Stochastic Model Errors via Robust Optimization

Quantifying Stochastic Model Errors via Robust Optimization Quantifying Stochastic Model Errors via Robust Optimization IPAM Workshop on Uncertainty Quantification for Multiscale Stochastic Systems and Applications Jan 19, 2016 Henry Lam Industrial & Operations

More information

A Crash-Course on the Adjoint Method for Aerodynamic Shape Optimization

A Crash-Course on the Adjoint Method for Aerodynamic Shape Optimization A Crash-Course on the Adjoint Method for Aerodynamic Shape Optimization Juan J. Alonso Department of Aeronautics & Astronautics Stanford University jjalonso@stanford.edu Lecture 19 AA200b Applied Aerodynamics

More information

A Stochastic Collocation based. for Data Assimilation

A Stochastic Collocation based. for Data Assimilation A Stochastic Collocation based Kalman Filter (SCKF) for Data Assimilation Lingzao Zeng and Dongxiao Zhang University of Southern California August 11, 2009 Los Angeles Outline Introduction SCKF Algorithm

More information

Practical unbiased Monte Carlo for Uncertainty Quantification

Practical unbiased Monte Carlo for Uncertainty Quantification Practical unbiased Monte Carlo for Uncertainty Quantification Sergios Agapiou Department of Statistics, University of Warwick MiR@W day: Uncertainty in Complex Computer Models, 2nd February 2015, University

More information

Hierarchical Parallel Solution of Stochastic Systems

Hierarchical Parallel Solution of Stochastic Systems Hierarchical Parallel Solution of Stochastic Systems Second M.I.T. Conference on Computational Fluid and Solid Mechanics Contents: Simple Model of Stochastic Flow Stochastic Galerkin Scheme Resulting Equations

More information

Discrete Variables and Gradient Estimators

Discrete Variables and Gradient Estimators iscrete Variables and Gradient Estimators This assignment is designed to get you comfortable deriving gradient estimators, and optimizing distributions over discrete random variables. For most questions,

More information

arxiv: v2 [math.pr] 27 Oct 2015

arxiv: v2 [math.pr] 27 Oct 2015 A brief note on the Karhunen-Loève expansion Alen Alexanderian arxiv:1509.07526v2 [math.pr] 27 Oct 2015 October 28, 2015 Abstract We provide a detailed derivation of the Karhunen Loève expansion of a stochastic

More information

ECON 616: Lecture 1: Time Series Basics

ECON 616: Lecture 1: Time Series Basics ECON 616: Lecture 1: Time Series Basics ED HERBST August 30, 2017 References Overview: Chapters 1-3 from Hamilton (1994). Technical Details: Chapters 2-3 from Brockwell and Davis (1987). Intuition: Chapters

More information

Econ 424 Time Series Concepts

Econ 424 Time Series Concepts Econ 424 Time Series Concepts Eric Zivot January 20 2015 Time Series Processes Stochastic (Random) Process { 1 2 +1 } = { } = sequence of random variables indexed by time Observed time series of length

More information

arxiv: v2 [math.na] 5 Dec 2013

arxiv: v2 [math.na] 5 Dec 2013 ACTIVE SUBSPACE METHODS IN THEORY AND PRACTICE: APPLICATIONS TO KRIGING SURFACES PAUL G. CONSTANTINE, ERIC DOW, AND QIQI WANG arxiv:1304.2070v2 [math.na 5 Dec 2013 Abstract. Many multivariate functions

More information

Efficient Solvers for Stochastic Finite Element Saddle Point Problems

Efficient Solvers for Stochastic Finite Element Saddle Point Problems Efficient Solvers for Stochastic Finite Element Saddle Point Problems Catherine E. Powell c.powell@manchester.ac.uk School of Mathematics University of Manchester, UK Efficient Solvers for Stochastic Finite

More information

Probabilistic Structural Dynamics: Parametric vs. Nonparametric Approach

Probabilistic Structural Dynamics: Parametric vs. Nonparametric Approach Probabilistic Structural Dynamics: Parametric vs. Nonparametric Approach S Adhikari School of Engineering, Swansea University, Swansea, UK Email: S.Adhikari@swansea.ac.uk URL: http://engweb.swan.ac.uk/

More information

A Vector-Space Approach for Stochastic Finite Element Analysis

A Vector-Space Approach for Stochastic Finite Element Analysis A Vector-Space Approach for Stochastic Finite Element Analysis S Adhikari 1 1 Swansea University, UK CST2010: Valencia, Spain Adhikari (Swansea) Vector-Space Approach for SFEM 14-17 September, 2010 1 /

More information

Stochastic Spectral Approaches to Bayesian Inference

Stochastic Spectral Approaches to Bayesian Inference Stochastic Spectral Approaches to Bayesian Inference Prof. Nathan L. Gibson Department of Mathematics Applied Mathematics and Computation Seminar March 4, 2011 Prof. Gibson (OSU) Spectral Approaches to

More information

Max. Likelihood Estimation. Outline. Econometrics II. Ricardo Mora. Notes. Notes

Max. Likelihood Estimation. Outline. Econometrics II. Ricardo Mora. Notes. Notes Maximum Likelihood Estimation Econometrics II Department of Economics Universidad Carlos III de Madrid Máster Universitario en Desarrollo y Crecimiento Económico Outline 1 3 4 General Approaches to Parameter

More information

Impact of Geometric Variability on Compressor Repeating-Stage Performance. Antoine Vincent

Impact of Geometric Variability on Compressor Repeating-Stage Performance. Antoine Vincent Impact of Geometric Variability on Compressor Repeating-Stage Performance by Antoine Vincent Diplôme d ingénieur, École Polytechnique, Palaiseau (2002) Submitted to the Department of Aeronautics and Astronautics

More information

Monte Carlo Methods for Uncertainty Quantification

Monte Carlo Methods for Uncertainty Quantification Monte Carlo Methods for Uncertainty Quantification Mike Giles Mathematical Institute, University of Oxford Contemporary Numerical Techniques Mike Giles (Oxford) Monte Carlo methods 1 / 23 Lecture outline

More information

. Frobenius-Perron Operator ACC Workshop on Uncertainty Analysis & Estimation. Raktim Bhattacharya

. Frobenius-Perron Operator ACC Workshop on Uncertainty Analysis & Estimation. Raktim Bhattacharya .. Frobenius-Perron Operator 2014 ACC Workshop on Uncertainty Analysis & Estimation Raktim Bhattacharya Laboratory For Uncertainty Quantification Aerospace Engineering, Texas A&M University. uq.tamu.edu

More information

A Few Notes on Fisher Information (WIP)

A Few Notes on Fisher Information (WIP) A Few Notes on Fisher Information (WIP) David Meyer dmm@{-4-5.net,uoregon.edu} Last update: April 30, 208 Definitions There are so many interesting things about Fisher Information and its theoretical properties

More information

Long-Run Covariability

Long-Run Covariability Long-Run Covariability Ulrich K. Müller and Mark W. Watson Princeton University October 2016 Motivation Study the long-run covariability/relationship between economic variables great ratios, long-run Phillips

More information

Overview. Bayesian assimilation of experimental data into simulation (for Goland wing flutter) Why not uncertainty quantification?

Overview. Bayesian assimilation of experimental data into simulation (for Goland wing flutter) Why not uncertainty quantification? Delft University of Technology Overview Bayesian assimilation of experimental data into simulation (for Goland wing flutter), Simao Marques 1. Why not uncertainty quantification? 2. Why uncertainty quantification?

More information

Review. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda

Review. DS GA 1002 Statistical and Mathematical Models.   Carlos Fernandez-Granda Review DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall16 Carlos Fernandez-Granda Probability and statistics Probability: Framework for dealing with

More information

Collocation based high dimensional model representation for stochastic partial differential equations

Collocation based high dimensional model representation for stochastic partial differential equations Collocation based high dimensional model representation for stochastic partial differential equations S Adhikari 1 1 Swansea University, UK ECCM 2010: IV European Conference on Computational Mechanics,

More information

The Bayesian approach to inverse problems

The Bayesian approach to inverse problems The Bayesian approach to inverse problems Youssef Marzouk Department of Aeronautics and Astronautics Center for Computational Engineering Massachusetts Institute of Technology ymarz@mit.edu, http://uqgroup.mit.edu

More information

Adaptive Collocation with Kernel Density Estimation

Adaptive Collocation with Kernel Density Estimation Examples of with Kernel Density Estimation Howard C. Elman Department of Computer Science University of Maryland at College Park Christopher W. Miller Applied Mathematics and Scientific Computing Program

More information

Concepts in Global Sensitivity Analysis IMA UQ Short Course, June 23, 2015

Concepts in Global Sensitivity Analysis IMA UQ Short Course, June 23, 2015 Concepts in Global Sensitivity Analysis IMA UQ Short Course, June 23, 2015 A good reference is Global Sensitivity Analysis: The Primer. Saltelli, et al. (2008) Paul Constantine Colorado School of Mines

More information

Schwarz Preconditioner for the Stochastic Finite Element Method

Schwarz Preconditioner for the Stochastic Finite Element Method Schwarz Preconditioner for the Stochastic Finite Element Method Waad Subber 1 and Sébastien Loisel 2 Preprint submitted to DD22 conference 1 Introduction The intrusive polynomial chaos approach for uncertainty

More information

From Fractional Brownian Motion to Multifractional Brownian Motion

From Fractional Brownian Motion to Multifractional Brownian Motion From Fractional Brownian Motion to Multifractional Brownian Motion Antoine Ayache USTL (Lille) Antoine.Ayache@math.univ-lille1.fr Cassino December 2010 A.Ayache (USTL) From FBM to MBM Cassino December

More information

Monte Carlo Methods for Statistical Inference: Variance Reduction Techniques

Monte Carlo Methods for Statistical Inference: Variance Reduction Techniques Monte Carlo Methods for Statistical Inference: Variance Reduction Techniques Hung Chen hchen@math.ntu.edu.tw Department of Mathematics National Taiwan University 3rd March 2004 Meet at NS 104 On Wednesday

More information

Multi-fidelity sensitivity analysis

Multi-fidelity sensitivity analysis Multi-fidelity sensitivity analysis Loic Le Gratiet 1,2, Claire Cannamela 2 & Bertrand Iooss 3 1 Université Denis-Diderot, Paris, France 2 CEA, DAM, DIF, F-91297 Arpajon, France 3 EDF R&D, 6 quai Watier,

More information

Lecture 15, 16: Diagonalization

Lecture 15, 16: Diagonalization Lecture 15, 16: Diagonalization Motivation: Eigenvalues and Eigenvectors are easy to compute for diagonal matrices. Hence, we would like (if possible) to convert matrix A into a diagonal matrix. Suppose

More information

UNCERTAINTY ASSESSMENT USING STOCHASTIC REDUCED BASIS METHOD FOR FLOW IN POROUS MEDIA

UNCERTAINTY ASSESSMENT USING STOCHASTIC REDUCED BASIS METHOD FOR FLOW IN POROUS MEDIA UNCERTAINTY ASSESSMENT USING STOCHASTIC REDUCED BASIS METHOD FOR FLOW IN POROUS MEDIA A REPORT SUBMITTED TO THE DEPARTMENT OF ENERGY RESOURCES ENGINEERING OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT

More information

Natural Evolution Strategies for Direct Search

Natural Evolution Strategies for Direct Search Tobias Glasmachers Natural Evolution Strategies for Direct Search 1 Natural Evolution Strategies for Direct Search PGMO-COPI 2014 Recent Advances on Continuous Randomized black-box optimization Thursday

More information

Monte Carlo simulation inspired by computational optimization. Colin Fox Al Parker, John Bardsley MCQMC Feb 2012, Sydney

Monte Carlo simulation inspired by computational optimization. Colin Fox Al Parker, John Bardsley MCQMC Feb 2012, Sydney Monte Carlo simulation inspired by computational optimization Colin Fox fox@physics.otago.ac.nz Al Parker, John Bardsley MCQMC Feb 2012, Sydney Sampling from π(x) Consider : x is high-dimensional (10 4

More information

Kernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt.

Kernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt. SINGAPORE SHANGHAI Vol TAIPEI - Interdisciplinary Mathematical Sciences 19 Kernel-based Approximation Methods using MATLAB Gregory Fasshauer Illinois Institute of Technology, USA Michael McCourt University

More information

3. Review of Probability and Statistics

3. Review of Probability and Statistics 3. Review of Probability and Statistics ECE 830, Spring 2014 Probabilistic models will be used throughout the course to represent noise, errors, and uncertainty in signal processing problems. This lecture

More information

Solution of the Two-Dimensional Steady State Heat Conduction using the Finite Volume Method

Solution of the Two-Dimensional Steady State Heat Conduction using the Finite Volume Method Ninth International Conference on Computational Fluid Dynamics (ICCFD9), Istanbul, Turkey, July 11-15, 2016 ICCFD9-0113 Solution of the Two-Dimensional Steady State Heat Conduction using the Finite Volume

More information

SG39 Meeting May 16-17, Update on Continuous Energy Cross Section Adjustment. UC Berkeley / INL collaboration

SG39 Meeting May 16-17, Update on Continuous Energy Cross Section Adjustment. UC Berkeley / INL collaboration SG39 Meeting May 16-17, 2017 Update on Continuous Energy Cross Section Adjustment. UC Berkeley / INL collaboration Outline Presentation of the proposed methodology (you've already seen this) Results from

More information

Copyright 2003 by the American Institute of Aeronautics and Astronautics Inc. All rights reserved

Copyright 2003 by the American Institute of Aeronautics and Astronautics Inc. All rights reserved 1 ISABE29-1225 COMPUTATION OF SECOND-ORDER SENSITIVITIES OF THE TOTAL PRESSURE LOSSES FUNCTIONAL IN CASCADE FLOWS T. Zervogiannis, D.I. Papadimitriou and K.C. Giannakoglou National Technical University

More information

Random Matrix Eigenvalue Problems in Probabilistic Structural Mechanics

Random Matrix Eigenvalue Problems in Probabilistic Structural Mechanics Random Matrix Eigenvalue Problems in Probabilistic Structural Mechanics S Adhikari Department of Aerospace Engineering, University of Bristol, Bristol, U.K. URL: http://www.aer.bris.ac.uk/contact/academic/adhikari/home.html

More information

The effects of manufacturing variability on turbine vane performance. John D. Duffner

The effects of manufacturing variability on turbine vane performance. John D. Duffner The effects of manufacturing variability on turbine vane performance by John D. Duffner B.S., Aerospace Engineering (26) University of Notre Dame Submitted to the Department of Aeronautics and Astronautics

More information

2 Tikhonov Regularization and ERM

2 Tikhonov Regularization and ERM Introduction Here we discusses how a class of regularization methods originally designed to solve ill-posed inverse problems give rise to regularized learning algorithms. These algorithms are kernel methods

More information

Random Eigenvalue Problems Revisited

Random Eigenvalue Problems Revisited Random Eigenvalue Problems Revisited S Adhikari Department of Aerospace Engineering, University of Bristol, Bristol, U.K. Email: S.Adhikari@bristol.ac.uk URL: http://www.aer.bris.ac.uk/contact/academic/adhikari/home.html

More information

Lecture 1: Center for Uncertainty Quantification. Alexander Litvinenko. Computation of Karhunen-Loeve Expansion:

Lecture 1: Center for Uncertainty Quantification. Alexander Litvinenko. Computation of Karhunen-Loeve Expansion: tifica Lecture 1: Computation of Karhunen-Loeve Expansion: Alexander Litvinenko http://sri-uq.kaust.edu.sa/ Stochastic PDEs We consider div(κ(x, ω) u) = f (x, ω) in G, u = 0 on G, with stochastic coefficients

More information

Numerical Synthesis of Pontryagin Optimal Control Minimizers Using Sampling-Based Methods

Numerical Synthesis of Pontryagin Optimal Control Minimizers Using Sampling-Based Methods Numerical Synthesis of Pontryagin Optimal Control Minimizers Using Sampling-Based Methods Humberto Gonzalez Department of Electrical & Systems Engineering Washington University in St. Louis April 7th,

More information

Chapter 6. Panel Data. Joan Llull. Quantitative Statistical Methods II Barcelona GSE

Chapter 6. Panel Data. Joan Llull. Quantitative Statistical Methods II Barcelona GSE Chapter 6. Panel Data Joan Llull Quantitative Statistical Methods II Barcelona GSE Introduction Chapter 6. Panel Data 2 Panel data The term panel data refers to data sets with repeated observations over

More information

An Investigation of the Attainable Efficiency of Flight at Mach One or Just Beyond

An Investigation of the Attainable Efficiency of Flight at Mach One or Just Beyond An Investigation of the Attainable Efficiency of Flight at Mach One or Just Beyond Antony Jameson Department of Aeronautics and Astronautics AIAA Aerospace Sciences Meeting, Reno, NV AIAA Paper 2007-0037

More information

Random Vibrations & Failure Analysis Sayan Gupta Indian Institute of Technology Madras

Random Vibrations & Failure Analysis Sayan Gupta Indian Institute of Technology Madras Random Vibrations & Failure Analysis Sayan Gupta Indian Institute of Technology Madras Lecture 1: Introduction Course Objectives: The focus of this course is on gaining understanding on how to make an

More information

Effect of Geometric Uncertainties on the Aerodynamic Characteristic of Offshore Wind Turbine Blades

Effect of Geometric Uncertainties on the Aerodynamic Characteristic of Offshore Wind Turbine Blades the Aerodynamic Offshore Wind, Henning Schmitt, Jörg R. Seume The Science of Making Torque from Wind 2012 October 9-11, 2012 Oldenburg, Germany 1. Motivation and 2. 3. 4. 5. Conclusions and Slide 2 / 12

More information

Constrained data assimilation. W. Carlisle Thacker Atlantic Oceanographic and Meteorological Laboratory Miami, Florida USA

Constrained data assimilation. W. Carlisle Thacker Atlantic Oceanographic and Meteorological Laboratory Miami, Florida USA Constrained data assimilation W. Carlisle Thacker Atlantic Oceanographic and Meteorological Laboratory Miami, Florida 33149 USA Plan Range constraints: : HYCOM layers have minimum thickness. Optimal interpolation:

More information

A reduced-order stochastic finite element analysis for structures with uncertainties

A reduced-order stochastic finite element analysis for structures with uncertainties A reduced-order stochastic finite element analysis for structures with uncertainties Ji Yang 1, Béatrice Faverjon 1,2, Herwig Peters 1, icole Kessissoglou 1 1 School of Mechanical and Manufacturing Engineering,

More information

c 2004 Society for Industrial and Applied Mathematics

c 2004 Society for Industrial and Applied Mathematics SIAM J. SCI. COMPUT. Vol. 26, No. 2, pp. 558 577 c 2004 Society for Industrial and Applied Mathematics A COMPARATIVE STUDY ON UNCERTAINTY QUANTIFICATION FOR FLOW IN RANDOMLY HETEROGENEOUS MEDIA USING MONTE

More information

Karhunen-Loève decomposition of Gaussian measures on Banach spaces

Karhunen-Loève decomposition of Gaussian measures on Banach spaces Karhunen-Loève decomposition of Gaussian measures on Banach spaces Jean-Charles Croix jean-charles.croix@emse.fr Génie Mathématique et Industriel (GMI) First workshop on Gaussian processes at Saint-Etienne

More information

Algorithms for Uncertainty Quantification

Algorithms for Uncertainty Quantification Algorithms for Uncertainty Quantification Lecture 9: Sensitivity Analysis ST 2018 Tobias Neckel Scientific Computing in Computer Science TUM Repetition of Previous Lecture Sparse grids in Uncertainty Quantification

More information

UNIVERSITY OF MARYLAND Department of Physics College Park, Maryland. PHYSICS Ph.D. QUALIFYING EXAMINATION PART II

UNIVERSITY OF MARYLAND Department of Physics College Park, Maryland. PHYSICS Ph.D. QUALIFYING EXAMINATION PART II UNIVERSITY OF MARYLAND Department of Physics College Park, Maryland PHYSICS Ph.D. QUALIFYING EXAMINATION PART II August 23, 208 9:00 a.m. :00 p.m. Do any four problems. Each problem is worth 25 points.

More information

4.1 Eigenvalues, Eigenvectors, and The Characteristic Polynomial

4.1 Eigenvalues, Eigenvectors, and The Characteristic Polynomial Linear Algebra (part 4): Eigenvalues, Diagonalization, and the Jordan Form (by Evan Dummit, 27, v ) Contents 4 Eigenvalues, Diagonalization, and the Jordan Canonical Form 4 Eigenvalues, Eigenvectors, and

More information

Covariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 )

Covariance Stationary Time Series. Example: Independent White Noise (IWN(0,σ 2 )) Y t = ε t, ε t iid N(0,σ 2 ) Covariance Stationary Time Series Stochastic Process: sequence of rv s ordered by time {Y t } {...,Y 1,Y 0,Y 1,...} Defn: {Y t } is covariance stationary if E[Y t ]μ for all t cov(y t,y t j )E[(Y t μ)(y

More information

Chapter 5. Sound Waves and Vortices. 5.1 Sound waves

Chapter 5. Sound Waves and Vortices. 5.1 Sound waves Chapter 5 Sound Waves and Vortices In this chapter we explore a set of characteristic solutions to the uid equations with the goal of familiarizing the reader with typical behaviors in uid dynamics. Sound

More information

Complexity analysis of second-order algorithms based on line search for smooth nonconvex optimization

Complexity analysis of second-order algorithms based on line search for smooth nonconvex optimization Complexity analysis of second-order algorithms based on line search for smooth nonconvex optimization Clément Royer - University of Wisconsin-Madison Joint work with Stephen J. Wright MOPTA, Bethlehem,

More information

Stochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions

Stochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions International Journal of Control Vol. 00, No. 00, January 2007, 1 10 Stochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions I-JENG WANG and JAMES C.

More information

Covariance function estimation in Gaussian process regression

Covariance function estimation in Gaussian process regression Covariance function estimation in Gaussian process regression François Bachoc Department of Statistics and Operations Research, University of Vienna WU Research Seminar - May 2015 François Bachoc Gaussian

More information

ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering

ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering Lecturer: Nikolay Atanasov: natanasov@ucsd.edu Teaching Assistants: Siwei Guo: s9guo@eng.ucsd.edu Anwesan Pal:

More information

Active Subspaces of Airfoil Shape Parameterizations

Active Subspaces of Airfoil Shape Parameterizations Active Subspaces of Airfoil Shape Parameterizations arxiv:172.299v1 [math.na] 9 Feb 217 Zachary J. Grey and Paul G. Constantine Colorado School of Mines, Golden, Colorado, 841, USA Design and optimization

More information

Multilevel accelerated quadrature for elliptic PDEs with random diffusion. Helmut Harbrecht Mathematisches Institut Universität Basel Switzerland

Multilevel accelerated quadrature for elliptic PDEs with random diffusion. Helmut Harbrecht Mathematisches Institut Universität Basel Switzerland Multilevel accelerated quadrature for elliptic PDEs with random diffusion Mathematisches Institut Universität Basel Switzerland Overview Computation of the Karhunen-Loéve expansion Elliptic PDE with uniformly

More information

COS 424: Interacting with Data

COS 424: Interacting with Data COS 424: Interacting with Data Lecturer: Rob Schapire Lecture #14 Scribe: Zia Khan April 3, 2007 Recall from previous lecture that in regression we are trying to predict a real value given our data. Specically,

More information

Dynamic System Identification using HDMR-Bayesian Technique

Dynamic System Identification using HDMR-Bayesian Technique Dynamic System Identification using HDMR-Bayesian Technique *Shereena O A 1) and Dr. B N Rao 2) 1), 2) Department of Civil Engineering, IIT Madras, Chennai 600036, Tamil Nadu, India 1) ce14d020@smail.iitm.ac.in

More information

Remark By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero.

Remark By definition, an eigenvector must be a nonzero vector, but eigenvalue could be zero. Sec 6 Eigenvalues and Eigenvectors Definition An eigenvector of an n n matrix A is a nonzero vector x such that A x λ x for some scalar λ A scalar λ is called an eigenvalue of A if there is a nontrivial

More information

A Worst-Case Estimate of Stability Probability for Engineering Drive

A Worst-Case Estimate of Stability Probability for Engineering Drive A Worst-Case Estimate of Stability Probability for Polynomials with Multilinear Uncertainty Structure Sheila R. Ross and B. Ross Barmish Department of Electrical and Computer Engineering University of

More information

Lie Groups for 2D and 3D Transformations

Lie Groups for 2D and 3D Transformations Lie Groups for 2D and 3D Transformations Ethan Eade Updated May 20, 2017 * 1 Introduction This document derives useful formulae for working with the Lie groups that represent transformations in 2D and

More information

Generalization of Hensel lemma: nding of roots of p-adic Lipschitz functions

Generalization of Hensel lemma: nding of roots of p-adic Lipschitz functions Generalization of Hensel lemma: nding of roots of p-adic Lipschitz functions (joint talk with Andrei Khrennikov) Dr. Ekaterina Yurova Axelsson Linnaeus University, Sweden September 8, 2015 Outline Denitions

More information

Motivation General concept of CVaR Optimization Comparison. VaR and CVaR. Přemysl Bejda.

Motivation General concept of CVaR Optimization Comparison. VaR and CVaR. Přemysl Bejda. VaR and CVaR Přemysl Bejda premyslbejda@gmail.com 2014 Contents 1 Motivation 2 General concept of CVaR 3 Optimization 4 Comparison Contents 1 Motivation 2 General concept of CVaR 3 Optimization 4 Comparison

More information

Time Series 2. Robert Almgren. Sept. 21, 2009

Time Series 2. Robert Almgren. Sept. 21, 2009 Time Series 2 Robert Almgren Sept. 21, 2009 This week we will talk about linear time series models: AR, MA, ARMA, ARIMA, etc. First we will talk about theory and after we will talk about fitting the models

More information

Can we do statistical inference in a non-asymptotic way? 1

Can we do statistical inference in a non-asymptotic way? 1 Can we do statistical inference in a non-asymptotic way? 1 Guang Cheng 2 Statistics@Purdue www.science.purdue.edu/bigdata/ ONR Review Meeting@Duke Oct 11, 2017 1 Acknowledge NSF, ONR and Simons Foundation.

More information

A Brief Analysis of Central Limit Theorem. SIAM Chapter Florida State University

A Brief Analysis of Central Limit Theorem. SIAM Chapter Florida State University 1 / 36 A Brief Analysis of Central Limit Theorem Omid Khanmohamadi (okhanmoh@math.fsu.edu) Diego Hernán Díaz Martínez (ddiazmar@math.fsu.edu) Tony Wills (twills@math.fsu.edu) Kouadio David Yao (kyao@math.fsu.edu)

More information

Lecture 2: Review of Basic Probability Theory

Lecture 2: Review of Basic Probability Theory ECE 830 Fall 2010 Statistical Signal Processing instructor: R. Nowak, scribe: R. Nowak Lecture 2: Review of Basic Probability Theory Probabilistic models will be used throughout the course to represent

More information

Calculating determinants for larger matrices

Calculating determinants for larger matrices Day 26 Calculating determinants for larger matrices We now proceed to define det A for n n matrices A As before, we are looking for a function of A that satisfies the product formula det(ab) = det A det

More information

Asymptotics of minimax stochastic programs

Asymptotics of minimax stochastic programs Asymptotics of minimax stochastic programs Alexander Shapiro Abstract. We discuss in this paper asymptotics of the sample average approximation (SAA) of the optimal value of a minimax stochastic programming

More information

Statistical signal processing

Statistical signal processing Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable

More information

Chapter 1: A Brief Review of Maximum Likelihood, GMM, and Numerical Tools. Joan Llull. Microeconometrics IDEA PhD Program

Chapter 1: A Brief Review of Maximum Likelihood, GMM, and Numerical Tools. Joan Llull. Microeconometrics IDEA PhD Program Chapter 1: A Brief Review of Maximum Likelihood, GMM, and Numerical Tools Joan Llull Microeconometrics IDEA PhD Program Maximum Likelihood Chapter 1. A Brief Review of Maximum Likelihood, GMM, and Numerical

More information

Lecture 11: Eigenvalues and Eigenvectors

Lecture 11: Eigenvalues and Eigenvectors Lecture : Eigenvalues and Eigenvectors De nition.. Let A be a square matrix (or linear transformation). A number λ is called an eigenvalue of A if there exists a non-zero vector u such that A u λ u. ()

More information

Nonparametric density estimation for elliptic problems with random perturbations

Nonparametric density estimation for elliptic problems with random perturbations Nonparametric density estimation for elliptic problems with random perturbations, DqF Workshop, Stockholm, Sweden, 28--2 p. /2 Nonparametric density estimation for elliptic problems with random perturbations

More information

Brandon C. Kelly (Harvard Smithsonian Center for Astrophysics)

Brandon C. Kelly (Harvard Smithsonian Center for Astrophysics) Brandon C. Kelly (Harvard Smithsonian Center for Astrophysics) Probability quantifies randomness and uncertainty How do I estimate the normalization and logarithmic slope of a X ray continuum, assuming

More information

MODELLING OF FLEXIBLE MECHANICAL SYSTEMS THROUGH APPROXIMATED EIGENFUNCTIONS L. Menini A. Tornambe L. Zaccarian Dip. Informatica, Sistemi e Produzione

MODELLING OF FLEXIBLE MECHANICAL SYSTEMS THROUGH APPROXIMATED EIGENFUNCTIONS L. Menini A. Tornambe L. Zaccarian Dip. Informatica, Sistemi e Produzione MODELLING OF FLEXIBLE MECHANICAL SYSTEMS THROUGH APPROXIMATED EIGENFUNCTIONS L. Menini A. Tornambe L. Zaccarian Dip. Informatica, Sistemi e Produzione, Univ. di Roma Tor Vergata, via di Tor Vergata 11,

More information

A general theory of discrete ltering. for LES in complex geometry. By Oleg V. Vasilyev AND Thomas S. Lund

A general theory of discrete ltering. for LES in complex geometry. By Oleg V. Vasilyev AND Thomas S. Lund Center for Turbulence Research Annual Research Briefs 997 67 A general theory of discrete ltering for ES in complex geometry By Oleg V. Vasilyev AND Thomas S. und. Motivation and objectives In large eddy

More information