Stochastic representation of random positive-definite tensor-valued properties: application to 3D anisotropic permeability random fields
|
|
- Martha Fisher
- 5 years ago
- Views:
Transcription
1 Sous la co-tutelle de : LABORATOIRE DE MODÉLISATION ET SIMULATION MULTI ÉCHELLE CNRS UPEC UNIVERSITÉ PARIS-EST CRÉTEIL UPEM UNIVERSITÉ PARIS-EST MARNE-LA-VALLÉE Stochastic representation of random positive-definite tensor-valued properties: application to 3D anisotropic permeability random fields Johann Guilleminot Joint work with Christian Soize and Roger Ghanem Université Paris-Est Modélisation et Simulation Multi Echelle, MSME UMR 8208 CNRS University of Southern California Department of Aerospace and Mechanical Engineering October J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
2 Outline 1 Motivations 2 Algebraic Stochastic Representation 3 Application 4 Revisiting initial theory with SDEs 5 Conclusion J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
3 Motivations Central issue : modeling, generation and calibration of a matrix-valued random field (e.g. a permeability tensor field) - with various interpretations. Classical multiscale framework : HOMOGENIZATION Microscale Macroscale Mesoscale The medium is, hence, described through random fields of apparent properties. J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
4 Motivations Modeling of uncertainties, and identification solving an underdetermined inverse problem : Limited measurements are made on boundaries, and used to calibrate the model at any point. The aim here is to derive models : that are consistent from a mathematical standpoint ; that contain as much physics as possible ; that do not rely on too many parameters. J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
5 Algebraic Stochastic Representation Notation and overview of the construction Let {[A(x)], x Ω} be any M + n (R)-valued random field, indexed by Ω R d. Methodology : construct an information-theoretic stochastic model for the family of first order marginal distributions ; define {[A(x)], x Ω} through a pointwise nonlinear mapping T, acting on some underlying vector-valued Gaussian random field, such that it exhibits the above family of first-order marginal distributions. Relevant issues : how to define the marginal? how to construct mapping T? J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
6 Algebraic Stochastic Representation Reminder on Information Theory Assume that [A(x)] (x fixed) satisfies n c algebraic constraints : E{g i ([A(x)])} = f i (x), 1 i n c Information theory and Maximum entropy principle : with p [A(x)] = arg max S(p) p C ad (x) S(p) = p([a]) ln(p([a]))d[a] M + n (R) MaxEnt estimate for the probability density function : ) n c p [A(x)] ([A]) = 1 M + ([A]) n ( (R) c0 exp < L i(x), g i ([A]) > Hi i=1 J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
7 Algebraic Stochastic Representation Definition of RM : available information Constraints (no dependence on x for notational convenience) : (1) E {[A]} = [A] p [A] ([A]) d[a] = [A] (2) (3) E M + n (R) M + n (R) ln (det ([A])) p [A] ([A]) d[a] = β, β < + { ( ϕ kt [A] ϕ k) } 2 = s 2 kλ 2 k, k {1,..., m} (1) is related to the mean value, (2) to finiteness of second-order moments, and (3) are constraints on the spectrum. Let : [A(x)] = [L(x)][G(x)][L(x)] T with [G(x)] = [H(x)][H(x)] T and [H(x)] a lower triangular random matrix. J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
8 Algebraic Stochastic Representation Definition of RM : joint P.D.F. Assume m = n. For i fixed, r.v. {H il } i l=1 are jointly distributed : where ϕ is defined as : p Hi1,...,H ii (h) = 1 S(h) c 0 h ii n 1 i+2α(x) ϕ(h; µ i(x), τ i(x)) ϕ(h; µ i(x), τ i(x)) := exp µ i(x) Parameter µ i(x) satisfies : x α(x) : level of fluctuations. ( i l=1 h il 2 ) τ i(x) ( i l=1 h il 2 ) 2 R + c 1 g (n+2α(x) 1)/2 exp{ µ i(x)g τ i(x)g 2 } dg = 1 (1) x τ i(x) : variance of λ i (ordered statistics). J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
9 Algebraic Stochastic Representation Non linear mapping How to define mapping T? Rosenblatt transformation. Numerical approximation : KL decomposition (PCA) : Polynomial chaos expansion : N KL H (i) h (i) + λjη jv j N pce j=1 η pce z γ Ψ γ(u (i) ) Computation of the coefficients by the maximum likelihood method (first-order m.p.d.f., joint p.d.f.). γ=1 J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
10 Application Context Darcean flows through random porous media 1 : v = 1 µ [K(x)] p Various fields of applications : Geomechanics : oil industry, etc. Composite manufacturing : resin transfer molding, etc. Let and [K] = [ ( ) h11 0 [H] = h 21 h 22 ] 1. See Guilleminot, J., Soize, C. and Ghanem, R. G., IJNAMG, 36(13), J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
11 Application Influence of parametrization PDF Principal permeability FIGURE 1: Plot of the p.d.f. of λ x (red line) and λ y (blue line), in m 2, for τ x = τ y = 10 2 and α = 20 (dash-dot line), α = 50 (solid line) and α = 80 (dashed line). J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
12 Application Influence of parametrization PDF τ = 1 τ = 10 τ = 10 2 τ = 10 3 τ = 10 4 PDF τ = 1 τ = 10 τ = 10 2 τ = 10 3 τ = Principal permeability λ x Principal permeability λ y FIGURE 2: Plot of the p.d.f. of λ x (left) and λ y (right), for α = 60 and different values of τ x = τ y = τ. J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
13 Application Influence of parametrization PDF Principal permeability PDF Principal permeability FIGURE 3: Plot of the p.d.f. of the first (red dashed line) and second (blue solid line) stochastic principal permeability (in m 2 ). Left : α = 80, τ x = 10 4 and τ y = 1. Right : α = 80, τ x = 1 and τ y = J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
14 Application Defining T with the chaos expansion PDF ρ (1) FIGURE 4: Plot (in semi-log scale) of the p.d.f. of random variable ρ (1) : target (thin solid line) and 10th-order chaos projection (thick solid line). J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
15 Application Defining T with the chaos expansion PDF PDF (1) ρ (2) ρ 2 FIGURE 5: Plot (in semi-log scale) of the p.d.f. p ηj (2). Reference : thin solid line ; Estimation based on chaos expansion (4th-order expansion) : thick solid line. Left : j = 1 ; Right : j = 2. J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
16 Application Example y y x x FIGURE 6: Plot of a realisation of random fields x λ x(x) (left) and x λ y(x) (right). Two important applications : in geomechanics : orientation of cracks ; in composite manufacturing : local architecture of the preform (racetracking channels, etc.). J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
17 Revisiting initial theory with SDEs Revisiting the initial formulation The previous derivations involve PCEs, and require a reference generator to be available : can we circumvent these drawbacks? Let p be the target marginal p.d.f., and let : p(u) := c exp ( Φ(u)), u S R q, (2) with Φ the potential. In our case, for the i-th row (q = i) : Φ(u) = log (1 S(u)) β(x) log (u i) + µ i(x) ( i with β(x) := n 1 i + 2α(x). Two cases of practical interest : unconstrained case, S = R q ; constrained case, S R q (recall that H ii > 0 a.s.). l=1 u l 2 ) + τ i(x) ( i l=1 u l 2 ) 2 J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
18 Revisiting initial theory with SDEs The sampling scheme in a nutshell (S = R q ) Let {W(r, x), r R +, x Ω} be a Gaussian random field, with values in R q, such that : for x fixed in R d, {W(r, x), r R + } is a normalized Wiener process ; for r fixed R +, {W(r, x), x R d } is a colored Gaussian field. Let F be the family of ISDEs, indexed by x, such that : r 0, { du(r, x) = V(r, x) dr dv(r, x) = ( uφ(u(r, x)) η ) 2 V(r, x) dr + η dw(r, x) (3) with given initial conditions. Under some assumptions on Φ : Summary 2 : family of ergodic homogeneous diffusion processes ; law lim U(r, x) = A(x). (4) r + definition of the associated family of invariant measures. 2. See Guilleminot, J., Soize, C., SIAM MULTISCALE MODEL. SIMUL., 11(3), J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
19 Revisiting initial theory with SDEs Tackling the constrained case : S R q 3 Let Ψ be the target potential : Ψ(u) := log(1 S(u)) + Z(u), u S. (5) Step 1 : define the potential Ψ ɛ, 0 < ɛ 1, through Ψ ɛ(u) := log (1 ɛ S(u)) + Z(u), u V S, (6) with 1 ɛ S the regularized indicator function (lim ɛ 0 1 ɛ S = 1 S), S V R q, such that Ψ ɛ satisfies all the assumptions related to the SDE analysis ; lim ɛ 0 Ψ ɛ = Ψ in S. For all x in Ω : Then consider the asymptotic case ɛ 0. law lim Uɛ(r, x) = A r + ɛ(x) (7) 3. See Guilleminot, J., Soize, C., SIAM J. SCI. COMPUT., 36(6), J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
20 Revisiting initial theory with SDEs Step 2 : definition of an adaptive scheme (adapted from Lamberton & Lemaire (2005)) Let (γ k) k 1 be the sequence : γ k := γ 0 k 1/τ, k 1, (8) with γ 0 > 0 and τ N. Let { {χ k x, k 1} } be the family of processes defined x Ω as : χ k x := 2 V(Uk ɛ(x), V k ɛ(x)), k 0, x Ω. (9) b(u k ɛ(x), V k ɛ(x) 2 1 Define the step sequence ( γ k+1) k 0 as : γ k+1 := min x Ω ( γ k+1 χ k x ), k 0, (10) with γ 0 = γ 0. Scheme : X k+1 ɛ (x) = D SV ( X k ɛ(x), W k+1 (x), γ k+1 ), k 0. (11) with X 0 ɛ(x) = x 0 a.s. for all x in Ω (x 0 = (u 0, v 0) S R q ). J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
21 Revisiting initial theory with SDEs The computational cost is essentially governed by : the rate of convergence towards the stationary solution ; the gradient computation ; the sampling algorithm for the underlying Gaussians. Current applications deal with more than 100,000 points (100,000 SDEs are integrated simultaneously). Various techniques were benchmarked for the sampling of Gaussians, such as circular embedding ; direct factorization-based methods (Cholesky) ; Krylov subspace methods ; spectral methods. However, it is still an open issue for large-scale simulations and for arbitrary covariance kernels. J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
22 Revisiting initial theory with SDEs Application 1 Let p be defined as : p(u) := c exp { Ψ(u)}, u S, (12) where Ψ(u) := log (1 S(u)) + 1 [K]u, u, u S, (13) 2 with S := [ 0.5, 0.5] [ 0.5, 0.5] and [K] := diag(1, 1). FIGURE 7: Graph of the indicator function 1 ɛ S for ɛ = 0.04 (left) and ɛ = 0.01 (right). J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
23 Revisiting initial theory with SDEs Sample paths of {(U k 1, U k 2), k k stat} : FIGURE 8: Sample paths for ɛ = 0.04 (left) and ɛ = 0.01 (right). J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
24 Revisiting initial theory with SDEs Application 2 Let the target potential be defined as (nonlinear term) : with Ψ(u) := log (1 S(u)) (λ 1) log (det([mat(u)])) + q 1 + 2λ 2 q u k(k+1)/2, (14) S := { u R n [Mat(u)] M + q (R) }. (15) k=1 Let ρ k be the r.v. with values in R + defined as : ( ) ρ k := min S [Mat(U k )], (16) with S([A]) the spectrum of [A] M S q(r) (q = 2 hereinafter). J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
25 Revisiting initial theory with SDEs FIGURE 9: Sample paths of {ρ k, k k stat} (red circles, left axis) and { γ k, k k stat} (black line, right axis), obtained for ɛ = 0.01, γ 0 = 2 6 and τ = J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
26 Conclusion Concluding comments Construction of random field models that are consistent with mathematics and physics : based on Information Theory ; for Darcean flows through porous media, it allows for the local architecture of the pore space to be accounted for (at least to some extent). Some parts of the model were revisited using a transformation with memory, and involve an adaptive procedure. Numerical investigations on permeability fields are currently under progress. Thank You J. Guilleminot johann.guilleminot@u-pem.fr Workshop MoMas October / 26
Data-driven probability concentration and sampling on manifold
Data-driven probability concentration and sampling on manifold Christian Soize, Roger Ghanem To cite this version: Christian Soize, Roger Ghanem. Data-driven probability concentration and sampling on manifold.
More informationarxiv: v1 [math.pr] 8 Mar 2016
Data-driven probability concentration and sampling on manifold C. Soize,a, R. Ghanem b arxiv:1603.02657v1 [math.pr] 8 Mar 2016 a Université Paris-Est, Laboratoire Modélisation et Simulation Multi-Echelle,
More informationChristian Soize. To cite this version: HAL Id: hal https://hal-upec-upem.archives-ouvertes.fr/hal
Construction of probability distributions in high dimension using the maximum entropy principle: Applications to stochastic processes, random fields and random matrices Christian Soize To cite this version:
More informationA reduced-order stochastic finite element analysis for structures with uncertainties
A reduced-order stochastic finite element analysis for structures with uncertainties Ji Yang 1, Béatrice Faverjon 1,2, Herwig Peters 1, icole Kessissoglou 1 1 School of Mechanical and Manufacturing Engineering,
More informationhal , version 1-26 Aug 2013
Author manuscript, published in "Multiscale Modeling and Simulation (A SIAM Interdisciplinary Journal) 11, 3 (2013) Pages: 840-870" DOI : 10.1137/120898346 STOCHASTIC MODEL AND GENERATOR FOR RANDOM FIELDS
More informationGeneration of response spectrum compatible accelerograms using the maximum entropy principle
Generation of response spectrum compatible accelerograms using the maximum entropy principle Anas Batou, Christian Soize To cite this version: Anas Batou, Christian Soize. Generation of response spectrum
More informationIndependent Component Analysis. Contents
Contents Preface xvii 1 Introduction 1 1.1 Linear representation of multivariate data 1 1.1.1 The general statistical setting 1 1.1.2 Dimension reduction methods 2 1.1.3 Independence as a guiding principle
More informationCharacterization of heterogeneous hydraulic conductivity field via Karhunen-Loève expansions and a measure-theoretic computational method
Characterization of heterogeneous hydraulic conductivity field via Karhunen-Loève expansions and a measure-theoretic computational method Jiachuan He University of Texas at Austin April 15, 2016 Jiachuan
More informationA Stochastic Collocation based. for Data Assimilation
A Stochastic Collocation based Kalman Filter (SCKF) for Data Assimilation Lingzao Zeng and Dongxiao Zhang University of Southern California August 11, 2009 Los Angeles Outline Introduction SCKF Algorithm
More informationUNCERTAINTY ASSESSMENT USING STOCHASTIC REDUCED BASIS METHOD FOR FLOW IN POROUS MEDIA
UNCERTAINTY ASSESSMENT USING STOCHASTIC REDUCED BASIS METHOD FOR FLOW IN POROUS MEDIA A REPORT SUBMITTED TO THE DEPARTMENT OF ENERGY RESOURCES ENGINEERING OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT
More informationRandom Eigenvalue Problems Revisited
Random Eigenvalue Problems Revisited S Adhikari Department of Aerospace Engineering, University of Bristol, Bristol, U.K. Email: S.Adhikari@bristol.ac.uk URL: http://www.aer.bris.ac.uk/contact/academic/adhikari/home.html
More informationMAXIMUM ENTROPY-BASED UNCERTAINTY MODELING AT THE FINITE ELEMENT LEVEL. Pengchao Song and Marc P. Mignolet
MAXIMUM ENTROPY-BASED UNCERTAINTY MODELING AT THE FINITE ELEMENT LEVEL Pengchao Song and Marc P. Mignolet SEMTE, Faculties of Mechanical and Aerospace Engineering, Arizona State University, 51 E. Tyler
More informationCOMPUTATIONAL MULTI-POINT BME AND BME CONFIDENCE SETS
VII. COMPUTATIONAL MULTI-POINT BME AND BME CONFIDENCE SETS Until now we have considered the estimation of the value of a S/TRF at one point at the time, independently of the estimated values at other estimation
More informationCheng Soon Ong & Christian Walder. Canberra February June 2018
Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 2018 Outlines Overview Introduction Linear Algebra Probability Linear Regression
More informationInformation geometry for bivariate distribution control
Information geometry for bivariate distribution control C.T.J.Dodson + Hong Wang Mathematics + Control Systems Centre, University of Manchester Institute of Science and Technology Optimal control of stochastic
More informationLessons in Estimation Theory for Signal Processing, Communications, and Control
Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL
More informationNumerical Methods - Numerical Linear Algebra
Numerical Methods - Numerical Linear Algebra Y. K. Goh Universiti Tunku Abdul Rahman 2013 Y. K. Goh (UTAR) Numerical Methods - Numerical Linear Algebra I 2013 1 / 62 Outline 1 Motivation 2 Solving Linear
More informationPattern Recognition and Machine Learning. Bishop Chapter 6: Kernel Methods
Pattern Recognition and Machine Learning Chapter 6: Kernel Methods Vasil Khalidov Alex Kläser December 13, 2007 Training Data: Keep or Discard? Parametric methods (linear/nonlinear) so far: learn parameter
More informationEstimating functional uncertainty using polynomial chaos and adjoint equations
0. Estimating functional uncertainty using polynomial chaos and adjoint equations February 24, 2011 1 Florida State University, Tallahassee, Florida, Usa 2 Moscow Institute of Physics and Technology, Moscow,
More informationHierarchical Parallel Solution of Stochastic Systems
Hierarchical Parallel Solution of Stochastic Systems Second M.I.T. Conference on Computational Fluid and Solid Mechanics Contents: Simple Model of Stochastic Flow Stochastic Galerkin Scheme Resulting Equations
More informationLinear Regression and Its Applications
Linear Regression and Its Applications Predrag Radivojac October 13, 2014 Given a data set D = {(x i, y i )} n the objective is to learn the relationship between features and the target. We usually start
More informationStatistical Estimation: Data & Non-data Information
Statistical Estimation: Data & Non-data Information Roger J-B Wets University of California, Davis & M.Casey @ Raytheon G.Pflug @ U. Vienna, X. Dong @ EpiRisk, G-M You @ EpiRisk. a little background Decision
More informationNonparametric Drift Estimation for Stochastic Differential Equations
Nonparametric Drift Estimation for Stochastic Differential Equations Gareth Roberts 1 Department of Statistics University of Warwick Brazilian Bayesian meeting, March 2010 Joint work with O. Papaspiliopoulos,
More informationLecture No 1 Introduction to Diffusion equations The heat equat
Lecture No 1 Introduction to Diffusion equations The heat equation Columbia University IAS summer program June, 2009 Outline of the lectures We will discuss some basic models of diffusion equations and
More informationwhere r n = dn+1 x(t)
Random Variables Overview Probability Random variables Transforms of pdfs Moments and cumulants Useful distributions Random vectors Linear transformations of random vectors The multivariate normal distribution
More informationBeyond Wiener Askey Expansions: Handling Arbitrary PDFs
Journal of Scientific Computing, Vol. 27, Nos. 1 3, June 2006 ( 2005) DOI: 10.1007/s10915-005-9038-8 Beyond Wiener Askey Expansions: Handling Arbitrary PDFs Xiaoliang Wan 1 and George Em Karniadakis 1
More informationA Polynomial Chaos Approach to Robust Multiobjective Optimization
A Polynomial Chaos Approach to Robust Multiobjective Optimization Silvia Poles 1, Alberto Lovison 2 1 EnginSoft S.p.A., Optimization Consulting Via Giambellino, 7 35129 Padova, Italy s.poles@enginsoft.it
More informationRandom Matrix Eigenvalue Problems in Probabilistic Structural Mechanics
Random Matrix Eigenvalue Problems in Probabilistic Structural Mechanics S Adhikari Department of Aerospace Engineering, University of Bristol, Bristol, U.K. URL: http://www.aer.bris.ac.uk/contact/academic/adhikari/home.html
More informationOn prediction and density estimation Peter McCullagh University of Chicago December 2004
On prediction and density estimation Peter McCullagh University of Chicago December 2004 Summary Having observed the initial segment of a random sequence, subsequent values may be predicted by calculating
More informationSENSITIVITY ANALYSIS IN NUMERICAL SIMULATION OF MULTIPHASE FLOW FOR CO 2 STORAGE IN SALINE AQUIFERS USING THE PROBABILISTIC COLLOCATION APPROACH
XIX International Conference on Water Resources CMWR 2012 University of Illinois at Urbana-Champaign June 17-22,2012 SENSITIVITY ANALYSIS IN NUMERICAL SIMULATION OF MULTIPHASE FLOW FOR CO 2 STORAGE IN
More informationPreliminary/Qualifying Exam in Numerical Analysis (Math 502a) Spring 2012
Instructions Preliminary/Qualifying Exam in Numerical Analysis (Math 502a) Spring 2012 The exam consists of four problems, each having multiple parts. You should attempt to solve all four problems. 1.
More informationCM3. Probabilistic model for MEMS microbeam resonance frequency. Computational & Multiscale Mechanics of Materials
Computational & Multiscale Mechanics of Materials CM3 www.ltas-cm3.ulg.ac.be Probabilistic model for MEMS microbeam resonance frequency Lucas Vincent Wu Ling Arnst Maarten Golinval Jean-Claude Paquay Stéphane
More informationSoil Uncertainty and Seismic Ground Motion
Boris Jeremić and Kallol Sett Department of Civil and Environmental Engineering University of California, Davis GEESD IV May 2008 Support by NSF CMMI 0600766 Outline Motivation Soils and Uncertainty Stochastic
More informationA Probability Review
A Probability Review Outline: A probability review Shorthand notation: RV stands for random variable EE 527, Detection and Estimation Theory, # 0b 1 A Probability Review Reading: Go over handouts 2 5 in
More informationEfficient Monte Carlo computation of Fisher information matrix using prior information
Efficient Monte Carlo computation of Fisher information matrix using prior information Sonjoy Das, UB James C. Spall, APL/JHU Roger Ghanem, USC SIAM Conference on Data Mining Anaheim, California, USA April
More informationBasic Principles of Weak Galerkin Finite Element Methods for PDEs
Basic Principles of Weak Galerkin Finite Element Methods for PDEs Junping Wang Computational Mathematics Division of Mathematical Sciences National Science Foundation Arlington, VA 22230 Polytopal Element
More informationMultiple Random Variables
Multiple Random Variables This Version: July 30, 2015 Multiple Random Variables 2 Now we consider models with more than one r.v. These are called multivariate models For instance: height and weight An
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationNonparametric Identification of a Binary Random Factor in Cross Section Data - Supplemental Appendix
Nonparametric Identification of a Binary Random Factor in Cross Section Data - Supplemental Appendix Yingying Dong and Arthur Lewbel California State University Fullerton and Boston College July 2010 Abstract
More informationFactor Analysis (10/2/13)
STA561: Probabilistic machine learning Factor Analysis (10/2/13) Lecturer: Barbara Engelhardt Scribes: Li Zhu, Fan Li, Ni Guan Factor Analysis Factor analysis is related to the mixture models we have studied.
More informationLAN property for sde s with additive fractional noise and continuous time observation
LAN property for sde s with additive fractional noise and continuous time observation Eulalia Nualart (Universitat Pompeu Fabra, Barcelona) joint work with Samy Tindel (Purdue University) Vlad s 6th birthday,
More informationDimension Reduction and Low-dimensional Embedding
Dimension Reduction and Low-dimensional Embedding Ying Wu Electrical Engineering and Computer Science Northwestern University Evanston, IL 60208 http://www.eecs.northwestern.edu/~yingwu 1/26 Dimension
More informationSolving the steady state diffusion equation with uncertainty Final Presentation
Solving the steady state diffusion equation with uncertainty Final Presentation Virginia Forstall vhfors@gmail.com Advisor: Howard Elman elman@cs.umd.edu Department of Computer Science May 6, 2012 Problem
More informationStatistical Signal Processing Detection, Estimation, and Time Series Analysis
Statistical Signal Processing Detection, Estimation, and Time Series Analysis Louis L. Scharf University of Colorado at Boulder with Cedric Demeure collaborating on Chapters 10 and 11 A TT ADDISON-WESLEY
More informationA stochastic 3-scale method to predict the thermo-elastic behaviors of polycrystalline structures
Computational & Multiscale Mechanics of Materials CM3 www.ltas-cm3.ulg.ac.be A stochastic 3-scale method to predict the thermo-elastic behaviors of polycrystalline structures Wu Ling, Lucas Vincent, Golinval
More informationCheng Soon Ong & Christian Walder. Canberra February June 2018
Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 2018 Outlines Overview Introduction Linear Algebra Probability Linear Regression
More informationEigenvalues and Singular Values of Random Matrices: A Tutorial Introduction
Random Matrix Theory and its applications to Statistics and Wireless Communications Eigenvalues and Singular Values of Random Matrices: A Tutorial Introduction Sergio Verdú Princeton University National
More informationInformation Theory. Lecture 5 Entropy rate and Markov sources STEFAN HÖST
Information Theory Lecture 5 Entropy rate and Markov sources STEFAN HÖST Universal Source Coding Huffman coding is optimal, what is the problem? In the previous coding schemes (Huffman and Shannon-Fano)it
More informationCS8803: Statistical Techniques in Robotics Byron Boots. Hilbert Space Embeddings
CS8803: Statistical Techniques in Robotics Byron Boots Hilbert Space Embeddings 1 Motivation CS8803: STR Hilbert Space Embeddings 2 Overview Multinomial Distributions Marginal, Joint, Conditional Sum,
More informationLecture 5: Linear models for classification. Logistic regression. Gradient Descent. Second-order methods.
Lecture 5: Linear models for classification. Logistic regression. Gradient Descent. Second-order methods. Linear models for classification Logistic regression Gradient descent and second-order methods
More informationReactive Transport in Porous Media
Reactive Transport in Porous Media Daniel M. Tartakovsky Department of Mechanical & Aerospace Engineering University of California, San Diego Alberto Guadagnini, Politecnico di Milano, Italy Peter C. Lichtner,
More informationFundamentals of Unconstrained Optimization
dalmau@cimat.mx Centro de Investigación en Matemáticas CIMAT A.C. Mexico Enero 2016 Outline Introduction 1 Introduction 2 3 4 Optimization Problem min f (x) x Ω where f (x) is a real-valued function The
More informationModel reduction of Multiscale Models using Kernel Methods
Model reduction of Multiscale Models using Kernel Methods at the WORM 213 Haus der Kirche, Bad Herrenalb Daniel Wirtz August 23, 213 Dipl. Math. Dipl. Inf. Daniel Wirtz, IANS, University of Stuttgart daniel.wirtz@mathematik.uni-stuttgart.de
More informationPerformance Evaluation of Generalized Polynomial Chaos
Performance Evaluation of Generalized Polynomial Chaos Dongbin Xiu, Didier Lucor, C.-H. Su, and George Em Karniadakis 1 Division of Applied Mathematics, Brown University, Providence, RI 02912, USA, gk@dam.brown.edu
More informationCOMS 4721: Machine Learning for Data Science Lecture 19, 4/6/2017
COMS 4721: Machine Learning for Data Science Lecture 19, 4/6/2017 Prof. John Paisley Department of Electrical Engineering & Data Science Institute Columbia University PRINCIPAL COMPONENT ANALYSIS DIMENSIONALITY
More informationPC EXPANSION FOR GLOBAL SENSITIVITY ANALYSIS OF NON-SMOOTH FUNCTIONALS OF UNCERTAIN STOCHASTIC DIFFERENTIAL EQUATIONS SOLUTIONS
PC EXPANSION FOR GLOBAL SENSITIVITY ANALYSIS OF NON-SMOOTH FUNCTIONALS OF UNCERTAIN STOCHASTIC DIFFERENTIAL EQUATIONS SOLUTIONS M. Navarro, O.P. Le Maître,2, O.M. Knio,3 mariaisabel.navarrojimenez@kaust.edu.sa
More informationIf we want to analyze experimental or simulated data we might encounter the following tasks:
Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction
More informationStrong approximation for additive functionals of geometrically ergodic Markov chains
Strong approximation for additive functionals of geometrically ergodic Markov chains Florence Merlevède Joint work with E. Rio Université Paris-Est-Marne-La-Vallée (UPEM) Cincinnati Symposium on Probability
More informationLecture 5: GPs and Streaming regression
Lecture 5: GPs and Streaming regression Gaussian Processes Information gain Confidence intervals COMP-652 and ECSE-608, Lecture 5 - September 19, 2017 1 Recall: Non-parametric regression Input space X
More informationSobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis
Sobol-Hoeffding decomposition Application to Global SA Computation of the SI Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis Olivier Le Maître with Colleague & Friend Omar
More informationMIMO Capacities : Eigenvalue Computation through Representation Theory
MIMO Capacities : Eigenvalue Computation through Representation Theory Jayanta Kumar Pal, Donald Richards SAMSI Multivariate distributions working group Outline 1 Introduction 2 MIMO working model 3 Eigenvalue
More informationMaximum variance formulation
12.1. Principal Component Analysis 561 Figure 12.2 Principal component analysis seeks a space of lower dimensionality, known as the principal subspace and denoted by the magenta line, such that the orthogonal
More informationNONLINEAR CLASSIFICATION AND REGRESSION. J. Elder CSE 4404/5327 Introduction to Machine Learning and Pattern Recognition
NONLINEAR CLASSIFICATION AND REGRESSION Nonlinear Classification and Regression: Outline 2 Multi-Layer Perceptrons The Back-Propagation Learning Algorithm Generalized Linear Models Radial Basis Function
More informationPREDICTION AND NONGAUSSIAN AUTOREGRESSIVE STATIONARY SEQUENCES 1. Murray Rosenblatt University of California, San Diego
PREDICTION AND NONGAUSSIAN AUTOREGRESSIVE STATIONARY SEQUENCES 1 Murray Rosenblatt University of California, San Diego Abstract The object of this paper is to show that under certain auxiliary assumptions
More informationCollocation based high dimensional model representation for stochastic partial differential equations
Collocation based high dimensional model representation for stochastic partial differential equations S Adhikari 1 1 Swansea University, UK ECCM 2010: IV European Conference on Computational Mechanics,
More informationStochastic Dimension Reduction
Stochastic Dimension Reduction Roger Ghanem University of Southern California Los Angeles, CA, USA Computational and Theoretical Challenges in Interdisciplinary Predictive Modeling Over Random Fields 12th
More informationEE613 Machine Learning for Engineers. Kernel methods Support Vector Machines. jean-marc odobez 2015
EE613 Machine Learning for Engineers Kernel methods Support Vector Machines jean-marc odobez 2015 overview Kernel methods introductions and main elements defining kernels Kernelization of k-nn, K-Means,
More information1 Data Arrays and Decompositions
1 Data Arrays and Decompositions 1.1 Variance Matrices and Eigenstructure Consider a p p positive definite and symmetric matrix V - a model parameter or a sample variance matrix. The eigenstructure is
More informationADAPTIVE FILTER THEORY
ADAPTIVE FILTER THEORY Fifth Edition Simon Haykin Communications Research Laboratory McMaster University Hamilton, Ontario, Canada International Edition contributions by Telagarapu Prabhakar Department
More informationNonlinear Filtering. With Polynomial Chaos. Raktim Bhattacharya. Aerospace Engineering, Texas A&M University uq.tamu.edu
Nonlinear Filtering With Polynomial Chaos Raktim Bhattacharya Aerospace Engineering, Texas A&M University uq.tamu.edu Nonlinear Filtering with PC Problem Setup. Dynamics: ẋ = f(x, ) Sensor Model: ỹ = h(x)
More informationExercises Chapter 4 Statistical Hypothesis Testing
Exercises Chapter 4 Statistical Hypothesis Testing Advanced Econometrics - HEC Lausanne Christophe Hurlin University of Orléans December 5, 013 Christophe Hurlin (University of Orléans) Advanced Econometrics
More informationCheng Soon Ong & Christian Walder. Canberra February June 2018
Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 2018 (Many figures from C. M. Bishop, "Pattern Recognition and ") 1of 254 Part V
More informationECE 636: Systems identification
ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental
More informationStatistical signal processing
Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable
More informationCopula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011
Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011 Outline Ordinary Least Squares (OLS) Regression Generalized Linear Models
More informationconditional cdf, conditional pdf, total probability theorem?
6 Multiple Random Variables 6.0 INTRODUCTION scalar vs. random variable cdf, pdf transformation of a random variable conditional cdf, conditional pdf, total probability theorem expectation of a random
More informationProf. Dr.-Ing. Armin Dekorsy Department of Communications Engineering. Stochastic Processes and Linear Algebra Recap Slides
Prof. Dr.-Ing. Armin Dekorsy Department of Communications Engineering Stochastic Processes and Linear Algebra Recap Slides Stochastic processes and variables XX tt 0 = XX xx nn (tt) xx 2 (tt) XX tt XX
More informationIntroduction to Computational Stochastic Differential Equations
Introduction to Computational Stochastic Differential Equations Gabriel J. Lord Catherine E. Powell Tony Shardlow Preface Techniques for solving many of the differential equations traditionally used by
More informationModel Specification Testing in Nonparametric and Semiparametric Time Series Econometrics. Jiti Gao
Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics Jiti Gao Department of Statistics School of Mathematics and Statistics The University of Western Australia Crawley
More informationFully Bayesian Deep Gaussian Processes for Uncertainty Quantification
Fully Bayesian Deep Gaussian Processes for Uncertainty Quantification N. Zabaras 1 S. Atkinson 1 Center for Informatics and Computational Science Department of Aerospace and Mechanical Engineering University
More informationConvex discretization of functionals involving the Monge-Ampère operator
Convex discretization of functionals involving the Monge-Ampère operator Quentin Mérigot CNRS / Université Paris-Dauphine Joint work with J.D. Benamou, G. Carlier and É. Oudet GeMeCod Conference October
More informationGaussian processes for inference in stochastic differential equations
Gaussian processes for inference in stochastic differential equations Manfred Opper, AI group, TU Berlin November 6, 2017 Manfred Opper, AI group, TU Berlin (TU Berlin) inference in SDE November 6, 2017
More informationHandbook of Stochastic Methods
C. W. Gardiner Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences Third Edition With 30 Figures Springer Contents 1. A Historical Introduction 1 1.1 Motivation I 1.2 Some Historical
More informationStochastic Elastic-Plastic Finite Element Method for Performance Risk Simulations
Stochastic Elastic-Plastic Finite Element Method for Performance Risk Simulations Boris Jeremić 1 Kallol Sett 2 1 University of California, Davis 2 University of Akron, Ohio ICASP Zürich, Switzerland August
More informationJuly 31, 2009 / Ben Kedem Symposium
ing The s ing The Department of Statistics North Carolina State University July 31, 2009 / Ben Kedem Symposium Outline ing The s 1 2 s 3 4 5 Ben Kedem ing The s Ben has made many contributions to time
More informationStochastic Solvers for the Euler Equations
43rd AIAA Aerospace Sciences Meeting and Exhibit 1-13 January 5, Reno, Nevada 5-873 Stochastic Solvers for the Euler Equations G. Lin, C.-H. Su and G.E. Karniadakis Division of Applied Mathematics Brown
More informationA Thermo-Hydro-Mechanical Damage Model for Unsaturated Geomaterials
A Thermo-Hydro-Mechanical Damage Model for Unsaturated Geomaterials Chloé Arson ALERT PhD Prize PhD Advisor : Behrouz Gatmiri Paris-Est University, U.R. Navier, geotechnical group (CERMES) This research
More informationECE 4400:693 - Information Theory
ECE 4400:693 - Information Theory Dr. Nghi Tran Lecture 8: Differential Entropy Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Lecture 1 / 43 Outline 1 Review: Entropy of discrete RVs 2 Differential
More informationStabilization and Acceleration of Algebraic Multigrid Method
Stabilization and Acceleration of Algebraic Multigrid Method Recursive Projection Algorithm A. Jemcov J.P. Maruszewski Fluent Inc. October 24, 2006 Outline 1 Need for Algorithm Stabilization and Acceleration
More informationEXAM IN STATISTICAL MACHINE LEARNING STATISTISK MASKININLÄRNING
EXAM IN STATISTICAL MACHINE LEARNING STATISTISK MASKININLÄRNING DATE AND TIME: June 9, 2018, 09.00 14.00 RESPONSIBLE TEACHER: Andreas Svensson NUMBER OF PROBLEMS: 5 AIDING MATERIAL: Calculator, mathematical
More informationA Spectral Approach to Linear Bayesian Updating
A Spectral Approach to Linear Bayesian Updating Oliver Pajonk 1,2, Bojana V. Rosic 1, Alexander Litvinenko 1, and Hermann G. Matthies 1 1 Institute of Scientific Computing, TU Braunschweig, Germany 2 SPT
More informationCOMS 4721: Machine Learning for Data Science Lecture 10, 2/21/2017
COMS 4721: Machine Learning for Data Science Lecture 10, 2/21/2017 Prof. John Paisley Department of Electrical Engineering & Data Science Institute Columbia University FEATURE EXPANSIONS FEATURE EXPANSIONS
More informationError Budgets: A Path from Uncertainty Quantification to Model Validation
Error Budgets: A Path from Uncertainty Quantification to Model Validation Roger Ghanem Aerospace and Mechanical Engineering Civil Engineering University of Southern California Los Angeles Advanced Simulation
More informationcomponent risk analysis
273: Urban Systems Modeling Lec. 3 component risk analysis instructor: Matteo Pozzi 273: Urban Systems Modeling Lec. 3 component reliability outline risk analysis for components uncertain demand and uncertain
More informationELEMENTS OF PROBABILITY THEORY
ELEMENTS OF PROBABILITY THEORY Elements of Probability Theory A collection of subsets of a set Ω is called a σ algebra if it contains Ω and is closed under the operations of taking complements and countable
More informationMath Exam 2, October 14, 2008
Math 96 - Exam 2, October 4, 28 Name: Problem (5 points Find all solutions to the following system of linear equations, check your work: x + x 2 x 3 2x 2 2x 3 2 x x 2 + x 3 2 Solution Let s perform Gaussian
More informationEstimation, Detection, and Identification CMU 18752
Estimation, Detection, and Identification CMU 18752 Graduate Course on the CMU/Portugal ECE PhD Program Spring 2008/2009 Instructor: Prof. Paulo Jorge Oliveira pjcro @ isr.ist.utl.pt Phone: +351 21 8418053
More informationVector Spaces ปร ภ ม เวกเตอร
Vector Spaces ปร ภ ม เวกเตอร 1 5.1 Real Vector Spaces ปร ภ ม เวกเตอร ของจ านวนจร ง Vector Space Axioms (1/2) Let V be an arbitrary nonempty set of objects on which two operations are defined, addition
More informationGatsby Theoretical Neuroscience Lectures: Non-Gaussian statistics and natural images Parts I-II
Gatsby Theoretical Neuroscience Lectures: Non-Gaussian statistics and natural images Parts I-II Gatsby Unit University College London 27 Feb 2017 Outline Part I: Theory of ICA Definition and difference
More informationStochastic Spectral Approaches to Bayesian Inference
Stochastic Spectral Approaches to Bayesian Inference Prof. Nathan L. Gibson Department of Mathematics Applied Mathematics and Computation Seminar March 4, 2011 Prof. Gibson (OSU) Spectral Approaches to
More information