WATER RESOURCES RESEARCH, VOL. 49, , doi: /wrcr.20454, 2013

Size: px
Start display at page:

Download "WATER RESOURCES RESEARCH, VOL. 49, , doi: /wrcr.20454, 2013"

Transcription

1 WATER RESOURCES RESEARCH, VOL. 49, , doi: /wrcr.20454, 2013 A computational method for simulating subsurface flow and reactive transport in heterogeneous porous media embedded with flexible uncertainty quantification X. Chen, 1 B. M. Ng, 2 Y. Sun, 3 and C. H. Tong 1 Received 1 October 2012; revised 15 July 2013; accepted 31 July 2013; published 13 September [1] In Chen et al. (2013), the fundamental concepts of the modular UQ methodology have been introduced for general multiphysics applications in which each physics module can be independently embedded with its internal UQ method (intrusive or nonintrusive) without losing the global uncertainty propagation property. In the current paper, we extend the modular UQ methodology to subsurface flow and reactive transport applications, which are characterized by high dimensionality in the stochastic space due to spatially random velocity field in randomly heterogeneous porous media. Specifically, we develop a scheme to reduce the dimension of the stochastic space. This is achieved via a doubly nested dimension reduction by applying Karhunen-Loève expansion to the logarithmic hydraulic conductivity field, followed by Proper Orthogonal Decomposition to the velocity field. This scheme enables the modular UQ framework to handle spatially random models efficiently while maintaining solution accuracy. When compared against sampling-based nonintrusive UQ methods, the modular UQ method demonstrates a similar accuracy at a fraction of computational cost on designed numerical experiments. Citation: Chen, X., B. M. Ng, Y. Sun, and C. H. Tong (2013), A computational method for simulating subsurface flow and reactive transport in heterogeneous porous media embedded with flexible uncertainty quantification, Water Resour. Res., 49, , doi: /wrcr Center for Applied Scientific Computing, Lawrence Livermore National Laboratory, Livermore, California, USA. 2 Computational Engineering Division, Lawrence Livermore National Laboratory, Livermore, California, USA. 3 Atmospheric, Earth and Energy Division, Lawrence Livermore National Laboratory, Livermore, California, USA. Corresponding author: X. Chen, Center for Applied Scientific Computing, Lawrence Livermore National Laboratory, 7000 East Ave., Livermore, CA 94550, USA. (chen73llnl.gov) American Geophysical Union. All Rights Reserved /13/ /wrcr Introduction [2] Stochastic simulation is an important research topic in the modeling of subsurface (unsaturated and saturated) flow and transport due to the various sources of uncertainties [Dagan, 1989; Tartakovsky, 2012; Lin et al., 2010; Lu et al., 2012] inherent in the mathematical models, especially those related to spatially and temporally distributed model parameters. In particular, effective and efficient uncertainty quantification methods (UQ) are needed to properly characterize and quantify uncertainties for complex subsurface transport models involving multiphase, multicomponent, and multiscale features. [3] In Chen et al. [2013], a modular UQ methodology was proposed for the uncertainty and sensitivity analysis of multiphysics systems and was demonstrated on applications pertaining to reactive transport in an isotropic and homogeneous medium with constant flow. A unique feature of the modular UQ method is that it supports the use of different UQ methods, intrusive or nonintrusive (to be defined later), on different physics modules of a multiphysics system with minimal intermodule interference; that is, each stochastic module needs only to handle the propagation of its own internal uncertain parameters, regardless of whether there are any other uncertain parameters in other modules. This modular software engineering strategy has already been adopted as common practice in many deterministic simulation model development efforts [Clark and Baldwin, 2000]. The modular UQ methodology presented in Chen et al. [2013] extends this plug-and-play concept to stochastic simulation models via a computational framework that facilitates the propagation of global uncertainty and sensitivity through all physics modules. The objective of this paper is to generalize the modular UQ methodology to reactive transport applications involving spatially random velocity fields with realistic correlation lengths (that are much smaller than the size of the computational domain). [4] To do so, we need another specialized module whose solver is equipped to handle uncertainty propagation for spatially distributed random parameters. The difficulty with such spatial randomness stems from the high dimensionality of the stochastic space, which is proportional to the number of grid points in the computational mesh. To reduce the stochastic dimension, the Karhunen-Loève expansion (KLE) [Karhunen, 1947; Kac and Siegert, 1947], also known as biorthogonal decomposition (BOD) or proper orthogonal decomposition (POD) or principal components analysis (PCA) [Pearson, 1901; Hotelling, 1933], has been widely applied to problems involving 5740

2 spatial heterogeneity, and is becoming more prevalent in environmental applications. These KLE-based approaches provide a mathematical procedure that transforms a number of possibly correlated variables into a smaller number of uncorrelated variables called principal components or modes. For example, Chanem and Dham [1998] combined the KLE of random permeability field with orthogonal polynomials, and applied the result to a two-dimensional (2-D) multiphase flow problem. Zhang and Lu [2004] proposed a moment-equation-based KLE approach called KLME for solving a 2-D flow problem. Li and Zhang [2007] applied the KLME technique to solve a 2-D stochastic solute transport problem. Chen et al. [2011a, 2011b] applied the PODbased approaches to solve reduced-order data assimilation problems for shallow-water equations model. [5] In this work, we combine KLE-based approaches with our hybrid (modular) UQ framework to study a 2-D flow problem coupled with contaminant transport and reactions in heterogeneous media. In particular, the stochastic system comprises three modules: flow, transport, and reaction. To showcase the use of hybrid UQ methods in the modular UQ framework, we first use a polynomial-chaosbased nonintrusive method by a least squares fit [Knio and Le Ma^ıtre, 2010] in the flow module to compute the stochastic hydraulic head to derive the stochastic velocity field. This stochastic velocity field is then used by the stochastic transport module, which solves for the species concentrations with a polynomial-chaos-based intrusive method. Finally, the stochastic reaction module (stochastic because of uncertain reaction rates), which simulates sequential chain reactions in absence of transport, uses a sampling-based nonintrusive method to propagate uncertainties. A benefit of the modular UQ methodology is that these three modules can be developed independent of one another using different UQ methods, and then be seamlessly glued together via a generic UQ framework to solve a transient multispecies reactive transport system. Subsequent changes to any module (for example, the reaction module) do not affect the implementations and operations of the other modules. [6] The challenge to the applicability of the modular UQ framework to reactive transport in heterogeneous media is the high-dimensional stochastic space introduced by the presence of spatial randomness with large variance, which is specific to the user-defined physics and has not been studied in the previous modular UQ framework [Chen et al., 2013]. In this paper, we expand the framework to handle this scenario by incorporating a new KLE capability that allows uncertainties from the flow module to be propagated to the transport module. However, a straightforward application of the KLE method to the random hydraulic head does not preserve the orthogonality of the corresponding velocity field, which presents a computational bottleneck. To circumvent the problem, we develop a doubly nested dimension reduction scheme based on KLE and POD within the modular UQ framework to ensure that the velocity field is optimally represented in a low-dimensional manner. [7] The outline of this paper is as follows: in section 2, we present the governing equations for deterministic groundwater flow, transport, and reactions in heterogeneous porous media. In section 3, we provide a brief review of intrusive, nonintrusive, and hybrid UQ methods. In section 4, we describe the steps to solve the subsequent stochastic two-dimensional flow system in randomly heterogeneous porous media. In section 5, we present the steps to solve a stochastic multispecies reactive transport system, using a polynomial chaos method for transport and a nonintrusive sampling method for reactions, followed by discussions about the application and implementation aspects of modular UQ framework. We report the results of numerical experiments in section 6. Finally, we conclude with summary and future work in section Governing Equations [8] In this section, we present the governing equations for deterministic groundwater flow, transport, and reactions in a heterogeneous porous medium. We defer the discussion of uncertainty and sensitivity propagation between these three (flow, transport, and reaction) modules to sections 4 and Two-Dimensional Flow in Heterogeneous Porous Media [9] Let be a heterogeneous two-dimensional domain and x ¼ ðx; yþ 2. We consider a steady state flow in a saturated medium satisfying the following continuity equation: x KðxÞh ðþ x þ x y KðÞh x ðþ x ¼ 0 y where h(x) is the hydraulic head, and K(x) is the hydraulic conductivity. We impose a no-flow condition and constant heads on the boundary Two-Dimensional Transport Coupled With First-Order Reactions [10] The study of sequential multistep reactions is central to the understanding of various biodegradation processes subsurface [Clement et al., 1998; Sun et al., 1998]. For example, the reductive anaerobic degradation of trichloroethylene (TCE) to dichloroethylene (DCE), then to vinyl chloride (VC), and eventually to ethylene (ETH), may be modeled using a sequential first-order degradation kinetic model [Sun et al., 2004]. The ability to quantify uncertainties in sequential multistep reaction models has the potential to facilitate the assessment and control of various biochemical processes impacting the environment. [11] The reductive anaerobic degradation falls under the general category of multispecies reactive transport in heterogeneous porous media that can be described by the following system of equations: c i t ¼ F i½c i ðþ x Š ¼ 1 c R i x Dx iðþ x x þ 1 c R i y Dy iðþ x 1 ðv x c i Þ 1 ðv y c i Þ y R i x R i y þ R i 1 k i 1 c i 1 k i c i ; 8i ¼ 1; 2;...; n R i where c i ½ML 3 Š is the concentration of the ith species; t [T] is time; v x and v y ½LT 1 Š are the velocity components for x and y direction; D x and D y [L 2 T 1 ] are the dispersion ð1þ ð2þ 5741

3 coefficients in x and y direction. The dispersion coefficient can be prescribed as a linear function of the dispersivity ½LŠ, i.e., D x ¼ x v x and D y ¼ y v x [Scheidegger, 1961]. For each species i, k i [T 1 ] is the first-order reaction rate, and R i is the retardation factor with R 0 ¼ 0. Let n be the number of species and c ¼ ðc 1 ;...; c n Þ T, then the system of multispecies equations can be rewritten as: ½cx ðþš ¼ Fcx ½ ðþšþacx ½ ðþš ð3þ t where F½cðÞŠ¼ x ðf 1 ½c 1 ðþ x Š;...; F n ½c n ðþ x ŠÞ T. The structure of the matrix A depends on the nature of the reaction network [Sun et al., 2012]. [12] In this paper, we apply equation (3) to model the sequential first-order network representing the biodegradation from TCE to ETH: l 1 l 2 l 3 l 4 TCE! DCE!k2 VC!k3 ETH!k4 k1 [13] In this case, l i is the yield coefficient of the ith reaction, with l i ¼ 1 for unimolecular reactions. The reaction matrix A for this network has the following form: ð4þ 0 1 k R 1 l 1 k 1 k R 2 A ¼ R 2 0 l 2 k 2 k 3 0 : ð5þ B R 3 C R 3 A 0 0 l 3 k 3 k 4 R 4 [14] To solve equation (3), one popular solution approach is to use operator splitting, namely, split the solution process into two stages to mimic the equation structure that consists of independent transport and reaction terms. At each time step, the transport equation is solved for the species concentration, followed by the solution of the reaction equation. In the special case of sequential networks with first-order reactions, the reaction equation has an analytical solution [Sun et al., 2012]. [15] Using operator splitting of equation (3), the (vectorized) transport equation becomes: 1 ctþ 2 t ¼ 1 R i x 1 D x ctþ 2 1 D y ctþ 2 þ 1 x R i y y 1 v x c tþ1 2 1 v y c tþ1 2 R i x R i y which consists of four independent equations, one per species. Then, we apply c tþ1=2 (i.e., the solution to equation (6)) as initial conditions to the (vectorized) reaction equation: c tþ1 t ¼ Ac tþ1 which is solved analytically [Sun et al., 2012]. ð6þ ð7þ 3. Uncertainty Quantification Methods [16] In this section, we give a brief review of intrusive and nonintrusive UQ methods, then, describe related works in hybrid UQ methods. We contrast these methods against the modular UQ methodology, and present the mathematical framework of the methodology Intrusive UQ Methods [17] A popular intrusive method is the stochastic Galerkin method using polynomial chaos expansions (PCE) [Ghanem and Spanos, 1991a, 1991b]. Intuitively, PCE formulations involve the expansion of random quantities (e.g., a random variable, vector, or field) in terms of orthogonal polynomials corresponding to the random quantities probability distributions. PCE provides a convenient representation because uncertainty and sensitivity information can be efficiently computed at low computational expense assuming adequate smoothness of the given random quantity. [18] Formally, consider a probability space (,, P) where is the sample space, is a -algebra on (nonempty collection of subsets of that is closed under complementation and countable unions of its members), and P is a probability measure (mapping to [0,1]). Let X be a real-valued random variable defined on (,, P): X :7!R and let L 2 ð; PÞ be the set of second-order random varia- bles such that, for 8X 2 L 2 ð; PÞ, we have E jx j 2 < 1 where EX ½ Š ¼ R X ðþdp ðþ. L 2ð; PÞ forms a Hilbert space with respect to the inner product: Z Z Z hx; Yi ¼EXY ½ Š ¼ XðÞY ðþdp ðþ¼ XYPðX ; YÞdX dy R R ð9þ where P(X, Y) is the joint probability rffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi density function of X and Y. The associated norm of X is E jx j 2. [19] The basic concept in representing uncertainty using polynomial chaos is that one can express a second-order random variable X involving m random variables 1 ;...; m as a sum of orthogonal polynomials: X ¼ X 0 þ Xm j1¼1 X m X j1 1 j1 ðþ þ X j1 j1¼1 j2¼1 ð8þ X j1;j2 2 j1 ðþ; j2 ðþ þ ð10þ where k j1 ;...; jk are polynomial chaoses of order p in the variables j1 ;...; jk with the polynomial type and domain depending on the distributions imposed on the m- dimensional random variables ¼ f 1 ;...; m g. For example, in the flow and reactive transport equations (1) and (2), X can represent the physical random parameters, which in our case, would be fk; v x ; v y ; x ; k 1 ; k 2 ; k 3 ; k 4 g. These parameters are approximated by a polynomial chaos expansion using the generic random variables with known distribution P() in the L 2 ð; PÞ Hilbert space. Alternatively, the random variable X can also be used to represent the stochastic solution of equation (1) or (2). 5742

4 [20] To simplify notation, the multidimensional expansion in equation (10) is usually mapped term-by-term to a single-index form given by: ^X ¼ XQ j¼0 X j jðþ ð11þ where jðnþ s are the same polynomial chaoses in singleindex form and (Q þ 1) is the total number of terms in the expansion using polynomial order p: Q þ 1 ¼ ðp þ mþ! : ð12þ p!m! [21] The polynomial chaoses are mutually orthogonal with respect to the inner product associated with the space spanned by the random variables. In particular, when a uniform distribution is assumed for the m random variables, the associated orthogonal polynomials are the Legendre polynomials. Using PCE, it is straightforward to verify that the approximate mean of X (using Q þ 1 terms) is X 0 and the approximate variance is: Z 1 1 " X # Q 2 X j jðþ x n 0 0ðÞ n d ¼ XQ j¼0 j¼1 h i Xj 2 h 2 j i : ð13þ [22] In general, when the input-output mapping is sufficiently smooth, intrusive methods have the potential to be more computationally efficient than nonintrusive methods [Li and Xiu, 2009; Elman et al., 2011]. However, this is at the expense of higher development effort, since implementation would require major modifications to existing deterministic codes. This overhead might be too cumbersome or time consuming for complex multiphysics and multiscale computer codes. As a result, intrusive methods have not been as widely adopted as nonintrusive methods Nonintrusive UQ Methods [23] Nonintrusive methods consist of generating samples of random variables based on their distributions via a fixed sampling scheme. Different sampling schemes generate samples with different space coverage properties. The samples are then propagated through the model by running the model repeatedly with the sample inputs. The outputs of interest are collected and the desired statistics, such as mean and standard deviation, are computed. Again, let m be the number of random variables; Pð 1 ; 2 ;...; m Þ be the corresponding joint probability distribution function; S 2 R Nm be the set of N samples drawn from this distribution, where each row of S is a single sample of the input m dimensional random variables; and Y 2 R N be the (univariate) outputs corresponding to the N input samples. The sample approximations of the mean and standard deviation are ¼ 1 P qffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi N N i¼1 Y i and ¼ 1 P N N 1 i¼1 ð Y i Þ 2, respectively. [24] While straightforward to implement, the nonintrusive approach suffers from poor computational efficiency. The p convergence rate of the computed mean is only O(1= ffiffiffiffi N ) for the Monte Carlo sampling method. Despite the fact that other sampling strategies (e.g., Latin hypercube [McKay et al., 1979], Quasi-Monte Carlo [Morokoff and Caflisch, 1985], importance sampling [Ghanem and Spanos, 2002; Liu, 2001]) have been proposed to improve convergence, existing sampling methods are still inadequate to handle high-dimensional models. When input-tooutput mapping is sufficiently smooth, a popular alternative is to assess uncertainties on the surrogates (or response surfaces) constructed from the samples Hybrid UQ Methods [25] Hybrid UQ methods seek to bridge the gap between the practicality of nonintrusive methods and the potential efficiency of intrusive methods. The term Hybrid UQ has been used in various contexts [Abdel-Khalik, 2010; Joslyn and Ferson, 2005; Constantine et al., 2009]. Here, hybrid stands for mixed techniques that facilitate the flexibility of using different UQ methods, intrusive or nonintrusive, at individual modules in a strongly coupled multiphysics system. As such, the modular UQ framework can be interpreted as a hybrid UQ method. [26] There are two key issues in designing a modular UQ framework for propagating global uncertainties using only user-implemented modules that propagate only local uncertainties: (1) defining the global uncertainty representation and (2) deriving the operators that handle information between modules. In this work, we have selected PCE to represent global uncertainty. This choice is appropriate if the dependent stochastic variables are sufficiently smooth in the independent stochastic parameter space. The advantage of this choice is that both uncertainties and parameter sensitivities are embedded in the representation. The drawback is that it may suffer from the curse of dimensionality, as the computational cost grows rapidly with respect to the dimension of the stochastic space. This drawback is especially acute in applications involving spatial randomness with relatively small length scales. For this reason, we developed a doubly nested dimension reduction scheme to facilitate dimension reduction in order to overcome this drawback. [27] Let be the number of independent physics modules in a multiphysics system in which each module has a stochastic solver (which could be implemented by an intrusive, nonintrusive, or even hybrid method). Let n ¼ fn 1 ; ::::n g be disjoint subsets of independent secondorder stochastic variables, where k denotes module k s internal stochastic variables. Also, let u(x, ) be the dependent stochastic variables that are propagated between different modules. Each module k contributes local updates to u(x, ): u ðx; n Þ ¼ M k ½n k ; uðx; nþš ð14þ where M k is a stochastic solver for module k. Suppose a two-module system is solved by using the solvers M 1 and M 2 via operator splitting. The updates through the system at time step t can be performed in two steps: u tþ1=2 ðx; nþ ¼ M 1 ½n 1 ; u t ðx; nþš u tþ1 ðx; nþ ¼ M 2 n 2 ; u tþ1=2 ð15þ ðx; nþ where 1 and 2 are stochastic variables internal to modules 1 and 2, respectively. For example, M 1 could represent the 5743

5 transport solver (cf. equation (6)) with n 1 ¼ fv x ; v y ; x g, while M 2 the reaction solver (cf. equation (7)) with n 2 ¼ fk 1 ; k 2 ; k 3 ; k 4 g. [28] When equation (14) is naively formulated as equation (15), the solver M 1 requires all the stochastic variables in the system including 2. This is an impediment to separability in model development. The key to decoupling the stochastic modules is to reformulate equation (14) as equation (16): u ðx; nþ ¼ Xnk i¼1 P ki ^M ki ½n k ; R ki uðx; nþš ð16þ by introducing restriction (R ki ) and interpolation (P ki ) operators. These operators help to break up the stochastic solver M k into n k subproblems. Each subproblem solver ^M k is responsible for propagating uncertainties with respect to only the local stochastic variables, but together, these ^M k s propagate global uncertainties. The role of R ki is to restrict the dependent stochastic variables defined in the entire stochastic space to the local stochastic space k, while the role of P ki is to interpolate these same dependent stochastic variables from the local space back to the global stochastic space. [29] The mathematical forms of R ki and P ki are different for different modules with different UQ methods. For example, in intrusive polynomial-chaos-based modules for linear partial differential equations, R ki and P ki are analogous to the scatter and gather operators, respectively. We provide these operators as part of the modular UQ library so that code developers need only to focus on their own solvers ^M ki in equation (16). The only requirement for users to use the framework is to specify, for each module, the degree of polynomial (for PCE representation), the number of random variables, the stochastic solvers, and whether they are intrusive or nonintrusive, linearly coupled or nonlinearly coupled. In section 5, more details about the requirements for user-generated solvers ^M ki are given. 4. Two-Dimensional Stochastic Flow in Heterogeneous Porous Media [30] Let K(x, ), the stochastic hydraulic conductivity, be represented as a random process in the space L 2 ð; PÞ, where denotes the Cartesian product and x ¼ ðx; yþ 2, 2. Applying the logarithmic transformation Yðx;Þ ¼ ln Kðx;Þ, we have the following stochastic partial differential equations to describe the stochastic flow: h x; exp½yðx;þš ð Þ x x þ h x; exp½y ðx;þš ð Þ ¼ 0 y y ð17þ where h(x, ) is the stochastic hydraulic head, which will be used to compute the stochastic velocity field required by the transport module. [31] In this section, we describe the steps to compute the stochastic velocity field (i.e., the solution to the stochastic flow equation given in equation (17)) via a doubly nested dimension reduction scheme that combines KLE and POD. Section 4.1 describes how KLE is used to reduce the infinite-dimensional random field Y(x, ) to an approximate finite-dimensional representation. Section 4.2 presents a nonintrusive PCE-based method (the implementation of which is greatly facilitated by the modular UQ framework) to solve for the stochastic hydraulic head h(x, ) from the stochastic flow equation. Section 4.3 describes a POD reduced-order modeling technique based on singular value decomposition (SVD) to generate a low-dimensional stochastic velocity field from the stochastic hydraulic head KLE of Log Hydraulic Conductivity [32] For the random process Y(x, ) in equation (17), the covariance function [Zhang and Lu, 2004; Li and Zhang, 2007, 2009; Liu et al., 2007]: C Y ðx; yþ ¼ hyðx;þ; Yðy;Þi ð18þ is bounded, symmetric, and positive definite with x ¼ ðx 1 ; y 1 Þ 2 and y ¼ ðx 2 ; y 2 Þ 2 (h; i in equation (18) denotes the inner product in the space ). The covariance function can be decomposed into: C Y ðx; yþ ¼ X1 n f n ðþf x n ðþ y ð19þ where n and f n (x) are the eigenvalues and eigenfunctions, respectively. Here, f n (x) are the orthogonal and deterministic functions that form a complete set such that: Z f n ðþf x m ðþdx x ¼ nm ; n; m 1 ð20þ where nm is the Kronecker product. The random process Y(x, ) can be expressed via KLE as: Yðx;Þ ¼ Y ðþþ x X1 pffiffiffiffiffi ðþ n ðþ nfn x ð21þ where Y ðþis x the mean of the stochastic process Y(x, ), and n () are orthogonal zero-mean random variables. Formally, h n ðþi L2 ð;pþ ¼ 0, and h nðþ; m ðþi L2 ð;pþ ¼ nm, where h; i L2 ð;pþ denotes the inner product in the space L 2 ð; PÞ. [33] Eigenvalues and eigenfunctions of the covariance function C Y (x, y) can be solved from the following Fredholm equation: Z C Y ðx; yþf ðþdx x ¼ f ðþ y ð22þ [34] For example, consider a one-dimensional stochastic process with the following covariance function: C Y ðx 1 ; x 2 Þ ¼ 2 Y exp ð jx 1 x 2 j=þ ð23þ where x and y are scalars, and 2 Y and are the variance and correlation length of the random process. The eigenvalues n and eigenfunctions f n (x, y) can be solved analytically [Zhang and Lu, 2004]. For problems in two 5744

6 Table 1. Ranges of Physical Parameters in Validation Experiments Physical Parameters Case I Case II Physical Parameters Case I Case II v x md 1 0:26 ½0:1; 0:3Š k 1 0:05 6 [0.04, 0.06] v y md k 2 0:03 6 [0.024, 0.036] x ðmþ 1:25 6 ½1:0; 1:5Š k 3 0:02 6 [0.016, 0.024] y ðmþ k 4 0:005 6 [0.004, 0.006] dimensions, we consider a separable covariance function: C Y ðx; yþ ¼ 2 Y exp ð jx 1 x 2 j= 1 jy 1 y 2 j= 2 Þ ð24þ in a domain ¼ fðx; yþ : 0 x L 1 ; 0 y L 2 g, and the eigenvalues and eigenfunctions can be obtained by combining those from the one-dimensional formulations. We can truncate the KLE to a finite number of terms by inspecting the spectral decay rate of n. The higher the rate of spectral decay is, the smaller the number of terms is needed in the truncated KLE. In fact, the rate of spectral decay depends on the correlation function of the stochastic process. The more correlated the process is, the higher is the rate of spectral decay and fewer terms are needed in the truncated KLE to account for the same fraction of the total variance Nonintrusive PCE-Based Stochastic Solution of Flow Equation [35] By substituting the truncated (N -term) KLE of Y(x, ) (assuming Y ðþ¼ x 0 and omitting in n ()) into the stochastic flow equation, we obtain: "! # x exp XN pffiffiffiffiffi hðx;þ nfn ðþ x n x "! # þ : ð25þ y exp XN pffiffiffiffiffi hðx;þ nfn ðþ x n ¼ 0 y by applying a Galerkin finite-element discretization approach. [39] Let Hx ð Þ ¼ ½hðx; 1 Þ; hðx; 2 Þ;...; hðx; N ÞŠ T be the set of hydraulic heads obtained by solving the corresponding N deterministic equations above. The objective is to compute the PCE coefficients for the hydraulic head h(x, T, ), that is, h 0 ðþ; x h 1 ðþ; x...; h Q ðþ x such that: h l ðx; l Þ ¼ XQ h i ðþ x ið l Þ; l ¼ 1;...; N : i¼0 [40] In matrix form, equation (30) can be rewritten as: ZhðÞ¼Hx x ð30þ ð31þ where Z ¼ ðz li Þ NðQþ1Þ with z li ¼ ið l Þ consisting of Legendre polynomials evaluated at the sample points l ; l ¼ 1;...; N. Since Z is either a square matrix or an overdetermined matrix, h(x) can be solved in a least-square sense by: hx ðþ¼ Z T 1Z Z T Hx ðþ: ð32þ [36] Next, we expand h(x, ) in terms of PCE: hðx;þ ¼ XQ h i ðþ x iðþ i¼0 ð26þ where Q is defined in equation (12), and is the vector of random variables from equation (25): ¼ ð 1 ; 2 ;...; N Þ T : ð27þ [37] To solve the stochastic flow equation, we first generate a set of the N Q þ 1 sample points, that is: l ¼ ð 1l ; 2l ;...; N l Þ T ; l ¼ 1;...; N: ð28þ [38] For each sample point l, we solve the following deterministic equation: ( " # ) exp XN pffiffiffiffiffi h l ðþ x nfn ðþ x x nl x ( " # ) þ exp XN pffiffiffiffiffi h l ðþ x nfn ðþ x y nl y ¼ 0 ð29þ Figure 1. Comparison of relative concentrations at y ¼ 10 m and t ¼ 40 days. The relative concentration means computed from the modular UQ method with polynomial order of p ¼ 3 are shown as solid lines, and those computed from the analytical procedure are shown as circles. For the modular UQ method, parameters correspond to Case I in Table

7 Figure 2. Uncertainty bands ( 6 ) showing the relative concentration means (solid lines) and the standard deviations (blue bands) computed by the modular UQ method with polynomial order of p ¼ 3 for y ¼ 10 m. Exact solutions (circles) are shown for completeness. (a) Species 1, (b) species 2, (c) species 3, and (d) species 4. For the modular UQ method, parameters are from Case II in Table 1. [41] The sample generation and the computation of h(x) are automatically handled by the nonintrusive module in the modular UQ framework Generation of the Stochastic Velocity Field [42] The stochastic velocity can now be computed using the KLE of hydraulic conductivity and the stochastic hydraulic head. The respective x and y direction velocities are: v x ðx;þ ¼ Kðx;Þ hðx;þ " x # ¼ 1 Xm pffiffiffiffiffi hðx; nþ exp nfn ðþ x n x " # ¼ 1 Xm pffiffiffiffiffi X Q h i ðþ x exp nfn ðþ x n x i¼0 v y ðx;þ ¼ Kðx;Þ hðx;þ " y # ¼ 1 Xm pffiffiffiffiffi X Q exp nfn ðþ x n i¼0 h i ðþ x y iðþ n iðþ n ð33þ ð34þ where is the porosity, which is assumed to be a known constant. Therefore, the overall velocity field is given by: vx; ð Þ ¼ ðv x ½x; nðþ Š; v y ½x; nðþ ŠÞ T : ð35þ [43] In equation (35), the biorthogonality structure of the KLE representation of K(x, ) is destroyed in v(x, ). This introduces high stochastic dimension and thus computational inefficiency in the solution of the stochastic transport equation. To mitigate this situation, we use a numerical covariance quadrature method to approximate the analytical covariance function (i.e., the method of snapshots [Sirovich et al., 1987]), then apply singular value decomposition. To do so, we generate a set of samples fg N i¼1 in the stochastic space and solve equations (33) and (34) at each sample point i to compute v s ¼ fvx; ð i Þg N i¼1, where N Q þ 1. Subsequently, the numerical covariance matrix can be constructed from ðv s v s Þ T ðv s v s Þ, where v s is the sample mean of v s. [44] It can be shown that the eigenvalue decomposition of the covariance matrix is equivalent to applying SVD [Golub and Loan, 1996] to ðv s v s Þ: 5746

8 Figure 3. Hydraulic head mean computed by a PCE-based nonintrusive method using least squares fit with polynomial order of p ¼ 3. v s v s ¼ USV T ¼ f 1 f r f jn j fflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflffl{zfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflffl} vx; ð Þ ¼ f 0 ðþþ x Xr s n f n ðþ x n : ð38þ U 0 1 s [45] As such, we obtain s r. ðg 1 g N Þ T ð36þ NN B.. fflfflfflfflfflfflfflfflfflfflfflfflfflfflffl{zfflfflfflfflfflfflfflfflfflfflfflfflfflfflffl} C v A x ðx;þ ¼ f x V s T 0 ðþþxr x s n fn x ðþ x n N : ð39þ 0 0 N fflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflffl{zfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflfflffl} v y ðx;þ ¼ f y 0 ðþþxr x s n fn y ðþ x n S where v s ¼ f 0 ðþis x the sample mean of v s representing the average velocity field; r is the number of truncated singular values; and is the number of nodes on the finite-element mesh that are not lying on. Let f n ¼ ðf n1 ;...; f n Þ T, and g n ¼ ðg n1 ;...; g nn Þ T. Then, v s can now be represented by an optimal rank r approximation using the eigen-velocity field f n (x): v s ðþ¼v x s ðþþ x Xr s n f n ðþg x n T ð37þ where f n ðxþ ¼ fn xðþ; x f n yðþ x. If instead of using the samples gn T, we consider the sampled variables themselves (denote the first r of those variables as g ¼ f n g r ), then we have the general (nonsample-based) expression for the velocity field: [46] Note that v x ðx; gþ and v y ðx; gþ now share a new set of random variables, and their ranges can be specified by the variability of their realizations from the coefficient matrix V computed from SVD. Let R n1 ¼ min g nj j¼1 and R n2 ¼ max g nj ; n ¼ 1;...; r, and N define: N j¼1 R n ¼ minfjr n1 j; jr n2 jg; n ¼ 1;...; r: ð40þ [47] Using R n, we can normalize the random variables f n g r by s0 n ¼ s n=r n and finally represent the spatially correlated random field v(x, ) in terms of the stochastic expansion of the spatially uncorrelated normalized random variables g: vx; ð Þ ¼ f 0 ðþþ x Xr s 0 n f nðþ x n ð41þ 5747

9 Figure 4. Hydraulic head variance computed by a PCE-based nonintrusive method using least squares fit with polynomial order of p ¼ 3. which is applied as an (uncertain) input to the transport module (to be discussed in section 5). Here, n () follows a standard uniform distribution: n ðþu ½ 1; 1Š; n ¼ 1;...; r: c t ¼ 1 x v x c þ 1 R x x R y y v x c y 1 ðv x cþ 1 ðv y cþ 2 R x R y ð42þ 5. Hybrid UQ for Reactive Transport System in Randomly Heterogeneous Media [48] In this section, we describe the steps to solve a multispecies reactive transport system using the velocity field obtained in section 4. Here, we apply the modular UQ methodology described in section 3.3. In the following, we first introduce the formulation of a two-dimensional reactive transport system in heterogeneous porous media, then describe the stochastic solution of the transport and reaction modules, where the transport system is solved by the PCE-based intrusive method and the reaction system is solved by a sampling-based nonintrusive method. Finally, we show how to glue these two independently implemented modules together using the modular UQ framework to propagate global uncertainties and sensitivities PCE-Based Stochastic Transport Module [49] The transport equation can be solved independently for each species. Hence, it suffices to discuss the PCE formulation of one generic species (scalar) transport equation. Removing the species and time indices, the scalar transport equation becomes: where again, is an anisotropic two-dimensional domain with boundary. [50] When x, y, v x, and v y are fixed parameters, equation (42) describes a deterministic problem with the species concentration field as its solution: c : ðx; t Þ 2 t 0 ; t f 7!cðx; tþ 2 R ð43þ where cðx; Þ ¼ c d ðþ; x x 2, and c d ðþis x a given function on. [51] We apply PCE-based stochastic Galerkin projection with the finite-element approximation of the stochastic variational form and we introduce the polynomial chaos space W Q onto which we project the stochastic space L 2 ð; PÞ: W Q span 0;...; Q L2 ð; PÞ ð44þ where f kg Q k¼0 are the polynomial chaoses of some prespecified order p, and the number of terms (Q þ 1) is defined in equation (12). After applying stochastic Galerkin projection (Appendix A) to the stochastic problem, we arrive at equation (A(6)), which is a sparse matrix system that can 5748

10 Figure 5. Eigen-velocity fields computed by our doubly nested dimension reduction scheme. (a) First, (b) second, (c) fifth, and (d) seventh mode of the eigen-velocity fields, respectively. be solved by preconditioned Krylov methods [Golub and Loan, 1996] Propagation of Uncertainties Through the Transport and Reaction Modules [52] While the transport system (equation (6)) can be solved independently for each species, the reaction system (equation (7)) is coupled so it must be solved in its vectorized form. Reproduced here for clarity, the reaction problem is to apply c tþ1 2 (the transport solution) as the initial condition for solving c tþ1 in: c tþ1 t ¼ Ac tþ1 ð45þ where A has the form of equation (5). To solve this equation, we follow the analytical procedure in Sun et al. [2012]. This equation is solved for each sample of fk i g 4 i¼1, the first-order reaction rates which are the random variables in the reaction module. [53] In terms of implementation, the reaction solver is wrapped around by a nonintrusive module in the modular UQ framework, which provides generic tools for sampling and regression analysis. Thus, the reaction solver is treated as a black box to run an ensemble of sample points drawn from the probability distributions of fk i g 4 i¼1, the results of which are used to construct uncertainty and sensitivity information to be propagated to the next module. [54] The full reaction-transport system with embedded UQ can now be solved by calling each module sequentially at each time step. At the end of the simulation, the overall uncertainty and sensitivity information can be extracted from the PCE coefficients as prescribed in section 3. The task of global uncertainty propagation is handled by the modular UQ framework, freeing the user to develop the transport or reaction solver independently. The computational framework to handle the decomposition and recombination of the global PCE information is generic so that it can be applied to other similar multiphysics problems. Table 2. Description of Physical Flow and Transport Parameters in Numerical Experiments Physical Parameters Definitions Internal Representations v ¼ ðv x ; v y Þ md 1 v ¼ f 0 ðþþ x r 0 n f nðxþ n ðþ f i g r i¼1 x ; y ð m Þ y ð 1 Þ ¼ 0:1 x ð 1 Þ 1 D x ; D y m 2 d 1 D x ¼ x v x ; D y ¼ y v x 1 ; f i g r i¼1 5749

11 Table 3. Description and Ranges of Physical Reaction Parameters in Numerical Experiments Physical Parameters Internal Representations Case I Case II k 1 (day 1 ) 2 [ , ] [0.04, 0.06] k 2 (day 1 ) 3 [ , ] [0.024, 0.036] k 3 (day 1 ) 4 [ , ] [0.016, 0.024] k 4 (day 1 ) 5 [ , ] [0.004, 0.006] [55] In summary, we have described the multispecies reactive transport problem as a two-module system in the modular UQ framework, in which the propagation of global uncertainties through the transport module is performed intrusively while the propagation of global uncertainties through the reaction module is performed nonintrusively. By applying the stochastic velocity field from the flow module as input into the transport module, spatial uncertainty associated with the randomly heterogeneous media is propagated through the system. 6. Numerical Results and Analysis [56] In numerical experiments, we consider a twodimensional square domain of size L 1 ¼ L 2 ¼ 20 (m), with 40 evenly spaced elements in each direction. The time step is set to Dt ¼ 1 (day). We used a polynomial order of p ¼ 3 in the PCE representation, which has been verified to give results with sufficient accuracy Multispecies Reactive Transport (Validation Experiments) [57] First, we make sure that our previously described two-dimensional methodology agrees well with the analytical solution [Sun et al., 2012] for one-dimensional multispecies reactive transport model problem. This validation step is important to ensure the methodology does not introduce numerical bias to the solution. In this problem setup, dispersivity is ¼ 1.25 (m) and velocity is v ¼ 0:2 (m d 1 ). The reaction rates for the four species are k 1 ¼ 0:05; k 2 ¼ 0:03; k 3 ¼ 0:02, and k 4 ¼ (day 1 ), respectively. The retardation factors and yield coefficients are all assumed to be 1.0. The homogeneous velocity is given by ðv x ; v y Þ md 1, where both v x and v y are Figure 6. Comparison of relative concentration means at y ¼ 10 m and t ¼ 10 days. The results computed from the modular UQ method with polynomial order of p ¼ 3 are shown as solid lines, and those computed from sampling with 1000 samples are shown as dashed lines. Transport and reaction parameters are from Tables 2 and 3 (Case II). (a) Species 1, (b) species 2, (c) species 3, and (d) species

12 Figure 7. Comparison of relative concentration standard deviations at y ¼ 10 m and t ¼ 10 days. The results computed from the modular UQ method with polynomial order of p ¼ 3 are shown as solid lines, and those computed from sampling with 1000 samples are shown as dashed lines. Transport and reaction parameters are from Tables 2 and 3 (Case II). (a) Species 1, (b) species 2, (c) species 3, and (d) species 4. homogeneous random variables with ranges defined in Table 1. Since we are using a one-dimensional problem to verify the two-dimensional implementation, we set the dispersivity and velocity in the y direction to zero. The total simulation time is t ¼ 40 (days) with Dt ¼ 1 (day). We used the HYPRE iterative solver package [Falgout, 2011] to solve the matrix equations arising from the discretization of the stochastic finite-element problem. [58] We considered two scenarios: one in which the uncertainty is negligible (Case I) and another with increased uncertainty (Case II). In both scenarios, we compare the analytic solution against our solution at the center line y ¼ 10 (m) since the solution is computed for a twodimensional stochastic domain. For the first scenario, we assumed no variability in dispersivity and velocity (as defined in Case I of Table 1) by setting very small uncertainty ranges to velocity parameters and using a polynomial order of p ¼ 0. As shown in Figure 1, the concentration means computed by the modular UQ method (solid lines) agree well with the exact solutions (circles) given in Sun et al. [2004]. For the second scenario, the ranges of dispersivity and velocity are defined in Case II of Table 1. As shown in Figure 2, the exact solutions (circles) of the concentration profiles lie inside of the uncertainty bands of 6 computed by our method. Here, the lines are the same as the ones from Figure 1. These two scenarios demonstrate that our method is well validated against analytic methods and that no bias is introduced by our method Multispecies Flow and Reactive Transport in Random Media [59] In the next numerical experiment, we consider a two-dimensional four-species flow and reactive transport system in randomly heterogeneous porous media. We first used KLE to reduce the dimension of the logarithmic hydraulic conductivity. We then applied a PCE-based nonintrusive approach (i.e., used sampling to construct the PCE coefficients) to solve the stochastic head from the stochastic flow equation. In this setup, no-flow boundary conditions are assumed at y ¼ 0.0 and 20 m; and constant hydraulic heads are prescribed to be 2.0 and 0.0 m at x ¼ 0.0 and 20 m, respectively. The mean of the logarithmic hydraulic conductivity is prescribed as Y ¼ 0. We used a separable covariance function of the logarithmic hydraulic conductivity C Y ðx; yþ ¼ 2 Y exp ð jx 1 x 2 j= 1 jy 1 y 2 j= 2 Þ in the square domain ¼ fðx; yþ : 0 x 20; 0 y 20g, with variance 2 Y ¼ 1:0 and correlation length 1 ¼ 2 ¼ 1:0. Figures 3 and 4 show the computed mean and variance of the hydraulic head, which have been verified by using a large Monte 5751

13 Figure 8. Contours of relative concentration means computed by the modular UQ method with polynomial order of p ¼ 3att¼10 days. Transport and reaction parameters are from Tables 2 and 3 (Case II). (a) Species 1, (b) species 2, (c) species 3, and (d) species 4. Carlo sample. The stochastic velocity field was thus computed based on the KLE of hydraulic conductivity field and the computed stochastic hydraulic head field, which introduces high stochastic dimension to the velocity field. We then obtain orthogonal eigen-velocity fields by our doubly nested dimension reduction scheme, as discussed in section 4.3. Figure 5 displays the first, second, fifth, and seventh eigen-velocity field in the two dimensional domain. [60] Next, we applied the solution to the stochastic flow equation for solving the reactive transport system (equation (2)). Initial concentrations for all four species are assumed to be zero throughout the computational domain. A Gaussian boundary concentration cð0; y; tþ ¼ expð ðy 15Þ 2 =45Þ is imposed at the inlet in the x direction. The retardation factors and yield coefficients in the reaction matrix A (equation (5)) are treated as deterministic and are given by: R ¼ ð2:9; 2:8; 1:4; 5:3Þ and l ¼ ð0:7927; 0:7385; 0:6458; 0:4516Þ. Results are presented for t ¼ 10 (days). [61] In this experiment, the porosity is specified by a deterministic constant ¼ 0:3. The independent physical parameters are: fv x ; v y g from the flow module, x from the transport module (because y ¼ 0:1 x ; D x ¼ x v x, and D y ¼ y v x are dependent random variables), and fk 1 ; k 2 ; k 3 ; k 4 g from the reaction module. These parameters are assumed to follow uniform distributions and their ranges are given in Tables 2 and 3. These tables also show how each of these physical parameters are internally represented by the generic random variables in the modular UQ framework: v x ; v y by f i g r i¼1, where r is the number of KLE functions taken from the stochastic flow module; x is internally represented by 1 ; D x ; D y by f i g r i¼1 and 1; and k i by f i g 5 i¼1. The total number of uncertain parameter is r þ 5 where r is the number of KLE functions taken from the stochastic flow module and 5 is the number of i s. We use r ¼ 2, for the reason that, when we varied r from 2 to 7, we noticed only a negligible change in the standard deviations. In sum, the physical uncertain parameters are represented by the random vector n ¼ f 1 ;...; r ; 1 ; 2 ; 3 ; 4 ; 5 g. [62] We ran the numerical experiment on an imac computer (with 3.4 GHz Intel Core i7 processor and 8 GB 1333 MHz DDR3 memories). We compare our results against the ground truth results approximated by a large number of samples, as shown in Figures 6 and 7. We observe that the modular UQ method demonstrates a similar accuracy as the ground truth results. Figures 8 and 9 show the contours of (mean) and (standard deviation) over the entire twodimensional domain, respectively. We also compare the performance of our modular UQ method with a pure sampling-based method (using 1000 samples, which is the 5752

14 Figure 9. Contours of relative concentration standard deviations computed by the modular UQ method with polynomial order of p ¼ 3att¼10 days. Transport and reaction parameters are from Tables 2 and 3 (Case II). (a) Species 1, (b) species 2, (c) species 3, and (d) species 4. minimum required for convergence of statistical moments). The overall CPU run times are 91 and 821 s, respectively. The speedup of the modular UQ can be attributed to the reuse of the assembled stochastic matrices in the intrusive transport module. Specially, the CPU run times for matrix setup are 15 and 389 s, respectively, while the CPU run time for linear system solves are 76 and 432 s, respectively. Further speedup of our modular UQ can be obtained by using more efficient solvers for linear system with multiple right hand sides. 7. Conclusions [63] Intrusive UQ methods offer mathematically rigorous and also potentially more efficient means of quantifying uncertainties in simulation models compared to nonintrusive methods. However, the complexities of their formulation and implementation have hampered the practicality of these methods for large-scale reactive transport applications. In this paper, we applied our computational framework to address spatial heterogeneity in the propagation of global uncertainties and sensitivities in a multispecies problem involving flow, diffusive transport, and sequential firstorder reactions with spatial stochasticity in randomly heterogeneous porous media. In this setting, transport is handled by intrusive PCE and reaction is solved by a deterministic solver. Specifically, we develop a scheme to reduce the dimension of the stochastic space via a doubly nested dimension reduction scheme. This scheme enables the modular UQ framework to handle spatially random models efficiently while maintaining solution accuracy. We have validated the framework under different uncertainty levels for the transport and reaction parameters. The modular UQ method shows excellent computational accuracy and efficiency compared to estimates derived from a purely nonintrusive sampling method. By providing a generic computational framework and the associated algorithms to manage the complexities of global uncertainty/sensitivity propagation, this approach has strong potentials for streamlining the development and maintenance of UQ methods on a per module basis, allowing the application developers to independently enhance each module without having to be concerned about incompatibilities with other modules. This paradigm of plug-and-play (or modular programming) is already well adopted in the development of deterministic simulation models, and our work provides the computational machinery to extend this concept to stochastic simulation models. The future work includes extending this framework to handle more complex reaction networks with stronger heterogeneity and nonlinearity, and coupling scale-dependent heterogeneity within the hybrid UQ framework. 5753

15 Appendix A: Stochastic Galerkin Projection [64] The stochastic Galerkin projection of the Q þ 1 polynomial chaos bases onto equation (6) gives rise to a ðq þ 1ÞðQ þ 1Þ system, where each subproblem (i, j) has the following form: c t ¼ 1 R x Dx ij ðþ x cðþ x þ 1 x R y Dy ij ðþ x cðþ x h i h i y 1 Vij xcðx; tþ 1 V y ij cðx; tþ : ða1þ 2 R x R y Here, Vij x; V y ij ; Dx ij, and Dy ij are the effective velocity and dispersion coefficients corresponding to the subproblem (i, j). These quantities can be computed by substituting equation (41) in x and y direction separately as follows: 2 V ij ¼hv i ji=h i i! ¼ f 0 þ Xr s 0 k f 2 k k i j =h i i " k¼1! X r # ¼ f 0 h i jiþ s 0 k f 2 : ða2þ k k i j =h i i k¼1! ¼ f 0 h i jiþ Xr s 0 k f 2 kh k i ji =h i i k¼1 We assume the dispersivity to be linear function of a random variable. That is, ¼ þ, in which and are constants, and their values depend on s uncertainty range. For the dispersion coefficients, we have: 2 D ij ¼hv i ji=h i i! ¼ ð þ Þ f 0 þ Xr s 0 k f 2 k k i j =h i i " k¼1 # : ¼ f 0 hð þ Þ i jiþ Xr s 0 k f 2 kh k ð þ Þ i ji =h i i k¼1 ða3þ [65] Due to the orthogonality of the stochastic expansion bases in W Q, the PCE-based stochastic variational problem can be simplified and rewritten in terms of the stochastic global sparse matrices [M] and [K]: ½MŠ ½_c Šþ½KŠ½Š¼0 c ða4þ where the stochastic global matrices [M] and [K] are constructed from the deterministic global mass matrices M and stiffness matrices K (assembled from the finite-element method) as follows: ½MŠ ¼ 0 1 M M A; ½KŠ ¼ 0 K 0; K 0;Q B... K Q;0 K Q;Q C A: ða5þ Here, K i;j is the stiffness matrix corresponding to each subproblem ði; jþ from the ðq þ 1ÞðQ þ 1Þ stochastic global problem, and: T c ¼ c 0 ;...; c Q is the stochastic concentration field, where c k ¼ T; c 1;k ;...; c ;k 0 k Q; denotes the vector of nodal values of the kth stochastic mode of the solution. [66] Using the backward Euler method, we can discretize equation (A(4)) in time and rewrite it as: 0 1 M þ K 0;0 Dt... K 0;Q Dt 0 1tþ1=2 c 0 B.. C. A A K Q;0 Dt M þ K Q;Q Dt c Q 0 10 M ¼.. A c 1 : ða6þ t 0 A 0 M c Q [67] Assuming uniform probability distributions for the random variables f x ; y gand f i g r i¼1, we can exploit the orthogonality of the Legendre polynomial chaos to approximate the mean and variance of the concentration at each grid point i by: c i t þ 1 ¼ c tþ1=2 i;0 2 2 i t þ 1 ¼ XQ 2 ða7þ c tþ1=2 ik : 2 [68] Acknowledgments. This research was funded by U. S. Department of Energy Office of Advanced Scientific Computing Research Applied Mathematics Program and performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under contract DE-AC52-07NA References Abdel-Khalik, H. S. (2010), Hybrid uncertainty and sensitivity algorithms for high dimensional nonlinear models, part I: Introduction to the theory, Trans. Am. Nucl. Soc., 103, Chanem, R., and S. Dham (1998), Stochastic finite element analysis for multiphase flow in heterogeneous porous media, Transp. Porous Media, 32, Chen, X., I. M. Navon, and F. Fang (2011a), A dual-weighted trust-region adaptive POD 4D-VAR applied to a finite-element shallow-water equations model, Int. J. Numer. Methods Fluids, 65, Chen, X., S. Akella, and I. M. Navon (2011b), A dual weighted trust-region adaptive POD 4D-Var applied to a finite volume shallow water equations model on the sphere, Int. J. Numer. Methods Fluids, 68, Chen, X., B. M. Ng, Y. Sun, and C. H. Tong (2013), A flexible uncertainty quantification method for linearly coupled multi-physics systems, J. Comput. Phys., 248, Clark, K. B., and C. Y. Baldwin (2000), Design Rules, The Power of Modularity, vol. 1, MIT Press, Cambridge, Mass. Clement, T. P., Y. Sun, B. S. Hooker, and J. N. Petersen (1998), Modeling multi-species reactive transport in groundwater aquifers, Ground Water Monit. Rem., 18, Constantine, P. G., A. Doostan, and G. Iaccarino (2009), A hybrid collocation/galerkin scheme for convective heat transfer problems with stochastic boundary conditions, Int. J. Numer. Methods Eng., 80, Dagan, G. (1989), Flow and Transport in Porous Formations, Springer, New York. Elman, H. C., C. W. Miller, E. T. Phipps, and R. S. Tuminaro (2011), Assessment of collocation and galerkin approaches to linear diffusion equations with random data, Int. J. Uncertainty Quantification, 1, Falgout, R. (2011), HYPRE User s Manual UCRL-CODE (Version 2.8.0b), Lawrence Livermore Natl. Lab, Livermore, Calif. Ghanem, R. (1998), Probabilistic characterization of transport in heterogeneous media, Comput. Method Appl. Mech. Eng., 158, Ghanem, R., and P. D. Spanos (1991a), Stochastic Finite Elements: A Spectral Approach, Springer, New York. Ghanem, R., and P. D. Spanos (1991b), Spectral stochastic finite-element formulation for reliability analysis, J. Eng. Mech., 117, k¼1 5754

Probabilistic Collocation Method for Uncertainty Analysis of Soil Infiltration in Flood Modelling

Probabilistic Collocation Method for Uncertainty Analysis of Soil Infiltration in Flood Modelling Probabilistic Collocation Method for Uncertainty Analysis of Soil Infiltration in Flood Modelling Y. Huang 1,2, and X.S. Qin 1,2* 1 School of Civil & Environmental Engineering, Nanyang Technological University,

More information

Stochastic Spectral Approaches to Bayesian Inference

Stochastic Spectral Approaches to Bayesian Inference Stochastic Spectral Approaches to Bayesian Inference Prof. Nathan L. Gibson Department of Mathematics Applied Mathematics and Computation Seminar March 4, 2011 Prof. Gibson (OSU) Spectral Approaches to

More information

A Polynomial Chaos Approach to Robust Multiobjective Optimization

A Polynomial Chaos Approach to Robust Multiobjective Optimization A Polynomial Chaos Approach to Robust Multiobjective Optimization Silvia Poles 1, Alberto Lovison 2 1 EnginSoft S.p.A., Optimization Consulting Via Giambellino, 7 35129 Padova, Italy s.poles@enginsoft.it

More information

Dinesh Kumar, Mehrdad Raisee and Chris Lacor

Dinesh Kumar, Mehrdad Raisee and Chris Lacor Dinesh Kumar, Mehrdad Raisee and Chris Lacor Fluid Mechanics and Thermodynamics Research Group Vrije Universiteit Brussel, BELGIUM dkumar@vub.ac.be; m_raisee@yahoo.com; chris.lacor@vub.ac.be October, 2014

More information

Solving the steady state diffusion equation with uncertainty Final Presentation

Solving the steady state diffusion equation with uncertainty Final Presentation Solving the steady state diffusion equation with uncertainty Final Presentation Virginia Forstall vhfors@gmail.com Advisor: Howard Elman elman@cs.umd.edu Department of Computer Science May 6, 2012 Problem

More information

Polynomial chaos expansions for sensitivity analysis

Polynomial chaos expansions for sensitivity analysis c DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Polynomial chaos expansions for sensitivity analysis B. Sudret Chair of Risk, Safety & Uncertainty

More information

Polynomial Chaos and Karhunen-Loeve Expansion

Polynomial Chaos and Karhunen-Loeve Expansion Polynomial Chaos and Karhunen-Loeve Expansion 1) Random Variables Consider a system that is modeled by R = M(x, t, X) where X is a random variable. We are interested in determining the probability of the

More information

A Stochastic Collocation based. for Data Assimilation

A Stochastic Collocation based. for Data Assimilation A Stochastic Collocation based Kalman Filter (SCKF) for Data Assimilation Lingzao Zeng and Dongxiao Zhang University of Southern California August 11, 2009 Los Angeles Outline Introduction SCKF Algorithm

More information

Beyond Wiener Askey Expansions: Handling Arbitrary PDFs

Beyond Wiener Askey Expansions: Handling Arbitrary PDFs Journal of Scientific Computing, Vol. 27, Nos. 1 3, June 2006 ( 2005) DOI: 10.1007/s10915-005-9038-8 Beyond Wiener Askey Expansions: Handling Arbitrary PDFs Xiaoliang Wan 1 and George Em Karniadakis 1

More information

Efficient Solvers for Stochastic Finite Element Saddle Point Problems

Efficient Solvers for Stochastic Finite Element Saddle Point Problems Efficient Solvers for Stochastic Finite Element Saddle Point Problems Catherine E. Powell c.powell@manchester.ac.uk School of Mathematics University of Manchester, UK Efficient Solvers for Stochastic Finite

More information

Characterization of heterogeneous hydraulic conductivity field via Karhunen-Loève expansions and a measure-theoretic computational method

Characterization of heterogeneous hydraulic conductivity field via Karhunen-Loève expansions and a measure-theoretic computational method Characterization of heterogeneous hydraulic conductivity field via Karhunen-Loève expansions and a measure-theoretic computational method Jiachuan He University of Texas at Austin April 15, 2016 Jiachuan

More information

Solving the Stochastic Steady-State Diffusion Problem Using Multigrid

Solving the Stochastic Steady-State Diffusion Problem Using Multigrid Solving the Stochastic Steady-State Diffusion Problem Using Multigrid Tengfei Su Applied Mathematics and Scientific Computing Advisor: Howard Elman Department of Computer Science Sept. 29, 2015 Tengfei

More information

Journal of Computational Physics

Journal of Computational Physics Journal of Computational Physics 229 (2) 6995 72 Contents lists available at ScienceDirect Journal of Computational Physics journal homepage: www.elsevier.com/locate/jcp Uncertainty quantification via

More information

Performance Evaluation of Generalized Polynomial Chaos

Performance Evaluation of Generalized Polynomial Chaos Performance Evaluation of Generalized Polynomial Chaos Dongbin Xiu, Didier Lucor, C.-H. Su, and George Em Karniadakis 1 Division of Applied Mathematics, Brown University, Providence, RI 02912, USA, gk@dam.brown.edu

More information

Characterization of reservoir simulation models using a polynomial chaos-based ensemble Kalman filter

Characterization of reservoir simulation models using a polynomial chaos-based ensemble Kalman filter WATER RESOURCES RESEARCH, VOL. 45,, doi:10.1029/2008wr007148, 2009 Characterization of reservoir simulation models using a polynomial chaos-based ensemble Kalman filter George Saad 1 and Roger Ghanem 1

More information

Sparse polynomial chaos expansions in engineering applications

Sparse polynomial chaos expansions in engineering applications DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Sparse polynomial chaos expansions in engineering applications B. Sudret G. Blatman (EDF R&D,

More information

An Empirical Chaos Expansion Method for Uncertainty Quantification

An Empirical Chaos Expansion Method for Uncertainty Quantification An Empirical Chaos Expansion Method for Uncertainty Quantification Melvin Leok and Gautam Wilkins Abstract. Uncertainty quantification seeks to provide a quantitative means to understand complex systems

More information

Uncertainty quantification for flow in highly heterogeneous porous media

Uncertainty quantification for flow in highly heterogeneous porous media 695 Uncertainty quantification for flow in highly heterogeneous porous media D. Xiu and D.M. Tartakovsky a a Theoretical Division, Los Alamos National Laboratory, Mathematical Modeling and Analysis Group

More information

Kernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt.

Kernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt. SINGAPORE SHANGHAI Vol TAIPEI - Interdisciplinary Mathematical Sciences 19 Kernel-based Approximation Methods using MATLAB Gregory Fasshauer Illinois Institute of Technology, USA Michael McCourt University

More information

SENSITIVITY ANALYSIS IN NUMERICAL SIMULATION OF MULTIPHASE FLOW FOR CO 2 STORAGE IN SALINE AQUIFERS USING THE PROBABILISTIC COLLOCATION APPROACH

SENSITIVITY ANALYSIS IN NUMERICAL SIMULATION OF MULTIPHASE FLOW FOR CO 2 STORAGE IN SALINE AQUIFERS USING THE PROBABILISTIC COLLOCATION APPROACH XIX International Conference on Water Resources CMWR 2012 University of Illinois at Urbana-Champaign June 17-22,2012 SENSITIVITY ANALYSIS IN NUMERICAL SIMULATION OF MULTIPHASE FLOW FOR CO 2 STORAGE IN

More information

Stochastic uncertainty analysis for solute transport in randomly heterogeneous media using a Karhunen-Loève-based moment equation approach

Stochastic uncertainty analysis for solute transport in randomly heterogeneous media using a Karhunen-Loève-based moment equation approach WATER RESOURCES RESEARCH, VOL. 43,, doi:10.1029/2006wr005193, 2007 Stochastic uncertainty analysis for solute transport in randomly heterogeneous media using a Karhunen-Loève-based moment equation approach

More information

EE731 Lecture Notes: Matrix Computations for Signal Processing

EE731 Lecture Notes: Matrix Computations for Signal Processing EE731 Lecture Notes: Matrix Computations for Signal Processing James P. Reilly c Department of Electrical and Computer Engineering McMaster University September 22, 2005 0 Preface This collection of ten

More information

Simple closed form formulas for predicting groundwater flow model uncertainty in complex, heterogeneous trending media

Simple closed form formulas for predicting groundwater flow model uncertainty in complex, heterogeneous trending media WATER RESOURCES RESEARCH, VOL. 4,, doi:0.029/2005wr00443, 2005 Simple closed form formulas for predicting groundwater flow model uncertainty in complex, heterogeneous trending media Chuen-Fa Ni and Shu-Guang

More information

A Decomposition Method for Solving Coupled Multi-Species Reactive Transport Problems

A Decomposition Method for Solving Coupled Multi-Species Reactive Transport Problems Transport in Porous Media 37: 327 346, 1999. c 1999 Kluwer Academic Publishers. Printed in the Netherlands. 327 A Decomposition Method for Solving Coupled Multi-Species Reactive Transport Problems YUNWEI

More information

Uncertainty Quantification in Computational Models

Uncertainty Quantification in Computational Models Uncertainty Quantification in Computational Models Habib N. Najm Sandia National Laboratories, Livermore, CA, USA Workshop on Understanding Climate Change from Data (UCC11) University of Minnesota, Minneapolis,

More information

Experiences with Model Reduction and Interpolation

Experiences with Model Reduction and Interpolation Experiences with Model Reduction and Interpolation Paul Constantine Stanford University, Sandia National Laboratories Qiqi Wang (MIT) David Gleich (Purdue) Emory University March 7, 2012 Joe Ruthruff (SNL)

More information

A Non-Intrusive Polynomial Chaos Method For Uncertainty Propagation in CFD Simulations

A Non-Intrusive Polynomial Chaos Method For Uncertainty Propagation in CFD Simulations An Extended Abstract submitted for the 44th AIAA Aerospace Sciences Meeting and Exhibit, Reno, Nevada January 26 Preferred Session Topic: Uncertainty quantification and stochastic methods for CFD A Non-Intrusive

More information

Organization. I MCMC discussion. I project talks. I Lecture.

Organization. I MCMC discussion. I project talks. I Lecture. Organization I MCMC discussion I project talks. I Lecture. Content I Uncertainty Propagation Overview I Forward-Backward with an Ensemble I Model Reduction (Intro) Uncertainty Propagation in Causal Systems

More information

Applications of Randomized Methods for Decomposing and Simulating from Large Covariance Matrices

Applications of Randomized Methods for Decomposing and Simulating from Large Covariance Matrices Applications of Randomized Methods for Decomposing and Simulating from Large Covariance Matrices Vahid Dehdari and Clayton V. Deutsch Geostatistical modeling involves many variables and many locations.

More information

Hierarchical Parallel Solution of Stochastic Systems

Hierarchical Parallel Solution of Stochastic Systems Hierarchical Parallel Solution of Stochastic Systems Second M.I.T. Conference on Computational Fluid and Solid Mechanics Contents: Simple Model of Stochastic Flow Stochastic Galerkin Scheme Resulting Equations

More information

Schwarz Preconditioner for the Stochastic Finite Element Method

Schwarz Preconditioner for the Stochastic Finite Element Method Schwarz Preconditioner for the Stochastic Finite Element Method Waad Subber 1 and Sébastien Loisel 2 Preprint submitted to DD22 conference 1 Introduction The intrusive polynomial chaos approach for uncertainty

More information

Hyperbolic Polynomial Chaos Expansion (HPCE) and its Application to Statistical Analysis of Nonlinear Circuits

Hyperbolic Polynomial Chaos Expansion (HPCE) and its Application to Statistical Analysis of Nonlinear Circuits Hyperbolic Polynomial Chaos Expansion HPCE and its Application to Statistical Analysis of Nonlinear Circuits Majid Ahadi, Aditi Krishna Prasad, Sourajeet Roy High Speed System Simulations Laboratory Department

More information

c 2004 Society for Industrial and Applied Mathematics

c 2004 Society for Industrial and Applied Mathematics SIAM J. SCI. COMPUT. Vol. 26, No. 2, pp. 558 577 c 2004 Society for Industrial and Applied Mathematics A COMPARATIVE STUDY ON UNCERTAINTY QUANTIFICATION FOR FLOW IN RANDOMLY HETEROGENEOUS MEDIA USING MONTE

More information

AN EFFICIENT COMPUTATIONAL FRAMEWORK FOR UNCERTAINTY QUANTIFICATION IN MULTISCALE SYSTEMS

AN EFFICIENT COMPUTATIONAL FRAMEWORK FOR UNCERTAINTY QUANTIFICATION IN MULTISCALE SYSTEMS AN EFFICIENT COMPUTATIONAL FRAMEWORK FOR UNCERTAINTY QUANTIFICATION IN MULTISCALE SYSTEMS A Dissertation Presented to the Faculty of the Graduate School of Cornell University in Partial Fulfillment of

More information

Uncertainty Quantification for multiscale kinetic equations with high dimensional random inputs with sparse grids

Uncertainty Quantification for multiscale kinetic equations with high dimensional random inputs with sparse grids Uncertainty Quantification for multiscale kinetic equations with high dimensional random inputs with sparse grids Shi Jin University of Wisconsin-Madison, USA Kinetic equations Different Q Boltmann Landau

More information

UNCERTAINTY ASSESSMENT USING STOCHASTIC REDUCED BASIS METHOD FOR FLOW IN POROUS MEDIA

UNCERTAINTY ASSESSMENT USING STOCHASTIC REDUCED BASIS METHOD FOR FLOW IN POROUS MEDIA UNCERTAINTY ASSESSMENT USING STOCHASTIC REDUCED BASIS METHOD FOR FLOW IN POROUS MEDIA A REPORT SUBMITTED TO THE DEPARTMENT OF ENERGY RESOURCES ENGINEERING OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT

More information

New Fast Kalman filter method

New Fast Kalman filter method New Fast Kalman filter method Hojat Ghorbanidehno, Hee Sun Lee 1. Introduction Data assimilation methods combine dynamical models of a system with typically noisy observations to obtain estimates of the

More information

Combining multiple surrogate models to accelerate failure probability estimation with expensive high-fidelity models

Combining multiple surrogate models to accelerate failure probability estimation with expensive high-fidelity models Combining multiple surrogate models to accelerate failure probability estimation with expensive high-fidelity models Benjamin Peherstorfer a,, Boris Kramer a, Karen Willcox a a Department of Aeronautics

More information

Uncertainty Quantification of Two-Phase Flow in Heterogeneous Porous Media

Uncertainty Quantification of Two-Phase Flow in Heterogeneous Porous Media Uncertainty Quantification of Two-Phase Flow in Heterogeneous Porous Media M.Köppel, C.Rohde Institute for Applied Analysis and Numerical Simulation Inria, Nov 15th, 2016 Porous Media Examples: sponge,

More information

Introduction to Computational Stochastic Differential Equations

Introduction to Computational Stochastic Differential Equations Introduction to Computational Stochastic Differential Equations Gabriel J. Lord Catherine E. Powell Tony Shardlow Preface Techniques for solving many of the differential equations traditionally used by

More information

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2.

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2. APPENDIX A Background Mathematics A. Linear Algebra A.. Vector algebra Let x denote the n-dimensional column vector with components 0 x x 2 B C @. A x n Definition 6 (scalar product). The scalar product

More information

EFFICIENT SHAPE OPTIMIZATION USING POLYNOMIAL CHAOS EXPANSION AND LOCAL SENSITIVITIES

EFFICIENT SHAPE OPTIMIZATION USING POLYNOMIAL CHAOS EXPANSION AND LOCAL SENSITIVITIES 9 th ASCE Specialty Conference on Probabilistic Mechanics and Structural Reliability EFFICIENT SHAPE OPTIMIZATION USING POLYNOMIAL CHAOS EXPANSION AND LOCAL SENSITIVITIES Nam H. Kim and Haoyu Wang University

More information

Estimating functional uncertainty using polynomial chaos and adjoint equations

Estimating functional uncertainty using polynomial chaos and adjoint equations 0. Estimating functional uncertainty using polynomial chaos and adjoint equations February 24, 2011 1 Florida State University, Tallahassee, Florida, Usa 2 Moscow Institute of Physics and Technology, Moscow,

More information

Comparison between Karhunen Loeve and wavelet expansions for simulation of Gaussian processes

Comparison between Karhunen Loeve and wavelet expansions for simulation of Gaussian processes Computers and Structures 82 (2004) 985 99 www.elsevier.com/locate/compstruc Comparison between Karhunen Loeve and wavelet expansions for simulation of Gaussian processes K.K. Phoon *, H.W. Huang, S.T.

More information

Maximum variance formulation

Maximum variance formulation 12.1. Principal Component Analysis 561 Figure 12.2 Principal component analysis seeks a space of lower dimensionality, known as the principal subspace and denoted by the magenta line, such that the orthogonal

More information

Dipartimento di Scienze Matematiche

Dipartimento di Scienze Matematiche Exploiting parallel computing in Discrete Fracture Network simulations: an inherently parallel optimization approach Stefano Berrone stefano.berrone@polito.it Team: Matìas Benedetto, Andrea Borio, Claudio

More information

Uncertainty analysis of large-scale systems using domain decomposition

Uncertainty analysis of large-scale systems using domain decomposition Center for Turbulence Research Annual Research Briefs 2007 143 Uncertainty analysis of large-scale systems using domain decomposition By D. Ghosh, C. Farhat AND P. Avery 1. Motivation and objectives A

More information

A stochastic Lagrangian approach for geometrical uncertainties in electrostatics

A stochastic Lagrangian approach for geometrical uncertainties in electrostatics Journal of Computational Physics 226 (27) 156 179 www.elsevier.com/locate/jcp A stochastic Lagrangian approach for geometrical uncertainties in electrostatics Nitin Agarwal, N.R. Aluru * Department of

More information

Dimension-adaptive sparse grid for industrial applications using Sobol variances

Dimension-adaptive sparse grid for industrial applications using Sobol variances Master of Science Thesis Dimension-adaptive sparse grid for industrial applications using Sobol variances Heavy gas flow over a barrier March 11, 2015 Ad Dimension-adaptive sparse grid for industrial

More information

A new Hierarchical Bayes approach to ensemble-variational data assimilation

A new Hierarchical Bayes approach to ensemble-variational data assimilation A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander

More information

NONLOCALITY AND STOCHASTICITY TWO EMERGENT DIRECTIONS FOR APPLIED MATHEMATICS. Max Gunzburger

NONLOCALITY AND STOCHASTICITY TWO EMERGENT DIRECTIONS FOR APPLIED MATHEMATICS. Max Gunzburger NONLOCALITY AND STOCHASTICITY TWO EMERGENT DIRECTIONS FOR APPLIED MATHEMATICS Max Gunzburger Department of Scientific Computing Florida State University North Carolina State University, March 10, 2011

More information

Spectral Representation of Random Processes

Spectral Representation of Random Processes Spectral Representation of Random Processes Example: Represent u(t,x,q) by! u K (t, x, Q) = u k (t, x) k(q) where k(q) are orthogonal polynomials. Single Random Variable:! Let k (Q) be orthogonal with

More information

STOCHASTIC FINITE ELEMENTS WITH MULTIPLE RANDOM NON-GAUSSIAN PROPERTIES

STOCHASTIC FINITE ELEMENTS WITH MULTIPLE RANDOM NON-GAUSSIAN PROPERTIES STOCHASTIC FIITE ELEMETS WITH MULTIPLE RADOM O-GAUSSIA PROPERTIES By Roger Ghanem, 1 Member, ASCE ABSTRACT: The spectral formulation of the stochastic finite-element method is applied to the problem of

More information

Journal of Computational Physics

Journal of Computational Physics Journal of Computational Physics 229 (21) 3884 3915 Contents lists available at ScienceDirect Journal of Computational Physics journal homepage: www.elsevier.com/locate/jcp An adaptive high-dimensional

More information

Research Article Multiresolution Analysis for Stochastic Finite Element Problems with Wavelet-Based Karhunen-Loève Expansion

Research Article Multiresolution Analysis for Stochastic Finite Element Problems with Wavelet-Based Karhunen-Loève Expansion Mathematical Problems in Engineering Volume 2012, Article ID 215109, 15 pages doi:10.1155/2012/215109 Research Article Multiresolution Analysis for Stochastic Finite Element Problems with Wavelet-Based

More information

arxiv: v1 [math.na] 3 Apr 2019

arxiv: v1 [math.na] 3 Apr 2019 arxiv:1904.02017v1 [math.na] 3 Apr 2019 Poly-Sinc Solution of Stochastic Elliptic Differential Equations Maha Youssef and Roland Pulch Institute of Mathematics and Computer Science, University of Greifswald,

More information

MULTISCALE FINITE ELEMENT METHODS FOR STOCHASTIC POROUS MEDIA FLOW EQUATIONS AND APPLICATION TO UNCERTAINTY QUANTIFICATION

MULTISCALE FINITE ELEMENT METHODS FOR STOCHASTIC POROUS MEDIA FLOW EQUATIONS AND APPLICATION TO UNCERTAINTY QUANTIFICATION MULTISCALE FINITE ELEMENT METHODS FOR STOCHASTIC POROUS MEDIA FLOW EQUATIONS AND APPLICATION TO UNCERTAINTY QUANTIFICATION P. DOSTERT, Y. EFENDIEV, AND T.Y. HOU Abstract. In this paper, we study multiscale

More information

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Dongbin Xiu Department of Mathematics, Purdue University Support: AFOSR FA955-8-1-353 (Computational Math) SF CAREER DMS-64535

More information

Machine Learning Applied to 3-D Reservoir Simulation

Machine Learning Applied to 3-D Reservoir Simulation Machine Learning Applied to 3-D Reservoir Simulation Marco A. Cardoso 1 Introduction The optimization of subsurface flow processes is important for many applications including oil field operations and

More information

Stochastic simulation of Advection-Diffusion equation considering uncertainty in input variables

Stochastic simulation of Advection-Diffusion equation considering uncertainty in input variables INTERNATIONAL JOURNAL OF MATEMATICAL MODELS AND METODS IN APPLIED SCIENCES Volume, 7 Stochastic simulation of Advection-Diffusion equation considering uncertainty in input variables ossein Khorshidi, Gholamreza

More information

11280 Electrical Resistivity Tomography Time-lapse Monitoring of Three-dimensional Synthetic Tracer Test Experiments

11280 Electrical Resistivity Tomography Time-lapse Monitoring of Three-dimensional Synthetic Tracer Test Experiments 11280 Electrical Resistivity Tomography Time-lapse Monitoring of Three-dimensional Synthetic Tracer Test Experiments M. Camporese (University of Padova), G. Cassiani* (University of Padova), R. Deiana

More information

Ensemble square-root filters

Ensemble square-root filters Ensemble square-root filters MICHAEL K. TIPPETT International Research Institute for climate prediction, Palisades, New Yor JEFFREY L. ANDERSON GFDL, Princeton, New Jersy CRAIG H. BISHOP Naval Research

More information

Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis

Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis Sobol-Hoeffding decomposition Application to Global SA Computation of the SI Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis Olivier Le Maître with Colleague & Friend Omar

More information

Spectral methods for fuzzy structural dynamics: modal vs direct approach

Spectral methods for fuzzy structural dynamics: modal vs direct approach Spectral methods for fuzzy structural dynamics: modal vs direct approach S Adhikari Zienkiewicz Centre for Computational Engineering, College of Engineering, Swansea University, Wales, UK IUTAM Symposium

More information

Cheng Soon Ong & Christian Walder. Canberra February June 2018

Cheng Soon Ong & Christian Walder. Canberra February June 2018 Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 2018 (Many figures from C. M. Bishop, "Pattern Recognition and ") 1of 254 Part V

More information

Algorithms for Uncertainty Quantification

Algorithms for Uncertainty Quantification Algorithms for Uncertainty Quantification Lecture 9: Sensitivity Analysis ST 2018 Tobias Neckel Scientific Computing in Computer Science TUM Repetition of Previous Lecture Sparse grids in Uncertainty Quantification

More information

Fast Numerical Methods for Stochastic Computations

Fast Numerical Methods for Stochastic Computations Fast AreviewbyDongbinXiu May 16 th,2013 Outline Motivation 1 Motivation 2 3 4 5 Example: Burgers Equation Let us consider the Burger s equation: u t + uu x = νu xx, x [ 1, 1] u( 1) =1 u(1) = 1 Example:

More information

A reduced-order stochastic finite element analysis for structures with uncertainties

A reduced-order stochastic finite element analysis for structures with uncertainties A reduced-order stochastic finite element analysis for structures with uncertainties Ji Yang 1, Béatrice Faverjon 1,2, Herwig Peters 1, icole Kessissoglou 1 1 School of Mechanical and Manufacturing Engineering,

More information

MACHINE LEARNING. Methods for feature extraction and reduction of dimensionality: Probabilistic PCA and kernel PCA

MACHINE LEARNING. Methods for feature extraction and reduction of dimensionality: Probabilistic PCA and kernel PCA 1 MACHINE LEARNING Methods for feature extraction and reduction of dimensionality: Probabilistic PCA and kernel PCA 2 Practicals Next Week Next Week, Practical Session on Computer Takes Place in Room GR

More information

Uncertainty Management and Quantification in Industrial Analysis and Design

Uncertainty Management and Quantification in Industrial Analysis and Design Uncertainty Management and Quantification in Industrial Analysis and Design www.numeca.com Charles Hirsch Professor, em. Vrije Universiteit Brussel President, NUMECA International The Role of Uncertainties

More information

Incomplete LU Preconditioning and Error Compensation Strategies for Sparse Matrices

Incomplete LU Preconditioning and Error Compensation Strategies for Sparse Matrices Incomplete LU Preconditioning and Error Compensation Strategies for Sparse Matrices Eun-Joo Lee Department of Computer Science, East Stroudsburg University of Pennsylvania, 327 Science and Technology Center,

More information

Dynamic System Identification using HDMR-Bayesian Technique

Dynamic System Identification using HDMR-Bayesian Technique Dynamic System Identification using HDMR-Bayesian Technique *Shereena O A 1) and Dr. B N Rao 2) 1), 2) Department of Civil Engineering, IIT Madras, Chennai 600036, Tamil Nadu, India 1) ce14d020@smail.iitm.ac.in

More information

Journal of Computational Physics

Journal of Computational Physics Journal of Computational Physics 229 (2010) 1536 1557 Contents lists available at ScienceDirect Journal of Computational Physics journal homepage: www.elsevier.com/locate/jcp Multi-element probabilistic

More information

A Hybrid Method for the Wave Equation. beilina

A Hybrid Method for the Wave Equation.   beilina A Hybrid Method for the Wave Equation http://www.math.unibas.ch/ beilina 1 The mathematical model The model problem is the wave equation 2 u t 2 = (a 2 u) + f, x Ω R 3, t > 0, (1) u(x, 0) = 0, x Ω, (2)

More information

Linear Solvers. Andrew Hazel

Linear Solvers. Andrew Hazel Linear Solvers Andrew Hazel Introduction Thus far we have talked about the formulation and discretisation of physical problems...... and stopped when we got to a discrete linear system of equations. Introduction

More information

Probabilistic collocation and Lagrangian sampling for tracer transport in randomly heterogeneous porous media

Probabilistic collocation and Lagrangian sampling for tracer transport in randomly heterogeneous porous media Eidgenössische Technische Hochschule Zürich Ecole polytechnique fédérale de Zurich Politecnico federale di Zurigo Swiss Federal Institute of Technology Zurich Probabilistic collocation and Lagrangian sampling

More information

Linear Regression and Its Applications

Linear Regression and Its Applications Linear Regression and Its Applications Predrag Radivojac October 13, 2014 Given a data set D = {(x i, y i )} n the objective is to learn the relationship between features and the target. We usually start

More information

Solving the stochastic steady-state diffusion problem using multigrid

Solving the stochastic steady-state diffusion problem using multigrid IMA Journal of Numerical Analysis (2007) 27, 675 688 doi:10.1093/imanum/drm006 Advance Access publication on April 9, 2007 Solving the stochastic steady-state diffusion problem using multigrid HOWARD ELMAN

More information

Uncertainty Quantification and hypocoercivity based sensitivity analysis for multiscale kinetic equations with random inputs.

Uncertainty Quantification and hypocoercivity based sensitivity analysis for multiscale kinetic equations with random inputs. Uncertainty Quantification and hypocoercivity based sensitivity analysis for multiscale kinetic equations with random inputs Shi Jin University of Wisconsin-Madison, USA Shanghai Jiao Tong University,

More information

PARALLEL COMPUTATION OF 3D WAVE PROPAGATION BY SPECTRAL STOCHASTIC FINITE ELEMENT METHOD

PARALLEL COMPUTATION OF 3D WAVE PROPAGATION BY SPECTRAL STOCHASTIC FINITE ELEMENT METHOD 13 th World Conference on Earthquake Engineering Vancouver, B.C., Canada August 1-6, 24 Paper No. 569 PARALLEL COMPUTATION OF 3D WAVE PROPAGATION BY SPECTRAL STOCHASTIC FINITE ELEMENT METHOD Riki Honda

More information

Advances in Water Resources

Advances in Water Resources Advances in Water Resources 32 (2009) 329 339 Contents lists available at ScienceDirect Advances in Water Resources journal homepage: www.elsevier.com/locate/advwatres Efficient uncertainty quantification

More information

At A Glance. UQ16 Mobile App.

At A Glance. UQ16 Mobile App. At A Glance UQ16 Mobile App Scan the QR code with any QR reader and download the TripBuilder EventMobile app to your iphone, ipad, itouch or Android mobile device. To access the app or the HTML 5 version,

More information

Probabilistic collocation method for strongly nonlinear problems: 1. Transform by location

Probabilistic collocation method for strongly nonlinear problems: 1. Transform by location WATER RESOURCES RESEARCH, VOL. 49, 7911 7928, doi:10.1002/2013wr014055, 2013 Probabilistic collocation method for strongly nonlinear problems: 1. Transform by location Qinzhuo Liao 1 and Dongxiao Zhang

More information

Model Calibration under Uncertainty: Matching Distribution Information

Model Calibration under Uncertainty: Matching Distribution Information Model Calibration under Uncertainty: Matching Distribution Information Laura P. Swiler, Brian M. Adams, and Michael S. Eldred September 11, 008 AIAA Multidisciplinary Analysis and Optimization Conference

More information

Fundamentals of Data Assimila1on

Fundamentals of Data Assimila1on 014 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO July 14-16, 014 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University

More information

CS 450 Numerical Analysis. Chapter 8: Numerical Integration and Differentiation

CS 450 Numerical Analysis. Chapter 8: Numerical Integration and Differentiation Lecture slides based on the textbook Scientific Computing: An Introductory Survey by Michael T. Heath, copyright c 2018 by the Society for Industrial and Applied Mathematics. http://www.siam.org/books/cl80

More information

Linear Algebra and Eigenproblems

Linear Algebra and Eigenproblems Appendix A A Linear Algebra and Eigenproblems A working knowledge of linear algebra is key to understanding many of the issues raised in this work. In particular, many of the discussions of the details

More information

Block-diagonal preconditioning for spectral stochastic finite-element systems

Block-diagonal preconditioning for spectral stochastic finite-element systems IMA Journal of Numerical Analysis (2009) 29, 350 375 doi:0.093/imanum/drn04 Advance Access publication on April 4, 2008 Block-diagonal preconditioning for spectral stochastic finite-element systems CATHERINE

More information

Uncertainty Quantification and Validation Using RAVEN. A. Alfonsi, C. Rabiti. Risk-Informed Safety Margin Characterization. https://lwrs.inl.

Uncertainty Quantification and Validation Using RAVEN. A. Alfonsi, C. Rabiti. Risk-Informed Safety Margin Characterization. https://lwrs.inl. Risk-Informed Safety Margin Characterization Uncertainty Quantification and Validation Using RAVEN https://lwrs.inl.gov A. Alfonsi, C. Rabiti North Carolina State University, Raleigh 06/28/2017 Assumptions

More information

Machine Learning. B. Unsupervised Learning B.2 Dimensionality Reduction. Lars Schmidt-Thieme, Nicolas Schilling

Machine Learning. B. Unsupervised Learning B.2 Dimensionality Reduction. Lars Schmidt-Thieme, Nicolas Schilling Machine Learning B. Unsupervised Learning B.2 Dimensionality Reduction Lars Schmidt-Thieme, Nicolas Schilling Information Systems and Machine Learning Lab (ISMLL) Institute for Computer Science University

More information

Overview of sparse system identification

Overview of sparse system identification Overview of sparse system identification J.-Ch. Loiseau 1 & Others 2, 3 1 Laboratoire DynFluid, Arts et Métiers ParisTech, France 2 LIMSI, Université d Orsay CNRS, France 3 University of Washington, Seattle,

More information

A Spectral Approach to Linear Bayesian Updating

A Spectral Approach to Linear Bayesian Updating A Spectral Approach to Linear Bayesian Updating Oliver Pajonk 1,2, Bojana V. Rosic 1, Alexander Litvinenko 1, and Hermann G. Matthies 1 1 Institute of Scientific Computing, TU Braunschweig, Germany 2 SPT

More information

Simulation of simply cross correlated random fields by series expansion methods

Simulation of simply cross correlated random fields by series expansion methods Available online at www.sciencedirect.com STRUCTURAL SAFETY Structural Safety 30 (2008) 337 363 www.elsevier.com/locate/strusafe Simulation of simply cross correlated random fields by series expansion

More information

Robustness of Principal Components

Robustness of Principal Components PCA for Clustering An objective of principal components analysis is to identify linear combinations of the original variables that are useful in accounting for the variation in those original variables.

More information

Measure-Theoretic parameter estimation and prediction for contaminant transport and coastal ocean modeling

Measure-Theoretic parameter estimation and prediction for contaminant transport and coastal ocean modeling Measure-Theoretic parameter estimation and prediction for contaminant transport and coastal ocean modeling Steven Mattis and Lindley Graham RMSWUQ 2015 July 17, 2015 Collaborators 2/45 The University of

More information

Practical Linear Algebra: A Geometry Toolbox

Practical Linear Algebra: A Geometry Toolbox Practical Linear Algebra: A Geometry Toolbox Third edition Chapter 12: Gauss for Linear Systems Gerald Farin & Dianne Hansford CRC Press, Taylor & Francis Group, An A K Peters Book www.farinhansford.com/books/pla

More information

CS168: The Modern Algorithmic Toolbox Lecture #8: How PCA Works

CS168: The Modern Algorithmic Toolbox Lecture #8: How PCA Works CS68: The Modern Algorithmic Toolbox Lecture #8: How PCA Works Tim Roughgarden & Gregory Valiant April 20, 206 Introduction Last lecture introduced the idea of principal components analysis (PCA). The

More information

Introduction to Uncertainty Quantification in Computational Science Handout #3

Introduction to Uncertainty Quantification in Computational Science Handout #3 Introduction to Uncertainty Quantification in Computational Science Handout #3 Gianluca Iaccarino Department of Mechanical Engineering Stanford University June 29 - July 1, 2009 Scuola di Dottorato di

More information

Slide05 Haykin Chapter 5: Radial-Basis Function Networks

Slide05 Haykin Chapter 5: Radial-Basis Function Networks Slide5 Haykin Chapter 5: Radial-Basis Function Networks CPSC 636-6 Instructor: Yoonsuck Choe Spring Learning in MLP Supervised learning in multilayer perceptrons: Recursive technique of stochastic approximation,

More information

EFFICIENT STOCHASTIC GALERKIN METHODS FOR RANDOM DIFFUSION EQUATIONS

EFFICIENT STOCHASTIC GALERKIN METHODS FOR RANDOM DIFFUSION EQUATIONS EFFICIENT STOCHASTIC GALERKIN METHODS FOR RANDOM DIFFUSION EQUATIONS DONGBIN XIU AND JIE SHEN Abstract. We discuss in this paper efficient solvers for stochastic diffusion equations in random media. We

More information