Collocation based high dimensional model representation for stochastic partial differential equations

Similar documents
A Vector-Space Approach for Stochastic Finite Element Analysis

Dynamic response of structures with uncertain properties

Comput. Methods Appl. Mech. Engrg.

Spectral methods for fuzzy structural dynamics: modal vs direct approach

Probabilistic Structural Dynamics: Parametric vs. Nonparametric Approach

Polynomial Chaos and Karhunen-Loeve Expansion

Efficient Solvers for Stochastic Finite Element Saddle Point Problems

Implementation of Sparse Wavelet-Galerkin FEM for Stochastic PDEs

Stochastic Spectral Approaches to Bayesian Inference

Solving the steady state diffusion equation with uncertainty Final Presentation

Hierarchical Parallel Solution of Stochastic Systems

Reduction of Random Variables in Structural Reliability Analysis

Random Eigenvalue Problems in Structural Dynamics: An Experimental Investigation

Sparse polynomial chaos expansions in engineering applications

Introduction to Computational Stochastic Differential Equations

linearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice

Linear Algebra: Matrix Eigenvalue Problems

Schwarz Preconditioner for the Stochastic Finite Element Method

Solving the Stochastic Steady-State Diffusion Problem Using Multigrid

Random Eigenvalue Problems Revisited

PARALLEL COMPUTATION OF 3D WAVE PROPAGATION BY SPECTRAL STOCHASTIC FINITE ELEMENT METHOD

UNCERTAINTY ASSESSMENT USING STOCHASTIC REDUCED BASIS METHOD FOR FLOW IN POROUS MEDIA

Linear Algebra Review. Vectors

Performance Evaluation of Generalized Polynomial Chaos

Theorem A.1. If A is any nonzero m x n matrix, then A is equivalent to a partitioned matrix of the form. k k n-k. m-k k m-k n-k

COMPLEX MODES IN LINEAR STOCHASTIC SYSTEMS

S. Freitag, B. T. Cao, J. Ninić & G. Meschke

Elementary maths for GMT

Fundamentals of Engineering Analysis (650163)

On the Nature of Random System Matrices in Structural Dynamics

Second-Order Inference for Gaussian Random Curves

STOCHASTIC SAMPLING METHODS

Fast Numerical Methods for Stochastic Computations

Random Matrix Eigenvalue Problems in Probabilistic Structural Mechanics

Stochastic structural dynamic analysis with random damping parameters

Random Fields in Bayesian Inference: Effects of the Random Field Discretization

Review (Probability & Linear Algebra)

Structure in Data. A major objective in data analysis is to identify interesting features or structure in the data.

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Stochastic Elastic-Plastic Finite Element Method for Performance Risk Simulations

MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.

Random Vibrations & Failure Analysis Sayan Gupta Indian Institute of Technology Madras

Linear Algebra in Computer Vision. Lecture2: Basic Linear Algebra & Probability. Vector. Vector Operations

Dinesh Kumar, Mehrdad Raisee and Chris Lacor

Algebraic Theory of Entanglement

Orthogonal Polynomial Ensembles

Galerkin Methods for Linear and Nonlinear Elliptic Stochastic Partial Differential Equations

Math 1553, Introduction to Linear Algebra

Stochastic Solvers for the Euler Equations

Lecture 1: Center for Uncertainty Quantification. Alexander Litvinenko. Computation of Karhunen-Loeve Expansion:

Quantum Computing Lecture 2. Review of Linear Algebra

Review problems for MA 54, Fall 2004.

An Efficient Computational Solution Scheme of the Random Eigenvalue Problems

PART IV Spectral Methods

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2.

x. Figure 1: Examples of univariate Gaussian pdfs N (x; µ, σ 2 ).

EE731 Lecture Notes: Matrix Computations for Signal Processing

Chapter Two Elements of Linear Algebra

Chapter 7. Linear Algebra: Matrices, Vectors,

Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88

1 Matrices and Systems of Linear Equations. a 1n a 2n

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.

Math Linear Algebra Final Exam Review Sheet

Karhunen-Loève Approximation of Random Fields Using Hierarchical Matrix Techniques

Linear Algebra Review (Course Notes for Math 308H - Spring 2016)

An Empirical Chaos Expansion Method for Uncertainty Quantification

Review of Linear Algebra

DOA Estimation using MUSIC and Root MUSIC Methods

Research Article Multiresolution Analysis for Stochastic Finite Element Problems with Wavelet-Based Karhunen-Loève Expansion

Mechanics of Irregular Honeycomb Structures

Jordan normal form notes (version date: 11/21/07)

CS 143 Linear Algebra Review

A reduced-order stochastic finite element analysis for structures with uncertainties

A Dynamically Bi-Orthogonal Method for Time-Dependent Stochastic Partial Differential Equations I: Derivation and Algorithms

Polynomial chaos expansions for sensitivity analysis

Introduction to Finite Element Method

ELE/MCE 503 Linear Algebra Facts Fall 2018

Solutions to Final Exam

Solution of Linear Equations

Basic Elements of Linear Algebra

A Note on Hilbertian Elliptically Contoured Distributions

Lecture 10: Fourier Sine Series

Estimating functional uncertainty using polynomial chaos and adjoint equations

Practical Linear Algebra: A Geometry Toolbox

MATRICES. a m,1 a m,n A =

1. Foundations of Numerics from Advanced Mathematics. Linear Algebra

Quantum Physics II (8.05) Fall 2002 Assignment 3

STOCHASTIC FINITE ELEMENTS WITH MULTIPLE RANDOM NON-GAUSSIAN PROPERTIES

Linear Algebra in Actuarial Science: Slides to the lecture

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET

Linear Algebra Practice Final

Kernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt.

Functional Analysis Review

Review (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology

1 Matrices and Systems of Linear Equations

Tests for separability in nonparametric covariance operators of random surfaces

1. What is the determinant of the following matrix? a 1 a 2 4a 3 2a 2 b 1 b 2 4b 3 2b c 1. = 4, then det

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2

1 Determinants. 1.1 Determinant

Transcription:

Collocation based high dimensional model representation for stochastic partial differential equations S Adhikari 1 1 Swansea University, UK ECCM 2010: IV European Conference on Computational Mechanics, Paris Adhikari (SU) Reduced methods for SPDE 20 May 2010 1 / 52

Nanoscale Energy Harvesting: ZnO nanowires ZnO materials have attracted extensive attention due to their excellent performance in electronic, ferroelectric and piezoelectric applications. Nano-scale ZnO is an important material for the nanoscale energy harvesting and scavenging. Investigation and understanding of the bending of ZnO nanowires are valuable for their potential application. For example, ZnO nanowires are bend by rubbing against each other for energy scavenging. Adhikari (SU) Reduced methods for SPDE 20 May 2010 2 / 52

Rubbing the right way When ambient vibrations move a microfibre covered with zinc oxide nanowires (blue) back and forth with respect to a similar fibre that has been coated with gold (orange), electrical energy is produced because ZnO is a piezoelectric material; Nature Nanotechnology, Vol 3, March 2008, pp 123. Adhikari (SU) Reduced methods for SPDE 20 May 2010 3 / 52

Power shirt Adhikari (SU) Reduced methods for SPDE 20 May 2010 4 / 52

Collection of ZnO A collection of vertically grown ZnO NWs. This can be viewed as the sample space for the application of stochastic finite element method. Adhikari (SU) Reduced methods for SPDE 20 May 2010 5 / 52

Stochastic nanomechanics: computational challenges When applying the continuum stochastic mechanics at the nanoscale, the following points need to be considered: The finite element discretization should be very small to take account of nanoscale spatial resolution (large n). Due to the small length-scale, the uncertainties are relatively large (as can be seen in the SEM images (large σ). The correlation length, which governs the statistical correlation between two points in the space is generally very small. This is because the interaction between the atoms reduces significantly with distance. This can be understood, for example, by looking at the Lennard-Jones potential V (r) = 4ɛ [ ( rmin r ) 12 ( rmin r ) ] 6 (large M). Since the standard deviation σ, the degrees-of-freedom n and the number of random variables M are all expected to be large, stochastic nanomechanics is particularity challenging as the computational cost can be significantly higher. Adhikari (SU) Reduced methods for SPDE 20 May 2010 6 / 52

Outline of the talk 1 Introduction Stochastic elliptic PDEs 2 Spectral decomposition in a vector space Projection in a finite dimensional vector-space Properties of the spectral functions 3 Error minimization in the Hilbert space The Galerkin approach Computational method 4 Numerical illustration ZnO nanowires Results for larger correlation length Results for smaller correlation length 5 Conclusions 6 Acknowledgements Adhikari (SU) Reduced methods for SPDE 20 May 2010 7 / 52

Introduction Stochastic elliptic PDEs Stochastic elliptic PDE We consider the stochastic elliptic partial differential equation (PDE) [a(r, ω) u(r, ω)] = p(r); r in D (1) with the associated boundary condition u(r, ω) = 0; r on D (2) Here a : R d Ω R is a random field, which can be viewed as a set of random variables indexed by r R d. We assume the random field a(r, ω) to be stationary and square integrable. Based on the physical problem the random field a(r, ω) can be used to model different physical quantities. Adhikari (SU) Reduced methods for SPDE 20 May 2010 8 / 52

Introduction Stochastic elliptic PDEs Discretized Stochastic PDE The random process a(r, ω) can be expressed in a generalized fourier type of series known as the Karhunen-Loève expansion a(r, ω) = a 0 (r) + νi ξ i (ω)ϕ i (r) (3) Here a 0 (r) is the mean function, ξ i (ω) are uncorrelated standard Gaussian random variables, ν i and ϕ i (r) are eigenvalues and eigenfunctions satisfying the integral equation D C a(r 1, r 2 )ϕ j (r 1 )dr 1 = ν j ϕ j (r 2 ), j = 1, 2,. Truncating the series (3) upto the M-th term, substituting a(r, ω) in the governing PDE (1) and applying the boundary conditions, the discretized equation can be written as [ ] M A 0 + ξ i (ω)a i u(ω) = f (4) i=1 i=1 Adhikari (SU) Reduced methods for SPDE 20 May 2010 9 / 52

Introduction Stochastic elliptic PDEs Polynomial Chaos expansion Using the Polynomial Chaos expansion, the solution (a vector valued function) can be expressed as u(ω) = u i0 h 0 + u i1 h 1 (ξ i1 (ω)) + i 1 i 1 =1 i 2 =1 + i 1 i 1 =1 i 1 =1 i 2 =1 i 3 =1 + u i1,i 2 h 2 (ξ i1 (ω), ξ i2 (ω)) i 2 i 1 i 2 i 3 i 1 =1 i 2 =1 i 3 =1 i 4 =1 u i1 i 2 i 3 h 3 (ξ i1 (ω), ξ i2 (ω), ξ i3 (ω)) u i1 i 2 i 3 i 4 h 4 (ξ i1 (ω), ξ i2 (ω), ξ i3 (ω), ξ i4 (ω)) +..., Here u i1,...,i p R n are deterministic vectors to be determined. Adhikari (SU) Reduced methods for SPDE 20 May 2010 10 / 52

Introduction Stochastic elliptic PDEs Polynomial Chaos expansion After the finite truncation, concisely, the polynomial chaos expansion can be written as û(ω) = P H k (ξ(ω))u k (5) k=1 where H k (ξ(ω)) are the polynomial chaoses. The value of the number of terms P depends on the number of basic random variables M and the order of the PC expansion r as P = r j=0 (M + j 1)! j!(m 1)! (6) Adhikari (SU) Reduced methods for SPDE 20 May 2010 11 / 52

Introduction Stochastic elliptic PDEs Some basics of linear algebra Definition (Linearly independent vectors) A set of vectors {φ 1, φ 2,..., φ n } is linearly independent if the expression n k=1 α kφ k = 0 if and only if α k = 0 for all k = 1, 2,..., n. Remark (The spanning property) Suppose {φ 1, φ 2,..., φ n } is a complete basis in the Hilbert space H. Then for every nonzero u H, it is possible to choose α 1, α 2,..., α n 0 uniquely such that u = α 1 φ 1 + α 2 φ 2 +... α n φ n. Adhikari (SU) Reduced methods for SPDE 20 May 2010 12 / 52

Introduction Stochastic elliptic PDEs Polynomial Chaos expansion We can split the Polynomial Chaos type of expansions as û(ω) = n H k (ξ(ω))u k + k=1 P k=n+1 H k (ξ(ω))u k (7) According to the spanning property of a complete basis in R n it is always possible to project û(ω) in a finite dimensional vector basis for any ω Ω. Therefore, in a vector polynomial chaos expansion (7), all u k for k > n must be linearly dependent. This is the motivation behind seeking a finite dimensional expansion. Adhikari (SU) Reduced methods for SPDE 20 May 2010 13 / 52

Spectral decomposition in a vector space Projection in a finite dimensional vector-space Projection in a finite dimensional vector-space Theorem There exist a finite set of functions Γ k : (R m Ω) (R Ω) and an orthonormal basis φ k R n for k = 1, 2,..., n such that the series û(ω) = n Γ k (ξ(ω))φ k (8) k=1 converges to the exact solution of the discretized stochastic finite element equation (4) with probability 1. Outline of proof: The first step is to generate a complete orthonormal basis. We use the eigenvectors φ k R n of the matrix A 0 such that A 0 φ k = λ 0k φ k ; k = 1, 2,... n (9) Adhikari (SU) Reduced methods for SPDE 20 May 2010 14 / 52

Spectral decomposition in a vector space Projection in a finite dimensional vector-space Projection in a finite dimensional vector-space We define the matrix of eigenvalues and eigenvectors Λ 0 = diag [λ 01, λ 02,..., λ 0n ] R n n ; Φ = [φ 1, φ 2,..., φ n ] R n n (10) Eigenvalues are ordered in the ascending order: λ 01 < λ 02 <... < λ 0n. Since Φ is an orthogonal matrix we have Φ 1 = Φ T so that: Φ T A 0 Φ = Λ 0 ; A 0 = Φ T Λ 0 Φ 1 and A 1 0 = ΦΛ 1 0 ΦT (11) We also introduce the transformations à i = Φ T A i Φ R n n ; i = 0, 1, 2,..., M (12) Note that Ã0 = Λ 0, a diagonal matrix and A i = Φ T à i Φ 1 R n n ; i = 1, 2,..., M (13) Adhikari (SU) Reduced methods for SPDE 20 May 2010 15 / 52

Spectral decomposition in a vector space Projection in a finite dimensional vector-space Projection in a finite dimensional vector-space Suppose the solution of Eq. (4) is given by [ ] 1 M û(ω) = A 0 + ξ i (ω)a i f (14) Using Eqs. (10) (13) and the orthonormality of Φ one has [ ] 1 M û(ω) = Φ T Λ 0 Φ 1 + ξ i (ω)φ T Ã i Φ 1 f = ΦΨ (ξ(ω)) Φ T f i=1 i=1 where [ Ψ (ξ(ω)) = Λ 0 + (15) 1 M ξ i (ω)ãi] (16) and the M-dimensional random vector ξ(ω) = {ξ 1 (ω), ξ 2 (ω),..., ξ M (ω)} T (17) i=1 Adhikari (SU) Reduced methods for SPDE 20 May 2010 16 / 52

Spectral decomposition in a vector space Projection in a finite dimensional vector-space Projection in a finite dimensional vector-space Now we separate the diagonal and off-diagonal terms of the Ãi matrices as à i = Λ i + i, i = 1, 2,..., M (18) Here the diagonal matrix ] Λ i = diag [à = diag [ ] λ i1, λ i2,..., λ in R n n (19) and i = Ãi Λ i is an off-diagonal only matrix. M M Ψ (ξ(ω)) = Λ 0 + ξ i (ω)λ i + ξ i (ω) i i=1 i=1 }{{}}{{} Λ(ξ(ω)) (ξ(ω)) 1 (20) where Λ (ξ(ω)) R n n is a diagonal matrix and (ξ(ω)) is an off-diagonal only matrix. Adhikari (SU) Reduced methods for SPDE 20 May 2010 17 / 52

Spectral decomposition in a vector space Projection in a finite dimensional vector-space Projection in a finite dimensional vector-space We rewrite Eq. (20) as Ψ (ξ(ω)) = [ [ 1 Λ (ξ(ω)) I n + Λ 1 (ξ(ω)) (ξ(ω))]] (21) The above expression can be represented using a Neumann type of matrix series as Ψ (ξ(ω)) = [ s ( 1) s Λ 1 (ξ(ω)) (ξ(ω))] Λ 1 (ξ(ω)) (22) s=0 Adhikari (SU) Reduced methods for SPDE 20 May 2010 18 / 52

Spectral decomposition in a vector space Projection in a finite dimensional vector-space Polynomial Chaos expansion Taking an arbitrary r-th element of û(ω), Eq. (15) can be rearranged to have n n ( f) û r (ω) = Ψ kj (ξ(ω)) φ T j (23) Defining k=1 Φ rk Γ k (ξ(ω)) = j=1 n j=1 ( ) Ψ kj (ξ(ω)) φ T j f and collecting all the elements in Eq. (23) for r = 1, 2,..., n one has û(ω) = (24) n Γ k (ξ(ω)) φ k (25) k=1 Adhikari (SU) Reduced methods for SPDE 20 May 2010 19 / 52

Spectral decomposition in a vector space Properties of the spectral functions Spectral functions Definition The functions Γ k (ξ(ω)), k = 1, 2,... n are called the spectral functions as they are expressed in terms of the spectral properties of the coefficient matrices of the governing discretized equation. The main difficulty in applying this result is that each of the spectral functions Γ k (ξ(ω)) contain infinite number of terms and they are highly nonlinear functions of the random variables ξ i (ω). For computational purposes, it is necessary to truncate the series after certain number of terms. Different order of spectral functions can be obtained by using truncation in the expression of Γ k (ξ(ω)) Adhikari (SU) Reduced methods for SPDE 20 May 2010 20 / 52

Spectral decomposition in a vector space Properties of the spectral functions First-order spectral functions Definition The first-order spectral functions Γ (1) k (ξ(ω)), k = 1, 2,..., n are obtained by retaining one term in the series (22). Retaining one term in (22) we have Ψ (1) (ξ(ω)) = Λ 1 (ξ(ω)) or Ψ (1) kj (ξ(ω)) = δ kj λ 0k + M i=1 ξ i(ω)λ ik(26) Using the definition of the spectral function in Eq. (24), the first-order spectral functions can be explicitly obtained as n ( ) Γ (1) k (ξ(ω)) = Ψ (1) kj (ξ(ω)) φ T φ T k j f = f λ 0k + M i=1 ξ (27) i(ω)λ ik j=1 From this expression it is clear that Γ (1) k (ξ(ω)) are non-gaussian random variables even if ξ i (ω) are Gaussian random variables. Adhikari (SU) Reduced methods for SPDE 20 May 2010 21 / 52

Spectral decomposition in a vector space Properties of the spectral functions Second-order spectral functions Definition The second-order spectral functions Γ (2) k (ξ(ω)), k = 1, 2,..., n are obtained by retaining two terms in the series (22). Retaining two terms in (22) we have Ψ (2) (ξ(ω)) = Λ 1 (ξ(ω)) Λ 1 (ξ(ω)) (ξ(ω)) Λ 1 (ξ(ω)) (28) Using the definition of the spectral function in Eq. (24), the second-order spectral functions can be obtained in closed-form as Γ (2) k (ξ(ω)) = φ T k f λ 0k + M n j=1 i=1 ξ i(ω)λ ik ( φ T j f) M i=1 ξ i(ω) ikj ( λ 0k + M i=1 ξ i(ω)λ ik ) ( λ 0j + M i=1 ξ i(ω)λ ij ) (29) Adhikari (SU) Reduced methods for SPDE 20 May 2010 22 / 52

Spectral decomposition in a vector space Properties of the spectral functions Analysis of spectral functions The spectral basis functions are not simple polynomials, but ratio of polynomials in ξ(ω). We now look into the functional nature of the solution u(ω) in terms of the random variables ξ i (ω). Theorem If all A i R n n are matrices of rank n, then the elements of u(ω) are the ratio of polynomials of the form p (n 1) (ξ 1 (ω), ξ 2 (ω),..., ξ M (ω)) p (n) (ξ 1 (ω), ξ 2 (ω),..., ξ M (ω)) (30) where p (n) (ξ 1 (ω), ξ 2 (ω),..., ξ M (ω)) is an n-th order complete multivariate polynomial of variables ξ 1 (ω), ξ 2 (ω),..., ξ M (ω). Adhikari (SU) Reduced methods for SPDE 20 May 2010 23 / 52

Spectral decomposition in a vector space Properties of the spectral functions Analysis of spectral functions Suppose we denote so that A(ω) = [ A 0 + ] M ξ i (ω)a i R n n (31) i=1 From the definition of the matrix inverse we have u(ω) = A 1 (ω)f (32) A 1 = Adj(A) det (A) = CT a det (A) (33) where C a is the matrix of cofactors. The determinant of A contains a maximum of n number of products of A kj and their linear combinations. Note from Eq. (31) that M A kj (ω) = A 0kj + ξ i (ω)a ikj (34) i=1 Adhikari (SU) Reduced methods for SPDE 20 May 2010 24 / 52

Spectral decomposition in a vector space Properties of the spectral functions Analysis of spectral functions Since all the matrices are of full rank, the determinant contains a maximum of n number of products of linear combination of random variables in Eq. (34). On the other hand, each entries of the matrix of cofactors, contains a maximum of (n 1) number of products of linear combination of random variables in Eq. (34). From Eqs. (32) and (33) it follows that u(ω) = CT a f det (A) (35) Therefore, the numerator of each element of the solution vector contains linear combinations of the elements of the cofactor matrix, which are complete polynomials of order (n 1). The result derived in this theorem is important because the solution methods proposed for stochastic finite element analysis essentially aim to approximate the ratio of the polynomials given in Eq. (30). Adhikari (SU) Reduced methods for SPDE 20 May 2010 25 / 52

Spectral decomposition in a vector space Properties of the spectral functions Analysis of spectral functions Theorem The linear combination of the spectral functions has the same functional form in (ξ 1 (ω), ξ 2 (ω),..., ξ M (ω)) as the elements of the solution vector, that is, û r (ω) p(n 1) r (ξ 1 (ω), ξ 2 (ω),..., ξ M (ω)) p (n), r = 1, 2,..., n (36) r (ξ 1 (ω), ξ 2 (ω),..., ξ M (ω)) When first-order spectral functions (27) are considered, we have û (1) r (ω) = n k=1 Γ (1) k (ξ(ω)) φ rk = n k=1 φ T k f λ 0k + M i=1 ξ i(ω)λ ik φ rk (37) All (λ 0k + M i=1 ξ i(ω)λ ik ) are different for different k because it is assumed that all eigenvalues λ 0k are distinct. Adhikari (SU) Reduced methods for SPDE 20 May 2010 26 / 52

Spectral decomposition in a vector space Properties of the spectral functions Analysis of spectral functions Carrying out the above summation one has n number of products of (λ 0k + M i=1 ξ i(ω)λ ik ) in the denominator and n sums of (n 1) number of products of (λ 0k + M i=1 ξ i(ω)λ ik ) in the numerator, that is, û (1) r (ω) = ( j=1 k λ 0j + ) M i=1 ξ i(ω)λ ij ( n 1 k=1 λ 0j + ) (38) M i=1 ξ i(ω)λ ij n k=1 (φt k f)φ rk n 1 Adhikari (SU) Reduced methods for SPDE 20 May 2010 27 / 52

Error minimization in the Hilbert space The Galerkin approach The Galerkin approach There exist a set of finite functions Γ k : (R m Ω) (R Ω), constants c k R and orthonormal vectors φ k R n for k = 1, 2,..., n such that the series n û(ω) = c k Γk (ξ(ω))φ k (39) k=1 converges to the exact solution of the discretized stochastic finite element equation (4) in the mean-square sense provided the vector c = {c 1, c 2,..., c n } T satisfies the n n algebraic equations S c = b with M S jk = Ã ijk D ijk ; j, k = 1, 2,..., n; Ãi jk = φ T j A i φ k, (40) i=0 [ ] D ijk = E ξ i (ω) Γ j (ξ(ω)) Γ k (ξ(ω)) ] ( ) and b j = E [ Γj (ξ(ω)) φ T j f. (41) Adhikari (SU) Reduced methods for SPDE 20 May 2010 28 / 52

Error minimization in the Hilbert space The Galerkin approach The Galerkin approach The error vector can be obtained as ( M ) ( n ) ε(ω) = A i ξ i (ω) c k Γk (ξ(ω))φ k f R n (42) i=0 k=1 } The solution is viewed as a projection where { Γk (ξ(ω))φ k R n are the basis functions and c k are the unknown constants to be determined. We wish to obtain the coefficients c k such that the error norm χ 2 = ε(ω), ε(ω) is minimum. This can be achieved using the Galerkin approach so that the error is made orthogonal to the basis functions, that is, mathematically ) ε(ω) ( Γj (ξ(ω))φ j or Γj (ξ(ω))φ j, ε(ω) = 0 j = 1, 2,..., n (43) Adhikari (SU) Reduced methods for SPDE 20 May 2010 29 / 52

Error minimization in the Hilbert space The Galerkin approach The Galerkin approach Imposing the orthogonality condition and using the expression of the error one has [ ( M ) ( n ) ] E Γj (ξ(ω))φ T j A i ξ i (ω) c k Γk (ξ(ω))φ k Γ j (ξ(ω))φ T j f = i=0 k=1 (44) Interchanging the E [ ] and summation operations, this can be simplified to ( n M k=1 i=0 ) [ (φ T j A i φ k E ξ i (ω) Γ j (ξ(ω)) Γ k (ξ(ω))] ) c k = ] ( ) E [ Γj (ξ(ω)) φ T j f (45) or ( n M ) Ã ijk D ijk c k = b j (46) k=1 i=0 Adhikari (SU) Reduced methods for SPDE 20 May 2010 30 / 52

Error minimization in the Hilbert space Computational method Computational method The mean vector can be obtained as ū = E [û(ω)] = n k=1 ] c k E [ Γk (ξ(ω)) φ k (47) The covariance of the solution vector can be expressed as [ ] Σ u = E (û(ω) ū) (û(ω) ū) T = n k=1 j=1 n c k c j Σ Γkj φ k φ T j (48) where the elements of the covariance matrix of the spectral functions are given by ])] Σ Γkj = E [( Γk (ξ(ω)) E [ Γk (ξ(ω))]) ( Γj (ξ(ω)) E [ Γj (ξ(ω)) (49) Adhikari (SU) Reduced methods for SPDE 20 May 2010 31 / 52

Error minimization in the Hilbert space Computational method Summary of the computational method 1 Solve the eigenvalue problem associated with the mean matrix A 0 to generate the orthonormal basis vectors: A 0 Φ = Λ 0 Φ 2 Select a number of samples, say N samp. Generate the samples of basic random variables ξ i (ω), i = 1, 2,..., M. 3 Calculate the spectral basis functions (for example, first-order): φ T k f Γ k (ξ(ω)) = λ 0k + M i=1 ξ i (ω)λ ik 4 Obtain the coefficient vector: c = S 1 b R n, where b = f Γ, S = Λ 0 D 0 + M [ i=1 Ãi ] D i and D i = E Γ(ω)ξ i (ω)γ T (ω), i = 0, 1, 2,..., M 5 Obtain the samples of the response from the spectral series: û(ω) = n k=1 c kγ k (ξ(ω))φ k Adhikari (SU) Reduced methods for SPDE 20 May 2010 32 / 52

Error minimization in the Hilbert space Computational method Computational complexity The spectral functions Γ k (ξ(ω)) are highly non-gaussian in nature and do not in general enjoy any orthogonality properties like the Hermite polynomials or any other orthogonal polynomials with respect to the underlying probability measure. The coefficient matrix S and the vector b should be obtained numerically using the Monte Carlo simulation or other numerical integration technique. The simulated spectral functions can also be recycled to obtain the statistics and probability density function (pdf) of the solution. The main computational cost of the proposed method depends on (a) the solution of the matrix eigenvalue problem, (b) the generation of the coefficient matrices D i, and (c) the calculation of the coefficient vector by solving linear matrix equation. Adhikari (SU) Reduced methods for SPDE 20 May 2010 33 / 52

Error minimization in the Hilbert space Computational method Computational complexity Both the linear matrix algebraic and the matrix eigenvalue problem scales in O(n 3 ) in the worse case. The calculation of the coefficient matrices scales linearly with M and n(n + 1)/2 with n. Therefore, this cost scales with O((M + 1) n(n + 1)/2). The overall cost is 2O(n 3 ) + O((M + 1) n(n + 1)/2). For large M and n, asymptotically the computational cost becomes C s = O(Mn 2 ) + O(n 3 ). The important point to note here that the proposed approach scales linearly with the number of random variables M. For comparison, in the classical PC expansion one needs to solve a matrix equation of dimension Pn, which in the worse case scales with (O(Pn) 3 ). Since P M, we have O(P 3 n 3 ) O(Mn 2 ) + O(n 3 ). Adhikari (SU) Reduced methods for SPDE 20 May 2010 34 / 52

Numerical illustration ZnO nanowires Collection of ZnO: Close up Uncertainties in ZnO NWs in the close up view. The uncertain parameter include geometric parameters such as the length and the cross sectional area along the length, boundary condition and material properties. Adhikari (SU) Reduced methods for SPDE 20 May 2010 35 / 52

Numerical illustration ZnO nanowires ZnO nanowires For the future nano energy scavenging devices several thousands of ZnO NWs will be used simultaneously. This gives a natural framework for the application of stochastic finite element method due a large sample space. ZnO NWs have the nano piezoelastic property so that the electric charge generated is a function of the deformation. It is therefore vitally important to look into the ensemble behavior of the deformation of ZnO NW for the reliable estimate of mechanical deformation and consequently the charge generation. For the nano-scale application this is especially crucial as the margin of error is very small. Here we study the deformation of a cantilevered ZnO NW with stochastic properties under the Atomic Force Microscope (AFM) tip. Adhikari (SU) Reduced methods for SPDE 20 May 2010 36 / 52

Numerical illustration ZnO nanowires ZnO nanowires (a) The SEM image of a collection of ZnO NW showing hexagonal cross sectional area. (b) The atomic structure of the cross section of a ZnO NW (the red is O 2 and the grey is Zn atom) Adhikari (SU) Reduced methods for SPDE 20 May 2010 37 / 52

Numerical illustration ZnO nanowires ZnO nanowires (c) The atomistic model of a ZnO NW (d) The continuum idealization of a cantilevered ZnO NW under an AFM tip. grown from a ZnO crystal in the (0, 0, 0, 1) direction. Adhikari (SU) Reduced methods for SPDE 20 May 2010 38 / 52

Numerical illustration ZnO nanowires Problem details We study the deflection of ZnO NW under the AFM tip considering stochastically varying bending modulus. The variability of the deflection is particularly important as the harvested energy from the bending depends on it. We assume that the bending modulus of the ZnO NW is a homogeneous stationary Gaussian random field of the form EI(x, ω) = EI 0 (1 + a(x, ω)) (50) where x is the coordinate along the length of ZnO NW, EI 0 is the estimate of the mean bending modulus, a(x, ω) is a zero mean stationary Gaussian random field. The autocorrelation function of this random field is assumed to be C a (x 1, x 2 ) = σ 2 ae ( x 1 x 2 )/µ a (51) where µ a is the correlation length and σ a is the standard deviation. Adhikari (SU) Reduced methods for SPDE 20 May 2010 39 / 52

Numerical illustration ZnO nanowires Problem details We consider a long nanowire where the continuum model has been validated. We use the baseline parameters for the ZnO NW from Gao and Wang (Nano Letters 7 (8) (2007), 2499 2505) as the length L = 600nm, diameter d = 50nm and the lateral point force at the tip f T = 80nN. Using these data, the baseline deflection can be obtained as δ 0 = 145nm. We normalize our results with this baseline value for convenience. Two correlation lengths are considered in the numerical studies: µ a = L/3 and µ a = L/10. The number of terms M in the KL expansion becomes 24 and 67 (95% capture). The nanowire is divided into 50 beam elements of equal length. The number of degrees of freedom of the model n = 100 (standard beam element). Adhikari (SU) Reduced methods for SPDE 20 May 2010 40 / 52

Numerical illustration Results for larger correlation length Moments: larger correlation length (e) Mean of the normalized deflection. (f) Standard deviation of the normalized deflection. Figure: The number of random variable used: M = 24. The number of degrees of freedom: n = 100. Adhikari (SU) Reduced methods for SPDE 20 May 2010 41 / 52

Numerical illustration Results for larger correlation length Error in moments: larger correlation length Statistics Methods σ a = 0.05 σ a = 0.10 σ a = 0.15 σ a = 0.20 Mean 1st order 0.1027 0.4240 1.0104 1.9749 Galerkin 2nd order Galerkin 0.0003 0.0045 0.0283 0.1321 Standard 1st order 1.8693 3.0517 5.2490 11.3447 Galerkin deviation 2nd order Galerkin 0.2201 1.0425 2.7690 8.2712 Percentage error in the mean and standard deviation of the deflection of the ZnO NW under the AFM tip when correlation length is µ a = L/3. For n = 100 and M = 24, if the second-order PC was used, one would need to solve a linear system of equation of size 32400. The results shown here are obtained by solving a linear system of equation of size 100 using the proposed Galerkin approach. Adhikari (SU) Reduced methods for SPDE 20 May 2010 42 / 52

Numerical illustration Results for larger correlation length Pdf: larger correlation length (a) Probability density function for σ a = 0.05. (b) Probability density function for σ a = 0.1. The probability density function of the normalized deflection δ/δ 0 of the ZnO NW under the AFM tip (δ 0 = 145nm). Adhikari (SU) Reduced methods for SPDE 20 May 2010 43 / 52

Numerical illustration Results for larger correlation length Pdf: larger correlation length (c) Probability density function for σ a = 0.15. (d) Probability density function for σ a = 0.2. The probability density function of the normalized deflection δ/δ 0 of the ZnO NW under the AFM tip (δ 0 = 145nm). Adhikari (SU) Reduced methods for SPDE 20 May 2010 44 / 52

Numerical illustration Results for smaller correlation length Moments: smaller correlation length (e) Mean of the normalized deflection. (f) Standard deviation of the normalized deflection. Figure: The number of random variable used: M = 67. The number of degrees of freedom: n = 100. Adhikari (SU) Reduced methods for SPDE 20 May 2010 45 / 52

Numerical illustration Results for smaller correlation length Error in moments: smaller correlation length Statistics Methods σ a = 0.05 σ a = 0.10 σ a = 0.15 σ a = 0.20 Mean 1st order 0.1761 0.7206 1.6829 3.1794 Galerkin 2nd order Galerkin 0.0007 0.0113 0.0642 0.6738 Standard 1st order 3.9543 5.9581 9.0305 14.6568 Galerkin deviation 2nd order Galerkin 0.3222 1.8425 4.6781 8.9037 Percentage error in the mean and standard deviation of the deflection of the ZnO NW under the AFM tip when correlation length is µ a = L/3. For n = 100 and M = 67, if the second-order PC was used, one would need to solve a linear system of equation of size 234,500. The results shown here are obtained by solving a linear system of equation of size 100 using the proposed Galerkin approach. Adhikari (SU) Reduced methods for SPDE 20 May 2010 46 / 52

Numerical illustration Results for smaller correlation length Pdf: smaller correlation length (a) Probability density function for σ a = 0.05. (b) Probability density function for σ a = 0.1. The probability density function of the normalized deflection δ/δ 0 of the ZnO NW under the AFM tip (δ 0 = 145nm). Adhikari (SU) Reduced methods for SPDE 20 May 2010 47 / 52

Numerical illustration Results for smaller correlation length Pdf: smaller correlation length (c) Probability density function for σ a = 0.15. (d) Probability density function for σ a = 0.2. The probability density function of the normalized deflection δ/δ 0 of the ZnO NW under the AFM tip (δ 0 = 145nm). Adhikari (SU) Reduced methods for SPDE 20 May 2010 48 / 52

Conclusions Conclusions 1 We consider discretised stochastic elliptic partial differential equations. 2 The solution is projected into a finite dimensional complete orthonormal vector basis and the associated coefficient functions are obtained. 3 The coefficient functions, called as the spectral functions, are expressed in terms of the spectral properties of the system matrices. 4 If n is the size of the discretized matrices and M is the number of random variables, then the computational complexity grows in O(Mn 2 ) + O(n 3 ) for large M and n in the worse case. 5 We consider a problem with 24 and 67 random variables and n = 100 degrees of freedom. A second-order PC would require the solution of equations of dimension 32,400 and 234,500 respectively. In comparison, the proposed Galerkin approach requires the solution of algebraic equations of dimension n only. Adhikari (SU) Reduced methods for SPDE 20 May 2010 49 / 52

Conclusions Conclusions (e) Basic building blocks. (f) Possible solution. An analogy of PC based solution. Adhikari (SU) Reduced methods for SPDE 20 May 2010 50 / 52

Conclusions Conclusions (g) Basic building blocks. (h) Possible solution. An analogy of the proposed spectral function based Galerkin solution. Adhikari (SU) Reduced methods for SPDE 20 May 2010 51 / 52

Acknowledgements Acknowledgements Adhikari (SU) Reduced methods for SPDE 20 May 2010 52 / 52