A Vector-Space Approach for Stochastic Finite Element Analysis

Size: px
Start display at page:

Download "A Vector-Space Approach for Stochastic Finite Element Analysis"

Transcription

1 A Vector-Space Approach for Stochastic Finite Element Analysis S Adhikari 1 1 Swansea University, UK CST2010: Valencia, Spain Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

2 Outline of the talk 1 Introduction Uncertainty in computational mechanics Stochastic elliptic PDEs 2 Spectral decomposition in a vector space Projection in a finite dimensional vector-space Properties of the spectral functions 3 Error minimization in the Hilbert space The Galerkin approach POD like Model Reduction Computational method 4 Numerical illustration ZnO nanowires Results for larger correlation length Results for smaller correlation length 5 Conclusions Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

3 Introduction Uncertainty in computational mechanics Sources of uncertainty (a) parametric uncertainty - e.g., uncertainty in geometric parameters, friction coefficient, strength of the materials involved; (b) model inadequacy - arising from the lack of scientific knowledge about the model which is a-priori unknown; (c) experimental error - uncertain and unknown error percolate into the model when they are calibrated against experimental results; (d) computational uncertainty - e.g, machine precession, error tolerance and the so called h and p refinements in finite element analysis, and (e) model uncertainty - genuine randomness in the model such as uncertainty in the position and velocity in quantum mechanics, deterministic chaos. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

4 Introduction Stochastic elliptic PDEs Stochastic elliptic PDE We consider the stochastic elliptic partial differential equation (PDE) [a(r, θ) u(r, θ)] = p(r); r in D (1) with the associated boundary condition u(r, θ) = 0; r on D (2) Here a : R d Θ R is a random field, which can be viewed as a set of random variables indexed by r R d. We assume the random field a(r, θ) to be stationary and square integrable. Based on the physical problem the random field a(r, θ) can be used to model different physical quantities. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

5 Introduction Stochastic elliptic PDEs Discretized Stochastic PDE The random process a(r, θ) can be expressed in a generalized fourier type of series known as the Karhunen-Loève expansion a(r, θ) = a 0 (r) + νi ξ i (θ)ϕ i (r) (3) Here a 0 (r) is the mean function, ξ i (θ) are uncorrelated standard Gaussian random variables, ν i and ϕ i (r) are eigenvalues and eigenfunctions satisfying the integral equation C a (r 1, r 2 )ϕ j (r 1 )dr 1 = ν j ϕ j (r 2 ), j = 1, 2, (4) D i=1 Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

6 Introduction Stochastic elliptic PDEs Discrete equation for stochastic mechanics Truncating the KL expansion upto the M-th term and discretising the displacement field, the equation for static deformation can be expresses as [ ] M A 0 + ξ i (θ)a i u(θ) = f (5) i=1 The aim is to efficiently solve for u(θ). Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

7 Introduction Stochastic elliptic PDEs Polynomial Chaos expansion Using the Polynomial Chaos expansion, the solution (a vector valued function) can be expressed as u(θ) = u i0 h 0 + u i1 h 1 (ξ i1 (θ)) + i 1 i 1 =1 i 2 =1 + i 1 i 1 =1 i 1 =1 i 2 =1 i 3 =1 + u i1,i 2 h 2 (ξ i1 (θ), ξ i2 (θ)) i 2 i 1 i 2 i 3 i 1 =1 i 2 =1 i 3 =1 i 4 =1 u i1 i 2 i 3 h 3 (ξ i1 (θ), ξ i2 (θ), ξ i3 (θ)) u i1 i 2 i 3 i 4 h 4 (ξ i1 (θ), ξ i2 (θ), ξ i3 (θ), ξ i4 (θ)) +..., Here u i1,...,i p R n are deterministic vectors to be determined. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

8 Introduction Stochastic elliptic PDEs Polynomial Chaos expansion After the finite truncation, concisely, the polynomial chaos expansion can be written as û(θ) = P H k (ξ(θ))u k (6) k=1 where H k (ξ(θ)) are the polynomial chaoses. The value of the number of terms P depends on the number of basic random variables M and the order of the PC expansion r as P = r j=0 (M + j 1)! j!(m 1)! (7) Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

9 Introduction Stochastic elliptic PDEs Polynomial Chaos expansion We need to solve a np np linear equation to obtain all u k R n. A 0,0 A 0,P 1 u 0 f 0 A 1,0 A 1,P 1 u 1 f 1 =..... A P 1,0 A P 1,P 1 u P 1 f P 1 (8) P increases exponentially with M: M nd order PC rd order PC Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

10 Introduction Stochastic elliptic PDEs Mathematical nature of the solution (1) The elements of the solution vector are not simple polynomials, but ratio of polynomials in ξ(θ). Remark If all A i R n n are matrices of rank n, then the elements of u(θ) are the ratio of polynomials of the form p (n 1) (ξ 1 (θ), ξ 2 (θ),..., ξ M (θ)) p (n) (ξ 1 (θ), ξ 2 (θ),..., ξ M (θ)) (9) where p (n) (ξ 1 (θ), ξ 2 (θ),..., ξ M (θ)) is an n-th order complete multivariate polynomial of variables ξ 1 (θ), ξ 2 (θ),..., ξ M (θ). Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

11 Introduction Stochastic elliptic PDEs Mathematical nature of the solution (2) Suppose we denote so that A(θ) = [ A 0 + ] M ξ i (θ)a i R n n (10) i=1 From the definition of the matrix inverse we have u(θ) = A 1 (θ)f (11) A 1 = Adj(A) det (A) = CT a det (A) (12) where C a is the matrix of cofactors. The determinant of A contains a maximum of n number of products of A kj and their linear combinations. Note from Eq. (10) that M A kj (θ) = A 0kj + ξ i (θ)a ikj (13) i=1 Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

12 Introduction Stochastic elliptic PDEs Mathematical nature of the solution (3) Since all the matrices are of full rank, the determinant contains a maximum of n number of products of linear combination of random variables in Eq. (13). On the other hand, each entries of the matrix of cofactors, contains a maximum of (n 1) number of products of linear combination of random variables in Eq. (13). From Eqs. (11) and (12) it follows that u(θ) = CT a f det (A) (14) Therefore, the numerator of each element of the solution vector contains linear combinations of the elements of the cofactor matrix, which are complete polynomials of order (n 1). The result derived in this theorem is important because the solution methods proposed for stochastic finite element analysis essentially aim to approximate the ratio of the polynomials given in Eq. (9). Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

13 Introduction Stochastic elliptic PDEs Some basics of linear algebra Definition (Linearly independent vectors) A set of vectors {φ 1, φ 2,..., φ n } is linearly independent if the expression n k=1 α kφ k = 0 if and only if α k = 0 for all k = 1, 2,..., n. Remark (The spanning property) Suppose {φ 1, φ 2,..., φ n } is a complete basis in the Hilbert space H. Then for every nonzero u H, it is possible to choose α 1, α 2,..., α n 0 uniquely such that u = α 1 φ 1 + α 2 φ α n φ n. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

14 Introduction Stochastic elliptic PDEs Polynomial Chaos expansion We can split the Polynomial Chaos type of expansions as û(θ) = n H k (ξ(θ))u k + k=1 P k=n+1 H k (ξ(θ))u k (15) According to the spanning property of a complete basis in R n it is always possible to project û(θ) in a finite dimensional vector basis for any θ Θ. Therefore, in a vector polynomial chaos expansion (15), all u k for k > n must be linearly dependent. This is the motivation behind seeking a finite dimensional expansion. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

15 Spectral decomposition in a vector space Projection in a finite dimensional vector-space Projection in a finite dimensional vector-space Theorem There exist a finite set of functions Γ k : (R m Θ) (R Θ) and an orthonormal basis φ k R n for k = 1, 2,..., n such that the series û(θ) = n Γ k (ξ(θ))φ k (16) k=1 converges to the exact solution of the discretized stochastic finite element equation (5) with probability 1. Outline of proof: The first step is to generate a complete orthonormal basis. We use the eigenvectors φ k R n of the matrix A 0 such that A 0 φ k = λ 0k φ k ; k = 1, 2,... n (17) Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

16 Spectral decomposition in a vector space Projection in a finite dimensional vector-space Projection in a finite dimensional vector-space We define the matrix of eigenvalues and eigenvectors Λ 0 = diag [λ 01, λ 02,..., λ 0n ] R n n ; Φ = [φ 1, φ 2,..., φ n ] R n n (18) Eigenvalues are ordered in the ascending order: λ 01 < λ 02 <... < λ 0n. Since Φ is an orthogonal matrix we have Φ 1 = Φ T so that: Φ T A 0 Φ = Λ 0 ; A 0 = Φ T Λ 0 Φ 1 and A 1 0 = ΦΛ 1 0 ΦT (19) We also introduce the transformations à i = Φ T A i Φ R n n ; i = 0, 1, 2,..., M (20) Note that Ã0 = Λ 0, a diagonal matrix and A i = Φ T à i Φ 1 R n n ; i = 1, 2,..., M (21) Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

17 Spectral decomposition in a vector space Projection in a finite dimensional vector-space Projection in a finite dimensional vector-space Suppose the solution of Eq. (5) is given by [ ] 1 M û(θ) = A 0 + ξ i (θ)a i f (22) i=1 Using Eqs. (18) (21) and the orthonormality of Φ one has [ ] 1 M û(θ) = Φ T Λ 0 Φ 1 + ξ i (θ)φ T Ã i Φ 1 f = ΦΨ (ξ(θ)) Φ T f (23) i=1 where [ 1 M Ψ (ξ(θ)) = Λ 0 + ξ i (θ)ãi] (24) and the M-dimensional random vector ξ(θ) = {ξ 1 (θ), ξ 2 (θ),..., ξ M (θ)} T (25) i=1 Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

18 Spectral decomposition in a vector space Projection in a finite dimensional vector-space Projection in a finite dimensional vector-space Now we separate the diagonal and off-diagonal terms of the Ãi matrices as à i = Λ i + i, i = 1, 2,..., M (26) Here the diagonal matrix ] Λ i = diag [à = diag [ ] λ i1, λ i2,..., λ in R n n (27) and i = Ãi Λ i is an off-diagonal only matrix. M M Ψ (ξ(θ)) = Λ 0 + ξ i (θ)λ i + ξ i (θ) i i=1 i=1 }{{}}{{} Λ(ξ(θ)) (ξ(θ)) 1 (28) where Λ (ξ(θ)) R n n is a diagonal matrix and (ξ(θ)) is an off-diagonal only matrix. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

19 Spectral decomposition in a vector space Projection in a finite dimensional vector-space Projection in a finite dimensional vector-space We rewrite Eq. (28) as Ψ (ξ(θ)) = [ [ 1 Λ (ξ(θ)) I n + Λ 1 (ξ(θ)) (ξ(θ))]] (29) The above expression can be represented using a Neumann type of matrix series as Ψ (ξ(θ)) = [ s ( 1) s Λ 1 (ξ(θ)) (ξ(θ))] Λ 1 (ξ(θ)) (30) s=0 Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

20 Spectral decomposition in a vector space Projection in a finite dimensional vector-space Polynomial Chaos expansion Taking an arbitrary r-th element of û(θ), Eq. (23) can be rearranged to have n n ( f) û r (θ) = Ψ kj (ξ(θ)) φ T j (31) Defining k=1 Φ rk Γ k (ξ(θ)) = j=1 n j=1 ( ) Ψ kj (ξ(θ)) φ T j f and collecting all the elements in Eq. (31) for r = 1, 2,..., n one has û(θ) = (32) n Γ k (ξ(θ)) φ k (33) k=1 Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

21 Spectral decomposition in a vector space Properties of the spectral functions Spectral functions Definition The functions Γ k (ξ(θ)), k = 1, 2,... n are called the spectral functions as they are expressed in terms of the spectral properties of the coefficient matrices of the governing discretized equation. The main difficulty in applying this result is that each of the spectral functions Γ k (ξ(θ)) contain infinite number of terms and they are highly nonlinear functions of the random variables ξ i (θ). For computational purposes, it is necessary to truncate the series after certain number of terms. Different order of spectral functions can be obtained by using truncation in the expression of Γ k (ξ(θ)) Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

22 Spectral decomposition in a vector space Properties of the spectral functions First-order spectral functions Definition The first-order spectral functions Γ (1) k (ξ(θ)), k = 1, 2,..., n are obtained by retaining one term in the series (30). Retaining one term in (30) we have Ψ (1) (ξ(θ)) = Λ 1 (ξ(θ)) or Ψ (1) kj (ξ(θ)) = δ kj λ 0k + M i=1 ξ i(θ)λ ik (34) Using the definition of the spectral function in Eq. (32), the first-order spectral functions can be explicitly obtained as n ( ) Γ (1) k (ξ(θ)) = Ψ (1) kj (ξ(θ)) φ T φ T k j f = f λ 0k + M i=1 ξ (35) i(θ)λ ik j=1 From this expression it is clear that Γ (1) k (ξ(θ)) are non-gaussian random variables even if ξ i (θ) are Gaussian random variables. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

23 Spectral decomposition in a vector space Properties of the spectral functions Second-order spectral functions Definition The second-order spectral functions Γ (2) k (ξ(θ)), k = 1, 2,..., n are obtained by retaining two terms in the series (30). Retaining two terms in (30) we have Ψ (2) (ξ(θ)) = Λ 1 (ξ(θ)) Λ 1 (ξ(θ)) (ξ(θ)) Λ 1 (ξ(θ)) (36) Using the definition of the spectral function in Eq. (32), the second-order spectral functions can be obtained in closed-form as Γ (2) k (ξ(θ)) = φ T k f λ 0k + M n j=1 i=1 ξ i(θ)λ ik ( φ T j f) M i=1 ξ i(θ) ikj ( λ 0k + M i=1 ξ i(θ)λ ik ) ( λ 0j + M i=1 ξ i(θ)λ ij ) (37) Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

24 Spectral decomposition in a vector space Properties of the spectral functions Analysis of spectral functions Remark The linear combination of the spectral functions has the same functional form in (ξ 1 (θ), ξ 2 (θ),..., ξ M (θ)) as the elements of the solution vector, that is, û r (θ) p(n 1) r (ξ 1 (θ), ξ 2 (θ),..., ξ M (θ)) p (n), r = 1, 2,..., n (38) r (ξ 1 (θ), ξ 2 (θ),..., ξ M (θ)) When first-order spectral functions (35) are considered, we have û (1) r (θ) = n k=1 Γ (1) k (ξ(θ)) φ rk = n k=1 φ T k f λ 0k + M i=1 ξ i(θ)λ ik φ rk (39) All (λ 0k + M i=1 ξ i(θ)λ ik ) are different for different k because it is assumed that all eigenvalues λ 0k are distinct. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

25 Spectral decomposition in a vector space Properties of the spectral functions Analysis of spectral functions Carrying out the above summation one has n number of products of (λ 0k + M i=1 ξ i(θ)λ ik ) in the denominator and n sums of (n 1) number of products of (λ 0k + M i=1 ξ i(θ)λ ik ) in the numerator, that is, û (1) r (θ) = ( j=1 k λ 0j + ) M i=1 ξ i(θ)λ ij ( n 1 k=1 λ 0j + ) (40) M i=1 ξ i(θ)λ ij n k=1 (φt k f)φ rk n 1 Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

26 Error minimization in the Hilbert space The Galerkin approach The Galerkin approach There exist a set of finite functions Γ k : (R m Θ) (R Θ), constants c k R and orthonormal vectors φ k R n for k = 1, 2,..., n such that the series n û(θ) = c k Γk (ξ(θ))φ k (41) k=1 converges to the exact solution of the discretized stochastic finite element equation (5) in the mean-square sense provided the vector c = {c 1, c 2,..., c n } T satisfies the n n algebraic equations S c = b with M S jk = Ã ijk D ijk ; j, k = 1, 2,..., n; Ãi jk = φ T j A i φ k, (42) i=0 [ ] D ijk = E ξ i (θ) Γ j (ξ(θ)) Γ k (ξ(θ)) ] ( ) and b j = E [ Γj (ξ(θ)) φ T j f. (43) Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

27 Error minimization in the Hilbert space The Galerkin approach The Galerkin approach The error vector can be obtained as ( M ) ( n ) ε(θ) = A i ξ i (θ) c k Γk (ξ(θ))φ k f R n (44) i=0 k=1 } The solution is viewed as a projection where { Γk (ξ(θ))φ k R n are the basis functions and c k are the unknown constants to be determined. We wish to obtain the coefficients c k such that the error norm χ 2 = ε(θ), ε(θ) is minimum. This can be achieved using the Galerkin approach so that the error is made orthogonal to the basis functions, that is, mathematically ) ε(θ) ( Γj (ξ(θ))φ j or Γj (ξ(θ))φ j, ε(θ) = 0 j = 1, 2,..., n (45) Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

28 Error minimization in the Hilbert space The Galerkin approach The Galerkin approach Imposing the orthogonality condition and using the expression of the error one has [ ( M ) ( n ) ] E Γj (ξ(θ))φ T j A i ξ i (θ) c k Γk (ξ(θ))φ k Γ j (ξ(θ))φ T j f = 0 i=0 k=1 (46) Interchanging the E [ ] and summation operations, this can be simplified to ( n M k=1 i=0 ) [ (φ T j A i φ k E ξ i (θ) Γ j (ξ(θ)) Γ k (ξ(θ))] ) c k = ] ( ) E [ Γj (ξ(θ)) φ T j f (47) or ( n M ) Ã ijk D ijk c k = b j (48) k=1 i=0 Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

29 Error minimization in the Hilbert space POD like Model Reduction Model Reduction by reduced number of basis Suppose the eigenvalues of A 0 are arranged in an increasing order such that λ 01 < λ 02 <... < λ 0n (49) From the expression of the spectral functions observe that the eigenvalues appear in the denominator: Γ (1) k (ξ(ω)) = φ T k f λ 0k + M i=1 ξ i(ω)λ ik (50) The series can be truncated based on the magnitude of the eigenvalues as the higher terms becomes smaller. Therefore one could only retain the dominant terms in the series (POD like reduction). Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

30 Error minimization in the Hilbert space POD like Model Reduction Model Reduction by reduced number of basis One can select a small value ɛ such that λ 01 /λ 0p < ɛ for some value of p. Based on this discussion we have the following proposition. Proposiion (reduced orthonormal basis) Suppose there exist an ɛ and p < n such that λ 01 /λ 0p < ɛ. Then the solution of the discretized stochastic finite element equation (5) can be expressed by the series representation û(ω) = p c k Γk (ξ(ω))φ k (51) k=1 such that the error is minimized in a least-square sense. c k, Γ k (ξ(ω)) and φ k can be obtained following the procedure described in the previous section by letting the indices j, k upto p in Eqs. (42) and (43). Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

31 Error minimization in the Hilbert space Computational method Computational method The mean vector can be obtained as ū = E [û(θ)] = p k=1 ] c k E [ Γk (ξ(θ)) φ k (52) The covariance of the solution vector can be expressed as [ ] Σ u = E (û(θ) ū) (û(θ) ū) T = p k=1 j=1 p c k c j Σ Γkj φ k φ T j (53) where the elements of the covariance matrix of the spectral functions are given by ])] Σ Γkj = E [( Γk (ξ(θ)) E [ Γk (ξ(θ))]) ( Γj (ξ(θ)) E [ Γj (ξ(θ)) (54) Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

32 Error minimization in the Hilbert space Computational method Summary of the computational method 1 Solve the eigenvalue problem associated with the mean matrix A 0 to generate the orthonormal basis vectors: A 0 Φ = Λ 0 Φ 2 Select a number of samples, say N samp. Generate the samples of basic random variables ξ i (θ), i = 1, 2,..., M. 3 Calculate the spectral basis functions (for example, first-order): φ T k f Γ k (ξ(θ)) = λ 0k + M, for k = 1, p, p < n i=1 ξ i (θ)λ ik 4 Obtain the coefficient vector: c = S 1 b R n, where b = f Γ, S = Λ 0 D 0 + M [ i=1 Ãi ] D i and D i = E Γ(θ)ξ i (θ)γ T (θ), i = 0, 1, 2,..., M 5 Obtain the samples of the response from the spectral series: û(θ) = p k=1 c kγ k (ξ(θ))φ k Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

33 Numerical illustration ZnO nanowires Nanoscale Energy Harvesting: ZnO nanowires ZnO materials have attracted extensive attention due to their excellent performance in electronic, ferroelectric and piezoelectric applications. Nano-scale ZnO is an important material for the nanoscale energy harvesting and scavenging. Investigation and understanding of the bending of ZnO nanowires are valuable for their potential application. For example, ZnO nanowires are bend by rubbing against each other for energy scavenging. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

34 Numerical illustration ZnO nanowires Rubbing the right way When ambient vibrations move a microfibre covered with zinc oxide nanowires (blue) back and forth with respect to a similar fibre that has been coated with gold (orange), electrical energy is produced because ZnO is a piezoelectric material; Nature Nanotechnology, Vol 3, March 2008, pp 123. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

35 Numerical illustration ZnO nanowires Power shirt Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

36 Numerical illustration ZnO nanowires Collection of ZnO A collection of vertically grown ZnO NWs. This can be viewed as the sample space for the application of stochastic finite element method. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

37 Numerical illustration ZnO nanowires Collection of ZnO: Close up Uncertainties in ZnO NWs in the close up view. The uncertain parameter include geometric parameters such as the length and the cross sectional area along the length, boundary condition and material properties. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

38 Numerical illustration ZnO nanowires ZnO nanowires (a) The atomistic model of a ZnO NW (b) The continuum idealization of a cantilevered ZnO NW under an AFM tip. grown from a ZnO crystal in the (0, 0, 0, 1) direction. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

39 Numerical illustration ZnO nanowires Problem details We study the deflection of ZnO NW under the AFM tip considering stochastically varying bending modulus. The variability of the deflection is particularly important as the harvested energy from the bending depends on it. We assume that the bending modulus of the ZnO NW is a homogeneous stationary Gaussian random field of the form EI(x, θ) = EI 0 (1 + a(x, θ)) (55) where x is the coordinate along the length of ZnO NW, EI 0 is the estimate of the mean bending modulus, a(x, θ) is a zero mean stationary random field. The autocorrelation function of this random field is assumed to be C a (x 1, x 2 ) = σ 2 ae ( x 1 x 2 )/µ a (56) where µ a is the correlation length and σ a is the standard deviation. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

40 Numerical illustration ZnO nanowires Problem details We consider a long nanowire where the continuum model has been validated. We use the baseline parameters for the ZnO NW from Gao and Wang (Nano Letters 7 (8) (2007), ) as the length L = 600nm, diameter d = 50nm and the lateral point force at the tip f T = 80nN. Using these data, the baseline deflection can be obtained as δ 0 = 145nm. We normalize our results with this baseline value for convenience. Two correlation lengths are considered in the numerical studies: µ a = L/3 and µ a = L/10. The number of terms M in the KL expansion becomes 24 and 67 (95% capture). The nanowire is divided into 50 beam elements of equal length. The number of degrees of freedom of the model n = 100 (standard beam element). Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

41 Numerical illustration Results for larger correlation length Moments: larger correlation length (c) Mean of the normalized deflection. (d) Standard deviation of the normalized deflection. Figure: The number of random variable used: M = 24. The number of degrees of freedom: n = 100. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

42 Numerical illustration Results for larger correlation length Error in moments: larger correlation length Statistics Methods σ a = 0.05 σ a = 0.10 σ a = 0.15 σ a = 0.20 Mean 1st order Galerkin 2nd order Galerkin Standard 1st order Galerkin deviation 2nd order Galerkin Percentage error in the mean and standard deviation of the deflection of the ZnO NW under the AFM tip when correlation length is µ a = L/3. For n = 100 and M = 24, if the second-order PC was used, one would need to solve a linear system of equation of size The results shown here are obtained by solving a linear system of equation of size 6 using the proposed Galerkin approach. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

43 Numerical illustration Results for larger correlation length Pdf: larger correlation length (a) Probability density function for σ a = (b) Probability density function for σ a = 0.1. The probability density function of the normalized deflection δ/δ 0 of the ZnO NW under the AFM tip (δ 0 = 145nm). Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

44 Numerical illustration Results for larger correlation length Pdf: larger correlation length (c) Probability density function for σ a = (d) Probability density function for σ a = 0.2. The probability density function of the normalized deflection δ/δ 0 of the ZnO NW under the AFM tip (δ 0 = 145nm). Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

45 Numerical illustration Results for smaller correlation length Moments: smaller correlation length (e) Mean of the normalized deflection. (f) Standard deviation of the normalized deflection. Figure: The number of random variable used: M = 67. The number of degrees of freedom: n = 100. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

46 Numerical illustration Results for smaller correlation length Error in moments: smaller correlation length Statistics Methods σ a = 0.05 σ a = 0.10 σ a = 0.15 σ a = 0.20 Mean 1st order Galerkin 2nd order Galerkin Standard 1st order Galerkin deviation 2nd order Galerkin Percentage error in the mean and standard deviation of the deflection of the ZnO NW under the AFM tip when correlation length is µ a = L/3. For n = 100 and M = 67, if the second-order PC was used, one would need to solve a linear system of equation of size 234,500. The results shown here are obtained by solving a linear system of equation of size 6 using the proposed Galerkin approach. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

47 Numerical illustration Results for smaller correlation length Pdf: smaller correlation length (a) Probability density function for σ a = (b) Probability density function for σ a = 0.1. The probability density function of the normalized deflection δ/δ 0 of the ZnO NW under the AFM tip (δ 0 = 145nm). Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

48 Numerical illustration Results for smaller correlation length Pdf: smaller correlation length (c) Probability density function for σ a = (d) Probability density function for σ a = 0.2. The probability density function of the normalized deflection δ/δ 0 of the ZnO NW under the AFM tip (δ 0 = 145nm). Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

49 Conclusions Conclusions 1 We consider discretised stochastic elliptic partial differential equations. 2 The solution is projected into a finite dimensional complete orthonormal vector basis and the associated coefficient functions are obtained. 3 The coefficient functions, called as the spectral functions, are expressed in terms of the spectral properties of the system matrices. 4 If p < n number of orthonormal vectors are used and M is the number of random variables, then the computational complexity grows in O(Mp 2 ) + O(p 3 ) for large M and p in the worse case. 5 We consider a problem with 24 and 67 random variables and n = 100 degrees of freedom. A second-order PC would require the solution of equations of dimension 32,400 and 234,500 respectively. In comparison, the proposed Galerkin approach requires the solution of algebraic equations of dimension 6 only. Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

50 Conclusions Acknowledgements Adhikari (Swansea) Vector-Space Approach for SFEM September, / 50

Collocation based high dimensional model representation for stochastic partial differential equations

Collocation based high dimensional model representation for stochastic partial differential equations Collocation based high dimensional model representation for stochastic partial differential equations S Adhikari 1 1 Swansea University, UK ECCM 2010: IV European Conference on Computational Mechanics,

More information

Dynamic response of structures with uncertain properties

Dynamic response of structures with uncertain properties Dynamic response of structures with uncertain properties S. Adhikari 1 1 Chair of Aerospace Engineering, College of Engineering, Swansea University, Bay Campus, Fabian Way, Swansea, SA1 8EN, UK International

More information

Probabilistic Structural Dynamics: Parametric vs. Nonparametric Approach

Probabilistic Structural Dynamics: Parametric vs. Nonparametric Approach Probabilistic Structural Dynamics: Parametric vs. Nonparametric Approach S Adhikari School of Engineering, Swansea University, Swansea, UK Email: S.Adhikari@swansea.ac.uk URL: http://engweb.swan.ac.uk/

More information

Comput. Methods Appl. Mech. Engrg.

Comput. Methods Appl. Mech. Engrg. Comput. Methods Appl. Mech. Engrg. 200 (2011) 1804 1821 Contents lists available at ScienceDirect Comput. Methods Appl. Mech. Engrg. journal homepage: www.elsevier.com/locate/cma A reduced function approach

More information

Spectral methods for fuzzy structural dynamics: modal vs direct approach

Spectral methods for fuzzy structural dynamics: modal vs direct approach Spectral methods for fuzzy structural dynamics: modal vs direct approach S Adhikari Zienkiewicz Centre for Computational Engineering, College of Engineering, Swansea University, Wales, UK IUTAM Symposium

More information

Random Eigenvalue Problems in Structural Dynamics: An Experimental Investigation

Random Eigenvalue Problems in Structural Dynamics: An Experimental Investigation Random Eigenvalue Problems in Structural Dynamics: An Experimental Investigation S. Adhikari, A. Srikantha Phani and D. A. Pape School of Engineering, Swansea University, Swansea, UK Email: S.Adhikari@swansea.ac.uk

More information

An Efficient Computational Solution Scheme of the Random Eigenvalue Problems

An Efficient Computational Solution Scheme of the Random Eigenvalue Problems 50th AIAA SDM Conference, 4-7 May 2009 An Efficient Computational Solution Scheme of the Random Eigenvalue Problems Rajib Chowdhury & Sondipon Adhikari School of Engineering Swansea University Swansea,

More information

Polynomial Chaos and Karhunen-Loeve Expansion

Polynomial Chaos and Karhunen-Loeve Expansion Polynomial Chaos and Karhunen-Loeve Expansion 1) Random Variables Consider a system that is modeled by R = M(x, t, X) where X is a random variable. We are interested in determining the probability of the

More information

Schwarz Preconditioner for the Stochastic Finite Element Method

Schwarz Preconditioner for the Stochastic Finite Element Method Schwarz Preconditioner for the Stochastic Finite Element Method Waad Subber 1 and Sébastien Loisel 2 Preprint submitted to DD22 conference 1 Introduction The intrusive polynomial chaos approach for uncertainty

More information

PARALLEL COMPUTATION OF 3D WAVE PROPAGATION BY SPECTRAL STOCHASTIC FINITE ELEMENT METHOD

PARALLEL COMPUTATION OF 3D WAVE PROPAGATION BY SPECTRAL STOCHASTIC FINITE ELEMENT METHOD 13 th World Conference on Earthquake Engineering Vancouver, B.C., Canada August 1-6, 24 Paper No. 569 PARALLEL COMPUTATION OF 3D WAVE PROPAGATION BY SPECTRAL STOCHASTIC FINITE ELEMENT METHOD Riki Honda

More information

Efficient Solvers for Stochastic Finite Element Saddle Point Problems

Efficient Solvers for Stochastic Finite Element Saddle Point Problems Efficient Solvers for Stochastic Finite Element Saddle Point Problems Catherine E. Powell c.powell@manchester.ac.uk School of Mathematics University of Manchester, UK Efficient Solvers for Stochastic Finite

More information

UNCERTAINTY ASSESSMENT USING STOCHASTIC REDUCED BASIS METHOD FOR FLOW IN POROUS MEDIA

UNCERTAINTY ASSESSMENT USING STOCHASTIC REDUCED BASIS METHOD FOR FLOW IN POROUS MEDIA UNCERTAINTY ASSESSMENT USING STOCHASTIC REDUCED BASIS METHOD FOR FLOW IN POROUS MEDIA A REPORT SUBMITTED TO THE DEPARTMENT OF ENERGY RESOURCES ENGINEERING OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT

More information

Stochastic Spectral Approaches to Bayesian Inference

Stochastic Spectral Approaches to Bayesian Inference Stochastic Spectral Approaches to Bayesian Inference Prof. Nathan L. Gibson Department of Mathematics Applied Mathematics and Computation Seminar March 4, 2011 Prof. Gibson (OSU) Spectral Approaches to

More information

Linear Algebra: Matrix Eigenvalue Problems

Linear Algebra: Matrix Eigenvalue Problems CHAPTER8 Linear Algebra: Matrix Eigenvalue Problems Chapter 8 p1 A matrix eigenvalue problem considers the vector equation (1) Ax = λx. 8.0 Linear Algebra: Matrix Eigenvalue Problems Here A is a given

More information

Implementation of Sparse Wavelet-Galerkin FEM for Stochastic PDEs

Implementation of Sparse Wavelet-Galerkin FEM for Stochastic PDEs Implementation of Sparse Wavelet-Galerkin FEM for Stochastic PDEs Roman Andreev ETH ZÜRICH / 29 JAN 29 TOC of the Talk Motivation & Set-Up Model Problem Stochastic Galerkin FEM Conclusions & Outlook Motivation

More information

Quantum Computing Lecture 2. Review of Linear Algebra

Quantum Computing Lecture 2. Review of Linear Algebra Quantum Computing Lecture 2 Review of Linear Algebra Maris Ozols Linear algebra States of a quantum system form a vector space and their transformations are described by linear operators Vector spaces

More information

Linear Algebra Review. Vectors

Linear Algebra Review. Vectors Linear Algebra Review 9/4/7 Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa (UCSD) Cogsci 8F Linear Algebra review Vectors

More information

Random Fields in Bayesian Inference: Effects of the Random Field Discretization

Random Fields in Bayesian Inference: Effects of the Random Field Discretization Random Fields in Bayesian Inference: Effects of the Random Field Discretization Felipe Uribe a, Iason Papaioannou a, Wolfgang Betz a, Elisabeth Ullmann b, Daniel Straub a a Engineering Risk Analysis Group,

More information

linearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice

linearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice 3. Eigenvalues and Eigenvectors, Spectral Representation 3.. Eigenvalues and Eigenvectors A vector ' is eigenvector of a matrix K, if K' is parallel to ' and ' 6, i.e., K' k' k is the eigenvalue. If is

More information

On the Nature of Random System Matrices in Structural Dynamics

On the Nature of Random System Matrices in Structural Dynamics On the Nature of Random System Matrices in Structural Dynamics S. ADHIKARI AND R. S. LANGLEY Cambridge University Engineering Department Cambridge, U.K. Nature of Random System Matrices p.1/20 Outline

More information

Chapter 2 Spectral Expansions

Chapter 2 Spectral Expansions Chapter 2 Spectral Expansions In this chapter, we discuss fundamental and practical aspects of spectral expansions of random model data and of model solutions. We focus on a specific class of random process

More information

Theorem A.1. If A is any nonzero m x n matrix, then A is equivalent to a partitioned matrix of the form. k k n-k. m-k k m-k n-k

Theorem A.1. If A is any nonzero m x n matrix, then A is equivalent to a partitioned matrix of the form. k k n-k. m-k k m-k n-k I. REVIEW OF LINEAR ALGEBRA A. Equivalence Definition A1. If A and B are two m x n matrices, then A is equivalent to B if we can obtain B from A by a finite sequence of elementary row or elementary column

More information

Algebraic Theory of Entanglement

Algebraic Theory of Entanglement Algebraic Theory of (arxiv: 1205.2882) 1 (in collaboration with T.R. Govindarajan, A. Queiroz and A.F. Reyes-Lega) 1 Physics Department, Syracuse University, Syracuse, N.Y. and The Institute of Mathematical

More information

Solving the steady state diffusion equation with uncertainty Final Presentation

Solving the steady state diffusion equation with uncertainty Final Presentation Solving the steady state diffusion equation with uncertainty Final Presentation Virginia Forstall vhfors@gmail.com Advisor: Howard Elman elman@cs.umd.edu Department of Computer Science May 6, 2012 Problem

More information

Reduction of Random Variables in Structural Reliability Analysis

Reduction of Random Variables in Structural Reliability Analysis Reduction of Random Variables in Structural Reliability Analysis S. Adhikari and R. S. Langley Department of Engineering University of Cambridge Trumpington Street Cambridge CB2 1PZ (U.K.) February 21,

More information

Math 1553, Introduction to Linear Algebra

Math 1553, Introduction to Linear Algebra Learning goals articulate what students are expected to be able to do in a course that can be measured. This course has course-level learning goals that pertain to the entire course, and section-level

More information

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 1 x 2. x n 8 (4) 3 4 2 MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS SYSTEMS OF EQUATIONS AND MATRICES Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a

More information

Elementary maths for GMT

Elementary maths for GMT Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1

More information

Fundamentals of Engineering Analysis (650163)

Fundamentals of Engineering Analysis (650163) Philadelphia University Faculty of Engineering Communications and Electronics Engineering Fundamentals of Engineering Analysis (6563) Part Dr. Omar R Daoud Matrices: Introduction DEFINITION A matrix is

More information

Math113: Linear Algebra. Beifang Chen

Math113: Linear Algebra. Beifang Chen Math3: Linear Algebra Beifang Chen Spring 26 Contents Systems of Linear Equations 3 Systems of Linear Equations 3 Linear Systems 3 2 Geometric Interpretation 3 3 Matrices of Linear Systems 4 4 Elementary

More information

COMPLEX MODES IN LINEAR STOCHASTIC SYSTEMS

COMPLEX MODES IN LINEAR STOCHASTIC SYSTEMS Proceedings of VETOMAC-I October 25-27, 2, Bangalore, INDIA COMPLEX MODES IN LINEAR STOCHASTIC SYSTEMS S. Adhikari Cambridge University Engineering Department Trumpington Street Cambridge CB2 1PZ (U.K.)

More information

S. Freitag, B. T. Cao, J. Ninić & G. Meschke

S. Freitag, B. T. Cao, J. Ninić & G. Meschke SFB 837 Interaction Modeling Mechanized Tunneling S Freitag, B T Cao, J Ninić & G Meschke Institute for Structural Mechanics Ruhr University Bochum 1 Content 1 Motivation 2 Process-oriented FE model for

More information

Sparse polynomial chaos expansions in engineering applications

Sparse polynomial chaos expansions in engineering applications DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Sparse polynomial chaos expansions in engineering applications B. Sudret G. Blatman (EDF R&D,

More information

Stochastic Elastic-Plastic Finite Element Method for Performance Risk Simulations

Stochastic Elastic-Plastic Finite Element Method for Performance Risk Simulations Stochastic Elastic-Plastic Finite Element Method for Performance Risk Simulations Boris Jeremić 1 Kallol Sett 2 1 University of California, Davis 2 University of Akron, Ohio ICASP Zürich, Switzerland August

More information

Jordan normal form notes (version date: 11/21/07)

Jordan normal form notes (version date: 11/21/07) Jordan normal form notes (version date: /2/7) If A has an eigenbasis {u,, u n }, ie a basis made up of eigenvectors, so that Au j = λ j u j, then A is diagonal with respect to that basis To see this, let

More information

Chapter Two Elements of Linear Algebra

Chapter Two Elements of Linear Algebra Chapter Two Elements of Linear Algebra Previously, in chapter one, we have considered single first order differential equations involving a single unknown function. In the next chapter we will begin to

More information

Review (Probability & Linear Algebra)

Review (Probability & Linear Algebra) Review (Probability & Linear Algebra) CE-725 : Statistical Pattern Recognition Sharif University of Technology Spring 2013 M. Soleymani Outline Axioms of probability theory Conditional probability, Joint

More information

1 Matrices and Systems of Linear Equations. a 1n a 2n

1 Matrices and Systems of Linear Equations. a 1n a 2n March 31, 2013 16-1 16. Systems of Linear Equations 1 Matrices and Systems of Linear Equations An m n matrix is an array A = (a ij ) of the form a 11 a 21 a m1 a 1n a 2n... a mn where each a ij is a real

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2016 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

Second-Order Inference for Gaussian Random Curves

Second-Order Inference for Gaussian Random Curves Second-Order Inference for Gaussian Random Curves With Application to DNA Minicircles Victor Panaretos David Kraus John Maddocks Ecole Polytechnique Fédérale de Lausanne Panaretos, Kraus, Maddocks (EPFL)

More information

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition

Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Linear Algebra review Powers of a diagonalizable matrix Spectral decomposition Prof. Tesler Math 283 Fall 2018 Also see the separate version of this with Matlab and R commands. Prof. Tesler Diagonalizing

More information

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2.

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2. APPENDIX A Background Mathematics A. Linear Algebra A.. Vector algebra Let x denote the n-dimensional column vector with components 0 x x 2 B C @. A x n Definition 6 (scalar product). The scalar product

More information

Chapter 7. Linear Algebra: Matrices, Vectors,

Chapter 7. Linear Algebra: Matrices, Vectors, Chapter 7. Linear Algebra: Matrices, Vectors, Determinants. Linear Systems Linear algebra includes the theory and application of linear systems of equations, linear transformations, and eigenvalue problems.

More information

MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors.

MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. MATH 304 Linear Algebra Lecture 20: The Gram-Schmidt process (continued). Eigenvalues and eigenvectors. Orthogonal sets Let V be a vector space with an inner product. Definition. Nonzero vectors v 1,v

More information

Linear Algebra Review (Course Notes for Math 308H - Spring 2016)

Linear Algebra Review (Course Notes for Math 308H - Spring 2016) Linear Algebra Review (Course Notes for Math 308H - Spring 2016) Dr. Michael S. Pilant February 12, 2016 1 Background: We begin with one of the most fundamental notions in R 2, distance. Letting (x 1,

More information

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0.

Linear Algebra. Matrices Operations. Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0. Matrices Operations Linear Algebra Consider, for example, a system of equations such as x + 2y z + 4w = 0, 3x 4y + 2z 6w = 0, x 3y 2z + w = 0 The rectangular array 1 2 1 4 3 4 2 6 1 3 2 1 in which the

More information

CS 143 Linear Algebra Review

CS 143 Linear Algebra Review CS 143 Linear Algebra Review Stefan Roth September 29, 2003 Introductory Remarks This review does not aim at mathematical rigor very much, but instead at ease of understanding and conciseness. Please see

More information

33AH, WINTER 2018: STUDY GUIDE FOR FINAL EXAM

33AH, WINTER 2018: STUDY GUIDE FOR FINAL EXAM 33AH, WINTER 2018: STUDY GUIDE FOR FINAL EXAM (UPDATED MARCH 17, 2018) The final exam will be cumulative, with a bit more weight on more recent material. This outline covers the what we ve done since the

More information

Review problems for MA 54, Fall 2004.

Review problems for MA 54, Fall 2004. Review problems for MA 54, Fall 2004. Below are the review problems for the final. They are mostly homework problems, or very similar. If you are comfortable doing these problems, you should be fine on

More information

Linear Algebra Practice Final

Linear Algebra Practice Final . Let (a) First, Linear Algebra Practice Final Summer 3 3 A = 5 3 3 rref([a ) = 5 so if we let x 5 = t, then x 4 = t, x 3 =, x = t, and x = t, so that t t x = t = t t whence ker A = span(,,,, ) and a basis

More information

Quiz ) Locate your 1 st order neighbors. 1) Simplify. Name Hometown. Name Hometown. Name Hometown.

Quiz ) Locate your 1 st order neighbors. 1) Simplify. Name Hometown. Name Hometown. Name Hometown. Quiz 1) Simplify 9999 999 9999 998 9999 998 2) Locate your 1 st order neighbors Name Hometown Me Name Hometown Name Hometown Name Hometown Solving Linear Algebraic Equa3ons Basic Concepts Here only real

More information

Equality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same.

Equality: Two matrices A and B are equal, i.e., A = B if A and B have the same order and the entries of A and B are the same. Introduction Matrix Operations Matrix: An m n matrix A is an m-by-n array of scalars from a field (for example real numbers) of the form a a a n a a a n A a m a m a mn The order (or size) of A is m n (read

More information

Basic Elements of Linear Algebra

Basic Elements of Linear Algebra A Basic Review of Linear Algebra Nick West nickwest@stanfordedu September 16, 2010 Part I Basic Elements of Linear Algebra Although the subject of linear algebra is much broader than just vectors and matrices,

More information

Lecture 10: Fourier Sine Series

Lecture 10: Fourier Sine Series Introductory lecture notes on Partial Differential Equations - c Anthony Peirce. Not to be copied, used, or revised without eplicit written permission from the copyright owner. ecture : Fourier Sine Series

More information

EE731 Lecture Notes: Matrix Computations for Signal Processing

EE731 Lecture Notes: Matrix Computations for Signal Processing EE731 Lecture Notes: Matrix Computations for Signal Processing James P. Reilly c Department of Electrical and Computer Engineering McMaster University September 22, 2005 0 Preface This collection of ten

More information

Karhunen-Loève Approximation of Random Fields Using Hierarchical Matrix Techniques

Karhunen-Loève Approximation of Random Fields Using Hierarchical Matrix Techniques Institut für Numerische Mathematik und Optimierung Karhunen-Loève Approximation of Random Fields Using Hierarchical Matrix Techniques Oliver Ernst Computational Methods with Applications Harrachov, CR,

More information

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each

More information

Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88

Math Camp Lecture 4: Linear Algebra. Xiao Yu Wang. Aug 2010 MIT. Xiao Yu Wang (MIT) Math Camp /10 1 / 88 Math Camp 2010 Lecture 4: Linear Algebra Xiao Yu Wang MIT Aug 2010 Xiao Yu Wang (MIT) Math Camp 2010 08/10 1 / 88 Linear Algebra Game Plan Vector Spaces Linear Transformations and Matrices Determinant

More information

Lecture 2: From Classical to Quantum Model of Computation

Lecture 2: From Classical to Quantum Model of Computation CS 880: Quantum Information Processing 9/7/10 Lecture : From Classical to Quantum Model of Computation Instructor: Dieter van Melkebeek Scribe: Tyson Williams Last class we introduced two models for deterministic

More information

MP 472 Quantum Information and Computation

MP 472 Quantum Information and Computation MP 472 Quantum Information and Computation http://www.thphys.may.ie/staff/jvala/mp472.htm Outline Open quantum systems The density operator ensemble of quantum states general properties the reduced density

More information

DOA Estimation using MUSIC and Root MUSIC Methods

DOA Estimation using MUSIC and Root MUSIC Methods DOA Estimation using MUSIC and Root MUSIC Methods EE602 Statistical signal Processing 4/13/2009 Presented By: Chhavipreet Singh(Y515) Siddharth Sahoo(Y5827447) 2 Table of Contents 1 Introduction... 3 2

More information

Math Linear Algebra Final Exam Review Sheet

Math Linear Algebra Final Exam Review Sheet Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of

More information

1 Matrices and Systems of Linear Equations

1 Matrices and Systems of Linear Equations March 3, 203 6-6. Systems of Linear Equations Matrices and Systems of Linear Equations An m n matrix is an array A = a ij of the form a a n a 2 a 2n... a m a mn where each a ij is a real or complex number.

More information

Advanced Vibrations. Distributed-Parameter Systems: Approximate Methods Lecture 20. By: H. Ahmadian

Advanced Vibrations. Distributed-Parameter Systems: Approximate Methods Lecture 20. By: H. Ahmadian Advanced Vibrations Distributed-Parameter Systems: Approximate Methods Lecture 20 By: H. Ahmadian ahmadian@iust.ac.ir Distributed-Parameter Systems: Approximate Methods Rayleigh's Principle The Rayleigh-Ritz

More information

Review (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology

Review (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology Review (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology M. Soleymani Fall 2012 Some slides have been adopted from Prof. H.R. Rabiee s and also Prof. R. Gutierrez-Osuna

More information

Review of Linear Algebra

Review of Linear Algebra Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=

More information

Linear Algebra in Computer Vision. Lecture2: Basic Linear Algebra & Probability. Vector. Vector Operations

Linear Algebra in Computer Vision. Lecture2: Basic Linear Algebra & Probability. Vector. Vector Operations Linear Algebra in Computer Vision CSED441:Introduction to Computer Vision (2017F Lecture2: Basic Linear Algebra & Probability Bohyung Han CSE, POSTECH bhhan@postech.ac.kr Mathematics in vector space Linear

More information

Math Matrix Algebra

Math Matrix Algebra Math 44 - Matrix Algebra Review notes - (Alberto Bressan, Spring 7) sec: Orthogonal diagonalization of symmetric matrices When we seek to diagonalize a general n n matrix A, two difficulties may arise:

More information

Solving the Stochastic Steady-State Diffusion Problem Using Multigrid

Solving the Stochastic Steady-State Diffusion Problem Using Multigrid Solving the Stochastic Steady-State Diffusion Problem Using Multigrid Tengfei Su Applied Mathematics and Scientific Computing Advisor: Howard Elman Department of Computer Science Sept. 29, 2015 Tengfei

More information

BASIC ALGORITHMS IN LINEAR ALGEBRA. Matrices and Applications of Gaussian Elimination. A 2 x. A T m x. A 1 x A T 1. A m x

BASIC ALGORITHMS IN LINEAR ALGEBRA. Matrices and Applications of Gaussian Elimination. A 2 x. A T m x. A 1 x A T 1. A m x BASIC ALGORITHMS IN LINEAR ALGEBRA STEVEN DALE CUTKOSKY Matrices and Applications of Gaussian Elimination Systems of Equations Suppose that A is an n n matrix with coefficents in a field F, and x = (x,,

More information

Lecture 1: Center for Uncertainty Quantification. Alexander Litvinenko. Computation of Karhunen-Loeve Expansion:

Lecture 1: Center for Uncertainty Quantification. Alexander Litvinenko. Computation of Karhunen-Loeve Expansion: tifica Lecture 1: Computation of Karhunen-Loeve Expansion: Alexander Litvinenko http://sri-uq.kaust.edu.sa/ Stochastic PDEs We consider div(κ(x, ω) u) = f (x, ω) in G, u = 0 on G, with stochastic coefficients

More information

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET

IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET IMPORTANT DEFINITIONS AND THEOREMS REFERENCE SHEET This is a (not quite comprehensive) list of definitions and theorems given in Math 1553. Pay particular attention to the ones in red. Study Tip For each

More information

Dinesh Kumar, Mehrdad Raisee and Chris Lacor

Dinesh Kumar, Mehrdad Raisee and Chris Lacor Dinesh Kumar, Mehrdad Raisee and Chris Lacor Fluid Mechanics and Thermodynamics Research Group Vrije Universiteit Brussel, BELGIUM dkumar@vub.ac.be; m_raisee@yahoo.com; chris.lacor@vub.ac.be October, 2014

More information

ELE/MCE 503 Linear Algebra Facts Fall 2018

ELE/MCE 503 Linear Algebra Facts Fall 2018 ELE/MCE 503 Linear Algebra Facts Fall 2018 Fact N.1 A set of vectors is linearly independent if and only if none of the vectors in the set can be written as a linear combination of the others. Fact N.2

More information

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017

Math 4A Notes. Written by Victoria Kala Last updated June 11, 2017 Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...

More information

235 Final exam review questions

235 Final exam review questions 5 Final exam review questions Paul Hacking December 4, 0 () Let A be an n n matrix and T : R n R n, T (x) = Ax the linear transformation with matrix A. What does it mean to say that a vector v R n is an

More information

Mathematical foundations - linear algebra

Mathematical foundations - linear algebra Mathematical foundations - linear algebra Andrea Passerini passerini@disi.unitn.it Machine Learning Vector space Definition (over reals) A set X is called a vector space over IR if addition and scalar

More information

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB

Glossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB Glossary of Linear Algebra Terms Basis (for a subspace) A linearly independent set of vectors that spans the space Basic Variable A variable in a linear system that corresponds to a pivot column in the

More information

A matrix over a field F is a rectangular array of elements from F. The symbol

A matrix over a field F is a rectangular array of elements from F. The symbol Chapter MATRICES Matrix arithmetic A matrix over a field F is a rectangular array of elements from F The symbol M m n (F ) denotes the collection of all m n matrices over F Matrices will usually be denoted

More information

Solutions to Final Exam

Solutions to Final Exam Solutions to Final Exam. Let A be a 3 5 matrix. Let b be a nonzero 5-vector. Assume that the nullity of A is. (a) What is the rank of A? 3 (b) Are the rows of A linearly independent? (c) Are the columns

More information

New Developments in LS-OPT - Robustness Studies

New Developments in LS-OPT - Robustness Studies 5. LS-DYNA - Anwenderforum, Ulm 2006 Robustheit / Optimierung I New Developments in LS-OPT - Robustness Studies Ken Craig, Willem Roux 2, Nielen Stander 2 Multidisciplinary Design Optimization Group University

More information

Solution of Linear Equations

Solution of Linear Equations Solution of Linear Equations (Com S 477/577 Notes) Yan-Bin Jia Sep 7, 07 We have discussed general methods for solving arbitrary equations, and looked at the special class of polynomial equations A subclass

More information

Advanced Digital Signal Processing -Introduction

Advanced Digital Signal Processing -Introduction Advanced Digital Signal Processing -Introduction LECTURE-2 1 AP9211- ADVANCED DIGITAL SIGNAL PROCESSING UNIT I DISCRETE RANDOM SIGNAL PROCESSING Discrete Random Processes- Ensemble Averages, Stationary

More information

Concentration Ellipsoids

Concentration Ellipsoids Concentration Ellipsoids ECE275A Lecture Supplement Fall 2008 Kenneth Kreutz Delgado Electrical and Computer Engineering Jacobs School of Engineering University of California, San Diego VERSION LSECE275CE

More information

The Matrix Representation of a Three-Dimensional Rotation Revisited

The Matrix Representation of a Three-Dimensional Rotation Revisited Physics 116A Winter 2010 The Matrix Representation of a Three-Dimensional Rotation Revisited In a handout entitled The Matrix Representation of a Three-Dimensional Rotation, I provided a derivation of

More information

III. Quantum ergodicity on graphs, perspectives

III. Quantum ergodicity on graphs, perspectives III. Quantum ergodicity on graphs, perspectives Nalini Anantharaman Université de Strasbourg 24 août 2016 Yesterday we focussed on the case of large regular (discrete) graphs. Let G = (V, E) be a (q +

More information

MATRICES. a m,1 a m,n A =

MATRICES. a m,1 a m,n A = MATRICES Matrices are rectangular arrays of real or complex numbers With them, we define arithmetic operations that are generalizations of those for real and complex numbers The general form a matrix of

More information

Matrices and Vectors. Definition of Matrix. An MxN matrix A is a two-dimensional array of numbers A =

Matrices and Vectors. Definition of Matrix. An MxN matrix A is a two-dimensional array of numbers A = 30 MATHEMATICS REVIEW G A.1.1 Matrices and Vectors Definition of Matrix. An MxN matrix A is a two-dimensional array of numbers A = a 11 a 12... a 1N a 21 a 22... a 2N...... a M1 a M2... a MN A matrix can

More information

Random Eigenvalue Problems Revisited

Random Eigenvalue Problems Revisited Random Eigenvalue Problems Revisited S Adhikari Department of Aerospace Engineering, University of Bristol, Bristol, U.K. Email: S.Adhikari@bristol.ac.uk URL: http://www.aer.bris.ac.uk/contact/academic/adhikari/home.html

More information

Functional Analysis Review

Functional Analysis Review Outline 9.520: Statistical Learning Theory and Applications February 8, 2010 Outline 1 2 3 4 Vector Space Outline A vector space is a set V with binary operations +: V V V and : R V V such that for all

More information

Conceptual Questions for Review

Conceptual Questions for Review Conceptual Questions for Review Chapter 1 1.1 Which vectors are linear combinations of v = (3, 1) and w = (4, 3)? 1.2 Compare the dot product of v = (3, 1) and w = (4, 3) to the product of their lengths.

More information

Structure in Data. A major objective in data analysis is to identify interesting features or structure in the data.

Structure in Data. A major objective in data analysis is to identify interesting features or structure in the data. Structure in Data A major objective in data analysis is to identify interesting features or structure in the data. The graphical methods are very useful in discovering structure. There are basically two

More information

Stochastic Dimension Reduction

Stochastic Dimension Reduction Stochastic Dimension Reduction Roger Ghanem University of Southern California Los Angeles, CA, USA Computational and Theoretical Challenges in Interdisciplinary Predictive Modeling Over Random Fields 12th

More information

Random Vibrations & Failure Analysis Sayan Gupta Indian Institute of Technology Madras

Random Vibrations & Failure Analysis Sayan Gupta Indian Institute of Technology Madras Random Vibrations & Failure Analysis Sayan Gupta Indian Institute of Technology Madras Lecture 1: Introduction Course Objectives: The focus of this course is on gaining understanding on how to make an

More information

CS 246 Review of Linear Algebra 01/17/19

CS 246 Review of Linear Algebra 01/17/19 1 Linear algebra In this section we will discuss vectors and matrices. We denote the (i, j)th entry of a matrix A as A ij, and the ith entry of a vector as v i. 1.1 Vectors and vector operations A vector

More information

Chapter 7: Symmetric Matrices and Quadratic Forms

Chapter 7: Symmetric Matrices and Quadratic Forms Chapter 7: Symmetric Matrices and Quadratic Forms (Last Updated: December, 06) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). A few theorems have been moved

More information

1. General Vector Spaces

1. General Vector Spaces 1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule

More information

1. What is the determinant of the following matrix? a 1 a 2 4a 3 2a 2 b 1 b 2 4b 3 2b c 1. = 4, then det

1. What is the determinant of the following matrix? a 1 a 2 4a 3 2a 2 b 1 b 2 4b 3 2b c 1. = 4, then det What is the determinant of the following matrix? 3 4 3 4 3 4 4 3 A 0 B 8 C 55 D 0 E 60 If det a a a 3 b b b 3 c c c 3 = 4, then det a a 4a 3 a b b 4b 3 b c c c 3 c = A 8 B 6 C 4 D E 3 Let A be an n n matrix

More information

1 Determinants. 1.1 Determinant

1 Determinants. 1.1 Determinant 1 Determinants [SB], Chapter 9, p.188-196. [SB], Chapter 26, p.719-739. Bellow w ll study the central question: which additional conditions must satisfy a quadratic matrix A to be invertible, that is to

More information

ELEMENTARY LINEAR ALGEBRA

ELEMENTARY LINEAR ALGEBRA ELEMENTARY LINEAR ALGEBRA K R MATTHEWS DEPARTMENT OF MATHEMATICS UNIVERSITY OF QUEENSLAND First Printing, 99 Chapter LINEAR EQUATIONS Introduction to linear equations A linear equation in n unknowns x,

More information