component risk analysis

Similar documents
risk assessment of systems

Review (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology

Structural Reliability

Review (Probability & Linear Algebra)

Multivariate Distributions

Reduction of Random Variables in Structural Reliability Analysis

A Probability Review

x. Figure 1: Examples of univariate Gaussian pdfs N (x; µ, σ 2 ).

L03. PROBABILITY REVIEW II COVARIANCE PROJECTION. NA568 Mobile Robotics: Methods & Algorithms

Background Mathematics (2/2) 1. David Barber

Bayesian Networks. instructor: Matteo Pozzi. x 1. x 2. x 3 x 4. x 5. x 6. x 7. x 8. x 9. Lec : Urban Systems Modeling

Multivariate Statistical Analysis

Gaussian random variables inr n

STA 4273H: Statistical Machine Learning

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2.

Sensitivity and Reliability Analysis of Nonlinear Frame Structures

Computer Vision Group Prof. Daniel Cremers. 9. Gaussian Processes - Regression

1 Data Arrays and Decompositions

Nonparametric Bayesian Methods (Gaussian Processes)

Multivariate Statistics

MACHINE LEARNING ADVANCED MACHINE LEARNING

Physics 403. Segev BenZvi. Numerical Methods, Maximum Likelihood, and Least Squares. Department of Physics and Astronomy University of Rochester

MACHINE LEARNING ADVANCED MACHINE LEARNING

Elliptically Contoured Distributions

Computer Vision Group Prof. Daniel Cremers. 4. Gaussian Processes - Regression

Adaptive Filtering. Squares. Alexander D. Poularikas. Fundamentals of. Least Mean. with MATLABR. University of Alabama, Huntsville, AL.

COMP 558 lecture 18 Nov. 15, 2010

Mathematical foundations - linear algebra

2 Functions of random variables

VAR Model. (k-variate) VAR(p) model (in the Reduced Form): Y t-2. Y t-1 = A + B 1. Y t + B 2. Y t-p. + ε t. + + B p. where:

Whitening and Coloring Transformations for Multivariate Gaussian Data. A Slecture for ECE 662 by Maliha Hossain

Fundamentals of Matrices

EFFICIENT MODELS FOR WIND TURBINE EXTREME LOADS USING INVERSE RELIABILITY

ECE521 week 3: 23/26 January 2017

Lecture Notes: Geometric Considerations in Unconstrained Optimization

2. Linear algebra. matrices and vectors. linear equations. range and nullspace of matrices. function of vectors, gradient and Hessian

Mobile Robotics 1. A Compact Course on Linear Algebra. Giorgio Grisetti

CMPE 58K Bayesian Statistics and Machine Learning Lecture 5

Linear Algebra for Machine Learning. Sargur N. Srihari

Chapter 5 continued. Chapter 5 sections

Sequential Importance Sampling for Rare Event Estimation with Computer Experiments

Econ Slides from Lecture 7

The Multivariate Gaussian Distribution [DRAFT]

3. Probability and Statistics

Guideline for Offshore Structural Reliability Analysis - General 3. RELIABILITY ANALYSIS 38

Robotics 2 Data Association. Giorgio Grisetti, Cyrill Stachniss, Kai Arras, Wolfram Burgard

5. Discriminant analysis

On the Fisher Bingham Distribution

[y i α βx i ] 2 (2) Q = i=1

7. Symmetric Matrices and Quadratic Forms

Problem 1: Toolbox (25 pts) For all of the parts of this problem, you are limited to the following sets of tools:

1 Appendix A: Matrix Algebra

Eigenvalues and diagonalization

Created by Erik Kostandyan, v4 January 15, 2017

8 - Continuous random vectors

Linear Algebra, part 3 QR and SVD

MACHINE LEARNING. Methods for feature extraction and reduction of dimensionality: Probabilistic PCA and kernel PCA

Foundations of Computer Vision

Gaussian Models (9/9/13)

Statistics for scientists and engineers

Statistics. Lent Term 2015 Prof. Mark Thomson. 2: The Gaussian Limit

Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17

Probabilistic Graphical Models

5. Random Vectors. probabilities. characteristic function. cross correlation, cross covariance. Gaussian random vectors. functions of random vectors

Bayesian decision theory Introduction to Pattern Recognition. Lectures 4 and 5: Bayesian decision theory

1.6: 16, 20, 24, 27, 28

EEL 5544 Noise in Linear Systems Lecture 30. X (s) = E [ e sx] f X (x)e sx dx. Moments can be found from the Laplace transform as

Discriminant analysis and supervised classification

Today: Fundamentals of Monte Carlo

Reduction of Random Variables in Structural Reliability Analysis

Short course A vademecum of statistical pattern recognition techniques with applications to image and video analysis. Agenda

Bayesian Regression Linear and Logistic Regression

CSE 554 Lecture 7: Alignment

Safety Envelope for Load Tolerance and Its Application to Fatigue Reliability Design

Non-linear least squares

A geometric proof of the spectral theorem for real symmetric matrices

Overfitting, Bias / Variance Analysis

Computational Methods CMSC/AMSC/MAPL 460. Eigenvalues and Eigenvectors. Ramani Duraiswami, Dept. of Computer Science

Kernel Methods. Machine Learning A W VO

Exercises * on Principal Component Analysis

Discrete Mathematics and Probability Theory Fall 2015 Lecture 21

Introduction to Mobile Robotics Compact Course on Linear Algebra. Wolfram Burgard, Bastian Steder

8. Diagonalization.

Announcements (repeat) Principal Components Analysis

Random Matrix Eigenvalue Problems in Probabilistic Structural Mechanics

Transformation of Probability Densities

PCA & ICA. CE-717: Machine Learning Sharif University of Technology Spring Soleymani

Multivariate Distribution Models

L3: Review of linear algebra and MATLAB

Unsupervised Learning: Dimensionality Reduction

EECS 275 Matrix Computation

Previously Monte Carlo Integration

Random Vibrations & Failure Analysis Sayan Gupta Indian Institute of Technology Madras

Next is material on matrix rank. Please see the handout

Statistical Geometry Processing Winter Semester 2011/2012

Link to Paper. The latest iteration can be found at:

The Expectation-Maximization Algorithm

Lecture Notes 1: Vector spaces

Chapter 3 Numerical Methods

Dimensionality Reduction and Principle Components

Transcription:

273: Urban Systems Modeling Lec. 3 component risk analysis instructor: Matteo Pozzi 273: Urban Systems Modeling Lec. 3 component reliability

outline risk analysis for components uncertain demand and uncertain capacity; multivariate normal distribution: definition; properties; transformation to standard normal space; design point; multivariate log normal distribution; First Order Reliability Method; sensitivity analysis. 273: Urban Systems Modeling Lec. 3 component reliability 2

example of components, general framework A structure, say a bridge. A road segment. An electrical component. A pump in a water system. A component is modeled by a set of random variables, describing loads, demands, capacity, resistance, features affecting the behavior. These variables are modeled by a joint distribution: The functioning of the component is described by a binary variable: the safe, of functioning state, and the failure. Task: computing the probability of failure, Pfailure 9% 273: Urban Systems Modeling Lec. 3 component reliability 3

PART I approaches to component risk analysis 273: Urban Systems Modeling Lec. 3 component reliability 4

reliability with uncertain load and resistance: method I, the load: ;,, the resistance: independence: s ;, p(s), p(r). 2 3 4 6 7 r, s find safe condition limit state function: failure p(s) p(r) P var var var always true The difference between two normal rv.s is a normal rv. [to be proved later] ;, Φ ;, standard normal cdf Φ think of as the residual capacity P if resistance R is known Φ 273: Urban Systems Modeling Lec. 3 component reliability

reliability with uncertain load and resistance: method II 2 joint prob. in vector notation exp 2.4 2 p(g).2 exp 2.3.2, g P. -. -.2 with correlated random variables:, -.3 2 x 2 = r 2 4 x = s 6 273: Urban Systems Modeling Lec. 3 component reliability 6

example of reliability problem : multivariate normal variable [defined later] vector notation: KN 2.KN.KN 3% 4.9.9 2.2 KN KN 2 2.KN reliability index [defined later]: probability of damage: 2. 2.37 Φ.89% 273: Urban Systems Modeling Lec. 3 component reliability 7

example of reliability, changing correlation : multivariate normal variable [defined later] varying the correlation coefficient: ; 2 2 = -.99 2 2 = -.3 sr -.8 -...6 x 2 = r x 2 = r P f.4.2, 2, 2 2 2 = 2 2 =.6 8 6 4 x 2 = r x 2 = r 2 - -.. sr, 2 x = s, 2 x = s 273: Urban Systems Modeling Lec. 3 component reliability 8

reliability with uncertain load and resistance: method III p(x,x 2 ).3.2. x 2 = r 2 4 x = s 6 x 2 = r 7 6 4 3 2,, safe domain failure domain, 2 4 6 x = s p(x,x 2 ), g(x,x2).3.2. -. -.2 -.3,, classical reliability problem: solve an integral., x 2 = r 2 4 x = s 6 273: Urban Systems Modeling Lec. 3 component reliability 9

reliability with uncertain load and resistance: method III 7,, 7,, 6 6 u 2 x 2 = r 4 3 x 2 = r 4 3 u 2 x 2 2 x 2 x 2 4 6 x = s, x transformation: orthogonal to,, 2 4 6 x = s transformation to standard normal space: then it is easy standard normal var.: 273: Urban Systems Modeling Lec. 3 component reliability

reliability with uncertain load and resistance: method IV x 2 = r,, 7 6 4 3 2 x 2 x 2 4 6 x = s,,, conditional cumulative distribution s prob. that resistance is lower than load, for load equal to. 273: Urban Systems Modeling Lec. 3 component reliability

reliability with uncertain load and resistance: method IV p(s), p(r) F(s), F(r).2.2.... 2 p(s) p(r) r, s 2 r, s,, prob. that load is higher than resistance, for resistance equal to. alternative formulation: s, conditional cumulative distribution prob. that resistance is lower than load, for load equal to. 273: Urban Systems Modeling Lec. 3 component reliability 2

towards multivariate normal distribution 2 exp 2 2 exp 2 2 exp 2 2 2, number of dimension exp 2 determinant parameters ;, multivariate normal distribution 273: Urban Systems Modeling Lec. 3 component reliability 3

PART II Gaussian model for component risk analysis 273: Urban Systems Modeling Lec. 3 component reliability 4

multivariate normal distribution pdf: ;, 2 exp 2 vector of random variables = 4, 2 = 6, = 2, 2 = 3, 2 =.4 mean vector covariance matrix : E : var, : p(x,x 2 ).2.2... x 2 - - x.3 273: Urban Systems Modeling Lec. 3 component reliability

multivariate normal distribution in log. scale pdf: gradient: log ;, Hessian matrix: maximum: uniform curvature, always negative definite. So MVN is log concave. 2 p(x,x 2 ) - - - = 4, 2 = 6, = 2, 2 = 3, 2 =.4 Simplest case: the standard MVN: log ;, 2 2 x 2 - - x 273: Urban Systems Modeling Lec. 3 component reliability 6

multivariate normal distribution: contour plot pdf: log ;, 2 contour line: const. = 4, 2 = 6, = 2, 2 = 3, 2 = lines are ellipses centered in the mean = 4, 2 = 6, = 2, 2 = 3, 2 =.4 x 2 = 4, 2 = 6, = 2, 2 = 3, 2 = -.9 x 2 - - x examples, changing the correlation only x 2 - - x - - x 273: Urban Systems Modeling Lec. 3 component reliability 7

multivariate normal distribution: eigenvalues pdf: log ;, 2 contour line: const. eigen value decomposition: = 4, 2 = 6, = 2, 2 = 3, 2 =.4 : eigenvector matrix Eigenvectors form an ortho normal base: i. e. : eigenvalue matrix eigen problem: x 2 - - x 273: Urban Systems Modeling Lec. 3 component reliability 8

multivariate normal distribution: eigenvalues pdf: log ;, 2 contour line: const. eigen value decomposition: = 4, 2 = 6, = 2, 2 = 3, 2 =.4 principal components : / / x 2 in terms of variables, the contour line (surfaces) are circles (spheres): is standard MVN - - x 273: Urban Systems Modeling Lec. 3 component reliability 9

multivariate normal distribution: eigenvalues principal components: / inverse relation: original rand. var.s as a function of the components: = 4, 2 = 6, = 2, 2 = 3, 2 =.4 / basic idea of eigen values: to change point of view: from canonical base to an ortho normal base centered in the mean. Now variables looks uncorrelated. Re scale using : now variable has also unit variance. x 2 Matlab: [m_v,m_l]=eig(m_sigma), eig - - x 273: Urban Systems Modeling Lec. 3 component reliability 2

example of: eigen value decomposition you may check that: 4 2.4 2.4 9.37.93.93.37 9.97 3.3.37.93.93.37 covariance matrix: eigenvector matrix: = 4, 2 = 6, = 2, 2 = 3, 2 =.4 4 2.4 2.4 9.37.93.93.37 eigenvalue matrix: Λ 9.97 3.3 x 2 Length of ellipse s principal axes: 3.6.74 - - x 273: Urban Systems Modeling Lec. 3 component reliability 2

covariance matrix properties: symmetry:, positive definitiveness: : :correlation matrix = 4, 2 = 6, = 2, 2 = 3, 2 = = 4, 2 = 6, = 2, 2 = 3, 2 =.6 = 4, 2 = 6, = 2, 2 = 3, 2 = -.9 x 2 x 2 x 2 - - - - - - x x x 273: Urban Systems Modeling Lec. 3 component reliability 22

properties of MN: marginalization ;, parameters 2 exp 2 \ ;, rand. vars. ;, marginal is normal = 99% = % same, same marginal = -3% same marginal 273: Urban Systems Modeling Lec. 3 component reliability 23

properties of MN: marginalization [cont.] ;, 2 exp 2 partition: marginal probability: ;, Marginalization may be computationally expensive in general. But if a vector of rand. vars. is jointly normal, any subset is jointly normal as well, and parameters can be directly read in those of the joint set. 273: Urban Systems Modeling Lec. 3 component reliability 24

properties of MN: conditional ;, 2 exp 2 After observing, the conditional distribution of is still normal: ;, the reduction of variance does not depend on the value observed if uncorrelated, : For jointly normal rand. vars., uncorrelation and independence are equivalent. 273: Urban Systems Modeling Lec. 3 component reliability 2

properties of MN: conditional [cont.] ;, 2 p(x 2 x ) p(x,x 2 ) p(x ) x 2. p(x =.3,x 2 ) p(x,x 2 =.4).2.4 x.6 p(x 2 ).8 p(x x 2 ) 6 4 2. x 2. x 2 x x.. 273: Urban Systems Modeling Lec. 3 component reliability 26

example of marginalization/conditional ;, marginalization vector of random variables mean vector 6 4 ;, covariance matrix conditional suppose to observe 4.2.2 9 2.4 6 2.4 3.6 2.4 2.4 6 3.6 6 3.2 3.2 4 7 2 4 9 3.6 3.6 4 reduction of uncertainty ;, 9 3.6 3.6 4.2 6 2.4 3.2 4 2.4 2.4 6.2 2.4 6 3.2 6.7 2.2 2.2 2.3 4.2 6 2.4 3.2 4 2.4 2.4 6 7 2 6.8 4.8 273: Urban Systems Modeling Lec. 3 component reliability 27

recap: transformation of random variables in d p z (z) F z (z) z = f(x) x x = f - (z) = g(z) random variable, transformation new random variable, z z : monotonically increasing inverse p z (z), F z (z) conservation of probability p x (x), F x (x) x p x (x) F x (x) 273: Urban Systems Modeling Lec. 3 component reliability 28

transformation of multivariate rand. vars. vector of rv.s joint probability,,, dim: inverse map: invertible map find:,,, : Jacobian Jacobian of the inverse map dim.: when determinant of the Jacobian general formula: 273: Urban Systems Modeling Lec. 3 component reliability 29

transformation of multivariate rand. vars. [cont.].8.2 x 2.6.4.2 area( ) area( ) 2.2 y 2.8.6.4. x area( ) 4% area( ).2.. y 2. e.g.: uniform 2... x.. x 2 equal probability (volume). y.. y 2. 273: Urban Systems Modeling Lec. 3 component reliability 3

sign of the determinant of the Jacobian the map preserves orientation x 2 y 2 y we are only interested in the ratio between areas, hence we take the absolute value of the determinant. x http://noirbabes.com/preco de/22/8/26/32/ y 2 the map inverts orientation y 273: Urban Systems Modeling Lec. 3 component reliability 3

linear transformation of mult. rand. vars. linear transformation:.4 x 2.8.6.4.2. x y 2.2.8.6.4.2.2.4.6.8 y inverse transformation: for a linear transformation, the Jacobian (and consequently its determinant) is uniform. 273: Urban Systems Modeling Lec. 3 component reliability 32

example of linear transformations: x 2.8.6.4.2. x pure rotation cos /3 sin /3 sin /3 cos /3 y 2.4.2 -.2 -.4 -.6 -.8. y diagonal (no rotation)...7 y 2...2.4 y general.6.3.3.3.73.33.37 y 2.2.8.6.4.2 -.2 -.4 -.2.2.4.6 y 273: Urban Systems Modeling Lec. 3 component reliability 33

linear transformation of jointly normal rand. vars. ;, 2 exp 2 linear invertible transformation: ;, exp 2 exp 2 ;, same as for mean vector and covariance matrix of every multivariate rand. var.s this proves that: A linear combination of jointly normal rand. var.s is also jointly normal. This is true in general, also for a transformation to a smaller space, e.g. from vector to scalar (proved by marginalization). 273: Urban Systems Modeling Lec. 3 component reliability 34

summary on jointly normal rand. vars. ;, the joint probability is completely defined by mean vector and covariance matrix, which are the parameters of the distribution. the conditional distribution, given any subset of variable, is also jointly normal. each subset of is jointly normally distributed, and marginalization is computationally trivial (just copy part of and ). note: if the marginal probability of each variable is normal, this does not imply that the set of variables is jointly normal. any linear transformation of the variables is jointly normal: ;, ADVANCED the variables can be easily mapped into the «standard normal space». 273: Urban Systems Modeling Lec. 3 component reliability 3

linear transformation of jointly normal rand. vars. ;, distribution of : ;, from linear transformation rule sum: 2 difference: 2 example: 7 3 7 3 many loads, many resistances: limit state function 4 3 6 8 2 resistances loads 4 3 6 8 2 273: Urban Systems Modeling Lec. 3 component reliability 36

sum of two random variables in the general case joint probability,,,,,, convolution integral, hopefully it can be solved for specific distributions,. if independency,, second moment representation: always true difference: 273: Urban Systems Modeling Lec. 3 component reliability 37

reliability for normal vars., with linear limit state func. linear limit state function: safe condition failure.3 P.2 distribution of : ;, p(x,x 2 ), g(x,x2). -. probability of failure : Φ -.2 -.3 reliability index : x 2 = r 2 4 x = s 6 273: Urban Systems Modeling Lec. 3 component reliability 38

why do we assume a MVN model? consider ~ [not necessarily ] does and exist (can be computed)? consider linearly related to : : safe condition so that failure -.4.3 p norm. appr. can we compute and var? why we need ~? Because we get ~ and we can easily compute P p(x) F(g).2.. =44% appr. =27% - g 273: Urban Systems Modeling Lec. 3 component reliability 39

PART III transformation of the Gaussian model 273: Urban Systems Modeling Lec. 3 component reliability 4

transformation to standard normal space Given and, find and so that: ;, d: ;, Cholesky decomposition: Given any matrix (positive definite), chol is a lower triangular matrix so that. standard normalization: Eigenvalue analysis: Given any matrix, is orthonormal matrix, is a diagonal matrix so that. not the same map. / Cholesky is simpler. / Matlab: m_l=chol(m_sigma,'lower') 273: Urban Systems Modeling Lec. 3 component reliability 4

example of transformation to standard normal space ;, 4.2.2 9 2.4 6 2.4 3.6 inverse relation: Eigenvalue 6 4 2.4 2.4 6 3.6 6 3.2 3.2 4 Cholesky.3.29.38.68.22.27.4. Cholesky chol Eigenvalue /...34.2.8.4.26 2..6 2.94.2.8.2.98.7.66.3.97.4.6.8.8.28.79.4.748.42.84.236.66.74.6 3.36.26.43.8.68 2.27.48 3.72.4.28 3..9.32.3.22.77. 2.76 273: Urban Systems Modeling Lec. 3 component reliability 42

p(u,u 2 ) density in the standard normal space ;, polar coord..2... 2 u 2 p(u,u 2 =) -2-2 2 exp 2 p(u =,u 2 ) u 2 u 2 3 2 - -2 2 u exp 2-3 -3-2 - 2 3 () ;,.8.6 2 2 3.4 2 3 Maximum density in the origin, fast decay in radial direction. Radial symmetry: density only dependents on. ().3.2. pdf cdf 273: Urban Systems Modeling Lec. 3 component reliability 43

rotation in the standard normal space ;, polar coord. 2 new reference system: for an ortho normal system: new coordinates: distribution in new coordinates exp 2 u 2 3 2 - -2 2 exp 2 ;, 273: Urban Systems Modeling Lec. 3 component reliability u -3-3 -2-2 3 ;, ;, () ().8.6 2 2 3.4.3.2. pdf cdf 2 3 the distribution is invariant respect to rotation 44

properties of the standard normal space ;, polar coord. 2 exp 2 2 exp 2 ;, 2 for each number of dimensions, there is just one standard normal space; the distribution is invariant respect to rotation; the origin,, is the mean vector and it is the (only) mode (i.e. maximum); each variable is scaled to (zero mean and) unit standard deviation; each variable is independent from the others; all marginal distributions are the same:, (standard normal); the density at one point () depends only by the distance from the origin () and the number of dimensions (). 273: Urban Systems Modeling Lec. 3 component reliability 4

reliability in the standard normal space transformation from standard normal to physical space: limit state function in the standard normal space linear limit state functions stay linear: as expected, reliability in standard normal space and in the physical space are equivalent: probability of failure : 273: Urban Systems Modeling Lec. 3 component reliability 46

design point in the standard normal space design point design point: the most dangerous condition: arg max in standard normal space: Failure Domain exp 2 log 2 arg min the design point is the point in the failure domain closest to the origin. If : arg min origin in the safe domain, i.e. low probability of failure. design point: it belongs to the failure domain (it is on the edge safe/failure); it has a high probability (the highest in the failure domain); it can be found by solving a constrained optimization problem; for linear limit state functions, the solution is very simple. 273: Urban Systems Modeling Lec. 3 component reliability 47

design point in the standard normal space [cont.] limit state function design point conditions to find design point vector of norm coordinates of the design point 273: Urban Systems Modeling Lec. 3 component reliability 48

reliability using design point, in stand. normal space design point coordinates of the design point reliability index Φ [check that this is consistent with previous result] once you have found the design point, you can measure how far the failure domain is from the origin, and compute the probability of failure. Summary: Transform your belief in the standard normal space, and define the new limit that function. Find the design point, measure how far is it from the origin to get the reliability index. 273: Urban Systems Modeling Lec. 3 component reliability 49

design point in the physical space [normal variables] 4 3 standard normal space 2 =, 2 =, = 2, 2 =., 2 =.6 2 u 2 x 2 = r - -2-3 -4-4 -2 2 4 u arg max physical space 2 x = s arg max The design point is the most dangerous scenario: it is a (incipient) failure condition, and it is the scenario with highest probability in the failure domain. If the map is linear, the design point in the physical coordinates is. If it is not linear, previous equation can be only approximate. 273: Urban Systems Modeling Lec. 3 component reliability

reliability index it gives the order of magnitude of the probability of failure: Φ Φ example, problem: Φ Φ [actually, if the set is an hyper plane, and is regular, continuous] IF the limit state function is linear in standard normal space, than the reliability index is the distance between the origin and the design point. IF NOT, it is not necessary. ;, 2 P f - 2 4 6 273: Urban Systems Modeling Lec. 3 component reliability - -2-3 -4 - -6-7 -8-9 %.6% 2 2.28% 3.3% 4 3.7 2.87 7 6.99 9

log normal multivariate distribution log scale ;, exp log linear scale ln;, Jacobian determinant of the Jacobian exp exp exp log normal density log ;, 2 exp 2 log log ln;, 273: Urban Systems Modeling Lec. 3 component reliability 2

moments to parameters for log norm. mult. distr. ln;, ;, parameters: log linear scale log scale moments of : relations: ln for small ln as for d ln for small ln for small 273: Urban Systems Modeling Lec. 3 component reliability 3

properties of log normal multivariate distribution =, 2 =., =., 2 =.8, xx2 =.6 =, 2 =., =., 2 =.8, xx2 =.6 p(z,z 2 ).8.6.4 9 8 7 6.2 z 2 4 3 2 z 2 2 4 6 8 z 2 4 6 8 completely defined by mean vector and covariance matrix; marginal and conditional distributions of any subset of rand. vars. are lognormal; product functions are jointly lognormal; uncorrelation implies independence. z 273: Urban Systems Modeling Lec. 3 component reliability 4

r s problem with log normal rand. var.s load and resistance: ln;, consider the load to resistance ratio: safe condition if log failure if log log log log log limit state function: log log log safe condition failure in the logarithm scale, the formulation is equivalent to that with normal rand. vars. log ;, log log 273: Urban Systems Modeling Lec. 3 component reliability

reliability problem with log normal rand. var.s ln;, limit state function log vector of random variables log log we can re shape the problem as that of a linear limit state function on a jointly normal distributed variable: example: failure 7 2 4 3 7 24 3 7 2 4 3 failure with, > log log ;, 8.7 3. log 2.93 273: Urban Systems Modeling Lec. 3 component reliability 6

PART IV general approach and FORM 273: Urban Systems Modeling Lec. 3 component reliability 7

general reliability problem given 8 6 joint probability limit state function compute When many random variables are involved in the problem (high dimensional space), it is expensive to compute the integral. x 2 4 No analytical solutions are generally available. 2 2 4 6 8 x The integral can be solved numerically, by counting along a grid (but that method is ineffective because of the course of dimensionality). Approximate solutions are provided by reliability methods (FORM: first order reliability method). Or by simulations (Monte Carlo). For reliability methods and for simulations it is convenient to formulate the problem in the standard normal space. 273: Urban Systems Modeling Lec. 3 component reliability 8

general reliability problem in stand. norm. space given joint probability limit state function compute 3 8 6 2 x 2 u 2 4-2 -2 2 4 6 8-3 -3-2 - 2 3 x u find transformation to the standard normal space: : ;, 273: Urban Systems Modeling Lec. 3 component reliability 9

going to the standard normal space It can be easily done for any jointly normal distribution (e.g. using Cholesky). Also for any jointly log normal distribution (taking the log, and using Cholesky). It can also be done for any distribution (Rosenblatt transformation), but it may complicate. u 2 3 2 - -2 why we prefer this space: once here, distribution is very simple. -3-3 -2-2 3 u variables are uniform, in the same scale, uncorrelated. you can easily generate samples from the distribution, you can approximate the solution finding the design point (FORM) 273: Urban Systems Modeling Lec. 3 component reliability 6

First Order Reliability Method (FORM) find design point: in standard normal space design point arg max arg min compute approximate reliability index: Φ approximate limit state (linear approximation at the design point) 273: Urban Systems Modeling Lec. 3 component reliability 6

FORM in d p(u), g(u) standard normal var.: non linear limit state function:.8.6.4.2 -.2 -.4 4 is in the safe domain design point: : approximation: Φ safe failure -.6 - u find design point find zero Newton Raphson method start at approximate (Taylor) derivative (gradient in higher dim.) repeat until convergence 273: Urban Systems Modeling Lec. 3 component reliability 62

FORM in d [cont.] p(u), g(u) standard normal var.: non linear limit state function:.8.6.4.2 -.2 -.4 4 is in the safe domain design point: : approximation: Φ safe failure -.6 - u find design point find zero Newton Raphson method start at approximate (Taylor) derivative (gradient in higher dim.) repeat until convergence 273: Urban Systems Modeling Lec. 3 component reliability 63

FORM for more than variable probability limit state function ;, [generally non linear] [standard normal space] linear approximation around [Taylor] gradient design point: distant from the origin: 273: Urban Systems Modeling Lec. 3 component reliability 64

FORM iterative method select repeat, from compute until convergence at set Φ 273: Urban Systems Modeling Lec. 3 component reliability 6

example of FORM 2 2 g(u,u 2 ) - -2 g(u,u 2 ) - -3-2 u 2 - - u -3 u 2 - - u 273: Urban Systems Modeling Lec. 3 component reliability 66

example of FORM 2 2 g(u,u 2 ) - -2 g(u,u 2 ) - -2-3 u 2 - - u -3 u 2 - - u 273: Urban Systems Modeling Lec. 3 component reliability 67

example of FORM u 2 8 6 4 2 # iter. 2.3333 3 4.786 4 3.999 3.9974 6 3.997 7 3.997-2 3.2-4 -6 Monte Carlo: 4. % -8-8 -6-4 -2 2 4 6 8 u 273: Urban Systems Modeling Lec. 3 component reliability 68

gradient following a transformation invertible map : inverse map: limit state function proof Suppose we have the Jacobian, and the gradient, we can compute the gradient as chain rule, multiplying Jacobian and gradient. 273: Urban Systems Modeling Lec. 3 component reliability 69

Jacobian of a composed map invertible maps : : proof Suppose we have the Jacobian, and that for, we can compute the Jacobian as chain rule, multiplying the two matrices. 273: Urban Systems Modeling Lec. 3 component reliability 7

example of reliability problem by FORM ln;, failure normal space exp ;,.4.2 7% 7% 2% limit state function 3 exp exp exp exp exp.49.98.98.49 standard normal space.7.4.69 ;, 273: Urban Systems Modeling Lec. 3 component reliability 7

example of reliability problem by FORM limit state function is not linear in the standard normal space (from integration and Monte Carlo).97% 2 design point u g(u,u2) - - - -2 - - - u - u u2 273: Urban Systems Modeling Lec. 3 component reliability 72

reliability problem by FORM: iterative scheme limit state function is not linear in the standard normal space.97% (from integration and Monte Carlo) g(u,u 2 ) 2 - u k = 4.64 3.2 22.62-2 - u - u 2 - - 3.3 2.28 u.64 % 9 273: Urban Systems Modeling Lec. 3 component reliability 73

reliability problem by FORM: iterative scheme limit state function is not linear in the standard normal space.97% (from integration and Monte Carlo) g(u,u 2 ) 2 - u k = 2 4.64 3.2 3.7.78 32-2 - u - u 2 - - 8.2 39.7 u.64 4. 9 2 273: Urban Systems Modeling Lec. 3 component reliability 74

reliability problem by FORM: iterative scheme limit state function is not linear in the standard normal space.97% (from integration and Monte Carlo) g(u,u 2 ) 2 - u k = 3 3.7.78 2.9.93 43.2-2 - u - u 2 - - 4.8 3.2 u 4. 3.6 2.% 273: Urban Systems Modeling Lec. 3 component reliability 7

reliability problem by FORM: iterative scheme limit state function is not linear in the standard normal space.97% (from integration and Monte Carlo) g(u,u 2 ) 2 - u k = 4 2.9.93 2.2.7.6-2 - u - u 2 - - 23.4 6. u 3.6 2.6.%.4% 273: Urban Systems Modeling Lec. 3 component reliability 76

reliability problem by FORM: iterative scheme limit state function is not linear in the standard normal space.97% (from integration and Monte Carlo) g(u,u 2 ) 2 - u k = 2.2.7 2.44.73.29-2 - u - u 2 - - 7.6.26 u 2.6 2.44.4%.48% 273: Urban Systems Modeling Lec. 3 component reliability 77

reliability problem by FORM: iterative scheme limit state function is not linear in the standard normal space.97% (from integration and Monte Carlo) g(u,u 2 ) 2 - u k = 6 2.44.73 2.42.77.36-2 - u - u 2 - - 6.7.28 u 2.44 2.42.48%.% 273: Urban Systems Modeling Lec. 3 component reliability 78

reliability problem by FORM: iterative scheme limit state function is not linear in the standard normal space.97% (from integration and Monte Carlo) g(u,u 2 ) 2 - u k = 7 2.42.77 2.42.79 3.9x 3-2 - u - u 2 - - 6.9.4 u 2.42 2.4.%.2% 273: Urban Systems Modeling Lec. 3 component reliability 79

reliability problem by FORM: iterative scheme limit state function is not linear in the standard normal space.97% (from integration and Monte Carlo) g(u,u 2 ) 2 - u k = 8 2.42.79 2.4.8.x 3-2 - u - u 2 - - 6.3.48 u 2.4 2.44.2%.2% compare with Monte Carlo result:.97% 273: Urban Systems Modeling Lec. 3 component reliability 8

FORM importance measures in the stand. norm. space importance measure: : is a load : is a capacity : irrelevant is a capacity is more important that linearized limit state function: design point: direction of the design point: 273: Urban Systems Modeling Lec. 3 component reliability 8

FORM importance measures in the stand. norm. space importance measure: : is a load : is a capacity : irrelevant is a capacity is more important that linearized limit state function: direction of the design point: stand. norm. space: ;, importance measure gives the importance of variable in the problem. 273: Urban Systems Modeling Lec. 3 component reliability 82

FORM importance measures in physical space linearized map linearized inverse map linearized limit state function constants stand. dev. of : contribution to the uncertainty (variance) of : we assume correlation matrix, because we are not interested in the correlation, to define the importance singular variables. normalized vector gives the importance measures of variables in. 273: Urban Systems Modeling Lec. 3 component reliability 83

example of importance measures in physical space design point: Standard normal space Normal space Physical space 2.4.8 9 32 % 3.9 2.9 2.88 8.2 exp exp exp 2 S 4.2 3.37.32.4.67 6.3 3.3 79 4.2 3.37 6.3 3.3 79 9 32 24 9 % 77 63 % 273: Urban Systems Modeling Lec. 3 component reliability 84

PART V further remarks on component reliability 273: Urban Systems Modeling Lec. 3 component reliability 8

general transformation to the standard normal space w p w (w)..8.6.4.2 u -4-2 2 4.8.6 - x = F x (w) w = F x (x).4.2 x a) every rand. var. distributed by:, can be transformed into a uniform rand. var. by transformation. ;, -4-2 2 4 x. p x (x) 273: Urban Systems Modeling Lec. 3 component reliability 86

w general transformation to the standard normal space..8.6.4.2 a) every rand. var. distributed by:, can be transformed into a uniform rand. var. by transformation. ;, b) uniform rand. var. can be transformed into rand. var., distributed by,, through transformation. -4-2 2 4 u, x hence can be derived by through. In particular, can be mapped into the standard normal distribution by transformation Φ. p w (w) u -4-2 2 4 u = - (w) w = (u) x = F x - (w) w = F x (x).8.6.4.2 x p u (u), p x (x) multivariate case: independent rand. vars. : Φ dependent rand. vars. Φ Φ Φ Rosenblatt transform. 273: Urban Systems Modeling Lec. 3 component reliability 87

properties of limit state function, to use FORM only the sign of the limit state function is relevant. Functions and, so that sign sign, are equivalent. the reliability does not depend on the slope of the gradient, or on the magnitude of : the reliability problem is defined by boundary: [and sign] a linear limit state function is convenient, because local data, at any point define the all boundary. p(u), g(u). -. -4-3 -2-2 3 4 u to use FORM (Newton method), we require function to be continuous and differentiable:. 273: Urban Systems Modeling Lec. 3 component reliability 88

convergence of Newton Rapshon method The method may not converge in some conditions: To overcome this problem, one may pose a maximum size in the steps taken by the algorithm:. see Wolfe Conditions and Armijo rule: http://en.wikipedia.org/wiki/wolfe_c onditions p(u), g(u)..4.3.2. -. -.2-2 2 4 6 8 u 273: Urban Systems Modeling Lec. 3 component reliability 89

SORM Second Order Reliability Method: it approximates the limit state function with a quadratic form around the design point. 2 design point limit state function is approximated taking curvature into account Hessian matrix It is more accurate than FORM, but computationally more expensive because it requires to obtain curvatures ( ) at the design point. It is a further step after FORM: find the design point compute curvature at. 273: Urban Systems Modeling Lec. 3 component reliability 9

bounds for FORM and SORM By definition, the design point is the closest to the origin. Hence the all region belongs to the safe domain. Let us define. FORM: upper bound to the probability of failure: P χ Cumulative Chi squared distribution, with degrees of freedom. design point χ [no lower bound] 2 - -2 P f FORM upper bound.. 2 2. 3-3 * 273: Urban Systems Modeling Lec. 3 component reliability 9

note about design point and reliability index definition of reliability index: Φ Φ distance of the design point from the origin: FORM approximation: design point arg max arg max design point for a non linear map, the design point in the stand. norm. space is not necessary mapped into the max. of the physical space in the failure domain. analogy: the mode of the (e.g. uni variate) normal distr. is not mapped into the mode of the log normal. 273: Urban Systems Modeling Lec. 3 component reliability 92

refereces on wikipedia: Cholesky decomposition Eigenvalues and eigenvectors Gradient Jacobian Positive definite matrix Multivariate normal distribution Newton's method Chi squared distribution Wolfe Condition Chain rule Barber, B. (22). Bayesian Reasoning and Machine Learning. Cambridge UP. Downloadable from http://web4.cs.ucl.ac.uk/staff/d.barber/pmwiki/pmwiki.php?n=brml.homepage. Section 8.4 on Multivariate Gaussian. Der Kiureghian, A. (2) "First and Second Order Reliability Methods", in book: E. Nikolaidis, D.M. Ghiocel, S. Singhal (Eds), The Engineering design reliability handbook, CRC Press LLC. Ditlevsen, O. and H.O. Madsen. (996). Structural reliability methods. J. Wiley & Sons, New York, NY. Downloadable from http://www.web.mek.dtu.dk/staff/od/books/od HOM StrucRelMeth Ed2.3.7 June September.pdf. Sections 2. 3, 4. 2,. Faber, M. (29) Risk and Safety in Engineering, lecture notes, Lectures 6, available at http://www.ibk.ethz.ch/emeritus/fa/education/ws_safety/non_printable_script.pdf Sørensen, J.D. (24) "Notes in Structural Reliability Theory And Risk Analysis", notes 3, avail. at http://www.waterbouw.tudelft.nl/fileadmin/faculteit/citg/over_de_faculteit/afdelingen/afd eling_waterbouwkunde/sectie_waterbouwkunde/people/personal/gelder/publications/citatio ns/doc/citatie2.pdf 273: Urban Systems Modeling Lec. 3 component reliability 93

MW Matlab commands M=zeros(n,m) : it defines matrix M, of size (nm), with all entries zero. length(v) : number of entries in vector v. M=diag(v) : it makes diagonal matrix M, putting vector v on the diagonal. L=chol(M,'lower') : compute lower triangular matrix L, from Cholesky decomp. of M. M.*M2: when matrices (or vectors) M and M2 have the same dimension, it makes matrices M3 as element by element product of M and M2. Similar allowed operations are: M./M2,./M, M.^2. 273: Urban Systems Modeling Lec. 3 component reliability 94