THERE IS growing interest in predicting the future health

Size: px
Start display at page:

Download "THERE IS growing interest in predicting the future health"

Transcription

1 IEEE TRANSACTIONS ON DEVICE AND MATERIALS RELIABILITY, VOL. 12, NO. 1, MARCH Prognostics of Multilayer Ceramic Capacitors Via the Parameter Residuals Jianzhong Sun, Shunfeng Cheng, Student Member, IEEE, and Michael Pecht, Fellow, IEEE Abstract This paper presents a parameter residual-based method for predicting the remaining useful life (RUL) of multilayer ceramic capacitors (MLCCs) under temperature-humiditybias conditions. Three performance parameters in each MLCC were monitored: capacitance, dissipation factor, and insulation resistance. A kernel regression method was used to estimate the parameters values of interest. The residuals were generated by the difference between the estimation and the actual monitored value. Based on the features of the residual data, a linear state space model was adopted to describe the dynamics of the residuals. The future evolution of the residuals was predicted with uncertainty bounds in a Bayesian framework. The failure threshold in terms of the parameter residuals was investigated. Then, the RUL of each MLCC with uncertainty bounds was determined. By comparing the predicted results with the experimental results, it was demonstrated that the proposed prognostics approach can provide an estimation of the RUL of MLCCs. Index Terms Kernel regression, multilayer ceramic capacitors (MLCCs), parameter residual, prognostics, state space model. I. INTRODUCTION THERE IS growing interest in predicting the future health state of electronics to provide advance warning of failure and reduce risk [1]. Multilayer ceramic capacitors (MLCCs) have been widely used in electronic products to perform functions such as noise reduction (bypass), direct current blocking, filtering, timing, tuning, and energy storage. Changes in the performance of MLCCs may result in product instability and failure. Many failure mechanisms can be traced to underlying physical or chemical degradation processes. A degradation process may be linear or nonlinear. When it is possible to measure degradation, such measurements often provide valuable information about a product s health state. Defining the relationship between component failure and the amount of degradation makes it possible to use a degradation model along with monitored data to predict the failure time [2]. Compared to conventional reliability analysis approaches typically based on lifetime data, degradation analysis provides more information, Manuscript received February 6, 2011; revised May 27, 2011; accepted July 7, Date of publication July 22, 2011; date of current version March 7, This work was supported in part by the Center for Advanced Life Cycle Engineering Consortium (CALCE). The work of J. Sun was supported in part by the Chinese Scholarship Council and in part by CALCE. J. Sun is with the Nanjing University of Aeronautics and Astronautics, Nanjing , China ( sunjianzhong@nuaa.edu.cn). S. Cheng and M. Pecht are with the Center for Advanced Life Cycle Engineering (CALCE), University of Maryland, College Park, MD USA ( chengsf@calce.umd.edu; pecht@calce.umd.edu). Color versions of one or more of the figures in this paper are available online at Digital Object Identifier /TDMR particularly in applications with few or no failures [3], [4]. Degradation analysis also makes it possible to assess the reliability of an individual product under actual operation conditions based on the measure of the degradation of the specific product. However, only in very few cases is it possible to measure the degradation of a product directly (e.g., tire wear [5]). The measures of product performance (e.g., temperature, resistance) are available in most situations where the degradation analysis can be carried out on the basis of performance parameters. The advantages of degradation analysis are compromised when the performance measurements are contaminated with noise or when there is no strong correlation between the actual degradation and performance measurements. Thus, in most degradation analysis, the challenge is to find variables that are highly related to the actual degradation state. For failure prognostics, another challenge is to develop an appropriate model to describe the dynamics of the specific variables against time. These challenges are investigated in this paper for prognostics of MLCCs in which the physical degradation of the components is difficult to characterize using nondestructive analysis techniques. Three electrical parameters capacitance (C), dissipation factor (DF), and insulation resistance (IR) were measured to assess the performance of the MLCCs. The performance parameters of MLCCs exhibit a variety of behavior during degradation [6], [7]. The degradation cannot be monitored directly, but failure may be determined by analyzing the performance parameters or the features extracted from the monitored performance parameters. For example, a study by J. Gu et al. [7] found that performance parameter residuals can be used to provide an advance warning of failure of MLCCs in THB tests. In that study, a simple polynomial regression model was first trained based on training data and then used to calculate the residuals. A healthy residual space was established based on the training data set. When a new residual value was out of the lower 95% bound, it was considered to be an advance warning of failure; if the residual was also outside of the lower 99.9% bound, it was defined as an estimated failure. A univariate cubic polynomial model was assumed for regression analysis based only on two of the three monitored parameters in [7]; the assumption on the model form in [7] imposed some constraints on the regression model and may not be appropriate, since no prior knowledge of the mathematical structure of the regression model is available. In this paper, a nonparametric regression method is adopted to calculate the residuals based on all three monitored performance parameters. In the experiment analysis in [7], the failure times were determined strictly according to the failure criterion /$ IEEE

2 50 IEEE TRANSACTIONS ON DEVICE AND MATERIALS RELIABILITY, VOL. 12, NO. 1, MARCH 2012 TABLE I TEST MATRIX AND NUMBER OF FAILURES Sudden changes in the performance parameters of MLCCs that are very close to, but do not exceed, the failure threshold may also result in severe instability of the product, thus decreasing the reliability of a system. However, the failure criteria adopted in [6] cannot handle such a situation. This paper introduces a failure prognostics methodology for MLCCs based on the parameter residual generated by the difference between the measured capacitance and its estimation. This capacitance estimate was obtained using a nonparametric regression method based on the dissipation factor and insulation resistance. A linear state space model was designed to describe the dynamics of the residual. The soft failure times of the components were investigated, and a soft failure criterion in terms of the parameter residual was developed. Given a failure threshold in terms of the residual, we can predict the failure time of an MLCC. Fig. 1. Fig. 2. Normalized capacitance values for four training samples. Normalized dissipation factor values for four training samples. II. EXPERIMENT A total of ten MLCCs were selected for in situ monitoring and life testing in elevated temperature (85 C) and humidity (85% RH) conditions with 50 V bias voltage. During testing, three performance parameters the insulation resistance, capacitance, and dissipation factor were monitored in situ. The measurements of the electrical parameters of each capacitor were taken every 200 min, and the total THB test lasted for around 1240 h. The test matrix is listed in Table I. Fig. 3. Normalized insulation resistance values for four training samples. III. PARAMETER RESIDUAL CALCULATION The prognostics method proposed in this study was developed based on the parameter residuals. Data normalization was first performed for each parameter, and then a kernel regression method was introduced to calculate the parameter residual. A. Data Normalization Due to manufacturing variance, the performance parameters of each component may have had different initial values. Thus, some data preprocessing was applied to the raw performance data. First, the relative values of the three performance parameters were computed: ˆP i =(P i P 0 )/P 0 (1) where ˆP i is the relative value of the performance parameter P i, and P 0 is the initial value of the corresponding parameter. The performance data were then normalized, as in [7]. We selected four survived capacitors as the training samples. Their data were normal (i.e., no abnormal behavior was observed in the data). On the basis of the training data set, we cal- culated the mean and standard deviation for each performance parameter (IR, C, and DF) using μ = 1 n x i (2) n σ = n (x i μ) 2 /(n 1) (3) where μ and σ are the mean and standard deviation, and n is the number of the training samples. Then, data normalization was performed for each parameter of all the MLCCs using the following equations: NC i =(C i μ C )/σ C (4) NDF i =(DF i μ DF )/σ DF (5) NIR i =(IR i μ IR )/σ IR (6) where C i, DF i, and IR i are the relative values of the performance parameters for C, DF, and IR for the ith sample data point, respectively; and NC i, NDF i, and NIR i are the normalized C i, DF i, and IR i, respectively, as shown in Figs. 1 3.

3 SUN et al.: PROGNOSTICS OF MULTILAYER CERAMIC CAPACITORS VIA THE PARAMETER RESIDUALS 51 B. Residual Calculation After normalization, regression analysis was performed to obtain the relationships among the normalized parameters based on the training data set. Then, the parameter of interest was estimated based on the other parameters. In this paper, a nonparametric regression method was used to construct an empirical regression model. Compared with parametric methods, which are defined by sets of parameters and predefined functional relationships, the nonparametric method does not need to make any assumptions about the mathematical structure of the regression model [8]. The nonparametric method stores past data in memory and processes them when a new query is made. In statistics and empirical modeling, the process of estimating a parameter s value by calculating a weighted average of historical training sample values is known as kernel regression [9], [10]. Rather than modeling a whole input space with a parametric model, kernel regression techniques are used to construct a local model in the immediate region of a query. When a query is made, the algorithm locates training samples in its vicinity and performs a weighted regression with the corresponding responses of the located training samples. The responses are weighted with respect to their proximity to the query point. Consider the simplest inferential model (i.e., one predictor x, one response y): n ŷ(x) = {K h [d i (X i x)] Y i } n K (7) h [d i (X i x)] where X i and Y i are the predictor and response of the ith training sample, respectively; K h [d i (X i x)] is the kernel function, which generates a weight for a given distance between a training sample and a query; and ŷ(x) is an estimate of y, given x. The nonparametric model operates by comparing a query (x) to the predictor part of each training sample (X) to determine the weight. The output is the weighted average of the response of the training sample (Y ). The kernel function generates a weight for a given distance. Therefore, it should have large values for small distances and small values for large distances. Many functions can satisfy this criterion; the Gaussian kernel is a commonly used one [11]: K h (d) = 1 2πh 2 exp( d2 /2h 2 ). (8) Here, h is commonly referred to as the kernel s bandwidth and is used to control the effective distances that are deemed similar. As for the distance function, a common one is Euclidean distance: d i (X i x) = (X i x) 2. (9) To develop the nonparametric model, the training samples used were divided into sample predictor X and response Y : X 1,1 X 1,2 X 1,p X 2,1 X 2,2 X 2,p X = X n,1 X n,2 X n,p, Y = Y 1 Y 2.. Y n. Fig. 4. Process diagram for calculation of parameter residuals using kernel regression method. Here, each row, X i, is the predictor vector of the ith training sample, and Y i is the response of the ith training sample. These training samples represent the memory of the nonparametric regression model. Using this format, a query vector is represented by the 1 p vector, x =[x 1,x 2,...,x p ]. For a query predictor, the corresponding response ŷ can be obtained using the kernel regression method in three steps, as shown in Fig. 4. 1) Compute the distance between a query vector x and each predictor of memory X: d i (X i,x)= (X i,1 x 1 ) 2 +(X i,2 x 2 ) (X i,p x p ) 2. (10) This calculation is repeated for each of the n memory vectors, resulting in an n 1 vector of distances, d = [d 1,d 2,...,d n ] T. 2) Compute the weights using the Gaussian kernel function according to (8). The weight vector is obtained as: w =[w 1,w 2,...,w n ] T. (11) 3) Finally, the weight vector is combined with the response vector of the memory to make predictions using the weighted average: n / n ŷ = w i Y i w i. (12) In this paper, the normalized parameters from four training samples (MLCCs No. 1, 2, 4, and 5) were used to construct the memory for the nonparametric model. The normalized capacitance is the response of the training sample with the other two parameters as the predictor vector of the training sample. After the memory matrix was built, when new measurements arrived, they were first processed according to the data processing procedure introduced in Section III-A. The estimated capacitance was then calculated based on the other parameters according to steps (1) (3) described above. The residual was the difference between the normalized real measurements of capacitance and the estimated capacitance. Two residual sequences from MLCC No. 4 (survived) and MLCC No. 6 (failed at the 962nd h)

4 52 IEEE TRANSACTIONS ON DEVICE AND MATERIALS RELIABILITY, VOL. 12, NO. 1, MARCH 2012 state space model to describe the dynamics of the degradation. We assumed that there was some estimation error for the capacitance, and the error was finally propagated into the residual error. The residual error also came from the sensor noise from the capacitance measurement. Hence, the residual error was the sum of the capacitance estimation error (which may be divided into regression model error and input error) and the error from the capacitance measured value. It is not easy to analyze all the residual error sources. Thus, in our approach, we assume that the residual error follows a Gaussian distribution with unknown variance to be estimated based on real data in a Bayesian framework. The linear state space degradation model is as follows: Fig. 5. Residual sequences for MLCC No. 4 and MLCC No. 6. MLCC No. 4 survived during the experiment, while MLCC No. 6 failed at the 962nd h according to the failure criteria. The decrease in the residual after the failure was due to the abnormal behavior of the performance parameters after failure. are shown in Fig. 5. It can be observed that as an MLCC approached the end of its lifetime, the residual increased. The residual sequences from other components also showed similar trends. IV. FAILURE PROGNOSTICS Based on the analysis of the experimental data, it was determined that the parameter residual would increase as the capacitor degrades. The parameter residual can be defined as the indirect measurement of the unobservable degradation state of the components. Then, by defining failure in terms of the parameter residuals, the failure time of the component can be predicted when it first exceeds the threshold. The failure threshold in terms of the residual can be determined based on the runto-failure data; this will be discussed in detail along with a case study in Section V. In this section, a linear growth model is introduced to describe the degradation of a component in terms of residuals and demonstrate how to predict the component s future degradation in a Bayesian framework. A. Linear Degradation Model The residuals for four failed samples (MLCCs No. 3, 6, 7, and 8) are plotted in Fig. 6. It can be observed that the parameter residual first evolved like random walking (without an evident trend), which may mean that there was little or no degradation in the early stages of its lifetime. This was followed by a rough linear growth trend with different rates as the end of life of each component approached. Many components or products with linear degradation trends in experiments have been reported in the reliability analysis literature. Suzuki, Maki, and Yokogawa [12] used linear degradation models to study the increase in resistance measurements over time. Linear degradation models were also used to study the laser degradation problem in [2], [13]. Researchers have reported using a linear model to describe the degradation of light-emitting diodes [14], semiconductor devices [15], and tire wear [5]. In this paper, a linear state space degradation model was adopted. Errors in the residual sequence due to sensor noise and data processing were also taken into account in the linear y t = μ t + v t v t N(0,V) (13) μ t = μ t 1 + β t 1 + w μ,t w μ,t N(0,W μ ) (14) β t = β t 1 + w β,t w β,t N(0,W β ) (15) where μ t is interpreted as the unobservable degradation state and β is the degradation rate. The latent degradation state was indirectly measured through the noisy parameter residual y t.to estimate the degradation rate, some dynamics were introduced into β through w β,t. This was a special case of the linear state space model with time-varying degradation rate β t for the dynamics of the degradation level μ t. Equation (13) is the observation equation, while (14) and (15) constitute the state equation. Here, we assumed that the degradation process had Gaussian noise, i.e., w μ,t N(0,W μ ) and w β,t N(0,W β ). The observations were also assumed to be contaminated with Gaussian noise (v t N(0,V)). In this model, the state vector was X t =(μ t,β t ) T, where μ t was interpreted as the level of actual degradation and β t as the degradation growth rate. The model assumed that the current level changed linearly over time and that the growth rate also evolved. It was thus more flexible than a global linear trend model and more suitable for describing the evolution of noisy residuals in our case. At the beginning, there was no evident trend. As the end of life approached, the growth rate increased to a certain level, and the component deteriorated at a constant rate. The model can be written more formally as a state space model [16]: { Yt = F t X t + v t v t N(0,V) (16) X t = G t X t 1 + w t w t N(0,W) [ μt ], G t = [ ] 1 1, F 0 1 t =[10], W = where X t = [ ] β t Wμ 0. 0 W β As the end of lifetime approached, there was a linear trend. Due to its flexibility, the linear state space model [(16)] is suitable to describe such an evolution. The state space model can adapt itself to the real data sequence with an adaptive rate parameter in the model (the degradation rate in our case). Thus, although the evolution of the residuals in Fig. 6 does not appear to be linear over the whole lifetime, the linear state space model can still track the residual evolution correctly.

5 SUN et al.: PROGNOSTICS OF MULTILAYER CERAMIC CAPACITORS VIA THE PARAMETER RESIDUALS 53 Fig. 6. Residual sequences for four failed samples. MLCC No. 8 experienced an intermittent failure at the 317th h and recovered after about 20 h. Vertical lines indicate the soft failure times. B. Degradation Estimation and Prediction Given the state space degradation model and the noisy observation of the degradation state, we obtained the optimal estimation of the actual degradation state and made further predictions regarding future degradation in a Bayesian framework. For a well-defined Gaussian linear state space model, there was a closed-form solution for state estimation and prediction. Using standard results from the multivariate Gaussian distribution, it was easily proven that the estimated and predictive state distributions were Gaussian, and it sufficed to compute their means and variances [16]. To facilitate the understanding of the following Bayesian conjugate inference and prediction, we here use the symbols closer to the traditional ones used in Bayesian inference. Let x t 1 y 1:t 1 N(m t 1,C t 1 ); then the one-step-ahead prediction is given by: where x t y 1:t 1 N(a t,r t ) (17) a t = E(x t y 1:t 1 )=G t m t 1 (18) R t =Var(x t y 1:t 1 )=G t C t 1 G T t + W t. (19) Moreover, the state estimation is given by: where x t y 1:t N(m t,c t ) (20) m t = E(x t y 1:t )=a t + R t Ft T Q 1 t e t (21) C t =Var(x t y 1:t )=R t R t Ft T Q 1 t F t R t (22) where e t = y t a t is the prediction error and Q t = F t R t F T t + V t. Equations (17) and (20) present a basic state estimation mechanism for the model in (16), where all the parameters are known. However, in practice only, rarely are the covariance matrices W t and V t completely known. In this paper, the process noise and observation noise were assumed to be Gaussian in form, but the values of the variances of the Gaussian distributions were unknown. Thus, a basic problem was estimating W t and V t jointly with the latent state. One typical method is maximum likelihood estimation. In a Bayesian framework, one alternative is the Bayesian inference, where the unknown parameters are regarded as random variables. Usually, there is no closed-form solution to these problems, and we have to turn to Monte Carlo simulation-based approaches for more complex state space models with unknown parameters, which is still an active research area. For some simple cases, such as the Gaussian linear case in this study, Bayesian inference can still be carried out in a closed form using conjugate priors. Further information can be found in [16], [17]. Suppose that at time t, we have obtained the state estimation results given by p(μ t y 1:t )=N(m t,c t ), p(β t y 1:t )= N(β,V β ), respectively, for degradation level and degradation rate. Then k-steps-ahead predictive degradation is still a Gaussian distribution, x t+k N(a t+k,r t+k ), where the mean and variance are given by (24) and (25) below. For k 1: a t+k = G t+k a t+k 1 R t+k = G t+k R t+k 1 G t+k + S (23) [ ] [ ] where a t =[m t,β] T Ct 0 W + Vβ 0, R t =, S = Substituting all known parameters, we get the mean and the variance of the predictive distribution. In this case: a t+k = m t + k β (24) R t+k = C t + k (W + V β ). (25) The variance of the predictive distribution R t+k represents the prediction uncertainty for the k-steps-ahead prediction. On the basis of the residual sequence, the degradation level and the degradation rate were estimated in a Bayesian framework. Given the estimation results, the degradation level, and the degradation rate in distribution form, degradation prediction

6 54 IEEE TRANSACTIONS ON DEVICE AND MATERIALS RELIABILITY, VOL. 12, NO. 1, MARCH 2012 was carried out using (23). Once new measurements arrived, the state estimation and prediction were updated recursively. Due to the statistical nature of the Bayesian method, the degradation prediction was given in a distribution form by (23). Since the failure was defined in terms of a specified level of degradation, the failure time distribution was deduced based on the predictive distribution of the degradation state. We assumed that failure occurred when the predicted degradation level, x t, reached the predefined failure threshold x F for the first time, i.e., x t x F.LetF T (t) denote the cumulative failure time distribution (or unreliability) at time t. Then, for an upper-bounded monotonic degradation process, the cumulative distribution function (CDF) for failure time can be expressed as follows: F T (t) =Pr[T t] =Pr[x t x F ]= + x F f(x t ) dx t (26) where T is the lifetime of a component, f(x t ) is the probability density distribution of the residual at time t, and x F is the failure threshold in terms of residuals. It has to be pointed out that there is very little error between Pr[T t] and Pr[x t x F ] due to the Gaussian process noise assumption. However, in the degradation stage of interest to us, the error can be reduced so as to become negligible, and (26) can be considered valid. Here, we use ˆF T (t) to denote the estimation of F T (t): On the basis of the failure time CDF, we can calculate other reliability indices of interest, such as the remaining useful life (RUL), which may be useful for maintenance or replacement decision making. Given the cumulative failure time distribution, any quantile lifetime of the conponent can be calculated according to: ˆF T (t) =F T (t) =Pr[x t x F ]= ˆF (T α )= + + x F f(x t ) dx (27) x F f (x Tα ) dx = α (28) T α is interpreted as the α quantile of the failure time distribution (e.g., the time T 0.10 by which the component will fail with a possibility of 10%). In some applications, we may be more interested in the conditional reliability of the component or system, given the fact that the component or system has survived until the last inspection time t c. For example, the conditional failure probability is given as follows: F T (t t c )=Pr[T t T >t c ] = Pr[t c <T t] Pr[T >t c ] = F T (t) F T (t c ) 1 F T (t c ) (29) where F T (t) is given by (26). Further conditional RUL or quantile lifetime can be obtained based on (28) by substituting ˆF (T α ) with ˆF (T α t c ). Fig. 7. Evolution of normalized IR of MLCC No. 7. The IR suddenly dropped to the failure threshold at about the 856th h and was followed by an intermittent failure. Fig. 8. Evolution of NIR of MLCC No. 3. The IR suddenly dropped to the failure threshold at about the 727th h, but it was not declared a failure according to the failure criterion until the 856th h. V. R ESULTS AND DISCUSSION The proposed prognostics method was demonstrated on the failed samples. The soft failure time of the failed samples was investigated first, and then a soft failure threshold in terms of the parameter residuals was determined based on the failed samples. Failure prediction was carried out based on the residual data using the method described in Section IV. A. Failure Threshold There were hard and soft failure criteria adopted in [7]. The hard failure criteria were defined as an IR drop to a value of less than 10 7 Ohms, a change in capacitance of 10%, or a doubling of the dissipation factor maintained for five consecutive readings during the THB test. The failure time determined based on these criteria used in [7] was called the hard failure time in this study. It was observed that there was a sudden and considerable drop in the IR parameter before a hard failure for each of the failed components. For example, MLCC No. 7 (shown in Fig. 7) failed right after the sudden drop, while the others were not declared to have failed after the sudden drop (MLCCs No. 3 and No. 6, shown in Figs. 8 and 9, respectively) according the hard failure criterion. Sudden drops can result in severe instability of the product, thus decreasing the reliability of the system. This sudden drop point in time can be defined as the soft failure time

7 SUN et al.: PROGNOSTICS OF MULTILAYER CERAMIC CAPACITORS VIA THE PARAMETER RESIDUALS 55 Fig. 9. Evolution of NIR of MLCC No. 6. The IR suddenly dropped to the failure threshold at about the 839th h, but it was not declared a failure according to the failure criterion until the 962nd h. TABLE II HARD FAILURE TIMES AND SOFT FAILURE TIMES Fig. 10. Prediction of the residuals for MLCC No. 6 based on the linear growth model in a Bayesian framework. Prediction started at the 671st h (80% lifetime of MLCC No. 6). TABLE III FAILURE PROGNOSTICS RESULTS FOR MLCCS NO.3,6,AND 7 of four MLCCs. Three of them failed at different points in time (indicated by the vertical dotted lines in Fig. 6) during the test. MLCC #8 had a weak intermittent failure but soon recovered. There were no advance indications in the performance parameters or the residuals for this MLCC; thus, it was hard to predict an intermittent failure based on the performance parameters monitored. Hence, it was excluded from the testing samples. Based on the analysis, the failure threshold in this study was determined by the run-to-failure data, and the soft failure threshold with regard to the parameter residual was set at level 2. This was supported by the fact that three run-to-failure samples failed near this threshold (horizontal solid red lines in Fig. 10), and none of the healthy samples passed through this threshold until the end of the experiment. of the component. The hard and soft failure times for the failed components are compared in Table II. From Table II, it can be seen that the soft failure times were earlier than or at least equal to the hard failure time. It is difficult to determine the cause of the sudden drop due to the architectural complexity of MLCCs and insufficient knowledge of the physics-of-failure of MLCCs. It is also difficult to predict the hard failure time due to the sudden change in performance parameters near the end of life. However, it is possible to predict the soft failure time based on the soft failure threshold and the trends shown in the parameter residuals before the sudden drops. Fig. 6 shows the residual evolution trajectories B. Prognostic Results We demonstrated the proposed method on three run-tofailure components (MLCCs No. 3, 6, and 7). MLCC No. 10 failed at a very early stage of its lifetime. MLCC No. 8 experienced a weak intermittent failure at an early stage and then recovered soon. The mean times to failure with 95% confidence limits (T and T ) were predicted at different lifetime stages and are summarized in Table III. The actual times to soft failure of the components were determined based on the experimental data analysis given in Table II. Pre. Time is the time instance (%Lifetime) when the prediction was launched.

8 56 IEEE TRANSACTIONS ON DEVICE AND MATERIALS RELIABILITY, VOL. 12, NO. 1, MARCH 2012 Fig. 11. Failure time prediction launched at the 671st h (80% lifetime ) for MLCC No. 6. The mean times to failure with 95% confidence limits (T 0.025, T 0.5,andT ) are indicated by the circles in the plot. To give a comparison of the prediction results for components with different life spans, predictions were made at the same stage of the normalized lives (%Lifetime) of different components. The normalized life was computed according to the following: Current Time Normalized Life(%Lifetime) = 100%. (30) Lifetime It can be seen from the failure prognostics results listed in Table III that when the end of life approaches, the predicted mean failure time becomes closer to the actual failure time. In fact, the prediction uncertainty decreases at the same time. To illustrate the proposed method, suppose that one prediction is launched at the 671st h (in fact, at 80% lifetime) for one component, e.g., MLCC No. 6. As shown in Fig. 10, before the prediction starting point (the 671st h), the measured residuals were calculated based on the monitoring data using the kernal regression method introduced in Section III. Bayesian conjugate inference was used in this study to estimate the degradation rate as well as the variance of the noise based on the measured residuals. Then, Bayesian prediction was carried out to predict the future residuals from the starting point (the 671st h). The predicted residual evolution in a distribution form is represented by the mean (the blue dashed line) and with uncertainty limits (95% confidence limits represented by grey dotted lines) in Fig. 10. As stated previously, the predictive distribution of the residuals is a Gaussian distribution due to the linear state space model assumption. Two predictive distributions of the residuals, at the 760th h and the 890th h, are plotted in Fig. 10. Fig. 11 shows the predicted failure time distribution for MLCC No. 6. The prediction was launched at the 671st h (80% lifetime) based on all the up-to-date monitoring data. As the new measurements arrive, the predicted failure time will be updated. Generally, the prognostics results became more accurate as the end of life approached. C. Discussion Residual-based failure prognostics is dependent on the evolution pattern of the calculated residual, so it is important to establish an appropriate capacitance reconstruction model. Rather than the traditional auto-associative approach, which is a common choice for anomaly detection [8], a different reconstruction model was used for the prognostics prediction task in this paper. The capacitance reconstruction model was trained based on healthy samples (the four survived capacitors in the test). In fact, all of the components experienced normal aging in service. In our experiment, the samples that survived until the end of the test were thought of as healthy, and the others were considered unhealthy. In this way, although some aging data may have been included in the training data, the advantage was that we could also remove some of the effects from the normal aging of the components from the training data set. In practice, we could select some survived samples until some point in time (e.g., the required lifetime or test time) as the healthy ones and the others as unhealthy. On the other hand, in contrast to the traditional residual calculation method, where an autoassociative approach is often used to reconstruct the parameters of interest, in our study the capacitance was reconstructed based only on two other parameters IR and DF rather than on all the parameters, since high correlation was shown among these parameters. A more evident trend in the residuals is preferred for prognostic prediction. If the traditional auto-associative model is used, in which the measured capacitance is also used to get its estimation, the calculated residual will be masked more or less, and thus no evident trend will be available. In this situation, the measured capacitance is excluded from the input set of the reconstruction model. A linear state space model is used to describe the dynamics of the residual evolution, which is considered to be an indicator of the health state of the capacitor in this study. Instead of predicting the failure of a component directly based on the monitored performance parameters, we first predict the degradation indicator of the capacitor, and when the degradation reaches the threshold, the component is declared to have failed. It is natural since many component failures can be traced to an underlying physical or chemical degradation process. However, the degradation process typically cannot be directly measured or monitored, but may manifest itself through the features extracted from the monitored performance parameters. In Table III, we provide the 95% confidence limits, T and T 0.975, for the predicted failure time distribution. It can be seen from the tabled results that as the end of lifetime approaches, the method can give a relatively accurate and precise prediction of the failure time. T can give a conservative and safe lifetime prediction. For example, for MLCC No. 3, the failure time prediction error is considerably large, even at 95% lifetime. This can be attributed to the complex residual evolution trajectory. Even as the end of lifetime approaches, it does not show an evident linear trend. This means that the parameter residual has poor trendabilty on this sample, so the prediction result is not good enough. Selection of a more approparate prognositcs parameter or features extracted from the available performance parameters may result in a more accurate RUL prediction. Metrics for assessing the suitability of the candidate prognostics parameters or features are introduced in [18]. Soft failure criteria and times of MLCCs were investigated in this paper. In our experiment, a sudden and considerable drop in insulation resistance was first observed for each of the five failed samples before they were observed to have failed.

9 SUN et al.: PROGNOSTICS OF MULTILAYER CERAMIC CAPACITORS VIA THE PARAMETER RESIDUALS 57 In practice, such a sudden drop may have severe consequences for a highly reliable product. This drop in insulation resistance was taken as a soft failure in this study. However, this type of soft failure cannot be detected in the current widely used failure criterion. A soft failure criterion in terms of the parameter residual was presented in this paper. One advantage of our method is that the parameter residual can serve as a real-time monitor of the health state of MLCCs because it reveals the degradation trend of the component over time, which can be used for RUL prediction. VI. CONCLUSION A novel failure prognostics method for RUL prediction for MLCCs based on parameter residuals was developed and demonstrated. The parameter residuals were generated from the difference between the real measured capacitance and its estimation calculated by a nonparametric regression model based on three in situ monitored parameters. Our study showed that the parameter residuals increased as the capacitors reached their end of life. Furthermore, there was a general linear trend in the last stage of life that could be utilized for failure prognostics. The proposed prediction method can produce prognostics results with uncertainty quantified by the time to failure distribution. Other reliability indices can be deduced based on this distribution. As more monitoring data becomes available, the prognostics results can be updated in an online fashion and will become more accurate as the end of lifetime approaches. This would allow condition-based maintenance or replacement, thereby increasing product safety and availability. The resulting reductions in unplanned downtime could produce substantial savings in operational costs. ACKNOWLEDGMENT The authors would like to thank Dr. D. Das and the Center for Advance Life Cycle Engineering, University of Maryland, for their support of this research. REFERENCES [1] M. G. Pecht, Prognostics and Health Management of Electronics. New York: Wiley-Interscience, [2] W. Q. Meeker and L. A. Escobar, Statistical Method for Reliability Data. Hoboken, NJ: Wiley, [3] C. J. Lu and W. Q. Meeker, Using degradation measures to estimate a time-to-failure distribution, Technometrics, vol. 35, no. 2, pp , May [4] S. J. Bae, W. Kuo, and P. H. Kvam, Degradation models and implied lifetime distributions, Reliab. Eng. Syst. Saf.,vol.92,no.5,pp , May [5] V. Bagdonavicius, A. Bikelis, and V. Kazakevičius, Statistical analysis of linear degradation and failure time data with multiple failure modes, Lifetime Data Anal., vol. 10, no. 1, pp , Mar [6] L. Nie, M. H. Azarian, M. Keimasi, and M. G. Pecht, Prognostics of ceramic capacitor temperature-humidity bias reliability using mahalanobis distance analysis, Circuit World, vol. 33, no. 3, pp , Aug [7] J. Gu, M. H. Azarian, and M. G. Pecht, Failure prognostics of multilayer ceramic capacitors in temperature humidity bias conditions, in Proc. Int. Conf. Prognostics Health Manag., Denver, CO, 2008, pp [8] J. W. Hines, D. Garvey, R. Seibert, and A. Usynin, Technical review of on-line monitoring techniques for performance assessment, U.S. Nuclear Regulatory Commission, NUREG/CR-6895, vol. 2, Washington, DC, [9] E. A. Nadaraya, On estimating regression, Theory Probab. Appl., vol. 9, no. 1, pp , [10] C. G. Atkeson, A. W. Moore, and S. Schaal, Locally weighted learning, Artif. Intell. Rev., vol. 11, no. 1 5, pp , Feb [11] J. Fan and I. Gijbels, Local Polynomial Modeling and Its Applications. New York: Chapman & Hall/CRC, [12] K. Suzuki, K. Maki, and S. Yokogawa, An analysis of degradation data of a carbon film and properties of the estimators, in Proc. 3rd Pacific Area Stat. Conf. Stat. Sci. Data Anal., K. Matusita, M. L. Puri, and T. Hayakawa, Eds., 1993, pp [13] M. S. Hamada, Using degradation data to assess reliability, Qual. Eng., vol. 17, no. 4, pp , Oct [14] W. Zhao and E. A. Elsayed, An accelerated life-testing model involving performance degradation, in Proc. Annu. Symp. RAMS, Los Angeles, CA, 2004, pp [15] J.-C. Lu, J. Park, and Q. Yang, Statistical inference of a time-to-failure distribution derived from linear degradation data, Technometrics, vol. 39, no. 4, pp , Nov [16] M. West and P. J. Harrison, Bayesian Forecasting and Dynamic Models, 2nd ed. New York: Springer-Verlag, [17] A. Pole, M. West, and P. J. Harrison, Applied Bayesian Forecasting and Time Series Analysis. New York: Chapman & Hall, [18] J. Coble and J. W. Hines, Identifying optimal prognostics parameters from data: A genetic algorithms approach, in Proc. Annu. Conf. Prognostics Health Manag. Soc., San Diego, CA, Oct Jianzhong Sun received the B.S. degree in electromechanical engineering from Nanjing University of Aeronautics and Astronautics, Nanjing, China, in 2006, where he is currently working toward the Ph.D. degree in traffic information engineering and control. His research interests are data-driven-based and physics-of-failure-based prognostics methods, and aircraft system in-service reliability prediction. Shunfeng Cheng (S 08) received the B.S. and M.S. degrees in mechanical engineering from Huazhong University of Science and Technology, Wuhan, China. He is currently working toward the Ph.D. degree at the Center for Advanced Life Cycle Engineering, University of Maryland, College Park. His current research includes sensor systems for prognostics and health monitoring and datadriven-based and physics-of-failure-based prognostics methods for electrical devices. Michael Pecht (M 83 SM 90 F 92) received the M.S. degree in electrical engineering, and the M.S. and Ph.D. degrees in engineering mechanics from the University of Wisconsin-Madison, Madison. He is the Founder of the Center for Advanced Life Cycle Engineering, University of Maryland, College Park, which is funded by over 150 of the world s leading electronics companies. He is also a Chair Professor of mechanical engineering and a Professor of applied mathematics with the University of Maryland. He has written more than 20 books on electronic product development, use, and supply chain management and over 400 technical articles. He has consulted for over 100 major international electronics companies, providing expertise in strategic planning, design, test, prognostics, IP, and risk assessment of electronic products and systems. Prof. Pecht is a Professional Engineer, an ASME Fellow, an IMAPS Fellow, and an SAE Fellow. He has served as Chief Editor of the IEEE TRANSACTIONS ON RELIABILITY for 8 years and on the Advisory Board of IEEE SPECTRUM. He is Chief Editor for Microelectronics Reliability and an Associate Editor for the IEEE TRANSACTIONS ON COMPONENTS AND PACKAGING TECHNOLOGY. He was awarded the highest reliability honor, the IEEE Reliability Society s Lifetime Achievement Award in He has previously received the European Micro- and Nanoreliability Award for outstanding contributions to reliability research, the 3M Research Award for electronics packaging, and the IMAPS William D. Ashman Memorial Achievement Award for his contributions in electronics reliability analysis.

Application of Grey Prediction Model for Failure Prognostics of Electronics

Application of Grey Prediction Model for Failure Prognostics of Electronics International Journal of Performability Engineering, Vol. 6, No. 5, September 2010, pp. 435-442. RAMS Consultants Printed in India Application of Grey Prediction Model for Failure Prognostics of Electronics

More information

Reliability of Flexible Termination Ceramic Capacitors in Temperature-Humidity-Bias Conditions. Michael H. Azarian, Ph.D

Reliability of Flexible Termination Ceramic Capacitors in Temperature-Humidity-Bias Conditions. Michael H. Azarian, Ph.D inemi Medical TIG Forum November 14, 2008 FDA, Silver Spring, Maryland Reliability of Flexible Termination Ceramic Capacitors in Temperature-Humidity-Bias Conditions Michael H. Azarian, Ph.D (CALCE) College

More information

A Fusion Prognostics Method for Remaining Useful Life Prediction of Electronic Products

A Fusion Prognostics Method for Remaining Useful Life Prediction of Electronic Products 5th Annual IEEE Conference on Automation Science and Engineering Bangalore, India, August -5, 009 A Fusion Prognostics Method for Remaining Useful Life Prediction of Electronic Products Shunfeng Cheng,

More information

Remaining Useful Performance Analysis of Batteries

Remaining Useful Performance Analysis of Batteries Remaining Useful Performance Analysis of Batteries Wei He, Nicholas Williard, Michael Osterman, and Michael Pecht Center for Advanced Life Engineering, University of Maryland, College Park, MD 20742, USA

More information

Bivariate Degradation Modeling Based on Gamma Process

Bivariate Degradation Modeling Based on Gamma Process Bivariate Degradation Modeling Based on Gamma Process Jinglun Zhou Zhengqiang Pan Member IAENG and Quan Sun Abstract Many highly reliable products have two or more performance characteristics (PCs). The

More information

1. INTRODUCTION /09/$ IEEE. 2 IEEEAC paper #1715, Version 4, Updated Nov 02, 2008

1. INTRODUCTION /09/$ IEEE. 2 IEEEAC paper #1715, Version 4, Updated Nov 02, 2008 An Innovative Approach for Isolating Faulty Parameters Sachin Kumar, Eli Dolev, and Michael Pecht Prognostics Health Management Group Center for Advanced Life Cycle Engineering (CALCE) University of Maryland,

More information

EARLY DETECTION OF AVALANCHE BREAKDOWN IN EMBEDDED CAPACITORS USING SPRT

EARLY DETECTION OF AVALANCHE BREAKDOWN IN EMBEDDED CAPACITORS USING SPRT EARLY DETECTION OF AVALANCHE BREAKDOWN IN EMBEDDED CAPACITORS USING SPRT Mohammed A. Alam 1, Michael H. Azarian 2, Michael Osterman and Michael Pecht Center for Advanced Life Cycle Engineering (CALCE)

More information

Evaluation and Comparison of Mixed Effects Model Based Prognosis for Hard Failure

Evaluation and Comparison of Mixed Effects Model Based Prognosis for Hard Failure IEEE TRANSACTIONS ON RELIABILITY, VOL. 62, NO. 2, JUNE 2013 379 Evaluation and Comparison of Mixed Effects Model Based Prognosis for Hard Failure Junbo Son, Qiang Zhou, Shiyu Zhou, Xiaofeng Mao, and Mutasim

More information

A Data-driven Approach for Remaining Useful Life Prediction of Critical Components

A Data-driven Approach for Remaining Useful Life Prediction of Critical Components GT S3 : Sûreté, Surveillance, Supervision Meeting GdR Modélisation, Analyse et Conduite des Systèmes Dynamiques (MACS) January 28 th, 2014 A Data-driven Approach for Remaining Useful Life Prediction of

More information

Failure Prognostics with Missing Data Using Extended Kalman Filter

Failure Prognostics with Missing Data Using Extended Kalman Filter Failure Prognostics with Missing Data Using Extended Kalman Filter Wlamir Olivares Loesch Vianna 1, and Takashi Yoneyama 2 1 EMBRAER S.A., São José dos Campos, São Paulo, 12227 901, Brazil wlamir.vianna@embraer.com.br

More information

Evaluating the value of structural heath monitoring with longitudinal performance indicators and hazard functions using Bayesian dynamic predictions

Evaluating the value of structural heath monitoring with longitudinal performance indicators and hazard functions using Bayesian dynamic predictions Evaluating the value of structural heath monitoring with longitudinal performance indicators and hazard functions using Bayesian dynamic predictions C. Xing, R. Caspeele, L. Taerwe Ghent University, Department

More information

A Bayesian Hidden Markov Model-Based Approach for Anomaly Detection in Electronic Systems

A Bayesian Hidden Markov Model-Based Approach for Anomaly Detection in Electronic Systems A Bayesian Hidden Markov Model-Based Approach for Anomaly Detection in Electronic Systems Enkhjargal Dorj Center for Advanced Life Cycle Engineering University of Maryland College Park, MD 20742 301-405-5323

More information

Reliability Monitoring Using Log Gaussian Process Regression

Reliability Monitoring Using Log Gaussian Process Regression COPYRIGHT 013, M. Modarres Reliability Monitoring Using Log Gaussian Process Regression Martin Wayne Mohammad Modarres PSA 013 Center for Risk and Reliability University of Maryland Department of Mechanical

More information

Title of Document: THE EFFECTS OF ENVIRONMENTAL. Garry Brock Jr., Master of Science, Chair Professor, Michael G. Pecht, Department of

Title of Document: THE EFFECTS OF ENVIRONMENTAL. Garry Brock Jr., Master of Science, Chair Professor, Michael G. Pecht, Department of Abstract Title of Document: THE EFFECTS OF ENVIRONMENTAL STRESSES ON THE RELIABILITY OF FLEXIBLE AND STANDARD TERMINATION MULTILAYER CERAMIC CAPACITORS Garry Brock Jr., Master of Science, 2009 Directed

More information

The Relationship Between Confidence Intervals for Failure Probabilities and Life Time Quantiles

The Relationship Between Confidence Intervals for Failure Probabilities and Life Time Quantiles Statistics Preprints Statistics 2008 The Relationship Between Confidence Intervals for Failure Probabilities and Life Time Quantiles Yili Hong Iowa State University, yili_hong@hotmail.com William Q. Meeker

More information

Dynamic System Identification using HDMR-Bayesian Technique

Dynamic System Identification using HDMR-Bayesian Technique Dynamic System Identification using HDMR-Bayesian Technique *Shereena O A 1) and Dr. B N Rao 2) 1), 2) Department of Civil Engineering, IIT Madras, Chennai 600036, Tamil Nadu, India 1) ce14d020@smail.iitm.ac.in

More information

Load-strength Dynamic Interaction Principle and Failure Rate Model

Load-strength Dynamic Interaction Principle and Failure Rate Model International Journal of Performability Engineering Vol. 6, No. 3, May 21, pp. 25-214. RAMS Consultants Printed in India Load-strength Dynamic Interaction Principle and Failure Rate Model LIYANG XIE and

More information

A New Method for Varying Adaptive Bandwidth Selection

A New Method for Varying Adaptive Bandwidth Selection IEEE TRASACTIOS O SIGAL PROCESSIG, VOL. 47, O. 9, SEPTEMBER 1999 2567 TABLE I SQUARE ROOT MEA SQUARED ERRORS (SRMSE) OF ESTIMATIO USIG THE LPA AD VARIOUS WAVELET METHODS A ew Method for Varying Adaptive

More information

A Tool for Evaluating Time-Varying-Stress Accelerated Life Test Plans with Log-Location- Scale Distributions

A Tool for Evaluating Time-Varying-Stress Accelerated Life Test Plans with Log-Location- Scale Distributions Statistics Preprints Statistics 6-2010 A Tool for Evaluating Time-Varying-Stress Accelerated Life Test Plans with Log-Location- Scale Distributions Yili Hong Virginia Tech Haiming Ma Iowa State University,

More information

Advanced Methods for Fault Detection

Advanced Methods for Fault Detection Advanced Methods for Fault Detection Piero Baraldi Agip KCO Introduction Piping and long to eploration distance pipelines activities Piero Baraldi Maintenance Intervention Approaches & PHM Maintenance

More information

Supplementary Note on Bayesian analysis

Supplementary Note on Bayesian analysis Supplementary Note on Bayesian analysis Structured variability of muscle activations supports the minimal intervention principle of motor control Francisco J. Valero-Cuevas 1,2,3, Madhusudhan Venkadesan

More information

Using Hankel structured low-rank approximation for sparse signal recovery

Using Hankel structured low-rank approximation for sparse signal recovery Using Hankel structured low-rank approximation for sparse signal recovery Ivan Markovsky 1 and Pier Luigi Dragotti 2 Department ELEC Vrije Universiteit Brussel (VUB) Pleinlaan 2, Building K, B-1050 Brussels,

More information

ACCELERATED DESTRUCTIVE DEGRADATION TEST PLANNING. Presented by Luis A. Escobar Experimental Statistics LSU, Baton Rouge LA 70803

ACCELERATED DESTRUCTIVE DEGRADATION TEST PLANNING. Presented by Luis A. Escobar Experimental Statistics LSU, Baton Rouge LA 70803 ACCELERATED DESTRUCTIVE DEGRADATION TEST PLANNING Presented by Luis A. Escobar Experimental Statistics LSU, Baton Rouge LA 70803 This is jointly work with Ying Shi and William Q. Meeker both from Iowa

More information

Accelerated Testing Obtaining Reliability Information Quickly

Accelerated Testing Obtaining Reliability Information Quickly Accelerated Testing Background Accelerated Testing Obtaining Reliability Information Quickly William Q. Meeker Department of Statistics and Center for Nondestructive Evaluation Iowa State University Ames,

More information

The Reliability Predictions for the Avionics Equipment

The Reliability Predictions for the Avionics Equipment Universal Journal of Applied Mathematics 2(8): 277-282, 2014 DOI: 10.13189/ujam.2014.020801 http://www.hrpub.org The Reliability Predictions for the Avionics Equipment Zahid Khan 1,*, Radzuan B.Razali

More information

Computing Consecutive-Type Reliabilities Non-Recursively

Computing Consecutive-Type Reliabilities Non-Recursively IEEE TRANSACTIONS ON RELIABILITY, VOL. 52, NO. 3, SEPTEMBER 2003 367 Computing Consecutive-Type Reliabilities Non-Recursively Galit Shmueli Abstract The reliability of consecutive-type systems has been

More information

Relevance Vector Machines for Earthquake Response Spectra

Relevance Vector Machines for Earthquake Response Spectra 2012 2011 American American Transactions Transactions on on Engineering Engineering & Applied Applied Sciences Sciences. American Transactions on Engineering & Applied Sciences http://tuengr.com/ateas

More information

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature

More information

Part I State space models

Part I State space models Part I State space models 1 Introduction to state space time series analysis James Durbin Department of Statistics, London School of Economics and Political Science Abstract The paper presents a broad

More information

Point and Interval Estimation for Gaussian Distribution, Based on Progressively Type-II Censored Samples

Point and Interval Estimation for Gaussian Distribution, Based on Progressively Type-II Censored Samples 90 IEEE TRANSACTIONS ON RELIABILITY, VOL. 52, NO. 1, MARCH 2003 Point and Interval Estimation for Gaussian Distribution, Based on Progressively Type-II Censored Samples N. Balakrishnan, N. Kannan, C. T.

More information

Gamma process model for time-dependent structural reliability analysis

Gamma process model for time-dependent structural reliability analysis Gamma process model for time-dependent structural reliability analysis M.D. Pandey Department of Civil Engineering, University of Waterloo, Waterloo, Ontario, Canada J.M. van Noortwijk HKV Consultants,

More information

Degradation data analysis for samples under unequal operating conditions: a case study on train wheels

Degradation data analysis for samples under unequal operating conditions: a case study on train wheels Degradation data analysis for samples under unequal operating conditions: a case study on train wheels Marta AFONSO FREITAS UNIVERSIDADE FEDERAL DE MINAS GERAIS DEPARTMENT OF PRODUCTION ENGINEERING marta.afreitas@gmail.com

More information

Statistical Inference on Constant Stress Accelerated Life Tests Under Generalized Gamma Lifetime Distributions

Statistical Inference on Constant Stress Accelerated Life Tests Under Generalized Gamma Lifetime Distributions Int. Statistical Inst.: Proc. 58th World Statistical Congress, 2011, Dublin (Session CPS040) p.4828 Statistical Inference on Constant Stress Accelerated Life Tests Under Generalized Gamma Lifetime Distributions

More information

Modeling Rate of Occurrence of Failures with Log-Gaussian Process Models: A Case Study for Prognosis and Health Management of a Fleet of Vehicles

Modeling Rate of Occurrence of Failures with Log-Gaussian Process Models: A Case Study for Prognosis and Health Management of a Fleet of Vehicles International Journal of Performability Engineering, Vol. 9, No. 6, November 2013, pp. 701-713. RAMS Consultants Printed in India Modeling Rate of Occurrence of Failures with Log-Gaussian Process Models:

More information

Prediction for Two-Phase Degradation. A thesis presented to. the faculty of. In partial fulfillment. of the requirements for the degree

Prediction for Two-Phase Degradation. A thesis presented to. the faculty of. In partial fulfillment. of the requirements for the degree Bayesian Degradation Analysis Considering Competing Risks and Residual-Life Prediction for Two-Phase Degradation A thesis presented to the faculty of the Russ College of Engineering and Technology of Ohio

More information

Quantile POD for Hit-Miss Data

Quantile POD for Hit-Miss Data Quantile POD for Hit-Miss Data Yew-Meng Koh a and William Q. Meeker a a Center for Nondestructive Evaluation, Department of Statistics, Iowa State niversity, Ames, Iowa 50010 Abstract. Probability of detection

More information

MOMENT functions are used in several computer vision

MOMENT functions are used in several computer vision IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 13, NO. 8, AUGUST 2004 1055 Some Computational Aspects of Discrete Orthonormal Moments R. Mukundan, Senior Member, IEEE Abstract Discrete orthogonal moments

More information

Time-varying failure rate for system reliability analysis in large-scale railway risk assessment simulation

Time-varying failure rate for system reliability analysis in large-scale railway risk assessment simulation Time-varying failure rate for system reliability analysis in large-scale railway risk assessment simulation H. Zhang, E. Cutright & T. Giras Center of Rail Safety-Critical Excellence, University of Virginia,

More information

Degradation Modeling and Monitoring of Truncated Degradation Signals. Rensheng Zhou, Nagi Gebraeel, and Nicoleta Serban

Degradation Modeling and Monitoring of Truncated Degradation Signals. Rensheng Zhou, Nagi Gebraeel, and Nicoleta Serban Degradation Modeling and Monitoring of Truncated Degradation Signals Rensheng Zhou, Nagi Gebraeel, and Nicoleta Serban School of Industrial and Systems Engineering, Georgia Institute of Technology Abstract:

More information

MLC Quality and Reliability Data 2777 Route 20 East Cazenovia, New York, Phone: (315) Fax: (315)

MLC Quality and Reliability Data 2777 Route 20 East Cazenovia, New York, Phone: (315) Fax: (315) MLC Quality and Reliability 777 Route East Cazenovia, New York, Phone: () 6-87 Fax: () 6-87 www.knowlescapacitors.co m Reliability General Manufacturing Process At each manufacturing step, defined process

More information

Available online at ScienceDirect. Procedia Engineering 119 (2015 ) 13 18

Available online at   ScienceDirect. Procedia Engineering 119 (2015 ) 13 18 Available online at www.sciencedirect.com ScienceDirect Procedia Engineering 119 (2015 ) 13 18 13th Computer Control for Water Industry Conference, CCWI 2015 Real-time burst detection in water distribution

More information

Microelectronics Reliability

Microelectronics Reliability Microelectronics Reliability 52 (2012) 482 488 Contents lists available at SciVerse ScienceDirect Microelectronics Reliability journal homepage: www.elsevier.com/locate/microrel A prognostic approach for

More information

Bayesian Remaining Useful Lifetime Prediction of Thermally Aged Power MOSFETs

Bayesian Remaining Useful Lifetime Prediction of Thermally Aged Power MOSFETs Bayesian Remaining Useful Lifetime Prediction of Thermally Aged Power MOSFETs Mehrdad Heydarzadeh, Serkan Dusmez, Mehrdad Nourani, Bilal Akin 1 Department of Electrical Engineering, The University of Texas

More information

INTRODUCTION TO PATTERN RECOGNITION

INTRODUCTION TO PATTERN RECOGNITION INTRODUCTION TO PATTERN RECOGNITION INSTRUCTOR: WEI DING 1 Pattern Recognition Automatic discovery of regularities in data through the use of computer algorithms With the use of these regularities to take

More information

Time Series Prediction by Kalman Smoother with Cross-Validated Noise Density

Time Series Prediction by Kalman Smoother with Cross-Validated Noise Density Time Series Prediction by Kalman Smoother with Cross-Validated Noise Density Simo Särkkä E-mail: simo.sarkka@hut.fi Aki Vehtari E-mail: aki.vehtari@hut.fi Jouko Lampinen E-mail: jouko.lampinen@hut.fi Abstract

More information

Abstract. 1. Introduction

Abstract. 1. Introduction Abstract Repairable system reliability: recent developments in CBM optimization A.K.S. Jardine, D. Banjevic, N. Montgomery, A. Pak Department of Mechanical and Industrial Engineering, University of Toronto,

More information

Unsupervised Learning Methods

Unsupervised Learning Methods Structural Health Monitoring Using Statistical Pattern Recognition Unsupervised Learning Methods Keith Worden and Graeme Manson Presented by Keith Worden The Structural Health Monitoring Process 1. Operational

More information

Machine Learning Practice Page 2 of 2 10/28/13

Machine Learning Practice Page 2 of 2 10/28/13 Machine Learning 10-701 Practice Page 2 of 2 10/28/13 1. True or False Please give an explanation for your answer, this is worth 1 pt/question. (a) (2 points) No classifier can do better than a naive Bayes

More information

EM-algorithm for Training of State-space Models with Application to Time Series Prediction

EM-algorithm for Training of State-space Models with Application to Time Series Prediction EM-algorithm for Training of State-space Models with Application to Time Series Prediction Elia Liitiäinen, Nima Reyhani and Amaury Lendasse Helsinki University of Technology - Neural Networks Research

More information

Reliability Analysis of Moog Ultrasonic Air Bubble Detectors

Reliability Analysis of Moog Ultrasonic Air Bubble Detectors Reliability Analysis of Moog Ultrasonic Air Bubble Detectors Air-in-line sensors are vital to the performance of many of today s medical device applications. The reliability of these sensors should be

More information

Overview. DS GA 1002 Probability and Statistics for Data Science. Carlos Fernandez-Granda

Overview. DS GA 1002 Probability and Statistics for Data Science.   Carlos Fernandez-Granda Overview DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Probability and statistics Probability: Framework for dealing

More information

Introduction. Chapter 1

Introduction. Chapter 1 Chapter 1 Introduction In this book we will be concerned with supervised learning, which is the problem of learning input-output mappings from empirical data (the training dataset). Depending on the characteristics

More information

STAT 518 Intro Student Presentation

STAT 518 Intro Student Presentation STAT 518 Intro Student Presentation Wen Wei Loh April 11, 2013 Title of paper Radford M. Neal [1999] Bayesian Statistics, 6: 475-501, 1999 What the paper is about Regression and Classification Flexible

More information

Confidence Estimation Methods for Neural Networks: A Practical Comparison

Confidence Estimation Methods for Neural Networks: A Practical Comparison , 6-8 000, Confidence Estimation Methods for : A Practical Comparison G. Papadopoulos, P.J. Edwards, A.F. Murray Department of Electronics and Electrical Engineering, University of Edinburgh Abstract.

More information

SILICON-ON-INSULATOR (SOI) technology has been regarded

SILICON-ON-INSULATOR (SOI) technology has been regarded IEEE TRANSACTIONS ON ELECTRON DEVICES, VOL. 53, NO. 10, OCTOBER 2006 2559 Analysis of the Gate Source/Drain Capacitance Behavior of a Narrow-Channel FD SOI NMOS Device Considering the 3-D Fringing Capacitances

More information

An Integral Measure of Aging/Rejuvenation for Repairable and Non-repairable Systems

An Integral Measure of Aging/Rejuvenation for Repairable and Non-repairable Systems An Integral Measure of Aging/Rejuvenation for Repairable and Non-repairable Systems M.P. Kaminskiy and V.V. Krivtsov Abstract This paper introduces a simple index that helps to assess the degree of aging

More information

Accelerated Life Test Principles and Applications in Power Solutions

Accelerated Life Test Principles and Applications in Power Solutions Accelerated Life Test Principles and Applications in Power Solutions Created by Michael Shover, Ph.D., Advanced Energy Industries, Inc. Abstract This paper discusses using an Accelerated Life Test (ALT)

More information

Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother

Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Prediction of ESTSP Competition Time Series by Unscented Kalman Filter and RTS Smoother Simo Särkkä, Aki Vehtari and Jouko Lampinen Helsinki University of Technology Department of Electrical and Communications

More information

Virtual Sensors and Large-Scale Gaussian Processes

Virtual Sensors and Large-Scale Gaussian Processes Virtual Sensors and Large-Scale Gaussian Processes Ashok N. Srivastava, Ph.D. Principal Investigator, IVHM Project Group Lead, Intelligent Data Understanding ashok.n.srivastava@nasa.gov Coauthors: Kamalika

More information

A hidden semi-markov model for the occurrences of water pipe bursts

A hidden semi-markov model for the occurrences of water pipe bursts A hidden semi-markov model for the occurrences of water pipe bursts T. Economou 1, T.C. Bailey 1 and Z. Kapelan 1 1 School of Engineering, Computer Science and Mathematics, University of Exeter, Harrison

More information

Neural Network Approach to Estimating Conditional Quantile Polynomial Distributed Lag (QPDL) Model with an Application to Rubber Price Returns

Neural Network Approach to Estimating Conditional Quantile Polynomial Distributed Lag (QPDL) Model with an Application to Rubber Price Returns American Journal of Business, Economics and Management 2015; 3(3): 162-170 Published online June 10, 2015 (http://www.openscienceonline.com/journal/ajbem) Neural Network Approach to Estimating Conditional

More information

Reliability Analysis of k-out-of-n Systems with Phased- Mission Requirements

Reliability Analysis of k-out-of-n Systems with Phased- Mission Requirements International Journal of Performability Engineering, Vol. 7, No. 6, November 2011, pp. 604-609. RAMS Consultants Printed in India Reliability Analysis of k-out-of-n Systems with Phased- Mission Requirements

More information

Choosing the Summary Statistics and the Acceptance Rate in Approximate Bayesian Computation

Choosing the Summary Statistics and the Acceptance Rate in Approximate Bayesian Computation Choosing the Summary Statistics and the Acceptance Rate in Approximate Bayesian Computation COMPSTAT 2010 Revised version; August 13, 2010 Michael G.B. Blum 1 Laboratoire TIMC-IMAG, CNRS, UJF Grenoble

More information

Lifetime prediction and confidence bounds in accelerated degradation testing for lognormal response distributions with an Arrhenius rate relationship

Lifetime prediction and confidence bounds in accelerated degradation testing for lognormal response distributions with an Arrhenius rate relationship Scholars' Mine Doctoral Dissertations Student Research & Creative Works Spring 01 Lifetime prediction and confidence bounds in accelerated degradation testing for lognormal response distributions with

More information

Multistate Modeling and Applications

Multistate Modeling and Applications Multistate Modeling and Applications Yang Yang Department of Statistics University of Michigan, Ann Arbor IBM Research Graduate Student Workshop: Statistics for a Smarter Planet Yang Yang (UM, Ann Arbor)

More information

In-Flight Engine Diagnostics and Prognostics Using A Stochastic-Neuro-Fuzzy Inference System

In-Flight Engine Diagnostics and Prognostics Using A Stochastic-Neuro-Fuzzy Inference System In-Flight Engine Diagnostics and Prognostics Using A Stochastic-Neuro-Fuzzy Inference System Dan M. Ghiocel & Joshua Altmann STI Technologies, Rochester, New York, USA Keywords: reliability, stochastic

More information

Use of Bayesian multivariate prediction models to optimize chromatographic methods

Use of Bayesian multivariate prediction models to optimize chromatographic methods Use of Bayesian multivariate prediction models to optimize chromatographic methods UCB Pharma! Braine lʼalleud (Belgium)! May 2010 Pierre Lebrun, ULg & Arlenda Bruno Boulanger, ULg & Arlenda Philippe Lambert,

More information

COMS 4721: Machine Learning for Data Science Lecture 10, 2/21/2017

COMS 4721: Machine Learning for Data Science Lecture 10, 2/21/2017 COMS 4721: Machine Learning for Data Science Lecture 10, 2/21/2017 Prof. John Paisley Department of Electrical Engineering & Data Science Institute Columbia University FEATURE EXPANSIONS FEATURE EXPANSIONS

More information

Gaussian process for nonstationary time series prediction

Gaussian process for nonstationary time series prediction Computational Statistics & Data Analysis 47 (2004) 705 712 www.elsevier.com/locate/csda Gaussian process for nonstationary time series prediction Soane Brahim-Belhouari, Amine Bermak EEE Department, Hong

More information

Optimal Time and Random Inspection Policies for Computer Systems

Optimal Time and Random Inspection Policies for Computer Systems Appl. Math. Inf. Sci. 8, No. 1L, 413-417 214) 413 Applied Mathematics & Information Sciences An International Journal http://dx.doi.org/1.12785/amis/81l51 Optimal Time and Random Inspection Policies for

More information

State-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Financial Econometrics / 49

State-space Model. Eduardo Rossi University of Pavia. November Rossi State-space Model Financial Econometrics / 49 State-space Model Eduardo Rossi University of Pavia November 2013 Rossi State-space Model Financial Econometrics - 2013 1 / 49 Outline 1 Introduction 2 The Kalman filter 3 Forecast errors 4 State smoothing

More information

Bayesian time series classification

Bayesian time series classification Bayesian time series classification Peter Sykacek Department of Engineering Science University of Oxford Oxford, OX 3PJ, UK psyk@robots.ox.ac.uk Stephen Roberts Department of Engineering Science University

More information

EVALUATING SYMMETRIC INFORMATION GAP BETWEEN DYNAMICAL SYSTEMS USING PARTICLE FILTER

EVALUATING SYMMETRIC INFORMATION GAP BETWEEN DYNAMICAL SYSTEMS USING PARTICLE FILTER EVALUATING SYMMETRIC INFORMATION GAP BETWEEN DYNAMICAL SYSTEMS USING PARTICLE FILTER Zhen Zhen 1, Jun Young Lee 2, and Abdus Saboor 3 1 Mingde College, Guizhou University, China zhenz2000@21cn.com 2 Department

More information

Chapter 2 Inference on Mean Residual Life-Overview

Chapter 2 Inference on Mean Residual Life-Overview Chapter 2 Inference on Mean Residual Life-Overview Statistical inference based on the remaining lifetimes would be intuitively more appealing than the popular hazard function defined as the risk of immediate

More information

Independent Component Analysis for Redundant Sensor Validation

Independent Component Analysis for Redundant Sensor Validation Independent Component Analysis for Redundant Sensor Validation Jun Ding, J. Wesley Hines, Brandon Rasmussen The University of Tennessee Nuclear Engineering Department Knoxville, TN 37996-2300 E-mail: hines2@utk.edu

More information

Chapter 15. System Reliability Concepts and Methods. William Q. Meeker and Luis A. Escobar Iowa State University and Louisiana State University

Chapter 15. System Reliability Concepts and Methods. William Q. Meeker and Luis A. Escobar Iowa State University and Louisiana State University Chapter 15 System Reliability Concepts and Methods William Q. Meeker and Luis A. Escobar Iowa State University and Louisiana State University Copyright 1998-2008 W. Q. Meeker and L. A. Escobar. Based on

More information

Tactical Ballistic Missile Tracking using the Interacting Multiple Model Algorithm

Tactical Ballistic Missile Tracking using the Interacting Multiple Model Algorithm Tactical Ballistic Missile Tracking using the Interacting Multiple Model Algorithm Robert L Cooperman Raytheon Co C 3 S Division St Petersburg, FL Robert_L_Cooperman@raytheoncom Abstract The problem of

More information

Optimization of the detection of train wheel defects. SNCF Innovation and Research Department Paris, FRANCE 1

Optimization of the detection of train wheel defects. SNCF Innovation and Research Department Paris, FRANCE 1 Optimization of the detection of train wheel defects 1 R. Ziani SNCF Innovation and Research Department Paris, FRANCE 1 Abstract This paper describes how statistical models and learning algorithms could

More information

A short introduction to INLA and R-INLA

A short introduction to INLA and R-INLA A short introduction to INLA and R-INLA Integrated Nested Laplace Approximation Thomas Opitz, BioSP, INRA Avignon Workshop: Theory and practice of INLA and SPDE November 7, 2018 2/21 Plan for this talk

More information

CONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström

CONTROL SYSTEMS, ROBOTICS, AND AUTOMATION - Vol. V - Prediction Error Methods - Torsten Söderström PREDICTIO ERROR METHODS Torsten Söderström Department of Systems and Control, Information Technology, Uppsala University, Uppsala, Sweden Keywords: prediction error method, optimal prediction, identifiability,

More information

Density Estimation. Seungjin Choi

Density Estimation. Seungjin Choi Density Estimation Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr http://mlg.postech.ac.kr/

More information

Research on Transformer Condition-based Maintenance System using the Method of Fuzzy Comprehensive Evaluation

Research on Transformer Condition-based Maintenance System using the Method of Fuzzy Comprehensive Evaluation Research on Transformer -based Maintenance System using the Method of Fuzzy Comprehensive Evaluation Po-Chun Lin and Jyh-Cherng Gu Abstract This study adopted previous fault patterns, results of detection

More information

The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems

The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems 668 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL 49, NO 10, OCTOBER 2002 The Discrete Kalman Filtering of a Class of Dynamic Multiscale Systems Lei Zhang, Quan

More information

Inference on reliability in two-parameter exponential stress strength model

Inference on reliability in two-parameter exponential stress strength model Metrika DOI 10.1007/s00184-006-0074-7 Inference on reliability in two-parameter exponential stress strength model K. Krishnamoorthy Shubhabrata Mukherjee Huizhen Guo Received: 19 January 2005 Springer-Verlag

More information

WEIGHTED QUANTILE REGRESSION THEORY AND ITS APPLICATION. Abstract

WEIGHTED QUANTILE REGRESSION THEORY AND ITS APPLICATION. Abstract Journal of Data Science,17(1). P. 145-160,2019 DOI:10.6339/JDS.201901_17(1).0007 WEIGHTED QUANTILE REGRESSION THEORY AND ITS APPLICATION Wei Xiong *, Maozai Tian 2 1 School of Statistics, University of

More information

PACKAGE LMest FOR LATENT MARKOV ANALYSIS

PACKAGE LMest FOR LATENT MARKOV ANALYSIS PACKAGE LMest FOR LATENT MARKOV ANALYSIS OF LONGITUDINAL CATEGORICAL DATA Francesco Bartolucci 1, Silvia Pandofi 1, and Fulvia Pennoni 2 1 Department of Economics, University of Perugia (e-mail: francesco.bartolucci@unipg.it,

More information

2D Image Processing. Bayes filter implementation: Kalman filter

2D Image Processing. Bayes filter implementation: Kalman filter 2D Image Processing Bayes filter implementation: Kalman filter Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de

More information

Instance-based Learning CE-717: Machine Learning Sharif University of Technology. M. Soleymani Fall 2016

Instance-based Learning CE-717: Machine Learning Sharif University of Technology. M. Soleymani Fall 2016 Instance-based Learning CE-717: Machine Learning Sharif University of Technology M. Soleymani Fall 2016 Outline Non-parametric approach Unsupervised: Non-parametric density estimation Parzen Windows Kn-Nearest

More information

STA414/2104 Statistical Methods for Machine Learning II

STA414/2104 Statistical Methods for Machine Learning II STA414/2104 Statistical Methods for Machine Learning II Murat A. Erdogdu & David Duvenaud Department of Computer Science Department of Statistical Sciences Lecture 3 Slide credits: Russ Salakhutdinov Announcements

More information

Optimal Kernel Shapes for Local Linear Regression

Optimal Kernel Shapes for Local Linear Regression Optimal Kernel Shapes for Local Linear Regression Dirk Ormoneit Trevor Hastie Department of Statistics Stanford University Stanford, CA 94305-4065 ormoneit@stat.stanjord.edu Abstract Local linear regression

More information

TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA

TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA CHAPTER 6 TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA 6.1. Introduction A time series is a sequence of observations ordered in time. A basic assumption in the time series analysis

More information

CSE 417T: Introduction to Machine Learning. Final Review. Henry Chai 12/4/18

CSE 417T: Introduction to Machine Learning. Final Review. Henry Chai 12/4/18 CSE 417T: Introduction to Machine Learning Final Review Henry Chai 12/4/18 Overfitting Overfitting is fitting the training data more than is warranted Fitting noise rather than signal 2 Estimating! "#$

More information

Estimation of cumulative distribution function with spline functions

Estimation of cumulative distribution function with spline functions INTERNATIONAL JOURNAL OF ECONOMICS AND STATISTICS Volume 5, 017 Estimation of cumulative distribution function with functions Akhlitdin Nizamitdinov, Aladdin Shamilov Abstract The estimation of the cumulative

More information

Stochastic Analogues to Deterministic Optimizers

Stochastic Analogues to Deterministic Optimizers Stochastic Analogues to Deterministic Optimizers ISMP 2018 Bordeaux, France Vivak Patel Presented by: Mihai Anitescu July 6, 2018 1 Apology I apologize for not being here to give this talk myself. I injured

More information

Optimal Mean-Square Noise Benefits in Quantizer-Array Linear Estimation Ashok Patel and Bart Kosko

Optimal Mean-Square Noise Benefits in Quantizer-Array Linear Estimation Ashok Patel and Bart Kosko IEEE SIGNAL PROCESSING LETTERS, VOL. 17, NO. 12, DECEMBER 2010 1005 Optimal Mean-Square Noise Benefits in Quantizer-Array Linear Estimation Ashok Patel and Bart Kosko Abstract A new theorem shows that

More information

Bayesian Methods for Accelerated Destructive Degradation Test Planning

Bayesian Methods for Accelerated Destructive Degradation Test Planning Statistics Preprints Statistics 11-2010 Bayesian Methods for Accelerated Destructive Degradation Test Planning Ying Shi Iowa State University William Q. Meeker Iowa State University, wqmeeker@iastate.edu

More information

Uncertainty propagation in a sequential model for flood forecasting

Uncertainty propagation in a sequential model for flood forecasting Predictions in Ungauged Basins: Promise and Progress (Proceedings of symposium S7 held during the Seventh IAHS Scientific Assembly at Foz do Iguaçu, Brazil, April 2005). IAHS Publ. 303, 2006. 177 Uncertainty

More information

Gaussian Process for Internal Model Control

Gaussian Process for Internal Model Control Gaussian Process for Internal Model Control Gregor Gregorčič and Gordon Lightbody Department of Electrical Engineering University College Cork IRELAND E mail: gregorg@rennesuccie Abstract To improve transparency

More information

Lazy learning for control design

Lazy learning for control design Lazy learning for control design Gianluca Bontempi, Mauro Birattari, Hugues Bersini Iridia - CP 94/6 Université Libre de Bruxelles 5 Bruxelles - Belgium email: {gbonte, mbiro, bersini}@ulb.ac.be Abstract.

More information

Quantitative Trendspotting. Rex Yuxing Du and Wagner A. Kamakura. Web Appendix A Inferring and Projecting the Latent Dynamic Factors

Quantitative Trendspotting. Rex Yuxing Du and Wagner A. Kamakura. Web Appendix A Inferring and Projecting the Latent Dynamic Factors 1 Quantitative Trendspotting Rex Yuxing Du and Wagner A. Kamakura Web Appendix A Inferring and Projecting the Latent Dynamic Factors The procedure for inferring the latent state variables (i.e., [ ] ),

More information