ANY TIME PROBABILISTIC REASONING FOR SENSOR VALIDATION

Size: px
Start display at page:

Download "ANY TIME PROBABILISTIC REASONING FOR SENSOR VALIDATION"

Transcription

1 266 ANY TIME PROBABILISTIC REASONING FOR SENSOR VALIDATION P.H. Ibargiiegoytia Istituto de Ivestigacioes Eh ctricas, A.P Cueravaca, Mor., 62001, Mexico L.E. Sucar Istituto Tecol6gico y de Estudios Superiores de Moterrey Campus Morelos, A.P. 99-C Cueravaca, Mor., 62050, Mexico esucar@campus.mor.itesm.mx S. Vadera Uiversity of Salford Dept. of Mathematics ad Computer Sciece Salford, M5 4WT, U.K. S.Vadera@mcs.salford.ac.uk Abstract For may real time applicatios, it is importat to validate the iformatio received from the sesors before eterig higher levels of reasoig. This paper presets a ay time probabilistic algorithm for validatig the iformatio provided by sesors. The system cosists of two Bayesia etwork models. The first oe is a model of the depedecies betwee sesors ad it is used to validate each sesor. It provides a list of potetially faulty sesors. To isolate the real faults, a secod Bayesia etwork is used, which relates the potetial faults with the real faults. This secod model is also used to make the validatio algorithm ay time, by validatig first the sesors that provide more iformatio. To select the ext sesor to validate, ad measure the quality of the results at each stage, a etropy fuctio is used. This fuctio captures i a sigle quatity both the certaity ad specificity measures of ay time algorithms. Together, both models costitute a mechaism for validatig sesors i a ay time fashio, providig at each step the probability of correct/faulty for each sesor, ad the total quality of the results. The algorithm has bee tested i the validatio of temperature sesors of a power plat. 1 Itroductio Artificial itelligece (AI) techiques are playig a icreasigly importat role i real applicatios. I idustry, differet techiques have bee proposed, for example, i diagosis, automatic cotrol, ad moitorig. Geerally, these applicatios require a overall model which usually, its iputs are maily sesors. Also, may of these real applicatios eed to maitai a real time behaviour, i.e., the correctess of the system depeds ot oly o the logical result of the computatio but also o the time at which the results are produced (Stakovic 1988]. Usually, real applicatios possess a time limit by which some actios must be performed. This paper presets a model for the validatio of the sesors used i real time applicatios. The proposed validatio is carried out i a separate module that works together with other fuctios i a system. I other words, it is assumed that a layered scheme is used i which the lowest level cocetrates o validatig the sigals trasmitted by the sesors as preseted i Fig. 1 (Yug & Clarke 1989]. The mai beefit of Figure 1: Layered diagosis architecture. usig a layered approach is that it eables the costructio of models i a modular fashio. That is, it is easier to costruct a model for sesor validatio ad the a model for the process tha it is to costruct a overall model i oe step. This separatio of the sesor validatio layer ca also result i simpler higher layer models ad leave the higher layers to utilize other techiques. Faults i the sesors readigs are detected i a decetralised ad hierarchical approach, so that they ca be easily isolated ad repaired. Additioally, suppose that the higher layers of the system represet other importat ad critical fuctios, e.g., the fault diagosis of a uclear plat. The itermediate layer (loop diagosis) may be usig model based reasoig to diagose a cotrol loop i the plat, whereas the system diagosis layer may be utilizig a differet approach. The validatio module preseted i this paper, utilizes a probabilistic model which cosiders oly the relatioships betwee the variables to be validated. This

2 Ay Time Probabilistic Reasoig for Sesor Validatio 267 probabilistic model is idepedet of the higher layers models, so it is easier to costruct ad matai whe ecessary. This paper presets the cotiuatio of the project described i a previous paper [Ibargiiegoytia et al. 1996]. I that paper, the authors described a probabilistic approach to sesor validatio that took advatage of a Markov blaket property to distiguish real faults from apparet faults. A Bayesia etwork was used as a basis for predictig a probability distributio for a sesor value based o other sesors. The predicted distributio ad the actual sesor readig was used i order to determie if there was a potetial fault. However, the sesor validatio process described i that paper works i batch mode, i.e., o itermediate results are available, ad o attempt is made to estimate the quality of the results. For a real time applicatio, these characteristics are iadequate. This paper presets the extesio of the sesor validatio algorithm, so it ca be applied i real time systems. This cosists i the use of ay time algorithms. Thus, the extesio of the sesor validatio algorithm cosists i the followig features. First, the use of a probabilistic causal etwork that relates the real ad apparet faults. Secod, i order to perform i ay time basis, the validatio algorithm selects the sesor which provides more iformatio whe validated. Fially, a quality fuctio is calculated i order to characterize the behaviour of the algorithm. The selectio of the most iformative sesor is made usig the etropy fuctio. To summarize, this paper presets a ay time probabilistic algorithm for validatig the iformatio provided by sesors. The system cosists of two Bayesia etwork models. The first oe is a model of the depedecies betwee sesors ad it is used to validate each sesor. It provides a list of potetially faulty sesors. To isolate the real faults, a secod Bayesia etwork is used, which relates the potetial faults with the real faults. This secod model is also used to make the validatio algorithm ay time, by validatig first the sesors that provide more iformatio. To select the ext sesor to validate, ad measure the quality of the results at each stage, a etropy fuctio is used. Together, both models costitute a mechaism for validatig sesors i a ay time fashio, providig at each step the probability of correct/faulty for each sesor, ad the total quality of the results. The ext sectio briefly describes the basis of ay time algorithms. 2 Ay Time Algorithms Ay time algorithms represet oe directio of work that aims to achieve the use of artificial itelligece techiques i real time systems. This term was iitially used by Dea i his research about time depedet plaig [Dea & Boddy 1988]. At the same time, Horvitz (1987) proposed the ame of flexible computatio for this mechaism. Ay time algorithms are those that ca be iterrupted at ay poit durig computatio, ad retur a aswer whose value icreases as it is allocated additioal time [Boddy & Dea 1994]. However, how ca this value be measured i a specific applicatio? The literature cotais descriptios of differet dimesios that have bee proposed as metrics [Zilberstei & Russell 1996]: certaity, accuracy ad specificity. Performace profiles represet the expected value of these metrics for a give procedure as a fuctio of time. I other words, performace profiles characterize the quality of a algorithm's output as a fuctio of computatio time. Figure 2 illustrates three cases of performace profiles [Zilberstei & Russell 1996], [Dea & Boddy 1988]: q (a) (b) (c) Figure 2: Examples of performace profiles. (a) a stadard or oe shot algorithm. (b) a ideal, expoetial precisio algorithm, ad (c) a more realistic profile for a ay time algorithm i practice. Clearly, all these types of performace profiles are special cases of a superclass that ca be defied as mootoic improvemet, i.e., the quality of its itermediate results does ot decrease as more time is spet to produce the result. The ext sectio explais the basis of the validatio algorithm, so that sectio 4 develops the ay time algorithm for the sesor validatio problem. 3 Sesor Validatio The probabilistic sesor validatio model utilizes Bayesia etworks. The odes represet the measures of the sesors. The structure of the etwork makes explicit the depedece relatios betwee the variables. The probabilistic sesor validatio icludes the diagosis of all sigle sesors i the etwork. The idea is to istatiate all the odes with the sesor readigs, except the oe beig validated. A probabilistic propagatio provides a distributio of the posterior probability of the estimatio of a sigal value based o the readigs of the most related sigals. The estimated value is the compared with the curret value i order to decide if the measuremet is correct. The most closely related variables for each sesor cosist of a Markov blaket of the sesor variable. A Markov

3 268 Ibargiiegoytia, Sucar, ad Vadera blaket is defied as the set of variables that makes a variable idepedet from the others. I a Bayesia etwork, the followig three sets of eighbours is sufficiet for formig a Markov blaket of a ode: the set of direct predecessors, direct successors, ad the direct predecessors of the successors (i.e. parets, childre, ad spouses) [Pearl 1988]. The set of variables that costitutes the Markov blaket of a variable ca be see as a protectio of this variable agaist chages of variables outside the blaket. This meas that, i order to aalyze a variable, it is oly ecessary to kow the value of all variables i its blaket [Ibargiiegoytia et al. 1996]. Additioally, the exteded Markov blaket (EMB) of a sesor is formed by its Markov blaket plus the variable itself. However, sice validatig a sesor based o a faulty oe results i a erroeous validatio, the probabilistic validatio oly provides a list of apparet faults. Thus, the probabilistic validatio provides a list of potetial correct ad potetial faulty sesors. The fault isolatio is carried out whe the list of potetial faulty sesors is compared with the list of EMB of each sesor. Whe a match exists, the the faulty sesor has bee distiguished. Otherwise, differet coditios exist for the isolatio of multiple failures [Ibargiiegoytia et al. 1996]. The ext sectio describes the extesios of the sesor validatio model i order to discrimiate faulty ad correct sesors i a ay time basis. will be explaied ext i order to clarify the rest of the algorithm. 4.1 Validatio The validatio step was briefly itroduced i sectio 3 ad more extesively i [Ibargiiegoytia et al. 1996]. The sesors are processed oe by oe by the validatio fuctio utilizig the followig algorithm: 1. Read the actual value of the variable provided by the sesor. 2. Read the value of all variables that appear i the Markov blaket of the selected variable. 3. Propagate the probabilities ad obtai the posterior probability distributio for the selected variable. 4. If the probability (obtaied i 3) of the value acquired i step 1 is lower tha a specified value, retur failure; else retur success For example, cosider the simplified model of a gas turbie show i Fig. 4. The validatio of m is carried 4 Ay Time Sesor Validatio Ay time sesor validatio algorithm implies that the kowledge about the state of the sesors (faulty or correct) becomes more certai ad complete as time progresses. Certaity about the state of a sesor refers to the degree of belief i the correctess of a sesor, ad completeess is characterized by the umber of sesors from which the state is kow. Thus, it is required to be able to moitor the state of the sesors durig all the validatio process. This is doe through a vector whose elemets PJ ( s;) represet the probabilities of failure for the sesors s;. Give that the ay time validatio process eeds to be cyclic, the top level of the algorithm ca take the form show i Fig Iitialize P1 ( s;) for all sesors s;. 2. While there are uvalidated sesors do: (a) choose the ext sesor to validate (b) validate it (c) update the probability of failure vector P1 (d) measure the quality of the partial respose Figure 3: Top level of the ay time sesor validatio algorithm. The probabilistic validatio of a sigle sesor (step b) Figure 4: A reduced Bayesia etwork of a gas turbie. out by calculatig the probability distributio of m give the measuremets oft ad p. If the real value of sesor m has a probability greater tha certai value, the the sesor is cosidered correct, ad faulty otherwise. However, if the fault is i sesor p, the the validatio of m will also result i apparet fault. Thus, the validatio step is carried out by this algorithm that receives as iput, the sesor that will be validated. As output, the algorithm returs a biary value { correct,faulty} with the apparet status of the sesor. 4.2 Selectio of ext sesor This sectio develops a mathematical model for choosig the best sesor to validate give the history of the validatio process ad the curret state of the system. Also, the model proposed here will be used for measurig the quality of the respose i order to obtai the performace profile of the validatio algorithm. The cetral idea is that the validatio of a sesor provides

4 Ay Time Probabilistic Reasoig for Sesor Validatio 269 some iformatio ad also, extra iformatio ca be iferred. Therefore, a measure of the iformatio that a sigle validatio produces is required. A defiitio of the expected amout of iformatio that a evet produces was first proposed by Shao ad used i commuicatio theory [Shao & Weaver 1949]. Shao proposed the followig defiitios. Defiitio 4.1 Give a fiite probability distributio Pi 0 for (i = 1,..., ), ad L: p; = 1 Shao's etropy measure is defied as H=H( Pl,, P)=-2:.,p;log2Pi (1) i=l Thus, the etropy measures the related umber of bits required to store the iformatio. Sice the validatio of a sesor s has two possible outcomes, the etropy fuctio H(s) is the defied as: { 0 if p = 0 or p = 1 H(s) = -plog2(p)- (1-p)log2(1- p) otherwise (2) where p represets the probability of failure of the sesor. Notice that the expressio plog2(p) = 0 whe p = 1 but it is udefied whe p = 0. However, sice plog2(p) teds to zero as p teds to zero, the values defied i equatio 2 ca be safely assumed. Notice that it has its maximum whe p = 'i.e., whe the igorace is maximum, ad it is zero whe either p = 0 or p = 1, i.e., whe the iformatio is maximum ad igorace is miimum. This fuctio ca be cosidered either as a measure of the iformatio provided by a experimet, or as a measure of the ucertaity i the experimet's outcome. Thus, cosiderig each sigle sesor validatio as a experimet, this fuctio ca be used to measure the amout of iformatio provided by that validatio. The, the average amout of iformatio E for the system ca be defied as follows: 1 E(s1,...,s) = - 2:.,H(s;) i=l 1 = -- L PJ(s;)log2PJ(s;) i=l + (1- P1(s;))log2(1- PJ(s;)) 2 = -- L PJ(s;)log2PJ(s;) (3) i=l where is the umber of sesors i the system S, ad P1(s;) represets the curret probability of failure value assiged to sesors;. Notice that the vector whose elemets are P1 ( s;) provides a measure of the certaity i the validatio while the sum of idividual etropies provides a specificity measure of the result. Give this measure, the ay time sesor validatio algorithm eeds to select a sesor X that gives the best improvemet i the average etropy of the system S. Hece the followig coditioal versio of equatio 3 ca be writte E(S I X) = E(S I x = ok) + E(S I x = flty) = (2:.,H( s; I x = ok) + 2:.,H(s; I x = flty)) (4) This fuctio ca be evaluated for each sesor ad the oe which gives the most iformatio (the miimum E(S I X;)) ca be selected as the ext sesor X; to be validated. The computatio suggested by the above formulae could be too expesive for a real time sesor validatio process. To overcome this problem, a pre compilatio of the sesor selectio mechaism is implemeted as follows. The above formulae are used to select the sesor, Sr which gives the most iformatio. This selected sesor forms the root of a biary decisio tree. A fault is simulated i this sesor ad the formulae are agai used to select the ext sesor Sr-. The, the root Sr is assumed to be correct, ad the formulae are used to select the sesor Sr+ i this case. This results i the partial decisio tree show i Fig. 5. This process is repeated recursively o the Figure 5: Partial decisio tree. odes Sr- ad Sr+ to obtai a complete decisio tree, so that each path i the tree icludes all the sesors. As a example, cosider the etwork show i Fig. 4. This process results i the decisio tree show i Fig. 6. Notice that this tree ca be reduced cosiderig Figure 6: Biary tree idicatig the order of validatio give the respose of the validatio step. oly the valid trajectories formed by the assumptio of, for example, sigle faults amog the set of sesors. See [Ibargiiegoytia 1997] for more details.

5 270 lbargiiegoytia, Sucar, ad Vadera This decisio tree ca be used to select the ext sesor more efficietly i real time tha by performig the calculatios. Thus, the selectio step of the algorithm of Fig. 3 cosists of simply traversig the tree oe level after every sigle sesor validatio. The cycle starts at the root, ad the decisio tree poits to the ext ode i the tree accordig to the result of validatig the curret sesor. gas turbie give i Fig. 4. Thus, the cosequeces of 4.3 Isolatio The validatio step provides oly a list of potetially faulty sesors. Thus, a compariso is made betwee the set of potetially faulty sesors with the table of exteded Markov blakets of all the sesors. Whe a match is foud, a real fault is determied. However, the set of potetially faulty sesors is obtaied after all the sesors have bee validated. Therefore, i order to exted that algorithm for ay time behaviour, a differet mechaism for distiguishig real faults from apparet oes is required. This ew mechaism provides, as the output of the isolatio phase, a vector with the probability of a real fault i all the sesors. This vector is refied icremetally i time, so the ay time behaviour ca be achieved. The ay time fault isolatio process is based o the relatioship betwee real ad apparet faults. There are two situatios that arise: (i) the existece of a real fault causes a apparet fault (as show i Fig. 7(a)), ad (ii) oe apparet fault is the maifestatio of several possible real faults (as show i Fig. 7(b)). (a) (b) Figure 7: Causal relatio betwee real faults (R) ad apparet (A) faults represeted as odes. I (a), oe real fault causes several apparet oes, while i (b), oe apparet fault is caused by oe or more real faults. I both figures, the relatio betwee root odes ad leaf odes is the same as the exteded Markov blaket (EMB) of a sesor. Cosiderig all the sesors, a causal model relatig the real ad apparet faults ca therefore be obtaied from the fault detectio Bayesia etwork (i fact, the EMB table is sufficiet to build this etwork). I the first level (roots), the odes represet the evets of real failure i every sesor. The, the secod level (leaves) is formed by odes represetig apparet failures i all the sesors. Arcs are icluded betwee every root ode, ad the correspodig odes of the exteded Markov blaket. For example, the causal etwork show i Fig. 8 ca be obtaied directly from the Bayesia etwork of the Figure 8: Probabilistic causal model for fault isolatio i the example of Fig. 4. Rt_ represets a real fault m sesor i while Aj represets a apparet fault i sesor j. observig a apparet fault ca be propagated i the causal etwork i order to obtai the probabilities of a real fault i all the sesors. The etwork of Fig. 8 is multiply coected. Hece, the propagatio method of trees of cliques is utilized [Lauritze & Spiegelhalter 1988). I geeral, 0(2) coditioal probabilities would be required (for a ode with parets). However, the oisy or model ca be adopted here. Two assumptios eed to hold i order to use this model: accoutability ad exceptio idepedece [Pearl1988). The accoutability assumptio holds by the way the model is costructed, i.e., a sesor is apparetly faulty oly if there is a fault i its MB. The exceptio idepedece assumptio is cocered about a rare situatio for this particular model. The relatioship betwee the real ad apparet faults is obtaied from a Bayesia etwork i which the depedecies are assumed to be strog. Hece, the probability of a real fault ot resultig i a apparet fault is small. Further, the mechaism by which a real fault i oe sesor does ot result i a apparet fault is eve less likely to be depedet o aother real fault. Hece, give that these assumptios are reasoable, the coditioal probability matrix ca be calculated by utilizig equatio 5. where d is the set of assigmets of the set of apparet faults, ad Td represet the set of all apparet faults actually preset. Thus, the oly parameter required is defied as: Cij = 1-% = P(Aj I R; oly). I the case of the sesor validatio problem, i a ideal case, all the parameters Cij 1. Of course, these values ca be obtaied by simulatio from the data if the problem is expected to depart from this ideal case. That is, accordig to the theory developed i Ibargiiegoytia et al. (1996), whe a real fault Rt_ is (5)

6 Ay Time Probabilistic Reasoig for Sesor Validatio 271 preset, it will always cause the apparet fault Aj (assumig that there is a arc from R; to Aj). The etwork of Fig. 8 is iitialized with the followig iformatio: (i) the prior probability of all the root odes i the model is 0.5 (assumig igorace at the begiig of a cycle), ad (ii) the parameters Cij = 0.99 for all 1 :::; i, j ::;umber of odes. Havig described how real ad apparet faults ca be related, the fault isolatio model ca ow be summarized. It receives as a iput, a validated sesor with its detected state (faulty or correct) ad updates the probability of failure of all the sesors. It does this by istatiatig the value of the correspodig apparet ode ad usig a propagatio algorithm to obtai the posterior probabilities of the real faulty odes. A vector Pf of these posterior probabilities represets the curret state of kowledge about the sesors, ad ca be viewed as the output of the system at ay time. For example, assumig a fault i g i the etwork of Fig. 4, produces the sequece of values of the probability vector as show i Table (a) time (b) Figure 9: Performace profile describig the combiatio of certaity ad specificity i oe parameter agaist time. (a) without failure, (b) with a simulated failure i sesor g. Mexico. A Bayesia etwork represetig the depedecies betwee the sesors of the plat is show i Fig. 10. The depedecy model was obtaied by utilizig a automatic learig program that uses real data from the start up phase of the turbie [Sucar et al. 1997]. Table 1: Example of the values of the probability vector Pf. Step Pr(m) Pr(t) Pr(P) Pr(g) P1(a) t =faulty m = correct g =faulty a= c orrect p =correct Quality measure A measure that is idepedet of the applicatio is the average etropy of the sesors give i equatio 3. That is, if the curret quality measure is: 2 Q(s1,..., s) == -- L Pj(si)log2Pj(si) (6) i=l the, the reported quality fuctio is calculated with the formula Q = 9maxQ9curret where Qmax is the maximum value of the q ;lity measure (i.e.,, the umber of odes). Notice that this measure captures both the certaity ad specificity measures of ay time algorithms. It captures certaity sice the probabilities of the sesors are used, ad specificity sice all the sesors are combied to give a average. Figure 9 shows the performace profile obtaied with this quality measure for the example of Fig 4. 5 Empirical Results The sesor validatio algorithm was evaluated by applyig it to the validatio of temperature sesors of the gas turbie at the Gomez Palacio power plat i Figure 10: Probabilistic tree of the applicatio. Nodes represet temperature sigals of a gas turbie. The data set was partitioed i two subsets: oe partitio for traiig the etwork, ad the other partitio for testig. The traiig/testig partitio used was 70-30% of the origial data set, i.e., 610 istaces for traiig the model (calculatig the prior ad coditioal probabilities), ad 260 istaces for testig. Theoretically, the system should always detect ad isolate sigle faults correctly. However, i reality, some errors may occur sice i practice it is ulikely that the depedecy model will be perfect. Cosequetly, two types of errors could occur: a correct readig might be cosidered faulty, ad a real fault might ot be detected. These two possible errors are called type I ad type II errors i the literature, ad defied as follows [Cohe 1995]: type I: rejectio of the ull hypothesis whe it is true, type II: acceptace of the ull hypothesis whe it is actually false. The ull hypothesis used refers to the hypothesis that a sesor is workig properly. Thus, i other words,

7 272 lbargiiegoytia, Sucar, ad Vadera type I errors occur whe a correct sesor is reported as faulty while type II errors occur whe faulty sesors are ot detected. The criteria for decidig if a readig is faulty or ot ca result i a trade off betwee these two types of errors. The criteria cosidered i this project are the followig: 1. Calculate the distace of the real value from the expected value, ad map it to faulty if it is beyod a specified threshold ad to correct if it is less tha a specified threshold. The threshold values cosidered were 2, 2.5 ad 3 times the stadard deviatio rr. 2. Assume that the sesor is workig properly ad establish a cofidece level at which this hypothesis ca be rejected, i which case it ca be cosidered faulty. This cofidece level is kow as the p value. The p values cosidered were 0.05 ad The accuracy of the model, i.e., the proportio of type I ad II errors, is evaluated by varyig the possible thresholds for each of these criteria. Two differet faults were simulated: Severe. The sesor value modified is the most distat extreme value, i.e., the real value is substituted by oe which differs by miimum 50 %. Mild. The real value is replaced by oe which differs by 25 %. A test procedure was used to evaluate the accuracy of the whole validatio process. Table 2 presets the fial evaluatio of the prototype with the percetage of type I ad II errors for severe ad mild faults. Criteria Type I Type II Type I Type II Type I errors imply that most of the sesors i a EMB preset apparet type I errors. This is more commo as it ca be see i Table 2. That is, there are cases where the existece of a ivalid apparet fault, together with the valid oes, completes the EMB of a misdiagosed sesor. Hece, a type I error is produced. O the cotrary, type II errors are detected at this stage whe most of the sesors of a EMB preset misdiagosed apparet faults. This is very improbable as the results of Table 2 cofirms. The percetages are obtaied comparig the average umber of errors, with the total umber of experimets. 6 Discussio Sectio 4.2 developed a ay time sesor validatio algorithm that utilizes a etropy fuctio as a criterio for selectig the ext sesor to validate. This etropy fuctio calculates the amout of iformatio that ay sigle validatio provides for diagosig all the sesors. Hece, to evaluate this criterio, this sectio compares the performace profile of the ay time sesor validatio algorithm as a fuctio of time whe the etropy based measure is used, ad whe a radom selectio scheme is used. Figure 11 shows the resultat performace profile of the ay time sesor validatio algorithm. That is, the 0.9 o.s (J Tme -- Radom -x- Etropy x-x Figure 11: Performace profile of the ay time sesor validatio algorithm (timex 10-2 sec.). quality of the respose as a fuctio of time. A experimet cosisted i the simulatio of a sigle fault. Thus, 21 idepedet experimets were ecessary to simulate a fault i all the sesors. I total, 260 experimets were carried out, so every oe of the 21 sesors was simulated faulty at least 12 times (12.6 times). The etropy graph represets the average of the resultat quality with the etropy based scheme for the 21 sesors of Fig. 10. The radom graph represets the average of the same experimet with a radom selectio scheme. The time axis is a qualitative compariso rather tha quatitative. Alteratively, the results ca also be evaluated by comparig the time required to reach differet levels of quality. For example i Fig. 11, whe the radom criterio reaches 60 % of quality, the etropy criterio has already reached more tha 80 %. The approach has bee implemeted ad is beig tested o the validatio of temperature sesors i a gas turbie of a combied cycle power plat. The results for the accuracy of the model were reported i terms of the type I ad type II errors ad with respect to detectig severe ad mild faults. The results showed, that for this particular test applicatio, more

8 Ay Time Probabilistic Reasoig for Sesor Validatio 273 striget criteria for detectig failures reduced type I errors but did ot sigificatly icrease type II errors. The results of the evaluatio of the validatio ad isolatio phases together are show i Table 2. Agai, with a p value of 0.01, there are 2.9% of type I errors, ad 0.4 % type II errors. Notice that, i geeral, the sesor validatio algorithm performs almost perfectly with respect to udetected faulty sesors, i.e., all the faults are detected. At the same time, the rate of icorrect detectio faults is satisfactory for most of the criteria aalyzed. Two complexity aspects eed to be discussed. The first oe is the size of the pre compliled decisio tree preseted i sectio 4.2. A biary tree for sesors cotais levels ad up to 2-l odes (1,048,575 odes for 21 sesors). However, if a sigle fault is assumed, the the decisio tree results i a prued tree with levels ad at most x ( + 1) odes. The secod oe is the complexity for probability propagatio i the fault isolatio etwork as i Fig. 8. The propagatio complexity (usig the closterig algorithm [Lauritze & Spiegelhalter 1988]), depeds o the the size of the largest etry of the EM B table, i.e., the largest clique. However, if a tree is assumed for the detectio Bayesia etwork, the umber of odes i the EM B table remais small, i.e., just oe paret ad the childre of a ode. 7 Coclusios This paper has preseted a ay time, probabilistic algorithm for sesor validatio. A layered approach is cosidered where the lowest layer performs the validatio. A Bayesia etwork is used to defie the relatioships betwee variables ad to estimate the expected value of a sesor. The expected value is the compared with the actual readig obtaied. If these measures differ the a faulty sesor is suspected. A faulty sesor is the distiguished from apparetly faulty sesors by the use of a property based o the Markov blaket. A ay time versio of the validatio algorithm, that improves the quality of its aswer icremetally, has also bee preseted. This ay time algorithm uses a causal etwork to distiguish the real fault from the apparet oes. The ay time behaviour is obtaied with the selectio of the sesor that provides more iformatio whe validated. The selectio is made with the etropy fuctio. The evaluatio of the ay time behaviour of the algorithm preseted i this paper was doe by carryig out experimets to obtai the performace profile of the etropy based selectio scheme ad comparig it with a radom selectio scheme. Future research will attempt to use the probabilities obtaied i the fault detectio Bayesia etwork, as the iput to the fault isolatio Bayesia etwork. At this stage, the output of the detectio etwork cosists i a biary value ({correct, faulty}). Ackowledgmets Thaks to the aoymous referees for their commets which improved this article. This research is supported by a grat from CONACYT ad lie uder the IIE/SALFORD/CONACYT doctoral programme. Refereces Boddy, M. & Dea, T. (1994), 'Decisio theoretic deliberatio schedullig for problem solvig i timecostraied eviromets', Artificial Itelligece 67(2), Cohe, P. (1995), Empirical methods for artificial itelligece, MIT press, Cambridge, Mass., U.S.A. Dea, T. & Boddy, M. (1988), A aalysis of time depedet plaig, i 'Proc. Seveth Natl. Cof. o AI', St. Paul, MN, U.S.A. Horvitz, E. (1987), Reasoig about beliefs ad actios uder computatioal resource costraits, i 'Proc. Third Coferece o Ucertaity i Artificial Itelligece', Seatle, WA, U.S.A., pp Ibargiiegoytia, P. (1997), Ay time probabilistic sesor validatio, PhD dissertatio, Uiversity of Salford, Computer ad Mathematical Scieces, Salford U.K. Ibargiiegoytia, P., Sucar, L. & Vadera, S. (1996), A probabilistic model for sesor validatio, i 'Proc. Twelfth Coferece o Ucertaity i Artificial Itelligece', Portlad, Orego, U.S.A., pp Lauritze, S. & Spiegelhalter, D. J. (1988), 'Local computatios with probabilities o graphical structures ad their applicatio to expert systems', Joural of the Royal Statistical Society series B 50(2), Pearl, J. (1988), Probabilistic reasoig i itelliget systems: etworks of plausible iferece, Morga Kaufma, Palo Alto, Calif., U.S.A. Shao, C. & Weaver, W. (1949), The mathematical theory of commuicatio, Uiversity of Illiois press, Urbaa, Ill., U.S.A. Stakovic, J. (1988), 'Miscoceptios about real time computig: a serious problem for ext geeratio systems', Computer 21(10), Sucar, L., Perez-Brito, J., Ruiz-Suarez, J. & Morales, E. (1997), 'Learig structure from data ad its applicatio to ozoe predictio', Applied Itelligece 7, Yug, S. & Clarke, D. (1989), 'Local sesor validatio', Measuremet f3 Cotrol22 (3), Zilberstei, S. & Russell, S. (1996), 'Optimal compositio of real-time systems', Artificial Itelligece 82 (1-2) '

GUIDELINES ON REPRESENTATIVE SAMPLING

GUIDELINES ON REPRESENTATIVE SAMPLING DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue

More information

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

1 Review of Probability & Statistics

1 Review of Probability & Statistics 1 Review of Probability & Statistics a. I a group of 000 people, it has bee reported that there are: 61 smokers 670 over 5 960 people who imbibe (drik alcohol) 86 smokers who imbibe 90 imbibers over 5

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

Statistical inference: example 1. Inferential Statistics

Statistical inference: example 1. Inferential Statistics Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either

More information

Information-based Feature Selection

Information-based Feature Selection Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with

More information

11 Correlation and Regression

11 Correlation and Regression 11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

Measurement uncertainty of the sound absorption

Measurement uncertainty of the sound absorption Measuremet ucertaity of the soud absorptio coefficiet Aa Izewska Buildig Research Istitute, Filtrowa Str., 00-6 Warsaw, Polad a.izewska@itb.pl 6887 The stadard ISO/IEC 705:005 o the competece of testig

More information

Frequentist Inference

Frequentist Inference Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for

More information

STA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to:

STA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to: STA 2023 Module 10 Comparig Two Proportios Learig Objectives Upo completig this module, you should be able to: 1. Perform large-sample ifereces (hypothesis test ad cofidece itervals) to compare two populatio

More information

6 Sample Size Calculations

6 Sample Size Calculations 6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig

More information

Discrete Mathematics and Probability Theory Spring 2013 Anant Sahai Lecture 18

Discrete Mathematics and Probability Theory Spring 2013 Anant Sahai Lecture 18 EECS 70 Discrete Mathematics ad Probability Theory Sprig 2013 Aat Sahai Lecture 18 Iferece Oe of the major uses of probability is to provide a systematic framework to perform iferece uder ucertaity. A

More information

Section 9.2. Tests About a Population Proportion 12/17/2014. Carrying Out a Significance Test H A N T. Parameters & Hypothesis

Section 9.2. Tests About a Population Proportion 12/17/2014. Carrying Out a Significance Test H A N T. Parameters & Hypothesis Sectio 9.2 Tests About a Populatio Proportio P H A N T O M S Parameters Hypothesis Assess Coditios Name the Test Test Statistic (Calculate) Obtai P value Make a decisio State coclusio Sectio 9.2 Tests

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

Sequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018

Sequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018 CSE 353 Discrete Computatioal Structures Sprig 08 Sequeces, Mathematical Iductio, ad Recursio (Chapter 5, Epp) Note: some course slides adopted from publisher-provided material Overview May mathematical

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

Analysis of Experimental Measurements

Analysis of Experimental Measurements Aalysis of Experimetal Measuremets Thik carefully about the process of makig a measuremet. A measuremet is a compariso betwee some ukow physical quatity ad a stadard of that physical quatity. As a example,

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Principle Of Superposition

Principle Of Superposition ecture 5: PREIMINRY CONCEP O RUCUR NYI Priciple Of uperpositio Mathematically, the priciple of superpositio is stated as ( a ) G( a ) G( ) G a a or for a liear structural system, the respose at a give

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

Classification of problem & problem solving strategies. classification of time complexities (linear, logarithmic etc)

Classification of problem & problem solving strategies. classification of time complexities (linear, logarithmic etc) Classificatio of problem & problem solvig strategies classificatio of time complexities (liear, arithmic etc) Problem subdivisio Divide ad Coquer strategy. Asymptotic otatios, lower boud ad upper boud:

More information

Chapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.

Chapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc. Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo

More information

Chapter 22. Comparing Two Proportions. Copyright 2010 Pearson Education, Inc.

Chapter 22. Comparing Two Proportions. Copyright 2010 Pearson Education, Inc. Chapter 22 Comparig Two Proportios Copyright 2010 Pearso Educatio, Ic. Comparig Two Proportios Comparisos betwee two percetages are much more commo tha questios about isolated percetages. Ad they are more

More information

Chapter 8: Estimating with Confidence

Chapter 8: Estimating with Confidence Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig

More information

Polynomial identity testing and global minimum cut

Polynomial identity testing and global minimum cut CHAPTER 6 Polyomial idetity testig ad global miimum cut I this lecture we will cosider two further problems that ca be solved usig probabilistic algorithms. I the first half, we will cosider the problem

More information

Probability, Expectation Value and Uncertainty

Probability, Expectation Value and Uncertainty Chapter 1 Probability, Expectatio Value ad Ucertaity We have see that the physically observable properties of a quatum system are represeted by Hermitea operators (also referred to as observables ) such

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

Provläsningsexemplar / Preview TECHNICAL REPORT INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE

Provläsningsexemplar / Preview TECHNICAL REPORT INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE TECHNICAL REPORT CISPR 16-4-3 2004 AMENDMENT 1 2006-10 INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE Amedmet 1 Specificatio for radio disturbace ad immuity measurig apparatus ad methods Part 4-3:

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

A quick activity - Central Limit Theorem and Proportions. Lecture 21: Testing Proportions. Results from the GSS. Statistics and the General Population

A quick activity - Central Limit Theorem and Proportions. Lecture 21: Testing Proportions. Results from the GSS. Statistics and the General Population A quick activity - Cetral Limit Theorem ad Proportios Lecture 21: Testig Proportios Statistics 10 Coli Rudel Flip a coi 30 times this is goig to get loud! Record the umber of heads you obtaied ad calculate

More information

ANALYSIS OF EXPERIMENTAL ERRORS

ANALYSIS OF EXPERIMENTAL ERRORS ANALYSIS OF EXPERIMENTAL ERRORS All physical measuremets ecoutered i the verificatio of physics theories ad cocepts are subject to ucertaities that deped o the measurig istrumets used ad the coditios uder

More information

Tests of Hypotheses Based on a Single Sample (Devore Chapter Eight)

Tests of Hypotheses Based on a Single Sample (Devore Chapter Eight) Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

Lecture 2. The Lovász Local Lemma

Lecture 2. The Lovász Local Lemma Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio

More information

15-780: Graduate Artificial Intelligence. Density estimation

15-780: Graduate Artificial Intelligence. Density estimation 5-780: Graduate Artificial Itelligece Desity estimatio Coditioal Probability Tables (CPT) But where do we get them? P(B)=.05 B P(E)=. E P(A B,E) )=.95 P(A B, E) =.85 P(A B,E) )=.5 P(A B, E) =.05 A P(J

More information

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D.

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D. ample ie Estimatio i the Proportioal Haards Model for K-sample or Regressio ettigs cott. Emerso, M.D., Ph.D. ample ie Formula for a Normally Distributed tatistic uppose a statistic is kow to be ormally

More information

Data Analysis and Statistical Methods Statistics 651

Data Analysis and Statistical Methods Statistics 651 Data Aalysis ad Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasii/teachig.html Suhasii Subba Rao Review of testig: Example The admistrator of a ursig home wats to do a time ad motio

More information

This is an introductory course in Analysis of Variance and Design of Experiments.

This is an introductory course in Analysis of Variance and Design of Experiments. 1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class

More information

IP Reference guide for integer programming formulations.

IP Reference guide for integer programming formulations. IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random

10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random Part III. Areal Data Aalysis 0. Comparative Tests amog Spatial Regressio Models While the otio of relative likelihood values for differet models is somewhat difficult to iterpret directly (as metioed above),

More information

MA238 Assignment 4 Solutions (part a)

MA238 Assignment 4 Solutions (part a) (i) Sigle sample tests. Questio. MA38 Assigmet 4 Solutios (part a) (a) (b) (c) H 0 : = 50 sq. ft H A : < 50 sq. ft H 0 : = 3 mpg H A : > 3 mpg H 0 : = 5 mm H A : 5mm Questio. (i) What are the ull ad alterative

More information

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test.

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test. Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal

More information

Recurrence Relations

Recurrence Relations Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The

More information

6.883: Online Methods in Machine Learning Alexander Rakhlin

6.883: Online Methods in Machine Learning Alexander Rakhlin 6.883: Olie Methods i Machie Learig Alexader Rakhli LECTURES 5 AND 6. THE EXPERTS SETTING. EXPONENTIAL WEIGHTS All the algorithms preseted so far halluciate the future values as radom draws ad the perform

More information

Exercises Advanced Data Mining: Solutions

Exercises Advanced Data Mining: Solutions Exercises Advaced Data Miig: Solutios Exercise 1 Cosider the followig directed idepedece graph. 5 8 9 a) Give the factorizatio of P (X 1, X 2,..., X 9 ) correspodig to this idepedece graph. P (X) = 9 P

More information

Investigating the Significance of a Correlation Coefficient using Jackknife Estimates

Investigating the Significance of a Correlation Coefficient using Jackknife Estimates Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------

More information

There is no straightforward approach for choosing the warmup period l.

There is no straightforward approach for choosing the warmup period l. B. Maddah INDE 504 Discrete-Evet Simulatio Output Aalysis () Statistical Aalysis for Steady-State Parameters I a otermiatig simulatio, the iterest is i estimatig the log ru steady state measures of performace.

More information

CHAPTER 10 INFINITE SEQUENCES AND SERIES

CHAPTER 10 INFINITE SEQUENCES AND SERIES CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece

More information

WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? ABSTRACT

WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? ABSTRACT WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? Harold G. Loomis Hoolulu, HI ABSTRACT Most coastal locatios have few if ay records of tsuami wave heights obtaied over various time periods. Still

More information

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The

More information

Intro to Learning Theory

Intro to Learning Theory Lecture 1, October 18, 2016 Itro to Learig Theory Ruth Urer 1 Machie Learig ad Learig Theory Comig soo 2 Formal Framework 21 Basic otios I our formal model for machie learig, the istaces to be classified

More information

Analysis of Experimental Data

Analysis of Experimental Data Aalysis of Experimetal Data 6544597.0479 ± 0.000005 g Quatitative Ucertaity Accuracy vs. Precisio Whe we make a measuremet i the laboratory, we eed to kow how good it is. We wat our measuremets to be both

More information

Lecture 12: Hypothesis Testing

Lecture 12: Hypothesis Testing 9.07 Itroductio to Statistics for Brai ad Cogitive Scieces Emery N. Brow Lecture : Hypothesis Testig I. Objectives. Uderstad the hypothesis testig paradigm.. Uderstad how hypothesis testig procedures are

More information

CS284A: Representations and Algorithms in Molecular Biology

CS284A: Representations and Algorithms in Molecular Biology CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Output Analysis (2, Chapters 10 &11 Law)

Output Analysis (2, Chapters 10 &11 Law) B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe

More information

The target reliability and design working life

The target reliability and design working life Safety ad Security Egieerig IV 161 The target reliability ad desig workig life M. Holický Kloker Istitute, CTU i Prague, Czech Republic Abstract Desig workig life ad target reliability levels recommeded

More information

CONTROL CHARTS FOR THE LOGNORMAL DISTRIBUTION

CONTROL CHARTS FOR THE LOGNORMAL DISTRIBUTION CONTROL CHARTS FOR THE LOGNORMAL DISTRIBUTION Petros Maravelakis, Joh Paaretos ad Stelios Psarakis Departmet of Statistics Athes Uiversity of Ecoomics ad Busiess 76 Patisio St., 4 34, Athes, GREECE. Itroductio

More information

Time-Domain Representations of LTI Systems

Time-Domain Representations of LTI Systems 2.1 Itroductio Objectives: 1. Impulse resposes of LTI systems 2. Liear costat-coefficiets differetial or differece equatios of LTI systems 3. Bloc diagram represetatios of LTI systems 4. State-variable

More information

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen) Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................

More information

OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES

OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES Peter M. Maurer Why Hashig is θ(). As i biary search, hashig assumes that keys are stored i a array which is idexed by a iteger. However, hashig attempts to bypass

More information

As stated by Laplace, Probability is common sense reduced to calculation.

As stated by Laplace, Probability is common sense reduced to calculation. Note: Hadouts DO NOT replace the book. I most cases, they oly provide a guidelie o topics ad a ituitive feel. The math details will be covered i class, so it is importat to atted class ad also you MUST

More information

Rademacher Complexity

Rademacher Complexity EECS 598: Statistical Learig Theory, Witer 204 Topic 0 Rademacher Complexity Lecturer: Clayto Scott Scribe: Ya Deg, Kevi Moo Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved for

More information

Overview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions

Overview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples

More information

Axioms of Measure Theory

Axioms of Measure Theory MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that

More information

NUMERICAL METHODS FOR SOLVING EQUATIONS

NUMERICAL METHODS FOR SOLVING EQUATIONS Mathematics Revisio Guides Numerical Methods for Solvig Equatios Page 1 of 11 M.K. HOME TUITION Mathematics Revisio Guides Level: GCSE Higher Tier NUMERICAL METHODS FOR SOLVING EQUATIONS Versio:. Date:

More information

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com

More information

10-701/ Machine Learning Mid-term Exam Solution

10-701/ Machine Learning Mid-term Exam Solution 0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it

More information

x a x a Lecture 2 Series (See Chapter 1 in Boas)

x a x a Lecture 2 Series (See Chapter 1 in Boas) Lecture Series (See Chapter i Boas) A basic ad very powerful (if pedestria, recall we are lazy AD smart) way to solve ay differetial (or itegral) equatio is via a series expasio of the correspodig solutio

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

TEACHER CERTIFICATION STUDY GUIDE

TEACHER CERTIFICATION STUDY GUIDE COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra

More information

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS R775 Philips Res. Repts 26,414-423, 1971' THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS by H. W. HANNEMAN Abstract Usig the law of propagatio of errors, approximated

More information

A proposed discrete distribution for the statistical modeling of

A proposed discrete distribution for the statistical modeling of It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical

More information

Chapter 6 Part 5. Confidence Intervals t distribution chi square distribution. October 23, 2008

Chapter 6 Part 5. Confidence Intervals t distribution chi square distribution. October 23, 2008 Chapter 6 Part 5 Cofidece Itervals t distributio chi square distributio October 23, 2008 The will be o help sessio o Moday, October 27. Goal: To clearly uderstad the lik betwee probability ad cofidece

More information

On an Application of Bayesian Estimation

On an Application of Bayesian Estimation O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, Higashi-Osaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

PH 425 Quantum Measurement and Spin Winter SPINS Lab 1

PH 425 Quantum Measurement and Spin Winter SPINS Lab 1 PH 425 Quatum Measuremet ad Spi Witer 23 SPIS Lab Measure the spi projectio S z alog the z-axis This is the experimet that is ready to go whe you start the program, as show below Each atom is measured

More information

Estimation of a population proportion March 23,

Estimation of a population proportion March 23, 1 Social Studies 201 Notes for March 23, 2005 Estimatio of a populatio proportio Sectio 8.5, p. 521. For the most part, we have dealt with meas ad stadard deviatios this semester. This sectio of the otes

More information

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Modeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy

Modeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy Sri Laka Joural of Applied Statistics, Vol (5-3) Modelig ad Estimatio of a Bivariate Pareto Distributio usig the Priciple of Maximum Etropy Jagathath Krisha K.M. * Ecoomics Research Divisio, CSIR-Cetral

More information

Number of fatalities X Sunday 4 Monday 6 Tuesday 2 Wednesday 0 Thursday 3 Friday 5 Saturday 8 Total 28. Day

Number of fatalities X Sunday 4 Monday 6 Tuesday 2 Wednesday 0 Thursday 3 Friday 5 Saturday 8 Total 28. Day LECTURE # 8 Mea Deviatio, Stadard Deviatio ad Variace & Coefficiet of variatio Mea Deviatio Stadard Deviatio ad Variace Coefficiet of variatio First, we will discuss it for the case of raw data, ad the

More information

Computing Confidence Intervals for Sample Data

Computing Confidence Intervals for Sample Data Computig Cofidece Itervals for Sample Data Topics Use of Statistics Sources of errors Accuracy, precisio, resolutio A mathematical model of errors Cofidece itervals For meas For variaces For proportios

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

Sample Size Determination (Two or More Samples)

Sample Size Determination (Two or More Samples) Sample Sie Determiatio (Two or More Samples) STATGRAPHICS Rev. 963 Summary... Data Iput... Aalysis Summary... 5 Power Curve... 5 Calculatios... 6 Summary This procedure determies a suitable sample sie

More information

Soo King Lim Figure 1: Figure 2: Figure 3: Figure 4: Figure 5: Figure 6: Figure 7:

Soo King Lim Figure 1: Figure 2: Figure 3: Figure 4: Figure 5: Figure 6: Figure 7: 0 Multivariate Cotrol Chart 3 Multivariate Normal Distributio 5 Estimatio of the Mea ad Covariace Matrix 6 Hotellig s Cotrol Chart 6 Hotellig s Square 8 Average Value of k Subgroups 0 Example 3 3 Value

More information

c. Explain the basic Newsvendor model. Why is it useful for SC models? e. What additional research do you believe will be helpful in this area?

c. Explain the basic Newsvendor model. Why is it useful for SC models? e. What additional research do you believe will be helpful in this area? 1. Research Methodology a. What is meat by the supply chai (SC) coordiatio problem ad does it apply to all types of SC s? Does the Bullwhip effect relate to all types of SC s? Also does it relate to SC

More information

Commutativity in Permutation Groups

Commutativity in Permutation Groups Commutativity i Permutatio Groups Richard Wito, PhD Abstract I the group Sym(S) of permutatios o a oempty set S, fixed poits ad trasiet poits are defied Prelimiary results o fixed ad trasiet poits are

More information

Research on Dependable level in Network Computing System Yongxia Li 1, a, Guangxia Xu 2,b and Shuangyan Liu 3,c

Research on Dependable level in Network Computing System Yongxia Li 1, a, Guangxia Xu 2,b and Shuangyan Liu 3,c Applied Mechaics ad Materials Olie: 04-0-06 ISSN: 66-748, Vols. 53-57, pp 05-08 doi:0.408/www.scietific.et/amm.53-57.05 04 Tras Tech Publicatios, Switzerlad Research o Depedable level i Network Computig

More information

The Random Walk For Dummies

The Random Walk For Dummies The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli

More information