ANY TIME PROBABILISTIC REASONING FOR SENSOR VALIDATION
|
|
- Lewis Price
- 6 years ago
- Views:
Transcription
1 266 ANY TIME PROBABILISTIC REASONING FOR SENSOR VALIDATION P.H. Ibargiiegoytia Istituto de Ivestigacioes Eh ctricas, A.P Cueravaca, Mor., 62001, Mexico L.E. Sucar Istituto Tecol6gico y de Estudios Superiores de Moterrey Campus Morelos, A.P. 99-C Cueravaca, Mor., 62050, Mexico esucar@campus.mor.itesm.mx S. Vadera Uiversity of Salford Dept. of Mathematics ad Computer Sciece Salford, M5 4WT, U.K. S.Vadera@mcs.salford.ac.uk Abstract For may real time applicatios, it is importat to validate the iformatio received from the sesors before eterig higher levels of reasoig. This paper presets a ay time probabilistic algorithm for validatig the iformatio provided by sesors. The system cosists of two Bayesia etwork models. The first oe is a model of the depedecies betwee sesors ad it is used to validate each sesor. It provides a list of potetially faulty sesors. To isolate the real faults, a secod Bayesia etwork is used, which relates the potetial faults with the real faults. This secod model is also used to make the validatio algorithm ay time, by validatig first the sesors that provide more iformatio. To select the ext sesor to validate, ad measure the quality of the results at each stage, a etropy fuctio is used. This fuctio captures i a sigle quatity both the certaity ad specificity measures of ay time algorithms. Together, both models costitute a mechaism for validatig sesors i a ay time fashio, providig at each step the probability of correct/faulty for each sesor, ad the total quality of the results. The algorithm has bee tested i the validatio of temperature sesors of a power plat. 1 Itroductio Artificial itelligece (AI) techiques are playig a icreasigly importat role i real applicatios. I idustry, differet techiques have bee proposed, for example, i diagosis, automatic cotrol, ad moitorig. Geerally, these applicatios require a overall model which usually, its iputs are maily sesors. Also, may of these real applicatios eed to maitai a real time behaviour, i.e., the correctess of the system depeds ot oly o the logical result of the computatio but also o the time at which the results are produced (Stakovic 1988]. Usually, real applicatios possess a time limit by which some actios must be performed. This paper presets a model for the validatio of the sesors used i real time applicatios. The proposed validatio is carried out i a separate module that works together with other fuctios i a system. I other words, it is assumed that a layered scheme is used i which the lowest level cocetrates o validatig the sigals trasmitted by the sesors as preseted i Fig. 1 (Yug & Clarke 1989]. The mai beefit of Figure 1: Layered diagosis architecture. usig a layered approach is that it eables the costructio of models i a modular fashio. That is, it is easier to costruct a model for sesor validatio ad the a model for the process tha it is to costruct a overall model i oe step. This separatio of the sesor validatio layer ca also result i simpler higher layer models ad leave the higher layers to utilize other techiques. Faults i the sesors readigs are detected i a decetralised ad hierarchical approach, so that they ca be easily isolated ad repaired. Additioally, suppose that the higher layers of the system represet other importat ad critical fuctios, e.g., the fault diagosis of a uclear plat. The itermediate layer (loop diagosis) may be usig model based reasoig to diagose a cotrol loop i the plat, whereas the system diagosis layer may be utilizig a differet approach. The validatio module preseted i this paper, utilizes a probabilistic model which cosiders oly the relatioships betwee the variables to be validated. This
2 Ay Time Probabilistic Reasoig for Sesor Validatio 267 probabilistic model is idepedet of the higher layers models, so it is easier to costruct ad matai whe ecessary. This paper presets the cotiuatio of the project described i a previous paper [Ibargiiegoytia et al. 1996]. I that paper, the authors described a probabilistic approach to sesor validatio that took advatage of a Markov blaket property to distiguish real faults from apparet faults. A Bayesia etwork was used as a basis for predictig a probability distributio for a sesor value based o other sesors. The predicted distributio ad the actual sesor readig was used i order to determie if there was a potetial fault. However, the sesor validatio process described i that paper works i batch mode, i.e., o itermediate results are available, ad o attempt is made to estimate the quality of the results. For a real time applicatio, these characteristics are iadequate. This paper presets the extesio of the sesor validatio algorithm, so it ca be applied i real time systems. This cosists i the use of ay time algorithms. Thus, the extesio of the sesor validatio algorithm cosists i the followig features. First, the use of a probabilistic causal etwork that relates the real ad apparet faults. Secod, i order to perform i ay time basis, the validatio algorithm selects the sesor which provides more iformatio whe validated. Fially, a quality fuctio is calculated i order to characterize the behaviour of the algorithm. The selectio of the most iformative sesor is made usig the etropy fuctio. To summarize, this paper presets a ay time probabilistic algorithm for validatig the iformatio provided by sesors. The system cosists of two Bayesia etwork models. The first oe is a model of the depedecies betwee sesors ad it is used to validate each sesor. It provides a list of potetially faulty sesors. To isolate the real faults, a secod Bayesia etwork is used, which relates the potetial faults with the real faults. This secod model is also used to make the validatio algorithm ay time, by validatig first the sesors that provide more iformatio. To select the ext sesor to validate, ad measure the quality of the results at each stage, a etropy fuctio is used. Together, both models costitute a mechaism for validatig sesors i a ay time fashio, providig at each step the probability of correct/faulty for each sesor, ad the total quality of the results. The ext sectio briefly describes the basis of ay time algorithms. 2 Ay Time Algorithms Ay time algorithms represet oe directio of work that aims to achieve the use of artificial itelligece techiques i real time systems. This term was iitially used by Dea i his research about time depedet plaig [Dea & Boddy 1988]. At the same time, Horvitz (1987) proposed the ame of flexible computatio for this mechaism. Ay time algorithms are those that ca be iterrupted at ay poit durig computatio, ad retur a aswer whose value icreases as it is allocated additioal time [Boddy & Dea 1994]. However, how ca this value be measured i a specific applicatio? The literature cotais descriptios of differet dimesios that have bee proposed as metrics [Zilberstei & Russell 1996]: certaity, accuracy ad specificity. Performace profiles represet the expected value of these metrics for a give procedure as a fuctio of time. I other words, performace profiles characterize the quality of a algorithm's output as a fuctio of computatio time. Figure 2 illustrates three cases of performace profiles [Zilberstei & Russell 1996], [Dea & Boddy 1988]: q (a) (b) (c) Figure 2: Examples of performace profiles. (a) a stadard or oe shot algorithm. (b) a ideal, expoetial precisio algorithm, ad (c) a more realistic profile for a ay time algorithm i practice. Clearly, all these types of performace profiles are special cases of a superclass that ca be defied as mootoic improvemet, i.e., the quality of its itermediate results does ot decrease as more time is spet to produce the result. The ext sectio explais the basis of the validatio algorithm, so that sectio 4 develops the ay time algorithm for the sesor validatio problem. 3 Sesor Validatio The probabilistic sesor validatio model utilizes Bayesia etworks. The odes represet the measures of the sesors. The structure of the etwork makes explicit the depedece relatios betwee the variables. The probabilistic sesor validatio icludes the diagosis of all sigle sesors i the etwork. The idea is to istatiate all the odes with the sesor readigs, except the oe beig validated. A probabilistic propagatio provides a distributio of the posterior probability of the estimatio of a sigal value based o the readigs of the most related sigals. The estimated value is the compared with the curret value i order to decide if the measuremet is correct. The most closely related variables for each sesor cosist of a Markov blaket of the sesor variable. A Markov
3 268 Ibargiiegoytia, Sucar, ad Vadera blaket is defied as the set of variables that makes a variable idepedet from the others. I a Bayesia etwork, the followig three sets of eighbours is sufficiet for formig a Markov blaket of a ode: the set of direct predecessors, direct successors, ad the direct predecessors of the successors (i.e. parets, childre, ad spouses) [Pearl 1988]. The set of variables that costitutes the Markov blaket of a variable ca be see as a protectio of this variable agaist chages of variables outside the blaket. This meas that, i order to aalyze a variable, it is oly ecessary to kow the value of all variables i its blaket [Ibargiiegoytia et al. 1996]. Additioally, the exteded Markov blaket (EMB) of a sesor is formed by its Markov blaket plus the variable itself. However, sice validatig a sesor based o a faulty oe results i a erroeous validatio, the probabilistic validatio oly provides a list of apparet faults. Thus, the probabilistic validatio provides a list of potetial correct ad potetial faulty sesors. The fault isolatio is carried out whe the list of potetial faulty sesors is compared with the list of EMB of each sesor. Whe a match exists, the the faulty sesor has bee distiguished. Otherwise, differet coditios exist for the isolatio of multiple failures [Ibargiiegoytia et al. 1996]. The ext sectio describes the extesios of the sesor validatio model i order to discrimiate faulty ad correct sesors i a ay time basis. will be explaied ext i order to clarify the rest of the algorithm. 4.1 Validatio The validatio step was briefly itroduced i sectio 3 ad more extesively i [Ibargiiegoytia et al. 1996]. The sesors are processed oe by oe by the validatio fuctio utilizig the followig algorithm: 1. Read the actual value of the variable provided by the sesor. 2. Read the value of all variables that appear i the Markov blaket of the selected variable. 3. Propagate the probabilities ad obtai the posterior probability distributio for the selected variable. 4. If the probability (obtaied i 3) of the value acquired i step 1 is lower tha a specified value, retur failure; else retur success For example, cosider the simplified model of a gas turbie show i Fig. 4. The validatio of m is carried 4 Ay Time Sesor Validatio Ay time sesor validatio algorithm implies that the kowledge about the state of the sesors (faulty or correct) becomes more certai ad complete as time progresses. Certaity about the state of a sesor refers to the degree of belief i the correctess of a sesor, ad completeess is characterized by the umber of sesors from which the state is kow. Thus, it is required to be able to moitor the state of the sesors durig all the validatio process. This is doe through a vector whose elemets PJ ( s;) represet the probabilities of failure for the sesors s;. Give that the ay time validatio process eeds to be cyclic, the top level of the algorithm ca take the form show i Fig Iitialize P1 ( s;) for all sesors s;. 2. While there are uvalidated sesors do: (a) choose the ext sesor to validate (b) validate it (c) update the probability of failure vector P1 (d) measure the quality of the partial respose Figure 3: Top level of the ay time sesor validatio algorithm. The probabilistic validatio of a sigle sesor (step b) Figure 4: A reduced Bayesia etwork of a gas turbie. out by calculatig the probability distributio of m give the measuremets oft ad p. If the real value of sesor m has a probability greater tha certai value, the the sesor is cosidered correct, ad faulty otherwise. However, if the fault is i sesor p, the the validatio of m will also result i apparet fault. Thus, the validatio step is carried out by this algorithm that receives as iput, the sesor that will be validated. As output, the algorithm returs a biary value { correct,faulty} with the apparet status of the sesor. 4.2 Selectio of ext sesor This sectio develops a mathematical model for choosig the best sesor to validate give the history of the validatio process ad the curret state of the system. Also, the model proposed here will be used for measurig the quality of the respose i order to obtai the performace profile of the validatio algorithm. The cetral idea is that the validatio of a sesor provides
4 Ay Time Probabilistic Reasoig for Sesor Validatio 269 some iformatio ad also, extra iformatio ca be iferred. Therefore, a measure of the iformatio that a sigle validatio produces is required. A defiitio of the expected amout of iformatio that a evet produces was first proposed by Shao ad used i commuicatio theory [Shao & Weaver 1949]. Shao proposed the followig defiitios. Defiitio 4.1 Give a fiite probability distributio Pi 0 for (i = 1,..., ), ad L: p; = 1 Shao's etropy measure is defied as H=H( Pl,, P)=-2:.,p;log2Pi (1) i=l Thus, the etropy measures the related umber of bits required to store the iformatio. Sice the validatio of a sesor s has two possible outcomes, the etropy fuctio H(s) is the defied as: { 0 if p = 0 or p = 1 H(s) = -plog2(p)- (1-p)log2(1- p) otherwise (2) where p represets the probability of failure of the sesor. Notice that the expressio plog2(p) = 0 whe p = 1 but it is udefied whe p = 0. However, sice plog2(p) teds to zero as p teds to zero, the values defied i equatio 2 ca be safely assumed. Notice that it has its maximum whe p = 'i.e., whe the igorace is maximum, ad it is zero whe either p = 0 or p = 1, i.e., whe the iformatio is maximum ad igorace is miimum. This fuctio ca be cosidered either as a measure of the iformatio provided by a experimet, or as a measure of the ucertaity i the experimet's outcome. Thus, cosiderig each sigle sesor validatio as a experimet, this fuctio ca be used to measure the amout of iformatio provided by that validatio. The, the average amout of iformatio E for the system ca be defied as follows: 1 E(s1,...,s) = - 2:.,H(s;) i=l 1 = -- L PJ(s;)log2PJ(s;) i=l + (1- P1(s;))log2(1- PJ(s;)) 2 = -- L PJ(s;)log2PJ(s;) (3) i=l where is the umber of sesors i the system S, ad P1(s;) represets the curret probability of failure value assiged to sesors;. Notice that the vector whose elemets are P1 ( s;) provides a measure of the certaity i the validatio while the sum of idividual etropies provides a specificity measure of the result. Give this measure, the ay time sesor validatio algorithm eeds to select a sesor X that gives the best improvemet i the average etropy of the system S. Hece the followig coditioal versio of equatio 3 ca be writte E(S I X) = E(S I x = ok) + E(S I x = flty) = (2:.,H( s; I x = ok) + 2:.,H(s; I x = flty)) (4) This fuctio ca be evaluated for each sesor ad the oe which gives the most iformatio (the miimum E(S I X;)) ca be selected as the ext sesor X; to be validated. The computatio suggested by the above formulae could be too expesive for a real time sesor validatio process. To overcome this problem, a pre compilatio of the sesor selectio mechaism is implemeted as follows. The above formulae are used to select the sesor, Sr which gives the most iformatio. This selected sesor forms the root of a biary decisio tree. A fault is simulated i this sesor ad the formulae are agai used to select the ext sesor Sr-. The, the root Sr is assumed to be correct, ad the formulae are used to select the sesor Sr+ i this case. This results i the partial decisio tree show i Fig. 5. This process is repeated recursively o the Figure 5: Partial decisio tree. odes Sr- ad Sr+ to obtai a complete decisio tree, so that each path i the tree icludes all the sesors. As a example, cosider the etwork show i Fig. 4. This process results i the decisio tree show i Fig. 6. Notice that this tree ca be reduced cosiderig Figure 6: Biary tree idicatig the order of validatio give the respose of the validatio step. oly the valid trajectories formed by the assumptio of, for example, sigle faults amog the set of sesors. See [Ibargiiegoytia 1997] for more details.
5 270 lbargiiegoytia, Sucar, ad Vadera This decisio tree ca be used to select the ext sesor more efficietly i real time tha by performig the calculatios. Thus, the selectio step of the algorithm of Fig. 3 cosists of simply traversig the tree oe level after every sigle sesor validatio. The cycle starts at the root, ad the decisio tree poits to the ext ode i the tree accordig to the result of validatig the curret sesor. gas turbie give i Fig. 4. Thus, the cosequeces of 4.3 Isolatio The validatio step provides oly a list of potetially faulty sesors. Thus, a compariso is made betwee the set of potetially faulty sesors with the table of exteded Markov blakets of all the sesors. Whe a match is foud, a real fault is determied. However, the set of potetially faulty sesors is obtaied after all the sesors have bee validated. Therefore, i order to exted that algorithm for ay time behaviour, a differet mechaism for distiguishig real faults from apparet oes is required. This ew mechaism provides, as the output of the isolatio phase, a vector with the probability of a real fault i all the sesors. This vector is refied icremetally i time, so the ay time behaviour ca be achieved. The ay time fault isolatio process is based o the relatioship betwee real ad apparet faults. There are two situatios that arise: (i) the existece of a real fault causes a apparet fault (as show i Fig. 7(a)), ad (ii) oe apparet fault is the maifestatio of several possible real faults (as show i Fig. 7(b)). (a) (b) Figure 7: Causal relatio betwee real faults (R) ad apparet (A) faults represeted as odes. I (a), oe real fault causes several apparet oes, while i (b), oe apparet fault is caused by oe or more real faults. I both figures, the relatio betwee root odes ad leaf odes is the same as the exteded Markov blaket (EMB) of a sesor. Cosiderig all the sesors, a causal model relatig the real ad apparet faults ca therefore be obtaied from the fault detectio Bayesia etwork (i fact, the EMB table is sufficiet to build this etwork). I the first level (roots), the odes represet the evets of real failure i every sesor. The, the secod level (leaves) is formed by odes represetig apparet failures i all the sesors. Arcs are icluded betwee every root ode, ad the correspodig odes of the exteded Markov blaket. For example, the causal etwork show i Fig. 8 ca be obtaied directly from the Bayesia etwork of the Figure 8: Probabilistic causal model for fault isolatio i the example of Fig. 4. Rt_ represets a real fault m sesor i while Aj represets a apparet fault i sesor j. observig a apparet fault ca be propagated i the causal etwork i order to obtai the probabilities of a real fault i all the sesors. The etwork of Fig. 8 is multiply coected. Hece, the propagatio method of trees of cliques is utilized [Lauritze & Spiegelhalter 1988). I geeral, 0(2) coditioal probabilities would be required (for a ode with parets). However, the oisy or model ca be adopted here. Two assumptios eed to hold i order to use this model: accoutability ad exceptio idepedece [Pearl1988). The accoutability assumptio holds by the way the model is costructed, i.e., a sesor is apparetly faulty oly if there is a fault i its MB. The exceptio idepedece assumptio is cocered about a rare situatio for this particular model. The relatioship betwee the real ad apparet faults is obtaied from a Bayesia etwork i which the depedecies are assumed to be strog. Hece, the probability of a real fault ot resultig i a apparet fault is small. Further, the mechaism by which a real fault i oe sesor does ot result i a apparet fault is eve less likely to be depedet o aother real fault. Hece, give that these assumptios are reasoable, the coditioal probability matrix ca be calculated by utilizig equatio 5. where d is the set of assigmets of the set of apparet faults, ad Td represet the set of all apparet faults actually preset. Thus, the oly parameter required is defied as: Cij = 1-% = P(Aj I R; oly). I the case of the sesor validatio problem, i a ideal case, all the parameters Cij 1. Of course, these values ca be obtaied by simulatio from the data if the problem is expected to depart from this ideal case. That is, accordig to the theory developed i Ibargiiegoytia et al. (1996), whe a real fault Rt_ is (5)
6 Ay Time Probabilistic Reasoig for Sesor Validatio 271 preset, it will always cause the apparet fault Aj (assumig that there is a arc from R; to Aj). The etwork of Fig. 8 is iitialized with the followig iformatio: (i) the prior probability of all the root odes i the model is 0.5 (assumig igorace at the begiig of a cycle), ad (ii) the parameters Cij = 0.99 for all 1 :::; i, j ::;umber of odes. Havig described how real ad apparet faults ca be related, the fault isolatio model ca ow be summarized. It receives as a iput, a validated sesor with its detected state (faulty or correct) ad updates the probability of failure of all the sesors. It does this by istatiatig the value of the correspodig apparet ode ad usig a propagatio algorithm to obtai the posterior probabilities of the real faulty odes. A vector Pf of these posterior probabilities represets the curret state of kowledge about the sesors, ad ca be viewed as the output of the system at ay time. For example, assumig a fault i g i the etwork of Fig. 4, produces the sequece of values of the probability vector as show i Table (a) time (b) Figure 9: Performace profile describig the combiatio of certaity ad specificity i oe parameter agaist time. (a) without failure, (b) with a simulated failure i sesor g. Mexico. A Bayesia etwork represetig the depedecies betwee the sesors of the plat is show i Fig. 10. The depedecy model was obtaied by utilizig a automatic learig program that uses real data from the start up phase of the turbie [Sucar et al. 1997]. Table 1: Example of the values of the probability vector Pf. Step Pr(m) Pr(t) Pr(P) Pr(g) P1(a) t =faulty m = correct g =faulty a= c orrect p =correct Quality measure A measure that is idepedet of the applicatio is the average etropy of the sesors give i equatio 3. That is, if the curret quality measure is: 2 Q(s1,..., s) == -- L Pj(si)log2Pj(si) (6) i=l the, the reported quality fuctio is calculated with the formula Q = 9maxQ9curret where Qmax is the maximum value of the q ;lity measure (i.e.,, the umber of odes). Notice that this measure captures both the certaity ad specificity measures of ay time algorithms. It captures certaity sice the probabilities of the sesors are used, ad specificity sice all the sesors are combied to give a average. Figure 9 shows the performace profile obtaied with this quality measure for the example of Fig 4. 5 Empirical Results The sesor validatio algorithm was evaluated by applyig it to the validatio of temperature sesors of the gas turbie at the Gomez Palacio power plat i Figure 10: Probabilistic tree of the applicatio. Nodes represet temperature sigals of a gas turbie. The data set was partitioed i two subsets: oe partitio for traiig the etwork, ad the other partitio for testig. The traiig/testig partitio used was 70-30% of the origial data set, i.e., 610 istaces for traiig the model (calculatig the prior ad coditioal probabilities), ad 260 istaces for testig. Theoretically, the system should always detect ad isolate sigle faults correctly. However, i reality, some errors may occur sice i practice it is ulikely that the depedecy model will be perfect. Cosequetly, two types of errors could occur: a correct readig might be cosidered faulty, ad a real fault might ot be detected. These two possible errors are called type I ad type II errors i the literature, ad defied as follows [Cohe 1995]: type I: rejectio of the ull hypothesis whe it is true, type II: acceptace of the ull hypothesis whe it is actually false. The ull hypothesis used refers to the hypothesis that a sesor is workig properly. Thus, i other words,
7 272 lbargiiegoytia, Sucar, ad Vadera type I errors occur whe a correct sesor is reported as faulty while type II errors occur whe faulty sesors are ot detected. The criteria for decidig if a readig is faulty or ot ca result i a trade off betwee these two types of errors. The criteria cosidered i this project are the followig: 1. Calculate the distace of the real value from the expected value, ad map it to faulty if it is beyod a specified threshold ad to correct if it is less tha a specified threshold. The threshold values cosidered were 2, 2.5 ad 3 times the stadard deviatio rr. 2. Assume that the sesor is workig properly ad establish a cofidece level at which this hypothesis ca be rejected, i which case it ca be cosidered faulty. This cofidece level is kow as the p value. The p values cosidered were 0.05 ad The accuracy of the model, i.e., the proportio of type I ad II errors, is evaluated by varyig the possible thresholds for each of these criteria. Two differet faults were simulated: Severe. The sesor value modified is the most distat extreme value, i.e., the real value is substituted by oe which differs by miimum 50 %. Mild. The real value is replaced by oe which differs by 25 %. A test procedure was used to evaluate the accuracy of the whole validatio process. Table 2 presets the fial evaluatio of the prototype with the percetage of type I ad II errors for severe ad mild faults. Criteria Type I Type II Type I Type II Type I errors imply that most of the sesors i a EMB preset apparet type I errors. This is more commo as it ca be see i Table 2. That is, there are cases where the existece of a ivalid apparet fault, together with the valid oes, completes the EMB of a misdiagosed sesor. Hece, a type I error is produced. O the cotrary, type II errors are detected at this stage whe most of the sesors of a EMB preset misdiagosed apparet faults. This is very improbable as the results of Table 2 cofirms. The percetages are obtaied comparig the average umber of errors, with the total umber of experimets. 6 Discussio Sectio 4.2 developed a ay time sesor validatio algorithm that utilizes a etropy fuctio as a criterio for selectig the ext sesor to validate. This etropy fuctio calculates the amout of iformatio that ay sigle validatio provides for diagosig all the sesors. Hece, to evaluate this criterio, this sectio compares the performace profile of the ay time sesor validatio algorithm as a fuctio of time whe the etropy based measure is used, ad whe a radom selectio scheme is used. Figure 11 shows the resultat performace profile of the ay time sesor validatio algorithm. That is, the 0.9 o.s (J Tme -- Radom -x- Etropy x-x Figure 11: Performace profile of the ay time sesor validatio algorithm (timex 10-2 sec.). quality of the respose as a fuctio of time. A experimet cosisted i the simulatio of a sigle fault. Thus, 21 idepedet experimets were ecessary to simulate a fault i all the sesors. I total, 260 experimets were carried out, so every oe of the 21 sesors was simulated faulty at least 12 times (12.6 times). The etropy graph represets the average of the resultat quality with the etropy based scheme for the 21 sesors of Fig. 10. The radom graph represets the average of the same experimet with a radom selectio scheme. The time axis is a qualitative compariso rather tha quatitative. Alteratively, the results ca also be evaluated by comparig the time required to reach differet levels of quality. For example i Fig. 11, whe the radom criterio reaches 60 % of quality, the etropy criterio has already reached more tha 80 %. The approach has bee implemeted ad is beig tested o the validatio of temperature sesors i a gas turbie of a combied cycle power plat. The results for the accuracy of the model were reported i terms of the type I ad type II errors ad with respect to detectig severe ad mild faults. The results showed, that for this particular test applicatio, more
8 Ay Time Probabilistic Reasoig for Sesor Validatio 273 striget criteria for detectig failures reduced type I errors but did ot sigificatly icrease type II errors. The results of the evaluatio of the validatio ad isolatio phases together are show i Table 2. Agai, with a p value of 0.01, there are 2.9% of type I errors, ad 0.4 % type II errors. Notice that, i geeral, the sesor validatio algorithm performs almost perfectly with respect to udetected faulty sesors, i.e., all the faults are detected. At the same time, the rate of icorrect detectio faults is satisfactory for most of the criteria aalyzed. Two complexity aspects eed to be discussed. The first oe is the size of the pre compliled decisio tree preseted i sectio 4.2. A biary tree for sesors cotais levels ad up to 2-l odes (1,048,575 odes for 21 sesors). However, if a sigle fault is assumed, the the decisio tree results i a prued tree with levels ad at most x ( + 1) odes. The secod oe is the complexity for probability propagatio i the fault isolatio etwork as i Fig. 8. The propagatio complexity (usig the closterig algorithm [Lauritze & Spiegelhalter 1988]), depeds o the the size of the largest etry of the EM B table, i.e., the largest clique. However, if a tree is assumed for the detectio Bayesia etwork, the umber of odes i the EM B table remais small, i.e., just oe paret ad the childre of a ode. 7 Coclusios This paper has preseted a ay time, probabilistic algorithm for sesor validatio. A layered approach is cosidered where the lowest layer performs the validatio. A Bayesia etwork is used to defie the relatioships betwee variables ad to estimate the expected value of a sesor. The expected value is the compared with the actual readig obtaied. If these measures differ the a faulty sesor is suspected. A faulty sesor is the distiguished from apparetly faulty sesors by the use of a property based o the Markov blaket. A ay time versio of the validatio algorithm, that improves the quality of its aswer icremetally, has also bee preseted. This ay time algorithm uses a causal etwork to distiguish the real fault from the apparet oes. The ay time behaviour is obtaied with the selectio of the sesor that provides more iformatio whe validated. The selectio is made with the etropy fuctio. The evaluatio of the ay time behaviour of the algorithm preseted i this paper was doe by carryig out experimets to obtai the performace profile of the etropy based selectio scheme ad comparig it with a radom selectio scheme. Future research will attempt to use the probabilities obtaied i the fault detectio Bayesia etwork, as the iput to the fault isolatio Bayesia etwork. At this stage, the output of the detectio etwork cosists i a biary value ({correct, faulty}). Ackowledgmets Thaks to the aoymous referees for their commets which improved this article. This research is supported by a grat from CONACYT ad lie uder the IIE/SALFORD/CONACYT doctoral programme. Refereces Boddy, M. & Dea, T. (1994), 'Decisio theoretic deliberatio schedullig for problem solvig i timecostraied eviromets', Artificial Itelligece 67(2), Cohe, P. (1995), Empirical methods for artificial itelligece, MIT press, Cambridge, Mass., U.S.A. Dea, T. & Boddy, M. (1988), A aalysis of time depedet plaig, i 'Proc. Seveth Natl. Cof. o AI', St. Paul, MN, U.S.A. Horvitz, E. (1987), Reasoig about beliefs ad actios uder computatioal resource costraits, i 'Proc. Third Coferece o Ucertaity i Artificial Itelligece', Seatle, WA, U.S.A., pp Ibargiiegoytia, P. (1997), Ay time probabilistic sesor validatio, PhD dissertatio, Uiversity of Salford, Computer ad Mathematical Scieces, Salford U.K. Ibargiiegoytia, P., Sucar, L. & Vadera, S. (1996), A probabilistic model for sesor validatio, i 'Proc. Twelfth Coferece o Ucertaity i Artificial Itelligece', Portlad, Orego, U.S.A., pp Lauritze, S. & Spiegelhalter, D. J. (1988), 'Local computatios with probabilities o graphical structures ad their applicatio to expert systems', Joural of the Royal Statistical Society series B 50(2), Pearl, J. (1988), Probabilistic reasoig i itelliget systems: etworks of plausible iferece, Morga Kaufma, Palo Alto, Calif., U.S.A. Shao, C. & Weaver, W. (1949), The mathematical theory of commuicatio, Uiversity of Illiois press, Urbaa, Ill., U.S.A. Stakovic, J. (1988), 'Miscoceptios about real time computig: a serious problem for ext geeratio systems', Computer 21(10), Sucar, L., Perez-Brito, J., Ruiz-Suarez, J. & Morales, E. (1997), 'Learig structure from data ad its applicatio to ozoe predictio', Applied Itelligece 7, Yug, S. & Clarke, D. (1989), 'Local sesor validatio', Measuremet f3 Cotrol22 (3), Zilberstei, S. & Russell, S. (1996), 'Optimal compositio of real-time systems', Artificial Itelligece 82 (1-2) '
GUIDELINES ON REPRESENTATIVE SAMPLING
DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More information1 Review of Probability & Statistics
1 Review of Probability & Statistics a. I a group of 000 people, it has bee reported that there are: 61 smokers 670 over 5 960 people who imbibe (drik alcohol) 86 smokers who imbibe 90 imbibers over 5
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationStatistical inference: example 1. Inferential Statistics
Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either
More informationInformation-based Feature Selection
Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationMeasurement uncertainty of the sound absorption
Measuremet ucertaity of the soud absorptio coefficiet Aa Izewska Buildig Research Istitute, Filtrowa Str., 00-6 Warsaw, Polad a.izewska@itb.pl 6887 The stadard ISO/IEC 705:005 o the competece of testig
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More informationSTA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to:
STA 2023 Module 10 Comparig Two Proportios Learig Objectives Upo completig this module, you should be able to: 1. Perform large-sample ifereces (hypothesis test ad cofidece itervals) to compare two populatio
More information6 Sample Size Calculations
6 Sample Size Calculatios Oe of the major resposibilities of a cliical trial statisticia is to aid the ivestigators i determiig the sample size required to coduct a study The most commo procedure for determiig
More informationDiscrete Mathematics and Probability Theory Spring 2013 Anant Sahai Lecture 18
EECS 70 Discrete Mathematics ad Probability Theory Sprig 2013 Aat Sahai Lecture 18 Iferece Oe of the major uses of probability is to provide a systematic framework to perform iferece uder ucertaity. A
More informationSection 9.2. Tests About a Population Proportion 12/17/2014. Carrying Out a Significance Test H A N T. Parameters & Hypothesis
Sectio 9.2 Tests About a Populatio Proportio P H A N T O M S Parameters Hypothesis Assess Coditios Name the Test Test Statistic (Calculate) Obtai P value Make a decisio State coclusio Sectio 9.2 Tests
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationSequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018
CSE 353 Discrete Computatioal Structures Sprig 08 Sequeces, Mathematical Iductio, ad Recursio (Chapter 5, Epp) Note: some course slides adopted from publisher-provided material Overview May mathematical
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationAnalysis of Experimental Measurements
Aalysis of Experimetal Measuremets Thik carefully about the process of makig a measuremet. A measuremet is a compariso betwee some ukow physical quatity ad a stadard of that physical quatity. As a example,
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationPrinciple Of Superposition
ecture 5: PREIMINRY CONCEP O RUCUR NYI Priciple Of uperpositio Mathematically, the priciple of superpositio is stated as ( a ) G( a ) G( ) G a a or for a liear structural system, the respose at a give
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationClassification of problem & problem solving strategies. classification of time complexities (linear, logarithmic etc)
Classificatio of problem & problem solvig strategies classificatio of time complexities (liear, arithmic etc) Problem subdivisio Divide ad Coquer strategy. Asymptotic otatios, lower boud ad upper boud:
More informationChapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo
More informationChapter 22. Comparing Two Proportions. Copyright 2010 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010 Pearso Educatio, Ic. Comparig Two Proportios Comparisos betwee two percetages are much more commo tha questios about isolated percetages. Ad they are more
More informationChapter 8: Estimating with Confidence
Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig
More informationPolynomial identity testing and global minimum cut
CHAPTER 6 Polyomial idetity testig ad global miimum cut I this lecture we will cosider two further problems that ca be solved usig probabilistic algorithms. I the first half, we will cosider the problem
More informationProbability, Expectation Value and Uncertainty
Chapter 1 Probability, Expectatio Value ad Ucertaity We have see that the physically observable properties of a quatum system are represeted by Hermitea operators (also referred to as observables ) such
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationProvläsningsexemplar / Preview TECHNICAL REPORT INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE
TECHNICAL REPORT CISPR 16-4-3 2004 AMENDMENT 1 2006-10 INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE Amedmet 1 Specificatio for radio disturbace ad immuity measurig apparatus ad methods Part 4-3:
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationA quick activity - Central Limit Theorem and Proportions. Lecture 21: Testing Proportions. Results from the GSS. Statistics and the General Population
A quick activity - Cetral Limit Theorem ad Proportios Lecture 21: Testig Proportios Statistics 10 Coli Rudel Flip a coi 30 times this is goig to get loud! Record the umber of heads you obtaied ad calculate
More informationANALYSIS OF EXPERIMENTAL ERRORS
ANALYSIS OF EXPERIMENTAL ERRORS All physical measuremets ecoutered i the verificatio of physics theories ad cocepts are subject to ucertaities that deped o the measurig istrumets used ad the coditios uder
More informationTests of Hypotheses Based on a Single Sample (Devore Chapter Eight)
Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationLecture 2. The Lovász Local Lemma
Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio
More information15-780: Graduate Artificial Intelligence. Density estimation
5-780: Graduate Artificial Itelligece Desity estimatio Coditioal Probability Tables (CPT) But where do we get them? P(B)=.05 B P(E)=. E P(A B,E) )=.95 P(A B, E) =.85 P(A B,E) )=.5 P(A B, E) =.05 A P(J
More informationSample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D.
ample ie Estimatio i the Proportioal Haards Model for K-sample or Regressio ettigs cott. Emerso, M.D., Ph.D. ample ie Formula for a Normally Distributed tatistic uppose a statistic is kow to be ormally
More informationData Analysis and Statistical Methods Statistics 651
Data Aalysis ad Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasii/teachig.html Suhasii Subba Rao Review of testig: Example The admistrator of a ursig home wats to do a time ad motio
More informationThis is an introductory course in Analysis of Variance and Design of Experiments.
1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class
More informationIP Reference guide for integer programming formulations.
IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More information10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random
Part III. Areal Data Aalysis 0. Comparative Tests amog Spatial Regressio Models While the otio of relative likelihood values for differet models is somewhat difficult to iterpret directly (as metioed above),
More informationMA238 Assignment 4 Solutions (part a)
(i) Sigle sample tests. Questio. MA38 Assigmet 4 Solutios (part a) (a) (b) (c) H 0 : = 50 sq. ft H A : < 50 sq. ft H 0 : = 3 mpg H A : > 3 mpg H 0 : = 5 mm H A : 5mm Questio. (i) What are the ull ad alterative
More informationBecause it tests for differences between multiple pairs of means in one test, it is called an omnibus test.
Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal
More informationRecurrence Relations
Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The
More information6.883: Online Methods in Machine Learning Alexander Rakhlin
6.883: Olie Methods i Machie Learig Alexader Rakhli LECTURES 5 AND 6. THE EXPERTS SETTING. EXPONENTIAL WEIGHTS All the algorithms preseted so far halluciate the future values as radom draws ad the perform
More informationExercises Advanced Data Mining: Solutions
Exercises Advaced Data Miig: Solutios Exercise 1 Cosider the followig directed idepedece graph. 5 8 9 a) Give the factorizatio of P (X 1, X 2,..., X 9 ) correspodig to this idepedece graph. P (X) = 9 P
More informationInvestigating the Significance of a Correlation Coefficient using Jackknife Estimates
Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------
More informationThere is no straightforward approach for choosing the warmup period l.
B. Maddah INDE 504 Discrete-Evet Simulatio Output Aalysis () Statistical Aalysis for Steady-State Parameters I a otermiatig simulatio, the iterest is i estimatig the log ru steady state measures of performace.
More informationCHAPTER 10 INFINITE SEQUENCES AND SERIES
CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece
More informationWHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? ABSTRACT
WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? Harold G. Loomis Hoolulu, HI ABSTRACT Most coastal locatios have few if ay records of tsuami wave heights obtaied over various time periods. Still
More informationt distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference
EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The
More informationIntro to Learning Theory
Lecture 1, October 18, 2016 Itro to Learig Theory Ruth Urer 1 Machie Learig ad Learig Theory Comig soo 2 Formal Framework 21 Basic otios I our formal model for machie learig, the istaces to be classified
More informationAnalysis of Experimental Data
Aalysis of Experimetal Data 6544597.0479 ± 0.000005 g Quatitative Ucertaity Accuracy vs. Precisio Whe we make a measuremet i the laboratory, we eed to kow how good it is. We wat our measuremets to be both
More informationLecture 12: Hypothesis Testing
9.07 Itroductio to Statistics for Brai ad Cogitive Scieces Emery N. Brow Lecture : Hypothesis Testig I. Objectives. Uderstad the hypothesis testig paradigm.. Uderstad how hypothesis testig procedures are
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe
More informationThe target reliability and design working life
Safety ad Security Egieerig IV 161 The target reliability ad desig workig life M. Holický Kloker Istitute, CTU i Prague, Czech Republic Abstract Desig workig life ad target reliability levels recommeded
More informationCONTROL CHARTS FOR THE LOGNORMAL DISTRIBUTION
CONTROL CHARTS FOR THE LOGNORMAL DISTRIBUTION Petros Maravelakis, Joh Paaretos ad Stelios Psarakis Departmet of Statistics Athes Uiversity of Ecoomics ad Busiess 76 Patisio St., 4 34, Athes, GREECE. Itroductio
More informationTime-Domain Representations of LTI Systems
2.1 Itroductio Objectives: 1. Impulse resposes of LTI systems 2. Liear costat-coefficiets differetial or differece equatios of LTI systems 3. Bloc diagram represetatios of LTI systems 4. State-variable
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More informationOPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES
OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES Peter M. Maurer Why Hashig is θ(). As i biary search, hashig assumes that keys are stored i a array which is idexed by a iteger. However, hashig attempts to bypass
More informationAs stated by Laplace, Probability is common sense reduced to calculation.
Note: Hadouts DO NOT replace the book. I most cases, they oly provide a guidelie o topics ad a ituitive feel. The math details will be covered i class, so it is importat to atted class ad also you MUST
More informationRademacher Complexity
EECS 598: Statistical Learig Theory, Witer 204 Topic 0 Rademacher Complexity Lecturer: Clayto Scott Scribe: Ya Deg, Kevi Moo Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved for
More informationOverview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions
Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More informationNUMERICAL METHODS FOR SOLVING EQUATIONS
Mathematics Revisio Guides Numerical Methods for Solvig Equatios Page 1 of 11 M.K. HOME TUITION Mathematics Revisio Guides Level: GCSE Higher Tier NUMERICAL METHODS FOR SOLVING EQUATIONS Versio:. Date:
More informationR. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State
Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com
More information10-701/ Machine Learning Mid-term Exam Solution
0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it
More informationx a x a Lecture 2 Series (See Chapter 1 in Boas)
Lecture Series (See Chapter i Boas) A basic ad very powerful (if pedestria, recall we are lazy AD smart) way to solve ay differetial (or itegral) equatio is via a series expasio of the correspodig solutio
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationTEACHER CERTIFICATION STUDY GUIDE
COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra
More informationTHE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS
R775 Philips Res. Repts 26,414-423, 1971' THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS by H. W. HANNEMAN Abstract Usig the law of propagatio of errors, approximated
More informationA proposed discrete distribution for the statistical modeling of
It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical
More informationChapter 6 Part 5. Confidence Intervals t distribution chi square distribution. October 23, 2008
Chapter 6 Part 5 Cofidece Itervals t distributio chi square distributio October 23, 2008 The will be o help sessio o Moday, October 27. Goal: To clearly uderstad the lik betwee probability ad cofidece
More informationOn an Application of Bayesian Estimation
O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, Higashi-Osaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationPH 425 Quantum Measurement and Spin Winter SPINS Lab 1
PH 425 Quatum Measuremet ad Spi Witer 23 SPIS Lab Measure the spi projectio S z alog the z-axis This is the experimet that is ready to go whe you start the program, as show below Each atom is measured
More informationEstimation of a population proportion March 23,
1 Social Studies 201 Notes for March 23, 2005 Estimatio of a populatio proportio Sectio 8.5, p. 521. For the most part, we have dealt with meas ad stadard deviatios this semester. This sectio of the otes
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationModeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy
Sri Laka Joural of Applied Statistics, Vol (5-3) Modelig ad Estimatio of a Bivariate Pareto Distributio usig the Priciple of Maximum Etropy Jagathath Krisha K.M. * Ecoomics Research Divisio, CSIR-Cetral
More informationNumber of fatalities X Sunday 4 Monday 6 Tuesday 2 Wednesday 0 Thursday 3 Friday 5 Saturday 8 Total 28. Day
LECTURE # 8 Mea Deviatio, Stadard Deviatio ad Variace & Coefficiet of variatio Mea Deviatio Stadard Deviatio ad Variace Coefficiet of variatio First, we will discuss it for the case of raw data, ad the
More informationComputing Confidence Intervals for Sample Data
Computig Cofidece Itervals for Sample Data Topics Use of Statistics Sources of errors Accuracy, precisio, resolutio A mathematical model of errors Cofidece itervals For meas For variaces For proportios
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More informationSample Size Determination (Two or More Samples)
Sample Sie Determiatio (Two or More Samples) STATGRAPHICS Rev. 963 Summary... Data Iput... Aalysis Summary... 5 Power Curve... 5 Calculatios... 6 Summary This procedure determies a suitable sample sie
More informationSoo King Lim Figure 1: Figure 2: Figure 3: Figure 4: Figure 5: Figure 6: Figure 7:
0 Multivariate Cotrol Chart 3 Multivariate Normal Distributio 5 Estimatio of the Mea ad Covariace Matrix 6 Hotellig s Cotrol Chart 6 Hotellig s Square 8 Average Value of k Subgroups 0 Example 3 3 Value
More informationc. Explain the basic Newsvendor model. Why is it useful for SC models? e. What additional research do you believe will be helpful in this area?
1. Research Methodology a. What is meat by the supply chai (SC) coordiatio problem ad does it apply to all types of SC s? Does the Bullwhip effect relate to all types of SC s? Also does it relate to SC
More informationCommutativity in Permutation Groups
Commutativity i Permutatio Groups Richard Wito, PhD Abstract I the group Sym(S) of permutatios o a oempty set S, fixed poits ad trasiet poits are defied Prelimiary results o fixed ad trasiet poits are
More informationResearch on Dependable level in Network Computing System Yongxia Li 1, a, Guangxia Xu 2,b and Shuangyan Liu 3,c
Applied Mechaics ad Materials Olie: 04-0-06 ISSN: 66-748, Vols. 53-57, pp 05-08 doi:0.408/www.scietific.et/amm.53-57.05 04 Tras Tech Publicatios, Switzerlad Research o Depedable level i Network Computig
More informationThe Random Walk For Dummies
The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli
More information