Process Monitoring of Exponentially Distributed Characteristics. Through an Optimal Normalizing Transformation

Size: px
Start display at page:

Download "Process Monitoring of Exponentially Distributed Characteristics. Through an Optimal Normalizing Transformation"

Transcription

1 Process Montorng of Exponentally Dstrbuted Characterstcs Through an Optmal Normalzng Transformaton Zhenln Yang Department of Statstcs and Appled Probablty Natonal Unversty of Sngapore, Kent Rdge, Sngapore 96 Mn Xe Department of Industral and Systems Engneerng Natonal Unversty of Sngapore, Kent Rdge, Sngapore 96 Abstract: Many process characterstcs follow exponental dstrbuton and control charts based on such a dstrbuton have attracted a lot of attenton. Tradtonal control lmts may be not approprate because of the lack of symmetry. In ths paper, process montorng through a normalzng power transformaton s studed. The tradtonal ndvdual measurements control charts can be used based on the transformed data. The propertes of ths control chart are nvestgated. Comparson wth the chart usng probablty lmts s also carred out for the cases of known and estmated parameter. Wthout losng much accuracy even compared wth the exact probablty lmts, the power transformaton approach can easly be used to produce charts that can be nterpreted when the normalty assumpton s vald.

2 . Introducton A basc assumpton n usng the tradtonal Shewhart-type control charts s that the qualty characterstc nvolved follows a normal dstrbuton. The Shewhart charts may stll be applcable to non-normal stuatons when the sample sze s large as guaranteed by the Central Lmt Theorem. However, n modern manufacturng envronment, tems are often checked one by one and control charts for ndvdual measurements are desrable, see e.g., Shel (995), Gong et al. (997) and Xe et al. (998). The normalty assumpton for ndvdual value s usually questonable and the normalty should be tested before the mplementaton of tradtonal technque. In case the normalty s rejected, t can be convenent to frst transform a non-normal varable to near normal and then apply the tradtonal control charts on the transformed values. In ths paper, process montorng for exponentally dstrbuted qualty characterstc s dscussed and propertes for such a chart based on transformaton are studed. One usefulness of a control chart for the exponental measurement s that t can be used as a control chart for parts-per-mllon nonconformng tems (Nelson, 994 and Radaell, 998). The dea s that f the number of nonconformng tems s assumed to be a Posson random varable then the 'tme' untl a defectve tem has an exponental dstrbuton. Usually ths 'tme' can be real tme, length or volume, etc. If the producton process has a constant speed, then obvously the count and the tme untl a defectve tem are equvalent quanttes (Nelson, 994) that can both be modeled by an exponental dstrbuton. Nelson (994) proposed a normalzng transformaton whch may be not an optmal () one and the propertes of the chart based on ths transformaton have not been nvestgated. A control chart based on an optmal normalzng transformaton s proposed () It should be noted that the optmalty depends on the adopted optmalty crteron.

3 3 n ths paper. The property of ths chart s nvestgated. At the same tme t s compared wth the chart for exponental dstrbuton wth probablty lmts. Both the case of known parameter and estmated one are dscussed. The nvestgaton or comparson for parameter unknown case are done va an extensve Monte Carlo smulaton. Ths paper s organzed as follows. Secton dscusses the best transformaton wthn the power famly. Secton 3 nvestgates the propertes of the control charts when the model parameter s known, whereas Secton 4 consders the case of unknown parameter where extensve Monte Carlo smulaton results are presented. Two llustratve examples are also presented n Secton 5.. The Best Normalzng Power Transformaton.. Background In studyng the large sample behavor of transformatons to normalty, Hernandez and Johnson (98) consdered an nformaton number approach to transform a known dstrbuton to near normalty, to serve as benchmarks for the maxmum amount of mprovement achevable through Box-Cox transformaton (Box and Cox, 964). The Box-Cox transformaton technque ams to transform the nonnegatve data to near normal through a smple power transformaton so that the normal theory procedures can be appled to the transformed data. It s seen to have many applcatons n relablty, qualty control and lfetme data analyss. See for example, Hnkle and Emptage (99), Fearn and Nebenzahl (995) and Yang (999). Let the probablty densty functon (pdf) of a contnuous nonnegatve random varable X be g ( x; ) where s the mean. Denote by Y = X the power transformed observaton and f ( y;, ) ts pdf. Let ( y ;, ) be a normal pdf wth mean and standard devaton (SD). The basc dea of fndng the `best` normalzng transformaton

4 4 s to fnd, and such that f ( y;, ) and ( y;, ) are closest n a certan sense. Hernandez and Jonhson (98) suggested the so-called Kullback-Lebler (KL) nformaton number as a measure of closeness: f ( y;, ) I ( f, ) = f ( y;, )log dy. (.) ( y;, ) Thus, the optmal transformaton value s found by mnmzng (.). That s, mnmze I [ f ( ;, ), ( ;, )] over (,, ). (.) Ths can be done by usng the general result of Hernandez and Johnson (98). For an exponental dstrbuton, a drect algebrac manpulaton can be easer... Dervaton of the best power transformaton for exponental varables If X s an exponental random varable, then ts pdf has the form g ( x; ) = exp( x ), >. The pdf of Y = X s thus f ( y;, ) = ( ) y exp( y ) by change of varable technque. Indeed, t can be notced that f ( y;, ) s a Webull pdf of the form y exp[ ( y ) ] wth = and =. If ( y ;, ) s a normal pdf wth mean and SD, then the Kullback-Lebler nformaton between f ( y;, ) and ( y;, ) becomes I ( f, ) = y exp y log dy y exp exp( y ( y ) ) = log + dy y y log exp y exp y y ( y ) y dy

5 5 By ntroducng x y, the frst ntegral becomes y log y exp y dy = log x exp xdx = (log ), where =.5776, the Euler-Gamma constant and the second ntegral becomes y y ( y ) exp y dy exp = x x x xdx = ( ) + ( ). Fnally, we have I ( f, ) = log + ()(log) + ( ) ( ) +. Now, settng the partal dervatves of I ( f, ) wth respect to and to zero and solvng the equatons, t can be shown that I ( f, ) s partally mnmzed at () = ( ) and ( ) = [ ( ) ( )]. Substtutng () and ( ) back nto I ( f, ) gves the partally mnmzed Kullback- Lebler nformaton number I() = log( ) + () log + log[ ( ) ( ) ]. Fnally, mnmzng I() gves the best transformaton. Ths can be done by any of numercal maxmzaton procedure. The resulted optmal parameter values are: =.654, =.934 and =.675

6 6 and the mnmzed dstance s I f ( ;, ), ( ;, )] =.78. [ Notce that I() s ndependent of the parameter, whch makes the transformaton very attractve to the practtoners. It s nterestng to pont out that the orgnal exponental pdf ( = ), havng a KL number of.489, s very 'far' from a normal pdf. Comparson of the mnmzed KL nformaton numbers shows therefore a great mprovement to normalty by such a smple power transformaton. It can be further noted that usng the power transformaton proposed n Nelson (994), by matchng the frst few moments, =.777, we have a KL number of.93, that s approxmately 5% larger than that from the transformaton =.654, showng that =.777 s not optmal n terms of KL mnmzng crteron. Hence, although the two transformatons perform smlarly, the former s recommended as t has a sound theoretcal bass. Table. presents some tal probabltes of the optmally transformed Y wth the related normal varable. It has seen that the tal probabltes of Y are very close to those of the correspondng normal random varable. Table.. Tal Probabltes for the Transformed Exponental Random Varable K P( Y k ) P( Y k ) Normal Tal Prob

7 7 3. Control Chart when s Known In ths secton the operatng characterstc (OC) functon of the chart for Y s nvestgated for the case when the n-control exponental mean,, s known and compared wth the chart for X based on the exact probablty lmts. It should be ponted out that for asymmetrcally dstrbuted characterstcs the exact probablty lmts should be usually preferable to the tradtonal 3-sgma lmts. Indeed, t can be noted that for the exponental dstrbutons, 3-sgma lmts would lead to a negatve LCL. The two-sded control chart for the orgnal X, wth allowed false alarm probablty or Type I rsk s of the form: LCL = log( ), CL =.693, (3.) UCL = log( ). In accordance wth the usual approach, the two-sded control chart for Y can be defned as follows: LCL = k, CL =, (3.) UCL = + k, where =.934, =.675 and k s the number of SDs allowed n the control lmts. The ablty to detect shfts n process qualty s an mportant factor to be consdered n desgnng a control chart. Such ablty s often measured by the OC functon of the control chart, whch s defned as the probablty of not detectng a shft under an out-ofcontrol stuaton. Ths probablty represents the type II rsk. As we are nterested n

8 8 detectng a shft n exponental mean, the -rsk for an r SDs shft n the mean of X s gven (under the X chart) by X (r) = P log( ) X log( ) r (3.3) = ( ) (r ) /(r ) ( ). For the Y chart, the OC functon s: (r) = P k Y k r Y = exp r k k exp r, (3.4) where k > s so that PY k + PY k =. Notce that one SD shft n X scale causes less than one SD shft n Y scale. The X chart centers at the medan poston whle the Y chart centers at the mean poston. Ths s not unexpected snce the dstrbuton of Y s almost symmetrc, wth mean and medan almost the same, whch are.934 and (.693 ) =.973, respectvely. Fgure 3. shows the OC functon of X and Y charts, for two typcal values of k,.e., k = (equvalently =.455) and k = 3 ( =.7). b rsk, k= b rsk, k= Fgure 3.. OC Curves for X chart (sold lne) and Y chart (dashed lne).

9 9 As expected, for k = two charts perform very smlarly, whereas for k = 3 the exact probablty lmts wll perform slghtly better than the transformed Y chart. However, the chart based on the transformaton s able to provde a smlar level of senstvty, especally for the case of small to medum shft. Lastly, t can be remarked that, as s known, comparson between the Average Run Lengths (ARLs) of X and Y charts s readly dervable from the OC curves. 4. Control Chart when s Unknown When s unknown, t can be commonly estmated on earler process data. In ths case, the propertes of the two charts are not obvous. In ths secton, the two approaches are compared for the case that s unknown and supposed to be estmated from n past observatons X, X,, X n. 4.. Dervaton of the control lmts For the X chart, the sample mean X can be used to estmate, whch gves the X chart wth estmated control lmts: LCL X X log( ), CL X. 693X, (4.) UCL X X log( ). For the Y chart, one can work drectly wth the transformed data and construct a control chart n the usual way as f the transformed data are exactly normal. A typcal control chart would be the one whch uses the mean of past data as an estmator or and the mean of the movng ranges as an estmator of (Nelson, 994):

10 LCL Y Y k MR d, CL Y Y, (4.) UCL Y Y k MR d. where MR s the mean of the movng ranges of two observatons and d =.8. There are other ways to estmate the control lmts of the Y chart. However, we wll focus our study on (4.) as t s more common for ndvdual chart that s the case here. 4.. Comparson of the alarm rate Snce the control lmts are estmated n ths case, t s dffcult to evaluate the -rsk, the -rsk and the ARL. Monte Carlo smulaton s helpful and convenent for the nvestgatons. There are three ssues that have to be addressed for the Y chart wth estmated control lmts: ) the effect of nonnormalty as the transformed data are stll not exactly normal, ) the effect of estmated control lmts, and ) the relatve performance compared wth the X chart. As the comparson of the Y chart wth X chart s the am of ths paper, we wll concentrate on the last ssue. The smulaton process can be smply descrbed as follows. Let B be the event that the next th observaton falls ether below LCL or above UCL. Then P( B ) represents the probablty that the next th observaton sgnals a process out of control. When process s n control, P( B ) s the -rsk whle when the process s shfted, then P( B ) s the -rsk. Notce that n contrast to the known control lmt case, the B 's are not ndependent anymore. Hence the ARL does not equal to / or /(). We frst smulate P( B ) and then ARL for certan values of n and r.

11 To smulate P( B ) for the X chart, n values from Exp() are generated to calculate LCL X and UCL X. Then a value from Exp(+ r) s generated and s counted by one f ths value s ether below LCL X or above UCL X. Repeat ths process many tmes. The proporton of tmes that the extra value falls ether below Monte Carlo estmate of P( B ). LCL X or above UCL X gves a To smulate P( B ) for the Y chart, generate n values from Exp(), rase these values to a power of, and then calculate LCL Y and UCL Y. Generate another value from Exp(+ r), and rase t to a power of, and then check to see f ths value falls below LCL Y or above UCL Y. Repeat ths process many tmes. The proporton of tmes that the extra value falls outsde of the control lmts gves a Monte Carlo estmate of P( B ) for the Y chart. All the smulaton results n ths paper were based on, runs, that ensured a good accuracy of the smulated probabltes. For example, the estmated standard error of the estmated probablty. s only.4. Some results are presented n Table 4.. It can be seen that the alarm rate s smlar for both methods. Table 4.. Smulated probabltes of acceptance at r sgma shft Upper entry s for the X chart; lower entry s for the Y chart. r= k = =.455) n = k = 3 ( =.7) n =

12 4.3. Comparson of the ARL Unlke the case of a known, the ARL cannot be easly calculated as the events are no longer ndependent. Monte Carlo smulaton s used here. To obtan the ARL, n values wth zero shft from the target value are generated to calculate the estmated control lmts. Then a number of values are generated wth an r sgma shft from the target value, untl an out of control sgnal s gven. Ths number serves as one observaton drawn from the run length dstrbuton. Repeat ths process many tmes. The mean of all the observatons drawn from the run length dstrbuton serves as an estmate of the ARL. B 's Snce the orgnal measurements are exponental and the transformed measurements are Webull where both cases gve closed form cdfs, t s possble to gve an equvalent but smpler algorthm for smulatng ARL. Instead of generatng addtonal measurements at the shfted mean untl one out of control sgnal, we can smply generate a geometrc observaton wth the probablty of success (out of control) beng the condtonal probablty that a new observaton s out of the estmated control lmts. For the X chart, t s p = P( X LCL X) P( X UCL X) LCLX UCLX = exp exp, ( r) ( r) and for the Y chart, t s gven by X X p = P( Y LCL Y) P( Y UCL Y) ( LCLY ) ( UCLY ) = exp exp ( r) ( r) Y where X and Y denote the orgnal and transformed vectors of past observatons. Notce that to calculate p for the Y chart, t s necessary that Y LCL Y be nonnegatve. Ths s not always true for the Y chart usng MR. We thus use the Y chart wth ˆ X for

13 3 smulaton and comparson. The smulated ARLs are summarzed n Table 4.. Agan, each smulated ARL s based on, runs. In ths case, t can be found that all the estmated standard errors are around.4% of the correspondng smulated ARLs, showng that the smulated ARLs are very accurate. Table 4.. Smulated ARLs: Upper entry s for X chart; lower entry s for Y chart. r= k = ( =.455) n = k = 3 ( =.7) n = From Table 4. we see that, for k = ( =.455) and when the process s n control (r = ), the ARLs for both charts are all very close to the nomnal value / = /.455 =.98, though the values for the Y chart are slghtly larger. When there s a shft n the process mean, the ARLs for the X chart and Y chart are agan very close, showng that the two charts are essentally equvalent n detectng a process shft. Also from Table 4., for the charts wth =.7 or k = 3, the Y chart has much larger ARLs than the X chart when process s n control, whch s not bad. For relatvely small shfts the Y chart leads to a larger out-of-control ARL than the X chart (e.g., for n = and r = 3, Y-ARL was approxmately 5% larger than the X-ARL). However, when there s a large enough shft n process mean, the ARLs for the two charts are very close, meanng that the power transformaton-based chart wll be able to detect process shft at a comparable fast speed to the orgnal X chart (e.g., for n = and r = 6, Y-ARL was approxmately only 3% larger than the X-ARL).

14 4 5. Two Implementaton Examples In ths secton, two examples are used to llustrate the control charts dscussed above. The frst example uses a smulated data set for llustratng the known case and the second uses a real data set of Baker (996) for llustratng the unknown case. Example 5.. The smulated data. The frst 3 values are generated from an exponental populaton wth = and used n dervng control lmts, assumng =.7 (.e., k = 3). The next values are generated from an exponental populaton wth = 3 and the last wth = 5. The smulated data are lsted below and the control charts are gven n Fgures 5. where the observatons are plotted on the chart n the same order as they are lsted n the table. Table 5.. A set of smulated data. = = = From the orgnal X chart, we see that the plotted ponts cluster between LCL and CL whch are very close to each other. Ths makes the data vsualzaton dffcult. From the control chart for the transformed data, we see that the plotted ponts scatter evenly around the center lne. The two charts perform smlarly as far as the ablty of dentfyng a process shft s concerned, but the latter s easer to nterpret. In fact, suppose that run rules and other tests (Nelson, 984 and Wang et al., 998) are to be mplemented, t s much clearer f the transformed plot s used.

15 5 3 X Chart Indvdual Value UCL= CL=6.93 LCL= Observaton Number 5 4 Y Chart Indvdual Value 3 UCL=3.43 CL=.6645 LCL= Observaton Number Fgure 5.. Control charts for the smulated data Example 5.. The nterfalure tme data. The data set gven n Table 5. represents the nterfalure tmes for 9 successve falures of a photocoper system. It was orgnally gven n Baker (996) n the form of age (n days) at the falures. Table 5.. A set of nterfalure tme data

16 6 The lkelhood rato test (Lawless, 98, p44) s performed on the orgnal as well as the transformed data and the results are consstent wth the hypotheszed dstrbutonal assumptons. The sample mean of the orgnal data s X =.337. Wth =.7 and k = 3, the control charts specfed by (4.) and (4.) can be easly constructed, see Fgure 5.. It can be seen that the plotted ponts n Y chart scatter evenly on both sdes of the centre lne and agan further nterpretatons are straghtforward. 9 Indvdual Value X Chart UCL=8.586 CL=8.558 LCL= Observaton Number 4 3 Y Chart UCL=3.557 Indvdual Value CL=.6767 LCL= Observaton Number Fgure 5.. Control charts for the nterfalure tme data

17 7 6. Conclusons The Box-Cox transformaton can be used to transform a non-normal dstrbuton to normal. In ths paper, we have studed the use of ths transformaton for exponentally dstrbuted qualty characterstc by mnmzng the Kullback-Lebler nformaton number. The study ndcates that t s easy to use and possesses a number of nterestng statstcal propertes, especally t s of great advantage that the transformaton to normalty does not depend on the specfc parameter value of the exponental dstrbuton. Smlar transformatons have been proposed n Nelson (994) and Kttltz, Jr. (999), but they may not be optmal and no nvestgaton has been gven for the propertes of the resulted control charts. Compared wth the tradtonal probablty lmts, the data transformaton approach leads to a chart that s only a lttle less accurate than the exact one. The transformed data should be used when a control chart s to be nterpreted n a tradtonal sense and especally when run rules are to be used. Ths s especally the case when the model parameter s unknown. However, t should be ponted out that data transformaton approach should be avoded when plottng actual observaton for data recordng s an mportant ssue for specfc mplementaton. Acknowledgement: The authors are grateful to the edtor and to the referee for the detaled comments that lead to a sgnfcant mprovement n the presentaton of the paper. Part of ths research s funded by a research grant from the Natonal Unversty of Sngapore for the project Some practcal aspects of SPC for automated manufacturng process (RP39865).

18 8 References Baker, R. D. (996) Some new tests of the power law process. Technometrcs, 38, Box, G. E. P. and Cox, D. R. (964) An analyss of transformaton (wth dscusson). Journal of the Royal Statstcal Socety B, 6, -5. Fearn, D.H. and Nebenzahl, E. (995) Usng power-transformatons when approxmatng quantles. Communcatons n Statstcs - Theory and Methods, 4, Gong, L.G., Jwo, W.S. and Tang, K. (997) Usng on-lne sensors n statstcal process control. Management Scence, 43, 7-8. Kttltz, Jr., R.G., (999) Transformng the exponental for SPC applcatons. Journal of Qualty Technology, 3, Hernandez, F. and Johnson, R.A. (98) The large-sample behavor of transformatons to normalty. Journal of the Amercan Statstcal Assocaton, 75, Hnkle, A.J. and Emptage, M.R. (99) Analyss of fatgue lfe data usng Box-Cox transformaton. Fatgue and Fracture of Engneerng Materals and Structures, 4, Lawless, J. F. (98) Statstcal Models and Methods for Lfetme Data. John Wley & Sons. New York. Nelson, L.S. (984) The Shewhart control chart - tests for specal causes. Journal of Qualty Technology, 6, Nelson, L.S. (994) A control chart for parts-per-mllon nonconformng tems. Journal of Qualty Technology, 6, Radaell, G. (998) Plannng tme-between-events Shewhart control charts. Total Qualty Management, 9, Shel, J. (995) An economc-approach towards usng ndvdual measurements to control the mean of contnuously montored processes. Internatonal Journal of Producton Research, 33,

19 9 Wang, J.M., Kochhar, A.K. and Hannam, R.G. (998) Pattern recognton for statstcal process control charts. Internatonal Journal of Advanced Manufacturng Technology, 4, Xe, M., Goh, T.N. and Lu, X.S. (998). Computer-aded statstcal montorng of automated manufacturng processes. Computers and Industral Engneerng, 35, Yang, Z. (999) Predctng a future lfetme through Box-Cox transformaton. Lfetme Data Analyss, 5,

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for P Charts. Dr. Wayne A. Taylor Taylor Enterprses, Inc. Control Lmts for P Charts Copyrght 2017 by Taylor Enterprses, Inc., All Rghts Reserved. Control Lmts for P Charts Dr. Wayne A. Taylor Abstract: P charts are used for count data

More information

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for U Charts. Dr. Wayne A. Taylor

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for U Charts. Dr. Wayne A. Taylor Taylor Enterprses, Inc. Adjusted Control Lmts for U Charts Copyrght 207 by Taylor Enterprses, Inc., All Rghts Reserved. Adjusted Control Lmts for U Charts Dr. Wayne A. Taylor Abstract: U charts are used

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

International Journal of Engineering Research and Modern Education (IJERME) Impact Factor: 7.018, ISSN (Online): (

International Journal of Engineering Research and Modern Education (IJERME) Impact Factor: 7.018, ISSN (Online): ( CONSTRUCTION AND SELECTION OF CHAIN SAMPLING PLAN WITH ZERO INFLATED POISSON DISTRIBUTION A. Palansamy* & M. Latha** * Research Scholar, Department of Statstcs, Government Arts College, Udumalpet, Tamlnadu

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

/ n ) are compared. The logic is: if the two

/ n ) are compared. The logic is: if the two STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

Joint Statistical Meetings - Biopharmaceutical Section

Joint Statistical Meetings - Biopharmaceutical Section Iteratve Ch-Square Test for Equvalence of Multple Treatment Groups Te-Hua Ng*, U.S. Food and Drug Admnstraton 1401 Rockvlle Pke, #200S, HFM-217, Rockvlle, MD 20852-1448 Key Words: Equvalence Testng; Actve

More information

Computing MLE Bias Empirically

Computing MLE Bias Empirically Computng MLE Bas Emprcally Kar Wa Lm Australan atonal Unversty January 3, 27 Abstract Ths note studes the bas arses from the MLE estmate of the rate parameter and the mean parameter of an exponental dstrbuton.

More information

Lecture 3 Stat102, Spring 2007

Lecture 3 Stat102, Spring 2007 Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture

More information

RELIABILITY ASSESSMENT

RELIABILITY ASSESSMENT CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

Chapter 5 Multilevel Models

Chapter 5 Multilevel Models Chapter 5 Multlevel Models 5.1 Cross-sectonal multlevel models 5.1.1 Two-level models 5.1.2 Multple level models 5.1.3 Multple level modelng n other felds 5.2 Longtudnal multlevel models 5.2.1 Two-level

More information

Credit Card Pricing and Impact of Adverse Selection

Credit Card Pricing and Impact of Adverse Selection Credt Card Prcng and Impact of Adverse Selecton Bo Huang and Lyn C. Thomas Unversty of Southampton Contents Background Aucton model of credt card solctaton - Errors n probablty of beng Good - Errors n

More information

Double Acceptance Sampling Plan for Time Truncated Life Tests Based on Transmuted Generalized Inverse Weibull Distribution

Double Acceptance Sampling Plan for Time Truncated Life Tests Based on Transmuted Generalized Inverse Weibull Distribution J. Stat. Appl. Pro. 6, No. 1, 1-6 2017 1 Journal of Statstcs Applcatons & Probablty An Internatonal Journal http://dx.do.org/10.18576/jsap/060101 Double Acceptance Samplng Plan for Tme Truncated Lfe Tests

More information

System in Weibull Distribution

System in Weibull Distribution Internatonal Matheatcal Foru 4 9 no. 9 94-95 Relablty Equvalence Factors of a Seres-Parallel Syste n Webull Dstrbuton M. A. El-Dacese Matheatcs Departent Faculty of Scence Tanta Unversty Tanta Egypt eldacese@yahoo.co

More information

on the improved Partial Least Squares regression

on the improved Partial Least Squares regression Internatonal Conference on Manufacturng Scence and Engneerng (ICMSE 05) Identfcaton of the multvarable outlers usng T eclpse chart based on the mproved Partal Least Squares regresson Lu Yunlan,a X Yanhu,b

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

Goodness of fit and Wilks theorem

Goodness of fit and Wilks theorem DRAFT 0.0 Glen Cowan 3 June, 2013 Goodness of ft and Wlks theorem Suppose we model data y wth a lkelhood L(µ) that depends on a set of N parameters µ = (µ 1,...,µ N ). Defne the statstc t µ ln L(µ) L(ˆµ),

More information

Statistical analysis using matlab. HY 439 Presented by: George Fortetsanakis

Statistical analysis using matlab. HY 439 Presented by: George Fortetsanakis Statstcal analyss usng matlab HY 439 Presented by: George Fortetsanaks Roadmap Probablty dstrbutons Statstcal estmaton Fttng data to probablty dstrbutons Contnuous dstrbutons Contnuous random varable X

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

FREQUENCY DISTRIBUTIONS Page 1 of The idea of a frequency distribution for sets of observations will be introduced,

FREQUENCY DISTRIBUTIONS Page 1 of The idea of a frequency distribution for sets of observations will be introduced, FREQUENCY DISTRIBUTIONS Page 1 of 6 I. Introducton 1. The dea of a frequency dstrbuton for sets of observatons wll be ntroduced, together wth some of the mechancs for constructng dstrbutons of data. Then

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

4.3 Poisson Regression

4.3 Poisson Regression of teratvely reweghted least squares regressons (the IRLS algorthm). We do wthout gvng further detals, but nstead focus on the practcal applcaton. > glm(survval~log(weght)+age, famly="bnomal", data=baby)

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

Here is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)

Here is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y) Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,

More information

Rockefeller College University at Albany

Rockefeller College University at Albany Rockefeller College Unverst at Alban PAD 705 Handout: Maxmum Lkelhood Estmaton Orgnal b Davd A. Wse John F. Kenned School of Government, Harvard Unverst Modfcatons b R. Karl Rethemeer Up to ths pont n

More information

Limited Dependent Variables

Limited Dependent Variables Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages

More information

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth

More information

Gaussian Mixture Models

Gaussian Mixture Models Lab Gaussan Mxture Models Lab Objectve: Understand the formulaton of Gaussan Mxture Models (GMMs) and how to estmate GMM parameters. You ve already seen GMMs as the observaton dstrbuton n certan contnuous

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

Explaining the Stein Paradox

Explaining the Stein Paradox Explanng the Sten Paradox Kwong Hu Yung 1999/06/10 Abstract Ths report offers several ratonale for the Sten paradox. Sectons 1 and defnes the multvarate normal mean estmaton problem and ntroduces Sten

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

A nonparametric two-sample wald test of equality of variances

A nonparametric two-sample wald test of equality of variances Unversty of Wollongong Research Onlne Centre for Statstcal & Survey Methodology Workng Paper Seres Faculty of Engneerng and Informaton Scences 0 A nonparametrc two-sample wald test of equalty of varances

More information

Lecture 6: Introduction to Linear Regression

Lecture 6: Introduction to Linear Regression Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6

More information

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek Dscusson of Extensons of the Gauss-arkov Theorem to the Case of Stochastc Regresson Coeffcents Ed Stanek Introducton Pfeffermann (984 dscusses extensons to the Gauss-arkov Theorem n settngs where regresson

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Constructing Control Process for Wafer Defects Using Data Mining Technique

Constructing Control Process for Wafer Defects Using Data Mining Technique The Fourth nternatonal Conference on Electronc Busness (CEB004) / Bejng 5 Constructng Control ocess for Wafer Defects Usng Data Mnng Technque Leeng Tong Hsngyn Lee Chfeng Huang Changke Ln Chenhu Yang Department

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable

More information

An (almost) unbiased estimator for the S-Gini index

An (almost) unbiased estimator for the S-Gini index An (almost unbased estmator for the S-Gn ndex Thomas Demuynck February 25, 2009 Abstract Ths note provdes an unbased estmator for the absolute S-Gn and an almost unbased estmator for the relatve S-Gn for

More information

Economics 130. Lecture 4 Simple Linear Regression Continued

Economics 130. Lecture 4 Simple Linear Regression Continued Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do

More information

Statistical inference for generalized Pareto distribution based on progressive Type-II censored data with random removals

Statistical inference for generalized Pareto distribution based on progressive Type-II censored data with random removals Internatonal Journal of Scentfc World, 2 1) 2014) 1-9 c Scence Publshng Corporaton www.scencepubco.com/ndex.php/ijsw do: 10.14419/jsw.v21.1780 Research Paper Statstcal nference for generalzed Pareto dstrbuton

More information

Lecture 12: Classification

Lecture 12: Classification Lecture : Classfcaton g Dscrmnant functons g The optmal Bayes classfer g Quadratc classfers g Eucldean and Mahalanobs metrcs g K Nearest Neghbor Classfers Intellgent Sensor Systems Rcardo Guterrez-Osuna

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

THE ROYAL STATISTICAL SOCIETY 2006 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE

THE ROYAL STATISTICAL SOCIETY 2006 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE THE ROYAL STATISTICAL SOCIETY 6 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutons to assst canddates preparng for the eamnatons n future years and for

More information

Maximum Likelihood Estimation (MLE)

Maximum Likelihood Estimation (MLE) Maxmum Lkelhood Estmaton (MLE) Ken Kreutz-Delgado (Nuno Vasconcelos) ECE 175A Wnter 01 UCSD Statstcal Learnng Goal: Gven a relatonshp between a feature vector x and a vector y, and d data samples (x,y

More information

Chapter 6. Supplemental Text Material

Chapter 6. Supplemental Text Material Chapter 6. Supplemental Text Materal S6-. actor Effect Estmates are Least Squares Estmates We have gven heurstc or ntutve explanatons of how the estmates of the factor effects are obtaned n the textboo.

More information

LOGIT ANALYSIS. A.K. VASISHT Indian Agricultural Statistics Research Institute, Library Avenue, New Delhi

LOGIT ANALYSIS. A.K. VASISHT Indian Agricultural Statistics Research Institute, Library Avenue, New Delhi LOGIT ANALYSIS A.K. VASISHT Indan Agrcultural Statstcs Research Insttute, Lbrary Avenue, New Delh-0 02 amtvassht@asr.res.n. Introducton In dummy regresson varable models, t s assumed mplctly that the dependent

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

Phase I Monitoring of Nonlinear Profiles

Phase I Monitoring of Nonlinear Profiles Phase I Montorng of Nonlnear Profles James D. Wllams Wllam H. Woodall Jeffrey B. Brch May, 003 J.D. Wllams, Bll Woodall, Jeff Brch, Vrgna Tech 003 Qualty & Productvty Research Conference, Yorktown Heghts,

More information

DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION

DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION Internatonal Worshop ADVANCES IN STATISTICAL HYDROLOGY May 3-5, Taormna, Italy DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION by Sooyoung

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models

More information

ELASTIC WAVE PROPAGATION IN A CONTINUOUS MEDIUM

ELASTIC WAVE PROPAGATION IN A CONTINUOUS MEDIUM ELASTIC WAVE PROPAGATION IN A CONTINUOUS MEDIUM An elastc wave s a deformaton of the body that travels throughout the body n all drectons. We can examne the deformaton over a perod of tme by fxng our look

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

A Note on Test of Homogeneity Against Umbrella Scale Alternative Based on U-Statistics

A Note on Test of Homogeneity Against Umbrella Scale Alternative Based on U-Statistics J Stat Appl Pro No 3 93- () 93 NSP Journal of Statstcs Applcatons & Probablty --- An Internatonal Journal @ NSP Natural Scences Publshng Cor A Note on Test of Homogenety Aganst Umbrella Scale Alternatve

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES

TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES SVANTE JANSON Abstract. We gve explct bounds for the tal probabltes for sums of ndependent geometrc or exponental varables, possbly wth dfferent

More information

This column is a continuation of our previous column

This column is a continuation of our previous column Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

Integrals and Invariants of Euler-Lagrange Equations

Integrals and Invariants of Euler-Lagrange Equations Lecture 16 Integrals and Invarants of Euler-Lagrange Equatons ME 256 at the Indan Insttute of Scence, Bengaluru Varatonal Methods and Structural Optmzaton G. K. Ananthasuresh Professor, Mechancal Engneerng,

More information

Lecture 4. Instructor: Haipeng Luo

Lecture 4. Instructor: Haipeng Luo Lecture 4 Instructor: Hapeng Luo In the followng lectures, we focus on the expert problem and study more adaptve algorthms. Although Hedge s proven to be worst-case optmal, one may wonder how well t would

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

Statistical Inference. 2.3 Summary Statistics Measures of Center and Spread. parameters ( population characteristics )

Statistical Inference. 2.3 Summary Statistics Measures of Center and Spread. parameters ( population characteristics ) Ismor Fscher, 8//008 Stat 54 / -8.3 Summary Statstcs Measures of Center and Spread Dstrbuton of dscrete contnuous POPULATION Random Varable, numercal True center =??? True spread =???? parameters ( populaton

More information

Parameters Estimation of the Modified Weibull Distribution Based on Type I Censored Samples

Parameters Estimation of the Modified Weibull Distribution Based on Type I Censored Samples Appled Mathematcal Scences, Vol. 5, 011, no. 59, 899-917 Parameters Estmaton of the Modfed Webull Dstrbuton Based on Type I Censored Samples Soufane Gasm École Supereure des Scences et Technques de Tuns

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE

ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE P a g e ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE Darmud O Drscoll ¹, Donald E. Ramrez ² ¹ Head of Department of Mathematcs and Computer Studes

More information

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.

More information

Welfare Properties of General Equilibrium. What can be said about optimality properties of resource allocation implied by general equilibrium?

Welfare Properties of General Equilibrium. What can be said about optimality properties of resource allocation implied by general equilibrium? APPLIED WELFARE ECONOMICS AND POLICY ANALYSIS Welfare Propertes of General Equlbrum What can be sad about optmalty propertes of resource allocaton mpled by general equlbrum? Any crteron used to compare

More information

The optimal delay of the second test is therefore approximately 210 hours earlier than =2.

The optimal delay of the second test is therefore approximately 210 hours earlier than =2. THE IEC 61508 FORMULAS 223 The optmal delay of the second test s therefore approxmately 210 hours earler than =2. 8.4 The IEC 61508 Formulas IEC 61508-6 provdes approxmaton formulas for the PF for smple

More information

STAT 405 BIOSTATISTICS (Fall 2016) Handout 15 Introduction to Logistic Regression

STAT 405 BIOSTATISTICS (Fall 2016) Handout 15 Introduction to Logistic Regression STAT 45 BIOSTATISTICS (Fall 26) Handout 5 Introducton to Logstc Regresson Ths handout covers materal found n Secton 3.7 of your text. You may also want to revew regresson technques n Chapter. In ths handout,

More information

Basically, if you have a dummy dependent variable you will be estimating a probability.

Basically, if you have a dummy dependent variable you will be estimating a probability. ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy

More information

Notes prepared by Prof Mrs) M.J. Gholba Class M.Sc Part(I) Information Technology

Notes prepared by Prof Mrs) M.J. Gholba Class M.Sc Part(I) Information Technology Inverse transformatons Generaton of random observatons from gven dstrbutons Assume that random numbers,,, are readly avalable, where each tself s a random varable whch s unformly dstrbuted over the range(,).

More information

Effective plots to assess bias and precision in method comparison studies

Effective plots to assess bias and precision in method comparison studies Effectve plots to assess bas and precson n method comparson studes Bern, November, 016 Patrck Taffé, PhD Insttute of Socal and Preventve Medcne () Unversty of Lausanne, Swtzerland Patrck.Taffe@chuv.ch

More information

A Double EWMA Control Chart for the Individuals Based on a Linear Prediction

A Double EWMA Control Chart for the Individuals Based on a Linear Prediction Journal of Modern Appled Statstcal Methods Volume 16 Issue Artcle 4 1-1-017 A Double EWMA Control Chart for the Indvduals Based on a Lnear Predcton Rafael Perez Abreu Unversty of Northern Calforna, pere445@bears.unco.edu

More information

b ), which stands for uniform distribution on the interval a x< b. = 0 elsewhere

b ), which stands for uniform distribution on the interval a x< b. = 0 elsewhere Fall Analyss of Epermental Measurements B. Esensten/rev. S. Errede Some mportant probablty dstrbutons: Unform Bnomal Posson Gaussan/ormal The Unform dstrbuton s often called U( a, b ), hch stands for unform

More information

10.34 Fall 2015 Metropolis Monte Carlo Algorithm

10.34 Fall 2015 Metropolis Monte Carlo Algorithm 10.34 Fall 2015 Metropols Monte Carlo Algorthm The Metropols Monte Carlo method s very useful for calculatng manydmensonal ntegraton. For e.g. n statstcal mechancs n order to calculate the prospertes of

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

9. Binary Dependent Variables

9. Binary Dependent Variables 9. Bnar Dependent Varables 9. Homogeneous models Log, prob models Inference Tax preparers 9.2 Random effects models 9.3 Fxed effects models 9.4 Margnal models and GEE Appendx 9A - Lkelhood calculatons

More information

Chapter Newton s Method

Chapter Newton s Method Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve

More information

Change Point Estimation for Pareto Type-II Model

Change Point Estimation for Pareto Type-II Model Journal of Modern Appled Statstcal Methods Volume 3 Issue Artcle 5--04 Change Pont Estmaton for Pareto Type-II Model Gyan Prakash S. N. Medcal College, Agra, U. P., Inda, ggyanj@yahoo.com Follow ths and

More information

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl

Suppose that there s a measured wndow of data fff k () ; :::; ff k g of a sze w, measured dscretely wth varable dscretzaton step. It s convenent to pl RECURSIVE SPLINE INTERPOLATION METHOD FOR REAL TIME ENGINE CONTROL APPLICATIONS A. Stotsky Volvo Car Corporaton Engne Desgn and Development Dept. 97542, HA1N, SE- 405 31 Gothenburg Sweden. Emal: astotsky@volvocars.com

More information

Non-Mixture Cure Model for Interval Censored Data: Simulation Study ABSTRACT

Non-Mixture Cure Model for Interval Censored Data: Simulation Study ABSTRACT Malaysan Journal of Mathematcal Scences 8(S): 37-44 (2014) Specal Issue: Internatonal Conference on Mathematcal Scences and Statstcs 2013 (ICMSS2013) MALAYSIAN JOURNAL OF MATHEMATICAL SCIENCES Journal

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

ESTIMATION OF THE SAMPLE SIZE AND COVERAGE FOR GUARANTEED-COVERAGE NONNORMAL TOLERANCE INTERVALS. Huifen Chen Tsu-Kuang Yang

ESTIMATION OF THE SAMPLE SIZE AND COVERAGE FOR GUARANTEED-COVERAGE NONNORMAL TOLERANCE INTERVALS. Huifen Chen Tsu-Kuang Yang Proceedngs of the 998 Wnter Smulaton Conference D.J. Mederos, E.F. Watson, J.S. Carson and M.S. Manvannan, eds. ESTIMATION OF THE SAMPLE SIZE AND COVERAGE FOR GUARANTEED-COVERAGE NONNORMAL TOLERANCE INTERVALS

More information