Some Applications of the Resampling Methods in Computational Physics
|
|
- Winifred Singleton
- 5 years ago
- Views:
Transcription
1 Iteratoal Joural of Mathematcs Treds ad Techoloy Volume 6 February 04 Some Applcatos of the Resampl Methods Computatoal Physcs Sotraq Marko #, Lorec Ekoom * # Physcs Departmet, Uversty of Korca, Albaa, * Mathematcs Departmet, Uversty of Korca, Albaa Abstract The statstcal methods are be very mportat for estmat the ukow parameters computatoal physcs Betwee them we ca meto the resampl methods: the jackkfe ad bootstrap estmate I our work we have doe ther deas ad have show the results of some applcatos physcs problems of parameter estmato Keywords Jackkfe, bootstrap, bas, computatoal physcs, Bder rato, Loretza I INTRODUCTION The physcas use varous statstcal methods ther works But the books o these topcs usually fall to oe of two camps At oe etreme, the books for physcas do t dscuss all that s eeded ad rarely prove the results that they quote At the other etreme, the books for mathematcas presumably prove everyth but are wrtte the style of lemmas, proofs ad ufamlar otato whch s tmdat to physcas For the ecepto, there are some works whch fd a ood mddle roup [], [6], [0] I the follow we have treated some applcato of the resampl methods physc problems Let us see the statstcal problem of the mea estmato of a radom varable X Let suppose that,,, are depedet observatos from the radom varable X We ote the mea of the radom varable X by µ ad the sample mea by, where radom varable X the -th observato, we propose the statstc X X to be a estmator for the ukow parameter µ Sce X µ If we deote X, =,,, the ISSN: Pae 54 E, the statstc () s a ubased estmator for the ukow parameter µ If we deote the varace of the radom varable X by, we have Var(X) We ca use Var( X) to measure the ucertaty the sample mea or the error bar estmate Hece our estmate of µ s () Furthermore, X coveres to µ We ca say that X become more ad more accurate as the umber of observatos crease Now let suppose that we wat to estmate ot µ, but some fucto of µ e µ I Secto we have doe stadard statstcal methods for the estmato of µ ad have aalyzed the bas of the estmato ad ts order I Secto 3 we have show the dea of the jackkfe ad bootstrap estmatos ad have ve some cosderato about the jackkfe ad bootstrap estmato of the bas We have stressed that the bas order of jackkfe ad bootstrap estmate s stead of stadard estmatos I Secto 4 we have show some smulatos cases ad have doe a comparso betwee the jackkfe ad bootstrap methods wth stadard methods ()
2 form Iteratoal Joural of Mathematcs Treds ad Techoloy Volume 6 February 04 II THE BIAS ORDER IN STANDARD METHODS I the above codtos, we compute some statstc of terest, say θˆ,, θˆ ad defe the bas the Bas Eθˆ - µ, (3) where E θˆ s the mea of θˆ Now let us aalyze the estmato of the ukow parameter µ A poor way to estmate µ would be from However, ths s really a estmate for the mea of (X), rather tha µ we evaluate the dfferece θˆ X (4) E(X) µ For the () we have µ µ µ µ µ But, eeral E(X) µ ()!! (5) We ca see that the bas s equal to µ varx E() - µ O()! (6) So, the bas does ot vash for If s a lear fucto the 0 ad Bas=0 Thus, there s o bas f s a lear fucto We take a better result f we chae (5) () wth I ths case µ µ µ µ ( ) µ!! (7) ad µ varx E( ) - µ O! (8) Now, the bas s of order rather tha the order Ths bas ca usually be elected because t s smaller tha Let statstcal error () of order To decrease the bas order we use the jackkfe ad the bootstrap methods I the follow secto we have ve the dea of the jackkfe ad the bootstrap estmatos III THE BIAS ESTIMATE WITH RESAMPLING METHODS The resampl methods are ett a mportat space may statstcal problems of estmat ukow parameters ad dstrbutos It depeds o two reasos The frst reaso s the use of computers ad software ad the secod reaso s that these methods ot ask ay codto about the dstrbutos Let us see the dea of the jackkfe ad bootstrap estmate A The Jackkfe Estmate of the Bas We defe the observato mea whe we have removed the observato the form - =,, I smlar way we defe =,, or, =,, The jackkfe estmate of µ j s the averae of,, ISSN: Pae 55
3 ad Iteratoal Joural of Mathematcs Treds ad Techoloy Volume 6 February 04 J Let us aalyze the jackkfe estmate We have The ( µ j µ µ, =,, (0) - ) µ µ µ - E( The bas of the jackkfe estmate s E J j µ ) - µ µ µ - µ - µ - j µ - µ! () We see that hh order terms are at order The bas vashes for ad t s of the same order wth the estmate Sometmes we wat to estmate drectly the bas To do t, let us see Queoulle s bas estmate [9] Ths method s based o sequetally delet pots ad recomput the statstc θˆ Deot bas (8) of the X θˆ θˆ (,,,,, ) ad θˆ θˆ, Queoulle s estmate of bas s Bas J θˆ - θˆ, () lead to the bas-corrected jackkfe estmate of µ ~ θ θˆ - BasJ θˆ - -θˆ For may commo statstcs, clud most mamum lkelhood estmates, a a Eθˆ µ, (3) where a, a, do ot deped upo [8] After some calculatos we have ~ a Eθ θ - a - 3 (4) We see that the bas order of ~ θ s O, compared to O for the oral estmator (3) The jackkfe estmate of varace s [] θˆ θˆ varj (5) Suppose θˆ X, where s some cely behaved fucto (dervatve ests cotuously) The a frst order Taylor epasos ves θˆ So, substtut ths epresso to (5), we have (9) ISSN: Pae 56
4 Iteratoal Joural of Mathematcs Treds ad Techoloy Volume 6 February 04 var (6) B The Bootstrap Estmate of the Bas The bootstrap [3] s coceptually a smple techque The bootstrap, lke the jackkfe, s a resampl of data pots Whereas jackkfe cosders ew data sets, each cota all the oral data pots mus, bootstrap uses B data sets each cota pots obtaed by radom sampl wth the same probablty of the oral set of pots * Let us ote such data set by,, X * * * X ad calculate θˆ (X,,X * ) Ths s the bootstrap estmate for the ukow parameter Idepedetly we repeat ths procedure a lare umber B of tmes obta bootstrap * replcatos θˆ,, θˆ*b The bootstrap estmate for the bas s B BasB θˆ*b θˆ (7) B b ad the bootstrap estmate for the varace s B varb (θˆ*b θˆ) (8) B b The order of the bas the bootstrap estmate s the same wth the order of the jackkfe estmate bas For the quadratc fuctoal we have BasJ BasB (9) IV EXAMPLES I ths Secto we have show the results of some applcatos of resampl methods Computatoal Physcs ) Eample 4 π Let us suppose we wat to compute cos(e(x)), where ε ad ε s a Gaussa radom varable wth 3 mea zero ad stadard devato uty We took a sample =000 The jackkfe estmate of the mea was 0496, wth a error estmate of 0080 whch s cosstet wth the eact value of 05 For comparso cos was also equal to 0496 to ths precso Us equato () to et a less based estmate of the mea, ad us the full precso of the umbers the computer ves 0499 The dfferece betwee 0496 ad 0499 s completely umportat sce the error bar of 0080 s very much larer Wth B=00 data sets we foud Ths result s cosstet wth the eact value of 05 ad very close to the jackkfe result ) Eample 4 Jackkfe ad bootstrap ca be used to compute error bars for qute eeral fuctos of the data set For eample, oe ca use the jackkfe ad bootstrap resampl schemes to estmate parameters descrb the shape of the dstrbuto from the data set A eample, whch s also used may researches phase trastos (where t s called the Bder rato ),, defed by 4 EX EX E X EX (0) ISSN: Pae 57
5 Iteratoal Joural of Mathematcs Treds ad Techoloy Volume 6 February 04 Sce the total power of X the umerator ad deomator s the same, the kurtoss depeds oly o the shape of the dstrbuto ad ot o ts overall scale It takes the value 3 for a Gaussa dstrbuto I the eample we took =000 pots from a Gaussa dstrbuto ad computed the kurtoss us the jackkfe method For the Gaussa dstrbuto we kow that EX=0 For each of the jackkfe data sets we computed ad obtaed a averae ad error bar us () above The result s whch s cosstet wth the eact value of 3 The kurtoss s foud for each B=00 bootstrap samples, ad the mea ad error obtaed from (7) The result s whch arees well wth the jackkfe estmate ad s cosstet wth the eact value of 3 3) Eample 43 Lear reresso: where Cosder the lear reresso model y β ε, =,,, () ε are depedet radom varables wth detcally ukow dstrbuto F ad ε 0 E, s a kow p vector of covarates whe y β ε, where β s a p vector of ukow parameters The statstc of terest s the least squares estmate of β the form T βˆ X X X T, () where Y y,, T, T Y y X,,X cov s T ˆ X X, (3) where ˆ εˆ ad εˆ be the estmated resdual y βˆ The multvarate verso of Tukey s formula s covj βˆ βˆ βˆ βˆ (4) If all the εˆ are detcal value ths s about the same as the stadard aswer, but otherwse the two formulas are qute dfferet I quadratc ft of 50 pots wth Gaussa ose to 3-+, the follow results were obtaed X The usual estmate of βˆ TABLE I THE ESTIMATE RESULTS OF THE LINEAR REGRESSION WITH STANDARD AND REAMPLING METHODS Least square ft Jackkfe ft Bootstrap ft Ft parameters Error bars Covarace matr ) Eample 4 The smple meda For most problems, the jackkfe ad bootstrap ve smlar results However, there s at least oe class of problems where the jackkfe approach s usatsfactory, because the data set are too smlar to each other, whle the bootstrap method works We ca ote that the jackkfe estmate of the varace fals the case of the sample meda A estmator for the sample meda s m f m- From the formula (3) we have (5) f m m m ISSN: Pae 58
6 Iteratoal Joural of Mathematcs Treds ad Techoloy Volume 6 February 04 - varj m m 4 (6) Stadard theory [7] shows that f the dstrbuto F of the radom varable X has a desty fucto f the var, (7) 4f µ Y where f µ s the desty at the sample meda µ, µ f s assumed >0 ad Y s a radom varable wth epectato ad varace 0 The true varace oes to the lmt [5] var (8) 4f µ I ths case, the jackkfe estmate s ot eve a cosstet estmator of the varace sample meda From the other had, the bootstrap estmate of the varace oes well for the sample meda The bootstrap estmate of stadard devato s show to be asymptotcally cosstet for the true stadard devato [4] I the bootstrap estmate, the B data samples are sfcatly dfferet from each other, so the error the meda ca be estmated As a eample, we took =00 data pots eerated from the postve half of a Loretza 0 f π (9) 0 0 Note that ths s a very broad dstrbuto for whch eve the mea s ot defed However, the meda s defed ad a stadard teral ves the value Iclud all 00 values of we have, we foud the meda to be 0963 Us the bootstrap wth B=5000 data sets we foud We see that the overall averae ad the mea of the bootstraps are very close, ad the result arees wth the eact value of wth the error bar V CONCLUSIONS I ths paper we have ve some applcatos of jackkfe ad bootstrap Computatoal Physcs We have show the effcecy ad faclty of these methods estmato whe the dstrbutos are ukow or asymmetrc We ca see t Eamples 4, 4 ad 43 But some cases the resampl methods do ot work We ca see t Eample 44, whe the bootstrap method works, meawhle the jackkfe method does ot work REFERENCES [] V Ambeaokar ad M Troyer M Estmat errors relably Mote Carlo smulatos of the Ehrefest model, Am J Phys Vol 78, 50, 009 [] G Bohm ad G Zech G (00) Itroducto to statstcs ad data aalyss for physcsts Verla Deutches Electroe Sychrotro, 00 [3] B Efro Bootstrap methods: aother look at the jackkfe A Statst, Vol 7, pp -6, 979 [4] B Efro The jackkfe, the bootstrap ad other resampl plas SIAM, 98 [5] M Kedall ad A Stuart The advaced theory of statstcs Grff Lodo, 958 [6] W H Press, S A Teukolsky, W T Wetterl ad B P Flaery Numercal recpes C, ed Ed Cambrde Uversty Press, 99 [7] R Pyke Spacs, J Roy Statst Soc Ser B Vol 7, pp , 965 [8] W Schucay, H Gray ad O Owe O bas reducto estmato JASA, Vol 66, pp , 97 [9] M Queoulle Appromate tests of correlato tme seres J Roy Statst Soc Ser B, Vol, pp -84, 949 [0] J R Taylor The study of ucertates physcal measuremets Uversty Scece Books, Sausalto, Calfora, 997 [] J Tukey Bas ad cofdece ot qute lare samples Abstract A Math Statst, Vol 9, pp 64, 958 ISSN: Pae 59
Econometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationOrdinary Least Squares Regression. Simple Regression. Algebra and Assumptions.
Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos
More informationSimulation Output Analysis
Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5
More informationMidterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes
coometrcs, CON Sa Fracsco State Uversty Mchael Bar Sprg 5 Mdterm am, secto Soluto Thursday, February 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes eam.. No calculators of ay kd are allowed..
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More informationESS Line Fitting
ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here
More informationChapter 5 Properties of a Random Sample
Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample
More informationSTK4011 and STK9011 Autumn 2016
STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationX ε ) = 0, or equivalently, lim
Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More informationModule 7. Lecture 7: Statistical parameter estimation
Lecture 7: Statstcal parameter estmato Parameter Estmato Methods of Parameter Estmato 1) Method of Matchg Pots ) Method of Momets 3) Mamum Lkelhood method Populato Parameter Sample Parameter Ubased estmato
More informationBias Correction in Estimation of the Population Correlation Coefficient
Kasetsart J. (Nat. Sc.) 47 : 453-459 (3) Bas Correcto Estmato of the opulato Correlato Coeffcet Juthaphor Ssomboothog ABSTRACT A estmator of the populato correlato coeffcet of two varables for a bvarate
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More informationLecture 3. Sampling, sampling distributions, and parameter estimation
Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called
More informationbest estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best
Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg
More information( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model
Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch
More informationComparison of Dual to Ratio-Cum-Product Estimators of Population Mean
Research Joural of Mathematcal ad Statstcal Sceces ISS 30 6047 Vol. 1(), 5-1, ovember (013) Res. J. Mathematcal ad Statstcal Sc. Comparso of Dual to Rato-Cum-Product Estmators of Populato Mea Abstract
More informationMultivariate Transformation of Variables and Maximum Likelihood Estimation
Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty
More informationBAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL DISTRIBUTION
Iteratoal Joural of Mathematcs ad Statstcs Studes Vol.4, No.3, pp.5-39, Jue 06 Publshed by Europea Cetre for Research Trag ad Developmet UK (www.eajourals.org BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL
More informationBayesian Inferences for Two Parameter Weibull Distribution Kipkoech W. Cheruiyot 1, Abel Ouko 2, Emily Kirimi 3
IOSR Joural of Mathematcs IOSR-JM e-issn: 78-578, p-issn: 9-765X. Volume, Issue Ver. II Ja - Feb. 05, PP 4- www.osrjourals.org Bayesa Ifereces for Two Parameter Webull Dstrbuto Kpkoech W. Cheruyot, Abel
More informationENGI 4421 Propagation of Error Page 8-01
ENGI 441 Propagato of Error Page 8-01 Propagato of Error [Navd Chapter 3; ot Devore] Ay realstc measuremet procedure cotas error. Ay calculatos based o that measuremet wll therefore also cota a error.
More information2SLS Estimates ECON In this case, begin with the assumption that E[ i
SLS Estmates ECON 3033 Bll Evas Fall 05 Two-Stage Least Squares (SLS Cosder a stadard lear bvarate regresso model y 0 x. I ths case, beg wth the assumto that E[ x] 0 whch meas that OLS estmates of wll
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity
ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More informationLecture Notes Types of economic variables
Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte
More informationLecture Notes Forecasting the process of estimating or predicting unknown situations
Lecture Notes. Ecoomc Forecastg. Forecastg the process of estmatg or predctg ukow stuatos Eample usuall ecoomsts predct future ecoomc varables Forecastg apples to a varet of data () tme seres data predctg
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More informationPROPERTIES OF GOOD ESTIMATORS
ESTIMATION INTRODUCTION Estmato s the statstcal process of fdg a appromate value for a populato parameter. A populato parameter s a characterstc of the dstrbuto of a populato such as the populato mea,
More informationA New Family of Transformations for Lifetime Data
Proceedgs of the World Cogress o Egeerg 4 Vol I, WCE 4, July - 4, 4, Lodo, U.K. A New Famly of Trasformatos for Lfetme Data Lakhaa Watthaacheewakul Abstract A famly of trasformatos s the oe of several
More informationEstimation of Stress- Strength Reliability model using finite mixture of exponential distributions
Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur
More informationMultiple Linear Regression Analysis
LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple
More informationComparison of Parameters of Lognormal Distribution Based On the Classical and Posterior Estimates
Joural of Moder Appled Statstcal Methods Volume Issue Artcle 8 --03 Comparso of Parameters of Logormal Dstrbuto Based O the Classcal ad Posteror Estmates Raja Sulta Uversty of Kashmr, Sragar, Ida, hamzasulta8@yahoo.com
More informationThe expected value of a sum of random variables,, is the sum of the expected values:
Sums of Radom Varables xpected Values ad Varaces of Sums ad Averages of Radom Varables The expected value of a sum of radom varables, say S, s the sum of the expected values: ( ) ( ) S Ths s always true
More informationMultiple Choice Test. Chapter Adequacy of Models for Regression
Multple Choce Test Chapter 06.0 Adequac of Models for Regresso. For a lear regresso model to be cosdered adequate, the percetage of scaled resduals that eed to be the rage [-,] s greater tha or equal to
More informationFunctions of Random Variables
Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,
More informationChapter 8: Statistical Analysis of Simulated Data
Marquette Uversty MSCS600 Chapter 8: Statstcal Aalyss of Smulated Data Dael B. Rowe, Ph.D. Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 08 by Marquette Uversty MSCS600 Ageda 8. The Sample
More informationSTA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #1
STA 08 Appled Lear Models: Regresso Aalyss Sprg 0 Soluto for Homework #. Let Y the dollar cost per year, X the umber of vsts per year. The the mathematcal relato betwee X ad Y s: Y 300 + X. Ths s a fuctoal
More informationMean is only appropriate for interval or ratio scales, not ordinal or nominal.
Mea Same as ordary average Sum all the data values ad dvde by the sample sze. x = ( x + x +... + x Usg summato otato, we wrte ths as x = x = x = = ) x Mea s oly approprate for terval or rato scales, ot
More informationBayes Interval Estimation for binomial proportion and difference of two binomial proportions with Simulation Study
IJIEST Iteratoal Joural of Iovatve Scece, Egeerg & Techology, Vol. Issue 5, July 04. Bayes Iterval Estmato for bomal proporto ad dfferece of two bomal proportos wth Smulato Study Masoud Gaj, Solmaz hlmad
More informationObjectives of Multiple Regression
Obectves of Multple Regresso Establsh the lear equato that best predcts values of a depedet varable Y usg more tha oe eplaator varable from a large set of potetal predctors {,,... k }. Fd that subset of
More informationENGI 3423 Simple Linear Regression Page 12-01
ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable
More informationComparing Different Estimators of three Parameters for Transmuted Weibull Distribution
Global Joural of Pure ad Appled Mathematcs. ISSN 0973-768 Volume 3, Number 9 (207), pp. 55-528 Research Ida Publcatos http://www.rpublcato.com Comparg Dfferet Estmators of three Parameters for Trasmuted
More informationSTK3100 and STK4100 Autumn 2017
SK3 ad SK4 Autum 7 Geeralzed lear models Part III Covers the followg materal from chaters 4 ad 5: Sectos 4..5, 4.3.5, 4.3.6, 4.4., 4.4., ad 4.4.3 Sectos 5.., 5.., ad 5.5. Ørulf Borga Deartmet of Mathematcs
More informationLine Fitting and Regression
Marquette Uverst MSCS6 Le Fttg ad Regresso Dael B. Rowe, Ph.D. Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Coprght 8 b Marquette Uverst Least Squares Regresso MSCS6 For LSR we have pots
More informationClass 13,14 June 17, 19, 2015
Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral
More informationSimple Linear Regression
Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uversty Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal
More informationSimple Linear Regression
Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato
More informationSTATISTICAL INFERENCE
(STATISTICS) STATISTICAL INFERENCE COMPLEMENTARY COURSE B.Sc. MATHEMATICS III SEMESTER ( Admsso) UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION CALICUT UNIVERSITY P.O., MALAPPURAM, KERALA, INDIA -
More informationENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections
ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty
More informationPoint Estimation: definition of estimators
Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.
More informationIFYMB002 Mathematics Business Appendix C Formula Booklet
Iteratoal Foudato Year (IFY IFYMB00 Mathematcs Busess Apped C Formula Booklet Related Documet: IFY Mathematcs Busess Syllabus 07/8 IFYMB00 Maths Busess Apped C Formula Booklet Cotets lease ote that the
More informationMidterm Exam 1, section 2 (Solution) Thursday, February hour, 15 minutes
coometrcs, CON Sa Fracsco State Uverst Mchael Bar Sprg 5 Mdterm xam, secto Soluto Thursda, Februar 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes exam.. No calculators of a kd are allowed..
More informationTHE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5
THE ROYAL STATISTICAL SOCIETY 06 EAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5 The Socety s provdg these solutos to assst cadtes preparg for the examatos 07. The solutos are teded as learg ads ad should
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationLECTURE - 4 SIMPLE RANDOM SAMPLING DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANPUR
amplg Theory MODULE II LECTURE - 4 IMPLE RADOM AMPLIG DR. HALABH DEPARTMET OF MATHEMATIC AD TATITIC IDIA ITITUTE OF TECHOLOGY KAPUR Estmato of populato mea ad populato varace Oe of the ma objectves after
More informationBootstrap Method for Testing of Equality of Several Coefficients of Variation
Cloud Publcatos Iteratoal Joural of Advaced Mathematcs ad Statstcs Volume, pp. -6, Artcle ID Sc- Research Artcle Ope Access Bootstrap Method for Testg of Equalty of Several Coeffcets of Varato Dr. Navee
More informationε. Therefore, the estimate
Suggested Aswers, Problem Set 3 ECON 333 Da Hugerma. Ths s ot a very good dea. We kow from the secod FOC problem b) that ( ) SSE / = y x x = ( ) Whch ca be reduced to read y x x = ε x = ( ) The OLS model
More informationSampling Theory MODULE X LECTURE - 35 TWO STAGE SAMPLING (SUB SAMPLING)
Samplg Theory ODULE X LECTURE - 35 TWO STAGE SAPLIG (SUB SAPLIG) DR SHALABH DEPARTET OF ATHEATICS AD STATISTICS IDIA ISTITUTE OF TECHOLOG KAPUR Two stage samplg wth uequal frst stage uts: Cosder two stage
More informationSTK3100 and STK4100 Autumn 2018
SK3 ad SK4 Autum 8 Geeralzed lear models Part III Covers the followg materal from chaters 4 ad 5: Cofdece tervals by vertg tests Cosder a model wth a sgle arameter β We may obta a ( α% cofdece terval for
More informationCOV. Violation of constant variance of ε i s but they are still independent. The error term (ε) is said to be heteroscedastic.
c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty olato of costat varace of s but they are stll depedet. C,, he error term s sad to be heteroscedastc. c Pogsa Porchawseskul, Faculty of Ecoomcs,
More informationQualifying Exam Statistical Theory Problem Solutions August 2005
Qualfyg Exam Statstcal Theory Problem Solutos August 5. Let X, X,..., X be d uform U(,),
More informationMEASURES OF DISPERSION
MEASURES OF DISPERSION Measure of Cetral Tedecy: Measures of Cetral Tedecy ad Dsperso ) Mathematcal Average: a) Arthmetc mea (A.M.) b) Geometrc mea (G.M.) c) Harmoc mea (H.M.) ) Averages of Posto: a) Meda
More informationLinear Regression with One Regressor
Lear Regresso wth Oe Regressor AIM QA.7. Expla how regresso aalyss ecoometrcs measures the relatoshp betwee depedet ad depedet varables. A regresso aalyss has the goal of measurg how chages oe varable,
More informationMaximum Likelihood Estimation
Marquette Uverst Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Coprght 08 b Marquette Uverst Maxmum Lkelhood Estmato We have bee sag that ~
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More informationCHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More information1 Solution to Problem 6.40
1 Soluto to Problem 6.40 (a We wll wrte T τ (X 1,...,X where the X s are..d. wth PDF f(x µ, σ 1 ( x µ σ g, σ where the locato parameter µ s ay real umber ad the scale parameter σ s > 0. Lettg Z X µ σ we
More informationSPECIAL CONSIDERATIONS FOR VOLUMETRIC Z-TEST FOR PROPORTIONS
SPECIAL CONSIDERAIONS FOR VOLUMERIC Z-ES FOR PROPORIONS Oe s stctve reacto to the questo of whether two percetages are sgfcatly dfferet from each other s to treat them as f they were proportos whch the
More informationLecture 2: The Simple Regression Model
Lectre Notes o Advaced coometrcs Lectre : The Smple Regresso Model Takash Yamao Fall Semester 5 I ths lectre we revew the smple bvarate lear regresso model. We focs o statstcal assmptos to obta based estmators.
More informationThe equation is sometimes presented in form Y = a + b x. This is reasonable, but it s not the notation we use.
INTRODUCTORY NOTE ON LINEAR REGREION We have data of the form (x y ) (x y ) (x y ) These wll most ofte be preseted to us as two colum of a spreadsheet As the topc develops we wll see both upper case ad
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More informationBayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information
Malaysa Joural of Mathematcal Sceces (): 97- (9) Bayes Estmator for Expoetal Dstrbuto wth Exteso of Jeffery Pror Iformato Hadeel Salm Al-Kutub ad Noor Akma Ibrahm Isttute for Mathematcal Research, Uverst
More informationGoodness of Fit Test for The Skew-T Distribution
Joural of mathematcs ad computer scece 4 (5) 74-83 Artcle hstory: Receved ecember 4 Accepted 6 Jauary 5 Avalable ole 7 Jauary 5 Goodess of Ft Test for The Skew-T strbuto M. Magham * M. Bahram + epartmet
More informationUnsupervised Learning and Other Neural Networks
CSE 53 Soft Computg NOT PART OF THE FINAL Usupervsed Learg ad Other Neural Networs Itroducto Mture Destes ad Idetfablty ML Estmates Applcato to Normal Mtures Other Neural Networs Itroducto Prevously, all
More informationEvaluation of uncertainty in measurements
Evaluato of ucertaty measuremets Laboratory of Physcs I Faculty of Physcs Warsaw Uversty of Techology Warszawa, 05 Itroducto The am of the measuremet s to determe the measured value. Thus, the measuremet
More informationA Study of the Reproducibility of Measurements with HUR Leg Extension/Curl Research Line
HUR Techcal Report 000--9 verso.05 / Frak Borg (borgbros@ett.f) A Study of the Reproducblty of Measuremets wth HUR Leg Eteso/Curl Research Le A mportat property of measuremets s that the results should
More informationSTRONG CONSISTENCY FOR SIMPLE LINEAR EV MODEL WITH v/ -MIXING
Joural of tatstcs: Advaces Theory ad Alcatos Volume 5, Number, 6, Pages 3- Avalable at htt://scetfcadvaces.co. DOI: htt://d.do.org/.864/jsata_7678 TRONG CONITENCY FOR IMPLE LINEAR EV MODEL WITH v/ -MIXING
More informationArithmetic Mean Suppose there is only a finite number N of items in the system of interest. Then the population arithmetic mean is
Topc : Probablty Theory Module : Descrptve Statstcs Measures of Locato Descrptve statstcs are measures of locato ad shape that perta to probablty dstrbutos The prmary measures of locato are the arthmetc
More informationConfidence Intervals for Double Exponential Distribution: A Simulation Approach
World Academy of Scece, Egeerg ad Techology Iteratoal Joural of Physcal ad Mathematcal Sceces Vol:6, No:, 0 Cofdece Itervals for Double Expoetal Dstrbuto: A Smulato Approach M. Alrasheed * Iteratoal Scece
More informationCorrelation and Simple Linear Regression
Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uverst Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal
More information4. Standard Regression Model and Spatial Dependence Tests
4. Stadard Regresso Model ad Spatal Depedece Tests Stadard regresso aalss fals the presece of spatal effects. I case of spatal depedeces ad/or spatal heterogeet a stadard regresso model wll be msspecfed.
More informationUnimodality Tests for Global Optimization of Single Variable Functions Using Statistical Methods
Malaysa Umodalty Joural Tests of Mathematcal for Global Optmzato Sceces (): of 05 Sgle - 5 Varable (007) Fuctos Usg Statstcal Methods Umodalty Tests for Global Optmzato of Sgle Varable Fuctos Usg Statstcal
More information22 Nonparametric Methods.
22 oparametrc Methods. I parametrc models oe assumes apror that the dstrbutos have a specfc form wth oe or more ukow parameters ad oe tres to fd the best or atleast reasoably effcet procedures that aswer
More information1. The weight of six Golden Retrievers is 66, 61, 70, 67, 92 and 66 pounds. The weight of six Labrador Retrievers is 54, 60, 72, 78, 84 and 67.
Ecoomcs 3 Itroducto to Ecoometrcs Sprg 004 Professor Dobk Name Studet ID Frst Mdterm Exam You must aswer all the questos. The exam s closed book ad closed otes. You may use your calculators but please
More informationGENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA
Sc.It.(Lahore),26(3),985-990,2014 ISSN 1013-5316; CODEN: SINTE 8 GENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA Beradhta H. S. Utam 1, Warsoo 1, Da Kurasar 1, Mustofa Usma
More informationPGE 310: Formulation and Solution in Geosystems Engineering. Dr. Balhoff. Interpolation
PGE 30: Formulato ad Soluto Geosystems Egeerg Dr. Balhoff Iterpolato Numercal Methods wth MATLAB, Recktewald, Chapter 0 ad Numercal Methods for Egeers, Chapra ad Caale, 5 th Ed., Part Fve, Chapter 8 ad
More informationQuantitative analysis requires : sound knowledge of chemistry : possibility of interferences WHY do we need to use STATISTICS in Anal. Chem.?
Ch 4. Statstcs 4.1 Quattatve aalyss requres : soud kowledge of chemstry : possblty of terfereces WHY do we eed to use STATISTICS Aal. Chem.? ucertaty ests. wll we accept ucertaty always? f ot, from how
More informationRegresso What s a Model? 1. Ofte Descrbe Relatoshp betwee Varables 2. Types - Determstc Models (o radomess) - Probablstc Models (wth radomess) EPI 809/Sprg 2008 9 Determstc Models 1. Hypothesze
More informationLecture Note to Rice Chapter 8
ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,
More information12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model
1. Estmatg Model parameters Assumptos: ox ad y are related accordg to the smple lear regresso model (The lear regresso model s the model that says that x ad y are related a lear fasho, but the observed
More informationBayes (Naïve or not) Classifiers: Generative Approach
Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg
More informationIntroduction to local (nonparametric) density estimation. methods
Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest
More informationSection l h l Stem=Tens. 8l Leaf=Ones. 8h l 03. 9h 58
Secto.. 6l 34 6h 667899 7l 44 7h Stem=Tes 8l 344 Leaf=Oes 8h 5557899 9l 3 9h 58 Ths dsplay brgs out the gap the data: There are o scores the hgh 7's. 6. a. beams cylders 9 5 8 88533 6 6 98877643 7 488
More informationWu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1
Wu-Hausma Test: Detectg Falure of E( ε X ) Caot drectly test ths assumpto because lack ubased estmator of ε ad the OLS resduals wll be orthogoal to X, by costructo as ca be see from the momet codto X'
More informationSTA302/1001-Fall 2008 Midterm Test October 21, 2008
STA3/-Fall 8 Mdterm Test October, 8 Last Name: Frst Name: Studet Number: Erolled (Crcle oe) STA3 STA INSTRUCTIONS Tme allowed: hour 45 mutes Ads allowed: A o-programmable calculator A table of values from
More informationConvergence of the Desroziers scheme and its relation to the lag innovation diagnostic
Covergece of the Desrozers scheme ad ts relato to the lag ovato dagostc chard Méard Evromet Caada, Ar Qualty esearch Dvso World Weather Ope Scece Coferece Motreal, August 9, 04 o t t O x x x y x y Oservato
More informationb. There appears to be a positive relationship between X and Y; that is, as X increases, so does Y.
.46. a. The frst varable (X) s the frst umber the par ad s plotted o the horzotal axs, whle the secod varable (Y) s the secod umber the par ad s plotted o the vertcal axs. The scatterplot s show the fgure
More information