New Entropy Estimators with Smaller Root Mean Squared Error

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "New Entropy Estimators with Smaller Root Mean Squared Error"

Transcription

1 Joural of Moder Applied Statistical Methods Volume 4 Issue 2 Article New Etropy Estimators with Smaller Root Mea Squared Error Amer Ibrahim Al-Omari Al al-bayt Uiversity, Mafraq, Jorda, Follow this ad additioal works at: Part of the Applied Statistics Commos, Social ad Behavioral Scieces Commos, ad the Statistical Theory Commos Recommeded Citatio Al-Omari, Amer Ibrahim (205) "New Etropy Estimators with Smaller Root Mea Squared Error," Joural of Moder Applied Statistical Methods: Vol. 4 : Iss. 2, Article 0. DOI: /jmasm/ Available at: This Regular Article is brought to you for free ad ope access by the Ope Access Jourals at It has bee accepted for iclusio i Joural of Moder Applied Statistical Methods by a authorized editor of

2 New Etropy Estimators with Smaller Root Mea Squared Error Cover Page Footote The author thaks the editor ad the referees for their helpful ad valuable commets that substatially improved this paper. This regular article is available i Joural of Moder Applied Statistical Methods: iss2/0

3 Joural of Moder Applied Statistical Methods November 205, Vol. 4, No. 2, Copyright 205 JMASM, Ic. ISSN New Etropy Estimators with Smaller Root Mea Squared Error Amer Ibrahim Al-Omari Al al-bayt Uiversity Mafraq, Jorda New estimators of etropy of cotiuous radom variable are suggested. The proposed estimators are ivestigated uder simple radom samplig (SRS), raked set samplig (RSS), ad double raked set samplig (DRSS) methods. The estimators are compared with Vasicek (976) ad Al-Omari (204) etropy estimators theoretically ad by simulatio i terms of the root mea squared error (RMSE) ad bias values. The results idicate that the suggested estimators have less RMSE ad bias values tha their competig estimators itroduced by Vasicek (976) ad Al-Omari (204). Keywords: Shao etropy; simple radom samplig, raked set samplig; double raked set samplig; root mea square error. Itroductio The raked set samplig was first suggested by McItyre (952) to estimate a mea of pasture ad forage yields. It is a cost efficiet samplig procedure alterative to the commoly used simple radom samplig scheme. The RSS is useful i situatios where the visual orderig of a set of uits ca be doe easily, but the exact measuremet of the uits is difficult or expesive. Let the variable of iterest X has a probability desity fuctio (pdf) g(x) ad a cumulative distributio fuctio (cdf) G(x), with mea μ ad variace σ 2. Let g (i:) (x) ad G (i:) (x) be the pdf ad cdf of the ith order statistic, X (i:), ( i ) of a radom sample of size. The pdf ad the cdf of X (i:), respectively, are give by i i g( i : ) x G x Gx g x, x i Amer Ibrahim Al-Omari is Faculty of Sciece, i the Departmet of Mathematics. at: 88

4 AMER IBRAHIM AL-OMARI ad j j G : x G x G x, x i j j, 2 i: x dx ad variace i: i: x i : g x dx i:. The raked set samplig method ca be describes as follows: with mea x g 2 Step. Radomly select 2 uits from the target populatio. Step 2. Allocate the 2 selected uits radomly ito sets, each of size. Step 3. Without yet kowig ay values for the variable of iterest, rak the uits withi each set with respect to a variable of iterest. This may be based o a persoal professioal judgmet or based o a cocomitat variable correlated with the variable of iterest. Step 4. The sample uits are selected for actual measuremet by icludig the ith smallest raked uit of the ith sample (i =, 2,, ). Step 5. Repeat Steps through 4 for r cycles to obtai a sample of size r for actual measuremet. It is of iterest to ote here that eve if 2 uits are selected from the populatio, but oly of them are measured for compariso with a simple radom samplig of the same size. Let the measured RSS uits are deoted by X (:), X 2(2:),, X (:). The i RSS estimator of the populatio mea is defied as XRSS Xii :. Takahasi ad Wakimoto (968) provided the mathematical theory of the RSS ad showed that 2 i: i: RSS 2 ii: g x g x,, Var X. i i i Al-Saleh ad Al-Kadiri (2000) suggested double raked set samplig (DRSS) method for estimatig the populatio mea to icrease the efficiecy of the estimators for fixed sample size. The DRSS method ca be described as: 2 89

5 NEW ENTROPY ESTIMATORS Step. Radomly choose 2 samples of size each from the target populatio. Step 2. Apply the RSS method described above o the 2 samples i Step. This step yields samples of size each. Step 3. Reapply the RSS method agai o the samples obtaied i Step 2 to obtai a sample of size from the DRSS data. The cycle ca be repeated r times if eeded to obtai a sample of size r uits. Let X be a cotiuous radom variable with probability desity fuctio gx ( ) ad cumulative distributio fuctio G(x). The etropy H [g(x)] of the radom variable is defied by Shao (948a, 948b) as H g x g x log g x dx. () The problem of etropy estimatio of a cotiuous radom variable is cosidered by may authors. Vasicek's (976) suggested a estimator of etropy based o spacig's as log dg p H g x dp, 0 dp (2) where the estimatio is foud by replacig the distributio fuctio G(x) by the empirical distributio fuctio G (x), ad usig the differece operator istead of d the differetial operator. The the derivative G p is estimated by a dp fuctio of the order statistics. Let X, X 2,, X be a simple radom sample of size from G(x) ad X () < X (2) < < X () be the order statistics of the sample. The Vasicek's (976) estimator of H [g(x)] is defied as HV log X X 2 (3) m i m i m i m 90

6 AMER IBRAHIM AL-OMARI where m < / 2 is a positive iteger kow as the widow size, X (i - m) = X () if P. i m, ad X (i + m) = X () if i m. He proved that HVm H g x as m, m, ad 0. Va Es (992) suggested a estimator of etropy based o spacigs as m HVEm X X i m i log m log m i m km k (4) ad proved the cosistecy ad the asymptotic ormality of the estimator uder some coditios. Ebrahimi, Pflughoeft, ad Soofi (994) adjusted the weights of Vasicek (976) estimator to have a smaller weights ad proposed a etropy estimator give by where HE X X log (5) m i m i m i im i, i m, m i 2, m i m, i, m i, m where X (i-m) = X () for i m ad X (i+m) = X () for i m. Ebrahimi et al. (994) showed by simulatio that their estimator has a smaller bias ad mea squared error tha Vasicek (976) estimator. Also, they proved that P. HEm H g x m m as,, 0. Noughabi ad Noughabi (203) suggested a ew estimator of etropy of a ukow cotiuous probability desity fuctio as 9

7 NEW ENTROPY ESTIMATORS HNN log s, m, (6) m i i where ad gˆ X i gˆ X, i m, i 2 m/ si, m, m i m, Xi m X im gˆ X, m i, i Xi X j k, where h is badwidth ad k is a kerel fuctio h h j satisfies k xdx. They proved that HNN P m H g x as, m, m / 0. Note that the kerel fuctio i Noughabi ad Noughabi (203) is selected to be the stadard ormal distributio ad the badwidth h is chose to be h =.06s -/5, where s is the sample stadard deviatio. To estimate the etropy H [g(x)] of a ukow cotiuous probability desity fuctio g(x), Noughabi ad Arghami (200) suggested a etropy estimator give by where HN X X log (7) m i m i m i cim, im, ci 2, m i m,, m i, ad X (i-m) = X () if i m ad X (i+m) = X () for i m. Correa (995) suggested a modified etropy estimator to have smaller mea squared error i the form 92

8 AMER IBRAHIM AL-OMARI HC m i im j i X X j i j i m log, im X X 2 j i j i m (8) im where X X i j. 2m j i m Al-Omari (204) suggested three estimators of etropy of a ukow cotiuous probability desity fuctio g(x) usig SRS, RSS, ad DRSS methods. Based o SRS his first suggested estimator is defied as AHESRS X X log (9) m i m i m i im where X (i-m) = X () for i m, X (i+m) = X () for i m, ad, i m, 2 i 2, m i m,, m i, 2 (0) The secod ad third estimators suggested by Al-Omari (204), based o RSS ad DRSS respectively, are give by ad AHERSS X X * * log () m i m i m i im AHEDRSS X X ** ** log (2) m i m i m i im * * * * where Xi m X () for i m ad X X im ( ) for i m, ad 93

9 NEW ENTROPY ESTIMATORS X X ** ** X im () for i m ad i m X for i m. ** ** ( ) For more about etropy estimators, see Choi, Kim, ad Sog (2004), Park, Park (2003), Goria, Leoeko, Mergel, ad Novi Iverardi (2005) ad Choi (2008). The remaiig part of this paper is orgaized as follows. The suggested etropy estimators are give i the sectio, Proposed Estimators. Next, a simulatio study is coducted to compare the ew estimators with their couterparts suggested by Vasicek (976) ad Al-Omari (204). Fially, some coclusios ad suggestios for further works. The proposed estimators The coefficiet of the etropy estimators i Ebrahimi et al. (994), Noughabi ad (0) (0) (0) Arghami (200), ad Al-Omari (204) are adjusted. Let X, X 2,..., X be a simple radom sample of size from G (x). Based o SRS the first suggested estimator is give by where SHESRS X X 0 0 log (3) m i m i m i im, i m, 4 i 2, m i m,, m i, 4 (4) (0) (0) (0) (0) Xi m X () for i m ad X X im ( ) for i m. Comparig (3) with (3), we have 94

10 AMER IBRAHIM AL-OMARI Let 0 0 SHESRSm log X i m X im i im 2 HVSRSm log (5) () () () (: ) (2: ) ( : ) HVSRS m i 2m 8 log 5 X, X,..., X be a RSS of size, Vasicek (976) etropy estimator usig RSS as cosidered by Mahdizadeh (202) is give by HVRSS log X X 2 i (6) m i m i m i m Based o the RSS uits etropy estimator is X (), (: ) X (), (2: ), X () ( : ), the secod suggested SHERSS X X log (7) m i m i m i im () () () () where i is defied as i (4), ad Xi m X () for i m ad X X im ( ) for i m. Comparig (6) with (7) to have Assume that () () SHERSSm log X i m X im i im 2 HVRSSm Log (8) HVRSS m i 2m 8 log 5 X, X,..., X is a DRSS sample of size. The third (2) (2) (2) (: ) (2: ) ( : ) suggested etropy estimator has the form i 95

11 NEW ENTROPY ESTIMATORS SHEDRSS X X 2 2 log (9) m i m i m i im (2) (2) (2) (2) where i is defied as i (4), ad Xi m X () for i m ad X X im ( ) for i m. Based o DRSS method Mahdizadeh (202) showed that Vasicek (976) estimator will be SHEDRSS log X X (20) m i m i m i m Comparig (9) with (20) to get 2 2 SHEDRSSm log X i m X im i im 2 HVDRSSm log (2) HVDRSS ME Remark : The etropy m i 2m 8 log 5 H f of a empirical maximum etropy desity ME f which is related to HVSRS ad SHESRS ca be computed followig Theil (980) as: i ME 2 2log 2 H f HVSRS log 2 SHESRS log SHESRS log 5 (22) ME Remark 2: If i (22), the H f SHESRS. I the followig two theorems, we compared the suggested estimators with Vasicek (967) ad Al-Omari (204). 96

12 AMER IBRAHIM AL-OMARI Theorem : The suggested estimators have the followig properties: (0) (0) (0) a) Let X, X 2,..., X be SRS of size, the SHESRS m > HVSRS m. () () () b) Let X (), X (2),..., X ( ) be a RSS of size, the SHERSS m > HVRSS m. (2) (2) (2) c) Let X (), X (2),..., X ( ) be a DRSS of size, the SHEDRSS m > HVDRSS m. Proof: The proof of (a), (b), (c), is straightforward by usig (5), (8), (2), respectively, where 2 m log I the followig theorem, we compare our suggested etropy estimators with their competitors i Al-Omari (204). Theorem 2: Based o the suggested estimators ad Al-Omari (204) etropy respectively, we have SHEj m > AHEj m, j = SRS, RSS, DRSS. Proof: Compare (9) with (3) based o SRS to obtai SHESRS m 2m 6 AHESRS m log, 5 ad sice 2 m log 6 0, the the case of SRS holds. Also, compare () with (7) 5 based o RSS, ad (2) with (9) usig DRSS to complete the proof of this theorem. The followig theorem proves the cosistecy of the suggested estimators SHESRS m, SHERSS m, ad SHEDRSS m. Theorem 3: Let Ω be the class of cotiuous desities with fiite etropies ad let X, X 2,, X be a radom sample from g Ω. If, m, m/ 0, the SHEj m, (j = SRS, RSS, DRSS) coverges i probability to H [g(x)]. Proof: Based o the simple radom samplig, from (5) we have 97

13 NEW ENTROPY ESTIMATORS SHESRS m 2m 8 HVSRS m log, 5 ad Vasicek (976) showed that HVSRS m coverges i probability to H [g(x)] ad sice 2 m log 8 coverges to zero as goes to ifiity, the we proved the 5 case of the SRS. Follow the same approach ad use (8) ad (2) to prove the theorem for RSS ad DRSS estimators, respectively. Methodology Simulatio study A simulatio was coducted to ivestigate the performace of the suggested etropy estimators with Vasicek (976) ad Al-Omari (204) etropy estimators usig samplig methods cosidered i this study. The compariso is based o the root mea squared errors (RMSEs) ad bias values of the estimators for 0000 samples geerated from the uiform, expoetial ad the stadard ormal distributios usig SRS, RSS ad DRSS methods. The selectio of the optimal values of the widow size of m for a give value is as yet a ope problem i the etropy estimatio. Therefore, we used the heuristic formula m 0.5 suggested by Wieczorkowski ad Grzegorzewski (999) to select m ad to compute the RMSEs of etropy estimators. I this study, we cosidered the sample ad widow sizes as give i Table. Table. The sample ad widow sizes cosidered i this simulatio Sample size = 0 = 20 = 30 Widow size m 5 m 0 m 5 Also, the performace of the RMSE of the suggested estimators for samples geerated from the uiform, expoetial ad stadard ormal distributios is evaluated based o the quatity Q N HVjm N 00, N SHEj m, AHEj m, j SRS, RSS, DRSS. HVj m 98

14 AMER IBRAHIM AL-OMARI The results are summarized i Tables 2-6. Also, we compared the suggested estimators of etropy with their competitors suggested by Al-Omari (204) ad the results preseted i Table 7 are take from Al-Omari (204). Based o these results observe the followig. The suggested etropy estimators usig SRS, RSS ad DRSS methods are more efficiet tha their competitors HV m based o the same method for all cases cosidered i this study. As a example, from Table 3, with = 0 ad m = 3 for the expoetial distributio with H [g(x)] = usig RSS method, the RMSE ad bias value of SHERSS m are ad compared to ad the RMSE ad bias of HVRSS m. The SHEDRSS m is superior to the other suggested estimators, SHERSS m ad SHESRS m uder the uiform, expoetial ad ormal distributios. From Table, cosider the case of = 20 ad m = 4 uder the uiform distributio whe H [g(x)] = 0, it ca be oted that the RMSE values of SHEDRSS m, SHERSS m, ad SHESRS m are , ad , respectively. The ature of the uderlyig distributio as well as the value of H [g(x)] affect o the efficiecy of the estimator usig the same method. As a example, the Q values with = 30 ad m = 3 SHERSS m for the uiform, expoetial, ad the stadard ormal distributios are , ad , respectively. However, the values of Q for the uiform distributio with H [g(x)] = 0 are SHE m superior to their couterparts for the expoetial ad ormal distributios. Fially, the suggested etropy estimators are foud to be more efficiet tha their competitors i Al-Omari (204) etropy estimators usig SRS, RSS ad DRSS schemes for the same widow ad sample sizes. For illustratio, assume that = 30 ad m = 8 whe the uderlyig distributio is the stadard ormal, from Table 4, the RMSE of SHERSS m is compared to which is the RMSE of AHERSS m as show i Table 7. 99

15 NEW ENTROPY ESTIMATORS Table 2. The Mote Carlo RMSEs ad bias values of HV m ad SHE m for the uiform distributio with H [g(x)] = 0. SRS HV m SHE m RSS Q SHE m HV m SHE m m Bias RMSE Bias RMSE Bias RMSE Bias RMSE Q SHE m Table 2 cotiued o ext page 00

16 AMER IBRAHIM AL-OMARI Table 3. The Mote Carlo RMSEs ad bias values of HV m ad SHE m for the expoetial distributio with H [g(x)] =. SRS HV m SHE m RSS Q SHE m HV m SHE m m Bias RMSE Bias RMSE Bias RMSE Bias RMSE Q SHE m Table 3 cotiued o ext page 0

17 NEW ENTROPY ESTIMATORS Table 4. The Mote Carlo RMSEs ad bias values of HV m ad SHE m for the stadard ormal distributio ad H [g(x)] =.49. SRS HV m SHE m RSS Q SHE m HV m SHE m m Bias RMSE Bias RMSE Bias RMSE Bias RMSE Q SHE m Table 4 cotiued o ext page 02

18 AMER IBRAHIM AL-OMARI Table 5. The Mote Carlo RMSEs ad bias values of HV m ad SHE m for the uiform distributio with H [g(x)] = 0 ad expoetial distributio with H [g(x)] = usig DRSS. SRS HV m m SHE SHEm RSS Q HV m m SHE Q SHEm m Bias RMSE Bias RMSE Bias RMSE Bias RMSE Table 5 cotiued o ext page 03

19 NEW ENTROPY ESTIMATORS

20 AMER IBRAHIM AL-OMARI Table 6. The Mote Carlo RMSEs ad bias values of HV m ad SHE m for the stadard ormal distributio ad H [g(x)] =.49. HV m SHE m m Bias RMSE Bias RMSE Q SHE m

21 NEW ENTROPY ESTIMATORS Table 7. The Mote Carlo RMSEs ad bias values of AHEj m, j = SRS, RSS, DRSS (Al-Omari, 204). AHESRS m Q AHESRS AHERSS m Q AHERSS AHEDRSS m Q AHEDRSS m Bias RMSE Bias RMSE Bias RMSE Uiform distributio with H [g(x)] = Expoetial distributio with H [g(x)] = Stadard ormal distributio with H [g(x)] =

22 AMER IBRAHIM AL-OMARI Coclusio Three etropy estimators are suggested usig SRS, RSS, ad DRSS methods. The cosistecy of these estimators is proved as well as some properties are reported. Based o theoretical ad umerical comparisos the suggested etropy estimators are more efficiet tha Vasicek (976) ad Al-Omari (204) etropy estimators. However, the suggested estimators of etropy i this paper ca be exteded by cosiderig other samplig methods such as the multistage RSS ad media RSS methods. Ackowledgemets The author thaks the referees for their helpful ad valuable commets that substatially improved this paper. Refereces Al-Omari, A. I. (204). Estimatio of etropy usig radom samplig. Joural of Computatio ad Applied Mathematics, 26, doi:0.06/j.cam Al-Saleh, M. F. & Al-Kadiri, M. A. (2000). Double raked set samplig. Statistics ad Probability Letters, 48(2), doi:0.06/s (99) Choi, B. (2008). Improvemet of goodess of fit test for ormal distributio based o etropy ad power compariso. Joural of Statistical Computatio ad Simulatio, 78(9), doi:0.080/ Choi, B., Kim, K., & Sog, S. H. (2004). Goodess of fit test for expoetiality based o Kullback-Leibler iformatio. Commuicatio i Statistics-Simulatio ad Computatio, 33(2), doi:0.08/sac Goria, M. N., Leoeko, N. N., Mergel, V. V., & Novi Iverardi, P. L. (2005). A ew class of radom vector etropy estimators ad its applicatios i testig statistical hypotheses. Joural of Noparametric Statistics, 7(3), doi:0.080/

23 NEW ENTROPY ESTIMATORS Correa, J. C. (995). A ew estimator of etropy. Commuicatio i Statistics-Theory Methods, 24(0), doi:0.080/ Ebrahimi, N., Pflughoeft, K., & Soofi, E. S. (994). Two measures of sample etropy. Statistics & Probability Letters, 20(3), doi:0.06/ (94) Mahdizadeh, M. (202). O the use of raked set samples i etropy based test of fit for the Laplace distributio. Revista Colombiaa de Estadística, 35(3), McItyre, G. A. (952). A method for ubiased selective samplig usig raked sets. Australia Joural of Agricultural Research, 3(4), doi:0.07/ar Noughabi, H. A. & Noughabi, R. A. (203). O the etropy estimators. Joural of Statistical Computatio ad Simulatio, 83(4), doi:0.080/ Noughabi, H. A. & Arghami, N. R. (200). A ew estimator of etropy. Joural of the Iraia Statistical Society, 9(), Park, S. & Park, D. (2003). Correctig momets for goodess of fit tests based o two etropy estimates. Joural of Statistical Computatio ad Simulatio, 73(9), doi:0.080/ Shao, C. E. (948a). A mathematical theory of commuicatios. Bell System Techical Joural 27(3), doi:0.002/j tb0338.x Shao, C. E. (948b). A mathematical theory of commuicatios. Bell System Techical Joural 27(4), doi:0.002/j tb0097.x Takahasi, K. & Wakimoto, K. (968). O the ubiased estimates of the populatio mea based o the sample stratified by meas of orderig. Aals of the Istitute of Statistical Mathematics, 20(), -3. doi:0.007/bf Theil, J. (980). The etropy of maximum etropy distributio. Ecoomics Letters, 5(2), doi:0.06/ (80) Va Es, B. (992). Estimatig fuctioals related to a desity by class of statistics based o spacigs. Scadiavia Joural of Statistics, 9(), Vasicek, O. (976). A test for ormality based o sample etropy. Joural of the Royal Statistical Society, B, 38,

24 AMER IBRAHIM AL-OMARI Wieczorkowski, R. & Grzegorzewsky, P. (999). Etropy estimators - improvemets ad comparisos. Commuicatio i Statistics-Simulatio ad Computatio, 28(2), doi:0.080/

Estimation of Gumbel Parameters under Ranked Set Sampling

Estimation of Gumbel Parameters under Ranked Set Sampling Joural of Moder Applied Statistical Methods Volume 13 Issue 2 Article 11-2014 Estimatio of Gumbel Parameters uder Raked Set Samplig Omar M. Yousef Al Balqa' Applied Uiversity, Zarqa, Jorda, abuyaza_o@yahoo.com

More information

Bootstrap Intervals of the Parameters of Lognormal Distribution Using Power Rule Model and Accelerated Life Tests

Bootstrap Intervals of the Parameters of Lognormal Distribution Using Power Rule Model and Accelerated Life Tests Joural of Moder Applied Statistical Methods Volume 5 Issue Article --5 Bootstrap Itervals of the Parameters of Logormal Distributio Usig Power Rule Model ad Accelerated Life Tests Mohammed Al-Ha Ebrahem

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

Element sampling: Part 2

Element sampling: Part 2 Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

Power Comparison of Some Goodness-of-fit Tests

Power Comparison of Some Goodness-of-fit Tests Florida Iteratioal Uiversity FIU Digital Commos FIU Electroic Theses ad Dissertatios Uiversity Graduate School 7-6-2016 Power Compariso of Some Goodess-of-fit Tests Tiayi Liu tliu019@fiu.edu DOI: 10.25148/etd.FIDC000750

More information

The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution

The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution Iteratioal Mathematical Forum, Vol. 8, 2013, o. 26, 1263-1277 HIKARI Ltd, www.m-hikari.com http://d.doi.org/10.12988/imf.2013.3475 The Samplig Distributio of the Maimum Likelihood Estimators for the Parameters

More information

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function Iteratioal Joural of Statistics ad Systems ISSN 973-2675 Volume 12, Number 4 (217), pp. 791-796 Research Idia Publicatios http://www.ripublicatio.com Bayesia ad E- Bayesia Method of Estimatio of Parameter

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece

More information

G. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan

G. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals 7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses

More information

A goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality

A goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality A goodess-of-fit test based o the empirical characteristic fuctio ad a compariso of tests for ormality J. Marti va Zyl Departmet of Mathematical Statistics ad Actuarial Sciece, Uiversity of the Free State,

More information

Modified Lilliefors Test

Modified Lilliefors Test Joural of Moder Applied Statistical Methods Volume 14 Issue 1 Article 9 5-1-2015 Modified Lilliefors Test Achut Adhikari Uiversity of Norther Colorado, adhi2939@gmail.com Jay Schaffer Uiversity of Norther

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Modified Ratio Estimators Using Known Median and Co-Efficent of Kurtosis

Modified Ratio Estimators Using Known Median and Co-Efficent of Kurtosis America Joural of Mathematics ad Statistics 01, (4): 95-100 DOI: 10.593/j.ajms.01004.05 Modified Ratio s Usig Kow Media ad Co-Efficet of Kurtosis J.Subramai *, G.Kumarapadiya Departmet of Statistics, Podicherry

More information

Estimation of the Population Mean in Presence of Non-Response

Estimation of the Population Mean in Presence of Non-Response Commuicatios of the Korea Statistical Society 0, Vol. 8, No. 4, 537 548 DOI: 0.535/CKSS.0.8.4.537 Estimatio of the Populatio Mea i Presece of No-Respose Suil Kumar,a, Sadeep Bhougal b a Departmet of Statistics,

More information

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series Applied Mathematical Scieces, Vol. 7, 03, o. 6, 3-337 HIKARI Ltd, www.m-hikari.com http://d.doi.org/0.988/ams.03.3430 Compariso Study of Series Approimatio ad Covergece betwee Chebyshev ad Legedre Series

More information

A General Family of Estimators for Estimating Population Variance Using Known Value of Some Population Parameter(s)

A General Family of Estimators for Estimating Population Variance Using Known Value of Some Population Parameter(s) Rajesh Sigh, Pakaj Chauha, Nirmala Sawa School of Statistics, DAVV, Idore (M.P.), Idia Floreti Smaradache Uiversity of New Meico, USA A Geeral Family of Estimators for Estimatig Populatio Variace Usig

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE Vol. 8 o. Joural of Systems Sciece ad Complexity Apr., 5 MOMET-METHOD ESTIMATIO BASED O CESORED SAMPLE I Zhogxi Departmet of Mathematics, East Chia Uiversity of Sciece ad Techology, Shaghai 37, Chia. Email:

More information

ESTIMATION AND PREDICTION BASED ON K-RECORD VALUES FROM NORMAL DISTRIBUTION

ESTIMATION AND PREDICTION BASED ON K-RECORD VALUES FROM NORMAL DISTRIBUTION STATISTICA, ao LXXIII,. 4, 013 ESTIMATION AND PREDICTION BASED ON K-RECORD VALUES FROM NORMAL DISTRIBUTION Maoj Chacko Departmet of Statistics, Uiversity of Kerala, Trivadrum- 695581, Kerala, Idia M. Shy

More information

It should be unbiased, or approximately unbiased. Variance of the variance estimator should be small. That is, the variance estimator is stable.

It should be unbiased, or approximately unbiased. Variance of the variance estimator should be small. That is, the variance estimator is stable. Chapter 10 Variace Estimatio 10.1 Itroductio Variace estimatio is a importat practical problem i survey samplig. Variace estimates are used i two purposes. Oe is the aalytic purpose such as costructig

More information

EDGEWORTH SIZE CORRECTED W, LR AND LM TESTS IN THE FORMATION OF THE PRELIMINARY TEST ESTIMATOR

EDGEWORTH SIZE CORRECTED W, LR AND LM TESTS IN THE FORMATION OF THE PRELIMINARY TEST ESTIMATOR Joural of Statistical Research 26, Vol. 37, No. 2, pp. 43-55 Bagladesh ISSN 256-422 X EDGEORTH SIZE CORRECTED, AND TESTS IN THE FORMATION OF THE PRELIMINARY TEST ESTIMATOR Zahirul Hoque Departmet of Statistics

More information

KLMED8004 Medical statistics. Part I, autumn Estimation. We have previously learned: Population and sample. New questions

KLMED8004 Medical statistics. Part I, autumn Estimation. We have previously learned: Population and sample. New questions We have previously leared: KLMED8004 Medical statistics Part I, autum 00 How kow probability distributios (e.g. biomial distributio, ormal distributio) with kow populatio parameters (mea, variace) ca give

More information

Published online: 12 Jul 2013.

Published online: 12 Jul 2013. This article was dowloaded by: [Hadi Alizadeh Noughabi] O: 12 July 2013, At: 11:39 Publisher: Taylor & Fracis Iforma Ltd Registered i Eglad ad Wales Registered Number: 1072954 Registered office: Mortimer

More information

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced

More information

Basis for simulation techniques

Basis for simulation techniques Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios

More information

Monte Carlo Integration

Monte Carlo Integration Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce

More information

Some Exponential Ratio-Product Type Estimators using information on Auxiliary Attributes under Second Order Approximation

Some Exponential Ratio-Product Type Estimators using information on Auxiliary Attributes under Second Order Approximation ; [Formerly kow as the Bulleti of Statistics & Ecoomics (ISSN 097-70)]; ISSN 0975-556X; Year: 0, Volume:, Issue Number: ; It. j. stat. eco.; opyright 0 by ESER Publicatios Some Expoetial Ratio-Product

More information

Review Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn

Review Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn Stat 366 Lab 2 Solutios (September 2, 2006) page TA: Yury Petracheko, CAB 484, yuryp@ualberta.ca, http://www.ualberta.ca/ yuryp/ Review Questios, Chapters 8, 9 8.5 Suppose that Y, Y 2,..., Y deote a radom

More information

Asymptotic Results for the Linear Regression Model

Asymptotic Results for the Linear Regression Model Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Statistical Test for Multi-dimensional Uniformity

Statistical Test for Multi-dimensional Uniformity Florida Iteratioal Uiversity FIU Digital Commos FIU Electroic Theses ad Dissertatios Uiversity Graduate School -0-20 Statistical Test for Multi-dimesioal Uiformity Tieyog Hu Florida Iteratioal Uiversity,

More information

Probability and statistics: basic terms

Probability and statistics: basic terms Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample

More information

Exam II Review. CEE 3710 November 15, /16/2017. EXAM II Friday, November 17, in class. Open book and open notes.

Exam II Review. CEE 3710 November 15, /16/2017. EXAM II Friday, November 17, in class. Open book and open notes. Exam II Review CEE 3710 November 15, 017 EXAM II Friday, November 17, i class. Ope book ad ope otes. Focus o material covered i Homeworks #5 #8, Note Packets #10 19 1 Exam II Topics **Will emphasize material

More information

Parameter, Statistic and Random Samples

Parameter, Statistic and Random Samples Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,

More information

Estimating Confidence Interval of Mean Using. Classical, Bayesian, and Bootstrap Approaches

Estimating Confidence Interval of Mean Using. Classical, Bayesian, and Bootstrap Approaches Iteratioal Joural of Mathematical Aalysis Vol. 8, 2014, o. 48, 2375-2383 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ijma.2014.49287 Estimatig Cofidece Iterval of Mea Usig Classical, Bayesia,

More information

Economics Spring 2015

Economics Spring 2015 1 Ecoomics 400 -- Sprig 015 /17/015 pp. 30-38; Ch. 7.1.4-7. New Stata Assigmet ad ew MyStatlab assigmet, both due Feb 4th Midterm Exam Thursday Feb 6th, Chapters 1-7 of Groeber text ad all relevat lectures

More information

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com

More information

Final Examination Solutions 17/6/2010

Final Examination Solutions 17/6/2010 The Islamic Uiversity of Gaza Faculty of Commerce epartmet of Ecoomics ad Political Scieces A Itroductio to Statistics Course (ECOE 30) Sprig Semester 009-00 Fial Eamiatio Solutios 7/6/00 Name: I: Istructor:

More information

Kernel density estimator

Kernel density estimator Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I

More information

Chapter 13, Part A Analysis of Variance and Experimental Design

Chapter 13, Part A Analysis of Variance and Experimental Design Slides Prepared by JOHN S. LOUCKS St. Edward s Uiversity Slide 1 Chapter 13, Part A Aalysis of Variace ad Eperimetal Desig Itroductio to Aalysis of Variace Aalysis of Variace: Testig for the Equality of

More information

5. Likelihood Ratio Tests

5. Likelihood Ratio Tests 1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,

More information

New Ratio Estimators Using Correlation Coefficient

New Ratio Estimators Using Correlation Coefficient New atio Estimators Usig Correlatio Coefficiet Cem Kadilar ad Hula Cigi Hacettepe Uiversit, Departmet of tatistics, Betepe, 06800, Akara, Turke. e-mails : kadilar@hacettepe.edu.tr ; hcigi@hacettepe.edu.tr

More information

Improved exponential estimator for population variance using two auxiliary variables

Improved exponential estimator for population variance using two auxiliary variables OCTOGON MATHEMATICAL MAGAZINE Vol. 7, No., October 009, pp 667-67 ISSN -5657, ISBN 97-973-55-5-0, www.hetfalu.ro/octogo 667 Improved expoetial estimator for populatio variace usig two auxiliar variables

More information

Varanasi , India. Corresponding author

Varanasi , India. Corresponding author A Geeral Family of Estimators for Estimatig Populatio Mea i Systematic Samplig Usig Auxiliary Iformatio i the Presece of Missig Observatios Maoj K. Chaudhary, Sachi Malik, Jayat Sigh ad Rajesh Sigh Departmet

More information

SAMPLING LIPSCHITZ CONTINUOUS DENSITIES. 1. Introduction

SAMPLING LIPSCHITZ CONTINUOUS DENSITIES. 1. Introduction SAMPLING LIPSCHITZ CONTINUOUS DENSITIES OLIVIER BINETTE Abstract. A simple ad efficiet algorithm for geeratig radom variates from the class of Lipschitz cotiuous desities is described. A MatLab implemetatio

More information

Statistical inference: example 1. Inferential Statistics

Statistical inference: example 1. Inferential Statistics Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Dimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector

Dimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector Dimesio-free PAC-Bayesia bouds for the estimatio of the mea of a radom vector Olivier Catoi CREST CNRS UMR 9194 Uiversité Paris Saclay olivier.catoi@esae.fr Ilaria Giulii Laboratoire de Probabilités et

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

Joint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { }

Joint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { } UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig

More information

Lecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables

Lecture 01: the Central Limit Theorem. 1 Central Limit Theorem for i.i.d. random variables CSCI-B609: A Theorist s Toolkit, Fall 06 Aug 3 Lecture 0: the Cetral Limit Theorem Lecturer: Yua Zhou Scribe: Yua Xie & Yua Zhou Cetral Limit Theorem for iid radom variables Let us say that we wat to aalyze

More information

The Sample Variance Formula: A Detailed Study of an Old Controversy

The Sample Variance Formula: A Detailed Study of an Old Controversy The Sample Variace Formula: A Detailed Study of a Old Cotroversy Ky M. Vu PhD. AuLac Techologies Ic. c 00 Email: kymvu@aulactechologies.com Abstract The two biased ad ubiased formulae for the sample variace

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

This is an introductory course in Analysis of Variance and Design of Experiments.

This is an introductory course in Analysis of Variance and Design of Experiments. 1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

Discrete Orthogonal Moment Features Using Chebyshev Polynomials

Discrete Orthogonal Moment Features Using Chebyshev Polynomials Discrete Orthogoal Momet Features Usig Chebyshev Polyomials R. Mukuda, 1 S.H.Og ad P.A. Lee 3 1 Faculty of Iformatio Sciece ad Techology, Multimedia Uiversity 75450 Malacca, Malaysia. Istitute of Mathematical

More information

Research Article A New Second-Order Iteration Method for Solving Nonlinear Equations

Research Article A New Second-Order Iteration Method for Solving Nonlinear Equations Abstract ad Applied Aalysis Volume 2013, Article ID 487062, 4 pages http://dx.doi.org/10.1155/2013/487062 Research Article A New Secod-Order Iteratio Method for Solvig Noliear Equatios Shi Mi Kag, 1 Arif

More information

The Distribution of the Concentration Ratio for Samples from a Uniform Population

The Distribution of the Concentration Ratio for Samples from a Uniform Population Applied Mathematics, 05, 6, 57-70 Published Olie Jauary 05 i SciRes. http://www.scirp.or/joural/am http://dx.doi.or/0.436/am.05.6007 The Distributio of the Cocetratio Ratio for Samples from a Uiform Populatio

More information

Testing Statistical Hypotheses for Compare. Means with Vague Data

Testing Statistical Hypotheses for Compare. Means with Vague Data Iteratioal Mathematical Forum 5 o. 3 65-6 Testig Statistical Hypotheses for Compare Meas with Vague Data E. Baloui Jamkhaeh ad A. adi Ghara Departmet of Statistics Islamic Azad iversity Ghaemshahr Brach

More information

Some Properties of the Exact and Score Methods for Binomial Proportion and Sample Size Calculation

Some Properties of the Exact and Score Methods for Binomial Proportion and Sample Size Calculation Some Properties of the Exact ad Score Methods for Biomial Proportio ad Sample Size Calculatio K. KRISHNAMOORTHY AND JIE PENG Departmet of Mathematics, Uiversity of Louisiaa at Lafayette Lafayette, LA 70504-1010,

More information

Stat 200 -Testing Summary Page 1

Stat 200 -Testing Summary Page 1 Stat 00 -Testig Summary Page 1 Mathematicias are like Frechme; whatever you say to them, they traslate it ito their ow laguage ad forthwith it is somethig etirely differet Goethe 1 Large Sample Cofidece

More information

The Random Walk For Dummies

The Random Walk For Dummies The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli

More information

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10 DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set

More information

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS R775 Philips Res. Repts 26,414-423, 1971' THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS by H. W. HANNEMAN Abstract Usig the law of propagatio of errors, approximated

More information

Unbiased Estimation. February 7-12, 2008

Unbiased Estimation. February 7-12, 2008 Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

More information

Introducing Sample Proportions

Introducing Sample Proportions Itroducig Sample Proportios Probability ad statistics Aswers & Notes TI-Nspire Ivestigatio Studet 60 mi 7 8 9 0 Itroductio A 00 survey of attitudes to climate chage, coducted i Australia by the CSIRO,

More information

Statisticians use the word population to refer the total number of (potential) observations under consideration

Statisticians use the word population to refer the total number of (potential) observations under consideration 6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space

More information

Sampling Distributions, Z-Tests, Power

Sampling Distributions, Z-Tests, Power Samplig Distributios, Z-Tests, Power We draw ifereces about populatio parameters from sample statistics Sample proportio approximates populatio proportio Sample mea approximates populatio mea Sample variace

More information

A LARGER SAMPLE SIZE IS NOT ALWAYS BETTER!!!

A LARGER SAMPLE SIZE IS NOT ALWAYS BETTER!!! A LARGER SAMLE SIZE IS NOT ALWAYS BETTER!!! Nagaraj K. Neerchal Departmet of Mathematics ad Statistics Uiversity of Marylad Baltimore Couty, Baltimore, MD 2250 Herbert Lacayo ad Barry D. Nussbaum Uited

More information

Section 14. Simple linear regression.

Section 14. Simple linear regression. Sectio 14 Simple liear regressio. Let us look at the cigarette dataset from [1] (available to dowload from joural s website) ad []. The cigarette dataset cotais measuremets of tar, icotie, weight ad carbo

More information

On an Application of Bayesian Estimation

On an Application of Bayesian Estimation O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, Higashi-Osaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma

More information

Output Analysis and Run-Length Control

Output Analysis and Run-Length Control IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%

More information

Chapter 10: Power Series

Chapter 10: Power Series Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because

More information

ON POINTWISE BINOMIAL APPROXIMATION

ON POINTWISE BINOMIAL APPROXIMATION Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece

More information

On Bayesian Shrinkage Estimator of Parameter of Exponential Distribution with Outliers

On Bayesian Shrinkage Estimator of Parameter of Exponential Distribution with Outliers Pujab Uiversity Joural of Mathematics ISSN 1016-2526) Vol. 502)2018) pp. 11-19 O Bayesia Shrikage Estimator of Parameter of Expoetial Distributio with Outliers P. Nasiri Departmet of Statistics, Uiversity

More information

Day 8-3. Prakash Balachandran Department of Mathematics & Statistics Boston University. Friday, October 28, 2011

Day 8-3. Prakash Balachandran Department of Mathematics & Statistics Boston University. Friday, October 28, 2011 Day 8-3 Prakash Balachadra Departmet of Mathematics & Statistics Bosto Uiversity Friday, October 8, 011 Sectio 5.: Hypothesis Tests forµ Aoucemets: Tutorig: Math office i 111 Cummigto 1st floor, Rich Hall.

More information

Moment-entropy inequalities for a random vector

Moment-entropy inequalities for a random vector 1 Momet-etropy iequalities for a radom vector Erwi Lutwak, Deae ag, ad Gaoyog Zhag Abstract The p-th momet matrix is defied for a real radom vector, geeralizig the classical covariace matrix. Sharp iequalities

More information

The variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.

The variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2. SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample

More information

STATISTICAL INFERENCE

STATISTICAL INFERENCE STATISTICAL INFERENCE POPULATION AND SAMPLE Populatio = all elemets of iterest Characterized by a distributio F with some parameter θ Sample = the data X 1,..., X, selected subset of the populatio = sample

More information

IE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes.

IE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes. Closed book ad otes. No calculators. 120 miutes. Cover page, five pages of exam, ad tables for discrete ad cotiuous distributios. Score X i =1 X i / S X 2 i =1 (X i X ) 2 / ( 1) = [i =1 X i 2 X 2 ] / (

More information

Confidence Intervals for the Coefficients of Variation with Bounded Parameters

Confidence Intervals for the Coefficients of Variation with Bounded Parameters Vol:7, No:9, 03 Cofidece Itervals for the Coefficiets of Variatio with Bouded Parameters Jeerapa Sappakitkamjor, Sa-aat Niwitpog Iteratioal Sciece Idex, Mathematical ad Computatioal Scieces Vol:7, No:9,

More information

1 Constructing and Interpreting a Confidence Interval

1 Constructing and Interpreting a Confidence Interval Itroductory Applied Ecoometrics EEP/IAS 118 Sprig 2014 WARM UP: Match the terms i the table with the correct formula: Adrew Crae-Droesch Sectio #6 5 March 2014 ˆ Let X be a radom variable with mea µ ad

More information

( µ /σ)ζ/(ζ+1) µ /σ ( µ /σ)ζ/(ζ 1)

( µ /σ)ζ/(ζ+1) µ /σ ( µ /σ)ζ/(ζ 1) A eective CI for the mea with samples of size 1 ad Melaie Wall James Boe ad Richard Tweedie 1 Abstract It is couterituitive that with a sample of oly oe value from a ormal distributio oe ca costruct a

More information

SRC Technical Note June 17, Tight Thresholds for The Pure Literal Rule. Michael Mitzenmacher. d i g i t a l

SRC Technical Note June 17, Tight Thresholds for The Pure Literal Rule. Michael Mitzenmacher. d i g i t a l SRC Techical Note 1997-011 Jue 17, 1997 Tight Thresholds for The Pure Literal Rule Michael Mitzemacher d i g i t a l Systems Research Ceter 130 Lytto Aveue Palo Alto, Califoria 94301 http://www.research.digital.com/src/

More information

o <Xln <X2n <... <X n < o (1.1)

o <Xln <X2n <... <X n < o (1.1) Metrika, Volume 28, 1981, page 257-262. 9 Viea. Estimatio Problems for Rectagular Distributios (Or the Taxi Problem Revisited) By J.S. Rao, Sata Barbara I ) Abstract: The problem of estimatig the ukow

More information

1 Covariance Estimation

1 Covariance Estimation Eco 75 Lecture 5 Covariace Estimatio ad Optimal Weightig Matrices I this lecture, we cosider estimatio of the asymptotic covariace matrix B B of the extremum estimator b : Covariace Estimatio Lemma 4.

More information

Q-BINOMIALS AND THE GREATEST COMMON DIVISOR. Keith R. Slavin 8474 SW Chevy Place, Beaverton, Oregon 97008, USA.

Q-BINOMIALS AND THE GREATEST COMMON DIVISOR. Keith R. Slavin 8474 SW Chevy Place, Beaverton, Oregon 97008, USA. INTEGERS: ELECTRONIC JOURNAL OF COMBINATORIAL NUMBER THEORY 8 2008, #A05 Q-BINOMIALS AND THE GREATEST COMMON DIVISOR Keith R. Slavi 8474 SW Chevy Place, Beaverto, Orego 97008, USA slavi@dsl-oly.et Received:

More information

Sampling, Sampling Distribution and Normality

Sampling, Sampling Distribution and Normality 4/17/11 Tools of Busiess Statistics Samplig, Samplig Distributio ad ormality Preseted by: Mahedra Adhi ugroho, M.Sc Descriptive statistics Collectig, presetig, ad describig data Iferetial statistics Drawig

More information

Intermittent demand forecasting by using Neural Network with simulated data

Intermittent demand forecasting by using Neural Network with simulated data Proceedigs of the 011 Iteratioal Coferece o Idustrial Egieerig ad Operatios Maagemet Kuala Lumpur, Malaysia, Jauary 4, 011 Itermittet demad forecastig by usig Neural Network with simulated data Nguye Khoa

More information

Probabilistic and Average Linear Widths in L -Norm with Respect to r-fold Wiener Measure

Probabilistic and Average Linear Widths in L -Norm with Respect to r-fold Wiener Measure joural of approximatio theory 84, 3140 (1996) Article No. 0003 Probabilistic ad Average Liear Widths i L -Norm with Respect to r-fold Wieer Measure V. E. Maiorov Departmet of Mathematics, Techio, Haifa,

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

Decoupling Zeros of Positive Discrete-Time Linear Systems*

Decoupling Zeros of Positive Discrete-Time Linear Systems* Circuits ad Systems,,, 4-48 doi:.436/cs..7 Published Olie October (http://www.scirp.org/oural/cs) Decouplig Zeros of Positive Discrete-Time Liear Systems* bstract Tadeusz Kaczorek Faculty of Electrical

More information

Solutions: Homework 3

Solutions: Homework 3 Solutios: Homework 3 Suppose that the radom variables Y,...,Y satisfy Y i = x i + " i : i =,..., IID where x,...,x R are fixed values ad ",...," Normal(0, )with R + kow. Fid ˆ = MLE( ). IND Solutio: Observe

More information

Eigenvalue localization for complex matrices

Eigenvalue localization for complex matrices Electroic Joural of Liear Algebra Volume 7 Article 1070 014 Eigevalue localizatio for complex matrices Ibrahim Halil Gumus Adıyama Uiversity, igumus@adiyama.edu.tr Omar Hirzallah Hashemite Uiversity, o.hirzal@hu.edu.jo

More information

Eksamen 2006 H Utsatt SENSORVEILEDNING. Problem 1. Settet består av 9 delspørsmål som alle anbefales å telle likt. Svar er gitt i <<.. >>.

Eksamen 2006 H Utsatt SENSORVEILEDNING. Problem 1. Settet består av 9 delspørsmål som alle anbefales å telle likt. Svar er gitt i <<.. >>. Eco 43 Eksame 6 H Utsatt SENSORVEILEDNING Settet består av 9 delspørsmål som alle abefales å telle likt. Svar er gitt i . Problem a. Let the radom variable (rv.) X be expoetially distributed with

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information