International Journal of Mathematical Archive-5(7), 2014, Available online through ISSN

Size: px
Start display at page:

Download "International Journal of Mathematical Archive-5(7), 2014, Available online through ISSN"

Transcription

1 Iteratioal Joural of Mathematical Archive-5(7), 214, Available olie through ISSN USING SQUARED-LOG ERROR LOSS FUNCTION TO ESTIMATE THE SHAPE PARAMETER AND THE RELIABILITY FUNCTION OF PARETO TYPE I DISTRIBUTION Huda, A. Rasheed* Al-Mustasiriya Uiversity, Collage of Sciece, Dept. of Math., Iraq. Najam A. Aleawy Al-Gazi Math teacher at the Miistry of Eductio Dhi Qar Iraq. (Received o: ; Revised & Accepted o: ) ABSTRACT I this paper, we derived Bayes estimators for the shape parameter ad the reliability fuctio of the Pareto type I distributio uder Squared-Log error loss fuctio. I order to get better uderstadig of our Bayesia aalysis, we cosider o-iformative prior for the shape parameter Usig Jeffery prior Iformatio as well as iformative prior desity represeted by Expoetial prior. Accordig to Mote-Carlo simulatio study, the performace of these estimators is compared depedig o the mea square Errors ( s). Key words: Pareto distributio, Reliability fuctio, Maximum Likelihood Estimator, Bayes estimator, Squared-Log error loss fuctio, Jeffery prior ad Expoetial prior. 1. INTRODUCTION The Pareto distributio is amed after the ecoomist Vilfredo Pareto ( ), this distributio is first used as a model for the distributio of icomes a model for city populatio withi a give area, failure model i reliability theory [1] ad a queuig model i operatio research [5]. A radom variable X, is said to follow the two parameter Pareto distributio if its pdf is give by: θα θ ; x α, α >, θθ > (1) f(x; α, θ) = xθ+1, otherwise where α ad θ are the scale ad shape parameters respectively. The cumulative distributio fuctio (CDF) i its simplest form is give by: θ F(x; α, θ) = 1 α x, x α; α, θ >, otherwise So, the reliability fuctio is: R(t) = α t θ (2) (3) Correspodig author: Huda, A. Rasheed* Al-Mustasiriya Uiversity, Collage of Sciece, Dept. of Math., Iraq. Iteratioal Joural of Mathematical Archive- 5(7), July

2 Huda, A. Rasheed* ad Najam A. Aleawy Al-Gazi / Usig Squared-Log Error Loss Fuctio To Estimate The Shape Parameter ad The Reliability Fuctio of Pareto Type I Distributio / IJMA- 5(7), July-214. I this paper, for the simplificatio we ll assume that α = 1 2. MAXIMUM LIKELIHOOD ESTIMATOR Give x 1, x 2,, x a radom sample of size from Pareto distributio, we cosider estimatio usig Maximum likelihood method as follows: L(x 1,, x θ) = f(x ; θ) L(x 1,, x θ) = θ (θ+1) lx e The Log- likelihood fuctio is give by l L(x 1,, x θ) = l θ (θ + 1) l x i Differetiatig the log likelihood with respect to θ: [l L(x 1,, x θ)] = θ θ l x i Hece, the MLE of θ is: θ ML = l x i θ ML = T, where T = l x i (4) Usig the ivariat property, the MLER ML (t) for R(t) may be obtaied by replacig θ by its MLEθ ML i (3) [6] R ML (t) = 1 t θ ML (5) 3. BAYES ESTIMATOR UNDERSQUARED-LOG ERROR LOSS FUNCTION Bayes estimators for the shape parameter θ ad Reliability fuctio were cosidered uder squared-log error loss fuctio with o-iformative prior which represeted by Jeffrey prior ad iformative loss fuctio represeted by Expoetial prior where the Squared-log error loss fuctio is of the form: L θ, θ = l θ l θ 2 Which is balaced with LLLLLL L θ,θ as θ or. A balaced loss fuctio takes both error of estimatio ad goodess of fit ito accout but the ubalaced loss fuctio oly cosiders error of estimatio. This loss fuctio is covex for θ θ e ad cocave otherwise, but its risk fuctio has a uique miimum with respect to θ. [3] Accordig to the above metioed loss fuctios, we drive the correspodig Bayes' estimators for θ usig Risk fuctio R θ θ which miimizes the posterior risk R θ θ = E L θ, θ = l θ l θ 2 h(θ x 1.. x )dθ = (l θ ) 2 2 lθ E(l θ x) + E((l θ) 2 x) Rsik θ = 2 l θ 1 θ 2 E((l θ) x) θ By lettig, R θ θ = θ The Bayes estimator for the parameter θ of Pareto distributio uder the squared-log error loss fuctio is: θ = Exp[E(lθ x)] (6) 214, IJMA. All Rights Reserved 111

3 Huda, A. Rasheed* ad Najam A. Aleawy Al-Gazi / Usig Squared-Log Error Loss Fuctio To Estimate The Shape Parameter ad The Reliability Fuctio of Pareto Type I Distributio / IJMA- 5(7), July-214. Accordig to the Squared-Log error loss fuctio, the correspodig Bayes' estimator for the reliability fuctio will be: R (t) = Exp[E(lR(t) t)] (7) E(lR(t) t) = lr(t) h(θ t)dθ We have R(t) = 1 t θ Hece, E[lR(t)] = l 1 E[θ] (8) t Substitutig (8) i (7), we get: R (t) = Exp l 1 E[θ] (9) t 4. PRIOR AND POSTERIOR DISTRIBUTIONS I this paper, we cosider iformative as well as o-iformative prior desity for θ i order to get better uderstadig of our Bayesia aalysis as follows: (i) Bayes Estimator Usig Jeffery Prior Iformatio Let us assume that θ has o-iformative prior desity defied by usig Jeffrey prior iformatio g 1 (θ) which give by: g 1 (θ) I(θ) where I(θ) represets Fisher iformatio which defied as follows: I(θ) = E 2 lf θ 2 g 1 (θ) = C E 2 lf θ2 (1) lf(x; θ) = lθ (θ + 1)lx lf θ = 1 θ lx 2 lf θ 2 = 1 θ 2 E 2 lf θ 2 = 1 θ 2 After substitutio i (1) we fid that: g 1 (θ) = c θ So, the posterior distributio for θ usig Jeffery prior is: L(x 1,, x θ)g 1 (θ) h 1 (θ x) = L(x 1,, x θ)g 1 (θ)dθ θ e (θ+1) lx c θ = θ e (θ+1) lx c dθ θ = T θ 1 e θt Г() This posterior desity is recogized as the desity of the gamma distributio: (11) 214, IJMA. All Rights Reserved 112

4 Huda, A. Rasheed* ad Najam A. Aleawy Al-Gazi / Usig Squared-Log Error Loss Fuctio To Estimate The Shape Parameter ad The Reliability Fuctio of Pareto Type I Distributio / IJMA- 5(7), July-214. θ~gamma, l x i, with: E(θ) = Now,, ver(θ) = l x i ( l x i ) T E(lθ x) = Г() l θ θ 1 e θt dθ 2 Let y = θt Hece, T E(lθ x) = Г() = T 1 l y T y T dy y e T Г()T [l y l T]y 1 e y dy = l y y 1 e y dy l T y 1 e y dy Г() Г() E(lθ x) = φ() l T (12) Where, φ() = Г() is the digamma fuctio [5] Г() Substitutig (12) i (6), we get θ J = Exp φ() l T (13) Now, usig (9) to estimate Reliability fuctio we reach to: = Exp T l 1 (14) t We ca otice that is equivalet to the Maximum Likelihood Estimator for R(t). (ii) Posterior Distributio Usig Expoetial Prior Distributio Assumig that θ has iformative prior as Expoetial prior, which takes the followig form: g 2 (θ) = 1 λ e θ λ, θ, λ > So, the posterior distributio for the parameter θ give the data (x 1, x 2, x ) is: π f(x i θ)g 2 (θ) h 2 θ X = π f(x i θ)g 2 (θ)dθ The the posterior distributio became as follows: T + 1 ג +1 θ e θ T+1 ג h 2 (θ t) = Г( + 1) (15) This posterior desity is recogized as the desity of the gamma distributio where: θ~gamma + 1, 1 + l x λ i, With: E(θ) = 1 + l x, ver(θ) = λ i ( 1 + l x λ i) The Bayes estimator uder Squared-Log error loss fuctio will be: θ = Exp lθ h E 2 (θ t)dθ 2 214, IJMA. All Rights Reserved 113

5 Huda, A. Rasheed* ad Najam A. Aleawy Al-Gazi / Usig Squared-Log Error Loss Fuctio To Estimate The Shape Parameter ad The Reliability Fuctio of Pareto Type I Distributio / IJMA- 5(7), July-214. = lθ T θ e θ T+ λ Г( + 1) 1 λ dθ (16) Let y = θ T + 1 λ Substitutig i (16), we have: E(lθ x) = T λ y y l Г( + 1) T + 1 T + 1 λ λ By simplificatio, we get: E(lθ x) = φ( + 1) + l T + 1 λ e y dy T + 1 λ = ExP φ( + 1) + l T + 1 (17) λ Now, the correspodig Bayes estimator for with posterior distributio (15), come out as: = ExP ( + 1)l (1 ) t T + 1 λ 5. SIMULATION RESULTS I our simulatio study, we geerated I = 25 samples of sizes = 2, 5, ad1 from Pareto type I distributio to represet small, moderate ad large sample size with the shape parameter θ =.5, 1.5, 2.5 ad takig t = 1.5, 3. We chose two values of λ for the Expoetial prior (λ=.5, 3). I this sectio, Mote Carlo simulatio study is performed to compare the methods of estimatio by usig mea square Errors ( s) as a idex for precisio to compare the efficiecy of each of estimators, where: (θ ) = I θ i θ 2 I The results were summarized ad tabulated i the followig tables for each estimator ad for all sample sizes. 6- NUMERICAL VALUES OF ESTIMATOR (θθ ) The expectatios ad s for θθ are schedule i tables (1, 2, ad 3) accordig to the sequece of tables as follows: Table - 1: Expected Values ad s of the Parameter of Pareto Distributio with θ =.5 N Bayes(Jeffery) θ J λ= , IJMA. All Rights Reserved 114

6 Huda, A. Rasheed* ad Najam A. Aleawy Al-Gazi / Usig Squared-Log Error Loss Fuctio To Estimate The Shape Parameter ad The Reliability Fuctio of Pareto Type I Distributio / IJMA- 5(7), July-214. Table - 2: Expected Values ad s of the Parameter of Pareto Distributio with θ = 1.5 N θ J λ= Table - 3: Expected Values ad s of the Parameter of Pareto Distributio with θ = DISCUSSION N θ J λ= From tables (1, 2, 3) whe θ=.5, 1.5, 2.5, the simulatio results show that with λ=.5 was the best i performace, followed by θ J (which equivalet to R ML (t)) for differet size of samples. ad we ca otice that 's icreases with icreases of λ (λ =3). Fially for all sample sizes, a obvious icrease i is observed with the icrease of the shape parameter values. 8. NUMERICAL VALUES OF ESTIMATOR RR (tt) The umerical results are schedule i tables (4, 5, 6, 7, 8, ad 9) accordig to the sequece of tables as follows: Table - 4: Expected Values ad s of the Reliability Fuctio of Pareto Distributio with θ =.5, t = 1.5, (R(t) t=1.5 = ) λ= Table - 5: Expected Values ad s of the Reliability Fuctio of Pareto Distributio with θ =.5, t = 3, (R(t) t=3 = ) λ= , IJMA. All Rights Reserved 115

7 Huda, A. Rasheed* ad Najam A. Aleawy Al-Gazi / Usig Squared-Log Error Loss Fuctio To Estimate The Shape Parameter ad The Reliability Fuctio of Pareto Type I Distributio / IJMA- 5(7), July-214. Table - 6: Expected Values ad s of the Reliability Fuctio of Pareto Distributio with θ = 1.5, t = 1.5, (R(t) t=1.5 = ) λ= Table - 7: Expected values ad s of the Reliability Fuctio of Pareto Distributio with θ = 1.5, t = 3, (R(t) t=3 = ) λ= Table - 8: Expected Values ad s of the Reliability Fuctio of Pareto Distributio with θ = 2.5, t = 1.5, (R(t) t=1.5 = ) λ= Table - 9: Expected Values ad s of the Reliability Fuctio of Pareto Distributio with θ = 2.5, t = 3, (R(t) t=3 =.71278) λ= DISCUSSION From tables (4, 5, 6, 7) whe θ =.5, 1.5 ad t = 1.5, 3 the simulatio results shows that with all sample sizes, with λ=.5 was better i performace tha each of (which equivalet to MLE) ad with. Also tables (4, 5, 6, ad 7) shows that the results of estimators (icluded MLE) are closed especially with large sample sizes. 214, IJMA. All Rights Reserved 116

8 Huda, A. Rasheed* ad Najam A. Aleawy Al-Gazi / Usig Squared-Log Error Loss Fuctio To Estimate The Shape Parameter ad The Reliability Fuctio of Pareto Type I Distributio / IJMA- 5(7), July-214. Tables (8, 9) showig that, with a large value of θ, (θ = 2.5) s is decreases with icreasig of λ (λ = 3) for the Bayes estimator with expoetial prior so, we ca say that with is better tha each of the estimator with Jeffery prior (MLE) ad with λ=.5. I geeral, we coclude that i situatios ivolvig estimatio of parameter Reliability fuctio of Pareto type I distributio uder Squared-Log error loss fuctio, usig expoetial prior with small value of λ (λ =.5) is more appropriate tha usig Jeffery prior (or MLE) whe t,θ are small relatively (t=1.5, θ =.5). Otherwise usig expoetial prior with large value of λ (λ = 3) is better tha usig Jeffery prior (or MLE). REFERENCES [1] Nadarajah, S. & Kots, S., Reliability i Pareto models, Metro, Iteratioal, Joural of statistic, vol. LXI, No.2, (23), [2] Podder, C.K., Compariso of Two Risk Fuctios Usig Pareto distributio, pak. J. States. Vol. 2(3), (24), [3] Dey, S., Bayesia Estimatio of the Parameter of the Geeralized Expoetial Distributio uder Differet Loss Fuctios, Pak. J. Stat. Oper. Res., Vol.6, No.2, (21), [4] Setiya, P. & Kumar, V. BAYESIAN ESTIMATION IN PARETO TYPE-I MODEL", Joural of Reliability ad Statistical Studies; ISSN (Prit): , (Olie): Vol. 6, Issue 2 (213), [5] Shortle, J & Fischer, M., Usig the Pareto distributio i queuig modelig, Submitted Joural of probability ad Statistical Sciece, (25), 1 4. [6] Sigh, S. K., Sigh, U. ad Kumar, D. Bayesia Estimatio of the Expoetiated Gamma Parameter ad Reliability Fuctio uder Asymmetric Loss Fuctio. REVSTAT Statistical Joural, vol. 9, o.3, (211), Source of support: Nil, Coflict of iterest: Noe Declared [Copy right 214 This is a Ope Access article distributed uder the terms of the Iteratioal Joural of Mathematical Archive (IJMA), which permits urestricted use, distributio, ad reproductio i ay medium, provided the origial work is properly cited.] 214, IJMA. All Rights Reserved 117

Bayesian inference for Parameter and Reliability function of Inverse Rayleigh Distribution Under Modified Squared Error Loss Function

Bayesian inference for Parameter and Reliability function of Inverse Rayleigh Distribution Under Modified Squared Error Loss Function Australia Joural of Basic ad Applied Scieces, (6) November 26, Pages: 24-248 AUSTRALIAN JOURNAL OF BASIC AND APPLIED SCIENCES ISSN:99-878 EISSN: 239-844 Joural home page: www.ajbasweb.com Bayesia iferece

More information

Bayes Estimators for the Shape Parameter of Pareto Type I. Distribution under Generalized Square Error Loss Function

Bayes Estimators for the Shape Parameter of Pareto Type I. Distribution under Generalized Square Error Loss Function Mathematical Theory ad Modelig ISSN 2224-584 (aper) ISSN 2225-522 (Olie) Vol.4, No.11, 214 Bayes Estimators for the Shape arameter of areto Type I Distributio uder Geeralized Square Error Loss Fuctio Dr.

More information

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function Iteratioal Joural of Statistics ad Systems ISSN 973-2675 Volume 12, Number 4 (217), pp. 791-796 Research Idia Publicatios http://www.ripublicatio.com Bayesia ad E- Bayesia Method of Estimatio of Parameter

More information

Minimax Estimation of the Parameter of Maxwell Distribution Under Different Loss Functions

Minimax Estimation of the Parameter of Maxwell Distribution Under Different Loss Functions America Joural of heoretical ad Applied Statistics 6; 5(4): -7 http://www.sciecepublishiggroup.com/j/ajtas doi:.648/j.ajtas.654.6 ISSN: 6-8999 (Prit); ISSN: 6-96 (Olie) Miimax Estimatio of the Parameter

More information

Al- Mustansiriyah J. Sci. Vol. 24, No 5, 2013

Al- Mustansiriyah J. Sci. Vol. 24, No 5, 2013 Al- Mustasiriyah J. Sci. Vol. 24, No 5, 23 Usig Etropy Loss Fuctio to Estimate the Scale Parameter for Laplace Distributio Huda A. Rasheed, Akbal J. Sulta ad Nadia J. Fazah Departmet of Mathematics, college

More information

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values

More information

The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution

The Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution Iteratioal Mathematical Forum, Vol. 8, 2013, o. 26, 1263-1277 HIKARI Ltd, www.m-hikari.com http://d.doi.org/10.12988/imf.2013.3475 The Samplig Distributio of the Maimum Likelihood Estimators for the Parameters

More information

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical

More information

International Journal of Mathematical Archive-7(6), 2016, Available online through ISSN

International Journal of Mathematical Archive-7(6), 2016, Available online through   ISSN Iteratioal Joural of Mathematical Archive-7(6, 06, 04-0 Available olie through www.ijma.ifo ISSN 9 5046 COMMON FIED POINT THEOREM FOR FOUR WEAKLY COMPATIBLE SELFMAPS OF A COMPLETE G METRIC SPACE J. NIRANJAN

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

Review Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn

Review Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn Stat 366 Lab 2 Solutios (September 2, 2006) page TA: Yury Petracheko, CAB 484, yuryp@ualberta.ca, http://www.ualberta.ca/ yuryp/ Review Questios, Chapters 8, 9 8.5 Suppose that Y, Y 2,..., Y deote a radom

More information

Modeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy

Modeling and Estimation of a Bivariate Pareto Distribution using the Principle of Maximum Entropy Sri Laka Joural of Applied Statistics, Vol (5-3) Modelig ad Estimatio of a Bivariate Pareto Distributio usig the Priciple of Maximum Etropy Jagathath Krisha K.M. * Ecoomics Research Divisio, CSIR-Cetral

More information

The (P-A-L) Generalized Exponential Distribution: Properties and Estimation

The (P-A-L) Generalized Exponential Distribution: Properties and Estimation Iteratioal Mathematical Forum, Vol. 12, 2017, o. 1, 27-37 HIKARI Ltd, www.m-hikari.com https://doi.org/10.12988/imf.2017.610140 The (P-A-L) Geeralized Expoetial Distributio: Properties ad Estimatio M.R.

More information

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution METRON - Iteratioal Joural of Statistics 004, vol. LXII,. 3, pp. 377-389 NAGI S. ABD-EL-HAKIM KHALAF S. SULTAN Maximum likelihood estimatio from record-breakig data for the geeralized Pareto distributio

More information

1.010 Uncertainty in Engineering Fall 2008

1.010 Uncertainty in Engineering Fall 2008 MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Record Values from T-X Family of. Pareto-Exponential Distribution with. Properties and Simulations

Record Values from T-X Family of. Pareto-Exponential Distribution with. Properties and Simulations Applied Mathematical Scieces, Vol. 3, 209, o., 33-44 HIKARI Ltd, www.m-hikari.com https://doi.org/0.2988/ams.209.879 Record Values from T-X Family of Pareto-Epoetial Distributio with Properties ad Simulatios

More information

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the

More information

G. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan

G. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Maximum Likelihood Estimation

Maximum Likelihood Estimation ECE 645: Estimatio Theory Sprig 2015 Istructor: Prof. Staley H. Cha Maximum Likelihood Estimatio (LaTeX prepared by Shaobo Fag) April 14, 2015 This lecture ote is based o ECE 645(Sprig 2015) by Prof. Staley

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

Lecture 11 and 12: Basic estimation theory

Lecture 11 and 12: Basic estimation theory Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis

More information

Lecture 7: Properties of Random Samples

Lecture 7: Properties of Random Samples Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com

More information

AAEC/ECON 5126 FINAL EXAM: SOLUTIONS

AAEC/ECON 5126 FINAL EXAM: SOLUTIONS AAEC/ECON 5126 FINAL EXAM: SOLUTIONS SPRING 2015 / INSTRUCTOR: KLAUS MOELTNER This exam is ope-book, ope-otes, but please work strictly o your ow. Please make sure your ame is o every sheet you re hadig

More information

Some Exponential Ratio-Product Type Estimators using information on Auxiliary Attributes under Second Order Approximation

Some Exponential Ratio-Product Type Estimators using information on Auxiliary Attributes under Second Order Approximation ; [Formerly kow as the Bulleti of Statistics & Ecoomics (ISSN 097-70)]; ISSN 0975-556X; Year: 0, Volume:, Issue Number: ; It. j. stat. eco.; opyright 0 by ESER Publicatios Some Expoetial Ratio-Product

More information

Comparison of Methods for Estimation of Sample Sizes under the Weibull Distribution

Comparison of Methods for Estimation of Sample Sizes under the Weibull Distribution Iteratioal Joural of Applied Egieerig Research ISSN 0973-4562 Volume 12, Number 24 (2017) pp. 14273-14278 Research Idia Publicatios. http://www.ripublicatio.com Compariso of Methods for Estimatio of Sample

More information

Estimation of Gumbel Parameters under Ranked Set Sampling

Estimation of Gumbel Parameters under Ranked Set Sampling Joural of Moder Applied Statistical Methods Volume 13 Issue 2 Article 11-2014 Estimatio of Gumbel Parameters uder Raked Set Samplig Omar M. Yousef Al Balqa' Applied Uiversity, Zarqa, Jorda, abuyaza_o@yahoo.com

More information

Statistical Theory MT 2008 Problems 1: Solution sketches

Statistical Theory MT 2008 Problems 1: Solution sketches Statistical Theory MT 008 Problems : Solutio sketches. Which of the followig desities are withi a expoetial family? Explai your reasoig. a) Let 0 < θ < ad put fx, θ) = θ)θ x ; x = 0,,,... b) c) where α

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes.

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes. Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely

More information

Statistical Theory MT 2009 Problems 1: Solution sketches

Statistical Theory MT 2009 Problems 1: Solution sketches Statistical Theory MT 009 Problems : Solutio sketches. Which of the followig desities are withi a expoetial family? Explai your reasoig. (a) Let 0 < θ < ad put f(x, θ) = ( θ)θ x ; x = 0,,,... (b) (c) where

More information

Comparison of Minimum Initial Capital with Investment and Non-investment Discrete Time Surplus Processes

Comparison of Minimum Initial Capital with Investment and Non-investment Discrete Time Surplus Processes The 22 d Aual Meetig i Mathematics (AMM 207) Departmet of Mathematics, Faculty of Sciece Chiag Mai Uiversity, Chiag Mai, Thailad Compariso of Miimum Iitial Capital with Ivestmet ad -ivestmet Discrete Time

More information

A New Distribution Using Sine Function- Its Application To Bladder Cancer Patients Data

A New Distribution Using Sine Function- Its Application To Bladder Cancer Patients Data J. Stat. Appl. Pro. 4, No. 3, 417-47 015 417 Joural of Statistics Applicatios & Probability A Iteratioal Joural http://dx.doi.org/10.1785/jsap/040309 A New Distributio Usig Sie Fuctio- Its Applicatio To

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

Asymptotics. Hypothesis Testing UMP. Asymptotic Tests and p-values

Asymptotics. Hypothesis Testing UMP. Asymptotic Tests and p-values of the secod half Biostatistics 6 - Statistical Iferece Lecture 6 Fial Exam & Practice Problems for the Fial Hyu Mi Kag Apil 3rd, 3 Hyu Mi Kag Biostatistics 6 - Lecture 6 Apil 3rd, 3 / 3 Rao-Blackwell

More information

Solutions: Homework 3

Solutions: Homework 3 Solutios: Homework 3 Suppose that the radom variables Y,...,Y satisfy Y i = x i + " i : i =,..., IID where x,...,x R are fixed values ad ",...," Normal(0, )with R + kow. Fid ˆ = MLE( ). IND Solutio: Observe

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

f(x) dx as we do. 2x dx x also diverges. Solution: We compute 2x dx lim

f(x) dx as we do. 2x dx x also diverges. Solution: We compute 2x dx lim Math 3, Sectio 2. (25 poits) Why we defie f(x) dx as we do. (a) Show that the improper itegral diverges. Hece the improper itegral x 2 + x 2 + b also diverges. Solutio: We compute x 2 + = lim b x 2 + =

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Surveying the Variance Reduction Methods

Surveying the Variance Reduction Methods Iteratioal Research Joural of Applied ad Basic Scieces 2013 Available olie at www.irjabs.com ISSN 2251-838X / Vol, 7 (7): 427-432 Sciece Explorer Publicatios Surveyig the Variace Reductio Methods Arash

More information

ANOTHER WEIGHTED WEIBULL DISTRIBUTION FROM AZZALINI S FAMILY

ANOTHER WEIGHTED WEIBULL DISTRIBUTION FROM AZZALINI S FAMILY ANOTHER WEIGHTED WEIBULL DISTRIBUTION FROM AZZALINI S FAMILY Sulema Nasiru, MSc. Departmet of Statistics, Faculty of Mathematical Scieces, Uiversity for Developmet Studies, Navrogo, Upper East Regio, Ghaa,

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 4, Issue 6, December 2014

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 4, Issue 6, December 2014 Bayesian Estimation for the Reliability Function of Pareto Type I Distribution under Generalized Square Error Loss Function Dr. Huda A. Rasheed, Najam A. Aleawy Al-Gazi Abstract The main objective of this

More information

POWER AKASH DISTRIBUTION AND ITS APPLICATION

POWER AKASH DISTRIBUTION AND ITS APPLICATION POWER AKASH DISTRIBUTION AND ITS APPLICATION Rama SHANKER PhD, Uiversity Professor, Departmet of Statistics, College of Sciece, Eritrea Istitute of Techology, Asmara, Eritrea E-mail: shakerrama009@gmail.com

More information

LECTURE NOTES 9. 1 Point Estimation. 1.1 The Method of Moments

LECTURE NOTES 9. 1 Point Estimation. 1.1 The Method of Moments LECTURE NOTES 9 Poit Estimatio Uder the hypothesis that the sample was geerated from some parametric statistical model, a atural way to uderstad the uderlyig populatio is by estimatig the parameters of

More information

Improved Class of Ratio -Cum- Product Estimators of Finite Population Mean in two Phase Sampling

Improved Class of Ratio -Cum- Product Estimators of Finite Population Mean in two Phase Sampling Global Joural of Sciece Frotier Research: F Mathematics ad Decisio Scieces Volume 4 Issue 2 Versio.0 Year 204 Type : Double Blid Peer Reviewed Iteratioal Research Joural Publisher: Global Jourals Ic. (USA

More information

The Expectation-Maximization (EM) Algorithm

The Expectation-Maximization (EM) Algorithm The Expectatio-Maximizatio (EM) Algorithm Readig Assigmets T. Mitchell, Machie Learig, McGraw-Hill, 997 (sectio 6.2, hard copy). S. Gog et al. Dyamic Visio: From Images to Face Recogitio, Imperial College

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

A Method of Proposing New Distribution and its Application to Bladder Cancer Patients Data

A Method of Proposing New Distribution and its Application to Bladder Cancer Patients Data J. Stat. Appl. Pro. Lett. 2, No. 3, 235-245 (2015) 235 Joural of Statistics Applicatios & Probability Letters A Iteratioal Joural http://dx.doi.org/10.12785/jsapl/020306 A Method of Proposig New Distributio

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Questions and Answers on Maximum Likelihood

Questions and Answers on Maximum Likelihood Questios ad Aswers o Maximum Likelihood L. Magee Fall, 2008 1. Give: a observatio-specific log likelihood fuctio l i (θ) = l f(y i x i, θ) the log likelihood fuctio l(θ y, X) = l i(θ) a data set (x i,

More information

Stat410 Probability and Statistics II (F16)

Stat410 Probability and Statistics II (F16) Some Basic Cocepts of Statistical Iferece (Sec 5.) Suppose we have a rv X that has a pdf/pmf deoted by f(x; θ) or p(x; θ), where θ is called the parameter. I previous lectures, we focus o probability problems

More information

Direction: This test is worth 150 points. You are required to complete this test within 55 minutes.

Direction: This test is worth 150 points. You are required to complete this test within 55 minutes. Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem

More information

Bayesian Methods: Introduction to Multi-parameter Models

Bayesian Methods: Introduction to Multi-parameter Models Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested

More information

Bounds for the Positive nth-root of Positive Integers

Bounds for the Positive nth-root of Positive Integers Pure Mathematical Scieces, Vol. 6, 07, o., 47-59 HIKARI Ltd, www.m-hikari.com https://doi.org/0.988/pms.07.7 Bouds for the Positive th-root of Positive Itegers Rachid Marsli Mathematics ad Statistics Departmet

More information

Bayesian Control Charts for the Two-parameter Exponential Distribution

Bayesian Control Charts for the Two-parameter Exponential Distribution Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com 2 Uiversity of the Free State Abstract By usig data that are the mileages

More information

Lecture 10 October Minimaxity and least favorable prior sequences

Lecture 10 October Minimaxity and least favorable prior sequences STATS 300A: Theory of Statistics Fall 205 Lecture 0 October 22 Lecturer: Lester Mackey Scribe: Brya He, Rahul Makhijai Warig: These otes may cotai factual ad/or typographic errors. 0. Miimaxity ad least

More information

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE Vol. 8 o. Joural of Systems Sciece ad Complexity Apr., 5 MOMET-METHOD ESTIMATIO BASED O CESORED SAMPLE I Zhogxi Departmet of Mathematics, East Chia Uiversity of Sciece ad Techology, Shaghai 37, Chia. Email:

More information

CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION

CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION 4. Itroductio Numerous bivariate discrete distributios have bee defied ad studied (see Mardia, 97 ad Kocherlakota ad Kocherlakota, 99) based o various methods

More information

6. Sufficient, Complete, and Ancillary Statistics

6. Sufficient, Complete, and Ancillary Statistics Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary

More information

The Minimum Distance Energy for Polygonal Unknots

The Minimum Distance Energy for Polygonal Unknots The Miimum Distace Eergy for Polygoal Ukots By:Johaa Tam Advisor: Rollad Trapp Abstract This paper ivestigates the eergy U MD of polygoal ukots It provides equatios for fidig the eergy for ay plaar regular

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Department of Mathematics

Department of Mathematics Departmet of Mathematics Ma 3/103 KC Border Itroductio to Probability ad Statistics Witer 2017 Lecture 19: Estimatio II Relevat textbook passages: Larse Marx [1]: Sectios 5.2 5.7 19.1 The method of momets

More information

Statistics for Applications. Chapter 3: Maximum Likelihood Estimation 1/23

Statistics for Applications. Chapter 3: Maximum Likelihood Estimation 1/23 18.650 Statistics for Applicatios Chapter 3: Maximum Likelihood Estimatio 1/23 Total variatio distace (1) ( ) Let E,(IPθ ) θ Θ be a statistical model associated with a sample of i.i.d. r.v. X 1,...,X.

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

SYSTEMATIC SAMPLING FOR NON-LINEAR TREND IN MILK YIELD DATA

SYSTEMATIC SAMPLING FOR NON-LINEAR TREND IN MILK YIELD DATA Joural of Reliability ad Statistical Studies; ISS (Prit): 0974-804, (Olie):9-5666 Vol. 7, Issue (04): 57-68 SYSTEMATIC SAMPLIG FOR O-LIEAR TRED I MILK YIELD DATA Tauj Kumar Padey ad Viod Kumar Departmet

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

Stat 421-SP2012 Interval Estimation Section

Stat 421-SP2012 Interval Estimation Section Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible

More information

Control Charts for Mean for Non-Normally Correlated Data

Control Charts for Mean for Non-Normally Correlated Data Joural of Moder Applied Statistical Methods Volume 16 Issue 1 Article 5 5-1-017 Cotrol Charts for Mea for No-Normally Correlated Data J. R. Sigh Vikram Uiversity, Ujjai, Idia Ab Latif Dar School of Studies

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

Simulation. Two Rule For Inverting A Distribution Function

Simulation. Two Rule For Inverting A Distribution Function Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump

More information

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series Applied Mathematical Scieces, Vol. 7, 03, o. 6, 3-337 HIKARI Ltd, www.m-hikari.com http://d.doi.org/0.988/ams.03.3430 Compariso Study of Series Approimatio ad Covergece betwee Chebyshev ad Legedre Series

More information

Maximum Likelihood Estimation and Complexity Regularization

Maximum Likelihood Estimation and Complexity Regularization ECE90 Sprig 004 Statistical Regularizatio ad Learig Theory Lecture: 4 Maximum Likelihood Estimatio ad Complexity Regularizatio Lecturer: Rob Nowak Scribe: Pam Limpiti Review : Maximum Likelihood Estimatio

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y

More information

ECE 901 Lecture 13: Maximum Likelihood Estimation

ECE 901 Lecture 13: Maximum Likelihood Estimation ECE 90 Lecture 3: Maximum Likelihood Estimatio R. Nowak 5/7/009 The focus of this lecture is to cosider aother approach to learig based o maximum likelihood estimatio. Ulike earlier approaches cosidered

More information

The new class of Kummer beta generalized distributions

The new class of Kummer beta generalized distributions The ew class of Kummer beta geeralized distributios Rodrigo Rossetto Pescim 12 Clarice Garcia Borges Demétrio 1 Gauss Moutiho Cordeiro 3 Saralees Nadarajah 4 Edwi Moisés Marcos Ortega 1 1 Itroductio Geeralized

More information

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test.

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test. Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal

More information

Extreme Value Theory in Civil Engineering

Extreme Value Theory in Civil Engineering Extreme Value Theory i Civil Egieerig Baidurya Bhattacharya Dept of Civil Egieerig IIT Kharagpur December 2016 Homepage: www.facweb.iitkgp.eret.i/~baidurya/ Prelimiaries: Retur period IID radom variables

More information

GUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)*

GUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)* GUIDE FOR THE USE OF THE DECISION SUPPORT SYSTEM (DSS)* *Note: I Frech SAD (Système d Aide à la Décisio) 1. Itroductio to the DSS Eightee statistical distributios are available i HYFRAN-PLUS software to

More information

Unbiased Estimation. February 7-12, 2008

Unbiased Estimation. February 7-12, 2008 Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

More information

Monte Carlo Integration

Monte Carlo Integration Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

Exponential Families and Bayesian Inference

Exponential Families and Bayesian Inference Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

Power Comparison of Some Goodness-of-fit Tests

Power Comparison of Some Goodness-of-fit Tests Florida Iteratioal Uiversity FIU Digital Commos FIU Electroic Theses ad Dissertatios Uiversity Graduate School 7-6-2016 Power Compariso of Some Goodess-of-fit Tests Tiayi Liu tliu019@fiu.edu DOI: 10.25148/etd.FIDC000750

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio

More information

Inference of Bivariate Generalized Exponential. Distribution Based on Copula Functions

Inference of Bivariate Generalized Exponential. Distribution Based on Copula Functions Applied Mathematical Scieces, Vol. 11, 2017, o. 24, 1155-1186 HIKARI Ltd, www.m-hikari.com https://doi.org/10.12988/ams.2017.7398 Iferece of Bivariate Geeralized Expoetial Distributio Based o Copula Fuctios

More information

( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2

( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2 82 CHAPTER 4. MAXIMUM IKEIHOOD ESTIMATION Defiitio: et X be a radom sample with joit p.m/d.f. f X x θ. The geeralised likelihood ratio test g.l.r.t. of the NH : θ H 0 agaist the alterative AH : θ H 1,

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

Chapter 2 The Monte Carlo Method

Chapter 2 The Monte Carlo Method Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful

More information

Last Lecture. Unbiased Test

Last Lecture. Unbiased Test Last Lecture Biostatistics 6 - Statistical Iferece Lecture Uiformly Most Powerful Test Hyu Mi Kag March 8th, 3 What are the typical steps for costructig a likelihood ratio test? Is LRT statistic based

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information