Faculty Research Interest Seminar Department of Biostatistics, GSPH University of Pittsburgh. Gong Tang Feb. 18, 2005

Size: px
Start display at page:

Download "Faculty Research Interest Seminar Department of Biostatistics, GSPH University of Pittsburgh. Gong Tang Feb. 18, 2005"

Transcription

1 Faculty Research Iterest Semar Departmet of Bostatstcs, GSPH Uversty of Pttsburgh Gog ag Feb. 8, 25

2 Itroducto Joed the departmet 2. each two courses: Elemets of Stochastc Processes (Bostat 24). Aalyss of Icomplete Data (Bostat 265). Some research terests: Statstcal Aalyss of Mssg Data. Aalyss of Correlated Outcomes. Sem-Parametrc Statstcs. Statstca of the Bostatstcal Ceter of NSABP ( Work o cacer clcal trals. Recetly volved studes to vestgate the assocato betwee geomc data ad clcal outcomes (wth Drs. Joh Bryat ad Joe Costato).

3 A Iterestg Pheomeo Pseudolkelhood method Lkelhood fucto of : L( ; α) = L( α). : parameter of terest; α: ussace parameter. ˆ α s a cosstet estmator of α; α s the true value. Cosder ˆ = arg max L( α ; ) ad = arg max L( ; ˆ α) <pseudolkelhood estmate>. I some crcumstaces, var( ) < var( ˆ ). Demostrate through a mssg-data problem. Questo: how to mprove the effcecy whe α s actually kow, from other source?

4 Bvarate data wth outcome-depedet orespose Model assumptos: ( a) X f( x; α), [ Y X] g( y x, ). ( b) Pr[ R= X, Y ] = w( y; ψ ). A codtoal lkelhood method m L( ; F) = p( x y ;, F) (for x R, gve y ) m g( y x, ), m=# of c.c. g( y x, ) df( x) where F( x) = F( x; α ) represets the true CDF of X. ˆ = arg max L( ; F) = arg max L( ; F( x; ˆ α)), where ˆ α = arg max f( x; α). α X Y R = R =

5 Full lkelhood for 2-patter data Model assumptos: ( a) X f( x α), [ Y X] g( y x, ). ( b) Pr[ R= X, Y ] = w( y ψ ). Full lkelhood: m L ( αψ,, ) = f( x α) g( y x, ) w( y ψ) Full m+ f( x α) g( y x, ){ w( y ψ )} dy m m+ = { f ( x α) } [{ g( y x, ) w( y ψ)} g( y x, ){ w( y ψ)} dy] = L( α) L( ψ, ) X Y R = R =

6 Asymptotc Varace of ˆ Let l( ) = log L( ; α), from ˆ = arg max L( ; α ), the = l ( ˆ α ; ) l ( ; α) + l ( ; α)( ˆ ) ˆ herefore, l ( ; α ) l ( ; α) E( l,) l, ( ; α). ( ) { } Var( ( ˆ )) E( l ) Var( l ( ; α )) E( l ),,, = El ( ) El ( l ) El ( ),,,,, (A sadwch-type estmator).

7 Asymptotc Varace of (I) Let S( α ) = log f( x; α), ˆ α = arg max f( x; α) s MLE of α, ( ˆ α α ) ( ) (, ( ) ). ESαα Sα, N ESαα From = arg max ( ; ˆ) arg max ( ; ˆ L α = l α), = l ( ; ˆ α) l ( ; ˆ α) + l ( ; ˆ α) ( ), the ( ) { } α l ( ; ˆ α) l ( ; ˆ α) l ( ˆ ; α) + lα ( α α) E( l,) El l El (,) {, ( α,) ES ( αα ) Sα, }.

8 Asymptotc Varace of (II) From ( ) ( ) { ( ) ( ) El, l, Elα, ESαα Sα, Var( ( )) El ( ) { El ( l ),,, El ( S ) E( S ) E( l },, α, αα α, El l l ( α,) ES ( αα ) ES ( α, l, ) El ( α,) ES ( αα ) E( α, ) } E(,). O the other had, = E( l ) = l,, = l, ( α, ) f( x; α) g( y x; ) p( r x, y ; ψ) dx dy dr ( α, ) L( α) L(, ψ) dµ So, = El (, ) = El ( α, ) + S l,, L( ) L(, ) d α α ψ µ α = El ( ) + ES ( l ) = El ( ) + ES ( l ). herefore, α, α,, α, α,, Var( ( )) E( l ) { E( l l ) El ( ) E( S ) El ( ) } El ( ),,, α, αα α,, )

9 Aother Pseudolkelhood Estmator Whe the fuctoal form of = arg max L( ; F ) m m j= F( x) g( y x, ) = arg m ax, g( y x, ) df ( x) j s ukow, let = arg max g( y x, ), ( PL2 ) g( y x, ) where, F ( x) = I( x x) s the emprcal dstrbuto of X. Smulato studes suggest that s eve more effcet eve though t has o assumpto o F( x). X Y R = R =

10 Auxlary Iformato If F( x) = F( x; α ) s kow, for example, some survey studes, ca we get more effcet estmator? Aswer: yes, wth emprcal lkelhood.

11 Emprcal Lkelhood " Emprcal lkelhood s a oparametrc method of ferece based o a data-drve lkelhood rato fucto" (Art Owe). Suppose { x} s a radom sample of X F( x), estmator for F( x) s F( x) = I{ x x}, the the o-parametrc or p s maxmzed subject to p =, where p = pr{ X = x}. Wth auxlary formato Ewx ( ( )) = avalable, the emprcal lkelhood estmator maxmzes p subject to costrats p = ad pw( x ) =.

12 Icorporate Auxlary Iformato For example, EX ( ) = µ s kow. he PL2 estmator solves the estmatg equatos New estmator: = l ( ; F ) = l ( ; F )., () Maxmzes p subject to costrats p = ad p ( x µ ) =. Get {p ˆ }. () Let solves = p ˆ l ( ; F ), the, ( ) = ( ) { ( ( ; )) ( ) ( ) ( )}( ). Var El Var l F E l x Var x E xl El X Y R = R =

13 X Y A smulato study Complete data: () [ x] N(,), (2) [ y x] N( + x,). Mssg-data mechasm: pr[ R = x, y] =Φ( y -). Compare the performace of the PL ad EL estmates for the regresso model (2), where β β σ = 2 =(,, ) (,,). Note: sample sze =3, average # of c.c.=5.

14 Smulato results able: emprcal bases ad stadard devatos of two estmators over replcates Methods β β σ 2 PL.2 (.33).9 (.5).5 (.97) EL.2 (.29).7 (.).9 (.86)

15 Referece ag, Lttle ad Raghuatha. Aalyss of multvarate mssg data wth ogorable orespose. Bometrka, vol. 9, pp , 23. ag, Lttle ad Raghuatha. Aalyss of multvarate mootoe mssg data by a pseudolkelhood method. Proceedgs of the 2 d Seattle Symposum Bostatstcs: Aalyss of Correlated Data. Lecture Notes Statstcs, Vol. 79. Edtor, D. L ad P.J. Heagerty. 25. A upublshed mauscrpt.

A New Family of Transformations for Lifetime Data

A New Family of Transformations for Lifetime Data Proceedgs of the World Cogress o Egeerg 4 Vol I, WCE 4, July - 4, 4, Lodo, U.K. A New Famly of Trasformatos for Lfetme Data Lakhaa Watthaacheewakul Abstract A famly of trasformatos s the oe of several

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:

More information

Chapter 8: Statistical Analysis of Simulated Data

Chapter 8: Statistical Analysis of Simulated Data Marquette Uversty MSCS600 Chapter 8: Statstcal Aalyss of Smulated Data Dael B. Rowe, Ph.D. Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 08 by Marquette Uversty MSCS600 Ageda 8. The Sample

More information

BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL DISTRIBUTION

BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL DISTRIBUTION Iteratoal Joural of Mathematcs ad Statstcs Studes Vol.4, No.3, pp.5-39, Jue 06 Publshed by Europea Cetre for Research Trag ad Developmet UK (www.eajourals.org BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL

More information

Bayesian Inferences for Two Parameter Weibull Distribution Kipkoech W. Cheruiyot 1, Abel Ouko 2, Emily Kirimi 3

Bayesian Inferences for Two Parameter Weibull Distribution Kipkoech W. Cheruiyot 1, Abel Ouko 2, Emily Kirimi 3 IOSR Joural of Mathematcs IOSR-JM e-issn: 78-578, p-issn: 9-765X. Volume, Issue Ver. II Ja - Feb. 05, PP 4- www.osrjourals.org Bayesa Ifereces for Two Parameter Webull Dstrbuto Kpkoech W. Cheruyot, Abel

More information

Parameter Estimation in Generalized Linear Models through

Parameter Estimation in Generalized Linear Models through It. Statstcal Ist.: Proc. 58th World Statstcal Cogress,, Dubl (Sesso CPS3 p.463 Parameter Estmato Geeralzed Lear Models through Modfed Mamum Lkelhood Oral, Evrm Lousaa State Uversty Health Sceces Ceter

More information

LECTURE - 4 SIMPLE RANDOM SAMPLING DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANPUR

LECTURE - 4 SIMPLE RANDOM SAMPLING DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANPUR amplg Theory MODULE II LECTURE - 4 IMPLE RADOM AMPLIG DR. HALABH DEPARTMET OF MATHEMATIC AD TATITIC IDIA ITITUTE OF TECHOLOGY KAPUR Estmato of populato mea ad populato varace Oe of the ma objectves after

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted

More information

CHAPTER VI Statistical Analysis of Experimental Data

CHAPTER VI Statistical Analysis of Experimental Data Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca

More information

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch

More information

BAYESIAN ESTIMATOR OF A CHANGE POINT IN THE HAZARD FUNCTION

BAYESIAN ESTIMATOR OF A CHANGE POINT IN THE HAZARD FUNCTION Mathematcal ad Computatoal Applcatos, Vol. 7, No., pp. 29-38, 202 BAYESIAN ESTIMATOR OF A CHANGE POINT IN THE HAZARD FUNCTION Durdu Karasoy Departmet of Statstcs, Hacettepe Uversty, 06800 Beytepe, Akara,

More information

Econometric Methods. Review of Estimation

Econometric Methods. Review of Estimation Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators

More information

Lecture Notes Types of economic variables

Lecture Notes Types of economic variables Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte

More information

Bias Correction in Estimation of the Population Correlation Coefficient

Bias Correction in Estimation of the Population Correlation Coefficient Kasetsart J. (Nat. Sc.) 47 : 453-459 (3) Bas Correcto Estmato of the opulato Correlato Coeffcet Juthaphor Ssomboothog ABSTRACT A estmator of the populato correlato coeffcet of two varables for a bvarate

More information

Improving coverage probabilities of confidence intervals in random effects meta-analysis with publication bias

Improving coverage probabilities of confidence intervals in random effects meta-analysis with publication bias Improvg coverage probabltes of cofdece tervals radom effects meta-aalyss th publcato bas Masayuk Hem The Isttute of Statstcal Mathematcs, Japa Joh B. Copas Uversty of Warck, UK Itroducto Meta-aalyss: statstcal

More information

Regresso What s a Model? 1. Ofte Descrbe Relatoshp betwee Varables 2. Types - Determstc Models (o radomess) - Probablstc Models (wth radomess) EPI 809/Sprg 2008 9 Determstc Models 1. Hypothesze

More information

Linear Regression with One Regressor

Linear Regression with One Regressor Lear Regresso wth Oe Regressor AIM QA.7. Expla how regresso aalyss ecoometrcs measures the relatoshp betwee depedet ad depedet varables. A regresso aalyss has the goal of measurg how chages oe varable,

More information

Estimation and Testing in Type-II Generalized Half Logistic Distribution

Estimation and Testing in Type-II Generalized Half Logistic Distribution Joural of Moder Appled Statstcal Methods Volume 13 Issue 1 Artcle 17 5-1-014 Estmato ad Testg Type-II Geeralzed Half Logstc Dstrbuto R R. L. Katam Acharya Nagarjua Uversty, Ida, katam.rrl@gmal.com V Ramakrsha

More information

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ  1 STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ

More information

22 Nonparametric Methods.

22 Nonparametric Methods. 22 oparametrc Methods. I parametrc models oe assumes apror that the dstrbutos have a specfc form wth oe or more ukow parameters ad oe tres to fd the best or atleast reasoably effcet procedures that aswer

More information

Bayes Interval Estimation for binomial proportion and difference of two binomial proportions with Simulation Study

Bayes Interval Estimation for binomial proportion and difference of two binomial proportions with Simulation Study IJIEST Iteratoal Joural of Iovatve Scece, Egeerg & Techology, Vol. Issue 5, July 04. Bayes Iterval Estmato for bomal proporto ad dfferece of two bomal proportos wth Smulato Study Masoud Gaj, Solmaz hlmad

More information

Application of Calibration Approach for Regression Coefficient Estimation under Two-stage Sampling Design

Application of Calibration Approach for Regression Coefficient Estimation under Two-stage Sampling Design Authors: Pradp Basak, Kaustav Adtya, Hukum Chadra ad U.C. Sud Applcato of Calbrato Approach for Regresso Coeffcet Estmato uder Two-stage Samplg Desg Pradp Basak, Kaustav Adtya, Hukum Chadra ad U.C. Sud

More information

STA302/1001-Fall 2008 Midterm Test October 21, 2008

STA302/1001-Fall 2008 Midterm Test October 21, 2008 STA3/-Fall 8 Mdterm Test October, 8 Last Name: Frst Name: Studet Number: Erolled (Crcle oe) STA3 STA INSTRUCTIONS Tme allowed: hour 45 mutes Ads allowed: A o-programmable calculator A table of values from

More information

Multivariate Transformation of Variables and Maximum Likelihood Estimation

Multivariate Transformation of Variables and Maximum Likelihood Estimation Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty

More information

Inference for L-Estimators of Location Using a Bootstrap Warping Approach

Inference for L-Estimators of Location Using a Bootstrap Warping Approach www.srl-joural.org Statstcs Research Letters (SRL Volume 5 6 do.4355/srl.6.5.4 Iferece for L-Estmators of Locato Usg a Bootstrap Warpg Approach Ala D. Hutso Roswell Park Cacer Isttute Departmet of Bostatstcs

More information

Analysis of Variance with Weibull Data

Analysis of Variance with Weibull Data Aalyss of Varace wth Webull Data Lahaa Watthaacheewaul Abstract I statstcal data aalyss by aalyss of varace, the usual basc assumptos are that the model s addtve ad the errors are radomly, depedetly, ad

More information

Qualifying Exam Statistical Theory Problem Solutions August 2005

Qualifying Exam Statistical Theory Problem Solutions August 2005 Qualfyg Exam Statstcal Theory Problem Solutos August 5. Let X, X,..., X be d uform U(,),

More information

COV. Violation of constant variance of ε i s but they are still independent. The error term (ε) is said to be heteroscedastic.

COV. Violation of constant variance of ε i s but they are still independent. The error term (ε) is said to be heteroscedastic. c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty olato of costat varace of s but they are stll depedet. C,, he error term s sad to be heteroscedastc. c Pogsa Porchawseskul, Faculty of Ecoomcs,

More information

Statistics. Correlational. Dr. Ayman Eldeib. Simple Linear Regression and Correlation. SBE 304: Linear Regression & Correlation 1/3/2018

Statistics. Correlational. Dr. Ayman Eldeib. Simple Linear Regression and Correlation. SBE 304: Linear Regression & Correlation 1/3/2018 /3/08 Sstems & Bomedcal Egeerg Departmet SBE 304: Bo-Statstcs Smple Lear Regresso ad Correlato Dr. Ama Eldeb Fall 07 Descrptve Orgasg, summarsg & descrbg data Statstcs Correlatoal Relatoshps Iferetal Geeralsg

More information

Simple Linear Regression

Simple Linear Regression Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uversty Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal

More information

A practical threshold estimation for jump processes

A practical threshold estimation for jump processes A practcal threshold estmato for jump processes Yasutaka Shmzu (Osaka Uversty, Japa) WORKSHOP o Face ad Related Mathematcal ad Statstcal Issues @ Kyoto, JAPAN, 3 6 Sept., 2008. Itroducto O (Ω, F,P; {F

More information

Estimation of Population Total using Local Polynomial Regression with Two Auxiliary Variables

Estimation of Population Total using Local Polynomial Regression with Two Auxiliary Variables J. Stat. Appl. Pro. 3, o., 9-36 04) 9 Joural of Statstcs Applcatos & Probablty A Iteratoal Joural http://dx.do.org/0.785/jsap/03003 Estmato of Populato Total usg Local Polyomal Regresso wth Two Auxlary

More information

Wu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1

Wu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1 Wu-Hausma Test: Detectg Falure of E( ε X ) Caot drectly test ths assumpto because lack ubased estmator of ε ad the OLS resduals wll be orthogoal to X, by costructo as ca be see from the momet codto X'

More information

1. The weight of six Golden Retrievers is 66, 61, 70, 67, 92 and 66 pounds. The weight of six Labrador Retrievers is 54, 60, 72, 78, 84 and 67.

1. The weight of six Golden Retrievers is 66, 61, 70, 67, 92 and 66 pounds. The weight of six Labrador Retrievers is 54, 60, 72, 78, 84 and 67. Ecoomcs 3 Itroducto to Ecoometrcs Sprg 004 Professor Dobk Name Studet ID Frst Mdterm Exam You must aswer all the questos. The exam s closed book ad closed otes. You may use your calculators but please

More information

X ε ) = 0, or equivalently, lim

X ε ) = 0, or equivalently, lim Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece

More information

THE EFFICIENCY OF EMPIRICAL LIKELIHOOD WITH NUISANCE PARAMETERS

THE EFFICIENCY OF EMPIRICAL LIKELIHOOD WITH NUISANCE PARAMETERS Joural of Mathematcs ad Statstcs (: 5-9, 4 ISSN: 549-3644 4 Scece Publcatos do:.3844/jmssp.4.5.9 Publshed Ole ( 4 (http://www.thescpub.com/jmss.toc THE EFFICIENCY OF EMPIRICAL LIKELIHOOD WITH NUISANCE

More information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information Malaysa Joural of Mathematcal Sceces (): 97- (9) Bayes Estmator for Expoetal Dstrbuto wth Exteso of Jeffery Pror Iformato Hadeel Salm Al-Kutub ad Noor Akma Ibrahm Isttute for Mathematcal Research, Uverst

More information

Simulation Output Analysis

Simulation Output Analysis Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5

More information

12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model

12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model 1. Estmatg Model parameters Assumptos: ox ad y are related accordg to the smple lear regresso model (The lear regresso model s the model that says that x ad y are related a lear fasho, but the observed

More information

Comparison of Dual to Ratio-Cum-Product Estimators of Population Mean

Comparison of Dual to Ratio-Cum-Product Estimators of Population Mean Research Joural of Mathematcal ad Statstcal Sceces ISS 30 6047 Vol. 1(), 5-1, ovember (013) Res. J. Mathematcal ad Statstcal Sc. Comparso of Dual to Rato-Cum-Product Estmators of Populato Mea Abstract

More information

Some Applications of the Resampling Methods in Computational Physics

Some Applications of the Resampling Methods in Computational Physics Iteratoal Joural of Mathematcs Treds ad Techoloy Volume 6 February 04 Some Applcatos of the Resampl Methods Computatoal Physcs Sotraq Marko #, Lorec Ekoom * # Physcs Departmet, Uversty of Korca, Albaa,

More information

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The

More information

Handout #8. X\Y f(x) 0 1/16 1/ / /16 3/ / /16 3/16 0 3/ /16 1/16 1/8 g(y) 1/16 1/4 3/8 1/4 1/16 1

Handout #8. X\Y f(x) 0 1/16 1/ / /16 3/ / /16 3/16 0 3/ /16 1/16 1/8 g(y) 1/16 1/4 3/8 1/4 1/16 1 Hadout #8 Ttle: Foudatos of Ecoometrcs Course: Eco 367 Fall/05 Istructor: Dr. I-Mg Chu Lear Regresso Model So far we have focused mostly o the study of a sgle radom varable, ts correspodg theoretcal dstrbuto,

More information

2SLS Estimates ECON In this case, begin with the assumption that E[ i

2SLS Estimates ECON In this case, begin with the assumption that E[ i SLS Estmates ECON 3033 Bll Evas Fall 05 Two-Stage Least Squares (SLS Cosder a stadard lear bvarate regresso model y 0 x. I ths case, beg wth the assumto that E[ x] 0 whch meas that OLS estmates of wll

More information

VOL. 3, NO. 11, November 2013 ISSN ARPN Journal of Science and Technology All rights reserved.

VOL. 3, NO. 11, November 2013 ISSN ARPN Journal of Science and Technology All rights reserved. VOL., NO., November 0 ISSN 5-77 ARPN Joural of Scece ad Techology 0-0. All rghts reserved. http://www.ejouralofscece.org Usg Square-Root Iverted Gamma Dstrbuto as Pror to Draw Iferece o the Raylegh Dstrbuto

More information

PARAMETER ESTIMATION OF GEOGRAPHICALLY WEIGHTED MULTIVARIATE t REGRESSION MODEL

PARAMETER ESTIMATION OF GEOGRAPHICALLY WEIGHTED MULTIVARIATE t REGRESSION MODEL Joural of heoretcal ad Appled Iformato echology 5 th October 06. Vol.9. No. 005-06 JAI & LLS. All rghts reserved. ISSN: 99-8645 www.jatt.org E-ISSN: 87-395 PARAMEER ESIMAION OF GEOGRAPHICALLY WEIGHED MULIVARIAE

More information

Some Statistical Inferences on the Records Weibull Distribution Using Shannon Entropy and Renyi Entropy

Some Statistical Inferences on the Records Weibull Distribution Using Shannon Entropy and Renyi Entropy OPEN ACCESS Coferece Proceedgs Paper Etropy www.scforum.et/coferece/ecea- Some Statstcal Ifereces o the Records Webull Dstrbuto Usg Shao Etropy ad Rey Etropy Gholamhosse Yar, Rezva Rezae * School of Mathematcs,

More information

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers

More information

Lecture 3. Sampling, sampling distributions, and parameter estimation

Lecture 3. Sampling, sampling distributions, and parameter estimation Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called

More information

DERIVATIVE ESTIMATION WITH KNOWN CONTROL-VARIATE VARIANCES. Jamie R. Wieland Bruce W. Schmeiser

DERIVATIVE ESTIMATION WITH KNOWN CONTROL-VARIATE VARIANCES. Jamie R. Wieland Bruce W. Schmeiser Proceedgs of the 007 Wter Smulato Coferece S G Hederso, B Bller, M-H Hseh, J Shortle, J D Tew, ad R R Barto, eds DERIVATIVE ESTIMATION WITH KNOWN CONTROL-VARIATE VARIANCES Jame R Welad Bruce W Schmeser

More information

Midterm Exam 1, section 2 (Solution) Thursday, February hour, 15 minutes

Midterm Exam 1, section 2 (Solution) Thursday, February hour, 15 minutes coometrcs, CON Sa Fracsco State Uverst Mchael Bar Sprg 5 Mdterm xam, secto Soluto Thursda, Februar 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes exam.. No calculators of a kd are allowed..

More information

New Nonparametric Rank-Based Tests for Paired Data

New Nonparametric Rank-Based Tests for Paired Data Ope Joural of Statstcs, 04, 4, 495-503 Publshed Ole August 04 ScRes. http://www.scrp.org/joural/ojs http://dx.do.org/0.436/ojs.04.47047 New Noparametrc Rak-Based Tests for Pared Data Guoge Sha Departmet

More information

STK4011 and STK9011 Autumn 2016

STK4011 and STK9011 Autumn 2016 STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto

More information

Efficiency Comparisons in Multivariate Multiple Regression with Missing Outcomes

Efficiency Comparisons in Multivariate Multiple Regression with Missing Outcomes joural of multvarate aalyss 61, 102128 (1997) artcle o. MV971660 Effcecy Comparsos Multvarate Multple Regresso wth Mssg Outcomes Adrea Rottzky* Harvard School of Publc Health Chrsta A. Holcroft - Uversty

More information

Module 7. Lecture 7: Statistical parameter estimation

Module 7. Lecture 7: Statistical parameter estimation Lecture 7: Statstcal parameter estmato Parameter Estmato Methods of Parameter Estmato 1) Method of Matchg Pots ) Method of Momets 3) Mamum Lkelhood method Populato Parameter Sample Parameter Ubased estmato

More information

Iterated Logarithm Laws on GLM Randomly Censored with Random Regressors and Incomplete Information #

Iterated Logarithm Laws on GLM Randomly Censored with Random Regressors and Incomplete Information # Appled Mathematcs 363-368 do:.436/am..343 ublshed Ole March (http://www.scr.org/joural/am) Iterated Logarthm Laws o GLM Radomly Cored wth Radom Regrsors ad Icomplete Iformato # Abstract Qag Zhu Zhhog ao

More information

Midterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes

Midterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes coometrcs, CON Sa Fracsco State Uversty Mchael Bar Sprg 5 Mdterm am, secto Soluto Thursday, February 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes eam.. No calculators of ay kd are allowed..

More information

Bootstrap Method for Testing of Equality of Several Coefficients of Variation

Bootstrap Method for Testing of Equality of Several Coefficients of Variation Cloud Publcatos Iteratoal Joural of Advaced Mathematcs ad Statstcs Volume, pp. -6, Artcle ID Sc- Research Artcle Ope Access Bootstrap Method for Testg of Equalty of Several Coeffcets of Varato Dr. Navee

More information

EFFICIENT ESTIMATION OF THE WEIBULL SHAPE PARAMETER BASED ON A MODIFIED PROFILE LIKELIHOOD

EFFICIENT ESTIMATION OF THE WEIBULL SHAPE PARAMETER BASED ON A MODIFIED PROFILE LIKELIHOOD Appeared : Joural of Statstcal Computato ad Smulato, 003, 73, 5-3. EFFICIENT ESTIMATION OF THE WEIBULL SHAPE PARAMETER BASED ON A MODIFIED PROFILE LIKELIHOOD ZHENLIN YANG a ad MIN XIE b a School of Ecoomcs

More information

Class 13,14 June 17, 19, 2015

Class 13,14 June 17, 19, 2015 Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Aalyss of Varace ad Desg of Exermets-I MODULE II LECTURE - GENERAL LINEAR HYPOTHESIS AND ANALYSIS OF VARIANCE Dr Shalabh Deartmet of Mathematcs ad Statstcs Ida Isttute of Techology Kaur Tukey s rocedure

More information

A new Family of Distributions Using the pdf of the. rth Order Statistic from Independent Non- Identically Distributed Random Variables

A new Family of Distributions Using the pdf of the. rth Order Statistic from Independent Non- Identically Distributed Random Variables Iteratoal Joural of Cotemporary Mathematcal Sceces Vol. 07 o. 8 9-05 HIKARI Ltd www.m-hkar.com https://do.org/0.988/jcms.07.799 A ew Famly of Dstrbutos Usg the pdf of the rth Order Statstc from Idepedet

More information

ESTIMATION OF PARAMETERS OF THE MARSHALL-OLKIN EXTENDED LOG-LOGISTIC DISTRIBUTION FROM PROGRESSIVELY CENSORED SAMPLES

ESTIMATION OF PARAMETERS OF THE MARSHALL-OLKIN EXTENDED LOG-LOGISTIC DISTRIBUTION FROM PROGRESSIVELY CENSORED SAMPLES ESTIMATION OF PARAMETERS OF THE MARSHALL-OLKIN EXTENDED LOG-LOGISTIC DISTRIBUTION FROM PROGRESSIVELY CENSORED SAMPLES Mahmoud Rad Mahmoud Isttute of Statstcs, Caro Uversty Suza Mahmoud Mohammed Faculty

More information

Goodness of Fit Test for The Skew-T Distribution

Goodness of Fit Test for The Skew-T Distribution Joural of mathematcs ad computer scece 4 (5) 74-83 Artcle hstory: Receved ecember 4 Accepted 6 Jauary 5 Avalable ole 7 Jauary 5 Goodess of Ft Test for The Skew-T strbuto M. Magham * M. Bahram + epartmet

More information

An Epsilon Half Normal Slash Distribution and Its Applications to Nonnegative Measurements

An Epsilon Half Normal Slash Distribution and Its Applications to Nonnegative Measurements Ope Joural of Optmzato, 3,, -8 http://dx.do.org/.436/ojop.3. Publshed Ole March 3 (http://www.scrp.org/joural/ojop) A Epslo Half Normal Slash Dstrbuto ad Its Applcatos to Noegatve Measuremets Wehao Gu

More information

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions. Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos

More information

Arithmetic Mean Suppose there is only a finite number N of items in the system of interest. Then the population arithmetic mean is

Arithmetic Mean Suppose there is only a finite number N of items in the system of interest. Then the population arithmetic mean is Topc : Probablty Theory Module : Descrptve Statstcs Measures of Locato Descrptve statstcs are measures of locato ad shape that perta to probablty dstrbutos The prmary measures of locato are the arthmetc

More information

Functions of Random Variables

Functions of Random Variables Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,

More information

Sampling Theory MODULE X LECTURE - 35 TWO STAGE SAMPLING (SUB SAMPLING)

Sampling Theory MODULE X LECTURE - 35 TWO STAGE SAMPLING (SUB SAMPLING) Samplg Theory ODULE X LECTURE - 35 TWO STAGE SAPLIG (SUB SAPLIG) DR SHALABH DEPARTET OF ATHEATICS AD STATISTICS IDIA ISTITUTE OF TECHOLOG KAPUR Two stage samplg wth uequal frst stage uts: Cosder two stage

More information

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data

More information

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d 9 U-STATISTICS Suppose,,..., are P P..d. wth CDF F. Our goal s to estmate the expectato t (P)=Eh(,,..., m ). Note that ths expectato requres more tha oe cotrast to E, E, or Eh( ). Oe example s E or P((,

More information

Multiple Choice Test. Chapter Adequacy of Models for Regression

Multiple Choice Test. Chapter Adequacy of Models for Regression Multple Choce Test Chapter 06.0 Adequac of Models for Regresso. For a lear regresso model to be cosdered adequate, the percetage of scaled resduals that eed to be the rage [-,] s greater tha or equal to

More information

Lecture Note to Rice Chapter 8

Lecture Note to Rice Chapter 8 ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,

More information

Chapter 5 Properties of a Random Sample

Chapter 5 Properties of a Random Sample Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample

More information

GENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA

GENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA Sc.It.(Lahore),26(3),985-990,2014 ISSN 1013-5316; CODEN: SINTE 8 GENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA Beradhta H. S. Utam 1, Warsoo 1, Da Kurasar 1, Mustofa Usma

More information

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights CIS 800/002 The Algorthmc Foudatos of Data Prvacy October 13, 2011 Lecturer: Aaro Roth Lecture 9 Scrbe: Aaro Roth Database Update Algorthms: Multplcatve Weghts We ll recall aga) some deftos from last tme:

More information

Chapter 14 Logistic Regression Models

Chapter 14 Logistic Regression Models Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as

More information

Generative classification models

Generative classification models CS 75 Mache Learg Lecture Geeratve classfcato models Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square Data: D { d, d,.., d} d, Classfcato represets a dscrete class value Goal: lear f : X Y Bar classfcato

More information

Answer key to problem set # 2 ECON 342 J. Marcelo Ochoa Spring, 2009

Answer key to problem set # 2 ECON 342 J. Marcelo Ochoa Spring, 2009 Aswer key to problem set # ECON 34 J. Marcelo Ochoa Sprg, 009 Problem. For T cosder the stadard pael data model: y t x t β + α + ǫ t a Numercally compare the fxed effect ad frst dfferece estmates. b Compare

More information

F. Tibaldi Limburgs Universitair Centrum, Hasselt University, Belgium

F. Tibaldi Limburgs Universitair Centrum, Hasselt University, Belgium BIOMETRICS - Vol I - Lear Regresso Models - F Tbald LINEAR REGRESSION MODELS F Tbald Lmburgs Uverstar Cetrum, Hasselt Uversty, Belgum Keywords: Smple lear regresso, multple regresso, estmato, ferece, dagostcs

More information

ECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model

ECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model ECON 48 / WH Hog The Smple Regresso Model. Defto of the Smple Regresso Model Smple Regresso Model Expla varable y terms of varable x y = β + β x+ u y : depedet varable, explaed varable, respose varable,

More information

Econometrics. 3) Statistical properties of the OLS estimator

Econometrics. 3) Statistical properties of the OLS estimator 30C0000 Ecoometrcs 3) Statstcal propertes of the OLS estmator Tmo Kuosmae Professor, Ph.D. http://omepre.et/dex.php/tmokuosmae Today s topcs Whch assumptos are eeded for OLS to work? Statstcal propertes

More information

STATISTICAL INFERENCE

STATISTICAL INFERENCE (STATISTICS) STATISTICAL INFERENCE COMPLEMENTARY COURSE B.Sc. MATHEMATICS III SEMESTER ( Admsso) UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION CALICUT UNIVERSITY P.O., MALAPPURAM, KERALA, INDIA -

More information

Estimation of the Loss and Risk Functions of Parameter of Maxwell Distribution

Estimation of the Loss and Risk Functions of Parameter of Maxwell Distribution Scece Joural of Appled Mathematcs ad Statstcs 06; 4(4): 9- http://www.scecepublshggroup.com/j/sjams do: 0.648/j.sjams.060404. ISSN: 76-949 (Prt); ISSN: 76-95 (Ole) Estmato of the Loss ad Rsk Fuctos of

More information

ENGI 3423 Simple Linear Regression Page 12-01

ENGI 3423 Simple Linear Regression Page 12-01 ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable

More information

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements Aoucemets No-Parametrc Desty Estmato Techques HW assged Most of ths lecture was o the blacboard. These sldes cover the same materal as preseted DHS Bometrcs CSE 90-a Lecture 7 CSE90a Fall 06 CSE90a Fall

More information

Comparison of Parameters of Lognormal Distribution Based On the Classical and Posterior Estimates

Comparison of Parameters of Lognormal Distribution Based On the Classical and Posterior Estimates Joural of Moder Appled Statstcal Methods Volume Issue Artcle 8 --03 Comparso of Parameters of Logormal Dstrbuto Based O the Classcal ad Posteror Estmates Raja Sulta Uversty of Kashmr, Sragar, Ida, hamzasulta8@yahoo.com

More information

The equation is sometimes presented in form Y = a + b x. This is reasonable, but it s not the notation we use.

The equation is sometimes presented in form Y = a + b x. This is reasonable, but it s not the notation we use. INTRODUCTORY NOTE ON LINEAR REGREION We have data of the form (x y ) (x y ) (x y ) These wll most ofte be preseted to us as two colum of a spreadsheet As the topc develops we wll see both upper case ad

More information

A WEIGHTED LEAST SQUARES METHOD FOR ESTIMATING THE SUCCESS RATE IN CLUSTERED BINARY DATA

A WEIGHTED LEAST SQUARES METHOD FOR ESTIMATING THE SUCCESS RATE IN CLUSTERED BINARY DATA Jot Statstcal Meetgs - Bopharmaceutcal Secto A GHTED LEAST SQUAS METHOD FOR ESTMATNG THE SUCCESS RATE N CLUSTED BNARY DATA Mtchell J. Rose, Ph.D. Seor Bostatstca, Project Drector Departmet of Bostatstcs

More information

STK3100 and STK4100 Autumn 2018

STK3100 and STK4100 Autumn 2018 SK3 ad SK4 Autum 8 Geeralzed lear models Part III Covers the followg materal from chaters 4 ad 5: Cofdece tervals by vertg tests Cosder a model wth a sgle arameter β We may obta a ( α% cofdece terval for

More information

Point Estimation: definition of estimators

Point Estimation: definition of estimators Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.

More information

THE ROYAL STATISTICAL SOCIETY 2010 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA MODULE 2 STATISTICAL INFERENCE

THE ROYAL STATISTICAL SOCIETY 2010 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA MODULE 2 STATISTICAL INFERENCE THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA MODULE STATISTICAL INFERENCE The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the

More information

Chapter 8. Inferences about More Than Two Population Central Values

Chapter 8. Inferences about More Than Two Population Central Values Chapter 8. Ifereces about More Tha Two Populato Cetral Values Case tudy: Effect of Tmg of the Treatmet of Port-We tas wth Lasers ) To vestgate whether treatmet at a youg age would yeld better results tha

More information

Naïve Bayes MIT Course Notes Cynthia Rudin

Naïve Bayes MIT Course Notes Cynthia Rudin Thaks to Şeyda Ertek Credt: Ng, Mtchell Naïve Bayes MIT 5.097 Course Notes Cytha Rud The Naïve Bayes algorthm comes from a geeratve model. There s a mportat dstcto betwee geeratve ad dscrmatve models.

More information

Median as a Weighted Arithmetic Mean of All Sample Observations

Median as a Weighted Arithmetic Mean of All Sample Observations Meda as a Weghted Arthmetc Mea of All Sample Observatos SK Mshra Dept. of Ecoomcs NEHU, Shllog (Ida). Itroducto: Iumerably may textbooks Statstcs explctly meto that oe of the weakesses (or propertes) of

More information

TESTS BASED ON MAXIMUM LIKELIHOOD

TESTS BASED ON MAXIMUM LIKELIHOOD ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal

More information

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty

More information

Lecture 1: Introduction to Regression

Lecture 1: Introduction to Regression Lecture : Itroducto to Regresso A Eample: Eplag State Homcde Rates What kds of varables mght we use to epla/predct state homcde rates? Let s cosder just oe predctor for ow: povert Igore omtted varables,

More information

Correlation and Simple Linear Regression

Correlation and Simple Linear Regression Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uverst Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal

More information

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur

More information