Contents. Introduction to Bayesian methods. Introduction to Bayesian methods Meta Analysis. Models and Methods. Mantel-Haenzel methods for 2x2 tables
|
|
- Poppy Thomas
- 6 years ago
- Views:
Transcription
1 Cotet Meta-aalye: Modeller og metoder Itroducto to Bayea method Meta Aaly. Model ad Method. Matel-Haezel method for x table Sta Lydere KLMED8006 Avedt med tatt St303 med tatt 8 Aprl Frequett v Bayea tattc. Itroducto to Bayea method Partly baed o Evertt, B. S.: Moder Medcal Stattc. Arold Publher, 003. Secto 8. The probablty dtrbuto P(D θ of our data D deped o ome parameter( θ. Example: X,..., ~ (, X N μσ Data D Paramter θ The frequett regard θ a a uow cotat The Bayea regard θ a a (uoberved radom varable from a probablty dtrbuto, pror dtrbuto, P(θ. 5 6 Baye rule (oer, eq 3.0 B B A B Followg Baye theorem, the probablty dtrbuto of the parameter gve the data, poteror dtrbuto, P( θ P( D θ P( θ D P( θ P( D θ dθ P( B A j P( A BP( B P( A B P( B The deomator a cotat (doe ot deped o θ, o P( θ D P( θ P( D θ poteror dtrbuto pror dtrbuto lelhood
2 7 8 Bayea etmate: ˆ θb E( θ D (-α Bayea cofdece terval (credblty terval: The α/ quatle (θ l, θ h of the poteror dtrbuto Iterpretato (!: P( θ < θ < θ α l h 9 0 Example: Normal dtrbuto. X,..., ~ (, X N μσ Pror dtrbuto: μ ~ N ( ν, τ Poteror dtrbuto: μ ( X,..., X ~ N( Bν + ( B X,( B σ / σ / where B σ / + τ Baye etmate (poteror mea ˆ μb Bν + ( B X A weghted average betwee the pror mea ν ad X If the pror varace τ large, we have a vague or uformatve pror, ad ˆ μ B X Example: Bomal dtrbuto: umber of evet tral: X ~ b(, θ Pror dtrbuto: θ ~ Beta( a, b ( a b a b f ( θ Γ + ( for 0< < ( a ( b θ θ Γ Γ θ a>0, b>0 a E( θ a + b f(theta The Beta dtrbuto , 0,4 0,6 0,8 Theta ab ab/ a, b4 ab6,5 a8, b
3 3 4 Poteror dtrbuto: θ X ~ Beta( a+ x, b+ ( x Poteror mea: a+ x E( θ x a + b + a peudo umber of evet a+b peudo umber of tral 5 6 Meta Aaly. Model ad Method. Maly baed o: Normad, Sharo-Le T: Tutoral Botattc. Meta-Aaly: Formulatg, Evaluatg, Combg, ad eportg. Stattc Medce, 8, ( Def. Meta-Aaly may be broadly defed a the quattatve revew ad ythe of the reult of related but depedet tude. Meta-aalye er gjeomgag og ammefatg av relaterte, uavhegge tuder. Example: adomzed cotrolled tral of ldocae v placebo for patet wth myocardal farcto LOS (legth of tay hoptal for troe patet, pecalt patet troe care v opecalt troe care 3
4 Fxed effect v radom effect model Fxed effect: The tude have detcal charactertc ad tudy effect. adom effect: The tude may have dfferet effect ad dfferet charactertc Debate a to the choce of approprate model Alway reaoable to aume ome betwee-tudy varato ad few reao to beleve t zero. Combg tude: Dfferet clae of outcome (tudy ummary Dcrete outcome uch a dfferece proporto Cotuou outcome uch a mea Tet tattc (ot exhautve lt 4
5 5 6 Bary outcome: dfferece, relatve r, odd rato Etmator ad cofdece terval a decrbed oer (005, Secto 3.3 outcome Etmator Stadard devato Group Ye No T a b a+b T C c d c+d C dfferece elatve r ( rato d pˆ pˆ T C r pˆ / pˆ T C Log ( r d pt ( pt pc ( pc + T pt p + p p C T T C C C Study umber : pˆ T a c, pˆc T C Odd rato pˆ /( ˆ T pt ω pˆ /( pˆ C C ω a b c d Log ( 7 8 Cotuou outcome: Dfferece mea from tudy umber : Y xt xc wth tadard devato calculated a p + T C where ( + ( p + T T C C T C Poble effect ze: The tadardzed mea dfferece T μ μ δ σ whe C Y N j T T j ~ ( μ, σ ;,,..., T Y N j C C j ~ ( μ, σ ;,,..., C (Normad, 999, tate the above wthout ubcrpt 9 30 Etmator for δ (deoted Hedge g: T C Y Y h, ˆ ˆ δ Var( h + + T C ( T + C p-value a outcome May method ext for combg p, p,, p. (Cooper ad Hedge (994 lt 6 method Much ued (Darlgto & Haye, 000: The Stouffer ad the Fher method Uder H 0, uder qute geeral codto, p (approxmately uformly dtrbuted o (0, where ˆ δ the ample etmate of δ. 5
6 3 3 The Stouffer (949 method: Compute the z-value correpodg to the p-value: z Φ ( p ~ N(0, uder H 0 z+ z z Combed z-value: z ~ N(0, uder H 0 Combed p-value: pφ ( z Example (Darlgto & Haye, 000: p-value.59,.33,.,.09 z-value -.999, , -.39 combed z-.330, combed p0.00 The Fher (93 method: A low value of pp... p or equvaletly, log( pp... p log( p tae a evdece agat H 0 Uder H 0,, log( p~ χ Example: p-value.59,.33,.,.09 χ 6.88, df *48 Fher p Publcato ba: Fle-Drawer (Fal-Safe umber eearcher may have upublhed, ot gfcat reult ther fle-drawer How may uow tude (N FS,α wth average z0 eed to be added to the ow N to mae the outcome of Stouffer tet ot gfcat at level α? (oethal, 979 N Sum of N FS,α term z N N N N z + 0 z / or α FS, α z FS, α + N α / Example (cot d N4, combed p0.00, combed zz , z N FS, dv N FS, Source of varato meta-aaly but: Combg p-value gve lttle ght effect ze ad t drecto. Samplg error may vary betwee tude. Varyg ample ze. Study-level charactertc may vary (for example forproft v ot-for-proft hotptal Iter-tudy varato (radom effect model 6
7 37 38 Y ummary tattc from tudy o (for example treatmet effect Approxmately ormally dtrbuted Fxed effect model: Y N ~ ( θ, for,,..., where θ the mea treatmet effect (ame all tude Fg. 3. Fxed effect model adom-effect model Smlar to: - mult level model - herarchcal model - mxed effect model θ ~ N( θτ, Y N θ, ~ ( θ, whereθ the tudy pecfc mea draw from a uperpopulato wth hyperparameter θ ad τ, Y N θ ~ ( θ, θ θ τ θ τ, ~ N (, Fg. 4. adom effect model. 4 4 Ucodtoal dtrbuto of Y : Y N ~ ( θ, + τ where ad τ are wth-tudy ad betwee tudy varato. The dtrbuto of the tudy-pecfc effect θ, codtoal o the oberved data ad the hyperparameter, θ θ τ θ + ( Y,..., Y,, ~ N( B ( B Y, ( B where B the hrage factor for the th tudy + τ 7
8 43 44 Fxed-effect model: Maxmum lelhood etmator for commo mea f ow: WY ˆ θ MLE wth W W, ˆ θmle ~ N θ, ( W Tet for homogeety of tudy mea: H 0 : θ θ... θ H : At leat two are dfferet Uder H 0, for large ample ze, ˆ QW W( Y θmle ~ χ adom-effect model: Maxmum lelhood etmator for commo mea f τ wa ow: W τ Y ˆ( MLE wth W ( τ θτ ( W ( τ + τ EML (etrcted Maxmum Lelhood Apply lear fucto K y uch that K y cota oe of the fxed effect. Etmate the radom effect (varace parameter by applyg ML to K y. For fxed effect, EML ML. Uually τ uow. Two commo etmato method are - EML (etrcted Maxmum Lelhood - Bayea Example: Whe X, X,..., X depedet N( μσ, ˆ σ (, EML X X ( ˆ σ ( ML X X EML or ML? (Dggle & al, 00, p 69. EML etmator hould be le baed (McCulloch ad Searle, 00, p A growg preferece for EML mxed model For balaced ad ormal data, EML oluto are mmal varace ubaed. EML for ubalaced data et yeld o clea algebrac reult EML etmator eem to be le etve to outler the data 8
9 49 50 EML: Etmate of θ ad τ may be foud a oluto to ˆ τ ˆ ( ˆ τ w ( ˆ ( τ Y θ w Etmator for θ (emprcal Baye: ˆ ˆ ˆ ( ˆ θ B θ + B Y where Bˆ ˆ + τ w( ˆ ˆ τ Y θ wth ( ˆ w τ w ( ˆ τ + ˆ τ 5 5 Full Bayea approach: θτ, are regarded a radom varable wth oe realzato For example θ ~ N(0, a ad τ ~ gamma( c, d The hyperparameter (a,c,d are pecfed a pror, ot etmated from data Matel-Haezel method for x table oer, Secto 3.5 9
10 55 56 K table: outcome Ye No T a b Group C c d Matel-Haezel tet for codtoal depedece. Uder H 0, table o, codtoal o the row ad colum um, a hypergeometrc dtrbuted (a Fher exact tet, wth mea ad varace ( a + b( a + c E ( a + b( c + d( a + c( b + d V ( The (Cochra-Matel-Haezel tet for codtoal depedece Null hypothee: The commo O: ( O E χmh ~ χ uder H 0 V where O O a ( a + b( a + c E a + b c + d a + c b + d V ( E V ( ( ( ( oer Eq 3.4 p 653 ue a cotuty correcto, a propoed by Matel & Haezel (959. ( O E 0.5 χmh V Th approxmate a exact codtoal tet, but ted to be coervatve (Agret The Matel-Haezel etmator for the commo odd rato: oer, eq 3.5 p 655 O ˆ MH ad bc Cofdece terval for commo O (oer eq 3.6 exp l O ˆ ˆ MH ± z α / Var(l OMH where Var(l O ˆ P ( PS + Q QS MH + + ( ( ( S ( S ad a + d b + c ad bc P, Q,, S 0
11 6 6 Tet for homogeety of odd rato: Strata: Woolf method, oer eq 3.7, Brelow-Day method (SPSS, StatXact Meta-aaly: oer eq 3.40 Example Doll ad Hll (950, oer exerce Me: moe omoe total lug cacer cotrol total Wome moe omoe total lug cacer cotrol total Me ad wome eparately: etmate 95% c.. p-value Me to 59.7E-6 Wome.47. to exact StatXact etmate 95% c.. p-value Me to.3e-6 Wome.47. to Logtc regreo a alteratve to Matel Haezel method. Strata (or tudy a categorcal covarate (or coded wth - dcator varable Approxmately ame reult a Matel- Haezel method. Tet for homogeety of O: Brelow & Day tattc 5., df, p0.0 MH etmate for commo O: % c..:.4 to eferece Cooper, H, Hedge, L. V. The Hadboo of eearch Sythe. uell Sage Foudato, 994. Darlgto,. B., Haye, A. F.: Combg Idepedet p Value: Exteo of the Stouffer ad the Bomal Model. Pychologcal Method, 000, Vol 5, No 4, Dggle, P. J., Heagerty, P., Lag, K-Y, Zeger, S. L.: Aaly of Logtudal Data d ed, Oxford Uverty pre, 00. Evertt, B. S.: Moder Medcal Stattc. Arold Publher, 003. eferece McCulloch, C. E., Searle, S. : Geeralzed, Lear ad Mxed Model. Wley, 00. Normad, Sharo-Le T: Tutoral Botattc. Meta- Aaly: Formulatg, Evaluatg, Combg, ad eportg. Stattc Medce, 8, (999 oethal,. The fle-drawer problem ad tolerace for ull reult. Pychologcal Bullet, 86, (979 oer, B. Fudametal of Botattc. 6th Ed. Thomo, 005.
8 The independence problem
Noparam Stat 46/55 Jame Kwo 8 The depedece problem 8.. Example (Tua qualty) ## Hollader & Wolfe (973), p. 87f. ## Aemet of tua qualty. We compare the Huter L meaure of ## lghte to the average of coumer
More informationr y Simple Linear Regression How To Study Relation Between Two Quantitative Variables? Scatter Plot Pearson s Sample Correlation Correlation
Maatee Klled Correlato & Regreo How To Study Relato Betwee Two Quattatve Varable? Smple Lear Regreo 6.11 A Smple Regreo Problem 1 I there relato betwee umber of power boat the area ad umber of maatee klled?
More informationSimple Linear Regression. How To Study Relation Between Two Quantitative Variables? Scatter Plot. Pearson s Sample Correlation.
Correlato & Regreo How To Study Relato Betwee Two Quattatve Varable? Smple Lear Regreo 6. A Smple Regreo Problem I there relato betwee umber of power boat the area ad umber of maatee klled? Year NPB( )
More informationSimple Linear Regression Analysis
LINEAR REGREION ANALYSIS MODULE II Lecture - 5 Smple Lear Regreo Aaly Dr Shalabh Departmet of Mathematc Stattc Ida Ittute of Techology Kapur Jot cofdece rego for A jot cofdece rego for ca alo be foud Such
More informationReaction Time VS. Drug Percentage Subject Amount of Drug Times % Reaction Time in Seconds 1 Mary John Carl Sara William 5 4
CHAPTER Smple Lear Regreo EXAMPLE A expermet volvg fve ubject coducted to determe the relatohp betwee the percetage of a certa drug the bloodtream ad the legth of tme t take the ubject to react to a tmulu.
More informationLinear Regression. Can height information be used to predict weight of an individual? How long should you wait till next eruption?
Iter-erupto Tme Weght Correlato & Regreo 1 1 Lear Regreo 0 80 70 80 Heght 1 Ca heght formato be ued to predct weght of a dvdual? How log hould ou wat tll et erupto? Weght: Repoe varable (Outcome, Depedet)
More informationREVIEW OF SIMPLE LINEAR REGRESSION SIMPLE LINEAR REGRESSION
REVIEW OF SIMPLE LINEAR REGRESSION SIMPLE LINEAR REGRESSION I lear regreo, we coder the frequecy dtrbuto of oe varable (Y) at each of everal level of a ecod varable (X). Y kow a the depedet varable. The
More informationImproving coverage probabilities of confidence intervals in random effects meta-analysis with publication bias
Improvg coverage probabltes of cofdece tervals radom effects meta-aalyss th publcato bas Masayuk Hem The Isttute of Statstcal Mathematcs, Japa Joh B. Copas Uversty of Warck, UK Itroducto Meta-aalyss: statstcal
More informationFunctions of Random Variables
Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,
More informationANOVA with Summary Statistics: A STATA Macro
ANOVA wth Summary Stattc: A STATA Macro Nadeem Shafque Butt Departmet of Socal ad Prevetve Pedatrc Kg Edward Medcal College, Lahore, Pata Shahd Kamal Ittute of Stattc, Uverty of the Puab Lahore, Pata Muhammad
More informationFormulas and Tables from Beginning Statistics
Fmula ad Table from Begg Stattc Chater Cla Mdot Relatve Frequecy Chater 3 Samle Mea Poulato Mea Weghted Mea Rage Lower Lmt Uer Lmt Cla Frequecy Samle Se µ ( w) w f Mamum Data Value - Mmum Data Value Poulato
More informationSummarizing Bivariate Data. Correlation. Scatter Plot. Pearson s Sample Correlation. Summarizing Bivariate Data SBD - 1
Summarzg Bvarate Data Summarzg Bvarate Data - Eamg relato betwee two quattatve varable I there relato betwee umber of hadgu regtered the area ad umber of people klled? Ct NGR ) Nkll ) 447 3 4 3 48 4 4
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More informationChapter 8. Inferences about More Than Two Population Central Values
Chapter 8. Ifereces about More Tha Two Populato Cetral Values Case tudy: Effect of Tmg of the Treatmet of Port-We tas wth Lasers ) To vestgate whether treatmet at a youg age would yeld better results tha
More informationQuiz 1- Linear Regression Analysis (Based on Lectures 1-14)
Quz - Lear Regreo Aaly (Baed o Lecture -4). I the mple lear regreo model y = β + βx + ε, wth Tme: Hour Ε ε = Ε ε = ( ) 3, ( ), =,,...,, the ubaed drect leat quare etmator ˆβ ad ˆβ of β ad β repectvely,
More informationPredicting the eruption time after observed an eruption of 4 minutes in duration.
Lear Regreo ad Correlato 00 Predctg the erupto tme after oberved a erupto of 4 mute durato. 90 80 70 Iter-erupto Tme.5.0.5 3.0 3.5 4.0 4.5 5.0 5.5 Durato A ample of tererupto tme wa take durg Augut -8,
More informationEuropean Journal of Mathematics and Computer Science Vol. 5 No. 2, 2018 ISSN
Europea Joural of Mathematc ad Computer Scece Vol. 5 o., 018 ISS 059-9951 APPLICATIO OF ASYMPTOTIC DISTRIBUTIO OF MA-HITEY STATISTIC TO DETERMIE THE DIFFERECE BETEE THE SYSTOLIC BLOOD PRESSURE OF ME AD
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationKR20 & Coefficient Alpha Their equivalence for binary scored items
KR0 & Coeffcet Alpha Ther equvalece for bary cored tem Jue, 007 http://www.pbarrett.et/techpaper/r0.pdf f of 7 Iteral Cotecy Relablty for Dchotomou Item KR 0 & Alpha There apparet cofuo wth ome dvdual
More informationChapter 11 The Analysis of Variance
Chapter The Aalyss of Varace. Oe Factor Aalyss of Varace. Radomzed Bloc Desgs (ot for ths course) NIPRL . Oe Factor Aalyss of Varace.. Oe Factor Layouts (/4) Suppose that a expermeter s terested populatos
More informationLecture Notes Types of economic variables
Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationEuropean Journal of Mathematics and Computer Science Vol. 5 No. 2, 2018 ISSN
Europea Joural of Mathematc ad Computer Scece Vol. 5 o., 018 ISS 059-9951 APPLICATIO OF ASYMPTOTIC DISTRIBUTIO OF MA-HITEY STATISTIC TO DETERMIE THE DIFFERECE BETEE THE SYSTOLIC BLOOD PRESSURE OF ME AD
More informationMean is only appropriate for interval or ratio scales, not ordinal or nominal.
Mea Same as ordary average Sum all the data values ad dvde by the sample sze. x = ( x + x +... + x Usg summato otato, we wrte ths as x = x = x = = ) x Mea s oly approprate for terval or rato scales, ot
More informationA Result of Convergence about Weighted Sum for Exchangeable Random Variable Sequence in the Errors-in-Variables Model
AMSE JOURNALS-AMSE IIETA publcato-17-sere: Advace A; Vol. 54; N ; pp 3-33 Submtted Mar. 31, 17; Reved Ju. 11, 17, Accepted Ju. 18, 17 A Reult of Covergece about Weghted Sum for Exchageable Radom Varable
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More informationLecture 3. Sampling, sampling distributions, and parameter estimation
Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called
More informationChapter 3 Sampling For Proportions and Percentages
Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys
More informationHandout #4. Statistical Inference. Probability Theory. Data Generating Process (i.e., Probability distribution) Observed Data (i.e.
Hadout #4 Ttle: FAE Coure: Eco 368/01 Sprg/015 Itructor: Dr. I-Mg Chu Th hadout ummarze chapter 3~4 from the referece PE. Relevat readg (detaled oe) ca be foud chapter 6, 13, 14, 19, 3, ad 5 from MPS.
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationSTK3100 and STK4100 Autumn 2017
SK3 ad SK4 Autum 7 Geeralzed lear models Part III Covers the followg materal from chaters 4 ad 5: Sectos 4..5, 4.3.5, 4.3.6, 4.4., 4.4., ad 4.4.3 Sectos 5.., 5.., ad 5.5. Ørulf Borga Deartmet of Mathematcs
More informationTHE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5
THE ROYAL STATISTICAL SOCIETY 06 EAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5 The Socety s provdg these solutos to assst cadtes preparg for the examatos 07. The solutos are teded as learg ads ad should
More informationTHE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE
THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the
More informationContinuous Distributions
7//3 Cotuous Dstrbutos Radom Varables of the Cotuous Type Desty Curve Percet Desty fucto, f (x) A smooth curve that ft the dstrbuto 3 4 5 6 7 8 9 Test scores Desty Curve Percet Probablty Desty Fucto, f
More informationChapter 5 Properties of a Random Sample
Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample
More informationCorrelation. Pearson s Sample Correlation. Correlation and Linear Regression. Scatter Plot
Correlato ad Lear Regreo Dr. Thoma Smotzer Eame Relato Betwee Two Quattatve Varable I there a relato betwee the umber of hadgu regtered ad the umber of people klled b gu? ear #reg #kll 77 447 78 4 79 48
More informationChapter 4 Multiple Random Variables
Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:
More informationSTK4011 and STK9011 Autumn 2016
STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto
More informationSTK3100 and STK4100 Autumn 2018
SK3 ad SK4 Autum 8 Geeralzed lear models Part III Covers the followg materal from chaters 4 ad 5: Cofdece tervals by vertg tests Cosder a model wth a sgle arameter β We may obta a ( α% cofdece terval for
More informationEconometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More informationPoint Estimation: definition of estimators
Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.
More informationPart I: Background on the Binomial Distribution
Part I: Bacgroud o the Bomal Dstrbuto A radom varable s sad to have a Beroull dstrbuto f t taes o the value wth probablt "p" ad the value wth probablt " - p". The umber of "successes" "" depedet Beroull
More informationAnalysis of Variance with Weibull Data
Aalyss of Varace wth Webull Data Lahaa Watthaacheewaul Abstract I statstcal data aalyss by aalyss of varace, the usual basc assumptos are that the model s addtve ad the errors are radomly, depedetly, ad
More informationClass 13,14 June 17, 19, 2015
Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral
More informationMultivariate Transformation of Variables and Maximum Likelihood Estimation
Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty
More informationX ε ) = 0, or equivalently, lim
Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece
More informationENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections
ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty
More informationRegression. Chapter 11 Part 4. More than you ever wanted to know about how to interpret the computer printout
Regreo Chapter Part 4 More tha you ever wated to kow about how to terpret the computer prtout February 7, 009 Let go back to the etrol/brthweght problem. We are ug the varable bwt00 for brthweght o brthweght
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More informationIFYMB002 Mathematics Business Appendix C Formula Booklet
Iteratoal Foudato Year (IFY IFYMB00 Mathematcs Busess Apped C Formula Booklet Related Documet: IFY Mathematcs Busess Syllabus 07/8 IFYMB00 Maths Busess Apped C Formula Booklet Cotets lease ote that the
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More informationCOV. Violation of constant variance of ε i s but they are still independent. The error term (ε) is said to be heteroscedastic.
c Pogsa Porchawseskul, Faculty of Ecoomcs, Chulalogkor Uversty olato of costat varace of s but they are stll depedet. C,, he error term s sad to be heteroscedastc. c Pogsa Porchawseskul, Faculty of Ecoomcs,
More informationParameter, Statistic and Random Samples
Parameter, Statstc ad Radom Samples A parameter s a umber that descrbes the populato. It s a fxed umber, but practce we do ot kow ts value. A statstc s a fucto of the sample data,.e., t s a quatty whose
More informationρ < 1 be five real numbers. The
Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More informationChapter 11 Systematic Sampling
Chapter stematc amplg The sstematc samplg techue s operatoall more coveet tha the smple radom samplg. It also esures at the same tme that each ut has eual probablt of cluso the sample. I ths method of
More informationCorrelation: Examine Quantitative Bivariate Data
Correlato ad Regreo Correlato: Eame Quattatve Bvarate Data The correlato, ρ, betwee two radom varable, X ad Y, defed a, ( X µ ρ average σx X ) ( Y µ Y σ Y ) product of the tadard devate of X ad Y, quatfe
More informationBayes (Naïve or not) Classifiers: Generative Approach
Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg
More informationSimple Linear Regression
Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato
More informationWu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1
Wu-Hausma Test: Detectg Falure of E( ε X ) Caot drectly test ths assumpto because lack ubased estmator of ε ad the OLS resduals wll be orthogoal to X, by costructo as ca be see from the momet codto X'
More informationSimulation Output Analysis
Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5
More informationLinear Approximating to Integer Addition
Lear Approxmatg to Iteger Addto L A-Pg Bejg 00085, P.R. Cha apl000@a.com Abtract The teger addto ofte appled cpher a a cryptographc mea. I th paper we wll preet ome reult about the lear approxmatg for
More informationChapter 5 Properties of a Random Sample
Lecture 3 o BST 63: Statstcal Theory I Ku Zhag, /6/006 Revew for the revous lecture Cocets: radom samle, samle mea, samle varace Theorems: roertes of a radom samle, samle mea, samle varace Examles: how
More informationChapter 8: Statistical Analysis of Simulated Data
Marquette Uversty MSCS600 Chapter 8: Statstcal Aalyss of Smulated Data Dael B. Rowe, Ph.D. Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 08 by Marquette Uversty MSCS600 Ageda 8. The Sample
More informationbest estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best
Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg
More informationLaw of Large Numbers
Toss a co tmes. Law of Large Numbers Suppose 0 f f th th toss came up H toss came up T s are Beroull radom varables wth p ½ ad E( ) ½. The proporto of heads s. Itutvely approaches ½ as. week 2 Markov s
More informationD KL (P Q) := p i ln p i q i
Cheroff-Bouds 1 The Geeral Boud Let P 1,, m ) ad Q q 1,, q m ) be two dstrbutos o m elemets, e,, q 0, for 1,, m, ad m 1 m 1 q 1 The Kullback-Lebler dvergece or relatve etroy of P ad Q s defed as m D KL
More informationStatistics: Unlocking the Power of Data Lock 5
STAT 0 Dr. Kar Lock Morga Exam 2 Grades: I- Class Multple Regresso SECTIONS 9.2, 0., 0.2 Multple explaatory varables (0.) Parttog varablty R 2, ANOVA (9.2) Codtos resdual plot (0.2) Exam 2 Re- grades Re-
More informationThe Occupancy and Coupon Collector problems
Chapter 4 The Occupacy ad Coupo Collector problems By Sarel Har-Peled, Jauary 9, 08 4 Prelmares [ Defto 4 Varace ad Stadard Devato For a radom varable X, let V E [ X [ µ X deote the varace of X, where
More informationComments on Discussion Sheet 18 and Worksheet 18 ( ) An Introduction to Hypothesis Testing
Commet o Dicuio Sheet 18 ad Workheet 18 ( 9.5-9.7) A Itroductio to Hypothei Tetig Dicuio Sheet 18 A Itroductio to Hypothei Tetig We have tudied cofidece iterval for a while ow. Thee are method that allow
More informationTHE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA MODULE 2
THE ROYAL STATISTICAL SOCIETY 06 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA MODULE The Socety s provdg these solutos to assst caddates preparg for the examatos 07. The solutos are teded as learg ads ad should
More informationChapter 4 Multiple Random Variables
Revew o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for Chapter 4-5 Notes: Although all deftos ad theorems troduced our lectures ad ths ote are mportat ad you should be famlar wth, but I put those
More informationIntroduction to Probability
Itroducto to Probablty Nader H Bshouty Departmet of Computer Scece Techo 32000 Israel e-mal: bshouty@cstechoacl 1 Combatorcs 11 Smple Rules I Combatorcs The rule of sum says that the umber of ways to choose
More informationBayes Interval Estimation for binomial proportion and difference of two binomial proportions with Simulation Study
IJIEST Iteratoal Joural of Iovatve Scece, Egeerg & Techology, Vol. Issue 5, July 04. Bayes Iterval Estmato for bomal proporto ad dfferece of two bomal proportos wth Smulato Study Masoud Gaj, Solmaz hlmad
More informationQualifying Exam Statistical Theory Problem Solutions August 2005
Qualfyg Exam Statstcal Theory Problem Solutos August 5. Let X, X,..., X be d uform U(,),
More informationSTA302/1001-Fall 2008 Midterm Test October 21, 2008
STA3/-Fall 8 Mdterm Test October, 8 Last Name: Frst Name: Studet Number: Erolled (Crcle oe) STA3 STA INSTRUCTIONS Tme allowed: hour 45 mutes Ads allowed: A o-programmable calculator A table of values from
More informationThe expected value of a sum of random variables,, is the sum of the expected values:
Sums of Radom Varables xpected Values ad Varaces of Sums ad Averages of Radom Varables The expected value of a sum of radom varables, say S, s the sum of the expected values: ( ) ( ) S Ths s always true
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationChapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance
Chapter, Part A Aalyss of Varace ad Epermetal Desg Itroducto to Aalyss of Varace Aalyss of Varace: Testg for the Equalty of Populato Meas Multple Comparso Procedures Itroducto to Aalyss of Varace Aalyss
More informationGenerative classification models
CS 75 Mache Learg Lecture Geeratve classfcato models Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square Data: D { d, d,.., d} d, Classfcato represets a dscrete class value Goal: lear f : X Y Bar classfcato
More informationENGI 3423 Simple Linear Regression Page 12-01
ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable
More informationMultiple Choice Test. Chapter Adequacy of Models for Regression
Multple Choce Test Chapter 06.0 Adequac of Models for Regresso. For a lear regresso model to be cosdered adequate, the percetage of scaled resduals that eed to be the rage [-,] s greater tha or equal to
More informationσ σ r = x i x N Statistics Formulas Sample Mean Population Mean Interquartile Range Population Variance Population Standard Deviation
Stattc Formula Samle Mea Poulato Mea µ Iterquartle Rae IQR Q 3 Q Samle Varace ( ) Samle Stadard Devato ( ) Poulato Varace Poulato Stadard Devato ( µ ) Coecet o Varato Stadard Devato CV 00% Mea ( µ ) -Score
More informationA note on testing the covariance matrix for large dimension
A ote o tetg the covarace matrx for large dmeo Melae Brke Ruhr-Uvertät Bochum Fakultät für Mathematk 44780 Bochum, Germay e-mal: melae.brke@ruhr-u-bochum.de Holger ette Ruhr-Uvertät Bochum Fakultät für
More information22 Nonparametric Methods.
22 oparametrc Methods. I parametrc models oe assumes apror that the dstrbutos have a specfc form wth oe or more ukow parameters ad oe tres to fd the best or atleast reasoably effcet procedures that aswer
More informationExample: Multiple linear regression. Least squares regression. Repetition: Simple linear regression. Tron Anders Moger
Example: Multple lear regresso 5000,00 4000,00 Tro Aders Moger 0.0.007 brthweght 3000,00 000,00 000,00 0,00 50,00 00,00 50,00 00,00 50,00 weght pouds Repetto: Smple lear regresso We defe a model Y = β0
More informationModule 7. Lecture 7: Statistical parameter estimation
Lecture 7: Statstcal parameter estmato Parameter Estmato Methods of Parameter Estmato 1) Method of Matchg Pots ) Method of Momets 3) Mamum Lkelhood method Populato Parameter Sample Parameter Ubased estmato
More informationOn Two-stage Seamless Adaptive Design in Clinical Trials
ORIGINAL ARICLE O wo-tage Seamle Adaptve Deg Clcal ral She-Chug Chow, * Y-Hua u I recet year, the ue of adaptve deg method clcal reearch ad developmet baed o accrued data ha become very popular becaue
More informationRandom Variate Generation ENM 307 SIMULATION. Anadolu Üniversitesi, Endüstri Mühendisliği Bölümü. Yrd. Doç. Dr. Gürkan ÖZTÜRK.
adom Varate Geerato ENM 307 SIMULATION Aadolu Üverstes, Edüstr Mühedslğ Bölümü Yrd. Doç. Dr. Gürka ÖZTÜK 0 adom Varate Geerato adom varate geerato s about procedures for samplg from a varety of wdely-used
More informationA New Family of Transformations for Lifetime Data
Proceedgs of the World Cogress o Egeerg 4 Vol I, WCE 4, July - 4, 4, Lodo, U.K. A New Famly of Trasformatos for Lfetme Data Lakhaa Watthaacheewakul Abstract A famly of trasformatos s the oe of several
More informationx z Increasing the size of the sample increases the power (reduces the probability of a Type II error) when the significance level remains fixed.
] z-tet for the mea, μ If the P-value i a mall or maller tha a pecified value, the data are tatitically igificat at igificace level. Sigificace tet for the hypothei H 0: = 0 cocerig the ukow mea of a populatio
More informationTHE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA
THE ROYAL STATISTICAL SOCIETY EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER II STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for
More informationConstruction and Evaluation of Actuarial Models. Rajapaksha Premarathna
Costructo ad Evaluato of Actuaral Models Raapaksha Premaratha Table of Cotets Modelg Some deftos ad Notatos...4 Case : Polcy Lmtu...4 Case : Wth a Ordary deductble....5 Case 3: Maxmum Covered loss u wth
More informationLINEAR REGRESSION ANALYSIS
LINEAR REGRESSION ANALYSIS MODULE V Lecture - Correctg Model Iadequaces Through Trasformato ad Weghtg Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Aalytcal methods for
More informationECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model
ECON 48 / WH Hog The Smple Regresso Model. Defto of the Smple Regresso Model Smple Regresso Model Expla varable y terms of varable x y = β + β x+ u y : depedet varable, explaed varable, respose varable,
More informationCHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More informationUnsupervised Learning and Other Neural Networks
CSE 53 Soft Computg NOT PART OF THE FINAL Usupervsed Learg ad Other Neural Networs Itroducto Mture Destes ad Idetfablty ML Estmates Applcato to Normal Mtures Other Neural Networs Itroducto Prevously, all
More informationSPECIAL CONSIDERATIONS FOR VOLUMETRIC Z-TEST FOR PROPORTIONS
SPECIAL CONSIDERAIONS FOR VOLUMERIC Z-ES FOR PROPORIONS Oe s stctve reacto to the questo of whether two percetages are sgfcatly dfferet from each other s to treat them as f they were proportos whch the
More information