Population Design in Nonlinear Mixed Effects Multiple Response Models: extension of PFIM and evaluation by simulation with NONMEM and MONOLIX
|
|
- Ruby Carroll
- 5 years ago
- Views:
Transcription
1 Populaton Desgn n Nonlnear Mxed Effects Multple Response Models: extenson of PFIM and evaluaton by smulaton wth NONMEM and MONOLIX May 4th 007 Carolne Bazzol, Sylve Retout, France Mentré Inserm U738 Unversty Pars7 Pars, France PODE 1
2 Context (1) Nonlnear mxed effects models (NLEM) Handle data measured repeatedly through tme and descrbed by nonlnear models Estmaton of the mean parameters and ther ntersubject varablty n the populaton to be treated Allow sparse data Nonlnear mxed effects models for multple responses For each ndvdual : vectors of observatons n tme from K dfferent types of measure (k=1,,k) Dfferent tmes of measurement n case of dfferent tme scale for each type of measure Examples Pharmacoknetcs/Pharmacodynamcs (PK/PD) Drug and ts metabolte PODE
3 Context () Maxmum lkelhood estmaton No analytcal expresson for the lkelhood Several methods Lnearsaton of the log-lkelhood NONMEM (1) FO method (Frst Order) : lnearsaton of the model around the mean of the random effects FOCE method (Frst Order Condtonal Estmate) () : lnearsaton of the model around ndvdual values of the random effects Stochastc approach MONOLIX (3) : SAEM algorthm (4) Based on the EM algorthm Used Markov Chan Monte Carlo Estmaton by stochastc approxmaton (1) Beal SL, Shener LB. NONMEM Project Group, Unversty of Calforna, 199 () Lndstrom MJ, Bates DM. Bometrcs, 1990 (3) MONOLIX, Verson.1. (007) (4) Khun E, Lavelle M. Computatonal Statstcs and Data Analyss, 005 3
4 Context (3) Collect of data: Importance of the choce of the desgn Impact on the precson of estmaton of the populaton parameters Ξ Populaton desgn Model for one response N subjects Q groups of N q subjects wth a same elementary desgn ξ q = {t 1, t,,t nq } n q samples Allocaton n tme Ξ = {[ ξ N ]; [ ξ, N ];...;[, ]} 1, 1 ξq N Q Model for multple responses Ξ = 1 K 1 K 1 K {[ ( ξ, ξ,.., ξ ), N ]; [( ξ, ξ,.., ξ ), N ];... ;[( ξ, ξ,.., ), N ]} Q Q ξq Q Elementary desgn composed of several sub-desgn ξ, k = 1,, K, assocated wth the k th type of measurement : k q 1 K { ξ, ξ ξ } ξ =,.., PODE 4
5 Context (4) Desgn evaluaton and optmsaton Approach based on the Fsher nformaton matrx For sngle response model Lnearsaton of the model usng a frst order Taylor expanson around the expectaton of the random effects (1) Relevance of ths approach demonstrated on real data () For multple response model Extenson of M F for multple responses (3) (4) Same method as for a model wth one response Computaton of the matrx more complex Some parameters ncluded n several models Need to be consdered n the dervatves Relevance of ths extenson wth ths frst order approxmaton? (1) Mentré F, Mallet A, Baccar D. Bometrka, 1997 () Retout S, Mentré F. Bruno R. Statstcs n Medcne, 00 (3) Hooker A, Vcn P. The Amercan Assocaton of Pharmaceutcal Scentsts Journal, 005 (4) Gueorgueva I, Aarons L, Ogungbenro K, Jorga KM, Rodgers T, Rowland M. Journal of Pharmacoknetcs and Pharmacodynamcs, 006 5
6 Objectve Evaluaton of the relevance of ths frst order extenson for multple response model by smulaton PODE 6
7 PODE 7 f k descrbng nonlnear model θ k vector of ndvdual parameters Notaton Nonlnear mxed effects model for one ndvdual among N [ ] T K T T y y y Y,...,, 1 = θ = β +b or θ = β exp(b ), as θ =g(β,b ) wth ~ )), ( ( ), ( nt slope er F F Y ξ θ σ σ ε ξ θ + + = Statstcal model ( ) 0,Ω N b ε are supposed ndependent from one type of measurement to the other. = ), ( ), ( ), ( ), ( K K K f f f F ξ θ ξ θ ξ θ ξ θ M )), ( ( ), ( nt k k k slope er k k k k k f f y k k ξ θ σ σ ε ξ θ + + =
8 Choce of a model Evaluaton by smulaton : PK/PD model PK model Populaton desgn f PK PK PK Dose Cl ( θ, ξ ) = exp( ξ V V PK θ PK : Cl et V Proportonal error model ) Ξ = PK PD {[ ( ξ,ξ ), N ]} ξ PK = {0.166,6,1} ξ PD = {0.166,6,1,0} N =100 PD model f PD ( θ PK, θ PD, ξ PD ) = E E f ( θ ( θ, ξ, ξ PK PD max PK + 0 C + f 50 PK PK PD ) ) θ PD : E 0, E max et C 50 Addtve error model Exponental random effects for all the parameters PODE 8
9 Evaluaton : Method (1) Implementaton of ths extenson n PFIM Computaton of the predcted standard errors wth the extenson of PFIM Relatve standard errors : RSE PFIM Comparson to the predcted SE obtaned wth an exact method Computaton of M F by the SAEM algorthm (MONOLIX) Lous method Exact method wthout lnearsaton gold standard Smulaton of one data set wth subjects Asymptotc propertes of M F Rescale of the SE for N=100 subjects PODE 9
10 Predcted RSE (%): PFIM/SAEM Emprcal FO (1000) FOCE (853) SAEM (1000) Predcted RSE PFIM RSE SAEM PODE 10
11 Evaluaton : Method () Comparson to the emprcal RSE (NONMEM et MONOLIX) Smulaton of 1000 data sets (R software) Estmaton of the populaton parameters NONMEM (FO et FOCE) MONOLIX : SAEM For each method of estmaton: Computaton of the emprcal RSE : standard-devaton on the 1000 estmates of each parameter PODE 11
12 Data sets convergence On the 1000 data sets Convergence obtaned for FO : 1000 data sets FOCE : 853 data sets SAEM : 1000 data sets PODE 1
13 Emprcal RSE ( %) Emprcal FO (1000) FOCE (853) SAEM (1000) Predcted RSE PFIM RSE SAEM PODE 13
14 Emprcal and predcted RSE ( %) Emprcal FO (1000) FOCE (853) SAEM (1000) Predcted RSE PFIM RSE SAEM PODE 14
15 Evaluaton : Method () Comparson to the dstrbuton of the relatve standard errors obtaned on each data set for each parameter NONMEM (FO et FOCE) MONOLIX : SAEM Computaton of the SE Lnearsaton around the ndvdual parameters estmated by SAEM wthout lnearsaton Lous method Comparson wth RSE PFIM and the emprcal RSE PODE 15
16 Data sets convergence (%) On the 1000 data sets Convergence obtaned for : FO : 1000 data sets FOCE : 853 data sets SAEM : 1000 data sets Varance covarance matrx obtaned for : FO : 997 data sets FOCE : 798 data sets SAEM : 1000 data sets PODE 16
17 RSE (%) RSE PFIM RSE emp β Cl β Emax β C50 FO 3 outlers (86,9%, 80,7%, 131,7%) FOCE outlers (64,4%,466%) 1 outler (30,5%) 1 outler(84,8%) RSE (%) Cl Emax FO FOCE oulters(98.8%) SA_Lo 1 outler (1.1%) 1 outler(09,4%) C50 σ slopepk 3 outlers(53.%,596.6%,100%) σ nterpd
18 RSE (%) RSE PFIM RSE emp β Cl β Emax β C50 FOCE outlers (64.4%,466,0%) 1 oulter (45%) outlers (84.6%,43.%) SA_Lo 17 fles wth NA + outlers (1.9%,13.7%) 7 outlers [10.6% : 41.8%] RSE (%) Cl Emax C50 σ slopepk σ nterpd FOCE 1 outler (98;8%) 1 oulter (13;%) outlers(45.6%,138.8%) 1 outler (48.4%) SA_Lo 1 outler (1,1%) 1 outler(09,4%) 5 outlers [500%-10^18%] 1 outler (109,5%) outlers (153.3%,163.3%)
19 Concluson Relevance of the frst order extenson Predcted RSE by PFIM equvalent to the RSE predcted by SAEM close to the emprcal RSE of FOCE and SAEM concordant wth the dstrbuton of the RSE obtaned wth SAEM (lnearsaton) and FOCE Although the extenson of M F for multple response s based on a frst order approxmaton the predcted RSE are close to those computed by FOCE and not by FO Extenson n PFIM and PFIMOPT for K responses : PFIM 3.0 /PFIMOPT 3.0 PODE 19
20 PODE 0
21 Bas and RMSE: FO, FOCE and SAEM PODE 1
22 Bas (%) and RMSE (%) Bas (%) Bas (%) β Cl β V β Emax β E0 β C50 Cl V E 0 E max C σ 50 slopepk σ nt erpd FO (1000) FOCE (853) SAEM (1000) RMSE (%) RMSE (%) β Cl β V β Emax β E0 β C50 Cl V E 0 E max C σ 50 slopepk σ nt erpd PODE
23 RMSE (%) Bas (%) Bas (%) and RMSE ( %) β Cl β V β Emax β E0 β C50 Cl V E 0 E max C σ 50 slopepk σ nt erpd FOCE (853) SAEM (1000) β Cl β V β E0 β β Emax C50 Cl V E 0 E max C σ 50 slopepk σnterpd PODE 3
Improved conditional approximations of the population Fisher Information Matrix
Improved condtonal approxmatons of the populaton Fsher Informaton Matrx Joakm Nyberg, Sebastan Ueckert and Andrew C. Hooker Pharmacometrcs research group Department of Pharmaceutcal Boscences Uppsala Unversty
More informationData Abstraction Form for population PK, PD publications
Data Abstracton Form for populaton PK/PD publcatons Brendel K. 1*, Dartos C. 2*, Comets E. 1, Lemenuel-Dot A. 3, Laffont C.M. 3, Lavelle C. 4, Grard P. 2, Mentré F. 1 1 INSERM U738, Pars, France 2 EA3738,
More informationOn an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1
On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool
More informationParametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010
Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton
More informationStatistical Evaluation of WATFLOOD
tatstcal Evaluaton of WATFLD By: Angela MacLean, Dept. of Cvl & Envronmental Engneerng, Unversty of Waterloo, n. ctober, 005 The statstcs program assocated wth WATFLD uses spl.csv fle that s produced wth
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationTesting for outliers in nonlinear longitudinal data models based on M-estimation
ISS 1746-7659, England, UK Journal of Informaton and Computng Scence Vol 1, o, 017, pp107-11 estng for outlers n nonlnear longtudnal data models based on M-estmaton Huhu Sun 1 1 School of Mathematcs and
More informationRESIDUALS AND INFLUENCE IN NONLINEAR REGRESSION FOR REPEATED MEASUREMENT DATA
Operatons Research and Applcatons : An Internatonal Journal (ORAJ), Vol.4, No.3/4, November 17 RESIDUALS AND INFLUENCE IN NONLINEAR REGRESSION FOR REPEAED MEASUREMEN DAA Munsr Al, Yu Feng, Al choo, Zamr
More informationPhase I Monitoring of Nonlinear Profiles
Phase I Montorng of Nonlnear Profles James D. Wllams Wllam H. Woodall Jeffrey B. Brch May, 003 J.D. Wllams, Bll Woodall, Jeff Brch, Vrgna Tech 003 Qualty & Productvty Research Conference, Yorktown Heghts,
More informationComputing MLE Bias Empirically
Computng MLE Bas Emprcally Kar Wa Lm Australan atonal Unversty January 3, 27 Abstract Ths note studes the bas arses from the MLE estmate of the rate parameter and the mean parameter of an exponental dstrbuton.
More informationComputation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models
Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,
More informationRobust design in model-based analysis of longitudinal clinical data
Robust design in model-based analysis of longitudinal clinical data Giulia Lestini, Sebastian Ueckert, France Mentré IAME UMR 1137, INSERM, University Paris Diderot, France PODE, June 0 016 Context Optimal
More informationOn Outlier Robust Small Area Mean Estimate Based on Prediction of Empirical Distribution Function
On Outler Robust Small Area Mean Estmate Based on Predcton of Emprcal Dstrbuton Functon Payam Mokhtaran Natonal Insttute of Appled Statstcs Research Australa Unversty of Wollongong Small Area Estmaton
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationSTK4080/9080 Survival and event history analysis
SK48/98 Survval and event hstory analyss Lecture 7: Regresson modellng Relatve rsk regresson Regresson models Assume that we have a sample of n ndvduals, and let N (t) count the observed occurrences of
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VIII LECTURE - 34 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS EFFECTS MODEL Dr Shalabh Department of Mathematcs and Statstcs Indan
More informationF. Combes (1,2,3) S. Retout (2), N. Frey (2) and F. Mentré (1) PODE 2012
Prediction of shrinkage of individual parameters using the Bayesian information matrix in nonlinear mixed-effect models with application in pharmacokinetics F. Combes (1,2,3) S. Retout (2), N. Frey (2)
More informationDurban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications
Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department
More informationParametric fractional imputation for missing data analysis
Secton on Survey Research Methods JSM 2008 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Wayne Fuller Abstract Under a parametrc model for mssng data, the EM algorthm s a popular tool
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models
More informationApproximations to the Loglikelihood Function in the Nonlinear Mixed Effects Model
Approxmatons to the Lolkelhood Functon n the Nonlnear Mxed Effects Model José C. Pnhero and Doulas M. Bates Department of Statstcs Unversty of Wsconsn, Madson Nonlnear mxed effects models have receved
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationNon-Mixture Cure Model for Interval Censored Data: Simulation Study ABSTRACT
Malaysan Journal of Mathematcal Scences 8(S): 37-44 (2014) Specal Issue: Internatonal Conference on Mathematcal Scences and Statstcs 2013 (ICMSS2013) MALAYSIAN JOURNAL OF MATHEMATICAL SCIENCES Journal
More informationRobust Small Area Estimation Using a Mixture Model
Robust Small Area Estmaton Usng a Mxture Model Jule Gershunskaya U.S. Bureau of Labor Statstcs Partha Lahr JPSM, Unversty of Maryland, College Park, USA ISI Meetng, Dubln, August 23, 2011 Parameter of
More informationLOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin
Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationGlobal Sensitivity. Tuesday 20 th February, 2018
Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values
More informationDevelopment Pattern and Prediction Error for the Stochastic Bornhuetter-Ferguson Claims Reserving Method
Development Pattern and Predcton Error for the Stochastc Bornhuetter-Ferguson Clams Reservng Method Annna Saluz, Alos Gsler, Maro V. Wüthrch ETH Zurch ASTIN Colloquum Madrd, June 2011 Overvew 1 Notaton
More informationEfficient Algorithms for Robust Estimation in Linear Mixed-Effects Models Using the Multivariate t-distribution
Effcent Algorthms for Robust Estmaton n Lnear Mxed-Effects Models Usng the Multvarate t-dstrbuton José C. Pnhero, Chuanha Lu Bell Laboratores Lucent Technologes Murray Hll, NJ 07974 and Yngnan Wu Department
More informationAdvances in Longitudinal Methods in the Social and Behavioral Sciences. Finite Mixtures of Nonlinear Mixed-Effects Models.
Advances n Longtudnal Methods n the Socal and Behavoral Scences Fnte Mxtures of Nonlnear Mxed-Effects Models Jeff Harrng Department of Measurement, Statstcs and Evaluaton The Center for Integrated Latent
More informationMethods in Epidemiology. Medical statistics 02/11/2014
Methods n Epdemology At the end of the course students should be able to use statstcal methods to nfer conclusons from study fndngs Medcal statstcs At the end of the lecture students should be able to
More informationx = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationEffective plots to assess bias and precision in method comparison studies
Effectve plots to assess bas and precson n method comparson studes Bern, November, 016 Patrck Taffé, PhD Insttute of Socal and Preventve Medcne () Unversty of Lausanne, Swtzerland Patrck.Taffe@chuv.ch
More informationBias-correction under a semi-parametric model for small area estimation
Bas-correcton under a sem-parametrc model for small area estmaton Laura Dumtrescu, Vctora Unversty of Wellngton jont work wth J. N. K. Rao, Carleton Unversty ICORS 2017 Workshop on Robust Inference for
More informationAn R implementation of bootstrap procedures for mixed models
The R User Conference 2009 July 8-10, Agrocampus-Ouest, Rennes, France An R mplementaton of bootstrap procedures for mxed models José A. Sánchez-Espgares Unverstat Poltècnca de Catalunya Jord Ocaña Unverstat
More informationUCLA STAT 13 Introduction to Statistical Methods for the Life and Health Sciences. Chapter 11 Analysis of Variance - ANOVA. Instructor: Ivo Dinov,
UCLA STAT 3 ntroducton to Statstcal Methods for the Lfe and Health Scences nstructor: vo Dnov, Asst. Prof. of Statstcs and Neurology Chapter Analyss of Varance - ANOVA Teachng Assstants: Fred Phoa, Anwer
More informationA Comparative Study for Estimation Parameters in Panel Data Model
A Comparatve Study for Estmaton Parameters n Panel Data Model Ahmed H. Youssef and Mohamed R. Abonazel hs paper examnes the panel data models when the regresson coeffcents are fxed random and mxed and
More informationMultivariate Ratio Estimator of the Population Total under Stratified Random Sampling
Open Journal of Statstcs, 0,, 300-304 ttp://dx.do.org/0.436/ojs.0.3036 Publsed Onlne July 0 (ttp://www.scrp.org/journal/ojs) Multvarate Rato Estmator of te Populaton Total under Stratfed Random Samplng
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experments- MODULE LECTURE - 6 EXPERMENTAL DESGN MODELS Dr. Shalabh Department of Mathematcs and Statstcs ndan nsttute of Technology Kanpur Two-way classfcaton wth nteractons
More informationAsymptoticProperties of Nonlinear Mixed-E ects Models inlargesamples
AsymptotcPropertes of Nonlnear Mxed-E ects Models nlargesamples Eugene Demdenko Dartmouth Medcal School, HB 7927 DHMC, Lebanon, NH 03756 e-mal: eugene.demdenko@dartmouth.edu November 9, 998 A short verson
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationParameters Estimation of the Modified Weibull Distribution Based on Type I Censored Samples
Appled Mathematcal Scences, Vol. 5, 011, no. 59, 899-917 Parameters Estmaton of the Modfed Webull Dstrbuton Based on Type I Censored Samples Soufane Gasm École Supereure des Scences et Technques de Tuns
More informationEcon Statistical Properties of the OLS estimator. Sanjaya DeSilva
Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate
More informationCS 2750 Machine Learning. Lecture 5. Density estimation. CS 2750 Machine Learning. Announcements
CS 750 Machne Learnng Lecture 5 Densty estmaton Mlos Hauskrecht mlos@cs.ptt.edu 539 Sennott Square CS 750 Machne Learnng Announcements Homework Due on Wednesday before the class Reports: hand n before
More informationU-Pb Geochronology Practical: Background
U-Pb Geochronology Practcal: Background Basc Concepts: accuracy: measure of the dfference between an expermental measurement and the true value precson: measure of the reproducblty of the expermental result
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More informationIndirect Evidence: Indirect Treatment Comparisons in Meta-analysis
Evdence: Treatment Comparsons n Meta-analyss analyss George Wells, Shagufta Sultan, L Chen, Doug Coyle Current Issues for Health Technology Assessment n Canada An Invtatonal Symposum for HTA Researchers
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationPinheiro, J. C. and Bates, D. M. (1995). Mixed-eects methods and classes for s and splus, Technical
Pnhero, J. C. and Bates, D. M. (1995). Mxed-eects methods and classes for s and splus, Techncal Report 89, Department of Bostatstcs, Unversty of Wsconsn { Madson. Pottho, R. F. and Roy, S. N. (1964). A
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationUSE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE
STATISTICA, anno LXXV, n. 4, 015 USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE Manoj K. Chaudhary 1 Department of Statstcs, Banaras Hndu Unversty, Varanas,
More informationAssignment 5. Simulation for Logistics. Monti, N.E. Yunita, T.
Assgnment 5 Smulaton for Logstcs Mont, N.E. Yunta, T. November 26, 2007 1. Smulaton Desgn The frst objectve of ths assgnment s to derve a 90% two-sded Confdence Interval (CI) for the average watng tme
More informationInfluence Diagnostics on Competing Risks Using Cox s Model with Censored Data. Jalan Gombak, 53100, Kuala Lumpur, Malaysia.
Proceedngs of the 8th WSEAS Internatonal Conference on APPLIED MAHEMAICS, enerfe, Span, December 16-18, 5 (pp14-138) Influence Dagnostcs on Competng Rsks Usng Cox s Model wth Censored Data F. A. M. Elfak
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationMotion Perception Under Uncertainty. Hongjing Lu Department of Psychology University of Hong Kong
Moton Percepton Under Uncertanty Hongjng Lu Department of Psychology Unversty of Hong Kong Outlne Uncertanty n moton stmulus Correspondence problem Qualtatve fttng usng deal observer models Based on sgnal
More informationMAXIMUM LIKELIHOOD FOR GENERALIZED LINEAR MODEL AND GENERALIZED ESTIMATING EQUATIONS
www.arpapress.com/volumes/vol18issue1/ijrras_18_1_08.pdf MAXIMUM LIKELIHOOD FOR GENERALIZED LINEAR MODEL AND GENERALIZED ESTIMATING EQUATIONS A. Lanan MAM Laboratory. Department of Mathematcs. Unversty
More informationChapter 9: Statistical Inference and the Relationship between Two Variables
Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,
More informationF statistic = s2 1 s 2 ( F for Fisher )
Stat 4 ANOVA Analyss of Varance /6/04 Comparng Two varances: F dstrbuton Typcal Data Sets One way analyss of varance : example Notaton for one way ANOVA Comparng Two varances: F dstrbuton We saw that the
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informationCentral tendency. mean for metric data. The mean. "I say what I means and I means what I say!."
Central tendency "I say hat I means and I means hat I say!." Popeye Normal dstrbuton vdeo clp To ve an unedted verson vst: http://.learner.org/resources/seres65.html# mean for metrc data mportant propertes
More informationChecking Pairwise Relationships. Lecture 19 Biostatistics 666
Checkng Parwse Relatonshps Lecture 19 Bostatstcs 666 Last Lecture: Markov Model for Multpont Analyss X X X 1 3 X M P X 1 I P X I P X 3 I P X M I 1 3 M I 1 I I 3 I M P I I P I 3 I P... 1 IBD states along
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationAn adaptive SMC scheme for ABC. Bayesian Computation (ABC)
An adaptve SMC scheme for Approxmate Bayesan Computaton (ABC) (ont work wth Prof. Mke West) Department of Statstcal Scence - Duke Unversty Aprl/2011 Approxmate Bayesan Computaton (ABC) Problems n whch
More information/ n ) are compared. The logic is: if the two
STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence
More informationMATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)
1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons
More informationConditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Condtonal Random Felds: Probablstc Models for Segmentng and Labelng Sequence Data Paper by John Lafferty, Andrew McCallum, and Fernando Perera ICML 2001 Presentaton by Joe Drsh May 9, 2002 Man Goals Present
More informationDiscussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek
Dscusson of Extensons of the Gauss-arkov Theorem to the Case of Stochastc Regresson Coeffcents Ed Stanek Introducton Pfeffermann (984 dscusses extensons to the Gauss-arkov Theorem n settngs where regresson
More informationECONOMETRICS II (ECO 2401S) University of Toronto. Department of Economics. Winter 2017 Instructor: Victor Aguirregabiria
ECOOMETRICS II ECO 40S Unversty of Toronto Department of Economcs Wnter 07 Instructor: Vctor Agurregabra SOLUTIO TO FIAL EXAM Tuesday, Aprl 8, 07 From :00pm-5:00pm 3 hours ISTRUCTIOS: - Ths s a closed-book
More informationAnalysis of two-factor unreplicated experiments with one factor random
Bostatstcs (2013), 0, 0, pp. 1 14 do:10.1093/bostatstcs/ms V4 Analyss of two-factor unreplcated experments wth one factor random Ka Wang Department of Bostatstcs, College of Publc Health, Unversty of Iowa,
More informationModeling Mood Variation and Covariation among Adolescent Smokers: Application of a Bivariate Location-Scale Mixed-Effects Model
Modelng Mood Varaton and Covaraton among Adolescent Smokers: Applcaton of a Bvarate Locaton-Scale Mxed-Effects Model Oksana Pgach, PhD, Donald Hedeker, PhD, Robn Mermelsten, PhD Insttte for Health Research
More informationLinear regression. Regression Models. Chapter 11 Student Lecture Notes Regression Analysis is the
Chapter 11 Student Lecture Notes 11-1 Lnear regresson Wenl lu Dept. Health statstcs School of publc health Tanjn medcal unversty 1 Regresson Models 1. Answer What Is the Relatonshp Between the Varables?.
More informationEstimation: Part 2. Chapter GREG estimation
Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the
More informationPrimer on High-Order Moment Estimators
Prmer on Hgh-Order Moment Estmators Ton M. Whted July 2007 The Errors-n-Varables Model We wll start wth the classcal EIV for one msmeasured regressor. The general case s n Erckson and Whted Econometrc
More informationSolutions Homework 4 March 5, 2018
1 Solutons Homework 4 March 5, 018 Soluton to Exercse 5.1.8: Let a IR be a translaton and c > 0 be a re-scalng. ˆb1 (cx + a) cx n + a (cx 1 + a) c x n x 1 cˆb 1 (x), whch shows ˆb 1 s locaton nvarant and
More informationA note on regression estimation with unknown population size
Statstcs Publcatons Statstcs 6-016 A note on regresson estmaton wth unknown populaton sze Mchael A. Hdroglou Statstcs Canada Jae Kwang Km Iowa State Unversty jkm@astate.edu Chrstan Olver Nambeu Statstcs
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationLogistic regression models 1/12
Logstc regresson models 1/12 2/12 Example 1: dogs look lke ther owners? Some people beleve that dogs look lke ther owners. Is ths true? To test the above hypothess, The New York Tmes conducted a quz onlne.
More informationChapter 6. Supplemental Text Material
Chapter 6. Supplemental Text Materal S6-. actor Effect Estmates are Least Squares Estmates We have gven heurstc or ntutve explanatons of how the estmates of the factor effects are obtaned n the textboo.
More informationHidden Markov Models
Hdden Markov Models Namrata Vaswan, Iowa State Unversty Aprl 24, 204 Hdden Markov Model Defntons and Examples Defntons:. A hdden Markov model (HMM) refers to a set of hdden states X 0, X,..., X t,...,
More informationOutline for today. Markov chain Monte Carlo. Example: spatial statistics (Christensen and Waagepetersen 2001)
Markov chan Monte Carlo Rasmus Waagepetersen Department of Mathematcs Aalborg Unversty Denmark November, / Outlne for today MCMC / Condtonal smulaton for hgh-dmensonal U: Markov chan Monte Carlo Consder
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Mamum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models for
More informationReview: Fit a line to N data points
Revew: Ft a lne to data ponts Correlated parameters: L y = a x + b Orthogonal parameters: J y = a (x ˆ x + b For ntercept b, set a=0 and fnd b by optmal average: ˆ b = y, Var[ b ˆ ] = For slope a, set
More informationRELIABILITY ASSESSMENT
CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department
More informationLogistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI
Logstc Regresson CAP 561: achne Learnng Instructor: Guo-Jun QI Bayes Classfer: A Generatve model odel the posteror dstrbuton P(Y X) Estmate class-condtonal dstrbuton P(X Y) for each Y Estmate pror dstrbuton
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationRockefeller College University at Albany
Rockefeller College Unverst at Alban PAD 705 Handout: Maxmum Lkelhood Estmaton Orgnal b Davd A. Wse John F. Kenned School of Government, Harvard Unverst Modfcatons b R. Karl Rethemeer Up to ths pont n
More informationA Note on Test of Homogeneity Against Umbrella Scale Alternative Based on U-Statistics
J Stat Appl Pro No 3 93- () 93 NSP Journal of Statstcs Applcatons & Probablty --- An Internatonal Journal @ NSP Natural Scences Publshng Cor A Note on Test of Homogenety Aganst Umbrella Scale Alternatve
More informationComparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method
Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method
More informationMLE and Bayesian Estimation. Jie Tang Department of Computer Science & Technology Tsinghua University 2012
MLE and Bayesan Estmaton Je Tang Department of Computer Scence & Technology Tsnghua Unversty 01 1 Lnear Regresson? As the frst step, we need to decde how we re gong to represent the functon f. One example:
More informationMarkov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement
Markov Chan Monte Carlo MCMC, Gbbs Samplng, Metropols Algorthms, and Smulated Annealng 2001 Bonformatcs Course Supplement SNU Bontellgence Lab http://bsnuackr/ Outlne! Markov Chan Monte Carlo MCMC! Metropols-Hastngs
More informationBasically, if you have a dummy dependent variable you will be estimating a probability.
ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy
More informationDESIGN EVALUATION AND OPTIMISATION IN CROSSOVER PHARMACOKINETIC STUDIES ANALYSED BY NONLINEAR MIXED EFFECTS MODELS
DESIGN EVALUATION AND OPTIMISATION IN CROSSOVER PHARMACOKINETIC STUDIES ANALYSED BY NONLINEAR MIXED EFFECTS MODELS Thu Thuy Nguyen, Caroline Bazzoli, France Mentré UMR 738 INSERM - University Paris Diderot,
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More information