Marginal Models for categorical data.
|
|
- Anissa Crawford
- 5 years ago
- Views:
Transcription
1 Margnal Models for categorcal data Applcaton to condtonal ndependence and graphcal models Wcher Bergsma 1 Marcel Croon 2 Jacques Hagenaars 2 Tamas Rudas 3 1 London School of Economcs and Poltcal Scence 2 Tlburg Unversty 3 ELTE, Hungary Cambrdge Unversty, February 2012
2 Outlne 1 Introducton 2 Degrees of freedom CI models wth non d data 3 Smoothness of ntersectons of CI models
3 Margnal models: for what types of data? Interest les n populaton averaged quanttes, but through desgn data are dependent (clustered). For correct nference, margnal modelng s needed.
4 Margnal models: for what types of data? Interest les n populaton averaged quanttes, but through desgn data are dependent (clustered). For correct nference, margnal modelng s needed. Dependences n the data arse n many stuatons: Comparng margnal dstrbutons of two characterstcs measured on the same respondents, e.g., preference prme mnster and party preference.
5 Margnal models: for what types of data? Interest les n populaton averaged quanttes, but through desgn data are dependent (clustered). For correct nference, margnal modelng s needed. Dependences n the data arse n many stuatons: Comparng margnal dstrbutons of two characterstcs measured on the same respondents, e.g., preference prme mnster and party preference. Respondents are clustered, e.g., husbands and wves, but nterest les n overall populaton dfferences men and women.
6 Margnal models: for what types of data? Interest les n populaton averaged quanttes, but through desgn data are dependent (clustered). For correct nference, margnal modelng s needed. Dependences n the data arse n many stuatons: Comparng margnal dstrbutons of two characterstcs measured on the same respondents, e.g., preference prme mnster and party preference. Respondents are clustered, e.g., husbands and wves, but nterest les n overall populaton dfferences men and women. Panel studes (repeated measurements): are there overall changes n the populaton?
7 Margnal models: for what types of data? Interest les n populaton averaged quanttes, but through desgn data are dependent (clustered). For correct nference, margnal modelng s needed. Dependences n the data arse n many stuatons: Comparng margnal dstrbutons of two characterstcs measured on the same respondents, e.g., preference prme mnster and party preference. Respondents are clustered, e.g., husbands and wves, but nterest les n overall populaton dfferences men and women. Panel studes (repeated measurements): are there overall changes n the populaton? Trend studes: comparng changes n two varables over tme.
8 Ths talk: two types of margnal models 1 Condtonal ndependence models for certan non-d data.
9 Ths talk: two types of margnal models 1 Condtonal ndependence models for certan non-d data. 2 Intersectons of condtonal ndependences
10 Ths talk: two types of margnal models 1 Condtonal ndependence models for certan non-d data. 2 Intersectons of condtonal ndependences Problems: degrees of freedom and mnmal specfcaton, smoothness
11 Ths talk: two types of margnal models 1 Condtonal ndependence models for certan non-d data. 2 Intersectons of condtonal ndependences Problems: degrees of freedom and mnmal specfcaton, smoothness Focus on categorcal data
12 Example: longtudnal data Age (A) 13 % 14 % 15 % 16 % 17 % Boys Maruana use (B) 1. Never Once a month More than once a month Grls Maruana use (G) 1. Never Once a month More than once a month
13 Growth curves maruna use Mean Usage Boys Grls 1.1 r Varables of nterest: age (A), maruana use (M), gender (G). Longtudnal study,.e., same boys and grls at each pont n tme, so data n Table AMG not d.
14 Fttng and testng: maxmum lkelhood How to test a model such as M G A (at all ages, maruana use same for boys and grls)?
15 Fttng and testng: maxmum lkelhood How to test a model such as M G A (at all ages, maruana use same for boys and grls)? Model nduces constrants on multnomal probabltes n full table GM 1 M 2 M 3 M 4 M 5.
16 Fttng and testng: maxmum lkelhood How to test a model such as M G A (at all ages, maruana use same for boys and grls)? Model nduces constrants on multnomal probabltes n full table GM 1 M 2 M 3 M 4 M 5. Maxmze kernel of multnomal log-lkelhood subect to the constrant L = p log π π B log(a π) = 0 Use scorng type Lagrange multpler method, algorthm of B. (1997), based on Atchson and Slvey (1959) and Lang and Agrest (1994).
17 Problems For many models: no problems at all wth fttng and testng. For some models we encountered problems...
18 Outlne 1 Introducton 2 Degrees of freedom CI models wth non d data 3 Smoothness of ntersectons of CI models
19 How many degrees of freedom (df)? For = 1,..., K and = 1,..., K : π A BC + D + = π A + B CD + = π A + B + C D
20 How many degrees of freedom (df)? For = 1,..., K and = 1,..., K : π A BC + D + = π A + B CD + = π A + B + C D (K 2 1) restrctons per eq. (1)
21 How many degrees of freedom (df)? For = 1,..., K and = 1,..., K : π A BC + D + = π A + B CD + = π A + B + C Nave calculaton: df = 2(K 2 1) D (K 2 1) restrctons per eq. (1)
22 How many degrees of freedom (df)? For = 1,..., K and = 1,..., K : π A BC + D + = π A + B CD + = π A + B + C D (K 2 1) restrctons per eq. (1) Nave calculaton: df = 2(K 2 1) Wrong: K 1 of the restrctons are not needed.
23 How many degrees of freedom (df)? For = 1,..., K and = 1,..., K : π A BC + D + = π A + B CD + = π A + B + C D (K 2 1) restrctons per eq. (1) Nave calculaton: df = 2(K 2 1) Wrong: K 1 of the restrctons are not needed. Soluton usng margnal loglnear parameterzatons (B. & Rudas, 2002); (1) equvalent to λ A B = λ B C = λ C D (K 1) 2 restrctons per eq. λ A = λ B = λ C = λ D (K 1) restrctons per eq. These form restrctons on a parameterzaton, so ths s a mnmal specfcaton; hence df = 2(K 1) 2 + 3(K 1)
24 How many degrees of freedom (df)? Ex. 2 π B A = π C B = π D C
25 How many degrees of freedom (df)? Ex. 2 π B A = π C B = π D C K (K 1) restrctons per eq. (2)
26 How many degrees of freedom (df)? Ex. 2 π B A = π C B = π D C K (K 1) restrctons per eq. (2) Nave calculaton: df = 2K (K 1)
27 How many degrees of freedom (df)? Ex. 2 π B A = π C B = π D C K (K 1) restrctons per eq. (2) Nave calculaton: df = 2K (K 1) Correct. But how do we know?
28 How many degrees of freedom (df)? Ex. 2 π B A = π C B = π D C K (K 1) restrctons per eq. (2) Nave calculaton: df = 2K (K 1) Correct. But how do we know? Usng margnal loglnear parameters (2) equvalent to λ A B = λ B C = λ C D (K 1) 2 restrctons per eq. λ A B = λ B C = λ C D (K 1) restrctons per eq.
29 How many degrees of freedom (df)? Ex. 2 π B A = π C B = π D C K (K 1) restrctons per eq. (2) Nave calculaton: df = 2K (K 1) Correct. But how do we know? Usng margnal loglnear parameters (2) equvalent to λ A B = λ B C = λ C D (K 1) 2 restrctons per eq. λ A B = λ B C = λ C D (K 1) restrctons per eq. Agan, restrctons on a parameterzaton, so ths s mnmal specfcaton; df = 2(K 1) 2 + 2(K 1) = 2K (K 1)
30 Cause of problems Same loglnear effect s restrcted n two dfferent margnal tables. Frst example revsted: π A BC + D + = π A + B CD + = π A + B + C Nave margnal loglnear specfcaton: D λ A B = λ B C = λ C D λ A B = λ B C = λ C D λ A B = λ B C = λ C D The loglnear B-effect s restrcted n both tables AB and BC, and the C-effect n BC and CD problems!
31 A not-so-obvous example Panel study drugs use of youth wth 5 waves (ages 13 to 17) Response varables: alcohol and maruana use Margnal tables of nterest: transtons from tme t to t + 1 for both alcohol and maruana usage. Artfcal table IPRS: I - tem (maruana or alcohol) P - perod (age 13-14, 14-15, 15-16, or 16-17) R, S - Response at 1st and 2nd measurement Condtonal ndependence models for margnal table IPRS: IP RS: all turnover tables dentcal, whatever I, P P RS: for both alcohol and maruana (I), turnover tables same for all perods I RS P: for any perod, turnover table alcohol same as for maruana
32 Soluton to the not-so-obvous example Probabltes n table IPRS formed by sums of probabltes n the orgnal multnomal table M 1 M 2 M 3 M 4 M 5 A 1 A 2 A 3 A 4 A 5 (3 10 = 59, 049 cells). Soluton s to formulate models such as P RS n terms of restrctons on a margnal loglnear parameterzaton for orgnal table.
33 Specfcaton model Model IP RS T k : measurement at tme pont k. Model nvolves these restrctons on margnals of multnomal table: π I T 1 T 2 1 = π I 1 T 2 T 3 = π I 1 T 3 T 4 = π I 1 T 4 T 5 = π I 2 T 1 T 2 = π I 2 T 2 T 3 = π I 2 T 3 T 4 = π I 2 A mnmal specfcaton s obtaned by frst, mposng equalty of the condtonal margnal assocaton parameters: λ T 1T 2 1 = λ T 2 T 3 1 = λ T 3 T 4 1 = λ T 4 T 5 1 = λ T 1 T 2 2 = λ T 2 T 3 2 = λ T 3 and second, by constranng the followng unvarate margnals: λ T 1 T 4 T 4 T 5, 2 = λ T 4 1 = λ T 2 1 = λ T 3 1 = λ T 4 1 = λ T 5 1 = λ T 1 2 = λ T 2 2 = λ T 3 2 = λ T 4 2 = λ T The number of ndependent constrants n ths mnmal specfcaton s (K 1)(7K + 2). T
34 Specfcaton model Model P RS Model assumes that the turnover tables are dfferent for the two tems but are dentcal over tme for each tem. A mnmal specfcaton: and λ T 1T 2 λ T 1T 2 λ T 1 λ T 1 1 = λ T 2 2 = λ T 2 T 3 T 3 1 = λ T 3 2 = λ T 3 T 4 T 4 1 = λ T 4 2 = λ T 4 T 5 1, T 5 2, 1 = λ T 2 1 = λ T 3 1 = λ T 4 1 = λ T 5 2 = λ T 2 2 = λ T 3 2 = λ T 4 2 = λ T 5 1, 2. The number of ndependent constrants n ths mnmal specfcaton s (K 1)(6K + 2).
35 Specfcaton model Model I RS P Model assumes that the turnover tables change over perod, but are the same for both tems at each perod. Mnmal specfcaton: and: λ T 1T 2 λ T 2T 3 λ T 3T 4 λ T 4T 5 λ T 1 λ T 2 λ T 3 λ T 4 1 = λ T 1 1 = λ T 2 1 = λ T 3 1 = λ T 4 1 = λ T 1 1 = λ T 2 1 = λ T 3 T 2 2 T 3 2 T 4 2 T 5 2, = λ T 4
36 Outlne 1 Introducton 2 Degrees of freedom CI models wth non d data 3 Smoothness of ntersectons of CI models
37 Illustraton of problem Intersecton margnal and condtonal ndependence: A B A B C If C s bnary, then equvalent to unon A C B C so ntersecton nonsmooth at A B C. How can we know?
38 Soluton n ths case Agan same loglnear effect (of AB) restrcted n two dfferent margnal tables: A B λ A B = 0 ( ) A B C λ A BC k = 0 and λa BC = 0 No smplfcaton possble, so problems to be expected. Another example: A BC DE F BD C ABC (and FBDC) effects restrcted twce! AF BE DC But ntersecton smooth, how do we know? Next theorem needed.
39 General condtonal ndependence model Q = {P P : A B C (P)} where A, B, C V for a set of varables V, P the famly of postve probablty dstrbutons for V.
40 General condtonal ndependence model Q = {P P : A B C (P)} where A, B, C V for a set of varables V, P the famly of postve probablty dstrbutons for V. Any fnte set of axoms ncompletely descrbes relatons among models (Studeny, 2005).
41 General condtonal ndependence model Q = {P P : A B C (P)} where A, B, C V for a set of varables V, P the famly of postve probablty dstrbutons for V. Any fnte set of axoms ncompletely descrbes relatons among models (Studeny, 2005). But: we can dentfy well-behaved subsets of models (next theorem).
42 Identfcaton of smooth models Condtonal ndependence model: Q = {P P : A B Wth IP(.) denotng the power set, let C (P)} ID = ID (A, B, C ) = IP(A B C ) \ (IP(A C ) IP(B C )) (ID contans loglnear effects set to zero under th CI) Let M 1,..., M m = V be nondecreasng orderng of margnals. For E V, M(E) s frst of the M contanng E. Theorem Suppose C M(E) A B C for all and E ID. Then * Q s herarchcal margnal log-lnear and s hence smooth. * Smple formula can be gven for correct df
43 Chan graph whose Andersson Madgan Perlman nterpretaton s a smooth model by Theorem (famly contans nonsmooth models) A C E G B D F Smoothness not easly verfed wthout theorem
44 Further work By ncompleteness of axoms, condtonal ndependence theory as complex as number theory. Much to be dscovered! Other results by Mlan Studeny, Frantsek Matus.
45 Some references Bergsma, W. P. and T. Rudas (2002). Margnal models for categorcal data. Annals of Statstcs, Vol. 30, Bergsma, W. P., M. A. Croon and J. A. Hagenaars (2009). Margnal models for dependent, clustered and longtudnal categorcal data. Sprnger NY. Rudas, T. and W. P. Bergsma and R. Nemeth (2010). Margnal log-lnear parameterzaton of condtonal ndependence models. Bometrka, vol 97, ssue 4, pp
The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationHidden Markov Models & The Multivariate Gaussian (10/26/04)
CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models
More informationChapter 5 Multilevel Models
Chapter 5 Multlevel Models 5.1 Cross-sectonal multlevel models 5.1.1 Two-level models 5.1.2 Multple level models 5.1.3 Multple level modelng n other felds 5.2 Longtudnal multlevel models 5.2.1 Two-level
More informationParametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010
Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton
More informationLecture 13 APPROXIMATION OF SECOMD ORDER DERIVATIVES
COMPUTATIONAL FLUID DYNAMICS: FDM: Appromaton of Second Order Dervatves Lecture APPROXIMATION OF SECOMD ORDER DERIVATIVES. APPROXIMATION OF SECOND ORDER DERIVATIVES Second order dervatves appear n dffusve
More informationFabio Rapallo. p x = P[x] = ϕ(t (x)) x X, (1)
Frst Internatonal School on Algebrac Statstcs STID Menton (France) February, 17-18, 2003 Torc Statstcal Models. The Dacons Sturmfels algorthm for log-lnear models. Tutoral Fabo Rapallo 1 Theoretcal recalls
More informationMATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)
1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons
More informationAdvanced Statistical Methods: Beyond Linear Regression
Advanced Statstcal Methods: Beyond Lnear Regresson John R. Stevens Utah State Unversty Notes 2. Statstcal Methods I Mathematcs Educators Workshop 28 March 2009 1 http://www.stat.usu.edu/~rstevens/pcm 2
More information8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore
8/5/17 Data Modelng Patrce Koehl Department of Bologcal Scences atonal Unversty of Sngapore http://www.cs.ucdavs.edu/~koehl/teachng/bl59 koehl@cs.ucdavs.edu Data Modelng Ø Data Modelng: least squares Ø
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationDiagnostics in Poisson Regression. Models - Residual Analysis
Dagnostcs n Posson Regresson Models - Resdual Analyss 1 Outlne Dagnostcs n Posson Regresson Models - Resdual Analyss Example 3: Recall of Stressful Events contnued 2 Resdual Analyss Resduals represent
More informationarxiv: v1 [math.co] 1 Mar 2014
Unon-ntersectng set systems Gyula O.H. Katona and Dánel T. Nagy March 4, 014 arxv:1403.0088v1 [math.co] 1 Mar 014 Abstract Three ntersecton theorems are proved. Frst, we determne the sze of the largest
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VIII LECTURE - 34 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS EFFECTS MODEL Dr Shalabh Department of Mathematcs and Statstcs Indan
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationDurban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications
Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department
More informationRandom Partitions of Samples
Random Parttons of Samples Klaus Th. Hess Insttut für Mathematsche Stochastk Technsche Unverstät Dresden Abstract In the present paper we construct a decomposton of a sample nto a fnte number of subsamples
More informationThe Relationship between Factor Analytic and Item Response Models
The Relatonshp between Factor Analytc and Item Response Models Akhto Kamata Department of Educaton Polcy and Leadershp Department of Psychology Center on Research and Evaluaton Southern Methodst Unversty
More informationA new construction of 3-separable matrices via an improved decoding of Macula s construction
Dscrete Optmzaton 5 008 700 704 Contents lsts avalable at ScenceDrect Dscrete Optmzaton journal homepage: wwwelsevercom/locate/dsopt A new constructon of 3-separable matrces va an mproved decodng of Macula
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More informationAdvances in Longitudinal Methods in the Social and Behavioral Sciences. Finite Mixtures of Nonlinear Mixed-Effects Models.
Advances n Longtudnal Methods n the Socal and Behavoral Scences Fnte Mxtures of Nonlnear Mxed-Effects Models Jeff Harrng Department of Measurement, Statstcs and Evaluaton The Center for Integrated Latent
More informationSTAT 405 BIOSTATISTICS (Fall 2016) Handout 15 Introduction to Logistic Regression
STAT 45 BIOSTATISTICS (Fall 26) Handout 5 Introducton to Logstc Regresson Ths handout covers materal found n Secton 3.7 of your text. You may also want to revew regresson technques n Chapter. In ths handout,
More informationSee Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)
Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes
More informationFirst Year Examination Department of Statistics, University of Florida
Frst Year Examnaton Department of Statstcs, Unversty of Florda May 7, 010, 8:00 am - 1:00 noon Instructons: 1. You have four hours to answer questons n ths examnaton.. You must show your work to receve
More informationComputation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models
Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,
More information2016 Wiley. Study Session 2: Ethical and Professional Standards Application
6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton
More informationMultilevel Logistic Regression for Polytomous Data and Rankings
Outlne Multlevel Logstc Regresson for Polytomous Data and Rankngs 1. Introducton to Applcaton: Brtsh Electon Panel 2. Logstc Models as Random Utlty Models 3. Independence from Irrelevant Alternatves (IIA)
More information3.1 ML and Empirical Distribution
67577 Intro. to Machne Learnng Fall semester, 2008/9 Lecture 3: Maxmum Lkelhood/ Maxmum Entropy Dualty Lecturer: Amnon Shashua Scrbe: Amnon Shashua 1 In the prevous lecture we defned the prncple of Maxmum
More information4.3 Poisson Regression
of teratvely reweghted least squares regressons (the IRLS algorthm). We do wthout gvng further detals, but nstead focus on the practcal applcaton. > glm(survval~log(weght)+age, famly="bnomal", data=baby)
More informationTopic 23 - Randomized Complete Block Designs (RCBD)
Topc 3 ANOVA (III) 3-1 Topc 3 - Randomzed Complete Block Desgns (RCBD) Defn: A Randomzed Complete Block Desgn s a varant of the completely randomzed desgn (CRD) that we recently learned. In ths desgn,
More informationOn cyclic of Steiner system (v); V=2,3,5,7,11,13
On cyclc of Stener system (v); V=,3,5,7,,3 Prof. Dr. Adl M. Ahmed Rana A. Ibraham Abstract: A stener system can be defned by the trple S(t,k,v), where every block B, (=,,,b) contans exactly K-elementes
More information8 : Learning in Fully Observed Markov Networks. 1 Why We Need to Learn Undirected Graphical Models. 2 Structural Learning for Completely Observed MRF
10-708: Probablstc Graphcal Models 10-708, Sprng 2014 8 : Learnng n Fully Observed Markov Networks Lecturer: Erc P. Xng Scrbes: Meng Song, L Zhou 1 Why We Need to Learn Undrected Graphcal Models In the
More informationPortfolios with Trading Constraints and Payout Restrictions
Portfolos wth Tradng Constrants and Payout Restrctons John R. Brge Northwestern Unversty (ont wor wth Chrs Donohue Xaodong Xu and Gongyun Zhao) 1 General Problem (Very) long-term nvestor (eample: unversty
More informationExercises of Chapter 2
Exercses of Chapter Chuang-Cheh Ln Department of Computer Scence and Informaton Engneerng, Natonal Chung Cheng Unversty, Mng-Hsung, Chay 61, Tawan. Exercse.6. Suppose that we ndependently roll two standard
More informationHidden Markov Models
CM229S: Machne Learnng for Bonformatcs Lecture 12-05/05/2016 Hdden Markov Models Lecturer: Srram Sankararaman Scrbe: Akshay Dattatray Shnde Edted by: TBD 1 Introducton For a drected graph G we can wrte
More informationOnline Appendix to: Axiomatization and measurement of Quasi-hyperbolic Discounting
Onlne Appendx to: Axomatzaton and measurement of Quas-hyperbolc Dscountng José Lus Montel Olea Tomasz Strzaleck 1 Sample Selecton As dscussed before our ntal sample conssts of two groups of subjects. Group
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationLimited Dependent Variables and Panel Data. Tibor Hanappi
Lmted Dependent Varables and Panel Data Tbor Hanapp 30.06.2010 Lmted Dependent Varables Dscrete: Varables that can take onl a countable number of values Censored/Truncated: Data ponts n some specfc range
More informationLecture 6: Introduction to Linear Regression
Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationProblem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationBasically, if you have a dummy dependent variable you will be estimating a probability.
ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy
More informationBasic Business Statistics, 10/e
Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson
More informationNumber of cases Number of factors Number of covariates Number of levels of factor i. Value of the dependent variable for case k
ANOVA Model and Matrx Computatons Notaton The followng notaton s used throughout ths chapter unless otherwse stated: N F CN Y Z j w W Number of cases Number of factors Number of covarates Number of levels
More informationAn Introduction to Censoring, Truncation and Sample Selection Problems
An Introducton to Censorng, Truncaton and Sample Selecton Problems Thomas Crossley SPIDA June 2003 1 A. Introducton A.1 Basc Ideas Most of the statstcal technques we study are for estmatng (populaton)
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationBIO Lab 2: TWO-LEVEL NORMAL MODELS with school children popularity data
Lab : TWO-LEVEL NORMAL MODELS wth school chldren popularty data Purpose: Introduce basc two-level models for normally dstrbuted responses usng STATA. In partcular, we dscuss Random ntercept models wthout
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationWinter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan
Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments
More informationLOGIT ANALYSIS. A.K. VASISHT Indian Agricultural Statistics Research Institute, Library Avenue, New Delhi
LOGIT ANALYSIS A.K. VASISHT Indan Agrcultural Statstcs Research Insttute, Lbrary Avenue, New Delh-0 02 amtvassht@asr.res.n. Introducton In dummy regresson varable models, t s assumed mplctly that the dependent
More informationPhysics 5153 Classical Mechanics. Principle of Virtual Work-1
P. Guterrez 1 Introducton Physcs 5153 Classcal Mechancs Prncple of Vrtual Work The frst varatonal prncple we encounter n mechancs s the prncple of vrtual work. It establshes the equlbrum condton of a mechancal
More informationSTATS 306B: Unsupervised Learning Spring Lecture 10 April 30
STATS 306B: Unsupervsed Learnng Sprng 2014 Lecture 10 Aprl 30 Lecturer: Lester Mackey Scrbe: Joey Arthur, Rakesh Achanta 10.1 Factor Analyss 10.1.1 Recap Recall the factor analyss (FA) model for lnear
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More informationxp(x µ) = 0 p(x = 0 µ) + 1 p(x = 1 µ) = µ
CSE 455/555 Sprng 2013 Homework 7: Parametrc Technques Jason J. Corso Computer Scence and Engneerng SUY at Buffalo jcorso@buffalo.edu Solutons by Yngbo Zhou Ths assgnment does not need to be submtted and
More informationCredit Card Pricing and Impact of Adverse Selection
Credt Card Prcng and Impact of Adverse Selecton Bo Huang and Lyn C. Thomas Unversty of Southampton Contents Background Aucton model of credt card solctaton - Errors n probablty of beng Good - Errors n
More informationGoodness of fit and Wilks theorem
DRAFT 0.0 Glen Cowan 3 June, 2013 Goodness of ft and Wlks theorem Suppose we model data y wth a lkelhood L(µ) that depends on a set of N parameters µ = (µ 1,...,µ N ). Defne the statstc t µ ln L(µ) L(ˆµ),
More informationsince [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation
Econ 388 R. Butler 204 revsons Lecture 4 Dummy Dependent Varables I. Lnear Probablty Model: the Regresson model wth a dummy varables as the dependent varable assumpton, mplcaton regular multple regresson
More informationOutline. Bayesian Networks: Maximum Likelihood Estimation and Tree Structure Learning. Our Model and Data. Outline
Outlne Bayesan Networks: Maxmum Lkelhood Estmaton and Tree Structure Learnng Huzhen Yu janey.yu@cs.helsnk.f Dept. Computer Scence, Unv. of Helsnk Probablstc Models, Sprng, 200 Notces: I corrected a number
More informationCHAPTER-5 INFORMATION MEASURE OF FUZZY MATRIX AND FUZZY BINARY RELATION
CAPTER- INFORMATION MEASURE OF FUZZY MATRI AN FUZZY BINARY RELATION Introducton The basc concept of the fuzz matr theor s ver smple and can be appled to socal and natural stuatons A branch of fuzz matr
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More informationPredictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore
Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationBayesian predictive Configural Frequency Analysis
Psychologcal Test and Assessment Modelng, Volume 54, 2012 (3), 285-292 Bayesan predctve Confgural Frequency Analyss Eduardo Gutérrez-Peña 1 Abstract Confgural Frequency Analyss s a method for cell-wse
More informationMin Cut, Fast Cut, Polynomial Identities
Randomzed Algorthms, Summer 016 Mn Cut, Fast Cut, Polynomal Identtes Instructor: Thomas Kesselhem and Kurt Mehlhorn 1 Mn Cuts n Graphs Lecture (5 pages) Throughout ths secton, G = (V, E) s a mult-graph.
More informationMean Field / Variational Approximations
Mean Feld / Varatonal Appromatons resented by Jose Nuñez 0/24/05 Outlne Introducton Mean Feld Appromaton Structured Mean Feld Weghted Mean Feld Varatonal Methods Introducton roblem: We have dstrbuton but
More informationOn an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1
On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool
More informationA Local Variational Problem of Second Order for a Class of Optimal Control Problems with Nonsmooth Objective Function
A Local Varatonal Problem of Second Order for a Class of Optmal Control Problems wth Nonsmooth Objectve Functon Alexander P. Afanasev Insttute for Informaton Transmsson Problems, Russan Academy of Scences,
More informationReport on Image warping
Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours
UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x
More informationAndreas C. Drichoutis Agriculural University of Athens. Abstract
Heteroskedastcty, the sngle crossng property and ordered response models Andreas C. Drchouts Agrculural Unversty of Athens Panagots Lazards Agrculural Unversty of Athens Rodolfo M. Nayga, Jr. Texas AMUnversty
More informationCalculation of time complexity (3%)
Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add
More informationSimulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests
Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth
More informationEstimation: Part 2. Chapter GREG estimation
Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the
More informationJoint Statistical Meetings - Biopharmaceutical Section
Iteratve Ch-Square Test for Equvalence of Multple Treatment Groups Te-Hua Ng*, U.S. Food and Drug Admnstraton 1401 Rockvlle Pke, #200S, HFM-217, Rockvlle, MD 20852-1448 Key Words: Equvalence Testng; Actve
More informationMaximizing Overlap of Large Primary Sampling Units in Repeated Sampling: A comparison of Ernst s Method with Ohlsson s Method
Maxmzng Overlap of Large Prmary Samplng Unts n Repeated Samplng: A comparson of Ernst s Method wth Ohlsson s Method Red Rottach and Padrac Murphy 1 U.S. Census Bureau 4600 Slver Hll Road, Washngton DC
More informationThermodynamics and statistical mechanics in materials modelling II
Course MP3 Lecture 8/11/006 (JAE) Course MP3 Lecture 8/11/006 Thermodynamcs and statstcal mechancs n materals modellng II A bref résumé of the physcal concepts used n materals modellng Dr James Ellott.1
More informationModule Contact: Dr Susan Long, ECO Copyright of the University of East Anglia Version 1
UNIVERSITY OF EAST ANGLIA School of Economcs Man Seres PG Examnaton 016-17 ECONOMETRIC METHODS ECO-7000A Tme allowed: hours Answer ALL FOUR Questons. Queston 1 carres a weght of 5%; Queston carres 0%;
More informationStatistics Chapter 4
Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment
More informationANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE
P a g e ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE Darmud O Drscoll ¹, Donald E. Ramrez ² ¹ Head of Department of Mathematcs and Computer Studes
More informationDepartment of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution
Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable
More informationThe Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD
he Gaussan classfer Nuno Vasconcelos ECE Department, UCSD Bayesan decson theory recall that we have state of the world X observatons g decson functon L[g,y] loss of predctng y wth g Bayes decson rule s
More informationRules of Probability
( ) ( ) = for all Corollary: Rules of robablty The probablty of the unon of any two events and B s roof: ( Φ) = 0. F. ( B) = ( ) + ( B) ( B) If B then, ( ) ( B). roof: week 2 week 2 2 Incluson / Excluson
More informationGlobal Sensitivity. Tuesday 20 th February, 2018
Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values
More informationSystem in Weibull Distribution
Internatonal Matheatcal Foru 4 9 no. 9 94-95 Relablty Equvalence Factors of a Seres-Parallel Syste n Webull Dstrbuton M. A. El-Dacese Matheatcs Departent Faculty of Scence Tanta Unversty Tanta Egypt eldacese@yahoo.co
More informationMaximizing the number of nonnegative subsets
Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum
More informationHere is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)
Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,
More informationBOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu
BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com
More information/ n ) are compared. The logic is: if the two
STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models
More informationChapter 1: Introduction to Probability
Chapter : Introducton to obablty Sectons Engneerng pplcatons of obablty Random Experments and Events Defntons of obablty The Relatve Frequency pproach Elementary Set Theory The xomatc pproach Condtonal
More informationDesign and Optimization of Fuzzy Controller for Inverse Pendulum System Using Genetic Algorithm
Desgn and Optmzaton of Fuzzy Controller for Inverse Pendulum System Usng Genetc Algorthm H. Mehraban A. Ashoor Unversty of Tehran Unversty of Tehran h.mehraban@ece.ut.ac.r a.ashoor@ece.ut.ac.r Abstract:
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informationBayesian Learning. Smart Home Health Analytics Spring Nirmalya Roy Department of Information Systems University of Maryland Baltimore County
Smart Home Health Analytcs Sprng 2018 Bayesan Learnng Nrmalya Roy Department of Informaton Systems Unversty of Maryland Baltmore ounty www.umbc.edu Bayesan Learnng ombnes pror knowledge wth evdence to
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationDiscussion 11 Summary 11/20/2018
Dscusson 11 Summary 11/20/2018 1 Quz 8 1. Prove for any sets A, B that A = A B ff B A. Soluton: There are two drectons we need to prove: (a) A = A B B A, (b) B A A = A B. (a) Frst, we prove A = A B B A.
More information