Interval Regression with Sample Selection
|
|
- Victoria Underwood
- 5 years ago
- Views:
Transcription
1 Interval Regresson wth Sample Selecton Géraldne Hennngsen, Arne Hennngsen, Sebastan Petersen May 3, 07 Ths vgnette s largely based on Petersen et al. 07. Model Specfcaton The general specfcaton of an nterval regresson model wth sample selecton s: ε S ε O y S β S x S + ε S { y S 0 f y S 0 otherwse y O β O x O + ε O 3 unknown f y S 0 f < y O and y S y O f < y O 3 and y S. M 0 N 0, [ ρ ρ 4 f M < y O M+ and y S ], 5 where subscrpt ndcates the observaton, y O s a latent outcome varable, y O s a partally observed categorcal varable that ndcates n whch nterval y O les, M s the number of ntervals,,..., M+ are the boundares of the ntervals whereas frequently but not necessarly and M+, y S s a bnary varable that ndcates whether y O s observed, y S s a latent varable that ndcates the tendency that y S s one, x S and x O are column vectors of explanatory varables for the selecton equaton and outcome equaton, respectvely, ε S and ε O are random dsturbance terms that have a jont bvarate normal dstrbuton, and β S and β O are column vectors and ρ and are scalars of unknown model parameters.
2 Log-Lkelhood Functon The probablty that y O s unobserved s: P y S 0 P y S 0 6 P β S x S + ε S 0 7 P ε S β S x S 8 The probablty that y O s observed and ndcates that y O les n the mth nterval s: P y S y O m P y S > 0 m < y O m+ 9 β S x S + ε S > 0 m < β O x O + ε O m+ P P ε S > β S x S m β O x O < ε O m+ β O x O 0 The log-lkelhood contrbuton of the th observaton s: [ ] l y S ln Φ β S x S + y S y O m+ β m ln [Φ O x O, β S x S, ρ m ] Φ m β O x O, β S x S, ρ, where Φ. ndcates the cumulatve dstrbuton functon of the unvarate standard normal dstrbuton and Φ. ndcates the cumulatve dstrbuton functon of the bvarate standard normal dstrbuton. 3 Restrctng coeffcents ρ and The parameter ρ needs to be n the nterval,. In order to restrct ρ to be n ths nterval, we estmate arctanρ nstead of ρ so that the derved parameter ρ tanarctanρ s always n the nterval,. We use the delta method to calculate approxmate standard errors of the derved parameter ρ, whereas the correspondng element of the Jacoban matrx s: tanarctanρ arctanρ ρ arctanρ + ρ 3 The parameter needs to be strctly postve,.e. > 0. In order to restrct to be strctly postve, we estmate log nstead of or so that the derved parameters explog and exp log are always strctly postve. We use the delta
3 method to calculate approxmate standard errors of the derved parameters and, whereas the correspondng elements of the Jacoban matrx are: explog log exp log log explog 4 exp log 5 4 Gradents of the CDF of the bvarate standard normal dstrbuton In order to facltate the calculaton of the gradents of the log-lkelhood functon, we calculate the partal dervatves of the cumulatve dstrbuton functon CDF of the bvarate standard normal dstrbuton: Φ x, x, ρ x x φ a, a, ρ da da, 6 where φ. s the probablty densty functon PDF of the bvarate standard normal dstrbuton: φ x, x, ρ π ρ exp x ρx x + x ρ 7 In the followng, we check equaton 7 by a smple numercal example: > lbrary "mvtnorm" > lbrary "maxlk" > x <- 0.4 > x < > rho < > sgma <- matrx c, rho, rho,, nrow > dens <- dmvnorm c x, x, sgma sgma > prnt dens [] > all.equal dens, * p * sqrt - rho^ ^- * + exp - x^ - * rho * x * x + x^ / * - rho^ [] TRUE 3
4 4. Gradents wth respect to the lmts x and x Φ x, x, ρ x x x x x x φ a, x, ρ da 8 φa x, ρφx da 9 φ a, ρx, ρ φx da 0 a ρx φ ρ φx da ρ φ x ρx ρ Φ a ρx ρ ρ da φx x ρx ρ φa da φx 3 φx, 4 where φ, µ, ndcates the densty functon of a normal dstrbuton wth mean µ and varance. In the followng, we use the same smple numercal example as n the begnnng of secton 4 to check the above dervatons. Frst, we check whether the PDF of the bvarate standard normal dstrbuton,.e. φ x, x, ρ part of equaton 8, s equal to φ x, ρx, ρ φx part of equaton 0 and equal to φ x ρx / ρ ρ φx part of equatons and : > all.equal dens, dnorm x, rho * x, sqrt - rho^ * dnormx [] TRUE > all.equal dens, dnorm x - rho * x / sqrt - rho^ / + sqrt - rho^ * dnormx [] TRUE In the followng, we wll numercally calculate the dervatve of the cumulatve dstrbuton functon of the bvarate normal dstrbuton equaton 6 wth respect to x and check wehther ths partal dervatve s equal to the rght-hand sdes of equatons 8,,, and 4: > funx <- functon a { + prob <- pmvnorm upper c x, a, sgma sgma 4
5 + return prob > grad <- c numercgradent funx, x > prnt grad [] > funx <- functon a { + dens <- rep NA, length a + for n :length a { + dens[] <- dmvnorm c a[], x, sgma sgma + return dens > all.equal grad, ntegrate funx, lower -Inf, upper x $value [] TRUE > funxa <- functon a { + dens <- rep NA, length a + for n :length a { + dens[] <- dnorm a[] - rho * x / sqrt - rho^ / + sqrt-rho^ * dnormx + return dens > all.equal grad, ntegrate funxa, lower -Inf, upper x $value [] TRUE > funxb <- functon a { + dens <- rep NA, length a + for n :length a { + dens[] <- dnorm a[] - rho * x / sqrt - rho^ / + sqrt-rho^ + return dens > all.equal grad, + ntegrate funxb, lower -Inf, upper x $value * dnormx [] TRUE > all.equal grad, + pnorm x - rho * x / sqrt - rho^ * dnorm x [] TRUE 5
6 4. Gradents wth respect to the coeffcent of correlaton ρ Φ x, x, ρ ρ [ x ] x φ a, a, ρ da da ρ 5 6 x x φ a, a, ρ da da 7 ρ x x ρ exp a ρa a + a ρ π ρ da da 8 x x π ρ exp a ρa a + a ρ ρ da da 9 x x ρ π exp a ρa a + a ρ ρ ρ ρ exp a ρa a + a ρ ρ da da ρ 30 x x ρ π a ρa a + a ρ exp a ρa a + a ρ ρ ρ ρ ρ exp a ρa a + a ρ ρ da da 3 6
7 x x π 4ρa ρa a + a ρ a a 4 ρ exp ρ a ρa a + a ρ ρ ρ ρ exp a ρa a + a ρ ρ da da 3 4ρa x x ρa a + a ρ a a 4 ρ ρ ρ ρ π ρ ρ exp a ρa a + a ρ da da x x 4ρa ρa a + a ρ a a ρ + π 4 ρ 5 3 ρ 3 exp a ρa a + a ρ da da x x 4ρa ρa a + a ρ a a ρ + π 4 ρ 5 ρ 3 exp a ρa a + a ρ da da x x ρ ρa ρa a + a a a π ρ 3 ρ 5 exp a ρa a + a ρ da da x x ρ π ρ ρ ρa ρa a + a a a ρ exp a ρa a + a ρ da da
8 π ρ π ρ lm a x x a ρa ρ exp a ρa a + a x ρ a ρx ρ exp a ρa x + x ρ a + ρa ρ a exp ρa a + a da ρ Applyng L Hosptal on the last term leads to x π a ρx ρ ρ exp a ρa x + x ρ 0 π ρ x a ρx ρ exp a ρa x + x ρ da da 40 da 4 π ρ exp a ρa x + x x ρ π ρ exp x ρx x + x ρ 4 43 φ x, x, ρ 44 Ths result s n lne wth Sbuya 960 and Sungur 990. In the followng, we wll numercally calculate the dervatve of the cumulatve dstrbuton functon of the bvarate normal dstrbuton equaton 6 wth respect to ρ and check whether ths partal dervatve s equal to the rght-hand sdes of equaton 44: > # Numercal gradent of the PDF w.r.t. rho > funrho <- functon p { + prob <- dmvnorm x c x, x, + sgma matrx c, p, p,, nrow + return prob > grad <- c numercgradent funrho, rho > prnt grad [] > # Comparson wth analytcal gradent for rho > efun <- exp-x^ - * rho * x * x + x^/* - rho^ 8
9 > all.equal grad, + -*rho*-*rho*x*x+x^+x^ - *x*x*-rho^ * efun/ + *-rho^^3/ + + rho*efun/sqrt-rho^ / + *p*-rho^ [] TRUE > #Eq9 > all.equalgrad, + /*p * + -4*rho*x^-*rho*x*x+x^-*-rho^*-*x*x/4*-rho^^ * + efun * sqrt-rho^/-rho^ - + -rho/sqrt-rho^*efun/-rho^ + [] TRUE > #Eq33 > all.equalgrad, + /*p * + rho/-rho^^3/ - rho*x^-rho*x*x+x^-x*x/ + -rho^^5/ * efun + [] TRUE > #Eq34 > all.equalgrad, + /*p*sqrt-rho^ * + rho/-rho^ - rho*x^-rho*x*x+x^-x*x/ + -rho^^ * efun + [] TRUE > > > # Numercal gradent of the CDF w.r.t. rho > cdfrho <- functon p, xa x, xb x { + prob <- pmvnorm upper c xa, xb, + sgma matrx c, p, p,, nrow + return prob > grad <- c numercgradent cdfrho, rho > prnt grad 9
10 [] > # comparson wth analytcal gradent > all.equal grad, dmvnorm x c x, x, + sgma matrx c, rho, rho,, nrow [] TRUE > # comparsons wth other values > compdervrho <- functon xa, xb, p { + dn <- c numercgradent cdfrho, p, xa xa, xb xb + da <- dmvnorm x c xa, xb, + sgma matrx c, p, p,, nrow + return all.equal dn, da > compdervrho x, x, rho [] TRUE > compdervrho 0.5, x, rho [] TRUE > compdervrho.5, x, rho [] TRUE > compdervrho x, -, rho [] TRUE > compdervrho x, x, 0. [] TRUE > compdervrho x, x, 0.98 [] TRUE 0
11 5 Gradents of the Log-Lkelhood Functon 5. Gradents wth respect to the parameters n the self-selecton decson β S Frst, we use equaton 4, to determne the dervatve of the bvarate standard normal dstrbuton wth respect to the parameter β S as part of the loglkelhood functon: Φ m β O x O, β S x S, ρ Φ m β O x O m β O x O β S Φ ρβ S x S φβ S x S ρ βs x S β S 45 + ρβ S x S φβ S x S ρ x S 46 Usng ths result we can now derve the gradent for β S n the log-lkelhood functon: l β S + [ ] β S y S ln Φ β S x S y S y O m m ln m+ β [Φ O x O m β O x O Φ, β S x S, ρ y S β S + y S y O m ], β S x S, ρ 47 [ ] ln Φ β S x S 48 m m+ β β S ln [Φ O x O ], β S x S, ρ m β O x O Φ, β S x S, ρ β S x S x S 49 Φ β S x S φ y S + y S y O m m Φ m+ β O x O,β S x S, ρ β S Φ m β O x O,β S x S, ρ β S Φ m+ β O x O, β S x S, ρ Φ m β O x O, β S x S, ρ
12 φ β S x S y S x S 50 Φ β S x S + y S y O m m Φ m+ β O x O, β S x S, ρ Φ m β O x O, β S x S, ρ m+ β O x O Φ + ρβ S x S φ β S x S ρ x S Φ + ρβ S x S φ β S x S ρ x S m β O x O φ β S x S y S Φ β S x S + y S y O m m x S 5 Φ m+ β O x O +ρβ S x S ρ Φ m β O x O +ρβ S x S ρ φ β S x S x S Φ m+ β O x O, β S x S, ρ Φ m β O x O, β S x S, ρ
13 5. Gradents wth respect to the parameters n the outcome decson β O Analogous to β S and by usng equaton 4 we derve the gradent of β O : Φ m β O x O, β S x S, ρ β O Φ βs x S + ρ m βo x O ρ φ m β O x O xo Usng ths result we derve the gradent for the outcome parameter β O for the loglkelhood functon: l β O [ ] β O y S ln Φ β S x S + y S y O m m ln Φ m β O x O y S y O m m β O Φ m β O x O y S y O m m y S y O m m Φ m+ β [Φ O x O ], β S x S, ρ ln βs x S + ρ m+ β O x O ρ Φ m+ β [Φ O x O ], β S x S, ρ Φ m+ β O x O,β S x S, ρ β O, β S x S, ρ, β S x S, ρ Φ m β O x O,β S x S, ρ β O Φ m+ β O x O, β S x S, ρ Φ m β O x O, β S x S, ρ βs x S + ρ m βo x O ρ Φ m+ β O x O, β S x S, ρ Φ m β O x O, β S x S, ρ φ φ m+ β O x O m β O x O xo xo 56 3
14 y S y O m m Φ βs x S + ρ m+ β O x O ρ Φ βs x S + ρ m βo x O ρ Φ m+ β O x O, β S x S, ρ Φ m β O x O, β S x S, ρ φ φ m+ β O x O m β O x O xo Gradents wth respect to the coeffcent of correlaton ρ Gven the result that the dervatve of the CDF wth respect to ρ s equal to the PDF see equaton 44, we can also derve the gradent of the correlaton parameter ρ: l ρ ρ + y S y O m y S ln m ln [ ] Φ β S x S m+ β [Φ O x O ], β S x S, ρ m β O x O Φ, β S x S, ρ y S y O m m+ β ln [Φ O x O, β S x S, ρ ρ ] m Φ m β O x O y S y O m m, β S x S, ρ φ m β O x O, β S x S, ρ φ m+ β O x O, β S x S, ρ Φ m+ β O x O, β S x S, ρ Φ m β O x O, β S x S, ρ 60 l arctanhρ l ρ ρ arctanhρ l ρ ρ Gradents wth respect to the standard devaton used for normalsaton Fnally, we derve the gradent for n the same way as we dd for β S and β O : 4
15 Φ m β O x O, β S x S, ρ Φ βs x S + ρ m βo x O ρ φ m β O x O βo x O m 6 Φ m β O x O, β S x S, ρ lm m lm Φ Φ Φ m Φ βs x S + ρ m βo x O ρ m β O x O βs x S + ρ m βo x O φ ρ lm φ m β O x O m βs x S + ρ m βo x O ρ βs x S + ρ m βo x O ρ lm m β O x O m φ m β O x O βo x O m 63 βo x O m Φ Φ lm m φ m β O x O βs x S + ρ m βo x O ρ βs x S + ρ m βo x O ρ lm m lm m m βo x O φ m β O x O φ m β O x O φ m β O x O m β O x O m β O x O Smlarly: Φ m β O x O, β S x S, ρ lm m
16 l [ ] y S ln Φ β S x S + y S y O m+ β m ln [Φ O x O m ], β S x S, ρ m β O x O Φ, β S x S, ρ y S y O m m+ β ln [Φ O x O, β S x S, ρ ] m Φ m β O x O, β S x S, ρ y S y O m Φ m+ β O x O, β S x S, ρ Φ m β O x O, β S x S, ρ m Φ m+ β O x O,β S x S, ρ m β Φ O x O,β S x S, ρ y S yo m 74 m Φ m+ β O x O, β S x S, ρ Φ m β O x O, β S x S, ρ Φ βs x S + ρ m+ β O x O m+ β O x O φ βo x O m+ ρ Φ βs x S + ρ m βo x O ρ φ m β O x O βo x O m References l log l log l 75 Petersen, Sebastan, Géraldne Hennngsen, and Arne Hennngsen, Whch Households Invest n Energy-Savng Home Improvements? Evdence From a Dansh Polcy Interventon, 07. Unpublshed Manuscrpt. Department of Management Engneerng, Techncal Unversty of Denmark. Sbuya, Masaak, Bvarate Extreme Statstcs, I, Annals of the Insttute of Statstcal Mathematcs, 960,,
17 Sungur, Engn, Dependence Informaton n Parameterzed Copulas, Communcatons n Statstcs - Smulaton and Computaton, 990, 9 4,
Interval Regression with Sample Selection
Interval Regresson wth Sample Selecton Arne Hennngsen, Sebastan Petersen, Géraldne Hennngsen February 9, 09 Ths vgnette s largely based on Petersen et al. 07. Model Specfcaton The general specfcaton of
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Mamum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models for
More informationMarginal Effects in Probit Models: Interpretation and Testing. 1. Interpreting Probit Coefficients
ECON 5 -- NOE 15 Margnal Effects n Probt Models: Interpretaton and estng hs note ntroduces you to the two types of margnal effects n probt models: margnal ndex effects, and margnal probablty effects. It
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationSee Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)
Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes
More informationLimited Dependent Variables
Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationPOWER AND SIZE OF NORMAL DISTRIBUTION AND ITS APPLICATIONS
Jurnal Ilmah Matematka dan Penddkan Matematka (JMP) Vol. 9 No., Desember 07, hal. -6 ISSN (Cetak) : 085-456; ISSN (Onlne) : 550-04; https://jmpunsoed.com/ POWER AND SIZE OF NORMAL DISTRIBION AND ITS APPLICATIONS
More informationUncertainty and auto-correlation in. Measurement
Uncertanty and auto-correlaton n arxv:1707.03276v2 [physcs.data-an] 30 Dec 2017 Measurement Markus Schebl Federal Offce of Metrology and Surveyng (BEV), 1160 Venna, Austra E-mal: markus.schebl@bev.gv.at
More informationHere is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)
Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationChapter 20 Duration Analysis
Chapter 20 Duraton Analyss Duraton: tme elapsed untl a certan event occurs (weeks unemployed, months spent on welfare). Survval analyss: duraton of nterest s survval tme of a subject, begn n an ntal state
More informationUsing T.O.M to Estimate Parameter of distributions that have not Single Exponential Family
IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran
More informationAPPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14
APPROXIMAE PRICES OF BASKE AND ASIAN OPIONS DUPON OLIVIER Prema 14 Contents Introducton 1 1. Framewor 1 1.1. Baset optons 1.. Asan optons. Computng the prce 3. Lower bound 3.1. Closed formula for the prce
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationAn Application of Fuzzy Hypotheses Testing in Radar Detection
Proceedngs of the th WSES Internatonal Conference on FUZZY SYSEMS n pplcaton of Fuy Hypotheses estng n Radar Detecton.K.ELSHERIF, F.M.BBDY, G.M.BDELHMID Department of Mathematcs Mltary echncal Collage
More informationEffects of Ignoring Correlations When Computing Sample Chi-Square. John W. Fowler February 26, 2012
Effects of Ignorng Correlatons When Computng Sample Ch-Square John W. Fowler February 6, 0 It can happen that ch-square must be computed for a sample whose elements are correlated to an unknown extent.
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationComputation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models
Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationEEE 241: Linear Systems
EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they
More informationPhysicsAndMathsTutor.com
PhscsAndMathsTutor.com phscsandmathstutor.com June 005 5. The random varable X has probablt functon k, = 1,, 3, P( X = ) = k ( + 1), = 4, 5, where k s a constant. (a) Fnd the value of k. (b) Fnd the eact
More informationa. (All your answers should be in the letter!
Econ 301 Blkent Unversty Taskn Econometrcs Department of Economcs Md Term Exam I November 8, 015 Name For each hypothess testng n the exam complete the followng steps: Indcate the test statstc, ts crtcal
More informationChapter Newton s Method
Chapter 9. Newton s Method After readng ths chapter, you should be able to:. Understand how Newton s method s dfferent from the Golden Secton Search method. Understand how Newton s method works 3. Solve
More informationSimulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests
Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth
More informationOn an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1
On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationDO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes
25/6 Canddates Only January Examnatons 26 Student Number: Desk Number:...... DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR Department Module Code Module Ttle Exam Duraton
More informationNegative Binomial Regression
STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationGoodness of fit and Wilks theorem
DRAFT 0.0 Glen Cowan 3 June, 2013 Goodness of ft and Wlks theorem Suppose we model data y wth a lkelhood L(µ) that depends on a set of N parameters µ = (µ 1,...,µ N ). Defne the statstc t µ ln L(µ) L(ˆµ),
More information(c) Pongsa Pornchaiwiseskul, Faculty of Economics, Chulalongkorn University
Transform a bnary qualtatve varable (wth non-numercal values) to a dummy varable. For example, GENDER = f the observaton s male = f t s female (c) Pongsa Pornchawseskul, Faculty of Economcs, Chulalongkorn
More informationCorrelation and Regression. Correlation 9.1. Correlation. Chapter 9
Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours
UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More informationThis column is a continuation of our previous column
Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard
More informationAn (almost) unbiased estimator for the S-Gini index
An (almost unbased estmator for the S-Gn ndex Thomas Demuynck February 25, 2009 Abstract Ths note provdes an unbased estmator for the absolute S-Gn and an almost unbased estmator for the relatve S-Gn for
More informationProfessor Chris Murray. Midterm Exam
Econ 7 Econometrcs Sprng 4 Professor Chrs Murray McElhnney D cjmurray@uh.edu Mdterm Exam Wrte your answers on one sde of the blank whte paper that I have gven you.. Do not wrte your answers on ths exam.
More informationRELIABILITY ASSESSMENT
CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department
More informationMATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)
1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons
More informationj) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1
Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons
More informationIntroduction to the R Statistical Computing Environment R Programming
Introducton to the R Statstcal Computng Envronment R Programmng John Fox McMaster Unversty ICPSR 2018 John Fox (McMaster Unversty) R Programmng ICPSR 2018 1 / 14 Programmng Bascs Topcs Functon defnton
More informationLinear regression. Regression Models. Chapter 11 Student Lecture Notes Regression Analysis is the
Chapter 11 Student Lecture Notes 11-1 Lnear regresson Wenl lu Dept. Health statstcs School of publc health Tanjn medcal unversty 1 Regresson Models 1. Answer What Is the Relatonshp Between the Varables?.
More informationStatistics MINITAB - Lab 2
Statstcs 20080 MINITAB - Lab 2 1. Smple Lnear Regresson In smple lnear regresson we attempt to model a lnear relatonshp between two varables wth a straght lne and make statstcal nferences concernng that
More informationNUMERICAL DIFFERENTIATION
NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the
More informationSTAT 405 BIOSTATISTICS (Fall 2016) Handout 15 Introduction to Logistic Regression
STAT 45 BIOSTATISTICS (Fall 26) Handout 5 Introducton to Logstc Regresson Ths handout covers materal found n Secton 3.7 of your text. You may also want to revew regresson technques n Chapter. In ths handout,
More informationFUZZY FINITE ELEMENT METHOD
FUZZY FINITE ELEMENT METHOD RELIABILITY TRUCTURE ANALYI UING PROBABILITY 3.. Maxmum Normal tress Internal force s the shear force, V has a magntude equal to the load P and bendng moment, M. Bendng moments
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationThe Two-scale Finite Element Errors Analysis for One Class of Thermoelastic Problem in Periodic Composites
7 Asa-Pacfc Engneerng Technology Conference (APETC 7) ISBN: 978--6595-443- The Two-scale Fnte Element Errors Analyss for One Class of Thermoelastc Problem n Perodc Compostes Xaoun Deng Mngxang Deng ABSTRACT
More informationsince [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation
Econ 388 R. Butler 204 revsons Lecture 4 Dummy Dependent Varables I. Lnear Probablty Model: the Regresson model wth a dummy varables as the dependent varable assumpton, mplcaton regular multple regresson
More informationPredictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore
Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.
More informationLogistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI
Logstc Regresson CAP 561: achne Learnng Instructor: Guo-Jun QI Bayes Classfer: A Generatve model odel the posteror dstrbuton P(Y X) Estmate class-condtonal dstrbuton P(X Y) for each Y Estmate pror dstrbuton
More informationEffective plots to assess bias and precision in method comparison studies
Effectve plots to assess bas and precson n method comparson studes Bern, November, 016 Patrck Taffé, PhD Insttute of Socal and Preventve Medcne () Unversty of Lausanne, Swtzerland Patrck.Taffe@chuv.ch
More informationMLE and Bayesian Estimation. Jie Tang Department of Computer Science & Technology Tsinghua University 2012
MLE and Bayesan Estmaton Je Tang Department of Computer Scence & Technology Tsnghua Unversty 01 1 Lnear Regresson? As the frst step, we need to decde how we re gong to represent the functon f. One example:
More informationError Probability for M Signals
Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationEcon Statistical Properties of the OLS estimator. Sanjaya DeSilva
Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate
More informationLecture 3: Probability Distributions
Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the
More informationStatistical analysis using matlab. HY 439 Presented by: George Fortetsanakis
Statstcal analyss usng matlab HY 439 Presented by: George Fortetsanaks Roadmap Probablty dstrbutons Statstcal estmaton Fttng data to probablty dstrbutons Contnuous dstrbutons Contnuous random varable X
More informationDERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION
Internatonal Worshop ADVANCES IN STATISTICAL HYDROLOGY May 3-5, Taormna, Italy DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION by Sooyoung
More informationβ0 + β1xi. You are interested in estimating the unknown parameters β
Ordnary Least Squares (OLS): Smple Lnear Regresson (SLR) Analytcs The SLR Setup Sample Statstcs Ordnary Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals) wth OLS
More informationBasic R Programming: Exercises
Basc R Programmng: Exercses RProgrammng John Fox ICPSR, Summer 2009 1. Logstc Regresson: Iterated weghted least squares (IWLS) s a standard method of fttng generalzed lnear models to data. As descrbed
More informationFirst Year Examination Department of Statistics, University of Florida
Frst Year Examnaton Department of Statstcs, Unversty of Florda May 7, 010, 8:00 am - 1:00 noon Instructons: 1. You have four hours to answer questons n ths examnaton.. You must show your work to receve
More informationSTAT 3340 Assignment 1 solutions. 1. Find the equation of the line which passes through the points (1,1) and (4,5).
(out of 15 ponts) STAT 3340 Assgnment 1 solutons (10) (10) 1. Fnd the equaton of the lne whch passes through the ponts (1,1) and (4,5). β 1 = (5 1)/(4 1) = 4/3 equaton for the lne s y y 0 = β 1 (x x 0
More informationJanuary Examinations 2015
24/5 Canddates Only January Examnatons 25 DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR STUDENT CANDIDATE NO.. Department Module Code Module Ttle Exam Duraton (n words)
More informationU-Pb Geochronology Practical: Background
U-Pb Geochronology Practcal: Background Basc Concepts: accuracy: measure of the dfference between an expermental measurement and the true value precson: measure of the reproducblty of the expermental result
More informationOn the Influential Points in the Functional Circular Relationship Models
On the Influental Ponts n the Functonal Crcular Relatonshp Models Department of Mathematcs, Faculty of Scence Al-Azhar Unversty-Gaza, Gaza, Palestne alzad33@yahoo.com Abstract If the nterest s to calbrate
More information8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore
8/5/17 Data Modelng Patrce Koehl Department of Bologcal Scences atonal Unversty of Sngapore http://www.cs.ucdavs.edu/~koehl/teachng/bl59 koehl@cs.ucdavs.edu Data Modelng Ø Data Modelng: least squares Ø
More informationStatistical inference for generalized Pareto distribution based on progressive Type-II censored data with random removals
Internatonal Journal of Scentfc World, 2 1) 2014) 1-9 c Scence Publshng Corporaton www.scencepubco.com/ndex.php/ijsw do: 10.14419/jsw.v21.1780 Research Paper Statstcal nference for generalzed Pareto dstrbuton
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationInterval Estimation in the Classical Normal Linear Regression Model. 1. Introduction
ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model
More informationComputing MLE Bias Empirically
Computng MLE Bas Emprcally Kar Wa Lm Australan atonal Unversty January 3, 27 Abstract Ths note studes the bas arses from the MLE estmate of the rate parameter and the mean parameter of an exponental dstrbuton.
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VIII LECTURE - 34 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS EFFECTS MODEL Dr Shalabh Department of Mathematcs and Statstcs Indan
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationOnline Appendix to The Allocation of Talent and U.S. Economic Growth
Onlne Appendx to The Allocaton of Talent and U.S. Economc Growth Not for publcaton) Chang-Ta Hseh, Erk Hurst, Charles I. Jones, Peter J. Klenow February 22, 23 A Dervatons and Proofs The propostons n the
More informationLecture 16 Statistical Analysis in Biomaterials Research (Part II)
3.051J/0.340J 1 Lecture 16 Statstcal Analyss n Bomaterals Research (Part II) C. F Dstrbuton Allows comparson of varablty of behavor between populatons usng test of hypothess: σ x = σ x amed for Brtsh statstcan
More informationScatter Plot x
Construct a scatter plot usng excel for the gven data. Determne whether there s a postve lnear correlaton, negatve lnear correlaton, or no lnear correlaton. Complete the table and fnd the correlaton coeffcent
More informationMaximum Likelihood Estimation
Maxmum Lkelhood Estmaton INFO-2301: Quanttatve Reasonng 2 Mchael Paul and Jordan Boyd-Graber MARCH 7, 2017 INFO-2301: Quanttatve Reasonng 2 Paul and Boyd-Graber Maxmum Lkelhood Estmaton 1 of 9 Why MLE?
More informationChapter 14: Logit and Probit Models for Categorical Response Variables
Chapter 4: Logt and Probt Models for Categorcal Response Varables Sect 4. Models for Dchotomous Data We wll dscuss only ths secton of Chap 4, whch s manly about Logstc Regresson, a specal case of the famly
More informationSDMML HT MSc Problem Sheet 4
SDMML HT 06 - MSc Problem Sheet 4. The recever operatng characterstc ROC curve plots the senstvty aganst the specfcty of a bnary classfer as the threshold for dscrmnaton s vared. Let the data space be
More informationMIMA Group. Chapter 2 Bayesian Decision Theory. School of Computer Science and Technology, Shandong University. Xin-Shun SDU
Group M D L M Chapter Bayesan Decson heory Xn-Shun Xu @ SDU School of Computer Scence and echnology, Shandong Unversty Bayesan Decson heory Bayesan decson theory s a statstcal approach to data mnng/pattern
More informationModeling and Simulation NETW 707
Modelng and Smulaton NETW 707 Lecture 5 Tests for Random Numbers Course Instructor: Dr.-Ing. Magge Mashaly magge.ezzat@guc.edu.eg C3.220 1 Propertes of Random Numbers Random Number Generators (RNGs) must
More informationStatistics Chapter 4
Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment
More informationECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE)
ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE) June 7, 016 15:30 Frst famly name: Name: DNI/ID: Moble: Second famly Name: GECO/GADE: Instructor: E-mal: Queston 1 A B C Blank Queston A B C Blank Queston
More informationMaximum Likelihood Estimation (MLE)
Maxmum Lkelhood Estmaton (MLE) Ken Kreutz-Delgado (Nuno Vasconcelos) ECE 175A Wnter 01 UCSD Statstcal Learnng Goal: Gven a relatonshp between a feature vector x and a vector y, and d data samples (x,y
More informationNumber of cases Number of factors Number of covariates Number of levels of factor i. Value of the dependent variable for case k
ANOVA Model and Matrx Computatons Notaton The followng notaton s used throughout ths chapter unless otherwse stated: N F CN Y Z j w W Number of cases Number of factors Number of covarates Number of levels
More informationOutline. Multivariate Parametric Methods. Multivariate Data. Basic Multivariate Statistics. Steven J Zeil
Outlne Multvarate Parametrc Methods Steven J Zel Old Domnon Unv. Fall 2010 1 Multvarate Data 2 Multvarate ormal Dstrbuton 3 Multvarate Classfcaton Dscrmnants Tunng Complexty Dscrete Features 4 Multvarate
More informationCS-433: Simulation and Modeling Modeling and Probability Review
CS-433: Smulaton and Modelng Modelng and Probablty Revew Exercse 1. (Probablty of Smple Events) Exercse 1.1 The owner of a camera shop receves a shpment of fve cameras from a camera manufacturer. Unknown
More informationQuantum and Classical Information Theory with Disentropy
Quantum and Classcal Informaton Theory wth Dsentropy R V Ramos rubensramos@ufcbr Lab of Quantum Informaton Technology, Department of Telenformatc Engneerng Federal Unversty of Ceara - DETI/UFC, CP 6007
More informationANSWERS CHAPTER 9. TIO 9.2: If the values are the same, the difference is 0, therefore the null hypothesis cannot be rejected.
ANSWERS CHAPTER 9 THINK IT OVER thnk t over TIO 9.: χ 2 k = ( f e ) = 0 e Breakng the equaton down: the test statstc for the ch-squared dstrbuton s equal to the sum over all categores of the expected frequency
More information