Web-based Supplementary Materials for A Modified Partial Likelihood Score Method for Cox Regression with Covariate Error Under the Internal
|
|
- Alvin Greene
- 5 years ago
- Views:
Transcription
1 Web-based Supplemetary Materials for A Modified Partial Likelihood Score Method for Cox Regressio with Covariate Error Uder the Iteral Validatio Desig by David M. Zucker, Xi Zhou, Xiaomei Liao, Yi Li, ad Doa Spiegelma
2 Itroductio, Notatio, ad Prelimiaries I this documet we preset the details of the asymptotic theory for the modified score estimator. At the ed of the documet we preset tables with the simulatio results for the commo disease case that we referred to i the mai paper. Deote the true value of θ by θ. We assume that θ lies i a suitably large compact set Q whose iterior cotais θ. Two additioal assumptios will be itroduced later, with clear sigpostig. Let τ deote the maximum follow-up time. All assertios below of uiform covergece of fuctios of θ ad/or t refer to θ Q ad t [, τ]. We use the otatio used i the mai paper. From ow o, i the various S s defied i the mai paper we will write θ istead of β, α. We ow defie some additioal otatio. S e t, θ = S 2a t, θ = S 2b t, θ = S 2c t, θ = S 2d t, θ = ω j Y j t X j α expβ T X j t ω j Y j tx j X T j expβ T X j t ω j Y j t Xα Xα T expβ T Xαt ω j Y j t Xα Xα T expβ T Xαt ω j Y j t XαX T expβ T Xt E W t, θ = E[Y t expβ T Xα] E W W t, θ = E[Y t Xα expβ T Xα] XX t, θ = E[Y txx T expβ T X] E W W W t, θ = E[Y t Xα Xα T expβ T Xα] E W XX t, θ = E[Y t XαX T expβ T X] I additio, we defie Nt = i= N it ad N t = E[Nt]. We ow itroduce the followig assumptio: Assumptio : t, θ is bouded below over t ad θ.
3 This assumptio implies that there is a positive probability of reachig the maximum follow-up time τ with either a evet or a cesorig i the ope iterval, τ. I view of the fuctioal strog law of large umbers Aderse ad Gill, 982, Appedix III, the followig covergece relatios hold uiformly i t ad θ almost surely: S a t, θ π t, θ, S b t, θ πe W t, θ, S c t, θ πe W t, θ S d t, θ t, θ, S a t, θ πx t, θ, S b t, θ πe W W t, θ 2 S c t, θ πe W W t, θ, S d t, θ πe W X t, θ, S e t, θ πe W X t, θ 3 S 2a t, θ πxx t, θ, S 2b t, θ πe W W W t, θ 4 S 2c t, θ πe W W W t, θ, S 2d t, θ πe W XX t, θ 5 It follows that the followig covergece relatios hold uiformly i t ad θ almost surely ote that φπ = π: S t, β t, θ, S t, θ s t, θ 6 Also, it is clear that α α almost surely. Recall the coutig process represetatio of the score fuctio U MS θ: U MS θ = i= [ω i X i + ω i X i α]dn i t S t, θ dnt 7 S t, θ We ca write U MS θ = i= [ω i X i + ω i X i α]dn i t s t, θ t, θ dnt + R θ with R θ = S t, θ S t, θ s t, θ dnt t, θ Give the uiform covergece of S t, θ ad S t, θ, the assumptio that t, θ is bouded below, ad the fact that Nτ, we obtai the result that R θ uiformly i θ. Recall ow the defiitio dm i t = dn i t Y i t expβ T X i tλ tdt. Accordig to coutig 2
4 process theory Gill 984, M i t is a mea-zero martigale process w.r.t. the history defied by F t = σx i ; Y i s, N i s, s [, t], i =,...,. Give the oiformative measuremet error assumptio ad the fact that ω i is idepedet of all the other basic radom variables associated with idividual i, M i t is also a martigale w.r.t. the history defied by G t = σx i, W i, ω i, Y i s, N i s, s [, t], i =,...,. Cosistecy We ca write i= ω i X i dn i t = ω i X i dm i t + i= S a β, αλ t dt ad i= ω i X i α dn i t = ω i X i α dm i t + i= S e β, αλ t dt Similarly, s t, θ t, θ dnt = i= s t, θ τ t, θ dm it + s t, θ t, θ S dt, θ λ tdt Hece, U MS θ = S a β, αλ t dt + +R θ + Mθ S e β, αλ t dt s t, θ t, θ S dt, θ λ tdt where Mθ = i= ω i X i + ω i W i s t, θ dm i t t, θ Now, Mθ is the sample mea of i.i.d. mea-zero r.v. s, ad therefore coverges a.s. to, ad sice Q is compact ad t, θ ad s t, θ are cotiuous i θ uiformly over t the covergece is uiform i θ. Usig this result, alog with the covergece results -5 ad 3
5 the fact that α α a.s., we fid that U MS β, α coverges uiformly almost surely to uβ = s t, θ s t, β, α t, β, α t, θ λ t dt. We have that times the matrix of derivatives of U MS θ with respect to β is give by D ββ θ = Ṡt, θ S t, θ S t, θ S t, θ T Ṡ t, θ dnt 8 S t, θ where Sa t, θ Ṡ t, θ = S a t, θ + S b t, θ S c t, θ Sb t, θ Ṡ t, θ = S 2a t, θ + S 2b t, θ + S c t, θ + S d t, θ S c t, θ [ Sa t, θ + S b t, θ S c t, θ S 2d t, θ S 2c t, θ [ Sb t, θ S c t, θ Sb t, θ S c t, θ Sa t, θ S c t, θ ] T Sc t, θ S c t, θ ] Sc t, θ S c t, θ The limitig value of D ββ θ is give by [ τ XX t, θ d ββ θ = π t, θ + π EXX t, θ t, θ [ E W XX t, θ t, θ ] T EXX t, θ t, θ λ tdt t, θ EW X t, θ t, θ ] T EXX t, θ t, θ λ tdt t, θ which is times the matrix of derivatives of uθ with respect to β. The first term i the above expressio is a positive defiite matrix for all θ. At this poit, we itroduce a additioal assumptio: Assumptio 2: d ββ θ is osigular. By ispectio of uθ, we see that uβ, α =. Give this fact, the assumed osigularity of d ββ θ, the covergece of α to α, ad the uiform covergece of U MS θ to uθ ad D ββ θ to d ββ θ, it follows from the argumets of Foutz 977 that there exists a uique root of the score equatio U MS β, α = that coverges to β. 4
6 Asymptotic Distributio of βms The backgroud for the derivatio of the asymptotic distributio of β MS is preseted i Sectio 2.2 of the mai paper. We start here with the derivatio of U θ. As i Zucker ad Spiegelma 28, we use the argumet of Li ad Wei 989. I what follows, the symbol. = will deote equality up to egligible terms. Let us recall the coutig process represetatio of U θ: U θ = i= ω i X i + ω i X i αdn i t S t, θ S t, θ dnt We ow proceed to aalyze this quatity. For brevity, we will omit the argumets t ad θ. We ca write U θ = U a θ U θ with U a θ = U b θ = b i= S S ŝ ω i X i + ω i X i α ŝ dn =. S ŝ S dn i dn where ŝ t, β, α = πx t, β, α + πe W X t, β, α. Regardig U a θ, after some maipulatio we obtai U a θ = ω i i= + X i X ω i i= dn i π X i E W X dn i + π E W X X dn i dn E W X X dn i dn We ow tur to U b θ. We eed to work o the term S t, θ/s t, θ. We ca write S ŝ = S S ŝ S S E X. = E X = E X S ŝ S E X S ŝ ŝ S 5
7 Now, Sa S = S a + S b S c. = S a π + S b πe W + E φs a π φ S c πe W W E W = π ω j Y j e βt X j + ω j Y j e βt Xj E W E W φ ω j Y j e βt Xj E W By a similar argumet, S ŝ. = E W ω j Y j X j e βt X j X + + φ + E W E W X E W W ω j Y j Xj e βt Xj E W W ω j Y j Xj e βt X j E W X φ ω j Y j Xj e βt Xj E W W ω j Y j e βt Xj E W φ ω j Y j e βt Xj E W As a result, we ca write U θ. = U θ with where Z i = U θ = π m X i X φ φ E X τ i= ω i Z i dn i π Y i Xi e βt X i E W X E X dn + φ + π m i= E W X X dn i dn ω i Z 2 i Y i Xi e βt Xi E W W E X dn E W E W X E W W Y i e βt Xi E W E X dn + φŝ E W Y i e βt Xi E W E X dn ŝ π Y i X i e βt X i X E X dn Y i e βt X i E X dn 6
8 ad Z 2 i = X i E W X dn i + π E W X X dn i dn + E W E W X E W W Y i e βt Xi E W E X dn + Y i Xi e βt Xi E W W E X dn ŝ E W Y i e βt Xi E W E X dn I computig Ĉ as described i the mai paper, we substitute θ for θ, dnu for dn u, S for, S for ŝ, S b + S c for E W, π S a for X, π S d for E W X, ad S b + S c for E W W. We ow tur to the derivatio of the relevat compoets of Jacobia matrix Dθ. derivative of U θ with respect to β is give by 8. Let etry equals X ir / α t. The matrix ad whose remaiig rows are filled with s. We the have The X i deote the matrix whose r, t X i is a p p+p matrix whose first p rows are I p w T i U θ D βα = α = i= δ i ω i X i + i= δ i H2 S S H S S where ad H = S α = H 2 = S α = Sa i= S c i= ω i Y i β T X i e βt Xi ω i Y i X i e βt Xi + + S c S d S c + Sb S c Sb S 2 c i= S d S c i= i= Sa S b S 2 c i= ω i Y i Xi β T X i e βt Xi ω i Y i β T X i e βt Xi ω i Y i X i e βt X i i= i= ω i Y i X i e βt Xi ω i Y i β T X i e βt Xi ω i Y i β T X i e βt Xi i= ω i Y i Xi β T X i e βt Xi Fially, U2 θ D αα = α = ω i I p w i w T i i= 7
9 Table S: Simulatio results for the sigle-covariate commo disease case with idepedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA
10 Table S2: Simulatio results for the sigle-covariate commo disease case with depedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA
11 Table S3: Simulatio results for the multiple-covariate commo disease case with idepedet covariates ad idepedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA
12 Table S4: Simulatio results for the multiple-covariate commo disease case with idepedet covariates ad depedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA
13 Table S5: Simulatio results for the multiple-covariate commo disease case with depedet covariates ad idepedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA
14 Table S6: Simulatio results for the multiple-covariate commo disease case with depedet covariates ad depedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA MS CH RC CC NA
15 Table S7: Simulatio results for the multiple-covariate itermediate disease rate case with idepedet covariates ad idepedet measuremet error. β is the true value of β. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Mea Media CorrX, W expβ β Method ˆβ Bias% ˆβ Bias% IQR SE SD CR MS CH MS CH MS CH Table S8: Simulatio results for various sample sizes for the multiple-covariate commo disease case with idepedet measuremet error. β is the true value of β. NN is the sample size of the mai study ad NV is the sample size of the iteral validatio sample. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Sample Size ˆβ Bias% ˆβ Bias% IQR SE SD CR NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV= NN=5, NV= NN=25, NV= NN=5, NV=
16 Table S9: Simulatio results for various sample sizes for the multiple-covariate commo disease case with idepedet measuremet error. β is the true value of β. NN is the sample size of the mai study ad NV is the sample size of the iteral validatio sample. Bias% is the relative bias, i.e. Bias%= ˆβ β /β. IQR is.74 times the iterquartile rage of the ˆβ values. SE is the mea of the estimated stadard error of ˆβ. SD is the empirical stadard deviatio of the ˆβ values. CR is the empirical coverage rate of the asymptotic 95% cofidece iterval. Methods cosidered: MS = modified score, CH = Che, RC = regressio calibratio, CC = complete case, NA = aive. Mea Media CorrX, W expβ β Sample Size ˆβ Bias% ˆβ Bias% IQR SE SD CR NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV= NN=, NV= NN=, NV= NN=5, NV= NN=, NV=
Convergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More information17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15
17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig
More informationSTAT331. Example of Martingale CLT with Cox s Model
STAT33 Example of Martigale CLT with Cox s Model I this uit we illustrate the Martigale Cetral Limit Theorem by applyig it to the partial likelihood score fuctio from Cox s model. For simplicity of presetatio
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationDirection: This test is worth 250 points. You are required to complete this test within 50 minutes.
Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationEstimation of the Mean and the ACVF
Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationSTA Object Data Analysis - A List of Projects. January 18, 2018
STA 6557 Jauary 8, 208 Object Data Aalysis - A List of Projects. Schoeberg Mea glaucomatous shape chages of the Optic Nerve Head regio i aimal models 2. Aalysis of VW- Kedall ati-mea shapes with a applicatio
More informationRandom Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices
Radom Matrices with Blocks of Itermediate Scale Strogly Correlated Bad Matrices Jiayi Tog Advisor: Dr. Todd Kemp May 30, 07 Departmet of Mathematics Uiversity of Califoria, Sa Diego Cotets Itroductio Notatio
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationStatistical Inference Based on Extremum Estimators
T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationSolution to Chapter 2 Analytical Exercises
Nov. 25, 23, Revised Dec. 27, 23 Hayashi Ecoometrics Solutio to Chapter 2 Aalytical Exercises. For ay ε >, So, plim z =. O the other had, which meas that lim E(z =. 2. As show i the hit, Prob( z > ε =
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationLecture 2: Concentration Bounds
CSE 52: Desig ad Aalysis of Algorithms I Sprig 206 Lecture 2: Cocetratio Bouds Lecturer: Shaya Oveis Ghara March 30th Scribe: Syuzaa Sargsya Disclaimer: These otes have ot bee subjected to the usual scrutiy
More informationProbability 2 - Notes 10. Lemma. If X is a random variable and g(x) 0 for all x in the support of f X, then P(g(X) 1) E[g(X)].
Probability 2 - Notes 0 Some Useful Iequalities. Lemma. If X is a radom variable ad g(x 0 for all x i the support of f X, the P(g(X E[g(X]. Proof. (cotiuous case P(g(X Corollaries x:g(x f X (xdx x:g(x
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER / Statistics
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER 1 018/019 DR. ANTHONY BROWN 8. Statistics 8.1. Measures of Cetre: Mea, Media ad Mode. If we have a series of umbers the
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More informationLecture 15: Learning Theory: Concentration Inequalities
STAT 425: Itroductio to Noparametric Statistics Witer 208 Lecture 5: Learig Theory: Cocetratio Iequalities Istructor: Ye-Chi Che 5. Itroductio Recall that i the lecture o classificatio, we have see that
More informationGeneralized Semi- Markov Processes (GSMP)
Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual
More informationSince X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain
Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the
More informationREAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS
REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS 18th Feb, 016 Defiitio (Lipschitz fuctio). A fuctio f : R R is said to be Lipschitz if there exists a positive real umber c such that for ay x, y i the domai
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More informationECE 901 Lecture 14: Maximum Likelihood Estimation and Complexity Regularization
ECE 90 Lecture 4: Maximum Likelihood Estimatio ad Complexity Regularizatio R Nowak 5/7/009 Review : Maximum Likelihood Estimatio We have iid observatios draw from a ukow distributio Y i iid p θ, i,, where
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More informationEstimation of the essential supremum of a regression function
Estimatio of the essetial supremum of a regressio fuctio Michael ohler, Adam rzyżak 2, ad Harro Walk 3 Fachbereich Mathematik, Techische Uiversität Darmstadt, Schlossgartestr. 7, 64289 Darmstadt, Germay,
More informationRegression with an Evaporating Logarithmic Trend
Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,
More informationStochastic Simulation
Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationDetailed proofs of Propositions 3.1 and 3.2
Detailed proofs of Propositios 3. ad 3. Proof of Propositio 3. NB: itegratio sets are geerally omitted for itegrals defied over a uit hypercube [0, s with ay s d. We first give four lemmas. The proof of
More informationSection 14. Simple linear regression.
Sectio 14 Simple liear regressio. Let us look at the cigarette dataset from [1] (available to dowload from joural s website) ad []. The cigarette dataset cotais measuremets of tar, icotie, weight ad carbo
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationGlivenko-Cantelli Classes
CS28B/Stat24B (Sprig 2008 Statistical Learig Theory Lecture: 4 Gliveko-Catelli Classes Lecturer: Peter Bartlett Scribe: Michelle Besi Itroductio This lecture will cover Gliveko-Catelli (GC classes ad itroduce
More informationAppendix to: Hypothesis Testing for Multiple Mean and Correlation Curves with Functional Data
Appedix to: Hypothesis Testig for Multiple Mea ad Correlatio Curves with Fuctioal Data Ao Yua 1, Hog-Bi Fag 1, Haiou Li 1, Coli O. Wu, Mig T. Ta 1, 1 Departmet of Biostatistics, Bioiformatics ad Biomathematics,
More informationMATH/STAT 352: Lecture 15
MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationMATH 413 FINAL EXAM. f(x) f(y) M x y. x + 1 n
MATH 43 FINAL EXAM Math 43 fial exam, 3 May 28. The exam starts at 9: am ad you have 5 miutes. No textbooks or calculators may be used durig the exam. This exam is prited o both sides of the paper. Good
More informationEntropy Rates and Asymptotic Equipartition
Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,
More informationLecture 3 The Lebesgue Integral
Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified
More information1 Convergence in Probability and the Weak Law of Large Numbers
36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec
More informationLecture Chapter 6: Convergence of Random Sequences
ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite
More informationMAS111 Convergence and Continuity
MAS Covergece ad Cotiuity Key Objectives At the ed of the course, studets should kow the followig topics ad be able to apply the basic priciples ad theorems therei to solvig various problems cocerig covergece
More informationLECTURE 14 NOTES. A sequence of α-level tests {ϕ n (x)} is consistent if
LECTURE 14 NOTES 1. Asymptotic power of tests. Defiitio 1.1. A sequece of -level tests {ϕ x)} is cosistet if β θ) := E θ [ ϕ x) ] 1 as, for ay θ Θ 1. Just like cosistecy of a sequece of estimators, Defiitio
More informationApplication to Random Graphs
A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationCHAPTER 5. Theory and Solution Using Matrix Techniques
A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL
More informationb i u x i U a i j u x i u x j
M ath 5 2 7 Fall 2 0 0 9 L ecture 1 9 N ov. 1 6, 2 0 0 9 ) S ecod- Order Elliptic Equatios: Weak S olutios 1. Defiitios. I this ad the followig two lectures we will study the boudary value problem Here
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More information2.2. Central limit theorem.
36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard
More informationThe picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled
1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how
More informationMa 530 Introduction to Power Series
Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationLecture 3 : Random variables and their distributions
Lecture 3 : Radom variables ad their distributios 3.1 Radom variables Let (Ω, F) ad (S, S) be two measurable spaces. A map X : Ω S is measurable or a radom variable (deoted r.v.) if X 1 (A) {ω : X(ω) A}
More informationSlide Set 13 Linear Model with Endogenous Regressors and the GMM estimator
Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday
More informationIntroduction to Probability. Ariel Yadin
Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationMathematical Statistics - MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties
More informationSummary and Discussion on Simultaneous Analysis of Lasso and Dantzig Selector
Summary ad Discussio o Simultaeous Aalysis of Lasso ad Datzig Selector STAT732, Sprig 28 Duzhe Wag May 4, 28 Abstract This is a discussio o the work i Bickel, Ritov ad Tsybakov (29). We begi with a short
More informationIntegrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number
MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios
More informationDirection: This test is worth 150 points. You are required to complete this test within 55 minutes.
Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem
More informationSolutions to HW Assignment 1
Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.
More informationRandomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)
Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black
More informationAsymptotic Results for the Linear Regression Model
Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is
More informationSTA6938-Logistic Regression Model
Dr. Yig Zhag STA6938-Logistic Regressio Model Topic -Simple (Uivariate) Logistic Regressio Model Outlies:. Itroductio. A Example-Does the liear regressio model always work? 3. Maximum Likelihood Curve
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationSieve Estimators: Consistency and Rates of Convergence
EECS 598: Statistical Learig Theory, Witer 2014 Topic 6 Sieve Estimators: Cosistecy ad Rates of Covergece Lecturer: Clayto Scott Scribe: Julia Katz-Samuels, Brado Oselio, Pi-Yu Che Disclaimer: These otes
More informationCOMPUTING SUMS AND THE AVERAGE VALUE OF THE DIVISOR FUNCTION (x 1) + x = n = n.
COMPUTING SUMS AND THE AVERAGE VALUE OF THE DIVISOR FUNCTION Abstract. We itroduce a method for computig sums of the form f( where f( is ice. We apply this method to study the average value of d(, where
More informationEFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS
EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS Ryszard Zieliński Ist Math Polish Acad Sc POBox 21, 00-956 Warszawa 10, Polad e-mail: rziel@impagovpl ABSTRACT Weak laws of large umbers (W LLN), strog
More informationBull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung
Bull. Korea Math. Soc. 36 (999), No. 3, pp. 45{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Abstract. This paper provides suciet coditios which esure the strog cosistecy of regressio
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More information1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1
8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationLecture 5: Parametric Hypothesis Testing: Comparing Means. GENOME 560, Spring 2016 Doug Fowler, GS
Lecture 5: Parametric Hypothesis Testig: Comparig Meas GENOME 560, Sprig 2016 Doug Fowler, GS (dfowler@uw.edu) 1 Review from last week What is a cofidece iterval? 2 Review from last week What is a cofidece
More information