Nonparametric model calibration estimation in survey sampling
|
|
- Jared Baker
- 5 years ago
- Views:
Transcription
1 Ames February 18, 004 Nonparametrc model calbraton estmaton n survey samplng M. Govanna Ranall Department of Statstcs, Colorado State Unversty (Jont work wth G.E. Montanar, Dpartmento d Scenze Statstche, Unverstà d eruga, Italy) 1/7 M L
2 Outlne /7 M L
3 Outlne Introducton to the framework and notaton /7 M L
4 Outlne Introducton to the framework and notaton Auxlary nformaton: Calbraton /7 M L
5 Outlne Introducton to the framework and notaton Auxlary nformaton: Calbraton Allowng for more flexble models: Model Calbraton /7 M L
6 Outlne Introducton to the framework and notaton Auxlary nformaton: Calbraton Allowng for more flexble models: Model Calbraton Nonparametrc methods for Model Calbraton: Neural Networks and Local olynomals /7 M L
7 Outlne Introducton to the framework and notaton Auxlary nformaton: Calbraton Allowng for more flexble models: Model Calbraton Nonparametrc methods for Model Calbraton: Neural Networks and Local olynomals A small smulaton study /7 M L
8 Outlne Introducton to the framework and notaton Auxlary nformaton: Calbraton Allowng for more flexble models: Model Calbraton Nonparametrc methods for Model Calbraton: Neural Networks and Local olynomals A small smulaton study Conclusons and perspectves /7 M L
9 The roblem am and tools We want to know more about a Fnte opulaton... U = {u 1, u,..., u N } fnte populaton of N dstnct unts labelled by the ntegers = 1,..., N. y value taken by the survey varable y n unt. Ȳ = N 1 U y populaton mean of y, parameter of nterest. /7 M L
10 The roblem am and tools We want to know more about a Fnte opulaton... U = {u 1, u,..., u N } fnte populaton of N dstnct unts labelled by the ntegers = 1,..., N. y value taken by the survey varable y n unt. Ȳ = N 1 U y populaton mean of y, parameter of nterest.... by means of a robablstc sample and Auxlary Informaton. s sample of sze n selected from U accordng to a samplng desgn p(s), whch nduces frst and second order ncluson probabltes π and π j. y, for s values of y observed on sample unts. x = (x 1, x,..., x Q ) known for U. value taken by Q auxlary varables x on unt and /7 M L
11 Calbraton Estmators Devlle & Särndal (199) 4/7 M L
12 Calbraton Estmators Devlle & Särndal (199) CAL = N 1 s w y 4/7 M L
13 Calbraton Estmators Devlle & Särndal (199) CAL = N 1 s w y The weghts w are found to be as close as possble to d = π 1, whle meetng benchmark constrants: 4/7 M L
14 Calbraton Estmators Devlle & Särndal (199) CAL = N 1 s w y The weghts w are found to be as close as possble to d = π 1, whle meetng benchmark constrants: mn w Φ (w, d ) s.t. N 1 s w x = N 1 U x s 4/7 M L
15 Calbraton Estmators Devlle & Särndal (199) CAL = N 1 s w y The weghts w are found to be as close as possble to d = π 1, whle meetng benchmark constrants: mn w Φ (w, d ) s.t. N 1 s w x = N 1 U x s Dfferent dstance measures can be employed n the mnmzaton procedure as long as they meet some basc requrements. 4/7 M L
16 How to get a soluton 5/7 M L
17 How to get a soluton The mnmzaton problem s solved by φ (w, d ) x l = 0, where φ (w, d) = Φ(w, d)/ w and l s a vector of Lagrangan multplers. 5/7 M L
18 How to get a soluton The mnmzaton problem s solved by φ (w, d ) x l = 0, where φ (w, d) = Φ(w, d)/ w and l s a vector of Lagrangan multplers. If a soluton exsts, basc requrements guarantee t s unque and can be wrtten as w = d F (x l), where d F ( ) s the recprocal mappng of φ(, d ). 5/7 M L
19 How to get a soluton The mnmzaton problem s solved by φ (w, d ) x l = 0, where φ (w, d) = Φ(w, d)/ w and l s a vector of Lagrangan multplers. If a soluton exsts, basc requrements guarantee t s unque and can be wrtten as w = d F (x l), where d F ( ) s the recprocal mappng of φ(, d ). The vector l can be determned through the calbraton constrants: x = 1 N w x = s s d F (x l)x g s (l) = s d (F (x l) 1)x = x ˆ x. 5/7 M L
20 How to get a soluton The mnmzaton problem s solved by φ (w, d ) x l = 0, where φ (w, d) = Φ(w, d)/ w and l s a vector of Lagrangan multplers. If a soluton exsts, basc requrements guarantee t s unque and can be wrtten as w = d F (x l), where d F ( ) s the recprocal mappng of φ(, d ). The vector l can be determned through the calbraton constrants: x = 1 N w x = s s d F (x l)x g s (l) = s Therefore, gven a sample s and chosen a dstance functon Φ (, d) d (F (x l) 1)x = x ˆ x. 5/7 M L
21 How to get a soluton The mnmzaton problem s solved by φ (w, d ) x l = 0, where φ (w, d) = Φ(w, d)/ w and l s a vector of Lagrangan multplers. If a soluton exsts, basc requrements guarantee t s unque and can be wrtten as w = d F (x l), where d F ( ) s the recprocal mappng of φ(, d ). The vector l can be determned through the calbraton constrants: x = 1 N w x = s s d F (x l)x g s (l) = s Therefore, gven a sample s and chosen a dstance functon Φ (, d) 1. determne the unquely correspondng functon F ( );. solve g s (l) = x ˆ x for l; d (F (x l) 1)x = x ˆ x.. obtan the calbraton estmator as CAL = N 1 s w y = N 1 s d F (x l)y. 5/7 M L
22 An example - not chosen by chance... 6/7 M L
23 An example - not chosen by chance Assume you choose a quadratc dstance functon Φ (w, d ) = (w d ) d q, where the q s are known constants unrelated to d. 6/7 M L
24 An example - not chosen by chance Assume you choose a quadratc dstance functon Φ (w, d ) = (w d ) d q, where the q s are known constants unrelated to d. The partal dervatve s gven by φ (w, d ) = (w /d 1)/q and ts recprocal mappng by d F (u) = d (1 + q u); 6/7 M L
25 An example - not chosen by chance Assume you choose a quadratc dstance functon Φ (w, d ) = (w d ) d q, where the q s are known constants unrelated to d. The partal dervatve s gven by φ (w, d ) = (w /d 1)/q and ts recprocal mappng by d F (u) = d (1 + q u); therefore w = d (1 + q x l). 6/7 M L
26 An example - not chosen by chance Assume you choose a quadratc dstance functon Φ (w, d ) = (w d ) d q, where the q s are known constants unrelated to d. The partal dervatve s gven by φ (w, d ) = (w /d 1)/q and ts recprocal mappng by d F (u) = d (1 + q u); therefore w = d (1 + q x l).. The Lagrangan multplers are determned by means of s d q x x l = ( x ˆ x) as l = ( s d q x x ) 1 ( x ˆ x). 6/7 M L
27 An example - not chosen by chance... (follows). And the calbraton estmator follows to be 7/7 M L
28 An example - not chosen by chance... (follows). And the calbraton estmator follows to be CAL = N 1 s w y = 7/7 M L
29 An example - not chosen by chance... (follows). And the calbraton estmator follows to be CAL = N 1 s w y = = N 1 s d (1 + q x ( s d q x x ) 1 ( x ˆ x) )y = 7/7 M L
30 An example - not chosen by chance... (follows). And the calbraton estmator follows to be CAL = N 1 s w y = = N 1 s d (1 + q x ( s d q x x ) 1 ( x ˆ x) )y = = ˆȲ + ( x ˆ x)( s d q x x ) 1 s d q x y = 7/7 M L
31 An example - not chosen by chance... (follows). And the calbraton estmator follows to be CAL = N 1 s w y = = N 1 s d (1 + q x ( s d q x x ) 1 ( x ˆ x) )y = = ˆȲ + ( x ˆ x)( s d q x x ) 1 s d q x y = = ˆȲ + ( x ˆ x) ˆβ c 7/7 M L
32 An example - not chosen by chance... (follows). And the calbraton estmator follows to be CAL = N 1 s w y = = N 1 s d (1 + q x ( s d q x x ) 1 ( x ˆ x) )y = = ˆȲ + ( x ˆ x)( s d q x x ) 1 s d q x y = = ˆȲ + ( x ˆ x) ˆβ c Whch s equvalent to the Generalzed REGresson estmator, GREG, f we choose the q s to represent the varance structure of the workng model. 7/7 M L
33 Calbraton Estmators - propertes 8/7 M L
34 Calbraton Estmators - propertes In an asymptotc framework as n Isak and Fuller (198) and under regularty condtons (Devlle & Särndal, 199, p.79), CAL s shown to be desgn n-consstent for Ȳ, n the sense that CAL Ȳ = O p(n 1/ ). 8/7 M L
35 Calbraton Estmators - propertes In an asymptotc framework as n Isak and Fuller (198) and under regularty condtons (Devlle & Särndal, 199, p.79), CAL s shown to be desgn n-consstent for Ȳ, n the sense that CAL Ȳ = O p(n 1/ ). Moreover, all the calbraton estmators are asymptotcally equvalent to the one that employs a quadratc dstance measure. In fact, CAL GREG= O p (n 1 ). 8/7 M L
36 Calbraton Estmators - propertes In an asymptotc framework as n Isak and Fuller (198) and under regularty condtons (Devlle & Särndal, 199, p.79), CAL s shown to be desgn n-consstent for Ȳ, n the sense that CAL Ȳ = O p(n 1/ ). Moreover, all the calbraton estmators are asymptotcally equvalent to the one that employs a quadratc dstance measure. In fact, CAL GREG= O p (n 1 ). Therefore CAL and GREG share the same lmtng dstrbuton and then AV (CAL) = U j U (π j π π j ) E π E j π j, wth E = y x β c and β c = ( U q ) x 1 x U q x y. 8/7 M L
37 Model Calbraton - the dea (Wu & Stter, 001) 9/7 M L
38 Model Calbraton - the dea (Wu & Stter, 001) 1. Assume a (lnear), nonlnear, generalzed lnear model well descrbes the relatonshp between x and y; 9/7 M L
39 Model Calbraton - the dea (Wu & Stter, 001) 1. Assume a (lnear), nonlnear, generalzed lnear model well descrbes the relatonshp between x and y;. obtan obtan ftted values of y for all unts n the populaton accordng to the model and accountng for the samplng plan; 9/7 M L
40 Model Calbraton - the dea (Wu & Stter, 001) 1. Assume a (lnear), nonlnear, generalzed lnear model well descrbes the relatonshp between x and y;. obtan obtan ftted values of y for all unts n the populaton accordng to the model and accountng for the samplng plan;. buld a calbraton estmator by calbratng on populaton mean of such ftted values (and not wth respect to x). 9/7 M L
41 Model Calbraton - n symbols 10/7 M L
42 Model Calbraton - n symbols 1. Workng model { Eξ (y ) = µ(x, θ), U, µ( ) s known V ξ (y ) = σ v(x ), U, v( ) s known µ(x, θ) nonlnear model g(µ ) = x θ (lnear or) generalzed lnear model 10/7 M L
43 Model Calbraton - n symbols 1. Workng model { Eξ (y ) = µ(x, θ), U, µ( ) s known V ξ (y ) = σ v(x ), U, v( ) s known µ(x, θ) nonlnear model g(µ ) = x θ (lnear or) generalzed lnear model. Obtan ftted values ˆµ = µ(x, ˆθ), ˆθ = f {y, x, π } by e.g. estmatng equatons modfed to account for the desgn. 10/7 M L
44 Model Calbraton - the new calbraton step 11/7 M L
45 Model Calbraton - the new calbraton step. Buld the model calbraton estmator MC = N 1 s w y 11/7 M L
46 Model Calbraton - the new calbraton step. Buld the model calbraton estmator MC = N 1 s w y wth weghts w found agan to be as close as possble to d benchmark constrants: = π 1, but wth new 11/7 M L
47 Model Calbraton - the new calbraton step. Buld the model calbraton estmator MC = N 1 s w y wth weghts w found agan to be as close as possble to d benchmark constrants: = π 1, but wth new mn w s (w d ) d q s.t. s w = N N 1 s w ˆµ = N 1 U ˆµ 11/7 M L
48 Model Calbraton - the new calbraton step. Buld the model calbraton estmator MC = N 1 s w y wth weghts w found agan to be as close as possble to d benchmark constrants: = π 1, but wth new mn w s (w d ) d q s.t. s w = N N 1 s w ˆµ = N 1 U ˆµ The estmator s obtaned as n the prevous example as ( MC = ˆȲ + 1 ˆµ ) d ˆµ N s U ˆβ mc where ˆβ mc, s the GREG coeffcent of a regresson estmator of y on ˆµ. 11/7 M L
49 Nonparametrc model calbraton - the dea 1/7 M L
50 Nonparametrc model calbraton - the dea Allow more flexble modellng than parametrc model calbraton by assumng more general models and employ nonparametrc technques to obtan ftted values to calbrate on. 1/7 M L
51 Nonparametrc model calbraton - the dea Allow more flexble modellng than parametrc model calbraton by assumng more general models and employ nonparametrc technques to obtan ftted values to calbrate on. Any nonparametrc technque can n prncple be employed. We wll focus on Neural Networks because ths method 1. allows dervng theoretcal propertes of the resultng estmator,. s a popular nonparametrc technque for whch software s easly avalable,. allows straghtforward nserton of multvarate auxlary nformaton; 1/7 M L
52 Nonparametrc model calbraton - the dea Allow more flexble modellng than parametrc model calbraton by assumng more general models and employ nonparametrc technques to obtan ftted values to calbrate on. Any nonparametrc technque can n prncple be employed. We wll focus on Neural Networks because ths method 1. allows dervng theoretcal propertes of the resultng estmator,. s a popular nonparametrc technque for whch software s easly avalable,. allows straghtforward nserton of multvarate auxlary nformaton; and on Local olynomals, snce ths has been the frst nonparametrc method consdered for model-asssted survey samplng (Bredt & Opsomer, 000). 1/7 M L
53 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons 1/7 M L
54 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons It s just a lnear combnaton of sgmodal functons of lnear combnatons of the auxlary varables LUS a lnear model 1/7 M L
55 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons It s just a lnear combnaton of sgmodal functons of lnear combnatons of the auxlary varables LUS a lnear model f(x ) = Q q=1 γ qmx q + γ 0m 1/7 M L
56 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons It s just a lnear combnaton of sgmodal functons of lnear combnatons of the auxlary varables LUS a lnear model f(x ) = ( ) φ Q q=1 γ qmx q + γ 0m 1/7 M L
57 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons It s just a lnear combnaton of sgmodal functons of lnear combnatons of the auxlary varables LUS a lnear model f(x ) = ( ) M Q m=1 am φ q=1 γ qmx q + γ 0m +a 0 1/7 M L
58 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons It s just a lnear combnaton of sgmodal functons of lnear combnatons of the auxlary varables LUS a lnear model f(x ) = ( ) Q M Q q=1 β qx q + m=1 am φ q=1 γ qmx q + γ 0m +a 0 1/7 M L
59 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons It s just a lnear combnaton of sgmodal functons of lnear combnatons of the auxlary varables LUS a lnear model f(x ) = ( ) Q M Q q=1 β qx q + m=1 am φ q=1 γ qmx q + γ 0m +a 0 We wll denote by θ = {β 1,..., β Q, a 0, a 1,..., a M, γ 01,..., γ 0M, γ 1,..., γ M } the set of all parameters of the net. 1/7 M L
60 A dagram that usually represents a NNet x 1 x x Q 5 γ 11 5 γ γ 1M φ a 1 a 0 φ a. β 5. M 5 y a M γ Q1 γ φ QM β Q... lauxlary varables Neurons Response varable β 1 14/7 M L
61 Nonparametrc model calbraton - the steps 15/7 M L
62 Nonparametrc model calbraton - the steps 1. Workng model - Neural Network model E ξ (y ) = f(x ), V ξ (y ) = v(x ), U U 15/7 M L
63 Nonparametrc model calbraton - the steps 1. Workng model - Neural Network model E ξ (y ) = f(x ), V ξ (y ) = v(x ), U U. Obtan ftted values. Frst get the populaton parameter as the mnmzer of { N } 1 r θ = argmn (y f(x, θ)) + λ θl, θ Θ v where λ s a weght decay parameter, =1 l=1 15/7 M L
64 Nonparametrc model calbraton - the steps 1. Workng model - Neural Network model E ξ (y ) = f(x ), V ξ (y ) = v(x ), U U. Obtan ftted values. Frst get the populaton parameter as the mnmzer of { N } 1 r θ = argmn (y f(x, θ)) + λ θl, θ Θ v where λ s a weght decay parameter, by means of estmatng equatons N =1 =1 { (y f(x, θ)) f(x, θ) θ l=1 1 λ } v N θ = 0. 15/7 M L
65 Nonparametrc model calbraton - the steps 1. Workng model - Neural Network model E ξ (y ) = f(x ), V ξ (y ) = v(x ), U U. Obtan ftted values. Frst get the populaton parameter as the mnmzer of { N } 1 r θ = argmn (y f(x, θ)) + λ θl, θ Θ v where λ s a weght decay parameter, by means of estmatng equatons N =1 =1 { (y f(x, θ)) f(x, θ) θ l=1 1 λ } v N θ = 0. Then get ˆθ as the soluton of the desgn based sample verson of t n { 1 (y f(x, θ)) f(x, θ) 1 λ } θ v N θ = 0. =1 π 15/7 M L
66 Nonparametrc model calbraton - the steps 1. Workng model - Neural Network model E ξ (y ) = f(x ), V ξ (y ) = v(x ), U U. Obtan ftted values. Frst get the populaton parameter as the mnmzer of { N } 1 r θ = argmn (y f(x, θ)) + λ θl, θ Θ v where λ s a weght decay parameter, by means of estmatng equatons N { (y f(x, θ)) f(x, θ) 1 λ } θ v N θ = 0. =1 =1 l=1 Then get ˆθ as the soluton of the desgn based sample verson of t n { 1 (y f(x, θ)) f(x, θ) 1 λ } θ v N θ =1 π = 0. Then we can obtan ftted values ˆf = f(x, ˆθ) such that ˆf = f(x, θ) + O p (n 1/ ). 15/7 M L
67 Nonparametrc model calbraton - the calbraton step 16/7 M L
68 Nonparametrc model calbraton - the calbraton step. Buld the calbraton estmator as for parametrc model calbraton, just the ftted values n the calbraton constrant are dfferent NNMC = N 1 s w y 16/7 M L
69 Nonparametrc model calbraton - the calbraton step. Buld the calbraton estmator as for parametrc model calbraton, just the ftted values n the calbraton constrant are dfferent NNMC = N 1 s w y mn w s (w d ) d q s.t. s w = N N 1 s w ˆf = N 1 U ˆf 16/7 M L
70 Nonparametrc model calbraton - the calbraton step. Buld the calbraton estmator as for parametrc model calbraton, just the ftted values n the calbraton constrant are dfferent NNMC = N 1 s w y mn w s (w d ) d q s.t. s w = N N 1 s w ˆf = N 1 U ˆf Then, NNMC = ˆȲ + 1 N ( U ˆf s 16/7 M L d ˆf ) where ˆβ nn, s the GREG coeffcent of a regresson estmator of y on ˆf. (Cfr wth a modfed GAM regresson estmator n Opsomer et al., 001) ˆβ nn
71 Local polynomals model calbraton - the steps 17/7 M L
72 Local polynomals model calbraton - the steps 1. Workng model - A very general unvarate model { Eξ (y ) = m(x ), U V ξ (y ) = v(x ), U 17/7 M L
73 Local polynomals model calbraton - the steps 1. Workng model - A very general unvarate model { Eξ (y ) = m(x ), U V ξ (y ) = v(x ), U. Get ftted values by means of local polynomals ˆm = e 1(X sw s X s ) 1 X sw s y s, where e 1 = (1, 0,..., 0) s a column vector of length p + 1, p s the order of the local polynomal ft, y s = (y 1,..., y n ), W s = dag {d j K h (x j x )} j s, K s a kernel functon, h s the bandwdth and X s = [1 x j x (x j x ) p ] j s. 17/7 M L
74 Local polynomals model calbraton - the steps 18/7 M L
75 Local polynomals model calbraton - the steps. Buld the model calbraton estmator as prevously LMC = N 1 s w y 18/7 M L
76 Local polynomals model calbraton - the steps. Buld the model calbraton estmator as prevously LMC = N 1 s w y mn w s (w d ) d q s.t. s w = N N 1 s w ˆm = N 1 U ˆm 18/7 M L
77 Local polynomals model calbraton - the steps. Buld the model calbraton estmator as prevously LMC = N 1 s w y Then, mn w s (w d ) d q s.t. LMC = ˆȲ + 1 N ( s w = N N 1 s w ˆm = N 1 U ˆm U ˆm s d ˆm ) where ˆβ lp, s the GREG coeffcent of a regresson estmator of y on ˆm. ˆβ lp 18/7 M L
78 Whch s the dfference between LMC and LRE The Local polynomal regresson estmator (Bredt & Opsomer, 000) s gven by ( LRE = ˆȲ + 1 ˆm ) d ˆm. N s U 19/7 M L
79 Whch s the dfference between LMC and LRE The Local polynomal regresson estmator (Bredt & Opsomer, 000) s gven by ( LRE = ˆȲ + 1 ˆm ) d ˆm. N s U The only dfference lays n the supplementary regresson step provded by ˆβ lp. LMC can be also thought of a GREG estmator wth a workng model of the type E ξ (y ) = a + b m(x ). 19/7 M L
80 Whch s the dfference between LMC and LRE The Local polynomal regresson estmator (Bredt & Opsomer, 000) s gven by ( LRE = ˆȲ + 1 ˆm ) d ˆm. N s U The only dfference lays n the supplementary regresson step provded by ˆβ lp. LMC can be also thought of a GREG estmator wth a workng model of the type E ξ (y ) = a + b m(x ). If the nonparametrc technque provdes based estmates of the mean functon or the workng model s not vald, then ths step wll lead to more effcent estmates by correctng ths bas. 19/7 M L
81 Smulaton Study - MAHA regon The Md-Atlantc Hghlands study regon ncludes the area from the Blue Rdge Mountans n the east to the Oho Rver n the west and from the Catskll Mountans n the north to Vrgna n the south. 0/7 M L
82 Smulaton Study - data Md-Atlantc Hghlands Area (MAHA) EA Regon : A, VA, WV, DE, MD. Data collected by EAs EMA. Streams sampled from 199 through Total Ntrogen (NTL) and Total hosphorus (TL) sampled at 574 stes. roporton of watershed devoted to Agrculture (AG) avalable from remote sensng. 1/7 M L
83 Scatterplots of the two survey varables wrt AG NTL 700 TL AG AG /7 M L
84 Smulaton Study - setup N = 574, auxlary varable: AG, survey varables: NTL and TL. A thousand smple random samples wthout replacement of dmenson n = 100 have been drawn from U. /7 M L
85 Smulaton Study - setup N = 574, auxlary varable: AG, survey varables: NTL and TL. A thousand smple random samples wthout replacement of dmenson n = 100 have been drawn from U. For each sample we computed the followng estmators HT the sample mean; CAL the regresson estmator; NNMC wth four combnatons of complexty parameters M and λ LMC, LRE wth a local constant and a local lnear ft wth bandwdths h = 0.10 and h = 0.5 /7 M L
86 Smulaton Study - setup N = 574, auxlary varable: AG, survey varables: NTL and TL. A thousand smple random samples wthout replacement of dmenson n = 100 have been drawn from U. For each sample we computed the followng estmators HT the sample mean; CAL the regresson estmator; NNMC wth four combnatons of complexty parameters M and λ LMC, LRE wth a local constant and a local lnear ft wth bandwdths h = 0.10 and h = 0.5 erformance evaluated by means of Smse( ) = Mse( )/ Mse(CAL) /7 M L
87 Smulaton Study - results NTL TL HT CAL NNMC M = λ=5e M =4 λ=5e M =6 λ=1e M =8 λ=1e LMC p=0 h= p=0 h= p=1 h= p=1 h= LRE p=0 h= p=0 h= p=1 h= p=1 h=
88 Conclusons The use of Nonparametrc methods to obtan ftted values for non-sampled unts provdes more effcent estmates by allowng for more complex modellng than wth parametrc calbraton. Neural Networks have shown effcent and robust behavors n both unvarate and (multvarate - not shown here) settngs. Such behavor seems to be less nfluenced by the choce of complexty parameters w.r.t. other nonparametrc methods. Wth respect to nonparametrc regresson estmaton, the supplementary calbraton step performed by model calbraton provdes more effcent estmators when the ftted values underft the data (low degree polynomal and/or large bandwdth) 5/7 M L
89 Ongong research and perspectves erformance of NNMC s beng explored wth multple auxlary nformaton and compared to other nonparametrc technques (GAM, MARS, DART) Model calbraton weghts depend on the survey varable, therefore a sngle set of weghts s not avalable for more than one. Also studyng the effects of multple smultaneous calbraton (dea n Opsomer et al., 001). Varance estmaton s an ssue when nonparametrc methods are employed: usually largely underestmated. 6/7 M L
90 Essental bblography Bredt F.J. and Opsomer J.D. (000), Local polynomal regresson estmators n survey samplng, The Annals of Statstcs, 8, Devlle J.C. and Särndal C.E. (199), JASA, 87, Calbraton estmators n survey samplng, Opsomer J.D., Mosen G.G. and Km J.Y. (001), Model-asssted estmaton of forest resources wth generalzed addtve models, ASA roceedngs of the Secton on Survey Research Methods. Wu C. and Stter R.R. (001), A model-calbraton to usng complete auxlary nformaton from survey data, JASA, 96, The work reported here was n part developed under the STAR Research Assstance Agreement CR awarded by the U.S. Envronmental rotecton Agency (EA) to Colorado State Unversty. Ths presentaton has not been formally revewed by EA. The vews expressed here are solely those of the presenter and STARMA. EA does not endorse any products or commercal servces mentoned n ths presentaton. 7/7 M L
Estimation: Part 2. Chapter GREG estimation
Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the
More informationParametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010
Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationA note on regression estimation with unknown population size
Statstcs Publcatons Statstcs 6-016 A note on regresson estmaton wth unknown populaton sze Mchael A. Hdroglou Statstcs Canada Jae Kwang Km Iowa State Unversty jkm@astate.edu Chrstan Olver Nambeu Statstcs
More informationBias-correction under a semi-parametric model for small area estimation
Bas-correcton under a sem-parametrc model for small area estmaton Laura Dumtrescu, Vctora Unversty of Wellngton jont work wth J. N. K. Rao, Carleton Unversty ICORS 2017 Workshop on Robust Inference for
More informationNonparametric Regression Estimation. of Finite Population Totals. under Two-Stage Sampling
Nonparametrc Regresson Estmaton of Fnte Populaton Totals under Two-Stage Samplng J-Yeon Km Iowa State Unversty F. Jay Bredt Colorado State Unversty Jean D. Opsomer Iowa State Unversty ay 21, 2003 Abstract
More informationEfficient nonresponse weighting adjustment using estimated response probability
Effcent nonresponse weghtng adjustment usng estmated response probablty Jae Kwang Km Department of Appled Statstcs, Yonse Unversty, Seoul, 120-749, KOREA Key Words: Regresson estmator, Propensty score,
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationMultivariate Ratio Estimator of the Population Total under Stratified Random Sampling
Open Journal of Statstcs, 0,, 300-304 ttp://dx.do.org/0.436/ojs.0.3036 Publsed Onlne July 0 (ttp://www.scrp.org/journal/ojs) Multvarate Rato Estmator of te Populaton Total under Stratfed Random Samplng
More informationPsychology 282 Lecture #24 Outline Regression Diagnostics: Outliers
Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More information1 Convex Optimization
Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased
More informationOn Outlier Robust Small Area Mean Estimate Based on Prediction of Empirical Distribution Function
On Outler Robust Small Area Mean Estmate Based on Predcton of Emprcal Dstrbuton Functon Payam Mokhtaran Natonal Insttute of Appled Statstcs Research Australa Unversty of Wollongong Small Area Estmaton
More informationn α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0
MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector
More informationCSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography
CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve
More informationPrimer on High-Order Moment Estimators
Prmer on Hgh-Order Moment Estmators Ton M. Whted July 2007 The Errors-n-Varables Model We wll start wth the classcal EIV for one msmeasured regressor. The general case s n Erckson and Whted Econometrc
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE
P a g e ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE Darmud O Drscoll ¹, Donald E. Ramrez ² ¹ Head of Department of Mathematcs and Computer Studes
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More informationReport on Image warping
Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationA Robust Method for Calculating the Correlation Coefficient
A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal
More informationChapter 9: Statistical Inference and the Relationship between Two Variables
Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationPHYS 705: Classical Mechanics. Calculus of Variations II
1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary
More informationGlobal Sensitivity. Tuesday 20 th February, 2018
Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values
More informationExponential Type Product Estimator for Finite Population Mean with Information on Auxiliary Attribute
Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 193-9466 Vol. 10, Issue 1 (June 015), pp. 106-113 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) Exponental Tpe Product Estmator
More informationBasically, if you have a dummy dependent variable you will be estimating a probability.
ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy
More informationPopulation element: 1 2 N. 1.1 Sampling with Replacement: Hansen-Hurwitz Estimator(HH)
Chapter 1 Samplng wth Unequal Probabltes Notaton: Populaton element: 1 2 N varable of nterest Y : y1 y2 y N Let s be a sample of elements drawn by a gven samplng method. In other words, s s a subset of
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationSolutions Homework 4 March 5, 2018
1 Solutons Homework 4 March 5, 018 Soluton to Exercse 5.1.8: Let a IR be a translaton and c > 0 be a re-scalng. ˆb1 (cx + a) cx n + a (cx 1 + a) c x n x 1 cˆb 1 (x), whch shows ˆb 1 s locaton nvarant and
More informationInterval Estimation in the Classical Normal Linear Regression Model. 1. Introduction
ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model
More informationβ0 + β1xi and want to estimate the unknown
SLR Models Estmaton Those OLS Estmates Estmators (e ante) v. estmates (e post) The Smple Lnear Regresson (SLR) Condtons -4 An Asde: The Populaton Regresson Functon B and B are Lnear Estmators (condtonal
More informationSampling Theory MODULE VII LECTURE - 23 VARYING PROBABILITY SAMPLING
Samplng heory MODULE VII LECURE - 3 VARYIG PROBABILIY SAMPLIG DR. SHALABH DEPARME OF MAHEMAICS AD SAISICS IDIA ISIUE OF ECHOLOGY KAPUR he smple random samplng scheme provdes a random sample where every
More informationParametric fractional imputation for missing data analysis
Secton on Survey Research Methods JSM 2008 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Wayne Fuller Abstract Under a parametrc model for mssng data, the EM algorthm s a popular tool
More informationRELIABILITY ASSESSMENT
CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department
More informationEcon Statistical Properties of the OLS estimator. Sanjaya DeSilva
Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More informationInterpreting Slope Coefficients in Multiple Linear Regression Models: An Example
CONOMICS 5* -- Introducton to NOT CON 5* -- Introducton to NOT : Multple Lnear Regresson Models Interpretng Slope Coeffcents n Multple Lnear Regresson Models: An xample Consder the followng smple lnear
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationA Comparative Study for Estimation Parameters in Panel Data Model
A Comparatve Study for Estmaton Parameters n Panel Data Model Ahmed H. Youssef and Mohamed R. Abonazel hs paper examnes the panel data models when the regresson coeffcents are fxed random and mxed and
More informationTHE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens
THE CHINESE REMAINDER THEOREM KEITH CONRAD We should thank the Chnese for ther wonderful remander theorem. Glenn Stevens 1. Introducton The Chnese remander theorem says we can unquely solve any par of
More informationA general class of estimators for the population mean using multi-phase sampling with the non-respondents
Hacettepe Journal of Mathematcs Statstcs Volume 43 3 014 511 57 A general class of estmators for the populaton mean usng mult-phase samplng wth the non-respondents Saba Raz Gancarlo Dana Javd Shabbr Abstract
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationDifference Equations
Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1
More informationβ0 + β1xi. You are interested in estimating the unknown parameters β
Ordnary Least Squares (OLS): Smple Lnear Regresson (SLR) Analytcs The SLR Setup Sample Statstcs Ordnary Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals) wth OLS
More informationIntroduction to Regression
Introducton to Regresson Dr Tom Ilvento Department of Food and Resource Economcs Overvew The last part of the course wll focus on Regresson Analyss Ths s one of the more powerful statstcal technques Provdes
More informationSee Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)
Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes
More informationprinceton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg
prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationNumerical Heat and Mass Transfer
Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and
More informationTesting for seasonal unit roots in heterogeneous panels
Testng for seasonal unt roots n heterogeneous panels Jesus Otero * Facultad de Economía Unversdad del Rosaro, Colomba Jeremy Smth Department of Economcs Unversty of arwck Monca Gulett Aston Busness School
More informationLeast Squares Fitting of Data
Least Squares Fttng of Data Davd Eberly Geoetrc Tools, LLC http://www.geoetrctools.co/ Copyrght c 1998-2015. All Rghts Reserved. Created: July 15, 1999 Last Modfed: January 5, 2015 Contents 1 Lnear Fttng
More informationThe Expectation-Maximization Algorithm
The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.
More informationLeast Squares Fitting of Data
Least Squares Fttng of Data Davd Eberly Geoetrc Tools, LLC http://www.geoetrctools.co/ Copyrght c 1998-2014. All Rghts Reserved. Created: July 15, 1999 Last Modfed: February 9, 2008 Contents 1 Lnear Fttng
More informationUSE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE
STATISTICA, anno LXXV, n. 4, 015 USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE Manoj K. Chaudhary 1 Department of Statstcs, Banaras Hndu Unversty, Varanas,
More informationISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013
ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run
More informationWeighted Estimating Equations with Response Propensities in Terms of Covariates Observed only for Responders
Weghted Estmatng Equatons wth Response Propenstes n Terms of Covarates Observed only for Responders Erc V. Slud, U.S. Census Bureau, CSRM Unv. of Maryland, Mathematcs Dept. NISS Mssng Data Workshop, November
More informationADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING
1 ADVANCED ACHINE LEARNING ADVANCED ACHINE LEARNING Non-lnear regresson technques 2 ADVANCED ACHINE LEARNING Regresson: Prncple N ap N-dm. nput x to a contnuous output y. Learn a functon of the type: N
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationDurban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications
Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department
More informationThe Ordinary Least Squares (OLS) Estimator
The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More informationT E C O L O T E R E S E A R C H, I N C.
T E C O L O T E R E S E A R C H, I N C. B rdg n g En g neern g a nd Econo mcs S nce 1973 THE MINIMUM-UNBIASED-PERCENTAGE ERROR (MUPE) METHOD IN CER DEVELOPMENT Thrd Jont Annual ISPA/SCEA Internatonal Conference
More informationComputation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models
Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationPhysics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1
P. Guterrez Physcs 5153 Classcal Mechancs D Alembert s Prncple and The Lagrangan 1 Introducton The prncple of vrtual work provdes a method of solvng problems of statc equlbrum wthout havng to consder the
More informationFactor models with many assets: strong factors, weak factors, and the two-pass procedure
Factor models wth many assets: strong factors, weak factors, and the two-pass procedure Stanslav Anatolyev 1 Anna Mkusheva 2 1 CERGE-EI and NES 2 MIT December 2017 Stanslav Anatolyev and Anna Mkusheva
More informationMATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)
1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationBallot Paths Avoiding Depth Zero Patterns
Ballot Paths Avodng Depth Zero Patterns Henrch Nederhausen and Shaun Sullvan Florda Atlantc Unversty, Boca Raton, Florda nederha@fauedu, ssull21@fauedu 1 Introducton In a paper by Sapounaks, Tasoulas,
More informationIssues To Consider when Estimating Health Care Costs with Generalized Linear Models (GLMs): To Gamma/Log Or Not To Gamma/Log? That Is The New Question
Issues To Consder when Estmatng Health Care Costs wth Generalzed Lnear Models (GLMs): To Gamma/Log Or Not To Gamma/Log? That Is The New Queston ISPOR 20th Annual Internatonal Meetng May 19, 2015 Jalpa
More informationChapter 15 Student Lecture Notes 15-1
Chapter 15 Student Lecture Notes 15-1 Basc Busness Statstcs (9 th Edton) Chapter 15 Multple Regresson Model Buldng 004 Prentce-Hall, Inc. Chap 15-1 Chapter Topcs The Quadratc Regresson Model Usng Transformatons
More informationA Bound for the Relative Bias of the Design Effect
A Bound for the Relatve Bas of the Desgn Effect Alberto Padlla Banco de Méxco Abstract Desgn effects are typcally used to compute sample szes or standard errors from complex surveys. In ths paper, we show
More informationSmall Area Estimation for Business Surveys
ASA Secton on Survey Research Methods Small Area Estmaton for Busness Surveys Hukum Chandra Southampton Statstcal Scences Research Insttute, Unversty of Southampton Hghfeld, Southampton-SO17 1BJ, U.K.
More informationCredit Card Pricing and Impact of Adverse Selection
Credt Card Prcng and Impact of Adverse Selecton Bo Huang and Lyn C. Thomas Unversty of Southampton Contents Background Aucton model of credt card solctaton - Errors n probablty of beng Good - Errors n
More informationLOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin
Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence
More informationβ0 + β1xi. You are interested in estimating the unknown parameters β
Revsed: v3 Ordnar Least Squares (OLS): Smple Lnear Regresson (SLR) Analtcs The SLR Setup Sample Statstcs Ordnar Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals)
More informationSupplementary Notes for Chapter 9 Mixture Thermodynamics
Supplementary Notes for Chapter 9 Mxture Thermodynamcs Key ponts Nne major topcs of Chapter 9 are revewed below: 1. Notaton and operatonal equatons for mxtures 2. PVTN EOSs for mxtures 3. General effects
More informationCHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE
CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng
More informationECE559VV Project Report
ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate
More informationDiscussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek
Dscusson of Extensons of the Gauss-arkov Theorem to the Case of Stochastc Regresson Coeffcents Ed Stanek Introducton Pfeffermann (984 dscusses extensons to the Gauss-arkov Theorem n settngs where regresson
More informationTemperature. Chapter Heat Engine
Chapter 3 Temperature In prevous chapters of these notes we ntroduced the Prncple of Maxmum ntropy as a technque for estmatng probablty dstrbutons consstent wth constrants. In Chapter 9 we dscussed the
More informationCorrelation and Regression. Correlation 9.1. Correlation. Chapter 9
Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,
More informationGoodness of fit and Wilks theorem
DRAFT 0.0 Glen Cowan 3 June, 2013 Goodness of ft and Wlks theorem Suppose we model data y wth a lkelhood L(µ) that depends on a set of N parameters µ = (µ 1,...,µ N ). Defne the statstc t µ ln L(µ) L(ˆµ),
More informationNumerical Solution of Ordinary Differential Equations
Numercal Methods (CENG 00) CHAPTER-VI Numercal Soluton of Ordnar Dfferental Equatons 6 Introducton Dfferental equatons are equatons composed of an unknown functon and ts dervatves The followng are examples
More informationsince [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation
Econ 388 R. Butler 204 revsons Lecture 4 Dummy Dependent Varables I. Lnear Probablty Model: the Regresson model wth a dummy varables as the dependent varable assumpton, mplcaton regular multple regresson
More informationModule 2. Random Processes. Version 2 ECE IIT, Kharagpur
Module Random Processes Lesson 6 Functons of Random Varables After readng ths lesson, ou wll learn about cdf of functon of a random varable. Formula for determnng the pdf of a random varable. Let, X be
More information