Nonparametric model calibration estimation in survey sampling

Size: px
Start display at page:

Download "Nonparametric model calibration estimation in survey sampling"

Transcription

1 Ames February 18, 004 Nonparametrc model calbraton estmaton n survey samplng M. Govanna Ranall Department of Statstcs, Colorado State Unversty (Jont work wth G.E. Montanar, Dpartmento d Scenze Statstche, Unverstà d eruga, Italy) 1/7 M L

2 Outlne /7 M L

3 Outlne Introducton to the framework and notaton /7 M L

4 Outlne Introducton to the framework and notaton Auxlary nformaton: Calbraton /7 M L

5 Outlne Introducton to the framework and notaton Auxlary nformaton: Calbraton Allowng for more flexble models: Model Calbraton /7 M L

6 Outlne Introducton to the framework and notaton Auxlary nformaton: Calbraton Allowng for more flexble models: Model Calbraton Nonparametrc methods for Model Calbraton: Neural Networks and Local olynomals /7 M L

7 Outlne Introducton to the framework and notaton Auxlary nformaton: Calbraton Allowng for more flexble models: Model Calbraton Nonparametrc methods for Model Calbraton: Neural Networks and Local olynomals A small smulaton study /7 M L

8 Outlne Introducton to the framework and notaton Auxlary nformaton: Calbraton Allowng for more flexble models: Model Calbraton Nonparametrc methods for Model Calbraton: Neural Networks and Local olynomals A small smulaton study Conclusons and perspectves /7 M L

9 The roblem am and tools We want to know more about a Fnte opulaton... U = {u 1, u,..., u N } fnte populaton of N dstnct unts labelled by the ntegers = 1,..., N. y value taken by the survey varable y n unt. Ȳ = N 1 U y populaton mean of y, parameter of nterest. /7 M L

10 The roblem am and tools We want to know more about a Fnte opulaton... U = {u 1, u,..., u N } fnte populaton of N dstnct unts labelled by the ntegers = 1,..., N. y value taken by the survey varable y n unt. Ȳ = N 1 U y populaton mean of y, parameter of nterest.... by means of a robablstc sample and Auxlary Informaton. s sample of sze n selected from U accordng to a samplng desgn p(s), whch nduces frst and second order ncluson probabltes π and π j. y, for s values of y observed on sample unts. x = (x 1, x,..., x Q ) known for U. value taken by Q auxlary varables x on unt and /7 M L

11 Calbraton Estmators Devlle & Särndal (199) 4/7 M L

12 Calbraton Estmators Devlle & Särndal (199) CAL = N 1 s w y 4/7 M L

13 Calbraton Estmators Devlle & Särndal (199) CAL = N 1 s w y The weghts w are found to be as close as possble to d = π 1, whle meetng benchmark constrants: 4/7 M L

14 Calbraton Estmators Devlle & Särndal (199) CAL = N 1 s w y The weghts w are found to be as close as possble to d = π 1, whle meetng benchmark constrants: mn w Φ (w, d ) s.t. N 1 s w x = N 1 U x s 4/7 M L

15 Calbraton Estmators Devlle & Särndal (199) CAL = N 1 s w y The weghts w are found to be as close as possble to d = π 1, whle meetng benchmark constrants: mn w Φ (w, d ) s.t. N 1 s w x = N 1 U x s Dfferent dstance measures can be employed n the mnmzaton procedure as long as they meet some basc requrements. 4/7 M L

16 How to get a soluton 5/7 M L

17 How to get a soluton The mnmzaton problem s solved by φ (w, d ) x l = 0, where φ (w, d) = Φ(w, d)/ w and l s a vector of Lagrangan multplers. 5/7 M L

18 How to get a soluton The mnmzaton problem s solved by φ (w, d ) x l = 0, where φ (w, d) = Φ(w, d)/ w and l s a vector of Lagrangan multplers. If a soluton exsts, basc requrements guarantee t s unque and can be wrtten as w = d F (x l), where d F ( ) s the recprocal mappng of φ(, d ). 5/7 M L

19 How to get a soluton The mnmzaton problem s solved by φ (w, d ) x l = 0, where φ (w, d) = Φ(w, d)/ w and l s a vector of Lagrangan multplers. If a soluton exsts, basc requrements guarantee t s unque and can be wrtten as w = d F (x l), where d F ( ) s the recprocal mappng of φ(, d ). The vector l can be determned through the calbraton constrants: x = 1 N w x = s s d F (x l)x g s (l) = s d (F (x l) 1)x = x ˆ x. 5/7 M L

20 How to get a soluton The mnmzaton problem s solved by φ (w, d ) x l = 0, where φ (w, d) = Φ(w, d)/ w and l s a vector of Lagrangan multplers. If a soluton exsts, basc requrements guarantee t s unque and can be wrtten as w = d F (x l), where d F ( ) s the recprocal mappng of φ(, d ). The vector l can be determned through the calbraton constrants: x = 1 N w x = s s d F (x l)x g s (l) = s Therefore, gven a sample s and chosen a dstance functon Φ (, d) d (F (x l) 1)x = x ˆ x. 5/7 M L

21 How to get a soluton The mnmzaton problem s solved by φ (w, d ) x l = 0, where φ (w, d) = Φ(w, d)/ w and l s a vector of Lagrangan multplers. If a soluton exsts, basc requrements guarantee t s unque and can be wrtten as w = d F (x l), where d F ( ) s the recprocal mappng of φ(, d ). The vector l can be determned through the calbraton constrants: x = 1 N w x = s s d F (x l)x g s (l) = s Therefore, gven a sample s and chosen a dstance functon Φ (, d) 1. determne the unquely correspondng functon F ( );. solve g s (l) = x ˆ x for l; d (F (x l) 1)x = x ˆ x.. obtan the calbraton estmator as CAL = N 1 s w y = N 1 s d F (x l)y. 5/7 M L

22 An example - not chosen by chance... 6/7 M L

23 An example - not chosen by chance Assume you choose a quadratc dstance functon Φ (w, d ) = (w d ) d q, where the q s are known constants unrelated to d. 6/7 M L

24 An example - not chosen by chance Assume you choose a quadratc dstance functon Φ (w, d ) = (w d ) d q, where the q s are known constants unrelated to d. The partal dervatve s gven by φ (w, d ) = (w /d 1)/q and ts recprocal mappng by d F (u) = d (1 + q u); 6/7 M L

25 An example - not chosen by chance Assume you choose a quadratc dstance functon Φ (w, d ) = (w d ) d q, where the q s are known constants unrelated to d. The partal dervatve s gven by φ (w, d ) = (w /d 1)/q and ts recprocal mappng by d F (u) = d (1 + q u); therefore w = d (1 + q x l). 6/7 M L

26 An example - not chosen by chance Assume you choose a quadratc dstance functon Φ (w, d ) = (w d ) d q, where the q s are known constants unrelated to d. The partal dervatve s gven by φ (w, d ) = (w /d 1)/q and ts recprocal mappng by d F (u) = d (1 + q u); therefore w = d (1 + q x l).. The Lagrangan multplers are determned by means of s d q x x l = ( x ˆ x) as l = ( s d q x x ) 1 ( x ˆ x). 6/7 M L

27 An example - not chosen by chance... (follows). And the calbraton estmator follows to be 7/7 M L

28 An example - not chosen by chance... (follows). And the calbraton estmator follows to be CAL = N 1 s w y = 7/7 M L

29 An example - not chosen by chance... (follows). And the calbraton estmator follows to be CAL = N 1 s w y = = N 1 s d (1 + q x ( s d q x x ) 1 ( x ˆ x) )y = 7/7 M L

30 An example - not chosen by chance... (follows). And the calbraton estmator follows to be CAL = N 1 s w y = = N 1 s d (1 + q x ( s d q x x ) 1 ( x ˆ x) )y = = ˆȲ + ( x ˆ x)( s d q x x ) 1 s d q x y = 7/7 M L

31 An example - not chosen by chance... (follows). And the calbraton estmator follows to be CAL = N 1 s w y = = N 1 s d (1 + q x ( s d q x x ) 1 ( x ˆ x) )y = = ˆȲ + ( x ˆ x)( s d q x x ) 1 s d q x y = = ˆȲ + ( x ˆ x) ˆβ c 7/7 M L

32 An example - not chosen by chance... (follows). And the calbraton estmator follows to be CAL = N 1 s w y = = N 1 s d (1 + q x ( s d q x x ) 1 ( x ˆ x) )y = = ˆȲ + ( x ˆ x)( s d q x x ) 1 s d q x y = = ˆȲ + ( x ˆ x) ˆβ c Whch s equvalent to the Generalzed REGresson estmator, GREG, f we choose the q s to represent the varance structure of the workng model. 7/7 M L

33 Calbraton Estmators - propertes 8/7 M L

34 Calbraton Estmators - propertes In an asymptotc framework as n Isak and Fuller (198) and under regularty condtons (Devlle & Särndal, 199, p.79), CAL s shown to be desgn n-consstent for Ȳ, n the sense that CAL Ȳ = O p(n 1/ ). 8/7 M L

35 Calbraton Estmators - propertes In an asymptotc framework as n Isak and Fuller (198) and under regularty condtons (Devlle & Särndal, 199, p.79), CAL s shown to be desgn n-consstent for Ȳ, n the sense that CAL Ȳ = O p(n 1/ ). Moreover, all the calbraton estmators are asymptotcally equvalent to the one that employs a quadratc dstance measure. In fact, CAL GREG= O p (n 1 ). 8/7 M L

36 Calbraton Estmators - propertes In an asymptotc framework as n Isak and Fuller (198) and under regularty condtons (Devlle & Särndal, 199, p.79), CAL s shown to be desgn n-consstent for Ȳ, n the sense that CAL Ȳ = O p(n 1/ ). Moreover, all the calbraton estmators are asymptotcally equvalent to the one that employs a quadratc dstance measure. In fact, CAL GREG= O p (n 1 ). Therefore CAL and GREG share the same lmtng dstrbuton and then AV (CAL) = U j U (π j π π j ) E π E j π j, wth E = y x β c and β c = ( U q ) x 1 x U q x y. 8/7 M L

37 Model Calbraton - the dea (Wu & Stter, 001) 9/7 M L

38 Model Calbraton - the dea (Wu & Stter, 001) 1. Assume a (lnear), nonlnear, generalzed lnear model well descrbes the relatonshp between x and y; 9/7 M L

39 Model Calbraton - the dea (Wu & Stter, 001) 1. Assume a (lnear), nonlnear, generalzed lnear model well descrbes the relatonshp between x and y;. obtan obtan ftted values of y for all unts n the populaton accordng to the model and accountng for the samplng plan; 9/7 M L

40 Model Calbraton - the dea (Wu & Stter, 001) 1. Assume a (lnear), nonlnear, generalzed lnear model well descrbes the relatonshp between x and y;. obtan obtan ftted values of y for all unts n the populaton accordng to the model and accountng for the samplng plan;. buld a calbraton estmator by calbratng on populaton mean of such ftted values (and not wth respect to x). 9/7 M L

41 Model Calbraton - n symbols 10/7 M L

42 Model Calbraton - n symbols 1. Workng model { Eξ (y ) = µ(x, θ), U, µ( ) s known V ξ (y ) = σ v(x ), U, v( ) s known µ(x, θ) nonlnear model g(µ ) = x θ (lnear or) generalzed lnear model 10/7 M L

43 Model Calbraton - n symbols 1. Workng model { Eξ (y ) = µ(x, θ), U, µ( ) s known V ξ (y ) = σ v(x ), U, v( ) s known µ(x, θ) nonlnear model g(µ ) = x θ (lnear or) generalzed lnear model. Obtan ftted values ˆµ = µ(x, ˆθ), ˆθ = f {y, x, π } by e.g. estmatng equatons modfed to account for the desgn. 10/7 M L

44 Model Calbraton - the new calbraton step 11/7 M L

45 Model Calbraton - the new calbraton step. Buld the model calbraton estmator MC = N 1 s w y 11/7 M L

46 Model Calbraton - the new calbraton step. Buld the model calbraton estmator MC = N 1 s w y wth weghts w found agan to be as close as possble to d benchmark constrants: = π 1, but wth new 11/7 M L

47 Model Calbraton - the new calbraton step. Buld the model calbraton estmator MC = N 1 s w y wth weghts w found agan to be as close as possble to d benchmark constrants: = π 1, but wth new mn w s (w d ) d q s.t. s w = N N 1 s w ˆµ = N 1 U ˆµ 11/7 M L

48 Model Calbraton - the new calbraton step. Buld the model calbraton estmator MC = N 1 s w y wth weghts w found agan to be as close as possble to d benchmark constrants: = π 1, but wth new mn w s (w d ) d q s.t. s w = N N 1 s w ˆµ = N 1 U ˆµ The estmator s obtaned as n the prevous example as ( MC = ˆȲ + 1 ˆµ ) d ˆµ N s U ˆβ mc where ˆβ mc, s the GREG coeffcent of a regresson estmator of y on ˆµ. 11/7 M L

49 Nonparametrc model calbraton - the dea 1/7 M L

50 Nonparametrc model calbraton - the dea Allow more flexble modellng than parametrc model calbraton by assumng more general models and employ nonparametrc technques to obtan ftted values to calbrate on. 1/7 M L

51 Nonparametrc model calbraton - the dea Allow more flexble modellng than parametrc model calbraton by assumng more general models and employ nonparametrc technques to obtan ftted values to calbrate on. Any nonparametrc technque can n prncple be employed. We wll focus on Neural Networks because ths method 1. allows dervng theoretcal propertes of the resultng estmator,. s a popular nonparametrc technque for whch software s easly avalable,. allows straghtforward nserton of multvarate auxlary nformaton; 1/7 M L

52 Nonparametrc model calbraton - the dea Allow more flexble modellng than parametrc model calbraton by assumng more general models and employ nonparametrc technques to obtan ftted values to calbrate on. Any nonparametrc technque can n prncple be employed. We wll focus on Neural Networks because ths method 1. allows dervng theoretcal propertes of the resultng estmator,. s a popular nonparametrc technque for whch software s easly avalable,. allows straghtforward nserton of multvarate auxlary nformaton; and on Local olynomals, snce ths has been the frst nonparametrc method consdered for model-asssted survey samplng (Bredt & Opsomer, 000). 1/7 M L

53 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons 1/7 M L

54 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons It s just a lnear combnaton of sgmodal functons of lnear combnatons of the auxlary varables LUS a lnear model 1/7 M L

55 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons It s just a lnear combnaton of sgmodal functons of lnear combnatons of the auxlary varables LUS a lnear model f(x ) = Q q=1 γ qmx q + γ 0m 1/7 M L

56 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons It s just a lnear combnaton of sgmodal functons of lnear combnatons of the auxlary varables LUS a lnear model f(x ) = ( ) φ Q q=1 γ qmx q + γ 0m 1/7 M L

57 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons It s just a lnear combnaton of sgmodal functons of lnear combnatons of the auxlary varables LUS a lnear model f(x ) = ( ) M Q m=1 am φ q=1 γ qmx q + γ 0m +a 0 1/7 M L

58 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons It s just a lnear combnaton of sgmodal functons of lnear combnatons of the auxlary varables LUS a lnear model f(x ) = ( ) Q M Q q=1 β qx q + m=1 am φ q=1 γ qmx q + γ 0m +a 0 1/7 M L

59 ...Quckly, what s a Feedforward Neural Network wth skp layer connectons It s just a lnear combnaton of sgmodal functons of lnear combnatons of the auxlary varables LUS a lnear model f(x ) = ( ) Q M Q q=1 β qx q + m=1 am φ q=1 γ qmx q + γ 0m +a 0 We wll denote by θ = {β 1,..., β Q, a 0, a 1,..., a M, γ 01,..., γ 0M, γ 1,..., γ M } the set of all parameters of the net. 1/7 M L

60 A dagram that usually represents a NNet x 1 x x Q 5 γ 11 5 γ γ 1M φ a 1 a 0 φ a. β 5. M 5 y a M γ Q1 γ φ QM β Q... lauxlary varables Neurons Response varable β 1 14/7 M L

61 Nonparametrc model calbraton - the steps 15/7 M L

62 Nonparametrc model calbraton - the steps 1. Workng model - Neural Network model E ξ (y ) = f(x ), V ξ (y ) = v(x ), U U 15/7 M L

63 Nonparametrc model calbraton - the steps 1. Workng model - Neural Network model E ξ (y ) = f(x ), V ξ (y ) = v(x ), U U. Obtan ftted values. Frst get the populaton parameter as the mnmzer of { N } 1 r θ = argmn (y f(x, θ)) + λ θl, θ Θ v where λ s a weght decay parameter, =1 l=1 15/7 M L

64 Nonparametrc model calbraton - the steps 1. Workng model - Neural Network model E ξ (y ) = f(x ), V ξ (y ) = v(x ), U U. Obtan ftted values. Frst get the populaton parameter as the mnmzer of { N } 1 r θ = argmn (y f(x, θ)) + λ θl, θ Θ v where λ s a weght decay parameter, by means of estmatng equatons N =1 =1 { (y f(x, θ)) f(x, θ) θ l=1 1 λ } v N θ = 0. 15/7 M L

65 Nonparametrc model calbraton - the steps 1. Workng model - Neural Network model E ξ (y ) = f(x ), V ξ (y ) = v(x ), U U. Obtan ftted values. Frst get the populaton parameter as the mnmzer of { N } 1 r θ = argmn (y f(x, θ)) + λ θl, θ Θ v where λ s a weght decay parameter, by means of estmatng equatons N =1 =1 { (y f(x, θ)) f(x, θ) θ l=1 1 λ } v N θ = 0. Then get ˆθ as the soluton of the desgn based sample verson of t n { 1 (y f(x, θ)) f(x, θ) 1 λ } θ v N θ = 0. =1 π 15/7 M L

66 Nonparametrc model calbraton - the steps 1. Workng model - Neural Network model E ξ (y ) = f(x ), V ξ (y ) = v(x ), U U. Obtan ftted values. Frst get the populaton parameter as the mnmzer of { N } 1 r θ = argmn (y f(x, θ)) + λ θl, θ Θ v where λ s a weght decay parameter, by means of estmatng equatons N { (y f(x, θ)) f(x, θ) 1 λ } θ v N θ = 0. =1 =1 l=1 Then get ˆθ as the soluton of the desgn based sample verson of t n { 1 (y f(x, θ)) f(x, θ) 1 λ } θ v N θ =1 π = 0. Then we can obtan ftted values ˆf = f(x, ˆθ) such that ˆf = f(x, θ) + O p (n 1/ ). 15/7 M L

67 Nonparametrc model calbraton - the calbraton step 16/7 M L

68 Nonparametrc model calbraton - the calbraton step. Buld the calbraton estmator as for parametrc model calbraton, just the ftted values n the calbraton constrant are dfferent NNMC = N 1 s w y 16/7 M L

69 Nonparametrc model calbraton - the calbraton step. Buld the calbraton estmator as for parametrc model calbraton, just the ftted values n the calbraton constrant are dfferent NNMC = N 1 s w y mn w s (w d ) d q s.t. s w = N N 1 s w ˆf = N 1 U ˆf 16/7 M L

70 Nonparametrc model calbraton - the calbraton step. Buld the calbraton estmator as for parametrc model calbraton, just the ftted values n the calbraton constrant are dfferent NNMC = N 1 s w y mn w s (w d ) d q s.t. s w = N N 1 s w ˆf = N 1 U ˆf Then, NNMC = ˆȲ + 1 N ( U ˆf s 16/7 M L d ˆf ) where ˆβ nn, s the GREG coeffcent of a regresson estmator of y on ˆf. (Cfr wth a modfed GAM regresson estmator n Opsomer et al., 001) ˆβ nn

71 Local polynomals model calbraton - the steps 17/7 M L

72 Local polynomals model calbraton - the steps 1. Workng model - A very general unvarate model { Eξ (y ) = m(x ), U V ξ (y ) = v(x ), U 17/7 M L

73 Local polynomals model calbraton - the steps 1. Workng model - A very general unvarate model { Eξ (y ) = m(x ), U V ξ (y ) = v(x ), U. Get ftted values by means of local polynomals ˆm = e 1(X sw s X s ) 1 X sw s y s, where e 1 = (1, 0,..., 0) s a column vector of length p + 1, p s the order of the local polynomal ft, y s = (y 1,..., y n ), W s = dag {d j K h (x j x )} j s, K s a kernel functon, h s the bandwdth and X s = [1 x j x (x j x ) p ] j s. 17/7 M L

74 Local polynomals model calbraton - the steps 18/7 M L

75 Local polynomals model calbraton - the steps. Buld the model calbraton estmator as prevously LMC = N 1 s w y 18/7 M L

76 Local polynomals model calbraton - the steps. Buld the model calbraton estmator as prevously LMC = N 1 s w y mn w s (w d ) d q s.t. s w = N N 1 s w ˆm = N 1 U ˆm 18/7 M L

77 Local polynomals model calbraton - the steps. Buld the model calbraton estmator as prevously LMC = N 1 s w y Then, mn w s (w d ) d q s.t. LMC = ˆȲ + 1 N ( s w = N N 1 s w ˆm = N 1 U ˆm U ˆm s d ˆm ) where ˆβ lp, s the GREG coeffcent of a regresson estmator of y on ˆm. ˆβ lp 18/7 M L

78 Whch s the dfference between LMC and LRE The Local polynomal regresson estmator (Bredt & Opsomer, 000) s gven by ( LRE = ˆȲ + 1 ˆm ) d ˆm. N s U 19/7 M L

79 Whch s the dfference between LMC and LRE The Local polynomal regresson estmator (Bredt & Opsomer, 000) s gven by ( LRE = ˆȲ + 1 ˆm ) d ˆm. N s U The only dfference lays n the supplementary regresson step provded by ˆβ lp. LMC can be also thought of a GREG estmator wth a workng model of the type E ξ (y ) = a + b m(x ). 19/7 M L

80 Whch s the dfference between LMC and LRE The Local polynomal regresson estmator (Bredt & Opsomer, 000) s gven by ( LRE = ˆȲ + 1 ˆm ) d ˆm. N s U The only dfference lays n the supplementary regresson step provded by ˆβ lp. LMC can be also thought of a GREG estmator wth a workng model of the type E ξ (y ) = a + b m(x ). If the nonparametrc technque provdes based estmates of the mean functon or the workng model s not vald, then ths step wll lead to more effcent estmates by correctng ths bas. 19/7 M L

81 Smulaton Study - MAHA regon The Md-Atlantc Hghlands study regon ncludes the area from the Blue Rdge Mountans n the east to the Oho Rver n the west and from the Catskll Mountans n the north to Vrgna n the south. 0/7 M L

82 Smulaton Study - data Md-Atlantc Hghlands Area (MAHA) EA Regon : A, VA, WV, DE, MD. Data collected by EAs EMA. Streams sampled from 199 through Total Ntrogen (NTL) and Total hosphorus (TL) sampled at 574 stes. roporton of watershed devoted to Agrculture (AG) avalable from remote sensng. 1/7 M L

83 Scatterplots of the two survey varables wrt AG NTL 700 TL AG AG /7 M L

84 Smulaton Study - setup N = 574, auxlary varable: AG, survey varables: NTL and TL. A thousand smple random samples wthout replacement of dmenson n = 100 have been drawn from U. /7 M L

85 Smulaton Study - setup N = 574, auxlary varable: AG, survey varables: NTL and TL. A thousand smple random samples wthout replacement of dmenson n = 100 have been drawn from U. For each sample we computed the followng estmators HT the sample mean; CAL the regresson estmator; NNMC wth four combnatons of complexty parameters M and λ LMC, LRE wth a local constant and a local lnear ft wth bandwdths h = 0.10 and h = 0.5 /7 M L

86 Smulaton Study - setup N = 574, auxlary varable: AG, survey varables: NTL and TL. A thousand smple random samples wthout replacement of dmenson n = 100 have been drawn from U. For each sample we computed the followng estmators HT the sample mean; CAL the regresson estmator; NNMC wth four combnatons of complexty parameters M and λ LMC, LRE wth a local constant and a local lnear ft wth bandwdths h = 0.10 and h = 0.5 erformance evaluated by means of Smse( ) = Mse( )/ Mse(CAL) /7 M L

87 Smulaton Study - results NTL TL HT CAL NNMC M = λ=5e M =4 λ=5e M =6 λ=1e M =8 λ=1e LMC p=0 h= p=0 h= p=1 h= p=1 h= LRE p=0 h= p=0 h= p=1 h= p=1 h=

88 Conclusons The use of Nonparametrc methods to obtan ftted values for non-sampled unts provdes more effcent estmates by allowng for more complex modellng than wth parametrc calbraton. Neural Networks have shown effcent and robust behavors n both unvarate and (multvarate - not shown here) settngs. Such behavor seems to be less nfluenced by the choce of complexty parameters w.r.t. other nonparametrc methods. Wth respect to nonparametrc regresson estmaton, the supplementary calbraton step performed by model calbraton provdes more effcent estmators when the ftted values underft the data (low degree polynomal and/or large bandwdth) 5/7 M L

89 Ongong research and perspectves erformance of NNMC s beng explored wth multple auxlary nformaton and compared to other nonparametrc technques (GAM, MARS, DART) Model calbraton weghts depend on the survey varable, therefore a sngle set of weghts s not avalable for more than one. Also studyng the effects of multple smultaneous calbraton (dea n Opsomer et al., 001). Varance estmaton s an ssue when nonparametrc methods are employed: usually largely underestmated. 6/7 M L

90 Essental bblography Bredt F.J. and Opsomer J.D. (000), Local polynomal regresson estmators n survey samplng, The Annals of Statstcs, 8, Devlle J.C. and Särndal C.E. (199), JASA, 87, Calbraton estmators n survey samplng, Opsomer J.D., Mosen G.G. and Km J.Y. (001), Model-asssted estmaton of forest resources wth generalzed addtve models, ASA roceedngs of the Secton on Survey Research Methods. Wu C. and Stter R.R. (001), A model-calbraton to usng complete auxlary nformaton from survey data, JASA, 96, The work reported here was n part developed under the STAR Research Assstance Agreement CR awarded by the U.S. Envronmental rotecton Agency (EA) to Colorado State Unversty. Ths presentaton has not been formally revewed by EA. The vews expressed here are solely those of the presenter and STARMA. EA does not endorse any products or commercal servces mentoned n ths presentaton. 7/7 M L

Estimation: Part 2. Chapter GREG estimation

Estimation: Part 2. Chapter GREG estimation Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

Lecture 10 Support Vector Machines II

Lecture 10 Support Vector Machines II Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

A note on regression estimation with unknown population size

A note on regression estimation with unknown population size Statstcs Publcatons Statstcs 6-016 A note on regresson estmaton wth unknown populaton sze Mchael A. Hdroglou Statstcs Canada Jae Kwang Km Iowa State Unversty jkm@astate.edu Chrstan Olver Nambeu Statstcs

More information

Bias-correction under a semi-parametric model for small area estimation

Bias-correction under a semi-parametric model for small area estimation Bas-correcton under a sem-parametrc model for small area estmaton Laura Dumtrescu, Vctora Unversty of Wellngton jont work wth J. N. K. Rao, Carleton Unversty ICORS 2017 Workshop on Robust Inference for

More information

Nonparametric Regression Estimation. of Finite Population Totals. under Two-Stage Sampling

Nonparametric Regression Estimation. of Finite Population Totals. under Two-Stage Sampling Nonparametrc Regresson Estmaton of Fnte Populaton Totals under Two-Stage Samplng J-Yeon Km Iowa State Unversty F. Jay Bredt Colorado State Unversty Jean D. Opsomer Iowa State Unversty ay 21, 2003 Abstract

More information

Efficient nonresponse weighting adjustment using estimated response probability

Efficient nonresponse weighting adjustment using estimated response probability Effcent nonresponse weghtng adjustment usng estmated response probablty Jae Kwang Km Department of Appled Statstcs, Yonse Unversty, Seoul, 120-749, KOREA Key Words: Regresson estmator, Propensty score,

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

STAT 3008 Applied Regression Analysis

STAT 3008 Applied Regression Analysis STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Multivariate Ratio Estimator of the Population Total under Stratified Random Sampling

Multivariate Ratio Estimator of the Population Total under Stratified Random Sampling Open Journal of Statstcs, 0,, 300-304 ttp://dx.do.org/0.436/ojs.0.3036 Publsed Onlne July 0 (ttp://www.scrp.org/journal/ojs) Multvarate Rato Estmator of te Populaton Total under Stratfed Random Samplng

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

1 Convex Optimization

1 Convex Optimization Convex Optmzaton We wll consder convex optmzaton problems. Namely, mnmzaton problems where the objectve s convex (we assume no constrants for now). Such problems often arse n machne learnng. For example,

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased

More information

On Outlier Robust Small Area Mean Estimate Based on Prediction of Empirical Distribution Function

On Outlier Robust Small Area Mean Estimate Based on Prediction of Empirical Distribution Function On Outler Robust Small Area Mean Estmate Based on Predcton of Emprcal Dstrbuton Functon Payam Mokhtaran Natonal Insttute of Appled Statstcs Research Australa Unversty of Wollongong Small Area Estmaton

More information

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0 MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Primer on High-Order Moment Estimators

Primer on High-Order Moment Estimators Prmer on Hgh-Order Moment Estmators Ton M. Whted July 2007 The Errors-n-Varables Model We wll start wth the classcal EIV for one msmeasured regressor. The general case s n Erckson and Whted Econometrc

More information

Polynomial Regression Models

Polynomial Regression Models LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise. Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the

More information

e i is a random error

e i is a random error Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE

ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE P a g e ANOMALIES OF THE MAGNITUDE OF THE BIAS OF THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE REGRESSION SLOPE Darmud O Drscoll ¹, Donald E. Ramrez ² ¹ Head of Department of Mathematcs and Computer Studes

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

Statistics II Final Exam 26/6/18

Statistics II Final Exam 26/6/18 Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models

More information

PHYS 705: Classical Mechanics. Calculus of Variations II

PHYS 705: Classical Mechanics. Calculus of Variations II 1 PHYS 705: Classcal Mechancs Calculus of Varatons II 2 Calculus of Varatons: Generalzaton (no constrant yet) Suppose now that F depends on several dependent varables : We need to fnd such that has a statonary

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

Exponential Type Product Estimator for Finite Population Mean with Information on Auxiliary Attribute

Exponential Type Product Estimator for Finite Population Mean with Information on Auxiliary Attribute Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 193-9466 Vol. 10, Issue 1 (June 015), pp. 106-113 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) Exponental Tpe Product Estmator

More information

Basically, if you have a dummy dependent variable you will be estimating a probability.

Basically, if you have a dummy dependent variable you will be estimating a probability. ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy

More information

Population element: 1 2 N. 1.1 Sampling with Replacement: Hansen-Hurwitz Estimator(HH)

Population element: 1 2 N. 1.1 Sampling with Replacement: Hansen-Hurwitz Estimator(HH) Chapter 1 Samplng wth Unequal Probabltes Notaton: Populaton element: 1 2 N varable of nterest Y : y1 y2 y N Let s be a sample of elements drawn by a gven samplng method. In other words, s s a subset of

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Solutions Homework 4 March 5, 2018

Solutions Homework 4 March 5, 2018 1 Solutons Homework 4 March 5, 018 Soluton to Exercse 5.1.8: Let a IR be a translaton and c > 0 be a re-scalng. ˆb1 (cx + a) cx n + a (cx 1 + a) c x n x 1 cˆb 1 (x), whch shows ˆb 1 s locaton nvarant and

More information

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model

More information

β0 + β1xi and want to estimate the unknown

β0 + β1xi and want to estimate the unknown SLR Models Estmaton Those OLS Estmates Estmators (e ante) v. estmates (e post) The Smple Lnear Regresson (SLR) Condtons -4 An Asde: The Populaton Regresson Functon B and B are Lnear Estmators (condtonal

More information

Sampling Theory MODULE VII LECTURE - 23 VARYING PROBABILITY SAMPLING

Sampling Theory MODULE VII LECTURE - 23 VARYING PROBABILITY SAMPLING Samplng heory MODULE VII LECURE - 3 VARYIG PROBABILIY SAMPLIG DR. SHALABH DEPARME OF MAHEMAICS AD SAISICS IDIA ISIUE OF ECHOLOGY KAPUR he smple random samplng scheme provdes a random sample where every

More information

Parametric fractional imputation for missing data analysis

Parametric fractional imputation for missing data analysis Secton on Survey Research Methods JSM 2008 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Wayne Fuller Abstract Under a parametrc model for mssng data, the EM algorthm s a popular tool

More information

RELIABILITY ASSESSMENT

RELIABILITY ASSESSMENT CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department

More information

Econ Statistical Properties of the OLS estimator. Sanjaya DeSilva

Econ Statistical Properties of the OLS estimator. Sanjaya DeSilva Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate

More information

Lecture 3 Stat102, Spring 2007

Lecture 3 Stat102, Spring 2007 Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture

More information

Interpreting Slope Coefficients in Multiple Linear Regression Models: An Example

Interpreting Slope Coefficients in Multiple Linear Regression Models: An Example CONOMICS 5* -- Introducton to NOT CON 5* -- Introducton to NOT : Multple Lnear Regresson Models Interpretng Slope Coeffcents n Multple Lnear Regresson Models: An xample Consder the followng smple lnear

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

A Comparative Study for Estimation Parameters in Panel Data Model

A Comparative Study for Estimation Parameters in Panel Data Model A Comparatve Study for Estmaton Parameters n Panel Data Model Ahmed H. Youssef and Mohamed R. Abonazel hs paper examnes the panel data models when the regresson coeffcents are fxed random and mxed and

More information

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens THE CHINESE REMAINDER THEOREM KEITH CONRAD We should thank the Chnese for ther wonderful remander theorem. Glenn Stevens 1. Introducton The Chnese remander theorem says we can unquely solve any par of

More information

A general class of estimators for the population mean using multi-phase sampling with the non-respondents

A general class of estimators for the population mean using multi-phase sampling with the non-respondents Hacettepe Journal of Mathematcs Statstcs Volume 43 3 014 511 57 A general class of estmators for the populaton mean usng mult-phase samplng wth the non-respondents Saba Raz Gancarlo Dana Javd Shabbr Abstract

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

β0 + β1xi. You are interested in estimating the unknown parameters β

β0 + β1xi. You are interested in estimating the unknown parameters β Ordnary Least Squares (OLS): Smple Lnear Regresson (SLR) Analytcs The SLR Setup Sample Statstcs Ordnary Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals) wth OLS

More information

Introduction to Regression

Introduction to Regression Introducton to Regresson Dr Tom Ilvento Department of Food and Resource Economcs Overvew The last part of the course wll focus on Regresson Analyss Ths s one of the more powerful statstcal technques Provdes

More information

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition) Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Statistics for Business and Economics

Statistics for Business and Economics Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Testing for seasonal unit roots in heterogeneous panels

Testing for seasonal unit roots in heterogeneous panels Testng for seasonal unt roots n heterogeneous panels Jesus Otero * Facultad de Economía Unversdad del Rosaro, Colomba Jeremy Smth Department of Economcs Unversty of arwck Monca Gulett Aston Busness School

More information

Least Squares Fitting of Data

Least Squares Fitting of Data Least Squares Fttng of Data Davd Eberly Geoetrc Tools, LLC http://www.geoetrctools.co/ Copyrght c 1998-2015. All Rghts Reserved. Created: July 15, 1999 Last Modfed: January 5, 2015 Contents 1 Lnear Fttng

More information

The Expectation-Maximization Algorithm

The Expectation-Maximization Algorithm The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.

More information

Least Squares Fitting of Data

Least Squares Fitting of Data Least Squares Fttng of Data Davd Eberly Geoetrc Tools, LLC http://www.geoetrctools.co/ Copyrght c 1998-2014. All Rghts Reserved. Created: July 15, 1999 Last Modfed: February 9, 2008 Contents 1 Lnear Fttng

More information

USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE

USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE STATISTICA, anno LXXV, n. 4, 015 USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE Manoj K. Chaudhary 1 Department of Statstcs, Banaras Hndu Unversty, Varanas,

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013 ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run

More information

Weighted Estimating Equations with Response Propensities in Terms of Covariates Observed only for Responders

Weighted Estimating Equations with Response Propensities in Terms of Covariates Observed only for Responders Weghted Estmatng Equatons wth Response Propenstes n Terms of Covarates Observed only for Responders Erc V. Slud, U.S. Census Bureau, CSRM Unv. of Maryland, Mathematcs Dept. NISS Mssng Data Workshop, November

More information

ADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING

ADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING 1 ADVANCED ACHINE LEARNING ADVANCED ACHINE LEARNING Non-lnear regresson technques 2 ADVANCED ACHINE LEARNING Regresson: Prncple N ap N-dm. nput x to a contnuous output y. Learn a functon of the type: N

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department

More information

The Ordinary Least Squares (OLS) Estimator

The Ordinary Least Squares (OLS) Estimator The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed

More information

T E C O L O T E R E S E A R C H, I N C.

T E C O L O T E R E S E A R C H, I N C. T E C O L O T E R E S E A R C H, I N C. B rdg n g En g neern g a nd Econo mcs S nce 1973 THE MINIMUM-UNBIASED-PERCENTAGE ERROR (MUPE) METHOD IN CER DEVELOPMENT Thrd Jont Annual ISPA/SCEA Internatonal Conference

More information

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Physics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1

Physics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1 P. Guterrez Physcs 5153 Classcal Mechancs D Alembert s Prncple and The Lagrangan 1 Introducton The prncple of vrtual work provdes a method of solvng problems of statc equlbrum wthout havng to consder the

More information

Factor models with many assets: strong factors, weak factors, and the two-pass procedure

Factor models with many assets: strong factors, weak factors, and the two-pass procedure Factor models wth many assets: strong factors, weak factors, and the two-pass procedure Stanslav Anatolyev 1 Anna Mkusheva 2 1 CERGE-EI and NES 2 MIT December 2017 Stanslav Anatolyev and Anna Mkusheva

More information

MATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)

MATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2) 1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

Ballot Paths Avoiding Depth Zero Patterns

Ballot Paths Avoiding Depth Zero Patterns Ballot Paths Avodng Depth Zero Patterns Henrch Nederhausen and Shaun Sullvan Florda Atlantc Unversty, Boca Raton, Florda nederha@fauedu, ssull21@fauedu 1 Introducton In a paper by Sapounaks, Tasoulas,

More information

Issues To Consider when Estimating Health Care Costs with Generalized Linear Models (GLMs): To Gamma/Log Or Not To Gamma/Log? That Is The New Question

Issues To Consider when Estimating Health Care Costs with Generalized Linear Models (GLMs): To Gamma/Log Or Not To Gamma/Log? That Is The New Question Issues To Consder when Estmatng Health Care Costs wth Generalzed Lnear Models (GLMs): To Gamma/Log Or Not To Gamma/Log? That Is The New Queston ISPOR 20th Annual Internatonal Meetng May 19, 2015 Jalpa

More information

Chapter 15 Student Lecture Notes 15-1

Chapter 15 Student Lecture Notes 15-1 Chapter 15 Student Lecture Notes 15-1 Basc Busness Statstcs (9 th Edton) Chapter 15 Multple Regresson Model Buldng 004 Prentce-Hall, Inc. Chap 15-1 Chapter Topcs The Quadratc Regresson Model Usng Transformatons

More information

A Bound for the Relative Bias of the Design Effect

A Bound for the Relative Bias of the Design Effect A Bound for the Relatve Bas of the Desgn Effect Alberto Padlla Banco de Méxco Abstract Desgn effects are typcally used to compute sample szes or standard errors from complex surveys. In ths paper, we show

More information

Small Area Estimation for Business Surveys

Small Area Estimation for Business Surveys ASA Secton on Survey Research Methods Small Area Estmaton for Busness Surveys Hukum Chandra Southampton Statstcal Scences Research Insttute, Unversty of Southampton Hghfeld, Southampton-SO17 1BJ, U.K.

More information

Credit Card Pricing and Impact of Adverse Selection

Credit Card Pricing and Impact of Adverse Selection Credt Card Prcng and Impact of Adverse Selecton Bo Huang and Lyn C. Thomas Unversty of Southampton Contents Background Aucton model of credt card solctaton - Errors n probablty of beng Good - Errors n

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

β0 + β1xi. You are interested in estimating the unknown parameters β

β0 + β1xi. You are interested in estimating the unknown parameters β Revsed: v3 Ordnar Least Squares (OLS): Smple Lnear Regresson (SLR) Analtcs The SLR Setup Sample Statstcs Ordnar Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals)

More information

Supplementary Notes for Chapter 9 Mixture Thermodynamics

Supplementary Notes for Chapter 9 Mixture Thermodynamics Supplementary Notes for Chapter 9 Mxture Thermodynamcs Key ponts Nne major topcs of Chapter 9 are revewed below: 1. Notaton and operatonal equatons for mxtures 2. PVTN EOSs for mxtures 3. General effects

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

ECE559VV Project Report

ECE559VV Project Report ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate

More information

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek Dscusson of Extensons of the Gauss-arkov Theorem to the Case of Stochastc Regresson Coeffcents Ed Stanek Introducton Pfeffermann (984 dscusses extensons to the Gauss-arkov Theorem n settngs where regresson

More information

Temperature. Chapter Heat Engine

Temperature. Chapter Heat Engine Chapter 3 Temperature In prevous chapters of these notes we ntroduced the Prncple of Maxmum ntropy as a technque for estmatng probablty dstrbutons consstent wth constrants. In Chapter 9 we dscussed the

More information

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9 Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,

More information

Goodness of fit and Wilks theorem

Goodness of fit and Wilks theorem DRAFT 0.0 Glen Cowan 3 June, 2013 Goodness of ft and Wlks theorem Suppose we model data y wth a lkelhood L(µ) that depends on a set of N parameters µ = (µ 1,...,µ N ). Defne the statstc t µ ln L(µ) L(ˆµ),

More information

Numerical Solution of Ordinary Differential Equations

Numerical Solution of Ordinary Differential Equations Numercal Methods (CENG 00) CHAPTER-VI Numercal Soluton of Ordnar Dfferental Equatons 6 Introducton Dfferental equatons are equatons composed of an unknown functon and ts dervatves The followng are examples

More information

since [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation

since [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation Econ 388 R. Butler 204 revsons Lecture 4 Dummy Dependent Varables I. Lnear Probablty Model: the Regresson model wth a dummy varables as the dependent varable assumpton, mplcaton regular multple regresson

More information

Module 2. Random Processes. Version 2 ECE IIT, Kharagpur

Module 2. Random Processes. Version 2 ECE IIT, Kharagpur Module Random Processes Lesson 6 Functons of Random Varables After readng ths lesson, ou wll learn about cdf of functon of a random varable. Formula for determnng the pdf of a random varable. Let, X be

More information