Testing categorized bivariate normality with two-stage. polychoric correlation estimates
|
|
- Bryce Rice
- 6 years ago
- Views:
Transcription
1 Testing ctegorized bivrite normlity with two-stge polychoric correltion estimtes Albert Mydeu-Olivres Dept. of Psychology University of Brcelon Address correspondence to: Albert Mydeu-Olivres. Fculty of Psychology. University of Brcelon. P. Vlle de Hebrón, Brcelon (Spin). E-mil: This reserch ws supported by grnt BSO of the Spnish Ministry of Science nd Technology. I'm indebted to Krl Jöreskog for his encourgement to write this mnuscript nd for his comments to previous drft.
2 2 Abstrct We show tht when the thresholds nd the polychoric correltion re estimted in two stges, neither Person's X 2 nor the likelihood rtio G 2 goodness of fit test sttistics re symptoticlly chi-squre. We propose new sttistic tht is symptoticlly chi-squre in this sitution. However, our experience -illustrted with numericl exmple- nd smll simultion study using 5! 5 tble suggest tht in finite smples our new test is not ble to outperform X 2. Both mtch rther well reference chi-squre distribution even in smll smples. G 2, on the other hnd, ws found to be conservtive in smll smples. Thus, in prctice it is justified to use X 2 to test bivrite normlity when the prmeters re estimted in two stges, even in smll smples. Lrger smples my be needed to use G 2. We ttribute our empiricl results to the very smll numericl differences found when X 2 nd G 2 re computed using two or one-stge estimtes, where in the ltter cse it is theoreticlly justified to use these sttistics. Keywords: LISREL, LISCOMP, MPLUS, ctegoricl dt nlysis, pseudo-mximum likelihood estimtion, multinomil models, sprse tbles.
3 3. Introduction Consider bivrite stndrd norml density ctegorized ccording to (I - ) nd (J - ) thresholds, respectively. Within mximum likelihood frmework, Olsson (979) considered one nd two-stge pproches to estimte the q = (I - ) + (J - ) + prmeters of this model from the observed I! J contingency tble. In the one-stge pproch ll prmeters re estimted simultneously. In the two-stge pproch, the thresholds re estimted seprtely from ech univrite mrginl, then the polychoric correltion is estimted from the bivrite tble using the thresholds estimted in the first stge. Of course, fter estimting the prmeters one must test the model (Muthén, 993). To this end, one my employ Person's X 2 test sttistic or the likelihood rtio sttistic G 2. From stndrd theory (e.g, Agresti, 990), when the one-stge pproch is employed both sttistics re symptoticlly distributed s chi-squre with r = IJ - q - = IJ - I - J degrees of freedom. However, ever since Olsson (979) concluded tht very similr results re obtined with the computtionlly simpler two-stge pproch, this pproch hs become the stndrd procedure for estimting this model. As such, it is the procedure implemented in computer progrms such s LISCOMP (Muthén, 987), PRELIS/LISREL (Jöreskog & Sörbom, 993) nd MPLUS (Muthén & Muthén, 998). Yet, the distribution of X 2 nd G 2 is presently unknown when the two-stge pproch is employed. This pper fills in this gp using lrge smple theory. 2. Asymptotic distribution of prmeter estimtes Consider I! J contingency tble. Let! % "!,!,!,!,!,!,!,!,!,!,! J i ij I IJ denote its IJ vector of probbilities nd p its ssocited vector of smple proportions. $
4 4 Furthermore, let! % $ "!!!!! nd! % "!!!,,,, i I,,,, $!! denote the vectors of 2 j univrite mrginl probbilities, nd p nd p 2 the vectors of its ssocited smple proportions. We note tht, J illustrted here for I = 2 nd J = 3! % T!! % T!, () 2 2 & ' $ 0 3 3$( T % ) 0 $ $( ( )* " T % I I where 3 nd 0 3 denote three-dimensionl column vectors of 's nd 0's respectively. Now, ssume the following model for, ij, ij " 2 i " 2 j %.. " z dz! (2) " " i- 2 j- * * 2 where " %-/," %-/," %/," %/ nd 0 n ( ) denotes n-vrite stndrd norml I J density function. Thus, z * hs men zero nd correltion mtrix & $ '. In prticulr, )* $ ( + " 2 i * *! " " % z dz i. " i- In the sequel, let ", 2 " 2 j * *! % j. z dz (3) 2 2 " 2 j- " % " " $, where " nd " 2 denote the (I ) nd (J ) dimensionl vectors of thresholds implied by the model. Finlly, let % "", $ $. We now provide the symptotic distribution of the one nd two-stge prmeter estimtes using stndrd results for mximum likelihood estimtors for multinomil models. Agresti (990) is good source for the relevnt theory. Let! nd p be C-dimensionl vectors of multinomil probbilities nd smple
5 5 proportions, respectively, nd let N denote smple size. Consider prmetric structure for!,!($), with Jcobin mtrix! % %, nd suppose we estimte $ by mximizing $ $ C L" $ % N2 p ln! " $. (4) c% Then, under typicl regulrity conditions, it follows tht c c d N " p-! 3N " 0, & & % D -!!$ (5) where % Dig "! N N D, % " % denotes symptotic equlity. " $ - $ % N " -! B p (6) " " d - N," $ $ -$ 3 0 % D % - (7) B % $ D % % $ D, 3 d denotes convergence in distribution, nd 2. One-stge estimtion D d, Akin to (5) we write, N " -! 3N " & % Dig! " p 0, where & % D -!! $ nd. Then, when ll the prmeters re estimted simultneously by I J mximizing L "",", % N ln ",, i j 22p " " ij ij i j $! $, it follows from (7) i% j% N " " d - N," $ % D % - (8)! & ' )!! % % %) $ )* " $ $ ( + where nd ll necessry derivtives cn be found in Olsson (979). 2.2 Two-stge estimtion Consider now the following sequentil estimtor for (Olsson, 979):
6 6 First stge: Estimte the thresholds for ech vrible seprtely by mximizing "" ln "" I J % 2! L i i i "" N p ln 2 2 "" j j j i% j% L N p Second stge: Estimte the polychoric correltion by mximizing % 2! (9) L " $," N p ln! " $," (0) I J % 22 i% j% We shll now provide n lterntive derivtion of Olsson's results for this estimtor closely following Jöreskog's (994). We first notice tht " nd " re mximum likelihood estimtes, s (9) is the kernel of the log-likelihood function for estimting the thresholds from the univrite mrginls of the contingency tble. Similrly, (0) is the kernel of the log-likelihood function for estimting the polychoric correltion from the bivrite contingency tble given the estimted thresholds. Tht is, $ is pseudo-mximum likelihood estimte in the terminology of Gong nd Smniego (98). To obtin the symptotic distribution of the two-stge estimtes we first pply (6) to the first stge estimtes to obtin ij ij i j N "" -" % B N " p -! N "" -" % N " -! B p () where " B % % $ D - % - % $ D -, % Dig "!! D, % % " $, nd so on. These derivtives cn lso be found in Olsson (979). Now, letting B & B T ' ( %, by () nd () we get ) B T ( * 2+ N "" -"% N " -! B p. () Similrly, direct ppliction of (6) to the second stge estimtes yields - % % - - % $ % $ where " " N " $ - $ %' N p -! " $, " (3) 22! B D D, nd % %. Note tht B 22 nd % 22 re row nd $ 22
7 7 column vector, respectively, despite the nottion. Now, we need the symptotic distribution " of N p -! " $, " to proceed. In Appendix, we show tht N " p -! " $, " %" I-% B N " p -! (4) 2! where % %. Putting together (3) nd (4) we obtin 2 " $ N " - % B " I-% B N " p -! Finlly, putting together () nd (5) we obtin $ $. (5) 22 2 N " -% G N " p -! & B ' ( G % ) B I- B (. (6) " % )* nd since s shown in the Appendix, G! % 0, (7) N " d N ", $ - 3 0GD G (8) where G nd D re to be evluted t the true popultion vlues. 3. Goodness of fit testing We wish to investigte the symptotic distribution of Person's X 2 sttistic, X 2 I J % N22 " p -! " ij ij! " i% j% ij 2 nd the likelihood rtio sttistic I J p 2 ij G % N22 p ln % 2L " ij! i% j% ij, where by convention when p ij = 0, p ij pij ln 0! " %. ij From stndrd theory (e.g., Agresti, 990), when the model prmeters re estimted d simultneously, G % X 3%. When they re estimted in two stges, it lso holds tht - - G 2 2 IJ I J % X (see Agresti, 990: p. 434). Thus, we only consider the symptotic distribution of
8 8 X 2. To do so, we first consider the symptotic distribution of the unstndrdized residuls N e :% N " p -! " when re two- stge prmeter estimtes. In the Appendix it is shown tht " " Ne% I-K N p -! (9)! $ where % % %"% % 2 22 nd K % % G. Thus, by (9) nd (7), d N e3 N " 0,( ( %" I-K D " I-K $ -!! $. (20) Now, we note tht X 2 cn be written s X % NeD $ e. Using stndrd results 2 - (Agresti, 990: p. 432), X NeD e NeD e. (2) % $ % $ A necessry nd sufficient condition for (2) to be symptoticlly chi-squre distribution is (e.g., Schott, 997: Theorem 9.0) ( D ( D ( % ( D ( (22) In the Appendix we show tht - " 2 - ( " " " ( " " D % I-K I-JK I-J -C4 D % I-K I-J -C (23) where J % D K$ D nd - C %!! $ D. Thus, (22) is not stisfied. Neither X 2 nor G 2 re - symptoticlly chi-squred. Rther, these sttistics converge in distribution to mixture of r = IJ - I - J independent chi-squre vribles with one degree of freedom (Box, 954: Theorem 2.). Nevertheless, following Moore (977) it is esy to construct n lterntive qudrtic form in the residuls (20) tht is symptoticlly chi-squre. Consider ( -, mtrix tht converges in probbility to ( - -, generlized inverse of ( stisfying (( ( % (. Then, it redily follows tht
9 9 d W % N e$ ( - e 3% (24) 2 r where W is Wld sttistic. To consistently estimte ( we evlute ll derivtive mtrices in % nd G t the two-stge estimtes nd evlute ll probbilities t the estimted vlues. Then, ( - cn be redily obtined from ( by numericl methods. In closing this section, we note tht with one-stge prmeter estimtes X 2 = W s D is generlized inverse of the symptotic covrince mtrix of the unstndrdized - " residuls N e :% N p -! ". Next, we present numericl exmple nd very smll simultion study to illustrte the smll smple performnce of X 2, G 2, nd W. 4. Numericl Results 4. Soft drink dt Agresti (992) sked 6 respondents to compre the tste of Coke, Clssic Coke nd Pepsi using five point preference scle in pired comprison design {Coke vs. Clssic Coke, Coke vs. Pepsi, Clssic Coke vs. Pepsi}. The ctegories were {"Strong preference for i", "Mild preference for i", "Indiference", "Mild preference for i ", nd "Strong preference for i ",}. For ech pir of vribles, we shll test the ssumption tht the observed 5! 5 tble rises by ctegorizing stndrd bivrite norml density. Tht is, we re interested in testing substntive hypothesis of normlly distributed continuous preferences for the soft drinks in the popultion. In Tble we provide the thresholds nd polychoric correltion for ech pir of vribles estimted in two-stges, the symptotic stndrd errors of these prmeters, nd the goodness of fit results. The stndrd errors for the prmeter estimtes were obtined s the squre root of the digonl of (8) which ws consistently estimted by evluting ll derivtive mtrices nd probbilities t the estimted prmeter vlues.
10 Insert Tbles nd 2 bout here As cn be seen in this tble for ll three bivrite tbles the test sttistics suggest tht the ssumption of ctegorized bivrite normlity is resonble. We lso observe tht the W nd X 2 vlues obtined re extremely close. It is our experience tht this is lwys the cse. Thus, lthough X 2 is not symptoticlly chi-squred when the model prmeters re estimted in two stges, its finite smple distribution is so close to tht of the symptoticlly correct W sttistic tht it my be used in its plce. We believe this is becuse the expected probbilities obtined using the two-stge estimtes re very close to those obtined when ll model prmeters re jointly estimted. To illustrte this point, in Tble 2 we provide the one-stge estimtes for these three bivrite tbles, long with goodness of fit sttistics. We note tht when estimting the prmeters jointly, the thresholds estimted from different bivrite tbles need not be the sme cross tbles. We see in this tble tht the prmeter estimtes nd their stndrd errors re very similr to those obtined using the two stge pproch. Furthermore, the X 2 vlues re lso essentilly identicl to those obtined using the two stge pproch. We lso note in Tbles nd 2 tht the estimted G 2 sttistics re lrger thn thew nd X 2 sttistics. This is becuse we purposely chose numericl exmple with very smll smple size reltive to the size of the tble to highlight the differences between the sttistics. The estimted G 2 sttistics re lrger becuse there re some empty cells in the observed bivrite tble nd these re not included in the computtion of G 2. To investigte more systemticlly this effect we performed simultion study using " %"-, -0.5, 0.5, $, " %"-, -0.5, 0.5, $ nd 5 = 0.3. The results for N = 50, N = 00, nd N = 000 cross replictions re presented in Tble 3.
11 Insert Tble 3 bout here As cn be seen in this tble, G 2 yields conservtive results when N = 50 nd N = 00, lthough its behvior in the criticl region {% to 5%} is cceptble when N = 00. We lso see tht the differences between the W nd X 2 sttistics re negligible, so tht the computtionlly more complex W sttistic is not relly needed. The X 2 sttistic hs n cceptble behvior even when N = 50 in 5! 5 contingency tbles. This is remrkble. 5. Discussion The purpose of this reserch ws to investigte whether it ws theoreticlly justified to use X 2 nd G 2 to test ctegorized bivrite normlity when the model prmeters re estimted in two stges. We hve found tht it is not theoreticlly justified. Consequently, we hve proposed n lterntive test, W, tht is symptoticlly chi-squred when two-stge estimtion is employed. However, our experience -illustrted with our smll numericl exmple- nd our very smll simultion study suggest tht there re very smll numericl differences when X 2 nd G 2 re computed using one nd two-stge estimtes. In the former cse it is theoreticlly justified their use. Thus, in prctice it seems justified to use X 2 nd G 2 with two stge estimtes. It is not the purpose of the present reserch to investigte the reltive performnce of X 2 nd G 2 cross vriety of smple sizes nd true prmeter vlues. However, our limited simultion results suggest tht when there re empty cells G 2 is too conservtive nd tht X 2 is to be preferred to G 2. We hve lso found tht W does not outperform X 2 in prctice, where the ltter is to be preferred on computtionl grounds.
12 References Agresti, A. (990). Ctegoricl dt nlysis. New York: Wiley. Agresti, A. (992). Anlysis of ordinl pired comprison dt. Applied Sttistics, 4, Box, G.E.P. (954). Some theorems on qudrtic forms pplied in the study of nlysis of vrince problems: I. Effect of inequlity of vrince in the one-wy clssifiction. Annls of Mthemticl Sttistics, 6, Gong, G., & Smniego, F.J. (98). Pseudo mximum likelihood estimtion: Theory nd pplictions. Annls of Sttistics, 9, Jöreskog, K.G. (994). On the estimtion of polychoric correltions nd their symptotic covrince mtrix. Psychometrik, 59, Jöreskog, K.G. & Sörbom, D. (993). LISREL 8. User's reference guide. Chicgo, IL: Scientific Softwre. Moore, D.S. (977). Generlized inverses, Wld's method, nd the construction of chisqured tests of fit. Journl of the Americn Sttisticl Assocition, 72, Muthén, B. (987). LISCOMP: Anlysis of liner structurl equtions using comprehensive mesurement model. Mooresville, IN: Scientific Softwre. Muthén, B. (993). Goodness of fit with ctegoricl nd other non norml vribles. In K.A. Bollen & J.S. Long [Eds.] Testing structurl eqution models (pp ). Newbury Prk, CA: Sge. Muthén, L. & Muthén, B. (998). Mplus. Los Angeles, CA: Muthén & Muthén. Olsson, U. (979). Mximum likelihood estimtion of the polychoric correltion coefficient. Psychometrik, 44, Schott, J.R. (997). Mtrix nlysis for sttistics. New York: Wiley.
13 3 TABLE Two stge prmeter estimtes, estimted stndrd errors, nd goodness of fit tests for Agrestis soft drink dt Thresholds vr (0.80) (0.6) (0.69).50 (0.248) vr (0.87) (0.6) (0.66).202 (0.2) vr (0.2) (0.68) 0.03 (0.6) (0.84) Correltions nd Test Sttistics Vrs. Corr. W p-vlue G 2 p-vlue X 2 p-vlue (2,) 0.03 (0.40) (3,) (0.9) (3,2) (0.4) Notes: N = 6; stndrd errors in prentheses; 5 d.f.
14 4 TABLE 2 Joint prmeter estimtes, estimted stndrd errors nd goodness of fit tests for Agrestis soft drink dt Thresholds vr (0.87) (0.6) (0.66).202 (0.2) vr (0.80) 0.06 (0.6) (0.6).5 (0.249) vr (0.2) (0.67) 0.04 (0.60) (0.84) vr (0.80) (0.60) (0.60).50 (0.250) vr (0.2) (0.68) 0.03 (0.6) (0.84) vr (0.87) (0.6) (0.66).202 (0.2) Correltions nd Test Sttistics Vrs. Corr. G 2 p-vlue X 2 p-vlue (2,) 0.03 (0.44) (3,) (0.) (3,2) (0.52) Notes: N = 6; stndrd errors in prentheses; 5 d.f.
15 5 TABLE 3 Simultion results Nominl rtes N Stt. Men Vr. % 5% 0% 20% 30% 40% 50% 60% 70% 80% 90% W G X W G X W G X Notes: 000 replictions; 5 d.f.; " %"-, -0.5, 0.5, $, " %"-, -0.5, 0.5, $, 5 =
16 6 Appendix: Proofs of key results Proof of Eqution (4): A first order Tylor expnsion of! " $, " round " = " 0 yields! " $," %! " $," 6% "" -", 2! where % %. Thus, N " 2 "! $, " -! %% "" - "%% B N 2 2 " p -!, where " $ the lst symptotic equlity follows from (). Now, N " p -! " $," % N " p -! - N! " $," -! % I-% B N p -! " " " 2 Proof of Eqution (7): B T! % 0 becuse - - % $ D T! % % $ D! % 0. B T! % 0 becuse % $ D T! % % $ D! % 0. Thus, B! % Also, B! % 0 becuse 22 % $ D! % 0, so the proof is complete - 22 Proof of Eqution (9): A first order Tylor expnsion of! " round = 0 yields! where % % $! " %! " 6% " -,. Thus, N "! -! %%" -%% N " -! symptotic equlity follows from (6). Now, G p, where the lst " p -! % " p -! - "! -! %" I-% G " p -! N N N N
17 7 Proof of Eqution (23): We write ( D - %" I-K" I-J - C % A-C where K % % G, J % D G$ $ D nd % - C D. Then, " 2 %!! $ - ( D - % A -AC-CA6C. Using the stndrd equlities, 2 2 D! % %$ % 0 - $D $ % % 0 $ (25) -! % $ nd (7) we first notice tht JC % CJ % 0 KC % CK % 0 (26) Thus, AC = C nd CA = C. Furthermore, using (25) nd $! % ( sclr), C 2 = C. ( D - % A -C, but noting tht Thus, " 2 2 J 2 = J K 2 = K (27) we find tht 2 2 %"" - " - %" - " 6 " - A I K I J I K I JK I J. Therefore, " 2 ( D 4 ( D. - -
TESTING CATEGORIZED BIVARIATE NORMALITY WITH TWO-STAGE POLYCHORIC CORRELATION ESTIMATES
IE Working Pper WP 0 / 03 08/05/003 TESTING CATEGORIZED BIVARIATE NORMALITY WITH TWO-STAGE POLYCHORIC CORRELATION ESTIMATES Alberto Mydeu Olivres Instituto de Empres Mrketing Dept. C/ Mri de Molin, -5
More informationTESTING CATEGORIZED BIVARIATE NORMALITY WITH TWO-STAGE POLYCHORIC CORRELATION ESTIMATES. IE Working Paper MK8-106-I 08 / 05 / 2003
TESTING CATEGORIZED BIVARIATE NORMALITY WITH TWO-STAGE POLYCHORIC CORRELATION ESTIMATES IE Working Pper MK8-06-I 08 / 05 / 2003 Alberto Mydeu Olivres Instituto de Empres Mrketing Dept. C / Mrí de Molin
More informationNon-Linear & Logistic Regression
Non-Liner & Logistic Regression If the sttistics re boring, then you've got the wrong numbers. Edwrd R. Tufte (Sttistics Professor, Yle University) Regression Anlyses When do we use these? PART 1: find
More informationNew Expansion and Infinite Series
Interntionl Mthemticl Forum, Vol. 9, 204, no. 22, 06-073 HIKARI Ltd, www.m-hikri.com http://dx.doi.org/0.2988/imf.204.4502 New Expnsion nd Infinite Series Diyun Zhng College of Computer Nnjing University
More informationThe steps of the hypothesis test
ttisticl Methods I (EXT 7005) Pge 78 Mosquito species Time of dy A B C Mid morning 0.0088 5.4900 5.5000 Mid Afternoon.3400 0.0300 0.8700 Dusk 0.600 5.400 3.000 The Chi squre test sttistic is the sum of
More informationSection 11.5 Estimation of difference of two proportions
ection.5 Estimtion of difference of two proportions As seen in estimtion of difference of two mens for nonnorml popultion bsed on lrge smple sizes, one cn use CLT in the pproximtion of the distribution
More informationChapter 9: Inferences based on Two samples: Confidence intervals and tests of hypotheses
Chpter 9: Inferences bsed on Two smples: Confidence intervls nd tests of hypotheses 9.1 The trget prmeter : difference between two popultion mens : difference between two popultion proportions : rtio of
More information1B40 Practical Skills
B40 Prcticl Skills Comining uncertinties from severl quntities error propgtion We usully encounter situtions where the result of n experiment is given in terms of two (or more) quntities. We then need
More informationP 3 (x) = f(0) + f (0)x + f (0) 2. x 2 + f (0) . In the problem set, you are asked to show, in general, the n th order term is a n = f (n) (0)
1 Tylor polynomils In Section 3.5, we discussed how to pproximte function f(x) round point in terms of its first derivtive f (x) evluted t, tht is using the liner pproximtion f() + f ()(x ). We clled this
More informationMath 426: Probability Final Exam Practice
Mth 46: Probbility Finl Exm Prctice. Computtionl problems 4. Let T k (n) denote the number of prtitions of the set {,..., n} into k nonempty subsets, where k n. Argue tht T k (n) kt k (n ) + T k (n ) by
More informationReview of Calculus, cont d
Jim Lmbers MAT 460 Fll Semester 2009-10 Lecture 3 Notes These notes correspond to Section 1.1 in the text. Review of Clculus, cont d Riemnn Sums nd the Definite Integrl There re mny cses in which some
More informationLecture 21: Order statistics
Lecture : Order sttistics Suppose we hve N mesurements of sclr, x i =, N Tke ll mesurements nd sort them into scending order x x x 3 x N Define the mesured running integrl S N (x) = 0 for x < x = i/n for
More informationStudent Activity 3: Single Factor ANOVA
MATH 40 Student Activity 3: Single Fctor ANOVA Some Bsic Concepts In designed experiment, two or more tretments, or combintions of tretments, is pplied to experimentl units The number of tretments, whether
More informationTests for the Ratio of Two Poisson Rates
Chpter 437 Tests for the Rtio of Two Poisson Rtes Introduction The Poisson probbility lw gives the probbility distribution of the number of events occurring in specified intervl of time or spce. The Poisson
More informationMath 1B, lecture 4: Error bounds for numerical methods
Mth B, lecture 4: Error bounds for numericl methods Nthn Pflueger 4 September 0 Introduction The five numericl methods descried in the previous lecture ll operte by the sme principle: they pproximte the
More informationLecture 19: Continuous Least Squares Approximation
Lecture 19: Continuous Lest Squres Approximtion 33 Continuous lest squres pproximtion We begn 31 with the problem of pproximting some f C[, b] with polynomil p P n t the discrete points x, x 1,, x m for
More informationEstimation on Monotone Partial Functional Linear Regression
A^VÇÚO 1 33 ò 1 4 Ï 217 c 8 Chinese Journl of Applied Probbility nd Sttistics Aug., 217, Vol. 33, No. 4, pp. 433-44 doi: 1.3969/j.issn.11-4268.217.4.8 Estimtion on Monotone Prtil Functionl Liner Regression
More informationA Matrix Algebra Primer
A Mtrix Algebr Primer Mtrices, Vectors nd Sclr Multipliction he mtrix, D, represents dt orgnized into rows nd columns where the rows represent one vrible, e.g. time, nd the columns represent second vrible,
More informationIntroduction to Determinants. Remarks. Remarks. The determinant applies in the case of square matrices
Introduction to Determinnts Remrks The determinnt pplies in the cse of squre mtrices squre mtrix is nonsingulr if nd only if its determinnt not zero, hence the term determinnt Nonsingulr mtrices re sometimes
More informationBest Approximation. Chapter The General Case
Chpter 4 Best Approximtion 4.1 The Generl Cse In the previous chpter, we hve seen how n interpolting polynomil cn be used s n pproximtion to given function. We now wnt to find the best pproximtion to given
More informationNormal Distribution. Lecture 6: More Binomial Distribution. Properties of the Unit Normal Distribution. Unit Normal Distribution
Norml Distribution Lecture 6: More Binomil Distribution If X is rndom vrible with norml distribution with men µ nd vrince σ 2, X N (µ, σ 2, then P(X = x = f (x = 1 e 1 (x µ 2 2 σ 2 σ Sttistics 104 Colin
More informationODE: Existence and Uniqueness of a Solution
Mth 22 Fll 213 Jerry Kzdn ODE: Existence nd Uniqueness of Solution The Fundmentl Theorem of Clculus tells us how to solve the ordinry differentil eqution (ODE) du = f(t) dt with initil condition u() =
More informationCointegration and the joint confirmation hypothesis
Cointegrtion nd the joint confirmtion hypothesis Vsco J. Gbriel,b, * Deprtment of Economics, University of Minho, Gultr, 4710-057, Brog, Portugl b Deprtment of Economics, Birkbeck College, Oxford, UK Abstrct
More informationData Assimilation. Alan O Neill Data Assimilation Research Centre University of Reading
Dt Assimiltion Aln O Neill Dt Assimiltion Reserch Centre University of Reding Contents Motivtion Univrite sclr dt ssimiltion Multivrite vector dt ssimiltion Optiml Interpoltion BLUE 3d-Vritionl Method
More informationConstruction and Selection of Single Sampling Quick Switching Variables System for given Control Limits Involving Minimum Sum of Risks
Construction nd Selection of Single Smpling Quick Switching Vribles System for given Control Limits Involving Minimum Sum of Risks Dr. D. SENHILKUMAR *1 R. GANESAN B. ESHA RAFFIE 1 Associte Professor,
More informationNumerical Integration
Chpter 5 Numericl Integrtion Numericl integrtion is the study of how the numericl vlue of n integrl cn be found. Methods of function pproximtion discussed in Chpter??, i.e., function pproximtion vi the
More informationLecture 14: Quadrature
Lecture 14: Qudrture This lecture is concerned with the evlution of integrls fx)dx 1) over finite intervl [, b] The integrnd fx) is ssumed to be rel-vlues nd smooth The pproximtion of n integrl by numericl
More informationNOTE ON TRACES OF MATRIX PRODUCTS INVOLVING INVERSES OF POSITIVE DEFINITE ONES
Journl of pplied themtics nd Computtionl echnics 208, 7(), 29-36.mcm.pcz.pl p-issn 2299-9965 DOI: 0.752/jmcm.208..03 e-issn 2353-0588 NOE ON RCES OF RIX PRODUCS INVOLVING INVERSES OF POSIIVE DEFINIE ONES
More informationLecture INF4350 October 12008
Biosttistics ti ti Lecture INF4350 October 12008 Anj Bråthen Kristoffersen Biomedicl Reserch Group Deprtment of informtics, UiO Gol Presenttion of dt descriptive tbles nd grphs Sensitivity, specificity,
More informationA NOTE ON ESTIMATION OF THE GLOBAL INTENSITY OF A CYCLIC POISSON PROCESS IN THE PRESENCE OF LINEAR TREND
A NOTE ON ESTIMATION OF THE GLOBAL INTENSITY OF A CYCLIC POISSON PROCESS IN THE PRESENCE OF LINEAR TREND I WAYAN MANGKU Deprtment of Mthemtics, Fculty of Mthemtics nd Nturl Sciences, Bogor Agriculturl
More informationTHERMAL EXPANSION COEFFICIENT OF WATER FOR VOLUMETRIC CALIBRATION
XX IMEKO World Congress Metrology for Green Growth September 9,, Busn, Republic of Kore THERMAL EXPANSION COEFFICIENT OF WATER FOR OLUMETRIC CALIBRATION Nieves Medin Hed of Mss Division, CEM, Spin, mnmedin@mityc.es
More informationPhysics 116C Solution of inhomogeneous ordinary differential equations using Green s functions
Physics 6C Solution of inhomogeneous ordinry differentil equtions using Green s functions Peter Young November 5, 29 Homogeneous Equtions We hve studied, especilly in long HW problem, second order liner
More informationNew Integral Inequalities for n-time Differentiable Functions with Applications for pdfs
Applied Mthemticl Sciences, Vol. 2, 2008, no. 8, 353-362 New Integrl Inequlities for n-time Differentible Functions with Applictions for pdfs Aristides I. Kechriniotis Technologicl Eductionl Institute
More informationSEMIPARAMETRIC INFERENTIAL PROCEDURES FOR COMPARING MULTIVARIATE ROC CURVES WITH INTERACTION TERMS
Sttistic Sinic 19 2009), 1203-1221 SEMIPARAMETRIC INFERENTIAL PROCEDURES FOR COMPARING MULTIVARIATE ROC CURVES WITH INTERACTION TERMS Linsheng Tng 1 nd Xio-Hu Zhou 2,3 1 George Mson University, 2 VA Puget
More informationEstimation of Binomial Distribution in the Light of Future Data
British Journl of Mthemtics & Computer Science 102: 1-7, 2015, Article no.bjmcs.19191 ISSN: 2231-0851 SCIENCEDOMAIN interntionl www.sciencedomin.org Estimtion of Binomil Distribution in the Light of Future
More informationLecture 1. Functional series. Pointwise and uniform convergence.
1 Introduction. Lecture 1. Functionl series. Pointwise nd uniform convergence. In this course we study mongst other things Fourier series. The Fourier series for periodic function f(x) with period 2π is
More informationAQA Further Pure 1. Complex Numbers. Section 1: Introduction to Complex Numbers. The number system
Complex Numbers Section 1: Introduction to Complex Numbers Notes nd Exmples These notes contin subsections on The number system Adding nd subtrcting complex numbers Multiplying complex numbers Complex
More informationChapter 2 Fundamental Concepts
Chpter 2 Fundmentl Concepts This chpter describes the fundmentl concepts in the theory of time series models In prticulr we introduce the concepts of stochstic process, men nd covrince function, sttionry
More information8 Laplace s Method and Local Limit Theorems
8 Lplce s Method nd Locl Limit Theorems 8. Fourier Anlysis in Higher DImensions Most of the theorems of Fourier nlysis tht we hve proved hve nturl generliztions to higher dimensions, nd these cn be proved
More information1 Online Learning and Regret Minimization
2.997 Decision-Mking in Lrge-Scle Systems My 10 MIT, Spring 2004 Hndout #29 Lecture Note 24 1 Online Lerning nd Regret Minimiztion In this lecture, we consider the problem of sequentil decision mking in
More informationRecitation 3: More Applications of the Derivative
Mth 1c TA: Pdric Brtlett Recittion 3: More Applictions of the Derivtive Week 3 Cltech 2012 1 Rndom Question Question 1 A grph consists of the following: A set V of vertices. A set E of edges where ech
More informationNonparametric Methods for Unbalanced Multivariate Data and Many Factor Levels
onprmetric Methods for Unblnced Multivrite Dt nd Mny Fctor evels Solomon W. Hrrr nd rne C. Bthke bstrct We propose different nonprmetric tests for multivrite dt nd derive their symptotic distribution for
More informationBest Approximation in the 2-norm
Jim Lmbers MAT 77 Fll Semester 1-11 Lecture 1 Notes These notes correspond to Sections 9. nd 9.3 in the text. Best Approximtion in the -norm Suppose tht we wish to obtin function f n (x) tht is liner combintion
More informationThe Shortest Confidence Interval for the Mean of a Normal Distribution
Interntionl Journl of Sttistics nd Proility; Vol. 7, No. 2; Mrch 208 ISSN 927-7032 E-ISSN 927-7040 Pulished y Cndin Center of Science nd Eduction The Shortest Confidence Intervl for the Men of Norml Distriution
More informationMonte Carlo method in solving numerical integration and differential equation
Monte Crlo method in solving numericl integrtion nd differentil eqution Ye Jin Chemistry Deprtment Duke University yj66@duke.edu Abstrct: Monte Crlo method is commonly used in rel physics problem. The
More informationChapter 5 : Continuous Random Variables
STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 216 Néhémy Lim Chpter 5 : Continuous Rndom Vribles Nottions. N {, 1, 2,...}, set of nturl numbers (i.e. ll nonnegtive integers); N {1, 2,...}, set of ll
More informationProbability Distributions for Gradient Directions in Uncertain 3D Scalar Fields
Technicl Report 7.8. Technische Universität München Probbility Distributions for Grdient Directions in Uncertin 3D Sclr Fields Tobis Pfffelmoser, Mihel Mihi, nd Rüdiger Westermnn Computer Grphics nd Visuliztion
More informationDriving Cycle Construction of City Road for Hybrid Bus Based on Markov Process Deng Pan1, a, Fengchun Sun1,b*, Hongwen He1, c, Jiankun Peng1, d
Interntionl Industril Informtics nd Computer Engineering Conference (IIICEC 15) Driving Cycle Construction of City Rod for Hybrid Bus Bsed on Mrkov Process Deng Pn1,, Fengchun Sun1,b*, Hongwen He1, c,
More informationComparison Procedures
Comprison Procedures Single Fctor, Between-Subects Cse /8/ Comprison Procedures, One-Fctor ANOVA, Between Subects Two Comprison Strtegies post hoc (fter-the-fct) pproch You re interested in discovering
More informationthan 1. It means in particular that the function is decreasing and approaching the x-
6 Preclculus Review Grph the functions ) (/) ) log y = b y = Solution () The function y = is n eponentil function with bse smller thn It mens in prticulr tht the function is decresing nd pproching the
More informationAcceptance Sampling by Attributes
Introduction Acceptnce Smpling by Attributes Acceptnce smpling is concerned with inspection nd decision mking regrding products. Three spects of smpling re importnt: o Involves rndom smpling of n entire
More informationMATH34032: Green s Functions, Integral Equations and the Calculus of Variations 1
MATH34032: Green s Functions, Integrl Equtions nd the Clculus of Vritions 1 Section 1 Function spces nd opertors Here we gives some brief detils nd definitions, prticulrly relting to opertors. For further
More informationChapter 3. Vector Spaces
3.4 Liner Trnsformtions 1 Chpter 3. Vector Spces 3.4 Liner Trnsformtions Note. We hve lredy studied liner trnsformtions from R n into R m. Now we look t liner trnsformtions from one generl vector spce
More informationMultivariate problems and matrix algebra
University of Ferrr Stefno Bonnini Multivrite problems nd mtrix lgebr Multivrite problems Multivrite sttisticl nlysis dels with dt contining observtions on two or more chrcteristics (vribles) ech mesured
More informationMathematics notation and review
Appendix A Mthemtics nottion nd review This ppendix gives brief coverge of the mthemticl nottion nd concepts tht you ll encounter in this book. In the spce of few pges it is of course impossible to do
More informationPredict Global Earth Temperature using Linier Regression
Predict Globl Erth Temperture using Linier Regression Edwin Swndi Sijbt (23516012) Progrm Studi Mgister Informtik Sekolh Teknik Elektro dn Informtik ITB Jl. Gnesh 10 Bndung 40132, Indonesi 23516012@std.stei.itb.c.id
More informationThe First Fundamental Theorem of Calculus. If f(x) is continuous on [a, b] and F (x) is any antiderivative. f(x) dx = F (b) F (a).
The Fundmentl Theorems of Clculus Mth 4, Section 0, Spring 009 We now know enough bout definite integrls to give precise formultions of the Fundmentl Theorems of Clculus. We will lso look t some bsic emples
More informationA SHORT NOTE ON THE MONOTONICITY OF THE ERLANG C FORMULA IN THE HALFIN-WHITT REGIME. Bernardo D Auria 1
Working Pper 11-42 (31) Sttistics nd Econometrics Series December, 2011 Deprtmento de Estdístic Universidd Crlos III de Mdrid Clle Mdrid, 126 28903 Getfe (Spin) Fx (34) 91 624-98-49 A SHORT NOTE ON THE
More informationFor the percentage of full time students at RCC the symbols would be:
Mth 17/171 Chpter 7- ypothesis Testing with One Smple This chpter is s simple s the previous one, except it is more interesting In this chpter we will test clims concerning the sme prmeters tht we worked
More informationContinuous Random Variables
STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 217 Néhémy Lim Continuous Rndom Vribles Nottion. The indictor function of set S is rel-vlued function defined by : { 1 if x S 1 S (x) if x S Suppose tht
More information2008 Mathematical Methods (CAS) GA 3: Examination 2
Mthemticl Methods (CAS) GA : Exmintion GENERAL COMMENTS There were 406 students who st the Mthemticl Methods (CAS) exmintion in. Mrks rnged from to 79 out of possible score of 80. Student responses showed
More informationThe Algebra (al-jabr) of Matrices
Section : Mtri lgebr nd Clculus Wshkewicz College of Engineering he lgebr (l-jbr) of Mtrices lgebr s brnch of mthemtics is much broder thn elementry lgebr ll of us studied in our high school dys. In sense
More informationStein-Rule Estimation and Generalized Shrinkage Methods for Forecasting Using Many Predictors
Stein-Rule Estimtion nd Generlized Shrinkge Methods for Forecsting Using Mny Predictors Eric Hillebrnd CREATES Arhus University, Denmrk ehillebrnd@cretes.u.dk Te-Hwy Lee University of Cliforni, Riverside
More informationLecture 3 Gaussian Probability Distribution
Introduction Lecture 3 Gussin Probbility Distribution Gussin probbility distribution is perhps the most used distribution in ll of science. lso clled bell shped curve or norml distribution Unlike the binomil
More informationWeek 10: Line Integrals
Week 10: Line Integrls Introduction In this finl week we return to prmetrised curves nd consider integrtion long such curves. We lredy sw this in Week 2 when we integrted long curve to find its length.
More informationTHE EXISTENCE OF NEGATIVE MCMENTS OF CONTINUOUS DISTRIBUTIONS WALTER W. PIEGORSCH AND GEORGE CASELLA. Biometrics Unit, Cornell University, Ithaca, NY
THE EXISTENCE OF NEGATIVE MCMENTS OF CONTINUOUS DISTRIBUTIONS WALTER W. PIEGORSCH AND GEORGE CASELLA. Biometrics Unit, Cornell University, Ithc, NY 14853 BU-771-M * December 1982 Abstrct The question of
More informationApplicable Analysis and Discrete Mathematics available online at
Applicble Anlysis nd Discrete Mthemtics vilble online t http://pefmth.etf.rs Appl. Anl. Discrete Mth. 4 (2010), 23 31. doi:10.2298/aadm100201012k NUMERICAL ANALYSIS MEETS NUMBER THEORY: USING ROOTFINDING
More informationMAC-solutions of the nonexistent solutions of mathematical physics
Proceedings of the 4th WSEAS Interntionl Conference on Finite Differences - Finite Elements - Finite Volumes - Boundry Elements MAC-solutions of the nonexistent solutions of mthemticl physics IGO NEYGEBAUE
More informationSection 14.3 Arc Length and Curvature
Section 4.3 Arc Length nd Curvture Clculus on Curves in Spce In this section, we ly the foundtions for describing the movement of n object in spce.. Vector Function Bsics In Clc, formul for rc length in
More informationReversals of Signal-Posterior Monotonicity for Any Bounded Prior
Reversls of Signl-Posterior Monotonicity for Any Bounded Prior Christopher P. Chmbers Pul J. Hely Abstrct Pul Milgrom (The Bell Journl of Economics, 12(2): 380 391) showed tht if the strict monotone likelihood
More informationRiemann Sums and Riemann Integrals
Riemnn Sums nd Riemnn Integrls Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University August 26, 2013 Outline 1 Riemnn Sums 2 Riemnn Integrls 3 Properties
More informationBootstrap Inference in a Linear Equation Estimated by Instrumental Variables
Bootstrp Inference in Liner Eqution Estimted by Instrumentl Vribles GREQAM Centre de l Vieille Chrité 2 rue de l Chrité 13236 Mrseille cedex 02, Frnce Russell Dvidson emil: RussellDvidson@mcgillc nd Jmes
More informationNUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by.
NUMERICAL INTEGRATION 1 Introduction The inverse process to differentition in clculus is integrtion. Mthemticlly, integrtion is represented by f(x) dx which stnds for the integrl of the function f(x) with
More informationTHE UNIVERSITY OF CHICAGO Booth School of Business Business 41914, Spring Quarter 2015, Mr. Ruey S. Tsay
THE UNIVERSITY OF CHICAGO Booth School of Business Business 494, Spring Qurter 05, Mr. Ruey S. Tsy Reference: Chpter of the textbook. Introduction Lecture 3: Vector Autoregressive (VAR) Models Vector utoregressive
More informationRiemann Sums and Riemann Integrals
Riemnn Sums nd Riemnn Integrls Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University August 26, 203 Outline Riemnn Sums Riemnn Integrls Properties Abstrct
More informationODE: Existence and Uniqueness of a Solution
Mth 22 Fll 213 Jerry Kzdn ODE: Existence nd Uniqueness of Solution The Fundmentl Theorem of Clculus tells us how to solve the ordinry dierentil eqution (ODE) du f(t) dt with initil condition u() : Just
More informationImproper Integrals, and Differential Equations
Improper Integrls, nd Differentil Equtions October 22, 204 5.3 Improper Integrls Previously, we discussed how integrls correspond to res. More specificlly, we sid tht for function f(x), the region creted
More informationLecture 3. In this lecture, we will discuss algorithms for solving systems of linear equations.
Lecture 3 3 Solving liner equtions In this lecture we will discuss lgorithms for solving systems of liner equtions Multiplictive identity Let us restrict ourselves to considering squre mtrices since one
More informationMatrices, Moments and Quadrature, cont d
Jim Lmbers MAT 285 Summer Session 2015-16 Lecture 2 Notes Mtrices, Moments nd Qudrture, cont d We hve described how Jcobi mtrices cn be used to compute nodes nd weights for Gussin qudrture rules for generl
More information14.4. Lengths of curves and surfaces of revolution. Introduction. Prerequisites. Learning Outcomes
Lengths of curves nd surfces of revolution 4.4 Introduction Integrtion cn be used to find the length of curve nd the re of the surfce generted when curve is rotted round n xis. In this section we stte
More informationCzechoslovak Mathematical Journal, 55 (130) (2005), , Abbotsford. 1. Introduction
Czechoslovk Mthemticl Journl, 55 (130) (2005), 933 940 ESTIMATES OF THE REMAINDER IN TAYLOR S THEOREM USING THE HENSTOCK-KURZWEIL INTEGRAL, Abbotsford (Received Jnury 22, 2003) Abstrct. When rel-vlued
More informationECON 331 Lecture Notes: Ch 4 and Ch 5
Mtrix Algebr ECON 33 Lecture Notes: Ch 4 nd Ch 5. Gives us shorthnd wy of writing lrge system of equtions.. Allows us to test for the existnce of solutions to simultneous systems. 3. Allows us to solve
More informationAbstract inner product spaces
WEEK 4 Abstrct inner product spces Definition An inner product spce is vector spce V over the rel field R equipped with rule for multiplying vectors, such tht the product of two vectors is sclr, nd the
More informationLecture Note 9: Orthogonal Reduction
MATH : Computtionl Methods of Liner Algebr 1 The Row Echelon Form Lecture Note 9: Orthogonl Reduction Our trget is to solve the norml eution: Xinyi Zeng Deprtment of Mthemticl Sciences, UTEP A t Ax = A
More informationChapter 14. Matrix Representations of Linear Transformations
Chpter 4 Mtrix Representtions of Liner Trnsformtions When considering the Het Stte Evolution, we found tht we could describe this process using multipliction by mtrix. This ws nice becuse computers cn
More informationChapter 3 MATRIX. In this chapter: 3.1 MATRIX NOTATION AND TERMINOLOGY
Chpter 3 MTRIX In this chpter: Definition nd terms Specil Mtrices Mtrix Opertion: Trnspose, Equlity, Sum, Difference, Sclr Multipliction, Mtrix Multipliction, Determinnt, Inverse ppliction of Mtrix in
More informationA signalling model of school grades: centralized versus decentralized examinations
A signlling model of school grdes: centrlized versus decentrlized exmintions Mri De Pol nd Vincenzo Scopp Diprtimento di Economi e Sttistic, Università dell Clbri m.depol@unicl.it; v.scopp@unicl.it 1 The
More informationEuler, Ioachimescu and the trapezium rule. G.J.O. Jameson (Math. Gazette 96 (2012), )
Euler, Iochimescu nd the trpezium rule G.J.O. Jmeson (Mth. Gzette 96 (0), 36 4) The following results were estblished in recent Gzette rticle [, Theorems, 3, 4]. Given > 0 nd 0 < s
More informationDiscrete Least-squares Approximations
Discrete Lest-squres Approximtions Given set of dt points (x, y ), (x, y ),, (x m, y m ), norml nd useful prctice in mny pplictions in sttistics, engineering nd other pplied sciences is to construct curve
More information7.2 The Definite Integral
7.2 The Definite Integrl the definite integrl In the previous section, it ws found tht if function f is continuous nd nonnegtive, then the re under the grph of f on [, b] is given by F (b) F (), where
More informationConfidence Intervals for Predicting Lumber Strength Properties Based on Ratios of Percentiles From Two Weibull Populations
United Sttes Deprtment of Agriculture Forest Service Forest Products Lbortory Reserch Pper FPL RP 606 Confidence Intervls for Predicting Lumber Strength Properties Bsed on Rtios of Percentiles From Two
More informationOverview of Calculus I
Overview of Clculus I Prof. Jim Swift Northern Arizon University There re three key concepts in clculus: The limit, the derivtive, nd the integrl. You need to understnd the definitions of these three things,
More informationTerminal Velocity and Raindrop Growth
Terminl Velocity nd Rindrop Growth Terminl velocity for rindrop represents blnce in which weight mss times grvity is equl to drg force. F 3 π3 ρ L g in which is drop rdius, g is grvittionl ccelertion,
More informationIntroduction to Group Theory
Introduction to Group Theory Let G be n rbitrry set of elements, typiclly denoted s, b, c,, tht is, let G = {, b, c, }. A binry opertion in G is rule tht ssocites with ech ordered pir (,b) of elements
More informationQuadratic Forms. Quadratic Forms
Qudrtic Forms Recll the Simon & Blume excerpt from n erlier lecture which sid tht the min tsk of clculus is to pproximte nonliner functions with liner functions. It s ctully more ccurte to sy tht we pproximte
More informationNumerical integration
2 Numericl integrtion This is pge i Printer: Opque this 2. Introduction Numericl integrtion is problem tht is prt of mny problems in the economics nd econometrics literture. The orgniztion of this chpter
More informationg i fφdx dx = x i i=1 is a Hilbert space. We shall, henceforth, abuse notation and write g i f(x) = f
1. Appliction of functionl nlysis to PEs 1.1. Introduction. In this section we give little introduction to prtil differentil equtions. In prticulr we consider the problem u(x) = f(x) x, u(x) = x (1) where
More informationCHAPTER 4a. ROOTS OF EQUATIONS
CHAPTER 4. ROOTS OF EQUATIONS A. J. Clrk School o Engineering Deprtment o Civil nd Environmentl Engineering by Dr. Ibrhim A. Asskk Spring 00 ENCE 03 - Computtion Methods in Civil Engineering II Deprtment
More informationUniversity of Texas MD Anderson Cancer Center Department of Biostatistics. Inequality Calculator, Version 3.0 November 25, 2013 User s Guide
University of Texs MD Anderson Cncer Center Deprtment of Biosttistics Inequlity Clcultor, Version 3.0 November 5, 013 User s Guide 0. Overview The purpose of the softwre is to clculte the probbility tht
More informationSpanning tree congestion of some product graphs
Spnning tree congestion of some product grphs Hiu-Fi Lw Mthemticl Institute Oxford University 4-9 St Giles Oxford, OX1 3LB, United Kingdom e-mil: lwh@mths.ox.c.uk nd Mikhil I. Ostrovskii Deprtment of Mthemtics
More information