Topic 4. Orthogonal contrasts [ST&D p. 183]

Size: px
Start display at page:

Download "Topic 4. Orthogonal contrasts [ST&D p. 183]"

Transcription

1 4.1 Topc 4. Orthogonal contrasts [ST&D p. 183] ANOVA s a useful and powerful tool to copare several treatent eans. In coparng t treatents, the null hypothess tested s that the t true eans are all equal (H 0 : µ 1 = µ 2 =... = µ t ). If the F test s sgnfcant, one accepts the alternatve hypothess, whch erely states that they are not all equal (.e. at least one ean s dfferent). Snce the test does not tell you whch ean(s) s/are dfferent, the nforaton provded by ths ntal F test s lted. Further coparsons to deterne whch specfc treatent eans are dfferent can be carred out by further parttonng the treatent su of squares (SST) to provde addtonal F tests to answer planned questons. The orthogonal contrast approach to ean separaton s descrbed as planned F tests. These tests are planned n the sense that the questons of nterest are decded upon before lookng at the data. In fact, the questons of nterest dctate the treatent structure fro the very begnnng of the experent. Wth planned tests, therefore, there s a pror knowledge, based ether on bologcal consderatons or on the results of prelnary nvestgatons, as to whch coparsons are ost portant to ake. Sad another way, f the nvestgator has specfc questons to be answered, treatents are chosen (.e. a treatent structure s desgned) to provde nforaton and statstcal tests to answer those specfc questons. An experenced nvestgator wll select treatents so that the treatent su of squares (SST) can be parttoned perfectly to answer as any ndependent (.e. orthogonal) questons as there are degrees of freedo for treatents n the ANOVA. Consequently, another nae of these tests s sngle degree of freedo tests Defntons of contrast and orthogonalty [ST&D p. 183] "Contrast" s atheatcal jargon for a lnear cobnaton of ters (a polynoal) whose coeffcents su to zero. In ANOVA, "contrast" assues a ore lted defnton: A contrast (Q) s a lnear cobnaton of two or ore factor level eans whose coeffcents su to zero: Q 1 c Y, wth the constrant that c 0 As an exaple, consder a coparson of two eans, the splest contrast: 1 2 Ths s the sae as 0, where c 1, c 1, and c c It s essental that the su of the coeffcents for each coparson s zero. The ters are the treatent eans (t can also be the treatent sus), and t, s Y.

2 4.2 the nuber of treatents beng copared. For convenence, the c s are usually ntegers. A contrast always has a sngle degree of freedo. Orthogonal: Now consder two contrasts Suppose Qc cy.; and Qd d Y These two contrasts are sad to be orthogonal to one another f the su of the products of any par of correspondng coeffcents s zero. 1 c d 0 ( or 1 c d / n 0 for unbalanced desgns) So, orthogonalty s a property of a set of two contrasts. A set of ore than two contrasts s sad to be orthogonal only f each and every par wthn the set exhbts par-wse orthogonalty, as defned above. To declare a set of four contrasts (Q 1 Q 4 ) to be orthogonal, therefore, one ust show that each of the sx possble pars are orthogonal: (Q 1 and Q 2, Q 1 and Q 3, Q 1 and Q 4, Q 2 and Q 3, Q 2 and Q 4, Q 3 and Q 4 ). Why do we care? Reeber n our dscusson of CRDs that the total SS could be perfectly parttoned nto two parts: The treatent SS and the error SS: TSS = SST + SSE Ths perfect parttonng s possble due to the fact that, atheatcally, SST and SSE are orthogonal to one another. In an analogous way, orthogonal contrasts allow us to partton SST (.e. decopose the relatvely unnforatve H 0 of the ANOVA) nto a axu of (t - 1) eanngful and targeted coparsons nvolvng dfferent cobnatons of eans. Suppose a set of (t 1) contrasts s orthogonal. If the SS for each contrast are added together, ther su wll exactly equal the SST for the orgnal experent. Ths eans that an experent can be parttoned nto (t 1) separate, ndependent experents, one for each contrast. Exaple Suppose we are testng three treatents, T1, T2 and T3 (control) wth treatent eans 1, 2, and 3 (two d.f.). The null hypothess for the ANOVA s H 0 : 1 = 2 = 3 whch uses both degrees of freedo n one test (df t = t-1 = 2). Snce there are two degrees of freedo for treatents, there are n prncple two ndependent coparsons that can be ade.

3 4.3 For exaple, one could n prncple test the two hypotheses that 1 and 2 are not sgnfcantly dfferent fro the control: 1 = 3 and 2 = 3. As usual, we represent the eans wth ther estates Y = 3 can be rewrtten as = 0 the coeffcents of ths contrast are: c 1 = 1, c 2 = 0, c 3 = = 3 can be rewrtten as = 0 the coeffcents of ths contrast are: d 1 = 0, d 2 = 1, d 3 = -1 These lnear cobnatons of eans are contrast because 1 c 0 ( (-1) = 0); and d 0 ( (-1) = 0). 1 However these contrasts are not orthogonal because: 1 c d 0 (c 1 d 1 + c 2 d 2 + c 3 d 3 = = 1). So, not every par of hypotheses can be tested usng ths approach. In addton to sung to 0, the c coeffcents are alost always taken to be ntegers, a constrant whch severely restrcts ther possble values. For t = 3 such a set of values are 1) c 1 = 1, c 2 = 1, c 3 = -2; 2) d 1 = 1, d 2 = -1, d 3 = 0. These are contrasts snce ( (-2) = 0 and 1+ (-1) + 0= 0) and are orthogonal because (c 1 d 1 + c 2 d 2 + c 3 d 3 = 1 + (-1) + 0 = 0). Just as not all sets of hypotheses can be asked usng orthogonal contrasts, not all sets of orthogonal contrasts correspond to eanngful (or nterestng) hypotheses. In ths exaple, the contrasts are, n fact, nterestng. The hypotheses they defne are: 1) The average of the two treatents s equal to the control (.e. s there a sgnfcant average treatent effect?); and 2) The two treatents are equal to one another (.e. s one treatent sgnfcantly dfferent fro the other?).

4 4.4 There are two general knds of lnear cobnatons: Class coparsons Trend coparsons Class coparsons The frst category of hypothess we can pose usng orthogonal contrasts s class (or group) coparsons. Such contrasts copare specfc treatent eans or cobnatons of treatent eans, grouped s soe eanngful way. The procedure s llustrated by an exaple on page 185 of ST&D, whch nvolves the nt data dscussed n Topc 3. To llustrate orthogonal contrasts n class coparsons we wll use the data gven n Table 4.1. The analyss of varance for ths experent s gven n Tables 4.2. Table 4.1. Results (g shoot dry weght) of an experent (CRD) to deterne the effect of seed treatent by acds on the early growth of rce seedlngs. Treatent Replcatons Total Mean Y. Y. Control o HC Proponc Butyrc Overall Table 4.2. ANOVA of data n Table 4.1 (t = 4, r = 5) Y.. = Y.. = 3.86 Source of Su of Varaton df Squares Total Mean Squares F Treatent Error The treatent structure of ths experent suggests that the nvestgator had several specfc questons n nd fro the begnnng: 1) Do acd treatents affect seedlng growth? 2) Is the effect of =organc acds dfferent fro that of norganc acds? 3) Is there a dfference n the effects of the two dfferent organc acds?

5 4.5 These are planned questons and so are approprate canddates for posng va orthogonal contrasts. To do ths, we ust restate these questons atheatcally, as lnear cobnatons of treatents. In the followng table (Table 4.3), coeffcents are shown that translate these three planned questons nto contrasts. Table 4.3. Orthogonal coeffcents for parttonng the SST of Table 4.2. nto 3 ndependent tests. Control HC1 Proponc Butyrc Control vs. acd Inorganc vs. organc Between organcs Totals Coparsons Means The 1 st contrast (frst row) copares the control group to the average of the three acd-treated groups, as can be seen fro the followng anpulatons: 3μ Cont - 1μ HCl - 1μ Prop - 1μ But = 0 μ Cont = (1/3)*(1μ HCl + 1μ Prop + 1μ But ) Mean of the control group = Mean of all acd-treated groups The H 0 for ths 1 st contrast s that there s no average effect of acd treatent on seedlng growth. Snce ths H o nvolves only two group eans, t costs 1 df. The 2 nd contrast (second row) copares the norganc acd group to the average of the two organc acd groups: 0μ Cont + 2μ HCl - 1μ Prop - 1μ But = 0 μ HCl = (1/2)*(1μ Prop + 1μ But ) Mean of the HCl group = Mean of all organc acd-treated groups The H 0 for ths second contrast s that the effect of the norganc acd treatent on seedlng growth s no dfferent fro the average effect of organc acd treatent. Snce ths null hypothess nvolves only two group eans (eans than before), t also costs 1 df. Fnally, the thrd contrast (thrd row of coeffcents) copares the two organc acd groups to each other: 0μ Cont + 0μ HCl + 1μ Prop - 1μ But = 0 1μ Prop = 1μ But

6 4.6 The H 0 for ths thrd contrast s that the effect of the proponc acd treatent on seedlng growth s no dfferent fro the effect of butyrc acd treatent. Snce ths null hypothess nvolves only two group eans (dfferent eans than before), t also costs 1 df. At ths pont, we have spent all our avalable degrees of freedo (df trt = t 1 = 4 1 = 3). Because each of these questons are contrasts (each row of coeffcents sus to zero) and because the set of three questons s orthogonal (verfy ths for yourself), these three queston perfectly partton SST nto three coponents, each wth 1 df. The SS assocated wth each of these contrasts serve as the nuerators for three separate F tests, one for each coparson. The crtcal F values for these sngle df tests are based on 1 df n the nuerator and df Error n the denonator. All of ths can be seen n the expanded ANOVA table below. Table 4.4 Orthogonal parttonng of SST va contrasts. Source df SS MS F Total Treatent Control vs. acd Inorg. vs. Org Between Org Error Notce that SST = SS Contrast1 + SS Contrast2 + SS Contrast3. Ths perfect parttonng of SST aong ts degrees of freedo s a drect consequence of the orthogonalty of the posed contrasts. When coparsons are not orthogonal, the SS for one coparson ay contan (or be contaned by) part of the SS of another coparson. Therefore, the concluson fro one test ay be nfluenced (or contanated) by another test and the SS of those ndvdual coparsons wll not su to SST. Coputaton: The coputaton of the su of squares for a sngle degree of freedo F test for lnear cobnatons of treatent eans s ( ( 2 cy.) SS ( Q) MS( Q) 2 c / r ) 2 ( cy.) Ths expresson splfes to n balanced desgns (all r's equal) 2 ( c ) / r SS 1 (control vs. acd) = [3(4.19) ] 2 / [(12)/5] = 0.74 SS 2 (norg. vs. org.) = [ (3.87)] 2 / [(6)/5] = 0.11 SS 3 (between org.) = [ ] 2 / [(2)/5] = 0.02

7 4.7 Note: ST&D forulas for contrasts (p. 184) are for treatent totals nstead of treatent eans. The treatents eans forula s requred for unbalanced desgns. Fro ths analyss, we conclude that n ths experent acds sgnfcantly reduce seedlng growth (F = 86.22, p < 0.01), that the organc acds cause sgnfcantly ore reducton than the norganc acd (F = 13.13, p < 0.01), and that the dfference between the organc acds s not sgnfcant (F = 2.26, p > 0.05). Constructon of coeffcents for class coparsons (Lttle & Hlls p 66). Contrast coeffcents for a class coparson can always be deterned by wrtng the null hypothess n atheatcal for, ovng all ters to the sae sde of the equaton, and ultplyng by whatever factor s needed to turn the coeffcents nto ntegers. Ths s a general strategy. What follows are ore recpe-lke, step-bystep operatons to arrve at the sae results: 1. When the two groups of eans beng copared each contan the sae nuber of treatents assgn +1 to the ebers of one group and -1 to the ebers of the other. Thus for lne 3 n Table 4.3, we are coparng two eans, and assgn coeffcents of 1 (of opposte sgn) to each. The sae procedure extends to the case of ore than one treatent per group. 2. When coparng groups contanng dfferent nubers of treatents, assgn to the frst group coeffcents equal to the nuber of treatents n the second group; to the second group, assgn coeffcents of opposte sgn, equal to the nuber of treatents n the frst group. Thus, f aong 5 treatents, the frst two are to be copared to the last three, the coeffcents would be +3, +3, -2, -2, -2. In Table 4.3, where the control ean s copared wth the ean of the three acds, we assgn a 3 to the control and a 1 to each of the three acds. Opposte sgns are then assgned to the two groups. It s ateral as to whch group gets the postve or negatve sgn snce t s the su of squares of the coparson that s used n the F-test. 3. The coeffcents for any coparson should be reduced to the sallest possble ntegers for each calculaton. Thus, +4, +4, -2, -2, -2, -2, should be reduced to +2, +2, -1, -1, -1, The coeffcents for an nteracton coparson are deterned by sply ultplyng the correspondng coeffcents of the two underlyng an coparsons. See next exaple (Table 4.5).

8 4.8 Exaple: Fertlzer experent desgned as a CRD wth four treatents. The four treatents result fro all possble cobnatons of two levels of both ntrogen (N 0 = 0 N, N 1 = 100 lbs N/ac) and phosphorus (P 0 = 0 P, P 1 = 20 lbs P/ac). The questons ntended by ths treatent structure are: 1. Is there an effect of N on yeld? 2. Is there an effect of P on yeld? 3. Is there an nteracton between N and P on yeld? Equvalent ways of statng the nteracton queston: a) Is the effect of N the sae n the presence of P as t s n the absence of P? b) Is the effect of P the sae n the presence of N as t s n the absence of N?) The followng table (Table 4.5) presents the contrast coeffcents for these planned questons. Table 4.5. Fertlzer experent wth 4 treatents, 2 levels of N and 2 of P. N 0 P 0 N 0 P 1 N 1 P 0 N 1 P 1 Between N Between P Interacton (NxP) The coeffcents for the 1 st two coparsons are derved by rule 1. The nteracton coeffcents are the result of ultplyng the coeffcents of the frst two lnes. Note that the su of the coeffcents of each coparson s 0 and that the su of the cross products of any two coparsons s also 0. When these 2 condtons are et, the coparsons are sad to be orthogonal. Ths ples that the concluson drawn for one coparson s ndependent of (not nfluenced by) the others Trend coparsons Experents are often desgned to characterze the effect of ncreasng levels of a factor (e.g. ncreents of a fertlzer, plantng dates, doses of a checal, concentratons of a feed addtve, etc.) on soe response varable (e.g. yeld, dsease severty, growth, etc.). In these stuatons, the experenter s nterested n the dose response relatonshp. Such an analyss s concerned wth overall trends and not wth parwse coparsons. The splest exaple nvolves a sngle factor wth three levels. Ths s very coon stuaton n genetc experents, where the levels are: 0 dose of allele A n hoozygous BB ndvduals

9 4.9 1 dose of allele A n heterozygous AB ndvduals 2 doses of allele A n hoozygous AA ndvduals. Wth the use of olecular arkers t s now easy to score the genotype of the ndvduals of a segregatng populaton and classfy the nto one of these three groups (AA, AB, BB). These ndvduals are also phenotyped for the trat of nterest. Suppose 40 segregatng F 2 ndvduals genotyped for a certan olecular known to be lnked to a gene affectng N translocaton to the gran. The Ntrogen content of the seed s easured n the sae 40 ndvduals. Table 4.6. Genetc exaple of orthogonal contrasts. Ntrogen content (g) of seeds of three dfferent genotypes. Genotype (BB) Genotype (AB) Genotype (AA) 0 doses, A allele 1 dose, A allele 2 doses, A allele Unequal replcaton s coon n genetc experent due to segregaton ratos. In F 2 populatons, the expected rato of hoozygous to heterozygous ndvduals s 1:2:1, whch s what we see n the dataset above. Each ndvdual s an ndependent replcaton of ts respectve genotype; so there are fve replcatons of genotype BB, ten replcatons of genotype AB, and fve replcatons of genotype AA n ths experent. The "treatent" s dosage of the A allele, and the response varable s seed ntrogen content. Wth three levels of dosage, the ost coplcated response the data can reveal s a quadratc relatonshp between dosage (D) and N content: N = ad 2 + bd + c Ths quadratc relatonshp s coprsed of two coponents: A lnear coponent (slope b), and a quadratc coponent (curvature a). It just so happens that, wth 2 treatent degrees of freedo (df trt = t 1 = 3 1 = 2), we can construct orthogonal contrasts to probe each of these coponents. To test the hypothess that b = 0 (.e. there s 0 slope n the overall dosage response relatonshp), we choose H 0 : μ BB = μ AA. If the eans of the two extree dosages are equal, b = 0. As a contrast, ths H 0 takes the for: 1μ BB + 0μ AB - 1μ AA = 0.

10 4.10 To test the hypothess that a = 0 (.e. there s zero curvature n the overall dosage response relatonshp), we choose H 0 : μ AB = (1/2)*(μ AA + μ BB ). Because the dosage levels are equally spaced (0, 1, 2), a perfectly lnear relatonshp (.e. zero curvature) would requre that the average of the extree dosage levels [(1/2)*(μ AA + μ BB )] exactly equal the ean of the heterozygous group (μ AB ). As a contrast, ths H 0 takes the for: 1μ BB - 2μ AB + 1μ AA = 0. A quck nspecton shows each of these polynoals to be contrasts (.e. ther coeffcents su to zero) as well as orthogonal to each other (1*1 + 0*(-2) + (-1)*1 = 0). Constructng F tests for these contrasts follows the exact sae procedure we saw above n the case of class coparsons. So ths te, let's use SAS: SAS progra: Data GeneDose; Input Genotype $ N; Cards; BB 12.0 BB 12.5 BB 12.1 BB 11.8 BB 12.6 AB 13.5 AB 13.8 AB 13.0 AB 13.2 AB 13.0 AB 12.8 AB 12.9 AB 13.4 AB 12.7 AB 13.6 AA 13.8 AA 14.5 AA 13.9 AA 14.2 AA 14.1 ; Proc GLM Order = Data; Class Genotype; Model N = Genotype; Contrast 'Lnear' Genotype 1 0-1; Contrast 'Quadratc' Genotype 1-2 1; Run; Qut;

11 4.11 The resultant ANOVA table: Source df SS MS F p Total Model < Error R-Square: Contrast df SS MS F p Lnear < Quadratc The fact that the contrast SS su perfectly to the SST s a verfcaton of ther orthogonalty. The sgnfcant lnear contrast (p < ) leads us to the reject ts H 0. There does appear to be a sgnfcant, nonzero lnear coponent to the response. The non-sgnfcant quadratc contrast (p = ), however, leads us not to reject ts H 0. Snce the quadratc contrast s not sgnfcant we do not reject the hypothess of a lnear response. Fro the boxplot graph, there does not appear to be a quadratc coponent to the response (the ddle ean s algned wth the lne between the extree eans): μ 1 - μ 2 We would conclude fro all ths that the dosage response of ntrogen seed content to the presence of allele A s lnear. Before we ove on, notce that when there s no sgnfcant quadratc response, the F value of the lnear response (77.14, crtcal value F 2,17 = 3.59) s twce as large as the Model F value (38.50, crtcal value F 1,17 = 4.45). The reason for ths: In the lnear contrast, MS = SS/1, whle n the coplete Model, MS = SS/2 (.e. the full SST s dvded n half and arbtrarly assgned equally to both effects). When a quanttatve factor exhbtng a sgnfcant lnear dose response s easured at several levels, t s possble to have a non-sgnfcant overall treatent F test but a sgnfcant lnear response. Ths s because the overall treatent F test dvdes the full SST equally across any effects, ost of whch are non-sgnfcant. Ths obscures the sgnfcance of the true lnear effect. In such cases, contrasts sgnfcantly ncrease the power of the test.

12 4.12 Here s a slar dataset, but now the response varable s days to flowerng (DTF). Table 4.7 Days to flowerng (DTF) of seeds of three dfferent genotypes. Genotype (BB) Genotype (AB) Genotype (AA) 0 doses, A allele 1 dose, A allele 2 doses, A allele The SAS codng s dentcal n ths case. The resultant ANOVA table: Source df SS MS F p Total Model < Error R-Square: Contrast df SS MS F p Lnear < Quadratc < Agan, the contrast SS su perfectly to the SST, a verfcaton of ther orthogonalty. The sgnfcant lnear contrast (p < ) leads us to the reject ts H 0. There does appear to be a sgnfcant, nonzero lnear coponent to the response. And the sgnfcant quadratc contrast (p < ), leads us to reject ts H 0 as well. There does appear to be a sgnfcant, nonzero quadratc coponent to the response. All ths can be seen qute easly n the followng cobned boxplot: μ 2 - (1/2)*(μ 1 + μ 3 ) 0

13 4.13 We would conclude fro all ths that the dosage response of flowerng to the presence of allele A has both a lnear and a quadratc coponent. In genetc ters, there s donance. If we were to analyze ths last exaple va a sple lneal regresson, we would obtan the followng results: Source df SS MS F p Total Model Error = The F value s saller (18.36 < 61.73) because the quadratc SS (288.8) s now ncluded n the error su of squares (401.6 = ). The essage: An ANOVA wth lnear and quadratc contrasts s ore senstve to lnear effects than a lnear regresson test. A quadratc regresson test, however, wll yeld dentcal results to our analyss usng contrasts. Coeffcents for trend coparsons The c coeffcents used for trend coparsons (lnear, quadratc, cubc, quartc, etc.) aong equally spaced treatents are lsted below, taken fro Table (ST&D 390). Contrast coeffcents for trend coparsons for equally spaced treatents No. of Treat. Response c1 c2 c3 c4 c5 c6 2 Lnear Lnear Quadratc Lnear Quadratc Cubc Lnear Quadratc Cubc Quartc Lnear Quadratc Cubc Quartc Quntc

14 4.14 As argued n the two prevous exaples, the values of these coeffcents ultately can be traced back to sple geoetrc arguents. The plot below shows the values of the lnear and quadratc coeffcents for t = 5: X +2 X X X T1 X X T5 X -2 X To llustrate the procedure for evaluatng a trend response when ore treatent levels are nvolved, we wll use the data fro Table (ST&D 387). To splfy atters, we wll treat the blocks sply as replcatons n a CRD. Table Parttonng SST usng orthogonal polynoals. Yeld of Ottawa Mandarn soybeans grown n MN (bushels / acre). [ST&D 387] Rep.* Row spacng (n nches) Means * Blocks treated as replcatons n ths exaple Frst of all, note that the treatent levels are equally spaced (18, 24, 30, 36, 42 6 nches between adjacent levels). Trend analyss va contrasts s greatly splfed when treatent levels are equally spaced (ether arthetc or log scales). The contrast coeffcents and the analyss: Y. Row spacng c 2 c 2 / r SS F Means Lnear ** * Quadratc ** Cubc NS

15 4.15 Quartc In ths trend analyss, we perfectly parttoned SST (125.66) aong the four degrees of freedo for treatent, each degree of freedo correspondng to an ndependent, orthogonal contrast (lnear, quadratc, cubc, and quartc coponents to the overall response). We conclude fro ths analyss that the relatonshp between row spacng and yeld has sgnfcant lnear and sgnfcant quadratc coponents. The cubc and quartc coponents are not sgnfcant. Ths can be seen easly n a scatterplot of the data: 0.06 NS Unequally spaced treatents There are equatons to calculate coeffcent slar to those of Table for unequally spaced treatent levels and unequal nubers of replcatons. The ablty to copute such sus of squares usng orthogonal contrasts was crucal n the days before coputers. But now t s easer to pleent a regresson approach, whch does not requre equal spacng between treatent levels [ST&D 388]. The SAS code for a full regresson analyss of the soybean yeld data: Data Rows; Do Rep = 1 to 6; Do Sp = 18,24,30,36,42; Input Output; End; End; Cards; ; Proc GLM Order = Data; Model Yeld = Sp Sp*Sp Sp*Sp*Sp Sp*Sp*Sp*Sp; Run; Qut; Note the absence of a Class stateent! In regresson, we are not nterested n the ndvdual levels of the explanatory varable; we are nterested n the nature of overall trend. The output:

16 4.16 Su of Source DF Squares Mean Square F Value Pr > F Model <.0001 Error Corrected Total R-Square Coeff Var Root MSE Yeld Mean Source DF Type I SS Mean Square F Value Pr > F Sp <.0001 *** Sp*Sp ** Sp*Sp*Sp NS Sp*Sp*Sp*Sp NS Ths s the exact result we obtaned usng contrasts (see code and output below): Data Rows; Do Rep = 1 to 6; Do Sp = 18,24,30,36,42; Input Output; End; End; Cards; ; Proc GLM Order = Data; Class Sp; Model Yeld = Sp; Contrast 'Lnear' Sp ; Contrast 'Quadratc' Sp ; Contrast 'Cubc' Sp ; Contrast 'Quartc' Sp ; Run; Qut; Su of Source DF Squares Mean Square F Value Pr > F Model <.0001 Error Corrected Total R-Square Coeff Var Root MSE Yeld Mean Source DF Type III SS Mean Square F Value Pr > F Sp <.0001 Contrast DF Contrast SS Mean Square F Value Pr > F Lnear <.0001 *** Quadratc ** Cubc NS Quartc NS So, as long as the treatent levels are equally spaced, the results are the sae for both analyses. The ultple regresson analyss can be used wth unequally spaced

17 4.17 treatents, but the orthogonal contrast analyss, wth the provded coeffcents, cannot. Soe rearks on treatent levels for trend analyss The selecton of dose levels for a ateral depends on the objectves of the experent. If t s known that a certan response s lnear over a gven dose range and one s only nterested n the rate of change, two doses wll suffce, one low and one hgh. However, wth only two doses there s no nforaton avalable to verfy the ntal assupton of lnearty. It s good practce to use one extra level so that devaton fro lnearty can be estated and tested. Slarly, f a quadratc response s expected, a nu of four dose levels are requred to test whether or not a quadratc odel s approprate. The varablty n agrcultural data s generally greater than for physcal and checal laboratory studes, as the experental unts are subject to less controllable envronental nfluences. These varatons cause dffculty n analyzng and nterpretng cobned experents that are conducted over dfferent years or across dfferent locatons. Furtherore, true response odels are rarely known. For these reasons, agrcultural experents usually requre four to sx levels to characterze a dose-response curve. Fnal coent about orthogonal contrasts: Powerful as they are, contrasts are not always approprate. If you have to choose, eanngful hypotheses are ore desrable than orthogonal ones!

TSS = SST + SSE An orthogonal partition of the total SS

TSS = SST + SSE An orthogonal partition of the total SS ANOVA: Topc 4. Orhogonal conrass [ST&D p. 183] H 0 : µ 1 = µ =... = µ H 1 : The mean of a leas one reamen group s dfferen To es hs hypohess, a basc ANOVA allocaes he varaon among reamen means (SST) equally

More information

Topic 4: Orthogonal Contrasts

Topic 4: Orthogonal Contrasts Topic 4: Orthogonal Contrasts ANOVA is a useful and powerful tool to compare several treatment means. In comparing t treatments, the null hypothesis tested is that the t true means are all equal (H 0 :

More information

PROBABILITY AND STATISTICS Vol. III - Analysis of Variance and Analysis of Covariance - V. Nollau ANALYSIS OF VARIANCE AND ANALYSIS OF COVARIANCE

PROBABILITY AND STATISTICS Vol. III - Analysis of Variance and Analysis of Covariance - V. Nollau ANALYSIS OF VARIANCE AND ANALYSIS OF COVARIANCE ANALYSIS OF VARIANCE AND ANALYSIS OF COVARIANCE V. Nollau Insttute of Matheatcal Stochastcs, Techncal Unversty of Dresden, Gerany Keywords: Analyss of varance, least squares ethod, odels wth fxed effects,

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed

More information

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable

More information

/ n ) are compared. The logic is: if the two

/ n ) are compared. The logic is: if the two STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence

More information

Least Squares Fitting of Data

Least Squares Fitting of Data Least Squares Fttng of Data Davd Eberly Geoetrc Tools, LLC http://www.geoetrctools.co/ Copyrght c 1998-2014. All Rghts Reserved. Created: July 15, 1999 Last Modfed: February 9, 2008 Contents 1 Lnear Fttng

More information

Chapter 12 Lyes KADEM [Thermodynamics II] 2007

Chapter 12 Lyes KADEM [Thermodynamics II] 2007 Chapter 2 Lyes KDEM [Therodynacs II] 2007 Gas Mxtures In ths chapter we wll develop ethods for deternng therodynac propertes of a xture n order to apply the frst law to systes nvolvng xtures. Ths wll be

More information

[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.

[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students. PPOL 59-3 Problem Set Exercses n Smple Regresson Due n class /8/7 In ths problem set, you are asked to compute varous statstcs by hand to gve you a better sense of the mechancs of the Pearson correlaton

More information

STATISTICS QUESTIONS. Step by Step Solutions.

STATISTICS QUESTIONS. Step by Step Solutions. STATISTICS QUESTIONS Step by Step Solutons www.mathcracker.com 9//016 Problem 1: A researcher s nterested n the effects of famly sze on delnquency for a group of offenders and examnes famles wth one to

More information

Topic 23 - Randomized Complete Block Designs (RCBD)

Topic 23 - Randomized Complete Block Designs (RCBD) Topc 3 ANOVA (III) 3-1 Topc 3 - Randomzed Complete Block Desgns (RCBD) Defn: A Randomzed Complete Block Desgn s a varant of the completely randomzed desgn (CRD) that we recently learned. In ths desgn,

More information

XII.3 The EM (Expectation-Maximization) Algorithm

XII.3 The EM (Expectation-Maximization) Algorithm XII.3 The EM (Expectaton-Maxzaton) Algorth Toshnor Munaata 3/7/06 The EM algorth s a technque to deal wth varous types of ncoplete data or hdden varables. It can be appled to a wde range of learnng probles

More information

On Pfaff s solution of the Pfaff problem

On Pfaff s solution of the Pfaff problem Zur Pfaff scen Lösung des Pfaff scen Probles Mat. Ann. 7 (880) 53-530. On Pfaff s soluton of te Pfaff proble By A. MAYER n Lepzg Translated by D. H. Delpenc Te way tat Pfaff adopted for te ntegraton of

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

Polynomial Regression Models

Polynomial Regression Models LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance

More information

Multipoint Analysis for Sibling Pairs. Biostatistics 666 Lecture 18

Multipoint Analysis for Sibling Pairs. Biostatistics 666 Lecture 18 Multpont Analyss for Sblng ars Bostatstcs 666 Lecture 8 revously Lnkage analyss wth pars of ndvduals Non-paraetrc BS Methods Maxu Lkelhood BD Based Method ossble Trangle Constrant AS Methods Covered So

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

Chapter 8 Indicator Variables

Chapter 8 Indicator Variables Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n

More information

Statistics II Final Exam 26/6/18

Statistics II Final Exam 26/6/18 Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the

More information

Elastic Collisions. Definition: two point masses on which no external forces act collide without losing any energy.

Elastic Collisions. Definition: two point masses on which no external forces act collide without losing any energy. Elastc Collsons Defnton: to pont asses on hch no external forces act collde thout losng any energy v Prerequstes: θ θ collsons n one denson conservaton of oentu and energy occurs frequently n everyday

More information

Chapter One Mixture of Ideal Gases

Chapter One Mixture of Ideal Gases herodynacs II AA Chapter One Mxture of Ideal Gases. Coposton of a Gas Mxture: Mass and Mole Fractons o deterne the propertes of a xture, we need to now the coposton of the xture as well as the propertes

More information

System in Weibull Distribution

System in Weibull Distribution Internatonal Matheatcal Foru 4 9 no. 9 94-95 Relablty Equvalence Factors of a Seres-Parallel Syste n Webull Dstrbuton M. A. El-Dacese Matheatcs Departent Faculty of Scence Tanta Unversty Tanta Egypt eldacese@yahoo.co

More information

Topic- 11 The Analysis of Variance

Topic- 11 The Analysis of Variance Topc- 11 The Analyss of Varance Expermental Desgn The samplng plan or expermental desgn determnes the way that a sample s selected. In an observatonal study, the expermenter observes data that already

More information

The Parity of the Number of Irreducible Factors for Some Pentanomials

The Parity of the Number of Irreducible Factors for Some Pentanomials The Party of the Nuber of Irreducble Factors for Soe Pentanoals Wolfra Koepf 1, Ryul K 1 Departent of Matheatcs Unversty of Kassel, Kassel, F. R. Gerany Faculty of Matheatcs and Mechancs K Il Sung Unversty,

More information

AN ANALYSIS OF A FRACTAL KINETICS CURVE OF SAVAGEAU

AN ANALYSIS OF A FRACTAL KINETICS CURVE OF SAVAGEAU AN ANALYI OF A FRACTAL KINETIC CURE OF AAGEAU by John Maloney and Jack Hedel Departent of Matheatcs Unversty of Nebraska at Oaha Oaha, Nebraska 688 Eal addresses: aloney@unoaha.edu, jhedel@unoaha.edu Runnng

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Chapter 12 Analysis of Covariance

Chapter 12 Analysis of Covariance Chapter Analyss of Covarance Any scentfc experment s performed to know somethng that s unknown about a group of treatments and to test certan hypothess about the correspondng treatment effect When varablty

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

Description of the Force Method Procedure. Indeterminate Analysis Force Method 1. Force Method con t. Force Method con t

Description of the Force Method Procedure. Indeterminate Analysis Force Method 1. Force Method con t. Force Method con t Indeternate Analyss Force Method The force (flexblty) ethod expresses the relatonshps between dsplaceents and forces that exst n a structure. Prary objectve of the force ethod s to deterne the chosen set

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

ANOVA. The Observations y ij

ANOVA. The Observations y ij ANOVA Stands for ANalyss Of VArance But t s a test of dfferences n means The dea: The Observatons y j Treatment group = 1 = 2 = k y 11 y 21 y k,1 y 12 y 22 y k,2 y 1, n1 y 2, n2 y k, nk means: m 1 m 2

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

Statistics Chapter 4

Statistics Chapter 4 Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9 Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,

More information

Lecture 6: Introduction to Linear Regression

Lecture 6: Introduction to Linear Regression Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6

More information

Excess Error, Approximation Error, and Estimation Error

Excess Error, Approximation Error, and Estimation Error E0 370 Statstcal Learnng Theory Lecture 10 Sep 15, 011 Excess Error, Approxaton Error, and Estaton Error Lecturer: Shvan Agarwal Scrbe: Shvan Agarwal 1 Introducton So far, we have consdered the fnte saple

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

Computational and Statistical Learning theory Assignment 4

Computational and Statistical Learning theory Assignment 4 Coputatonal and Statstcal Learnng theory Assgnent 4 Due: March 2nd Eal solutons to : karthk at ttc dot edu Notatons/Defntons Recall the defnton of saple based Radeacher coplexty : [ ] R S F) := E ɛ {±}

More information

Chapter 15 - Multiple Regression

Chapter 15 - Multiple Regression Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term

More information

On the number of regions in an m-dimensional space cut by n hyperplanes

On the number of regions in an m-dimensional space cut by n hyperplanes 6 On the nuber of regons n an -densonal space cut by n hyperplanes Chungwu Ho and Seth Zeran Abstract In ths note we provde a unfor approach for the nuber of bounded regons cut by n hyperplanes n general

More information

Economics 130. Lecture 4 Simple Linear Regression Continued

Economics 130. Lecture 4 Simple Linear Regression Continued Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

What is LP? LP is an optimization technique that allocates limited resources among competing activities in the best possible manner.

What is LP? LP is an optimization technique that allocates limited resources among competing activities in the best possible manner. (C) 998 Gerald B Sheblé, all rghts reserved Lnear Prograng Introducton Contents I. What s LP? II. LP Theor III. The Splex Method IV. Refneents to the Splex Method What s LP? LP s an optzaton technque that

More information

Statistics for Business and Economics

Statistics for Business and Economics Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models

Statistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 14 Multple Regresson Models 1999 Prentce-Hall, Inc. Chap. 14-1 Chapter Topcs The Multple Regresson Model Contrbuton of Indvdual Independent Varables

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experment-I MODULE VIII LECTURE - 34 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS EFFECTS MODEL Dr Shalabh Department of Mathematcs and Statstcs Indan

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

First Year Examination Department of Statistics, University of Florida

First Year Examination Department of Statistics, University of Florida Frst Year Examnaton Department of Statstcs, Unversty of Florda May 7, 010, 8:00 am - 1:00 noon Instructons: 1. You have four hours to answer questons n ths examnaton.. You must show your work to receve

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Fermi-Dirac statistics

Fermi-Dirac statistics UCC/Physcs/MK/EM/October 8, 205 Fer-Drac statstcs Fer-Drac dstrbuton Matter partcles that are eleentary ostly have a type of angular oentu called spn. hese partcles are known to have a agnetc oent whch

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

17 Nested and Higher Order Designs

17 Nested and Higher Order Designs 54 17 Nested and Hgher Order Desgns 17.1 Two-Way Analyss of Varance Consder an experment n whch the treatments are combnatons of two or more nfluences on the response. The ndvdual nfluences wll be called

More information

Using the estimated penetrances to determine the range of the underlying genetic model in casecontrol

Using the estimated penetrances to determine the range of the underlying genetic model in casecontrol Georgetown Unversty From the SelectedWorks of Mark J Meyer 8 Usng the estmated penetrances to determne the range of the underlyng genetc model n casecontrol desgn Mark J Meyer Neal Jeffres Gang Zheng Avalable

More information

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an

More information

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study

More information

Chapter 13. Gas Mixtures. Study Guide in PowerPoint. Thermodynamics: An Engineering Approach, 5th edition by Yunus A. Çengel and Michael A.

Chapter 13. Gas Mixtures. Study Guide in PowerPoint. Thermodynamics: An Engineering Approach, 5th edition by Yunus A. Çengel and Michael A. Chapter 3 Gas Mxtures Study Gude n PowerPont to accopany Therodynacs: An Engneerng Approach, 5th edton by Yunus A. Çengel and Mchael A. Boles The dscussons n ths chapter are restrcted to nonreactve deal-gas

More information

Chapter 6. Supplemental Text Material

Chapter 6. Supplemental Text Material Chapter 6. Supplemental Text Materal S6-. actor Effect Estmates are Least Squares Estmates We have gven heurstc or ntutve explanatons of how the estmates of the factor effects are obtaned n the textboo.

More information

Least Squares Fitting of Data

Least Squares Fitting of Data Least Squares Fttng of Data Davd Eberly Geoetrc Tools, LLC http://www.geoetrctools.co/ Copyrght c 1998-2015. All Rghts Reserved. Created: July 15, 1999 Last Modfed: January 5, 2015 Contents 1 Lnear Fttng

More information

NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MTH352/MH3510 Regression Analysis

NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MTH352/MH3510 Regression Analysis NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION 014-015 MTH35/MH3510 Regresson Analyss December 014 TIME ALLOWED: HOURS INSTRUCTIONS TO CANDIDATES 1. Ths examnaton paper contans FOUR (4) questons

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

BAYESIAN CURVE FITTING USING PIECEWISE POLYNOMIALS. Dariusz Biskup

BAYESIAN CURVE FITTING USING PIECEWISE POLYNOMIALS. Dariusz Biskup BAYESIAN CURVE FITTING USING PIECEWISE POLYNOMIALS Darusz Bskup 1. Introducton The paper presents a nonparaetrc procedure for estaton of an unknown functon f n the regresson odel y = f x + ε = N. (1) (

More information

LINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables

LINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables LINEAR REGRESSION ANALYSIS MODULE VIII Lecture - 7 Indcator Varables Dr. Shalabh Department of Maematcs and Statstcs Indan Insttute of Technology Kanpur Indcator varables versus quanttatve explanatory

More information

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens

THE CHINESE REMAINDER THEOREM. We should thank the Chinese for their wonderful remainder theorem. Glenn Stevens THE CHINESE REMAINDER THEOREM KEITH CONRAD We should thank the Chnese for ther wonderful remander theorem. Glenn Stevens 1. Introducton The Chnese remander theorem says we can unquely solve any par of

More information

Our focus will be on linear systems. A system is linear if it obeys the principle of superposition and homogenity, i.e.

Our focus will be on linear systems. A system is linear if it obeys the principle of superposition and homogenity, i.e. SSTEM MODELLIN In order to solve a control syste proble, the descrptons of the syste and ts coponents ust be put nto a for sutable for analyss and evaluaton. The followng ethods can be used to odel physcal

More information

An Optimal Bound for Sum of Square Roots of Special Type of Integers

An Optimal Bound for Sum of Square Roots of Special Type of Integers The Sxth Internatonal Syposu on Operatons Research and Its Applcatons ISORA 06 Xnang, Chna, August 8 12, 2006 Copyrght 2006 ORSC & APORC pp. 206 211 An Optal Bound for Su of Square Roots of Specal Type

More information

17 - LINEAR REGRESSION II

17 - LINEAR REGRESSION II Topc 7 Lnear Regresson II 7- Topc 7 - LINEAR REGRESSION II Testng and Estmaton Inferences about β Recall that we estmate Yˆ ˆ β + ˆ βx. 0 μ Y X x β0 + βx usng To estmate σ σ squared error Y X x ε s ε we

More information

Recall that quantitative genetics is based on the extension of Mendelian principles to polygenic traits.

Recall that quantitative genetics is based on the extension of Mendelian principles to polygenic traits. BIOSTT/STT551, Statstcal enetcs II: Quanttatve Trats Wnter 004 Sources of varaton for multlocus trats and Handout Readng: Chapter 5 and 6. Extensons to Multlocus trats Recall that quanttatve genetcs s

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x

More information

STAT 3008 Applied Regression Analysis

STAT 3008 Applied Regression Analysis STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,

More information

arxiv: v2 [math.co] 3 Sep 2017

arxiv: v2 [math.co] 3 Sep 2017 On the Approxate Asyptotc Statstcal Independence of the Peranents of 0- Matrces arxv:705.0868v2 ath.co 3 Sep 207 Paul Federbush Departent of Matheatcs Unversty of Mchgan Ann Arbor, MI, 4809-043 Septeber

More information

Lecture 3 Stat102, Spring 2007

Lecture 3 Stat102, Spring 2007 Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Scatter Plot x

Scatter Plot x Construct a scatter plot usng excel for the gven data. Determne whether there s a postve lnear correlaton, negatve lnear correlaton, or no lnear correlaton. Complete the table and fnd the correlaton coeffcent

More information

Revision: December 13, E Main Suite D Pullman, WA (509) Voice and Fax

Revision: December 13, E Main Suite D Pullman, WA (509) Voice and Fax .9.1: AC power analyss Reson: Deceber 13, 010 15 E Man Sute D Pullan, WA 99163 (509 334 6306 Voce and Fax Oerew n chapter.9.0, we ntroduced soe basc quanttes relate to delery of power usng snusodal sgnals.

More information

COS 511: Theoretical Machine Learning

COS 511: Theoretical Machine Learning COS 5: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture #0 Scrbe: José Sões Ferrera March 06, 203 In the last lecture the concept of Radeacher coplexty was ntroduced, wth the goal of showng that

More information

Chapter 14 Simple Linear Regression

Chapter 14 Simple Linear Regression Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experments- MODULE LECTURE - 6 EXPERMENTAL DESGN MODELS Dr. Shalabh Department of Mathematcs and Statstcs ndan nsttute of Technology Kanpur Two-way classfcaton wth nteractons

More information

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques

More information

Topic 10: ANOVA models for random and mixed effects Fixed and Random Models in One-way Classification Experiments

Topic 10: ANOVA models for random and mixed effects Fixed and Random Models in One-way Classification Experiments Topc 10: ANOVA models for random and mxed effects eferences: ST&D Topc 7.5 (15-153), Topc 9.9 (5-7), Topc 15.5 (379-384); rules for expected on ST&D page 381 replaced by Chapter 8 from Montgomery, 1991.

More information

PHYS 1443 Section 002 Lecture #20

PHYS 1443 Section 002 Lecture #20 PHYS 1443 Secton 002 Lecture #20 Dr. Jae Condtons for Equlbru & Mechancal Equlbru How to Solve Equlbru Probles? A ew Exaples of Mechancal Equlbru Elastc Propertes of Solds Densty and Specfc Gravty lud

More information

Small-Sample Equating With Prior Information

Small-Sample Equating With Prior Information Research Report Sall-Saple Equatng Wth Pror Inforaton Sauel A Lvngston Charles Lews June 009 ETS RR-09-5 Lstenng Learnng Leadng Sall-Saple Equatng Wth Pror Inforaton Sauel A Lvngston and Charles Lews ETS,

More information

SIMPLE LINEAR REGRESSION

SIMPLE LINEAR REGRESSION Smple Lnear Regresson and Correlaton Introducton Prevousl, our attenton has been focused on one varable whch we desgnated b x. Frequentl, t s desrable to learn somethng about the relatonshp between two

More information

ITERATIVE ESTIMATION PROCEDURE FOR GEOSTATISTICAL REGRESSION AND GEOSTATISTICAL KRIGING

ITERATIVE ESTIMATION PROCEDURE FOR GEOSTATISTICAL REGRESSION AND GEOSTATISTICAL KRIGING ESE 5 ITERATIVE ESTIMATION PROCEDURE FOR GEOSTATISTICAL REGRESSION AND GEOSTATISTICAL KRIGING Gven a geostatstcal regresson odel: k Y () s x () s () s x () s () s, s R wth () unknown () E[ ( s)], s R ()

More information

UCLA STAT 13 Introduction to Statistical Methods for the Life and Health Sciences. Chapter 11 Analysis of Variance - ANOVA. Instructor: Ivo Dinov,

UCLA STAT 13 Introduction to Statistical Methods for the Life and Health Sciences. Chapter 11 Analysis of Variance - ANOVA. Instructor: Ivo Dinov, UCLA STAT 3 ntroducton to Statstcal Methods for the Lfe and Health Scences nstructor: vo Dnov, Asst. Prof. of Statstcs and Neurology Chapter Analyss of Varance - ANOVA Teachng Assstants: Fred Phoa, Anwer

More information

Applied Mathematics Letters

Applied Mathematics Letters Appled Matheatcs Letters 2 (2) 46 5 Contents lsts avalable at ScenceDrect Appled Matheatcs Letters journal hoepage: wwwelseverco/locate/al Calculaton of coeffcents of a cardnal B-splne Gradr V Mlovanovć

More information

Introduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors

Introduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors ECONOMICS 5* -- Introducton to Dummy Varable Regressors ECON 5* -- Introducton to NOTE Introducton to Dummy Varable Regressors. An Example of Dummy Varable Regressors A model of North Amercan car prces

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Joint Statistical Meetings - Biopharmaceutical Section

Joint Statistical Meetings - Biopharmaceutical Section Iteratve Ch-Square Test for Equvalence of Multple Treatment Groups Te-Hua Ng*, U.S. Food and Drug Admnstraton 1401 Rockvlle Pke, #200S, HFM-217, Rockvlle, MD 20852-1448 Key Words: Equvalence Testng; Actve

More information

Finite Fields and Their Applications

Finite Fields and Their Applications Fnte Felds and Ther Applcatons 5 009 796 807 Contents lsts avalable at ScenceDrect Fnte Felds and Ther Applcatons www.elsever.co/locate/ffa Typcal prtve polynoals over nteger resdue rngs Tan Tan a, Wen-Feng

More information

Reminder: Nested models. Lecture 9: Interactions, Quadratic terms and Splines. Effect Modification. Model 1

Reminder: Nested models. Lecture 9: Interactions, Quadratic terms and Splines. Effect Modification. Model 1 Lecture 9: Interactons, Quadratc terms and Splnes An Manchakul amancha@jhsph.edu 3 Aprl 7 Remnder: Nested models Parent model contans one set of varables Extended model adds one or more new varables to

More information

CHAPTER 6 CONSTRAINED OPTIMIZATION 1: K-T CONDITIONS

CHAPTER 6 CONSTRAINED OPTIMIZATION 1: K-T CONDITIONS Chapter 6: Constraned Optzaton CHAPER 6 CONSRAINED OPIMIZAION : K- CONDIIONS Introducton We now begn our dscusson of gradent-based constraned optzaton. Recall that n Chapter 3 we looked at gradent-based

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

,..., k N. , k 2. ,..., k i. The derivative with respect to temperature T is calculated by using the chain rule: & ( (5) dj j dt = "J j. k i.

,..., k N. , k 2. ,..., k i. The derivative with respect to temperature T is calculated by using the chain rule: & ( (5) dj j dt = J j. k i. Suppleentary Materal Dervaton of Eq. 1a. Assue j s a functon of the rate constants for the N coponent reactons: j j (k 1,,..., k,..., k N ( The dervatve wth respect to teperature T s calculated by usng

More information

Chapter 11: I = 2 samples independent samples paired samples Chapter 12: I 3 samples of equal size J one-way layout two-way layout

Chapter 11: I = 2 samples independent samples paired samples Chapter 12: I 3 samples of equal size J one-way layout two-way layout Serk Sagtov, Chalmers and GU, February 0, 018 Chapter 1. Analyss of varance Chapter 11: I = samples ndependent samples pared samples Chapter 1: I 3 samples of equal sze one-way layout two-way layout 1

More information