The written Master s Examination
|
|
- Elwin Riley
- 5 years ago
- Views:
Transcription
1 he wrtten Master s Eamnaton Opton Statstcs and Probablty SPRING 9 Full ponts may be obtaned for correct answers to 8 questons. Each numbered queston (whch may have several parts) s worth the same number of ponts. All answers wll be graded, but the score for the eamnaton wll be the sum of the scores of your best 8 solutons. Use separate answer sheets for each queston. DO NO PU YOUR NAME ON YOUR ANSWER SHEES. When you have fnshed, nsert all your answer sheets nto the envelope provded, then seal and prnt your name on t. Any student whose answers need clarfcaton may be requred to submt to an oral eamnaton.
2 MS Eam, Opton Probablty and Statstcs, SPRING 9. (Stat 4) Let U and V be two ndependent, standard normal random varables. (a) Fnd the jont dstrbuton of U + V and U V. U + V (b) Fnd the dstrbuton of. ( U V). (Stat 4) Let X,, X n be ndependent random varables wth X dstrbuted as N(βa,σ ), for =,,n, where a,..,a n are known (non-random) real numbers at least one of whch s non-zero and σ s known. () Derve the mamum lkelhood estmator (mle) of β. () Is the mle unbased? Justfy your answer. () Fnd the Rao-Cramer lower bound for unbased estmators of β. (v) Is the mle of β effcent (mnmum varance unbased)? Justfy your answer. 3. (Stat 4) Consder one random varable X that has a bnomal dstrbuton wth n = 4 and p = θ. [] Fnd the most powerful test of sze α / 6 based on X only for H : θ =.5 vs. H : θ =.75. [] Calculate the power of your test. [3] Justfy that your test s the most powerful one of sze /6. 4. (Stat 46) A chemst wshes to test the effect of four chemcal agents on the strength of a partcular type of cloth. Because there mght be varablty from one bolt to another, the chemst decdes to use a randomzed block desgn, wth the bolts of cloth consdered as blocks. She selects fve bolts and apples all four chemcals n random order to each bolt. he resultng tensle strengths follow. Bolt Chemcal A Chemcal B Chemcal C Chemcal D Descrbe the basc model of the Fredman test, gve ts test statstc S, and compute S. Eplan also why the Fredman test s here more approprate than the Kruskal-Walls test.
3 MS Eam, Opton Probablty and Statstcs, SPRING 9 5. (Stat 43) A clent has a fnte populaton of 6 unts and has funds to survey only 3 unts for the purpose of estmatng the mean and ts related standard devaton. here are two samplng plans to be consdered by two survey practtoners. Samplng Plan by Survey Practtoner : Is a smple random samplng plan of sze 3 wthout replacement, SRS (6, 3). Recall that ths s a unform samplng plan wth all samples of sze 3 n ts support. Samplng Plan by Survey Practtoner : Is a controlled samplng plan wth only 4 samples: A- he followng s samples are ecluded from beng surveyed, that s they have zero probablty of selecton. {,,3 }, {,4,5}, {,5,6}, {,3,5}, {,4,6}, {3,4,6}. B- he followng s samples are assgned probablty of / of selecton each: {,,5}, {,3,5}, {,4,6}, {,3,4}, {,3,6}, {4,5,6}. C- he remanng 8 samples are assgned probablty of / of selecton each. Remark: Note that the total probablty over the chosen 4 samples s and the survey s not a unform samplng plan snce s of the samples are assgned twce as much probablty as the remanng 8 samples. Suppose both practtoners mplemented ther survey plans and the sample {,, 5} s selected by both of them and the related survey data are: Y =, Y = 96, and Y 5 = 3. - What are the H estmators and ther values of the populaton mean under both samplng plans? - What are the standard devatons of your estmator under both samplng plans? 3- If you were the consultng statstcan, whch of the above two samplng plans would you recommend to your clent and why? 6. (Stat 46) he number of customers enterng a store on a gven day s Posson dstrbuted wth mean λ =. he amount of money spent by a customer s unformly dstrbuted over (,). Fnd the mean and the varance of the amount of money that the store takes n on a gven day. 3
4 MS Eam, Opton Probablty and Statstcs, SPRING 9 7. (Stat 47) Home depot stocks wooden planks of length 9 feet. Home Bulders buy such planks and cut them accordng to ther needs. A home bulder needs planks of length 7 feet, planks of length 5 feet, 3 planks of length 4 feet. Suppose only the followng 3 cuttng patterns are used. 7 Feet 5 Feet wth cuttng patterns 3 4 Feet 3 (a). How many 9 feet planks are needed to meet the requrements usng only these cuttng patterns. What s the total length of the wasted porton? (b). Use revsed smple method to check whether there s a potental cuttng pattern that would reduce the number of planks needed. (c). Determne whch pattern has to be replaced by the entry of the new cuttng pattern? (d). How many 9 feet planks are needed to meet the requrements usng only the new cuttng patterns after dscontnung one of the old patterns? 8. (Stat 47) Show that = 5/6, = 5/, = 7 / 6 s optmal to the lnear programmng problem: ma such that ,, unrestrcted. 9. (Stat 473) On a lnear forest path of unt length covered wth bushes, Joe chooses secretly a locaton to hde and Bob chooses a locaton y to hde. he payoff to Joe from Bob s y y. Show that the strategy whch chooses a random pont y n [,] wth densty f ( ), y gves an epectaton = /6for all. Fnd the value of the game. 4
5 MS Eam, Opton Probablty and Statstcs, SPRING 9. (Stat 48) A dary company would lke to nvestgate f the mlk s contamnated. In order to nvestgate a possble shpment (batch) effect, the company selects 5 shpments at random. After processng each batch, 6 cartons of mlk are selected at random and are stored for several days. hen the square root of the bactera counts are recorded and denoted by Y j, where =,...,5 and j=,...,6. (a). If the shpment effect s denoted as τ, wrte down ANOVA model and specfy requred dstrbuton of random components n the model. Please state the hypotheses. (b). Complete the followng table and conclude gven sgnfcance level.. Sources df SS MS F Shpment 83.3 Error otal 36. [Gven: F(., 5, 3) = 3.7, F(., 5, 5) = 3.85, F(., 4, 5) = 4.77 ] (c). Estmate the varance component(s).. (Stat 48) In lnear regresson analyss, leave-one-out cross valdaton (LOOCV) procedure s often used to estmate the predcton accuracy of the ftted regresson model. Let ( X, Y) = (, y ); =,..., n be a dataset wth p = (,,..., p) and y R ( X( ), Y ) ( ) y( ) = ( X( ) X( ) ) X ( ) Y( ) R + the -th row. A set of predcton values estmate s defned as, and let be the modfed dataset wthout n LOOCV = n e( ) wth e( ) = y y( ). ( X X) ( X X) (a) Show that( X( ) X( ) ) ( X X) = + ( X X) =. are obtaned and the LOOCV A zz A Hnt: ( A zz ) = A + assumng that A z z s nvertble. z A z e (b) Show that e( ) = ; =,..., n, where H = X( X X) X, h s the -th dagonal element of H h and e= ( e,..., e ) = ( I H) Y. n 5
6 Statstcs 4&48 MS Eam (Junhu Wang) Sprng Semester 9. Let U and V be two ndependent, standard normal random varables. (a) Fnd the jont dstrbuton of U + V and U V. (b) Fnd the dstrbuton of U + V ( U V). [Soluton] (a) Snce U N, I V, we have U + V U = N, I N,. U V V + ( ) ( ) (b) From (a), U V N,, U V N,, and thus ( ) (, U + V N ), and ( ) ( U V χ ). From (a), U + V and U V are ndependent, whch mples that ( ) U + V and ( ) U V are ndependent as well. herefore, we have U + V ( U V) based on the defnton of t dstrbuton. = ( U + V ) t() ( U V)
7 Stat 4, Estmaton problem. Sprng 9 Let X ; : : : ; X n be ndependent random varables wth X dstrbuted as N(a, ), for =,...,n, where a ; ::; a n are known (non-random) real numbers at least one of whch s non-zero and s known. () Derve the mamum lkelhood estmator (mle) of. () Is the mle unbased? Justfy your answer. () Fnd the Rao-Cramer lower bound for unbased estmators of. (v) Is the mle of e cent (mnmum varance unbased)? Justfy your answer. Soluton: () he lkelhood s L() = () n= n e ( a) he mle b mnmzes h () = has the soluton h() = n = ( a ) : b = a a : Also, h ( ) b > : Hence b s the mle of. () E b = for all ; hence b s unbased: = aa a () he nformaton n the sample X ; :::; X n ln L() I () = = a : Hence the Rao-Cramer lower bound for the varance of an unbased estmator of s (v) V b unbased. a : = ; the Rao-Cramer lower bound. Hence b s mnmum varance a
8 [Stat 4, chap. 8, 9] (Je Yang) Consder one random varable X that has a bnomal dstrbuton wth n = 4 and p = θ. [] Fnd the most powerful test of sze α / 6 for H : θ =.5 vs. H : θ =.75 [] Calculate the power of your test. [3] Justfy that your test s the most powerful one of sze /6. [Soluton] [] Snce X follows Bnomal (4,θ ), the lkelhood 4 4 L( θ ; ) = f ( ; θ ) = θ ( θ ), =,,,3,4 herefore, L(.5; ) 6 L (.5; ) =, L(.75; ) =, = L(.75; ) L (.5; ) / L(.75; ) 6 6/3 6/9 6/7 6/8 Pr( X = H ) /6 4/6 6/6 4/6 /6 Pr( X = H ) /56 /56 54/56 8/56 8/56 By Neyman-Pearson theorem, the test wth rejecton regon C : = : L(.5; ) / L(.75; ) k { } s the most powerful one of sze Pr( X C H ). Let k = 6 / 8, then C = { : = 4} leads to the most powerful test of sze / 6. [] he power s Pr( X = 4 H ) = 8/ 56. [3] he test s guaranteed by the Neyman-Pearson theorem to be the most powerful test. Alternatve way to justfy that: Another test wth rejecton regon{ : = } s of sze /6 too. he correspondng power s only /56.
9
10 Soluton Statstcs 43-MS Eam Sprng Semester 9 A clent has a fnte populaton of 6 unts and has funds to survey only 3 unts for the purpose of estmatng the mean and ts related standard devaton. here are two samplng plans to be consdered by two survey practtoners. Samplng Plan by Survey Practtoner : Is a smple random samplng plan of sze 3 wthout replacement, SRS (6, 3). Recall that ths s a unform samplng plan wth all samples of sze 3 n ts support. Samplng Plan by Survey Practtoner : Is a controlled samplng plan wth only 4 samples: A- he followng s samples are ecluded from beng surveyed, that s they have zero probablty of selecton. {,,3 }, {,4,5}, {,5,6}, {,3,5}, {,4,6}, {3,4,6}. B- he followng s samples are assgned probablty of / of selecton each: {,,5}, {,3,5}, {,4,6}, {,3,4}, {,3,6}, {4,5,6}. C- he remanng 8 samples are assgned probablty of / of selecton each. Remark: Note that the total probablty over the chosen 4 samples s and the survey s not a unform samplng plan snce s of the samples are assgned twce as much probablty as the remanng 8 samples. Suppose both practtoners mplemented ther survey plans and the sample {,, 5} s selected by both of them and the related survey data are: Y =, Y = 96, and Y 5 = 3. - What are the H estmators and ther values of the populaton mean under both samplng plans? Answer: We observe that the frst ncluson probabltes for both samplng desgn s constant (3/6) for all 6 unts. hus, the H estmator of the populaton mean under both samplng plans s smply the sample mean: (+96+3)/3 = 3. - What are the standard devatons of your estmator under both samplng plans? Answer: We observe also that the second order ncluson probabltes for both samplng plans are constant 3(3-)/6(6-) = 5 for all 5 dstnct pars. hus, thus desgn unbased estmator of the varance of H s smply [(sample varance)/3] [- 3/6)]. Compute the sample varance of the three observatons and plug t n the epresson and take ts postve square root.
11 3- If you were the consultng statstcan, whch of the above two samplng plans would you recommend to your clent and why? Answer: If there s no need or reason to eclude those samples whch survey desgn has ecluded from the support of the samplng plan then the frst survey plan whch wth s SRS(3, 6) s preferred due to ts statstcal optmalty (see the samplng book by Hedayat and Snha). In addton the statstcan does not have to justfy the ecluson of those samples whch survey desgn has done. However, f those samples whch have receved zero probablty of selecton under survey are to be ecluded from the survey then clearly the second survey desgn should be recommended.
12
13 Solutons to OR Problems n Masters Eam Sprng 9.E.S. Raghavan Aprl 7, 9 Soluton to Problem 7: Stat 47 From 9 feet boards we want planks 7 feet long, planks 5 feet long and 3 planks 4 feet long only usng cuttng patterns 7 feet 5 feet usng patterns 3,,. 4 feet 3 Say we need,, 3 planks cut n respectve patterns. Solvng 3 = 3 and roundng to the net hghest nteger, we get = 6, = 5, 3 = 9. Snce the fractonal sum s tself > 7 we want to see whether we can manage wth 8 planks. o check ths we have to fnd strct mprovement and ths must correspond to a new cuttng pattern brought n and one of the above pattern elmnated. By revsed smple method we solve for ub = c B where u s the row vector and c B s the row vector [,, ]. We get u = [u, u, u 3 ] = [ 4, u 7 =, ] 7 7. We now look for a cuttng pattern a a a 3 3 Department of Mathematcs, Statstcs and Computer Scence, 85, South Morgan Street #57, Unversty of Illnos at Chcago, Chcago, IL Emal: ter@uc.edu
14 such that 4 7 a + 7 a + 7 a 3 > 7a + 5a + 4a 3 9 hat s 4a + a + a 3 > 7 7a + 5a + 4a 3 9 he knapsack algorthm gves weghts for a, a, a 3 as 4 7, 5, 4 respectvely. hus choosng a =, a =, a 3 = gves the new cuttng pattern. Usng revsed smple method we determne whch pattern of the current has to be dropped out. o do ths we need to solve Bd = a where we solve 3 d d d 3 =. We get d = 4 7, d = 5 7, d 3 = 7. he new soluton clearly has to scrap the last cuttng pattern as d 3 alone s postve. hus the new cuttng patterns are 7 feet 5 feet 4 feet usng patterns 3, 3,. he new cuts to the nearest nteger not below the fractonal soluton s = 6, = 9, 3 = 3 ths meets the demands and we waste (9)(8) ()(7) ()(5) (3)(4) = 3. Prevously we wasted (9)(9) ()(7) ()(5) (3)(4) = 49 feet
15 Soluton to Problem 8, stat 47 he LP problem has as ts dual ma such that ,, 3 unrestrcted mn 6y + y + 5y 3 such that y + 5y + y 3 = 9 y + 4y + y 3 = 4 3y + y + y 3 = 7 y, y, y 3 has feasble soluton y =, y =, y 3 = 4. Snce = 5 6, = 5, 3 = 7 6 s feasble for prmal and gves the value of the objectve functon as 44 and so does the dual soluton the two are optmal for the two problems by the dualty theorem. Soluton to Problem 9, Stat 473 Gven the payoff functon K(, y) = y y, y the epected payoff to player I usng whle player II chooses a y at random usng densty f(y), y s gven by K(, y)dy = y = [ y y y = ] + [ y y ( y)dy + ] [ (y )dy y y + y3 3 ] ( y + y )dy = + + [ + 3 ] = 6 By the symmetry of the payoff functon, the same unform strategy s optmal for player I gvng an epectaton 6 for all y. hus the value of the game s 6. 3
16 SA 48 -Sprng 9 (Jng Wang) A dary company would lke to nvestgate f the mlk s contamnated. In order to nvestgate a possble shpment (batch) effect, the company selects 5 shpments at random. After processng each batch, 6 cartons of mlk are selected at random and are stored for several days. hen the square root of the bactera counts are recorded and denoted by Y j, where =,..., 5 and j =,..., 6. (a). If the shpment effect s denoted as τ, wrte down ANOVA model and specfy dstrbuton of random components n the model. Please state the hypotheses. Soluton: he shpment (batch) effect s a random effect. Hence a random-effect ANOVA model can be wrtten as Y j = µ + τ + ε j, where =,..., 5, j =,..., 6. In addton, τ and ε j are ndependently dstrbuted wth respectvely normal dstrbutons, τ N (, σ τ ) and εj N (, σ ) for any and j. o nvestgate f the batch effect s sgnfcant s equvalent to test H : σ τ = aganst H : σ τ >. (b). Complete the followng table and conclude based on. sgnfcance level. Soluton: Sources df SS M S F Shpment Error otal Snce the observed statstc F o = 9. > F (., 4, 5) = 4.77, the test s sgnfcant at level α =.,.e. there s consderable varaton among the shpments. (c). Estmate the varance component(s). Soluton: he error varance can be estmated by the MSE drectly, ˆσ = MS Error =.3. he varance component for the random effect s estmated as follows (sample sze for each batch s the same) ˆσ τ = n (MS reatment MS Eroor ) = (.8.3) =
17 . In lnear regresson analyss, leave-one-out cross valdaton (LOOCV) procedure s often used to estmate the predcton accuracy of the ftted regresson model. Let ( X, Y) = (, y ); =,..., n be a dataset wth R + ( X, Y ) ( ) ( ) p = (,,..., p) and y R, and let be the modfed dataset wthout the -th row. A set of predcton values y( ) = ( X( ) X( ) ) X Y ( ) ( ) are obtaned and the LOOCV estmate s defned as n n ( ) ( ). = = LOOCV = n e = n ( y y ) ( X X) ( X X) (a) Show that( X( ) X( ) ) = ( X X) + ( X X). A zz A Hnt: ( A zz ) = A + assumng that z A z A z z s nvertble. e (b) Show that e( ) = ; =,..., n, where H = X( X X) X, h s the -th dagonal h element of H and e= ( e,..., e ) = ( I H) Y. [Soluton] n (a) he equalty follows mmedately after the fact that X ( ) X( ) = X X formula n the Hnt. and the (b) Note that X ( ) Y( ) = X Y y and h = ( X X ) ( ) ( ), we thus have ( ) = ( ) = ( ( ) ( ) ) ( ) ( ) e y y y X X X Y = y X X X Y y ( ) ( ) ( X X) ( X X) = y ( X X) + ( X Y y) h = y X X X Y X X ( X X) y + ( X X) ( X X) X Y ( ) ( ) h h h = y β hy + β y h h e = y β =. h h h where ( β = X X) X Y. ( X X) h y
First Year Examination Department of Statistics, University of Florida
Frst Year Examnaton Department of Statstcs, Unversty of Florda May 7, 010, 8:00 am - 1:00 noon Instructons: 1. You have four hours to answer questons n ths examnaton.. You must show your work to receve
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationx = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationNegative Binomial Regression
STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationDepartment of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution
Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable
More informationStat 543 Exam 2 Spring 2016
Stat 543 Exam 2 Sprng 206 I have nether gven nor receved unauthorzed assstance on ths exam. Name Sgned Date Name Prnted Ths Exam conssts of questons. Do at least 0 of the parts of the man exam. I wll score
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours
UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationSee Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)
Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes
More informationStat 543 Exam 2 Spring 2016
Stat 543 Exam 2 Sprng 2016 I have nether gven nor receved unauthorzed assstance on ths exam. Name Sgned Date Name Prnted Ths Exam conssts of 11 questons. Do at least 10 of the 11 parts of the man exam.
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationLecture 4: Universal Hash Functions/Streaming Cont d
CSE 5: Desgn and Analyss of Algorthms I Sprng 06 Lecture 4: Unversal Hash Functons/Streamng Cont d Lecturer: Shayan Oves Gharan Aprl 6th Scrbe: Jacob Schreber Dsclamer: These notes have not been subjected
More informationSTAT 511 FINAL EXAM NAME Spring 2001
STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationGoodness of fit and Wilks theorem
DRAFT 0.0 Glen Cowan 3 June, 2013 Goodness of ft and Wlks theorem Suppose we model data y wth a lkelhood L(µ) that depends on a set of N parameters µ = (µ 1,...,µ N ). Defne the statstc t µ ln L(µ) L(ˆµ),
More informationTHE ROYAL STATISTICAL SOCIETY 2006 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE
THE ROYAL STATISTICAL SOCIETY 6 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutons to assst canddates preparng for the eamnatons n future years and for
More information/ n ) are compared. The logic is: if the two
STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence
More informationA Robust Method for Calculating the Correlation Coefficient
A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More information10-701/ Machine Learning, Fall 2005 Homework 3
10-701/15-781 Machne Learnng, Fall 2005 Homework 3 Out: 10/20/05 Due: begnnng of the class 11/01/05 Instructons Contact questons-10701@autonlaborg for queston Problem 1 Regresson and Cross-valdaton [40
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationEconomics 130. Lecture 4 Simple Linear Regression Continued
Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More informationChapter 14 Simple Linear Regression
Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng
More informationChapter 3 Describing Data Using Numerical Measures
Chapter 3 Student Lecture Notes 3-1 Chapter 3 Descrbng Data Usng Numercal Measures Fall 2006 Fundamentals of Busness Statstcs 1 Chapter Goals To establsh the usefulness of summary measures of data. The
More informationCorrelation and Regression. Correlation 9.1. Correlation. Chapter 9
Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,
More informationSampling Theory MODULE VII LECTURE - 23 VARYING PROBABILITY SAMPLING
Samplng heory MODULE VII LECURE - 3 VARYIG PROBABILIY SAMPLIG DR. SHALABH DEPARME OF MAHEMAICS AD SAISICS IDIA ISIUE OF ECHOLOGY KAPUR he smple random samplng scheme provdes a random sample where every
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationMATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)
1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons
More informationNANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MTH352/MH3510 Regression Analysis
NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION 014-015 MTH35/MH3510 Regresson Analyss December 014 TIME ALLOWED: HOURS INSTRUCTIONS TO CANDIDATES 1. Ths examnaton paper contans FOUR (4) questons
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationU.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017
U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More informationEstimation: Part 2. Chapter GREG estimation
Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationCOS 521: Advanced Algorithms Game Theory and Linear Programming
COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton
More informationStatistics MINITAB - Lab 2
Statstcs 20080 MINITAB - Lab 2 1. Smple Lnear Regresson In smple lnear regresson we attempt to model a lnear relatonshp between two varables wth a straght lne and make statstcal nferences concernng that
More informationChapter 15 - Multiple Regression
Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More informationProbability Theory. The nth coefficient of the Taylor series of f(k), expanded around k = 0, gives the nth moment of x as ( ik) n n!
8333: Statstcal Mechancs I Problem Set # 3 Solutons Fall 3 Characterstc Functons: Probablty Theory The characterstc functon s defned by fk ep k = ep kpd The nth coeffcent of the Taylor seres of fk epanded
More informationLecture Notes on Linear Regression
Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume
More informationChapter 12 Analysis of Covariance
Chapter Analyss of Covarance Any scentfc experment s performed to know somethng that s unknown about a group of treatments and to test certan hypothess about the correspondng treatment effect When varablty
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationResource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis
Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques
More informationj) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1
Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Mamum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models for
More informationPhysicsAndMathsTutor.com
PhscsAndMathsTutor.com phscsandmathstutor.com June 005 5. The random varable X has probablt functon k, = 1,, 3, P( X = ) = k ( + 1), = 4, 5, where k s a constant. (a) Fnd the value of k. (b) Fnd the eact
More informationCredit Card Pricing and Impact of Adverse Selection
Credt Card Prcng and Impact of Adverse Selecton Bo Huang and Lyn C. Thomas Unversty of Southampton Contents Background Aucton model of credt card solctaton - Errors n probablty of beng Good - Errors n
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VIII LECTURE - 34 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS EFFECTS MODEL Dr Shalabh Department of Mathematcs and Statstcs Indan
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More informationChapter 15 Student Lecture Notes 15-1
Chapter 15 Student Lecture Notes 15-1 Basc Busness Statstcs (9 th Edton) Chapter 15 Multple Regresson Model Buldng 004 Prentce-Hall, Inc. Chap 15-1 Chapter Topcs The Quadratc Regresson Model Usng Transformatons
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationInterval Estimation in the Classical Normal Linear Regression Model. 1. Introduction
ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model
More information4.3 Poisson Regression
of teratvely reweghted least squares regressons (the IRLS algorthm). We do wthout gvng further detals, but nstead focus on the practcal applcaton. > glm(survval~log(weght)+age, famly="bnomal", data=baby)
More informationChapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of
Chapter 7 Generalzed and Weghted Least Squares Estmaton The usual lnear regresson model assumes that all the random error components are dentcally and ndependently dstrbuted wth constant varance. When
More informationChapter 9: Statistical Inference and the Relationship between Two Variables
Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,
More informationLecture 16 Statistical Analysis in Biomaterials Research (Part II)
3.051J/0.340J 1 Lecture 16 Statstcal Analyss n Bomaterals Research (Part II) C. F Dstrbuton Allows comparson of varablty of behavor between populatons usng test of hypothess: σ x = σ x amed for Brtsh statstcan
More informationModule 9. Lecture 6. Duality in Assignment Problems
Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept
More informationProblem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationCS-433: Simulation and Modeling Modeling and Probability Review
CS-433: Smulaton and Modelng Modelng and Probablty Revew Exercse 1. (Probablty of Smple Events) Exercse 1.1 The owner of a camera shop receves a shpment of fve cameras from a camera manufacturer. Unknown
More informationPredictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore
Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models
More informationβ0 + β1xi and want to estimate the unknown
SLR Models Estmaton Those OLS Estmates Estmators (e ante) v. estmates (e post) The Smple Lnear Regresson (SLR) Condtons -4 An Asde: The Populaton Regresson Functon B and B are Lnear Estmators (condtonal
More informationHere is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)
Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,
More informationCS286r Assign One. Answer Key
CS286r Assgn One Answer Key 1 Game theory 1.1 1.1.1 Let off-equlbrum strateges also be that people contnue to play n Nash equlbrum. Devatng from any Nash equlbrum s a weakly domnated strategy. That s,
More informationJoint Statistical Meetings - Biopharmaceutical Section
Iteratve Ch-Square Test for Equvalence of Multple Treatment Groups Te-Hua Ng*, U.S. Food and Drug Admnstraton 1401 Rockvlle Pke, #200S, HFM-217, Rockvlle, MD 20852-1448 Key Words: Equvalence Testng; Actve
More informationSimulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests
Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth
More informationAmiri s Supply Chain Model. System Engineering b Department of Mathematics and Statistics c Odette School of Business
Amr s Supply Chan Model by S. Ashtab a,, R.J. Caron b E. Selvarajah c a Department of Industral Manufacturng System Engneerng b Department of Mathematcs Statstcs c Odette School of Busness Unversty of
More informationPopulation element: 1 2 N. 1.1 Sampling with Replacement: Hansen-Hurwitz Estimator(HH)
Chapter 1 Samplng wth Unequal Probabltes Notaton: Populaton element: 1 2 N varable of nterest Y : y1 y2 y N Let s be a sample of elements drawn by a gven samplng method. In other words, s s a subset of
More informationSDMML HT MSc Problem Sheet 4
SDMML HT 06 - MSc Problem Sheet 4. The recever operatng characterstc ROC curve plots the senstvty aganst the specfcty of a bnary classfer as the threshold for dscrmnaton s vared. Let the data space be
More informationLimited Dependent Variables
Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages
More informationLecture 6 More on Complete Randomized Block Design (RBD)
Lecture 6 More on Complete Randomzed Block Desgn (RBD) Multple test Multple test The multple comparsons or multple testng problem occurs when one consders a set of statstcal nferences smultaneously. For
More informationBasic Business Statistics, 10/e
Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson
More informationStatistics Chapter 4
Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment
More informationBayesian Learning. Smart Home Health Analytics Spring Nirmalya Roy Department of Information Systems University of Maryland Baltimore County
Smart Home Health Analytcs Sprng 2018 Bayesan Learnng Nrmalya Roy Department of Informaton Systems Unversty of Maryland Baltmore ounty www.umbc.edu Bayesan Learnng ombnes pror knowledge wth evdence to
More informationMIMA Group. Chapter 2 Bayesian Decision Theory. School of Computer Science and Technology, Shandong University. Xin-Shun SDU
Group M D L M Chapter Bayesan Decson heory Xn-Shun Xu @ SDU School of Computer Scence and echnology, Shandong Unversty Bayesan Decson heory Bayesan decson theory s a statstcal approach to data mnng/pattern
More informationMath 217 Fall 2013 Homework 2 Solutions
Math 17 Fall 013 Homework Solutons Due Thursday Sept. 6, 013 5pm Ths homework conssts of 6 problems of 5 ponts each. The total s 30. You need to fully justfy your answer prove that your functon ndeed has
More informationprinceton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg
prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there
More informationOn the Multicriteria Integer Network Flow Problem
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of
More informationIntroduction to Regression
Introducton to Regresson Dr Tom Ilvento Department of Food and Resource Economcs Overvew The last part of the course wll focus on Regresson Analyss Ths s one of the more powerful statstcal technques Provdes
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationStatistical analysis using matlab. HY 439 Presented by: George Fortetsanakis
Statstcal analyss usng matlab HY 439 Presented by: George Fortetsanaks Roadmap Probablty dstrbutons Statstcal estmaton Fttng data to probablty dstrbutons Contnuous dstrbutons Contnuous random varable X
More informationExpected Value and Variance
MATH 38 Expected Value and Varance Dr. Neal, WKU We now shall dscuss how to fnd the average and standard devaton of a random varable X. Expected Value Defnton. The expected value (or average value, or
More informationISQS 6348 Final Open notes, no books. Points out of 100 in parentheses. Y 1 ε 2
ISQS 6348 Fnal Open notes, no books. Ponts out of 100 n parentheses. 1. The followng path dagram s gven: ε 1 Y 1 ε F Y 1.A. (10) Wrte down the usual model and assumptons that are mpled by ths dagram. Soluton:
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experments- MODULE LECTURE - 6 EXPERMENTAL DESGN MODELS Dr. Shalabh Department of Mathematcs and Statstcs ndan nsttute of Technology Kanpur Two-way classfcaton wth nteractons
More informationLearning Objectives for Chapter 11
Chapter : Lnear Regresson and Correlaton Methods Hldebrand, Ott and Gray Basc Statstcal Ideas for Managers Second Edton Learnng Objectves for Chapter Usng the scatterplot n regresson analyss Usng the method
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More informationRELIABILITY ASSESSMENT
CHAPTER Rsk Analyss n Engneerng and Economcs RELIABILITY ASSESSMENT A. J. Clark School of Engneerng Department of Cvl and Envronmental Engneerng 4a CHAPMAN HALL/CRC Rsk Analyss for Engneerng Department
More informationLecture 3: Probability Distributions
Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the
More information