An Algebraic Connection between Ordinary Lease-square Regression and Regression though the Origin
|
|
- Marjory Wheeler
- 5 years ago
- Views:
Transcription
1 03 Hawa Uverst Iteratoal Cofereces Educato & Techolog Math & Egeerg Techolog Jue 0 th to Jue th Ala Moaa Hotel, Hoolulu, Hawa A Algebrac Coecto betwee Ordar Lease-square egresso ad egresso though the Org Dr. Xaohu Zhog Uverst of Detrot Merc, Detrot, M
2 A Algebrac Coecto betwee Ordar Lease-square egresso ad egresso though the Org Xaohu Zhog Uverst of Detrot Merc, Detrot, USA Kewords: egresso; egresso through the org; Breakdow pots; squared. Abstract Ordar least-square regressools or regresso through the orgto? That s the questo. Ths paper tres to establsh a algebrac relato of the slopes ad squares betwee these two models ad stud the coecto betwee them. Oe of the results ca be used as a pedagogcal tool to costruct data set wth breakdow pot. Itroducto I the frst course of statstcs, OLS model s alwas the oe beg troduced. However, the realt, especall some phscal model, TO ma be more apprecate. For ths specal case of smple lear regresso, most tetbooks dscuss t the same as a specal case of the OSL b droppg the costat term whle others cautousl war that ot to use ths model uless ecessar. Ma lteratures dcted that these models are ot comparable. But s there a coecto betwee them? Tradtoall, the classcal smple lear regresso model α β was used to ft the observatos for two varables ad for coeffcets ca be estmated as β α β 3 b the ordar least squares OLS method, wth otato for the estmator of α ad β for smplct.,,...,, where the,. Here we use the same
3 Ths model was wdel used a wde rage of areas cludg egeerg, socal studes, boscece, etc. I ths model, oe mportat statstcs for checkg whether the model s a good ft s SSSSSS SSSSSS SSSSSS SSSSSS where SSSSSS, SSSSSS ıı ad SSSSSS ıı. Ths dett s true because ıı ıı 0. A geeral rule of thumb s that the closer the 4 s to, the better ft the model s to the observatos. O the other had, the same set of data ca also be ftted to the lear model: β 5 Such a model s called regresso through the org TO. I ths model the coeffcet s gve b wth the correspodg β 6 s gve b SS SST However dett 4 s o loger true. ˆ I ma practcal stuatos, TO s ecessar. Such ecesst was well dscussed b Casella[983] ad Esehauer [003]. The approprateess of adoptg ether OLS or TO model was also dscussed these two papers. It was cocluded that regresso through the org s a mportat ad useful tool appled statstcs, but t remas a subject of pedagogcal eglect, cotrovers ad cofuso Esehauer [003] because the squares ad other statstcs are ot comparable. Whle calculatg the basc regresso model t s ow farl eas usg a statstcal software or eve hadheld calculator, the TO model s also just oe clck awa. Practtoers other felds are stll ot clear the dffereces betwee these two models. Eve SPSS there s such dsclamer: For regresso through the org the o-tercept model, square measures the proporto of the varablt the depedet varable about the org eplaed b regresso. Ths CANNOT be compared to Square for models whch clude a tercept. Some also observed that most of the cases, both squares ad F both crease from OLS to TO. Is ths alwas true? If so, what codtos wll make them larger? What s the relatoshp betwee these statstcs? What else ca we look for whle selectg a approprate model? These are few questos we wat to aswer ths paper usg smple algebra ad calculus techques. 7
4 Augmeted Data Oe wa to stud the relato betwee these two models s to add a specal augmeted pot,,, Casella[983]. The leverage mpact of ths pot was studed ad was made use for comparg the two models. To lear the coecto betwee the OLS ad TO models, we vestgate a broader model b troducg a geeral augmeted pot, kk, kk to the data set wth k beg a arbtrar costat. If we deote ad, the smple algebra shows that r where k r 8 The OLS model wth the augmeted pot wll have the followg parameters: r r r β ] [ ] [ r r r SST SS r If r, the k, ad β, ad ] [ whch agree wth ad 4 for the OLS. Ths meas that the parameters above are those for the OLS wth the orgal data set. Whe 0 r, the k, ad 0 β, ad ] [ 0
5 whch are eactl 6 ad 7 for the TO. Thus we restrct r to be betwee 0 ad wth k [, ] ad the two models ca be obtaed b a ufed OLS method wth a parameter r [0,]. We wll stud how the model parameters chage from OLS to TO b varg r from to 0. The slopes of the regresso models ad breakdow pot I both models, OSL ad TO, the slope β r plas a mportat role the predcto. The sg of the slope dcates the drecto of the depedet varable learl correlated wth the depedet varable ad the magtude tells the rate of chage. For the purpose of ths stud, we wll ol cosder the cases whe 0 ad 0. Actuall, f both of these meas are 0, the OSL wll be eactl TO alread. Now we ca wrte where aa r r a β r m 9 r r b, bb, ad m. Wthout lost of geeralt, we wll cosder the case whe M > 0 the results wll be opposte whe M < 0. I addto, we wll avod the rare case whe a b. Notce that b >, we wll aalze how the slope chages from OSL to TO b smpl lookg at the graph of the ratoal b a fucto β r m`. r b
6 From the graph, t ca be see that β r s alwas a mootoc fucto of r [0,]. The locato of the statstcs a relatve to ths terval determes the sg of β r ad whether t s creasg or decreasg. The dfferet cases ca be summarzed as follows. Case a: The slope of OLS s postve ad greater tha the slope of TO, or 0 < β 0 < β r < β for r 0,, ff a > b. We see that the graph of the ratoal fucto 9 s above m ad creasg for r [0,]. Traslatg to the OSL ad TO model, t ca be terpreted as that the slope of OSL s greater tha m, as t decreases toward the slope of TO whch s also greater tha m. Notce that the le obtaed wth r 0 s ot the real TO, but t s a le parallel to the TO. Case b: The slope of OLS s postve ad smaller tha that of the TO, or β 0 > β r > β > 0 for r 0,, ff < a < b. Case c: The slope of OLS s egatve ad smaller tha that of the TO, or 0 > β 0 > β > β for r 0,, ff a < 0.
7 Case d: Ths s the most terestg case: The sg of the slope of OLS s egatve ad the sg of the slope of TO s postve, or β 0 < 0 < β, ff 0 < a <. Furthermore β a 0, ths partcular regresso le wll have a slope 0. These observatos ma ot be ver sgfcat ow. But the last case ca be used as a pedagog method to costruct the data set wth breakdow pots. Wth ths method, smple algebra ca be used costruct the data. There are ma was to defe breakdow pots. The are the pots a set of data so cotamated such that the model does ot cove useful formato. Oe smple defto s foud Cha[00]. Defto: The breakdow pot of a procedure for fttg a le to pars of bvarate data s defed as the mmum proporto of the sample that, whe replaced b sutabl chose outlers, ca drve the slope to ft or zero, Cha [00]. It was cocluded that the slope β model caot tolerate wth eve oe outler wth a breakdow pot of. Cha[00] gave a algebrac method b tral ad error of asmptotc breakdow pot. Here we ca provde aother method of costructg a set of data wth a ver good OLS ft, but wth oe outler, the regresso le becomes totall useless, meag that the slope becomes eactl zero. To costruct such a eample, we ca start wth a set that obvousl have a egatve slope OLS ad postve slope TO. Such data set ca be geerated wth a le such β α ε, where β < 0 ad α > 0, ad ε ~ N0, σ for postve pars of,. A TO for ths set wll have a postve slope because egatve slope wll produce all egatve predcted values. O the other had the slope of OLS should be egatve because t s estmatg β 0. Thus, from the result case d, t ca be cocluded that the statstcs a must be betwee 0 ad. Followg eample llustrates the process. Eample: We start wth the smplest set of data: 8, 0, 9, 99, 0, 98. The OLS model s
8 .5.83 wth whch s cosdered a ver good ft. If TO s troduced, we wll have Usg Tredle commet Ecel wll produce a meagless result Ths pheomea s the result of ccorect mplemetato of the squared formula dscussed Esehauer [003]. However, the statstcs a wll help fdg a outler. Lettg r a ad solve for k from 8, we have k a The augmeted pot s k, 9.6, 06. Now the OSL o the set of data 8, 0, 9, 99, 9.6, 06, 0, 98 wll have a slope 0 whch o oe wats to have OLS ad TO of Three pots ² ² OLS wth oe augmeted pot as the breakdow pot ² The advatage of ths method s to have algebrac steps to create a set that show that the breakpot of the slope of a SLO has a break pot of. Sce the slope β r vared cotuousl betwee β 0 ad β, ths meas that we ca also create a set of data wth oe etra pot to have the slope that s betwee these two slopes a smlar fasho. But how well s the fttg? We wll dscuss ths b vestgatg chage of a dcator et. The Applcators alwas get ected whe the saw that becomes bgger whle movg from OLS to TO most of the observatos [quote about the webste]. However, t ma ot be ver meagful to have a bgger. Followg, we wll fd out some cases that we are certa that
9 the becomes bgger, whle other cases t ca be affrmed that t s smaller. More mportat, we wll use the correct defto so that The formula of wll ot become egatve. should be ver famlar to most studets eve though t s slghtl complcated tha the slope formula. ecall that for a set of data wth augmeted pot defed secto, r r r a 0 r r r b r c where a ad b are defed last secto, ad c. For r, the square r s that for the a set of data, thus t s alwas true that 0 r. Usg ths defto, the square the eample s To stud ths ratoal fucto, we wll cosder all r ecept the values of b ad c where ths fucto has verdcal asmptotes, but the value of the fucto wll eceed or become egatve whe r >. We wll b c also avod the ver rare ad specal cases whe a b, b c, a c ad a, because the are all equvalet ad t happes f ad ol f m for all,,..,. Wthout lost of geeralt, we assume that b < c. Elemetar calculus reveals that r should have two crtcal pots r a ad r bc a b c. We wll see that the locato of these two crtcal b c a pots determes how r chages o the terval [0, ]. Frst, we see that oe ad ol oe of the crtcal pots must be betwee b ad c. The other crtcal must be smaller tha b, otherwse, r wll become greater tha for all r <. As a b-product, ths result ca be summarzed as a theorem: Theorem: Let {,,,.. } be pars of pots of reals such that 0, 0, ad m for all,,...,, the oe of the followg must be true: bc a b c a < m b, c < < ma b, c b c a or bc a b c < m b, c < a < ma b, c b c a
10 where a, b, ad c. Wth the result of ths theorem, the chages of squares from OLS to TO ca be summarzed as follows b vestgatg the graph of the ratoal fucto defed b 0. Case I: square s smaller whe movg from OLS to TO, meag r s creasg whe r chages from 0 to ff rr < 0, or. Case II: square s greater whe movg from OLS to TO, meag r s decreasg whe r chages from 0 to ff rr >, ad. Case III: If 0 < r <, or, the r wll reach a mmum at r. We wll ot be able to judge whch square s greater wthout actual calculatg them. But such a case, t s possble to costruct a data set that both 0 ad are the same. Cocluso: OLS ad TO models rema to be a mth. However, wth basc algebra, we ca establsh certa relatoshp betwee ther slopes ad square. Such relatoshp ca be used as a pedagog tool to reveal to studet the fact that square s ot alwas bgger wth TO. The future work wll be to establsh smlar relatoshp betwee the F statstcs. efereces Casella, G Leverage ad egresso through the Org. Amerca Statstca,
11 37, Cha, W. 00, Teachg the Cocept of Breakdow Pot Smple Lear egresso, Iteratoal Joural of Mathematcal Educato Scece ad Techolog, Volume 3, No.5, Eshehauer, J. Autum 003, egresso through the Org, Teachg Statstcs, Volume 5, Number 3, 76-80
Objectives of Multiple Regression
Obectves of Multple Regresso Establsh the lear equato that best predcts values of a depedet varable Y usg more tha oe eplaator varable from a large set of potetal predctors {,,... k }. Fd that subset of
More information12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model
1. Estmatg Model parameters Assumptos: ox ad y are related accordg to the smple lear regresso model (The lear regresso model s the model that says that x ad y are related a lear fasho, but the observed
More informationCorrelation and Simple Linear Regression
Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uverst Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationChapter Two. An Introduction to Regression ( )
ubject: A Itroducto to Regresso Frst tage Chapter Two A Itroducto to Regresso (018-019) 1 pg. ubject: A Itroducto to Regresso Frst tage A Itroducto to Regresso Regresso aalss s a statstcal tool for the
More informationStatistics. Correlational. Dr. Ayman Eldeib. Simple Linear Regression and Correlation. SBE 304: Linear Regression & Correlation 1/3/2018
/3/08 Sstems & Bomedcal Egeerg Departmet SBE 304: Bo-Statstcs Smple Lear Regresso ad Correlato Dr. Ama Eldeb Fall 07 Descrptve Orgasg, summarsg & descrbg data Statstcs Correlatoal Relatoshps Iferetal Geeralsg
More informationMultiple Linear Regression Analysis
LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple
More informationSimple Linear Regression
Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato
More informationLecture 1: Introduction to Regression
Lecture : Itroducto to Regresso A Eample: Eplag State Homcde Rates What kds of varables mght we use to epla/predct state homcde rates? Let s cosder just oe predctor for ow: povert Igore omtted varables,
More informationMidterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes
coometrcs, CON Sa Fracsco State Uversty Mchael Bar Sprg 5 Mdterm am, secto Soluto Thursday, February 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes eam.. No calculators of ay kd are allowed..
More informationChapter Business Statistics: A First Course Fifth Edition. Learning Objectives. Correlation vs. Regression. In this chapter, you learn:
Chapter 3 3- Busess Statstcs: A Frst Course Ffth Edto Chapter 2 Correlato ad Smple Lear Regresso Busess Statstcs: A Frst Course, 5e 29 Pretce-Hall, Ic. Chap 2- Learg Objectves I ths chapter, you lear:
More informationESS Line Fitting
ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here
More informationThird handout: On the Gini Index
Thrd hadout: O the dex Corrado, a tala statstca, proposed (, 9, 96) to measure absolute equalt va the mea dfferece whch s defed as ( / ) where refers to the total umber of dvduals socet. Assume that. The
More informationSimple Linear Regression
Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uversty Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal
More informationMidterm Exam 1, section 2 (Solution) Thursday, February hour, 15 minutes
coometrcs, CON Sa Fracsco State Uverst Mchael Bar Sprg 5 Mdterm xam, secto Soluto Thursda, Februar 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes exam.. No calculators of a kd are allowed..
More informationCorrelation and Regression Analysis
Chapter V Correlato ad Regresso Aalss R. 5.. So far we have cosdered ol uvarate dstrbutos. Ma a tme, however, we come across problems whch volve two or more varables. Ths wll be the subject matter of the
More informationMultiple Choice Test. Chapter Adequacy of Models for Regression
Multple Choce Test Chapter 06.0 Adequac of Models for Regresso. For a lear regresso model to be cosdered adequate, the percetage of scaled resduals that eed to be the rage [-,] s greater tha or equal to
More informationLecture 1: Introduction to Regression
Lecture : Itroducto to Regresso A Eample: Eplag State Homcde Rates What kds of varables mght we use to epla/predct state homcde rates? Let s cosder just oe predctor for ow: povert Igore omtted varables,
More informationLecture 2: The Simple Regression Model
Lectre Notes o Advaced coometrcs Lectre : The Smple Regresso Model Takash Yamao Fall Semester 5 I ths lectre we revew the smple bvarate lear regresso model. We focs o statstcal assmptos to obta based estmators.
More informationFunctions of Random Variables
Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,
More informationMultiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades
STAT 101 Dr. Kar Lock Morga 11/20/12 Exam 2 Grades Multple Regresso SECTIONS 9.2, 10.1, 10.2 Multple explaatory varables (10.1) Parttog varablty R 2, ANOVA (9.2) Codtos resdual plot (10.2) Trasformatos
More information( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model
Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch
More informationJohns Hopkins University Department of Biostatistics Math Review for Introductory Courses
Johs Hopks Uverst Departmet of Bostatstcs Math Revew for Itroductor Courses Ratoale Bostatstcs courses wll rel o some fudametal mathematcal relatoshps, fuctos ad otato. The purpose of ths Math Revew s
More informationJohns Hopkins University Department of Biostatistics Math Review for Introductory Courses
Johs Hopks Uverst Departmet of Bostatstcs Math Revew for Itroductor Courses Ratoale Bostatstcs courses wll rel o some fudametal mathematcal relatoshps, fuctos ad otato. The purpose of ths Math Revew s
More informationPTAS for Bin-Packing
CS 663: Patter Matchg Algorthms Scrbe: Che Jag /9/00. Itroducto PTAS for B-Packg The B-Packg problem s NP-hard. If we use approxmato algorthms, the B-Packg problem could be solved polyomal tme. For example,
More informationLecture 8: Linear Regression
Lecture 8: Lear egresso May 4, GENOME 56, Sprg Goals Develop basc cocepts of lear regresso from a probablstc framework Estmatg parameters ad hypothess testg wth lear models Lear regresso Su I Lee, CSE
More informationCLASS NOTES. for. PBAF 528: Quantitative Methods II SPRING Instructor: Jean Swanson. Daniel J. Evans School of Public Affairs
CLASS NOTES for PBAF 58: Quattatve Methods II SPRING 005 Istructor: Jea Swaso Dael J. Evas School of Publc Affars Uversty of Washgto Ackowledgemet: The structor wshes to thak Rachel Klet, Assstat Professor,
More informationChapter 2 Supplemental Text Material
-. Models for the Data ad the t-test Chapter upplemetal Text Materal The model preseted the text, equato (-3) s more properl called a meas model. ce the mea s a locato parameter, ths tpe of model s also
More informationb. There appears to be a positive relationship between X and Y; that is, as X increases, so does Y.
.46. a. The frst varable (X) s the frst umber the par ad s plotted o the horzotal axs, whle the secod varable (Y) s the secod umber the par ad s plotted o the vertcal axs. The scatterplot s show the fgure
More informationRegresso What s a Model? 1. Ofte Descrbe Relatoshp betwee Varables 2. Types - Determstc Models (o radomess) - Probablstc Models (wth radomess) EPI 809/Sprg 2008 9 Determstc Models 1. Hypothesze
More informationEconometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More informationPart 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))
art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the
More informationOrdinary Least Squares Regression. Simple Regression. Algebra and Assumptions.
Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos
More informationStatistics MINITAB - Lab 5
Statstcs 10010 MINITAB - Lab 5 PART I: The Correlato Coeffcet Qute ofte statstcs we are preseted wth data that suggests that a lear relatoshp exsts betwee two varables. For example the plot below s of
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationSTA302/1001-Fall 2008 Midterm Test October 21, 2008
STA3/-Fall 8 Mdterm Test October, 8 Last Name: Frst Name: Studet Number: Erolled (Crcle oe) STA3 STA INSTRUCTIONS Tme allowed: hour 45 mutes Ads allowed: A o-programmable calculator A table of values from
More informationENGI 3423 Simple Linear Regression Page 12-01
ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable
More informationLecture 07: Poles and Zeros
Lecture 07: Poles ad Zeros Defto of poles ad zeros The trasfer fucto provdes a bass for determg mportat system respose characterstcs wthout solvg the complete dfferetal equato. As defed, the trasfer fucto
More informationComparison of Dual to Ratio-Cum-Product Estimators of Population Mean
Research Joural of Mathematcal ad Statstcal Sceces ISS 30 6047 Vol. 1(), 5-1, ovember (013) Res. J. Mathematcal ad Statstcal Sc. Comparso of Dual to Rato-Cum-Product Estmators of Populato Mea Abstract
More informationCHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More informationLINEAR REGRESSION ANALYSIS
LINEAR REGRESSION ANALYSIS MODULE V Lecture - Correctg Model Iadequaces Through Trasformato ad Weghtg Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Aalytcal methods for
More informationStudy of Correlation using Bayes Approach under bivariate Distributions
Iteratoal Joural of Scece Egeerg ad Techolog Research IJSETR Volume Issue Februar 4 Stud of Correlato usg Baes Approach uder bvarate Dstrbutos N.S.Padharkar* ad. M.N.Deshpade** *Govt.Vdarbha Isttute of
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationLecture Notes Types of economic variables
Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte
More informationMEASURES OF DISPERSION
MEASURES OF DISPERSION Measure of Cetral Tedecy: Measures of Cetral Tedecy ad Dsperso ) Mathematcal Average: a) Arthmetc mea (A.M.) b) Geometrc mea (G.M.) c) Harmoc mea (H.M.) ) Averages of Posto: a) Meda
More informationProbability and. Lecture 13: and Correlation
933 Probablty ad Statstcs for Software ad Kowledge Egeers Lecture 3: Smple Lear Regresso ad Correlato Mocha Soptkamo, Ph.D. Outle The Smple Lear Regresso Model (.) Fttg the Regresso Le (.) The Aalyss of
More informationTHE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE
THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the
More informationresidual. (Note that usually in descriptions of regression analysis, upper-case
Regresso Aalyss Regresso aalyss fts or derves a model that descres the varato of a respose (or depedet ) varale as a fucto of oe or more predctor (or depedet ) varales. The geeral regresso model s oe of
More informationCan we take the Mysticism Out of the Pearson Coefficient of Linear Correlation?
Ca we tae the Mstcsm Out of the Pearso Coeffcet of Lear Correlato? Itroducto As the ttle of ths tutoral dcates, our purpose s to egeder a clear uderstadg of the Pearso coeffcet of lear correlato studets
More informationLaboratory I.10 It All Adds Up
Laboratory I. It All Adds Up Goals The studet wll work wth Rema sums ad evaluate them usg Derve. The studet wll see applcatos of tegrals as accumulatos of chages. The studet wll revew curve fttg sklls.
More informationi 2 σ ) i = 1,2,...,n , and = 3.01 = 4.01
ECO 745, Homework 6 Le Cabrera. Assume that the followg data come from the lear model: ε ε ~ N, σ,,..., -6. -.5 7. 6.9 -. -. -.9. -..6.4.. -.6 -.7.7 Fd the mamum lkelhood estmates of,, ad σ ε s.6. 4. ε
More informationElementary Slopes in Simple Linear Regression. University of Montana and College of St. Catherine Missoula, MT St.
Elemetar Slopes Smple Lear Regresso Rud Gdeo Adele Mare Rotha, CSJ Uverst of Motaa ad College of St. Cathere Mssoula, MT 598 St. Paul, MN 5505 I a bvarate data plot, ever two pots determe a elemetar slope.
More informationStatistics: Unlocking the Power of Data Lock 5
STAT 0 Dr. Kar Lock Morga Exam 2 Grades: I- Class Multple Regresso SECTIONS 9.2, 0., 0.2 Multple explaatory varables (0.) Parttog varablty R 2, ANOVA (9.2) Codtos resdual plot (0.2) Exam 2 Re- grades Re-
More informationChapter 13 Student Lecture Notes 13-1
Chapter 3 Studet Lecture Notes 3- Basc Busess Statstcs (9 th Edto) Chapter 3 Smple Lear Regresso 4 Pretce-Hall, Ic. Chap 3- Chapter Topcs Types of Regresso Models Determg the Smple Lear Regresso Equato
More informationEstimation of Stress- Strength Reliability model using finite mixture of exponential distributions
Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur
More informationAnalysis of Lagrange Interpolation Formula
P IJISET - Iteratoal Joural of Iovatve Scece, Egeerg & Techology, Vol. Issue, December 4. www.jset.com ISS 348 7968 Aalyss of Lagrage Iterpolato Formula Vjay Dahya PDepartmet of MathematcsMaharaja Surajmal
More informationExample: Multiple linear regression. Least squares regression. Repetition: Simple linear regression. Tron Anders Moger
Example: Multple lear regresso 5000,00 4000,00 Tro Aders Moger 0.0.007 brthweght 3000,00 000,00 000,00 0,00 50,00 00,00 50,00 00,00 50,00 weght pouds Repetto: Smple lear regresso We defe a model Y = β0
More information: At least two means differ SST
Formula Card for Eam 3 STA33 ANOVA F-Test: Completely Radomzed Desg ( total umber of observatos, k = Number of treatmets,& T = total for treatmet ) Step : Epress the Clam Step : The ypotheses: :... 0 A
More informationε. Therefore, the estimate
Suggested Aswers, Problem Set 3 ECON 333 Da Hugerma. Ths s ot a very good dea. We kow from the secod FOC problem b) that ( ) SSE / = y x x = ( ) Whch ca be reduced to read y x x = ε x = ( ) The OLS model
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More informationMedian as a Weighted Arithmetic Mean of All Sample Observations
Meda as a Weghted Arthmetc Mea of All Sample Observatos SK Mshra Dept. of Ecoomcs NEHU, Shllog (Ida). Itroducto: Iumerably may textbooks Statstcs explctly meto that oe of the weakesses (or propertes) of
More informationDiscrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b
CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package
More informationAssignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)
Assgmet 5/MATH 7/Wter 00 Due: Frday, February 9 class (!) (aswers wll be posted rght after class) As usual, there are peces of text, before the questos [], [], themselves. Recall: For the quadratc form
More informationCHAPTER 8 REGRESSION AND CORRELATION
CHAPTER 8 REGREION AND CORRELATION Determg for relatoshps ad makg predctos based from sample formato s oe of the ma dea of data aalss. Everoe wats to aswer questos lke Ca I predct how ma uts I ll sell
More informationChapter 5 Properties of a Random Sample
Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample
More informationUNIT 2 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS
Numercal Computg -I UNIT SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS Structure Page Nos..0 Itroducto 6. Objectves 7. Ital Approxmato to a Root 7. Bsecto Method 8.. Error Aalyss 9.4 Regula Fals Method
More informationECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity
ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More informationLecture 3. Sampling, sampling distributions, and parameter estimation
Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called
More informationLecture Notes 2. The ability to manipulate matrices is critical in economics.
Lecture Notes. Revew of Matrces he ablt to mapulate matrces s crtcal ecoomcs.. Matr a rectagular arra of umbers, parameters, or varables placed rows ad colums. Matrces are assocated wth lear equatos. lemets
More informationAnalysis of Variance with Weibull Data
Aalyss of Varace wth Webull Data Lahaa Watthaacheewaul Abstract I statstcal data aalyss by aalyss of varace, the usual basc assumptos are that the model s addtve ad the errors are radomly, depedetly, ad
More informationLecture 2: Linear Least Squares Regression
Lecture : Lear Least Squares Regresso Dave Armstrog UW Mlwaukee February 8, 016 Is the Relatoshp Lear? lbrary(car) data(davs) d 150) Davs$weght[d]
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More informationMaximum Likelihood Estimation
Marquette Uverst Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Coprght 08 b Marquette Uverst Maxmum Lkelhood Estmato We have bee sag that ~
More informationChapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance
Chapter, Part A Aalyss of Varace ad Epermetal Desg Itroducto to Aalyss of Varace Aalyss of Varace: Testg for the Equalty of Populato Meas Multple Comparso Procedures Itroducto to Aalyss of Varace Aalyss
More informationIdeal multigrades with trigonometric coefficients
Ideal multgrades wth trgoometrc coeffcets Zarathustra Brady December 13, 010 1 The problem A (, k) multgrade s defed as a par of dstct sets of tegers such that (a 1,..., a ; b 1,..., b ) a j = =1 for all
More informationCHAPTER 2. = y ˆ β x (.1022) So we can write
CHAPTER SOLUTIONS TO PROBLEMS. () Let y = GPA, x = ACT, ad = 8. The x = 5.875, y = 3.5, (x x )(y y ) = 5.85, ad (x x ) = 56.875. From equato (.9), we obta the slope as ˆβ = = 5.85/56.875., rouded to four
More information= 1. UCLA STAT 13 Introduction to Statistical Methods for the Life and Health Sciences. Parameters and Statistics. Measures of Centrality
UCLA STAT Itroducto to Statstcal Methods for the Lfe ad Health Sceces Istructor: Ivo Dov, Asst. Prof. of Statstcs ad Neurology Teachg Assstats: Fred Phoa, Krste Johso, Mg Zheg & Matlda Hseh Uversty of
More informationLecture Notes Forecasting the process of estimating or predicting unknown situations
Lecture Notes. Ecoomc Forecastg. Forecastg the process of estmatg or predctg ukow stuatos Eample usuall ecoomsts predct future ecoomc varables Forecastg apples to a varet of data () tme seres data predctg
More informationUniversity of Belgrade. Faculty of Mathematics. Master thesis Regression and Correlation
Uversty of Belgrade Vrtual Lbrary of Faculty of Mathematcs - Uversty of Belgrade Faculty of Mathematcs Master thess Regresso ad Correlato The caddate Supervsor Karma Ibrahm Soufya Vesa Jevremovć Jue 014
More informationRegression and the LMS Algorithm
CSE 556: Itroducto to Neural Netorks Regresso ad the LMS Algorthm CSE 556: Regresso 1 Problem statemet CSE 556: Regresso Lear regresso th oe varable Gve a set of N pars of data {, d }, appromate d b a
More informationPGE 310: Formulation and Solution in Geosystems Engineering. Dr. Balhoff. Interpolation
PGE 30: Formulato ad Soluto Geosystems Egeerg Dr. Balhoff Iterpolato Numercal Methods wth MATLAB, Recktewald, Chapter 0 ad Numercal Methods for Egeers, Chapra ad Caale, 5 th Ed., Part Fve, Chapter 8 ad
More informationd dt d d dt dt Also recall that by Taylor series, / 2 (enables use of sin instead of cos-see p.27 of A&F) dsin
Learzato of the Swg Equato We wll cover sectos.5.-.6 ad begg of Secto 3.3 these otes. 1. Sgle mache-fte bus case Cosder a sgle mache coected to a fte bus, as show Fg. 1 below. E y1 V=1./_ Fg. 1 The admttace
More informationL5 Polynomial / Spline Curves
L5 Polyomal / Sple Curves Cotets Coc sectos Polyomal Curves Hermte Curves Bezer Curves B-Sples No-Uform Ratoal B-Sples (NURBS) Mapulato ad Represetato of Curves Types of Curve Equatos Implct: Descrbe a
More information4. Standard Regression Model and Spatial Dependence Tests
4. Stadard Regresso Model ad Spatal Depedece Tests Stadard regresso aalss fals the presece of spatal effects. I case of spatal depedeces ad/or spatal heterogeet a stadard regresso model wll be msspecfed.
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More informationPermutation Tests for More Than Two Samples
Permutato Tests for ore Tha Two Samples Ferry Butar Butar, Ph.D. Abstract A F statstc s a classcal test for the aalyss of varace where the uderlyg dstrbuto s a ormal. For uspecfed dstrbutos, the permutato
More informationSection l h l Stem=Tens. 8l Leaf=Ones. 8h l 03. 9h 58
Secto.. 6l 34 6h 667899 7l 44 7h Stem=Tes 8l 344 Leaf=Oes 8h 5557899 9l 3 9h 58 Ths dsplay brgs out the gap the data: There are o scores the hgh 7's. 6. a. beams cylders 9 5 8 88533 6 6 98877643 7 488
More informationBivariate Vieta-Fibonacci and Bivariate Vieta-Lucas Polynomials
IOSR Joural of Mathematcs (IOSR-JM) e-issn: 78-78, p-issn: 19-76X. Volume 1, Issue Ver. II (Jul. - Aug.016), PP -0 www.osrjourals.org Bvarate Veta-Fboacc ad Bvarate Veta-Lucas Polomals E. Gokce KOCER 1
More informationCHAPTER 4 RADICAL EXPRESSIONS
6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube
More informationChapter 5 Transformation and Weighting to Correct Model Inadequacies
Chapter 5 Trasformato ad Weghtg to Correct Model Iadequaces The graphcal methods help detectg the volato of basc assumptos regresso aalss. Now we cosder the methods ad procedures for buldg the models through
More informationMeasures of Dispersion
Chapter 8 Measures of Dsperso Defto of Measures of Dsperso (page 31) A measure of dsperso s a descrptve summary measure that helps us characterze the data set terms of how vared the observatos are from
More informationEvaluating Polynomials
Uverst of Nebraska - Lcol DgtalCommos@Uverst of Nebraska - Lcol MAT Exam Expostor Papers Math the Mddle Isttute Partershp 7-7 Evaluatg Polomals Thomas J. Harrgto Uverst of Nebraska-Lcol Follow ths ad addtoal
More informationUNIT 7 RANK CORRELATION
UNIT 7 RANK CORRELATION Rak Correlato Structure 7. Itroucto Objectves 7. Cocept of Rak Correlato 7.3 Dervato of Rak Correlato Coeffcet Formula 7.4 Te or Repeate Raks 7.5 Cocurret Devato 7.6 Summar 7.7
More informationhp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations
HP 30S Statstcs Averages ad Stadard Devatos Average ad Stadard Devato Practce Fdg Averages ad Stadard Devatos HP 30S Statstcs Averages ad Stadard Devatos Average ad stadard devato The HP 30S provdes several
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationPhysics 114 Exam 2 Fall Name:
Physcs 114 Exam Fall 015 Name: For gradg purposes (do ot wrte here): Questo 1. 1... 3. 3. Problem Aswer each of the followg questos. Pots for each questo are dcated red. Uless otherwse dcated, the amout
More informationThe Mathematics of Portfolio Theory
The Matheatcs of Portfolo Theory The rates of retur of stocks, ad are as follows Market odtos state / scearo) earsh Neutral ullsh Probablty 0. 0.5 0.3 % 5% 9% -3% 3% % 5% % -% Notato: R The retur of stock
More informationCHAPTER 3 POSTERIOR DISTRIBUTIONS
CHAPTER 3 POSTERIOR DISTRIBUTIONS If scece caot measure the degree of probablt volved, so much the worse for scece. The practcal ma wll stck to hs apprecatve methods utl t does, or wll accept the results
More information7.0 Equality Contraints: Lagrange Multipliers
Systes Optzato 7.0 Equalty Cotrats: Lagrage Multplers Cosder the zato of a o-lear fucto subject to equalty costrats: g f() R ( ) 0 ( ) (7.) where the g ( ) are possbly also olear fuctos, ad < otherwse
More information