# CTL.SC0x Supply Chain Analytics

Save this PDF as:

Size: px
Start display at page:

Download "CTL.SC0x Supply Chain Analytics"

## Transcription

1 CTL.SC0x Supply Chai Aalytics Key Cocepts Documet V1.1 This documet cotais the Key Cocepts documets for week 6, lessos 1 ad 2 withi the SC0x course. These are meat to complemet, ot replace, the lesso videos ad slides. They are iteded to be refereces for you to use goig forward ad are based o the assumptio that you have leared the cocepts ad completed the practice problems. The first draft was created by Dr. Alexis Batema i the Fall of This is a draft of the material, so please post ay suggestios, correctios, or recommedatios to the Discussio Forum uder the topic thread Key Cocept Documets Improvemets. Thaks, Chris Caplice, Eva Poce ad the SC0x Teachig Commuity Fall 2016 v1 v1.1 Fall 2016 This work is licesed uder a Creative Commos Attributio NoCommercial ShareAlike 4.0 Iteratioal Licese.

2 Week 6: Buildig Predictive Models Learig Objectives Uderstad how to work with multiple variables. Be aware of data limitatios with size ad represetatio of populatio. Idetify how to test a hypothesis. Review ad apply the steps i the practice of regressio. Be able to aalyze regressio ad recogize issues. Summary of Lesso I this lesso we expaded our tool set of predictive models to iclude ordiary least squares regressio. The lesso equips us with the tools to build, ru ad iterpret a regressio model. I the first lesso, we are itroduced with how to work with multiple variables ad their iteractio. This icludes correlatio ad covariace, which measures how two variables chage together. As we review how to work with multiple variables, it is importat to keep i mid that the data sets supply chai maagers will deal with are largely samples, ot a populatio. This meas that the subset of data must be represetative of the populatio. The later part of the lesso itroduces hypothesis testig, which allows us to aswer ifereces about the data. The secod part of the week tackles liear regressio. Regressio is a very importat practice for supply chai professioal because it allows us to take multiple radom variables ad fid relatioships betwee them. I some ways, regressio becomes more of a art the a sciece. There are four mai steps to regressio: choosig with idepedet variables to iclude, collectig data, ruig the regressio, ad aalyzig the output (the most importat step). Key Cocepts Multiple Radom Variables Most situatios i practice ivolve the use ad iteractio of multiple radom variables or some combiatio of radom variables. We eed to be able to measure the relatioship betwee these RVs as well as uderstad how they iteract. Covariace ad Correlatio Covariace ad correlatio measure a certai kid of depedece betwee variables. If radom variables are positively correlated, higher tha average values of X are likely to occur with higher tha average values of Y. For egatively correlated radom variables, higher tha average values are likely to occur with lower tha average values of Y. It is importat to CTL.SC0x Supply Chai Aalytics 2

3 remember as the old, but ecessary sayig goes: correlatio does ot equal causality. This meas that you are fidig a mathematical relatioship ot a causal oe. Covariace Cov(X,Y) P(X,Y y i )[( X )(y i Y )] i1 i1 ( X )(y i Y ) Correlatio Coefficiet: is used to stadardize the covariace i order to better iterpret. It is a measure betwee 1 ad +1 that idicates the degree ad directio of the relatioship betwee two radom variables or sets of data. CORR(X,Y) COV(X,Y ) X Y Spreadsheet Fuctios Fuctio Microsoft Excel Google Sheets LibreOffice >Calc Covariace =COVAR(array,array) =COVAR(array,array) =COVAR(array;array) Correlatio =CORREL(array,array) =CORREL(array, array) =CORREL(array;array) Liear Fuctio of Radom Variables A liear relatioship exists betwee X ad Y whe a oe uit chage i X causes Y to chage by a fixed amout, regardless of how large or small X is. Formally, this is: Y = ax + b. The summary statistics of a liear fuctio of a Radom Variable are: Expected value: E[Y] = μ Y = aμ X + b Variace: VAR[Y]= σ 2 Y = a 2 σ 2 X Stadard Deviatio: σ Y = a σ X Sums of Radom Variables IF X ad Y are idepedet radom variables where W = ax + by, the the summary statistics are: Expected value: E[W] = aμ X + bμ Y Variace: VAR[W] = a 2 σ 2 X + b 2 σ 2 Y + 2abCOV(X,Y) = a 2 σ 2 X + b 2 σ 2 Y + 2abσ X σ Y CORR(X,Y) Stadard Deviatio: σ W = VAR[W] These relatios hold for ay distributio of X ad Y. However, if X ad Y are ~N, the W is ~N as well! CTL.SC0x Supply Chai Aalytics 3

4 Cetral Limit Theorem Cetral limit theorem states that the sample distributio of the mea of ay idepedet radom variable will be ormal or early ormal, if the sample size is large eough. Large eough is based o a few factors oe is accuracy (more sample poits will be required) as well as the shape of the uderlyig populatio. May statisticias suggest that 30, sometimes 40, is cosidered large eough. This is importat because is does t matter what distributios the radom variable follows. Ca be iterpreted as follows: X i,..x are iid with mea= ad stadard deviatio = σ o The sum of the radom variables is S =ΣX i o The mea of the radom variables is X = S / The, if is large (say > 30) o S is Normally distributed with mea = ad stadard deviatio σ o X is Normally distributed with mea = ad stadard deviatio σ/ Iferece Testig Samplig We eed to kow somethig about the sample to make ifereces about the populatio. The iferece is a coclusio reached o the basis of evidece ad reasoig. To make ifereces we eed to ask testable questios such as if the data fits a specific distributio or are two variables correlated? To uderstad these questios ad more we eed to uderstad samplig of a populatio. If samplig is doe correctly, the sample mea should be a estimator of the populatio mea as well as correspodig parameters. Populatio: is the etire set of uits of observatio. Sample: subset of the populatio. Parameter: describes the distributio of radom variable. Radom Sample: is a sample selected from the populatio so that each item is equally likely. Cofidece Itervals Cofidece itervals are used to describe the ucertaity associated with a sample estimate of a populatio parameter. CTL.SC0x Supply Chai Aalytics 4

5 Calculatig Cofidece Itervals Whe the >30 We ca assume: X ~N(μ,σ/ ) The level c of a cofidece iterval gives the probability that the iterval produced icludes the true value of the parameter. Where z is the correspodig z score correspodig to the area aroud the mea: z=1.65 for =.90, z=1.96 for =.95, z=2.81 for =.995 x zs, x zs For spreadsheets use: z = NORM.S.INV((1+β)/2) Whe 30 The we eed to use the t distributio, which is bell shaped ad symmetric aroud 0. Mea = 0, but Std Dev = (k/k 2) Where k is the degrees of freedom ad, geerally, k= 1 The value of c is a fuctio of β ad k Where c is the correspodig t statistic correspodig to the area aroud the mea. x cs, x cs CTL.SC0x Supply Chai Aalytics 5

6 For spreadsheets, use: c =T.INV.2T(1 β, k) There are some importat isights for cofidece itervals aroud the mea. There are tradeoffs betwee iterval (l), sample size () ad cofidece (b): Whe is fixed, usig a higher cofidece level b leads to a wider iterval, L. Whe cofidece level is fixed (b), icreasig sample size, leads to smaller iterval, L. Whe both ad cofidece level are fixed, we ca obtai a tighter iterval, L, by reducig the variability (i.e. small s ad s). Whe iterpretig cofidece itervals, a few thigs to keep i mid: Repeatedly takig samples ad fidig cofidece itervals leads to differet itervals each time, But b% of the resultig itervals would cotai the true mea. To costruct a b% cofidece iterval that is withi (+/ ) L of μ, the required sample size is: =z 2 *s 2 / L 2 Hypothesis Testig Hypothesis testig is a method for makig a choice betwee two mutually exclusive ad collectively exhaustive alteratives. I this practice, we make two hypotheses ad oly oe ca be true. Null Hypothesis (H 0 ) ad the Alterative Hypothesis (H 1 ). We test, at a specified sigificace level, to see if we ca Reject the Null hypothesis, or Accept the Null Hypothesis (or more correctly, do ot reject ). Two types of Mistakes i hypothesis testig: Type I: Reject the Null hypothesis whe i fact it is True (Alpha) Type II: Accept the Null hypothesis whe i fact it is False (Beta) We focus o Type I errors whe settig sigificace level (.05,.01) Three possible hypotheses or outcomes to a test Ukow distributio is the same as the kow distributio (Always H 0 ) Ukow distributio is higher tha the kow distributio Ukow distributio is lower tha the kow distributio Chi square test Chi Square test ca be used to measure the goodess of fit ad determie whether the data is distributed ormally. To use a chi square test, you typically will create a bucket of categories, c, cout the expected ad observed (actual) values i each category, ad calculate the chi square statistics ad fid the p value. If the p=value is less tha the level of sigificat, you will the reject the ull hypothesis. Observed Expected 2 2 Expected df c 1 CTL.SC0x Supply Chai Aalytics 6

7 Spreadsheet Fuctios: Fuctio Microsoft Excel Google Sheets LibreOffice >Calc Returs p value for Chi Square Test =CHISQ.TEST(observed_values, expected_values) =CHITEST(observed_values, expected_values) =CHISQ.TEST(observed_values; expected_values) Ordiary Least Squares Liear Regressio Regressio is a statistical method that allows users to summarize ad study relatioships betwee a depedet (Y) variable ad oe or more idepedet (X) variables. The depedet variable Y is a fuctio of the idepedet variables X. It is importat to keep i mid that variables have differet scales (omial/ordial/ratio). For liear regressio, the depedet variable is always a ratio. The idepedet variables ca be combiatios of the differet umber types. Liear Regressio Model The data (, y i ) are the observed pairs from which we try to estimate the Β coefficiets to fid the best fit. The error term, ε, is the uaccouted or uexplaied portio. Liear Model: y i 0 1 Y i 0 1 i for i 1, 2,... Residuals Because a liear regressio model is ot always appropriate for the data, you should assess the appropriateess of the model by defiig residuals. The differece betwee the observed value of the depedet variable ad predicted value is called the residual. ŷ i b 0 b 1 for i 1,2,... e i y i ŷ i y i b 0 b 1 for i 1,2,... Ordiary Least Squares (OLS) Regressio Ordiary least squares is a method for estimatig the ukow parameters i a liear regressio model. It fids the optimal value of the coefficiets (b 0 ad b 1 ) that miimize the sum of the squares of the errors: 2 e i y i ŷ i y i b 0 b 1 i1 i1 2 i1 2 y b 1 x b 1 i1 ( x)( y i y) i1 ( x) 2 CTL.SC0x Supply Chai Aalytics 7

8 Multiple Variables These relatioships traslate also to multiple variables. Y i 0 1 x 1i... k x ki i for i 1,2,... E(Y x 1,x 2,..., x k ) 0 1 x 1 2 x 2... k x k StdDev(Y x 1,x 2,..., x k ) y i ŷ i y i b 0 b 1 x 1i... b k x ki 2 e i1 i i1 2 i1 2 Validatig a Model All statistical software packages will provide statistics for evaluatio (ames ad format will vary by package). But the model output typically icludes: model statistics (regressio statistics or summary of fit), aalysis of variace (ANOVA), ad parameter statistics (coefficiet statistics). Overall Fit Overall fit = how much variatio i the depedet variable (y), ca we explai? Total variatio of CPL fid the dispersio aroud the mea. Total Sum of Squares Make estimate for of Y for each x. Error or Residual Sum of Squares TSS (y i y) 2 e i y i ŷ i 2 RSS e i y i ŷ i 2 Model explais % of total variatio of the depedet variables. Coefficiet of Determiatio or Goodess of Fit (R 2 ) R 2 1 RSS TSS 1 y ŷ i i 2 y i y 2 Adjusted R 2 corrects for additioal variables adjr 2 1 RSS 1 TSS k 1 i1 CTL.SC0x Supply Chai Aalytics 8

9 Idividual Coefficiets Each Idepedet variable (ad b 0 ) will have: A estimate of coefficiet (b 1 ), A stadard error (s bi ) o s e = Stadard error of the model s e y i ŷ i 2 N 2 o s x = Stadard deviatio of the idepedet variables = umber of observatios The t statistic o k = umber of idepedet variables o b i = estimate or coefficiet of idepedet variable Correspodig p value Testig the Slope o We wat to see if there is a liear relatioship, i.e. we wat to see if the slope (b 1 ) is somethig other tha zero. So: H 0 : b 1 = 0 ad H 1 b 1 0 o Cofidece itervals estimate a iterval for the slope parameter. Multi Colliearity, Autocorrelatio ad Heterscedasticity Multi Colliearity is whe two or more variables i a multiple regressio model are highly correlated. The model might have a high R 2 but the explaatory variables might fail the t test. It ca also result i strage results for correlated variables. Autocorrelatio is a characteristics of data i which the correlatio betwee the values of the same variables is based o related objects. It is typically a time series issue. Heterscedasticity is whe the variability of a variable is uequal across the rage of values of a secod variable that predicts it. Some tell tale sigs iclude: observatios are supposed to have the same variace. Examie scatter plots ad look for fa shaped distributios. Refereces Hillier ad Lieberma (2012) Itroductio to Operatios Research, McGraw Hill. Bertsimas ad Freud (2003) Data, Models, ad Decisios: The Fudametals of Maagemet Sciece, Dyamic Ideas. CTL.SC0x Supply Chai Aalytics 9

### MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.

XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced

More information

### 3/3/2014. CDS M Phil Econometrics. Types of Relationships. Types of Relationships. Types of Relationships. Vijayamohanan Pillai N.

3/3/04 CDS M Phil Old Least Squares (OLS) Vijayamohaa Pillai N CDS M Phil Vijayamoha CDS M Phil Vijayamoha Types of Relatioships Oly oe idepedet variable, Relatioship betwee ad is Liear relatioships Curviliear

More information

### Recall the study where we estimated the difference between mean systolic blood pressure levels of users of oral contraceptives and non-users, x - y.

Testig Statistical Hypotheses Recall the study where we estimated the differece betwee mea systolic blood pressure levels of users of oral cotraceptives ad o-users, x - y. Such studies are sometimes viewed

More information

### STATISTICAL INFERENCE

STATISTICAL INFERENCE POPULATION AND SAMPLE Populatio = all elemets of iterest Characterized by a distributio F with some parameter θ Sample = the data X 1,..., X, selected subset of the populatio = sample

More information

### Regression. Correlation vs. regression. The parameters of linear regression. Regression assumes... Random sample. Y = α + β X.

Regressio Correlatio vs. regressio Predicts Y from X Liear regressio assumes that the relatioship betwee X ad Y ca be described by a lie Regressio assumes... Radom sample Y is ormally distributed with

More information

### Chapter 22: What is a Test of Significance?

Chapter 22: What is a Test of Sigificace? Thought Questio Assume that the statemet If it s Saturday, the it s the weeked is true. followig statemets will also be true? Which of the If it s the weeked,

More information

### Sampling Distributions, Z-Tests, Power

Samplig Distributios, Z-Tests, Power We draw ifereces about populatio parameters from sample statistics Sample proportio approximates populatio proportio Sample mea approximates populatio mea Sample variace

More information

### Topic 6 Sampling, hypothesis testing, and the central limit theorem

CSE 103: Probability ad statistics Fall 2010 Topic 6 Samplig, hypothesis testig, ad the cetral limit theorem 61 The biomial distributio Let X be the umberofheadswhe acoiofbiaspistossedtimes The distributio

More information

### Statistics. Chapter 10 Two-Sample Tests. Copyright 2013 Pearson Education, Inc. publishing as Prentice Hall. Chap 10-1

Statistics Chapter 0 Two-Sample Tests Copyright 03 Pearso Educatio, Ic. publishig as Pretice Hall Chap 0- Learig Objectives I this chapter, you lear How to use hypothesis testig for comparig the differece

More information

### KLMED8004 Medical statistics. Part I, autumn Estimation. We have previously learned: Population and sample. New questions

We have previously leared: KLMED8004 Medical statistics Part I, autum 00 How kow probability distributios (e.g. biomial distributio, ormal distributio) with kow populatio parameters (mea, variace) ca give

More information

### Binomial Distribution

0.0 0.5 1.0 1.5 2.0 2.5 3.0 0 1 2 3 4 5 6 7 0.0 0.5 1.0 1.5 2.0 2.5 3.0 Overview Example: coi tossed three times Defiitio Formula Recall that a r.v. is discrete if there are either a fiite umber of possible

More information

### Number of fatalities X Sunday 4 Monday 6 Tuesday 2 Wednesday 0 Thursday 3 Friday 5 Saturday 8 Total 28. Day

LECTURE # 8 Mea Deviatio, Stadard Deviatio ad Variace & Coefficiet of variatio Mea Deviatio Stadard Deviatio ad Variace Coefficiet of variatio First, we will discuss it for the case of raw data, ad the

More information

### REGRESSION (Physics 1210 Notes, Partial Modified Appendix A)

REGRESSION (Physics 0 Notes, Partial Modified Appedix A) HOW TO PERFORM A LINEAR REGRESSION Cosider the followig data poits ad their graph (Table I ad Figure ): X Y 0 3 5 3 7 4 9 5 Table : Example Data

More information

### Testing Statistical Hypotheses for Compare. Means with Vague Data

Iteratioal Mathematical Forum 5 o. 3 65-6 Testig Statistical Hypotheses for Compare Meas with Vague Data E. Baloui Jamkhaeh ad A. adi Ghara Departmet of Statistics Islamic Azad iversity Ghaemshahr Brach

More information

### Important Concepts not on the AP Statistics Formula Sheet

Part I: IQR = Q 3 Q 1 Test for a outlier: 1.5(IQR) above Q 3 or below Q 1 The calculator will ru the test for you as log as you choose the boplot with the oulier o it i STATPLOT Importat Cocepts ot o the

More information

### Probability, Expectation Value and Uncertainty

Chapter 1 Probability, Expectatio Value ad Ucertaity We have see that the physically observable properties of a quatum system are represeted by Hermitea operators (also referred to as observables ) such

More information

### Joint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { }

UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig

More information

### Sequences I. Chapter Introduction

Chapter 2 Sequeces I 2. Itroductio A sequece is a list of umbers i a defiite order so that we kow which umber is i the first place, which umber is i the secod place ad, for ay atural umber, we kow which

More information

### Chapter 6 Principles of Data Reduction

Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

### Question 1: Exercise 8.2

Questio 1: Exercise 8. (a) Accordig to the regressio results i colum (1), the house price is expected to icrease by 1% ( 100% 0.0004 500 ) with a additioal 500 square feet ad other factors held costat.

More information

### Introducing Sample Proportions

Itroducig Sample Proportios Probability ad statistics Aswers & Notes TI-Nspire Ivestigatio Studet 60 mi 7 8 9 0 Itroductio A 00 survey of attitudes to climate chage, coducted i Australia by the CSIRO,

More information

### STATISTICAL method is one branch of mathematical

40 INTERNATIONAL JOURNAL OF COMPUTING SCIENCE AND APPLIED MATHEMATICS, VOL 3, NO, AUGUST 07 Optimizig Forest Samplig by usig Lagrage Multipliers Suhud Wahyudi, Farida Agustii Widjajati ad Dea Oktaviati

More information

### Asymptotic Results for the Linear Regression Model

Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is

More information

### Testing Statistical Hypotheses with Fuzzy Data

Iteratioal Joural of Statistics ad Systems ISS 973-675 Volume 6, umber 4 (), pp. 44-449 Research Idia Publicatios http://www.ripublicatio.com/ijss.htm Testig Statistical Hypotheses with Fuzzy Data E. Baloui

More information

### Chapter 4 - Summarizing Numerical Data

Chapter 4 - Summarizig Numerical Data 15.075 Cythia Rudi Here are some ways we ca summarize data umerically. Sample Mea: i=1 x i x :=. Note: i this class we will work with both the populatio mea µ ad the

More information

### Hashing and Amortization

Lecture Hashig ad Amortizatio Supplemetal readig i CLRS: Chapter ; Chapter 7 itro; Sectio 7.. Arrays ad Hashig Arrays are very useful. The items i a array are statically addressed, so that isertig, deletig,

More information

### Statistical Inference Procedures

Statitical Iferece Procedure Cofidece Iterval Hypothei Tet Statitical iferece produce awer to pecific quetio about the populatio of iteret baed o the iformatio i a ample. Iferece procedure mut iclude a

More information

### Some Properties of the Exact and Score Methods for Binomial Proportion and Sample Size Calculation

Some Properties of the Exact ad Score Methods for Biomial Proportio ad Sample Size Calculatio K. KRISHNAMOORTHY AND JIE PENG Departmet of Mathematics, Uiversity of Louisiaa at Lafayette Lafayette, LA 70504-1010,

More information

### SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES

SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES Read Sectio 1.5 (pages 5 9) Overview I Sectio 1.5 we lear to work with summatio otatio ad formulas. We will also itroduce a brief overview of sequeces,

More information

### CH19 Confidence Intervals for Proportions. Confidence intervals Construct confidence intervals for population proportions

CH19 Cofidece Itervals for Proportios Cofidece itervals Costruct cofidece itervals for populatio proportios Motivatio Motivatio We are iterested i the populatio proportio who support Mr. Obama. This sample

More information

### Elementary Statistics

Elemetary Statistics M. Ghamsary, Ph.D. Sprig 004 Chap 0 Descriptive Statistics Raw Data: Whe data are collected i origial form, they are called raw data. The followig are the scores o the first test of

More information

### Stat 400, section 5.4 supplement: The Central Limit Theorem

Stat, sectio 5. supplemet: The Cetral Limit Theorem otes by Tim Pilachowski Table of Cotets 1. Backgroud 1. Theoretical. Practical. The Cetral Limit Theorem 5. Homework Exercises 7 1. Backgroud Gatherig

More information

### STAT 203 Chapter 18 Sampling Distribution Models

STAT 203 Chapter 18 Samplig Distributio Models Populatio vs. sample, parameter vs. statistic Recall that a populatio cotais the etire collectio of idividuals that oe wats to study, ad a sample is a subset

More information

### It should be unbiased, or approximately unbiased. Variance of the variance estimator should be small. That is, the variance estimator is stable.

Chapter 10 Variace Estimatio 10.1 Itroductio Variace estimatio is a importat practical problem i survey samplig. Variace estimates are used i two purposes. Oe is the aalytic purpose such as costructig

More information

### Central Limit Theorem the Meaning and the Usage

Cetral Limit Theorem the Meaig ad the Usage Covetio about otatio. N, We are usig otatio X is variable with mea ad stadard deviatio. i lieu of sayig that X is a ormal radom Assume a sample of measuremets

More information

### 18. Two-sample problems for population means (σ unknown)

8. Two-samle roblems for oulatio meas (σ ukow) The Practice of Statistics i the Life Scieces Third Editio 04 W.H. Freema ad Comay Objectives (PSLS Chater 8) Comarig two meas (σ ukow) Two-samle situatios

More information

### Singular Continuous Measures by Michael Pejic 5/14/10

Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable

More information

### Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

### Variance of Discrete Random Variables Class 5, Jeremy Orloff and Jonathan Bloom

Variace of Discrete Radom Variables Class 5, 18.05 Jeremy Orloff ad Joatha Bloom 1 Learig Goals 1. Be able to compute the variace ad stadard deviatio of a radom variable.. Uderstad that stadard deviatio

More information

### Chapter VII Measures of Correlation

Chapter VII Measures of Correlatio A researcher may be iterested i fidig out whether two variables are sigificatly related or ot. For istace, he may be iterested i kowig whether metal ability is sigificatly

More information

### L (x; 1 - x)(xi2- x) [(x; -x)z +(x;z -.xf] 2n i l. 2n i=l. kn i=l j=l

The Itraclass Correlatio: What is it ad why do we care? David J. Pasta, Techology Assessmet Grop, Sa Fracisco, CA Abstract The itraclass correlatio coefficiet (ICC) is a measure of reproducibility that

More information

### In number theory we will generally be working with integers, though occasionally fractions and irrationals will come into play.

Number Theory Math 5840 otes. Sectio 1: Axioms. I umber theory we will geerally be workig with itegers, though occasioally fractios ad irratioals will come ito play. Notatio: Z deotes the set of all itegers

More information

### Lecture 1 Probability and Statistics

Wikipedia: Lecture 1 Probability ad Statistics Bejami Disraeli, British statesma ad literary figure (1804 1881): There are three kids of lies: lies, damed lies, ad statistics. popularized i US by Mark

More information

### Math 2784 (or 2794W) University of Connecticut

ORDERS OF GROWTH PAT SMITH Math 2784 (or 2794W) Uiversity of Coecticut Date: Mar. 2, 22. ORDERS OF GROWTH. Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really

More information

### OBJECTIVES. Chapter 1 INTRODUCTION TO INSTRUMENTATION FUNCTION AND ADVANTAGES INTRODUCTION. At the end of this chapter, students should be able to:

OBJECTIVES Chapter 1 INTRODUCTION TO INSTRUMENTATION At the ed of this chapter, studets should be able to: 1. Explai the static ad dyamic characteristics of a istrumet. 2. Calculate ad aalyze the measuremet

More information

### Probability and Statistics

ICME Refresher Course: robability ad Statistics Staford Uiversity robability ad Statistics Luyag Che September 20, 2016 1 Basic robability Theory 11 robability Spaces A probability space is a triple (Ω,

More information

### Economics 102C: Advanced Topics in Econometrics 4 - Asymptotics & Large Sample Properties of OLS

Ecoomics 102C: Advaced Topics i Ecoometrics 4 - Asymptotics & Large Sample Properties of OLS Michael Best Sprig 2015 Asymptotics So far we have looked at the fiite sample properties of OLS Relied heavily

More information

### Notes on iteration and Newton s method. Iteration

Notes o iteratio ad Newto s method Iteratio Iteratio meas doig somethig over ad over. I our cotet, a iteratio is a sequece of umbers, vectors, fuctios, etc. geerated by a iteratio rule of the type 1 f

More information

### CE3502 Environmental Monitoring, Measurements, and Data Analysis (EMMA) Spring 2008 Final Review

CE35 Evirometal Moitorig, Meauremet, ad Data Aalyi (EMMA) Sprig 8 Fial Review I. Topic:. Decriptive tatitic: a. Mea, Stadard Deviatio, COV b. Bia (accuracy), preciio, Radom v. ytematic error c. Populatio

More information

### A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

### Lecture 3 The Lebesgue Integral

Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified

More information

### Frequency Response of FIR Filters

EEL335: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we itroduce the idea of the frequecy respose of LTI systems, ad focus specifically o the frequecy respose of FIR filters.. Steady-state

More information

### Example 2. Find the upper bound for the remainder for the approximation from Example 1.

Lesso 8- Error Approimatios 0 Alteratig Series Remaider: For a coverget alteratig series whe approimatig the sum of a series by usig oly the first terms, the error will be less tha or equal to the absolute

More information

### INF-GEO Solutions, Geometrical Optics, Part 1

INF-GEO430 20 Solutios, Geometrical Optics, Part Reflectio by a symmetric triagular prism Let be the agle betwee the two faces of a symmetric triagular prism. Let the edge A where the two faces meet be

More information

### Asymptotic distribution of the first-stage F-statistic under weak IVs

November 6 Eco 59A WEAK INSTRUMENTS III Testig for Weak Istrumets From the results discussed i Weak Istrumets II we kow that at least i the case of a sigle edogeous regressor there are weak-idetificatio-robust

More information

### Analysis of Algorithms. Introduction. Contents

Itroductio The focus of this module is mathematical aspects of algorithms. Our mai focus is aalysis of algorithms, which meas evaluatig efficiecy of algorithms by aalytical ad mathematical methods. We

More information

### Formulas FROM LECTURE 01 TO 22 W X. d n. fx f. Arslan Latif (mt ) & Mohsin Ali (mc ) Mean: Weighted Mean: Mean Deviation: Ungroup Data

1 Formulas FROM LECTURE 01 TO Mea: fx f Weighted Mea: X w W X i i Wi Mea Deviatio: Ugroup Data d M. D Group Data fi di M. D f d ( X X ) Coefficiet of Mea Deviatio: M. D Co-efficiet of M. D(for mea) Mea

More information

### HOMEWORK #10 SOLUTIONS

Math 33 - Aalysis I Sprig 29 HOMEWORK # SOLUTIONS () Prove that the fuctio f(x) = x 3 is (Riema) itegrable o [, ] ad show that x 3 dx = 4. (Without usig formulae for itegratio that you leart i previous

More information

### Introduction to Machine Learning DIS10

CS 189 Fall 017 Itroductio to Machie Learig DIS10 1 Fu with Lagrage Multipliers (a) Miimize the fuctio such that f (x,y) = x + y x + y = 3. Solutio: The Lagragia is: L(x,y,λ) = x + y + λ(x + y 3) Takig

More information

### Posted-Price, Sealed-Bid Auctions

Posted-Price, Sealed-Bid Auctios Professors Greewald ad Oyakawa 207-02-08 We itroduce the posted-price, sealed-bid auctio. This auctio format itroduces the idea of approximatios. We describe how well this

More information

### 62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

### Varanasi , India. Corresponding author

A Geeral Family of Estimators for Estimatig Populatio Mea i Systematic Samplig Usig Auxiliary Iformatio i the Presece of Missig Observatios Maoj K. Chaudhary, Sachi Malik, Jayat Sigh ad Rajesh Sigh Departmet

More information

### A Risk Comparison of Ordinary Least Squares vs Ridge Regression

Joural of Machie Learig Research 14 (2013) 1505-1511 Submitted 5/12; Revised 3/13; Published 6/13 A Risk Compariso of Ordiary Least Squares vs Ridge Regressio Paramveer S. Dhillo Departmet of Computer

More information

### Sequences III. Chapter Roots

Chapter 4 Sequeces III 4. Roots We ca use the results we ve established i the last workbook to fid some iterestig limits for sequeces ivolvig roots. We will eed more techical expertise ad low cuig tha

More information

### Topic 15: Maximum Likelihood Estimation

Topic 5: Maximum Likelihood Estimatio November ad 3, 20 Itroductio The priciple of maximum likelihood is relatively straightforward. As before, we begi with a sample X (X,..., X of radom variables chose

More information

### Practice Test Problems for Test IV, with Solutions

Practice Test Problems for Test IV, with Solutios Dr. Holmes May, 2008 The exam will cover sectios 8.2 (revisited) to 8.8. The Taylor remaider formula from 8.9 will ot be o this test. The fact that sums,

More information

### ROLL CUTTING PROBLEMS UNDER STOCHASTIC DEMAND

Pacific-Asia Joural of Mathematics, Volume 5, No., Jauary-Jue 20 ROLL CUTTING PROBLEMS UNDER STOCHASTIC DEMAND SHAKEEL JAVAID, Z. H. BAKHSHI & M. M. KHALID ABSTRACT: I this paper, the roll cuttig problem

More information

### Two-Stage Controlled Fractional Factorial Screening for Simulation Experiments

Two-Stage Cotrolled Fractioal Factorial Screeig for Simulatio Experimets Hog Wa Assistat Professor School of Idustrial Egieerig Purdue Uiversity 35 N. Grat Street West Lafayette, IN 4797-223 hwa@purdue.edu

More information

### A goodness-of-fit test based on the empirical characteristic function and a comparison of tests for normality

A goodess-of-fit test based o the empirical characteristic fuctio ad a compariso of tests for ormality J. Marti va Zyl Departmet of Mathematical Statistics ad Actuarial Sciece, Uiversity of the Free State,

More information

### ON POINTWISE BINOMIAL APPROXIMATION

Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece

More information

### ρ = Chapter 2 Review of Statistics Summarize from Heij Chapter Descriptive Statistics

Chapter Review of Statistics Summarize from Heij Chapter. Descriptive Statistics Presetatio of Statistics: there are may methods to preset iformatio i data set such as table, graph, ad picture. The importat

More information

### 11. FINITE FIELDS. Example 1: The following tables define addition and multiplication for a field of order 4.

11. FINITE FIELDS 11.1. A Field With 4 Elemets Probably the oly fiite fields which you ll kow about at this stage are the fields of itegers modulo a prime p, deoted by Z p. But there are others. Now although

More information

### 1 Hypothesis test of a mean vector

THE UNIVERSITY OF CHICAGO Booth School of Busiess Busiess 41912, Sprig Quarter 2010, Mr Ruey S Tsay Lecture: Iferece about sample mea Key cocepts: 1 Hotellig s T 2 test 2 Likelihood ratio test 3 Various

More information

### arxiv: v1 [math.pr] 13 Oct 2011

A tail iequality for quadratic forms of subgaussia radom vectors Daiel Hsu, Sham M. Kakade,, ad Tog Zhag 3 arxiv:0.84v math.pr] 3 Oct 0 Microsoft Research New Eglad Departmet of Statistics, Wharto School,

More information

### The Ratio Test. THEOREM 9.17 Ratio Test Let a n be a series with nonzero terms. 1. a. n converges absolutely if lim. n 1

460_0906.qxd //04 :8 PM Page 69 SECTION 9.6 The Ratio ad Root Tests 69 Sectio 9.6 EXPLORATION Writig a Series Oe of the followig coditios guaratees that a series will diverge, two coditios guaratee that

More information

### Available online at ScienceDirect. Physics Procedia 57 (2014 ) 48 52

Available olie at www.sciecedirect.com ScieceDirect Physics Procedia 57 (214 ) 48 52 27th Aual CSP Workshops o Recet Developmets i Computer Simulatio Studies i Codesed Matter Physics, CSP 214 Applicatio

More information

### Section 5.1 The Basics of Counting

1 Sectio 5.1 The Basics of Coutig Combiatorics, the study of arragemets of objects, is a importat part of discrete mathematics. I this chapter, we will lear basic techiques of coutig which has a lot of

More information

### Part 1 of the text covers regression analysis with cross-sectional data. It builds

Regressio Aalysis with Cross-Sectioal Data 1 Part 1 of the text covers regressio aalysis with cross-sectioal data. It builds upo a solid base of college algebra ad basic cocepts i probability ad statistics.

More information

### Solutions for the Exam 9 January 2012

Mastermath ad LNMB Course: Discrete Optimizatio Solutios for the Exam 9 Jauary 2012 Utrecht Uiversity, Educatorium, 15:15 18:15 The examiatio lasts 3 hours. Gradig will be doe before Jauary 23, 2012. Studets

More information

### Definitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.

Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,

More information

### Coefficient of variation and Power Pen s parade computation

Coefficiet of variatio ad Power Pe s parade computatio Jules Sadefo Kamdem To cite this versio: Jules Sadefo Kamdem. Coefficiet of variatio ad Power Pe s parade computatio. 20. HAL Id: hal-0058658

More information

### Lecture 11 October 27

STATS 300A: Theory of Statistics Fall 205 Lecture October 27 Lecturer: Lester Mackey Scribe: Viswajith Veugopal, Vivek Bagaria, Steve Yadlowsky Warig: These otes may cotai factual ad/or typographic errors..

More information

### CS 2750 Machine Learning. Lecture 23. Concept learning. CS 2750 Machine Learning. Concept Learning

Lecture 3 Cocept learig Milos Hauskrecht milos@cs.pitt.edu Cocept Learig Outlie: Learig boolea fuctios Most geeral ad most specific cosistet hypothesis. Mitchell s versio space algorithm Probably approximately

More information

### Review Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn

Stat 366 Lab 2 Solutios (September 2, 2006) page TA: Yury Petracheko, CAB 484, yuryp@ualberta.ca, http://www.ualberta.ca/ yuryp/ Review Questios, Chapters 8, 9 8.5 Suppose that Y, Y 2,..., Y deote a radom

More information

### 6.883: Online Methods in Machine Learning Alexander Rakhlin

6.883: Olie Methods i Machie Learig Alexader Rakhli LECTURES 5 AND 6. THE EXPERTS SETTING. EXPONENTIAL WEIGHTS All the algorithms preseted so far halluciate the future values as radom draws ad the perform

More information

### Lecture 9: Hierarchy Theorems

IAS/PCMI Summer Sessio 2000 Clay Mathematics Udergraduate Program Basic Course o Computatioal Complexity Lecture 9: Hierarchy Theorems David Mix Barrigto ad Alexis Maciel July 27, 2000 Most of this lecture

More information

### EECE 301 Signals & Systems

EECE 301 Sigals & Systems Prof. Mark Fowler Note Set #8 D-T Covolutio: The Tool for Fidig the Zero-State Respose Readig Assigmet: Sectio 2.1-2.2 of Kame ad Heck 1/14 Course Flow Diagram The arrows here

More information

### SEPARABLE LEAST SQUARES, VARIABLE PROJECTION, AND THE GAUSS-NEWTON ALGORITHM

SEPARABLE LEAS SQUARES, VARIABLE PROJECION, AND HE GAUSS-NEWON ALGORIHM M.R.OSBORNE Key words. oliear least squares, scorig, Newto s method, expected Hessia, Kaufma s modificatio, rate of covergece, radom

More information

### Sensitivity Analysis of Daubechies 4 Wavelet Coefficients for Reduction of Reconstructed Image Error

Proceedigs of the 6th WSEAS Iteratioal Coferece o SIGNAL PROCESSING, Dallas, Texas, USA, March -4, 7 67 Sesitivity Aalysis of Daubechies 4 Wavelet Coefficiets for Reductio of Recostructed Image Error DEVINDER

More information

### HOMEWORK 2 SOLUTIONS

HOMEWORK SOLUTIONS CSE 55 RANDOMIZED AND APPROXIMATION ALGORITHMS 1. Questio 1. a) The larger the value of k is, the smaller the expected umber of days util we get all the coupos we eed. I fact if = k

More information

### Math 140A Elementary Analysis Homework Questions 3-1

Math 0A Elemetary Aalysis Homework Questios -.9 Limits Theorems for Sequeces Suppose that lim x =, lim y = 7 ad that all y are o-zero. Detarime the followig limits: (a) lim(x + y ) (b) lim y x y Let s

More information

### Theory Meets Data. A Data Scientist s Handbook to Statistics DRAFT. Ani Adhikari. Editor: Dibya Jyoti Ghosh

Theory Meets Data A Data Scietist s Hadbook to Statistics Ai Adhikari Editor: Dibya Jyoti Ghosh DRAFT Cotributors: Shreya Agarwal, Thomas Athoy, Bryaie Bach, Adith Balamuruga, Betty Chag, Aditya Gadhi,

More information

### A General Family of Estimators for Estimating Population Variance Using Known Value of Some Population Parameter(s)

Rajesh Sigh, Pakaj Chauha, Nirmala Sawa School of Statistics, DAVV, Idore (M.P.), Idia Floreti Smaradache Uiversity of New Meico, USA A Geeral Family of Estimators for Estimatig Populatio Variace Usig

More information

### CALCULUS II. Sequences and Series. Paul Dawkins

CALCULUS II Sequeces ad Series Paul Dawkis Table of Cotets Preface... ii Sequeces ad Series... 3 Itroductio... 3 Sequeces... 5 More o Sequeces...5 Series The Basics... Series Covergece/Divergece...7 Series

More information

### AN INTRODUCTION TO SPECTRAL GRAPH THEORY

AN INTRODUCTION TO SPECTRAL GRAPH THEORY JIAQI JIANG Abstract. Spectral graph theory is the study of properties of the Laplacia matrix or adjacecy matrix associated with a graph. I this paper, we focus

More information

### Monte Carlo Integration

Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce

More information

### MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 6 9/24/2008 DISCRETE RANDOM VARIABLES AND THEIR EXPECTATIONS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 6 9/24/2008 DISCRETE RANDOM VARIABLES AND THEIR EXPECTATIONS Cotets 1. A few useful discrete radom variables 2. Joit, margial, ad

More information

### Lecture #18

18-1 Variatioal Method (See CTDL 1148-1155, [Variatioal Method] 252-263, 295-307[Desity Matrices]) Last time: Quasi-Degeeracy Diagoalize a part of ifiite H * sub-matrix : H (0) + H (1) * correctios for

More information

### Limitation of Applicability of Einstein s. Energy-Momentum Relationship

Limitatio of Applicability of Eistei s Eergy-Mometum Relatioship Koshu Suto Koshu_suto19@mbr.ifty.com Abstract Whe a particle moves through macroscopic space, for a isolated system, as its velocity icreases,

More information

### ETNA Kent State University

Electroic rasactios o Numerical Aalysis. Volume 28, pp. -5, 2007. Copyright 2007, Ket State Uiversity. ISSN 068-963. ENA Ket State Uiversity eta@mcs.ket.edu SEPARABLE LEAS SQUARES, VARIABLE PROJECION,

More information