ENGI 4421 Probability & Statistics

Similar documents
Inference in Simple Regression

Big Data Analytics! Special Topics for Computer Science CSE CSE Mar 31

Section 10 Regression with Stochastic Regressors

Regression with Stochastic Regressors

Section 14 Limited Dependent Variables

Statistics for Business and Economics

STAT 3340 Assignment 1 solutions. 1. Find the equation of the line which passes through the points (1,1) and (4,5).

Chapter 11: Simple Linear Regression and Correlation

This is natural first assumption, unless theory rejects it.

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Basics of heteroskedasticity

Cathy Walker March 5, 2010

Chapter 14 Simple Linear Regression

What regression does. = β + β x : The conditional mean of y given x is β + β x 1 2

Here is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

Chapter 3 Describing Data Using Numerical Measures

Statistics for Economics & Business

Fall 2010 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede. (n.b. for now, we do not require that k. vectors as a k 1 matrix: ( )

THE ROYAL STATISTICAL SOCIETY 2006 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction

Comparing Several Means: ANOVA. Group Means and Grand Mean

Biostatistics 360 F&t Tests and Intervals in Regression 1

Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management

Definition. Measures of Dispersion. Measures of Dispersion. Definition. The Range. Measures of Dispersion 3/24/2014

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation

Statistical Inference. 2.3 Summary Statistics Measures of Center and Spread. parameters ( population characteristics )

17 - LINEAR REGRESSION II

What regression does. x is called the regressor The linear form is a natural first assumption, unless theory rejects it. positive or negative.

Probability and. Lecture 13: and Correlation

Statistics MINITAB - Lab 2

Y = β 0 + β 1 X 1 + β 2 X β k X k + ε

Basic Business Statistics, 10/e

CHAPTER 3 ANALYSIS OF KY BOOST CONVERTER

NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MTH352/MH3510 Regression Analysis

Engineering Risk Benefit Analysis

First Year Examination Department of Statistics, University of Florida

Economics 130. Lecture 4 Simple Linear Regression Continued

The Simple Linear Regression Model: Theory

Hydrological statistics. Hydrological statistics and extremes

β0 + β1xi. You are interested in estimating the unknown parameters β

Unit 10: Simple Linear Regression and Correlation

MIMA Group. Chapter 2 Bayesian Decision Theory. School of Computer Science and Technology, Shandong University. Xin-Shun SDU

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

Lecture Notes Types of economic variables

where I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).

Chat eld, C. and A.J.Collins, Introduction to multivariate analysis. Chapman & Hall, 1980

PubH 7405: REGRESSION ANALYSIS. SLR: INFERENCES, Part II

Chapter 13: Multiple Regression

STAT 3008 Applied Regression Analysis

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Lecture 4 Hypothesis Testing

UNIVERSITY OF TORONTO. Faculty of Arts and Science JUNE EXAMINATIONS STA 302 H1F / STA 1001 H1F Duration - 3 hours Aids Allowed: Calculator

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Introduction to Electronic circuits.

a. (All your answers should be in the letter!

Topic 7: Analysis of Variance

Exercises H /OOA> f Wo AJoTHS l^»-l S. m^ttrt /A/ ?C,0&L6M5 INFERENCE FOR DISTRIBUTIONS OF CATEGORICAL DATA. tts^e&n tai-ns 5 2%-cas-hews^, 27%

Statistics and Probability Theory in Civil, Surveying and Environmental Engineering

Regression. The Simple Linear Regression Model

On Outlier Robust Small Area Mean Estimate Based on Prediction of Empirical Distribution Function

8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore

Biostatistics. Chapter 11 Simple Linear Correlation and Regression. Jing Li

SELECTION OF MODEL PARAMETERS OF BIOGAS IC ENGINE. Karol Cupiał, Grzegorz Katolik

CTN 2/23/16. EE 247B/ME 218: Introduction to MEMS Design Lecture 11m2: Mechanics of Materials. Copyright 2016 Regents of the University of California

Table of z values and probabilities for the standard normal distribution. z is the first column plus the top row. Each cell shows P(X z).

6. ELUTRIATION OF PARTICLES FROM FLUIDIZED BEDS

Answers Problem Set 2 Chem 314A Williamsen Spring 2000

Maximum Likelihood Estimation

Professor Chris Murray. Midterm Exam

since [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation

18. SIMPLE LINEAR REGRESSION III

Chapter 15 - Multiple Regression

β0 + β1xi. You are interested in estimating the unknown parameters β

The Ordinary Least Squares (OLS) Estimator

Modelling Heterogeneous Dispersion in Marginal Models for Longitudinal Proportional Data

28. SIMPLE LINEAR REGRESSION III

DIMENSION REDUCTION FOR CENSORED REGRESSION DATA

Lecture 6: Introduction to Linear Regression

Chapter 7. Systems 7.1 INTRODUCTION 7.2 MATHEMATICAL MODELING OF LIQUID LEVEL SYSTEMS. Steady State Flow. A. Bazoune

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression

Water vapour balance in a building moisture exposure for timber structures

_J _J J J J J J J J _. 7 particles in the blue state; 3 particles in the red state: 720 configurations _J J J _J J J J J J J J _

Exploiting vector space properties for the global optimization of process networks

Negative Binomial Regression

Limited Dependent Variables

Comparison of Regression Lines

Learning Objectives for Chapter 11

xp(x µ) = 0 p(x = 0 µ) + 1 p(x = 1 µ) = µ

Table of z values and probabilities for the standard normal distribution. z is the first column plus the top row. Each cell shows P(X z).

Statistics Chapter 4

CS 2750 Machine Learning. Lecture 5. Density estimation. CS 2750 Machine Learning. Announcements

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

Scatter Plot x

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

e i is a random error

ANSWERS CHAPTER 9. TIO 9.2: If the values are the same, the difference is 0, therefore the null hypothesis cannot be rejected.

ST2352. Working backwards with conditional probability. ST2352 Week 8 1

Module Contact: Dr Susan Long, ECO Copyright of the University of East Anglia Version 1

Transcription:

Lecture Ntes fr ENGI 441 Prbablty & Statstcs by Dr. G.H. Gerge Asscate Prfessr, Faculty f Engneerng and Appled Scence Seventh Edtn, reprnted 018 Sprng http://www.engr.mun.ca/~ggerge/441/

Table f Cntents 1. Descrptve Statstcs. Intrductn t Prbablty 3. Cuntng Technques 4. Laws f Prbablty; Bayes Therem 5. Dscrete Randm Quanttes; Expected Value and Varance 6. Cntnuus Randm Quanttes 7. Lnear Cmbnatns f Randm Quanttes; Jnt Prbablty Dstrbutns; Crrelatn; Pnt Estmatn; Bas and Precsn 8. Prpagatn f Errr 9. Dscrete Prbablty Dstrbutns 10. Cntnuus Prbablty Dstrbutns 11. Central Lmt Therem; One-sample Cnfdence Intervals 1. Tw-sample Cnfdence Intervals 13. Hypthess Tests 14. Ch-Square Tests 15. Smple Lnear Regressn Appendces: 16. Suggestns fr Frmula Sheets 17. Statstcal Tables

Lst f Symbls: prper subset subset,, ntersectn (same as lgcal AND), unn = lgcal nclusve OR Ø empty set = null set = {} prbablty f type I errr b x; n, p bnmal p.m.f. B x; n, p bnmal c.d.f. 1 prbablty f type II errr prbablty f type II errr f 0 ˆ 1 ntercept f regressn lne 0 estmate f 0 1 ˆ slpe f regressn lne 1 estmate f 1 CI cnfdence nterval c bundary f rejectn regn r CI (ne-sded) c L lwer bundary f tw-sded rejectn regn r CI c U upper bundary f tw-sded rejectn regn r CI n C r number f cmbnatns f r bjects frm n Cv XY, cvarance ch-square dstrbutn wth degrees f freedm, c fr whch P c E an event (value 1 f true, else 0) c * E r ~E r nt-e r E r E r E r E the cmplement f event E E X expected value f X e e resdual fr th pnt (n SLR) r number expected n cell f the null hypthess s true ( tests) e j number expected n cell (, j) f the null hypthess s true f f true errr fr th pnt (n SLR) value f F statstc = MSR/MSE frequency (number f bservatns n th nterval) x prbablty densty functn (pdf) f Fx cumulatve dstrbutn functn (cdf) PX x x gamma functn (= (x 1)!) r, gamma dstrbutn H null hypthess H A r H a r H 1 alternatve hypthess IQR nterquartle range ccurrence rate (n Pssn and expnental dstrbutns) x sample medan ppulatn medan MAD mean abslute devatn frm the mean MSE mean square errr s MSR mean square regressn X sample mean (estmatr) x sample mean (estmate) ppulatn mean * psterr estmate f (Bayesan) prr estmate f (Bayesan) r value f f null hypthess true n sample sze N ppulatn sze N, nrmal dstrbutn wth mean, varance number f degrees f freedm number bserved n cell

Lst f Symbls (cntnued) j number bserved n cell (, j) j number bserved n rw number bserved n clumn j ttal number bserved = n p ppulatn prprtn p E prbablty that event E P ccurs P A B cndtnal prbablty (that event A ccurs gven that event B has ccurred) p x P X x prbablty mass functn (pmf) fr dscrete x px, y P X x Y y p x p x, y margnal pmf X y py X y x p x, y px x P ˆp sample prprtn (estmatr) sample prprtn (estmate) * p adjusted ˆp (Agrest-Cull CI) n P r number f permutatns f r bjects frm n PI predctn nterval (SLR) z standard nrmal p.d.f. z standard nrmal c.d.f. q p 1 p cmplement f the prbablty p Q1 P cmplement f P qˆ1 pˆ cmplement f ˆp q L r x L lwer quartle q U r x U upper quartle * q adjusted ˆq (Agrest-Cull CI) r sample crrelatn r p r dds that an event wth 1 p prbablty p ccurs. r f / n relatve frequency ppulatn crrelatn S sample space = unversal set = pssblty space (set f all pssble utcmes) s sample standard devatn s sample varance ppulatn standard devatn ppulatn varance prr varance (Bayesan) * psterr estmate f (Bayesan) Sxy n xy x y Sxx n x x S n y y yy SIQR sem-nterquartle range SLR smple lnear regressn s.e. standard errr / n SSE sum f squares due t errr SSR sum f squares due t regressn SST ttal sum f squares T randm quantty fllwng t - dstrbutn wth degrees f freedm t, t fr whch P T t t bserved value f t bs V X varance f X w w d ŷ Z prr weght (Bayesan) data weght (Bayesan) value f y predcted frm regressn lne standard nrmal randm quantty P Z z z z fr whch z bs bserved value f z v

v

ENGI 441 Curse Outlne Page 0-01 [Replace ths sheet by the Curse Outlne handut that s suppled durng the frst week f classes n ths curse]

ENGI 441 Curse Outlne Page 0-0 [Replace ths sheet by the Curse Outlne handut that s suppled durng the frst week f classes n ths curse]

ENGI 441 Curse Outlne Page 0-03 [Replace ths sheet by the Curse Outlne handut that s suppled durng the frst week f classes n ths curse]

ENGI 441 Curse Outlne Page 0-04 [Replace ths sheet by the Curse Outlne handut that s suppled durng the frst week f classes n ths curse]