Chapter 5 Elementary Statistics, Empirical Probability Distributions, and More on Simulation
|
|
- Harry McCoy
- 5 years ago
- Views:
Transcription
1 Chapter 5 Elemetary Statstcs, Emprcal Probablty Dstrbutos, ad More o Smulato
2 Cotets Coectg Probablty wth Observatos of Data Sample Mea ad Sample Varace Regresso Techques Emprcal Dstrbuto Fuctos More o Mote Carlo Smulato Statstcal Process Cotrol Covergece of the Sample Mea to the Mea
3 Coectg Probablty wth Observatos of Data Scope of the chapter I chapter to chapter4: aoms of probablty, varous probablty relatoshps world of mathematcal models we ow deal wth problems of real world sample mea, varace, stadard devato, emprcal dstrbuto of radom data etc.. realm of statstcs
4 Coectg Probablty wth Observatos of Data (Cot.) Remark:. We wll also cosder estmato theory, ad decso makg based o probablstc cocepts later chapters.. Computer smulato of radom pheomea wll be revsted as well.
5 Sample Mea ad Sample Varace Suppose we take a sample of maufactured tems {,,, }, e.g. resstors Populato: totalty of tems {,,, } Sample: dvdual 's
6 Sample Mea ad Sample Varace (Cot.) Defto 5. Sample mea The sample mea of a populato s smply the arthmetc average of all the sample values,.e. Remarks Notce that the sample mea s a radom varable, depedg o the sample values selected from the populato. Hope that t s close to the actual mea: to be dscussed later...
7 Sample Mea ad Sample Varace (Cot.) Defto 5. Sample varace The sample varace of a populato s defed a smlar maer as the varace of a radom varable dscussed chapter,.e. s ( ) Where s the sample mea defed above.
8 Sample Mea ad Sample Varace (Cot.) Remarks Notce that s s a radom varable as sample mea s a radom varable It represets the measure of the spread of populato aroud the sample mea The square root of sample varace s called the stadard devato s ( )
9 Sample Mea ad Sample Varace (Cot.) The reaso for dvso by - rather tha wll become apparet subsequet chapter whe we cosder estmato. Note, for a momet, that as becomes large, the dfferece s small
10 Sample Mea ad Sample Varace (Cot.) Eample 5. Fd the sample mea of the followg resstace values Ω; 900, 03, 939, 06, 07, 996, 970, 079, 065, ad 049. Soluto Applyg the defto of the sample mea above, we easly get: 009
11 Sample Mea ad Sample Varace (Cot.) Eample 5. Obta the sample stadard devato of the resstace samples gve the above eample. Soluto Usg the defto of sample stadard devato, we obta s 58. 7
12 Sample Mea ad Sample Varace (Cot.) Note As the # of populato gets large, computatos volved the sample varace becomes tedous, due to the subtracto procedure... Frst, you calculate the sample mea, ad the subtract t from each sample before squarg ad summg aga
13 Sample Mea ad Sample Varace (Cot.) Computatoally effcet way of obtag Epadg the RHS of the sample varace, we get applyg the defto of the sample mea above s s ) ( ) ( s
14 Sample Mea ad Sample Varace (Cot.) Remark: We oly eed the sums of the sample mea ad the squares of the sample mea, wthout the tedous step of subtracto...
15 Sample Mea ad Sample Varace (Cot.) Eample 5.3 Redo the eample 5- followg the procedure metoed above. Soluto: We get s ad s 0,,806, 58,7, whch s 0,090, ad thus obta the same result obtaed prevously.
16 Sample Mea ad Sample Varace (Cot.) Eample 5.4 The resduals are defed as: Show that the sum of all resduals s equal to zero. Soluto: From the defto of the sample mea, we have: whch meas d 0 or d 0 ( ) 0
17 Regresso Techques Suppose we are gve measuremets of a par of data some relatoshp b/w the data 3 matchg the data relato to a smple straght le Objectve: Gve the measuremets of data pars, {(, y ), =,,, }, fd a straght le whch s best ft to the data: 3 Precse determato of the relatoshp s ot possble due to measuremet errors y
18 Regresso Techques (Cot.) Crtero: Choose the costats α ad β : the straght le ft to the data s take the sese of mmum squared error: (, ) argm o o (, ) where subscrpt o stads for optmum, ad the ε s the average squared error defed as follows: ( y )
19 Regresso Techques (Cot.) Procedure: (regresso techque) To fd (α o, β o ) makg ε as small as possble, we dfferetate ε wth respect to α ad β, ad put to zero: 0 ) ( 0 ) ( o o o o y y
20 Regresso Techques (Cot.) We ca re-arrage the above equatos to the followgs: o o o o y y
21 Regresso Techques (Cot.) Solvg for (α o, β o ) yelds: where represets the sample varace of the values. y s y y o o o ) ( s
22 Regresso Techques (Cot.) For further smplfcato, defe the sample covarace c y ad the sample correlato coeffcet r y respectvely as: c y ( )( y y) ad where s ad s y represet the sample stadard devato of the data sets { } ad {y }, respectvely. r y s c y s y
23 Regresso Techques (Cot.) By epadg the product c y, we have: Ad the costat α o ca smply be epressed as: The regresso le whch s best ft to the data becomes: ) ( y y c y y o s c s c y s c y y y o o
24 Regresso Techques (Cot.) The regresso le ca be arraged to: cy y y ( ) s Or, the regresso le ca be epressed as follows: 4 y y s y 4 Note that ths s a somewhat easer epresso to remember... r y s
25 Regresso Techques (Cot.) Remarks:. If r y = 0 the regresso le vashes, ad the data set are called ucorrelated.. If r y = ±, the data are learly related as follows: 3. The goodess of the ft s determed by the squared error ε: eve though t has bee mmzed, the regresso le mght stll ot well ft to data, especally whe the correlato b/w/ data s small. y m b
26 Regresso Techques (Cot.) Eample 5.5 Fd the correlato coeffcet ad the regresso le for the followg data set: Soluto: y From the data set, we ca get: r y = 0.7, =.6, y =.44, ad s = :39, s y = 3:88. Thus, the regresso le becomes: y whch s Fgure5-
27 Regresso Techques (Cot.) Fgure 5.: Data pars ad regresso le for the radom data set of Eample5-5
28 Emprcal Dstrbuto Fuctos F Cosder a r.v. X wth dstrbuto fucto whch s ukow. 5 We defe the emprcal cumulatve dstrbuto fucto 6 as follows: Defto 5.3 Emprcal Dstrbuto Fucto: We have a umber of depedet samples of a r.v. X, deoted {, =,,, }. The the emprcal dstrbuto fucto of X s defed as: umber of samples,,, ~ X (,,, ) F X () o greater tha
29 Emprcal Dstrbuto Fuctos (Cot.) 5 I chapter 3 whe we theoretcally dscussed r.v.'s, we assumed a certa type of dstrbuto fuctos such as Gaussa, epoetal etc., eve though are are ot absolutely sure of t... 6 Or smply emprcal dstrbuto.
30 Emprcal Dstrbuto Fuctos (Cot.) Eample 5.6 Obta the emprcal dstrbuto of the resstace samples gve Eample5-. Soluto Arragg the samples ascedg order, whch are 900, 939, 970, 996, 03, 07, 049, 06, 065 ad 079, the emprcal dstrbuto ca easly be obtaed va the above defto. The result s plotted Fgure5-.
31 Emprcal Dstrbuto Fuctos (Cot.) Fgure 5.: The emprcal dstrbuto fucto for resstace samples Eample5-.
32 Emprcal Dstrbuto Fuctos (Cot.) Note:. The emprcal dstrbuto fucto has the same propertes of a cdf. (check!). The emprcal probablty mass fucto, whch correspods to the pdf, ca easly be obtaed from the dstrbuto fucto. (how?)
33 Emprcal Dstrbuto Fuctos (Cot.) Smplfed way of computg emprcal dstrbuto: Whe the # of datum s large, we follow the followg steps: () We dvde the data rage to a coveet # of tervals of equal legth. () WE plot a hstogram coutg the umber of data wth each cell (or terval). (3) The # of data wth each cell s cumulatvely summed to get emprcal dstrbuto.
34 Emprcal Dstrbuto Fuctos (Cot.) Eample 5.7 The tervals b/w telephoe calls arrvg at a certa swtchg offce are recorded mutes, whch are: 0.06, 0.977, 0.05, 0.83, 0.597, 0.46,.37, 0.07, 0.9, 0.938, 0.065, 0.098, 0.7, 0.87, 0.863, 0.0, 0.37, 0.93, 0.343, 0.56, 0.45, 0.637, 0.8, 0.9, 0.4, 0.63, 0.37,.048, 0.5, 0.09,.675, 0.33, 0.06, 0.46,.8, 0.06, 0.04, 0.99, 0.53, 0.376, 0.49, 0.083, 0.575, 0.393, 0.65, 0.009, 0.606, 0.5, 0.83 ad Fd the hstogram ad the emprcal cdf of these tme tervals. Soluto: Followg the steps descrbed above, the result are plotted Fgure5-3. Note that the hstogram appears to be roughly epoetally decreasg
35 Emprcal Dstrbuto Fuctos (Cot.) Fgure 5.3: Emprcal dstrbutos for Eample5-7 (a) hstogram (b) emprcal cdf.
36 Emprcal Dstrbuto Fuctos (Cot.) Remarks:. Recall the defto of the pdf chapter 3: f X ( ) P( X ) umber of data values (, ) totalumber of data values,
37 Emprcal Dstrbuto Fuctos (Cot.) Based o ths, we ca fgure out that the hstogram obtaed above eample does ot match the pdf for two reasos: (a) The hstogram s ot ormalzed by the total # of data. (b) As s obvous the above equato,,.e. to get a appromato to the pdf, we must dvde through by Δ Wth these two correctos, replotted hstogram s Fgure5-4, alog wth the plot of the followg fucto: ~ f ( ) e X u( )
38 Emprcal Dstrbuto Fuctos (Cot.) (cf) The agreemet s surprsgly good The data values Eample5-7 have bee geerated va a radom umber geerator producg epoetally dstrbuted radom varables.
39 Emprcal Dstrbuto Fuctos (Cot.) Fgure 5.4: Normalzed hstogram to appromate the theoretcal pdf.
40 Emprcal Dstrbuto Fuctos (Cot.). Notce that there 9 a trade-off b/w # of bs versus the appearace of the hstogram: (a) Too may bs, due to too few samples per b, causes statstcal rregularty, ad thus make the hstogram ragged-lookg. (b) Too few bs causes a low resoluto o the abscssa of the hstogram. (cf) Usually rely o tral ad error process to select the sutable # of bs 8 8 Especally the case of relatvely few data samples, as the case of these eamples...
41 More o Mote Carlo Smulato Mote Carlo Smulato Comple computer smulatos of systems udergog radom perturbatos, usg radom umber geerator... Eample 5.8 Cosder a RC crcut wth radom resstace ad capactace 9, of whch the 3-dB cutoff frequecy of a RC flter s defed as: f 3 RC Aalyze the possble values of f 3.
42 More o Mote Carlo Smulato (Cot.) Soluto: Suppose the omal value of R s 000(Ω) w/ ±0% tolerace,.e. R ~ U[900; 00], whereas the capactace has a omal value of (μf) w/ ±5% tolerace,.e. C ~ U[0:95; :05]. 9 Ths s due to the ucerta maufacturg process...
43 More o Mote Carlo Smulato (Cot.) () Covetoal method: Wthout ay computer smulatos, all we ca deduce from the gve data are the omal value, mamum value, ad the mmum value of f 3,.e.: () omal f 3 : f, om () mamum f 3 : f 500 3, ma (Hz) 86(Hz)
44 More o Mote Carlo Smulato (Cot.) () mmum f 3 : f, m (Hz) Therefore, all we ca say about f3 s that t would have values of somewhere betwee 7(Hz) ad 86(Hz), wth ts omal value of 59(Hz).
45 More o Mote Carlo Smulato (Cot.) () Mote Carlo smulato: We geerate, say, 5000 values of R ad C whch are uformly dstrbuted wth ther allowed rage about the omal values, ad compute f 3 for each par of R ad C (usually usg hgh level programmg laguages C++, FORTRAN etc., or utlzg mathematcs package : MATLAB), ad the plot the hstogram of the cutoff frequecy... (fgure5-5)
46 More o Mote Carlo Smulato (Cot.) Fgure 5.5: Hstograms for (a) resstace, (b) capactace, ad (c) cutoff frequecy.
47 More o Mote Carlo Smulato (Cot.) Table5. MATLAB program for geeratg hstogram
48 More o Mote Carlo Smulato (Cot.) Wth ths method, we ca geerate a hstogram for f 3 to determe the fluece of compoet varato o cutoff frequecy Ths gves more formato that the above covetoal method 0 (e.g.) estmate of the most lkely value of f3 at whch the hstogram s ts peak. 0 We call ths covetoal method a etreme value aalyss
49 More o Mote Carlo Smulato (Cot.) Addtoal use of data from MC smulatos: (a) If the RC crcut s part of a larger system, we ca fd the mamum or mmum values of the cutoff frequecy, ad carry out a worst-case desg. (b) Fd the appromate probablty that f 3 les a specfed rego, for eample, from fgure5-5(c): P(40 whereas P(50 f f ) 60)
50 More o Mote Carlo Smulato (Cot.) Addtoal use of data from MC smulatos: (a) If the RC crcut s part of a larger system, we ca fd the mamum or mmum values of the cutoff frequecy, ad carry out a worst-case desg. (b) Fd the appromate probablty that f 3 les a specfed rego, for eample, from fgure5-5(c): Ths s the case wth more comple fuctoal relatoshps or probabltc models for the compoet values... Note that, a smple model as the above eample, we ca easly fgure out the etreme values w/o MC smulato. Note that, for ths purpose, the emprcal cdf would be more accurate..
51 Statstcal Process Cotrol I a maufacturg process, there several steps that take place Motor ad determe whe thgs have goe wrog... Close dow the process ad look for the offedg steps : Cotrol Chart Illustrato Suppose we are maufacturg trasstors, the ga of whch s of our cocer measure the ga, dvde the easuremets to lots
52 Statstcal Process Cotrol (Cot.) compute the sample mea of each lot: m, =,,,N compute the sample mea of the sample meas 3 : m set the upper ad lower lmts as ±3 sample std of the m 's from m check f ay m falls outsde the cotrol lmt... decde whether the maufacturg process has a problem or ot 3.e. sample mea of etre samples!
53 Statstcal Process Cotrol (Cot.) Eample 5.9 I a trasstor maufacturg process, for 5 lots of sze 5, the sample meas of the curret gas are measured ad plotted fgure5-6 by the 's. The sample mea of the etre 5 5 = 5 trasstor gas s 98.8, ad the sample stadard devato of the lot's sample mea s We, the, set the upper ad lower cotrol lmts as: UCL = 98: :95 = 9:65 LCL = 98:8-3 6:95 = 77:96
54 Statstcal Process Cotrol (Cot.) Soluto: The correspodg cotrol chart,.e. the sample meas of the 5 lots alog w/ the UCL ad LCL, s fgure 5-6. Note that for ths partcular process, we are well wth the cotrol lmts. 4 The MATLAB program producg the cotrol chart s Table5-. 4 If the sample mea of ay lot eceeds or goes below the UCL or LCL, respectvely, the process s sad to be out of cotrol, ad we seek for the cause of the ecurso, ad correct t!
55 Statstcal Process Cotrol (Cot.) Fgure 5.6: Cotrol chart for trasstor gas: 5 lots of 5 trasstor each
56 Statstcal Process Cotrol (Cot.) Table5. MATLAB program for geeratg a cotrol chart.
57 Covergece of the Sample Mea to the Mea Recall: The sample mea of a populato, gve below, s a estmate of the true mea μ X : Questo: How good ths estmate s? (r.v.) Aswer: We get a boud by applyg the Chebyshev's equalty We replace X wth.
58 Covergece of the Sample Mea to the Mea (Cot.) To apply the Chebyshev's equalty, we eed the () mea ad () varace of the sample mea : () mea 6 : E( ) X 6 Ths s show problem 4-4a.
59 Covergece of the Sample Mea to the Mea (Cot.) () varace: each sample from the populato of the varace s where ) Var( ) Var( ] ) [( )] )( [( ) )( ( ) ( } )] ( {[ ) Var( X X X j X j X j X j X X X X X X E X X E X X E X X E E
60 Covergece of the Sample Mea to the Mea (Cot.) Thus, the Chebyshev's equalty 7 becomes: P X k X k 7 Ufortuately, t s usually true that we also do ot kow the varace X of the samples, so we caot apply ths Chebyshev's equalty real estmato problems. We wll dscuss ths subject Chapter 6 aga.
61 Covergece of the Sample Mea to the Mea (Cot.) Eample 5.0 Samples draw from a populato are kow to have stadard devato of. We wat the probablty that the absolute value of the dfferece b/w ther sample mea ad the true mea s greater tha 0.5 to be less tha %. How may samples should be draw 8? 8 So that the sample mea, as a estmate of the true mea, matas the precso gve the problem.
62 Covergece of the Sample Mea to the Mea (Cot.) Soluto: From the Chebyshev's equalty, we wat: 0.0 k ad or k 00 or k 0 kσ X or or 600 Note that ths s a farly large # of samples.
63 Covergece of the Sample Mea to the Mea (Cot.) Remark If we kow somethg about the dstrbuto of the sample mea, the requred umber of samples ca be reduced...
64 Covergece of the Sample Mea to the Mea (Cot.) Recall 9 the cetral lmt theorem whch says that the sample mea s appromately Gaussa for a large umber of samples, ad the the LHS of Chebyshev's equalty becomes: e v /( X / ) dv Q( k) 0.0 k X / X / where the substtuto u = / v/σ X has bee used the tegrad to get the Q-fucto epresso. 9 I Chapter 4.
65 Covergece of the Sample Mea to the Mea (Cot.) Usg the table of Q-fucto, we fd that k = :57, ad sce k must be a teger, we roud t up to 3. Therefore, we have: kσ X or 0.5 or or Notce that the # of samples s cosderably lass tha the prevous case...
CHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More informationEconometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More informationLecture Notes Types of economic variables
Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationbest estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best
Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg
More information12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model
1. Estmatg Model parameters Assumptos: ox ad y are related accordg to the smple lear regresso model (The lear regresso model s the model that says that x ad y are related a lear fasho, but the observed
More informationChapter 5 Properties of a Random Sample
Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample
More informationMEASURES OF DISPERSION
MEASURES OF DISPERSION Measure of Cetral Tedecy: Measures of Cetral Tedecy ad Dsperso ) Mathematcal Average: a) Arthmetc mea (A.M.) b) Geometrc mea (G.M.) c) Harmoc mea (H.M.) ) Averages of Posto: a) Meda
More informationMean is only appropriate for interval or ratio scales, not ordinal or nominal.
Mea Same as ordary average Sum all the data values ad dvde by the sample sze. x = ( x + x +... + x Usg summato otato, we wrte ths as x = x = x = = ) x Mea s oly approprate for terval or rato scales, ot
More informationChapter 8: Statistical Analysis of Simulated Data
Marquette Uversty MSCS600 Chapter 8: Statstcal Aalyss of Smulated Data Dael B. Rowe, Ph.D. Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 08 by Marquette Uversty MSCS600 Ageda 8. The Sample
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More informationESS Line Fitting
ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here
More informationLecture 3. Sampling, sampling distributions, and parameter estimation
Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More informationSTA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #1
STA 08 Appled Lear Models: Regresso Aalyss Sprg 0 Soluto for Homework #. Let Y the dollar cost per year, X the umber of vsts per year. The the mathematcal relato betwee X ad Y s: Y 300 + X. Ths s a fuctoal
More information( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model
Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch
More informationENGI 3423 Simple Linear Regression Page 12-01
ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable
More informationMedian as a Weighted Arithmetic Mean of All Sample Observations
Meda as a Weghted Arthmetc Mea of All Sample Observatos SK Mshra Dept. of Ecoomcs NEHU, Shllog (Ida). Itroducto: Iumerably may textbooks Statstcs explctly meto that oe of the weakesses (or propertes) of
More informationModule 7: Probability and Statistics
Lecture 4: Goodess of ft tests. Itroducto Module 7: Probablty ad Statstcs I the prevous two lectures, the cocepts, steps ad applcatos of Hypotheses testg were dscussed. Hypotheses testg may be used to
More informationFunctions of Random Variables
Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,
More informationhp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations
HP 30S Statstcs Averages ad Stadard Devatos Average ad Stadard Devato Practce Fdg Averages ad Stadard Devatos HP 30S Statstcs Averages ad Stadard Devatos Average ad stadard devato The HP 30S provdes several
More informationObjectives of Multiple Regression
Obectves of Multple Regresso Establsh the lear equato that best predcts values of a depedet varable Y usg more tha oe eplaator varable from a large set of potetal predctors {,,... k }. Fd that subset of
More informationModule 7. Lecture 7: Statistical parameter estimation
Lecture 7: Statstcal parameter estmato Parameter Estmato Methods of Parameter Estmato 1) Method of Matchg Pots ) Method of Momets 3) Mamum Lkelhood method Populato Parameter Sample Parameter Ubased estmato
More informationSTA302/1001-Fall 2008 Midterm Test October 21, 2008
STA3/-Fall 8 Mdterm Test October, 8 Last Name: Frst Name: Studet Number: Erolled (Crcle oe) STA3 STA INSTRUCTIONS Tme allowed: hour 45 mutes Ads allowed: A o-programmable calculator A table of values from
More informationMultiple Choice Test. Chapter Adequacy of Models for Regression
Multple Choce Test Chapter 06.0 Adequac of Models for Regresso. For a lear regresso model to be cosdered adequate, the percetage of scaled resduals that eed to be the rage [-,] s greater tha or equal to
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More informationChapter 8. Inferences about More Than Two Population Central Values
Chapter 8. Ifereces about More Tha Two Populato Cetral Values Case tudy: Effect of Tmg of the Treatmet of Port-We tas wth Lasers ) To vestgate whether treatmet at a youg age would yeld better results tha
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More informationSimple Linear Regression
Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato
More informationf f... f 1 n n (ii) Median : It is the value of the middle-most observation(s).
CHAPTER STATISTICS Pots to Remember :. Facts or fgures, collected wth a defte pupose, are called Data.. Statstcs s the area of study dealg wth the collecto, presetato, aalyss ad terpretato of data.. The
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More informationClass 13,14 June 17, 19, 2015
Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral
More informationRegresso What s a Model? 1. Ofte Descrbe Relatoshp betwee Varables 2. Types - Determstc Models (o radomess) - Probablstc Models (wth radomess) EPI 809/Sprg 2008 9 Determstc Models 1. Hypothesze
More informationRandom Variate Generation ENM 307 SIMULATION. Anadolu Üniversitesi, Endüstri Mühendisliği Bölümü. Yrd. Doç. Dr. Gürkan ÖZTÜRK.
adom Varate Geerato ENM 307 SIMULATION Aadolu Üverstes, Edüstr Mühedslğ Bölümü Yrd. Doç. Dr. Gürka ÖZTÜK 0 adom Varate Geerato adom varate geerato s about procedures for samplg from a varety of wdely-used
More informationOrdinary Least Squares Regression. Simple Regression. Algebra and Assumptions.
Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos
More informationDiscrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b
CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package
More informationChapter Business Statistics: A First Course Fifth Edition. Learning Objectives. Correlation vs. Regression. In this chapter, you learn:
Chapter 3 3- Busess Statstcs: A Frst Course Ffth Edto Chapter 2 Correlato ad Smple Lear Regresso Busess Statstcs: A Frst Course, 5e 29 Pretce-Hall, Ic. Chap 2- Learg Objectves I ths chapter, you lear:
More informationX ε ) = 0, or equivalently, lim
Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece
More informationParameter, Statistic and Random Samples
Parameter, Statstc ad Radom Samples A parameter s a umber that descrbes the populato. It s a fxed umber, but practce we do ot kow ts value. A statstc s a fucto of the sample data,.e., t s a quatty whose
More informationSimulation Output Analysis
Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationLecture 1: Introduction to Regression
Lecture : Itroducto to Regresso A Eample: Eplag State Homcde Rates What kds of varables mght we use to epla/predct state homcde rates? Let s cosder just oe predctor for ow: povert Igore omtted varables,
More informationA Study of the Reproducibility of Measurements with HUR Leg Extension/Curl Research Line
HUR Techcal Report 000--9 verso.05 / Frak Borg (borgbros@ett.f) A Study of the Reproducblty of Measuremets wth HUR Leg Eteso/Curl Research Le A mportat property of measuremets s that the results should
More informationLecture 1 Review of Fundamental Statistical Concepts
Lecture Revew of Fudametal Statstcal Cocepts Measures of Cetral Tedecy ad Dsperso A word about otato for ths class: Idvduals a populato are desgated, where the dex rages from to N, ad N s the total umber
More informationDescriptive Statistics
Page Techcal Math II Descrptve Statstcs Descrptve Statstcs Descrptve statstcs s the body of methods used to represet ad summarze sets of data. A descrpto of how a set of measuremets (for eample, people
More informationMultiple Linear Regression Analysis
LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple
More informationPROPERTIES OF GOOD ESTIMATORS
ESTIMATION INTRODUCTION Estmato s the statstcal process of fdg a appromate value for a populato parameter. A populato parameter s a characterstc of the dstrbuto of a populato such as the populato mea,
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationMeasures of Dispersion
Chapter 8 Measures of Dsperso Defto of Measures of Dsperso (page 31) A measure of dsperso s a descrptve summary measure that helps us characterze the data set terms of how vared the observatos are from
More informationBounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy
Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled
More informationSimple Linear Regression
Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uversty Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal
More informationENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections
ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty
More informationLinear Regression. Hsiao-Lung Chan Dept Electrical Engineering Chang Gung University, Taiwan
Lear Regresso Hsao-Lug Cha Dept Electrcal Egeerg Chag Gug Uverst, Tawa chahl@mal.cgu.edu.tw Curve fttg Least-squares regresso Data ehbt a sgfcat degree of error or scatter A curve for the tred of the data
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More informationLecture 8: Linear Regression
Lecture 8: Lear egresso May 4, GENOME 56, Sprg Goals Develop basc cocepts of lear regresso from a probablstc framework Estmatg parameters ad hypothess testg wth lear models Lear regresso Su I Lee, CSE
More informationThird handout: On the Gini Index
Thrd hadout: O the dex Corrado, a tala statstca, proposed (, 9, 96) to measure absolute equalt va the mea dfferece whch s defed as ( / ) where refers to the total umber of dvduals socet. Assume that. The
More information22 Nonparametric Methods.
22 oparametrc Methods. I parametrc models oe assumes apror that the dstrbutos have a specfc form wth oe or more ukow parameters ad oe tres to fd the best or atleast reasoably effcet procedures that aswer
More informationCorrelation and Simple Linear Regression
Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uverst Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal
More informationSTATISTICAL INFERENCE
(STATISTICS) STATISTICAL INFERENCE COMPLEMENTARY COURSE B.Sc. MATHEMATICS III SEMESTER ( Admsso) UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION CALICUT UNIVERSITY P.O., MALAPPURAM, KERALA, INDIA -
More informationLecture 1: Introduction to Regression
Lecture : Itroducto to Regresso A Eample: Eplag State Homcde Rates What kds of varables mght we use to epla/predct state homcde rates? Let s cosder just oe predctor for ow: povert Igore omtted varables,
More informationENGI 4421 Propagation of Error Page 8-01
ENGI 441 Propagato of Error Page 8-01 Propagato of Error [Navd Chapter 3; ot Devore] Ay realstc measuremet procedure cotas error. Ay calculatos based o that measuremet wll therefore also cota a error.
More informationMidterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes
coometrcs, CON Sa Fracsco State Uversty Mchael Bar Sprg 5 Mdterm am, secto Soluto Thursday, February 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes eam.. No calculators of ay kd are allowed..
More informationIntroduction to local (nonparametric) density estimation. methods
Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest
More informationFeature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)
CSE 546: Mache Learg Lecture 6 Feature Selecto: Part 2 Istructor: Sham Kakade Greedy Algorthms (cotued from the last lecture) There are varety of greedy algorthms ad umerous amg covetos for these algorthms.
More informationChapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance
Chapter, Part A Aalyss of Varace ad Epermetal Desg Itroducto to Aalyss of Varace Aalyss of Varace: Testg for the Equalty of Populato Meas Multple Comparso Procedures Itroducto to Aalyss of Varace Aalyss
More informationArithmetic Mean Suppose there is only a finite number N of items in the system of interest. Then the population arithmetic mean is
Topc : Probablty Theory Module : Descrptve Statstcs Measures of Locato Descrptve statstcs are measures of locato ad shape that perta to probablty dstrbutos The prmary measures of locato are the arthmetc
More informationLinear Regression with One Regressor
Lear Regresso wth Oe Regressor AIM QA.7. Expla how regresso aalyss ecoometrcs measures the relatoshp betwee depedet ad depedet varables. A regresso aalyss has the goal of measurg how chages oe varable,
More informationStatistics Descriptive and Inferential Statistics. Instructor: Daisuke Nagakura
Statstcs Descrptve ad Iferetal Statstcs Istructor: Dasuke Nagakura (agakura@z7.keo.jp) 1 Today s topc Today, I talk about two categores of statstcal aalyses, descrptve statstcs ad feretal statstcs, ad
More informationComparison of Dual to Ratio-Cum-Product Estimators of Population Mean
Research Joural of Mathematcal ad Statstcal Sceces ISS 30 6047 Vol. 1(), 5-1, ovember (013) Res. J. Mathematcal ad Statstcal Sc. Comparso of Dual to Rato-Cum-Product Estmators of Populato Mea Abstract
More information1. A real number x is represented approximately by , and we are told that the relative error is 0.1 %. What is x? Note: There are two answers.
PROBLEMS A real umber s represeted appromately by 63, ad we are told that the relatve error s % What s? Note: There are two aswers Ht : Recall that % relatve error s What s the relatve error volved roudg
More informationCan we take the Mysticism Out of the Pearson Coefficient of Linear Correlation?
Ca we tae the Mstcsm Out of the Pearso Coeffcet of Lear Correlato? Itroducto As the ttle of ths tutoral dcates, our purpose s to egeder a clear uderstadg of the Pearso coeffcet of lear correlato studets
More informationEstimation of Stress- Strength Reliability model using finite mixture of exponential distributions
Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur
More informationGOALS The Samples Why Sample the Population? What is a Probability Sample? Four Most Commonly Used Probability Sampling Methods
GOLS. Epla why a sample s the oly feasble way to lear about a populato.. Descrbe methods to select a sample. 3. Defe ad costruct a samplg dstrbuto of the sample mea. 4. Epla the cetral lmt theorem. 5.
More informationBayes (Naïve or not) Classifiers: Generative Approach
Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg
More informationε. Therefore, the estimate
Suggested Aswers, Problem Set 3 ECON 333 Da Hugerma. Ths s ot a very good dea. We kow from the secod FOC problem b) that ( ) SSE / = y x x = ( ) Whch ca be reduced to read y x x = ε x = ( ) The OLS model
More informationSTA 105-M BASIC STATISTICS (This is a multiple choice paper.)
DCDM BUSINESS SCHOOL September Mock Eamatos STA 0-M BASIC STATISTICS (Ths s a multple choce paper.) Tme: hours 0 mutes INSTRUCTIONS TO CANDIDATES Do ot ope ths questo paper utl you have bee told to do
More informationLinear Regression. Hsiao-Lung Chan Dept Electrical Engineering Chang Gung University, Taiwan
Lear Regresso Hsao-Lug Cha Dept Electrcal Egeerg Chag Gug Uverst, Tawa chahl@mal.cgu.edu.tw Curve fttg Least-squares regresso Data ehbt a sgfcat degree of error or scatter A curve for the tred of the data
More informationLine Fitting and Regression
Marquette Uverst MSCS6 Le Fttg ad Regresso Dael B. Rowe, Ph.D. Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Coprght 8 b Marquette Uverst Least Squares Regresso MSCS6 For LSR we have pots
More informationSTK4011 and STK9011 Autumn 2016
STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto
More information2.28 The Wall Street Journal is probably referring to the average number of cubes used per glass measured for some population that they have chosen.
.5 x 54.5 a. x 7. 786 7 b. The raked observatos are: 7.4, 7.5, 7.7, 7.8, 7.9, 8.0, 8.. Sce the sample sze 7 s odd, the meda s the (+)/ 4 th raked observato, or meda 7.8 c. The cosumer would more lkely
More informationChapter Statistics Background of Regression Analysis
Chapter 06.0 Statstcs Backgroud of Regresso Aalyss After readg ths chapter, you should be able to:. revew the statstcs backgroud eeded for learg regresso, ad. kow a bref hstory of regresso. Revew of Statstcal
More informationCS286.2 Lecture 4: Dinur s Proof of the PCP Theorem
CS86. Lecture 4: Dur s Proof of the PCP Theorem Scrbe: Thom Bohdaowcz Prevously, we have prove a weak verso of the PCP theorem: NP PCP 1,1/ (r = poly, q = O(1)). Wth ths result we have the desred costat
More informationChapter 13 Student Lecture Notes 13-1
Chapter 3 Studet Lecture Notes 3- Basc Busess Statstcs (9 th Edto) Chapter 3 Smple Lear Regresso 4 Pretce-Hall, Ic. Chap 3- Chapter Topcs Types of Regresso Models Determg the Smple Lear Regresso Equato
More informationContinuous Distributions
7//3 Cotuous Dstrbutos Radom Varables of the Cotuous Type Desty Curve Percet Desty fucto, f (x) A smooth curve that ft the dstrbuto 3 4 5 6 7 8 9 Test scores Desty Curve Percet Probablty Desty Fucto, f
More informationMultivariate Transformation of Variables and Maximum Likelihood Estimation
Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty
More informationTHE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE
THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the
More informationLecture 9: Tolerant Testing
Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have
More information1 Onto functions and bijections Applications to Counting
1 Oto fuctos ad bectos Applcatos to Coutg Now we move o to a ew topc. Defto 1.1 (Surecto. A fucto f : A B s sad to be surectve or oto f for each b B there s some a A so that f(a B. What are examples of
More informationSection l h l Stem=Tens. 8l Leaf=Ones. 8h l 03. 9h 58
Secto.. 6l 34 6h 667899 7l 44 7h Stem=Tes 8l 344 Leaf=Oes 8h 5557899 9l 3 9h 58 Ths dsplay brgs out the gap the data: There are o scores the hgh 7's. 6. a. beams cylders 9 5 8 88533 6 6 98877643 7 488
More informationThe equation is sometimes presented in form Y = a + b x. This is reasonable, but it s not the notation we use.
INTRODUCTORY NOTE ON LINEAR REGREION We have data of the form (x y ) (x y ) (x y ) These wll most ofte be preseted to us as two colum of a spreadsheet As the topc develops we wll see both upper case ad
More informationLecture 5: Interpolation. Polynomial interpolation Rational approximation
Lecture 5: Iterpolato olyomal terpolato Ratoal appromato Coeffcets of the polyomal Iterpolato: Sometme we kow the values of a fucto f for a fte set of pots. Yet we wat to evaluate f for other values perhaps
More informationBIOREPS Problem Set #11 The Evolution of DNA Strands
BIOREPS Problem Set #11 The Evoluto of DNA Strads 1 Backgroud I the md 2000s, evolutoary bologsts studyg DNA mutato rates brds ad prmates dscovered somethg surprsg. There were a large umber of mutatos
More informationStatistics MINITAB - Lab 5
Statstcs 10010 MINITAB - Lab 5 PART I: The Correlato Coeffcet Qute ofte statstcs we are preseted wth data that suggests that a lear relatoshp exsts betwee two varables. For example the plot below s of
More informationCHAPTER 4 RADICAL EXPRESSIONS
6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube
More informationQuantitative analysis requires : sound knowledge of chemistry : possibility of interferences WHY do we need to use STATISTICS in Anal. Chem.?
Ch 4. Statstcs 4.1 Quattatve aalyss requres : soud kowledge of chemstry : possblty of terfereces WHY do we eed to use STATISTICS Aal. Chem.? ucertaty ests. wll we accept ucertaty always? f ot, from how
More informationThe expected value of a sum of random variables,, is the sum of the expected values:
Sums of Radom Varables xpected Values ad Varaces of Sums ad Averages of Radom Varables The expected value of a sum of radom varables, say S, s the sum of the expected values: ( ) ( ) S Ths s always true
More informationRandom Variables and Probability Distributions
Radom Varables ad Probablty Dstrbutos * If X : S R s a dscrete radom varable wth rage {x, x, x 3,. } the r = P (X = xr ) = * Let X : S R be a dscrete radom varable wth rage {x, x, x 3,.}.If x r P(X = x
More information5.1 Properties of Random Numbers
UNIT - 5 : RANDOM-NUMBER GENERATION, RANDOM-VARIATE GENERATION: Propertes of radom umbers; Geerato of pseudo-radom umbers; Techques for geeratg radom umbers; Tests for Radom Numbers. Radom-Varate Geerato:
More informationFor combinatorial problems we might need to generate all permutations, combinations, or subsets of a set.
Addtoal Decrease ad Coquer Algorthms For combatoral problems we mght eed to geerate all permutatos, combatos, or subsets of a set. Geeratg Permutatos If we have a set f elemets: { a 1, a 2, a 3, a } the
More informationChapter 11 Systematic Sampling
Chapter stematc amplg The sstematc samplg techue s operatoall more coveet tha the smple radom samplg. It also esures at the same tme that each ut has eual probablt of cluso the sample. I ths method of
More information