ELEG 3143 Probability & Stochastic Process Ch. 5 Elements of Statistics

Similar documents
: : 8.2. Test About a Population Mean. STT 351 Hypotheses Testing Case I: A Normal Population with Known. - null hypothesis states 0

Inference on One Population Mean Hypothesis Testing

Introduction to mathematical Statistics

Mathacle. PSet Stats, Concepts In Statistics Level Number Name: Date: Hypothesis Test We assume, calculate and conclude.

Probability and Stochastic Processes: A Friendly Introduction for Electrical and Computer Engineers Roy D. Yates and David J.

Avd. Matematisk statistik

, we would have a series, designated as + j 1

2017/2018 SEMESTER 1 COMMON TEST

Chapter 5. The Riemann Integral. 5.1 The Riemann integral Partitions and lower and upper integrals. Note: 1.5 lectures

82A Engineering Mathematics

D1.7 Two independent Events: Events A and B are independent if and only if P[AB] = P[A]P[B]. When events A and B have nonzero probabilities, the

Limit of a function:

Fourier Series and Applications

1. (25 points) Use the limit definition of the definite integral and the sum formulas to compute. [1 x + x2

1 Tangent Line Problem

0 otherwise. sin( nx)sin( kx) 0 otherwise. cos( nx) sin( kx) dx 0 for all integers n, k.

Particle in a Box. and the state function is. In this case, the Hermitian operator. The b.c. restrict us to 0 x a. x A sin for 0 x a, and 0 otherwise

Math 153: Lecture Notes For Chapter 1

UNIVERSITY OF BRISTOL. Examination for the Degrees of B.Sc. and M.Sci. (Level C/4) ANALYSIS 1B, SOLUTIONS MATH (Paper Code MATH-10006)

Chapter 7 Infinite Series

Prior distributions. July 29, 2002

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Lecture 17

INFINITE SERIES. ,... having infinite number of terms is called infinite sequence and its indicated sum, i.e., a 1

ELEG 5173L Digital Signal Processing Ch. 2 The Z-Transform

UNIT 4 EXTENDING THE NUMBER SYSTEM Lesson 1: Working with the Number System Instruction

Mathacle. PSet Stats, Concepts In Statistics Level Number Name: Date:

INTEGRATION TECHNIQUES (TRIG, LOG, EXP FUNCTIONS)

10.5 Power Series. In this section, we are going to start talking about power series. A power series is a series of the form

Definite Integral. The Left and Right Sums

MAS221 Analysis, Semester 2 Exercises

Graphing Review Part 3: Polynomials

MATRIX ALGEBRA, Systems Linear Equations

Taylor Polynomials. The Tangent Line. (a, f (a)) and has the same slope as the curve y = f (x) at that point. It is the best

ALGEBRA II CHAPTER 7 NOTES. Name

3 Monte Carlo Methods

POWER SERIES R. E. SHOWALTER

1.3 Continuous Functions and Riemann Sums

Unit 1. Extending the Number System. 2 Jordan School District

APPLICATION OF DIFFERENCE EQUATIONS TO CERTAIN TRIDIAGONAL MATRICES

Lecture 6 Simple alternatives and the Neyman-Pearson lemma

INTEGRATION IN THEORY

Schrödinger Equation Via Laplace-Beltrami Operator

PROGRESSIONS AND SERIES

Linear Programming. Preliminaries

g as the function in which for every element x be the set of polynomials of a degree less than or equal to n with , for each i from 0 to n )

Week 13 Notes: 1) Riemann Sum. Aim: Compute Area Under a Graph. Suppose we want to find out the area of a graph, like the one on the right:

8: Large-Sample Estimation

Students must always use correct mathematical notation, not calculator notation. the set of positive integers and zero, {0,1, 2, 3,...

2015/2016 SEMESTER 2 SEMESTRAL EXAMINATION

( ) k ( ) 1 T n 1 x = xk. Geometric series obtained directly from the definition. = 1 1 x. See also Scalars 9.1 ADV-1: lim n.

Summer MA Lesson 4 Section P.3. such that =, denoted by =, is the principal square root

Algebra 2 Readiness Summer Packet El Segundo High School

Error-free compression

The Exponential Function

Approximate Integration

2a a a 2a 4a. 3a/2 f(x) dx a/2 = 6i) Equation of plane OAB is r = λa + µb. Since C lies on the plane OAB, c can be expressed as c = λa +

Chapter 2 Infinite Series Page 1 of 9

In an algebraic expression of the form (1), like terms are terms with the same power of the variables (in this case

Section 6.3: Geometric Sequences

,... are the terms of the sequence. If the domain consists of the first n positive integers only, the sequence is a finite sequence.

EVALUATING DEFINITE INTEGRALS

Summer Math Requirement Algebra II Review For students entering Pre- Calculus Theory or Pre- Calculus Honors

ENGINEERING PROBABILITY AND STATISTICS

The Hypergeometric Coupon Collection Problem and its Dual

 n. A Very Interesting Example + + = d. + x3. + 5x4. math 131 power series, part ii 7. One of the first power series we examined was. 2!

We will begin by supplying the proof to (a).

Math 104: Final exam solutions

The Weight of the Shortest Path Tree

1 Probability Density Functions

8.3 Sequences & Series: Convergence & Divergence

CHAPTER 6: USING MULTIPLE REGRESSION

Lecture 38 (Trapped Particles) Physics Spring 2018 Douglas Fields

Review of the Riemann Integral

BRAIN TEASURES INDEFINITE INTEGRATION+DEFINITE INTEGRATION EXERCISE I

MATH 104 FINAL SOLUTIONS. 1. (2 points each) Mark each of the following as True or False. No justification is required. y n = x 1 + x x n n

Content: Essential Calculus, Early Transcendentals, James Stewart, 2007 Chapter 1: Functions and Limits., in a set B.

MA123, Chapter 9: Computing some integrals (pp )

Summary. Recap ... Last Lecture. Summary. Theorem

Name: Period: Date: 2.1 Rules of Exponents

Math 140 Introductory Statistics

is an ordered list of numbers. Each number in a sequence is a term of a sequence. n-1 term

Sequence and Series of Functions

Formal Languages The Pumping Lemma for CFLs

The Definite Integral

DIGITAL SIGNAL PROCESSING LECTURE 5

Infinite Series Sequences: terms nth term Listing Terms of a Sequence 2 n recursively defined n+1 Pattern Recognition for Sequences Ex:

* power rule: * fraction raised to negative exponent: * expanded power rule:

MTH 146 Class 16 Notes

4. When is the particle speeding up? Why? 5. When is the particle slowing down? Why?

Applications of Regular Closure

Probability for mathematicians INDEPENDENCE TAU

SM2H. Unit 2 Polynomials, Exponents, Radicals & Complex Numbers Notes. 3.1 Number Theory

( a n ) converges or diverges.

The Weierstrass Approximation Theorem

BC Calculus Review Sheet

Convergence rates of approximate sums of Riemann integrals

Double Sums of Binomial Coefficients

MATH 118 HW 7 KELLY DOUGAN, ANDREW KOMAR, MARIA SIMBIRSKY, BRANDEN LASKE

19.1 The dictionary problem

is continuous at x 2 and g(x) 2. Oil spilled from a ruptured tanker spreads in a circle whose area increases at a

Transcription:

Deprtet of Electricl Egieerig Uiversity of Arkss ELEG 3143 Probbility & Stochstic Process Ch. 5 Eleets of Sttistics Dr. Jigxi Wu wuj@urk.edu

OUTLINE Itroductio: wht is sttistics? Sple e d sple vrice Cofidece itervls Hypothesis testig

INTRODUCTION 3 Sttistics A bridge betwee the probbility theory d the rel world The sciece of gtherig d lyzig dt, d with the drwig of coclusios or ifereces fro the dt. Exple 1. collect dt bout the life sp of ll feles i US. lyze the dt to fid out:» Wht is the verge (e) fele life sp i US?» Wht is the vrice of the fele life sp?» Wht is the distributio of the fele life sp? Exple 1. cosider couictio syste trsittig -1 d 1. received sigl is distorted by oise (e.g., Tx 1, Rx 0.) 3. Bsed o the oisy received ifortio, fid out wht ws trsitted (1 or -1)

INTRODUCTION 4 Clssifictios of sttistics Splig theory: How to select sples fro soe collectio of dt tht is too lrge to be exied copletely. Estitio theory: Mke soe estitio or predictio bsed o the dt tht re vilble (e.g. estite the verge life sp) Hypothesis testig Attepts to decide which of two or ore hypotheses bout the dt re true (e.g. fid out whether 1 or -1 re trsitted i couictio syste)

OUTLINE 5 Itroductio: wht is sttistics? Sple e d sple vrice Cofidece itervl Hypothesis testig

SAMPLE MEAN AND VARIANCE 6 Defiitio: popultio the collectio of ALL objects or eleets uder study. E.g. esure the fele life sp i US eber: the life sp of oe fele i US (c be odeled s RV: ) Popultio: the life sps of ALL the feles i US Most of the tie, it is extreely difficult d expesive, if ot ipossible, to get the dt for the etire popultio. We tke liited uber of sples to represet the popultio Defiitio: rdo sple (or, sple) A rdo sple is prt of the popultio tht hs bee selected t rdo. E.g. Cosider popultio with N ebers. We c rdoly pick << N ebers. The ebers for sple of the popultio. All ebers of the popultio re eqully likely beig picked. The picks re idepedet of ech others.

SAMPLE MEAN AND VARIANCE 7 Rdo sple Cosider rdo sple with ebers Ech eber is rdo vrible The rdo vribles re utully idepedet The rdo vribles re ideticlly distributed With the rdo sple, we c ifer (estite) the properties of the popultio with N >> ebers E.g. e, vrice, distributio, etc. Ituitively, the lrger the vlue of, the better the estitio. We will prove this ituitio.

SAMPLE MEAN AND VARIANCE 8 Sple e The sple e of is 1 It is estitio of the ctul e of the popultio i 1 is rdo vrible, becuse it is fuctio of RVs i E ( ) The first oet of the sple e E [ ] Defiitio: ubised estitor The e of the estitio is the se s its true vlue The sple e is ubised estitio of the e E [ ]

SAMPLE MEAN AND VARIANCE The d cetrl oet (vrice) of the sple e Recll: vrice esures the devitio fro the e The sller the vrice, the less the rdoess If vrice is 0, the the RV is costt The lrger the sple size, the ore ccurte the estitio. 9 ] [ ] [ ) ( E E E Vr Vr ) (

SAMPLE MEAN AND VARIANCE 10 Exple A popultio of 10 resistors is to be tested. The true stdrd devitio is 5 Oh, d the true e is 100 Oh. How lrge ust be the sple size, if we wt to obti sple e, whose stdrd devitio is % of the true popultio e? If the sple size is 8, wht is the stdrd devitio of the sple e?

SAMPLE MEAN AND VARIANCE 11 Exple The sple of rdo tie fuctio follows pdf give s follows: f ( x ) 1 ( x 3) exp 10 10 The fuctio is spled so s to obti idepedet sple vlues. How y sple vlues re required to obti sple e, whose stdrd devitio is 1% fro the true e?

SAMPLE MEAN AND VARIANCE Sple vrice The sple vrice of is defied s The is used to ke ubised estitor. is rdo vrible. First oet of the sple vrice The sple vrice is ubised estitio of 1 i i S 1 ) ( 1 1 ~ 1 1 ~ S ~ S ~ S ] ~ [ S E

SAMPLE MEAN AND VARIANCE 13 Exple Cosider 5 rdo ubers: 0.3, 0., 0.8, 0.7, 0.9 1. Fid the sple e d sple vrice. If the 5 rdo ubers re rdoly picked fro popultio of rdo ubers tht re uiforly distributed i [0, 1], fid the vrice of the sple e.

SAMPLE MEAN AND VARIANCE 14 Exple Write Mtlb progr to geerte 100 idepedet rdo ubers. The rdo uber re sples of uiforly distributed rdo vrible i (0, 10). (1) Write fuctios to fid the sple e d sple vrice. () Wht is the vrice of the sple e? %------------------------------ % i. cler ll; rdo_sple = 10*rd (1, 100); % geerte 100 rdo ubers sple_e = fid_sple_e(rdo_sple); sple_vr = fid_sple_vr(rdo_sple); %-------------------------------- % fid_sple_e. fuctio output = fid_sple_e(iput) _sple = legth(iput); output = su(iput)/_sple;

SAMPLE MEAN AND VARIANCE 15 Exple (Cot d) %-------------------------------- % fid_sple_vr. fuctio output = fid_sple_vr(iput) % fid out how y ebers re i the sple _sple = legth(iput); % clculte the sple e sple_e = fid_sple_e(iput); % clculte the sple vrice output = su( (iput-sple_e).^ )/(_sple-1);

OUTLINE 16 Itroductio: wht is sttistics? Sple e d sple vrice Cofidece itervl Hypothesis testig

CONFIDENCE INTERVAL 17 Cetrl Liit Theore Let be rdo sple of size. They re idepedet d ideticlly distributed with e d vrice. Whe, the sple e, distributio with e d vrice. 1 i 1 i, coverges i distributio to Gussi Whe is lrge ( > 30), follows pproxitely to Gussi distributio, regrdless of the distributio of i

CONFIDENCE INTERVAL 18 Cofidece itervl Exple: estite the e,, of popultio of dt. The sple e, 1, is RV thus it could be quite differet fro the true e. i 1 i Specify itervl tht is highly likely to coti the true vlue of E.g. It is 99% likely tht the true vlue of is i the itervl [, ] Pr 0. 99 [, ] is clled the 99% cofidece itervl of the e

19 Cofidece Itervl Cofidece itervl v.s. sple e Sple e ttepts to use sigle uber, represet the sple e The sple e is RV, thus it could be quite differet fro the true e. How uch c we trust this sigle uber estitio? Cofidece itervl, isted, ttepts to specify itervl tht is highly likely to coti the true vlue of the estitio. 1 i 1 i, to The q 100 % cofidece itervl for the estitio of the preter is defied s [, ], such tht Pr q

CONFIDENCE INTERVAL Cofidece Itervl (Cot d) Bsed o the cetrl liit theore, is Gussi distributed with e d vrice 0 Pr Pr dx x f ) ( z Q dz e dx x f 1 1 ) ( Q 1 Pr Q 1 Pr

CONFIDENCE INTERVAL Exple A very lrge popultio of resistor vlues hs true e of 100 Oh d stdrd devitio of 5 Oh. Fid the 95% cofidece itervl (cofidece liits) o the sple e if the sple size is 100. Q(1.96) = 0.05 1 Q 1 Pr

OUTLINE Itroductio: wht is sttistics? Sple e d sple vrice Cofidece itervl Hypothesis testig

HYPOTHESIS TESTING 3 Hypothesis testig Testig ssertio bout popultio bsed o rdo sple. Exple: Hypothesis: give coi is fir Test: flip the coi 100 ties, cout the uber of heds Exple: If the coi is fir, we expect pproxitely 50 heds. E.g. if the uber of heds is i [47, 53], the hypothesis is true. The hypothesis is flse otherwise. The itervl [47, 53] is chose rbitrrily. How to systeticlly choose the itervl? Hypothesis: the light bulb fro certi ufcture c lst 1000 hrs. Test: tke 50 light bulbs, esure their life, d fid the sple e If the sple e is greter th t hrs, the hypothesis is true. How do we deterie the vlue t? 900 hrs? 950 hrs? 999 hrs?

HYPOTHESIS TESTING 4 Hypothesis testig: Null hypothesis The hypothesis to be tested Altertive hypothesis The copleet (opposite) of the ull hypothesis Exple: Test the hypothesis tht give coi is fir. Test the hypothesis tht lightbulb c lst 1,000 hours Test the hypothesis tht certi ptiet does ot hve ccer

HYPOTHESIS TESTING 5 Errors Type I error: Reject whe is true H H 0 0 Flse positive, flse lr Type II error: Accept whe is flse Flse egtive H H 0 0

HYPOTHESIS TESTING 6 Hypothesis testig: sigificce testig Test hypothesis bout preter p of rdo vrible Exple: test whether coi is fir : Beroulli RV with preter p: P(=1)=p, P(=0)=1-p : p = 0.5 (the coi is fir). H 0 H 0 Objective: ccept or reject the hypothesis bsed o rdo sple

HYPOTHESIS TESTING 7 Exple A certi coi is clied to be fir with 95% cofidece itervl. To test the hypothesis, we flip the coi 100 ties, d fid the sple e,. If, c we ccept the cli? 0.43 Sol: Hypothesis: this is fir coi p 0.5, fid out if 0.43 p p 0. 5 is i the 95% cofidece itervl Pr 1 Q

HYPOTHESIS TESTING 8 Exple: A resistor ufcture is testig the qulity of btch of resistors with oil vlue 1K Oh, with 95% cofidece level. A sple of 100 resistors re tested, d the sple e is 1040 Oh, d the sple stdrd devitio is 100 Oh. Do the resistors pss the qulity check?

HYPOTHESIS TESTING 9 Biry hypothesis testig: Exple

HYPOTHESIS 30 Receiver opertig chrcteristics (ROC) curve Plot true positive probbility (copleet of type II error) s fuctio of flse positive probbility (type I error)