Chapter 6 Principles of Data Reduction

Size: px
Start display at page:

Download "Chapter 6 Principles of Data Reduction"

Transcription

1 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a ukow parameter. Notes:. X deotes the radom variables X, X,, X ad x deotes the sample poits x, x,, x.. A statistic, T ( X ), is a form of summary or data reductio. 3. T ( X) ca be thought of as partitioig the sample space,, i terms of the set of values of the values of T. X i that geerate Three Priciples of Data Reductio. Sufficiecy Priciple: promotes a method of data reductio that does ot discard iformatio about parameter.. Likelihood Priciple: describes a fuctio of the parameter, determied by the observed sample, that cotais all the iformatio about that is available from the sample.

2 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 3. Equivariace Priciple: prescribes a method of data reductio that still preserves some importat features of the model. Sectio 6. Sufficiecy Priciple A sufficiet statistic for a parameter is a statistic that, i a certai sese, captures all the iformatio about cotaied i the sample. Ay additioal iformatio i the sample, besides the value of the sufficiet statistic, does ot cotais ay more iformatio about. Sufficiecy Priciple: If T ( X ) is a sufficiet statistic for, the ay iferece about should deped o the sample X oly through the value of T ( X ). That is, if x ad y are two sample poits such that T( x) T( y ), the the iferece about should be the same whether X=x or X=y is observed. Sectio 6..: Sufficiet Statistics Defiitio 6.. A statistic T ( X ) is a sufficiet statistic for if the coditioal distributio of the sample X give the value of T ( X) does ot deped o. Questio: Is there a simpler way to fid a sufficiet statistic?

3 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Theorem 6.. If p( x ) is the joit pdf or pmf X ad qt ( ) is the the pdf or pmf of T ( X ), the T ( X) is a sufficiet statistic for if, for every x i the sample space, the ratio p( x ) / qt ( ( x ) ) is a costat fuctio of. Proof: P ( X=x T( X) T( x)) P ( X=x) p( x ). P ( T( X) T( x)) p( T( x) ) P ( X=xad T( X) T( x)) P ( T( X) T( x)) Example 6..3 (Biomial sufficiet statistic) Let X,, X be iid Beroulli with parameter,0. Show that T( X) X X is a sufficiet statistic for. p( x ) Solutio: pt ( ( x) ) x x i i ( ) i =/ ( t x ). i i t t t ( ) t Example 6..4 (Normal sufficiet statistic) Let X,, X be iid (, ), where is kow. Show that T( X ) X is a sufficiet statistic for. Solutio: See the textbook. 3

4 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Example (Example of a Statistic that Is Not Sufficiet) Cosider the model of Example 6.. agai with 3. The T X X X3 is sufficiet while T XX X3 is ot sufficiet because: PX (, X 0, X3 XX X3 ) PX (, X 0, X3 ) PX (, X 0, X3 ) PX ( 0, X, X3 0) ( ) ( ). ( ) ( ) ( ) ( ) Example 6..5 (Sufficiet order statistic) Let X,, X be iid from a pdf f ad o other iformatio about f is available. The it follows that Where x() x() x( ) are the order statistics. f ( x ) f ( x ) f ( x ), i i i By Theorem 6.., the order statistics are a sufficiet statistic. Without additioal iformatio about f, we caot have further reductio. () i If f is Cauchy, the order statistics. f x ( ) /[ ( x ) ], or logic, f( x) e /[ e ] ( x) ( x), the most reductio we ca get are 4

5 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Note: Outside the expoetial family of distributios, it is rare to have a sufficiet statistic of smaller dimesio tha the size of the sample ad i may cases order statistics is the best we ca do. Example (Sufficiet Statistic for Poisso Family) Let X,, X be iid Poisso populatio with the parameter 0. The T( X ) X i i is a sufficiet statistic for. Proof: Notice that T has a Poisso distributio with the parameter. Questio: Ca we fid a sufficiet statistic by simple examiatio of the pdf or pmf? Theorem 6..6 (Factorizatio Theorem) Let f ( x ) deote the joit pdf or pmf of a sample X. A statistic T ( X ) is a sufficiet statistic for if ad oly if there exist fuctios gt ( ) ad h( x) such that, for all sample poits x ad all parameter poits, f ( x ) gt ( ( x) ) h( x ). Note: To use the factorizatio Theorem to fid a sufficiet statistic, we factor the joit pdf of the sample ito two parts, with oe part ot depedig o ( h( x )). The other part, the oe that depeds o, usually depeds o the sample X oly through some fuctio T ( X ) ad this fuctio is the sufficiet statistic of. 5

6 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Example 6..7 Let X,, X be iid (, ), where is kow. Show that T( X ) X is a sufficiet statistic for usig the Factorizatio Theorem. Example 6..8 (Uiform sufficiet statistic) Let X,, X be iid from a discrete uiform o,,. Show that T( X ) X max X is a sufficiet statistic for. ( ) i i Example 6..9 (Normal sufficiet statistic, ad ukow) Let X,, X be iid (, ). Show that T X T X T X X S is a sufficiet statistic for ad ( ) ( ( ), ( )) (, ). Note: For a ormal model (, ), X ad S cotai all iformatio about ad. However, if the model is ot ormal, this may ot ecessarily be true. Example (Sufficiet Statistic for Poisso Family) Let X,, X be iid Poisso populatio with the parameter 0. The use the Factorizatio Theorem to show that both sufficiet statistics for. T( X ) X ad i i T( X ) ( X, X ) i i are Questio: Is there a easy way to fid a sufficiet statistic for a expoetial family of distributios? 6

7 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Theorem 6..0 Let X,, X be iid from a pdf or pmf f ( x ) that belogs to a expoetial family give by Where θ (,, d ), d k. The is a sufficiet statistic for θ. f ( x θ) h( x) c( θ)exp( w( ) ( )) i i θ ti x, T( X) ( t ( X ), t ( X ),, t ( X )) j j j j j k j k Note: There ca be more tha oe sufficiet statistic for a give model (e.g., X itself is a sufficiet statistic; ay oe-to-oe fuctio of a sufficiet statistic is a sufficiet statistic). Example (Sufficiet Statistic for Poisso Family) Let X,, X be iid Poisso populatio with the parameter x 0. The f( x ) exp( ) exp( )exp( xlog( )), we have hx ( ) / x!, c( ) exp( ), x! x! w( ) log( ), ad tx ( ) x, so T ( X ) t ( X ) X is a sufficiet statistic for. i i i i Sectio 6..: Miimal Sufficiet Statistics 7

8 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Defiitio 6.. A sufficiet statistic T ( X ) is called miimal sufficiet statistic if, for ay other sufficiet statistic T '( X ), T ( X) is a fuctio of T '( X ). Notes:. The partitio associated with a miimal sufficiet statistic is the coarsest possible partitio for a sufficiet statistic so that it achieves the greatest possible data reductio for a sufficiet statistic.. Miimal sufficiet statistic elimiates all the extraeous iformatio i the sample ad leaves oly that which cotais iformatio about. 3. How to fid the miimal sufficiet statistics? Example 6.. (Two ormal sufficiet statistics) Let X,, X be iid (, ), where is kow. As see i Example 6..9, T '( ) ( X, S ) X is a sufficiet statistic for ( is a kow parameter i this case). However, we ca reduce further T '( X ) by defiig the fuctio rab (, ) aso that if T( ) r( X, S ) X X is a sufficiet statistic for (which we foud from Example 6..7). Note that we have ot show that X is miimal sufficiet for i this case where is kow. 8

9 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Theorem 6..3 Let f ( x ) be the pmf or pdf of a sample X. Suppose there exists a fuctio T ( X ) such that, for every two sample poits x ad y, the ratio of f ( x ) / f ( y ) is costat as a fuctio of if ad oly if T( x) T( y ). The T ( X ) is a miimal sufficiet statistic for. Example 6..4 (Normal miimal sufficiet statistic) Let X,, X be iid (, ), where both ad are ukow. Let x ad y be two sample poits with correspodig sample meas ad variaces Show that ( X, S ) is a miimal sufficiet statistic for (, ). (, S x ) x ad (, S y ) y. Note: If the set of x values o which the pdf or pmf is positive depeds o the parameter, the for the ratio i Theorem 6..3 to be a costat fuctio of, the umerator ad deomiator must be positive for exactly the same values of. Example 6..5 (Uiform miimal sufficiet statistic) Suppose X,, X are iid uiform observatios o the iterval (, ),. Show that T( X) ( X(), X( ) ) is a miimal sufficiet statistic. (I this example, the dimesio of the miimal sufficiet statistic does ot match the dimesio of the parameter.) Note: A miimal sufficiet statistic is ot uique! Ay oe-to-oe fuctio of a miimal sufficiet statistic is also a miimal sufficiet statistic. 9

10 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Illustratios:. Let X,, X be iid uiform observatios o the iterval (, ),. T( X) ( X(), X( ) ) is a miimal sufficiet for. Hece ( X( ) X(),( X( ) X() )/) is also a miimal sufficiet statistic.. Let X,, X be iid (, ), ad are ukow. ( X, S ) is a miimal sufficiet statistic for (, ). Hece, is also miimal sufficiet statistic. ( X, ) i X i i i Questio: Let X,, X be iid uiform observatios o the iterval (, ),. T( X) ( X(), X( ) ) is a miimal sufficiet for, is X( ) X() also a miimal sufficiet statistic? Sectio 6..3 Acillary Statistics Defiitio 6..6 A statistic S( X ) whose distributio does ot deped o the parameter is called a acillary statistic. Example 6..7 (Uiform acillary statistic) Let X,, X be iid uiform observatios o the iterval (, ),. Show that the rage statistic, R X( ) X(), is a acillary statistic. 0

11 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Example 6..8 (Locatio family acillary statistic) Suppose X,, X are iid observatios from a locatio parameter family with cdf F( x ),. Show that the rage statistic, R X( ) X(), is a acillary statistic. Example 6..9 (Scale family acillary statistic) Suppose X,, X are iid observatios from a locatio parameter family with cdf F( x/ ), 0. The ay statistic that depeds o the sample oly through the values X / X,, X / X is a acillary statistic. Note: From Chapter 4 (Example 4.3.6), it was show that if X ad X are iid is Cauchy(0, ). I fact, this also holds for ay 0. (0, ),where, the X / X Sectio 6..4 Sufficiet, Acillary ad Complete Statistics Questio: Is a acillary statistic ot related at all to miimal sufficiet statistic? Recall that if X,, X are iid uiform observatios o the iterval (, ),, the ( X(), X ( ) ) ad ( X( ) X(),( X( ) X() )/) are miimal sufficiet statistics for. But we also kow that R X( ) X() is a acillary statistic. Hece, i this case the miimal sufficiet ad acillary statistics are related.

12 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Questio: Whe is a miimal sufficiet statistic idepedet of every acillary statistic? Defiitio 6.. Let f ( t ) be a family of pdfs ad pmfs for a statistic T ( X ). The family of probability distributios is called complete if EgT ( ) 0 for all implies P ( g( T) 0). Equivaletly, T ( X ) is called a complete statistic. Illustratio: Cosider the family of distributios (,),. If g( X) X, the EgX ( ) EX 0 whe 0 but PgX ( ( ) 0) PX ( 0) 0 sice X is a cotiuous radom variable. So this family of distributios is complete for. Example 6.. (Biomial complete sufficiet statistic) Suppose that T has a biomial( pdistributio, ) with 0 p. Show that T is a complete statistic. Example 6..3 (Uiform complete sufficiet statistic) Let X,, X be iid uiform (0, ),0, observatios. Show that T X( ) is a complete statistic.

13 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Theorem 6..4 (Basu s Theorem) If T ( X ) is a complete ad miimal sufficiet statistic, the T ( X ) is idepedet of every acillary statistic. Note: Basu s Theorem allows us to deduce the idepedece of two statistics without ever fidig the joit distributio of the two statistics. Questio: Is there a easier way to fid a complete statistic? Theorem 6..5 (Complete statistics i the expoetial family) Let X,, X be iid observatios from a expoetial family with pdf or pmf of the form Where (,, k ). The the statistic f ( x θ) h( x) c( θ)exp( wi( θ ) ti( x)), k i j j j j j k j T( X) ( t ( X ), t ( X ),, t ( X )) is complete as log as the parameter space cotais a ope set i k R. Note: The distributio (, ) (recall from Example that this distributio is a member of the curved expoetial family of distributios) does ot cotai a two-dimesioal ope set because it cotais oly poits o the parabola. Hece, this distributio would ot satisfy the coditios of Theorem

14 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 I fact, oe ca fid a fuctio, gt ( ( X)) 0 such that EgT ( ( X )) 0. (Exercise 6.5) A Re-parameterizatio of Expoetial Families (Caoical Form): f ( x ) h ( x ) c ( *)exp( t ( x )), X where hx ( ) ad t ( x) are the same as i the origial parameterizatio. The set k i i k { (,, ): hx ( )exp( t( x)) dx }, which is called the atural parameter space for the family. i i k i i i Example (Re-parameterizatio of the Normal Distributio) Solutio: f ( x, ) exp( )exp( x x ), where / ad /. Defiitio 3.4.7: A Curved expoetial family is a family of desities of the form (3.4.) for which the dimesio of the vector is equal to d k. If d k, the family is a full expoetial family. Example 3.4.8: Normal with mea ad variace. 4

15 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Example 6..6 (Usig Basu s Theorem I) Let X,, X be iid expoetial( ) observatios. Compute Eg( X ) where X g( X) X X. Example 6..7 (Usig Basu s Theorem II) Let X,, X be iid observatios from Basu s Theorem, show that X ad S are idepedet. (, ) populatio. Usig Theorem 6..8 If a miimal sufficiet statistic exists, the ay complete statistic is also miimal sufficiet. Note: A miimal sufficiet statistics may ot be a complete statistic. Example (A miimal sufficiet statistics that is complete) Let X,, X be iid uiform observatios o the iterval (, ),. From example 6..5, we kow that T( X ) ( X(), X( ) ) is a miimal sufficiet statistic. From example 6..7, we kow that R( X ) X( ) X(), is a acillary statistic. I additio, we kow that R( X ) has a beta pdf with ad. Thus we have E ( X( ) X() ) 0, but PX ( ( ) X() 0) 0. So T( ) ( X, X ) X is ot complete. () ( ) 5

16 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Sectio 6.3 Likelihood Priciple I his sectio, we study a specific, importat statistic called the likelihood fuctio that also ca be used to summarize data. Defiitio 6.3. Let f ( x ) deote the joit pdf or pmf of the sample X ( X,, X ). The give that X=x is observed, the fuctio of defied by L( x) f ( x ) is called the likelihood fuctio. Questio: What is the differece betwee the likelihood fuctio ad the pdf (or pmf)? Aswer: They have the same formula. The distictio betwee them is which variable is fixed ad which is varyig. Likelihood Priciple If x ad y are two sample poits such that L( x ) is proportioal to L( y ), i.e., there exists a costat C( x,y ) such that L( x) C( x,y) L( y ), the the coclusios draw from x ad y for should be idetical. Notes: 6

17 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0. Likelihood priciple states that eve if two sample poits have proportioal likelihoods, the they will cotai equivalet iformatio about.. Give two parameter values ad, the likelihood fuctio tells us if is a more plausible (ot probable) parameter value tha i light of the data gathered. 3. Fiducial iferece (Fisher, 930) iterprets likelihood as probabilities for very much like Bayesia iferece. Skip Sectio 6.3. Formal likelihood priciple Example 6.3. (Negative biomial likelihood) Let X have a egative biomial distributio with r 3 ad success probability p. If x is observed, the the likelihood fuctio is the fifth-degree polyomial o 0 p defied by 4 3 L( p ) Pp ( X ) p ( p). I geeral, if X x is observed, the the likelihood fuctio is the polyomial of degree 3 x, 3 x L p x p p x 3 ( ) ( ) x. 7

18 Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Example (Normal fiducial distributio) Let X,, X be iid L (, ), kow. The / ( x) ( ) exp( ( x i ) / ( )) i / ( ) exp{ ( ( x ) ( ) ) / ( )} i i x x / / i i We first ote that C( x,y ) exists if ad oly if x exp( ( x x) / ( ))( / ) exp( ( x) / ( / )). y, i which case i i i i C ( x,y ) exp( ( x x ) /( ) ( y y ) /( )). Thus, the Likelihood Priciple states that the same coclusio about should be draw for ay sample poits satisfyig x y. Secod, up to a costat, L( x ) has a ormal distributio (, / ) x, thus we have x 0.95 P(.96.96) P( x.96 / x.96 / ). / Example (Likelihood Fuctio for Uiform Distributio) Let X,, X be iid uiform (0, ), the the likelihood fuctio is: L( x) I[0 x( ) ]( x,, x ). 8

6. Sufficient, Complete, and Ancillary Statistics

6. Sufficient, Complete, and Ancillary Statistics Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary

More information

Lecture 23: Minimal sufficiency

Lecture 23: Minimal sufficiency Lecture 23: Miimal sufficiecy Maximal reductio without loss of iformatio There are may sufficiet statistics for a give problem. I fact, X (the whole data set) is sufficiet. If T is a sufficiet statistic

More information

Lecture 12: September 27

Lecture 12: September 27 36-705: Itermediate Statistics Fall 207 Lecturer: Siva Balakrisha Lecture 2: September 27 Today we will discuss sufficiecy i more detail ad the begi to discuss some geeral strategies for costructig estimators.

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Lecture 7: Properties of Random Samples

Lecture 7: Properties of Random Samples Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

5. Likelihood Ratio Tests

5. Likelihood Ratio Tests 1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,

More information

Unbiased Estimation. February 7-12, 2008

Unbiased Estimation. February 7-12, 2008 Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

Stat 421-SP2012 Interval Estimation Section

Stat 421-SP2012 Interval Estimation Section Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Lecture 18: Sampling distributions

Lecture 18: Sampling distributions Lecture 18: Samplig distributios I may applicatios, the populatio is oe or several ormal distributios (or approximately). We ow study properties of some importat statistics based o a radom sample from

More information

1.010 Uncertainty in Engineering Fall 2008

1.010 Uncertainty in Engineering Fall 2008 MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval

More information

AMS570 Lecture Notes #2

AMS570 Lecture Notes #2 AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)

More information

STAT Homework 1 - Solutions

STAT Homework 1 - Solutions STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better

More information

Statistical Theory MT 2009 Problems 1: Solution sketches

Statistical Theory MT 2009 Problems 1: Solution sketches Statistical Theory MT 009 Problems : Solutio sketches. Which of the followig desities are withi a expoetial family? Explai your reasoig. (a) Let 0 < θ < ad put f(x, θ) = ( θ)θ x ; x = 0,,,... (b) (c) where

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

HOMEWORK I: PREREQUISITES FROM MATH 727

HOMEWORK I: PREREQUISITES FROM MATH 727 HOMEWORK I: PREREQUISITES FROM MATH 727 Questio. Let X, X 2,... be idepedet expoetial radom variables with mea µ. (a) Show that for Z +, we have EX µ!. (b) Show that almost surely, X + + X (c) Fid the

More information

Questions and Answers on Maximum Likelihood

Questions and Answers on Maximum Likelihood Questios ad Aswers o Maximum Likelihood L. Magee Fall, 2008 1. Give: a observatio-specific log likelihood fuctio l i (θ) = l f(y i x i, θ) the log likelihood fuctio l(θ y, X) = l i(θ) a data set (x i,

More information

Statistical Theory MT 2008 Problems 1: Solution sketches

Statistical Theory MT 2008 Problems 1: Solution sketches Statistical Theory MT 008 Problems : Solutio sketches. Which of the followig desities are withi a expoetial family? Explai your reasoig. a) Let 0 < θ < ad put fx, θ) = θ)θ x ; x = 0,,,... b) c) where α

More information

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the

More information

Last Lecture. Unbiased Test

Last Lecture. Unbiased Test Last Lecture Biostatistics 6 - Statistical Iferece Lecture Uiformly Most Powerful Test Hyu Mi Kag March 8th, 3 What are the typical steps for costructig a likelihood ratio test? Is LRT statistic based

More information

Last Lecture. Wald Test

Last Lecture. Wald Test Last Lecture Biostatistics 602 - Statistical Iferece Lecture 22 Hyu Mi Kag April 9th, 2013 Is the exact distributio of LRT statistic typically easy to obtai? How about its asymptotic distributio? For testig

More information

Exponential Families and Bayesian Inference

Exponential Families and Bayesian Inference Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

Mathematical Statistics - MS

Mathematical Statistics - MS Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios

More information

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes.

Direction: This test is worth 250 points. You are required to complete this test within 50 minutes. Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Lecture 16: UMVUE: conditioning on sufficient and complete statistics

Lecture 16: UMVUE: conditioning on sufficient and complete statistics Lecture 16: UMVUE: coditioig o sufficiet ad complete statistics The 2d method of derivig a UMVUE whe a sufficiet ad complete statistic is available Fid a ubiased estimator of ϑ, say U(X. Coditioig o a

More information

Stat 319 Theory of Statistics (2) Exercises

Stat 319 Theory of Statistics (2) Exercises Kig Saud Uiversity College of Sciece Statistics ad Operatios Research Departmet Stat 39 Theory of Statistics () Exercises Refereces:. Itroductio to Mathematical Statistics, Sixth Editio, by R. Hogg, J.

More information

Review Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn

Review Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn Stat 366 Lab 2 Solutios (September 2, 2006) page TA: Yury Petracheko, CAB 484, yuryp@ualberta.ca, http://www.ualberta.ca/ yuryp/ Review Questios, Chapters 8, 9 8.5 Suppose that Y, Y 2,..., Y deote a radom

More information

Solutions: Homework 3

Solutions: Homework 3 Solutios: Homework 3 Suppose that the radom variables Y,...,Y satisfy Y i = x i + " i : i =,..., IID where x,...,x R are fixed values ad ",...," Normal(0, )with R + kow. Fid ˆ = MLE( ). IND Solutio: Observe

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

Bayesian Methods: Introduction to Multi-parameter Models

Bayesian Methods: Introduction to Multi-parameter Models Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested

More information

January 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS

January 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

IE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes.

IE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes. Closed book ad otes. No calculators. 120 miutes. Cover page, five pages of exam, ad tables for discrete ad cotiuous distributios. Score X i =1 X i / S X 2 i =1 (X i X ) 2 / ( 1) = [i =1 X i 2 X 2 ] / (

More information

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen) Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Lecture 6 Simple alternatives and the Neyman-Pearson lemma

Lecture 6 Simple alternatives and the Neyman-Pearson lemma STATS 00: Itroductio to Statistical Iferece Autum 06 Lecture 6 Simple alteratives ad the Neyma-Pearso lemma Last lecture, we discussed a umber of ways to costruct test statistics for testig a simple ull

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5 CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio

More information

Interval Estimation (Confidence Interval = C.I.): An interval estimate of some population parameter is an interval of the form (, ),

Interval Estimation (Confidence Interval = C.I.): An interval estimate of some population parameter is an interval of the form (, ), Cofidece Iterval Estimatio Problems Suppose we have a populatio with some ukow parameter(s). Example: Normal(,) ad are parameters. We eed to draw coclusios (make ifereces) about the ukow parameters. We

More information

Lecture 11 and 12: Basic estimation theory

Lecture 11 and 12: Basic estimation theory Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

Simulation. Two Rule For Inverting A Distribution Function

Simulation. Two Rule For Inverting A Distribution Function Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

Ma 530 Introduction to Power Series

Ma 530 Introduction to Power Series Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

IE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes.

IE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes. IE 230 Seat # Name < KEY > Please read these directios. Closed book ad otes. 60 miutes. Covers through the ormal distributio, Sectio 4.7 of Motgomery ad Ruger, fourth editio. Cover page ad four pages of

More information

The variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2.

The variance of a sum of independent variables is the sum of their variances, since covariances are zero. Therefore. V (xi )= n n 2 σ2 = σ2. SAMPLE STATISTICS A radom sample x 1,x,,x from a distributio f(x) is a set of idepedetly ad idetically variables with x i f(x) for all i Their joit pdf is f(x 1,x,,x )=f(x 1 )f(x ) f(x )= f(x i ) The sample

More information

Lecture 8: Convergence of transformations and law of large numbers

Lecture 8: Convergence of transformations and law of large numbers Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

Lecture Chapter 6: Convergence of Random Sequences

Lecture Chapter 6: Convergence of Random Sequences ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

IIT JAM Mathematical Statistics (MS) 2006 SECTION A

IIT JAM Mathematical Statistics (MS) 2006 SECTION A IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Quick Review of Probability

Quick Review of Probability Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

Summary. Recap ... Last Lecture. Summary. Theorem

Summary. Recap ... Last Lecture. Summary. Theorem Last Lecture Biostatistics 602 - Statistical Iferece Lecture 23 Hyu Mi Kag April 11th, 2013 What is p-value? What is the advatage of p-value compared to hypothesis testig procedure with size α? How ca

More information

LECTURE NOTES 9. 1 Point Estimation. 1.1 The Method of Moments

LECTURE NOTES 9. 1 Point Estimation. 1.1 The Method of Moments LECTURE NOTES 9 Poit Estimatio Uder the hypothesis that the sample was geerated from some parametric statistical model, a atural way to uderstad the uderlyig populatio is by estimatig the parameters of

More information

EE 4TM4: Digital Communications II Probability Theory

EE 4TM4: Digital Communications II Probability Theory 1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair

More information

Probability and statistics: basic terms

Probability and statistics: basic terms Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample

More information

Properties of Point Estimators and Methods of Estimation

Properties of Point Estimators and Methods of Estimation CHAPTER 9 Properties of Poit Estimators ad Methods of Estimatio 9.1 Itroductio 9. Relative Efficiecy 9.3 Cosistecy 9.4 Sufficiecy 9.5 The Rao Blackwell Theorem ad Miimum-Variace Ubiased Estimatio 9.6 The

More information

If, for instance, we were required to test whether the population mean μ could be equal to a certain value μ

If, for instance, we were required to test whether the population mean μ could be equal to a certain value μ STATISTICAL INFERENCE INTRODUCTION Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I oesample testig, we essetially

More information

Approximations and more PMFs and PDFs

Approximations and more PMFs and PDFs Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.

More information

Math 155 (Lecture 3)

Math 155 (Lecture 3) Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,

More information

Quick Review of Probability

Quick Review of Probability Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig

More information

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced

More information

MATHEMATICAL SCIENCES PAPER-II

MATHEMATICAL SCIENCES PAPER-II MATHEMATICAL SCIENCES PAPER-II. Let {x } ad {y } be two sequeces of real umbers. Prove or disprove each of the statemets :. If {x y } coverges, ad if {y } is coverget, the {x } is coverget.. {x + y } coverges

More information

Lecture 20: Multivariate convergence and the Central Limit Theorem

Lecture 20: Multivariate convergence and the Central Limit Theorem Lecture 20: Multivariate covergece ad the Cetral Limit Theorem Covergece i distributio for radom vectors Let Z,Z 1,Z 2,... be radom vectors o R k. If the cdf of Z is cotiuous, the we ca defie covergece

More information

Element sampling: Part 2

Element sampling: Part 2 Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig

More information

5 : Exponential Family and Generalized Linear Models

5 : Exponential Family and Generalized Linear Models 0-708: Probabilistic Graphical Models 0-708, Sprig 206 5 : Expoetial Family ad Geeralized Liear Models Lecturer: Matthew Gormley Scribes: Yua Li, Yichog Xu, Silu Wag Expoetial Family Probability desity

More information

Chapter 13: Tests of Hypothesis Section 13.1 Introduction

Chapter 13: Tests of Hypothesis Section 13.1 Introduction Chapter 13: Tests of Hypothesis Sectio 13.1 Itroductio RECAP: Chapter 1 discussed the Likelihood Ratio Method as a geeral approach to fid good test procedures. Testig for the Normal Mea Example, discussed

More information

Section 11.8: Power Series

Section 11.8: Power Series Sectio 11.8: Power Series 1. Power Series I this sectio, we cosider geeralizig the cocept of a series. Recall that a series is a ifiite sum of umbers a. We ca talk about whether or ot it coverges ad i

More information

Parameter, Statistic and Random Samples

Parameter, Statistic and Random Samples Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

Chapter 4. Fourier Series

Chapter 4. Fourier Series Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,

More information

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Fall 2013 MTH431/531 Real analysis Section Notes

Fall 2013 MTH431/531 Real analysis Section Notes Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters

More information

This section is optional.

This section is optional. 4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore

More information

Massachusetts Institute of Technology

Massachusetts Institute of Technology Solutios to Quiz : Sprig 006 Problem : Each of the followig statemets is either True or False. There will be o partial credit give for the True False questios, thus ay explaatios will ot be graded. Please

More information

The Random Walk For Dummies

The Random Walk For Dummies The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15 17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig

More information