χ be any function of X and Y then

Similar documents
Professor Wei Zhu. 1. Sampling from the Normal Population

RECAPITULATION & CONDITIONAL PROBABILITY. Number of favourable events n E Total number of elementary events n S

Chapter 2: Descriptive Statistics

( m is the length of columns of A ) spanned by the columns of A : . Select those columns of B that contain a pivot; say those are Bi

The Linear Probability Density Function of Continuous Random Variables in the Real Number Field and Its Existence Proof

= y and Normed Linear Spaces

Lecture 10: Condensed matter systems

2. Sample Space: The set of all possible outcomes of a random experiment is called the sample space. It is usually denoted by S or Ω.

XII. Addition of many identical spins

Chapter 5 Properties of a Random Sample

VIII Dynamics of Systems of Particles

Exponential Generating Functions - J. T. Butler

FIBONACCI-LIKE SEQUENCE ASSOCIATED WITH K-PELL, K-PELL-LUCAS AND MODIFIED K-PELL SEQUENCES

2.1.1 The Art of Estimation Examples of Estimators Properties of Estimators Deriving Estimators Interval Estimators

SUBSEQUENCE CHARACTERIZAT ION OF UNIFORM STATISTICAL CONVERGENCE OF DOUBLE SEQUENCE

X ε ) = 0, or equivalently, lim

A GENERAL CLASS OF ESTIMATORS UNDER MULTI PHASE SAMPLING

Some Different Perspectives on Linear Least Squares

14. MRAC for MIMO Systems with Unstructured Uncertainties We consider affine-in-control MIMO systems in the form, x Ax B u f x t

are positive, and the pair A, B is controllable. The uncertainty in is introduced to model control failures.

φ (x,y,z) in the direction of a is given by

Probability. Stochastic Processes

Consider two masses m 1 at x = x 1 and m 2 at x 2.

Probability and Stochastic Processes

such that for 1 From the definition of the k-fibonacci numbers, the firsts of them are presented in Table 1. Table 1: First k-fibonacci numbers F 1

Minimizing spherical aberrations Exploiting the existence of conjugate points in spherical lenses

Lecture 3 Probability review (cont d)

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations

Midterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes

Summary of the lecture in Biostatistics

CHAPTER 4 RADICAL EXPRESSIONS

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA

Random Variables and Probability Distributions

RANDOM SYSTEMS WITH COMPLETE CONNECTIONS AND THE GAUSS PROBLEM FOR THE REGULAR CONTINUED FRACTIONS

Overview. Review Superposition Solution. Review Superposition. Review x and y Swap. Review General Superposition

Mu Sequences/Series Solutions National Convention 2014

Chapter 7 Varying Probability Sampling

Minimum Hyper-Wiener Index of Molecular Graph and Some Results on Szeged Related Index

Econometric Methods. Review of Estimation

. The set of these sums. be a partition of [ ab, ]. Consider the sum f( x) f( x 1)

VECTOR MECHANICS FOR ENGINEERS: Vector Mechanics for Engineers: Dynamics. In the current chapter, you will study the motion of systems of particles.

2. Independence and Bernoulli Trials

Chapter 8. Linear Momentum, Impulse, and Collisions

On EPr Bimatrices II. ON EP BIMATRICES A1 A Hence x. is said to be EP if it satisfies the condition ABx

Debabrata Dey and Atanu Lahiri

arxiv:math/ v1 [math.gm] 8 Dec 2005

2/20/2013. Topics. Power Flow Part 1 Text: Power Transmission. Power Transmission. Power Transmission. Power Transmission

Functions of Random Variables

Distribution of Geometrically Weighted Sum of Bernoulli Random Variables

ˆ SSE SSE q SST R SST R q R R q R R q

MATH 247/Winter Notes on the adjoint and on normal operators.

Recent Advances in Computers, Communications, Applied Social Science and Mathematics

Chapter 2 Probability and Stochastic Processes

Special Instructions / Useful Data

Introduction to Probability

Some results and conjectures about recurrence relations for certain sequences of binomial sums.

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d

Atomic units The atomic units have been chosen such that the fundamental electron properties are all equal to one atomic unit.

Investigation of Partially Conditional RP Model with Response Error. Ed Stanek

Homework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015

Non-degenerate Perturbation Theory

Module 7. Lecture 7: Statistical parameter estimation

Chain Rules for Entropy

ρ < 1 be five real numbers. The

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

MATH Midterm Solutions

1 Onto functions and bijections Applications to Counting

5. Data Compression. Review of Last Lecture. Outline of the Lecture. Course Overview. Basics of Information Theory: Markku Juntti

Bayes (Naïve or not) Classifiers: Generative Approach

Progression. CATsyllabus.com. CATsyllabus.com. Sequence & Series. Arithmetic Progression (A.P.) n th term of an A.P.

Module Title: Business Mathematics and Statistics 2

Lecture 9: Tolerant Testing

Strong Result for Level Crossings of Random Polynomials

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

Non-uniform Turán-type problems

Rademacher Complexity. Examples

Lecture 3. Sampling, sampling distributions, and parameter estimation

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights

Lecture 4 Sep 9, 2015

Extend the Borel-Cantelli Lemma to Sequences of. Non-Independent Random Variables

Third handout: On the Gini Index

α1 α2 Simplex and Rectangle Elements Multi-index Notation of polynomials of degree Definition: The set P k will be the set of all functions:

4 Inner Product Spaces

CHAPTER VI Statistical Analysis of Experimental Data

University of Pavia, Pavia, Italy. North Andover MA 01845, USA

1 Solution to Problem 6.40

Chapter 4 Multiple Random Variables

THE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5

= lim. (x 1 x 2... x n ) 1 n. = log. x i. = M, n

3.1 Introduction to Multinomial Logit and Probit

The Mathematical Appendix

CHAPTER 5 : SERIES. 5.2 The Sum of a Series Sum of Power of n Positive Integers Sum of Series of Partial Fraction Difference Method

Solutions to problem set ); (, ) (

Objectives. Learning Outcome. 7.1 Centre of Gravity (C.G.) 7. Statics. Determine the C.G of a lamina (Experimental method)

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b

Homework 1: Solutions

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

TESTS BASED ON MAXIMUM LIKELIHOOD

Strong Result for Level Crossings of Random Polynomials. Dipty Rani Dhal, Dr. P. K. Mishra. Department of Mathematics, CET, BPUT, BBSR, ODISHA, INDIA

Qualifying Exam Statistical Theory Problem Solutions August 2005

Transcription:

We have show that whe we ae gve Y g(), the [ ] [ g() ] g() f () Y o all g ()() f d fo dscete case Ths ca be eteded to clude fuctos of ay ube of ado vaables. Fo eaple, suppose ad Y ae.v. wth jot desty fucto, ( y). That s f < dχ y Y y dy (, y) ob, Y. f Y, Theoe Let g (, y) χ be ay fucto of ad Y the o [ g(, Y )] g(, y) f (, y) [ g(, Y )] g(, y) f (, y) all χ all y Y Y dχdy aple; We cosde ow, two ado vaables whose jot pdf (o pf) s gve by the at show below Table Table Y /8 / /8 /8 / /8 We defe g (, y) y y g, Y dectly, ad the by usg Theoe. Fd [ ( )] Let Z - Y Y. By specto, Z ca tae o the values,,, ad, wth pobablty,p(z), as show Table (whch ca easly be see to follow fo Table ). Table Table y /8 / /8 /8 / /8 z p Z (z) / / /

Fo defto of epectato the, [ g( Y )] [ g (, Y )] ( Z ) z p Z ( z ) all z, s equal to : We get the sae aswe fo [ g( Y )] gve Table : [ Y ] g( y) [ g(, Y )] p 8 y, by applyg Theoe to the jot pdf 8 8 8 The advatage, of couse, ejoyed by the latte soluto s that we avod the teedate step of havg to detee p Z (z). Aothe useful popety s the followg: Theoe I If ad Y ae depedet.v. the [ Y ] [ ] [ Y]. e. [ Y ] Yf ( y) f d - coelato ddy Yf dy Y Yf f [ ] [ Y ] Y ddy aple Two fou dce ae tossed, the epected value of the poduct of the two faces s [ Y ] [ ] [ Y ] [ ] ( ) [ ] Y [ Y ]. 5

The ea,, of a.v. s aalogous to the cete of gavty of f(). Aothe potat paaete s ts vaace,, o dspeso defed by We ote o [( ) ] ( ) f ( ) [( ) ] ρ[ ] [( ) ] [ ] Stadad devato d [ ] [] [ ] [ ] [] whee [] I, geeal, a oe coplete specfcato of the statstcs of ca be gve f oe ows ts MOMNTS,, defed by Clealy etc. [ ] f ()d [] We also have aothe stadad paaete called CNTRAL MOMNTS,.e., they elate the statstcs to the ea value: we have [( ) ] ( ) f ( ),, d We ca wte [( ) ] ( ) ( ) boal epaso ad due to the addtvty popety,

( ) ( ) [ ] ( ) ( ) I patcula We could also develop tes of Thee ae two potat popetes of vaaces. ) Defe b a Y, the [ ] [ ] [ ] ( ) ( ) [ ] [ ] ( ) [ ] [ ] () Va a a a b a b a Y Va b a b a Y aple A ado vaable s descbed by the pdf () < < f What s the stadad devato Y, whee Y? Fst, we eed to fd the vaace of. But ( ) ( ) ( ) ( ) 8 ad Va d d

The, by Theoe I, above, Va 9 8 ( Y ) ( ) Va( ) whch aes the stadad devato Y equal to, o.7. ) If Y whee ae depedet ado vaables. The, Va(Y) Va( ) Va ( ) Va( ) aple: The boal ado vaable beg the su of depedet Beoull s s a obvous caddate fo the above popety. Let deote the ube of successes occug o the th tal. The wth pobablty wth pobablty p - p Wte Y.. We wat to fd the vaace of Y. But ad ( ) p q p ( ) () p () ( p) so Va( ) ( ) [ ( ] p p p( p) pq It follows, the, that the vaace of a boal ado vaable s p(-p): Va) Y) Va( ) p( p)

Tchebycheff's Iequalty Suppose s a abtay ado vaable wth desty f() ad a fte vaace ( ) f ( ) d ( ) f ( ) > d f > () d { } { } Tchebcheff's Iequalty Alteately, we ca wte Tchebycheff's Iequalty aothe fo as: { < } > oof: Defe as a sall, postve value ad cosde a abtay pobablty law (depcted hee as a oal oly fo covece) f() { < } We defe the vaace of a ado vaable as follows; Va () ( ) f () d ( ) f ( ) d ( ) f ( ) d ( ) f ( ) If we eglect the secod te, whch s always postve, we have eag d

Va () ( ) f () d ( ) f () ( ) f ( ) d f () [ ] [ ] f [ ] d d Hece, Tchebysheff's Theoe ca be suazed as follows: Let be a ado vaable wth a ea of ad a fte vaace of. The fo ay sall value, >, [ ] whee Ths s equvalet to ( < < ) ( < < ) To tepet ths let, the the age fo to ude whateve pobablty law ests, ust cota at least / / / pecee of the pobablty ass fo the ado vaable. aple: Cosde: the daly poducto of electc otos at a ceta factoy aveages, wth a stadad devato of. a) What ca be sad about the facto of days that wll have a poducto level betwee ad. b) Fd the shotest teval ceta to cota at least 9% of the daly poducto levels. Solutos: a) The evet,, s daly poducto level of ay day { } { } { } > we see Hece, fo ( ) ad sce

> "At least 75% of days wll have poducto ths teval." So, { } { }. 75 c) Fd shotest teval of poducto values ceta to cota at least 9% of daly poducto. aga epesets daly poducto. We eed to fd. Set.9. {. < <. } {. < <.} O the teval 88. to 5. wll cota at least 9% of daly poducto levels. A oe detaled developet of the soluto s; So!.9 L [ L] [ ]. 9 [ ] > -/.9.. Wth, & - (. ) (. ) 88. 5. ; @ ; @ The teval s {88 to 5}. Ths eas that 9% of days wll have poducto betwee 88 to 5 otos. aple Suppose that s a epoetal ado vaable wth pdf () f e, >. a) Copute the eact pobablty that taes o a value oe tha two stadad devatos away fo ts ea. b) Use Chebycheff's equalty to get a uppe boud fo the pobablty ased fo pat a). Soluto: Gve () f e, > a) Calculate eact pobablty [ > ]

[] Let u dv e du d v e The udv vu [ ] ( e )() e e d vdu l e Let u e () () du v e e udv vu e d vdu e d ( ) dv e e d [ ] [ ] f() { > } [ ] e d. 5

b) [ ] [ ]. 5 aple A fa dce s tossed tes. Let deote the outcoe o the th oll. Use Theoe.. to get a lowe boud fo the pobablty that s betwee ad. Dce s tossed tes. Let outcoe o the th oll Fd lowe boud fo { Z betwee ad } { Z } Z But [ Z] [ ] [ ] [ ] [ ] [ ] ( 5 ) [ ] The 9 5 Sce depedet evets: Va So! ( Z ) Z [ Z] 5 5 9.7

[ ] o [ < ] [ < ( ) < ] [ < < ] 9.7 5 [ < ( ) < ]. 88 5-5 Aothe eaple s the desg of a epeet. aple Use Chebysheff's equalty to get a lowe boud fo the ube of tes a fa co ust be tossed ode fo the pobablty to be at least.9 that the ates of the obseved ube of heads to the total ube of tosses be betwee. ad.? Defe whee h h ube of heads tosses head a sgle toss p p tal a sgle toss () ( ) [] h [ ] h h h pected value of Va [] ƒ Va[ h h h ] Va( h ) We wat the ato of to equalty z fo Chebysheff's

sce o ad Va. >. ( a) a Va( ).. sce (fa co)..9 <. > > /.9. / (.) ( ) 5 Aothe potat te s soethg called the Moet Geeatg Fucto Moet Geeatg Fucto We see that, eve f we do't ow what the DK o pdf s, we ca estate ceta statstcs ad pobabltes. Befoe we beg, we defe the followg G c,,, If () ( ) the th [ G() ] ( c) oet of.v. aoud costat c th If c, ( ) oet aoud og o just aw oet c If () ea value of the.v. the ( () ) o sply th cetal oet (secod cetal oet s th oet the vaace) aoud the ea Usg Moet Geealty Fucto, we ca evaluate all aw oets, whe they est, of the.v. studed. Defto: The Moet Geealty Fucto of a.v., Ψ ( θ ), ay be defed as the epected value of the fucto e θ, whe θ s sply a abtay eal ube.

( θ ) Ψ θ ( θ ) ( e ) e all θ e f θ () p d () Ψ ay ot always est fo all θ. I othe wods, Ψ ca be ethe fte o fte (does ot est). It follows that a pobablty law o dstbuto ay ot always possess a oet geeatg fucto. Cosequetly, oe ay defe a fucto called a Chaactestc Fucto, ( e θ ), that always ests fo all values of θ. We ca tal late about ths, fo ow we cofe ouselves to Moet Geeatg Fuctos. To splfy, we wll assue M.G.F. ests. (Note: If M.G.F. ests, fo all θ L, L, the all oets est ad the dstbuto uquely deteed by t.) ( ) vaables). Tae epaso of e θ θ θ Cosde [ e ] e f ()d ( Note, Ths apples fo cotuous ad dscete ado θ e θ θ θ!! Hece Ψ Dffeetate wth espect to θ Ψ ' ad lettg θ, we get Ψ ' θ ( θ ) ( e ) ( θ ) f ( ) θ θ! d θ! () ( ) ( ) θ! ( θ ) ( ) θ( ) ( ) () () fst aw oet (the ea value)