Discrete probability distributions
|
|
- Julian Gaines
- 6 years ago
- Views:
Transcription
1 Discrete probability distributios I the chapter o probability we used the classical method to calculate the probability of various values of a radom variable. I some cases, however, we may be able to develop a mathematical fuctio for calculatig such probabilities based o the defiitio of the radom variable. I geeral, a radom variable may be discrete or cotiuous. A radom variable is discrete whe it ca assume coutable values, ad is cotiuous whe it ca take o values o a cotiuous scale. Usually, if you cout it, it is discrete, ad if you measure, it is cotiuous. I this chapter, we will develop mathematical fuctios to calculate probabilities associated with discrete radom variables. Accordigly, such a fuctio is called probability fuctio, probability mass fuctio, or probability distributio. These fuctios will be directly drive from the defiitio of the radom variable. For coveiece, we shall deote a radom variable by a capital letter, while the correspodig small letter will be used to deote a specific value of the radom variable. For eample, X may represet the umber of studets passig a course. the, will deote a specific value of X. The probability fuctio will be deoted by, where will assig P [X = ]. Probability fuctios must satisfy certai coditios that are directly related to the defiitio of a probability. These coditios are:. ú 0. (Probabilities must be positive).. =. All possible outcomes (sample space) must have a probability of. all ' s Associated with each radom variable or distributio is a cumulative distributio fuctio, F(, which assigs cumulative probabilities. F( = t) for < t <. I the followig sectio, we will defie some stadard discrete radom variables ad develop their probability distributios. Stadard Discrete Radom Variables The stadard discrete probability distributios preseted here are all based o the Beroulli trial. The Beroulli trial is ay eperimet or activity with two possible outcomes. For coveiece, we will call these outcomes success ad failure; with success beig the desired outcome. For eample, whe shootig at a target, oe may hit or miss. I this case success represets the outcome of hittig the target, while failure represets missig it. We will assume that the probability of success i the Beroulli trial is p, ad the probability of failure is q. Obviously, p+q=, or q=-p. Now, we may defie a radom variable X as the umber of successes i a Beroulli trial. Obviously, X is a discrete radom variable with two possible values 0 ad. We may defie its probability fuctio as: = p q, = 0,. is called the Beroulli distributio ad it clearly assigs the right probabilities ad satisfies the two coditios above (i.e., is always positive ad p ( = p + q = ). The Beroulli distributio is rather very simple, but is a foudatio for 0, may powerful distributios. t Discrete Probability Distributios of 8 L. K. Gaafar
2 The Biomial Distributio If we assume that we have a series of idepedet Beroulli trials, we may be iterested i the umber of successes i these trials. The word idepedet meas that the probability of success does ot chage from oe trial to aother. The umber of successes is clearly a discrete radom variable (X) ad i a series of idepedet Beroulli trials, it may assume ay discrete value from 0 to (i.e., 0,,,, ). For a give, we must have successes ad, accordigly, - failures. I other words we eed success ad success ad success etc. times, failure ad failure ad failure etc. - times. I simpler terms we are lookig for the itersectio of successes ad, accordigly, - failures. Sice these are all idepedet evets, they will happe with a probability p q. Still, the successes may be located i ways withi the trials. Therefore, = p q, 0,,...,. The figure to the right eplais how probabilities are calculated for successes i 4 trials. successes ad failures have a probability of p q. This outcome may occur i 6 differet ways leadig to: P(X=4) = 6 p q 4 4. Usig our probability fuctio, p ( ) = p q = 6 p q. Because of the form of the probability fuctio, it is called the biomial distributio. Notice that the Beroulli distributio is a special case of the biomial whe =. The biomial distributio satisfies the two coditios above. It is always positive ad p ( = p q = ( p + q) = () =. A iterestig questio is o average, how may successes are epected i such situatio? This is called the epected value of X ad is deoted by E[X]. E[X] is the log-term average of X, or simply the mea of ad may also be deoted by µ. If we made idepedet Beroulli trials ad recorded the umber of successes ad repeated this process so may times, µ or E[X]would be the average of the recorded successes. µ or E[X], where X is ay discrete radom variable, may easily be calculated as µ = E[ X ] =, which simply weighs each value of X by its probability to get the average. I geeral, all ' s E[ g( ] = g(, where g( is ay fuctio of all ' s X ad E[g(] is the log term average of that fuctio. The followig rules follow from the defiitio of E[X] ad E[g(]:. E[c] = c, where c is a costat.. E[cX] = ce[x]. Discrete Probability Distributios of 8 L. K. Gaafar
3 3. E[X! Y] = E[X]! E[Y], X ad Y are radom variables. For the Beroulli trial, µ = E[ X ] = = 0( q) + ( p) = p 0 For the biomial distributio, µ = E[ X ] = = p q = p. This result for the biomial distributio could easily be obtaied by observig that the biomial is the summatio of idepedet Beroulli distributios, ad from the third rule above, its mea would be the summatio of the meas, i.e., p. µ or E[X] is a measure of ceter. Aother importat measure is the variace, which measures how much the radom variable varies aroud its mea. The variace is the average square distace from the mea ad is deoted by σ. From its defiitio, σ = E[(X-µ) ] = E[(X- Ε[X]) ]. From the epectatio rules above, σ = E[X ] - µ or σ = E[X ] (Ε[X]). The followig rules follow from the defiitio of V[X]:. V[c] = 0, c is a costat. V[cX] = c V[X] 3. V[X! Y] = V[X] + V[Y], X ad Y are Idepedet radom variables For the Beroulli distributio, E[ X ] = = 0 ( q) + ( p) = p, V[X] = σ = E[X ] 0 (Ε[X]) = p p = -p) = pq. Agai, sice the biomial is the summatio of idepedet Beroulli distributios, for the biomial distributio σ = pq. Eample: The probability that a patiet survives a critical heart operatio is 0.9. What is the probability that eactly 5 out of the et 7 patiets havig this operatio survive? Solutio: We may cosider each operatio as a Beroulli trial with two possible outcomes: survival (p=0.9) ad death (q=0.). The 7 () operatios are the a series of idepedet Beroulli trials where we are iterested i havig 5 ( successes, leadig to the biomial distributio. We are assumig that the trials are idepedet because they are performed o differet patiets. However, if these operatios are performed by the same team, their eperiece my lead to chagig p from operatio (trial) to operatio. Nevertheless, we will assume idepedece (costat p). 7 5 Usig the biomial distributio, P[X=5] = p (5) = (0.9) (0.) = ()(0.505)(.0) = Discrete Probability Distributios 3 of 8 L. K. Gaafar
4 The Negative biomial (Pascal) Distributio With a series of idepedet Beroulli trials we may be iterested i the umber of trials (X) to obtai a specific umber of successes (r). X is clearly a radom variable that could be aywhere from r to. I other words, we may be very lucky ad succeed i every trial, ad thus get the r successes i r trials. O the other had, we may be ulucky ad cotiue to try without gettig the r successes. I geeral however, our last trial will always be a success (the r th success), otherwise we would have to cotiue, while the remaiig r- successes could be located aywhere i the remaiig - trials i ways. Each oe r of these locatios has a probability of p r q -r ad thus the overall probability of eedig trials to obtai r successes is r r =, =, +, +,...,. p q r r r r The figure to the right eplais this developmet for the case of eedig 4 trials to get successes. Notice how the last trial is always the last success. The defiitio of this radom variable is the opposite of the biomial case. Here the radom variable is the umber of trials to get specific successes, while i the biomial case, the radom variable is the umber of success i a specific umber of trials. Therefore, the resultig distributio is called the egative biomial. It is also sometimes called the Pascal distributio after the perso who developed it. r rq The mea ad variace of the Pascal distributio are give by: µ =, σ = p p A special case of the Pascal distributio results whe we are oly iterested i obtaiig oe success, i.e., r =. I this case, simplifies to = =, =,, 3,...,. p q pq This ew radom variable, the umber of successes to obtai ONE success, is called the geometric radom variable, ad the resultig probability fuctio is called the geometric distributio. The mea ad variace of the Geometric distributio are give by: q µ =, σ = p p Observe that the Pascal radom variable may be viewed as the summatio of r idepedet Geometric radom variables. Eample: A scietist ioculates several mice, oe at a time, with a disease germ util she fids that have cotracted the disease. If the probability of cotractig the disease is 0.5, what is the probability that: a. 8 mice are required? b. Less tha 5 mice are required? Discrete Probability Distributios 4 of 8 L. K. Gaafar
5 Solutio a. We are lookig to ifect mice ( successes) ad we are iterested i eedig to try 8 times to achieve this. This satisfies the Pascal distributio with r =, = 8. Therefore, P(8) = p (8) = p q = (0.5) (0.85) = (7)(0.05)(0.3775) = b. Less tha 5 may be satisfied by, 3, or 4, i.e., we are lookig for P( 4), or F(4). 4 4 F(4) = = p q = p + p q + p q = = Eample: The probability that a studet pilot passes the writte test for his private pilot s licese is 0.7. Fid the probability that a perso passes the test: a. o the third try b. before the fourth try Solutio Sice the perso eeds to pass the test oly oce, we are lookig for the umber of trials to obtai oe success, i.e. the Geometric distributio. Notice that, i usig the Geometric distributio, we are implicitly assumig that these trials are idepedet. I reality, however, oe would epect a higher probability of passig the test o the secod trial due to the learig effects. Nevertheless we will proceed with the idepedece assumptio assumig that these effects are miimal. a. = 3, 3) = p q = (0.7) (0.3) = Notice that the probability is low because the perso is much more likely to pass it o the first trial (0.7), or the secod (0.). b. Before the fourth trial may be satisfied by the first or the secod or the third, i.e., we are lookig for P( 3), or F(3). 3 F(3) = = pq 3 The Poisso Distributio = p + pq + pq = = A very useful radom variable ad probability distributio results from the Poisso process i which we cout discrete occurreces i a cotiuous iterval. For eample, we may be iterested i coutig the umber of customers arrivig to a service facility i a give time iterval, or coutig the umber of white blood cells i a drop of blood, or coutig the umber of traffic accidets at a particular itersectio over a week. We will assume that the rate of occurrece per uit time or measuremet uit is a kow costat, ad will deote by λ. To develop the Poisso distributio, we make the followig assumptios:. The umber of outcomes i a give iterval or regio is idepedet of the umber that occurs at ay other disjoit iterval or regio. That is to say that the Poisso process has o memory. Discrete Probability Distributios 5 of 8 L. K. Gaafar
6 . The probability that a sigle outcome will occur durig a very short time iterval or a very small regio (t) is proportioal to t. 3. The probability that more tha oe outcome will occur i t is egligible. The Poisso distributio may be developed from the biomial distributio. For eample, cosider the case of coutig the umber of arrivals i a time iterval (t). If the rate of arrival is λ per time uit, the the average umber of arrivals i t is µ=λt. If we divide t to a huge umber () of ifiitesimal itervals such that oly oe arrival ca occur i each ifiitesimal iterval with a very small probability (p), we may cosider each such iterval as a Beroulli trial with oly two possible outcomes: arrival (success) ad o arrival (failure). Now, the series of ifiitesimal itervals is a series of () Beroulli trials ad we are iterested i the umber of arrival (successes) X; i.e., X is biomially distributed with, p 0, µ = p, X = 0,,,,. I the biomial distributio, if we take the limit as ad substitute p = µ/, we get: µ µ ( )...( + µ µ lim = lim = lim! = lim ( µ However, lim( )...( ) =, lim µ lim )...( µ µ )! = lim{[ + ] ( ) / µ / µ } µ µ = e µ e µ =, =,,...,.! The last equatio is the distributio fuctio of the Poisso radom variable that satisfies the three coditios above. The mea of the Poisso distributio is µ ad the variace is µ = λt. Eample: The average umber of oil takers arrivig each day at a certai port is kow to be per hour. The port ca hadle at most takers per 8-hour day. What is the probability o a give day takers will have to be set away? Solutio: Let X represet the umber of arrivals per day. X is Poisso distributed with a mea µ = λt =*8 = 8 takers/day. µ 8 e µ e 8 P(X > ) =-P(X ñ ) = F() = = = = 0.936= !! The cumulative results were obtaied usig Microsoft Ecel, which has preprogrammed fuctios for all distributios covered here. µ =, Discrete Probability Distributios 6 of 8 L. K. Gaafar
7 The Hypergeometric Distributio All distributios described above were based o a series of idepedet Beroulli trials. A situatio i which we obtai a series of depedet Beroulli trials comes about i samplig without replacemet. For eample, assume that we are iterested i acceptig a lot of 00 parts if it cotais 5 or fewer defectives. We decide to take a sample of 0 parts, oe by oe, without replacemet ad cout the umber of defectives i the sample, ad use that umber to judge the quality of the lot. This ispectio is a series of Beroulli trials each with two possible outcomes: defective ad ot defective. If the lot cotais 5 defectives, the the probability that the first part o the sample will be defective is 5 = Now, the probability of the secod part beig 00 defective depeds o the results of the first part. If the first part is defective, we are left with 99 parts out of which oly 4 are defective ad accordigly, the probability of the secod part beig defective is 4 = If, however, the first part is ot defective, we are left with 99 parts out 99 of which 5 are defective, ad accordigly, the probability of the secod part beig defective is 5 = Hece, we have a series of Beroulli trials i which the probability of success i 99 each trial depeds o the results of all proceedig trials. We will ow develop the probability fuctio for this radom variable, X, defied as the umber of items with a give characteristic i a sample take from a lot N that has k items possessig the desired characteristic. The diagram to the right depicts this situatio. The items i the sample must come from the k items i the lot, while the remaiig items i the sample (- will have to come from the remaiig items i the lot (N-k). Usig the classical approach, umber of ways of choosig outof k ad outof N k = Number of ways outof N k N k =, = ma(0, N + k)...mi( k, ). N The rage of X starts from either 0 or - (N-K), whichever is larger, ad eds at either or k, whichever is smaller. X is called a hypergeometric radom variable ad is called the hypergeometric distributio. The mea ad variace of the hypergeometric distributio are give by k N k = = k µ, σ... N N N N N Notice that if we replace k/n by p, we get µ = p, ad σ =. pq, which are the mea ad N N the variace of the biomial distributio if the term is close to oe, which is the case N Discrete Probability Distributios 7 of 8 L. K. Gaafar
8 whe is small relative to N. Cosequetly, whe is small relative to N, the biomial distributio with p= k/n may be used to approimate the hypergeometric distributio. Eample: A committee of 5 members is formed by radomly choosig from a class of 40 studets i which oly 3 are freshme. What is the probability that the committee will iclude: a. eactly oe freshma? b. at most oe freshma? Solutio: a. Usig the hypergeometric distributio with = 5, N = 40, k = 3, =, we fid the probability of oe freshma to be (3)(66045) p ( ) = = = b. At most is satisfied by 0 or ()(435897) p ( 0) = = = P(X ñ ) = X = 0) + P(X = ) = = , a very high probability as we epect the majority of committee members to be o-freshme. Discrete Probability Distributios 8 of 8 L. K. Gaafar
Introduction to Probability and Statistics Twelfth Edition
Itroductio to Probability ad Statistics Twelfth Editio Robert J. Beaver Barbara M. Beaver William Medehall Presetatio desiged ad writte by: Barbara M. Beaver Itroductio to Probability ad Statistics Twelfth
More informationDiscrete Random Variables and Probability Distributions. Random Variables. Discrete Models
UCLA STAT 35 Applied Computatioal ad Iteractive Probability Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Chris Barr Uiversity of Califoria, Los Ageles, Witer 006 http://www.stat.ucla.edu/~diov/
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationIE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes.
IE 230 Seat # Name < KEY > Please read these directios. Closed book ad otes. 60 miutes. Covers through the ormal distributio, Sectio 4.7 of Motgomery ad Ruger, fourth editio. Cover page ad four pages of
More informationModeling and Performance Analysis with Discrete-Event Simulation
Simulatio Modelig ad Performace Aalysis with Discrete-Evet Simulatio Chapter 5 Statistical Models i Simulatio Cotets Basic Probability Theory Cocepts Useful Statistical Models Discrete Distributios Cotiuous
More informationProbability and Statistics
robability ad Statistics rof. Zheg Zheg Radom Variable A fiite sigle valued fuctio.) that maps the set of all eperimetal outcomes ito the set of real umbers R is a r.v., if the set ) is a evet F ) for
More informationProbability and statistics: basic terms
Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19
CS 70 Discrete Mathematics ad Probability Theory Sprig 2016 Rao ad Walrad Note 19 Some Importat Distributios Recall our basic probabilistic experimet of tossig a biased coi times. This is a very simple
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationLimit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p).
Limit Theorems Covergece i Probability Let X be the umber of heads observed i tosses. The, E[X] = p ad Var[X] = p(-p). L O This P x p NM QP P x p should be close to uity for large if our ituitio is correct.
More informationCH5. Discrete Probability Distributions
CH5. Discrete Probabilit Distributios Radom Variables A radom variable is a fuctio or rule that assigs a umerical value to each outcome i the sample space of a radom eperimet. Nomeclature: - Capital letters:
More informationIE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes.
Closed book ad otes. No calculators. 120 miutes. Cover page, five pages of exam, ad tables for discrete ad cotiuous distributios. Score X i =1 X i / S X 2 i =1 (X i X ) 2 / ( 1) = [i =1 X i 2 X 2 ] / (
More informationDiscrete Mathematics and Probability Theory Summer 2014 James Cook Note 15
CS 70 Discrete Mathematics ad Probability Theory Summer 2014 James Cook Note 15 Some Importat Distributios I this ote we will itroduce three importat probability distributios that are widely used to model
More informationThe Poisson Distribution
MATH 382 The Poisso Distributio Dr. Neal, WKU Oe of the importat distributios i probabilistic modelig is the Poisso Process X t that couts the umber of occurreces over a period of t uits of time. This
More informationReview on Probability Distributions
Discrete Probability Distributios: Biomial Probability Distributio ourse: MAT, Istructor: Md. Saifuddi Khalid Review o Probability Distributios Radom Variable. A radom variable is a variable which takes
More informationDiscrete Mathematics and Probability Theory Spring 2012 Alistair Sinclair Note 15
CS 70 Discrete Mathematics ad Probability Theory Sprig 2012 Alistair Siclair Note 15 Some Importat Distributios The first importat distributio we leared about i the last Lecture Note is the biomial distributio
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationLecture 5. Random variable and distribution of probability
Itroductio to theory of probability ad statistics Lecture 5. Radom variable ad distributio of probability prof. dr hab.iż. Katarzya Zarzewsa Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationCastiel, Supernatural, Season 6, Episode 18
13 Differetial Equatios the aswer to your questio ca best be epressed as a series of partial differetial equatios... Castiel, Superatural, Seaso 6, Episode 18 A differetial equatio is a mathematical equatio
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationAMS570 Lecture Notes #2
AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)
More informationRandom Models. Tusheng Zhang. February 14, 2013
Radom Models Tusheg Zhag February 14, 013 1 Radom Walks Let me describe the model. Radom walks are used to describe the motio of a movig particle (object). Suppose that a particle (object) moves alog the
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More informationChapter 8: Estimating with Confidence
Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig
More informationFinal Review for MATH 3510
Fial Review for MATH 50 Calculatio 5 Give a fairly simple probability mass fuctio or probability desity fuctio of a radom variable, you should be able to compute the expected value ad variace of the variable
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More information( ) = p and P( i = b) = q.
MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationPH 425 Quantum Measurement and Spin Winter SPINS Lab 1
PH 425 Quatum Measuremet ad Spi Witer 23 SPIS Lab Measure the spi projectio S z alog the z-axis This is the experimet that is ready to go whe you start the program, as show below Each atom is measured
More informationBinomial Distribution
0.0 0.5 1.0 1.5 2.0 2.5 3.0 0 1 2 3 4 5 6 7 0.0 0.5 1.0 1.5 2.0 2.5 3.0 Overview Example: coi tossed three times Defiitio Formula Recall that a r.v. is discrete if there are either a fiite umber of possible
More informationBHW #13 1/ Cooper. ENGR 323 Probabilistic Analysis Beautiful Homework # 13
BHW # /5 ENGR Probabilistic Aalysis Beautiful Homework # Three differet roads feed ito a particular freeway etrace. Suppose that durig a fixed time period, the umber of cars comig from each road oto the
More informationThe Random Walk For Dummies
The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli
More informationApril 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE
April 18, 2017 CONFIDENCE INTERVALS AND HYPOTHESIS TESTING, UNDERGRADUATE MATH 526 STYLE TERRY SOO Abstract These otes are adapted from whe I taught Math 526 ad meat to give a quick itroductio to cofidece
More informationProblems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:
Math 224 Fall 2017 Homework 4 Drew Armstrog Problems from 9th editio of Probability ad Statistical Iferece by Hogg, Tais ad Zimmerma: Sectio 2.3, Exercises 16(a,d),18. Sectio 2.4, Exercises 13, 14. Sectio
More informationInferential Statistics. Inference Process. Inferential Statistics and Probability a Holistic Approach. Inference Process.
Iferetial Statistics ad Probability a Holistic Approach Iferece Process Chapter 8 Poit Estimatio ad Cofidece Itervals This Course Material by Maurice Geraghty is licesed uder a Creative Commos Attributio-ShareAlike
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationDiscrete Mathematics for CS Spring 2005 Clancy/Wagner Notes 21. Some Important Distributions
CS 70 Discrete Mathematics for CS Sprig 2005 Clacy/Wager Notes 21 Some Importat Distributios Questio: A biased coi with Heads probability p is tossed repeatedly util the first Head appears. What is the
More informationCS/ECE 715 Spring 2004 Homework 5 (Due date: March 16)
CS/ECE 75 Sprig 004 Homework 5 (Due date: March 6) Problem 0 (For fu). M/G/ Queue with Radom-Sized Batch Arrivals. Cosider the M/G/ system with the differece that customers are arrivig i batches accordig
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationTopic 8: Expected Values
Topic 8: Jue 6, 20 The simplest summary of quatitative data is the sample mea. Give a radom variable, the correspodig cocept is called the distributioal mea, the epectatio or the epected value. We begi
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationMATH/STAT 352: Lecture 15
MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet
More informationSampling Distributions, Z-Tests, Power
Samplig Distributios, Z-Tests, Power We draw ifereces about populatio parameters from sample statistics Sample proportio approximates populatio proportio Sample mea approximates populatio mea Sample variace
More informationEmpirical Distributions
Empirical Distributios A empirical distributio is oe for which each possible evet is assiged a probability derived from experimetal observatio. It is assumed that the evets are idepedet ad the sum of the
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More information3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,
3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [
More informationUNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY
UNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY Structure 2.1 Itroductio Objectives 2.2 Relative Frequecy Approach ad Statistical Probability 2. Problems Based o Relative Frequecy 2.4 Subjective Approach
More information(6) Fundamental Sampling Distribution and Data Discription
34 Stat Lecture Notes (6) Fudametal Samplig Distributio ad Data Discriptio ( Book*: Chapter 8,pg5) Probability& Statistics for Egieers & Scietists By Walpole, Myers, Myers, Ye 8.1 Radom Samplig: Populatio:
More informationMost text will write ordinary derivatives using either Leibniz notation 2 3. y + 5y= e and y y. xx tt t
Itroductio to Differetial Equatios Defiitios ad Termiolog Differetial Equatio: A equatio cotaiig the derivatives of oe or more depedet variables, with respect to oe or more idepedet variables, is said
More informationLast time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object
6.3 Stochastic Estimatio ad Cotrol, Fall 004 Lecture 7 Last time: Momets of the Poisso distributio from its geeratig fuctio. Gs () e dg µ e ds dg µ ( s) µ ( s) µ ( s) µ e ds dg X µ ds X s dg dg + ds ds
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationSAMPLE. The binomial distribution. Objectives
C H A P T E R 15 The biomial distributio Objectives To defie Beroulli sequeces. To review the basic cocepts of the biomial probability distributio. To ivestigate the graph of the biomial probability distributio,
More informationMassachusetts Institute of Technology
Solutios to Quiz : Sprig 006 Problem : Each of the followig statemets is either True or False. There will be o partial credit give for the True False questios, thus ay explaatios will ot be graded. Please
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationEE 4TM4: Digital Communications II Probability Theory
1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair
More informationConfidence Intervals for the Population Proportion p
Cofidece Itervals for the Populatio Proportio p The cocept of cofidece itervals for the populatio proportio p is the same as the oe for, the samplig distributio of the mea, x. The structure is idetical:
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationLecture 2: April 3, 2013
TTIC/CMSC 350 Mathematical Toolkit Sprig 203 Madhur Tulsiai Lecture 2: April 3, 203 Scribe: Shubhedu Trivedi Coi tosses cotiued We retur to the coi tossig example from the last lecture agai: Example. Give,
More informationf X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probablity that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c} Pr(X c) = Pr({s S X(s)
More informationMAS275 Probability Modelling
MAS275 Probability Modellig 6 Poisso processes 6.1 Itroductio Poisso processes are a particularly importat topic i probability theory. The oe-dimesioal Poisso process, which most of this sectio will be
More informationDownloaded from
ocepts ad importat formulae o probability Key cocept: *coditioal probability *properties of coditioal probability *Multiplicatio Theorem o Probablity *idepedet evets *Theorem of Total Probablity *Bayes
More information6. Sufficient, Complete, and Ancillary Statistics
Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationSection 11.8: Power Series
Sectio 11.8: Power Series 1. Power Series I this sectio, we cosider geeralizig the cocept of a series. Recall that a series is a ifiite sum of umbers a. We ca talk about whether or ot it coverges ad i
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationDiscrete Mathematics and Probability Theory Fall 2016 Walrand Probability: An Overview
CS 70 Discrete Mathematics ad Probability Theory Fall 2016 Walrad Probability: A Overview Probability is a fasciatig theory. It provides a precise, clea, ad useful model of ucertaity. The successes of
More informationGeneralized Semi- Markov Processes (GSMP)
Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual
More informationLecture 4. Random variable and distribution of probability
Itroductio to theory of probability ad statistics Lecture. Radom variable ad distributio of probability dr hab.iż. Katarzya Zarzewsa, prof.agh Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Math 36Q Fall 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2 to
More information1 Review of Probability & Statistics
1 Review of Probability & Statistics a. I a group of 000 people, it has bee reported that there are: 61 smokers 670 over 5 960 people who imbibe (drik alcohol) 86 smokers who imbibe 90 imbibers over 5
More informationLesson 10: Limits and Continuity
www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig
More information4.1 Sigma Notation and Riemann Sums
0 the itegral. Sigma Notatio ad Riema Sums Oe strategy for calculatig the area of a regio is to cut the regio ito simple shapes, calculate the area of each simple shape, ad the add these smaller areas
More informationDisjoint set (Union-Find)
CS124 Lecture 7 Fall 2018 Disjoit set (Uio-Fid) For Kruskal s algorithm for the miimum spaig tree problem, we foud that we eeded a data structure for maitaiig a collectio of disjoit sets. That is, we eed
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationFirst come, first served (FCFS) Batch
Queuig Theory Prelimiaries A flow of customers comig towards the service facility forms a queue o accout of lack of capacity to serve them all at a time. RK Jaa Some Examples: Persos waitig at doctor s
More informationCS 171 Lecture Outline October 09, 2008
CS 171 Lecture Outlie October 09, 2008 The followig theorem comes very hady whe calculatig the expectatio of a radom variable that takes o o-egative iteger values. Theorem: Let Y be a radom variable that
More informationWhat is Probability?
Quatificatio of ucertaity. What is Probability? Mathematical model for thigs that occur radomly. Radom ot haphazard, do t kow what will happe o ay oe experimet, but has a log ru order. The cocept of probability
More informationLecture 12: November 13, 2018
Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,
More informationANALYSIS OF EXPERIMENTAL ERRORS
ANALYSIS OF EXPERIMENTAL ERRORS All physical measuremets ecoutered i the verificatio of physics theories ad cocepts are subject to ucertaities that deped o the measurig istrumets used ad the coditios uder
More informationStatisticians use the word population to refer the total number of (potential) observations under consideration
6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationSTAT 516 Answers Homework 6 April 2, 2008 Solutions by Mark Daniel Ward PROBLEMS
STAT 56 Aswers Homework 6 April 2, 28 Solutios by Mark Daiel Ward PROBLEMS Chapter 6 Problems 2a. The mass p(, correspods to either o the irst two balls beig white, so p(, 8 7 4/39. The mass p(, correspods
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More informationCS 330 Discussion - Probability
CS 330 Discussio - Probability March 24 2017 1 Fudametals of Probability 11 Radom Variables ad Evets A radom variable X is oe whose value is o-determiistic For example, suppose we flip a coi ad set X =
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. Comments:
Recall: STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Commets:. So far we have estimates of the parameters! 0 ad!, but have o idea how good these estimates are. Assumptio: E(Y x)! 0 +! x (liear coditioal
More informationU8L1: Sec Equations of Lines in R 2
MCVU U8L: Sec. 8.9. Equatios of Lies i R Review of Equatios of a Straight Lie (-D) Cosider the lie passig through A (-,) with slope, as show i the diagram below. I poit slope form, the equatio of the lie
More informationCentral Limit Theorem the Meaning and the Usage
Cetral Limit Theorem the Meaig ad the Usage Covetio about otatio. N, We are usig otatio X is variable with mea ad stadard deviatio. i lieu of sayig that X is a ormal radom Assume a sample of measuremets
More informationChapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities
Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other
More informationf X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probability that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c}) Pr(X c) = Pr({s S X(s)
More information