3 Modeling Process Quality

Size: px
Start display at page:

Download "3 Modeling Process Quality"

Transcription

1 3 Modeling Process Quality 3.1 Introduction Section 3.1 contains basic numerical and graphical methods. familiar with these methods. It is assumed the student is Goal: Review several discrete and continuous distributions commonly used in modeling applications of physical phenomena. In general, these distributions will depend on either one or two parameters. Once parameter values are assigned, the distributions are completely defined. In statistics, we study techniques for estimating these parameters. In probability, we study properties of these distributions and how they can be used to assign probabilities to various situations. 3.2 Important Discrete Distributions Bernoulli Distribution A single experiment has two possible events of interest, say 0 and 1 where 1 is generally referred to as a success and 0 as a failure. The random variable X assumes the value X = 0 or X = 1 such that p = P (X = 1) and q = 1 p = P (X = 0). The pdf f(x) of X is given by: f(x) = p x (1 p) 1 x = p x q 1 x where x = 0, 1 The mean E(X) = p The variance Var(X) = p(1 p) = pq X is known as a Bernoulli random variable and it follows a Bernoulli distribution. A single performance of this type of experiment is known as a Bernoulli trial. p is the parameter of the Bernoulli distribution. Binomial Distribution The experiment consists of a sequence of n independent Bernoulli trials. The random variable of interest X is the number of successes observed in n Bernoulli trials.thus, X can assume the values x = 0, 1, 2,..., n. The pdf b(x; n, p) of X is given by b(x; n, p) = where x = 0, 1,..., n. ( ) n p x (1 p) n x = x ( ) n p x q n x x X is known as a binomial random variable which follows a binomial distribution. 15

2 The CDF of a binomial random variable is given by: B(x; n, p) = k=1 ( ) n p k (1 p) n k = k k=1 ( ) n p k q n k k x = 0, 1,..., n The mean E(X) = np and the variance Var(X) = npq = np(1 p) Notation: To state that X follows a binomial distribution, we write: X B(x; n, p) or X BIN(n, p) p and n are the parameters of the binomial distribution. Application: Quality Control Sampling Items are produced in a production line process. The probability that any item has a defect is p. During production, n items are selected according to some sampling plan. If X is the number of defective items in the sample, then X B(n, p) (assuming the items are produced independently). Hypergeometric Distribution There are a total of N items in the experiment: M of Type 1 and N M of Type 2. n items are selected randomly from the N items without replacement. Let X be the number of Type 1 items in the sample of n items. Let x min = max(0, n N + M) and x max = min(n, M). The random variable X can integer values x where x min x x max. The pdf h(x; n, M, N) of X is given by h(x; n, M, N) = ( M )( N M ) x n x ( N n) X is known as a hypergeometric random variable which follows a hypergeometric distribution. The CDF of a hypergeometric random variable is given by: H(x; n, M, N) = x k=x min where. is the floor function, and x min x x max. ( M )( N M ) k n k ( N n) The mean E(X) = nm/n and the variance Var(X) = nm N ( 1 M N Notation: To state that X follows a hypergeometric distribution, we write: X HYP(n, M, N) n, M, and N are the parameters of the hypergeometric distribution. 16 ) ( ) N n N 1

3 Applications: Sampling from a Finite Population A population contains N items. M possess a certain characteristic of interest (e.g., an item is defective) and the remaining N M do not. In general, it is too costly to census the entire population so a random sample is taken. Let n be the sample size. Let X be the number of items in the sample that possess the characteristic of interest. X follows a hypergeometric distribution, i.e., X HYP(n, M, N). Negative Binomial Distribution The experiment consists of a sequence of independent Bernoulli trials (with probability of success p) until the r th success appears. Let the random variable X be the number of Bernoulli trials until the r th success. Note X is countably infinite, that is, the values that X can assume are r, r + 1, r + 2,.... The pdf f(x; r, p) of X is given by: ( ) x 1 f(x; r, p) = p r (1 p) x r = r 1 ( ) x 1 p r q x r x = r, r + 1, r + 2,... r 1 X is known as a negative binomial random variable which follows a negative binomial distribution. The CDF of a geometric random variable is given by: F (x; r, p) = k=r ( ) k 1 p r (1 p) k r = r 1 k=r ( ) k 1 p r q k r k = r, r + 1, r + 2,... r 1 The mean E(X) = r/p and the variance Var(X) = r(1 p)/p 2 = rq/p 2. Notation: If X follows a negative binomial distribution, we write: X NB(r, p). p and r are the parameters of the negative binomial distribution. Application Quality Control Sampling Items are produced in a production line process. The probability that any item has a defect is p. If r defects are found before R units are sampled, the process is shut down in search of a cause. You are interested in the average run length (ARL) of the process between shutdowns for various values of p and r. You want to develop a sampling plan (choosing r and R) based on the cost of shutting down the process vs sending defective items to a customer. If X is the number of items sampled until the r th defect is found, then X NB(r, p) and the ARL = E(X). 17

4 Geometric Distribution (Special Case of Negative Binomial with r = 1) Let the random variable X be the number of Bernoulli trials until the first success. The pdf g(x; p) of X is given by: g(x; p) = p(1 p) x 1 = pq x 1 x = 1, 2, 3,.... X is known as a geometric random variable which follows a geometric distribution. The CDF of a geometric random variable is given by: G(x; p) = p(1 p) k 1 = 1 (1 p) x = 1 q x x = 1, 2, 3,... k=1 The mean E(X) = 1/p and the variance Var(X) = (1 p)/p 2 = q/p 2. Notation: To state that X follows a geometric distribution, we write X GEO(p). p is the parameter of the geometric distribution. Application Run Length in Quality Control Sampling If X is the number of items sampled until a defect is found, then X GEO(p) and the ARL = E(X). Poisson Distribution Situation Poisson Processes: Consider a physical situation in which a certain type of event is recurring. Let X(t) denote the number of such occurrences that occur in a given interval [0, t]. Assume the following assumptions hold: 1. The probability that an event will occur in a given short interval [t, t + t] is approximately proportional to its length t, and this probability does not depend on the position on the interval. 2. The occurrences of events in nonoverlapping intervals are independent. 3. The probability of two or more events in a short interval [t, t + t] is negligible. If these assumptions hold as t 0, then the distribution of X(t) is Poisson. If these conditions hold, then for all t > 0, P [X(t) = n] = e λt (λt) n /n!. Note X is countably infinite, that is, the values that X can assume are 0, 1, 2,.... λ is called the rate of occurrence or intensity of the Poisson process. Because λ is assumed constant, the Poisson process is homogeneous. Suppose t is fixed, and let µ = λt. Then the pdf f(x; µ) of X is given by: f(x; µ) = e µ (µ) x /x! x = 0, 1, 2,... X is known as a Poisson random variable which follows a Poisson distribution. 18

5 The CDF of a Poisson random variable is given by: F (x; µ) = e µ (µ) k /k! x = 0, 1, 2,... k=0 The mean E(X) = µ and the variance Var(X) = µ Notation: To state that X follows a Poisson distribution, we write X POI(µ). µ is the parameter of the Poisson distribution. Application 1 Queueing Theory Application 2 Defect Occurrence in Quality Control 3.3 Important Continuous Distributions Gamma Distribution The gamma function is Γ(κ) = 0 t κ 1 e t dt for all κ > 0 Recall: ( ) (i) Γ(κ) = (κ 1)Γ(κ 1) (ii) Γ(n) = (n 1)! for n = 1, 2, 3,... (iii) 1 Γ = π 2 The random variable X can assume values > 0. For κ > 0 and θ > 0, the pdf f(x; θ, κ) of X is given by: 1 θ κ Γ(κ) xκ 1 e x/θ for x > 0 f(x; θ, κ) = 0 otherwise The mean E(X) = κθ and the variance Var(X) = κθ 2 X is known as a gamma random variable and it follows a gamma distribution. Notation: To state that X follows a gamma distribution, we write X GAM(θ, κ). The CDF of a gamma random variable is given by: F (x; θ, κ) = x 0 0 for x 0 1 θ κ Γ(κ) tκ 1 e t/θ dt for x > 0 Case 1: For κ = n (n = 1, 2,...), the CDF of a gamma random variable reduces to: F (x; θ, n) = 1 n 1 i=0 0 for x 0 (x/θ) i i! e x/θ for x > 0 19

6 θ and κ are the parameters of the gamma distribution. κ is the shape parameter and θ is the scale parameter. By varying κ and θ, the gamma pdf can assume many possible shapes. Therefore, by choosing appropriate κ and θ values, we can find a density that reasonably approximates many realworld situations. Case 2: When θ = 2 and κ = ν/2, this gamma distribution is referred to as a chi-square distribution with ν degrees of freedom. Case 3: When κ = 1, this gamma distribution is known as an exponential distribution. Application 1: Distribution of Lifetimes Application 2: Waiting Times (in queueing problems) Exponential Distribution The pdf f(x; θ) of X is given by: f(x; θ) = The mean E(X) = θ and the variance Var(X) = θ 2 1 θ e x/θ forx > 0 0 otherwise X is an exponential random variable and it follows an exponential distribution. Notation: To state that X follows an exponential distribution, we write X EXP (θ). The CDF of an exponential random variable is given by: F (x; θ) = 0 for x 0 1 e x/θ for x > 0 θ is the parameter of the exponential distribution and is a scale parameter. Application 1: Distribution of Lifetimes of Electronic Components Application 2: Interarrival Times (in queueing problems) Weibull Distribution The random variable X assumes the values x > 0. For β > 0 and θ > 0, the pdf f(x; θ, β) of X is given by: β x β 1 e (x/θ)β for x > 0 θ β f(x; θ, β) = 0 otherwise 20

7 By varying β and θ, the Weibull pdf can assume many possible shapes, and, therefore, by choosing appropriate β and θ, we can find a density that reasonably approximates many real-world situations. The mean E(X) = θγ ( β ( The variance Var(X) = θ [Γ ) ( Γ )] β β ) X is known as a Weibull random variable and it follows a Weibull distribution. Notation: To state that X follows a Weibull distribution, we write X W EI(θ, β). The CDF of a Weibull random variable is given by: F (x; θ, β) = 0 for x 0 1 e ( t/θ)β for x > 0 By solving the CDF for x, we have the p th percentile of the Weibull distribution: x p = θ [ ln(1 p)] 1/β θ and β are the parameters of the Weibull distribution. β is the shape parameter and θ is the scale parameter. Application: Lifetime distributions of products. Normal Distribution The distribution of the random variable X is symmetric, and the parameters µ and σ can be varied so the distribution is centered at any value and whose variability can be made as small or large as needed. The normal pdf follows a bell-shape. Although the normal distribution in positive over the real number line, it can provide a reasonable and very reliable model for variables that take on values in some interval. This is because negligible probability is associated with the tails of the normal distribution. For any real-valued µ and σ > 0, the pdf f(x; µ, σ) of X is given by: f(x; µ, σ) = 1 σ 2π e [(x µ)/σ]2 /2 The mean E(X) = µ and the variance Var(X) = σ 2 X is known as a normal random variable and it follows a normal distribution. Notation: To state that X follows a normal distribution, we write: X N(µ, σ 2 ). 21

8 Warning: Some texts use σ. That is, X N(µ, σ). µ and σ are the parameters of the normal distribution. µ is the location parameter and σ is the scale parameter. Some disciplines, e.g. engineering, refer to the normal distribution as the Gaussian distribution. The Standard Normal Distribution Special Case: When µ = 0 and σ 2 = 1, this normal distribution is referred to as the standard normal distribution. The pdf φ(z) and CDF Φ(z) of a standard normal random variable are denoted: φ(z) = 1 2π e z2 /2 Φ(z) = 1 2π z e t2 /2 dt Theorem Let X N(µ, σ 2 ). Then if we let Z = X µ, Z N(0, 1), i.e., Z is a standard σ normal random variable and ( ) x µ F (x; µ, σ) = Φ σ Distribution Examples Example 1: An assembly line produces machine parts. Assume independence in the production of parts. That is, there is a constant probability of producing a defective part. 1. Suppose a random sample of n parts is to be taken. Let the random variable X = the number of defective parts in the random sample and p = the probability of producing a defective part. If X 2, then the process is shut down to look for an assignable cause for the defects. For p =.01,.05, and.10, what is the probability the process is shut down if n = 15? 2. Suppose parts from this assembly line production process are tested until a defective part is found. Let X = the number of parts sampled when the first defective part is found. What is the distribution of X for p =.01,.10? and Plot the E(X) vs p for 0 < p Suppose parts from this assembly line production process are tested until two defective parts are found. Let X = the number of parts sampled when the second defective part is found. What is the distribution of X for p =.01,.10? and Plot the E(X) vs p for 0 < p 1. Example 2: Suppose a metal substrate is partitioned into an 8 8 grid of 64 squares. The colony of bacteria is denoted by the 7 bulleted squares. Suppose a random sample of n squares is to be taken. We say a colony is detected if at least one bulleted square is in the sample. Let X = the number of bulleted squares contained in the sample. What is the distribution of X? and For n = 5, 10, what is the probability the colony is detected? 22

15 Discrete Distributions

15 Discrete Distributions Lecture Note 6 Special Distributions (Discrete and Continuous) MIT 4.30 Spring 006 Herman Bennett 5 Discrete Distributions We have already seen the binomial distribution and the uniform distribution. 5.

More information

Probability Distributions Columns (a) through (d)

Probability Distributions Columns (a) through (d) Discrete Probability Distributions Columns (a) through (d) Probability Mass Distribution Description Notes Notation or Density Function --------------------(PMF or PDF)-------------------- (a) (b) (c)

More information

Computer Science, Informatik 4 Communication and Distributed Systems. Simulation. Discrete-Event System Simulation. Dr.

Computer Science, Informatik 4 Communication and Distributed Systems. Simulation. Discrete-Event System Simulation. Dr. Simulation Discrete-Event System Simulation Chapter 4 Statistical Models in Simulation Purpose & Overview The world the model-builder sees is probabilistic rather than deterministic. Some statistical model

More information

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models Fatih Cavdur fatihcavdur@uludag.edu.tr March 20, 2012 Introduction Introduction The world of the model-builder

More information

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations Chapter 5 Statistical Models in Simulations 5.1 Contents Basic Probability Theory Concepts Discrete Distributions Continuous Distributions Poisson Process Empirical Distributions Useful Statistical Models

More information

Stat 5101 Notes: Brand Name Distributions

Stat 5101 Notes: Brand Name Distributions Stat 5101 Notes: Brand Name Distributions Charles J. Geyer September 5, 2012 Contents 1 Discrete Uniform Distribution 2 2 General Discrete Uniform Distribution 2 3 Uniform Distribution 3 4 General Uniform

More information

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models Fatih Cavdur fatihcavdur@uludag.edu.tr March 29, 2014 Introduction Introduction The world of the model-builder

More information

Slides 8: Statistical Models in Simulation

Slides 8: Statistical Models in Simulation Slides 8: Statistical Models in Simulation Purpose and Overview The world the model-builder sees is probabilistic rather than deterministic: Some statistical model might well describe the variations. An

More information

Probability and Distributions

Probability and Distributions Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated

More information

Review for the previous lecture

Review for the previous lecture Lecture 1 and 13 on BST 631: Statistical Theory I Kui Zhang, 09/8/006 Review for the previous lecture Definition: Several discrete distributions, including discrete uniform, hypergeometric, Bernoulli,

More information

Things to remember when learning probability distributions:

Things to remember when learning probability distributions: SPECIAL DISTRIBUTIONS Some distributions are special because they are useful They include: Poisson, exponential, Normal (Gaussian), Gamma, geometric, negative binomial, Binomial and hypergeometric distributions

More information

Chapter 3 Common Families of Distributions

Chapter 3 Common Families of Distributions Lecture 9 on BST 631: Statistical Theory I Kui Zhang, 9/3/8 and 9/5/8 Review for the previous lecture Definition: Several commonly used discrete distributions, including discrete uniform, hypergeometric,

More information

EXAM. Exam #1. Math 3342 Summer II, July 21, 2000 ANSWERS

EXAM. Exam #1. Math 3342 Summer II, July 21, 2000 ANSWERS EXAM Exam # Math 3342 Summer II, 2 July 2, 2 ANSWERS i pts. Problem. Consider the following data: 7, 8, 9, 2,, 7, 2, 3. Find the first quartile, the median, and the third quartile. Make a box and whisker

More information

Random Variables and Their Distributions

Random Variables and Their Distributions Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital

More information

Continuous Random Variables

Continuous Random Variables Continuous Random Variables Recall: For discrete random variables, only a finite or countably infinite number of possible values with positive probability. Often, there is interest in random variables

More information

BMIR Lecture Series on Probability and Statistics Fall, 2015 Uniform Distribution

BMIR Lecture Series on Probability and Statistics Fall, 2015 Uniform Distribution Lecture #5 BMIR Lecture Series on Probability and Statistics Fall, 2015 Department of Biomedical Engineering and Environmental Sciences National Tsing Hua University s 5.1 Definition ( ) A continuous random

More information

(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3)

(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3) 3 Probability Distributions (Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3) Probability Distribution Functions Probability distribution function (pdf): Function for mapping random variables to real numbers. Discrete

More information

3 Continuous Random Variables

3 Continuous Random Variables Jinguo Lian Math437 Notes January 15, 016 3 Continuous Random Variables Remember that discrete random variables can take only a countable number of possible values. On the other hand, a continuous random

More information

Ching-Han Hsu, BMES, National Tsing Hua University c 2015 by Ching-Han Hsu, Ph.D., BMIR Lab. = a + b 2. b a. x a b a = 12

Ching-Han Hsu, BMES, National Tsing Hua University c 2015 by Ching-Han Hsu, Ph.D., BMIR Lab. = a + b 2. b a. x a b a = 12 Lecture 5 Continuous Random Variables BMIR Lecture Series in Probability and Statistics Ching-Han Hsu, BMES, National Tsing Hua University c 215 by Ching-Han Hsu, Ph.D., BMIR Lab 5.1 1 Uniform Distribution

More information

Probability Density Functions

Probability Density Functions Probability Density Functions Probability Density Functions Definition Let X be a continuous rv. Then a probability distribution or probability density function (pdf) of X is a function f (x) such that

More information

Random Variables. Definition: A random variable (r.v.) X on the probability space (Ω, F, P) is a mapping

Random Variables. Definition: A random variable (r.v.) X on the probability space (Ω, F, P) is a mapping Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the

More information

EE/CpE 345. Modeling and Simulation. Fall Class 5 September 30, 2002

EE/CpE 345. Modeling and Simulation. Fall Class 5 September 30, 2002 EE/CpE 345 Modeling and Simulation Class 5 September 30, 2002 Statistical Models in Simulation Real World phenomena of interest Sample phenomena select distribution Probabilistic, not deterministic Model

More information

Brief Review of Probability

Brief Review of Probability Maura Department of Economics and Finance Università Tor Vergata Outline 1 Distribution Functions Quantiles and Modes of a Distribution 2 Example 3 Example 4 Distributions Outline Distribution Functions

More information

(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3)

(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3) 3 Probability Distributions (Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3) Probability Distribution Functions Probability distribution function (pdf): Function for mapping random variables to real numbers. Discrete

More information

Continuous Random Variables and Continuous Distributions

Continuous Random Variables and Continuous Distributions Continuous Random Variables and Continuous Distributions Continuous Random Variables and Continuous Distributions Expectation & Variance of Continuous Random Variables ( 5.2) The Uniform Random Variable

More information

Known probability distributions

Known probability distributions Known probability distributions Engineers frequently wor with data that can be modeled as one of several nown probability distributions. Being able to model the data allows us to: model real systems design

More information

Continuous Distributions

Continuous Distributions A normal distribution and other density functions involving exponential forms play the most important role in probability and statistics. They are related in a certain way, as summarized in a diagram later

More information

THE QUEEN S UNIVERSITY OF BELFAST

THE QUEEN S UNIVERSITY OF BELFAST THE QUEEN S UNIVERSITY OF BELFAST 0SOR20 Level 2 Examination Statistics and Operational Research 20 Probability and Distribution Theory Wednesday 4 August 2002 2.30 pm 5.30 pm Examiners { Professor R M

More information

MATH : EXAM 2 INFO/LOGISTICS/ADVICE

MATH : EXAM 2 INFO/LOGISTICS/ADVICE MATH 3342-004: EXAM 2 INFO/LOGISTICS/ADVICE INFO: WHEN: Friday (03/11) at 10:00am DURATION: 50 mins PROBLEM COUNT: Appropriate for a 50-min exam BONUS COUNT: At least one TOPICS CANDIDATE FOR THE EXAM:

More information

Guidelines for Solving Probability Problems

Guidelines for Solving Probability Problems Guidelines for Solving Probability Problems CS 1538: Introduction to Simulation 1 Steps for Problem Solving Suggested steps for approaching a problem: 1. Identify the distribution What distribution does

More information

STAT 3610: Review of Probability Distributions

STAT 3610: Review of Probability Distributions STAT 3610: Review of Probability Distributions Mark Carpenter Professor of Statistics Department of Mathematics and Statistics August 25, 2015 Support of a Random Variable Definition The support of a random

More information

b. ( ) ( ) ( ) ( ) ( ) 5. Independence: Two events (A & B) are independent if one of the conditions listed below is satisfied; ( ) ( ) ( )

b. ( ) ( ) ( ) ( ) ( ) 5. Independence: Two events (A & B) are independent if one of the conditions listed below is satisfied; ( ) ( ) ( ) 1. Set a. b. 2. Definitions a. Random Experiment: An experiment that can result in different outcomes, even though it is performed under the same conditions and in the same manner. b. Sample Space: This

More information

Continuous Distributions

Continuous Distributions Chapter 3 Continuous Distributions 3.1 Continuous-Type Data In Chapter 2, we discuss random variables whose space S contains a countable number of outcomes (i.e. of discrete type). In Chapter 3, we study

More information

Discrete Distributions

Discrete Distributions Chapter 2 Discrete Distributions 2.1 Random Variables of the Discrete Type An outcome space S is difficult to study if the elements of S are not numbers. However, we can associate each element/outcome

More information

Chapter 5. Chapter 5 sections

Chapter 5. Chapter 5 sections 1 / 43 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions

More information

1 Review of Probability and Distributions

1 Review of Probability and Distributions Random variables. A numerically valued function X of an outcome ω from a sample space Ω X : Ω R : ω X(ω) is called a random variable (r.v.), and usually determined by an experiment. We conventionally denote

More information

Random Variables Example:

Random Variables Example: Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the

More information

II. The Normal Distribution

II. The Normal Distribution II. The Normal Distribution The normal distribution (a.k.a., a the Gaussian distribution or bell curve ) is the by far the best known random distribution. It s discovery has had such a far-reaching impact

More information

Definition: A random variable X is a real valued function that maps a sample space S into the space of real numbers R. X : S R

Definition: A random variable X is a real valued function that maps a sample space S into the space of real numbers R. X : S R Random Variables Definition: A random variable X is a real valued function that maps a sample space S into the space of real numbers R. X : S R As such, a random variable summarizes the outcome of an experiment

More information

Distributions of Functions of Random Variables. 5.1 Functions of One Random Variable

Distributions of Functions of Random Variables. 5.1 Functions of One Random Variable Distributions of Functions of Random Variables 5.1 Functions of One Random Variable 5.2 Transformations of Two Random Variables 5.3 Several Random Variables 5.4 The Moment-Generating Function Technique

More information

Probability distributions. Probability Distribution Functions. Probability distributions (contd.) Binomial distribution

Probability distributions. Probability Distribution Functions. Probability distributions (contd.) Binomial distribution Probability distributions Probability Distribution Functions G. Jogesh Babu Department of Statistics Penn State University September 27, 2011 http://en.wikipedia.org/wiki/probability_distribution We discuss

More information

MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems

MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions

More information

Suppose that you have three coins. Coin A is fair, coin B shows heads with probability 0.6 and coin C shows heads with probability 0.8.

Suppose that you have three coins. Coin A is fair, coin B shows heads with probability 0.6 and coin C shows heads with probability 0.8. Suppose that you have three coins. Coin A is fair, coin B shows heads with probability 0.6 and coin C shows heads with probability 0.8. Coin A is flipped until a head appears, then coin B is flipped until

More information

Chapter Learning Objectives. Probability Distributions and Probability Density Functions. Continuous Random Variables

Chapter Learning Objectives. Probability Distributions and Probability Density Functions. Continuous Random Variables Chapter 4: Continuous Random Variables and Probability s 4-1 Continuous Random Variables 4-2 Probability s and Probability Density Functions 4-3 Cumulative Functions 4-4 Mean and Variance of a Continuous

More information

STAT/MATH 395 A - PROBABILITY II UW Winter Quarter Moment functions. x r p X (x) (1) E[X r ] = x r f X (x) dx (2) (x E[X]) r p X (x) (3)

STAT/MATH 395 A - PROBABILITY II UW Winter Quarter Moment functions. x r p X (x) (1) E[X r ] = x r f X (x) dx (2) (x E[X]) r p X (x) (3) STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 07 Néhémy Lim Moment functions Moments of a random variable Definition.. Let X be a rrv on probability space (Ω, A, P). For a given r N, E[X r ], if it

More information

Stat 5101 Notes: Brand Name Distributions

Stat 5101 Notes: Brand Name Distributions Stat 5101 Notes: Brand Name Distributions Charles J. Geyer February 14, 2003 1 Discrete Uniform Distribution DiscreteUniform(n). Discrete. Rationale Equally likely outcomes. The interval 1, 2,..., n of

More information

Northwestern University Department of Electrical Engineering and Computer Science

Northwestern University Department of Electrical Engineering and Computer Science Northwestern University Department of Electrical Engineering and Computer Science EECS 454: Modeling and Analysis of Communication Networks Spring 2008 Probability Review As discussed in Lecture 1, probability

More information

Chapter 3. Discrete Random Variables and Their Probability Distributions

Chapter 3. Discrete Random Variables and Their Probability Distributions Chapter 3. Discrete Random Variables and Their Probability Distributions 1 3.4-3 The Binomial random variable The Binomial random variable is related to binomial experiments (Def 3.6) 1. The experiment

More information

Lecture 16. Lectures 1-15 Review

Lecture 16. Lectures 1-15 Review 18.440: Lecture 16 Lectures 1-15 Review Scott Sheffield MIT 1 Outline Counting tricks and basic principles of probability Discrete random variables 2 Outline Counting tricks and basic principles of probability

More information

Continuous random variables

Continuous random variables Continuous random variables Continuous r.v. s take an uncountably infinite number of possible values. Examples: Heights of people Weights of apples Diameters of bolts Life lengths of light-bulbs We cannot

More information

Introduction to Probability and Statistics Slides 3 Chapter 3

Introduction to Probability and Statistics Slides 3 Chapter 3 Introduction to Probability and Statistics Slides 3 Chapter 3 Ammar M. Sarhan, asarhan@mathstat.dal.ca Department of Mathematics and Statistics, Dalhousie University Fall Semester 2008 Dr. Ammar M. Sarhan

More information

Special Discrete RV s. Then X = the number of successes is a binomial RV. X ~ Bin(n,p).

Special Discrete RV s. Then X = the number of successes is a binomial RV. X ~ Bin(n,p). Sect 3.4: Binomial RV Special Discrete RV s 1. Assumptions and definition i. Experiment consists of n repeated trials ii. iii. iv. There are only two possible outcomes on each trial: success (S) or failure

More information

Chapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory

Chapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory Chapter 1 Statistical Reasoning Why statistics? Uncertainty of nature (weather, earth movement, etc. ) Uncertainty in observation/sampling/measurement Variability of human operation/error imperfection

More information

Chapter 6 Continuous Probability Distributions

Chapter 6 Continuous Probability Distributions Math 3 Chapter 6 Continuous Probability Distributions The observations generated by different statistical experiments have the same general type of behavior. The followings are the probability distributions

More information

Week 1 Quantitative Analysis of Financial Markets Distributions A

Week 1 Quantitative Analysis of Financial Markets Distributions A Week 1 Quantitative Analysis of Financial Markets Distributions A Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 October

More information

Part I Stochastic variables and Markov chains

Part I Stochastic variables and Markov chains Part I Stochastic variables and Markov chains Random variables describe the behaviour of a phenomenon independent of any specific sample space Distribution function (cdf, cumulative distribution function)

More information

Math Spring Practice for the Second Exam.

Math Spring Practice for the Second Exam. Math 4 - Spring 27 - Practice for the Second Exam.. Let X be a random variable and let F X be the distribution function of X: t < t 2 t < 4 F X (t) : + t t < 2 2 2 2 t < 4 t. Find P(X ), P(X ), P(X 2),

More information

PAS04 - Important discrete and continuous distributions

PAS04 - Important discrete and continuous distributions PAS04 - Important discrete and continuous distributions Jan Březina Technical University of Liberec 30. října 2014 Bernoulli trials Experiment with two possible outcomes: yes/no questions throwing coin

More information

STAT509: Discrete Random Variable

STAT509: Discrete Random Variable University of South Carolina September 16, 2014 Motivation So far, we have already known how to calculate probabilities of events. Suppose we toss a fair coin three times, we know that the probability

More information

Applied Statistics and Probability for Engineers. Sixth Edition. Chapter 4 Continuous Random Variables and Probability Distributions.

Applied Statistics and Probability for Engineers. Sixth Edition. Chapter 4 Continuous Random Variables and Probability Distributions. Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger Chapter 4 Continuous Random Variables and Probability Distributions 4 Continuous CHAPTER OUTLINE Random

More information

Chapter 4 Continuous Random Variables and Probability Distributions

Chapter 4 Continuous Random Variables and Probability Distributions Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger Chapter 4 Continuous Random Variables and Probability Distributions 4 Continuous CHAPTER OUTLINE 4-1

More information

Common ontinuous random variables

Common ontinuous random variables Common ontinuous random variables CE 311S Earlier, we saw a number of distribution families Binomial Negative binomial Hypergeometric Poisson These were useful because they represented common situations:

More information

Chapter 4a Probability Models

Chapter 4a Probability Models Chapter 4a Probability Models 4a.2 Probability models for a variable with a finite number of values 297 4a.1 Introduction Chapters 2 and 3 are concerned with data description (descriptive statistics) where

More information

Expectations. Definition Let X be a discrete rv with set of possible values D and pmf p(x). The expected value or mean value of X, denoted by E(X ) or

Expectations. Definition Let X be a discrete rv with set of possible values D and pmf p(x). The expected value or mean value of X, denoted by E(X ) or Expectations Expectations Definition Let X be a discrete rv with set of possible values D and pmf p(x). The expected value or mean value of X, denoted by E(X ) or µ X, is E(X ) = µ X = x D x p(x) Expectations

More information

Math/Stat 352 Lecture 8

Math/Stat 352 Lecture 8 Math/Stat 352 Lecture 8 Sections 4.3 and 4.4 Commonly Used Distributions: Poisson, hypergeometric, geometric, and negative binomial. 1 The Poisson Distribution Poisson random variable counts the number

More information

Probability Distributions for Continuous Variables. Probability Distributions for Continuous Variables

Probability Distributions for Continuous Variables. Probability Distributions for Continuous Variables Probability Distributions for Continuous Variables Probability Distributions for Continuous Variables Let X = lake depth at a randomly chosen point on lake surface If we draw the histogram so that the

More information

Chapter 3. Discrete Random Variables and Their Probability Distributions

Chapter 3. Discrete Random Variables and Their Probability Distributions Chapter 3. Discrete Random Variables and Their Probability Distributions 2.11 Definition of random variable 3.1 Definition of a discrete random variable 3.2 Probability distribution of a discrete random

More information

Will Landau. Feb 28, 2013

Will Landau. Feb 28, 2013 Iowa State University The F Feb 28, 2013 Iowa State University Feb 28, 2013 1 / 46 Outline The F The F Iowa State University Feb 28, 2013 2 / 46 The normal (Gaussian) distribution A random variable X is

More information

Chapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University

Chapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University Chapter 3, 4 Random Variables ENCS6161 - Probability and Stochastic Processes Concordia University ENCS6161 p.1/47 The Notion of a Random Variable A random variable X is a function that assigns a real

More information

B.N.Bandodkar College of Science, Thane. Subject : Computer Simulation and Modeling.

B.N.Bandodkar College of Science, Thane. Subject : Computer Simulation and Modeling. B.N.Bandodkar College of Science, Thane Subject : Computer Simulation and Modeling. Simulation is a powerful technique for solving a wide variety of problems. To simulate is to copy the behaviors of a

More information

STAT2201. Analysis of Engineering & Scientific Data. Unit 3

STAT2201. Analysis of Engineering & Scientific Data. Unit 3 STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random

More information

Math 180A. Lecture 16 Friday May 7 th. Expectation. Recall the three main probability density functions so far (1) Uniform (2) Exponential.

Math 180A. Lecture 16 Friday May 7 th. Expectation. Recall the three main probability density functions so far (1) Uniform (2) Exponential. Math 8A Lecture 6 Friday May 7 th Epectation Recall the three main probability density functions so far () Uniform () Eponential (3) Power Law e, ( ), Math 8A Lecture 6 Friday May 7 th Epectation Eample

More information

SUFFICIENT STATISTICS

SUFFICIENT STATISTICS SUFFICIENT STATISTICS. Introduction Let X (X,..., X n ) be a random sample from f θ, where θ Θ is unknown. We are interested using X to estimate θ. In the simple case where X i Bern(p), we found that the

More information

Sampling Random Variables

Sampling Random Variables Sampling Random Variables Introduction Sampling a random variable X means generating a domain value x X in such a way that the probability of generating x is in accordance with p(x) (respectively, f(x)),

More information

Continuous Probability Spaces

Continuous Probability Spaces Continuous Probability Spaces Ω is not countable. Outcomes can be any real number or part of an interval of R, e.g. heights, weights and lifetimes. Can not assign probabilities to each outcome and add

More information

Chapter 3 Discrete Random Variables

Chapter 3 Discrete Random Variables MICHIGAN STATE UNIVERSITY STT 351 SECTION 2 FALL 2008 LECTURE NOTES Chapter 3 Discrete Random Variables Nao Mimoto Contents 1 Random Variables 2 2 Probability Distributions for Discrete Variables 3 3 Expected

More information

Chapter 4: Continuous Random Variables and Probability Distributions

Chapter 4: Continuous Random Variables and Probability Distributions Chapter 4: and Probability Distributions Walid Sharabati Purdue University February 14, 2014 Professor Sharabati (Purdue University) Spring 2014 (Slide 1 of 37) Chapter Overview Continuous random variables

More information

Confidence Intervals for the Sample Mean

Confidence Intervals for the Sample Mean Confidence Intervals for the Sample Mean As we saw before, parameter estimators are themselves random variables. If we are going to make decisions based on these uncertain estimators, we would benefit

More information

EEC 686/785 Modeling & Performance Evaluation of Computer Systems. Lecture 18

EEC 686/785 Modeling & Performance Evaluation of Computer Systems. Lecture 18 EEC 686/785 Modeling & Performance Evaluation of Computer Systems Lecture 18 Department of Electrical and Computer Engineering Cleveland State University wenbing@ieee.org (based on Dr. Raj Jain s lecture

More information

2 Random Variable Generation

2 Random Variable Generation 2 Random Variable Generation Most Monte Carlo computations require, as a starting point, a sequence of i.i.d. random variables with given marginal distribution. We describe here some of the basic methods

More information

Plotting data is one method for selecting a probability distribution. The following

Plotting data is one method for selecting a probability distribution. The following Advanced Analytical Models: Over 800 Models and 300 Applications from the Basel II Accord to Wall Street and Beyond By Johnathan Mun Copyright 008 by Johnathan Mun APPENDIX C Understanding and Choosing

More information

Review 1: STAT Mark Carpenter, Ph.D. Professor of Statistics Department of Mathematics and Statistics. August 25, 2015

Review 1: STAT Mark Carpenter, Ph.D. Professor of Statistics Department of Mathematics and Statistics. August 25, 2015 Review : STAT 36 Mark Carpenter, Ph.D. Professor of Statistics Department of Mathematics and Statistics August 25, 25 Support of a Random Variable The support of a random variable, which is usually denoted

More information

Chapter 7: Theoretical Probability Distributions Variable - Measured/Categorized characteristic

Chapter 7: Theoretical Probability Distributions Variable - Measured/Categorized characteristic BSTT523: Pagano & Gavreau, Chapter 7 1 Chapter 7: Theoretical Probability Distributions Variable - Measured/Categorized characteristic Random Variable (R.V.) X Assumes values (x) by chance Discrete R.V.

More information

Continuous random variables

Continuous random variables Continuous random variables Can take on an uncountably infinite number of values Any value within an interval over which the variable is definied has some probability of occuring This is different from

More information

Random variables. DS GA 1002 Probability and Statistics for Data Science.

Random variables. DS GA 1002 Probability and Statistics for Data Science. Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities

More information

Probability and Statistics Concepts

Probability and Statistics Concepts University of Central Florida Computer Science Division COT 5611 - Operating Systems. Spring 014 - dcm Probability and Statistics Concepts Random Variable: a rule that assigns a numerical value to each

More information

Random variables, Expectation, Mean and Variance. Slides are adapted from STAT414 course at PennState

Random variables, Expectation, Mean and Variance. Slides are adapted from STAT414 course at PennState Random variables, Expectation, Mean and Variance Slides are adapted from STAT414 course at PennState https://onlinecourses.science.psu.edu/stat414/ Random variable Definition. Given a random experiment

More information

Relationship between probability set function and random variable - 2 -

Relationship between probability set function and random variable - 2 - 2.0 Random Variables A rat is selected at random from a cage and its sex is determined. The set of possible outcomes is female and male. Thus outcome space is S = {female, male} = {F, M}. If we let X be

More information

Discrete Probability Distributions

Discrete Probability Distributions Discrete Probability Distributions EGR 260 R. Van Til Industrial & Systems Engineering Dept. Copyright 2013. Robert P. Van Til. All rights reserved. 1 What s It All About? The behavior of many random processes

More information

Chapter 3: Discrete Random Variable

Chapter 3: Discrete Random Variable Chapter 3: Discrete Random Variable Shiwen Shen University of South Carolina 2017 Summer 1 / 63 Random Variable Definition: A random variable is a function from a sample space S into the real numbers.

More information

Statistical Methods in Particle Physics

Statistical Methods in Particle Physics Statistical Methods in Particle Physics Lecture 3 October 29, 2012 Silvia Masciocchi, GSI Darmstadt s.masciocchi@gsi.de Winter Semester 2012 / 13 Outline Reminder: Probability density function Cumulative

More information

1.6 Families of Distributions

1.6 Families of Distributions Your text 1.6. FAMILIES OF DISTRIBUTIONS 15 F(x) 0.20 1.0 0.15 0.8 0.6 Density 0.10 cdf 0.4 0.05 0.2 0.00 a b c 0.0 x Figure 1.1: N(4.5, 2) Distribution Function and Cumulative Distribution Function for

More information

Chapter 1. Sets and probability. 1.3 Probability space

Chapter 1. Sets and probability. 1.3 Probability space Random processes - Chapter 1. Sets and probability 1 Random processes Chapter 1. Sets and probability 1.3 Probability space 1.3 Probability space Random processes - Chapter 1. Sets and probability 2 Probability

More information

Chapter 5 continued. Chapter 5 sections

Chapter 5 continued. Chapter 5 sections Chapter 5 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions

More information

Continuous Probability Distributions

Continuous Probability Distributions 1 Chapter 5 Continuous Probability Distributions 5.1 Probability density function Example 5.1.1. Revisit Example 3.1.1. 11 12 13 14 15 16 21 22 23 24 25 26 S = 31 32 33 34 35 36 41 42 43 44 45 46 (5.1.1)

More information

Chapter 3 Single Random Variables and Probability Distributions (Part 1)

Chapter 3 Single Random Variables and Probability Distributions (Part 1) Chapter 3 Single Random Variables and Probability Distributions (Part 1) Contents What is a Random Variable? Probability Distribution Functions Cumulative Distribution Function Probability Density Function

More information

Moment Generating Functions

Moment Generating Functions MATH 382 Moment Generating Functions Dr. Neal, WKU Definition. Let X be a random variable. The moment generating function (mgf) of X is the function M X : R R given by M X (t ) = E[e X t ], defined for

More information

ECE 313 Probability with Engineering Applications Fall 2000

ECE 313 Probability with Engineering Applications Fall 2000 Exponential random variables Exponential random variables arise in studies of waiting times, service times, etc X is called an exponential random variable with parameter λ if its pdf is given by f(u) =

More information

Continuous-Valued Probability Review

Continuous-Valued Probability Review CS 6323 Continuous-Valued Probability Review Prof. Gregory Provan Department of Computer Science University College Cork 2 Overview Review of discrete distributions Continuous distributions 3 Discrete

More information

57:022 Principles of Design II Final Exam Solutions - Spring 1997

57:022 Principles of Design II Final Exam Solutions - Spring 1997 57:022 Principles of Design II Final Exam Solutions - Spring 1997 Part: I II III IV V VI Total Possible Pts: 52 10 12 16 13 12 115 PART ONE Indicate "+" if True and "o" if False: + a. If a component's

More information