A Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.

Similar documents
Review of Probability. CS1538: Introduction to Simulations

Counting principles, including permutations and combinations.

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models

Probability and Probability Distributions. Dr. Mohammed Alahmed

Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com

Special Discrete RV s. Then X = the number of successes is a binomial RV. X ~ Bin(n,p).

Discrete Random Variables

Guidelines for Solving Probability Problems

Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions

Copyright c 2006 Jason Underdown Some rights reserved. choose notation. n distinct items divided into r distinct groups.

Northwestern University Department of Electrical Engineering and Computer Science

Slides 8: Statistical Models in Simulation

Decision making and problem solving Lecture 1. Review of basic probability Monte Carlo simulation

Review of Probabilities and Basic Statistics

Why study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables

Relationship between probability set function and random variable - 2 -

Chapter 4. Probability-The Study of Randomness

Supratim Ray

Examples of random experiment (a) Random experiment BASIC EXPERIMENT

Introduction to Probability and Statistics Slides 3 Chapter 3

Chapter 7: Theoretical Probability Distributions Variable - Measured/Categorized characteristic

Bernoulli Trials, Binomial and Cumulative Distributions

Introduction to Probability and Stocastic Processes - Part I

Single Maths B: Introduction to Probability

Probability and Stochastic Processes: A Friendly Introduction for Electrical and Computer Engineers Roy D. Yates and David J.

Stochastic Processes - lesson 2

To find the median, find the 40 th quartile and the 70 th quartile (which are easily found at y=1 and y=2, respectively). Then we interpolate:

Math Review Sheet, Fall 2008

What is Probability? Probability. Sample Spaces and Events. Simple Event

Lecture 4: Random Variables and Distributions

Binomial and Poisson Probability Distributions

Lecture 2: Repetition of probability theory and statistics

MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems

Deep Learning for Computer Vision

Lecture 6. Probability events. Definition 1. The sample space, S, of a. probability experiment is the collection of all

Chapter 1: Revie of Calculus and Probability

Stochastic Models of Manufacturing Systems

Introduction to Statistical Data Analysis Lecture 3: Probability Distributions

EE 445 / 850: Final Examination

Lecture 10: Probability distributions TUESDAY, FEBRUARY 19, 2019

Topic 2: Probability & Distributions. Road Map Probability & Distributions. ECO220Y5Y: Quantitative Methods in Economics. Dr.

The Binomial distribution. Probability theory 2. Example. The Binomial distribution

Probability Review. Yutian Li. January 18, Stanford University. Yutian Li (Stanford University) Probability Review January 18, / 27

3.4. The Binomial Probability Distribution

STAT 3610: Review of Probability Distributions

Making Hard Decision. Probability Basics. ENCE 627 Decision Analysis for Engineering

Statistics for Managers Using Microsoft Excel (3 rd Edition)

Exam 3, Math Fall 2016 October 19, 2016

Set Notation and Axioms of Probability NOT NOT X = X = X'' = X

STAT/MATH 395 PROBABILITY II

Math 151. Rumbos Fall Solutions to Review Problems for Exam 2. Pr(X = 1) = ) = Pr(X = 2) = Pr(X = 3) = p X. (k) =

Random Variables and Their Distributions

Discrete Probability Distributions

Probability Distributions

Recitation 2: Probability

Continuous Probability Distributions. Uniform Distribution

ECE 313 Probability with Engineering Applications Fall 2000

Chapter 2: The Random Variable

Continuous Random Variables and Continuous Distributions

Bandits, Experts, and Games

The enumeration of all possible outcomes of an experiment is called the sample space, denoted S. E.g.: S={head, tail}

Dr. Junchao Xia Center of Biophysics and Computational Biology. Fall /13/2016 1/33

ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables

STAT/MATH 395 A - PROBABILITY II UW Winter Quarter Moment functions. x r p X (x) (1) E[X r ] = x r f X (x) dx (2) (x E[X]) r p X (x) (3)

There are two basic kinds of random variables continuous and discrete.

Discrete Distributions

Probability. Lecture Notes. Adolfo J. Rumbos

Dept. of Linguistics, Indiana University Fall 2015

Computer Science, Informatik 4 Communication and Distributed Systems. Simulation. Discrete-Event System Simulation. Dr.

M378K In-Class Assignment #1

STAT509: Discrete Random Variable

Quick review on Discrete Random Variables

Topic 3 - Discrete distributions

INF FALL NATURAL LANGUAGE PROCESSING. Jan Tore Lønning

Given a experiment with outcomes in sample space: Ω Probability measure applied to subsets of Ω: P[A] 0 P[A B] = P[A] + P[B] P[AB] = P(AB)

Bivariate distributions

Discrete Random Variables

Continuous r.v. s: cdf s, Expected Values

1. Exercise on Page 8: 2. Exercise on Page 8: (b)c 1 (C 2 C 3 ) and (C 1 C 2 ) (C 1 C 3 ) (C 1 C 2 ) (C 2 C 3 ) Problem Set 1 Fall 2017

Random Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay

Chapter 2: Discrete Distributions. 2.1 Random Variables of the Discrete Type

ACM 116: Lecture 2. Agenda. Independence. Bayes rule. Discrete random variables Bernoulli distribution Binomial distribution

ECE 302: Probabilistic Methods in Electrical Engineering

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models

Distributions of Functions of Random Variables. 5.1 Functions of One Random Variable

CDA5530: Performance Models of Computers and Networks. Chapter 2: Review of Practical Random Variables

RELIABILITY AND SIX SIGMA - PROBABILITIC MODELS

CIVL Continuous Distributions

Probability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008

Quick Tour of Basic Probability Theory and Linear Algebra

15 Discrete Distributions

p. 6-1 Continuous Random Variables p. 6-2

Outline PMF, CDF and PDF Mean, Variance and Percentiles Some Common Distributions. Week 5 Random Variables and Their Distributions

EXAM. Exam #1. Math 3342 Summer II, July 21, 2000 ANSWERS

Structural Reliability

Probability. Paul Schrimpf. January 23, UBC Economics 326. Probability. Paul Schrimpf. Definitions. Properties. Random variables.

EE 345 MIDTERM 2 Fall 2018 (Time: 1 hour 15 minutes) Total of 100 points

Continuous Distributions

Probability and Distributions

Lecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable

Transcription:

A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards??

Random Events A random event, E, will occur with some probability denoted by P(E) where 0 < P(E) < 1. P(E) = 0 describes an impossible event while P(E) = 1 denotes a certain event. The collection of all possible outcomes (events) relative to a random process is called the sample space, S where S = {E 1, E 2... E k } and P(S) = 1. Probability review 2

Complementary Events, Unions and Intersections of Events Let A = the event, the failure of component 1, B = the event, the failure of component 2. Then A B = the event, both components have failed, B = the event, component 1 did not fail and component 2 failed, A c A c B = the event, component 1 did not fail or component 2 failed. Probability review 3

P(A c ) = 1 - P(A) Probability of Complementary Events, Unions and Intersections of Events P( A B) = P(A) + P(B) if A and B are mutually exclusive P(A B) = 0 if A and B are mutually exclusive Probability review 4

Independent Events Two events A and B are independent if and only if P(A B) = P(A) P(B) Example: Let A = failure of component 1 and B = failure of component 2; where P(A) =.1 and P(B) =.2 Then P(A B) = (.1) (.2) =.02 is the probability both components fail. Probability review 5

Conditional Probability If two events are dependent, then the occurrence of one event changes the probability of the other event. Define the conditional probability: P(A B) = P(A B) / P(B) Then P(A B) = P(A B) P(B) Probability review 6

Conditional Probability Example - load sharing system Two components share a common load. If one component fails, the probability the other component will fail increases. Let A = the event, component 1 fails B = the event, component 2 fails Given P(A) = P(B) =.10 and P(A B) = P(B A) =.90 Then P(A B) = P(A) P(B A) =.10 (.90) =.09 Probability review 7

Addition Formula P(A B) = P(A) + P(B) - P(A B) = P(A) + P(B) - P(A B) P(B) = P(A) = P(B) - P(A) P(B) if independent A B A B A U B Probability review 8

Addition Formula Example Example: Let A = failure of component 1 and B = failure of component 2; where P(A) =.1 and P(B) =.2 Then the probability at least one component fails is given by: P(A B) =.1 +.2 - (.1) (.2) =.28 assuming independence Probability review 9

Random Variables A random variable is a variable which takes on numerical values in accordance with some probability distribution. Random variables may be either continuous (taking on real numbers) or discrete (usually taking on non-negative integer values). The probability distribution which assigns probabilities to each value of a discrete random variable, or assigns a probability over an interval of values of a continuous random variable, can be described in terms of a probability mass function (PMF), p(x) in the discrete case, and a probability density function (PDF), f(x), in the continuous case. For both discrete and continuous distributions, a cumulative distribution function (CDF), F(x) is defined where P{X< x} = F(x). By convention, capital letters represent the random variable while the corresponding small letters denote particular values the random variable may assume. Probability review 10

Random Variables - Examples Let T = a continuous random variable, the time to failure of a component, Y = a discrete random variable, the number of failures occurring in some time t, W = a continuous random variable, the time to repair a failed system, and X = a discrete random variable, the number of cycles until the first failure occurs. Probability review 11

Discrete Distributions Cumulative Distribution Function (CDF) = Fx ( ) = Pr{ X x} p( ξ) x all ξ where p(x) = Pr{X=x} Probability review 12

Discrete Distributions px ( ) = 1 μ = xp x all x σ = ( x μ) p( x) 2 2 all x variance all x mean ( ) Probability review 13

p Binomial Distribution X = a discrete random variable, the number of successes from among n independent trials having a constant probability of success equal to p. X = 0, 1, 2,, n F n ( x ) = H G I p ( p ) x K J 1 p x = prob of x successes x n x (1-p) n-x = prob of n-x non-successes F HG n I K J = x n! x!( n x)! = number of ways of achieving x successes Probability review 14

Binomial Distribution Example Let X = a discrete random variable, the number of failed components among 5 independent and identical components where each component has one chance in 100 of failing. 5 x p( x). 01 (. 99 5 ) x = F H G I K J E(X) = np = 5 (.01) =.05 and Var(x) = np(1-p) = 5 (.01) (.99) =.0495 Pr{X<=1} = p(0) + p(1) =.99 5 + 5(.01)(.99 4 ) =.999 x Probability review 15

Poisson Distribution X = a discrete random variable, the number of random occurrences (events) in a specified time. X = 0, 1, 2, p( x) = e λ λ x x! μ = E( X) = Var( X) = λ Probability review 16

Poisson Distribution Let X = a discrete random variable, the number of failures and subsequent repairs of a restorable system over a one year period. Assuming X has a Poison distribution with a mean of 2 failures per year, then the probability of no more than one failure a year is 1 2 x e 2 P{ X 1} = F( 1) = =. 406 x! x= 0 Probability review 17

1. 0 < F(x) < 1 2. P{X< x} = F(x) = 3. f ( x) dx = 1 Continuous Distributions 4. P{a < X < b} = f ( xdx ) = F(b) - F(a) 5. z μ = x f ( xdx ) b a x f ( ξ ) dξ Probability review 18