Decision making and problem solving Lecture 1. Review of basic probability Monte Carlo simulation
|
|
- Lorraine Hines
- 5 years ago
- Views:
Transcription
1 Decision making and problem solving Lecture 1 Review of basic probability Monte Carlo simulation
2 Why probabilities? Most decisions involve uncertainties Probability theory provides a rigorous framework for modeling uncertainties in decision analysis Sound axiomatic foundation Well established rules for computations Other approaches (e.g., Dempster-Shafer theory, fuzzy sets) are not covered Learning objective: refresh memory about probability theory and calculations
3 The sample space Sample space S = set of all possible outcomes Examples: One coin toss: S = {H,T} Two coin tosses: S = {HH, TT, TH, HT} Number of rainy days in Helsinki in 2016: S = {1,,366} Grades from four courses: S = G G G G = G 4, where G = {0,,5} Average m 2 -price for apartments in Helsinki area next year S = [0, )
4 Simple events and events Simple event = An single element (outcome) from the set S A coin toss: T Two coin tosses: TT Number of rainy days in Helsinki in 2016: 180 Grades from four courses: (4, 5, 3, 4) Average m 2 -price for apartments in Helsinki in 2017: 3800 Event = A collection of one or more outcomes (a subset of the sample space: E S) Two coin tosses: First toss tails, E={TT, TH} Number of rainy days in Helsinki in 2017: Less than 100, E={0,,99} Grades from four courses: Average at least 4.0, E = z G i=1 z i 4.0 Avg m 2 -price for apartments in Helsinki in 2017: Above 4000, E=(4000, )
5 Events derived from events: Complement, union, and intersection Complement A c of A = all outcomes in S that are not in A Union A B of two events A and B = all outcomes that are in A or B (or both) S A B Intersection A B = all outcomes that are in A and B A and B with no common outcomes are mutually exclusive A and B are collectively exhaustive if A B=S
6 Events derived from events: Laws of set algebra Commutative laws: A B = B A, A B = B A Associative laws: (A B) C= A (B C), (A B) C= A (B C), Distributive laws: (A B) C=(A C) (B C), (A B) C= (A C) (B C) DeMorgan s laws: (A B) c =A c B c, (A B) c = A c B c Validate these laws graphically! S A C B
7 Probability measure Definition: Probability P is a function that maps all events A onto real numbers and satisfies the following three axioms: 1. P(S)= P(A) 1 3. If A and B are mutually exclusive (i.e., A B= ) then P(A B)=P(A)+P(B)
8 Properties of probability From the three axioms it follows that I. P( )=0 S II. If A B, then P(A) P(B) Young Young and restless Restless III. IV. P(A c )=1-P(A) P(A B)=P(A)+P(B)-P(A B) Neither young nor restless In a given population, 30% of people are young, 15% are restless, and 7% are both young and restless. A person is randomly selected from this population. What is the chance that this person is Not young? 1. 30% 2. 55% 3. 70% Young but not restless? 1. 7% 2. 15% 3. 23% Either young or restless? 1. 38% 2. 45% 3. 62%
9 Independence Definition: Two events A and B are independent if P(A B)=P(A)P(B) A person is randomly selected from the entire population S S Are the events the person is young and the person is restless independent? Neither young nor restless Young (30%) Young and restless (7%) Restless (15%)
10 Conditional probability Definition: The conditional probability P(A B) of A given that B has occurred is P A B P A B. P B Note: If A and B are independent, the probability of A does not depend on whether B has occurred or not: P A B = P(A B) P(B) = P A P(B) P(B) = P A. Source: Wikipedia
11 Joint probability vs. conditional probability Example: A farmer is about to choose a farming strategy for next year. Experts have provided the following demand forecasts for the farmer s products. Questions: What is the probability of high wheat demand? 1. 40% 2. 65% % What is the probability of low rye demand? 1. 11% 2. 35% 3. 45% What is the conditional probability of high wheat demand, if rye demand is low? 1. 40% 2. 55% 3. 89% Are the demands independent? 1. Yes 2. No Joint probability Wheat demand Rye demand Low High Sum Low High Sum Conditional probability Wheat demand Rye demand Low High Sum Low High
12 Law of total probability If events E 1,.,E n are mutually exclusive and collectively exhaustive, then P(A)=P(A E 1 )P(E 1 )+ +P(A E n )P(E n ) Most frequent use of this law: Probabilities P(A B), P(A B c ), and P(B) are known These can be used to compute P(A)=P(A B)P(B)+P(A B c )P(B c )
13 Bayes rule Bayes rule: P A B = P(B A)P(A) P(B) Follows from 1. The definition of conditional probability: P A B = P(A B) P(B), P B A = P(B A) P(A), 2. Commutative laws: P B A = P A B.
14 Bayes rule Example: The probability of a fire in a certain building is 1/ any given day. An alarm goes off whenever there is a fire, but also once in every 200 days for no reason. Suppose the alarm goes off. What is the probability that there is a fire? Solution: F=Fire, F c =No fire, A=Alarm, A c =No alarm P(F)=0.0001, P(F c )=0.9999, P(A F)=1, P(A F c )=0.005 Bayes: P F A = P(A F)P(F) P(A) = % Law of total probability: P(A)=P(A F)P(F)+P(A F c ) P(F c )= When deciding whether to evacuate in case of an alarm, is the probability of an actual fire the only thing you consider?
15 Random variables A random variable is a mapping from sample space S to real numbers (discrete or continuous scale) The probability measure P on the sample space defines a probability distribution for these real numbers Probability distribution can be represented by Probability mass (discr.) / density (cont.) function Cumulative distribution function
16 Probability mass/density function (PMF & PDF) PMF of a discrete random variable is f X (t) such that f X (t)=p({s S X(s)=t}) = probability t (a,b] f X t = P(X (a, b]) = probability PDF of a continuous random variable is f X (t) such that f X (t) is NOT a probability a b fx t dt = P X a, b = probability f X (t) f X (t) t X~N( ) X~Bin(5,0.3) a b t
17 Cumulative distribution function (CDF) The CDF of random variable X is F X t = P s S X(s) t (often F t = P(X t)) F X (t) Properties F X is non-decreasing F X (t) approaches 0 (respectively 1) when t decreases (resp. increases) P(X>t)=1-F X (t) P(a<X b)= F X (b)- F X (a) F X (t) t a b t
18 Expected value The expected value of a random variable is the weighted average of all possible values, where the weights represent probability mass / density at these values Discrete X E X = tf X (t) t Continuous X E X = tf X t dt A function g(x) of random varibale X is itself a random variable, whereby E g(x) = g(t)f X (t) E g(x) = t g(t)f X t dt
19 Expected value: Properties If X 1,, X n and Y = n i=1 X i are random variables, then E Y = n i=1 E[X i ] If r.v. Y=aX+b where a and b are constants, then E Y = ae X + b NB! In general, E[g(X)]=g(E[X]) does not hold: Let X {0,1} with P(X=1)=0.7. Then, E X = = 0.7, E X 2 = = = (E X )
20 Random variables vs. sample space Models are often built by directly defining distributions (PDF/PMF or CDF) rather than starting with the sample space Cf. Alternative models for coin toss: 1. Sample space is S={H,T} and its probability measure P(s)=0.5 for all s S 2. PMF is given by f X (t)=0.5, t {0,1} and f X (t)=0 elsewhere Computational rules that apply to event probabilities also apply when these probabilities are represented by distributions Detailed descriptions about the properties and common uses of different kinds of discrete and continuous distributions are widely documented Elementary statistics books Wikipedia
21 Binomial distribution n independent binary (0/1, no/yes) trials, each with success probability p=p(x=1) The number X ~ Bin(n,p) of successful trials is a random variable that follows the binomial distribution with parameters n and p PMF: P X = t = f X t = n t pt (1 p) n t Expected value E[X]=np Variance Var[X]=np(1-p) Source: Wikipedia
22 Other common discrete distributions Bernoulli distribution If X {0,1} is the result of a single binary trial with success probability p, then X~Bernoulli(p). f X t = p t (1 p) 1 t, t {0,1} Geometric distribution If X {1,2,3, } is the number of Bernoulli trials needed to get the first success, then X~Geom(p). f X t = p(1 p) t 1, t {1,2,3, } Poisson distribution Let X {1,2,3, } be the number of times that an event occurs during a fixed time interval such that (i) the average occurence rate is known and (ii) events occur independently of the last event time. Then, X~Poisson( ). f X t = λk e λ k! Source: Wikipedia
23 Uniform distribution Let X [a,b] such that each real value within the interval has equal probability. Then, X~Uni(a,b) f X t = 1 b a E X = a+b 2, for a t b 0, otherwise Var X = 1 (b a)2 12 Source: Wikipedia
24 Normal distribution N(μ, σ 2 ) f X t = 1 e (t μ)2 2σ 2 σ 2π E X = μ, Var X = σ 2 The most common distribution for continuous random variables Central limit theorem: Let X 1,,X n be independent and identically distributed random variables with E[X i ]= μ and Var[X i ]=σ 2. Then, i=1 n X i n ~ a N μ, σ2 n. Source: Wikipedia
25 Other common continuous distributions Log-normal distribution: if X~N(μ, σ 2 ), then e X ~LogN(μ, σ 2 ) Exponential distribution Exp( ): describes the time between events in a Poisson process with event occurrence rate Beta distribution Beta(α,β): distribution for X [0,1] that can take various forms
26 Why Monte Carlo simulation? When probabilitistic models are used to support decision making, alternative decisions often need to be described by performance indices such as Expected values e.g., expected revenue from launching a new product to the market Probabilities of events e.g., the probability that the revenue is below 100k It may be difficult or impossible to calculate such measures analytically Monte Carlo simulation: Use a computer program to generate samples from the probability model Estimate expected values and event probabilites from these samples
27 Monte Carlo simulation of a probability model Probability model Monte Carlo simulation Random variable X~f X E X E g X P(a < X b) Sample (x 1,,x n ) from f X i=1 n n x i i=1 n g(x i ) n i {1,, n} x i (a, b) n
28 Uni(0,1) distribution in MC discrete random variables Some softwares only generate random numbers from Uni(0,1)-distribution Samples from Uni(0,1) can, however, be transformed into samples from many other distributions Discrete distribution: Let X x 1,, x n such that f X = P X = x i = p i. Divide interval [0,1] into n segments of lengths p 1,, p n. Sample values u j from Uni(0,1). Transform the sample: If u j [ i 1 i k=0 p k, k=0 p k ) where p 0 = 0, then X j = x i. U~Uni(0,1) u 1 = u 2 = u 3 = X=3 X=2 X=1 X=0 X~f X x 1 = 1 x 2 = 2 x 3 = 1 Demand x / week Prob. f X of demand
29 Uni(0,1) distribution in MC continuous random variables Assume that the CDF of r.v. X has an inverse function F X 1. Then, the r.v. Y = F X 1 (U) where U~Uni(0,1) follows the same distribution as X: F Y t = P Y t = P F X 1 (U) t = P U F X t = F X t Continuous distribution: Let X~F X (CDF) Sample values u j from Uni(0,1) Transform the sample: X j = F X 1 (u j ) U~Uni(0,1) u 1 = u 2 = u 3 = X~f X x 1 = x 2 = x 3 = F -1 X (u) f X =N(1000,500 2 ) u
30 Monte Carlo simulation in Excel VLOOKUP looks for the cell value in the 1st column of the table. The value in the 3rd column of the table is returned to the current cell. STDEV.S(E8:E207) AVERAGE(H7:H206) RAND() generates a random number from Uni(0,1)
31 Monte Carlo simulation in Matlab
32 Monte Carlo simulation in Matlab Statistics and Machine Learning Toolbox makes it easy to generate numbers from various distributions E.g., Y=normrnd(mu,sigma,m,n): m n-array of X~N(mu,sigma) Y=betarnd(A,B,m,n) : m n-array of X~Beta(A,B) Y=lognrnd(mu,sigma,m,n) : m n-array of X~LogN(mu,sigma) Y=binornd(N,P,m,n) : m n-array of X~Bin(N,P)
33 Summary Probability theory is this the dominant way of capturing uncertainty in decision models There are well-established computational rules for deriving the probabilities of events from those of simple events Conditional probability, law of total probability, Bayes rule To support decision making, probabilistic models are often used to compute performance measures (expected values, probabilities of events) Such measures can easily be computed through Monte Carlo simulation
A Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.
A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,
More informationDecision making and problem solving Lecture 1
Decision making and problem solving Lecture 1 Review of basic probability Monte Carlo simulation Liesiö, Punkka, Salo, Vilkkumaa Why probabilities? q Decisions are often made under uncertainty q How many
More informationSTAT 302 Introduction to Probability Learning Outcomes. Textbook: A First Course in Probability by Sheldon Ross, 8 th ed.
STAT 302 Introduction to Probability Learning Outcomes Textbook: A First Course in Probability by Sheldon Ross, 8 th ed. Chapter 1: Combinatorial Analysis Demonstrate the ability to solve combinatorial
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationReview of Probabilities and Basic Statistics
Alex Smola Barnabas Poczos TA: Ina Fiterau 4 th year PhD student MLD Review of Probabilities and Basic Statistics 10-701 Recitations 1/25/2013 Recitation 1: Statistics Intro 1 Overview Introduction to
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationBandits, Experts, and Games
Bandits, Experts, and Games CMSC 858G Fall 2016 University of Maryland Intro to Probability* Alex Slivkins Microsoft Research NYC * Many of the slides adopted from Ron Jin and Mohammad Hajiaghayi Outline
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationRelationship between probability set function and random variable - 2 -
2.0 Random Variables A rat is selected at random from a cage and its sex is determined. The set of possible outcomes is female and male. Thus outcome space is S = {female, male} = {F, M}. If we let X be
More informationLecture 2: Probability and Distributions
Lecture 2: Probability and Distributions Ani Manichaikul amanicha@jhsph.edu 17 April 2007 1 / 65 Probability: Why do we care? Probability helps us by: Allowing us to translate scientific questions info
More informationDiscrete Random Variables
CPSC 53 Systems Modeling and Simulation Discrete Random Variables Dr. Anirban Mahanti Department of Computer Science University of Calgary mahanti@cpsc.ucalgary.ca Random Variables A random variable is
More informationProbability: Why do we care? Lecture 2: Probability and Distributions. Classical Definition. What is Probability?
Probability: Why do we care? Lecture 2: Probability and Distributions Sandy Eckel seckel@jhsph.edu 22 April 2008 Probability helps us by: Allowing us to translate scientific questions into mathematical
More informationLecture 16. Lectures 1-15 Review
18.440: Lecture 16 Lectures 1-15 Review Scott Sheffield MIT 1 Outline Counting tricks and basic principles of probability Discrete random variables 2 Outline Counting tricks and basic principles of probability
More informationProbability Theory for Machine Learning. Chris Cremer September 2015
Probability Theory for Machine Learning Chris Cremer September 2015 Outline Motivation Probability Definitions and Rules Probability Distributions MLE for Gaussian Parameter Estimation MLE and Least Squares
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationProbability Distributions
Probability Distributions Series of events Previously we have been discussing the probabilities associated with a single event: Observing a 1 on a single roll of a die Observing a K with a single card
More informationProbability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008
Probability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008 1 Review We saw some basic metrics that helped us characterize
More informationRecap. The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY INFERENTIAL STATISTICS
Recap. Probability (section 1.1) The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY Population Sample INFERENTIAL STATISTICS Today. Formulation
More informationAarti Singh. Lecture 2, January 13, Reading: Bishop: Chap 1,2. Slides courtesy: Eric Xing, Andrew Moore, Tom Mitchell
Machine Learning 0-70/5 70/5-78, 78, Spring 00 Probability 0 Aarti Singh Lecture, January 3, 00 f(x) µ x Reading: Bishop: Chap, Slides courtesy: Eric Xing, Andrew Moore, Tom Mitchell Announcements Homework
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationSingle Maths B: Introduction to Probability
Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction
More informationStochastic Models of Manufacturing Systems
Stochastic Models of Manufacturing Systems Ivo Adan Organization 2/47 7 lectures (lecture of May 12 is canceled) Studyguide available (with notes, slides, assignments, references), see http://www.win.tue.nl/
More informationMaking Hard Decision. Probability Basics. ENCE 627 Decision Analysis for Engineering
CHAPTER Duxbury Thomson Learning Making Hard Decision Probability asics Third Edition A. J. Clark School of Engineering Department of Civil and Environmental Engineering 7b FALL 003 y Dr. Ibrahim. Assakkaf
More informationProbability. Lecture Notes. Adolfo J. Rumbos
Probability Lecture Notes Adolfo J. Rumbos October 20, 204 2 Contents Introduction 5. An example from statistical inference................ 5 2 Probability Spaces 9 2. Sample Spaces and σ fields.....................
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationBinomial and Poisson Probability Distributions
Binomial and Poisson Probability Distributions Esra Akdeniz March 3, 2016 Bernoulli Random Variable Any random variable whose only possible values are 0 or 1 is called a Bernoulli random variable. What
More informationFundamental Tools - Probability Theory II
Fundamental Tools - Probability Theory II MSc Financial Mathematics The University of Warwick September 29, 2015 MSc Financial Mathematics Fundamental Tools - Probability Theory II 1 / 22 Measurable random
More informationChapter 2 Random Variables
Stochastic Processes Chapter 2 Random Variables Prof. Jernan Juang Dept. of Engineering Science National Cheng Kung University Prof. Chun-Hung Liu Dept. of Electrical and Computer Eng. National Chiao Tung
More informationPart IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationAxioms of Probability
Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing
More informationPROBABILITY AND INFORMATION THEORY. Dr. Gjergji Kasneci Introduction to Information Retrieval WS
PROBABILITY AND INFORMATION THEORY Dr. Gjergji Kasneci Introduction to Information Retrieval WS 2012-13 1 Outline Intro Basics of probability and information theory Probability space Rules of probability
More informationWhy study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables
ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section
More informationProbability Review. Gonzalo Mateos
Probability Review Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ September 11, 2018 Introduction
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationRandom Variables. Definition: A random variable (r.v.) X on the probability space (Ω, F, P) is a mapping
Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationReview Basic Probability Concept
Economic Risk and Decision Analysis for Oil and Gas Industry CE81.9008 School of Engineering and Technology Asian Institute of Technology January Semester Presented by Dr. Thitisak Boonpramote Department
More informationCIVL Why are we studying probability and statistics? Learning Objectives. Basic Laws and Axioms of Probability
CIVL 3103 Basic Laws and Axioms of Probability Why are we studying probability and statistics? How can we quantify risks of decisions based on samples from a population? How should samples be selected
More informationBasics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationLearning Objectives for Stat 225
Learning Objectives for Stat 225 08/20/12 Introduction to Probability: Get some general ideas about probability, and learn how to use sample space to compute the probability of a specific event. Set Theory:
More informationData Modeling & Analysis Techniques. Probability & Statistics. Manfred Huber
Data Modeling & Analysis Techniques Probability & Statistics Manfred Huber 2017 1 Probability and Statistics Probability and statistics are often used interchangeably but are different, related fields
More informationInformation Science 2
Information Science 2 Probability Theory: An Overview Week 12 College of Information Science and Engineering Ritsumeikan University Agenda Terms and concepts from Week 11 Basic concepts of probability
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More informationChapter 7: Theoretical Probability Distributions Variable - Measured/Categorized characteristic
BSTT523: Pagano & Gavreau, Chapter 7 1 Chapter 7: Theoretical Probability Distributions Variable - Measured/Categorized characteristic Random Variable (R.V.) X Assumes values (x) by chance Discrete R.V.
More information1.1 Review of Probability Theory
1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationProbability and Probability Distributions. Dr. Mohammed Alahmed
Probability and Probability Distributions 1 Probability and Probability Distributions Usually we want to do more with data than just describing them! We might want to test certain specific inferences about
More informationCS626 Data Analysis and Simulation
CS626 Data Analysis and Simulation Instructor: Peter Kemper R 104A, phone 221-3462, email:kemper@cs.wm.edu Today: Probability Primer Quick Reference: Sheldon Ross: Introduction to Probability Models 9th
More informationSystem Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models
System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models Fatih Cavdur fatihcavdur@uludag.edu.tr March 20, 2012 Introduction Introduction The world of the model-builder
More informationM378K In-Class Assignment #1
The following problems are a review of M6K. M7K In-Class Assignment # Problem.. Complete the definition of mutual exclusivity of events below: Events A, B Ω are said to be mutually exclusive if A B =.
More informationIntroduction to Stochastic Processes
Stat251/551 (Spring 2017) Stochastic Processes Lecture: 1 Introduction to Stochastic Processes Lecturer: Sahand Negahban Scribe: Sahand Negahban 1 Organization Issues We will use canvas as the course webpage.
More informationSupratim Ray
Supratim Ray sray@cns.iisc.ernet.in Biophysics of Action Potentials Passive Properties neuron as an electrical circuit Passive Signaling cable theory Active properties generation of action potential Techniques
More informationRandom Signals and Systems. Chapter 1. Jitendra K Tugnait. Department of Electrical & Computer Engineering. James B Davis Professor.
Random Signals and Systems Chapter 1 Jitendra K Tugnait James B Davis Professor Department of Electrical & Computer Engineering Auburn University 2 3 Descriptions of Probability Relative frequency approach»
More informationCounting principles, including permutations and combinations.
1 Counting principles, including permutations and combinations. The binomial theorem: expansion of a + b n, n ε N. THE PRODUCT RULE If there are m different ways of performing an operation and for each
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationChapter 2 Class Notes
Chapter 2 Class Notes Probability can be thought of in many ways, for example as a relative frequency of a long series of trials (e.g. flips of a coin or die) Another approach is to let an expert (such
More informationIntroduction to Probability and Stocastic Processes - Part I
Introduction to Probability and Stocastic Processes - Part I Lecture 1 Henrik Vie Christensen vie@control.auc.dk Department of Control Engineering Institute of Electronic Systems Aalborg University Denmark
More informationAdvanced Herd Management Probabilities and distributions
Advanced Herd Management Probabilities and distributions Anders Ringgaard Kristensen Slide 1 Outline Probabilities Conditional probabilities Bayes theorem Distributions Discrete Continuous Distribution
More informationIntroduction to Probability
Introduction to Probability Gambling at its core 16th century Cardano: Books on Games of Chance First systematic treatment of probability 17th century Chevalier de Mere posed a problem to his friend Pascal.
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More informationExamples of random experiment (a) Random experiment BASIC EXPERIMENT
Random experiment A random experiment is a process leading to an uncertain outcome, before the experiment is run We usually assume that the experiment can be repeated indefinitely under essentially the
More information2011 Pearson Education, Inc
Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive
More informationChapter 1. Sets and probability. 1.3 Probability space
Random processes - Chapter 1. Sets and probability 1 Random processes Chapter 1. Sets and probability 1.3 Probability space 1.3 Probability space Random processes - Chapter 1. Sets and probability 2 Probability
More informationProbability Theory and Simulation Methods
Feb 28th, 2018 Lecture 10: Random variables Countdown to midterm (March 21st): 28 days Week 1 Chapter 1: Axioms of probability Week 2 Chapter 3: Conditional probability and independence Week 4 Chapters
More informationProbability. Machine Learning and Pattern Recognition. Chris Williams. School of Informatics, University of Edinburgh. August 2014
Probability Machine Learning and Pattern Recognition Chris Williams School of Informatics, University of Edinburgh August 2014 (All of the slides in this course have been adapted from previous versions
More informationProbability Theory. Patrick Lam
Probability Theory Patrick Lam Outline Probability Random Variables Simulation Important Distributions Discrete Distributions Continuous Distributions Most Basic Definition of Probability: number of successes
More informationChapter 2. Probability
2-1 Chapter 2 Probability 2-2 Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance with certainty. Examples: rolling a die tossing
More informationProbability theory. References:
Reasoning Under Uncertainty References: Probability theory Mathematical methods in artificial intelligence, Bender, Chapter 7. Expert systems: Principles and programming, g, Giarratano and Riley, pag.
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationChapter 1 (Basic Probability)
Chapter 1 (Basic Probability) What is probability? Consider the following experiments: 1. Count the number of arrival requests to a web server in a day. 2. Determine the execution time of a program. 3.
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions
Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions 1999 Prentice-Hall, Inc. Chap. 4-1 Chapter Topics Basic Probability Concepts: Sample
More informationCIVL 7012/8012. Basic Laws and Axioms of Probability
CIVL 7012/8012 Basic Laws and Axioms of Probability Why are we studying probability and statistics? How can we quantify risks of decisions based on samples from a population? How should samples be selected
More informationIntroduction to Machine Learning
Introduction to Machine Learning Introduction to Probabilistic Methods Varun Chandola Computer Science & Engineering State University of New York at Buffalo Buffalo, NY, USA chandola@buffalo.edu Chandola@UB
More informationBrief Review of Probability
Brief Review of Probability Nuno Vasconcelos (Ken Kreutz-Delgado) ECE Department, UCSD Probability Probability theory is a mathematical language to deal with processes or experiments that are non-deterministic
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationPart (A): Review of Probability [Statistics I revision]
Part (A): Review of Probability [Statistics I revision] 1 Definition of Probability 1.1 Experiment An experiment is any procedure whose outcome is uncertain ffl toss a coin ffl throw a die ffl buy a lottery
More informationLecture 1: Basics of Probability
Lecture 1: Basics of Probability (Luise-Vitetta, Chapter 8) Why probability in data science? Data acquisition is noisy Sampling/quantization external factors: If you record your voice saying machine learning
More information9/6/2016. Section 5.1 Probability. Equally Likely Model. The Division Rule: P(A)=#(A)/#(S) Some Popular Randomizers.
Chapter 5: Probability and Discrete Probability Distribution Learn. Probability Binomial Distribution Poisson Distribution Some Popular Randomizers Rolling dice Spinning a wheel Flipping a coin Drawing
More informationLecture 10: Probability distributions TUESDAY, FEBRUARY 19, 2019
Lecture 10: Probability distributions DANIEL WELLER TUESDAY, FEBRUARY 19, 2019 Agenda What is probability? (again) Describing probabilities (distributions) Understanding probabilities (expectation) Partial
More informationG.PULLAIAH COLLEGE OF ENGINEERING & TECHNOLOGY DEPARTMENT OF ELECTRONICS & COMMUNICATION ENGINEERING PROBABILITY THEORY & STOCHASTIC PROCESSES
G.PULLAIAH COLLEGE OF ENGINEERING & TECHNOLOGY DEPARTMENT OF ELECTRONICS & COMMUNICATION ENGINEERING PROBABILITY THEORY & STOCHASTIC PROCESSES LECTURE NOTES ON PTSP (15A04304) B.TECH ECE II YEAR I SEMESTER
More informationp. 4-1 Random Variables
Random Variables A Motivating Example Experiment: Sample k students without replacement from the population of all n students (labeled as 1, 2,, n, respectively) in our class. = {all combinations} = {{i
More information3. Review of Probability and Statistics
3. Review of Probability and Statistics ECE 830, Spring 2014 Probabilistic models will be used throughout the course to represent noise, errors, and uncertainty in signal processing problems. This lecture
More informationStochastic Models in Computer Science A Tutorial
Stochastic Models in Computer Science A Tutorial Dr. Snehanshu Saha Department of Computer Science PESIT BSC, Bengaluru WCI 2015 - August 10 to August 13 1 Introduction 2 Random Variable 3 Introduction
More informationLecture 10: Bayes' Theorem, Expected Value and Variance Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 10: Bayes' Theorem, Expected Value and Variance Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationStatistics for Business and Economics
Statistics for Business and Economics Basic Probability Learning Objectives In this lecture(s), you learn: Basic probability concepts Conditional probability To use Bayes Theorem to revise probabilities
More information(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3)
3 Probability Distributions (Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3) Probability Distribution Functions Probability distribution function (pdf): Function for mapping random variables to real numbers. Discrete
More informationTopic 3: The Expectation of a Random Variable
Topic 3: The Expectation of a Random Variable Course 003, 2017 Page 0 Expectation of a discrete random variable Definition (Expectation of a discrete r.v.): The expected value (also called the expectation
More informationBasic Probability and Information Theory: quick revision
Basic Probability and Information Theory: quick revision ML for NLP Lecturer: S Luz http://www.scss.tcd.ie/~luzs/t/cs4ll4/ February 17, 2015 In these notes we review the basics of probability theory and
More informationProbability. Paul Schrimpf. January 23, Definitions 2. 2 Properties 3
Probability Paul Schrimpf January 23, 2018 Contents 1 Definitions 2 2 Properties 3 3 Random variables 4 3.1 Discrete........................................... 4 3.2 Continuous.........................................
More informationChapter 1: Revie of Calculus and Probability
Chapter 1: Revie of Calculus and Probability Refer to Text Book: Operations Research: Applications and Algorithms By Wayne L. Winston,Ch. 12 Operations Research: An Introduction By Hamdi Taha, Ch. 12 OR441-Dr.Khalid
More informationVenn Diagrams; Probability Laws. Notes. Set Operations and Relations. Venn Diagram 2.1. Venn Diagrams; Probability Laws. Notes
Lecture 2 s; Text: A Course in Probability by Weiss 2.4 STAT 225 Introduction to Probability Models January 8, 2014 s; Whitney Huang Purdue University 2.1 Agenda s; 1 2 2.2 Intersection: the intersection
More informationProbability, Random Processes and Inference
INSTITUTO POLITÉCNICO NACIONAL CENTRO DE INVESTIGACION EN COMPUTACION Laboratorio de Ciberseguridad Probability, Random Processes and Inference Dr. Ponciano Jorge Escamilla Ambrosio pescamilla@cic.ipn.mx
More informationChapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University
Chapter 3, 4 Random Variables ENCS6161 - Probability and Stochastic Processes Concordia University ENCS6161 p.1/47 The Notion of a Random Variable A random variable X is a function that assigns a real
More informationDiscrete Probability Distributions
Discrete Probability Distributions EGR 260 R. Van Til Industrial & Systems Engineering Dept. Copyright 2013. Robert P. Van Til. All rights reserved. 1 What s It All About? The behavior of many random processes
More informationLecture 13. Poisson Distribution. Text: A Course in Probability by Weiss 5.5. STAT 225 Introduction to Probability Models February 16, 2014
Lecture 13 Text: A Course in Probability by Weiss 5.5 STAT 225 Introduction to Probability Models February 16, 2014 Whitney Huang Purdue University 13.1 Agenda 1 2 3 13.2 Review So far, we have seen discrete
More informationCopyright c 2006 Jason Underdown Some rights reserved. choose notation. n distinct items divided into r distinct groups.
Copyright & License Copyright c 2006 Jason Underdown Some rights reserved. choose notation binomial theorem n distinct items divided into r distinct groups Axioms Proposition axioms of probability probability
More information