Random Models. Tusheng Zhang. February 14, 2013
|
|
- Damon Hill
- 6 years ago
- Views:
Transcription
1 Random Models Tusheng Zhang February 14, Introduction In this module, we will introduce some random models which have many real life applications. The course consists of four parts. 1. A brief review of probability theory.. Simple random walks. 3. Branching processes. 5. Renewal processes. Why random? Our life is affected by random variations, uncertainties and unexpected events. For example, the credit crunch, the bank crisis, the earthquake of Haiti, the temperature, the price of a stock, the price of oil and many other quantities are affected by random, unpredictable factors. Meanwhile, these quantities also evolve in time. It is very important to learn how to handle the random variations. This is the aim of this and many other probability courses. The pre-requist for this module are probability I and probability II. To see what kind of problems we are going to treat, let us look at two examples. Example 1.1 A gambler has a capital of He wins/loses 100 with probability 1 or at each bet. What is the probability ( the chance) that the 3 3 gambler eventually is ruined? Example 1. What is the probability that a drunk man (wondering on the street) eventually gets home safely? Example 1.3 Family tree. Suppose that the first generation starts with a couple (of rabbits). For example, we can ask the question: what is the probability that the 10th generation consists of 30 members? What is the probability that the family tree is eventually extinct? A brief review of probability theory. A probability space (Ω, F, P ) consists of three objects. Ω is the sample space made of all possible outcomes; F is the collection of events; P (A) is the probability that the event A can happen. Computation rules: 1
2 1. If A B, P (A) P (B).. Let A c denotes the complement of A. Then P (A c ) 1 P (A). 3. P (A B) P (A) + P (B) P (A B), where A B is the intersection of A and B (both A and B). 1.. Conditional probability The probability of A given that event B has occurred is the called the the conditional probability of A given B defined by P (A B) P (A B) P (B) Consequences. 1. From the definition, P (A B) P (A B)P (B) P (B A)P (A). The law of total probability. Let {B i } i1 be a partition of the sample space Ω, i.e., B i are disjoint and Ω i1b i. Then for any event A it holds that P (A) A i1(a B i ) P (A B i ) P (B i )P (A B i ) i1 i1 Example.1. Suppose that the probability that a man is color-blind is and the probability that a woman is color-blind is Assume that a population is evenly divided by men and women. (1) Find out the probability that a randomly chosen person from the population is color-blind. () Suppose that a person from the population is color-blind. What is the probability that the person is a man? Let Then, C { a person is color-blind} M { a person is a man} W { a person is a woman} P (M) 1, P (W ) 1, P (C M) 0.005, P (C W ) (1). C (C M) (C W )
3 and P (C) P (M)P (C M) + P (W )P (C W ) (). P (M C) P (M C) P (C) P (M)P (C M) P (C) 1.3. Independence If P (A B) P (A), meaning that the probability of A remains the same no matter whether B has occurred or not (i.e., A has nothing to with B), we say that A and B are independent. In this case, P (A B) P (A)P (B) Events A 1, A,..., are said to be mutually independent if for each integer k, and each choice of distinct integers n 1,..., n k, P ( k i1a ni ) Π k i1p (A ni ) Example. Toss of a coin. Let A {head in the first toss} and B {tail in the second toss}. Then A, B are independent Random variables A random variable X is a real-valued function of outcomes. The value of X depends on the outcome of the experiment. Example.3 Let X be the number of black balls one gets when choosing 4 balls from a box that contains 6 black balls and 4 white balls. The X is a random variable. Example: X is the number of points one gets for tossing a dice. Discrete random variables. If a random variable X can only assume countably many number of values {x 1, x,..., x n...}, X is called a discrete random variable. In this case, {f X (x r ) P (X x r ), r 1,...} is called the probability mass (distribution) function of X. Expectation (mean). If X is a discrete random variable taking values, x 1, x,..., x n.., the expectation or the mean of X is defined as µ E(X) x r P (X x r ) r1 3
4 Variance: The variance of X is defined as V (X) E[(X µ) ] (x r µ) P (X x r ) r1, which measures the deviation of X from its mean. Independence of random variables. Let X be a random variable taking values x 1,..., x r,.. and X a random variable taking values y 1,..., y r,.. We say that X, Y are independent if for all x i, y j P (X x i, Y y j ) P (X x i )P (Y y j ) If X, Y are independent, we can deduce that E(XY ) E(X)E(Y ) Examples of discrete distributions 1. Bernoulli distribution. Write X Bern(p). In this case, the possible values of X are 0, 1 and P (X 1) p, P (X 0) q 1 p. For example, if X is the number of heads we get when tossing a fair coin, then X Bern( 1 ).. Binomial distribution with parameter n and p. Write X Bin(n, p). X is used to denote the number of times a certain event occurs in a series of repeated trials. It holds that P (X k) ( n k ) p k (1 p) n k, E[X] kp k 0,..., n Example. X the number of heads we get when tossing a fair coin n times. X Bin(n, 1 ). 3. Geometric distribution. We say that X has a geometric distribution with parameter p if P (X n) p(1 p) n 1, n 1,, 3,... Write X G(p). In this case, E[X] 1 p. For example, the number X of tosses we need to get the first head has a geometric distribution with parameter We say X has a Poisson distribution with parameter λ, write X P oiss(λ), if λ λn P (X n) e, n 0, 1,... E(X) V (X) λ 4
5 Example: X is the number of customers who visit a particular shop in a day. Continuous type distribution Besides the discrete random variables, we also have continuous type random variables whose values could fill in an entire interval [a, b] or the whole line, e.g. the lifetime of a car. In this case, X has a probability density function f X (x) so that µ E[X] P (X z) z xf X (x)dx, V (X) f X (x)dx (x µ) f X (x)dx. Examples. 1. X U[a, b], the uniform distribution on the interval [a, b]. The probability density function is given by f X (x) µ E(X) { 1 b a a x b 0 otherwise. xf X (x)dx 1 (b + a). X Exp(λ), the exponential distribution with parameter λ. The probability density function is given by { λexp( λx) x 0 f X (x) 0 x < 0. µ E(X) xf X (x)dx 1 λ For example, X could be the lifetime of a computer.. X N(µ, σ ), the normal distribution. The probability density function is given by ( ) f X (x) (πσ ) 1 (x µ) exp σ In this case, E(X) µ, V (X) σ, e.g. X could be the measurement of a particular quantity µ. For example, X could be the measurement of a particular quantity µ Probability generating functions We are going to introduce a useful tool for studying random variables and associated distributions. Let X be a random variable taking non-negative 5
6 integer values. Let f X (n) P (X n), n 0,...,.. be the probability mass function. The probability generating function of X is defined by the following infinite sum: G X (s) f X (n)s n P (X n)s n P (X 0) + P (X 1)s + P (X )s P (X n)s n +... Example.4 Let X be a Bernoulli random variable, i.e., P (X 1) p, P (X 0) 1 p q. Find the probability generating function of X. G X (s) P (X 0) + P (X 1)s + P (X )s +... q + ps Example.5 X Bin(n, p). Find G X (s). G X (s) P (X 0) + P (X 1)s + P (X )s +... n P (X k)s k k0 n k0 ( n k (ps + (1 p)) n Example.6 X P oiss(5). Find G X (s). ) p k (1 p) n k s k G X (s) P (X 0) + P (X 1)s + P (X )s +... P (X n)s n 5 (5s)n e k0 e 5s 5 5 5n e sn Example.7 Let X be a random variable with probability mass function P (X 1) 1, P (X 3) 1 and P (X 4) 3. Find the probability generating function of X. 6
7 G X (s) P (X 0) + P (X 1)s + P (X )s +... P (X 1)s + P (X 3)s 3 + P (X 4)s s s s4 Properties. (1). Equivalent expression for G X (s): For any fixed s, write h(x) s X. Then G X (s) E[s X ] E[h(X)] h(n)p (X n) (). s n P (X n) G X (1) P (X n)1 n P (X n) 1 G X (0) P (X 0) (3). Hence, G X(s) ( f X (n)s n ) G X(1) f X (n)ns n 1 nf X (n) E(X) e.g. X Bin(n, p). G(s) (ps + 1 p) n and G (1) np E[X]. (4). Similarly, we have, If V ar(x) G X(1) + G X(1) (G X(1)) (5). The generating function determines the probability mass function. G X1 (s) P (X 1 n)s n G X (s) then matching the coefficients we have P (X 1 n)s n P (X 1 n) P (X n), n 0, 1,,... (6). X 1 and X are independent if and only if G X1 +X (s) G X1 (s)g X (s). Let us prove it for one direction. Assume X 1 and X are independent. Then using the alternative expression, G X1 +X (s) E[s X 1+X ] E[s X 1.s X ] E[s X 1 ]E[s X ] G X1 (s)g X (s) 7
8 Example.8 Suppose that the probability generating function of X is given by G X (s) s s s4. Write down the probability mass function of X. Since P (X n) is the coefficient to s n by the definition of the generating function, we have P (X 0) 1 8, P (X 1) 0, P (X ) 1 4, P (X 3) 3 8 and P (X 4) 1 4. Example.9 Suppose that the probability generating functions of independent random variables X 1 and X are given by G X1 (s) s, G X (s) 5 s s4. Let S X 1 + X. Find (1). G S (s). (). The probability mass function of S. (1). G S (s) G X1 (s)g X (s) ( s )( 5 s s4 ) 15 s s s4 + 5 s6. (). P (S ) 15, P (S 4) 7 15, P (S 6) 5. Example.10 Suppose that the probability generating functions of X is G X (s) s e s Find the probability mass function (distribution) of X. Write G X (s) in power series as follows: We conclude that G X (s) s e s s e e s s e e s (s)n P (X n + ) e n n e sn+, n 0, 1,... In general, if G X (s) e λs λ, then X P oiss(λ). (s) n Example.11 If X 1 P oiss(λ 1 ), X P oiss(λ ) and X 1 X are independent, show X 1 + X P oiss(λ 1 + λ ). 8
9 We know that G X1 (s) e λ 1s λ 1 and G X (s) e λ s λ. Since X 1 and X are independent, we have G X1 +X (s) G X1 (s)g X (s) e (λ 1+λ )s (λ 1 +λ ) Therefore, X 1 + X P oiss(λ 1 + λ ). Example.1 (1). Let G(s) a 0 + a 1 s + a s a n s n be a polynomial with a i 0, i 0. Write down the necessary and sufficient condition under which G is a probability generating function of some random variable X. (). Suppose that a random variable X has generating function G X (s) ps, 0 < p < 1, q 1 p. 1 qs Determine the probability mass function of X and E(X). (1). The condition is a 0 + a a n 1. (). Using 1 1 x xn, we obtain that G X (s) ps 1 qs ps[ (qs) n ] pq n s n+1 This implies that P (X n + 1) pq n, n 0. A simple computation gives Hence, E(X) G X (1) G X(s) p (1 q1) 1 p. p (1 qs) Lemma.13 If X has the p.g.f G X (s), then the p.g.f. of Y a + bx is given by G Y (s) s a G X (s b ). Proof. G Y (s) E[s Y ] E[s a+bx ] E[s a s bx ] s a E[(s b ) X ] s a G X (s b ). Example.14 Assume P (X n) 3 ( 1 3 )n 1, n 1. (1). Find G X (s). (). Write down the generating function of Y + 5X. 9
IEOR 3106: Introduction to Operations Research: Stochastic Models. Professor Whitt. SOLUTIONS to Homework Assignment 1
IEOR 3106: Introduction to Operations Research: Stochastic Models Professor Whitt SOLUTIONS to Homework Assignment 1 Probability Review: Read Chapters 1 and 2 in the textbook, Introduction to Probability
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationPart IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationWeek 12-13: Discrete Probability
Week 12-13: Discrete Probability November 21, 2018 1 Probability Space There are many problems about chances or possibilities, called probability in mathematics. When we roll two dice there are possible
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationLecture 4: Probability and Discrete Random Variables
Error Correcting Codes: Combinatorics, Algorithms and Applications (Fall 2007) Lecture 4: Probability and Discrete Random Variables Wednesday, January 21, 2009 Lecturer: Atri Rudra Scribe: Anonymous 1
More informationProbability and Statistics Concepts
University of Central Florida Computer Science Division COT 5611 - Operating Systems. Spring 014 - dcm Probability and Statistics Concepts Random Variable: a rule that assigns a numerical value to each
More informationAnalysis of Engineering and Scientific Data. Semester
Analysis of Engineering and Scientific Data Semester 1 2019 Sabrina Streipert s.streipert@uq.edu.au Example: Draw a random number from the interval of real numbers [1, 3]. Let X represent the number. Each
More informationPart (A): Review of Probability [Statistics I revision]
Part (A): Review of Probability [Statistics I revision] 1 Definition of Probability 1.1 Experiment An experiment is any procedure whose outcome is uncertain ffl toss a coin ffl throw a die ffl buy a lottery
More informationDiscrete Distributions
Discrete Distributions STA 281 Fall 2011 1 Introduction Previously we defined a random variable to be an experiment with numerical outcomes. Often different random variables are related in that they have
More informationRefresher on Discrete Probability
Refresher on Discrete Probability STAT 27725/CMSC 25400: Machine Learning Shubhendu Trivedi University of Chicago October 2015 Background Things you should have seen before Events, Event Spaces Probability
More informationThings to remember when learning probability distributions:
SPECIAL DISTRIBUTIONS Some distributions are special because they are useful They include: Poisson, exponential, Normal (Gaussian), Gamma, geometric, negative binomial, Binomial and hypergeometric distributions
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More information1 Review of Probability
1 Review of Probability Random variables are denoted by X, Y, Z, etc. The cumulative distribution function (c.d.f.) of a random variable X is denoted by F (x) = P (X x), < x
More informationMartingale Theory for Finance
Martingale Theory for Finance Tusheng Zhang October 27, 2015 1 Introduction 2 Probability spaces and σ-fields 3 Integration with respect to a probability measure. 4 Conditional expectation. 5 Martingales.
More information2. AXIOMATIC PROBABILITY
IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop
More informationLecture 13 (Part 2): Deviation from mean: Markov s inequality, variance and its properties, Chebyshev s inequality
Lecture 13 (Part 2): Deviation from mean: Markov s inequality, variance and its properties, Chebyshev s inequality Discrete Structures II (Summer 2018) Rutgers University Instructor: Abhishek Bhrushundi
More informationPart IA Probability. Theorems. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Theorems Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationX 1 ((, a]) = {ω Ω : X(ω) a} F, which leads us to the following definition:
nna Janicka Probability Calculus 08/09 Lecture 4. Real-valued Random Variables We already know how to describe the results of a random experiment in terms of a formal mathematical construction, i.e. the
More information1 Generating functions
1 Generating functions Even quite straightforward counting problems can lead to laborious and lengthy calculations. These are greatly simplified by using generating functions. 2 Definition 1.1. Given a
More informationGuidelines for Solving Probability Problems
Guidelines for Solving Probability Problems CS 1538: Introduction to Simulation 1 Steps for Problem Solving Suggested steps for approaching a problem: 1. Identify the distribution What distribution does
More information1.1 Review of Probability Theory
1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,
More informationProbability, Random Processes and Inference
INSTITUTO POLITÉCNICO NACIONAL CENTRO DE INVESTIGACION EN COMPUTACION Laboratorio de Ciberseguridad Probability, Random Processes and Inference Dr. Ponciano Jorge Escamilla Ambrosio pescamilla@cic.ipn.mx
More informationCS37300 Class Notes. Jennifer Neville, Sebastian Moreno, Bruno Ribeiro
CS37300 Class Notes Jennifer Neville, Sebastian Moreno, Bruno Ribeiro 2 Background on Probability and Statistics These are basic definitions, concepts, and equations that should have been covered in your
More informationMath Bootcamp 2012 Miscellaneous
Math Bootcamp 202 Miscellaneous Factorial, combination and permutation The factorial of a positive integer n denoted by n!, is the product of all positive integers less than or equal to n. Define 0! =.
More information18440: Probability and Random variables Quiz 1 Friday, October 17th, 2014
18440: Probability and Random variables Quiz 1 Friday, October 17th, 014 You will have 55 minutes to complete this test. Each of the problems is worth 5 % of your exam grade. No calculators, notes, or
More informationRandom Variable. Discrete Random Variable. Continuous Random Variable. Discrete Random Variable. Discrete Probability Distribution
Random Variable Theoretical Probability Distribution Random Variable Discrete Probability Distributions A variable that assumes a numerical description for the outcome of a random eperiment (by chance).
More informationProbability Theory. Introduction to Probability Theory. Principles of Counting Examples. Principles of Counting. Probability spaces.
Probability Theory To start out the course, we need to know something about statistics and probability Introduction to Probability Theory L645 Advanced NLP Autumn 2009 This is only an introduction; for
More informationTHE QUEEN S UNIVERSITY OF BELFAST
THE QUEEN S UNIVERSITY OF BELFAST 0SOR20 Level 2 Examination Statistics and Operational Research 20 Probability and Distribution Theory Wednesday 4 August 2002 2.30 pm 5.30 pm Examiners { Professor R M
More informationProbability Theory and Statistics. Peter Jochumzen
Probability Theory and Statistics Peter Jochumzen April 18, 2016 Contents 1 Probability Theory And Statistics 3 1.1 Experiment, Outcome and Event................................ 3 1.2 Probability............................................
More informationPRACTICE PROBLEMS FOR EXAM 2
PRACTICE PROBLEMS FOR EXAM 2 Math 3160Q Fall 2015 Professor Hohn Below is a list of practice questions for Exam 2. Any quiz, homework, or example problem has a chance of being on the exam. For more practice,
More informationSpecial distributions
Special distributions August 22, 2017 STAT 101 Class 4 Slide 1 Outline of Topics 1 Motivation 2 Bernoulli and binomial 3 Poisson 4 Uniform 5 Exponential 6 Normal STAT 101 Class 4 Slide 2 What distributions
More informationSTAT/MATH 395 A - PROBABILITY II UW Winter Quarter Moment functions. x r p X (x) (1) E[X r ] = x r f X (x) dx (2) (x E[X]) r p X (x) (3)
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 07 Néhémy Lim Moment functions Moments of a random variable Definition.. Let X be a rrv on probability space (Ω, A, P). For a given r N, E[X r ], if it
More informationChapter 4 : Discrete Random Variables
STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 2015 Néhémy Lim Chapter 4 : Discrete Random Variables 1 Random variables Objectives of this section. To learn the formal definition of a random variable.
More information1: PROBABILITY REVIEW
1: PROBABILITY REVIEW Marek Rutkowski School of Mathematics and Statistics University of Sydney Semester 2, 2016 M. Rutkowski (USydney) Slides 1: Probability Review 1 / 56 Outline We will review the following
More informationNorthwestern University Department of Electrical Engineering and Computer Science
Northwestern University Department of Electrical Engineering and Computer Science EECS 454: Modeling and Analysis of Communication Networks Spring 2008 Probability Review As discussed in Lecture 1, probability
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More information2.3 Conditional Probability
Arkansas Tech University MATH 3513: Applied Statistics I Dr. Marcel B. Finan 2.3 Conditional Probability In this section we introduce the concept of conditional probability. So far, the notation P (A)
More informationS n = x + X 1 + X X n.
0 Lecture 0 0. Gambler Ruin Problem Let X be a payoff if a coin toss game such that P(X = ) = P(X = ) = /2. Suppose you start with x dollars and play the game n times. Let X,X 2,...,X n be payoffs in each
More informationSTAT/MATH 395 PROBABILITY II
STAT/MATH 395 PROBABILITY II Chapter 6 : Moment Functions Néhémy Lim 1 1 Department of Statistics, University of Washington, USA Winter Quarter 2016 of Common Distributions Outline 1 2 3 of Common Distributions
More informationLecture 16. Lectures 1-15 Review
18.440: Lecture 16 Lectures 1-15 Review Scott Sheffield MIT 1 Outline Counting tricks and basic principles of probability Discrete random variables 2 Outline Counting tricks and basic principles of probability
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More information1 Random Variable: Topics
Note: Handouts DO NOT replace the book. In most cases, they only provide a guideline on topics and an intuitive feel. 1 Random Variable: Topics Chap 2, 2.1-2.4 and Chap 3, 3.1-3.3 What is a random variable?
More informationACM 116: Lecture 2. Agenda. Independence. Bayes rule. Discrete random variables Bernoulli distribution Binomial distribution
1 ACM 116: Lecture 2 Agenda Independence Bayes rule Discrete random variables Bernoulli distribution Binomial distribution Continuous Random variables The Normal distribution Expected value of a random
More informationELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Random Variable Discrete Random
More informationST 371 (V): Families of Discrete Distributions
ST 371 (V): Families of Discrete Distributions Certain experiments and associated random variables can be grouped into families, where all random variables in the family share a certain structure and a
More informationFundamental Tools - Probability Theory II
Fundamental Tools - Probability Theory II MSc Financial Mathematics The University of Warwick September 29, 2015 MSc Financial Mathematics Fundamental Tools - Probability Theory II 1 / 22 Measurable random
More informationChapter 2: Random Variables
ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:
More information14 - PROBABILITY Page 1 ( Answers at the end of all questions )
- PROBABILITY Page ( ) Three houses are available in a locality. Three persons apply for the houses. Each applies for one house without consulting others. The probability that all the three apply for the
More informationSet Theory Digression
1 Introduction to Probability 1.1 Basic Rules of Probability Set Theory Digression A set is defined as any collection of objects, which are called points or elements. The biggest possible collection of
More informationPhysics 403 Probability Distributions II: More Properties of PDFs and PMFs
Physics 403 Probability Distributions II: More Properties of PDFs and PMFs Segev BenZvi Department of Physics and Astronomy University of Rochester Table of Contents 1 Last Time: Common Probability Distributions
More informationExpected Value 7/7/2006
Expected Value 7/7/2006 Definition Let X be a numerically-valued discrete random variable with sample space Ω and distribution function m(x). The expected value E(X) is defined by E(X) = x Ω x m(x), provided
More informationElementary Probability. Exam Number 38119
Elementary Probability Exam Number 38119 2 1. Introduction Consider any experiment whose result is unknown, for example throwing a coin, the daily number of customers in a supermarket or the duration of
More informationStatistics 253/317 Introduction to Probability Models. Winter Midterm Exam Monday, Feb 10, 2014
Statistics 253/317 Introduction to Probability Models Winter 2014 - Midterm Exam Monday, Feb 10, 2014 Student Name (print): (a) Do not sit directly next to another student. (b) This is a closed-book, closed-note
More informationRandom Variables Example:
Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the
More information1 Basic continuous random variable problems
Name M362K Final Here are problems concerning material from Chapters 5 and 6. To review the other chapters, look over previous practice sheets for the two exams, previous quizzes, previous homeworks and
More informationCMPSCI 240: Reasoning Under Uncertainty
CMPSCI 240: Reasoning Under Uncertainty Lecture 5 Prof. Hanna Wallach wallach@cs.umass.edu February 7, 2012 Reminders Pick up a copy of B&T Check the course website: http://www.cs.umass.edu/ ~wallach/courses/s12/cmpsci240/
More informationClassical Probability
Chapter 1 Classical Probability Probability is the very guide of life. Marcus Thullius Cicero The original development of probability theory took place during the seventeenth through nineteenth centuries.
More informationMATH/STAT 3360, Probability Sample Final Examination Model Solutions
MATH/STAT 3360, Probability Sample Final Examination Model Solutions This Sample examination has more questions than the actual final, in order to cover a wider range of questions. Estimated times are
More informationMidterm Exam 1 Solution
EECS 126 Probability and Random Processes University of California, Berkeley: Fall 2015 Kannan Ramchandran September 22, 2015 Midterm Exam 1 Solution Last name First name SID Name of student on your left:
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationLecture 3. Discrete Random Variables
Math 408 - Mathematical Statistics Lecture 3. Discrete Random Variables January 23, 2013 Konstantin Zuev (USC) Math 408, Lecture 3 January 23, 2013 1 / 14 Agenda Random Variable: Motivation and Definition
More informationLecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationExpectations. Definition Let X be a discrete rv with set of possible values D and pmf p(x). The expected value or mean value of X, denoted by E(X ) or
Expectations Expectations Definition Let X be a discrete rv with set of possible values D and pmf p(x). The expected value or mean value of X, denoted by E(X ) or µ X, is E(X ) = µ X = x D x p(x) Expectations
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationThe probability of an event is viewed as a numerical measure of the chance that the event will occur.
Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that
More informationOverview. CSE 21 Day 5. Image/Coimage. Monotonic Lists. Functions Probabilistic analysis
Day 5 Functions/Probability Overview Functions Probabilistic analysis Neil Rhodes UC San Diego Image/Coimage The image of f is the set of values f actually takes on (a subset of the codomain) The inverse
More informationCS 630 Basic Probability and Information Theory. Tim Campbell
CS 630 Basic Probability and Information Theory Tim Campbell 21 January 2003 Probability Theory Probability Theory is the study of how best to predict outcomes of events. An experiment (or trial or event)
More information4. Suppose that we roll two die and let X be equal to the maximum of the two rolls. Find P (X {1, 3, 5}) and draw the PMF for X.
Math 10B with Professor Stankova Worksheet, Midterm #2; Wednesday, 3/21/2018 GSI name: Roy Zhao 1 Problems 1.1 Bayes Theorem 1. Suppose a test is 99% accurate and 1% of people have a disease. What is the
More informationBinomial and Poisson Probability Distributions
Binomial and Poisson Probability Distributions Esra Akdeniz March 3, 2016 Bernoulli Random Variable Any random variable whose only possible values are 0 or 1 is called a Bernoulli random variable. What
More informationLecture 2 Binomial and Poisson Probability Distributions
Binomial Probability Distribution Lecture 2 Binomial and Poisson Probability Distributions Consider a situation where there are only two possible outcomes (a Bernoulli trial) Example: flipping a coin James
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationProbability. Computer Science Tripos, Part IA. R.J. Gibbens. Computer Laboratory University of Cambridge. Easter Term 2008/9
Probability Computer Science Tripos, Part IA R.J. Gibbens Computer Laboratory University of Cambridge Easter Term 2008/9 Last revision: 2009-05-06/r-36 1 Outline Elementary probability theory (2 lectures)
More informationDiscrete Distributions
A simplest example of random experiment is a coin-tossing, formally called Bernoulli trial. It happens to be the case that many useful distributions are built upon this simplest form of experiment, whose
More informationChapter 1: Revie of Calculus and Probability
Chapter 1: Revie of Calculus and Probability Refer to Text Book: Operations Research: Applications and Algorithms By Wayne L. Winston,Ch. 12 Operations Research: An Introduction By Hamdi Taha, Ch. 12 OR441-Dr.Khalid
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationSUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416)
SUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416) D. ARAPURA This is a summary of the essential material covered so far. The final will be cumulative. I ve also included some review problems
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationLecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes
Lecture Notes 7 Random Processes Definition IID Processes Bernoulli Process Binomial Counting Process Interarrival Time Process Markov Processes Markov Chains Classification of States Steady State Probabilities
More informationBrief Review of Probability
Maura Department of Economics and Finance Università Tor Vergata Outline 1 Distribution Functions Quantiles and Modes of a Distribution 2 Example 3 Example 4 Distributions Outline Distribution Functions
More informationQuick review on Discrete Random Variables
STAT/MATH 395 A - PROBABILITY II UW Winter Quarter 2017 Néhémy Lim Quick review on Discrete Random Variables Notations. Z = {..., 2, 1, 0, 1, 2,...}, set of all integers; N = {0, 1, 2,...}, set of natural
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationMFM Practitioner Module: Quantitative Risk Management. John Dodson. September 23, 2015
MFM Practitioner Module: Quantitative Risk Management September 23, 2015 Mixtures Mixtures Mixtures Definitions For our purposes, A random variable is a quantity whose value is not known to us right now
More informationChapter 1 (Basic Probability)
Chapter 1 (Basic Probability) What is probability? Consider the following experiments: 1. Count the number of arrival requests to a web server in a day. 2. Determine the execution time of a program. 3.
More informationWhy study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables
ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section
More informationTheory of probability and mathematical statistics
Theory of probability and mathematical statistics Tomáš Mrkvička Bibliography [1] J. [2] J. Andďż l: Matematickďż statistika, SNTL/ALFA, Praha 1978 Andďż l: Statistickďż metody, Matfyzpress, Praha 1998
More informationWhat is the probability of getting a heads when flipping a coin
Chapter 2 Probability Probability theory is a branch of mathematics dealing with chance phenomena. The origins of the subject date back to the Italian mathematician Cardano about 1550, and French mathematicians
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationLecture Notes 2 Random Variables. Discrete Random Variables: Probability mass function (pmf)
Lecture Notes 2 Random Variables Definition Discrete Random Variables: Probability mass function (pmf) Continuous Random Variables: Probability density function (pdf) Mean and Variance Cumulative Distribution
More information5. Conditional Distributions
1 of 12 7/16/2009 5:36 AM Virtual Laboratories > 3. Distributions > 1 2 3 4 5 6 7 8 5. Conditional Distributions Basic Theory As usual, we start with a random experiment with probability measure P on an
More informationTopic 2: Probability & Distributions. Road Map Probability & Distributions. ECO220Y5Y: Quantitative Methods in Economics. Dr.
Topic 2: Probability & Distributions ECO220Y5Y: Quantitative Methods in Economics Dr. Nick Zammit University of Toronto Department of Economics Room KN3272 n.zammit utoronto.ca November 21, 2017 Dr. Nick
More informationSTA Module 4 Probability Concepts. Rev.F08 1
STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret
More informationRandom Processes. DS GA 1002 Probability and Statistics for Data Science.
Random Processes DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Aim Modeling quantities that evolve in time (or space)
More informationChapter 3. Chapter 3 sections
sections 3.1 Random Variables and Discrete Distributions 3.2 Continuous Distributions 3.4 Bivariate Distributions 3.5 Marginal Distributions 3.6 Conditional Distributions 3.7 Multivariate Distributions
More informationReview of Probability Theory
Review of Probability Theory Arian Maleki and Tom Do Stanford University Probability theory is the study of uncertainty Through this class, we will be relying on concepts from probability theory for deriving
More informationLecture 10: Bayes' Theorem, Expected Value and Variance Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 10: Bayes' Theorem, Expected Value and Variance Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationSample Spaces, Random Variables
Sample Spaces, Random Variables Moulinath Banerjee University of Michigan August 3, 22 Probabilities In talking about probabilities, the fundamental object is Ω, the sample space. (elements) in Ω are denoted
More informationProbability Review. Gonzalo Mateos
Probability Review Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ September 11, 2018 Introduction
More informationRandom Variables. Definition: A random variable (r.v.) X on the probability space (Ω, F, P) is a mapping
Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the
More information