Lecture 5: Introduction to Markov Chains
|
|
- Horatio Harris
- 5 years ago
- Views:
Transcription
1 Lecture 5: Introduction to Markov Chains Winfried Just Department of Mathematics, Ohio University January 24 26, 2018
2 weather.com light The weather is a stochastic process. For now we can assume that this just means it changes over time and cannot be predicted with certainty. Suppose you make the following observations: If day t is a sunny day, then day t + 1 will be sunny with probability p 11 and will be rainy with probability p 12. If day t is a rainy day, then day t + 1 will be sunny with probability p 21 and will be rainy with probability p 22. These observations can be organized into a matrix P as follows: [ ] p11 p P = 12 p 21 p 22 What can you say about the properties of the matrix P?
3 What are probabilities, anyway? Probabilities are numbers p such that 0 p 1. A probability of p = 0 for an event or outcome signifies that the event will never occur. A probability of p = 1 for an event signifies that the event will occur with certainty. A probability of p = 0.5 for an event signifies that there is a fifty-fifty chance that the event will occur. For example, if we flip a fair coin, then the event H that it will come up heads will be p = 0.5. Similarly, if we roll a fair die, then the event e 3 that it will come up 3 will be p = 1/6.
4 Probability distributions Suppose we can cut up all aspects of the future that are of interest for a particular application into events aka elementary outcomes e 1,..., e n so that exactly one of these outcomes will occur. Then the probability distribution is the vector [p 1,..., p n ] of probabilities of these outcomes, and we must have: p p n = n i=1 p i = 1. When we flip a fair coin once, we might consider [H, T ] = [e 1, e 2 ], and then [p 1, p 2 ] = [0.5, 0.5]. If we roll a fair die once, we might consider [e 1,..., e 6 ], and then [p 1, p 2, p 3, p 4, p 5, p 6 ] = [1/6, 1/6, 1/6, 1/6, 1/6, 1/6]. When we flip a fair coin twice and are only interested in the number of times heads comes up, we might consider [H, T ] = [e 0, e 1, e 2 ], and then [p 0, p 1, p 2 ] = [0.25, 0.5, 0.25].
5 weather.com light, continued [ ] p11 p P = 12 p 21 p 22 What can you say about the properties of the matrix P? Nothing much, actually. How about dry, but overcast days? Or about days when it rains in the morning and is sunny in the afternoon? OK, let us assume that you can somehow unambiguously classify each day as either sunny or rainy, but not both. Then you have two possible states of the weather on day t: 1 State 1: sunny day. 2 State 2: rainy day. Then P is the matrix of transition probabilities between the states on day t and day t + 1.
6 weather.com light, continued Under these assumptions, we can say something definite about P: [ ] p11 p P = 12 p 21 p 22 p 11 + p 12 = 1 and p 21 + p 22 = 1. P must be a stochastic matrix, that is, its elements must be probabilities, and each row of P must add up to 1. Consider the following examples: P 1 = [ 0.4 ] P 2 = [ 0.4 ] P 3 = [ 0.4 ] Here P 1 and P 3 are legitimate options for P, while P 2 is not. In P 1, each column also adds up to 1; this matrix is doubly stochastic. The latter property is not required though.
7 weather.com for perfectionists [ ] p11 p There are some stochastic matrices P = 12 p 21 p 22 that would allow you to predict the weather with perfect accuracy on any day in the future. Homework 13: (a) Which of the following matrices are stochastic and have this property? (b) What would they tell you about the weather pattern? P 1 = P 5 = [ ] [ ] P 2 = P 6 = [ ] [ ] P 3 = P 7 = [ ] [ ] P 4 = P 8 = [ 0.5 ] [ ]
8 weather.com, two-day forecast Let q 11 be the probability that if day t is a sunny day, then day t + 2 will also be sunny. q 12 be the probability that if day t is a sunny day, then day t + 2 will be rainy. q 21 be the probability that if day t is a rainy day, then day t + 2 will be sunny. q 12 be the probability that if day t is a rainy day, then day t + 2 will also be rainy. How can we express the transition probability matrix [ ] q11 q Q = 12 q 21 q 22 from day t to day t + 2 in terms of the next-day transition probabilities p 11, p 12, p 21, p 22?
9 weather.com, working out a two-day forecast q 11 is the probability that if day t is a sunny day, then day t + 2 will also be sunny. If day t is sunny, day t + 1 could be sunny (with probability p 11 ) or rainy (with probability p 12 ): q 11 = p 11 p 11 + p 12 p 21 q 12 is the probability that if day t is a sunny day, then day t + 2 will be rainy. q 12 = p 11 p 12 + p 12 p 22 q 21 is the probability that if day t is a rainy day, then day t + 2 will be sunny. q 21 = p 21 p 11 + p 22 p 21 q 12 is the probability that if day t is a rainy day, then day t + 2 will also be rainy. q 22 = p 21 p 12 + p 22 p 22
10 weather.com, posting a two-day forecast The transition probability matrix from day t to day t + 2 is [ ] [ ] q11 q Q = 12 p11 p = 11 + p 12 p 21 p 11 p 12 + p 12 p 22 q 21 q 22 p 21 p 11 + p 22 p 21 p 21 p 12 + p 22 p 22 Done!!! Anyone up for working out a seven-day forecast? Homework 14: Find the two-day transition probability matrix Q if the one-day transition probability matrix is [ ] P =
11 weather.com continued: The Markov property Let q 11 be the probability that if day t is a sunny day, then day t + 2 will also be sunny. Recall that the calculations of q 11 used the following argument: If day t is sunny, day t + 1 could be sunny (with probability p 11 ) or rainy (with probability p 12 ). In the first case, the probability that day t 2 will be sunny is p 11, in the second case this probability is p 21. This gives: q 11 = p 11 p 11 + p 12 p 21 Note that we are making a tacit assumption here: The state of the process at time t + 1 depends only on the state at time t, but not on prior history. (Whether day t 1 was also sunny or rainy.) This is called the Markov property and a (discrete-time) stochastic process with finitely many states that has this property is called a Markov chain.
12 weather.com for real: Does the weather work this way? Does the weather really have the Markov property? Probably not. A long stretch of sunny days may be more likely to be followed by one more sunny day than a single sunny day in an otherwise rainy period. But perhaps the real weather pattern is close enough to a Markov chain so that we can make somewhat accurate predictions by modeling it as one. All models involve simplifying assumptions. In this course we will only consider examples of stochastic processes that are assumed to be Markov chains.
13 Where is Waldo? Recall the friendship matrix for six students in our class that we discussed earlier? Waldo is another student in this class. He is highly gregarious and motivated and spends all of his evenings working with those six students on his MATH 3200 homework. At 7p.m. he visits a randomly chosen student i among those six, and then operates as follows: He starts working with i. After 10 minutes, he flips a fair coin. If the coin comes up heads, he continues working with i for another 10 minutes before flipping the coin again. If the coin comes up tails, he moves to the room of a randomly chosen friend of i and repeats the procedure. He never tires of these efforts until 1a.m. Where should we go looking for Waldo at midnight?
14 A few observations about Waldo We cannot know for certain where Waldo is at midnight. But can try to identify the room where he will be with the highest probability. Waldo s itinerary can be modeled as a Markov chain with states i = 1, 2,..., 6 where one time step lasts 10 minutes. State i simply means that Waldo is in i s room. We want to find the transition probability matrix for this Markov chain.
15 The transition probability matrix P for Waldo We can find P from the friendship matrix A = = [a ij ] / /4 0 1/4 0 1/2 0 1/4 0 1/4 P = 0 0 1/2 1/4 1/4 0 1/8 1/8 1/8 1/2 0 1/8 = [p ij ] /2 0 1/2 0 1/6 1/6 0 1/6 0 1/2
16 If Waldo weren t such great company... The story is halfway believable only if you assume that Waldo is extremely likable. What would happen if our six students were not all that fond of him? In this case you can think of i flipping the coin and deciding whether to kick out Waldo and sending him to a randomly chosen student who is not i s friend. This alternative story defines another Markov chain with the same states and the same interpretation of a single time step. Homework 15: Find the transition probability matrix for this new Markov chain.
17 Waldo surfs the web At 1a.m., Waldo goes back to his own room and surfs the web. He opens his home page and follows a randomly chosen link. At each page that he visits: If the page has no link to another page, he teleports to a randomly chosen URL. If the page has links, he rolls a fair die. If 6 comes up, he teleports to a randomly chosen URL. If any other number comes up, he follows a randomly chosen link from the current page. Note that teleporting here means that Waldo somehow reaches a web page without using any links. This surfing pattern, together with what he learned in MATH 3200, made Waldo rich and famous. Who is Waldo? Ohio University Since 1804 Department of Mathematics
MATH3200, Lecture 31: Applications of Eigenvectors. Markov Chains and Chemical Reaction Systems
Lecture 31: Some Applications of Eigenvectors: Markov Chains and Chemical Reaction Systems Winfried Just Department of Mathematics, Ohio University April 9 11, 2018 Review: Eigenvectors and left eigenvectors
More informationLecture 19: Introduction to Linear Transformations
Lecture 19: Introduction to Linear Transformations Winfried Just, Ohio University October 11, 217 Scope of this lecture Linear transformations are important and useful: A lot of applications of linear
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 2: Conditional probability Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching
More informationLecture 1 Introduction to Probability and Set Theory Text: A Course in Probability by Weiss
Lecture 1 to and Set Theory Text: A Course in by Weiss 1.2 2.3 STAT 225 to Models January 13, 2014 to and Whitney Huang Purdue University 1.1 Agenda to and 1 2 3 1.2 Motivation Uncertainty/Randomness in
More informationToday. Next lecture. (Ch 14) Markov chains and hidden Markov models
Today (Ch 14) Markov chains and hidden Markov models Graphical representation Transition probability matrix Propagating state distributions The stationary distribution Next lecture (Ch 14) Markov chains
More informationGrades 7 & 8, Math Circles 24/25/26 October, Probability
Faculty of Mathematics Waterloo, Ontario NL 3G1 Centre for Education in Mathematics and Computing Grades 7 & 8, Math Circles 4/5/6 October, 017 Probability Introduction Probability is a measure of how
More informationProbability Rules. MATH 130, Elements of Statistics I. J. Robert Buchanan. Fall Department of Mathematics
Probability Rules MATH 130, Elements of Statistics I J. Robert Buchanan Department of Mathematics Fall 2018 Introduction Probability is a measure of the likelihood of the occurrence of a certain behavior
More informationLecture 1. ABC of Probability
Math 408 - Mathematical Statistics Lecture 1. ABC of Probability January 16, 2013 Konstantin Zuev (USC) Math 408, Lecture 1 January 16, 2013 1 / 9 Agenda Sample Spaces Realizations, Events Axioms of Probability
More informationP (E) = P (A 1 )P (A 2 )... P (A n ).
Lecture 9: Conditional probability II: breaking complex events into smaller events, methods to solve probability problems, Bayes rule, law of total probability, Bayes theorem Discrete Structures II (Summer
More information18.440: Lecture 33 Markov Chains
18.440: Lecture 33 Markov Chains Scott Sheffield MIT 1 Outline Markov chains Examples Ergodicity and stationarity 2 Outline Markov chains Examples Ergodicity and stationarity 3 Markov chains Consider a
More informationProblems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman.
Math 224 Fall 2017 Homework 1 Drew Armstrong Problems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman. Section 1.1, Exercises 4,5,6,7,9,12. Solutions to Book Problems.
More informationMarkov Chains. As part of Interdisciplinary Mathematical Modeling, By Warren Weckesser Copyright c 2006.
Markov Chains As part of Interdisciplinary Mathematical Modeling, By Warren Weckesser Copyright c 2006 1 Introduction A (finite) Markov chain is a process with a finite number of states (or outcomes, or
More informationk P (X = k)
Math 224 Spring 208 Homework Drew Armstrong. Suppose that a fair coin is flipped 6 times in sequence and let X be the number of heads that show up. Draw Pascal s triangle down to the sixth row (recall
More informationMATH HOMEWORK PROBLEMS D. MCCLENDON
MATH 46- HOMEWORK PROBLEMS D. MCCLENDON. Consider a Markov chain with state space S = {0, }, where p = P (0, ) and q = P (, 0); compute the following in terms of p and q: (a) P (X 2 = 0 X = ) (b) P (X
More informationProbability Review Lecturer: Ji Liu Thank Jerry Zhu for sharing his slides
Probability Review Lecturer: Ji Liu Thank Jerry Zhu for sharing his slides slide 1 Inference with Bayes rule: Example In a bag there are two envelopes one has a red ball (worth $100) and a black ball one
More informationEPE / EDP 557 Homework 7
Section III. A. Questions EPE / EDP 557 Homework 7 Section III. A. and Lab 7 Suppose you roll a die once and flip a coin twice. Events are defined as follows: A = {Die is a 1} B = {Both flips of the coin
More informationMAT Mathematics in Today's World
MAT 1000 Mathematics in Today's World Last Time We discussed the four rules that govern probabilities: 1. Probabilities are numbers between 0 and 1 2. The probability an event does not occur is 1 minus
More informationChapter 35 out of 37 from Discrete Mathematics for Neophytes: Number Theory, Probability, Algorithms, and Other Stuff by J. M. Cargal.
35 Mixed Chains In this chapter we learn how to analyze Markov chains that consists of transient and absorbing states. Later we will see that this analysis extends easily to chains with (nonabsorbing)
More information18.600: Lecture 32 Markov Chains
18.600: Lecture 32 Markov Chains Scott Sheffield MIT Outline Markov chains Examples Ergodicity and stationarity Outline Markov chains Examples Ergodicity and stationarity Markov chains Consider a sequence
More informationProbability: Part 1 Naima Hammoud
Probability: Part 1 Naima ammoud Feb 7, 2017 Motivation ossing a coin Rolling a die Outcomes: eads or ails Outcomes: 1, 2, 3, 4, 5 or 6 Defining Probability If I toss a coin, there is a 50% chance I will
More informationMath 304 Handout: Linear algebra, graphs, and networks.
Math 30 Handout: Linear algebra, graphs, and networks. December, 006. GRAPHS AND ADJACENCY MATRICES. Definition. A graph is a collection of vertices connected by edges. A directed graph is a graph all
More informationSampling Distributions
Sampling Error As you may remember from the first lecture, samples provide incomplete information about the population In particular, a statistic (e.g., M, s) computed on any particular sample drawn from
More informationMATH 56A SPRING 2008 STOCHASTIC PROCESSES
MATH 56A SPRING 008 STOCHASTIC PROCESSES KIYOSHI IGUSA Contents 4. Optimal Stopping Time 95 4.1. Definitions 95 4.. The basic problem 95 4.3. Solutions to basic problem 97 4.4. Cost functions 101 4.5.
More information18.600: Lecture 39 Review: practice problems
18.600: Lecture 39 Review: practice problems Scott Sheffield MIT Markov chains Alice and Bob share a home with a bathroom, a walk-in closet, and 2 towels. Markov chains Alice and Bob share a home with
More informationCIS 2033 Lecture 5, Fall
CIS 2033 Lecture 5, Fall 2016 1 Instructor: David Dobor September 13, 2016 1 Supplemental reading from Dekking s textbook: Chapter2, 3. We mentioned at the beginning of this class that calculus was a prerequisite
More informationSection 13.3 Probability
288 Section 13.3 Probability Probability is a measure of how likely an event will occur. When the weather forecaster says that there will be a 50% chance of rain this afternoon, the probability that it
More informationLecture 3 - Axioms of Probability
Lecture 3 - Axioms of Probability Sta102 / BME102 January 25, 2016 Colin Rundel Axioms of Probability What does it mean to say that: The probability of flipping a coin and getting heads is 1/2? 3 What
More informationCHAPTER 3 PROBABILITY TOPICS
CHAPTER 3 PROBABILITY TOPICS 1. Terminology In this chapter, we are interested in the probability of a particular event occurring when we conduct an experiment. The sample space of an experiment is the
More informationThe probability of an event is viewed as a numerical measure of the chance that the event will occur.
Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that
More informationLecture 4 An Introduction to Stochastic Processes
Lecture 4 An Introduction to Stochastic Processes Prof. Massimo Guidolin Prep Course in Quantitative Methods for Finance August-September 2017 Plan of the lecture Motivation and definitions Filtrations
More informationStatistics 100A Homework 1 Solutions
Problem Statistics 00A Homework Solutions Ryan Rosario Suppose we flip a fair coin 4 times independently. () What is the sample space? By definition, the sample space, denoted as Ω, is the set of all possible
More informationUncertainty. Michael Peters December 27, 2013
Uncertainty Michael Peters December 27, 20 Lotteries In many problems in economics, people are forced to make decisions without knowing exactly what the consequences will be. For example, when you buy
More informationCOS 341: Discrete Mathematics
COS 341: Discrete Mathematics Final Exam Fall 2006 Print your name General directions: This exam is due on Monday, January 22 at 4:30pm. Late exams will not be accepted. Exams must be submitted in hard
More informationMath Tech IIII, Jan 21
Math Tech IIII, Jan 21 Probability III The Complement of an Event, Theoretical and Experimental Probability Book Sections: 3.1 Essential Questions: How can I compute the probability of any event? What
More informationStochastic Processes
qmc082.tex. Version of 30 September 2010. Lecture Notes on Quantum Mechanics No. 8 R. B. Griffiths References: Stochastic Processes CQT = R. B. Griffiths, Consistent Quantum Theory (Cambridge, 2002) DeGroot
More informationMath 243 Section 3.1 Introduction to Probability Lab
Math 243 Section 3.1 Introduction to Probability Lab Overview Why Study Probability? Outcomes, Events, Sample Space, Trials Probabilities and Complements (not) Theoretical vs. Empirical Probability The
More informationMath Camp Notes: Linear Algebra II
Math Camp Notes: Linear Algebra II Eigenvalues Let A be a square matrix. An eigenvalue is a number λ which when subtracted from the diagonal elements of the matrix A creates a singular matrix. In other
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More informationChapter 2.5 Random Variables and Probability The Modern View (cont.)
Chapter 2.5 Random Variables and Probability The Modern View (cont.) I. Statistical Independence A crucially important idea in probability and statistics is the concept of statistical independence. Suppose
More informationSTT 315 Problem Set #3
1. A student is asked to calculate the probability that x = 3.5 when x is chosen from a normal distribution with the following parameters: mean=3, sd=5. To calculate the answer, he uses this command: >
More informationMATH 3C: MIDTERM 1 REVIEW. 1. Counting
MATH 3C: MIDTERM REVIEW JOE HUGHES. Counting. Imagine that a sports betting pool is run in the following way: there are 20 teams, 2 weeks, and each week you pick a team to win. However, you can t pick
More informationProbability and Inference. POLI 205 Doing Research in Politics. Populations and Samples. Probability. Fall 2015
Fall 2015 Population versus Sample Population: data for every possible relevant case Sample: a subset of cases that is drawn from an underlying population Inference Parameters and Statistics A parameter
More informationCh 14 Randomness and Probability
Ch 14 Randomness and Probability We ll begin a new part: randomness and probability. This part contain 4 chapters: 14-17. Why we need to learn this part? Probability is not a portion of statistics. Instead
More informationElementary Discrete Probability
Elementary Discrete Probability MATH 472 Financial Mathematics J Robert Buchanan 2018 Objectives In this lesson we will learn: the terminology of elementary probability, elementary rules of probability,
More informationDO NOT WRITE BELOW THIS LINE Total page 1: / 20 points. Total page 2: / 20 points
MATH M118: Finite Mathematics Sample Department Final Examination (The actual final examination will be identical to this sample in length, format, and difficulty.) Directions: Place your name and student
More information6.041SC Probabilistic Systems Analysis and Applied Probability, Fall 2013 Transcript Tutorial:A Random Number of Coin Flips
6.041SC Probabilistic Systems Analysis and Applied Probability, Fall 2013 Transcript Tutorial:A Random Number of Coin Flips Hey, everyone. Welcome back. Today, we're going to do another fun problem that
More informationMean, Median and Mode. Lecture 3 - Axioms of Probability. Where do they come from? Graphically. We start with a set of 21 numbers, Sta102 / BME102
Mean, Median and Mode Lecture 3 - Axioms of Probability Sta102 / BME102 Colin Rundel September 1, 2014 We start with a set of 21 numbers, ## [1] -2.2-1.6-1.0-0.5-0.4-0.3-0.2 0.1 0.1 0.2 0.4 ## [12] 0.4
More informationExample. What is the sample space for flipping a fair coin? Rolling a 6-sided die? Find the event E where E = {x x has exactly one head}
Chapter 7 Notes 1 (c) Epstein, 2013 CHAPTER 7: PROBABILITY 7.1: Experiments, Sample Spaces and Events Chapter 7 Notes 2 (c) Epstein, 2013 What is the sample space for flipping a fair coin three times?
More informationLTCC. Exercises. (1) Two possible weather conditions on any day: {rainy, sunny} (2) Tomorrow s weather depends only on today s weather
1. Markov chain LTCC. Exercises Let X 0, X 1, X 2,... be a Markov chain with state space {1, 2, 3, 4} and transition matrix 1/2 1/2 0 0 P = 0 1/2 1/3 1/6. 0 0 0 1 (a) What happens if the chain starts in
More informationDiscrete Mathematics and Probability Theory Fall 2010 Tse/Wagner MT 2 Soln
CS 70 Discrete Mathematics and Probability heory Fall 00 se/wagner M Soln Problem. [Rolling Dice] (5 points) You roll a fair die three times. Consider the following events: A first roll is a 3 B second
More informationChapter 10 Markov Chains and Transition Matrices
Finite Mathematics (Mat 119) Lecture week 3 Dr. Firozzaman Department of Mathematics and Statistics Arizona State University Chapter 10 Markov Chains and Transition Matrices A Markov Chain is a sequence
More informationIndependence Solutions STAT-UB.0103 Statistics for Business Control and Regression Models
Independence Solutions STAT-UB.003 Statistics for Business Control and Regression Models The Birthday Problem. A class has 70 students. What is the probability that at least two students have the same
More information= 2 5 Note how we need to be somewhat careful with how we define the total number of outcomes in b) and d). We will return to this later.
PROBABILITY MATH CIRCLE (ADVANCED /27/203 The likelyhood of something (usually called an event happening is called the probability. Probability (informal: We can calculate probability using a ratio: want
More informationMarkov Chains. Chapter 16. Markov Chains - 1
Markov Chains Chapter 16 Markov Chains - 1 Why Study Markov Chains? Decision Analysis focuses on decision making in the face of uncertainty about one future event. However, many decisions need to consider
More informationCHAPTER 6. Markov Chains
CHAPTER 6 Markov Chains 6.1. Introduction A(finite)Markovchainisaprocess withafinitenumberofstates (or outcomes, or events) in which the probability of being in a particular state at step n+1depends only
More informationDiscrete Structures for Computer Science
Discrete Structures for Computer Science William Garrison bill@cs.pitt.edu 6311 Sennott Square Lecture #24: Probability Theory Based on materials developed by Dr. Adam Lee Not all events are equally likely
More informationLecture 10: Powers of Matrices, Difference Equations
Lecture 10: Powers of Matrices, Difference Equations Difference Equations A difference equation, also sometimes called a recurrence equation is an equation that defines a sequence recursively, i.e. each
More informationFebruary 2017 February 18, 2017
February 017 February 18, 017 Combinatorics 1. Kelvin the Frog is going to roll three fair ten-sided dice with faces labelled 0, 1,,..., 9. First he rolls two dice, and finds the sum of the two rolls.
More informationMarkov Chains (Part 4)
Markov Chains (Part 4) Steady State Probabilities and First Passage Times Markov Chains - 1 Steady-State Probabilities Remember, for the inventory example we had (8) P &.286 =.286.286 %.286 For an irreducible
More informationChapter 14. From Randomness to Probability. Copyright 2012, 2008, 2005 Pearson Education, Inc.
Chapter 14 From Randomness to Probability Copyright 2012, 2008, 2005 Pearson Education, Inc. Dealing with Random Phenomena A random phenomenon is a situation in which we know what outcomes could happen,
More informationBrief Review of Probability
Brief Review of Probability Nuno Vasconcelos (Ken Kreutz-Delgado) ECE Department, UCSD Probability Probability theory is a mathematical language to deal with processes or experiments that are non-deterministic
More informationIntroduction to probability
Introduction to probability 4.1 The Basics of Probability Probability The chance that a particular event will occur The probability value will be in the range 0 to 1 Experiment A process that produces
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 2 MATH00040 SEMESTER / Probability
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 2 MATH00040 SEMESTER 2 2017/2018 DR. ANTHONY BROWN 5.1. Introduction to Probability. 5. Probability You are probably familiar with the elementary
More informationBasic Probability. Introduction
Basic Probability Introduction The world is an uncertain place. Making predictions about something as seemingly mundane as tomorrow s weather, for example, is actually quite a difficult task. Even with
More informationLesson Plan. AM 121: Introduction to Optimization Models and Methods. Lecture 17: Markov Chains. Yiling Chen SEAS. Stochastic process Markov Chains
AM : Introduction to Optimization Models and Methods Lecture 7: Markov Chains Yiling Chen SEAS Lesson Plan Stochastic process Markov Chains n-step probabilities Communicating states, irreducibility Recurrent
More information9. DISCRETE PROBABILITY DISTRIBUTIONS
9. DISCRETE PROBABILITY DISTRIBUTIONS Random Variable: A quantity that takes on different values depending on chance. Eg: Next quarter s sales of Coca Cola. The proportion of Super Bowl viewers surveyed
More informationP (A) = P (B) = P (C) = P (D) =
STAT 145 CHAPTER 12 - PROBABILITY - STUDENT VERSION The probability of a random event, is the proportion of times the event will occur in a large number of repititions. For example, when flipping a coin,
More informationMath 1313 Experiments, Events and Sample Spaces
Math 1313 Experiments, Events and Sample Spaces At the end of this recording, you should be able to define and use the basic terminology used in defining experiments. Terminology The next main topic in
More information1 Basic continuous random variable problems
Name M362K Final Here are problems concerning material from Chapters 5 and 6. To review the other chapters, look over previous practice sheets for the two exams, previous quizzes, previous homeworks and
More informationTerm Definition Example Random Phenomena
UNIT VI STUDY GUIDE Probabilities Course Learning Outcomes for Unit VI Upon completion of this unit, students should be able to: 1. Apply mathematical principles used in real-world situations. 1.1 Demonstrate
More informationCS 246 Review of Proof Techniques and Probability 01/14/19
Note: This document has been adapted from a similar review session for CS224W (Autumn 2018). It was originally compiled by Jessica Su, with minor edits by Jayadev Bhaskaran. 1 Proof techniques Here we
More information1 Proof techniques. CS 224W Linear Algebra, Probability, and Proof Techniques
1 Proof techniques Here we will learn to prove universal mathematical statements, like the square of any odd number is odd. It s easy enough to show that this is true in specific cases for example, 3 2
More informationthe probability of getting either heads or tails must be 1 (excluding the remote possibility of getting it to land on its edge).
Probability One of the most useful and intriguing aspects of quantum mechanics is the Heisenberg Uncertainty Principle. Before I get to it however, we need some initial comments on probability. Let s first
More informationLECTURE 15: SIMPLE LINEAR REGRESSION I
David Youngberg BSAD 20 Montgomery College LECTURE 5: SIMPLE LINEAR REGRESSION I I. From Correlation to Regression a. Recall last class when we discussed two basic types of correlation (positive and negative).
More informationBe able to define the following terms and answer basic questions about them:
CS440/ECE448 Section Q Fall 2017 Final Review Be able to define the following terms and answer basic questions about them: Probability o Random variables, axioms of probability o Joint, marginal, conditional
More informationSTAT 111 Recitation 1
STAT 111 Recitation 1 Linjun Zhang January 20, 2017 What s in the recitation This class, and the exam of this class, is a mix of statistical concepts and calculations. We are going to do a little bit of
More informationIntroduction to Algebra: The First Week
Introduction to Algebra: The First Week Background: According to the thermostat on the wall, the temperature in the classroom right now is 72 degrees Fahrenheit. I want to write to my friend in Europe,
More informationGreat Theoretical Ideas in Computer Science
15-251 Great Theoretical Ideas in Computer Science Probability Theory: Counting in Terms of Proportions Lecture 10 (September 27, 2007) Some Puzzles Teams A and B are equally good In any one game, each
More informationPh 12b. Homework Assignment No. 3 Due: 5pm, Thursday, 28 January 2010
1 Ph 1b Homework Assignment No 3 Due: 5pm, Thursday, 8 January 010 1 A watched quantum state never moves Consider a simple model of an atom with two energy levels the ground state g has energy E g and
More informationTerminology. Experiment = Prior = Posterior =
Review: probability RVs, events, sample space! Measures, distributions disjoint union property (law of total probability book calls this sum rule ) Sample v. population Law of large numbers Marginals,
More informationV. Probability. by David M. Lane and Dan Osherson
V. Probability by David M. Lane and Dan Osherson Prerequisites none F.Introduction G.Basic Concepts I.Gamblers Fallacy Simulation K.Binomial Distribution L.Binomial Demonstration M.Base Rates Probability
More informationModelling data networks stochastic processes and Markov chains
Modelling data networks stochastic processes and Markov chains a 1, 3 1, 2 2, 2 b 0, 3 2, 3 u 1, 3 α 1, 6 c 0, 3 v 2, 2 β 1, 1 Richard G. Clegg (richard@richardclegg.org) November 2016 Available online
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationCompound Events. The event E = E c (the complement of E) is the event consisting of those outcomes which are not in E.
Compound Events Because we are using the framework of set theory to analyze probability, we can use unions, intersections and complements to break complex events into compositions of events for which it
More informationDiscrete Random Variables
Discrete Random Variables We have a probability space (S, Pr). A random variable is a function X : S V (X ) for some set V (X ). In this discussion, we must have V (X ) is the real numbers X induces a
More informationMAS275 Probability Modelling Exercises
MAS75 Probability Modelling Exercises Note: these questions are intended to be of variable difficulty. In particular: Questions or part questions labelled (*) are intended to be a bit more challenging.
More informationRandom Variable. Discrete Random Variable. Continuous Random Variable. Discrete Random Variable. Discrete Probability Distribution
Random Variable Theoretical Probability Distribution Random Variable Discrete Probability Distributions A variable that assumes a numerical description for the outcome of a random eperiment (by chance).
More informationLecture 6: Entropy Rate
Lecture 6: Entropy Rate Entropy rate H(X) Random walk on graph Dr. Yao Xie, ECE587, Information Theory, Duke University Coin tossing versus poker Toss a fair coin and see and sequence Head, Tail, Tail,
More information18.175: Lecture 30 Markov chains
18.175: Lecture 30 Markov chains Scott Sheffield MIT Outline Review what you know about finite state Markov chains Finite state ergodicity and stationarity More general setup Outline Review what you know
More informationBe able to define the following terms and answer basic questions about them:
CS440/ECE448 Fall 2016 Final Review Be able to define the following terms and answer basic questions about them: Probability o Random variables o Axioms of probability o Joint, marginal, conditional probability
More informationNote: Please use the actual date you accessed this material in your citation.
MIT OpenCourseWare http://ocw.mit.edu 18.06 Linear Algebra, Spring 2005 Please use the following citation format: Gilbert Strang, 18.06 Linear Algebra, Spring 2005. (Massachusetts Institute of Technology:
More informationMITOCW ocw f99-lec30_300k
MITOCW ocw-18.06-f99-lec30_300k OK, this is the lecture on linear transformations. Actually, linear algebra courses used to begin with this lecture, so you could say I'm beginning this course again by
More informationCambridge University Press How to Prove it: A Structured Approach: Second edition Daniel J. Velleman Excerpt More information
Introduction What is mathematics? High school mathematics is concerned mostly with solving equations and computing answers to numerical questions. College mathematics deals with a wider variety of questions,
More informationHypothesis Tests Solutions COR1-GB.1305 Statistics and Data Analysis
Hypothesis Tests Solutions COR1-GB.1305 Statistics and Data Analysis Introduction 1. An analyst claims to have a reliable model for Twitter s quarterly revenues. His model predicted that the most recent
More information1 Basic continuous random variable problems
Name M362K Final Here are problems concerning material from Chapters 5 and 6. To review the other chapters, look over previous practice sheets for the two exams, previous quizzes, previous homeworks and
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationSTAT Chapter 3: Probability
Basic Definitions STAT 515 --- Chapter 3: Probability Experiment: A process which leads to a single outcome (called a sample point) that cannot be predicted with certainty. Sample Space (of an experiment):
More informationLecture 6: The Pigeonhole Principle and Probability Spaces
Lecture 6: The Pigeonhole Principle and Probability Spaces Anup Rao January 17, 2018 We discuss the pigeonhole principle and probability spaces. Pigeonhole Principle The pigeonhole principle is an extremely
More informationMACHINE LEARNING INTRODUCTION: STRING CLASSIFICATION
MACHINE LEARNING INTRODUCTION: STRING CLASSIFICATION THOMAS MAILUND Machine learning means different things to different people, and there is no general agreed upon core set of algorithms that must be
More informationData Analysis and Monte Carlo Methods
Lecturer: Allen Caldwell, Max Planck Institute for Physics & TUM Recitation Instructor: Oleksander (Alex) Volynets, MPP & TUM General Information: - Lectures will be held in English, Mondays 16-18:00 -
More information