More Information! Conditional Probability and Inverse Methods Peter Zoogman Harvard Atmospheres Journal Club April 12, 2012

Size: px
Start display at page:

Download "More Information! Conditional Probability and Inverse Methods Peter Zoogman Harvard Atmospheres Journal Club April 12, 2012"

Transcription

1 More Information! Conditional Probability and Inverse Methods Peter Zoogman Harvard Atmospheres Journal Club April 12, 2012

2 Bayesian Analysis not very intuitive! Humans are bad at combining a priori information with new observations Conditional Probability examples 2-box inversion to constrain emissions Arellano et al paper on application of these methods EARTH SURFACE

3 The Monty Hall Problem You're given the choice of three doors: Behind one door is a car; behind the others, goats. You pick a door, say door A [but the door is not opened], and the host, who knows what's behind the doors, opens another door, say door B, which has a goat. He then says to you, "Do you want to pick door C?" Is it to your advantage to switch your choice? A B B C C

4 The Monty Hall Problem You're given the choice of three doors: Behind one door is a car; behind the others, goats. You pick a door, say door A [but the door is not opened], and the host, who knows what's behind the doors, opens another door, say door B, which has a goat. He then says to you, "Do you want to pick door C?" Is it to your advantage to switch your choice? A B B C C

5 The Monty Hall Problem You're given the choice of three doors: Behind one door is a car; behind the others, goats. You pick a door, say door A [but the door is not opened], and the host, who knows what's behind the doors, opens another door, say door B, which has a goat. He then says to you, "Do you want to pick door C?" Is it to your advantage to switch your choice? A B C

6 Bayes Theorem P(A B) = P(B A)P(A) P(B) P(car is behind A door B opened) = P(door B opened car is behind A) = 0.5 P(car is behind A door B opened) = Why is door C different? P(door B opened car is behind A)P(car is behind A) P(door B opened) 0.5 * = 0.33 EARTH SURFACE

7 Bayes Theorem P(A B) = P(B A)P(A) P(B) P(car is behind A door B opened) = P(door B opened car is behind A) = 0.5 P(door B opened car is behind A)P(car is behind A) P(door B opened) P(car is behind A door B opened) = 0.5* Why is door C different? P(door B opened car is behind C) =1 = 0.33 EARTH SURFACE

8 Updating an Initial Guess A cab was involved in a hit-and-run accident at night 85% of the cabs in the city are Green and 15% are Blue A witness identified the cab as Blue. Tests show that this witness correctly identifies the color of the cab 80% of the time What is the probability the cab was involved in the accident was Blue? EARTH SURFACE Set-up from Thinking, Fast and Slow (Kahneman)

9 Combine observation with a priori information P(car is Blue witnessed Blue) = P(car is blue) = 0.15 P(witnessed Blue car is Blue)P(car is blue) P(witnessed Blue) P(witnessed Blue car is Blue) = 0.8 P(witnessed Blue) = 0.8* *0.85 = 0.29 EARTH SURFACE P(car is Blue witnessed Blue) = 0.8 * = 0.41

10 Constraining Emissions Western US Eastern US Column Units: molec/cm 2 Observed Column: Observed Column: Modeled Column: Modeled Column: Emissions = Emissions = Emissions units 100 Tg/yr Modeled Column ~ Western Emissions Modeled Column ~ Western Emissions + Eastern Emissions

11 Bayesian Inversion P(X(emissions) Y(observations)) = K T S ε 1 (Kˆ x y) + S a 1 (ˆ x x a ) = 0 P(Y X)P(X) P(Y) y = Kx = 1 0 x 1 = 1 1 x 2 x 1 x 1 + x 2 ˆ x = x a + G(y Kˆ x a ) G = S a K T ( K S a K T + S ) 1 ε

12 Constraining Emissions Observed Column: Observed Column: Modeled Column: Modeled Column: Emissions = Emissions = S a = S ε = 2 * *0.5 2 G = S a K T ( K S a K T + S ) ε = (y Kˆ x a ) = =.5 1 x ˆ = x a + G(y Kˆ x a ) =

13 Estimating CO Sources Why CO? Strong link between free troposphere and regional emissions Relatively easy to observe from space Important to compare results using optimized sources to independent data sets CO can be used to optimize emissions/concentrations of other species CO 2, ozone [Arellano et al 2004]

Lecture 2. Conditional Probability

Lecture 2. Conditional Probability Math 408 - Mathematical Statistics Lecture 2. Conditional Probability January 18, 2013 Konstantin Zuev (USC) Math 408, Lecture 2 January 18, 2013 1 / 9 Agenda Motivation and Definition Properties of Conditional

More information

Conditional Probability. CS231 Dianna Xu

Conditional Probability. CS231 Dianna Xu Conditional Probability CS231 Dianna Xu 1 Boy or Girl? A couple has two children, one of them is a girl. What is the probability that the other one is also a girl? Assuming 50/50 chances of conceiving

More information

Consider an experiment that may have different outcomes. We are interested to know what is the probability of a particular set of outcomes.

Consider an experiment that may have different outcomes. We are interested to know what is the probability of a particular set of outcomes. CMSC 310 Artificial Intelligence Probabilistic Reasoning and Bayesian Belief Networks Probabilities, Random Variables, Probability Distribution, Conditional Probability, Joint Distributions, Bayes Theorem

More information

Outline. Introduction. Bayesian Probability Theory Bayes rule Bayes rule applied to learning Bayesian learning and the MDL principle

Outline. Introduction. Bayesian Probability Theory Bayes rule Bayes rule applied to learning Bayesian learning and the MDL principle Outline Introduction Bayesian Probability Theory Bayes rule Bayes rule applied to learning Bayesian learning and the MDL principle Sequence Prediction and Data Compression Bayesian Networks Copyright 2015

More information

Machine Learning. CS Spring 2015 a Bayesian Learning (I) Uncertainty

Machine Learning. CS Spring 2015 a Bayesian Learning (I) Uncertainty Machine Learning CS6375 --- Spring 2015 a Bayesian Learning (I) 1 Uncertainty Most real-world problems deal with uncertain information Diagnosis: Likely disease given observed symptoms Equipment repair:

More information

Basics on Probability. Jingrui He 09/11/2007

Basics on Probability. Jingrui He 09/11/2007 Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability

More information

CS 361: Probability & Statistics

CS 361: Probability & Statistics February 12, 2018 CS 361: Probability & Statistics Random Variables Monty hall problem Recall the setup, there are 3 doors, behind two of them are indistinguishable goats, behind one is a car. You pick

More information

Lecture 1: Review of Probability

Lecture 1: Review of Probability EAS31136/B9036: Statistics in Earth & Atmospheric Sciences Lecture 1: Review of Probability Instructor: Prof. Johnny Luo www.sci.ccny.cuny.edu/~luo Dates Topic Reading (Based on the 2 nd Edition of Wilks

More information

Lecture 4 Bayes Theorem

Lecture 4 Bayes Theorem 1 / 24 Lecture 4 Bayes Theorem September 09, 2010 2 / 24 Lesson Plan 1. Bayes Theorem 2. Simpson s Paradox 3. More worked problems 3 / 24 Why Study Probability? A probability model describes the random

More information

Lecture 4 Bayes Theorem

Lecture 4 Bayes Theorem Lecture 4 Bayes Theorem Thais Paiva STA 111 - Summer 2013 Term II July 5, 2013 Lecture Plan 1 Probability Review 2 Bayes Theorem 3 More worked problems Why Study Probability? A probability model describes

More information

Probability, Statistics, and Bayes Theorem Session 3

Probability, Statistics, and Bayes Theorem Session 3 Probability, Statistics, and Bayes Theorem Session 3 1 Introduction Now that we know what Bayes Theorem is, we want to explore some of the ways that it can be used in real-life situations. Often the results

More information

STAT509: Probability

STAT509: Probability University of South Carolina August 20, 2014 The Engineering Method and Statistical Thinking The general steps of engineering method are: 1. Develop a clear and concise description of the problem. 2. Identify

More information

Lecture 3. January 7, () Lecture 3 January 7, / 35

Lecture 3. January 7, () Lecture 3 January 7, / 35 Lecture 3 January 7, 2013 () Lecture 3 January 7, 2013 1 / 35 Outline This week s lecture: Fast review of last week s lecture: Conditional probability. Partition, Partition theorem. Bayes theorem and its

More information

Conditional probability

Conditional probability CHAPTER 4 Conditional probability 4.1. Introduction Suppose there are 200 men, of which 100 are smokers, and 100 women, of which 20 are smokers. What is the probability that a person chosen at random will

More information

Sampling Based Filters

Sampling Based Filters Statistical Techniques in Robotics (6-83, F4) Lecture#3 (Tuesday September 2) Sampling Based Filters Lecturer: Drew Bagnell Scribe:Haley Dalzell, Matt Barnes, De-An Huang Monty Hall Problem The Monty Hall

More information

More on conditioning and Mr. Bayes

More on conditioning and Mr. Bayes More on conditioning and Mr. Bayes Saad Mneimneh 1 Multiplication rule for conditioning We can generalize the formula P(A,B) P(A B)P(B) to more than two events. For instance, P(A,B,C) P(A)P(B A)P(C A,B).

More information

Some Basic Concepts of Probability and Information Theory: Pt. 1

Some Basic Concepts of Probability and Information Theory: Pt. 1 Some Basic Concepts of Probability and Information Theory: Pt. 1 PHYS 476Q - Southern Illinois University January 18, 2018 PHYS 476Q - Southern Illinois University Some Basic Concepts of Probability and

More information

Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10

Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10 EECS 70 Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10 Introduction to Basic Discrete Probability In the last note we considered the probabilistic experiment where we flipped

More information

2.4 Conditional Probability

2.4 Conditional Probability 2.4 Conditional Probability The probabilities assigned to various events depend on what is known about the experimental situation when the assignment is made. Example: Suppose a pair of dice is tossed.

More information

the time it takes until a radioactive substance undergoes a decay

the time it takes until a radioactive substance undergoes a decay 1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete

More information

Lecture 3: Probability

Lecture 3: Probability Lecture 3: Probability 28th of October 2015 Lecture 3: Probability 28th of October 2015 1 / 36 Summary of previous lecture Define chance experiment, sample space and event Introduce the concept of the

More information

Intermediate Math Circles November 15, 2017 Probability III

Intermediate Math Circles November 15, 2017 Probability III Intermediate Math Circles November 5, 07 Probability III Example : You have bins in which there are coloured balls. The balls are identical except for their colours. The contents of the containers are:

More information

DRAGON ADVANCED TRAINING COURSE IN ATMOSPHERE REMOTE SENSING. Inversion basics. Erkki Kyrölä Finnish Meteorological Institute

DRAGON ADVANCED TRAINING COURSE IN ATMOSPHERE REMOTE SENSING. Inversion basics. Erkki Kyrölä Finnish Meteorological Institute Inversion basics y = Kx + ε x ˆ = (K T K) 1 K T y Erkki Kyrölä Finnish Meteorological Institute Day 3 Lecture 1 Retrieval techniques - Erkki Kyrölä 1 Contents 1. Introduction: Measurements, models, inversion

More information

Discrete Mathematics

Discrete Mathematics Discrete Mathematics Workshop Organized by: ACM Unit, ISI Tutorial-1 Date: 05.07.2017 (Q1) Given seven points in a triangle of unit area, prove that three of them form a triangle of area not exceeding

More information

Chapter 1 Principles of Probability

Chapter 1 Principles of Probability Chapter Principles of Probability Combining independent probabilities You have applied to three medical schools: University of California at San Francisco (UCSF), Duluth School of Mines (DSM), and Harvard

More information

18.05 Problem Set 5, Spring 2014 Solutions

18.05 Problem Set 5, Spring 2014 Solutions 8.0 Problem Set, Spring 04 Solutions Problem. (0 pts.) (a) We know that y i ax i b = ε i N(0,σ ). y i = ε i + ax i + b N(ax i + b, σ ). That is, Therefore f(y i a, b, x i,σ)= e (y i ax i b) σ π σ. (b)

More information

Bayesian Learning. Reading: Tom Mitchell, Generative and discriminative classifiers: Naive Bayes and logistic regression, Sections 1-2.

Bayesian Learning. Reading: Tom Mitchell, Generative and discriminative classifiers: Naive Bayes and logistic regression, Sections 1-2. Bayesian Learning Reading: Tom Mitchell, Generative and discriminative classifiers: Naive Bayes and logistic regression, Sections 1-2. (Linked from class website) Conditional Probability Probability of

More information

Probability Pr(A) 0, for any event A. 2. Pr(S) = 1, for the sample space S. 3. If A and B are mutually exclusive, Pr(A or B) = Pr(A) + Pr(B).

Probability Pr(A) 0, for any event A. 2. Pr(S) = 1, for the sample space S. 3. If A and B are mutually exclusive, Pr(A or B) = Pr(A) + Pr(B). This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this

More information

Stat 225 Week 2, 8/27/12-8/31/12, Notes: Independence and Bayes Rule

Stat 225 Week 2, 8/27/12-8/31/12, Notes: Independence and Bayes Rule Stat 225 Week 2, 8/27/12-8/31/12, Notes: Independence and Bayes Rule The Fall 2012 Stat 225 T.A.s September 7, 2012 1 Monday, 8/27/12, Notes on Independence In general, a conditional probability will change

More information

Probabilistic models

Probabilistic models Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became

More information

C Examples of Bayes Calculations

C Examples of Bayes Calculations There are two buckets containing poker chips. Bucket A has Bucket B has 700 red chips 300 blue chips 300 red chips 700 blue chips Flip a coin to choose a bucket at random. From the chosen bucket, select

More information

ORF 245 Fundamentals of Statistics Chapter 5 Probability

ORF 245 Fundamentals of Statistics Chapter 5 Probability ORF 245 Fundamentals of Statistics Chapter 5 Probability Robert Vanderbei Oct 2015 Slides last edited on October 14, 2015 http://www.princeton.edu/ rvdb Sample Spaces (aka Populations) and Events When

More information

Lecture 04: Conditional Probability. Lisa Yan July 2, 2018

Lecture 04: Conditional Probability. Lisa Yan July 2, 2018 Lecture 04: Conditional Probability Lisa Yan July 2, 2018 Announcements Problem Set #1 due on Friday Gradescope submission portal up Use Piazza No class or OH on Wednesday July 4 th 2 Summary from last

More information

Uncertainty. Russell & Norvig Chapter 13.

Uncertainty. Russell & Norvig Chapter 13. Uncertainty Russell & Norvig Chapter 13 http://toonut.com/wp-content/uploads/2011/12/69wp.jpg Uncertainty Let A t be the action of leaving for the airport t minutes before your flight Will A t get you

More information

Introduction to Machine Learning (Pattern recognition and model fitting) for Master students

Introduction to Machine Learning (Pattern recognition and model fitting) for Master students Introduction to Machine Learning (Pattern recognition and model fitting) for Master students Spring 007, ÖU/RAP Thorsteinn Rögnvaldsson thorsteinn.rognvaldsson@tech.oru.se Contents Machine learning algorithms

More information

Basic Statistics for SGPE Students Part II: Probability theory 1

Basic Statistics for SGPE Students Part II: Probability theory 1 Basic Statistics for SGPE Students Part II: Probability theory 1 Mark Mitchell mark.mitchell@ed.ac.uk Nicolai Vitt n.vitt@ed.ac.uk University of Edinburgh September 2016 1 Thanks to Achim Ahrens, Anna

More information

Statistika pro informatiku

Statistika pro informatiku Statistika pro informatiku prof. RNDr. Roman Kotecký DrSc., Dr. Rudolf Blažek, PhD Katedra teoretické informatiky FIT České vysoké učení technické v Praze MI-SPI, ZS 2011/12, Přednáška 2 Evropský sociální

More information

With Question/Answer Animations. Chapter 7

With Question/Answer Animations. Chapter 7 With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements

More information

Conditional Probability, Independence, Bayes Theorem Spring January 1, / 23

Conditional Probability, Independence, Bayes Theorem Spring January 1, / 23 Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2014 January 1, 2017 1 / 23 Sample Space Confusions 1. Sample space = set of all possible outcomes of an experiment. 2. The size of the

More information

Conditional Probability, Independence, Bayes Theorem Spring 2018

Conditional Probability, Independence, Bayes Theorem Spring 2018 Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2018 Slides are Posted Don t forget that after class we post the slides including solutions to all the questions. February 13, 2018 2 /

More information

Joint, Conditional, & Marginal Probabilities

Joint, Conditional, & Marginal Probabilities Joint, Conditional, & Marginal Probabilities The three axioms for probability don t discuss how to create probabilities for combined events such as P [A B] or for the likelihood of an event A given that

More information

Lecture Overview. Introduction to Artificial Intelligence COMP 3501 / COMP Lecture 11: Uncertainty. Uncertainty.

Lecture Overview. Introduction to Artificial Intelligence COMP 3501 / COMP Lecture 11: Uncertainty. Uncertainty. Lecture Overview COMP 3501 / COMP 4704-4 Lecture 11: Uncertainty Return HW 1/Midterm Short HW 2 discussion Uncertainty / Probability Prof. JGH 318 Uncertainty Previous approaches dealt with relatively

More information

COS 424: Interacting with Data. Lecturer: Dave Blei Lecture #2 Scribe: Ellen Kim February 7, 2008

COS 424: Interacting with Data. Lecturer: Dave Blei Lecture #2 Scribe: Ellen Kim February 7, 2008 COS 424: Interacting with Data Lecturer: Dave Blei Lecture #2 Scribe: Ellen Kim February 7, 2008 1 Probability Review 1.1 Random Variables A random variable can be used to model any probabilistic outcome.

More information

Homework 4 solutions

Homework 4 solutions Homework 4 solutions Due Thu, Sept 25, 2003 Problem 2 p.104 Certainly for i < 7 we know that this conditional probability must be zero (there aren t any negative numbers on the dice). i = 7 The first die

More information

Consider the joint probability, P(x,y), shown as the contours in the figure above. P(x) is given by the integral of P(x,y) over all values of y.

Consider the joint probability, P(x,y), shown as the contours in the figure above. P(x) is given by the integral of P(x,y) over all values of y. ATMO/OPTI 656b Spring 009 Bayesian Retrievals Note: This follows the discussion in Chapter of Rogers (000) As we have seen, the problem with the nadir viewing emission measurements is they do not contain

More information

Statistical Methods for Astronomy

Statistical Methods for Astronomy Statistical Methods for Astronomy Probability (Lecture 1) Statistics (Lecture 2) Why do we need statistics? Useful Statistics Definitions Error Analysis Probability distributions Error Propagation Binomial

More information

Sets, measure and probability

Sets, measure and probability Chapter 1 Sets, measure and probability 1.1 Notes Logic If p, q denote propostions then ->p denotes the proposition "not p"; p A q denotes the proposition "p and q"; pv? denotes the proposition "p or q";

More information

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten

More information

Lecture 3 - More Conditional Probability

Lecture 3 - More Conditional Probability Lecture 3 - More Conditional Probability Statistics 02 Colin Rundel January 23, 203 Review R course Library R Course http:// library.duke.edu/ events/ data/ event.do? id=645&occur=4025 Statistics 02 (Colin

More information

CS 361: Probability & Statistics

CS 361: Probability & Statistics September 12, 2017 CS 361: Probability & Statistics Correlation Summary of what we proved We wanted a way of predicting y from x We chose to think in standard coordinates and to use a linear predictor

More information

CS 559: Machine Learning Fundamentals and Applications 2 nd Set of Notes

CS 559: Machine Learning Fundamentals and Applications 2 nd Set of Notes 1 CS 559: Machine Learning Fundamentals and Applications 2 nd Set of Notes Instructor: Philippos Mordohai Webpage: www.cs.stevens.edu/~mordohai E-mail: Philippos.Mordohai@stevens.edu Office: Lieb 215 Overview

More information

Monty Hall and Bayes s Theorem. Leslie Burkholder. Department Philosophy. University British Columbia. Vancouver V6T1Z1 Canada

Monty Hall and Bayes s Theorem. Leslie Burkholder. Department Philosophy. University British Columbia. Vancouver V6T1Z1 Canada Monty Hall and Bayes s Theorem Leslie Burkholder Department Philosophy University British Columbia Vancouver V6T1Z1 Canada lburkhdl@interchange.ubc.ca Revision Date = 07 Dec 2000 Monty Hall and Bayes s

More information

Probability Distributions. Conditional Probability.

Probability Distributions. Conditional Probability. Probability Distributions. Conditional Probability. CSE21 Winter 2017, Day 21 (B00), Day 14 (A00) March 6, 2017 http://vlsicad.ucsd.edu/courses/cse21-w17 Probability Rosen p. 446, 453 Sample space, S:

More information

6.080 / Great Ideas in Theoretical Computer Science Spring 2008

6.080 / Great Ideas in Theoretical Computer Science Spring 2008 MIT OpenCourseWare http://ocw.mit.edu 6.080 / 6.089 Great Ideas in Theoretical Computer Science Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

Extended Algorithms Courses COMP3821/9801

Extended Algorithms Courses COMP3821/9801 NEW SOUTH WALES Extended Algorithms Courses Aleks Ignjatović School of Computer Science and Engineering University of New South Wales rithms What are we going to do in this class We will do: randomised

More information

Formalizing Probability. Choosing the Sample Space. Probability Measures

Formalizing Probability. Choosing the Sample Space. Probability Measures Formalizing Probability Choosing the Sample Space What do we assign probability to? Intuitively, we assign them to possible events (things that might happen, outcomes of an experiment) Formally, we take

More information

Chapter 6 Conditional Probability

Chapter 6 Conditional Probability Lecture Notes o robability Coditioal robability 6. Suppose RE a radom experimet S sample space C subset of S φ (i.e. (C > 0 A ay evet Give that C must occur, the the probability that A happe is the coditioal

More information

Notes slides from before lecture. CSE 21, Winter 2017, Section A00. Lecture 15 Notes. Class URL:

Notes slides from before lecture. CSE 21, Winter 2017, Section A00. Lecture 15 Notes. Class URL: Notes slides from before lecture CSE 21, Winter 2017, Section A00 Lecture 15 Notes Class URL: http://vlsicad.ucsd.edu/courses/cse21-w17/ Notes slides from before lecture Notes March 6 (1) This week: Days

More information

Slides 5: Reasoning with Random Numbers

Slides 5: Reasoning with Random Numbers Slides 5: Reasoning with Random Numbers Realistic Simulating What is convincing? Fast and efficient? Solving Problems Simulation Approach Using Thought Experiment or Theory Formal Language 1 Brain Teasers

More information

Conditional Probability, Independence, Bayes Theorem Spring January 1, / 28

Conditional Probability, Independence, Bayes Theorem Spring January 1, / 28 Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2014 January 1, 2017 1 / 28 Sample Space Confusions 1. Sample space = set of all possible outcomes of an experiment. 2. The size of the

More information

CSC Discrete Math I, Spring Discrete Probability

CSC Discrete Math I, Spring Discrete Probability CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields

More information

Sheet 4 solutions. May 15, 2017

Sheet 4 solutions. May 15, 2017 Sheet 4 solutions May 15, 2017 Exercise 1: Bayes Rule Suppose you are a witness to a nighttime hit-and-run accident involving a taxi in Athens. All taxi cars in Athens are blue or green. You swear under

More information

Probability: Part 1 Naima Hammoud

Probability: Part 1 Naima Hammoud Probability: Part 1 Naima ammoud Feb 7, 2017 Motivation ossing a coin Rolling a die Outcomes: eads or ails Outcomes: 1, 2, 3, 4, 5 or 6 Defining Probability If I toss a coin, there is a 50% chance I will

More information

Discrete Random Variables

Discrete Random Variables Discrete Random Variables An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan Introduction The markets can be thought of as a complex interaction of a large number of random processes,

More information

Bayes Rule for probability

Bayes Rule for probability Bayes Rule for probability P A B P A P B A PAP B A P AP B A An generalization of Bayes Rule Let A, A 2,, A k denote a set of events such that S A A2 Ak and Ai Aj for all i and j. Then P A i B P Ai P B

More information

An Introduction to Bayesian Reasoning

An Introduction to Bayesian Reasoning Tilburg Center for Logic and Philosophy of Science (TiLPS) Tilburg University, The Netherlands EPS Seminar, TiLPS, 9 October 2013 Overview of the Tutorial This tutorial aims at giving you an idea of why

More information

(3) Review of Probability. ST440/540: Applied Bayesian Statistics

(3) Review of Probability. ST440/540: Applied Bayesian Statistics Review of probability The crux of Bayesian statistics is to compute the posterior distribution, i.e., the uncertainty distribution of the parameters (θ) after observing the data (Y) This is the conditional

More information

First Digit Tally Marks Final Count

First Digit Tally Marks Final Count Benford Test () Imagine that you are a forensic accountant, presented with the two data sets on this sheet of paper (front and back). Which of the two sets should be investigated further? Why? () () ()

More information

Conditional Probability and Update Logic

Conditional Probability and Update Logic Conditional Probability and Update Logic 1 Second version, January 2003 Johan van Benthem, Amsterdam & Stanford Abstract ynamic update of information states is the dernier cri in logical semantics. And

More information

Elementary Discrete Probability

Elementary Discrete Probability Elementary Discrete Probability MATH 472 Financial Mathematics J Robert Buchanan 2018 Objectives In this lesson we will learn: the terminology of elementary probability, elementary rules of probability,

More information

Bayesian Machine Learning

Bayesian Machine Learning Bayesian Machine Learning Andrew Gordon Wilson ORIE 6741 Lecture 2: Bayesian Basics https://people.orie.cornell.edu/andrew/orie6741 Cornell University August 25, 2016 1 / 17 Canonical Machine Learning

More information

CMPSCI 240: Reasoning about Uncertainty

CMPSCI 240: Reasoning about Uncertainty CMPSCI 240: Reasoning about Uncertainty Lecture 4: Sequential experiments Andrew McGregor University of Massachusetts Last Compiled: February 2, 2017 Outline 1 Recap 2 Sequential Experiments 3 Total Probability

More information

III. Naïve Bayes (pp.70-72) Probability review

III. Naïve Bayes (pp.70-72) Probability review III. Naïve Bayes (pp.70-72) This is a short section in our text, but we are presenting more material in these notes. Probability review Definition of probability: The probability of an even E is the ratio

More information

Bayesian Astronomy with R Aaron Robotham, ICRAR, UWA

Bayesian Astronomy with R Aaron Robotham, ICRAR, UWA Get this lecture at: https://dl.dropboxusercontent.com/u/ 10495241/AstroR-Bayes-Lec1.pdf Bayesian Astronomy with R Aaron Robotham, ICRAR, UWA Lecture 1 Get R at http://cran.rstudio.com/ Download Laplace

More information

Lecture 3 Probability Basics

Lecture 3 Probability Basics Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability

More information

Bi=[X=i] i=i,z, forma partition. Example

Bi=[X=i] i=i,z, forma partition. Example Example Suppose that a person plays a game in which his score must be one of the 50 numbers 1, 2,,50 and that each of these 50 numbers is equally likely to be his score The first time he plays the game,

More information

Lecture 1: Basics of Probability

Lecture 1: Basics of Probability Lecture 1: Basics of Probability (Luise-Vitetta, Chapter 8) Why probability in data science? Data acquisition is noisy Sampling/quantization external factors: If you record your voice saying machine learning

More information

P (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).

P (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B). Lectures 7-8 jacques@ucsdedu 41 Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information,

More information

A Event has occurred

A Event has occurred Statistics and probability: 1-1 1. Probability Event: a possible outcome or set of possible outcomes of an experiment or observation. Typically denoted by a capital letter: A, B etc. E.g. The result of

More information

Introduction to Probability Theory, Algebra, and Set Theory

Introduction to Probability Theory, Algebra, and Set Theory Summer School on Mathematical Philosophy for Female Students Introduction to Probability Theory, Algebra, and Set Theory Catrin Campbell-Moore and Sebastian Lutz July 28, 2014 Question 1. Draw Venn diagrams

More information

Probabilistic models

Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation

More information

Using Probability to do Statistics.

Using Probability to do Statistics. Al Nosedal. University of Toronto. November 5, 2015 Milk and honey and hemoglobin Animal experiments suggested that honey in a diet might raise hemoglobin level. A researcher designed a study involving

More information

Directed Graphical Models (aka. Bayesian Networks)

Directed Graphical Models (aka. Bayesian Networks) School of Computer Science 10-601B Introduction to Machine Learning Directed Graphical Models (aka. Bayesian Networks) Readings: Bishop 8.1 and 8.2.2 Mitchell 6.11 Murphy 10 Matt Gormley Lecture 21 November

More information

AST 418/518 Instrumentation and Statistics

AST 418/518 Instrumentation and Statistics AST 418/518 Instrumentation and Statistics Class Website: http://ircamera.as.arizona.edu/astr_518 Class Texts: Practical Statistics for Astronomers, J.V. Wall, and C.R. Jenkins Measuring the Universe,

More information

Probability Distributions. Conditional Probability

Probability Distributions. Conditional Probability Probability Distributions. Conditional Probability Russell Impagliazzo and Miles Jones Thanks to Janine Tiefenbruck http://cseweb.ucsd.edu/classes/sp16/cse21-bd/ May 16, 2016 In probability, we want to

More information

Discrete Random Variables

Discrete Random Variables Discrete Random Variables An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan 2014 Introduction The markets can be thought of as a complex interaction of a large number of random

More information

Introduction to Scientific Computing PSCB57, Final Exam

Introduction to Scientific Computing PSCB57, Final Exam Name: Student number: Introduction to Scientific Computing PSCB57, Final Exam Professor Hanno Rein University of Toronto, Scarborough Wednesday, December 7th, 2016, 2pm-4pm Points Question 1 6 Question

More information

Lower bound for sorting/probability Distributions

Lower bound for sorting/probability Distributions Lower bound for sorting/probability Distributions CSE21 Winter 2017, Day 20 (B00), Day 14 (A00) March 3, 2017 http://vlsicad.ucsd.edu/courses/cse21-w17 Another application of counting lower bounds Sorting

More information

University of California, Los Angeles Department of Statistics. Exam 1 21 October 2011

University of California, Los Angeles Department of Statistics. Exam 1 21 October 2011 University of California, Los Angeles Department of Statistics Statistics 00A Instructor: Nicolas Christou Exam 2 October 20 Name: Problem (20 points) a. Let X follow the Poisson distribution with parameter

More information

ECE531 Homework Assignment Number 2

ECE531 Homework Assignment Number 2 ECE53 Homework Assignment Number 2 Due by 8:5pm on Thursday 5-Feb-29 Make sure your reasoning and work are clear to receive full credit for each problem 3 points A city has two taxi companies distinguished

More information

n How to represent uncertainty in knowledge? n Which action to choose under uncertainty? q Assume the car does not have a flat tire

n How to represent uncertainty in knowledge? n Which action to choose under uncertainty? q Assume the car does not have a flat tire Uncertainty Uncertainty Russell & Norvig Chapter 13 Let A t be the action of leaving for the airport t minutes before your flight Will A t get you there on time? A purely logical approach either 1. risks

More information

MATHEMATICS 191, FALL 2004 MATHEMATICAL PROBABILITY Outline #3 (Conditional Probability)

MATHEMATICS 191, FALL 2004 MATHEMATICAL PROBABILITY Outline #3 (Conditional Probability) Last modified: October 5, 2004 References: PRP, sections 1.4, 1.5 and 1.7 EP, Chapter 2 MATHEMATICS, FALL 2004 MATHEMATICAL PROBABILITY Outline #3 (Conditional Probability) 1. Define conditional probability

More information

Conditional Probability P( )

Conditional Probability P( ) Conditional Probability P( ) 1 conditional probability where P(F) > 0 Conditional probability of E given F: probability that E occurs given that F has occurred. Conditioning on F Written as P(E F) Means

More information

CS-E3210 Machine Learning: Basic Principles

CS-E3210 Machine Learning: Basic Principles CS-E3210 Machine Learning: Basic Principles Lecture 4: Regression II slides by Markus Heinonen Department of Computer Science Aalto University, School of Science Autumn (Period I) 2017 1 / 61 Today s introduction

More information

Inverse problems and uncertainty quantification in remote sensing

Inverse problems and uncertainty quantification in remote sensing 1 / 38 Inverse problems and uncertainty quantification in remote sensing Johanna Tamminen Finnish Meterological Institute johanna.tamminen@fmi.fi ESA Earth Observation Summer School on Earth System Monitoring

More information

ORF 245 Fundamentals of Statistics Chapter 1 Probability

ORF 245 Fundamentals of Statistics Chapter 1 Probability ORF 245 Fundamentals of Statistics Chapter 1 Probability Robert Vanderbei Sept 2014 Slides last edited on September 19, 2014 http://www.princeton.edu/ rvdb Course Info Prereqs: Textbook: Three semesters

More information

A(VeryBrief)IntroductiontoIdealPoint Estimates

A(VeryBrief)IntroductiontoIdealPoint Estimates A(VeryBrief)IntroductiontoIdealPoint Estimates 1 Motivation 2 3 4 5 Motivation A cab was involved in a hit-and run accident at night. Two cab companies (Green and Blue) operate the city. 85% of the cabs

More information

arxiv: v1 [stat.ot] 5 Aug 2014

arxiv: v1 [stat.ot] 5 Aug 2014 1 The Final Solutions of Monty Hall Problem and Three Prisoners Problem arxiv:1408.0963v1 [stat.ot] 5 Aug 2014 Shiro Ishikawa Department of Mathematics, Faculty of Science and Technology, Keio University,

More information

Two hours UNIVERSITY OF MANCHESTER SCHOOL OF COMPUTER SCIENCE. Date: Monday 22nd May 2017 Time: 09:45-11:45

Two hours UNIVERSITY OF MANCHESTER SCHOOL OF COMPUTER SCIENCE. Date: Monday 22nd May 2017 Time: 09:45-11:45 COMP 14112 Two hours UNIVERSITY OF MANCHESTER SCHOOL OF COMPUTER SCIENCE Fundamentals of Artificial Intelligence Date: Monday 22nd May 2017 Time: 09:45-11:45 Answer One Question from Section A and One

More information

Bayes Formula. MATH 107: Finite Mathematics University of Louisville. March 26, 2014

Bayes Formula. MATH 107: Finite Mathematics University of Louisville. March 26, 2014 Bayes Formula MATH 07: Finite Mathematics University of Louisville March 26, 204 Test Accuracy Conditional reversal 2 / 5 A motivating question A rare disease occurs in out of every 0,000 people. A test

More information