Applied Probability. School of Mathematics and Statistics, University of Sheffield. (University of Sheffield) Applied Probability / 8

Size: px
Start display at page:

Download "Applied Probability. School of Mathematics and Statistics, University of Sheffield. (University of Sheffield) Applied Probability / 8"

Transcription

1 Applied Probability School of Mathematics and Statistics, University of Sheffield (University of Sheffield) Applied Probability / 8

2 Introduction You will have seen probability models. (University of Sheffield) Applied Probability / 8

3 Introduction You will have seen probability models. For example, discrete variables Y 1,..., Y n form a (discrete time) Markov chain if P(Y k = y k Y k 1 = y k 1 ) = p yk 1,y k (University of Sheffield) Applied Probability / 8

4 Introduction You will have seen probability models. For example, discrete variables Y 1,..., Y n form a (discrete time) Markov chain if P(Y k = y k Y k 1 = y k 1 ) = p yk 1,y k where p yk 1,y k matrix P. is the (y k 1, y k ) th element of a transition probability (University of Sheffield) Applied Probability / 8

5 This module This module builds on that in a number of ways. (University of Sheffield) Applied Probability / 8

6 This module This module builds on that in a number of ways. It will introduce further types of probability model: it will extend the idea of a Markov chain to continuous time; (University of Sheffield) Applied Probability / 8

7 This module This module builds on that in a number of ways. It will introduce further types of probability model: it will extend the idea of a Markov chain to continuous time; it will look at models for random scatterings of points. (University of Sheffield) Applied Probability / 8

8 Inference It will also consider the idea of how we might carry out inference for our probability models. (University of Sheffield) Applied Probability / 8

9 Inference It will also consider the idea of how we might carry out inference for our probability models. A simple example is where we have a discrete time Markov chain with two states, but with an unknown transition matrix ( ) θ1 1 θ 1, 1 θ 2 θ 2 where we have unknown parameters θ = (θ 1, θ 2 ). (University of Sheffield) Applied Probability / 8

10 Inference It will also consider the idea of how we might carry out inference for our probability models. A simple example is where we have a discrete time Markov chain with two states, but with an unknown transition matrix ( ) θ1 1 θ 1, 1 θ 2 θ 2 where we have unknown parameters θ = (θ 1, θ 2 ). We can ask the question of how to learn about these parameters θ from observations Y 1,..., Y n. (University of Sheffield) Applied Probability / 8

11 Likelihood There are lots of special cases, but for most purposes we use the likelihood L(θ y 1,..., y n ) = P(Y 1 = y 1,..., Y n = y n θ). (University of Sheffield) Applied Probability / 8

12 Likelihood There are lots of special cases, but for most purposes we use the likelihood L(θ y 1,..., y n ) = P(Y 1 = y 1,..., Y n = y n θ). or the corresponding log-likelihood l = log L. (University of Sheffield) Applied Probability / 8

13 Likelihood There are lots of special cases, but for most purposes we use the likelihood L(θ y 1,..., y n ) = P(Y 1 = y 1,..., Y n = y n θ). or the corresponding log-likelihood l = log L. We will also see applied problems in which probability models and statistical inference for their parameters are useful. Examples of modelling will be drawn from meteorology, epidemic studies, manpower planning, seismology, disease mapping and elsewhere. (University of Sheffield) Applied Probability / 8

14 Likelihood There are lots of special cases, but for most purposes we use the likelihood L(θ y 1,..., y n ) = P(Y 1 = y 1,..., Y n = y n θ). or the corresponding log-likelihood l = log L. We will also see applied problems in which probability models and statistical inference for their parameters are useful. Examples of modelling will be drawn from meteorology, epidemic studies, manpower planning, seismology, disease mapping and elsewhere. We will also look at the wider question of how to develop models to address particular questions, including issues of model fit and model comparison. (University of Sheffield) Applied Probability / 8

15 Contents Theory, examples, and some computation. (University of Sheffield) Applied Probability / 8

16 Contents Theory, examples, and some computation. Basic Poisson process, and review of Markov chains (University of Sheffield) Applied Probability / 8

17 Contents Theory, examples, and some computation. Basic Poisson process, and review of Markov chains Likelihood-based inference (University of Sheffield) Applied Probability / 8

18 Contents Theory, examples, and some computation. Basic Poisson process, and review of Markov chains Likelihood-based inference Inference for Markov chains (University of Sheffield) Applied Probability / 8

19 Contents Theory, examples, and some computation. Basic Poisson process, and review of Markov chains Likelihood-based inference Inference for Markov chains Continuous time Markov chains (University of Sheffield) Applied Probability / 8

20 Contents Theory, examples, and some computation. Basic Poisson process, and review of Markov chains Likelihood-based inference Inference for Markov chains Continuous time Markov chains Extensions of the Poisson process (University of Sheffield) Applied Probability / 8

21 Contents Theory, examples, and some computation. Basic Poisson process, and review of Markov chains Likelihood-based inference Inference for Markov chains Continuous time Markov chains Extensions of the Poisson process Examples, including epidemics and queues (University of Sheffield) Applied Probability / 8

22 Assessment Exam at the end of the module. (University of Sheffield) Applied Probability / 8

23 Assessment Exam at the end of the module. Standard closed book exam. (University of Sheffield) Applied Probability / 8

24 Assessment Exam at the end of the module. Standard closed book exam. Note that this is a change from previous years, when the exam has been open book. (University of Sheffield) Applied Probability / 8

25 Feedback Three sets of exercises to hand in, in weeks 4, 7 and 10. (University of Sheffield) Applied Probability / 8

26 Feedback Three sets of exercises to hand in, in weeks 4, 7 and 10. These will be marked for feedback. (University of Sheffield) Applied Probability / 8

27 Feedback Three sets of exercises to hand in, in weeks 4, 7 and 10. These will be marked for feedback. Contacting me: jonathan.jordan@sheffield.ac.uk or room I9. (University of Sheffield) Applied Probability / 8

28 Feedback Three sets of exercises to hand in, in weeks 4, 7 and 10. These will be marked for feedback. Contacting me: jonathan.jordan@sheffield.ac.uk or room I9. Discussion board on MOLE. (University of Sheffield) Applied Probability / 8

29 Feedback Three sets of exercises to hand in, in weeks 4, 7 and 10. These will be marked for feedback. Contacting me: jonathan.jordan@sheffield.ac.uk or room I9. Discussion board on MOLE. Course website uk/applprob/index.html (University of Sheffield) Applied Probability / 8

Statistics & Data Sciences: First Year Prelim Exam May 2018

Statistics & Data Sciences: First Year Prelim Exam May 2018 Statistics & Data Sciences: First Year Prelim Exam May 2018 Instructions: 1. Do not turn this page until instructed to do so. 2. Start each new question on a new sheet of paper. 3. This is a closed book

More information

MAS156: Mathematics (Electrical and Aerospace)

MAS156: Mathematics (Electrical and Aerospace) MAS156: Mathematics (Electrical and Aerospace) Dr Sam Marsh mas-engineering@sheffield.ac.uk Tuesday 17th October 2017, 1pm Diamond LT4 Course matters Online tests Some people had problems in the early

More information

Content by Week Week of October 14 27

Content by Week Week of October 14 27 Content by Week Week of October 14 27 Learning objectives By the end of this week, you should be able to: Understand the purpose and interpretation of confidence intervals for the mean, Calculate confidence

More information

Topic 12 Overview of Estimation

Topic 12 Overview of Estimation Topic 12 Overview of Estimation Classical Statistics 1 / 9 Outline Introduction Parameter Estimation Classical Statistics Densities and Likelihoods 2 / 9 Introduction In the simplest possible terms, the

More information

Sequence Modelling with Features: Linear-Chain Conditional Random Fields. COMP-599 Oct 6, 2015

Sequence Modelling with Features: Linear-Chain Conditional Random Fields. COMP-599 Oct 6, 2015 Sequence Modelling with Features: Linear-Chain Conditional Random Fields COMP-599 Oct 6, 2015 Announcement A2 is out. Due Oct 20 at 1pm. 2 Outline Hidden Markov models: shortcomings Generative vs. discriminative

More information

6.041/6.431 Fall 2010 Final Exam Wednesday, December 15, 9:00AM - 12:00noon.

6.041/6.431 Fall 2010 Final Exam Wednesday, December 15, 9:00AM - 12:00noon. 6.041/6.431 Fall 2010 Final Exam Wednesday, December 15, 9:00AM - 12:00noon. DO NOT TURN THIS PAGE OVER UNTIL YOU ARE TOLD TO DO SO Name: Recitation Instructor: TA: Question Score Out of 1.1 4 1.2 4 1.3

More information

All other items including (and especially) CELL PHONES must be left at the front of the room.

All other items including (and especially) CELL PHONES must be left at the front of the room. TEST #2 / STA 5327 (Inference) / Spring 2017 (April 24, 2017) Name: Directions This exam is closed book and closed notes. You will be supplied with scratch paper, and a copy of the Table of Common Distributions

More information

Statistics 253/317 Introduction to Probability Models. Winter Midterm Exam Friday, Feb 8, 2013

Statistics 253/317 Introduction to Probability Models. Winter Midterm Exam Friday, Feb 8, 2013 Statistics 253/317 Introduction to Probability Models Winter 2014 - Midterm Exam Friday, Feb 8, 2013 Student Name (print): (a) Do not sit directly next to another student. (b) This is a closed-book, closed-note

More information

[Chapter 6. Functions of Random Variables]

[Chapter 6. Functions of Random Variables] [Chapter 6. Functions of Random Variables] 6.1 Introduction 6.2 Finding the probability distribution of a function of random variables 6.3 The method of distribution functions 6.5 The method of Moment-generating

More information

Week 5: Logistic Regression & Neural Networks

Week 5: Logistic Regression & Neural Networks Week 5: Logistic Regression & Neural Networks Instructor: Sergey Levine 1 Summary: Logistic Regression In the previous lecture, we covered logistic regression. To recap, logistic regression models and

More information

Evaluation Module 5 - Class B11 (September 2012) Responsible for evaluation: Dorte Nielsen / Cristina Lerche Data processing and preparation of

Evaluation Module 5 - Class B11 (September 2012) Responsible for evaluation: Dorte Nielsen / Cristina Lerche Data processing and preparation of 2011 Evaluation Module 5 - Class B11 (September 2012) Responsible for evaluation: Dorte Nielsen / Cristina Lerche Data processing and preparation of report: Cristina Lerche Contents Contents... 2 Questions

More information

Answers to selected exercises

Answers to selected exercises Answers to selected exercises A First Course in Stochastic Models, Henk C. Tijms 1.1 ( ) 1.2 (a) Let waiting time if passengers already arrived,. Then,, (b) { (c) Long-run fraction for is (d) Let waiting

More information

COMP2610/COMP Information Theory

COMP2610/COMP Information Theory COMP2610/COMP6261 - Information Theory Lecture 9: Probabilistic Inequalities Mark Reid and Aditya Menon Research School of Computer Science The Australian National University August 19th, 2014 Mark Reid

More information

STA 624 Practice Exam 2 Applied Stochastic Processes Spring, 2008

STA 624 Practice Exam 2 Applied Stochastic Processes Spring, 2008 Name STA 624 Practice Exam 2 Applied Stochastic Processes Spring, 2008 There are five questions on this test. DO use calculators if you need them. And then a miracle occurs is not a valid answer. There

More information

Density Estimation. Seungjin Choi

Density Estimation. Seungjin Choi Density Estimation Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr http://mlg.postech.ac.kr/

More information

SMAM Exam 1 Name

SMAM Exam 1 Name SMAM 314-04 Exam 1 Name 1. A chemical reaction was run several times using a catalyst to control the yield of an undesireable side product. Results in units of percentage yield are given for 24 runs. 4.4

More information

Probabilistic Graphical Models for Image Analysis - Lecture 1

Probabilistic Graphical Models for Image Analysis - Lecture 1 Probabilistic Graphical Models for Image Analysis - Lecture 1 Alexey Gronskiy, Stefan Bauer 21 September 2018 Max Planck ETH Center for Learning Systems Overview 1. Motivation - Why Graphical Models 2.

More information

Announcements Monday, November 13

Announcements Monday, November 13 Announcements Monday, November 13 The third midterm is on this Friday, November 17. The exam covers 3.1, 3.2, 5.1, 5.2, 5.3, and 5.5. About half the problems will be conceptual, and the other half computational.

More information

CS 361 Sample Midterm 2

CS 361 Sample Midterm 2 CS 361 Sample Midterm 2 NAME: NETID: CIRCLE YOUR DISCUSSION: Thu 2-3 Thu 4-5 Fri 10-11 Fri 11-12 Be sure that your exam booklet has 6 pages including this cover page Make sure to write your name exactly

More information

Module 5 : Linear and Quadratic Approximations, Error Estimates, Taylor's Theorem, Newton and Picard Methods

Module 5 : Linear and Quadratic Approximations, Error Estimates, Taylor's Theorem, Newton and Picard Methods Module 5 : Linear and Quadratic Approximations, Error Estimates, Taylor's Theorem, Newton and Picard Methods Lecture 14 : Taylor's Theorem [Section 141] Objectives In this section you will learn the following

More information

Statistics 433 Practice Final Exam: Cover Sheet and Marking Sheet

Statistics 433 Practice Final Exam: Cover Sheet and Marking Sheet Statistics 433 Practice Final Exam: Cover Sheet and Marking Sheet YOUR NAME INSTRUCTIONS: No notes, no calculators, and no communications devices are permitted. Please keep all materials away from your

More information

Theory of Stochastic Processes 8. Markov chain Monte Carlo

Theory of Stochastic Processes 8. Markov chain Monte Carlo Theory of Stochastic Processes 8. Markov chain Monte Carlo Tomonari Sei sei@mist.i.u-tokyo.ac.jp Department of Mathematical Informatics, University of Tokyo June 8, 2017 http://www.stat.t.u-tokyo.ac.jp/~sei/lec.html

More information

Globe Academy Science Department GCSE Core Science Year 10 Homework Booklet Summer 2 Contents: Feedback/ Marking. Date Set. Due

Globe Academy Science Department GCSE Core Science Year 10 Homework Booklet Summer 2 Contents: Feedback/ Marking. Date Set. Due Globe Academy Science Department GCSE Core Science Year 10 Homework Booklet Summer 2 Contents: Topic 1 Vaccines and Antibiotics Revision 2 Alkali Metals and Noble Gases Revision Mid-Term Assessment Revision

More information

Association studies and regression

Association studies and regression Association studies and regression CM226: Machine Learning for Bioinformatics. Fall 2016 Sriram Sankararaman Acknowledgments: Fei Sha, Ameet Talwalkar Association studies and regression 1 / 104 Administration

More information

Mathematical statistics

Mathematical statistics October 1 st, 2018 Lecture 11: Sufficient statistic Where are we? Week 1 Week 2 Week 4 Week 7 Week 10 Week 14 Probability reviews Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation

More information

Ph.D. Qualifying Exam Friday Saturday, January 3 4, 2014

Ph.D. Qualifying Exam Friday Saturday, January 3 4, 2014 Ph.D. Qualifying Exam Friday Saturday, January 3 4, 2014 Put your solution to each problem on a separate sheet of paper. Problem 1. (5166) Assume that two random samples {x i } and {y i } are independently

More information

Announcements Monday, September 18

Announcements Monday, September 18 Announcements Monday, September 18 WeBWorK 1.4, 1.5 are due on Wednesday at 11:59pm. The first midterm is on this Friday, September 22. Midterms happen during recitation. The exam covers through 1.5. About

More information

Globe Academy Science Department GCSE Core Science Year 9 Homework Booklet Summer 2 Contents: Date Set. Feedback/ Marking. Due

Globe Academy Science Department GCSE Core Science Year 9 Homework Booklet Summer 2 Contents: Date Set. Feedback/ Marking. Due Globe Academy Science Department GCSE Core Science Year 9 Homework Booklet Summer 2 Contents: Topic 1 Vaccines and Antibiotics Revision 2 Alkali Metals and Noble Gases Revision Mid-Term Assessment Revision

More information

Random Walk on a Graph

Random Walk on a Graph IOR 67: Stochastic Models I Second Midterm xam, hapters 3 & 4, November 2, 200 SOLUTIONS Justify your answers; show your work.. Random Walk on a raph (25 points) Random Walk on a raph 2 5 F B 3 3 2 Figure

More information

MATH1014. Semester 1 Administrative Overview. Neil Montgomery calculus

MATH1014. Semester 1 Administrative Overview. Neil Montgomery calculus MATH1014 Semester 1 Administrative Overview Lecturers: Scott Morrison linear algebra scott.morrison@anu.edu.au Neil Montgomery calculus neil.montgomery@anu.edu.au Dr Scott Morrison (ANU) MATH1014 Notes

More information

(b) What is the variance of the time until the second customer arrives, starting empty, assuming that we measure time in minutes?

(b) What is the variance of the time until the second customer arrives, starting empty, assuming that we measure time in minutes? IEOR 3106: Introduction to Operations Research: Stochastic Models Fall 2006, Professor Whitt SOLUTIONS to Final Exam Chapters 4-7 and 10 in Ross, Tuesday, December 19, 4:10pm-7:00pm Open Book: but only

More information

AS MATHEMATICS HOMEWORK C1

AS MATHEMATICS HOMEWORK C1 Student Teacher AS MATHEMATICS HOMEWORK C September 05 City and Islington Sixth Form College Mathematics Department www.candimaths.uk HOMEWORK INTRODUCTION You should attempt all the questions. If you

More information

Announcements Monday, November 13

Announcements Monday, November 13 Announcements Monday, November 13 The third midterm is on this Friday, November 17 The exam covers 31, 32, 51, 52, 53, and 55 About half the problems will be conceptual, and the other half computational

More information

Statistics 253/317 Introduction to Probability Models. Winter Midterm Exam Monday, Feb 10, 2014

Statistics 253/317 Introduction to Probability Models. Winter Midterm Exam Monday, Feb 10, 2014 Statistics 253/317 Introduction to Probability Models Winter 2014 - Midterm Exam Monday, Feb 10, 2014 Student Name (print): (a) Do not sit directly next to another student. (b) This is a closed-book, closed-note

More information

Queueing Theory II. Summary. ! M/M/1 Output process. ! Networks of Queue! Method of Stages. ! General Distributions

Queueing Theory II. Summary. ! M/M/1 Output process. ! Networks of Queue! Method of Stages. ! General Distributions Queueing Theory II Summary! M/M/1 Output process! Networks of Queue! Method of Stages " Erlang Distribution " Hyperexponential Distribution! General Distributions " Embedded Markov Chains M/M/1 Output

More information

The Naïve Bayes Classifier. Machine Learning Fall 2017

The Naïve Bayes Classifier. Machine Learning Fall 2017 The Naïve Bayes Classifier Machine Learning Fall 2017 1 Today s lecture The naïve Bayes Classifier Learning the naïve Bayes Classifier Practical concerns 2 Today s lecture The naïve Bayes Classifier Learning

More information

Poisson Distribution

Poisson Distribution Poisson Distribution Activity Name and Table: Poisson Distribution Learning Goals and Objectives 1. Students will understand what it means for biological processes to be Poissonian. 2. Students will appreciate

More information

This exam contains 13 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 13 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability and Statistics FS 2017 Session Exam 22.08.2017 Time Limit: 180 Minutes Name: Student ID: This exam contains 13 pages (including this cover page) and 10 questions. A Formulae sheet is provided

More information

Question 1. Question 4. Question 2. Question 5. Question 3. Question 6.

Question 1. Question 4. Question 2. Question 5. Question 3. Question 6. İstanbul Kültür University Faculty of Engineering MCB17 Introduction to Probability Statistics Second Midterm Fall 21-21 Number: Name: Department: Section: Directions You have 9 minutes to complete the

More information

You may use your calculator and a single page of notes.

You may use your calculator and a single page of notes. LAST NAME (Please Print): KEY FIRST NAME (Please Print): HONOR PLEDGE (Please Sign): Statistics 111 Midterm 2 This is a closed book exam. You may use your calculator and a single page of notes. The room

More information

Hidden Markov Models. Terminology, Representation and Basic Problems

Hidden Markov Models. Terminology, Representation and Basic Problems Hidden Markov Models Terminology, Representation and Basic Problems Data analysis? Machine learning? In bioinformatics, we analyze a lot of (sequential) data (biological sequences) to learn unknown parameters

More information

MATH-3150H-A: Partial Differential Equation 2018WI - Peterborough Campus

MATH-3150H-A: Partial Differential Equation 2018WI - Peterborough Campus MATH-3150H-A: Partial Differential Equation 2018WI - Peterborough Campus Instructor: Instructor: Kenzu Abdella Email Address: kabdella@trentu.ca Phone Number: 705-748-1011 x7327 Office: GSC 339 Office

More information

Lesson 19: Understanding Variability When Estimating a Population Proportion

Lesson 19: Understanding Variability When Estimating a Population Proportion Lesson 19: Understanding Variability When Estimating a Population Proportion Student Outcomes Students understand the term sampling variability in the context of estimating a population proportion. Students

More information

Topics in Natural Language Processing

Topics in Natural Language Processing Topics in Natural Language Processing Shay Cohen Institute for Language, Cognition and Computation University of Edinburgh Lecture 9 Administrativia Next class will be a summary Please email me questions

More information

LECTURE 15 Markov chain Monte Carlo

LECTURE 15 Markov chain Monte Carlo LECTURE 15 Markov chain Monte Carlo There are many settings when posterior computation is a challenge in that one does not have a closed form expression for the posterior distribution. Markov chain Monte

More information

Stochastic Processes

Stochastic Processes Stochastic Processes 8.445 MIT, fall 20 Mid Term Exam Solutions October 27, 20 Your Name: Alberto De Sole Exercise Max Grade Grade 5 5 2 5 5 3 5 5 4 5 5 5 5 5 6 5 5 Total 30 30 Problem :. True / False

More information

GOV 2001/ 1002/ E-2001 Section 3 Theories of Inference

GOV 2001/ 1002/ E-2001 Section 3 Theories of Inference GOV 2001/ 1002/ E-2001 Section 3 Theories of Inference Solé Prillaman Harvard University February 11, 2015 1 / 48 LOGISTICS Reading Assignment- Unifying Political Methodology chs 2 and 4. Problem Set 3-

More information

Math 31 Lesson Plan. Day 2: Sets; Binary Operations. Elizabeth Gillaspy. September 23, 2011

Math 31 Lesson Plan. Day 2: Sets; Binary Operations. Elizabeth Gillaspy. September 23, 2011 Math 31 Lesson Plan Day 2: Sets; Binary Operations Elizabeth Gillaspy September 23, 2011 Supplies needed: 30 worksheets. Scratch paper? Sign in sheet Goals for myself: Tell them what you re going to tell

More information

A2 MATHEMATICS HOMEWORK C3

A2 MATHEMATICS HOMEWORK C3 Name Teacher A2 MATHEMATICS HOMEWORK C3 Mathematics Department September 2016 Version 1 Contents Contents... 2 Introduction... 3 Week 1 Trigonometric Equations 1... 4 Week 2 Trigonometric Equations 2...

More information

Statistical modelling: Theory and practice

Statistical modelling: Theory and practice Statistical modelling: Theory and practice Introduction Gilles Guillot gigu@dtu.dk August 27, 2013 Gilles Guillot (gigu@dtu.dk) Stat. modelling August 27, 2013 1 / 6 Schedule 13 weeks weekly time slot:

More information

Introduction to Bayesian Methods

Introduction to Bayesian Methods Introduction to Bayesian Methods Jessi Cisewski Department of Statistics Yale University Sagan Summer Workshop 2016 Our goal: introduction to Bayesian methods Likelihoods Priors: conjugate priors, non-informative

More information

Lecture 1: Introduction to IO Tom Holden

Lecture 1: Introduction to IO Tom Holden Lecture 1: Introduction to IO Tom Holden http://io.tholden.org/ Email: t.holden@surrey.ac.uk Standard office hours: Thursday, 12-1PM + 3-4PM, 29AD00 However, during term: CLASSES will be run in the first

More information

1 A simple example. A short introduction to Bayesian statistics, part I Math 217 Probability and Statistics Prof. D.

1 A simple example. A short introduction to Bayesian statistics, part I Math 217 Probability and Statistics Prof. D. probabilities, we ll use Bayes formula. We can easily compute the reverse probabilities A short introduction to Bayesian statistics, part I Math 17 Probability and Statistics Prof. D. Joyce, Fall 014 I

More information

Computer Engineering II Solution to Exercise Sheet Chapter 12

Computer Engineering II Solution to Exercise Sheet Chapter 12 Distributed Computing FS 07 Prof. R. Wattenhofer Computer Engineering II Solution to Exercise Sheet Chapter Quiz Questions a) Yes, by using states that consist of the current and the previous value in

More information

Summary STK 4150/9150

Summary STK 4150/9150 STK4150 - Intro 1 Summary STK 4150/9150 Odd Kolbjørnsen May 22 2017 Scope You are expected to know and be able to use basic concepts introduced in the book. You knowledge is expected to be larger than

More information

Machine Learning. Instructor: Pranjal Awasthi

Machine Learning. Instructor: Pranjal Awasthi Machine Learning Instructor: Pranjal Awasthi Course Info Requested an SPN and emailed me Wait for Carol Difrancesco to give them out. Not registered and need SPN Email me after class No promises It s a

More information

Chapter 6 Continuous Probability Distributions

Chapter 6 Continuous Probability Distributions Math 3 Chapter 6 Continuous Probability Distributions The observations generated by different statistical experiments have the same general type of behavior. The followings are the probability distributions

More information

Principles of Chemical Engineering Instructor: Dr. T. Behzad Winter 2013

Principles of Chemical Engineering Instructor: Dr. T. Behzad Winter 2013 Principles of Chemical Engineering 34-12-336 Instructor: Dr. T. Behzad Winter 2013 1 Isfahan University of Technology Department of Chemical Engineering Tuesday, February 05, 2013 1 Course Specifications

More information

SC7/SM6 Bayes Methods HT18 Lecturer: Geoff Nicholls Lecture 2: Monte Carlo Methods Notes and Problem sheets are available at http://www.stats.ox.ac.uk/~nicholls/bayesmethods/ and via the MSc weblearn pages.

More information

General Chemistry I Office: Chem

General Chemistry I Office: Chem General Chemistry I Office: Chem 122 Fall 2009 email: pdoucette@elcamino.edu Office Hours: Tu & Th: 1:00 2:00, W: 12:00 12:30, or by appointment Meeting times and locations: Lectures: T Th 2:00 4:05 Chem

More information

NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MH4702/MAS446/MTH437 Probabilistic Methods in OR

NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MH4702/MAS446/MTH437 Probabilistic Methods in OR NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION 2013-201 MH702/MAS6/MTH37 Probabilistic Methods in OR December 2013 TIME ALLOWED: 2 HOURS INSTRUCTIONS TO CANDIDATES 1. This examination paper contains

More information

Learning Outcomes. k 1

Learning Outcomes. k 1 Module 1DHS - Data Handling Skills Unit: Applied Maths Lecturer: Dr. Simon Hubbard (H13), Email: Simon.Hubbard@umist.ac.uk Title: Equilibria & Michaelis-Menten This lecture and problem class will introduce

More information

Introduction to Bayesian Methods. Introduction to Bayesian Methods p.1/??

Introduction to Bayesian Methods. Introduction to Bayesian Methods p.1/?? to Bayesian Methods Introduction to Bayesian Methods p.1/?? We develop the Bayesian paradigm for parametric inference. To this end, suppose we conduct (or wish to design) a study, in which the parameter

More information

Some Material on the Statistics Curriculum

Some Material on the Statistics Curriculum Some Material on the Curriculum A/Prof Ken Russell School of Mathematics & Applied University of Wollongong kgr@uow.edu.au involves planning the collection of data, collecting those data, describing, analysing

More information

Probability and Inference

Probability and Inference Deniz Yuret ECOE 554 Lecture 3 Outline 1 Probabilities and ensembles 2 3 Ensemble An ensemble X is a triple (x, A X, P X ), where the outcome x is the value of a random variable, which takes on one of

More information

Lecture 4: Hidden Markov Models: An Introduction to Dynamic Decision Making. November 11, 2010

Lecture 4: Hidden Markov Models: An Introduction to Dynamic Decision Making. November 11, 2010 Hidden Lecture 4: Hidden : An Introduction to Dynamic Decision Making November 11, 2010 Special Meeting 1/26 Markov Model Hidden When a dynamical system is probabilistic it may be determined by the transition

More information

CPSC 540: Machine Learning

CPSC 540: Machine Learning CPSC 540: Machine Learning Undirected Graphical Models Mark Schmidt University of British Columbia Winter 2016 Admin Assignment 3: 2 late days to hand it in today, Thursday is final day. Assignment 4:

More information

Statistics Ph.D. Qualifying Exam: Part II November 3, 2001

Statistics Ph.D. Qualifying Exam: Part II November 3, 2001 Statistics Ph.D. Qualifying Exam: Part II November 3, 2001 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. 1 2 3 4 5 6 7 8 9 10 11 12 2. Write your

More information

Math 494: Mathematical Statistics

Math 494: Mathematical Statistics Math 494: Mathematical Statistics Instructor: Jimin Ding jmding@wustl.edu Department of Mathematics Washington University in St. Louis Class materials are available on course website (www.math.wustl.edu/

More information

Announcements Wednesday, September 05

Announcements Wednesday, September 05 Announcements Wednesday, September 05 WeBWorK 2.2, 2.3 due today at 11:59pm. The quiz on Friday coers through 2.3 (last week s material). My office is Skiles 244 and Rabinoffice hours are: Mondays, 12

More information

CSC 412 (Lecture 4): Undirected Graphical Models

CSC 412 (Lecture 4): Undirected Graphical Models CSC 412 (Lecture 4): Undirected Graphical Models Raquel Urtasun University of Toronto Feb 2, 2016 R Urtasun (UofT) CSC 412 Feb 2, 2016 1 / 37 Today Undirected Graphical Models: Semantics of the graph:

More information

Forward algorithm vs. particle filtering

Forward algorithm vs. particle filtering Particle Filtering ØSometimes X is too big to use exact inference X may be too big to even store B(X) E.g. X is continuous X 2 may be too big to do updates ØSolution: approximate inference Track samples

More information

Note Set 5: Hidden Markov Models

Note Set 5: Hidden Markov Models Note Set 5: Hidden Markov Models Probabilistic Learning: Theory and Algorithms, CS 274A, Winter 2016 1 Hidden Markov Models (HMMs) 1.1 Introduction Consider observed data vectors x t that are d-dimensional

More information

Patterns of Scalable Bayesian Inference Background (Session 1)

Patterns of Scalable Bayesian Inference Background (Session 1) Patterns of Scalable Bayesian Inference Background (Session 1) Jerónimo Arenas-García Universidad Carlos III de Madrid jeronimo.arenas@gmail.com June 14, 2017 1 / 15 Motivation. Bayesian Learning principles

More information

Exercises Stochastic Performance Modelling. Hamilton Institute, Summer 2010

Exercises Stochastic Performance Modelling. Hamilton Institute, Summer 2010 Exercises Stochastic Performance Modelling Hamilton Institute, Summer Instruction Exercise Let X be a non-negative random variable with E[X ]

More information

Math 3B: Lecture 1. Noah White. September 23, 2016

Math 3B: Lecture 1. Noah White. September 23, 2016 Math 3B: Lecture 1 Noah White September 23, 2016 Syllabus Take a copy of the syllabus as you walk in or find it online at math.ucla.edu/~noah Class website There are a few places where you will find/receive

More information

SS257a Midterm Exam Monday Oct 27 th 2008, 6:30-9:30 PM Talbot College 342 and 343. You may use simple, non-programmable scientific calculators.

SS257a Midterm Exam Monday Oct 27 th 2008, 6:30-9:30 PM Talbot College 342 and 343. You may use simple, non-programmable scientific calculators. SS657a Midterm Exam, October 7 th 008 pg. SS57a Midterm Exam Monday Oct 7 th 008, 6:30-9:30 PM Talbot College 34 and 343 You may use simple, non-programmable scientific calculators. This exam has 5 questions

More information

Lecture 4 Logistic Regression

Lecture 4 Logistic Regression Lecture 4 Logistic Regression Dr.Ammar Mohammed Normal Equation Hypothesis hθ(x)=θ0 x0+ θ x+ θ2 x2 +... + θd xd Normal Equation is a method to find the values of θ operations x0 x x2.. xd y x x2... xd

More information

PARAMETER ESTIMATION: BAYESIAN APPROACH. These notes summarize the lectures on Bayesian parameter estimation.

PARAMETER ESTIMATION: BAYESIAN APPROACH. These notes summarize the lectures on Bayesian parameter estimation. PARAMETER ESTIMATION: BAYESIAN APPROACH. These notes summarize the lectures on Bayesian parameter estimation.. Beta Distribution We ll start by learning about the Beta distribution, since we end up using

More information

Metropolis Hastings. Rebecca C. Steorts Bayesian Methods and Modern Statistics: STA 360/601. Module 9

Metropolis Hastings. Rebecca C. Steorts Bayesian Methods and Modern Statistics: STA 360/601. Module 9 Metropolis Hastings Rebecca C. Steorts Bayesian Methods and Modern Statistics: STA 360/601 Module 9 1 The Metropolis-Hastings algorithm is a general term for a family of Markov chain simulation methods

More information

Directed and Undirected Graphical Models

Directed and Undirected Graphical Models Directed and Undirected Graphical Models Adrian Weller MLSALT4 Lecture Feb 26, 2016 With thanks to David Sontag (NYU) and Tony Jebara (Columbia) for use of many slides and illustrations For more information,

More information

Bayesian Networks aka belief networks, probabilistic networks. Bayesian Networks aka belief networks, probabilistic networks. An Example Bayes Net

Bayesian Networks aka belief networks, probabilistic networks. Bayesian Networks aka belief networks, probabilistic networks. An Example Bayes Net Bayesian Networks aka belief networks, probabilistic networks A BN over variables {X 1, X 2,, X n } consists of: a DAG whose nodes are the variables a set of PTs (Pr(X i Parents(X i ) ) for each X i P(a)

More information

Stat 5421 Lecture Notes Proper Conjugate Priors for Exponential Families Charles J. Geyer March 28, 2016

Stat 5421 Lecture Notes Proper Conjugate Priors for Exponential Families Charles J. Geyer March 28, 2016 Stat 5421 Lecture Notes Proper Conjugate Priors for Exponential Families Charles J. Geyer March 28, 2016 1 Theory This section explains the theory of conjugate priors for exponential families of distributions,

More information

Stat 515 Midterm Examination II April 4, 2016 (7:00 p.m. - 9:00 p.m.)

Stat 515 Midterm Examination II April 4, 2016 (7:00 p.m. - 9:00 p.m.) Name: Section: Stat 515 Midterm Examination II April 4, 2016 (7:00 p.m. - 9:00 p.m.) The total score is 120 points. Instructions: There are 10 questions. Please circle 8 problems below that you want to

More information

Parametric Models. Dr. Shuang LIANG. School of Software Engineering TongJi University Fall, 2012

Parametric Models. Dr. Shuang LIANG. School of Software Engineering TongJi University Fall, 2012 Parametric Models Dr. Shuang LIANG School of Software Engineering TongJi University Fall, 2012 Today s Topics Maximum Likelihood Estimation Bayesian Density Estimation Today s Topics Maximum Likelihood

More information

Logistics. Naïve Bayes & Expectation Maximization. 573 Schedule. Coming Soon. Estimation Models. Topics

Logistics. Naïve Bayes & Expectation Maximization. 573 Schedule. Coming Soon. Estimation Models. Topics Logistics Naïve Bayes & Expectation Maximization CSE 7 eam Meetings Midterm Open book, notes Studying See AIMA exercises Daniel S. Weld Daniel S. Weld 7 Schedule Selected opics Coming Soon Selected opics

More information

Unsupervised learning (part 1) Lecture 19

Unsupervised learning (part 1) Lecture 19 Unsupervised learning (part 1) Lecture 19 David Sontag New York University Slides adapted from Carlos Guestrin, Dan Klein, Luke Ze@lemoyer, Dan Weld, Vibhav Gogate, and Andrew Moore Bayesian networks enable

More information

Course Evaluation, Department of Theoretical Physics - FYS230 Theoretical Particle Physics, Fall 2006

Course Evaluation, Department of Theoretical Physics - FYS230 Theoretical Particle Physics, Fall 2006 Course Evaluation, Department of Theoretical Physics - FYS230 Theoretical Particle Physics, Fall 2006 Course Evaluation, Department of Theoretical Physics - FYS230 Theoretical Particle Physics, Fall 2006

More information

COPYRIGHTED MATERIAL CONTENTS. Preface Preface to the First Edition

COPYRIGHTED MATERIAL CONTENTS. Preface Preface to the First Edition Preface Preface to the First Edition xi xiii 1 Basic Probability Theory 1 1.1 Introduction 1 1.2 Sample Spaces and Events 3 1.3 The Axioms of Probability 7 1.4 Finite Sample Spaces and Combinatorics 15

More information

Applied Reactor Technology and Nuclear Power Safety, 4A1627; 4 cp. Course Description

Applied Reactor Technology and Nuclear Power Safety, 4A1627; 4 cp. Course Description Applied Reactor Technology and Nuclear Power Safety, 4A1627; 4 cp Course Objectives Course Description The purpose of the course is to provide a general knowledge on the physical processes that take place

More information

Shenandoah University. (PowerPoint) LESSON PLAN *

Shenandoah University. (PowerPoint) LESSON PLAN * Shenandoah University (PowerPoint) LESSON PLAN * NAME DATE 10/28/04 TIME REQUIRED 90 minutes SUBJECT Algebra I GRADE 6-9 OBJECTIVES AND PURPOSE (for each objective, show connection to SOL for your subject

More information

PY1007: Physics for Engineers I

PY1007: Physics for Engineers I PY1007: Physics for Engineers I LECTURES: TUESDAY 12-13 Kane Building G1 THURSDAY 13-14 Lecturers Dr. Richard Green (me!) r.green@ucc.ie 1 st Floor, Kane (Science) Building Dr. Síle Nic Chormaic (Module

More information

Intro to Probability. Andrei Barbu

Intro to Probability. Andrei Barbu Intro to Probability Andrei Barbu Some problems Some problems A means to capture uncertainty Some problems A means to capture uncertainty You have data from two sources, are they different? Some problems

More information

Statistics Ph.D. Qualifying Exam: Part I October 18, 2003

Statistics Ph.D. Qualifying Exam: Part I October 18, 2003 Statistics Ph.D. Qualifying Exam: Part I October 18, 2003 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. 1 2 3 4 5 6 7 8 9 10 11 12 2. Write your answer

More information

Intro to Bayesian Methods

Intro to Bayesian Methods Intro to Bayesian Methods Rebecca C. Steorts Bayesian Methods and Modern Statistics: STA 360/601 Lecture 1 1 Course Webpage Syllabus LaTeX reference manual R markdown reference manual Please come to office

More information

BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA

BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA Intro: Course Outline and Brief Intro to Marina Vannucci Rice University, USA PASI-CIMAT 04/28-30/2010 Marina Vannucci

More information

Poisson distributions Mixed exercise 2

Poisson distributions Mixed exercise 2 Poisson distributions Mixed exercise 2 1 a Let X be the number of accidents in a one-month period. Assume a Poisson distribution. So X ~Po(0.7) P(X =0)=e 0.7 =0.4966 (4 d.p.) b Let Y be the number of accidents

More information

Examination paper for TMA4275 Lifetime Analysis

Examination paper for TMA4275 Lifetime Analysis Department of Mathematical Sciences Examination paper for TMA4275 Lifetime Analysis Academic contact during examination: Ioannis Vardaxis Phone: 95 36 00 26 Examination date: Saturday May 30 2015 Examination

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.262 Discrete Stochastic Processes Midterm Quiz April 6, 2010 There are 5 questions, each with several parts.

More information

Syllabus Tutors Review from previous class. Resources. Lecture: MW 5:30PM-6:50PM Room 425

Syllabus Tutors Review from previous class. Resources. Lecture: MW 5:30PM-6:50PM Room 425 Chapter 2 Syllabus Tutors Review from previous class 1 Chapter 2 Resources Lecture: MW 5:30PM-6:50PM Room 425 Text book: Steven S. Zumdahl, Donald DeCosta, Introductory Chemistry: A Foundation, 8th Website:

More information