Chapter 3 Questions. Question 3.1. Based on the nature of values that each random variable can take, we can have the following classifications:

Size: px
Start display at page:

Download "Chapter 3 Questions. Question 3.1. Based on the nature of values that each random variable can take, we can have the following classifications:"

Transcription

1 Chapter Questions Question. Based on the nature of values that each random variable can take, we can have the following classifications: X: Discrete; since X is essentially count data) Y: Continuous; since Y is measured data M: Continuous; since M is measured data N: Discrete; since N is count data P: Discrete; since P is count data Q: Continuous; since Q is measured data Question. The results could be summarized into the table below: Sample HHH HHT HTH HTT THH THT TTH TTT point w - = - = - = - = - - = - = - - = - - = - Question.5 The principal rule for solving this question is that all probabilities for all sample points within the sample space should add up to. We desire: c(x + 4) x= So: = c X [( + 4)+ ( + 4) + (4 + 4) + (9 + 4)] = c = Following the similar manner of computation: C[( ) ( ) + ( ) ( ) + ( )( )] =

2 C = + + = Question.8 We first compute the probability associated to each sample point, then add up the corresponding sample points to obtain probability associated with each value of W. P(W=-)= P(TTT) = / X / X / = /7 P(W=-) = P(HTT) + P(THT) + P(TTH) = X (/ X / X /) = /9 P(W=) = P(HHT) + P(HTH) + P(THH) = X (/ X / X /) = 4/9 P(W=) = P(HHH) = / X / X / = 8/7 Verify they sum up to one: /7 + /9 + 4/9 + 8/7 = Thus, above describes a valid probability distribution on discrete random variable W. Question.9 Integrate over the value of X to obtain the area under this part of the density function: P( < X < ) = (x+) dx = [ x +4x ] 5 = (+4)/5 Still use integration over density function to compute the probability: = P(/4 < X < /) = 5 = [ x +4x ] / 5 /4 / (x+) /4 5 = (/4+)/5 (/6 + )/5 = 9/8 dx

3 Question. First compute probability distribution of discrete random variable X: Note that the values X could take on are:,,. P(X=) = (5 ) P(X=) = (5 )( ) P(X=) = (5 )( ) ( 7 = /5 = /7 ) ( 7 ) = (X)/5 = 4/7 ( 7 ) = (5X)/5 = /7 Note that they sum up to, thus the above distribution is a valid probability distribution. The probability histogram is as following: Question. To obtain the cumulative distribution function, we just need to performing a cumulative running sum of the probability mass function on X. Thus, the cumulative distribution function is shown as following: X x < x < x < x < x < 4 x 4 F(x) = = = =.78

4 Note the ending value for the cumulative function always equals to. Question.4 We just need to directly plot in the value of x into F(x): With minutes =. hours, we have: First, compute probability density function: F(x =.5) = e 8. =.798 f(x) = F (x) = 8e 8x Then, compute the probability using integration over the density function:. p = f(x)dx. = 8 e 8x dx = 8 8 [e 8x ]. = e 8. =.798 First, find the cumulative distribution function F(x): Note that from question.: P(X=) = /7 P(X=) = 4/7 P(X=) = /7 Question.5 Then the cumulative function for F(x) is shown as following: x x < x < x < x F(x) /7 /7 + 4/7 = 6/7 6/7 + /7 = Then use F(x) for asked quantities.

5 P(X = ) = F(X = ) F(X = ) = 6/7 /7 = 4/7 (since there is no probability mass within (,)) P( < X ) = P(X ) P(X ) = F(X = ) F(X = ) = /7 = 5/7 The graph is shown as following: Question.6 Question.9 For this density function to be valid, it has to satisfy two conditions:. f(x) x

6 +. f(x)dx = Condition is easily verified as exponential function never takes on negative values. For condition verification: + f(x)dx Thus this density function is indeed valid. F(x) is computed by the integration of f(x): For x<, as f(x)= everywhere, F(x)=. Part (c) + = x 4 dx = [x ] + = F(X) = The probability can be computed using compliment: X f(a)da x = a 4 da = [a ] x = x (for x ) P = -F(4) = ( 4 ) = /64 Question.6 Given the questions asked are about probabilities of certain range, compute the cumulative distribution function first: F(x) = x f(a)da = ( a)da x

7 = [ a + a] x = x + x (if <= x <= ) If x < : trivially F(x) = If x > : F(x) = Use cumulative function: P(X /) = F(x = /) = ( ) + / = 5/9 Use compliment for computing the desired probability, with cumulative function: Part (c) P = -P(x<=.5) = -F(x=.5) = (.5 +.5) =.5 P(x <.75 x.5) = p(.5 x<.75) p(x.5) = F(x=.75) F(x=.5) F(x=.5) = (.5 +.5) (.5 +.5) = =.75

8 STA86 Problem Set Solutions Problem.8 p(x, Y = ) = p(x =, Y = ) + p(x =, Y = ) + p(x =, Y = ) = f(,) + f(,) + f(,) = = 5 p(x >, Y ) = p(x =, Y = ) + P(X =, Y = ) = f(,) + f(,) = = 7 Part (c) p(x > Y) = f(,) + f(,) + f(,) + f(,) + f(,) + f(,) ( + ) + ( + ) + ( + ) + ( + ) + ( + ) + ( + ) = = 5 Part (d) p(x + Y = 4) = f(,) + f(,) ( + ) + ( + ) = = 4 5

9 Problem.4 Integrate the joint density function over all values of Y to get marginal density of X: g(x) = f(x, y)dy = (x + y)dy = [xy + y ] = x + Integrate the joint density function over all values of X to get marginal density of Y: h(y) = f(x, y)dy = (x + y)dx = [x + xy] Part (c) = 4y + This event corresponds to the condition on random variable: X.5. As only the drive-through facility is in the picture of the problem, we only need to consider the marginal density function g(x). Integrate over the density function to get the desired event probability:.5 p(x.5) = g(x)dx.5 = x + dx

10 = [ x + x ].5 =.5 = 5 Problem.56 Note that for values of f(x,y), Y s range is actually defined based on x, we can have the following observation: Given a fixed value of Y =.5: Case : x =.. Then y < -x, and thus f(.,.5) = 6X. =.8 (Note that since it s density function, so a value greater than is possible). Case : x =.7. Then y > -x, and thus f(.7,.5) = Thus we have f(.,.5) f(.7,.5), meaning the probability density for y =.5 is dependent on x. Thus, X and Y are not independent. Note that for Y =.5, when X.5, y < -x doesn t hold and leads to probability density. Thus, we only need to consider domains of X where the density is non-zero. P(X >. Y =.5) = f(x,.5)dx..5 = f(x,.5)dx..5 = 6xdx. = [x ].5. =.48

11 Problem.57 The requirement for probability density function to be valid is that it would be integrated to over all domains. f(x, y, z)dxdydz = kxy zdxdydz = ky z dydz = kz 6 dz Thus, k =. = k = (by definition) Integrate the corresponding region with respect to each of the variable, we have: p(x < 4, Y >, < Z < ) 4 = f(x, y, z)dxdydz 4 = kxy zdxdydz = ky z dydz = 7kz 768 dz = [ 7kz 56 ]

12 = 6 56 = 5

Events A and B are said to be independent if the occurrence of A does not affect the probability of B.

Events A and B are said to be independent if the occurrence of A does not affect the probability of B. Independent Events Events A and B are said to be independent if the occurrence of A does not affect the probability of B. Probability experiment of flipping a coin and rolling a dice. Sample Space: {(H,

More information

More on Distribution Function

More on Distribution Function More on Distribution Function The distribution of a random variable X can be determined directly from its cumulative distribution function F X. Theorem: Let X be any random variable, with cumulative distribution

More information

Introduction Probability. Math 141. Introduction to Probability and Statistics. Albyn Jones

Introduction Probability. Math 141. Introduction to Probability and Statistics. Albyn Jones Math 141 to and Statistics Albyn Jones Mathematics Department Library 304 jones@reed.edu www.people.reed.edu/ jones/courses/141 September 3, 2014 Motivation How likely is an eruption at Mount Rainier in

More information

Lecture 3: Random variables, distributions, and transformations

Lecture 3: Random variables, distributions, and transformations Lecture 3: Random variables, distributions, and transformations Definition 1.4.1. A random variable X is a function from S into a subset of R such that for any Borel set B R {X B} = {ω S : X(ω) B} is an

More information

Discrete Probability Distribution

Discrete Probability Distribution Shapes of binomial distributions Discrete Probability Distribution Week 11 For this activity you will use a web applet. Go to http://socr.stat.ucla.edu/htmls/socr_eperiments.html and choose Binomial coin

More information

Mathematics. ( : Focus on free Education) (Chapter 16) (Probability) (Class XI) Exercise 16.2

Mathematics. (  : Focus on free Education) (Chapter 16) (Probability) (Class XI) Exercise 16.2 ( : Focus on free Education) Exercise 16.2 Question 1: A die is rolled. Let E be the event die shows 4 and F be the event die shows even number. Are E and F mutually exclusive? Answer 1: When a die is

More information

Outline. 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks

Outline. 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks Outline 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks Likelihood A common and fruitful approach to statistics is to assume

More information

What are the odds? Coin tossing and applications

What are the odds? Coin tossing and applications What are the odds? Coin tossing and applications Dr. Antal Járai Department of Mathematical Sciences University of Bath 19 July 2011 Please feel free to interrupt with questions at any time. Outline This

More information

Probability Distributions for Discrete RV

Probability Distributions for Discrete RV An example: Assume we toss a coin 3 times and record the outcomes. Let X i be a random variable defined by { 1, if the i th outcome is Head; X i = 0, if the i th outcome is Tail; Let X be the random variable

More information

Discrete random variables and probability distributions

Discrete random variables and probability distributions Discrete random variables and probability distributions random variable is a mapping from the sample space to real numbers. notation: X, Y, Z,... Example: Ask a student whether she/he works part time or

More information

Probability (10A) Young Won Lim 6/12/17

Probability (10A) Young Won Lim 6/12/17 Probability (10A) Copyright (c) 2017 Young W. Lim. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later

More information

Why should you care?? Intellectual curiosity. Gambling. Mathematically the same as the ESP decision problem we discussed in Week 4.

Why should you care?? Intellectual curiosity. Gambling. Mathematically the same as the ESP decision problem we discussed in Week 4. I. Probability basics (Sections 4.1 and 4.2) Flip a fair (probability of HEADS is 1/2) coin ten times. What is the probability of getting exactly 5 HEADS? What is the probability of getting exactly 10

More information

Expected Value. Lecture A Tiefenbruck MWF 9-9:50am Center 212 Lecture B Jones MWF 2-2:50pm Center 214 Lecture C Tiefenbruck MWF 11-11:50am Center 212

Expected Value. Lecture A Tiefenbruck MWF 9-9:50am Center 212 Lecture B Jones MWF 2-2:50pm Center 214 Lecture C Tiefenbruck MWF 11-11:50am Center 212 Expected Value Lecture A Tiefenbruck MWF 9-9:50am Center 212 Lecture B Jones MWF 2-2:50pm Center 214 Lecture C Tiefenbruck MWF 11-11:50am Center 212 http://cseweb.ucsd.edu/classes/wi16/cse21-abc/ March

More information

What is Probability? Probability. Sample Spaces and Events. Simple Event

What is Probability? Probability. Sample Spaces and Events. Simple Event What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5

More information

Joint Distribution of Two or More Random Variables

Joint Distribution of Two or More Random Variables Joint Distribution of Two or More Random Variables Sometimes more than one measurement in the form of random variable is taken on each member of the sample space. In cases like this there will be a few

More information

Bayes Rule for probability

Bayes Rule for probability Bayes Rule for probability P A B P A P B A PAP B A P AP B A An generalization of Bayes Rule Let A, A 2,, A k denote a set of events such that S A A2 Ak and Ai Aj for all i and j. Then P A i B P Ai P B

More information

SDS 321: Introduction to Probability and Statistics

SDS 321: Introduction to Probability and Statistics SDS 321: Introduction to Probability and Statistics Lecture 17: Continuous random variables: conditional PDF Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin

More information

Formal Modeling in Cognitive Science Lecture 19: Application of Bayes Theorem; Discrete Random Variables; Distributions. Background.

Formal Modeling in Cognitive Science Lecture 19: Application of Bayes Theorem; Discrete Random Variables; Distributions. Background. Formal Modeling in Cognitive Science Lecture 9: ; Discrete Random Variables; Steve Renals (notes by Frank Keller) School of Informatics University of Edinburgh s.renals@ed.ac.uk February 7 Probability

More information

Formal Modeling in Cognitive Science

Formal Modeling in Cognitive Science Formal Modeling in Cognitive Science Lecture 9: Application of Bayes Theorem; Discrete Random Variables; Steve Renals (notes by Frank Keller) School of Informatics University of Edinburgh s.renals@ed.ac.uk

More information

sheng@mail.ncyu.edu.tw Content Joint distribution functions Independent random variables Sums of independent random variables Conditional distributions: discrete case Conditional distributions: continuous

More information

Applied Statistics I

Applied Statistics I Applied Statistics I Liang Zhang Department of Mathematics, University of Utah June 17, 2008 Liang Zhang (UofU) Applied Statistics I June 17, 2008 1 / 22 Random Variables Definition A dicrete random variable

More information

Chapter 2: The Random Variable

Chapter 2: The Random Variable Chapter : The Random Variable The outcome of a random eperiment need not be a number, for eample tossing a coin or selecting a color ball from a bo. However we are usually interested not in the outcome

More information

Review of Statistics I

Review of Statistics I Review of Statistics I Hüseyin Taştan 1 1 Department of Economics Yildiz Technical University April 17, 2010 1 Review of Distribution Theory Random variables, discrete vs continuous Probability distribution

More information

Math 416 Lecture 2 DEFINITION. Here are the multivariate versions: X, Y, Z iff P(X = x, Y = y, Z =z) = p(x, y, z) of X, Y, Z iff for all sets A, B, C,

Math 416 Lecture 2 DEFINITION. Here are the multivariate versions: X, Y, Z iff P(X = x, Y = y, Z =z) = p(x, y, z) of X, Y, Z iff for all sets A, B, C, Math 416 Lecture 2 DEFINITION. Here are the multivariate versions: PMF case: p(x, y, z) is the joint Probability Mass Function of X, Y, Z iff P(X = x, Y = y, Z =z) = p(x, y, z) PDF case: f(x, y, z) is

More information

Statistical methods in recognition. Why is classification a problem?

Statistical methods in recognition. Why is classification a problem? Statistical methods in recognition Basic steps in classifier design collect training images choose a classification model estimate parameters of classification model from training images evaluate model

More information

Appendix A Review of Probability Theory

Appendix A Review of Probability Theory Appendix A Review of Probability Theory A.1 Introduction: What Is Probability? What s in a word? The words probably and probability are used commonly in everyday speech. We all know how to interpret expressions

More information

What is a random variable

What is a random variable OKAN UNIVERSITY FACULTY OF ENGINEERING AND ARCHITECTURE MATH 256 Probability and Random Processes 04 Random Variables Fall 20 Yrd. Doç. Dr. Didem Kivanc Tureli didemk@ieee.org didem.kivanc@okan.edu.tr

More information

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. Math 4 review exam MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. Convert the constraints into linear equations by using slack variables. ) Maximize

More information

Outline. 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks

Outline. 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this

More information

Review: mostly probability and some statistics

Review: mostly probability and some statistics Review: mostly probability and some statistics C2 1 Content robability (should know already) Axioms and properties Conditional probability and independence Law of Total probability and Bayes theorem Random

More information

Deep Learning for Computer Vision

Deep Learning for Computer Vision Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair

More information

Chapter 3: Random Variables 1

Chapter 3: Random Variables 1 Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.

More information

Introduction to Probability and Sample Spaces

Introduction to Probability and Sample Spaces 2.2 2.3 Introduction to Probability and Sample Spaces Prof. Tesler Math 186 Winter 2019 Prof. Tesler Ch. 2.3-2.4 Intro to Probability Math 186 / Winter 2019 1 / 26 Course overview Probability: Determine

More information

Statistics Statistical Process Control & Control Charting

Statistics Statistical Process Control & Control Charting Statistics Statistical Process Control & Control Charting Cayman Systems International 1/22/98 1 Recommended Statistical Course Attendance Basic Business Office, Staff, & Management Advanced Business Selected

More information

Conditional Probability

Conditional Probability Conditional Probability Conditional Probability The Law of Total Probability Let A 1, A 2,..., A k be mutually exclusive and exhaustive events. Then for any other event B, P(B) = P(B A 1 ) P(A 1 ) + P(B

More information

Chapter 3: Random Variables 1

Chapter 3: Random Variables 1 Chapter 3: Random Variables 1 Yunghsiang S. Han Graduate Institute of Communication Engineering, National Taipei University Taiwan E-mail: yshan@mail.ntpu.edu.tw 1 Modified from the lecture notes by Prof.

More information

9709 MATHEMATICS. 9709/62 Paper 6, maximum raw mark 50

9709 MATHEMATICS. 9709/62 Paper 6, maximum raw mark 50 CAMBRIDGE INTERNATIONAL EXAMINATIONS GCE Advanced Subsidiary Level and GCE Advanced Level MARK SCHEME for the May/June 2014 series 9709 MATHEMATICS 9709/62 Paper 6, maximum raw mark 50 This mark scheme

More information

Prof. Thistleton MAT 505 Introduction to Probability Lecture 18

Prof. Thistleton MAT 505 Introduction to Probability Lecture 18 Prof. Thistleton MAT 505 Introduction to Probability Lecture Sections from Text and MIT Video Lecture: 6., 6.4, 7.5 http://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-04-probabilisticsystems-analysis-and-applied-probability-fall-200/video-lectures/lecture-6-discrete-randomvariable-examples-joint-pmfs/

More information

Solution to Assignment 3

Solution to Assignment 3 The Chinese University of Hong Kong ENGG3D: Probability and Statistics for Engineers 5-6 Term Solution to Assignment 3 Hongyang Li, Francis Due: 3:pm, March Release Date: March 8, 6 Dear students, The

More information

2/3/04. Syllabus. Probability Lecture #2. Grading. Probability Theory. Events and Event Spaces. Experiments and Sample Spaces

2/3/04. Syllabus. Probability Lecture #2. Grading. Probability Theory. Events and Event Spaces. Experiments and Sample Spaces Probability Lecture #2 Introduction to Natural Language Processing CMPSCI 585, Spring 2004 University of Massachusetts Amherst Andrew McCallum Syllabus Probability and Information Theory Spam filtering

More information

Probability theory. References:

Probability theory. References: Reasoning Under Uncertainty References: Probability theory Mathematical methods in artificial intelligence, Bender, Chapter 7. Expert systems: Principles and programming, g, Giarratano and Riley, pag.

More information

Lecture 6 Random Variable. Compose of procedure & observation. From observation, we get outcomes

Lecture 6 Random Variable. Compose of procedure & observation. From observation, we get outcomes ENM 07 Lecture 6 Random Variable Random Variable Eperiment (hysical Model) Compose of procedure & observation From observation we get outcomes From all outcomes we get a (mathematical) probability model

More information

Random Variables. Cumulative Distribution Function (CDF) Amappingthattransformstheeventstotherealline.

Random Variables. Cumulative Distribution Function (CDF) Amappingthattransformstheeventstotherealline. Random Variables Amappingthattransformstheeventstotherealline. Example 1. Toss a fair coin. Define a random variable X where X is 1 if head appears and X is if tail appears. P (X =)=1/2 P (X =1)=1/2 Example

More information

MODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES DISTRIBUTION FUNCTION AND ITS PROPERTIES

MODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES DISTRIBUTION FUNCTION AND ITS PROPERTIES MODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES 7-11 Topics 2.1 RANDOM VARIABLE 2.2 INDUCED PROBABILITY MEASURE 2.3 DISTRIBUTION FUNCTION AND ITS PROPERTIES 2.4 TYPES OF RANDOM VARIABLES: DISCRETE,

More information

Probability Pearson Education, Inc. Slide

Probability Pearson Education, Inc. Slide Probability The study of probability is concerned with random phenomena. Even though we cannot be certain whether a given result will occur, we often can obtain a good measure of its likelihood, or probability.

More information

A = (a + 1) 2 = a 2 + 2a + 1

A = (a + 1) 2 = a 2 + 2a + 1 A = (a + 1) 2 = a 2 + 2a + 1 1 A = ( (a + b) + 1 ) 2 = (a + b) 2 + 2(a + b) + 1 = a 2 + 2ab + b 2 + 2a + 2b + 1 A = ( (a + b) + 1 ) 2 = (a + b) 2 + 2(a + b) + 1 = a 2 + 2ab + b 2 + 2a + 2b + 1 3 A = (

More information

Mathematics 426 Robert Gross Homework 9 Answers

Mathematics 426 Robert Gross Homework 9 Answers Mathematics 4 Robert Gross Homework 9 Answers. Suppose that X is a normal random variable with mean µ and standard deviation σ. Suppose that PX > 9 PX

More information

1 Random variables and distributions

1 Random variables and distributions Random variables and distributions In this chapter we consider real valued functions, called random variables, defined on the sample space. X : S R X The set of possible values of X is denoted by the set

More information

27 Binary Arithmetic: An Application to Programming

27 Binary Arithmetic: An Application to Programming 27 Binary Arithmetic: An Application to Programming In the previous section we looked at the binomial distribution. The binomial distribution is essentially the mathematics of repeatedly flipping a coin

More information

MATH 317 Fall 2016 Assignment 5

MATH 317 Fall 2016 Assignment 5 MATH 37 Fall 26 Assignment 5 6.3, 6.4. ( 6.3) etermine whether F(x, y) e x sin y îı + e x cos y ĵj is a conservative vector field. If it is, find a function f such that F f. enote F (P, Q). We have Q x

More information

Homework 10 (due December 2, 2009)

Homework 10 (due December 2, 2009) Homework (due December, 9) Problem. Let X and Y be independent binomial random variables with parameters (n, p) and (n, p) respectively. Prove that X + Y is a binomial random variable with parameters (n

More information

To understand and analyze this test, we need to have the right model for the events. We need to identify an event and its probability.

To understand and analyze this test, we need to have the right model for the events. We need to identify an event and its probability. Probabilistic Models Example #1 A production lot of 10,000 parts is tested for defects. It is expected that a defective part occurs once in every 1,000 parts. A sample of 500 is tested, with 2 defective

More information

Statistical Machine Learning Notes 1. Background

Statistical Machine Learning Notes 1. Background Statistical Machine Learning Notes 1 Instructor: Justin Domke Background Contents 1 Probability 2 11 Sample Spaces 2 12 Random Variables 3 13 Multiple Random Variables 5 14 Expectations 6 15 Empirical

More information

Basic Statistics for SGPE Students Part II: Probability theory 1

Basic Statistics for SGPE Students Part II: Probability theory 1 Basic Statistics for SGPE Students Part II: Probability theory 1 Mark Mitchell mark.mitchell@ed.ac.uk Nicolai Vitt n.vitt@ed.ac.uk University of Edinburgh September 2016 1 Thanks to Achim Ahrens, Anna

More information

Stochastic processes and Data mining

Stochastic processes and Data mining Stochastic processes and Data mining Meher Krishna Patel Created on : Octorber, 2017 Last updated : May, 2018 More documents are freely available at PythonDSP Table of contents Table of contents i 1 The

More information

Exam 3 review for Math 1190

Exam 3 review for Math 1190 Exam 3 review for Math 9 Be sure to be familiar with the following : Extreme Value Theorem Optimization The antiderivative u-substitution as a method for finding antiderivatives Reimann sums (e.g. L 6

More information

Machine Learning Lecture Notes

Machine Learning Lecture Notes Machine Learning Lecture Notes Predrag Radivojac January 3, 25 Random Variables Until now we operated on relatively simple sample spaces and produced measure functions over sets of outcomes. In many situations,

More information

Multivariate Distributions (Hogg Chapter Two)

Multivariate Distributions (Hogg Chapter Two) Multivariate Distributions (Hogg Chapter Two) STAT 45-1: Mathematical Statistics I Fall Semester 15 Contents 1 Multivariate Distributions 1 11 Random Vectors 111 Two Discrete Random Variables 11 Two Continuous

More information

CS4705. Probability Review and Naïve Bayes. Slides from Dragomir Radev

CS4705. Probability Review and Naïve Bayes. Slides from Dragomir Radev CS4705 Probability Review and Naïve Bayes Slides from Dragomir Radev Classification using a Generative Approach Previously on NLP discriminative models P C D here is a line with all the social media posts

More information

Differential Equations

Differential Equations Math 181 Prof. Beydler 9.1/9.3 Notes Page 1 of 6 Differential Equations A differential equation is an equation that contains an unknown function and some of its derivatives. The following are examples

More information

Stochastic processes Lecture 1: Multiple Random Variables Ch. 5

Stochastic processes Lecture 1: Multiple Random Variables Ch. 5 Stochastic processes Lecture : Multiple Random Variables Ch. 5 Dr. Ir. Richard C. Hendriks 26/04/8 Delft University of Technology Challenge the future Organization Plenary Lectures Book: R.D. Yates and

More information

Conditional Probability

Conditional Probability Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the

More information

Practice Examination # 3

Practice Examination # 3 Practice Examination # 3 Sta 23: Probability December 13, 212 This is a closed-book exam so do not refer to your notes, the text, or any other books (please put them on the floor). You may use a single

More information

First Order Differential Equations and Applications

First Order Differential Equations and Applications First Order Differential Equations and Applications Definition. A differential Equation is an equation involving an unknown function y, and some of its derivatives, and possibly some other known functions.

More information

STA 256: Statistics and Probability I

STA 256: Statistics and Probability I Al Nosedal. University of Toronto. Fall 2017 My momma always said: Life was like a box of chocolates. You never know what you re gonna get. Forrest Gump. There are situations where one might be interested

More information

Math 1310 Lab 10. (Sections )

Math 1310 Lab 10. (Sections ) Math 131 Lab 1. (Sections 5.1-5.3) Name/Unid: Lab section: 1. (Properties of the integral) Use the properties of the integral in section 5.2 for answering the following question. (a) Knowing that 2 2f(x)

More information

NO CALCULATORS. NO BOOKS. NO NOTES. TURN OFF YOUR CELL PHONES AND PUT THEM AWAY.

NO CALCULATORS. NO BOOKS. NO NOTES. TURN OFF YOUR CELL PHONES AND PUT THEM AWAY. FINAL EXAM-MATH 3 FALL TERM, R. Blute & A. Novruzi Name(Print LEGIBLY) I.D. Number Instructions- This final examination consists of multiple choice questions worth 3 points each. Your answers to the multiple

More information

Definition of differential equations and their classification. Methods of solution of first-order differential equations

Definition of differential equations and their classification. Methods of solution of first-order differential equations Introduction to differential equations: overview Definition of differential equations and their classification Solutions of differential equations Initial value problems Existence and uniqueness Mathematical

More information

Random Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R

Random Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample

More information

(i) Given that a student is female, what is the probability of having a GPA of at least 3.0?

(i) Given that a student is female, what is the probability of having a GPA of at least 3.0? MATH 382 Conditional Probability Dr. Neal, WKU We now shall consider probabilities of events that are restricted within a subset that is smaller than the entire sample space Ω. For example, let Ω be the

More information

Conditional Probability and Bayes Theorem (2.4) Independence (2.5)

Conditional Probability and Bayes Theorem (2.4) Independence (2.5) Conditional Probability and Bayes Theorem (2.4) Independence (2.5) Prof. Tesler Math 186 Winter 2019 Prof. Tesler Conditional Probability and Bayes Theorem Math 186 / Winter 2019 1 / 38 Scenario: Flip

More information

ECE 4400:693 - Information Theory

ECE 4400:693 - Information Theory ECE 4400:693 - Information Theory Dr. Nghi Tran Lecture 8: Differential Entropy Dr. Nghi Tran (ECE-University of Akron) ECE 4400:693 Lecture 1 / 43 Outline 1 Review: Entropy of discrete RVs 2 Differential

More information

V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE

V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE A game of chance featured at an amusement park is played as follows: You pay $ to play. A penny a nickel are flipped. You win $ if either

More information

Statistical Experiment A statistical experiment is any process by which measurements are obtained.

Statistical Experiment A statistical experiment is any process by which measurements are obtained. (التوزيعات الا حتمالية ( Distributions Probability Statistical Experiment A statistical experiment is any process by which measurements are obtained. Examples of Statistical Experiments Counting the number

More information

Integration. Antiderivatives and Indefinite Integration 3/9/2015. Copyright Cengage Learning. All rights reserved.

Integration. Antiderivatives and Indefinite Integration 3/9/2015. Copyright Cengage Learning. All rights reserved. Integration Copyright Cengage Learning. All rights reserved. Antiderivatives and Indefinite Integration Copyright Cengage Learning. All rights reserved. 1 Objectives Write the general solution of a differential

More information

Joint p.d.f. and Independent Random Variables

Joint p.d.f. and Independent Random Variables 1 Joint p.d.f. and Independent Random Variables Let X and Y be two discrete r.v. s and let R be the corresponding space of X and Y. The joint p.d.f. of X = x and Y = y, denoted by f(x, y) = P(X = x, Y

More information

SDS 321: Introduction to Probability and Statistics

SDS 321: Introduction to Probability and Statistics SDS 321: Introduction to Probability and Statistics Lecture 2: Conditional probability Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching

More information

Lecture 3 - Axioms of Probability

Lecture 3 - Axioms of Probability Lecture 3 - Axioms of Probability Sta102 / BME102 January 25, 2016 Colin Rundel Axioms of Probability What does it mean to say that: The probability of flipping a coin and getting heads is 1/2? 3 What

More information

Continuous Random Variables

Continuous Random Variables 1 / 24 Continuous Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay February 27, 2013 2 / 24 Continuous Random Variables

More information

Probability, Random Processes and Inference

Probability, Random Processes and Inference INSTITUTO POLITÉCNICO NACIONAL CENTRO DE INVESTIGACION EN COMPUTACION Laboratorio de Ciberseguridad Probability, Random Processes and Inference Dr. Ponciano Jorge Escamilla Ambrosio pescamilla@cic.ipn.mx

More information

Ordinary Differential Equations (ODEs)

Ordinary Differential Equations (ODEs) c01.tex 8/10/2010 22: 55 Page 1 PART A Ordinary Differential Equations (ODEs) Chap. 1 First-Order ODEs Sec. 1.1 Basic Concepts. Modeling To get a good start into this chapter and this section, quickly

More information

2.12: Derivatives of Exp/Log (cont d) and 2.15: Antiderivatives and Initial Value Problems

2.12: Derivatives of Exp/Log (cont d) and 2.15: Antiderivatives and Initial Value Problems 2.12: Derivatives of Exp/Log (cont d) and 2.15: Antiderivatives and Initial Value Problems Mathematics 3 Lecture 14 Dartmouth College February 03, 2010 Derivatives of the Exponential and Logarithmic Functions

More information

11. Probability Sample Spaces and Probability

11. Probability Sample Spaces and Probability 11. Probability 11.1 Sample Spaces and Probability 1 Objectives A. Find the probability of an event. B. Find the empirical probability of an event. 2 Theoretical Probabilities 3 Example A fair coin is

More information

Problem Max. Possible Points Total

Problem Max. Possible Points Total MA 262 Exam 1 Fall 2011 Instructor: Raphael Hora Name: Max Possible Student ID#: 1234567890 1. No books or notes are allowed. 2. You CAN NOT USE calculators or any electronic devices. 3. Show all work

More information

New test - November 03, 2015 [79 marks]

New test - November 03, 2015 [79 marks] New test - November 03, 05 [79 marks] Let f(x) = e x cosx, x. a. Show that f (x) = e x ( cosx sin x). correctly finding the derivative of e x, i.e. e x correctly finding the derivative of cosx, i.e. sin

More information

Lecture 19: Solving linear ODEs + separable techniques for nonlinear ODE s

Lecture 19: Solving linear ODEs + separable techniques for nonlinear ODE s Lecture 19: Solving linear ODEs + separable techniques for nonlinear ODE s Geoffrey Cowles Department of Fisheries Oceanography School for Marine Science and Technology University of Massachusetts-Dartmouth

More information

Notation: X = random variable; x = particular value; P(X = x) denotes probability that X equals the value x.

Notation: X = random variable; x = particular value; P(X = x) denotes probability that X equals the value x. Ch. 16 Random Variables Def n: A random variable is a numerical measurement of the outcome of a random phenomenon. A discrete random variable is a random variable that assumes separate values. # of people

More information

1 Review of di erential calculus

1 Review of di erential calculus Review of di erential calculus This chapter presents the main elements of di erential calculus needed in probability theory. Often, students taking a course on probability theory have problems with concepts

More information

Lecture 1 : The Mathematical Theory of Probability

Lecture 1 : The Mathematical Theory of Probability Lecture 1 : The Mathematical Theory of Probability 0/ 30 1. Introduction Today we will do 2.1 and 2.2. We will skip Chapter 1. We all have an intuitive notion of probability. Let s see. What is the probability

More information

Probability Lecture #7

Probability Lecture #7 Probability Lecture #7 Introduction to Natural Language Processing CMPSCI 585, Fall 2007 University of Massachusetts Amherst Andrew McCallum Today s Main Points Remember (or learn) about probability theory

More information

Random Variables. Statistics 110. Summer Copyright c 2006 by Mark E. Irwin

Random Variables. Statistics 110. Summer Copyright c 2006 by Mark E. Irwin Random Variables Statistics 110 Summer 2006 Copyright c 2006 by Mark E. Irwin Random Variables A Random Variable (RV) is a response of a random phenomenon which is numeric. Examples: 1. Roll a die twice

More information

Expected Value 7/7/2006

Expected Value 7/7/2006 Expected Value 7/7/2006 Definition Let X be a numerically-valued discrete random variable with sample space Ω and distribution function m(x). The expected value E(X) is defined by E(X) = x Ω x m(x), provided

More information

2010 Euclid Contest. Solutions

2010 Euclid Contest. Solutions Canadian Mathematics Competition An activity of the Centre for Education in Mathematics and Computing, University of Waterloo, Waterloo, Ontario 00 Euclid Contest Wednesday, April 7, 00 Solutions 00 Centre

More information

CS206 Review Sheet 3 October 24, 2018

CS206 Review Sheet 3 October 24, 2018 CS206 Review Sheet 3 October 24, 2018 After ourintense focusoncounting, wecontinue withthestudyofsomemoreofthebasic notions from Probability (though counting will remain in our thoughts). An important

More information

Math 3215 Intro. Probability & Statistics Summer 14. Homework 5: Due 7/3/14

Math 3215 Intro. Probability & Statistics Summer 14. Homework 5: Due 7/3/14 Math 325 Intro. Probability & Statistics Summer Homework 5: Due 7/3/. Let X and Y be continuous random variables with joint/marginal p.d.f. s f(x, y) 2, x y, f (x) 2( x), x, f 2 (y) 2y, y. Find the conditional

More information

Math 4B Notes. Written by Victoria Kala SH 6432u Office Hours: T 12:45 1:45pm Last updated 7/24/2016

Math 4B Notes. Written by Victoria Kala SH 6432u Office Hours: T 12:45 1:45pm Last updated 7/24/2016 Math 4B Notes Written by Victoria Kala vtkala@math.ucsb.edu SH 6432u Office Hours: T 2:45 :45pm Last updated 7/24/206 Classification of Differential Equations The order of a differential equation is the

More information

P (x). all other X j =x j. If X is a continuous random vector (see p.172), then the marginal distributions of X i are: f(x)dx 1 dx n

P (x). all other X j =x j. If X is a continuous random vector (see p.172), then the marginal distributions of X i are: f(x)dx 1 dx n JOINT DENSITIES - RANDOM VECTORS - REVIEW Joint densities describe probability distributions of a random vector X: an n-dimensional vector of random variables, ie, X = (X 1,, X n ), where all X is are

More information

First Digit Tally Marks Final Count

First Digit Tally Marks Final Count Benford Test () Imagine that you are a forensic accountant, presented with the two data sets on this sheet of paper (front and back). Which of the two sets should be investigated further? Why? () () ()

More information

Ordinary Differential Equations

Ordinary Differential Equations Ordinary Differential Equations (MA102 Mathematics II) Shyamashree Upadhyay IIT Guwahati Shyamashree Upadhyay ( IIT Guwahati ) Ordinary Differential Equations 1 / 25 First order ODE s We will now discuss

More information

Introduction to bivariate analysis

Introduction to bivariate analysis Introduction to bivariate analysis When one measurement is made on each observation, univariate analysis is applied. If more than one measurement is made on each observation, multivariate analysis is applied.

More information