Chapter 1: Introduction to Probability Theory
|
|
- Dayna Fowler
- 5 years ago
- Views:
Transcription
1 ECE5: Stochastic Signals and Systems Fall 8 Lecture - September 6, 8 Prof. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter : Introduction to Probability Theory Axioms of Probability Definition (Probability Space). The Probability space is defined by a triplet (Ω, F, P), where: Ω is the Sample space F is the set of Events P is the Probability function Definition (Sample space). The Sample space, Ω, is the set of all possible outcomes of a random experiment. Example. When we toss a coin, all the possible outcomes are Heads or Tails. Therefore, the sample space of a coin tossing is Ω = {Head, Tail}. Example. When we toss a die, one of the 6 faces is going to come up. Therefore, the sample space of a die tossing is Ω = {,,,, 5, 6}. Example. Suppose that we want to measure the temperature a Thursday afternoon in September. Then Ω = R. Definition (Event). An event E is a subset of the sample space, i.e., E Ω. Example. Coin Tossing: The Event of getting a Head is E = {H} Example 5. Die Tossing: The Event of getting a multiple of is E = {, 6} Example 6. Temperature measurement: The Event of getting a temperature between 7 o F and 9 o F is E = [7, 9] Example 7. If we toss a fair coin twice, then the sample space is Ω = {HH, HT, T H, T T }. Consider the event A at least one Head occurs ; then, the event is A = {HH, HT, T H}. Let B be the event of tossing the coin repeatedly until a Head occurs. Then, B = {H, T H, T T H,... }. Let C be the event of tossing the coin an even number of times until a Head occurs. Then, C = {T H, T T T H,... }.
2 Definition (F). F is the set of all events Typically when Ω is countable, F is the set of all subsets of Ω, i.e., the power set of Ω. But this is not the case for Ω uncountable, where F is going to be too large and there will often be sets to which it will be impossible to assign a unique measure like in Ω = R. (Check Definition 5. and Remark.) Remark. F must be a σ algebra such that. Ω F,. If A F, then its complement set A C F,. if A i F for all i =,..., then i= A i F Corollary. From De Morgan s Law and the previous property we get that if A i F for all i =,..., then i= A i F Example 8. Temperature measurement How to prove that (a, b) is an Event when [a, b] F? If E = [a, b] F, then a & b F. T hen [a, b] {ā} { b} F which is (a, b). Definition 5 (Borel Set). Borel sets are the sets that can be constructed from open or closed sets by repeatedly taking countable unions and intersections. Formally, Borel algebra is the smallest σ algebra that makes all open sets measurable. Remark. Not all subsets of Ω are events. You can define sets that have no probability. In such a case, we have to use the smallest σ algebra called Borel algebra that contains all closed intervals For this class, any subset of Ω is an event. Definition 6 (Axioms of probability). A probability measure P on Ω is a function such that it satisfies the following properties: P : Ω [, ], E P (E), () P ( ) =. () P (Ω) =. () If A, A, A... are disjoint subsets of Ω, ( ) P A i = i= i P (A i ). Here, Ω is the power set of Ω. Lemma. Let A and B be two subsets of Ω. We define have: Ā to be the complement of A in Ω, we
3 (a) P (Ā) = P (A). (b) If A B, then P (A) P (B). (c) P (A B) = P (A) + P (B) P (A B). Proof. For part(a), For part(b), P (A Ā) = P (Ω) = and A, Ā are disjoint P (A) + P (Ā) = P (Ā) = p(a) B = A (B \ A) P (B) = P (A) + P (B \ A) P (A) For part(c), Now, P (A B) = P (A) + P (B \ A) = P (A) + P (B \ A B). (A B) B P (B \ A B) = P (B) P (A B). Lemma (Union bound). Let A and B be two subsets of Ω, then In general, P (A B) P (A) + P (B). ( n ) P A i i= n P (A i ). Example 9 (Tossing a Die (a)). A : The result number is a multiple of. A : The result number is a multiple of. A = {,, 6}, P (A ) =. A = {, 6}, P (A ) =. i= P (A A ) P (A ) + P (A ) = + = 5 6 In fact, A A = {,,, 6} and P (A A ) =. Example (Tossing a Die (b)). A : The result number is less than or equal to. A : The result number is prime. A = {,, 5, 6}, P (A ) =. A = {,, 5}, P (A ) =. P (A A ) P (A ) + P (A ) = + = 7 6 > In fact, A A = {,,, 5, 6} and P (A A ) = 5 6.
4 Figure : Graph connection. Example (Random Graphs). Consider the graph G = (V, E) over vertices, given in Figure, where V = {,,, } is the vertex set and E = {{, }, {, }, {, }} is the edge set. A random graph G defined over the vertex set V is a graph where an edge between any two vertices exists with a probability p. If we take a graph on n vertices and the edge exists between vertices n(n ) with probability=p=.5. Then the number of subsets of V of size = = ( n ). The number of subsets of V of size k = ( n k). If we have vertices in a graph.what is the probability that vertex is connected to k other nodes? (a) vertices,, are connected to each other (b) vertices, are connected to each other (c) vertices, are connected to each other (d) vertices,,, connected to each other Figure : Graph connection for vertices Let N be the neighbors of vertex, N = φ in fig(a), N = {, } in fig(b), N = {, } in fig(c), N = {,, } in fig(d). Then we define the event A N is that the vertex is connected to the vertices in N We say vertex is connected to k other vertices, if k =, all the possible graph are as (Figure ).
5 (a): Node connected to and (b): Node connected to and. (c): Node connected to and. Figure : vertex is connected to two vertices Define event A vertex is connected to other vertices,therefore: The probability of this event A is A = A {,} A {,} A {,}. P (A) = P (A {,} ) + P (A {,} ) + P (A {,} ). The probability of vertex is connected to vertex and is therefore, P (A {,} ) = ( ) = p ( p) = P (A {,} ) = P (A {,} ), P (A) = p ( p). In general, the probability vertex is connected to k specific vertices is P (A N ) = p k ( p) n k. The probability vertex is connected to k other vertices is P (A) = ΣP (A N ), ( ) n = p k ( p) n k. k. Conditional Probability Example. Let A be the event of tossing two fair dice such that the total exceeds 6. (a) Find P (A). The set of all events Ω is given by the following set: (, ), (, ),... (, ), (, ), (, ),... (, 6), Ω = (6, ), (6, ),... (6, 6). 5
6 Now, we need to find P (A). All the possible outcomes of A (total exceeds 6) are: A = {(, 6) (, 5), (, 6) (, ), (, 5), (, 6) (, ), (, ), (, 5), (, 6) (5, ), (5, ), (5, ), (5, 5), (5, 6) (6, ), (6, ), (6, ), (6, ), (6, 5), (6, 6)}. Therefore P (A) = e A P (e) fair dice = 6 (b) Let B the event that the first dice is. Find P (B). All the possible outcomes of event B are: B = {(, ), (, ), (, ), (, ), (, 5), (, 6)}. () Then all the possible outcomes of event A given B are the events in equation () satisfying A (total exceeds 6), hence (A B) = {(, ), (, 5), (, 6)}. (c) What is the probability of Total exceeds 6 given that the first dice is we can find that by P (A B) = 6, P (A B) = P (A B). P (B) Definition 7 (Conditional probability). We define the conditional probability of an event A given that event B happened (with P (B) > ) by: P (A B) = P (A B). P (B) Definition 8 (Independent events). Two events A and B are independent iff In general, P (A B) = P (A)P (B). We can also say that the events A and B are independent iff P (A B) = P (A)P (B A) () = P (B)P (A B). () P (A B) = P (A), (P (B) ) P (B A) = P (B), (P (A) ). 6
7 T ransmitted bits X -ε Received bits Y ε ε -ε Figure : Binary Symmetric Channel (BSC) with probability of error P e = ε. Example (Binary symmetric channel). In the BSC of Fig. 8 the bits are flipped with probability ε (ε is called crossover probability), we can write ε = P (Y = X = ) = P (Y = X = ). Suppose the bits and are equal likely to be sent, i.e., P (X = ) = P (X = ) =.5, Q. Find the probability of sending a and receiving a. Ans. P (X =, Y = ) = P (X = )P (Y = X = ) =.5( ε).. Total Law of Probability Theorem. Let A, A,..., A n be n mutually disjoint events such that Ω = n A i (P (A i ) ), () i= then for any event B Ω we have P (B) = P (A )P (B A ) + P (A )P (B A ) P (A n )P (B A n ). B... A A A n Figure 5: Total law of probability. 7
8 Proof. For n= B = (B A ) (B A ), (5) P (B) = P (B A ) + P (B A ), (6) = P (A )P (B A ) + P (A )P (B A ). (7) Example. (BSC) Consider a BSC in Fig. 6 with crossover probability ε =.. The probability of sending is. and the probability of sending is.6. Q. Find the probability of receiving a. X.9 Y...9 Figure 6: Binary Symmetric Channel with probability of error P e =.. Ans. The probability of sending is P (X = ) =.6, and the probability of sending is P (X = ) =.. Then if we want to know the probability of receiving, we can use the total law of probability to calculate P (Y = ), P (Y = ) = P (X = )P (Y = X = ) + P (X = )P (Y = X = ), = (.) (.9) + (.6) (.) =... Birthday paradox Question:What is the probability that at least students in class have the same birthday. E:at least students have the same birthday. Number of days per year is n, number of students in class is m. Ē: each student has distinct birthday. Answer: We know that P (Ē) = ( n ) ( n ) ( m n ). k n e k n, k n. 8
9 Then, P (Ē) = e n e n e m n, = exp( ( m )), n ) m(m = e n, e m n. Now we have student m = 5, and number of birthdays n = 65. P (E) e 65, %. Question:How big the class should be if the probability of students have same birthday is larger than 5%? Answer: Then P (E) =. e m n =, so m n = ln, m = ln n,. So we need approximately students in same class to make the probability that at least students have the same birthday is larger than. Theorem (Baye s Theorem). P (A i B) = P (B A i )P (A i ) n i= P (B A i)p (A i ). (8) Example 5 (BSC). In this case we have P (X = ) = P (X = ) = transmitted) Suppose we observe Y =. What value of X should we decode? P (X = Y = ) = P (X =, Y = ). P (Y = ) (s and s are equal likely 9
10 B... A A A n Figure 7: Baye s theorem. T ransmitted bits X -ε Received bits Y ε ε -ε Figure 8: Binary Symmetric Channel (BSC) with probability of error P e = ɛ. According to the Baye s theorem P (X = Y = ) = P (X = )P (Y = X = ) P (X = )P (Y = X = ) + P (X = )P (Y = X = ), =.5( ε).5ε +.5( ε), = ε.
Chapter 2: Random Variables
ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:
More informationMathematical Foundations of Computer Science Lecture Outline October 18, 2018
Mathematical Foundations of Computer Science Lecture Outline October 18, 2018 The Total Probability Theorem. Consider events E and F. Consider a sample point ω E. Observe that ω belongs to either F or
More informationECE 302: Chapter 02 Probability Model
ECE 302: Chapter 02 Probability Model Fall 2018 Prof Stanley Chan School of Electrical and Computer Engineering Purdue University 1 / 35 1. Probability Model 2 / 35 What is Probability? It is a number.
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More information4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio
4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Wrong is right. Thelonious Monk 4.1 Three Definitions of
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationLecture 1. ABC of Probability
Math 408 - Mathematical Statistics Lecture 1. ABC of Probability January 16, 2013 Konstantin Zuev (USC) Math 408, Lecture 1 January 16, 2013 1 / 9 Agenda Sample Spaces Realizations, Events Axioms of Probability
More informationLecture 9: Conditional Probability and Independence
EE5110: Probability Foundations July-November 2015 Lecture 9: Conditional Probability and Independence Lecturer: Dr. Krishna Jagannathan Scribe: Vishakh Hegde 9.1 Conditional Probability Definition 9.1
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationMidterm #1 - Solutions
Midterm # - olutions Math/tat 94 Quizzes. Let A be the event Andrea and Bill are both in class. The complementary event is (choose one): A c = Neither Andrea nor Bill are in class A c = Bill is not in
More informationIntroduction to Probability. Ariel Yadin. Lecture 1. We begin with an example [this is known as Bertrand s paradox]. *** Nov.
Introduction to Probability Ariel Yadin Lecture 1 1. Example: Bertrand s Paradox We begin with an example [this is known as Bertrand s paradox]. *** Nov. 1 *** Question 1.1. Consider a circle of radius
More informationHW Solution 3 Due: July 15
ECS 315: Probability and Random Processes 2010/1 HW Solution 3 Due: July 15 Lecturer: Prapun Suksompong, Ph.D. Instructions (a) A part of ONE question will be graded. Of course, you do not know which problem
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More informationDynamic Programming Lecture #4
Dynamic Programming Lecture #4 Outline: Probability Review Probability space Conditional probability Total probability Bayes rule Independent events Conditional independence Mutual independence Probability
More informationMODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES DISTRIBUTION FUNCTION AND ITS PROPERTIES
MODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES 7-11 Topics 2.1 RANDOM VARIABLE 2.2 INDUCED PROBABILITY MEASURE 2.3 DISTRIBUTION FUNCTION AND ITS PROPERTIES 2.4 TYPES OF RANDOM VARIABLES: DISCRETE,
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationRandomized Algorithms. Andreas Klappenecker
Randomized Algorithms Andreas Klappenecker Randomized Algorithms A randomized algorithm is an algorithm that makes random choices during its execution. A randomized algorithm uses values generated by a
More informationIndependence Solutions STAT-UB.0103 Statistics for Business Control and Regression Models
Independence Solutions STAT-UB.003 Statistics for Business Control and Regression Models The Birthday Problem. A class has 70 students. What is the probability that at least two students have the same
More informationChapter 2: Probability Part 1
Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.
More informationECE353: Probability and Random Processes. Lecture 2 - Set Theory
ECE353: Probability and Random Processes Lecture 2 - Set Theory Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu January 10, 2018 Set
More informationStatistics for Financial Engineering Session 2: Basic Set Theory March 19 th, 2006
Statistics for Financial Engineering Session 2: Basic Set Theory March 19 th, 2006 Topics What is a set? Notations for sets Empty set Inclusion/containment and subsets Sample spaces and events Operations
More information12 1 = = 1
Basic Probability: Problem Set One Summer 07.3. We have A B B P (A B) P (B) 3. We also have from the inclusion-exclusion principle that since P (A B). P (A B) P (A) + P (B) P (A B) 3 P (A B) 3 For examples
More informationSample Space: Specify all possible outcomes from an experiment. Event: Specify a particular outcome or combination of outcomes.
Chapter 2 Introduction to Probability 2.1 Probability Model Probability concerns about the chance of observing certain outcome resulting from an experiment. However, since chance is an abstraction of something
More informationThe probability of an event is viewed as a numerical measure of the chance that the event will occur.
Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationMAT2377. Ali Karimnezhad. Version September 9, Ali Karimnezhad
MAT2377 Ali Karimnezhad Version September 9, 2015 Ali Karimnezhad Comments These slides cover material from Chapter 1. In class, I may use a blackboard. I recommend reading these slides before you come
More informationBasics of Probability Theory
Basics of Probability Theory Andreas Klappenecker Texas A&M University 2018 by Andreas Klappenecker. All rights reserved. 1 / 39 Terminology The probability space or sample space Ω is the set of all possible
More informationRecap. The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY INFERENTIAL STATISTICS
Recap. Probability (section 1.1) The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY Population Sample INFERENTIAL STATISTICS Today. Formulation
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationLecture 1. Chapter 1. (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 ( ). 1. What is Statistics?
Lecture 1 (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 (2.1 --- 2.6). Chapter 1 1. What is Statistics? 2. Two definitions. (1). Population (2). Sample 3. The objective of statistics.
More informationLecture 11: Random Variables
EE5110: Probability Foundations for Electrical Engineers July-November 2015 Lecture 11: Random Variables Lecturer: Dr. Krishna Jagannathan Scribe: Sudharsan, Gopal, Arjun B, Debayani The study of random
More informationIntroduction to Probability
Introduction to Probability Gambling at its core 16th century Cardano: Books on Games of Chance First systematic treatment of probability 17th century Chevalier de Mere posed a problem to his friend Pascal.
More informationLecture 4: Probability and Discrete Random Variables
Error Correcting Codes: Combinatorics, Algorithms and Applications (Fall 2007) Lecture 4: Probability and Discrete Random Variables Wednesday, January 21, 2009 Lecturer: Atri Rudra Scribe: Anonymous 1
More informationConditional Probability
Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.
More informationLecture notes for probability. Math 124
Lecture notes for probability Math 124 What is probability? Probabilities are ratios, expressed as fractions, decimals, or percents, determined by considering results or outcomes of experiments whose result
More informationLecture 8: Probability
Lecture 8: Probability The idea of probability is well-known The flipping of a balanced coin can produce one of two outcomes: T (tail) and H (head) and the symmetry between the two outcomes means, of course,
More informationA PECULIAR COIN-TOSSING MODEL
A PECULIAR COIN-TOSSING MODEL EDWARD J. GREEN 1. Coin tossing according to de Finetti A coin is drawn at random from a finite set of coins. Each coin generates an i.i.d. sequence of outcomes (heads or
More informationORF 245 Fundamentals of Statistics Chapter 5 Probability
ORF 245 Fundamentals of Statistics Chapter 5 Probability Robert Vanderbei Oct 2015 Slides last edited on October 14, 2015 http://www.princeton.edu/ rvdb Sample Spaces (aka Populations) and Events When
More informationConditional Probability 2 Solutions COR1-GB.1305 Statistics and Data Analysis
Conditional Probability 2 Solutions COR-GB.305 Statistics and Data Analysis The Birthday Problem. A class has 50 students. What is the probability that at least two students have the same birthday? Assume
More informationProbability Theory Review
Cogsci 118A: Natural Computation I Lecture 2 (01/07/10) Lecturer: Angela Yu Probability Theory Review Scribe: Joseph Schilz Lecture Summary 1. Set theory: terms and operators In this section, we provide
More information4. Probability of an event A for equally likely outcomes:
University of California, Los Angeles Department of Statistics Statistics 110A Instructor: Nicolas Christou Probability Probability: A measure of the chance that something will occur. 1. Random experiment:
More informationModule 1. Probability
Module 1 Probability 1. Introduction In our daily life we come across many processes whose nature cannot be predicted in advance. Such processes are referred to as random processes. The only way to derive
More informationTheorem 1.7 [Bayes' Law]: Assume that,,, are mutually disjoint events in the sample space s.t.. Then Pr( )
Theorem 1.7 [Bayes' Law]: Assume that,,, are mutually disjoint events in the sample space s.t.. Then Pr Pr = Pr Pr Pr() Pr Pr. We are given three coins and are told that two of the coins are fair and the
More informationMath 1313 Experiments, Events and Sample Spaces
Math 1313 Experiments, Events and Sample Spaces At the end of this recording, you should be able to define and use the basic terminology used in defining experiments. Terminology The next main topic in
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models
More informationLecture 1: Overview of percolation and foundational results from probability theory 30th July, 2nd August and 6th August 2007
CSL866: Percolation and Random Graphs IIT Delhi Arzad Kherani Scribe: Amitabha Bagchi Lecture 1: Overview of percolation and foundational results from probability theory 30th July, 2nd August and 6th August
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationChap 1: Experiments, Models, and Probabilities. Random Processes. Chap 1 : Experiments, Models, and Probabilities
EE8103 Random Processes Chap 1 : Experiments, Models, and Probabilities Introduction Real world word exhibits randomness Today s temperature; Flip a coin, head or tail? WalkAt to a bus station, how long
More informationMA : Introductory Probability
MA 320-001: Introductory Probability David Murrugarra Department of Mathematics, University of Kentucky http://www.math.uky.edu/~dmu228/ma320/ Spring 2017 David Murrugarra (University of Kentucky) MA 320:
More informationWhy study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables
ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section
More informationLecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationUniversity of Regina. Lecture Notes. Michael Kozdron
University of Regina Statistics 851 Probability Lecture Notes Winter 2008 Michael Kozdron kozdron@stat.math.uregina.ca http://stat.math.uregina.ca/ kozdron References [1] Jean Jacod and Philip Protter.
More informationSum and Product Rules
Sum and Product Rules Exercise. Consider tossing a coin five times. What is the probability of getting the same result on the first two tosses or the last two tosses? Solution. Let E be the event that
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationSection 13.3 Probability
288 Section 13.3 Probability Probability is a measure of how likely an event will occur. When the weather forecaster says that there will be a 50% chance of rain this afternoon, the probability that it
More informationCS626 Data Analysis and Simulation
CS626 Data Analysis and Simulation Instructor: Peter Kemper R 104A, phone 221-3462, email:kemper@cs.wm.edu Today: Probability Primer Quick Reference: Sheldon Ross: Introduction to Probability Models 9th
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More informationIndependence. P(A) = P(B) = 3 6 = 1 2, and P(C) = 4 6 = 2 3.
Example: A fair die is tossed and we want to guess the outcome. The outcomes will be 1, 2, 3, 4, 5, 6 with equal probability 1 6 each. If we are interested in getting the following results: A = {1, 3,
More informationStatistics 1 - Lecture Notes Chapter 1
Statistics 1 - Lecture Notes Chapter 1 Caio Ibsen Graduate School of Economics - Getulio Vargas Foundation April 28, 2009 We want to establish a formal mathematic theory to work with results of experiments
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 3 9/10/2008 CONDITIONING AND INDEPENDENCE
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 3 9/10/2008 CONDITIONING AND INDEPENDENCE Most of the material in this lecture is covered in [Bertsekas & Tsitsiklis] Sections 1.3-1.5
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationECE 340 Probabilistic Methods in Engineering M/W 3-4:15. Lecture 2: Random Experiments. Prof. Vince Calhoun
ECE 340 Probabilistic Methods in Engineering M/W 3-4:15 Lecture 2: Random Experiments Prof. Vince Calhoun Reading This class: Section 2.1-2.2 Next class: Section 2.3-2.4 Homework: Assignment 1: From the
More informationBASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES
BASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES COMMON TERMS RELATED TO PROBABILITY Probability is the measure of the likelihood that an event will occur Probability values are
More informationHW2 Solutions, for MATH441, STAT461, STAT561, due September 9th
HW2 Solutions, for MATH44, STAT46, STAT56, due September 9th. You flip a coin until you get tails. Describe the sample space. How many points are in the sample space? The sample space consists of sequences
More informationAutomata and Languages
Automata and Languages Prof. Mohamed Hamada Software Engineering Lab. The University of Aizu Japan Mathematical Background Mathematical Background Sets Relations Functions Graphs Proof techniques Sets
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationEE 178 Lecture Notes 0 Course Introduction. About EE178. About Probability. Course Goals. Course Topics. Lecture Notes EE 178
EE 178 Lecture Notes 0 Course Introduction About EE178 About Probability Course Goals Course Topics Lecture Notes EE 178: Course Introduction Page 0 1 EE 178 EE 178 provides an introduction to probabilistic
More informationLecture 1 : The Mathematical Theory of Probability
Lecture 1 : The Mathematical Theory of Probability 0/ 30 1. Introduction Today we will do 2.1 and 2.2. We will skip Chapter 1. We all have an intuitive notion of probability. Let s see. What is the probability
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationP (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).
Lectures 7-8 jacques@ucsdedu 41 Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information,
More informationProbability: Part 1 Naima Hammoud
Probability: Part 1 Naima ammoud Feb 7, 2017 Motivation ossing a coin Rolling a die Outcomes: eads or ails Outcomes: 1, 2, 3, 4, 5 or 6 Defining Probability If I toss a coin, there is a 50% chance I will
More informationVenn Diagrams; Probability Laws. Notes. Set Operations and Relations. Venn Diagram 2.1. Venn Diagrams; Probability Laws. Notes
Lecture 2 s; Text: A Course in Probability by Weiss 2.4 STAT 225 Introduction to Probability Models January 8, 2014 s; Whitney Huang Purdue University 2.1 Agenda s; 1 2 2.2 Intersection: the intersection
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 2: Conditional probability Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationStatistics for Linguists. Don t pannic
Statistics for Linguists Don t pannic Basic Statistics The main reason that statistics has grown as popular as it has is something that is known as The stability of the relative frequency. This is the
More informationChapter Learning Objectives. Random Experiments Dfiii Definition: Dfiii Definition:
Chapter 2: Probability 2-1 Sample Spaces & Events 2-1.1 Random Experiments 2-1.2 Sample Spaces 2-1.3 Events 2-1 1.4 Counting Techniques 2-2 Interpretations & Axioms of Probability 2-3 Addition Rules 2-4
More informationIntermediate Math Circles November 8, 2017 Probability II
Intersection of Events and Independence Consider two groups of pairs of events Intermediate Math Circles November 8, 017 Probability II Group 1 (Dependent Events) A = {a sales associate has training} B
More informationCourse: ESO-209 Home Work: 1 Instructor: Debasis Kundu
Home Work: 1 1. Describe the sample space when a coin is tossed (a) once, (b) three times, (c) n times, (d) an infinite number of times. 2. A coin is tossed until for the first time the same result appear
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More informationMATH 556: PROBABILITY PRIMER
MATH 6: PROBABILITY PRIMER 1 DEFINITIONS, TERMINOLOGY, NOTATION 1.1 EVENTS AND THE SAMPLE SPACE Definition 1.1 An experiment is a one-off or repeatable process or procedure for which (a there is a well-defined
More informationWeek 2. Section Texas A& M University. Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019
Week 2 Section 1.2-1.4 Texas A& M University Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019 Oğuz Gezmiş (TAMU) Topics in Contemporary Mathematics II Week2 1
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More informationProbability Theory. Probability and Statistics for Data Science CSE594 - Spring 2016
Probability Theory Probability and Statistics for Data Science CSE594 - Spring 2016 What is Probability? 2 What is Probability? Examples outcome of flipping a coin (seminal example) amount of snowfall
More informationSTAT 111 Recitation 1
STAT 111 Recitation 1 Linjun Zhang January 20, 2017 What s in the recitation This class, and the exam of this class, is a mix of statistical concepts and calculations. We are going to do a little bit of
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationAlmost Sure Convergence of a Sequence of Random Variables
Almost Sure Convergence of a Sequence of Random Variables (...for people who haven t had measure theory.) 1 Preliminaries 1.1 The Measure of a Set (Informal) Consider the set A IR 2 as depicted below.
More informationProbability COMP 245 STATISTICS. Dr N A Heard. 1 Sample Spaces and Events Sample Spaces Events Combinations of Events...
Probability COMP 245 STATISTICS Dr N A Heard Contents Sample Spaces and Events. Sample Spaces........................................2 Events........................................... 2.3 Combinations
More informationProbability. Lecture Notes. Adolfo J. Rumbos
Probability Lecture Notes Adolfo J. Rumbos October 20, 204 2 Contents Introduction 5. An example from statistical inference................ 5 2 Probability Spaces 9 2. Sample Spaces and σ fields.....................
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationLecture 2: Probability. Readings: Sections Statistical Inference: drawing conclusions about the population based on a sample
Lecture 2: Probability Readings: Sections 5.1-5.3 1 Introduction Statistical Inference: drawing conclusions about the population based on a sample Parameter: a number that describes the population a fixed
More informationIntroduction to Stochastic Processes
Stat251/551 (Spring 2017) Stochastic Processes Lecture: 1 Introduction to Stochastic Processes Lecturer: Sahand Negahban Scribe: Sahand Negahban 1 Organization Issues We will use canvas as the course webpage.
More informationStat 451: Solutions to Assignment #1
Stat 451: Solutions to Assignment #1 2.1) By definition, 2 Ω is the set of all subsets of Ω. Therefore, to show that 2 Ω is a σ-algebra we must show that the conditions of the definition σ-algebra are
More informationStatistics 251: Statistical Methods
Statistics 251: Statistical Methods Probability Module 3 2018 file:///volumes/users/r/renaes/documents/classes/lectures/251301/renae/markdown/master%20versions/module3.html#1 1/33 Terminology probability:
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationMath-Stat-491-Fall2014-Notes-I
Math-Stat-491-Fall2014-Notes-I Hariharan Narayanan October 2, 2014 1 Introduction This writeup is intended to supplement material in the prescribed texts: Introduction to Probability Models, 10th Edition,
More informationMath 3338: Probability (Fall 2006)
Math 3338: Probability (Fall 2006) Jiwen He Section Number: 10853 http://math.uh.edu/ jiwenhe/math3338fall06.html Probability p.1/8 2.2 Axioms, Interpretations, and Properties of Probability Probability
More informationCMPSCI 240: Reasoning Under Uncertainty
CMPSCI 240: Reasoning Under Uncertainty Lecture 5 Prof. Hanna Wallach wallach@cs.umass.edu February 7, 2012 Reminders Pick up a copy of B&T Check the course website: http://www.cs.umass.edu/ ~wallach/courses/s12/cmpsci240/
More information