Soc500: Applied Social Statistics Week 1: Introduction and Probability
|
|
- Eugene Hancock
- 5 years ago
- Views:
Transcription
1 Soc500: Applied Social Statistics Week 1: Introduction and Probability Brandon Stewart 1 Princeton September 14, These slides are heavily influenced by Matt Blackwell, Adam Glynn and Matt Salganik. The spam filter segment is adapted from Justin Grimmer and Dan Jurafsky. Illustrations by Shay O Brien. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
2 Where We ve Been and Where We re Going... Last Week methods camp pre-grad school life This Week Wednesday welcome basics of probability Next Week random variables joint distributions Long Run probability inference regression Questions? Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
3 Welcome and Introductions Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
4 Welcome and Introductions Soc500: Applied Social Statistics Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
5 Welcome and Introductions Soc500: Applied Social Statistics I Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
6 Welcome and Introductions Soc500: Applied Social Statistics I... am an Assistant Professor in Sociology. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
7 Welcome and Introductions Soc500: Applied Social Statistics I... am an Assistant Professor in Sociology.... am trained in political science and statistics Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
8 Welcome and Introductions Soc500: Applied Social Statistics I... am an Assistant Professor in Sociology.... am trained in political science and statistics... do research in methods and statistical text analysis Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
9 Welcome and Introductions Soc500: Applied Social Statistics I... am an Assistant Professor in Sociology.... am trained in political science and statistics... do research in methods and statistical text analysis... love doing collaborative research Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
10 Welcome and Introductions Soc500: Applied Social Statistics I... am an Assistant Professor in Sociology.... am trained in political science and statistics... do research in methods and statistical text analysis... love doing collaborative research... talk very quickly Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
11 Welcome and Introductions Soc500: Applied Social Statistics I... am an Assistant Professor in Sociology.... am trained in political science and statistics... do research in methods and statistical text analysis... love doing collaborative research... talk very quickly Your Preceptors Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
12 Welcome and Introductions Soc500: Applied Social Statistics I... am an Assistant Professor in Sociology.... am trained in political science and statistics... do research in methods and statistical text analysis... love doing collaborative research... talk very quickly Your Preceptors sage guides of all things Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
13 Welcome and Introductions Soc500: Applied Social Statistics I... am an Assistant Professor in Sociology.... am trained in political science and statistics... do research in methods and statistical text analysis... love doing collaborative research... talk very quickly Your Preceptors sage guides of all things Ian Lundberg Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
14 Welcome and Introductions Soc500: Applied Social Statistics I... am an Assistant Professor in Sociology.... am trained in political science and statistics... do research in methods and statistical text analysis... love doing collaborative research... talk very quickly Your Preceptors sage guides of all things Ian Lundberg Simone Zhang Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
15 1 Welcome 2 Goals 3 Ways to Learn 4 Structure of Course 5 Introduction to Probability What is Probability? Sample Spaces and Events Probability Functions Marginal, Joint and Conditional Probability Bayes Rule Independence 6 Fun With History Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
16 1 Welcome 2 Goals 3 Ways to Learn 4 Structure of Course 5 Introduction to Probability What is Probability? Sample Spaces and Events Probability Functions Marginal, Joint and Conditional Probability Bayes Rule Independence 6 Fun With History Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
17 The Core Strategy Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
18 The Core Strategy Goal: get you ready to quantitative work Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
19 The Core Strategy Goal: get you ready to quantitative work First in a two course sequence replication project Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
20 The Core Strategy Goal: get you ready to quantitative work First in a two course sequence replication project (for graduate students, part of a longer arc) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
21 The Core Strategy Goal: get you ready to quantitative work First in a two course sequence replication project (for graduate students, part of a longer arc) Difficult course but with many resources to support you. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
22 The Core Strategy Goal: get you ready to quantitative work First in a two course sequence replication project (for graduate students, part of a longer arc) Difficult course but with many resources to support you. When we are done you will be able to teach yourself many things Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
23 Specific Goals Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
24 Specific Goals For the semester Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
25 Specific Goals For the semester critically read, interpret and replicate the quantitative content of many articles in the quantitative social sciences Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
26 Specific Goals For the semester critically read, interpret and replicate the quantitative content of many articles in the quantitative social sciences conduct, interpret, and communicate results from analysis using multiple regression Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
27 Specific Goals For the semester critically read, interpret and replicate the quantitative content of many articles in the quantitative social sciences conduct, interpret, and communicate results from analysis using multiple regression explain the limitations of observational data for making causal claims Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
28 Specific Goals For the semester critically read, interpret and replicate the quantitative content of many articles in the quantitative social sciences conduct, interpret, and communicate results from analysis using multiple regression explain the limitations of observational data for making causal claims write clean, reusable, and reliable R code. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
29 Specific Goals For the semester critically read, interpret and replicate the quantitative content of many articles in the quantitative social sciences conduct, interpret, and communicate results from analysis using multiple regression explain the limitations of observational data for making causal claims write clean, reusable, and reliable R code. feel empowered working with data Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
30 Specific Goals Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
31 Specific Goals For the year Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
32 Specific Goals For the year conduct, interpret, and communicate results from analysis using generalized linear models Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
33 Specific Goals For the year conduct, interpret, and communicate results from analysis using generalized linear models understand the fundamental ideas of missing data, modern causal inference, and hierarchical models Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
34 Specific Goals For the year conduct, interpret, and communicate results from analysis using generalized linear models understand the fundamental ideas of missing data, modern causal inference, and hierarchical models build a solid, reproducible research pipeline to go from raw data to final paper Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
35 Specific Goals For the year conduct, interpret, and communicate results from analysis using generalized linear models understand the fundamental ideas of missing data, modern causal inference, and hierarchical models build a solid, reproducible research pipeline to go from raw data to final paper provide you with the tools to produce your own research (e.g. second year empirical paper). Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
36 Why R? It s free Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
37 Why R? It s free It s extremely powerful, but relatively simple to do basic stats Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
38 Why R? It s free It s extremely powerful, but relatively simple to do basic stats It s the de facto standard in many applied statistical fields Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
39 Why R? It s free It s extremely powerful, but relatively simple to do basic stats It s the de facto standard in many applied statistical fields great community support Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
40 Why R? It s free It s extremely powerful, but relatively simple to do basic stats It s the de facto standard in many applied statistical fields great community support continuing development Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
41 Why R? It s free It s extremely powerful, but relatively simple to do basic stats It s the de facto standard in many applied statistical fields great community support continuing development massive number of supporting packages Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
42 Why R? It s free It s extremely powerful, but relatively simple to do basic stats It s the de facto standard in many applied statistical fields great community support continuing development massive number of supporting packages It will help you do research Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
43 Why RMarkdown? What you ve done before Baumer et al (2014) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
44 Why RMarkdown? RMarkdown Baumer et al (2014) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
45 1 Welcome 2 Goals 3 Ways to Learn 4 Structure of Course 5 Introduction to Probability What is Probability? Sample Spaces and Events Probability Functions Marginal, Joint and Conditional Probability Bayes Rule Independence 6 Fun With History Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
46 1 Welcome 2 Goals 3 Ways to Learn 4 Structure of Course 5 Introduction to Probability What is Probability? Sample Spaces and Events Probability Functions Marginal, Joint and Conditional Probability Bayes Rule Independence 6 Fun With History Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
47 Mathematical Prerequisites Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
48 Mathematical Prerequisites No formal pre-requisites Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
49 Mathematical Prerequisites No formal pre-requisites Balancing rigor and intuition Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
50 Mathematical Prerequisites No formal pre-requisites Balancing rigor and intuition no rigor for rigor s sake Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
51 Mathematical Prerequisites No formal pre-requisites Balancing rigor and intuition no rigor for rigor s sake we will tell you why you need the math, but also feel free to ask Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
52 Mathematical Prerequisites No formal pre-requisites Balancing rigor and intuition no rigor for rigor s sake we will tell you why you need the math, but also feel free to ask We will teach you any math you need as we go along Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
53 Mathematical Prerequisites No formal pre-requisites Balancing rigor and intuition no rigor for rigor s sake we will tell you why you need the math, but also feel free to ask We will teach you any math you need as we go along Crucially though- this class is not about statistical aptitude, it is about effort Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
54 Ways to Learn Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
55 Ways to Learn Lecture learn broad topics Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
56 Ways to Learn Lecture learn broad topics Precept learn data analysis skills, get targeted help on assignments Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
57 Ways to Learn Lecture learn broad topics Precept learn data analysis skills, get targeted help on assignments Readings support materials for lecture and precept Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
58 Reading Required reading: Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
59 Reading Required reading: Fox (2016) Applied Regression Analysis and Generalized Linear Models Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
60 Reading Required reading: Fox (2016) Applied Regression Analysis and Generalized Linear Models Angrist and Pischke (2008) Mostly Harmless Econometrics Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
61 Reading Required reading: Fox (2016) Applied Regression Analysis and Generalized Linear Models Angrist and Pischke (2008) Mostly Harmless Econometrics Imai (2017) A First Course in Quantitative Social Science* Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
62 Reading Required reading: Fox (2016) Applied Regression Analysis and Generalized Linear Models Angrist and Pischke (2008) Mostly Harmless Econometrics Imai (2017) A First Course in Quantitative Social Science* Aronow and Miller (2017) Theory of Agnostic Statistics* Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
63 Reading Required reading: Fox (2016) Applied Regression Analysis and Generalized Linear Models Angrist and Pischke (2008) Mostly Harmless Econometrics Imai (2017) A First Course in Quantitative Social Science* Aronow and Miller (2017) Theory of Agnostic Statistics* Suggested reading Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
64 Reading Required reading: Fox (2016) Applied Regression Analysis and Generalized Linear Models Angrist and Pischke (2008) Mostly Harmless Econometrics Imai (2017) A First Course in Quantitative Social Science* Aronow and Miller (2017) Theory of Agnostic Statistics* Suggested reading When and how to do the reading Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
65 Ways to Learn Lecture learn broad topics Precept learn data analysis skills, get targeted help on assignments Readings support materials for lecture and precept Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
66 Ways to Learn Lecture learn broad topics Precept learn data analysis skills, get targeted help on assignments Readings support materials for lecture and precept Problem Sets reinforce understanding of material, practice Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
67 Problem Sets Schedule (available Wednesday, due 8 days later at precept) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
68 Problem Sets Schedule (available Wednesday, due 8 days later at precept) Grading and solutions Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
69 Problem Sets Schedule (available Wednesday, due 8 days later at precept) Grading and solutions Code conventions Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
70 Problem Sets Schedule (available Wednesday, due 8 days later at precept) Grading and solutions Code conventions Collaboration policy Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
71 Problem Sets Schedule (available Wednesday, due 8 days later at precept) Grading and solutions Code conventions Collaboration policy Note: You may find these difficult. Start early and seek help! Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
72 Ways to Learn Lecture learn broad topics Precept learn data analysis skills, get targeted help on assignments Readings support materials for lecture and precept Problem Sets reinforce understanding of material, practice Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
73 Ways to Learn Lecture learn broad topics Precept learn data analysis skills, get targeted help on assignments Readings support materials for lecture and precept Problem Sets reinforce understanding of material, practice Piazza ask questions of us and your classmates Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
74 Ways to Learn Lecture learn broad topics Precept learn data analysis skills, get targeted help on assignments Readings support materials for lecture and precept Problem Sets reinforce understanding of material, practice Piazza ask questions of us and your classmates Office Hours ask even more questions. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
75 Ways to Learn Lecture learn broad topics Precept learn data analysis skills, get targeted help on assignments Readings support materials for lecture and precept Problem Sets reinforce understanding of material, practice Piazza ask questions of us and your classmates Office Hours ask even more questions. Your Job: get help when you need it! Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
76 Attribution and Thanks Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
77 Attribution and Thanks My philosophy on teaching: don t reinvent the wheel- customize, refine, improve. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
78 Attribution and Thanks My philosophy on teaching: don t reinvent the wheel- customize, refine, improve. Huge thanks to those who have provided slides particularly: Matt Blackwell, Adam Glynn, Justin Grimmer, Jens Hainmueller, Kevin Quinn Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
79 Attribution and Thanks My philosophy on teaching: don t reinvent the wheel- customize, refine, improve. Huge thanks to those who have provided slides particularly: Matt Blackwell, Adam Glynn, Justin Grimmer, Jens Hainmueller, Kevin Quinn Also thanks to those who have discussed with me at length including Dalton Conley, Chad Hazlett, Gary King, Kosuke Imai, Matt Salganik and Teppei Yamamoto. Shay O Brien produced the hand-drawn illustrations used throughout. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
80 1 Welcome 2 Goals 3 Ways to Learn 4 Structure of Course 5 Introduction to Probability What is Probability? Sample Spaces and Events Probability Functions Marginal, Joint and Conditional Probability Bayes Rule Independence 6 Fun With History Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
81 1 Welcome 2 Goals 3 Ways to Learn 4 Structure of Course 5 Introduction to Probability What is Probability? Sample Spaces and Events Probability Functions Marginal, Joint and Conditional Probability Bayes Rule Independence 6 Fun With History Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
82 Outline of Topics Outline in reverse order: Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
83 Outline of Topics Outline in reverse order: Regression: how to determine the relationship between variables. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
84 Outline of Topics Outline in reverse order: Regression: how to determine the relationship between variables. Inference: how to learn about things we don t know from the things we do know Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
85 Outline of Topics Outline in reverse order: Regression: how to determine the relationship between variables. Inference: how to learn about things we don t know from the things we do know Probability: learn what data we would expect if we did know the truth. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
86 Outline of Topics Outline in reverse order: Regression: how to determine the relationship between variables. Inference: how to learn about things we don t know from the things we do know Probability: learn what data we would expect if we did know the truth. Probability Inference Regression Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
87 What is Statistics? branch of mathematics studying collection and analysis of data Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
88 What is Statistics? branch of mathematics studying collection and analysis of data the name statistic comes from the word state Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
89 What is Statistics? branch of mathematics studying collection and analysis of data the name statistic comes from the word state the arc of developments in statistics Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
90 What is Statistics? branch of mathematics studying collection and analysis of data the name statistic comes from the word state the arc of developments in statistics 1 an applied scholar has a problem Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
91 What is Statistics? branch of mathematics studying collection and analysis of data the name statistic comes from the word state the arc of developments in statistics 1 an applied scholar has a problem 2 they solve the problem by inventing a specific method Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
92 What is Statistics? branch of mathematics studying collection and analysis of data the name statistic comes from the word state the arc of developments in statistics 1 an applied scholar has a problem 2 they solve the problem by inventing a specific method 3 statisticians generalize and export the best of these methods Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
93 Quantitative Research in Theory Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
94 Quantitative Research in Theory Inspiration: Hadley Wickham, Image: Matt Salganik Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
95 Quantitative Research in Practice Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
96 Quantitative Research in Practice Inspiration: Hadley Wickham, Image: Matt Salganik Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
97 Traditional Statistics Class Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
98 Traditional Statistics Class Inspiration: Hadley Wickham, Image: Matt Salganik Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
99 Time Actually Spent Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
100 Time Actually Spent Inspiration: Hadley Wickham, Image: Matt Salganik Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
101 This Class Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
102 This Class Strike a balance between practice and theory Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
103 This Class Strike a balance between practice and theory Heavy emphasis on applied data analysis Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
104 This Class Strike a balance between practice and theory Heavy emphasis on applied data analysis problem sets with real data Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
105 This Class Strike a balance between practice and theory Heavy emphasis on applied data analysis problem sets with real data replication project next semester Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
106 This Class Strike a balance between practice and theory Heavy emphasis on applied data analysis problem sets with real data replication project next semester Teaching select key principles from statistics Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
107 Deterministic vs. Stochastic what is the relationship between hours spent studying and performance in Soc500? Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
108 Deterministic vs. Stochastic what is the relationship between hours spent studying and performance in Soc500? One way to approach this: Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
109 Deterministic vs. Stochastic what is the relationship between hours spent studying and performance in Soc500? One way to approach this: generate a deterministic account of performance performance i = f (hours i ) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
110 Deterministic vs. Stochastic what is the relationship between hours spent studying and performance in Soc500? One way to approach this: generate a deterministic account of performance performance i = f (hours i ) but studying isn t the only indicator of performance! Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
111 Deterministic vs. Stochastic what is the relationship between hours spent studying and performance in Soc500? One way to approach this: generate a deterministic account of performance performance i = f (hours i ) but studying isn t the only indicator of performance! we could try to account for everything performance i = f (hours i ) + g(other i ). Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
112 Deterministic vs. Stochastic what is the relationship between hours spent studying and performance in Soc500? One way to approach this: generate a deterministic account of performance performance i = f (hours i ) but studying isn t the only indicator of performance! we could try to account for everything performance i = f (hours i ) + g(other i ). but that s impossible Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
113 Deterministic vs. Stochastic what is the relationship between hours spent studying and performance in Soc500? One way to approach this: generate a deterministic account of performance performance i = f (hours i ) but studying isn t the only indicator of performance! we could try to account for everything performance i = f (hours i ) + g(other i ). but that s impossible A better approach Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
114 Deterministic vs. Stochastic what is the relationship between hours spent studying and performance in Soc500? One way to approach this: generate a deterministic account of performance performance i = f (hours i ) but studying isn t the only indicator of performance! we could try to account for everything performance i = f (hours i ) + g(other i ). but that s impossible A better approach Instead treat other factors as stochastic Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
115 Deterministic vs. Stochastic what is the relationship between hours spent studying and performance in Soc500? One way to approach this: generate a deterministic account of performance performance i = f (hours i ) but studying isn t the only indicator of performance! we could try to account for everything performance i = f (hours i ) + g(other i ). but that s impossible A better approach Instead treat other factors as stochastic Thus we often write it as performance i = f (hours i ) + ɛ i Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
116 Deterministic vs. Stochastic what is the relationship between hours spent studying and performance in Soc500? One way to approach this: generate a deterministic account of performance performance i = f (hours i ) but studying isn t the only indicator of performance! we could try to account for everything performance i = f (hours i ) + g(other i ). but that s impossible A better approach Instead treat other factors as stochastic Thus we often write it as performance i = f (hours i ) + ɛ i This allows us to have uncertainty over outcomes given our inputs Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
117 Deterministic vs. Stochastic what is the relationship between hours spent studying and performance in Soc500? One way to approach this: generate a deterministic account of performance performance i = f (hours i ) but studying isn t the only indicator of performance! we could try to account for everything performance i = f (hours i ) + g(other i ). but that s impossible A better approach Instead treat other factors as stochastic Thus we often write it as performance i = f (hours i ) + ɛ i This allows us to have uncertainty over outcomes given our inputs Our way of talking about stochastic outcomes is probability. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
118 In a rasa ± I. a**roao.. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
119 In Picture Form. :..arrf ± HE rasa a :. a**roao.. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
120 In Picture Form probability Data generating process Observed data inference Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
121 Statistical Thought Experiments Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
122 Statistical Thought Experiments Start with probability Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
123 Statistical Thought Experiments Start with probability Allows us to contemplate world under hypothetical scenarios Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
124 Statistical Thought Experiments Start with probability Allows us to contemplate world under hypothetical scenarios hypotheticals let us ask- is the observed relationship happening by chance or is it systematic? Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
125 Statistical Thought Experiments Start with probability Allows us to contemplate world under hypothetical scenarios hypotheticals let us ask- is the observed relationship happening by chance or is it systematic? it tells us what the world would look like under a certain assumption Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
126 Statistical Thought Experiments Start with probability Allows us to contemplate world under hypothetical scenarios hypotheticals let us ask- is the observed relationship happening by chance or is it systematic? it tells us what the world would look like under a certain assumption We will review probability today, but feel free to ask questions as needed. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
127 Example: Fisher s Lady Tasting Tea Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
128 Example: Fisher s Lady Tasting Tea The Story Setup Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
129 Example: Fisher s Lady Tasting Tea The Story Setup (lady discerning about tea) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
130 Example: Fisher s Lady Tasting Tea The Story Setup (lady discerning about tea) The Experiment Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
131 Example: Fisher s Lady Tasting Tea The Story Setup (lady discerning about tea) The Experiment (perform a taste test) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
132 Example: Fisher s Lady Tasting Tea The Story Setup (lady discerning about tea) The Experiment (perform a taste test) The Hypothetical Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
133 Example: Fisher s Lady Tasting Tea The Story Setup (lady discerning about tea) The Experiment (perform a taste test) The Hypothetical (count possibilities) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
134 Example: Fisher s Lady Tasting Tea The Story Setup (lady discerning about tea) The Experiment (perform a taste test) The Hypothetical (count possibilities) The Result Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
135 Example: Fisher s Lady Tasting Tea The Story Setup (lady discerning about tea) The Experiment (perform a taste test) The Hypothetical (count possibilities) The Result (boom she was right) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
136 Example: Fisher s Lady Tasting Tea The Story Setup (lady discerning about tea) The Experiment (perform a taste test) The Hypothetical (count possibilities) The Result (boom she was right) This became the Fisher Exact Test. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
137 1 Welcome 2 Goals 3 Ways to Learn 4 Structure of Course 5 Introduction to Probability What is Probability? Sample Spaces and Events Probability Functions Marginal, Joint and Conditional Probability Bayes Rule Independence 6 Fun With History Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
138 1 Welcome 2 Goals 3 Ways to Learn 4 Structure of Course 5 Introduction to Probability What is Probability? Sample Spaces and Events Probability Functions Marginal, Joint and Conditional Probability Bayes Rule Independence 6 Fun With History Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
139 Why Probability? Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
140 Why Probability? Helps us envision hypotheticals Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
141 Why Probability? Helps us envision hypotheticals Describes uncertainty in how the data is generated Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
142 Why Probability? Helps us envision hypotheticals Describes uncertainty in how the data is generated Data Analysis: estimate probability that something will happen Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
143 Why Probability? Helps us envision hypotheticals Describes uncertainty in how the data is generated Data Analysis: estimate probability that something will happen Thus: we need to know how probability gives rise to data Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
144 Intuitive Definition of Probability Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
145 Intuitive Definition of Probability While there are several interpretations of what probability is, most modern (post 1935 or so) researchers agree on an axiomatic definition of probability. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
146 Intuitive Definition of Probability While there are several interpretations of what probability is, most modern (post 1935 or so) researchers agree on an axiomatic definition of probability. 3 Axioms (Intuitive Version): Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
147 Intuitive Definition of Probability While there are several interpretations of what probability is, most modern (post 1935 or so) researchers agree on an axiomatic definition of probability. 3 Axioms (Intuitive Version): 1 The probability of any particular event must be non-negative. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
148 Intuitive Definition of Probability While there are several interpretations of what probability is, most modern (post 1935 or so) researchers agree on an axiomatic definition of probability. 3 Axioms (Intuitive Version): 1 The probability of any particular event must be non-negative. 2 The probability of anything occurring among all possible events must be 1. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
149 Intuitive Definition of Probability While there are several interpretations of what probability is, most modern (post 1935 or so) researchers agree on an axiomatic definition of probability. 3 Axioms (Intuitive Version): 1 The probability of any particular event must be non-negative. 2 The probability of anything occurring among all possible events must be 1. 3 The probability of one of many mutually exclusive events happening is the sum of the individual probabilities. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
150 Intuitive Definition of Probability While there are several interpretations of what probability is, most modern (post 1935 or so) researchers agree on an axiomatic definition of probability. 3 Axioms (Intuitive Version): 1 The probability of any particular event must be non-negative. 2 The probability of anything occurring among all possible events must be 1. 3 The probability of one of many mutually exclusive events happening is the sum of the individual probabilities. All the rules of probability can be derived from these axioms. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
151 Sample Spaces Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
152 Sample Spaces To define probability we need to define the set of possible outcomes. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
153 Sample Spaces To define probability we need to define the set of possible outcomes. The sample space is the set of all possible outcomes, and is often written as S or Ω. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
154 Sample Spaces To define probability we need to define the set of possible outcomes. The sample space is the set of all possible outcomes, and is often written as S or Ω. For example, if we flip a coin twice, there are four possible outcomes, Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
155 Sample Spaces To define probability we need to define the set of possible outcomes. The sample space is the set of all possible outcomes, and is often written as S or Ω. For example, if we flip a coin twice, there are four possible outcomes, S = Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
156 Sample Spaces To define probability we need to define the set of possible outcomes. The sample space is the set of all possible outcomes, and is often written as S or Ω. For example, if we flip a coin twice, there are four possible outcomes, S = { {heads, heads}, Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
157 Sample Spaces To define probability we need to define the set of possible outcomes. The sample space is the set of all possible outcomes, and is often written as S or Ω. For example, if we flip a coin twice, there are four possible outcomes, S = { {heads, heads}, {heads, tails}, Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
158 Sample Spaces To define probability we need to define the set of possible outcomes. The sample space is the set of all possible outcomes, and is often written as S or Ω. For example, if we flip a coin twice, there are four possible outcomes, S = { {heads, heads}, {heads, tails}, {tails, heads}, Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
159 Sample Spaces To define probability we need to define the set of possible outcomes. The sample space is the set of all possible outcomes, and is often written as S or Ω. For example, if we flip a coin twice, there are four possible outcomes, S = { {heads, heads}, {heads, tails}, {tails, heads}, {tails, tails} } Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
160 Sample Spaces To define probability we need to define the set of possible outcomes. The sample space is the set of all possible outcomes, and is often written as S or Ω. For example, if we flip a coin twice, there are four possible outcomes, S = { {heads, heads}, {heads, tails}, {tails, heads}, {tails, tails} } Thus the table in Lady Tasting Tea was defining the sample space. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
161 Sample Spaces To define probability we need to define the set of possible outcomes. The sample space is the set of all possible outcomes, and is often written as S or Ω. For example, if we flip a coin twice, there are four possible outcomes, S = { {heads, heads}, {heads, tails}, {tails, heads}, {tails, tails} } Thus the table in Lady Tasting Tea was defining the sample space. (Note we defined illogical guesses to be prob= 0) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
162 A Running Visual Metaphor Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
163 A Running Visual Metaphor Imagine that we sample an apple from a bag. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
164 A Running Visual Metaphor Imagine that we sample an apple from a bag. Looking in the bag we see: Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
165 A Running Visual Metaphor Imagine that we sample an apple from a bag. Looking in the bag we see: The sample space is: Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
166 Events Events are subsets of the sample space. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
167 Events Events are subsets of the sample space. For Example, if Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
168 . Events Events are subsets of the sample space. For Example, if then a given }, ) and { rain } are both. T.B.DMBB.GG. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
169 Events Are a Kind of Set Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
170 Events Are a Kind of Set Sets are collections of things, in this case collections of outcomes Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
171 Events Are a Kind of Set Sets are collections of things, in this case collections of outcomes One way to define an event is to describe the common property that all of the outcomes share. We write this as {ω ω satisfies P}, where P is the property that they all share. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
172 Events Are a Kind of Set Sets are collections of things, in this case collections of outcomes One way to define an event is to describe the common property that all of the outcomes share. We write this as {ω ω satisfies P}, where P is the property that they all share. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
173 Complement A complement of event A is a set: A c, is collection of all of the outcomes not in A. That is, it is everything else in the sample space. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
174 . Complement A complement of event A is a set: A c, is collection of all of the outcomes not in A. That is, it is everything else in the sample space. a given }, ) and again { } g.a.oa.baaqog@rwaaaa.brb.s are A c = {ω Ω ω / A}. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
175 . Complement A complement of event A is a set: A c, is collection of all of the outcomes not in A. That is, it is everything else in the sample space. a given }, ) and again { } g.a.oa.baaqog@rwaaaa.brb.s are A c = {ω Ω ω / A}. Important complement: Ω c =, where is the empty set it s just the event that nothing happens. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
176 Operations on Events Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
177 Operations on Events The union of two events, A and B is the event that A or B occurs: { air. u * on #Mina,, = air } A B = {ω ω A or ω B}. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
178 Operations on Events The union of two events, A and B is the event that A or B occurs: { air. u * on #Mina,, = air } A B = {ω ω A or ω B}. The intersection of two events, A and B is the event that both A and B occur: s.no#go= A B = {ω ω A and ω B}. {ease } Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
179 Operations on Events We say that two events A and B are disjoint or mutually exclusive if they don t share any elements or that A B =. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
180 Operations on Events We say that two events A and B are disjoint or mutually exclusive if they don t share any elements or that A B =. An event and its complement A and A c are disjoint. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
181 Operations on Events We say that two events A and B are disjoint or mutually exclusive if they don t share any elements or that A B =. An event and its complement A and A c are disjoint. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
182 Operations on Events We say that two events A and B are disjoint or mutually exclusive if they don t share any elements or that A B =. An event and its complement A and A c are disjoint. Sample spaces can have infinite outcomes A 1, A 2,.... Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
183 Probability Function A probability function P( ) is a function defined over all subsets of a sample space S that satisfies the following three axioms: Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
184 . P( - Probability Function A probability function P( ) is a function defined over all subsets of a sample space S that satisfies the following three axioms: 1 P(A) 0 for all A in the set of all events. B 89 ) =. 5 Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
185 . P( - Probability Function A probability function P( ) is a function defined over all subsets of a sample space S that satisfies the following three axioms: 1 P(A) 0 for all A in the set of all events. nonnegativity B 89 ) =. 5 Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
186 . P. - Probability Function A probability function P( ) is a function defined over all subsets of a sample space S that satisfies the following three axioms: 1 P(A) 0 for all A in the set of all events. nonnegativity 2 P(S) = 1 B 399k (89 ) = P ( { air, raise. = Bin } ), 1 Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
187 . P. - Probability Function A probability function P( ) is a function defined over all subsets of a sample space S that satisfies the following three axioms: 1 P(A) 0 for all A in the set of all events. nonnegativity 2 P(S) = 1 normalization B 399k (89 ) = P ( { air, raise. = Bin } ), 1 Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
188 . P. - Probability Function A probability function P( ) is a function defined over all subsets of a sample space S that satisfies the following three axioms: 1 P(A) 0 for all A in the set of all events. nonnegativity 2 P(S) = 1 normalization 3 if events A 1, A 2,... are mutually exclusive then P( i=1 A i) = i=1 P(A i). B 399k B.. (89 ) =. 5 (given an} = ), Praa) P = ) P ( Aip ) + {give P (.ba when nq a and he# are mutually exclusive. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
189 . P. - Probability Function A probability function P( ) is a function defined over all subsets of a sample space S that satisfies the following three axioms: 1 P(A) 0 for all A in the set of all events. nonnegativity 2 P(S) = 1 normalization 3 if events A 1, A 2,... are mutually exclusive then P( i=1 A i) = i=1 P(A i). additivity B 399k B.. (89 ) =. 5 (given an} = ), Praa) P = ) P ( Aip ) + {give P (.ba when nq a and he# are mutually exclusive. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
190 . P. - Probability Function A probability function P( ) is a function defined over all subsets of a sample space S that satisfies the following three axioms: 1 P(A) 0 for all A in the set of all events. nonnegativity 2 P(S) = 1 normalization 3 if events A 1, A 2,... are mutually exclusive then P( i=1 A i) = i=1 P(A i). additivity B 399k B.. (89 ) =. 5 (given an} = ), Praa) P = ) P ( Aip ) + {give P (.ba when nq a and he# are mutually exclusive. All the rules of probability can be derived from these axioms. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
191 . P. - Probability Function A probability function P( ) is a function defined over all subsets of a sample space S that satisfies the following three axioms: 1 P(A) 0 for all A in the set of all events. nonnegativity 2 P(S) = 1 normalization 3 if events A 1, A 2,... are mutually exclusive then P( i=1 A i) = i=1 P(A i). additivity B 399k B.. (89 ) =. 5 (given an} = ), Praa) P = ) P ( Aip ) + {give P (.ba when nq a and he# are mutually exclusive. All the rules of probability can be derived from these axioms. Intuition: probability as allocating chunks of a unit-long stick. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
192 A Brief Word on Interpretation Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
193 A Brief Word on Interpretation Massive debate on interpretation: Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
194 A Brief Word on Interpretation Massive debate on interpretation: Subjective Interpretation Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
195 A Brief Word on Interpretation Massive debate on interpretation: Subjective Interpretation Example: The probability of drawing 5 red cards out of 10 drawn from a deck of cards is whatever you want it to be. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
196 A Brief Word on Interpretation Massive debate on interpretation: Subjective Interpretation Example: The probability of drawing 5 red cards out of 10 drawn from a deck of cards is whatever you want it to be. But... Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
197 A Brief Word on Interpretation Massive debate on interpretation: Subjective Interpretation Example: The probability of drawing 5 red cards out of 10 drawn from a deck of cards is whatever you want it to be. But... If you don t follow the axioms, a bookie can beat you Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
198 A Brief Word on Interpretation Massive debate on interpretation: Subjective Interpretation Example: The probability of drawing 5 red cards out of 10 drawn from a deck of cards is whatever you want it to be. But... If you don t follow the axioms, a bookie can beat you There is a correct way to update your beliefs with data. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
199 A Brief Word on Interpretation Massive debate on interpretation: Subjective Interpretation Example: The probability of drawing 5 red cards out of 10 drawn from a deck of cards is whatever you want it to be. But... If you don t follow the axioms, a bookie can beat you There is a correct way to update your beliefs with data. Frequency Interpretation Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
200 A Brief Word on Interpretation Massive debate on interpretation: Subjective Interpretation Example: The probability of drawing 5 red cards out of 10 drawn from a deck of cards is whatever you want it to be. But... If you don t follow the axioms, a bookie can beat you There is a correct way to update your beliefs with data. Frequency Interpretation Probability of is the relative frequency with which an event would occur if the process were repeated a large number of times under similar conditions. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
201 A Brief Word on Interpretation Massive debate on interpretation: Subjective Interpretation Example: The probability of drawing 5 red cards out of 10 drawn from a deck of cards is whatever you want it to be. But... If you don t follow the axioms, a bookie can beat you There is a correct way to update your beliefs with data. Frequency Interpretation Probability of is the relative frequency with which an event would occur if the process were repeated a large number of times under similar conditions. Example: The probability of drawing 5 red cards out of 10 drawn from a deck of cards is the frequency with which this event occurs in repeated samples of 10 cards. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
202 Marginal and Joint Probability So far we have only considered situations where we are interested in the probability of a single event A occurring. We ve denoted this P(A). P(A) is sometimes called a marginal probability. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
203 Marginal and Joint Probability So far we have only considered situations where we are interested in the probability of a single event A occurring. We ve denoted this P(A). P(A) is sometimes called a marginal probability. Suppose we are now in a situation where we would like to express the probability that an event A and an event B occur. This quantity is written as P(A B), P(B A), P(A, B), or P(B, A) and is the joint probability of A and B. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
204 p( a.) =? qq.pe#)= p( a *air.. #*@a rain. ringing. 589? a a.. µ Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
205 Conditional Probability Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
206 Conditional Probability The soul of statistics Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
207 Conditional Probability The soul of statistics If P(A) > 0 then the probability of B conditional on A can be written as Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
208 Conditional Probability The soul of statistics If P(A) > 0 then the probability of B conditional on A can be written as P(B A) = P(A, B) P(A) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
209 Conditional Probability The soul of statistics If P(A) > 0 then the probability of B conditional on A can be written as P(B A) = P(A, B) P(A) This implies that Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
210 Conditional Probability The soul of statistics If P(A) > 0 then the probability of B conditional on A can be written as P(B A) = P(A, B) P(A) This implies that P(A, B) = P(A) P(B A) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
211 Conditional Probability: A Visual Example. ) Parsa = t.io bids PC.ae#dpl*a grain. a gear a * or oaivoiv Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
212 Conditional Probability: A Visual Example. ) Parsa = t.io bids PC.ae#dpl*a grain. a gear a * or oaivoiv Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
213 Conditional Probability: A Visual Example. ) Parsa = t.io bids PC.ae#dpl*a grain. a gear a * or oaivoiv Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
214 A Card Player s Example If we randomly draw two cards from a standard 52 card deck and define the events A = {King on Draw 1} and B = {King on Draw 2}, then Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
215 A Card Player s Example If we randomly draw two cards from a standard 52 card deck and define the events A = {King on Draw 1} and B = {King on Draw 2}, then P(A) = Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
216 A Card Player s Example If we randomly draw two cards from a standard 52 card deck and define the events A = {King on Draw 1} and B = {King on Draw 2}, then P(A) = 4/52 Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
217 A Card Player s Example If we randomly draw two cards from a standard 52 card deck and define the events A = {King on Draw 1} and B = {King on Draw 2}, then P(A) = 4/52 P(B A) = Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
218 A Card Player s Example If we randomly draw two cards from a standard 52 card deck and define the events A = {King on Draw 1} and B = {King on Draw 2}, then P(A) = 4/52 P(B A) = 3/51 Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
219 A Card Player s Example If we randomly draw two cards from a standard 52 card deck and define the events A = {King on Draw 1} and B = {King on Draw 2}, then P(A) = 4/52 P(B A) = 3/51 P(A, B) = P(A) P(B A) = Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
220 A Card Player s Example If we randomly draw two cards from a standard 52 card deck and define the events A = {King on Draw 1} and B = {King on Draw 2}, then P(A) = 4/52 P(B A) = 3/51 P(A, B) = P(A) P(B A) = 4/52 3/ Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
221 Law of Total Probability (LTP) With 2 Events: P(B) = P(B, A) + P(B, A c ) = P(B A) P(A) + P(B A c ) P(A c ) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
222 Recall, if we randomly draw two cards from a standard 52 card deck and define the events A = {King on Draw 1} and B = {King on Draw 2}, then P(A) = 4/52 P(B A) = 3/51 P(A, B) = P(A) P(B A) = 4/52 3/51 Question: P(B) =? Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
223 Confirming Intuition with the LTP Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
224 Confirming Intuition with the LTP P(B) = P(B, A) + P(B, A c ) = P(B A) P(A) + P(B A c ) P(A c ) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
225 Confirming Intuition with the LTP P(B) = P(B, A) + P(B, A c ) = P(B A) P(A) + P(B A c ) P(A c ) P(B) = 3/51 1/13 + 4/51 12/13 = = 1 13 = 4 52 Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
226 Example: Voter Mobilization Suppose that we have put together a voter mobilization campaign and we want to know what the probability of voting is after the campaign: Pr[vote]. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
227 Example: Voter Mobilization Suppose that we have put together a voter mobilization campaign and we want to know what the probability of voting is after the campaign: Pr[vote]. We know the following: Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
228 Example: Voter Mobilization Suppose that we have put together a voter mobilization campaign and we want to know what the probability of voting is after the campaign: Pr[vote]. We know the following: Pr(vote mobilized) = 0.75 Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
229 Example: Voter Mobilization Suppose that we have put together a voter mobilization campaign and we want to know what the probability of voting is after the campaign: Pr[vote]. We know the following: Pr(vote mobilized) = 0.75 Pr(vote not mobilized) = 0.15 Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
230 Example: Voter Mobilization Suppose that we have put together a voter mobilization campaign and we want to know what the probability of voting is after the campaign: Pr[vote]. We know the following: Pr(vote mobilized) = 0.75 Pr(vote not mobilized) = 0.15 Pr(mobilized) = 0.6 and so Pr( not mobilized) = 0.4 Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
231 Example: Voter Mobilization Suppose that we have put together a voter mobilization campaign and we want to know what the probability of voting is after the campaign: Pr[vote]. We know the following: Pr(vote mobilized) = 0.75 Pr(vote not mobilized) = 0.15 Pr(mobilized) = 0.6 and so Pr( not mobilized) = 0.4 Note that mobilization partitions the data. Everyone is either mobilized or not. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
232 Example: Voter Mobilization Suppose that we have put together a voter mobilization campaign and we want to know what the probability of voting is after the campaign: Pr[vote]. We know the following: Pr(vote mobilized) = 0.75 Pr(vote not mobilized) = 0.15 Pr(mobilized) = 0.6 and so Pr( not mobilized) = 0.4 Note that mobilization partitions the data. Everyone is either mobilized or not. Thus, we can apply the LTP: Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
233 Example: Voter Mobilization Suppose that we have put together a voter mobilization campaign and we want to know what the probability of voting is after the campaign: Pr[vote]. We know the following: Pr(vote mobilized) = 0.75 Pr(vote not mobilized) = 0.15 Pr(mobilized) = 0.6 and so Pr( not mobilized) = 0.4 Note that mobilization partitions the data. Everyone is either mobilized or not. Thus, we can apply the LTP: Pr(vote) = Pr(vote mobilized) Pr(mobilized)+ Pr(vote not mobilized) Pr(not mobilized) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
234 Example: Voter Mobilization Suppose that we have put together a voter mobilization campaign and we want to know what the probability of voting is after the campaign: Pr[vote]. We know the following: Pr(vote mobilized) = 0.75 Pr(vote not mobilized) = 0.15 Pr(mobilized) = 0.6 and so Pr( not mobilized) = 0.4 Note that mobilization partitions the data. Everyone is either mobilized or not. Thus, we can apply the LTP: Pr(vote) = Pr(vote mobilized) Pr(mobilized)+ Pr(vote not mobilized) Pr(not mobilized) = Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
235 Example: Voter Mobilization Suppose that we have put together a voter mobilization campaign and we want to know what the probability of voting is after the campaign: Pr[vote]. We know the following: Pr(vote mobilized) = 0.75 Pr(vote not mobilized) = 0.15 Pr(mobilized) = 0.6 and so Pr( not mobilized) = 0.4 Note that mobilization partitions the data. Everyone is either mobilized or not. Thus, we can apply the LTP: Pr(vote) = Pr(vote mobilized) Pr(mobilized)+ Pr(vote not mobilized) Pr(not mobilized) = =.51 Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
236 Bayes Rule Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
237 Bayes Rule Often we have information about Pr(B A), but require Pr(A B) instead. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
238 Bayes Rule Often we have information about Pr(B A), but require Pr(A B) instead. When this happens, always think: Bayes rule Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
239 Bayes Rule Often we have information about Pr(B A), but require Pr(A B) instead. When this happens, always think: Bayes rule Bayes rule: if Pr(B) > 0, then: Pr(A B) = Pr(B A) Pr(A) Pr(B) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
240 Bayes Rule Often we have information about Pr(B A), but require Pr(A B) instead. When this happens, always think: Bayes rule Bayes rule: if Pr(B) > 0, then: Pr(A B) = Pr(B A) Pr(A) Pr(B) Proof: combine the multiplication rule Pr(B A) Pr(A) = P(A B), and the definition of conditional probability Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
241 Bayes Rule Mechanics )posed... ) I Pl = birds go.nu. areas aired aimed Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
242 Bayes Rule Mechanics )posed... ) I Pl = birds go.nu. areas aired aimed Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
243 Bayes Rule Mechanics )posed... ) I Pl = birds go.nu. areas aired aimed Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
244 Bayes Rule Mechanics )posed... ) I Pl = birds go.nu. areas aired aimed Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
245 Bayes Rule Example b.. Baird.. am r g. B... p. ) 76.5% of female their - billionaires inherited Women Men. fortunes, compared 24.5% of male billionaires So is p( woman ) inherited billions ) than greater Plmanlinherited billions )? to Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
246 Bayes Rule Example ) % of female - billionaires inherited Women Men. fortunes, compared to their 24.5% of male billionaires So is P( woman ) inherited billions ), than greater Plmanlinherited billions ) ei ml tet. ad.q.boibboioaaa.r@g.zaoap.o.76.s P( WII )=P(I1W)P(w)P( I ) = } * Data source : Billionaires characteristics database Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
247 Example: Race and Names Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
248 Example: Race and Names Enos (2015): how do we identify a person s race from their name? Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
249 Example: Race and Names Enos (2015): how do we identify a person s race from their name? First, note that the Census collects information on the distribution of names by race. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
250 Example: Race and Names Enos (2015): how do we identify a person s race from their name? First, note that the Census collects information on the distribution of names by race. For example, Washington is the most common last name among African-Americans in America: Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
251 Example: Race and Names Enos (2015): how do we identify a person s race from their name? First, note that the Census collects information on the distribution of names by race. For example, Washington is the most common last name among African-Americans in America: Pr(AfAm) = Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
252 Example: Race and Names Enos (2015): how do we identify a person s race from their name? First, note that the Census collects information on the distribution of names by race. For example, Washington is the most common last name among African-Americans in America: Pr(AfAm) = Pr(not AfAm) = 1 Pr(AfAm) =.868 Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
253 Example: Race and Names Enos (2015): how do we identify a person s race from their name? First, note that the Census collects information on the distribution of names by race. For example, Washington is the most common last name among African-Americans in America: Pr(AfAm) = Pr(not AfAm) = 1 Pr(AfAm) =.868 Pr(Washington AfAm) = Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
254 Example: Race and Names Enos (2015): how do we identify a person s race from their name? First, note that the Census collects information on the distribution of names by race. For example, Washington is the most common last name among African-Americans in America: Pr(AfAm) = Pr(not AfAm) = 1 Pr(AfAm) =.868 Pr(Washington AfAm) = Pr(Washington not AfAm) = Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
255 Example: Race and Names Enos (2015): how do we identify a person s race from their name? First, note that the Census collects information on the distribution of names by race. For example, Washington is the most common last name among African-Americans in America: Pr(AfAm) = Pr(not AfAm) = 1 Pr(AfAm) =.868 Pr(Washington AfAm) = Pr(Washington not AfAm) = We can now use Bayes Rule Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
256 Example: Race and Names Enos (2015): how do we identify a person s race from their name? First, note that the Census collects information on the distribution of names by race. For example, Washington is the most common last name among African-Americans in America: Pr(AfAm) = Pr(not AfAm) = 1 Pr(AfAm) =.868 Pr(Washington AfAm) = Pr(Washington not AfAm) = We can now use Bayes Rule Pr(AfAm Wash) = Pr(Wash AfAm) Pr(AfAm) Pr(Wash) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
257 Example: Race and Names Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
258 Example: Race and Names Note we don t have the probability of the name Washington. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
259 Example: Race and Names Note we don t have the probability of the name Washington. Remember that we can calculate it from the LTP since the sets African-American and not African-American partition the sample space: Pr(Wash AfAm) Pr(AfAm) Pr(Wash) = Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
260 Example: Race and Names Note we don t have the probability of the name Washington. Remember that we can calculate it from the LTP since the sets African-American and not African-American partition the sample space: Pr(Wash AfAm) Pr(AfAm) Pr(Wash) = Pr(Wash AfAm) Pr(AfAm) Pr(Wash AfAm) Pr(AfAm) + Pr(Wash not AfAm) Pr(not AfAm) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
261 Example: Race and Names Note we don t have the probability of the name Washington. Remember that we can calculate it from the LTP since the sets African-American and not African-American partition the sample space: Pr(Wash AfAm) Pr(AfAm) Pr(Wash) Pr(Wash AfAm) Pr(AfAm) = Pr(Wash AfAm) Pr(AfAm) + Pr(Wash not AfAm) Pr(not AfAm) = Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
262 Example: Race and Names Note we don t have the probability of the name Washington. Remember that we can calculate it from the LTP since the sets African-American and not African-American partition the sample space: Pr(Wash AfAm) Pr(AfAm) Pr(Wash) Pr(Wash AfAm) Pr(AfAm) = Pr(Wash AfAm) Pr(AfAm) + Pr(Wash not AfAm) Pr(not AfAm) = Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
263 Independence Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
264 Independence Intuitive Definition Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
265 Independence Intuitive Definition Events A and B are independent if knowing whether A occurred provides no information about whether B occurred. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
266 Independence Intuitive Definition Events A and B are independent if knowing whether A occurred provides no information about whether B occurred. Formal Definition Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
267 Independence Intuitive Definition Events A and B are independent if knowing whether A occurred provides no information about whether B occurred. Formal Definition P(A, B) = P(A)P(B) = A B Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
268 Independence Intuitive Definition Events A and B are independent if knowing whether A occurred provides no information about whether B occurred. Formal Definition P(A, B) = P(A)P(B) = A B With all the usual > 0 restrictions, this implies Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
269 Independence Intuitive Definition Events A and B are independent if knowing whether A occurred provides no information about whether B occurred. Formal Definition P(A, B) = P(A)P(B) = A B With all the usual > 0 restrictions, this implies P(A B) = P(A) P(B A) = P(B) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
270 Independence Intuitive Definition Events A and B are independent if knowing whether A occurred provides no information about whether B occurred. Formal Definition P(A, B) = P(A)P(B) = A B With all the usual > 0 restrictions, this implies P(A B) = P(A) P(B A) = P(B) Independence is a massively important concept in statistics. Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
271 Next Week Random Variables Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
272 Next Week Random Variables Reading Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
273 Next Week Random Variables Reading Aronow and Miller (1.1) on Random Events Aronow and Miller ( ) on Probability Theory, Summarizing Distributions Optional: Blitzstein and Hwang Chapters (probability), (conditional probability), (random variables), (expectation), (indicator rv, LOTUS, variance), (joint distributions) Optional: Imai Chapter 6 (probability) Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
274 Next Week Random Variables Reading Aronow and Miller (1.1) on Random Events Aronow and Miller ( ) on Probability Theory, Summarizing Distributions Optional: Blitzstein and Hwang Chapters (probability), (conditional probability), (random variables), (expectation), (indicator rv, LOTUS, variance), (joint distributions) Optional: Imai Chapter 6 (probability) A word from your preceptors Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
275 Fun With Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
276 Fun with Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
277 Fun with History Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
278 Fun with History Legendre Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
279 Fun with History Gauss Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
280 Fun with History Quetelet Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
281 Fun with History Galton Stewart (Princeton) Week 1: Introduction and Probability September 14, / 62
Soc500: Applied Social Statistics Week 1: Introduction and Probability
Soc500: Applied Social Statistics Week 1: Introduction and Probability Brandon Stewart 1 Princeton September 14, 2016 1 These slides are heavily influenced by Matt Blackwell, Adam Glynn and Matt Salganik.
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationMATH2206 Prob Stat/20.Jan Weekly Review 1-2
MATH2206 Prob Stat/20.Jan.2017 Weekly Review 1-2 This week I explained the idea behind the formula of the well-known statistic standard deviation so that it is clear now why it is a measure of dispersion
More informationDiscrete Mathematics and Probability Theory Fall 2014 Anant Sahai Note 15. Random Variables: Distributions, Independence, and Expectations
EECS 70 Discrete Mathematics and Probability Theory Fall 204 Anant Sahai Note 5 Random Variables: Distributions, Independence, and Expectations In the last note, we saw how useful it is to have a way of
More information2. Probability. Chris Piech and Mehran Sahami. Oct 2017
2. Probability Chris Piech and Mehran Sahami Oct 2017 1 Introduction It is that time in the quarter (it is still week one) when we get to talk about probability. Again we are going to build up from first
More informationDiscrete Probability and State Estimation
6.01, Fall Semester, 2007 Lecture 12 Notes 1 MASSACHVSETTS INSTITVTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.01 Introduction to EECS I Fall Semester, 2007 Lecture 12 Notes
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models
More informationCPSC340. Probability. Nando de Freitas September, 2012 University of British Columbia
CPSC340 Probability Nando de Freitas September, 2012 University of British Columbia Outline of the lecture This lecture is intended at revising probabilistic concepts that play an important role in the
More informationMATH MW Elementary Probability Course Notes Part I: Models and Counting
MATH 2030 3.00MW Elementary Probability Course Notes Part I: Models and Counting Tom Salisbury salt@yorku.ca York University Winter 2010 Introduction [Jan 5] Probability: the mathematics used for Statistics
More informationProbability (Devore Chapter Two)
Probability (Devore Chapter Two) 1016-345-01: Probability and Statistics for Engineers Fall 2012 Contents 0 Administrata 2 0.1 Outline....................................... 3 1 Axiomatic Probability 3
More informationNotes Week 2 Chapter 3 Probability WEEK 2 page 1
Notes Week 2 Chapter 3 Probability WEEK 2 page 1 The sample space of an experiment, sometimes denoted S or in probability theory, is the set that consists of all possible elementary outcomes of that experiment
More informationChapter 14. From Randomness to Probability. Copyright 2012, 2008, 2005 Pearson Education, Inc.
Chapter 14 From Randomness to Probability Copyright 2012, 2008, 2005 Pearson Education, Inc. Dealing with Random Phenomena A random phenomenon is a situation in which we know what outcomes could happen,
More informationToss 1. Fig.1. 2 Heads 2 Tails Heads/Tails (H, H) (T, T) (H, T) Fig.2
1 Basic Probabilities The probabilities that we ll be learning about build from the set theory that we learned last class, only this time, the sets are specifically sets of events. What are events? Roughly,
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More informationProbability- describes the pattern of chance outcomes
Chapter 6 Probability the study of randomness Probability- describes the pattern of chance outcomes Chance behavior is unpredictable in the short run, but has a regular and predictable pattern in the long
More informationSTA111 - Lecture 1 Welcome to STA111! 1 What is the difference between Probability and Statistics?
STA111 - Lecture 1 Welcome to STA111! Some basic information: Instructor: Víctor Peña (email: vp58@duke.edu) Course Website: http://stat.duke.edu/~vp58/sta111. 1 What is the difference between Probability
More informationSTA 291 Lecture 8. Probability. Probability Rules. Joint and Marginal Probability. STA Lecture 8 1
STA 291 Lecture 8 Probability Probability Rules Joint and Marginal Probability STA 291 - Lecture 8 1 Union and Intersection Let A and B denote two events. The union of two events: A B The intersection
More informationThe probability of an event is viewed as a numerical measure of the chance that the event will occur.
Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that
More informationChapter 6: Probability The Study of Randomness
Chapter 6: Probability The Study of Randomness 6.1 The Idea of Probability 6.2 Probability Models 6.3 General Probability Rules 1 Simple Question: If tossing a coin, what is the probability of the coin
More information2011 Pearson Education, Inc
Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive
More informationSTAT 111 Recitation 1
STAT 111 Recitation 1 Linjun Zhang January 20, 2017 What s in the recitation This class, and the exam of this class, is a mix of statistical concepts and calculations. We are going to do a little bit of
More informationMAT Mathematics in Today's World
MAT 1000 Mathematics in Today's World Last Time We discussed the four rules that govern probabilities: 1. Probabilities are numbers between 0 and 1 2. The probability an event does not occur is 1 minus
More informationSTA Module 4 Probability Concepts. Rev.F08 1
STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret
More informationChapter 2 Class Notes
Chapter 2 Class Notes Probability can be thought of in many ways, for example as a relative frequency of a long series of trials (e.g. flips of a coin or die) Another approach is to let an expert (such
More informationGOV 2001/ 1002/ Stat E-200 Section 1 Probability Review
GOV 2001/ 1002/ Stat E-200 Section 1 Probability Review Solé Prillaman Harvard University January 28, 2015 1 / 54 LOGISTICS Course Website: j.mp/g2001 lecture notes, videos, announcements Canvas: problem
More informationNotes 1 Autumn Sample space, events. S is the number of elements in the set S.)
MAS 108 Probability I Notes 1 Autumn 2005 Sample space, events The general setting is: We perform an experiment which can have a number of different outcomes. The sample space is the set of all possible
More informationBasic Probability. Introduction
Basic Probability Introduction The world is an uncertain place. Making predictions about something as seemingly mundane as tomorrow s weather, for example, is actually quite a difficult task. Even with
More informationStat 609: Mathematical Statistics I (Fall Semester, 2016) Introduction
Stat 609: Mathematical Statistics I (Fall Semester, 2016) Introduction Course information Instructor Professor Jun Shao TA Mr. Han Chen Office 1235A MSC 1335 MSC Phone 608-262-7938 608-263-5948 Email shao@stat.wisc.edu
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More informationChemistry 883 Computational Quantum Chemistry
Chemistry 883 Computational Quantum Chemistry Instructor Contact Information Professor Benjamin G. Levine levine@chemistry.msu.edu 215 Chemistry Building 517-353-1113 Office Hours Tuesday 9:00-11:00 am
More informationreview session gov 2000 gov 2000 () review session 1 / 38
review session gov 2000 gov 2000 () review session 1 / 38 Overview Random Variables and Probability Univariate Statistics Bivariate Statistics Multivariate Statistics Causal Inference gov 2000 () review
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationDiscrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10
EECS 70 Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10 Introduction to Basic Discrete Probability In the last note we considered the probabilistic experiment where we flipped
More information3 PROBABILITY TOPICS
Chapter 3 Probability Topics 135 3 PROBABILITY TOPICS Figure 3.1 Meteor showers are rare, but the probability of them occurring can be calculated. (credit: Navicore/flickr) Introduction It is often necessary
More informationLecture 3 Probability Basics
Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability
More information2) There should be uncertainty as to which outcome will occur before the procedure takes place.
robability Numbers For many statisticians the concept of the probability that an event occurs is ultimately rooted in the interpretation of an event as an outcome of an experiment, others would interpret
More informationMIT BLOSSOMS INITIATIVE
MIT BLOSSOMS INITIATIVE The Broken Stick Problem Taught by Professor Richard C. Larson Mitsui Professor of Engineering Systems and of Civil and Environmental Engineering Segment 1 Hi! My name is Dick Larson
More informationLecture 4 An Introduction to Stochastic Processes
Lecture 4 An Introduction to Stochastic Processes Prof. Massimo Guidolin Prep Course in Quantitative Methods for Finance August-September 2017 Plan of the lecture Motivation and definitions Filtrations
More information3.2 Probability Rules
3.2 Probability Rules The idea of probability rests on the fact that chance behavior is predictable in the long run. In the last section, we used simulation to imitate chance behavior. Do we always need
More information7.1 What is it and why should we care?
Chapter 7 Probability In this section, we go over some simple concepts from probability theory. We integrate these with ideas from formal language theory in the next chapter. 7.1 What is it and why should
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationSociology 6Z03 Topic 10: Probability (Part I)
Sociology 6Z03 Topic 10: Probability (Part I) John Fox McMaster University Fall 2014 John Fox (McMaster University) Soc 6Z03: Probability I Fall 2014 1 / 29 Outline: Probability (Part I) Introduction Probability
More informationIntroduction to Stochastic Processes
Stat251/551 (Spring 2017) Stochastic Processes Lecture: 1 Introduction to Stochastic Processes Lecturer: Sahand Negahban Scribe: Sahand Negahban 1 Organization Issues We will use canvas as the course webpage.
More informationBrief Review of Probability
Brief Review of Probability Nuno Vasconcelos (Ken Kreutz-Delgado) ECE Department, UCSD Probability Probability theory is a mathematical language to deal with processes or experiments that are non-deterministic
More informationLecture 1. ABC of Probability
Math 408 - Mathematical Statistics Lecture 1. ABC of Probability January 16, 2013 Konstantin Zuev (USC) Math 408, Lecture 1 January 16, 2013 1 / 9 Agenda Sample Spaces Realizations, Events Axioms of Probability
More informationProbability 1 (MATH 11300) lecture slides
Probability 1 (MATH 11300) lecture slides Márton Balázs School of Mathematics University of Bristol Autumn, 2015 December 16, 2015 To know... http://www.maths.bris.ac.uk/ mb13434/prob1/ m.balazs@bristol.ac.uk
More informationWeek 2: Probability: Counting, Sets, and Bayes
Statistical Methods APPM 4570/5570, STAT 4000/5000 21 Probability Introduction to EDA Week 2: Probability: Counting, Sets, and Bayes Random variable Random variable is a measurable quantity whose outcome
More informationFormalizing Probability. Choosing the Sample Space. Probability Measures
Formalizing Probability Choosing the Sample Space What do we assign probability to? Intuitively, we assign them to possible events (things that might happen, outcomes of an experiment) Formally, we take
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 16. Random Variables: Distribution and Expectation
CS 70 Discrete Mathematics and Probability Theory Spring 206 Rao and Walrand Note 6 Random Variables: Distribution and Expectation Example: Coin Flips Recall our setup of a probabilistic experiment as
More informationLecture 02: Summations and Probability. Summations and Probability
Lecture 02: Overview In today s lecture, we shall cover two topics. 1 Technique to approximately sum sequences. We shall see how integration serves as a good approximation of summation of sequences. 2
More informationCS 124 Math Review Section January 29, 2018
CS 124 Math Review Section CS 124 is more math intensive than most of the introductory courses in the department. You re going to need to be able to do two things: 1. Perform some clever calculations to
More information6.262: Discrete Stochastic Processes 2/2/11. Lecture 1: Introduction and Probability review
6.262: Discrete Stochastic Processes 2/2/11 Lecture 1: Introduction and Probability review Outline: Probability in the real world Probability as a branch of mathematics Discrete stochastic processes Processes
More informationChapter 1 (Basic Probability)
Chapter 1 (Basic Probability) What is probability? Consider the following experiments: 1. Count the number of arrival requests to a web server in a day. 2. Determine the execution time of a program. 3.
More informationVenn Diagrams; Probability Laws. Notes. Set Operations and Relations. Venn Diagram 2.1. Venn Diagrams; Probability Laws. Notes
Lecture 2 s; Text: A Course in Probability by Weiss 2.4 STAT 225 Introduction to Probability Models January 8, 2014 s; Whitney Huang Purdue University 2.1 Agenda s; 1 2 2.2 Intersection: the intersection
More informationProbability Review Lecturer: Ji Liu Thank Jerry Zhu for sharing his slides
Probability Review Lecturer: Ji Liu Thank Jerry Zhu for sharing his slides slide 1 Inference with Bayes rule: Example In a bag there are two envelopes one has a red ball (worth $100) and a black ball one
More informationStats Probability Theory
Stats 241.3 Probability Theory Instructor: Office: W.H.Laverty 235 McLean Hall Phone: 966-6096 Lectures: Evaluation: M T W Th F 1:30pm - 2:50pm Thorv 105 Lab: T W Th 3:00-3:50 Thorv 105 Assignments, Labs,
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationProbability Year 10. Terminology
Probability Year 10 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationP (E) = P (A 1 )P (A 2 )... P (A n ).
Lecture 9: Conditional probability II: breaking complex events into smaller events, methods to solve probability problems, Bayes rule, law of total probability, Bayes theorem Discrete Structures II (Summer
More informationBig Bang, Black Holes, No Math
ASTR/PHYS 109 Dr. David Toback Lecture 5 1 Prep For Today (is now due) L5 Reading: No new reading Unit 2 reading assigned at the end of class Pre-Lecture Reading Questions: Unit 1: Grades have been posted
More informationIntroduction to Probability
Introduction to Probability Gambling at its core 16th century Cardano: Books on Games of Chance First systematic treatment of probability 17th century Chevalier de Mere posed a problem to his friend Pascal.
More informationChapter 7 Wednesday, May 26th
Chapter 7 Wednesday, May 26 th Random event A random event is an event that the outcome is unpredictable. Example: There are 45 students in this class. What is the probability that if I select one student,
More informationProbability Year 9. Terminology
Probability Year 9 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationGuide to Proofs on Sets
CS103 Winter 2019 Guide to Proofs on Sets Cynthia Lee Keith Schwarz I would argue that if you have a single guiding principle for how to mathematically reason about sets, it would be this one: All sets
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationMean, Median and Mode. Lecture 3 - Axioms of Probability. Where do they come from? Graphically. We start with a set of 21 numbers, Sta102 / BME102
Mean, Median and Mode Lecture 3 - Axioms of Probability Sta102 / BME102 Colin Rundel September 1, 2014 We start with a set of 21 numbers, ## [1] -2.2-1.6-1.0-0.5-0.4-0.3-0.2 0.1 0.1 0.2 0.4 ## [12] 0.4
More informationConditional Probability
Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.
More informationMachine Learning (CS 567) Lecture 2
Machine Learning (CS 567) Lecture 2 Time: T-Th 5:00pm - 6:20pm Location: GFS118 Instructor: Sofus A. Macskassy (macskass@usc.edu) Office: SAL 216 Office hours: by appointment Teaching assistant: Cheol
More informationP Q (P Q) (P Q) (P Q) (P % Q) T T T T T T T F F T F F F T F T T T F F F F T T
Logic and Reasoning Final Exam Practice Fall 2017 Name Section Number The final examination is worth 100 points. 1. (10 points) What is an argument? Explain what is meant when one says that logic is the
More informationLecture 1: Probability Fundamentals
Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability
More informationSingle Maths B: Introduction to Probability
Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction
More informationMath Exam 1 Review. NOTE: For reviews of the other sections on Exam 1, refer to the first page of WIR #1 and #2.
Math 166 Fall 2008 c Heather Ramsey Page 1 Math 166 - Exam 1 Review NOTE: For reviews of the other sections on Exam 1, refer to the first page of WIR #1 and #2. Section 1.5 - Rules for Probability Elementary
More informationDiscrete Mathematics and Probability Theory Fall 2013 Vazirani Note 12. Random Variables: Distribution and Expectation
CS 70 Discrete Mathematics and Probability Theory Fall 203 Vazirani Note 2 Random Variables: Distribution and Expectation We will now return once again to the question of how many heads in a typical sequence
More informationIntroduction to probability
Introduction to probability 4.1 The Basics of Probability Probability The chance that a particular event will occur The probability value will be in the range 0 to 1 Experiment A process that produces
More information1.1 Administrative Stuff
601.433 / 601.633 Introduction to Algorithms Lecturer: Michael Dinitz Topic: Introduction, Karatsuba/Strassen Date: 9/4/18 1.1 Administrative Stuff Welcome to Algorithms! In this class you will learn the
More informationSample Space: Specify all possible outcomes from an experiment. Event: Specify a particular outcome or combination of outcomes.
Chapter 2 Introduction to Probability 2.1 Probability Model Probability concerns about the chance of observing certain outcome resulting from an experiment. However, since chance is an abstraction of something
More informationCS 188: Artificial Intelligence Spring Today
CS 188: Artificial Intelligence Spring 2006 Lecture 9: Naïve Bayes 2/14/2006 Dan Klein UC Berkeley Many slides from either Stuart Russell or Andrew Moore Bayes rule Today Expectations and utilities Naïve
More informationL14. 1 Lecture 14: Crash Course in Probability. July 7, Overview and Objectives. 1.2 Part 1: Probability
L14 July 7, 2017 1 Lecture 14: Crash Course in Probability CSCI 1360E: Foundations for Informatics and Analytics 1.1 Overview and Objectives To wrap up the fundamental concepts of core data science, as
More informationBay Area Scientists in Schools Presentation Plan
Bay Area Scientists in Schools Presentation Plan Lesson Name: We Love Gravity! Presenter(s) Virginia Lehr, Laura Hidrobo Grade Level 5 Standards Connection(s) Solar System and Gravity Teaser: Gravity is
More informationConditional Probability & Independence. Conditional Probabilities
Conditional Probability & Independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Definition: the conditional probability of E given F is P(E F
More informationSTA 247 Solutions to Assignment #1
STA 247 Solutions to Assignment #1 Question 1: Suppose you throw three six-sided dice (coloured red, green, and blue) repeatedly, until the three dice all show different numbers. Assuming that these dice
More informationP (A) = P (B) = P (C) = P (D) =
STAT 145 CHAPTER 12 - PROBABILITY - STUDENT VERSION The probability of a random event, is the proportion of times the event will occur in a large number of repititions. For example, when flipping a coin,
More informationPS 101: Introductory Astronomy Fall 2014
PS 101: Introductory Astronomy Fall 2014 Lecture: Lab: Tues./Thurs. 12:00 pm - 1:15 pm, S166 Tues. 4:00 pm - 5:50 pm, S166 Instructor: Dr. Jon M. Saken Office: S178 (Science Bldg.) Phone: 696-2753 E-mail:
More informationMath 1313 Experiments, Events and Sample Spaces
Math 1313 Experiments, Events and Sample Spaces At the end of this recording, you should be able to define and use the basic terminology used in defining experiments. Terminology The next main topic in
More informationReview of probability. Nuno Vasconcelos UCSD
Review of probability Nuno Vasconcelos UCSD robability probability is the language to deal with processes that are non-deterministic examples: if I flip a coin 00 times how many can I expect to see heads?
More informationWeek 2. Section Texas A& M University. Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019
Week 2 Section 1.2-1.4 Texas A& M University Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019 Oğuz Gezmiş (TAMU) Topics in Contemporary Mathematics II Week2 1
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 1: Introduction Andrew McGregor University of Massachusetts Last Compiled: January 24, 2017 Outline 1 Introduction 2 Course Logistics 3 Sets and Elements
More informationDiscrete Probability and State Estimation
6.01, Spring Semester, 2008 Week 12 Course Notes 1 MASSACHVSETTS INSTITVTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.01 Introduction to EECS I Spring Semester, 2008 Week
More informationProbability Theory for Machine Learning. Chris Cremer September 2015
Probability Theory for Machine Learning Chris Cremer September 2015 Outline Motivation Probability Definitions and Rules Probability Distributions MLE for Gaussian Parameter Estimation MLE and Least Squares
More informationINDIAN INSTITUTE OF TECHNOLOGY KHARAGPUR. NPTEL National Programme on Technology Enhanced Learning. Probability Methods in Civil Engineering
INDIAN INSTITUTE OF TECHNOLOGY KHARAGPUR NPTEL National Programme on Technology Enhanced Learning Probability Methods in Civil Engineering Prof. Rajib Maity Department of Civil Engineering IIT Kharagpur
More informationStatistics for Financial Engineering Session 2: Basic Set Theory March 19 th, 2006
Statistics for Financial Engineering Session 2: Basic Set Theory March 19 th, 2006 Topics What is a set? Notations for sets Empty set Inclusion/containment and subsets Sample spaces and events Operations
More informationCS626 Data Analysis and Simulation
CS626 Data Analysis and Simulation Instructor: Peter Kemper R 104A, phone 221-3462, email:kemper@cs.wm.edu Today: Probability Primer Quick Reference: Sheldon Ross: Introduction to Probability Models 9th
More informationProblems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman.
Math 224 Fall 2017 Homework 1 Drew Armstrong Problems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman. Section 1.1, Exercises 4,5,6,7,9,12. Solutions to Book Problems.
More informationLecture 8: Conditional probability I: definition, independence, the tree method, sampling, chain rule for independent events
Lecture 8: Conditional probability I: definition, independence, the tree method, sampling, chain rule for independent events Discrete Structures II (Summer 2018) Rutgers University Instructor: Abhishek
More informationCS 4649/7649 Robot Intelligence: Planning
CS 4649/7649 Robot Intelligence: Planning Probability Primer Sungmoon Joo School of Interactive Computing College of Computing Georgia Institute of Technology S. Joo (sungmoon.joo@cc.gatech.edu) 1 *Slides
More informationProbability: Terminology and Examples Class 2, Jeremy Orloff and Jonathan Bloom
1 Learning Goals Probability: Terminology and Examples Class 2, 18.05 Jeremy Orloff and Jonathan Bloom 1. Know the definitions of sample space, event and probability function. 2. Be able to organize a
More informationReview: Probability. BM1: Advanced Natural Language Processing. University of Potsdam. Tatjana Scheffler
Review: Probability BM1: Advanced Natural Language Processing University of Potsdam Tatjana Scheffler tatjana.scheffler@uni-potsdam.de October 21, 2016 Today probability random variables Bayes rule expectation
More informationPrecept 4: Hypothesis Testing
Precept 4: Hypothesis Testing Soc 500: Applied Social Statistics Ian Lundberg Princeton University October 6, 2016 Learning Objectives 1 Introduce vectorized R code 2 Review homework and talk about RMarkdown
More information