Probability basics. Probability and Measure Theory. Probability = mathematical analysis
|
|
- Loren Jennings
- 5 years ago
- Views:
Transcription
1 MA 751 Probability basics Probability and Measure Theory 1. Basics of probability 2 aspects of probability: Probability = mathematical analysis Probability = common sense
2 Probability basics A set-up of the common sense view: Define as experiment any event with an outcome. Example 1: Toss of a die Example 2: Record information on deaths of cancer patients. Example 3: Measure daily high body temperature of a person on chemotherapy Example 4: Observe the next letter in a chain of DNA:
3 Probability basics ATCTTCA Ä? Given a well-defined experiment we must know the set of all possible outcomes (this must be defined by the experimenter) Collection of possible outcomes is denoted as W œ sample space. (sometimes also called a probability space and written HÑ
4 Probability basics This is the collection of all possible outcomes of the experiment Example 5: Die toss: W œ Ö"ß #ß $ß %ß &ß ' Example 6: Cancer outcome records:
5 Probability basics 4 outcomes: RPßVPßRHßVH Vœreceived treatment; Pœlived; Hœdied Rœno treatment;
6 Probability basics Example 7: High temperature measurement WœÖ>À> a real number Many other outcome (sample) spaces W are possible, for example, profiles of functions of DNA regions So: Have practical situations and for each one we define the sample space W of possible outcomes Def. 1: For sets Eß F: Define E Fif Eis a subcollection of F. If I Wß I is an event
7 Probability basics Example 8: Die tossing experiment: if I œ even roll œ Ö 2, 4, 6 Ö 1, 2, 3, 4, 5, 6 then I is an event. Why an event? Intuitively, an event means something that has occurred, and above the event E œ Ö#ß %ß ' represents the occurrence of an even number
8 Probability basics Again can translate between mathematical definition (subset) and intuitive notions of meanings of words (event). Probabilist wants to assign a probability TÐIÑ between! and ") to every event I. (a number Thus, e.g., if I œ Ö event of an even roll œ Ö#ß %ß ' want TÐEÑ œ " # [Rationales can vary] So: Ideally, want to assign numbers (probabilities) to subsets I W.
9 Example 9: Probability basics Die toss revisited: TÐ"Ñ œ " ' TÐ#Ñ œ " ' TÐ$Ñ œ " ' TÐ'Ñ œ " '
10 Probability basics " ' Each component in W has probability.
11 Probability basics Any subset E W has probability determined by adding measures of component subsets. Want TÐWÑ œ " ( why?) E 3
12 Probability basics Example 10: If we want to predict next base in genomic sequence, we have the sample space W œöeßxßgßk Define Iœevent that next base is a purine, i.e., IœÖEßK W. If we expect all bases have equal probabilities, then T ÐIÑ œ "Î#Þ
13 Analytic probability 2. Sample space and probability measure: what properties do we want? Def. 2: Recall for sets Eß Fß define E F and E F as the union and intersection of the sets.
14 Analytic probability Desired properties of T : (1) If E 3 are disjoint (i.e., no pair of them intersects) then the probability of the union of the E 3 is the sum of their probabilities: If 9 œ empty set: TŠ. E œ TÐE Ñ 3œ" 3 3 3œ" (2) TÐ9Ñ œ!ß TÐWÑ œ "Þ (Linearity)
15 Analytic probability An assignment of numbers TÐIÑ to subsets (events) I W satisfying properties (1) and (2) is called a measure on the set W. However, we will sometimes need to restrict the collection of sets I to which we can assign a probability (measure) TÐIÑ. Ê need a collection Y of subsets of W whose probabilities we are allowed to measure.
16 Analytic probability This collection of subsets Y must have some specific properties: Def. 3: The notation I Y means that the object Iis in the collection Y
17 Analytic probability Def: 4 a collection Y of subsets of W is a 5-field if (i) W, 9 Y ( W and 9 are in collection Y) - - (ii) E Ê E Y ( E œ complement of E) (iii) E Y a3 Ê E [ aœfor all ] Y where EßEßEßá " # $ form a sequence of sets.
18 Analytic probability Once we have an W, Y, and a T as above, we call the triple ÐWß Yß T Ñ œ probability space We denote the class Y to be the measureable sets in W.
19 Analytic probability Example 11: W œ Ö"ß #ß $ß %ß &ß '. In this case the collection Y of measureable sets is usually all subsets of Wß i.e., Y œ Öall subsets of W} Example 12: WœÒ!ß"Ó, i.e., we are choosing a random number B in the interval Ò!ß "Ó; W is the set of all possible outcomes. Here Y œ collection of measureable sets is defined to be the smallest 5-field of sets including all possible intervals Ð+ß,Ñ.
20 Analytic probability Sometimes this collection Y is denoted as the Borel sets. We can define probabilities of sets to be, e.g. TÐ+ß,Ñ œ, + This defines the probability that our random number B is in the interval Ð+ß,Ñ. It can be shown that we can uniquely extend this definition of probability from the collection of intervals Ð+ß,Ñ to the larger collection of sets Y.
21 Analytic probability This full measure on the interval Ò!ß "Ó is called Lebesgue measure.
22 Measurable functions 3. Some basic notions: measurable functions If we have a sample space W on it. we want to define functions Definition 5: We define to be the collection of all real numbers. Definition 6: A function 0 on any set I is rule which assigns to each element B Ia real number denoted as 0ÐBÑ. In this case we write 0ÀIÄ
23 Measurable functions Assume now we have a collection of measurable sets Y on H Definition 7: A function 0ÀWÄ is measurable if for all B, the set Ö+ À 0Ð+Ñ Ÿ B œ the set of all + such that 0Ð+Ñ Ÿ B is measurable (i.e. is in Y) Þ Example 13: Consider the function 0À Ä $ 0BÑœB ( such that
24 Measurable functions Example 14: Consider 0ÐBÑ œ MUÐBÑ œ indicator function of rationals, defined by 0ÐBÑ œ " if B is rational œ! if B is irrational.
25 Random variables 4. Random Variables Definition 8: A random variable \ is any measurable function from the sample space W to the real numbers. Example 15: throw 2 dice
26 Random variables Suppose random variable \ maps outcomes to numbers.
27 Random variables Thus if the outcome is Ð$ß &Ñ (i.e. first die is a 3 and second die is a &) then \Ð$ß &Ñ œ ), i.e., \ maps each outcome to the total. Example 16: For a given amino acid + in a protein sequence, let \Ð+Ñ denote the number of other amino acids which + is bound to. Again \ maps the amino acid (in W) into a number. For a random variable (RV) \:
28 Random variables Def. 9: If \ is a random variable, we define its distribution function J to be distribution function ß J ÐBÑ À T Ð= À \Ð= Ñ Ÿ BÑ œ T Ð\ Ÿ BÑ
29 Properties of Random variables J Ðeasily derived) (i) JÐBÑ Ä " as B Ä JÐBÑ Ä! as B Ä (ii) J has at most countably many discontinuities i.e., discontinuity points BßBßá " # can be listed Example 17: Suppose we record high, low body temperatures for a patient on a given day; form a sample space of all possible pairs of measurements:
30 Random variables W œ ÖÐLßPÑ À L P Define a random variable \ÀWÄ as follows: for each element of W, let \ÐLßPÑ œ L P œ temperature range
31 Random variables Suppose we find that. J ÐBÑ œ T Ð ÐLß PÑ À ÐL PÑ Ÿ BÑ œ TÐ\ Ÿ BÑ œ " / B if œ B!! if B!
32 Random variables If J has a derivative, w JÐBÑœ0ÐBÑœ can check this is a d.f. density function of \. Example 18: here density œ0ðbñ œ / B œ!
33 Example 19: Random variables check: J ÐBÑ œ ( 0ÐB Ñ.B Þ Normal: density is B " # B Î# È / # 1 w w
34 1. Conditional probability More probability: Example 1: Die roll:
35 E œ event of even roll œ Ö#ß %ß ' F œ event of roll divisible by 3 œ Ö$ß ' TÐEÑ œ Define conditional probability " " à TÐFÑ œ # $ P(B A) œ Prob. of B given A occurs How to compute TÐFlEÑ? Create reduced sample space consisting only of E
36 and compute what portion of E is in F. Here reduced sample space E œ Ö#ß %ß '. Assuming equal probabilities: T Ð#lEÑ œ T Ð%lEÑ œ T Ð'lEÑ œ "Î$Þ Note T ÐFlEÑ œ T Ð'lEÑ œ "Î$Þ
37 Now note TÐE FÑ œ " ' ; thus " " ' TÐE FÑ TÐFlEÑ œ œ œ Þ $ " TÐEÑ Illustrates general mathematical definition TÐFlEÑ œ TÐE FÑ TÐEÑ #
38 2. Independence: We say events F and E are independent if TÐF EÑ T ÐFlEÑ œ T ÐFÑ Í œ T ÐFÑ TÐEÑ Í TÐE FÑ œ TÐEÑTÐFÑ In general a collection of events EßáßE " 8 is independent if for any subcollection E ßáßE TÐE 3 3 " 8 E á E Ñ œ TÐE ÑTÐE ÑâTÐE Ñ " # 8 " # 8 À
39 Example 2: Consider sequence BßBßáßB " # 5 forming gene 1. of bases Q: Are the successive bases BßB 3 3 " independent? For example, given we know the base B3 œ Aß does that change the probability TÐB œ C). More specifically, do we have 3 " TÐB3 " œ ClB3 œ AÑ œ TÐB3 " œ C Ñ? (3) If (3) also holds for all possible choices ÐC,G,T) replacing A and all choices replacing C, then B3 " and B3 are independent.
40 Expect: in actual DNA exon region has more dependence from base to base than an intron does. Why? Evolutionary structural pressures - exons are more important to survival
41 Independence of RV's 3. Independence of RV's Henceforth given a subset E of sample space W, we assume E is measurable unless stated otherwise. Definition 10: Let W be a sample (probability) space. Let \ÀWÄ be a random variable (i.e., a rule assigning a real number to each outcome in W) If EœÒ+ß,Ó ß define TÐ\ EÑœTÐ+Ÿ\Ÿ,Ñ
42 Independence of RV's œtð all outcomes = whose value \Ð=Ñ is between + and,ñ œtð=l+ÿ\ð=ñÿ,ñþ Recall: Definition 11: Let W be a sample space, and \" ß\ # be random variables. Then \ß\ " # are independent if for any sets E, E, " # T Ð\ E ß \ E Ñ œ T Ð\ E ÑT Ð\ E Ñ " " # # " " # #
43 Independence of RV's Generally \ßáß\ " 8 TÐ\ E ßáß\ are independent if E Ñ " " 8 8 œ T Ð\ E ÑT Ð\ E Ñá T Ð\ E Ñ " " # # 8 8
44 Independence of RV's More to come on these topics-
Notes on the Unique Extension Theorem. Recall that we were interested in defining a general measure of a size of a set on Ò!ß "Ó.
1. More on measures: Notes on the Unique Extension Theorem Recall that we were interested in defining a general measure of a size of a set on Ò!ß "Ó. Defined this measure T. Defined TÐ ( +ß, ) Ñ œ, +Þ
More informationGene expression experiments. Infinite Dimensional Vector Spaces. 1. Motivation: Statistical machine learning and reproducing kernel Hilbert Spaces
MA 751 Part 3 Gene expression experiments Infinite Dimensional Vector Spaces 1. Motivation: Statistical machine learning and reproducing kernel Hilbert Spaces Gene expression experiments Question: Gene
More informationThe Hahn-Banach and Radon-Nikodym Theorems
The Hahn-Banach and Radon-Nikodym Theorems 1. Signed measures Definition 1. Given a set Hand a 5-field of sets Y, we define a set function. À Y Ä to be a signed measure if it has all the properties of
More informationMath 131 Exam 4 (Final Exam) F04M
Math 3 Exam 4 (Final Exam) F04M3.4. Name ID Number The exam consists of 8 multiple choice questions (5 points each) and 0 true/false questions ( point each), for a total of 00 points. Mark the correct
More informationInfinite Dimensional Vector Spaces. 1. Motivation: Statistical machine learning and reproducing kernel Hilbert Spaces
MA 751 Part 3 Infinite Dimensional Vector Spaces 1. Motivation: Statistical machine learning and reproducing kernel Hilbert Spaces Microarray experiment: Question: Gene expression - when is the DNA in
More informationSTAT 2122 Homework # 3 Solutions Fall 2018 Instr. Sonin
STAT 2122 Homeork Solutions Fall 2018 Instr. Sonin Due Friday, October 5 NAME (25 + 5 points) Sho all ork on problems! (4) 1. In the... Lotto, you may pick six different numbers from the set Ö"ß ß $ß ÞÞÞß
More informationECE353: Probability and Random Processes. Lecture 2 - Set Theory
ECE353: Probability and Random Processes Lecture 2 - Set Theory Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu January 10, 2018 Set
More informationÐ"Ñ + Ð"Ñ, Ð"Ñ +, +, + +, +,,
Handout #11 Confounding: Complete factorial experiments in incomplete blocks Blocking is one of the important principles in experimental design. In this handout we address the issue of designing complete
More informationSVM example: cancer classification Support Vector Machines
SVM example: cancer classification Support Vector Machines 1. Cancer genomics: TCGA The cancer genome atlas (TCGA) will provide high-quality cancer data for large scale analysis by many groups: SVM example:
More informationProduct Measures and Fubini's Theorem
Product Measures and Fubini's Theorem 1. Product Measures Recall: Borel sets U in are generated by open sets. They are also generated by rectangles VœN " á N hich are products of intervals NÞ 3 Let V be
More informationExample Let VœÖÐBßCÑ À b-, CœB - ( see the example above). Explain why
Definition If V is a relation from E to F, then a) the domain of V œ dom ÐVÑ œ Ö+ E À b, F such that Ð+ß,Ñ V b) the range of V œ ran( VÑ œ Ö, F À b+ E such that Ð+ß,Ñ V " c) the inverse relation of V œ
More informationPART I. Multiple choice. 1. Find the slope of the line shown here. 2. Find the slope of the line with equation $ÐB CÑœ(B &.
Math 1301 - College Algebra Final Exam Review Sheet Version X This review, while fairly comprehensive, should not be the only material used to study for the final exam. It should not be considered a preview
More information1. Classify each number. Choose all correct answers. b. È # : (i) natural number (ii) integer (iii) rational number (iv) real number
Review for Placement Test To ypass Math 1301 College Algebra Department of Computer and Mathematical Sciences University of Houston-Downtown Revised: Fall 2009 PLEASE READ THE FOLLOWING CAREFULLY: 1. The
More informationBasic Measure and Integration Theory. Michael L. Carroll
Basic Measure and Integration Theory Michael L. Carroll Sep 22, 2002 Measure Theory: Introduction What is measure theory? Why bother to learn measure theory? 1 What is measure theory? Measure theory is
More informationDr. H. Joseph Straight SUNY Fredonia Smokin' Joe's Catalog of Groups: Direct Products and Semi-direct Products
Dr. H. Joseph Straight SUNY Fredonia Smokin' Joe's Catalog of Groups: Direct Products and Semi-direct Products One of the fundamental problems in group theory is to catalog all the groups of some given
More informationMATH 1301 (College Algebra) - Final Exam Review
MATH 1301 (College Algebra) - Final Exam Review This review is comprehensive but should not be the only material used to study for the final exam. It should not be considered a preview of the final exam.
More informationRelations. Relations occur all the time in mathematics. For example, there are many relations between # and % À
Relations Relations occur all the time in mathematics. For example, there are many relations between and % À Ÿ% % Á% l% Ÿ,, Á ß and l are examples of relations which might or might not hold between two
More informationReview of Elementary Probability Theory Math 495, Spring 2011
Revie of Elementary Probability Theory Math 495, Spring 2011 0.1 Probability spaces 0.1.1 Definition. A probability space is a triple ( HT,,P) here ( 3Ñ H is a non-empty setà Ð33Ñ T is a collection of
More information18.175: Lecture 2 Extension theorems, random variables, distributions
18.175: Lecture 2 Extension theorems, random variables, distributions Scott Sheffield MIT Outline Extension theorems Characterizing measures on R d Random variables Outline Extension theorems Characterizing
More informationSIMULATION - PROBLEM SET 1
SIMULATION - PROBLEM SET 1 " if! Ÿ B Ÿ 1. The random variable X has probability density function 0ÐBÑ œ " $ if Ÿ B Ÿ.! otherwise Using the inverse transform method of simulation, find the random observation
More informationStatistical machine learning and kernel methods. Primary references: John Shawe-Taylor and Nello Cristianini, Kernel Methods for Pattern Analysis
Part 5 (MA 751) Statistical machine learning and kernel methods Primary references: John Shawe-Taylor and Nello Cristianini, Kernel Methods for Pattern Analysis Christopher Burges, A tutorial on support
More informationLecture 1. Chapter 1. (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 ( ). 1. What is Statistics?
Lecture 1 (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 (2.1 --- 2.6). Chapter 1 1. What is Statistics? 2. Two definitions. (1). Population (2). Sample 3. The objective of statistics.
More informationB-9= B.Bà B 68 B.Bß B/.Bß B=38 B.B >+8 ab b.bß ' 68aB b.bà
8.1 Integration y Parts.@ a.? a Consider. a? a @ a œ? a @ a Þ....@ a..? a We can write this as? a œ a? a @ a@ a Þ... If we integrate oth sides, we otain.@ a a.?. œ a? a @ a..? a @ a. or...? a.@ œ? a @
More informationSystems of Equations 1. Systems of Linear Equations
Lecture 1 Systems of Equations 1. Systems of Linear Equations [We will see examples of how linear equations arise here, and how they are solved:] Example 1: In a lab experiment, a researcher wants to provide
More information8œ! This theorem is justified by repeating the process developed for a Taylor polynomial an infinite number of times.
Taylor and Maclaurin Series We can use the same process we used to find a Taylor or Maclaurin polynomial to find a power series for a particular function as long as the function has infinitely many derivatives.
More informationACT455H1S - TEST 2 - MARCH 25, 2008
ACT455H1S - TEST 2 - MARCH 25, 2008 Write name and student number on each page. Write your solution for each question in the space provided. For the multiple decrement questions, it is always assumed that
More informationNotes 1 : Measure-theoretic foundations I
Notes 1 : Measure-theoretic foundations I Math 733-734: Theory of Probability Lecturer: Sebastien Roch References: [Wil91, Section 1.0-1.8, 2.1-2.3, 3.1-3.11], [Fel68, Sections 7.2, 8.1, 9.6], [Dur10,
More informationProofs Involving Quantifiers. Proof Let B be an arbitrary member Proof Somehow show that there is a value
Proofs Involving Quantifiers For a given universe Y : Theorem ÐaBÑ T ÐBÑ Theorem ÐbBÑ T ÐBÑ Proof Let B be an arbitrary member Proof Somehow show that there is a value of Y. Call it B œ +, say Þ ÐYou can
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationECE 340 Probabilistic Methods in Engineering M/W 3-4:15. Lecture 2: Random Experiments. Prof. Vince Calhoun
ECE 340 Probabilistic Methods in Engineering M/W 3-4:15 Lecture 2: Random Experiments Prof. Vince Calhoun Reading This class: Section 2.1-2.2 Next class: Section 2.3-2.4 Homework: Assignment 1: From the
More informationWeek 2. Section Texas A& M University. Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019
Week 2 Section 1.2-1.4 Texas A& M University Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019 Oğuz Gezmiş (TAMU) Topics in Contemporary Mathematics II Week2 1
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationADVANCE TOPICS IN ANALYSIS - REAL. 8 September September 2011
ADVANCE TOPICS IN ANALYSIS - REAL NOTES COMPILED BY KATO LA Introductions 8 September 011 15 September 011 Nested Interval Theorem: If A 1 ra 1, b 1 s, A ra, b s,, A n ra n, b n s, and A 1 Ě A Ě Ě A n
More informationAppendix 4.1 Alternate Solution to the Infinite Square Well with Symmetric Boundary Conditions. V(x) I II III +L/2
Appendix 4.1 Alternate Solution to the Infinite Square Well with Symmetric Boundary Conditions V(x) I II III -L/2 +L/2 x In this problem, a particle of mass 7 confined by a potential energy which has a
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationMA : Introductory Probability
MA 320-001: Introductory Probability David Murrugarra Department of Mathematics, University of Kentucky http://www.math.uky.edu/~dmu228/ma320/ Spring 2017 David Murrugarra (University of Kentucky) MA 320:
More informationChap 1: Experiments, Models, and Probabilities. Random Processes. Chap 1 : Experiments, Models, and Probabilities
EE8103 Random Processes Chap 1 : Experiments, Models, and Probabilities Introduction Real world word exhibits randomness Today s temperature; Flip a coin, head or tail? WalkAt to a bus station, how long
More informationDigital Communications: An Overview of Fundamentals
IMPERIAL COLLEGE of SCIENCE, TECHNOLOGY and MEDICINE, DEPARTMENT of ELECTRICAL and ELECTRONIC ENGINEERING. COMPACT LECTURE NOTES on COMMUNICATION THEORY. Prof Athanassios Manikas, Spring 2001 Digital Communications:
More informationSample Space: Specify all possible outcomes from an experiment. Event: Specify a particular outcome or combination of outcomes.
Chapter 2 Introduction to Probability 2.1 Probability Model Probability concerns about the chance of observing certain outcome resulting from an experiment. However, since chance is an abstraction of something
More informationLecture notes for probability. Math 124
Lecture notes for probability Math 124 What is probability? Probabilities are ratios, expressed as fractions, decimals, or percents, determined by considering results or outcomes of experiments whose result
More informationCONVERGENCE OF RANDOM SERIES AND MARTINGALES
CONVERGENCE OF RANDOM SERIES AND MARTINGALES WESLEY LEE Abstract. This paper is an introduction to probability from a measuretheoretic standpoint. After covering probability spaces, it delves into the
More information7. Random variables as observables. Definition 7. A random variable (function) X on a probability measure space is called an observable
7. Random variables as observables Definition 7. A random variable (function) X on a probability measure space is called an observable Note all functions are assumed to be measurable henceforth. Note that
More informationModule 1. Probability
Module 1 Probability 1. Introduction In our daily life we come across many processes whose nature cannot be predicted in advance. Such processes are referred to as random processes. The only way to derive
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More informationRandomized Algorithms. Andreas Klappenecker
Randomized Algorithms Andreas Klappenecker Randomized Algorithms A randomized algorithm is an algorithm that makes random choices during its execution. A randomized algorithm uses values generated by a
More informatione) D œ < f) D œ < b) A parametric equation for the line passing through Ð %, &,) ) and (#,(, %Ñ.
Page 1 Calculus III : Bonus Problems: Set 1 Grade /42 Name Due at Exam 1 6/29/2018 1. (2 points) Give the equations for the following geometrical objects : a) A sphere of radius & centered at the point
More informationThe Experts In Actuarial Career Advancement. Product Preview. For More Information: or call 1(800)
P U B L I C A T I O N S The Experts In Actuarial Career Advancement Product Previe For More Information: email Support@ActexMadRivercom or call 1(800) 282-2839 SECTION 1 - BASIC PROBABILITY CONCEPTS 37
More informationSolving SVM: Quadratic Programming
MA 751 Part 7 Solving SVM: Quadratic Programming 1. Quadratic programming (QP): Introducing Lagrange multipliers α 4 and. 4 (can be justified in QP for inequality as well as equality constraints) we define
More informationDefinition Suppose M is a collection (set) of sets. M is called inductive if
Definition Suppose M is a collection (set) of sets. M is called inductive if a) g M, and b) if B Mß then B MÞ Then we ask: are there any inductive sets? Informally, it certainly looks like there are. For
More informationMAP METHODS FOR MACHINE LEARNING. Mark A. Kon, Boston University Leszek Plaskota, Warsaw University, Warsaw Andrzej Przybyszewski, McGill University
MAP METHODS FOR MACHINE LEARNING Mark A. Kon, Boston University Leszek Plaskota, Warsaw University, Warsaw Andrzej Przybyszewski, McGill University Example: Control System 1. Paradigm: Machine learning
More informationMAY 2005 SOA EXAM C/CAS 4 SOLUTIONS
MAY 2005 SOA EXAM C/CAS 4 SOLUTIONS Prepared by Sam Broverman, to appear in ACTEX Exam C/4 Study Guide http://wwwsambrovermancom 2brove@rogerscom sam@utstattorontoedu 1 The distribution function is JÐBÑ
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models
More informationOC330C. Wiring Diagram. Recommended PKH- P35 / P50 GALH PKA- RP35 / RP50. Remarks (Drawing No.) No. Parts No. Parts Name Specifications
G G " # $ % & " ' ( ) $ * " # $ % & " ( + ) $ * " # C % " ' ( ) $ * C " # C % " ( + ) $ * C D ; E @ F @ 9 = H I J ; @ = : @ A > B ; : K 9 L 9 M N O D K P D N O Q P D R S > T ; U V > = : W X Y J > E ; Z
More informationAlmost Sure Convergence of a Sequence of Random Variables
Almost Sure Convergence of a Sequence of Random Variables (...for people who haven t had measure theory.) 1 Preliminaries 1.1 The Measure of a Set (Informal) Consider the set A IR 2 as depicted below.
More informationOutline of Elementary Probability Theory Math 495, Spring 2013
Outline of Elementary Probability Theory Math 495, Spring 2013 1 Þ Probability spaces 1.1 Definition. A probability space is a triple ( H, T,P) here ( 3ÑH is a non-empty setà Ð33ÑT is a collection of subsets
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationProbability Theory. Introduction to Probability Theory. Principles of Counting Examples. Principles of Counting. Probability spaces.
Probability Theory To start out the course, we need to know something about statistics and probability Introduction to Probability Theory L645 Advanced NLP Autumn 2009 This is only an introduction; for
More informationRANDOM WALKS AND THE PROBABILITY OF RETURNING HOME
RANDOM WALKS AND THE PROBABILITY OF RETURNING HOME ELIZABETH G. OMBRELLARO Abstract. This paper is expository in nature. It intuitively explains, using a geometrical and measure theory perspective, why
More informationMathematics for Informatics 4a
Mathematics for Informatics 4a José Figueroa-O Farrill Lecture 1 18 January 2012 José Figueroa-O Farrill mi4a (Probability) Lecture 1 1 / 23 Introduction Topic: Probability and random processes Lectures:
More informationMachine Learning. Probability Theory. WS2013/2014 Dmitrij Schlesinger, Carsten Rother
Machine Learning Probability Theory WS2013/2014 Dmitrij Schlesinger, Carsten Rother Probability space is a three-tuple (Ω, σ, P) with: Ω the set of elementary events σ algebra P probability measure σ-algebra
More informationInner Product Spaces
Inner Product Spaces In 8 X, we defined an inner product? @? @?@ ÞÞÞ? 8@ 8. Another notation sometimes used is? @? ß@. The inner product in 8 has several important properties ( see Theorem, p. 33) that
More informationIt's Only Fitting. Fitting model to data parameterizing model estimating unknown parameters in the model
It's Only Fitting Fitting model to data parameterizing model estimating unknown parameters in the model Likelihood: an example Cohort of 8! individuals observe survivors at times >œ 1, 2, 3,..., : 8",
More informationChapter 2: Probability Part 1
Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.
More informationSIMULTANEOUS CONFIDENCE BANDS FOR THE PTH PERCENTILE AND THE MEAN LIFETIME IN EXPONENTIAL AND WEIBULL REGRESSION MODELS. Ping Sa and S.J.
SIMULTANEOUS CONFIDENCE BANDS FOR THE PTH PERCENTILE AND THE MEAN LIFETIME IN EXPONENTIAL AND WEIBULL REGRESSION MODELS " # Ping Sa and S.J. Lee " Dept. of Mathematics and Statistics, U. of North Florida,
More informationCellular Automaton Growth on # : Theorems, Examples, and Problems
Cellular Automaton Growth on : Theorems, Examples, and Problems (Excerpt from Advances in Applied Mathematics) Exactly 1 Solidification We will study the evolution starting from a single occupied cell
More informationHere are proofs for some of the results about diagonalization that were presented without proof in class.
Suppose E is an 8 8 matrix. In what follows, terms like eigenvectors, eigenvalues, and eigenspaces all refer to the matrix E. Here are proofs for some of the results about diagonalization that were presented
More informationChapter 4. Measure Theory. 1. Measure Spaces
Chapter 4. Measure Theory 1. Measure Spaces Let X be a nonempty set. A collection S of subsets of X is said to be an algebra on X if S has the following properties: 1. X S; 2. if A S, then A c S; 3. if
More informationLebesgue Measure. Dung Le 1
Lebesgue Measure Dung Le 1 1 Introduction How do we measure the size of a set in IR? Let s start with the simplest ones: intervals. Obviously, the natural candidate for a measure of an interval is its
More information: œ Ö: =? À =ß> real numbers. œ the previous plane with each point translated by : Ðfor example,! is translated to :)
â SpanÖ?ß@ œ Ö =? > @ À =ß> real numbers : SpanÖ?ß@ œ Ö: =? > @ À =ß> real numbers œ the previous plane with each point translated by : Ðfor example, is translated to :) á In general: Adding a vector :
More informationAxioms of Probability
Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing
More informationNOVEMBER 2005 EXAM NOVEMBER 2005 CAS COURSE 3 EXAM SOLUTIONS 1. Maximum likelihood estimation: The log of the density is 68 0ÐBÑ œ 68 ) Ð) "Ñ 68 B. The loglikelihood function is & j œ 68 0ÐB Ñ œ & 68 )
More informationV7 Foundations of Probability Theory
V7 Foundations of Probability Theory Probability : degree of confidence that an event of an uncertain nature will occur. Events : we will assume that there is an agreed upon space of possible outcomes
More informationProbability Basics Review
CS70: Jean Walrand: Lecture 16 Events, Conditional Probability, Independence, Bayes Rule Probability Basics Review Setup: Set notation review A B A [ B A \ B 1 Probability Basics Review 2 Events 3 Conditional
More informationThe Practice of Statistics Third Edition
The Practice of Statistics Third Edition Chapter 6: Probability and Simulation: The Study of Randomness Copyright 2008 by W. H. Freeman & Company Probability Rules True probability can only be found by
More informationChapter 5: Probability in Our Daily Lives
Chapter 5: in Our Daily Lives These notes reflect material from our text, Statistics: The Art and Science of Learning from Data, Third Edition, by Alan Agresti and Catherine Franklin, published by Pearson,
More informationLecture 6 Feb 5, The Lebesgue integral continued
CPSC 550: Machine Learning II 2008/9 Term 2 Lecture 6 Feb 5, 2009 Lecturer: Nando de Freitas Scribe: Kevin Swersky This lecture continues the discussion of the Lebesque integral and introduces the concepts
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 3 9/10/2008 CONDITIONING AND INDEPENDENCE
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 3 9/10/2008 CONDITIONING AND INDEPENDENCE Most of the material in this lecture is covered in [Bertsekas & Tsitsiklis] Sections 1.3-1.5
More informationImplicit in the definition of orthogonal arrays is a projection propertyþ
Projection properties Implicit in the definition of orthogonal arrays is a projection propertyþ factor screening effect ( factor) sparsity A design is said to be of projectivity : if in every subset of
More informationRandom Variables. Andreas Klappenecker. Texas A&M University
Random Variables Andreas Klappenecker Texas A&M University 1 / 29 What is a Random Variable? Random variables are functions that associate a numerical value to each outcome of an experiment. For instance,
More information1.1. MEASURES AND INTEGRALS
CHAPTER 1: MEASURE THEORY In this chapter we define the notion of measure µ on a space, construct integrals on this space, and establish their basic properties under limits. The measure µ(e) will be defined
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationRecap. The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY INFERENTIAL STATISTICS
Recap. Probability (section 1.1) The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY Population Sample INFERENTIAL STATISTICS Today. Formulation
More informationMonic Adjuncts of Quadratics (Developed, Composed & Typeset by: J B Barksdale Jr / )
Monic Adjuncts of Quadratics (eveloped, Composed & Typeset by: J B Barksdale Jr / 04 18 15) Article 00.: Introduction. Given a univariant, Quadratic polynomial with, say, real number coefficients, (0.1)
More information! " # $! % & '! , ) ( + - (. ) ( ) * + / 0 1 2 3 0 / 4 5 / 6 0 ; 8 7 < = 7 > 8 7 8 9 : Œ Š ž P P h ˆ Š ˆ Œ ˆ Š ˆ Ž Ž Ý Ü Ý Ü Ý Ž Ý ê ç è ± ¹ ¼ ¹ ä ± ¹ w ç ¹ è ¼ è Œ ¹ ± ¹ è ¹ è ä ç w ¹ ã ¼ ¹ ä ¹ ¼ ¹ ±
More informationTOTAL DIFFERENTIALS. In Section B-4, we observed that.c is a pretty good approximation for? C, which is the increment of
TOTAL DIFFERENTIALS The differential was introduced in Section -4. Recall that the differential of a function œ0ðñis w. œ 0 ÐÑ.Þ Here. is the differential with respect to the independent variable and is
More informationFramework for functional tree simulation applied to 'golden delicious' apple trees
Purdue University Purdue e-pubs Open Access Theses Theses and Dissertations Spring 2015 Framework for functional tree simulation applied to 'golden delicious' apple trees Marek Fiser Purdue University
More informationChapter 1: Introduction to Probability Theory
ECE5: Stochastic Signals and Systems Fall 8 Lecture - September 6, 8 Prof. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter : Introduction to Probability Theory Axioms of Probability
More informationOutline. 1. The Screening Philosophy 2. Robust Products/Processes 3. A Statistical Screening Procedure 4. Some Caveats 5.
Screening to Identify Robust Products Based on Fractional Factorial Experiments Thomas J. Santner Ohio State University Guohua Pan Novartis Pharmaceuticals Corp Outline 1. The Screening Philosophy 2. Robust
More informationLA PRISE DE CALAIS. çoys, çoys, har - dis. çoys, dis. tons, mantz, tons, Gas. c est. à ce. C est à ce. coup, c est à ce
> ƒ? @ Z [ \ _ ' µ `. l 1 2 3 z Æ Ñ 6 = Ð l sl (~131 1606) rn % & +, l r s s, r 7 nr ss r r s s s, r s, r! " # $ s s ( ) r * s, / 0 s, r 4 r r 9;: < 10 r mnz, rz, r ns, 1 s ; j;k ns, q r s { } ~ l r mnz,
More informationBrief Review of Probability
Brief Review of Probability Nuno Vasconcelos (Ken Kreutz-Delgado) ECE Department, UCSD Probability Probability theory is a mathematical language to deal with processes or experiments that are non-deterministic
More informationIntroduction to probability theory
Introduction to probability theory Fátima Sánchez Cabo Institute for Genomics and Bioinformatics, TUGraz f.sanchezcabo@tugraz.at 07/03/2007 - p. 1/35 Outline Random and conditional probability (7 March)
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationThe Lebesgue Integral
The Lebesgue Integral Brent Nelson In these notes we give an introduction to the Lebesgue integral, assuming only a knowledge of metric spaces and the iemann integral. For more details see [1, Chapters
More informationMathematical Probability
Mathematical Probability STA 281 Fall 2011 1 Introduction Engineers and scientists are always exposed to data, both in their professional capacities and in everyday activities. The discipline of statistics
More information1 Chapter 1: SETS. 1.1 Describing a set
1 Chapter 1: SETS set is a collection of objects The objects of the set are called elements or members Use capital letters :, B, C, S, X, Y to denote the sets Use lower case letters to denote the elements:
More informationProbability. Lecture Notes. Adolfo J. Rumbos
Probability Lecture Notes Adolfo J. Rumbos October 20, 204 2 Contents Introduction 5. An example from statistical inference................ 5 2 Probability Spaces 9 2. Sample Spaces and σ fields.....................
More informationLecture 9: Conditional Probability and Independence
EE5110: Probability Foundations July-November 2015 Lecture 9: Conditional Probability and Independence Lecturer: Dr. Krishna Jagannathan Scribe: Vishakh Hegde 9.1 Conditional Probability Definition 9.1
More informationReview of probability. Nuno Vasconcelos UCSD
Review of probability Nuno Vasconcelos UCSD robability probability is the language to deal with processes that are non-deterministic examples: if I flip a coin 00 times how many can I expect to see heads?
More informationProblem Set 2: Solutions Math 201A: Fall 2016
Problem Set 2: s Math 201A: Fall 2016 Problem 1. (a) Prove that a closed subset of a complete metric space is complete. (b) Prove that a closed subset of a compact metric space is compact. (c) Prove that
More information