Massachusetts Institute of Technology
|
|
- Emerald Blair
- 5 years ago
- Views:
Transcription
1 Solutios to Quiz : Sprig 006 Problem : Each of the followig statemets is either True or False. There will be o partial credit give for the True False questios, thus ay explaatios will ot be graded. Please clearly idicate True or False i your quiz booklet, ambiguous marks will receive zero credit. Cosider a probabilistic model with a sample space Ω, a collectio of evets that are subsets of Ω, ad a probability law P() defied o the collectio of evets all exactly as usual. Let A, B ad C be evets. (a) If P(A) P(B), the A B. True False False. As a couterexample, cosider the sample space associated with a biased coi which comes up heads with probability. The, P(heads) P(tails), but the evet heads is clearly ot a subset of the evet tails. Note that the coverse statemet is true, i.e. if A B, the P(A) P(B). (b) Assumig P(B) > 0, P(A B) is at least as large as P(A). True False False. As a couterexample, cosider the case where A B C ad 0 < P(B) <. Clearly P(A B) 0, but P(A) P(B) > 0. So, i this case P(A B) < P(A). Now let X ad Y be radom variables defied o the same probability space Ω as above. (c) If E[X ] > E[Y ], the E[X ] E[Y ]. True False False. Let X take o the values 0 ad with equal probability. Let Y take o the values 000 ad 000 with equal probability. The, E[X].5, ad E[Y ] 0, so E[X] > E[Y ]. However, E[X ].5, while E[Y ] Thus, E[X ] < E[Y ] i this case. A additioal couterexample usig degeerate radom variables is the trivial case of X, Y. (d) Suppose P(A) > 0. The E[X] E[X A] + E[X A C ]. True False False. This resembles the total expectatio theorem, but the P(A) ad P(A C ) terms are missig. As a explicit couterexample, say X is idepedet of A, ad E[X]. The, the left had side is, while the right had side of the equatio is +. (e) If X ad Y are idepedet ad P(C) > 0, the p X,Y C (x, y) p X C (x) p Y C (y). True False False. If X ad Y are idepedet, we ca coclude p X,Y (x, y) p X (x) p Y (y). The statemet asks whether X ad Y are coditioally idepedet give C. As we have see i class, idepedece does NOT imply coditioal idepedece. For example, let X take o the values 0 ad with equal probability. Let Y also take o the values 0 ad with equal probability, idepedet of X. Let C be the evet X + Y. The, clearly X ad Y are ot idepedet coditioed o C. To see this, ote that the joit PMF of X ad Y coditioed o C puts probability 4 o each of the outcomes (0, ) ad (, 0). Thus, coditioed o C, tellig you the value of X determies the value of Y exactly. O the other had, coditioed o C, if you do t kow the value of X, Y is still equally likely to be 0 or.
2 (f) If for some costat c we have P({X > c}), the E[X] > c. True False False. Let X take o the values ad with equal probability. The, P({X > 0}).5, ad E[X] 0 4. Icidetally, if we restrict X to be oegative, the statemet is true. We will study this more carefully later i the term. The iterested reader ca look up the Markov iequality i sectio 7. of the textbook. I a simple game ivolvig flips of a fair coi, you wi a dollar every time you get a head. Suppose that the maximum umber of flips is 0, however, the game termiates as soo as you get a tail. (g) The expected gai from this game is. True False False. Cosider a alterative game where you cotiue flippig util you see a tail, i.e. the game does ot termiate at a max of 0 flips. We ll refer to this as the ulimited game. Let G be your gai, ad X be the total umber of flips (head ad tails). Realize that X is a geometric radom variable, ad G X is a shifted geometric radom variable. Also E[G] E[X] $, which is the value of the ulimited game. The trucated game effectively scales dow all pay offs of the ulimited game which are > $0. Thus the trucated game must have a lower expected value tha tha the ulimited game. The expected gai of the trucated game is <. Let X be a uiformly distributed cotiuous radom variable over some iterval [a, b]. (h) We ca uiquely describe f X (x) from its mea ad variace. True False True. A uiformly distributed cotiuous radom variable is completely specified by it s (b a) rage, i.e. by a ad b. We have E[X] (a+b), ad var(x), thus give E[X] ad var(x) oe ca solve for a ad b. Let X be a expoetially distributed radom variable with a probability desity fuctio f X (x) e x. (i) The P ({0 X } { X 4}) e 4 True False True. Note {0 X } { X 4} {0 X 4}, so we have P ({0 X 4}) F X (4) e 4 Let X be a ormal radom variable with mea ad variace 4. Let Y be a ormal radom variable with mea ad variace. (j) P(X < 0) < P(Y < 0). True False False. Sice X N(, 4), X N(0, ). Similarly, Y N(0, ). So, P(X < 0) Φ( 0 ), ad P(Y < 0) Φ(0 ). We kow that ay CDF is mootoically odecreasig, so Φ( ) Φ( ). This shows that the statemet i false. A alterative solutio:
3 False. Sice X N(, 4), X N(0, ). Similarly, Y N(0, ). Let Z be a stadard ormal radom variable. The, P(X < 0) P(Z < 0 ), ad P(Y < 0) P(Z < 0 ). Now, the evet {Z < } is a subset of the evet {Z < }, ad hece P(Z < ) P(Z < ), which implies that the statemet i false.
4 Problem : (40 poits) Borders Book store has bee i busiess for 0 years, ad over that period, the store has collected trasactio data o all of its customers. Various marketig teams have bee busy usig the data to classify customers i hopes of better uderstadig customer spedig habits. Marketig Team A has determied that out of their customers, /4 are low frequecy buyers (i.e., they do t come to the store very ofte). They have also foud that out of the low frequecy buyers, / are high speders (i.e., they sped a sigificat amout of moey i the store), whereas out of the high frequecy buyers oly /0 are high speders. Assume each customer is either a low or high frequecy buyer. (a) Compute the probability that a radomly chose customer is a high speder. We use the abbreviatios HF, LF, HS, ad LS to refer to high frequecy, low frequecy, high speder, ad low speder. Usig the total probability theorem, P(HS) P(LF )P(HS LF ) + P(HF )P(HS HF ) (b) Compute the probability that a radomly chose customer is a high frequecy buyer give that he/she is a low speder. Usig Bayes rule, P(HF LS) P(HF )P(LS HF ) P(HF )P(LS HF ) + P(LF )P(LS LF ) You are told that the oly products Borders sells are books, CDs, ad DVDs. You are itroduced to Marketig Team B which has idetified customer groupigs. These groups are collectively exhaustive ad mutually exclusive. They have also determied that each customer is equally likely to be i ay group, customers are i.i.d, ad each customer buys oly oe item per day. They refer to the groupigs as C, C, ad C, ad have determied the followig coditioal probabilities: P(purchases a book customer i C ) / P(purchases a CD customer i C ) /4 P(purchases a DVD customer i C ) /4 P(purchases a book customer i C ) / P(purchases a CD customer i C ) 0 P(purchases a DVD customer i C ) / P(purchases a book customer i C ) / P(purchases a CD customer i C ) / P(purchases a DVD customer i C ) /
5 (c) Compute the probability that a customer purchases a book or a CD. We use the abbreviatios B, C, D for buyig a book, CD, or DVD. P(B C) P(B) + P(C) because a customer ca oly buy item, ad hece B ad C are disjoit. Applyig the total probability theorem, Similarly, P(B) P(C )P(B C ) + P(C )P(B C ) + P(C )P(B C ) P(C) P(C )P(C C ) + P(C )P(C C ) + P(C )P(C C ) So, P(B C) (Note: Alteratively, we could have used the fact that B ad C are coditioally disjoit give C, C, or C. The, we could just add together the coditioal probabilities. This would give the formula P(B C) 4 ) + ( + ( + 0) + ( + ).) (d) Compute the probability that a customer is i group C or C give he/she purchased a book. We use Bayes rule. P(C C B) P(B (C C )) P(B) P(B C ) + P(B C ) P(B C ) + P(B C ) + P(B C ). To get the secod lie, we used the fact that C, C, ad C are mutually disjoit ad collectively exhaustive. Now, substitutig the give umbers, P(C C B) Now i additio to the data from Marketig Team B, you are told that each book costs $5, each CD costs $0, ad each DVD costs $5. (e) Compute the PMF, expected value ad variace of the reveue (i dollars) Borders collects from a sigle item purchase of oe customer? Let R be the reveue from oe customer. The, R ca take o the values 0 ad 5. p R (0) 7 9 P(C). We calculated P(C) 6 i part c). p R (5) p R (0) 6 because the PMF must sum to. So,
6 p R (r) 7 r r otherwise Oce we have the PMF, calculated the mea ad variace is a simply a matter of pluggig 7 9 ito the defiitios. E[R] rp 505 R (r) Sice we kow the mea, we ca calculate the variace from var(r) E[R ] (E[R]) ( 6 ) (f) Suppose that customers shop o a give day. Compute the expected value ad variace of the reveue Borders makes from these customers. Let R, R,..., R be radom variables such that R i is the reveue from customer i. The total reveue is R i R i. Recall that the customers are i.i.d. Thus, by liearity of expectatio E[R] i E[R 505 i ] E[R ] usig the result from (e). Because the R 6 i are assumed to be idepedet, var(r) i var(r i) var(r ) , usig the result from (e). The followig questios are required for 6.4 Studets (6.04 Studets may attempt them for Extra Credit) Skipper is very abormal, ot that there s aythig wrog with that. He does t fit ito ay of the marketig teams models. Every day Skipper wakes up ad walks to Borders Bookstore. There he flips a fair coi repeatedly util he flips his secod tails. He the goes to the couter ad buys DVD for each head he flipped. Let R be the reveue Borders makes from Skipper each day. (g) What s the daily expected reveue from Skipper? The crucial observatio is that Skipper s reveue ca be broke dow as the sum of two idepedet shifted geometric radom variables. Let X ad X be idepedet geometric radom variables with paramater p. Let R be the total daily reveue from Skipper. We fid R 5(X ) + 5(X ), ad thus E[R] 5(E[X ] + E[X ]) 0 $0, where we ve used E[X 5 i ] Likewise we fid var(r) (var(x ) + var(x )) $900, where. we ve used var(x i ). ( )
7 Problem : (0 poits) We have s urs ad balls, where s. Cosider a experimet where each ball is placed i a ur at radom (i.e., each ball has equal probability of beig placed i ay of the urs). Assume each ball placemet is idepedet of other placemets, ad each ur ca fit ay umber of balls. Defie the followig radom variables: For each i,,..., s, let X i be the umber of balls i ur i. For each k 0,,...,, let Y k be the umber of urs that have exactly k balls. Note: Be sure to iclude rages of variables where appropriate. (a) Are the X i s idepedet? Aswer: Yes / No No. Beforehad, X ca take o ay value from 0,,...,. Say we are told X X... X s 0. The, coditioed o this iformatio, X with probability. Thus, the X i s caot be idepedet. (b) Fid the PMF, mea, ad variace of X i. p Xi (k) E[X i ] var(x i ) The crucial observatio is that X i has a biomial PMF. Cosider each ball. It chooses a ur idepedetly ad uiformly. Thus, the probability the ball lads i ur i is s. There are balls, so X i is distributed like a biomial radom variable with parameters ad s. Thus, we obtai ( ) ( ) ) k ( k p Xi (k), k 0,,..., k s s E[X i ] s ( ) ( ) ( ) ( ) var(x i ) s s s s (c) For this questio let 0, ad s. Fid the probability that the first ur has balls, the secod has, ad the third has 5. i.e. compute P(X, X, X 5) We ca calculate the required probability usig coutig. As our sample space, we will use sequeces of legth, where each the i th elemet i the sequece is the umber of the ur that the i th ball is i. The total umber of elemets i the sample space is s 0. The sequeces that have X, X, ad X 5 are those sequeces that have three s, two ( 0 ) s, ad five s. The umber of such sequeces is give be the partitio formula,,,5. So,,,5) 80 P(X, X, X 5) ( (d) Compute E[Y k ]. E[Y k ] This problem is very similar to the hat problem discussed i lecture. The trick is to defie idicator radom variables I, I,..., I s. I i is if ur i has exactly k balls, ad 0 otherwise. With s s this defiitio, Y k i I i. By liearity of expectatio, we see that E[Y k ] i E[I i ].
8 To calculate E[I i ], ote that E[I i ] P(X i k) p Xi (k). From b), we kow that p Xi (k) ( ) ( ) k ( ) ) k k s s. This meas E[Yk ] s ( ) ( ) k ( k k s s. (e) Compute var(y k ). You may assume k. var(y k ) var(y k ) E[Y ] (E[Y k ]). From d), we kow E[Y k ], so we oly eed to fid E[Y k ]. s E[Y ] E[( k i I i) k ]. Usig liearity of expectatio, ad otig that I I i sice I i is i s s s always 0 or, we obtai E[Yk ] i E[I i ] + i ji E[I ii j ]. From d), we kow E[I i ], which takes care of the first term. To calculate the secod term, E[I i I j ] P(X i X j k). Note that this evet oly has ozero probability if k (hece the assumptio i the problem statemet). Now, P(X i X j k) ca be computed usig the partitio formula. The probability that the first k balls lad i ur i, the ext k balls lad i ur j, ad the remaiig k balls ( ) k ( ) k ( ) k lad i urs ot equal to i or j is give by s s s. The umber of ways ( ) of partitioig the balls ito groups of size k, k, ad k is k,k, k. This gives P(X i X j k) ( ) ( ) k ( ) k k,k, k s s. Fially, substitutig our results ito the origial equatio, we get s s s var(y k ) E[I i ] + E[I i I j ] (E[Y k ]) i i ji+ ( ) ( ) ) ) k ( ( ) k ( ) k ( k s + s(s ) k s s k, k, k s s ( ( ) ( ) ) k ( k ) s k s s (f) This problem is required for 6.4 Studets (6.04 Studets may attempt it for Extra Credit) What is the probability that o ur is empty? i.e., compute P (X > 0, X > 0,..., X s > 0). P(X > 0, X > 0,..., X s > 0) To determie the desired probability, we will compute P(some ur is empty). Defie evets A i, i,,..., s such that A i is the evet {X i 0}, i.e. that ur i is empty. The, P(some ur is empty) P(A A... A s ). We will use the iclusio exclusio priciple to calculate the probability of the uio of the A i (see chapter, problem 9 for a detailed discussio of the iclusio exclusio priciple). The iclusio exclusio formula states s P(A A... A s ) P(A i ) P(A i A j )+ P(A i A j A k )+...+( ) s P(A A... A s ) i i<j s i<j<k s Let us calculate P(A A... A k ) for ay k s. This itersectio represets the evet that the first k urs are all empty. The probability the first k urs are empty is simply the
9 ( ) k probability that every ball misses these k urs, which is s. By symmetry, this formula works for ay fixed set of k urs. Pluggig this ito the iclusio exclusio formula, we get s ( ) ( ) ( ) ( ) P(A A... A s ) +...+( ) s s. s s s s i i<j s i<j<k s To simplify this ( expressio, ) cosider the first sum. There are s terms i the sum, so the first ( s ) ( s ) sum is just s s. I the ext sum, there are terms. I geeral, the k th sum has k terms. Thus, we get ( ) ( ) ( ) ( ) ( ) ( ) ( ) s s s P(A A... A s ) s ( ) s s. s s s s s We subtract this probability from to get the fial aswer, P(X > 0, X > 0,..., X s > 0) ( ( ) ( ) ( ) ( ) ( ) ( ) ( ) s s s ) s ( ) s s s s s s s ( ) ( ) s s ( ) k k k s k0 (We ca leave out the k s term sice that term is always 0.)
STAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More informationDiscrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22
CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationDiscrete Mathematics for CS Spring 2005 Clancy/Wagner Notes 21. Some Important Distributions
CS 70 Discrete Mathematics for CS Sprig 2005 Clacy/Wager Notes 21 Some Importat Distributios Questio: A biased coi with Heads probability p is tossed repeatedly util the first Head appears. What is the
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Math 36Q Fall 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2 to
More informationDiscrete Mathematics and Probability Theory Summer 2014 James Cook Note 15
CS 70 Discrete Mathematics ad Probability Theory Summer 2014 James Cook Note 15 Some Importat Distributios I this ote we will itroduce three importat probability distributios that are widely used to model
More informationRandomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)
Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black
More informationn outcome is (+1,+1, 1,..., 1). Let the r.v. X denote our position (relative to our starting point 0) after n moves. Thus X = X 1 + X 2 + +X n,
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 9 Variace Questio: At each time step, I flip a fair coi. If it comes up Heads, I walk oe step to the right; if it comes up Tails, I walk oe
More informationLecture 2: Concentration Bounds
CSE 52: Desig ad Aalysis of Algorithms I Sprig 206 Lecture 2: Cocetratio Bouds Lecturer: Shaya Oveis Ghara March 30th Scribe: Syuzaa Sargsya Disclaimer: These otes have ot bee subjected to the usual scrutiy
More informationDiscrete Mathematics and Probability Theory Spring 2012 Alistair Sinclair Note 15
CS 70 Discrete Mathematics ad Probability Theory Sprig 2012 Alistair Siclair Note 15 Some Importat Distributios The first importat distributio we leared about i the last Lecture Note is the biomial distributio
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19
CS 70 Discrete Mathematics ad Probability Theory Sprig 2016 Rao ad Walrad Note 19 Some Importat Distributios Recall our basic probabilistic experimet of tossig a biased coi times. This is a very simple
More informationLecture 12: November 13, 2018
Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,
More informationProblems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:
Math 224 Fall 2017 Homework 4 Drew Armstrog Problems from 9th editio of Probability ad Statistical Iferece by Hogg, Tais ad Zimmerma: Sectio 2.3, Exercises 16(a,d),18. Sectio 2.4, Exercises 13, 14. Sectio
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationFinal Review for MATH 3510
Fial Review for MATH 50 Calculatio 5 Give a fairly simple probability mass fuctio or probability desity fuctio of a radom variable, you should be able to compute the expected value ad variace of the variable
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Math 36Q Sprig 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationMath 155 (Lecture 3)
Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationSTAT Homework 2 - Solutions
STAT-36700 Homework - Solutios Fall 08 September 4, 08 This cotais solutios for Homework. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better isight.
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationCS 330 Discussion - Probability
CS 330 Discussio - Probability March 24 2017 1 Fudametals of Probability 11 Radom Variables ad Evets A radom variable X is oe whose value is o-determiistic For example, suppose we flip a coi ad set X =
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationIE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes.
IE 230 Seat # Name < KEY > Please read these directios. Closed book ad otes. 60 miutes. Covers through the ormal distributio, Sectio 4.7 of Motgomery ad Ruger, fourth editio. Cover page ad four pages of
More informationTopic 8: Expected Values
Topic 8: Jue 6, 20 The simplest summary of quatitative data is the sample mea. Give a radom variable, the correspodig cocept is called the distributioal mea, the epectatio or the epected value. We begi
More informationLearning Theory: Lecture Notes
Learig Theory: Lecture Notes Kamalika Chaudhuri October 4, 0 Cocetratio of Averages Cocetratio of measure is very useful i showig bouds o the errors of machie-learig algorithms. We will begi with a basic
More informationAMS570 Lecture Notes #2
AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)
More informationf X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probablity that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c} Pr(X c) = Pr({s S X(s)
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More information( ) = p and P( i = b) = q.
MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationHOMEWORK 2 SOLUTIONS
HOMEWORK SOLUTIONS CSE 55 RANDOMIZED AND APPROXIMATION ALGORITHMS 1. Questio 1. a) The larger the value of k is, the smaller the expected umber of days util we get all the coupos we eed. I fact if = k
More informationUC Berkeley Department of Electrical Engineering and Computer Sciences. EE126: Probability and Random Processes
UC Berkeley Departmet of Electrical Egieerig ad Computer Scieces EE26: Probability ad Radom Processes Problem Set Fall 208 Issued: Thursday, August 23, 208 Due: Wedesday, August 29, 207 Problem. (i Sho
More informationMATH 472 / SPRING 2013 ASSIGNMENT 2: DUE FEBRUARY 4 FINALIZED
MATH 47 / SPRING 013 ASSIGNMENT : DUE FEBRUARY 4 FINALIZED Please iclude a cover sheet that provides a complete setece aswer to each the followig three questios: (a) I your opiio, what were the mai ideas
More informationProblem Set 2 Solutions
CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S
More informationLecture 2: April 3, 2013
TTIC/CMSC 350 Mathematical Toolkit Sprig 203 Madhur Tulsiai Lecture 2: April 3, 203 Scribe: Shubhedu Trivedi Coi tosses cotiued We retur to the coi tossig example from the last lecture agai: Example. Give,
More information0, otherwise. EX = E(X 1 + X n ) = EX j = np and. Var(X j ) = np(1 p). Var(X) = Var(X X n ) =
PROBABILITY MODELS 35 10. Discrete probability distributios I this sectio, we discuss several well-ow discrete probability distributios ad study some of their properties. Some of these distributios, lie
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationMathematical Statistics - MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More informationLecture 6: Coupon Collector s problem
Radomized Algorithms Lecture 6: Coupo Collector s problem Sotiris Nikoletseas Professor CEID - ETY Course 2017-2018 Sotiris Nikoletseas, Professor Radomized Algorithms - Lecture 6 1 / 16 Variace: key features
More informationMath 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency
Math 152. Rumbos Fall 2009 1 Solutios to Review Problems for Exam #2 1. I the book Experimetatio ad Measuremet, by W. J. Youde ad published by the by the Natioal Sciece Teachers Associatio i 1962, the
More informationf X (12) = Pr(X = 12) = Pr({(6, 6)}) = 1/36
Probability Distributios A Example With Dice If X is a radom variable o sample space S, the the probability that X takes o the value c is Similarly, Pr(X = c) = Pr({s S X(s) = c}) Pr(X c) = Pr({s S X(s)
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More informationLecture 1 Probability and Statistics
Wikipedia: Lecture 1 Probability ad Statistics Bejami Disraeli, British statesma ad literary figure (1804 1881): There are three kids of lies: lies, damed lies, ad statistics. popularized i US by Mark
More informationLecture 2. The Lovász Local Lemma
Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio
More informationAs stated by Laplace, Probability is common sense reduced to calculation.
Note: Hadouts DO NOT replace the book. I most cases, they oly provide a guidelie o topics ad a ituitive feel. The math details will be covered i class, so it is importat to atted class ad also you MUST
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More informationHOMEWORK I: PREREQUISITES FROM MATH 727
HOMEWORK I: PREREQUISITES FROM MATH 727 Questio. Let X, X 2,... be idepedet expoetial radom variables with mea µ. (a) Show that for Z +, we have EX µ!. (b) Show that almost surely, X + + X (c) Fid the
More informationThe Random Walk For Dummies
The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli
More informationLecture 4 The Simple Random Walk
Lecture 4: The Simple Radom Walk 1 of 9 Course: M36K Itro to Stochastic Processes Term: Fall 014 Istructor: Gorda Zitkovic Lecture 4 The Simple Radom Walk We have defied ad costructed a radom walk {X }
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationUNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY
UNIT 2 DIFFERENT APPROACHES TO PROBABILITY THEORY Structure 2.1 Itroductio Objectives 2.2 Relative Frequecy Approach ad Statistical Probability 2. Problems Based o Relative Frequecy 2.4 Subjective Approach
More informationIntroduction to Probability. Ariel Yadin. Lecture 2
Itroductio to Probability Ariel Yadi Lecture 2 1. Discrete Probability Spaces Discrete probability spaces are those for which the sample space is coutable. We have already see that i this case we ca take
More informationLecture 1 Probability and Statistics
Wikipedia: Lecture 1 Probability ad Statistics Bejami Disraeli, British statesma ad literary figure (1804 1881): There are three kids of lies: lies, damed lies, ad statistics. popularized i US by Mark
More informationEE 4TM4: Digital Communications II Probability Theory
1 EE 4TM4: Digital Commuicatios II Probability Theory I. RANDOM VARIABLES A radom variable is a real-valued fuctio defied o the sample space. Example: Suppose that our experimet cosists of tossig two fair
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More informationChapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities
Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other
More informationProbability and statistics: basic terms
Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample
More informationWORKING WITH NUMBERS
1 WORKING WITH NUMBERS WHAT YOU NEED TO KNOW The defiitio of the differet umber sets: is the set of atural umbers {0, 1,, 3, }. is the set of itegers {, 3,, 1, 0, 1,, 3, }; + is the set of positive itegers;
More informationDiscrete probability distributions
Discrete probability distributios I the chapter o probability we used the classical method to calculate the probability of various values of a radom variable. I some cases, however, we may be able to develop
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationIE 230 Probability & Statistics in Engineering I. Closed book and notes. No calculators. 120 minutes.
Closed book ad otes. No calculators. 120 miutes. Cover page, five pages of exam, ad tables for discrete ad cotiuous distributios. Score X i =1 X i / S X 2 i =1 (X i X ) 2 / ( 1) = [i =1 X i 2 X 2 ] / (
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationSets and Probabilistic Models
ets ad Probabilistic Models Berli Che Departmet of Computer ciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Referece: - D. P. Bertsekas, J. N. Tsitsiklis, Itroductio to Probability, ectios 1.1-1.2
More information4. Basic probability theory
Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio
More informationIntroduction to Probability. Ariel Yadin
Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways
More informationMath 525: Lecture 5. January 18, 2018
Math 525: Lecture 5 Jauary 18, 2018 1 Series (review) Defiitio 1.1. A sequece (a ) R coverges to a poit L R (writte a L or lim a = L) if for each ǫ > 0, we ca fid N such that a L < ǫ for all N. If the
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationProbability for mathematicians INDEPENDENCE TAU
Probability for mathematicias INDEPENDENCE TAU 2013 28 Cotets 3 Ifiite idepedet sequeces 28 3a Idepedet evets........................ 28 3b Idepedet radom variables.................. 33 3 Ifiite idepedet
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science. BACKGROUND EXAM September 30, 2004.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Departmet of Electrical Egieerig ad Computer Sciece 6.34 Discrete Time Sigal Processig Fall 24 BACKGROUND EXAM September 3, 24. Full Name: Note: This exam is closed
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationProbability theory and mathematical statistics:
N.I. Lobachevsky State Uiversity of Nizhi Novgorod Probability theory ad mathematical statistics: Law of Total Probability. Associate Professor A.V. Zorie Law of Total Probability. 1 / 14 Theorem Let H
More informationOn Random Line Segments in the Unit Square
O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,
More informationVariance of Discrete Random Variables Class 5, Jeremy Orloff and Jonathan Bloom
Variace of Discrete Radom Variables Class 5, 18.05 Jeremy Orloff ad Joatha Bloom 1 Learig Goals 1. Be able to compute the variace ad stadard deviatio of a radom variable.. Uderstad that stadard deviatio
More informationLecture 2 February 8, 2016
MIT 6.854/8.45: Advaced Algorithms Sprig 206 Prof. Akur Moitra Lecture 2 February 8, 206 Scribe: Calvi Huag, Lih V. Nguye I this lecture, we aalyze the problem of schedulig equal size tasks arrivig olie
More informationkp(x = k) = λe λ λ k 1 (k 1)! = λe λ r k e λλk k! = e λ g(r) = e λ e rλ = e λ(r 1) g (1) = E[X] = λ g(r) = kr k 1 e λλk k! = E[X]
Problem 1: (8 poits) Let X be a Poisso radom variable of parameter λ. 1. ( poits) Compute E[X]. E[X] = = kp(x = k) = k=1 λe λ λ k 1 (k 1)! = λe λ ke λλk λ k k! k =0 2. ( poits) Compute g(r) = E [ r X],
More informationIntegrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number
MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationIf a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero?
2 Lebesgue Measure I Chapter 1 we defied the cocept of a set of measure zero, ad we have observed that every coutable set is of measure zero. Here are some atural questios: If a subset E of R cotais a
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationDiscrete Mathematics and Probability Theory Fall 2016 Walrand Probability: An Overview
CS 70 Discrete Mathematics ad Probability Theory Fall 2016 Walrad Probability: A Overview Probability is a fasciatig theory. It provides a precise, clea, ad useful model of ucertaity. The successes of
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationCS/ECE 715 Spring 2004 Homework 5 (Due date: March 16)
CS/ECE 75 Sprig 004 Homework 5 (Due date: March 6) Problem 0 (For fu). M/G/ Queue with Radom-Sized Batch Arrivals. Cosider the M/G/ system with the differece that customers are arrivig i batches accordig
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationMa 530 Introduction to Power Series
Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power
More informationIntroduction to Probability. Ariel Yadin. Lecture 7
Itroductio to Probability Ariel Yadi Lecture 7 1. Idepedece Revisited 1.1. Some remiders. Let (Ω, F, P) be a probability space. Give a collectio of subsets K F, recall that the σ-algebra geerated by K,
More information