Homework #4. Solution Spring 2001 IE 230
|
|
- Martha Joseph
- 5 years ago
- Views:
Transcription
1 Textbook: D.C. Montgomery and G.C. Runger, Applied Statistics and Probability for Engineers, John Wiley & Sons, New York, Sections Much of the Concise Notes page 5. Throughout, use the step-by-step approach whenever possible. 1. (From M&R, Problem 3-73.) In a test of a printed circuit board using a random test pattern, each bit in an array of ten bits is equally likely to be a zero or a one. Assume that the bits are independent. Let Z i denote the event that the i th bit is a zero, i = 1, 2,...,. (a) Describe the experiment and a sample space S so that the events Z 1, Z 2,...,Z are meaningful. Experiment: Randomly choose one printed circuit board. Sample space: The set of all available printed circuit boards. The events Z i are the circuit boards in S for which bit i is zero. (b) Write the event "all ten bits are zero". Z 1 Z 2... Z or equivalently (c) Determine the probability of the event in Part (b). P( Z i ) = Π P(Z i ) Z i since independent = (1 / 2) since P(Z i ) = 1 / 2 = simplify (d) Show that the probability of "alternating bits" (that is, a zero always following a one and a one always following a zero) is twice as likely as all bits being zero. P( alternating bits ) = P[(Z 1 Z 2 Z 3... Z ) (Z 1 Z 2 Z 3... Z )] = P(Z 1 Z 2 Z 3... Z ) same event + P(Z 1 Z 2 Z 3... Z ) mut. excl. = P(Z 1 )(Z 2 )P(Z 3 )... P(Z )) + P(Z 1 )P(Z 2 )P(Z 3 )... P(Z ) independence = (1 / 2) + (1 / 2) P(Z i ) = 1 / 2 = 2P( Z i ) from Part (b) - 1 of 6 - Schmeiser
2 2. (From M&R, Example 3-28) A random circuit, composed of a network of n devices, operates if and only if there is a path from beginning to end. The path cannot pass through a device that is not working. (Think of electricity flowing.) Let D i denote the event that device i works, i = 1, 2,..., n. Assume that these events are jointly independent. Consider the network of n = 6 devices illustrated in the textbook. For the network to operate, at least one of the first three devices must work, at least one of the fourth and fifth devices must work, and the sixth device must work. (a) Using D i event notation, write the six device probabilities given in the textbook. P(D 1 ) = P(D 2 ) = P(D 3 ) = 0.9 P(D 4 ) = P(D 5 ) = 0.95 P(D 6 ) = 0.99 (b) Write, in set notation, the event that the network operates. (D 1 ) (D 4 ) D 6 (c) Compute the probability of the event in Part (b). P(D 1 ) (D 4 ) D 6 = P(D 1 )P(D 4 )P(D 6 ) independence = [1 P((D 1 ) )] [1 P((D 4 ) )] P(D 6 ) complements = [1 P(D 1 D 2 D 3 )] [1 P(D 4 D 5 )] P(D 6 ) DeMorgan s Law = [1 P(D 1 )P(D 2 )P(D 3 )] [1 P(D 4 )P(D 5 )] P(D 6 ) independence = [1 (1 P(D 1 )) (1 P(D 2 )) (1 P(D 3 )] [1 (1 P(D 4 )) (1 P(D 5 ))] P(D 6 ) complements = [1 (1 0.90) (1 0.90) (1 0.90)] substitute information [1 (1 0.95) (1 0.95)] (0.99) from Part (b) = ( )( ) (0.99) simplify = simplify - 2 of 6 - Schmeiser
3 3. An unknown person has won the $1,000,000 lottery. To avoid greedy acquaintances, the person tries to claim the prize in secret, but with only partial success. Only four people have been seen entering the lottery office: a short man named Sam, a tall man named Ted, a short woman name Sue, and a tall woman named Tia; one is the winner. Having no other information, assume that each is equally likely to have won. We begin an investigation. Let M denote the event that the winner is a man. Let T denote the event that the winner is tall. Let U denote the event that the winner is either a tall woman or a short man. (a) Show that M and T are independent. M andt are independent if and only if P(M T ) = P(M )P(T). All four people are equally likely, so all three probabilities are the fraction of the four people in the event. Therefore P(M T ) = P("Ted" ) = 1 / 4. P(M) = P("Ted" or "Sam" ) = 2 / 4. P(T) = P("Ted" or "Tia" ) = 2 / 4. Therefore M and T are independent. (b) Show that three events M, T, and U are pairwise independent. Three events are pairwise independent if each of all three pairs of events are independent. From Part (a) M and T are independent. Similarly, P(M U ) = P("Sam" ) = 1 / 4. P(M) = P("Ted" or "Sam" ) = 2 / 4. P(U) = P("Tia" or "Sam" ) = 2 / 4. implies that M and U are independent. Similarly, P(T U ) = P("Tia" ) = 1 / 4. P(T) = P("Ted" or "Tia" ) = 2 / 4. P(U) = P("Tia" or "Sam" ) = 2 / 4. implies that T and U are independent. (c) Use the definition to show that the three events M, T, and U are not jointly independent. To be jointly independent, the three events M, T, and U must be pairwise independent and P(M T U ) = P(M )P(T)P(U) Again because all four people are equally likely to have won, the probabilities are the fraction of people in the event. Therefore, P(M T U ) = P( ) = 0, which is not equal to P(M )P(T) P(U) = 1 / 2 3, which implies that M, T, and U are not jointly independent. - 3 of 6 - Schmeiser
4 (d) Suppose that a lottery guard knows that the winner is a man and that a lottery clerk knows that the winner is tall. Compute P(U M T ). Explain in words why your answer makes sense. P(U M T ) = P(U (M T )) definition of cond. probability P(M T ) = 0 / (1 / 4) substituting from Parts (c) and (c) = 0 simplifying (e) Roughly, event independence means that knowing whether an event occurs is not useful for predicting whether another event occurs (in the same replication of the experiment). Therefore, because of pairwise independence, M helps to predict neither T nor U. Because the three events are not jointly independent, something can be predicted. What? As shown in Part (d), knowing that the winner is a tall man (i.e. T M ) is sufficient information to eliminate Tia and Sam (i.e., U ). This one example is enough to demonstrate that the events are not jointly independent. Other examples are easy to find. Comment. Compare this problem to Problem 2 from Fall Result: If the events A and B are independent, then A and B are independent. Provide the reason for each step of the proof. P(A B ) = P((A B ) ) < DeMorgan s Law > = 1 P(A B ) < complement > = 1 [P(A ) + P(B ) P(A B )] < maybe not m.e. > = 1 [P(A ) + P(B ) P(A )P(B )] < independence > = [1 P(A )] [1 P(B )] < algebra > = P(A )P(B ) < complements > - 4 of 6 - Schmeiser
5 5. In a trial by jury, a mistake can occur in two ways. First, the jury can convict an innocent defendant. Second, the jury can free a guilty defendant. Let G denote the event that the defendant is guilty. Let F denote the event that the jury frees the defendant. Consider this situation. A robbery victim views a line up of seven suspects, one of whom is guilty. The victim, embarrassed by not recognizing the guilty person, randomly chooses one of the seven, who is then tried. Assume that a jury convicts a guilty defendant 95% of the time and frees an innocent defendant 99% of the time. (a) Write the given information as probabilities of events. P(G ) = 1 / 7 since equally likely P(F G ) = 0.95 P(F G ) = 0.99 (b) Are events G and F independent? Why or why not? G and F are not independent. If freedom were not dependent upon guilt, the court system would be worthless. One way to show the dependence is to notice that 5% of guilty defendants are freed (P(F G ) = 1 P(F G ) = = 0.05). The corresponding probability for innocent defendants is P(F G ) = Because the probability of F depends upon G, they are not independent. (c) Conditional that the defendant is convicted, what is the probability that he or she is innocent? P(G F ) = = P(F G )P(G ) P(F G )P(G ) + P(F G )P(G) [1 P(F G )] [1 P(G )] [1 P(F G )] [1 P(G )] + P(F G )P(G) Bayes s Theorem complements = [1 (0.99)] [1 (1 / 7)] [1 (0.99)] [1 (1 / 7)] + (0.95) (1 / 7) complements = (0.01) (6 / 7) (0.01) (6 / 7) + (0.95) (1 / 7) from Part (a) = simplify = simplify - 5 of 6 - Schmeiser
6 6. Spread sheet. ( your spreadsheet to The results from Part (g) should be handwritten and submitted with your solutions to Problems 1-5.) We will perform a Monte Carlo simulation, at first with one-hundred independent replications, to estimate the probability that the network of Problem 2 operates. One purpose of such a simulation is to check your answer. For more-complicated networks, however, the simulation might be the only way to analyze the network. (a) At the top of the sheet, place your name, class, homework number, and problem number. Leave four or five blank rows. (b) In Column A place the heading "Trial #". Beneath the heading place the integers 1 through 0. (You can "drag" the integers; you should not enter the numbers manually.) (c) In Columns B-G place the headings U1, U2,..., U6. Beneath each of these headings, place 0 random numbers. (Use the "rand" command.) (d) In Columns H-M place the headings D1, D2,..., D6. Above each of these heading place the corresponding given probability of the device operating. Beneath each of these six headings, place 0 binary numbers, 1 if D i occurred (that is, if device i worked) and 0 if D i did not occur (that is, if device i did not work). (Use the "if" command, just like flipping a biased coin. The results for Column H should use the random numbers in Column B, I from C, etc.) (e) In Column N place the heading "Operates?" Beneath this heading compute the 0 binary numbers that indicate whether the network operated on each replication. As before, let 1 indicate that the event occurred and 0 that it did not occur. (You can use the "if" function. But it is easier to use the expression [1 (1 H 6)(1 I 6)(1 J 6)] [1 (1 K 6)(1 L 6)] M 6 for the trial in row 6. ) (f) Above the Column N heading, compute the relative frequency that the network operated. (Use the "average" command.) Label this cell. (g) Hit F9 enough times to convince yourself that the results match your answer from Problem 2(c). If the results do not match, check your work. When they do match, write the relative frequencies obtained from hitting F9 ten times. See the MSExcel spreadsheet for the solution to Problem # of 6 - Schmeiser
1. Two useful probability results. Provide the reason for each step of the proofs. (a) Result: P(A ) + P(A ) = 1. = P(A ) + P(A ) < Axiom 3 >
Textbook: D.C. Montgomery and G.C. Runger, Applied Statistics and Probability for Engineers, John Wiley & Sons, New York, 2003. Chapter 2, Sections 2.3 2.5. 1. Two useful probability results. Provide the
More informationIE 230 Seat # (1 point) Name (clearly) < KEY > Closed book and notes. No calculators. Designed for 60 minutes, but time is essentially unlimited.
Closed book and notes. No calculators. Designed for 60 minutes, but time is essentially unlimited. Cover page, four pages of exam. This test covers through Section 2.7 of Montgomery and Runger, fourth
More informationWith Question/Answer Animations. Chapter 7
With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More information4. Conditional Probability
1 of 13 7/15/2009 9:25 PM Virtual Laboratories > 2. Probability Spaces > 1 2 3 4 5 6 7 4. Conditional Probability Definitions and Interpretations The Basic Definition As usual, we start with a random experiment
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More information1 of 14 7/15/2009 9:25 PM Virtual Laboratories > 2. Probability Spaces > 1 2 3 4 5 6 7 5. Independence As usual, suppose that we have a random experiment with sample space S and probability measure P.
More informationConditional Probability
Conditional Probability Terminology: The probability of an event occurring, given that another event has already occurred. P A B = ( ) () P A B : The probability of A given B. Consider the following table:
More informationSingle Maths B: Introduction to Probability
Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction
More informationSTAT:5100 (22S:193) Statistical Inference I
STAT:5100 (22S:193) Statistical Inference I Week 3 Luke Tierney University of Iowa Fall 2015 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall 2015 1 Recap Matching problem Generalized
More informationDiscrete Mathematics and Probability Theory Summer 2014 James Cook Final Exam
CS 70 Discrete Mathematics and Probability Theory Summer 2014 James Cook Final Exam Friday August 15, 2014, 5:10pm-8:10pm. Instructions: Do not turn over this page until the proctor tells you to. Don t
More informationIntroductory Probability
Introductory Probability Bernoulli Trials and Binomial Probability Distributions Dr. Nguyen nicholas.nguyen@uky.edu Department of Mathematics UK February 04, 2019 Agenda Bernoulli Trials and Probability
More informationProbability and Discrete Distributions
AMS 7L LAB #3 Fall, 2007 Objectives: Probability and Discrete Distributions 1. To explore relative frequency and the Law of Large Numbers 2. To practice the basic rules of probability 3. To work with the
More informationLet us think of the situation as having a 50 sided fair die; any one number is equally likely to appear.
Probability_Homework Answers. Let the sample space consist of the integers through. {, 2, 3,, }. Consider the following events from that Sample Space. Event A: {a number is a multiple of 5 5, 0, 5,, }
More informationDiscrete Probability. Chemistry & Physics. Medicine
Discrete Probability The existence of gambling for many centuries is evidence of long-running interest in probability. But a good understanding of probability transcends mere gambling. The mathematics
More informationChapter Summary. 7.1 Discrete Probability 7.2 Probability Theory 7.3 Bayes Theorem 7.4 Expected value and Variance
Chapter 7 Chapter Summary 7.1 Discrete Probability 7.2 Probability Theory 7.3 Bayes Theorem 7.4 Expected value and Variance Section 7.1 Introduction Probability theory dates back to 1526 when the Italian
More informationName: Exam 2 Solutions. March 13, 2017
Department of Mathematics University of Notre Dame Math 00 Finite Math Spring 07 Name: Instructors: Conant/Galvin Exam Solutions March, 07 This exam is in two parts on pages and contains problems worth
More informationConditional Probability & Independence. Conditional Probabilities
Conditional Probability & Independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Definition: the conditional probability of E given F is P(E F
More information2.6 Tools for Counting sample points
2.6 Tools for Counting sample points When the number of simple events in S is too large, manual enumeration of every sample point in S is tedious or even impossible. (Example) If S contains N equiprobable
More informationMutually Exclusive Events
172 CHAPTER 3 PROBABILITY TOPICS c. QS, 7D, 6D, KS Mutually Exclusive Events A and B are mutually exclusive events if they cannot occur at the same time. This means that A and B do not share any outcomes
More informationC Examples of Bayes Calculations
There are two buckets containing poker chips. Bucket A has Bucket B has 700 red chips 300 blue chips 300 red chips 700 blue chips Flip a coin to choose a bucket at random. From the chosen bucket, select
More informationExperiment 0 ~ Introduction to Statistics and Excel Tutorial. Introduction to Statistics, Error and Measurement
Experiment 0 ~ Introduction to Statistics and Excel Tutorial Many of you already went through the introduction to laboratory practice and excel tutorial in Physics 1011. For that reason, we aren t going
More informationDiscrete Structures for Computer Science
Discrete Structures for Computer Science William Garrison bill@cs.pitt.edu 6311 Sennott Square Lecture #24: Probability Theory Based on materials developed by Dr. Adam Lee Not all events are equally likely
More informationIntroduction to Probability 2017/18 Supplementary Problems
Introduction to Probability 2017/18 Supplementary Problems Problem 1: Let A and B denote two events with P(A B) 0. Show that P(A) 0 and P(B) 0. A A B implies P(A) P(A B) 0, hence P(A) 0. Similarly B A
More informationConditional Probability. CS231 Dianna Xu
Conditional Probability CS231 Dianna Xu 1 Boy or Girl? A couple has two children, one of them is a girl. What is the probability that the other one is also a girl? Assuming 50/50 chances of conceiving
More informationHomework 1. Spring 2019 (Due Tuesday January 22)
ECE 302: Probabilistic Methods in Electrical and Computer Engineering Spring 2019 Instructor: Prof. A. R. Reibman Homework 1 Spring 2019 (Due Tuesday January 22) Homework is due on Tuesday January 22 at
More informationCOS 341: Discrete Mathematics
COS 341: Discrete Mathematics Final Exam Fall 2006 Print your name General directions: This exam is due on Monday, January 22 at 4:30pm. Late exams will not be accepted. Exams must be submitted in hard
More informationCS 441 Discrete Mathematics for CS Lecture 19. Probabilities. CS 441 Discrete mathematics for CS. Probabilities
CS 441 Discrete Mathematics for CS Lecture 19 Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square Experiment: a procedure that yields one of the possible outcomes Sample space: a set of possible outcomes
More informationChapter Three: Translations & Word Problems
Chapter Three: Translations & Word Problems Index: A: Literal Equations B: Algebraic Translations C: Consecutive Word Problems D: Linear Word Problems Name: Date: Period: Algebra I Literal Equations 3A
More informationUnit 19 Formulating Hypotheses and Making Decisions
Unit 19 Formulating Hypotheses and Making Decisions Objectives: To formulate a null hypothesis and an alternative hypothesis, and to choose a significance level To identify the Type I error and the Type
More informationConditional Probability & Independence. Conditional Probabilities
Conditional Probability & Independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Definition: the conditional probability of E given F is P(E F
More informationProbability 1 (MATH 11300) lecture slides
Probability 1 (MATH 11300) lecture slides Márton Balázs School of Mathematics University of Bristol Autumn, 2015 December 16, 2015 To know... http://www.maths.bris.ac.uk/ mb13434/prob1/ m.balazs@bristol.ac.uk
More informationDiscrete Structures Prelim 1 Selected problems from past exams
Discrete Structures Prelim 1 CS2800 Selected problems from past exams 1. True or false (a) { } = (b) Every set is a subset of its power set (c) A set of n events are mutually independent if all pairs of
More informationSTA111 - Lecture 1 Welcome to STA111! 1 What is the difference between Probability and Statistics?
STA111 - Lecture 1 Welcome to STA111! Some basic information: Instructor: Víctor Peña (email: vp58@duke.edu) Course Website: http://stat.duke.edu/~vp58/sta111. 1 What is the difference between Probability
More informationUseful for Multiplication Rule: When two events, A and B, are independent, P(A and B) = P(A) P(B).
Probability Independence Last time: Two events are indpt if knowing that one did or did not happen tells you nothing about whether the other will or will not. It doesn't change the probability. Example:
More informationBig-oh stuff. You should know this definition by heart and be able to give it,
Big-oh stuff Definition. if asked. You should know this definition by heart and be able to give it, Let f and g both be functions from R + to R +. Then f is O(g) (pronounced big-oh ) if and only if there
More informationProblem 1 (10 points)
y x CHEN 1703 - HOMEWORK 4 Submit your MATLAB solutions via the course web site. Be sure to include your name and UNID in your m-file. Submit each solution seperately. Also be sure to document your solutions
More informationHypothesis tests
6.1 6.4 Hypothesis tests Prof. Tesler Math 186 February 26, 2014 Prof. Tesler 6.1 6.4 Hypothesis tests Math 186 / February 26, 2014 1 / 41 6.1 6.2 Intro to hypothesis tests and decision rules Hypothesis
More informationPROBABILITY: CONDITIONING, BAYES THEOREM [DEVORE 2.4]
PROBABILITY: CONDITIONING, BAYES THEOREM [DEVORE 2.4] CONDITIONAL PROBABILITY: Let events E, F be events in the sample space Ω of an experiment. Then: The conditional probability of F given E, P(F E),
More informationSec$on Summary. Assigning Probabilities Probabilities of Complements and Unions of Events Conditional Probability
Section 7.2 Sec$on Summary Assigning Probabilities Probabilities of Complements and Unions of Events Conditional Probability Independence Bernoulli Trials and the Binomial Distribution Random Variables
More informationDiscrete Probability
MAT 258 Discrete Mathematics Discrete Probability Kenneth H. Rosen and Kamala Krithivasan Discrete Mathematics 7E Global Edition Chapter 7 Reproduced without explicit consent Fall 2016 Week 11 Probability
More informationOutline Conditional Probability The Law of Total Probability and Bayes Theorem Independent Events. Week 4 Classical Probability, Part II
Week 4 Classical Probability, Part II Week 4 Objectives This week we continue covering topics from classical probability. The notion of conditional probability is presented first. Important results/tools
More informationIE 581 Introduction to Stochastic Simulation. One page of notes, front and back. Closed book. 50 minutes. Score
One page of notes, front and back. Closed book. 50 minutes. Score Schmeiser Page 1 of 4 Test #1, Spring 2001 1. True or false. (If you wish, write an explanation of your thinking.) (a) T Data are "binary"
More informationUniversity of California, Berkeley, Statistics 134: Concepts of Probability. Michael Lugo, Spring Exam 1
University of California, Berkeley, Statistics 134: Concepts of Probability Michael Lugo, Spring 2011 Exam 1 February 16, 2011, 11:10 am - 12:00 noon Name: Solutions Student ID: This exam consists of seven
More informationIntroducing Proof 1. hsn.uk.net. Contents
Contents 1 1 Introduction 1 What is proof? 1 Statements, Definitions and Euler Diagrams 1 Statements 1 Definitions Our first proof Euler diagrams 4 3 Logical Connectives 5 Negation 6 Conjunction 7 Disjunction
More informationLecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationMath , Fall 2012: HW 5 Solutions
Math 230.0, Fall 202: HW 5 Solutions Due Thursday, October 4th, 202. Problem (p.58 #2). Let X and Y be the numbers obtained in two draws at random from a box containing four tickets labeled, 2, 3, 4. Display
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More information14 - PROBABILITY Page 1 ( Answers at the end of all questions )
- PROBABILITY Page ( ) Three houses are available in a locality. Three persons apply for the houses. Each applies for one house without consulting others. The probability that all the three apply for the
More informationNotes 1 Autumn Sample space, events. S is the number of elements in the set S.)
MAS 108 Probability I Notes 1 Autumn 2005 Sample space, events The general setting is: We perform an experiment which can have a number of different outcomes. The sample space is the set of all possible
More informationREPEATED TRIALS. p(e 1 ) p(e 2 )... p(e k )
REPEATED TRIALS We first note a basic fact about probability and counting. Suppose E 1 and E 2 are independent events. For example, you could think of E 1 as the event of tossing two dice and getting a
More informationProbability, Entropy, and Inference / More About Inference
Probability, Entropy, and Inference / More About Inference Mário S. Alvim (msalvim@dcc.ufmg.br) Information Theory DCC-UFMG (2018/02) Mário S. Alvim (msalvim@dcc.ufmg.br) Probability, Entropy, and Inference
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationMath 31 Lesson Plan. Day 5: Intro to Groups. Elizabeth Gillaspy. September 28, 2011
Math 31 Lesson Plan Day 5: Intro to Groups Elizabeth Gillaspy September 28, 2011 Supplies needed: Sign in sheet Goals for students: Students will: Improve the clarity of their proof-writing. Gain confidence
More informationBias Variance Trade-off
Bias Variance Trade-off The mean squared error of an estimator MSE(ˆθ) = E([ˆθ θ] 2 ) Can be re-expressed MSE(ˆθ) = Var(ˆθ) + (B(ˆθ) 2 ) MSE = VAR + BIAS 2 Proof MSE(ˆθ) = E((ˆθ θ) 2 ) = E(([ˆθ E(ˆθ)]
More informationUsing Microsoft Excel
Using Microsoft Excel Objective: Students will gain familiarity with using Excel to record data, display data properly, use built-in formulae to do calculations, and plot and fit data with linear functions.
More informationQuantitative Methods for Decision Making
January 14, 2012 Lecture 3 Probability Theory Definition Mutually exclusive events: Two events A and B are mutually exclusive if A B = φ Definition Special Addition Rule: Let A and B be two mutually exclusive
More informationLecture 10: Bayes' Theorem, Expected Value and Variance Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 10: Bayes' Theorem, Expected Value and Variance Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationCS446: Machine Learning Spring Problem Set 4
CS446: Machine Learning Spring 2017 Problem Set 4 Handed Out: February 27 th, 2017 Due: March 11 th, 2017 Feel free to talk to other members of the class in doing the homework. I am more concerned that
More informationMath 243 Section 3.1 Introduction to Probability Lab
Math 243 Section 3.1 Introduction to Probability Lab Overview Why Study Probability? Outcomes, Events, Sample Space, Trials Probabilities and Complements (not) Theoretical vs. Empirical Probability The
More informationThe Celsius temperature scale is based on the freezing point and the boiling point of water. 12 degrees Celsius below zero would be written as
Prealgebra, Chapter 2 - Integers, Introductory Algebra 2.1 Integers In the real world, numbers are used to represent real things, such as the height of a building, the cost of a car, the temperature of
More informationHW2 Solutions, for MATH441, STAT461, STAT561, due September 9th
HW2 Solutions, for MATH44, STAT46, STAT56, due September 9th. You flip a coin until you get tails. Describe the sample space. How many points are in the sample space? The sample space consists of sequences
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More information*Final Exam* EECS 203 Spring 2016
*Final Exam* EECS 203 Spring 2016 Name (Print): uniqname (Print): Instructions. You have 120 minutes to complete this exam. You may have two page of notes (8.5x11.5 two-sided) but may not use any other
More informationSTAT 285 Fall Assignment 1 Solutions
STAT 285 Fall 2014 Assignment 1 Solutions 1. An environmental agency sets a standard of 200 ppb for the concentration of cadmium in a lake. The concentration of cadmium in one lake is measured 17 times.
More informationThe remains of the course
Math 10A November 30, 2017 This is the end This is the last week of classes. This is the last class. You may see Kate taking a few photos during this class. When we re through talking, we can line up on
More information1 INFO 2950, 2 4 Feb 10
First a few paragraphs of review from previous lectures: A finite probability space is a set S and a function p : S [0, 1] such that p(s) > 0 ( s S) and s S p(s) 1. We refer to S as the sample space, subsets
More informationLecture 1: Probability Fundamentals
Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability
More informationDecision making and problem solving Lecture 1. Review of basic probability Monte Carlo simulation
Decision making and problem solving Lecture 1 Review of basic probability Monte Carlo simulation Why probabilities? Most decisions involve uncertainties Probability theory provides a rigorous framework
More informationAnswers to All Exercises
CAPER 10 CAPER 10 CAPER10 CAPER REFRESING YOUR SKILLS FOR CAPER 10 1a. 5 1 0.5 10 1b. 6 3 0.6 10 5 1c. 0. 10 5 a. 10 36 5 1 0. 7 b. 7 is most likely; probability of 7 is 6 36 1 6 0.1 6. c. 1 1 0.5 36 3a.
More informationCOM S 330 Homework 05 Solutions. Type your answers to the following questions and submit a PDF file to Blackboard. One page per problem.
Type your answers to the following questions and submit a PDF file to Blackboard. One page per problem. Problem 1. [5pts] Consider our definitions of Z, Q, R, and C. Recall that A B means A is a subset
More information4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space
I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood
More informationIntroduction to Probability. Ariel Yadin. Lecture 1. We begin with an example [this is known as Bertrand s paradox]. *** Nov.
Introduction to Probability Ariel Yadin Lecture 1 1. Example: Bertrand s Paradox We begin with an example [this is known as Bertrand s paradox]. *** Nov. 1 *** Question 1.1. Consider a circle of radius
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More informationDiscrete Probability
Discrete Probability Counting Permutations Combinations r- Combinations r- Combinations with repetition Allowed Pascal s Formula Binomial Theorem Conditional Probability Baye s Formula Independent Events
More informationA Event has occurred
Statistics and probability: 1-1 1. Probability Event: a possible outcome or set of possible outcomes of an experiment or observation. Typically denoted by a capital letter: A, B etc. E.g. The result of
More informationECO220Y Review and Introduction to Hypothesis Testing Readings: Chapter 12
ECO220Y Review and Introduction to Hypothesis Testing Readings: Chapter 12 Winter 2012 Lecture 13 (Winter 2011) Estimation Lecture 13 1 / 33 Review of Main Concepts Sampling Distribution of Sample Mean
More informationChapter 8 Sequences, Series, and Probability
Chapter 8 Sequences, Series, and Probability Overview 8.1 Sequences and Series 8.2 Arithmetic Sequences and Partial Sums 8.3 Geometric Sequences and Partial Sums 8.5 The Binomial Theorem 8.6 Counting Principles
More informationAlgebra Quarter 4 Review
Algebra Quarter 4 Review Chapters Covered (In Order) Chapter 11 Part 1 (probability and stats) Chapter 11 Part 2 (probability and stats) Chapter 10 (conics) Chapter 14-1, 13-2, 14-2, 14-4 (Trig functions)
More informationProperties of Arithmetic
Excerpt from "Prealgebra" 205 AoPS Inc. 4 6 7 4 5 8 22 23 5 7 0 Arithmetic is being able to count up to twenty without taking o your shoes. Mickey Mouse CHAPTER Properties of Arithmetic. Why Start with
More informationAnnouncements. Unit 3: Foundations for inference Lecture 3: Decision errors, significance levels, sample size, and power.
Announcements Announcements Unit 3: Foundations for inference Lecture 3:, significance levels, sample size, and power Statistics 101 Mine Çetinkaya-Rundel October 1, 2013 Project proposal due 5pm on Friday,
More informationIndependence 1 2 P(H) = 1 4. On the other hand = P(F ) =
Independence Previously we considered the following experiment: A card is drawn at random from a standard deck of cards. Let H be the event that a heart is drawn, let R be the event that a red card is
More informationM378K In-Class Assignment #1
The following problems are a review of M6K. M7K In-Class Assignment # Problem.. Complete the definition of mutual exclusivity of events below: Events A, B Ω are said to be mutually exclusive if A B =.
More informationCHAPTER 3 PROBABILITY: EVENTS AND PROBABILITIES
CHAPTER 3 PROBABILITY: EVENTS AND PROBABILITIES PROBABILITY: A probability is a number between 0 and 1, inclusive, that states the long-run relative frequency, likelihood, or chance that an outcome will
More information1. Sample spaces, events and conditional probabilities. A sample space is a finite or countable set S together with a function. P (x) = 1.
DEPARTMENT OF MATHEMATICS UNIVERSITY OF CALIFORNIA, BERKELEY Probability theory H.W. Lenstra, Jr. These notes contain material on probability for Math 55, Discrete mathematics. They were written to supplement
More informationChapter Three. Hypothesis Testing
3.1 Introduction The final phase of analyzing data is to make a decision concerning a set of choices or options. Should I invest in stocks or bonds? Should a new product be marketed? Are my products being
More informationChapter 2.5 Random Variables and Probability The Modern View (cont.)
Chapter 2.5 Random Variables and Probability The Modern View (cont.) I. Statistical Independence A crucially important idea in probability and statistics is the concept of statistical independence. Suppose
More informationIntroduction to Probability Theory
Introduction to Probability Theory 1 1.1. Introduction Any realistic model of a real-world phenomenon must take into account the possibility of randomness. That is, more often than not, the quantities
More information*Final Exam* EECS 203 Spring 2016
*Final Exam* EECS 203 Spring 2016 Name (Print): uniqname (Print): Instructions. You have 120 minutes to complete this exam. You may have two pages of notes (8.5x11.5 two-sided) but may not use any other
More informationMath 564 Homework 1. Solutions.
Math 564 Homework 1. Solutions. Problem 1. Prove Proposition 0.2.2. A guide to this problem: start with the open set S = (a, b), for example. First assume that a >, and show that the number a has the properties
More informationDiscrete Random Variables (1) Solutions
STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 06 Néhémy Lim Discrete Random Variables ( Solutions Problem. The probability mass function p X of some discrete real-valued random variable X is given
More informationProblems and results for the ninth week Mathematics A3 for Civil Engineering students
Problems and results for the ninth week Mathematics A3 for Civil Engineering students. Production line I of a factor works 0% of time, while production line II works 70% of time, independentl of each other.
More informationCIVL Why are we studying probability and statistics? Learning Objectives. Basic Laws and Axioms of Probability
CIVL 3103 Basic Laws and Axioms of Probability Why are we studying probability and statistics? How can we quantify risks of decisions based on samples from a population? How should samples be selected
More information3.4 Pascal s Pride. A Solidify Understanding Task
3.4 Pascal s Pride A Solidify Understanding Task Multiplying polynomials can require a bit of skill in the algebra department, but since polynomials are structured like numbers, multiplication works very
More information20 Hypothesis Testing, Part I
20 Hypothesis Testing, Part I Bob has told Alice that the average hourly rate for a lawyer in Virginia is $200 with a standard deviation of $50, but Alice wants to test this claim. If Bob is right, she
More informationApplied Bayesian Statistics
Applied Bayesian Statistics David Spiegelhalter Statistical Laboratory, Cambridge with thanks to: Nicky Best Dave Lunn Andrew Thomas Course: Lent Term 2010 Course Summary (provisional) Jan 18 Lect 1: Probability
More informationHomework 2. P(A 1 A 2 B) = P((A 1 A 2 ) B) P(B) From the distributive property of unions and intersections we have
Homework 2 Readings: Sections 2.1, 2.2, 2.4, 2.5 A note: in Section 2.2, we have not talked yet about arbitrary sample spaces and the axioms of probability, instead we have focused on the case of a finite
More informationIntroduction and basic definitions
Chapter 1 Introduction and basic definitions 1.1 Sample space, events, elementary probability Exercise 1.1 Prove that P( ) = 0. Solution of Exercise 1.1 : Events S (where S is the sample space) and are
More information1 Boolean Algebra Simplification
cs281: Computer Organization Lab3 Prelab Our objective in this prelab is to lay the groundwork for simplifying boolean expressions in order to minimize the complexity of the resultant digital logic circuit.
More informationProbability Year 9. Terminology
Probability Year 9 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More information