Probability and Statistics for Decision Making. Fall, 2017
|
|
- Arleen Simmons
- 5 years ago
- Views:
Transcription
1 Probability and Statistics for Decision Making Fall, 07
2 Course Outline Main Tetbook Probability & Statistics for Engineers & Scientists, Ronald E. Walpole Raymond H. Myers, and Sharon L. Myers, 9 th Edition Other Tetbooks Applied Statistics and Probability for Engineers, 6 th Edition, Douglas C. Montgomery, and George C. Runger Probability & Statistics With R for Engineers and Scientists, Akritas, Michael. The slides are based on these tetbooks and will be available at: Topic Week Overview on Probability & Introduction to Statistics Ch-4 Week Sampling Distributions & Estimation Ch9 Week 3 Hypothesis Testing with or -group samples Ch0 Week 4 Analysis of Variance Ch3 Week 5 Simple Linear Regression and Correlation Ch Week 6 Mulitple Linear Regression Ch
3 Tools The R tool The RStudio (an IDE for R) R Tutorial
4 Grading Policy Item Posted Due % Points Assigned Assignment Week 3 Week 4 30 Assignment Week 4 Week 5 30 Final Eam Week 7 40
5 Week Introduction to Statistics & Overview on Probability
6 Objectives By the end of this lesson, you should be able to: Identify the basic engineering process and the role of statistics. Recall the basic concepts of probability and statistics terminology. Recall the basic concepts of descriptive statistics. Recall some basic discrete and continuous random distributions. Identify some engineering applications to random distributions. Learn the basics of R using R-Studio IDE.
7 The Engineering Process An engineer is someone who solves problems of interest to society with the efficient application of scientific principles by: Refining eisting products Designing new products or processes The engineering method [Source: Applied Statistics and Probability for Engineers, Wiley]
8 Statistics: Basic Ideas Statistics is the area of science that deals with collection, organization, analysis, and interpretation of data. It also deals with methods and techniques that can be used to draw conclusions about the characteristics of a large number of data points-commonly called a population- by using a smaller subset of the entire data.
9 Statistics in Engineering Engineers perform tests to learn how things behave under different scenarios, and at what point they might fail. As engineers perform eperiments, they collect data that can be used to eplain relationships better and to reveal information about the quality of products and services they provide.
10 Probability: A review on basic concepts The Sample Space: (Optional) Definition The set of all possible outcomes of a statistical eperiment is called the sample space and is denoted by S. Each outcome (element or member) of the sample space S is called a sample point.
11 Eample Camera Specifications Suppose that the recycle times of two cameras are recorded. The etension of the positive real line R is to take the sample space to be the positive quadrant of the plane S R+ R+ If the objective of the analysis is to consider only whether or not the cameras conform to the manufacturing specifications, either camera may or may not conform. We abbreviate yes and no as y and n. If the ordered pair yn indicates that the first camera conforms and the second does no: the sample space can be represented by the four outcomes: S {yy, yn, ny, nn} If we are interested only in the number of conforming cameras in the sample, we might summarize the sample space as S {0,, } As another eample, consider an eperiment in which cameras are tested until the flash recycle time fails to meet the specifications. The sample space can be represented as S {n, yn, yyn, yyyn, yyyyn, and so forth} and this is an eample of a discrete sample space that is countably infinite.
12 Sample spaces can also be described graphically with tree diagrams. When a sample space can be constructed in several steps or stages, we can represent each of the nways of completing the first step as a branch of a tree. Each of the ways of completing the second step can be represented as n branches starting from the ends of the original branches, and so forth.
13 Eample Message Delays Each message in a digital communication system is classified as to whether it is received within the time specified by the system design. If three messages are classified, use a tree diagram to represent the sample space of possible outcomes. Each message can be received either on time or late. The possible results for three messages can be displayed by eight branches in the tree diagram shown in Fig. -5. Practical Interpretation: A tree diagram can effectively represent a sample space. Even if a tree becomes too large to construct, it can still conceptually clarify the sample space.
14 Measures of Location (Central Tendency) The data (observations) often tend to be concentrated around the center of the data. Some measures of location are: the mean, mode, and median. These measures are considered as representatives (or typical values) of the data. They are designed to give some quantitative measures of where the center of the data is in the sample. The Sample mean of the observations ( ): If,,, are the sample values, then the sample mean is n + + n + n i n n i (unit)
15 Eample: Suppose that the following sample represents the ages (in year) of a sample of 3 men: 3 Then, the sample mean is: n 30, 35, 7. (n3) Note: ( ) 0 i i
16 Measures of Variability (Dispersion or Variation) The variation or dispersion in a set of data refers to how spread out the observations are from each other. The variation is small when the observations are close together. There is no variation if the observations are the same. Some measures of dispersion are range, variance, and standard deviation These measures are designed to give some quantitative measures of the variability in the data.
17 The Sample Variance (S ): Let,,, n be the observations of the sample. The sample variance is denoted by S and is defined by: S n ( n ) ) ( ) + ( ) + + ( i i n n (unit) where n i i / n is the sample mean.
18 The Standard Deviation (S): The standard deviation is another measure of variation. It is the square root of the variance, i.e., it is: S ( i S n i n ) (unit) The standard deviation can also provide information about the relative spread of a data set.
19 Eample: Compute the sample variance and standard deviation of the following observations (ages in year): 0,, 33, 53, 54. Solution: n5 S n 5 i i i i n 5 n 5 ( i ) i i n ( i ) (year) (year) 4
20 The sample standard deviation is: S S (year) * Another Formula for Calculating S : S n i n i n For the previous Eample, i (It is simple and more accurate) i 7 i i 7355 S n i n n i (year) 5 4
21 Events: Definition: An event A is a subset of the sample space S. That is AS. We say that an event A occurs if the outcome (the result) of the eperiment is an element of A. S is an event ( is called the impossible event) SS is an event (S is called the sure event) Eample: Eperiment: Selecting a ball from a bo containing 6 balls numbered,,3,4,5 and 6. (or tossing a die)
22 This eperiment has 6 possible outcomes The sample space is S{,,3,4,5,6}. Consider the following events: E getting an even number {,4,6}S E getting a number less than 4{,,3}S E 3 getting or 3{,3}S E 4 getting an odd number{,3,5}s E 5 getting a negative number{ } S E 6 getting a number less than 0 {,,3,4,5,6}SS Notation: n(s) no. of outcomes (elements) in S. n(e) no. of outcomes (elements) in the event E. Eample: Eperiment: Selecting 3 items from manufacturing process; each item is inspected and classified as defective (D) or non-defective (N).
23 This eperiment has 8 possible outcomes S{DDD,DDN,DND,DNN,NDD,NDN,NND,NNN} Consider the following events: A{at least defectives} {DDD,DDN,DND,NDD}S B{at most one defective}{dnn,ndn,nnd,nnn}s C{3 defectives}{ddd}s
24 Some Operations on Events: Let A and B be two events defined on the sample space S. Definition.3: Complement of The Event A: A c or A' A c { S: A } A c consists of all points of S that are not in A. A c occurs if A does not. S Definition.4: Intersection: AB AB{ S: A and B} AB Consists of all points in both A and B. AB Occurs if both A and B occur together. S
25 Definition: Mutually Eclusive (Disjoint) Events: Two events A and B are mutually eclusive (or disjoint) if and only if AB; that is, A and B have no common elements (they do not occur together). AB A and B are not mutually eclusive AB A and B are mutually eclusive (disjoint)
26 Definition: Union: AB { S: A or B } AB Consists of all outcomes in A or in B or in both A and B. AB Occurs if A occurs, or B occurs, or both A and B occur. That is AB Occurs if at least one of A and B occurs. S
27 Counting Sample Points There are many counting techniques which can be used to count the number points in the sample space (or in some events) without listing each element. In many cases, we can compute the probability of an event by using the counting techniques.
28 Multiplication rule Assume an operation can be described as a sequence of k steps, and the number of ways of completing step is n, and the number of ways of completing step is n for each way of completing step and so on, then: The total number of ways of completing the operation is n n nk
29 Eample Web Site Design The design for a Website is to consist of four colors, three fonts, and three positions for an image. From the multiplication rule, different designs are possible. Practical Interpretation: The use of the multiplication rule and other counting techniques enables one to easily determine the number of outcomes in a sample space or event and this, in turn, allows probabilities of events to be determined.
30 Permutations Another useful calculation is to find the number of ordered sequences of the elements of a set. Consider a set of elements, such as S {a,b,c}. A permutation of the elements is an ordered sequence of the elements. For eample, abc, acb, bac, bca, cab, and cba are all of the permutations of the elements of S. The number of permutations of n different elements is n! where n! n (n ) (n ) The number of permutations of subsets of r elements selected from a set of n different elements is P n n! r n n n.. n r + n r!
31 Eample Printed Circuit Board A printed circuit board has eight different locations in which a component can be placed. If four different components are to be placed on the board, how many different designs are possible? Each design consists of selecting a location from the eight locations for the first component, a location from the remaining seven for the second component, a location from the remaining si for the third component, and a location from the remaining five for the fourth component. P 8 4 8! 680 different designs 4!
32 Combinations In many problems, we are interested in the number of ways of selecting r objects from n objects without regard to order. These selections are called combinations. Notation: n factorial is denoted by n! and is defined by: n! n n n for n,, 0! Theorem : The number of combinations of n distinct objects taken r at a time is denoted by and is given by: n r n r r! n! n r ;! r 0,,,, n
33 Notes: n r is read as n choose r. n n,,, n r n 0 n n n n r n r The number of different ways of selecting r objects from n distinct objects (order doesn t matter).
34 Eample: If we have 0 equal priority operations and only 4 operating rooms are available, in how many ways can we choose the 4 patients to be operated on first? Solution: 0 4 4! 0! 0! 0 4! 4! 6! ( different ways)
35 Probability of an Event: To every point (outcome) in the sample space of an eperiment S, we assign a weight (or probability), ranging from 0 to, such that the sum of all weights (probabilities) equals. The weight (or probability) of an outcome measures its likelihood (chance) of occurrence. To find the probability of an event A, we sum all probabilities of the sample points in A. This sum is called the probability of the event A and is denoted by P(A). Definition The probability of an event A is the sum of the weights (probabilities) of all sample points in A. Therefore, ) ) 3) PA S 0 0 P P
36 Eample: A balanced coin is tossed twice. What is the probability that at least one head occurs? Solution: S {HH, HT, TH, TT} A {at least one head occurs} {HH, HT, TH} Since the coin is balanced, the outcomes are equally likely; i.e., all outcomes have the same weight or probability. The probability that at least one head occurs is: P(A) P({at least one head occurs})p({hh, HT, TH}) P(HH) + P(HT) + P(TH) Outcom e HH HT TH TT Weight (Probabilit y) P(HH) w P(HT) w P(TH) w P(TT) w sum 4w 4w w /4 0.5 P(HH)P(HT)P(TH)P(TT)0. 5
37 Theorem If an eperiment has n(s)n equally likely different outcomes, then the probability of the event A is: n( A) n( A) P( A) n( S) N no. no. of of outcomes outcomes in in A S
38 Eample: A miture of candies consists of 6 mints, 4 toffees, and 3 chocolates. If a person makes a random selection of one of these candies, find the probability of getting: (a) a mint (b) a toffee or chocolate. Solution: Define the following events: M {getting a mint} T {getting a toffee} C {getting a chocolate} Eperiment: selecting a candy at random from 3 candies n(s) no. of outcomes of the eperiment of selecting a candy. no. of different ways of selecting a candy from 3 candies. 3 3
39 The outcomes of the eperiment are equally likely because the selection is made at random. (a) M {getting a mint} n(m) no. of different ways of selecting a mint candy from 6 mint candies 6 6 nm 6 P(M ) P({getting a mint}) n S 3 (b) TC {getting a toffee or chocolate} n(tc) no. of different ways of selecting a toffee or a chocolate candy no. of different ways of selecting a toffee candy + no. of different ways of selecting a chocolate candy
40 no. of different ways of selecting a candy from 7 candies 7 7 n T C n S 7 P(TC ) P({getting a toffee or chocolate}) 3 Eample: In a poker hand consisting of 5 cards, find the probability of holding aces and 3 jacks. Solution: Eperiment: selecting 5 cards from 5 cards. n(s) no. of outcomes of the eperiment of selecting 5 cards from 5 cards ! 5! 47!
41 The outcomes of the eperiment are equally likely because the selection is made at random. Define the event A {holding aces and 3 jacks} n(a) no. of ways of selecting aces and 3 jacks (no. of ways of selecting aces) (no. of ways of selecting 3 jacks) (no. of ways of selecting aces from 4 aces) (no. of ways of selecting 3 jacks from 4 jacks) ! 4! 6 4 4!! 3!! P(A ) P({holding aces and 3 jacks }) n n A S
42 Additive Rules: Theorem: If A and B are any two events, then: P(AB) P(A) + P(B) P(AB) Corollary : If A and B are mutually eclusive (disjoint) events, then: P(AB) P(A) + P(B) Corollary : If A, A,, A n are n mutually eclusive (disjoint) events, then: P(A A A n ) P(A ) + P(A ) + + P(A n ) n P A i i n P( A ) i i
43 Eample: The probability that Paula passes Mathematics is /3, and the probability that she passes English is 4/9. If the probability that she passes both courses is /4, what is the probability that she will: (a) pass at least one course? (b) pass Mathematics and fail English? (c) fail both courses? Solution: Define the events: M{Paula passes Mathematics} E{Paula passes English} We know that P(M)/3, P(E)4/9, and P(ME)/4. (a) Probability of passing at least one course is: P(ME) P(M) + P(E) P(ME)
44 (b) Probability of passing Mathematics and failing English is: P(ME C ) P(M) P(ME) (c) Probability of failing both courses is: P(M C E C ) P(ME) Theorem If A and A C are complementary events, then: P(A) + P(A C ) P(A C ) P(A) Conditional Probability: The probability of occurring an event A when it is known that some event B has occurred is called the conditional probability of A given B and is denoted P(A B).
45 Definition The conditional probability of the event A given the event B is defined by:.. 3. P P P P A B B P A B A B ; P B P B A n PA B PB A B/ ns nb/ ns PA B PA A B PA PB A PB PA B n A B n B ; 0 P(S)Total area for equally likely outcomes case (Multiplicative RuleTheorem.3)
46 Multiplicative Rule: Theorem: If P(A) 0 and P(B) 0, then: P(AB) P(A) P(B A) P(B) P(A B) Eample: Suppose we have a fuse bo containing 0 fuses of which 5 are defective (D) and 5 are non-defective (N). If fuses are selected at random and removed from the bo in succession without replacing the first, what is the probability that both fuses are defective? Solution: Define the following events: A {the first fuse is defective} B {the second fuse is defective} AB{the first fuse is defective and the second fuse is defective} {both fuses are defective}
47 We need to calculate P(AB). P(A) 5 0 P(B A) 4 9 P(AB) P(A) P(B A) First Selection Second Selection: given that the first is defective (D)
48 Theorem: Two events A and B are independent if and only if P(AB) P(A) P(B) *(Multiplicative Rule for independent events) Note: Two events A and B are independent if one of the following conditions is satisfied: (i) P(A B)P(A) (ii) P(B A)P(B) (iii) P(AB) P(A) P(B) Theorem: If A, A, A 3 are 3 events, then: P(A A A 3 ) P(A ) P(A A ) P(A 3 A A ) If A, A, A 3 are 3 independent events, then: P(A A A 3 ) P(A ) P(A ) P(A 3 )
49 Bayes' Rule: Definition: The events A, A,, and A n constitute a partition of the sample space S if: n i A i A A... A n S A i A j, i j Theorem (Total Probability) If the events A, A,, and A n constitute a partition of the sample space S such that P(A k )0 for k,,, n, then for any event B: P(B) n k n k P(A ) P(B k k ) P(A k B) A
50 Eample Three machines A, A, and A 3 make 0%, 30%, and 50%, respectively, of the products. It is known that %, 4%, and 7% of the products made by each machine, respectively, are defective. If a finished product is randomly selected, what is the probability that it is defective?
51 Solution: Define the following events: B {the selected product is defective} A {the selected product is made by machine A } A {the selected product is made by machine A } A 3 {the selected product is made by machine A 3 } 0 P(A) 0.; P(B A) P(A) 0.3; P(B A) P(A3) 0.5; P(B A3) P(B) 3 k P(A ) P(B A k k ) P(A ) P(B A ) + P(A ) P(B A ) + P(A 3 ) P(B A 3 )
52 Eample: If it is known that the selected product is defective, what is the probability that it is made by machine A? Answer: P(A B) P(A B) P(B) This rule is called Bayes' rule.
53 Theorem : (Bayes' rule) If the events A,A,, and A n constitute a partition of the sample space S such that P(A k )0 for k,,, n, then for any event B such that P(B)0: P(A B) for i,,, n. P(AiB) P(B) P(A ) P(B A ) i i i n k P(A k )P(B A k ) P(A i) P(B P(B) A ) i
54 Eample: In previous eample, if it is known that the selected product is defective, what is the probability that it is made by: (a) machine A? (b) machine A 3? Solution: P(A ) P(B A P(A ) ) P(B A ) P(A )P(B A P(B) ( a)p(a B) n k k k P(A 3) P(B A3) P(A 3) P(B A3) ( b)p(a3 B) n P(B) P(A ) P(B A ) k k k )
55 Note: P(A B) , P(A B) 0.449, P(A 3 B) k P(A B) k
56 Concept of a Random Variable: In a statistical eperiment, it is often very important to allocate numerical values to the outcomes. Eample: Eperiment: testing two components. (Ddefective, Nnon-defective) Sample space: S{DD,DN,ND,NN} Let X number of defective components when two components are tested. Assigned numerical values to the outcomes are:
57 Sample point (Outcome) Assigned Numerical Value () DD DN ND NN 0 Notice that, the set of all possible values of the random variable X is {0,, }. Definition A random variable X is a function that associates each element in the sample space with a real number (i.e., X : S R.) Notation: " X " denotes the random variable. " " denotes a value of the random variable X.
58 Types of Random Variables: A random variable X is called a discrete random variable if its set of possible values is countable, i.e., {,,, n } or {,, } A random variable X is called a continuous random variable if it can take values on a continuous scale, i.e., {: a < < b; a, b R} In most practical problems: o A discrete random variable represents count data, such as the number of defectives in a sample of k items. o A continuous random variable represents measured data, such as height.
59 Discrete Probability Distributions A discrete random variable X assumes each of its values with a certain probability. Eample: Eperiment: tossing a non-balanced coin times independently. H head, Ttail Sample space: S{HH, HT, TH, TT} Suppose P(H)½P(T) P(H)/3 and P(T)/3 Let X number of heads Sample point Probability Value of X (Outcome) HH P(HH)P(H) P(H)/3/3 /9 HT P(HT)P(H) P(T)/3/3 /9 TH P(TH)P(T) P(H)/3/3 /9 TT P(TT)P(T) P(T)/3/3 4/9 0 ()
60 The possible values of X are: 0,, and. X is a discrete random variable. Define the following events: Event (X) Probability P(X) (X0){TT} P(X0) P(TT)4/9 (X){HT,TH} P(X) P(HT)+P(TH)/9+/94/9 (X){HH} P(X) P(HH) /9 The possible values of X with their probabilities are: X 0 Total P(X)f() 4/9 4/9 /9.00 The function f()p(x) is called the probability function (probability distribution or density) of the discrete random variable X or simply the pdf of X.
61 Definition : The function f() is a probability function of a discrete random variable X if, for each possible values, we have: ) f() 0 ) f ( ) all 3) f() P(X) Note: P(XA ) all A f () Eample: For the previous eample, we have: all A P(X ) X f() P(X) 0 4/9 4/9 /9 Total f ( ) 0
62 P(X<) P(X0)4/9 P(X) P(X0) + P(X) 4/9+4/9 8/9 P(X0.5) P(X) + P(X) 4/9+/9 5/9 P(X>8) P() 0 P(X<0) P(X0) + P(X) + P(X) P(S) Eample A shipment of 8 similar microcomputers to a retail outlet contains 3 that are defective and 5 are non-defective. If a school makes a random purchase of of these computers, find the probability distribution of the number of defectives. Solution: We need to find the probability distribution of the random variable: X the number of defective computers purchased. Eperiment: selecting computers at random out of 8 n(s) 8 equally likely outcomes
63 The possible values of X are: 0,,. Consider the events: 3 5 (X 0) {0D and N} n(x 0) (X ) {D and N} n(x ) (X ) {D and 0N} n(x 3 5 ) n(x 0) 0 f (0) P(X 0) n(s) 8 0 8
64 n(s) ) n(x ) P(X () f n(s) ) n(x ) P(X () f n(s) ) n(x ) P(X f ()
65 The probability distribution of X is: 0 Total f() P(X) f 3 5 ; 0,, ( ) P( X ) 8 Hypergeometric Distribution 0; otherwise Definition: The cumulative distribution function (CDF), F(), of a discrete random variable X with the probability function f() is given by: F() P(X ) f (t) P(X t); for << t t
66 Eample: Find the CDF of the random variable X with the probability function: X 0 F() 0 8 Solution: F()P(X) for << For <0: F() For 0<: F()P(X0) 8 For <: F()P(X0)+P(X) For : F()P(X0)+P(X)+P(X)
67 The CDF of the random variable X is: F( ) P( X Note: F(0.5) P(X0.5)0 F(.5)P(X.5)F() F(3.8) P(X3.8)F() 0 ; 0 0 ; 0 8 ) 5 ; 8 ; 5 8 Result: P(a < X b) P(X b) P(X a) F(b) F(a) P(a X b) P(a < X b) + P(Xa) F(b) F(a) + f(a) P(a < X < b) P(a < X b) P(Xb) F(b) F(a) f(b)
68 Continuous Probability Distributions For any continuous random variable, X, there eists a non-negative function f(), called the probability density function (p.d.f) through which we can find probabilities of events epressed in term of X. f: R [0, ) P(a < X < b) area under the curve of f() and over the interval (a,b) P(XA) b f() d a f() d A area under the curve of f() and over the region A
69 Definition : The function f() is a probability density function (pdf) for a continuous random variable X, defined on the set of real numbers, if:. f() 0 R. f() d - 3. P(a X b) f() d a, b R; ab b a Note: For a continuous random variable X, we have:. f() P(X) (in general). P(Xa) 0 for any ar 3. P(a X b) P(a < X b) P(a X < b) P(a < X < b) 4. P(XA) f() d A
70 Eample Suppose that the error in the reaction temperature, in o C, for a controlled laboratory eperiment is a continuous random variable X having the following probability density function: ; f ( ) 3 0 ; elsewhere. Verify that (a) f() 0 and (b). Find P(0<X) Solution: X the error in the reaction temperature in o C. X is continuous r. v. f() d - f ( ) ; 3 0 ; elsewhere
71 . (a) f() 0 because f() is a quadratic function. (b) - f()d - 0d d d (8 ( )) 9. P(0<X) f() d ( (0)) 3 + d 0d
72 Definition The cumulative distribution function (CDF), F(), of a continuous random variable X with probability density function f() is given by: F() P(X) - f(t)dt; for << Result: P(a < X b) P(X b) P(X a) F(b) F(a)
73 In previous eample, find the CDF, then find P(0<X). Solution: ; f ( ) 3 0 ; elsewhere For < : F() f(t) dt 0dt For <: F() f(t) dt - t dt 3-9 t 0dt - t t + - ( 9 3 t dt ( )) ( 9 + )
74 For : F() 0dt dt t 3 0dt f(t)dt dt t 3 - Therefore, the CDF is: + ; ; ) ( 9 ; 0 ) ( ) ( 3 X P F. Using the CDF, P(0<X) F() F(0) 9 9 9
75 Mathematical Epectation Mean of a Random Variable: Definition: Let X be a random variable with a probability distribution f(). The mean (or epected value) of X is denoted by X (or E(X)) and is defined by: E(X) all μx f ( ) ; f ( ) d ; if if X is discrete X is continuous Eample: A shipment of 8 similar microcomputers to a retail outlet contains 3 that are defective and 5 are non-defective. If a school makes a random purchase of of these computers, find the epected number of defective computers purchased
76 Solution: Let X the number of defective computers purchased. Previously, we found that the probability distribution of X is: 0 F()p(X) or: f ( ) P( X ) 3 5 ; 8 0; otherwise 0,,
77 The epected value of the number of defective computers purchased is the mean (or the epected value) of X, which is: E(X) μ X 0 (0) f(0) + () f() +() f() f ( ) ( 0) + () + () (computers) Eample Let X be a continuous random variable that represents the life (in hours) of a certain electronic device. The pdf of X is given by: f ) 0,000 ; 00 0 ; elsewhere ( 3 Find the epected life of this type of devices.
78 Solution: E(X) μ X f ( ) d d d (hours) 00 Therefore, we epect that this type of electronic devices to last, on average, 00 hours.
79 Theorem Let X be a random variable with a probability distribution f(), and let g(x) be a function of the random variable X. The mean (or epected value) of the random variable g(x) is denoted by g(x) (or E[g(X)]) and is defined by: E[g(X)] all μg(x) g( ) f g( ) f ( ) ; ( ) d ; if if X X is is discrete continuous Eample: Let X be a discrete random variable with the following probability distribution 0 F() Find E[g(X)], where g(x)(x )
80 Solution: g(x)(x ) E[g(X)] μ g(x) g( ) 0 f ( ) ( 0 ) (0) f(0) + () f() +() f() 0 8 () + (0) 5 +() f ( ) 3 8
81 Eample: In Eample 4.3, find. E X Solution: 0,000 ; 00 f ( ) 3 0 ; elsewhere g(x) X E X E[g(X)] μ 00 g(x) g ( ) f ( ) d f ( ) d 0000 d d
82 Variance (of a Random Variable) The most important measure of variability of a random variable X is called the variance of X and is denoted by Var(X) or. σ X Definition Let X be a random variable with a probability distribution f() and mean. The variance of X is defined by: ( ) f ( ) ; if all Var(X) σ X E[(X μ) ] ( ) f ( ) d ; if X X is is discrete continuous Definition: The positive square root of the variance of X, σ X σ X,is called the standard deviation of X. Note: Var(X)E[g(X)], where g(x)(x )
83 Theorem The variance of the random variable X is given by: where Var(X) σ E(X ) all E(X ) μ X f ( ) ; f ( ) d ; if if X X is is discrete continuous Eample Let X be a discrete random variable with the following probability distribution 0 3 F() Find Var(X) σ X
84 Solution: 3 μ 0 f ( ) (0) f(0) + () f() +() f() + (3) f(3) (0) (0.5) + () (0.38) +() (0.0) + (3) (0.0) 0.6. First method: Var(X) σ ( ) f ( ) X ( 0.6) f () (00.6) f(0)+(0.6) f()+(0.6) f()+ (30.6) f(3) (0.6) (0.5)+(0.39) (0.38)+(.39) (0.0)+ (.39) (0.0) Second method: μ Var(X) σ E(X ) X E(X ) 3 0 f() (0 ) f(0) + ( ) f() +( ) f() + (3 ) f(3) (0) (0.5) + () (0.38) +(4) (0.0) + (9) (0.0) 0.87 E(X ) μ X Var(X) σ 0.87 (0.6)
85 Eample Let X be a continuous random variable with the following pdf: f ( ) ( ) ; 0 ; elsewhere Find the mean and the variance of X. Solution: μ E(X) E(X f ( ) d ) f ( ) d [ ( )] d ( ) d [( )] d ( ) d Var(X) σ E(X ) μ 7/6 (5/3) /8 X 5/3 7/6
86 Means and Variances of Linear Combinations of Random Variables: If X, X,, X n are n random variables and a, a,, a n are constants, then the random variable : n Y a X a X + a X + + i i n n i is called a linear combination of the random variables X,X,,X n. a X Theorem If X is a random variable with mean E(X), and if a and b are constants, then: E(aXb) a E(X) b axb a X ± b Corollary : E(b) b Corollary : E(aX) a E(X)
87 Eample Let X be a random variable with the following probability density function: f ( ) ; 3 0 ; elsewhere Find E(4X+3). Solution: μ E(X) f ( ) d 3 [ ] d 3 d /4 E(4X+3) 4 E(X)+3 4(5/4) + 38 Another solution: E[g(X)] ; g(x) 4X+3 g ( ) f ( ) d E(4X+3) 4 + 3) f ( ) d ( (4 + 3) [ ] d 8 3
88 Theorem: If X, X,, X n are n random variables and a, a,, a n are constants, then: E(a X +a X + +a n X n ) a E(X )+ a E(X )+ +a n E(X n ) n E( a i Corollary: If X, and Y are random variables, then: E(X ± Y) E(X) ± E(Y) i X i ) n a i i E( X i ) Theorem If X is a random variable with variance Var( X ) X constants, then: and if a and b are Var(aXb) a Var(X) ax + b a X
89 Theorem: If X, X,, X n are n independent random variables and a, a,, a n are constants, then: Var(a X +a X + +a n X n ) Var(X )+ Var (X )+ + Var(X n ) a a a n n Var( a X ) i i i ax + a X ++ a nxn n a i i Var( X X i ) X a + a + + a n Xn Corollary: If X, and Y are independent random variables, then: Var(aX+bY) a Var(X) + b Var (Y) Var(aXbY) a Var(X) + b Var (Y) Var(X ± Y) Var(X) + Var (Y)
90 Eample: Let X, and Y be two independent random variables such that E(X), Var(X)4, E(Y)7, and Var(Y). Find:. E(3X+7) and Var(3X+7). E(5X+Y) and Var(5X+Y). Solution:. E(3X+7) 3E(X)+7 3()+7 3 Var(3X+7) (3) Var(X)(3) (4) 36. E(5X+Y) 5E(X) + E(Y) (5)() + ()(7) Var(5X+Y) Var(5X+Y) 5 Var(X) + Var(Y) (5)(4)+(4)() 04
Chapter 2: Probability Part 1
Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.
More informationCIVL 7012/8012. Basic Laws and Axioms of Probability
CIVL 7012/8012 Basic Laws and Axioms of Probability Why are we studying probability and statistics? How can we quantify risks of decisions based on samples from a population? How should samples be selected
More informationSixth Edition. Chapter 2 Probability. Copyright 2014 John Wiley & Sons, Inc. All rights reserved. Probability
Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger Chapter 2 Probability 2 Probability CHAPTER OUTLINE 2-1 Sample Spaces and Events 2-1.1 Random Experiments
More informationSTAT 509: Statistics for Engineers Dr. Dewei Wang. Copyright 2014 John Wiley & Sons, Inc. All rights reserved.
STAT 509: Statistics for Engineers Dr. Dewei Wang Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger 2 Probability CHAPTER OUTLINE 2-1 Sample Spaces and
More informationIntroduction to Probability and Statistics Slides 3 Chapter 3
Introduction to Probability and Statistics Slides 3 Chapter 3 Ammar M. Sarhan, asarhan@mathstat.dal.ca Department of Mathematics and Statistics, Dalhousie University Fall Semester 2008 Dr. Ammar M. Sarhan
More informationUniversity of Technology, Building and Construction Engineering Department (Undergraduate study) PROBABILITY THEORY
ENGIEERING STATISTICS (Lectures) University of Technology, Building and Construction Engineering Department (Undergraduate study) PROBABILITY THEORY Dr. Maan S. Hassan Lecturer: Azhar H. Mahdi Probability
More information324 Stat Lecture Notes (1) Probability
324 Stat Lecture Notes 1 robability Chapter 2 of the book pg 35-71 1 Definitions: Sample Space: Is the set of all possible outcomes of a statistical experiment, which is denoted by the symbol S Notes:
More informationMAT2377. Ali Karimnezhad. Version September 9, Ali Karimnezhad
MAT2377 Ali Karimnezhad Version September 9, 2015 Ali Karimnezhad Comments These slides cover material from Chapter 1. In class, I may use a blackboard. I recommend reading these slides before you come
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationSociology 6Z03 Topic 10: Probability (Part I)
Sociology 6Z03 Topic 10: Probability (Part I) John Fox McMaster University Fall 2014 John Fox (McMaster University) Soc 6Z03: Probability I Fall 2014 1 / 29 Outline: Probability (Part I) Introduction Probability
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationAn-Najah National University Faculty of Engineering Industrial Engineering Department. Course : Quantitative Methods (65211)
An-Najah National University Faculty of Engineering Industrial Engineering Department Course : Quantitative Methods (65211) Instructor: Eng. Tamer Haddad 2 nd Semester 2009/2010 Chapter 2 Probability 2-1
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More informationUNIT Explain about the partition of a sampling space theorem?
UNIT -1 1. Explain about the partition of a sampling space theorem? PARTITIONS OF A SAMPLE SPACE The events B1, B2. B K represent a partition of the sample space 'S" if (a) So, when the experiment E is
More informationClass 26: review for final exam 18.05, Spring 2014
Probability Class 26: review for final eam 8.05, Spring 204 Counting Sets Inclusion-eclusion principle Rule of product (multiplication rule) Permutation and combinations Basics Outcome, sample space, event
More information4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space
I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions
Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions 1999 Prentice-Hall, Inc. Chap. 4-1 Chapter Topics Basic Probability Concepts: Sample
More informationA Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.
A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,
More information2011 Pearson Education, Inc
Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive
More informationTopic 3: Introduction to Probability
Topic 3: Introduction to Probability 1 Contents 1. Introduction 2. Simple Definitions 3. Types of Probability 4. Theorems of Probability 5. Probabilities under conditions of statistically independent events
More informationProbability Distributions
Probability Distributions Series of events Previously we have been discussing the probabilities associated with a single event: Observing a 1 on a single roll of a die Observing a K with a single card
More informationLecture 16. Lectures 1-15 Review
18.440: Lecture 16 Lectures 1-15 Review Scott Sheffield MIT 1 Outline Counting tricks and basic principles of probability Discrete random variables 2 Outline Counting tricks and basic principles of probability
More informationSTAT509: Probability
University of South Carolina August 20, 2014 The Engineering Method and Statistical Thinking The general steps of engineering method are: 1. Develop a clear and concise description of the problem. 2. Identify
More informationDecision making and problem solving Lecture 1. Review of basic probability Monte Carlo simulation
Decision making and problem solving Lecture 1 Review of basic probability Monte Carlo simulation Why probabilities? Most decisions involve uncertainties Probability theory provides a rigorous framework
More informationSTT When trying to evaluate the likelihood of random events we are using following wording.
Introduction to Chapter 2. Probability. When trying to evaluate the likelihood of random events we are using following wording. Provide your own corresponding examples. Subjective probability. An individual
More informationDiscrete Probability. Chemistry & Physics. Medicine
Discrete Probability The existence of gambling for many centuries is evidence of long-running interest in probability. But a good understanding of probability transcends mere gambling. The mathematics
More informationBASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES
BASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES COMMON TERMS RELATED TO PROBABILITY Probability is the measure of the likelihood that an event will occur Probability values are
More informationChapter 2 Class Notes
Chapter 2 Class Notes Probability can be thought of in many ways, for example as a relative frequency of a long series of trials (e.g. flips of a coin or die) Another approach is to let an expert (such
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationSTA 2023 EXAM-2 Practice Problems From Chapters 4, 5, & Partly 6. With SOLUTIONS
STA 2023 EXAM-2 Practice Problems From Chapters 4, 5, & Partly 6 With SOLUTIONS Mudunuru Venkateswara Rao, Ph.D. STA 2023 Fall 2016 Venkat Mu ALL THE CONTENT IN THESE SOLUTIONS PRESENTED IN BLUE AND BLACK
More informationProbability and Sample space
Probability and Sample space We call a phenomenon random if individual outcomes are uncertain but there is a regular distribution of outcomes in a large number of repetitions. The probability of any outcome
More informationCombinatorics and probability
Combinatorics and probability Maths 4 th ESO José Jaime Noguera 1 Organizing data: tree diagrams Draw the tree diagram for the problem: You have 3 seats and three people Andrea (A), Bob (B) and Carol (C).
More informationChapter 2. Probability
2-1 Chapter 2 Probability 2-2 Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance with certainty. Examples: rolling a die tossing
More informationSTAT Chapter 3: Probability
Basic Definitions STAT 515 --- Chapter 3: Probability Experiment: A process which leads to a single outcome (called a sample point) that cannot be predicted with certainty. Sample Space (of an experiment):
More informationSection 13.3 Probability
288 Section 13.3 Probability Probability is a measure of how likely an event will occur. When the weather forecaster says that there will be a 50% chance of rain this afternoon, the probability that it
More informationSTA 2023 EXAM-2 Practice Problems. Ven Mudunuru. From Chapters 4, 5, & Partly 6. With SOLUTIONS
STA 2023 EXAM-2 Practice Problems From Chapters 4, 5, & Partly 6 With SOLUTIONS Mudunuru, Venkateswara Rao STA 2023 Spring 2016 1 1. A committee of 5 persons is to be formed from 6 men and 4 women. What
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More information1 Preliminaries Sample Space and Events Interpretation of Probability... 13
Summer 2017 UAkron Dept. of Stats [3470 : 461/561] Applied Statistics Ch 2: Probability Contents 1 Preliminaries 3 1.1 Sample Space and Events...........................................................
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationChapter Learning Objectives. Random Experiments Dfiii Definition: Dfiii Definition:
Chapter 2: Probability 2-1 Sample Spaces & Events 2-1.1 Random Experiments 2-1.2 Sample Spaces 2-1.3 Events 2-1 1.4 Counting Techniques 2-2 Interpretations & Axioms of Probability 2-3 Addition Rules 2-4
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationMAT 271E Probability and Statistics
MAT 71E Probability and Statistics Spring 013 Instructor : Class Meets : Office Hours : Textbook : Supp. Text : İlker Bayram EEB 1103 ibayram@itu.edu.tr 13.30 1.30, Wednesday EEB 5303 10.00 1.00, Wednesday
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationStatistics for Managers Using Microsoft Excel (3 rd Edition)
Statistics for Managers Using Microsoft Excel (3 rd Edition) Chapter 4 Basic Probability and Discrete Probability Distributions 2002 Prentice-Hall, Inc. Chap 4-1 Chapter Topics Basic probability concepts
More informationProbability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008
Probability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008 1 Review We saw some basic metrics that helped us characterize
More informationProbability: Why do we care? Lecture 2: Probability and Distributions. Classical Definition. What is Probability?
Probability: Why do we care? Lecture 2: Probability and Distributions Sandy Eckel seckel@jhsph.edu 22 April 2008 Probability helps us by: Allowing us to translate scientific questions into mathematical
More informationOutline PMF, CDF and PDF Mean, Variance and Percentiles Some Common Distributions. Week 5 Random Variables and Their Distributions
Week 5 Random Variables and Their Distributions Week 5 Objectives This week we give more general definitions of mean value, variance and percentiles, and introduce the first probability models for discrete
More informationBasic Statistics and Probability Chapter 3: Probability
Basic Statistics and Probability Chapter 3: Probability Events, Sample Spaces and Probability Unions and Intersections Complementary Events Additive Rule. Mutually Exclusive Events Conditional Probability
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationSTAT 516: Basic Probability and its Applications
Lecture 3: Conditional Probability and Independence Prof. Michael September 29, 2015 Motivating Example Experiment ξ consists of rolling a fair die twice; A = { the first roll is 6 } amd B = { the sum
More informationChapter 1 (Basic Probability)
Chapter 1 (Basic Probability) What is probability? Consider the following experiments: 1. Count the number of arrival requests to a web server in a day. 2. Determine the execution time of a program. 3.
More informationProbability 5-4 The Multiplication Rules and Conditional Probability
Outline Lecture 8 5-1 Introduction 5-2 Sample Spaces and 5-3 The Addition Rules for 5-4 The Multiplication Rules and Conditional 5-11 Introduction 5-11 Introduction as a general concept can be defined
More informationLecture 2: Probability and Distributions
Lecture 2: Probability and Distributions Ani Manichaikul amanicha@jhsph.edu 17 April 2007 1 / 65 Probability: Why do we care? Probability helps us by: Allowing us to translate scientific questions info
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationProbability and Probability Distributions. Dr. Mohammed Alahmed
Probability and Probability Distributions 1 Probability and Probability Distributions Usually we want to do more with data than just describing them! We might want to test certain specific inferences about
More informationLecture 10. Variance and standard deviation
18.440: Lecture 10 Variance and standard deviation Scott Sheffield MIT 1 Outline Defining variance Examples Properties Decomposition trick 2 Outline Defining variance Examples Properties Decomposition
More informationPart IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationan event with one outcome is called a simple event.
Ch5Probability Probability is a measure of the likelihood of a random phenomenon or chance behavior. Probability describes the long-term proportion with which a certain outcome will occur in situations
More informationProbability Year 10. Terminology
Probability Year 10 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationHST.582J / 6.555J / J Biomedical Signal and Image Processing Spring 2007
MIT OpenCourseWare http://ocw.mit.edu HST.582J / 6.555J / 16.456J Biomedical Signal and Image Processing Spring 2007 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationLecture 3. Probability and elements of combinatorics
Introduction to theory of probability and statistics Lecture 3. Probability and elements of combinatorics prof. dr hab.inż. Katarzyna Zakrzewska Katedra Elektroniki, AGH e-mail: zak@agh.edu.pl http://home.agh.edu.pl/~zak
More informationCounting principles, including permutations and combinations.
1 Counting principles, including permutations and combinations. The binomial theorem: expansion of a + b n, n ε N. THE PRODUCT RULE If there are m different ways of performing an operation and for each
More informationProbability Year 9. Terminology
Probability Year 9 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationChapter 8 Sequences, Series, and Probability
Chapter 8 Sequences, Series, and Probability Overview 8.1 Sequences and Series 8.2 Arithmetic Sequences and Partial Sums 8.3 Geometric Sequences and Partial Sums 8.5 The Binomial Theorem 8.6 Counting Principles
More informationWeek 2: Probability: Counting, Sets, and Bayes
Statistical Methods APPM 4570/5570, STAT 4000/5000 21 Probability Introduction to EDA Week 2: Probability: Counting, Sets, and Bayes Random variable Random variable is a measurable quantity whose outcome
More information4-1 BASIC CONCEPTS OF PROBABILITY
CHAPTER 4 4-1 BASIC CONCEPTS OF PROBABILITY Identify probabilities as values between 0 and 1, and interpret those values as expressions of likelihood of events Develop the ability to calculate probabilities
More informationWhy study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables
ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section
More informationProbability Theory. Introduction to Probability Theory. Principles of Counting Examples. Principles of Counting. Probability spaces.
Probability Theory To start out the course, we need to know something about statistics and probability Introduction to Probability Theory L645 Advanced NLP Autumn 2009 This is only an introduction; for
More informationElementary Discrete Probability
Elementary Discrete Probability MATH 472 Financial Mathematics J Robert Buchanan 2018 Objectives In this lesson we will learn: the terminology of elementary probability, elementary rules of probability,
More informationChapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations
Chapter 5 Statistical Models in Simulations 5.1 Contents Basic Probability Theory Concepts Discrete Distributions Continuous Distributions Poisson Process Empirical Distributions Useful Statistical Models
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationHomework 4 Solution, due July 23
Homework 4 Solution, due July 23 Random Variables Problem 1. Let X be the random number on a die: from 1 to. (i) What is the distribution of X? (ii) Calculate EX. (iii) Calculate EX 2. (iv) Calculate Var
More informationChap 4 Probability p227 The probability of any outcome in a random phenomenon is the proportion of times the outcome would occur in a long series of
Chap 4 Probability p227 The probability of any outcome in a random phenomenon is the proportion of times the outcome would occur in a long series of repetitions. (p229) That is, probability is a long-term
More informationExample. What is the sample space for flipping a fair coin? Rolling a 6-sided die? Find the event E where E = {x x has exactly one head}
Chapter 7 Notes 1 (c) Epstein, 2013 CHAPTER 7: PROBABILITY 7.1: Experiments, Sample Spaces and Events Chapter 7 Notes 2 (c) Epstein, 2013 What is the sample space for flipping a fair coin three times?
More information7.1 What is it and why should we care?
Chapter 7 Probability In this section, we go over some simple concepts from probability theory. We integrate these with ideas from formal language theory in the next chapter. 7.1 What is it and why should
More informationMotivation. Stat Camp for the MBA Program. Probability. Experiments and Outcomes. Daniel Solow 5/10/2017
Stat Camp for the MBA Program Daniel Solow Lecture 2 Probability Motivation You often need to make decisions under uncertainty, that is, facing an unknown future. Examples: How many computers should I
More informationArkansas Tech University MATH 3513: Applied Statistics I Dr. Marcel B. Finan
2.4 Random Variables Arkansas Tech University MATH 3513: Applied Statistics I Dr. Marcel B. Finan By definition, a random variable X is a function with domain the sample space and range a subset of the
More informationBandits, Experts, and Games
Bandits, Experts, and Games CMSC 858G Fall 2016 University of Maryland Intro to Probability* Alex Slivkins Microsoft Research NYC * Many of the slides adopted from Ron Jin and Mohammad Hajiaghayi Outline
More informationPart (A): Review of Probability [Statistics I revision]
Part (A): Review of Probability [Statistics I revision] 1 Definition of Probability 1.1 Experiment An experiment is any procedure whose outcome is uncertain ffl toss a coin ffl throw a die ffl buy a lottery
More informationBusiness Statistics MBA Pokhara University
Business Statistics MBA Pokhara University Chapter 3 Basic Probability Concept and Application Bijay Lal Pradhan, Ph.D. Review I. What s in last lecture? Descriptive Statistics Numerical Measures. Chapter
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter One Jesse Crawford Department of Mathematics Tarleton State University (Tarleton State University) Chapter One Notes 1 / 71 Outline 1 A Sketch of Probability and
More informationLecture 4: Probability and Discrete Random Variables
Error Correcting Codes: Combinatorics, Algorithms and Applications (Fall 2007) Lecture 4: Probability and Discrete Random Variables Wednesday, January 21, 2009 Lecturer: Atri Rudra Scribe: Anonymous 1
More informationII. The Binomial Distribution
88 CHAPTER 4 PROBABILITY DISTRIBUTIONS 進佳數學團隊 Dr. Herbert Lam 林康榮博士 HKDSE Mathematics M1 II. The Binomial Distribution 1. Bernoulli distribution A Bernoulli eperiment results in any one of two possible
More informationLECTURE NOTES by DR. J.S.V.R. KRISHNA PRASAD
.0 Introduction: The theory of probability has its origin in the games of chance related to gambling such as tossing of a coin, throwing of a die, drawing cards from a pack of cards etc. Jerame Cardon,
More informationProbability Review. Chao Lan
Probability Review Chao Lan Let s start with a single random variable Random Experiment A random experiment has three elements 1. sample space Ω: set of all possible outcomes e.g.,ω={1,2,3,4,5,6} 2. event
More informationFault-Tolerant Computer System Design ECE 60872/CS 590. Topic 2: Discrete Distributions
Fault-Tolerant Computer System Design ECE 60872/CS 590 Topic 2: Discrete Distributions Saurabh Bagchi ECE/CS Purdue University Outline Basic probability Conditional probability Independence of events Series-parallel
More informationStochastic processes Lecture 1: Multiple Random Variables Ch. 5
Stochastic processes Lecture : Multiple Random Variables Ch. 5 Dr. Ir. Richard C. Hendriks 26/04/8 Delft University of Technology Challenge the future Organization Plenary Lectures Book: R.D. Yates and
More informationSTAT 430/510 Probability Lecture 7: Random Variable and Expectation
STAT 430/510 Probability Lecture 7: Random Variable and Expectation Pengyuan (Penelope) Wang June 2, 2011 Review Properties of Probability Conditional Probability The Law of Total Probability Bayes Formula
More informationChapter. Probability
Chapter 3 Probability Section 3.1 Basic Concepts of Probability Section 3.1 Objectives Identify the sample space of a probability experiment Identify simple events Use the Fundamental Counting Principle
More informationNotes 12 Autumn 2005
MAS 08 Probability I Notes Autumn 005 Conditional random variables Remember that the conditional probability of event A given event B is P(A B) P(A B)/P(B). Suppose that X is a discrete random variable.
More informationStochastic Models of Manufacturing Systems
Stochastic Models of Manufacturing Systems Ivo Adan Organization 2/47 7 lectures (lecture of May 12 is canceled) Studyguide available (with notes, slides, assignments, references), see http://www.win.tue.nl/
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationBasic Probability. Introduction
Basic Probability Introduction The world is an uncertain place. Making predictions about something as seemingly mundane as tomorrow s weather, for example, is actually quite a difficult task. Even with
More informationRS Chapter 2 Random Variables 9/28/2017. Chapter 2. Random Variables
RS Chapter Random Variables 9/8/017 Chapter Random Variables Random Variables A random variable is a convenient way to epress the elements of Ω as numbers rather than abstract elements of sets. Definition:
More informationOutline Conditional Probability The Law of Total Probability and Bayes Theorem Independent Events. Week 4 Classical Probability, Part II
Week 4 Classical Probability, Part II Week 4 Objectives This week we continue covering topics from classical probability. The notion of conditional probability is presented first. Important results/tools
More informationPERMUTATIONS, COMBINATIONS AND DISCRETE PROBABILITY
Friends, we continue the discussion with fundamentals of discrete probability in the second session of third chapter of our course in Discrete Mathematics. The conditional probability and Baye s theorem
More informationRelationship between probability set function and random variable - 2 -
2.0 Random Variables A rat is selected at random from a cage and its sex is determined. The set of possible outcomes is female and male. Thus outcome space is S = {female, male} = {F, M}. If we let X be
More informationComputer Science, Informatik 4 Communication and Distributed Systems. Simulation. Discrete-Event System Simulation. Dr.
Simulation Discrete-Event System Simulation Chapter 4 Statistical Models in Simulation Purpose & Overview The world the model-builder sees is probabilistic rather than deterministic. Some statistical model
More information