Basics of Monte Carlo Simulations: practical exercises

Size: px
Start display at page:

Download "Basics of Monte Carlo Simulations: practical exercises"

Transcription

1 Basics of Monte Carlo Simulations: practical exercises Piero Baraldi Politecnico di Milano, Energy Department Phone:

2 EXERCISE 1 (first part)

3 Exercise 1 Consider the Weibull distribution: with 1. Sample =400 values from 2. Show a Figure reporting the distribution of the obtained samples 3. Verify whether the obtained distribution provides a good approximation of the Weibull distribution

4 Sampling Random umbers from F X (x)

5 MATLAB COMMAD rand(m,1) provides a column of M random numbers sorted from an uniform distribution in the range (0,1) = hist(y) bins the elements of vector Y into 10 equally spaced containers and returns the number of elements in each container. More options if you write help hist

6 Example: Weibull Distribution Time-dependent hazard rate 1 t t cdf: T 1 F t P T t e t pdf: T 1 t f t dt P t T t dt t e dt Sampling a failure time T (by the inverse transform) R 1 R F r F t e T t 1 1 T FT R ln 1 R 1

7 % Exercise 1 clear all; close all % Weibull parameters beta = 1; alpha = 1.5; % Sample values from the Weibull distribution = 400; % number of samples r = rand(,1); t = (-log(1-r)/beta).^(1/alpha); % inverse transform method

8 % Verify the distribution delta_channel = 0.1; channel_centers = [delta_channel/2:delta_channel:5- delta_channel/2]; num_samples = hist(t,channel_centers); pdf_est = num_samples/(*delta_channel); % ormalization % Compute the analytic pdf analytic_weibull = alpha*beta*channel_centers.^(alpha- 1).*exp(-beta*channel_centers.^alpha);

9 figure % pdf plot(channel_centers,analytic_weibull); hold on; plot(channel_centers,pdf_est,'-sr'); grid legend('analytic pdf','sampled values distribution pdf',0) figure % cdf cdf_est = cumsum(pdf_est)*delta_channel; plot(channel_centers, cumsum(analytic_weibull)*delta_channel);hold on; plot(channel_centers, cdf_est,'*r'); grid legend('analytic cdf','sampled values distribution cdf',0)

10 1 0.9 Analytic pdf Sampled values distribution pdf

11 Analytic cdf Sampled values distribution cdf

12 EXERCISE 1 (second part)

13 MC Evaluation of Definite Integrals 13 G b a g x f xdx E[ gx] X MC = dart game: sample x from f(x) the probability that a shot hits x dx is f(x)dx the award is g(x) Consider trials with results x 1, x 2,, x : the average award is: G 1 i1 g x g i

14 MC Evaluation of Definite Integrals: Why G is a good estimator of G? 14 G 1 g x i i1 G is a random variable with: E 1 G E gx Egx Egx Var i1 1 G Var gx Vargx Vargx Varg( x) i1 i i 1 i1 1 2 i1 i 1 i1 i 1 2 i1 G 1 G is an unbiased estimator of G: G is a consistent estimator of G: EG G lim Var G 0

15 Exercise 1 (Second Part) Consider the Weibull distribution: with 1. Sample =400 values from 2. Show a Figure reporting the distribution of the obtained samples 3. Provide an estimate of with =400 and = Estimate the variance of with =400 and =6400

16 % Estimating the mean of the distribution (definite integral) G = mean(t); % Sample mean disp(['g_ = ',num2str(g)]) S2G = var(t)/; disp(['g_ variance = ', num2str(s2g)]) disp(['estimate = ',num2str(g),' +- ',num2str(sqrt(s2g))]); disp([' ']) disp(['true Value = ', num2str(gamma(5/3))]) disp([' ']) % mean_weibull=1/beta(gamma(1+1/alfa)) disp(['error = ', num2str(abs(gamma(5/3)-g))])

17 Interpretation of the Variance of G (1) G 1 st run of the code: 2 nd run of the code: 400 samples from f 400 different samples 100 th run of the code: 400 different samples G is a random variable: G distribution is approximated by a ormal 2000 E G Var G Vargx G 1 i G 1 g x i i1 h(g3500 ) G G

18 Interpretation of the Variance of G (2) unknown P G ; 0.68 G G G G h(g ) 0.68 P G G ; G 0.68 G G G G G G G G G G 1 st run of the code: 400 samples from f 2 nd run of the code: 400 different sample 100 th run of the code: 400 different samples

19 Validation =

20 EXERCISE 2

21 Exercise 2 Consider the following system A B C Transition rates (in arbitrary time-units): Failure: λ A = 0.001; λ B = 0.002; λ C = 0.005; Repair: μ A = 0.1; μ B = 0.15; μ C = 0.05; Estimate the reliability of the system at T miss = 500

22 Indirect Monte Carlo A B C Components times of transition between states are exponentially distributed Arrival Initial 1(nominal) 0 A( B,C) A B 1 2 (failed) ( B,C) A 0 ( 3 ) A( B) (failed) A( B) 3 1 A( B) 3 2 0

23 Analog Monte Carlo Trial Sampling the time of transition The rate of transition of the system out of its current configuration (1, 1, 1) is: We are now in the position of sampling the first system transition time t 1, by applying the inverse transform method: where R t ~ U[0,1) t 1,1,1 t A B C 1 ln(1 R ) 1,1,1 1 0 t

24 Analog Monte Carlo Trial Sampling the kind of Transition (1) Assuming that t 1 < T M (otherwise we would proceed to the successive trial), we now need to determine which component has undergone the transition The probabilities of components A, B, C undergoing a transition out of their initial nominal states 1, given that a transition occurs at time t 1, are: A B C,, 1,1,1 1,1,1 1,1,1 Thus, we can apply the inverse transform method to the discrete distribution Rc A B C C 1,1,1 1,1,1 1,1,1 0 R C U[0,1) 1

25 Analog Monte Carlo Trial Sampling the kind of Transition (2) As a result of this first transition, at t 1 the system is operating in configuration (1,2,1). The simulation now proceeds to sampling the next transition time t 2 with the updated transition rate 1,2,1 A B C

26 Unreliability and Unavailability Estimation 26 When the system enters a failed, tallies are appropriately collected for the unreliability estimates; After performing a large number of trials M, we can obtain estimates of the system unreliability by simply dividing by M, the number of MC simulation ended in a failure configuration

27 % Reliability of Simple Systems (A\\(B+C)) % System parameters lambda_a = 0.001; mu_a = 0.1; lambda_b = 0.002; mu_b = 0.15; lambda_c = 0.005; mu_c = 0.05;

28 % 2 = Failure; 1 = Working Trans_A = [0 lambda_a; mu_a 0]; Trans_B = [0 lambda_b; mu_b 0]; Trans_C = [0 lambda_c; mu_c 0]; failed_states = [2 1 2; 2 2 1; 2 2 2]; initial_state = [1 1 1]; % Mission time Tmiss = 500;

29 % MC simulation parameters = 1e3; % MC cycle unrel_counter = zeros(1,); for n = 1: % Main Monte Carlo cycle unrel_flag = 0; % 0 if no failures before Tmiss, 1 otherwise t = 0; current_state = initial_state;

30 while (t < Tmiss) % check if the system is in a failure configuration for jj = 1:3 % 3 is the number of system failure states end if sum(current_state == failed_states(jj,1:3)) == 3 end unrel_flag = 1; % find the system transition rate if unrel_flag ~= 1 lambda_a_out = sum(trans_a(current_state(1),:)); lambda_b_out = sum(trans_b(current_state(2),:)); lambda_c_out = sum(trans_c(current_state(3),:)); lambda_sys = lambda_a_out + lambda_b_out + lambda_c_out;

31 % Sample transition time t_trans = -1/lambda_sys*log(rand); t = t+t_trans; if t < Tmiss % if the transition time falls within Tmiss, end % Sample the kind of transition r = rand; sum_l = cumsum([lambda_a_out lambda_b_out lambda_c_out])/lambda_sys; comp = min(find(sum_l>r)); % Component that makes the transition %Change the state of the component that makes the transition old_st = current_state(comp); current_state(comp) = 3-current_state(comp);

32 else %(unreliability flag is 1) break % break the while loop end end %(of the while loop) unrel_counter(n) = unrel_flag; end %of the simulation % Estimate the reliability by the MC samples rel_mc = 1-mean(unrel_counter); var_mc = var(unrel_counter)/;

Monte Carlo Simulation for Reliability and Availability analyses

Monte Carlo Simulation for Reliability and Availability analyses Monte Carlo Simulation for Reliability and Availability analyses Monte Carlo Simulation: Why? 2 Computation of system reliability and availability for industrial systems characterized by: many components

More information

A Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.

A Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,

More information

IEOR 4703: Homework 2 Solutions

IEOR 4703: Homework 2 Solutions IEOR 4703: Homework 2 Solutions Exercises for which no programming is required Let U be uniformly distributed on the interval (0, 1); P (U x) = x, x (0, 1). We assume that your computer can sequentially

More information

Professor Terje Haukaas University of British Columbia, Vancouver Sampling ( ) = f (x)dx

Professor Terje Haukaas University of British Columbia, Vancouver   Sampling ( ) = f (x)dx Sampling There exist several sampling schemes to address the reliability problem. In fact, sampling is equally applicable to component and system reliability problems. For this reason, the failure region

More information

Northwestern University Department of Electrical Engineering and Computer Science

Northwestern University Department of Electrical Engineering and Computer Science Northwestern University Department of Electrical Engineering and Computer Science EECS 454: Modeling and Analysis of Communication Networks Spring 2008 Probability Review As discussed in Lecture 1, probability

More information

2 Random Variable Generation

2 Random Variable Generation 2 Random Variable Generation Most Monte Carlo computations require, as a starting point, a sequence of i.i.d. random variables with given marginal distribution. We describe here some of the basic methods

More information

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models Fatih Cavdur fatihcavdur@uludag.edu.tr March 20, 2012 Introduction Introduction The world of the model-builder

More information

CHAPTER 3 ANALYSIS OF RELIABILITY AND PROBABILITY MEASURES

CHAPTER 3 ANALYSIS OF RELIABILITY AND PROBABILITY MEASURES 27 CHAPTER 3 ANALYSIS OF RELIABILITY AND PROBABILITY MEASURES 3.1 INTRODUCTION The express purpose of this research is to assimilate reliability and its associated probabilistic variables into the Unit

More information

Random Variables and Their Distributions

Random Variables and Their Distributions Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital

More information

Exercise 5 Release: Due:

Exercise 5 Release: Due: Stochastic Modeling and Simulation Winter 28 Prof. Dr. I. F. Sbalzarini, Dr. Christoph Zechner (MPI-CBG/CSBD TU Dresden, 87 Dresden, Germany Exercise 5 Release: 8..28 Due: 5..28 Question : Variance of

More information

F X (x) = P [X x] = x f X (t)dt. 42 Lebesgue-a.e, to be exact 43 More specifically, if g = f Lebesgue-a.e., then g is also a pdf for X.

F X (x) = P [X x] = x f X (t)dt. 42 Lebesgue-a.e, to be exact 43 More specifically, if g = f Lebesgue-a.e., then g is also a pdf for X. 10.2 Properties of PDF and CDF for Continuous Random Variables 10.18. The pdf f X is determined only almost everywhere 42. That is, given a pdf f for a random variable X, if we construct a function g by

More information

Continuous Random Variables and Continuous Distributions

Continuous Random Variables and Continuous Distributions Continuous Random Variables and Continuous Distributions Continuous Random Variables and Continuous Distributions Expectation & Variance of Continuous Random Variables ( 5.2) The Uniform Random Variable

More information

Engineering Risk Benefit Analysis

Engineering Risk Benefit Analysis Engineering Risk Benefit Analysis 1.155, 2.943, 3.577, 6.938, 10.816, 13.621, 16.862, 22.82, ESD.72, ESD.721 RPRA 3. Probability Distributions in RPRA George E. Apostolakis Massachusetts Institute of Technology

More information

Conditioning a random variable on an event

Conditioning a random variable on an event Conditioning a random variable on an event Let X be a continuous random variable and A be an event with P (A) > 0. Then the conditional pdf of X given A is defined as the nonnegative function f X A that

More information

Chapter 4 Continuous Random Variables and Probability Distributions

Chapter 4 Continuous Random Variables and Probability Distributions Chapter 4 Continuous Random Variables and Probability Distributions Part 1: Continuous Random Variables Section 4.1 Continuous Random Variables Section 4.2 Probability Distributions & Probability Density

More information

Quiz #2 A Mighty Fine Review

Quiz #2 A Mighty Fine Review Quiz #2 A Mighty Fine Review February 27: A reliable adventure; a day like all days filled with those events that alter and change the course of history and you will be there! What is a Quiz #2? Three

More information

Statistics 3657 : Moment Approximations

Statistics 3657 : Moment Approximations Statistics 3657 : Moment Approximations Preliminaries Suppose that we have a r.v. and that we wish to calculate the expectation of g) for some function g. Of course we could calculate it as Eg)) by the

More information

Analysis of Engineering and Scientific Data. Semester

Analysis of Engineering and Scientific Data. Semester Analysis of Engineering and Scientific Data Semester 1 2019 Sabrina Streipert s.streipert@uq.edu.au Example: Draw a random number from the interval of real numbers [1, 3]. Let X represent the number. Each

More information

Math 180A. Lecture 16 Friday May 7 th. Expectation. Recall the three main probability density functions so far (1) Uniform (2) Exponential.

Math 180A. Lecture 16 Friday May 7 th. Expectation. Recall the three main probability density functions so far (1) Uniform (2) Exponential. Math 8A Lecture 6 Friday May 7 th Epectation Recall the three main probability density functions so far () Uniform () Eponential (3) Power Law e, ( ), Math 8A Lecture 6 Friday May 7 th Epectation Eample

More information

Continuous Random Variables

Continuous Random Variables MATH 38 Continuous Random Variables Dr. Neal, WKU Throughout, let Ω be a sample space with a defined probability measure P. Definition. A continuous random variable is a real-valued function X defined

More information

Fleet Maintenance Simulation With Insufficient Data

Fleet Maintenance Simulation With Insufficient Data Fleet Maintenance Simulation With Insufficient Data Zissimos P. Mourelatos Mechanical Engineering Department Oakland University mourelat@oakland.edu Ground Robotics Reliability Center (GRRC) Seminar 17

More information

Chapter Learning Objectives. Probability Distributions and Probability Density Functions. Continuous Random Variables

Chapter Learning Objectives. Probability Distributions and Probability Density Functions. Continuous Random Variables Chapter 4: Continuous Random Variables and Probability s 4-1 Continuous Random Variables 4-2 Probability s and Probability Density Functions 4-3 Cumulative Functions 4-4 Mean and Variance of a Continuous

More information

Statistics 100A Homework 5 Solutions

Statistics 100A Homework 5 Solutions Chapter 5 Statistics 1A Homework 5 Solutions Ryan Rosario 1. Let X be a random variable with probability density function a What is the value of c? fx { c1 x 1 < x < 1 otherwise We know that for fx to

More information

Structural Reliability

Structural Reliability Structural Reliability Thuong Van DANG May 28, 2018 1 / 41 2 / 41 Introduction to Structural Reliability Concept of Limit State and Reliability Review of Probability Theory First Order Second Moment Method

More information

3 Continuous Random Variables

3 Continuous Random Variables Jinguo Lian Math437 Notes January 15, 016 3 Continuous Random Variables Remember that discrete random variables can take only a countable number of possible values. On the other hand, a continuous random

More information

Reduction of Variance. Importance Sampling

Reduction of Variance. Importance Sampling Reduction of Variance As we discussed earlier, the statistical error goes as: error = sqrt(variance/computer time). DEFINE: Efficiency = = 1/vT v = error of mean and T = total CPU time How can you make

More information

Probability and Distributions

Probability and Distributions Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated

More information

Applied Statistics and Probability for Engineers. Sixth Edition. Chapter 4 Continuous Random Variables and Probability Distributions.

Applied Statistics and Probability for Engineers. Sixth Edition. Chapter 4 Continuous Random Variables and Probability Distributions. Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger Chapter 4 Continuous Random Variables and Probability Distributions 4 Continuous CHAPTER OUTLINE Random

More information

Chapter 4 Continuous Random Variables and Probability Distributions

Chapter 4 Continuous Random Variables and Probability Distributions Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger Chapter 4 Continuous Random Variables and Probability Distributions 4 Continuous CHAPTER OUTLINE 4-1

More information

Accurate Sample Size Calculations in Trials with Non-Proportional Hazards

Accurate Sample Size Calculations in Trials with Non-Proportional Hazards Accurate Sample Size Calculations in Trials with Non-Proportional Hazards James Bell Elderbrook Solutions GmbH PSI Conference - 4 th June 2018 Introduction Non-proportional hazards (NPH) are common in

More information

4. Distributions of Functions of Random Variables

4. Distributions of Functions of Random Variables 4. Distributions of Functions of Random Variables Setup: Consider as given the joint distribution of X 1,..., X n (i.e. consider as given f X1,...,X n and F X1,...,X n ) Consider k functions g 1 : R n

More information

EE 445 / 850: Final Examination

EE 445 / 850: Final Examination EE 445 / 850: Final Examination Date and Time: 3 Dec 0, PM Room: HLTH B6 Exam Duration: 3 hours One formula sheet permitted. - Covers chapters - 5 problems each carrying 0 marks - Must show all calculations

More information

Exam 3, Math Fall 2016 October 19, 2016

Exam 3, Math Fall 2016 October 19, 2016 Exam 3, Math 500- Fall 06 October 9, 06 This is a 50-minute exam. You may use your textbook, as well as a calculator, but your work must be completely yours. The exam is made of 5 questions in 5 pages,

More information

STAT 509 Section 3.4: Continuous Distributions. Probability distributions are used a bit differently for continuous r.v. s than for discrete r.v. s.

STAT 509 Section 3.4: Continuous Distributions. Probability distributions are used a bit differently for continuous r.v. s than for discrete r.v. s. STAT 509 Section 3.4: Continuous Distributions Probability distributions are used a bit differently for continuous r.v. s than for discrete r.v. s. A continuous random variable is one for which the outcome

More information

6 The normal distribution, the central limit theorem and random samples

6 The normal distribution, the central limit theorem and random samples 6 The normal distribution, the central limit theorem and random samples 6.1 The normal distribution We mentioned the normal (or Gaussian) distribution in Chapter 4. It has density f X (x) = 1 σ 1 2π e

More information

Reliability and Availability Simulation. Krige Visser, Professor, University of Pretoria, South Africa

Reliability and Availability Simulation. Krige Visser, Professor, University of Pretoria, South Africa Reliability and Availability Simulation Krige Visser, Professor, University of Pretoria, South Africa Content BACKGROUND DEFINITIONS SINGLE COMPONENTS MULTI-COMPONENT SYSTEMS AVAILABILITY SIMULATION CONCLUSION

More information

These notes will supplement the textbook not replace what is there. defined for α >0

These notes will supplement the textbook not replace what is there. defined for α >0 Gamma Distribution These notes will supplement the textbook not replace what is there. Gamma Function ( ) = x 0 e dx 1 x defined for >0 Properties of the Gamma Function 1. For any >1 () = ( 1)( 1) Proof

More information

57:022 Principles of Design II Final Exam Solutions - Spring 1997

57:022 Principles of Design II Final Exam Solutions - Spring 1997 57:022 Principles of Design II Final Exam Solutions - Spring 1997 Part: I II III IV V VI Total Possible Pts: 52 10 12 16 13 12 115 PART ONE Indicate "+" if True and "o" if False: + a. If a component's

More information

Monte Carlo Methods in Statistical Physics: I. Error analysis for uncorrelated data

Monte Carlo Methods in Statistical Physics: I. Error analysis for uncorrelated data 1 Monte Carlo Methods in Statistical Physics: I. Error analysis for uncorrelated data Andrea Pelissetto Andrea.Pelissetto@roma1.infn.it Dipartimento di Fisica Università di Roma La Sapienza Statistical

More information

Monte Carlo Simulation

Monte Carlo Simulation Monte Carlo Simulation 198 Introduction Reliability indices of an actual physical system could be estimated by collecting data on the occurrence of failures and durations of repair. The Monte Carlo method

More information

Let X be a continuous random variable, < X < f(x) is the so called probability density function (pdf) if

Let X be a continuous random variable, < X < f(x) is the so called probability density function (pdf) if University of California, Los Angeles Department of Statistics Statistics 1A Instructor: Nicolas Christou Continuous probability distributions Let X be a continuous random variable, < X < f(x) is the so

More information

STAT2201. Analysis of Engineering & Scientific Data. Unit 3

STAT2201. Analysis of Engineering & Scientific Data. Unit 3 STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random

More information

Probability Midterm Exam 2:15-3:30 pm Thursday, 21 October 1999

Probability Midterm Exam 2:15-3:30 pm Thursday, 21 October 1999 Name: 2:15-3:30 pm Thursday, 21 October 1999 You may use a calculator and your own notes but may not consult your books or neighbors. Please show your work for partial credit, and circle your answers.

More information

PAS04 - Important discrete and continuous distributions

PAS04 - Important discrete and continuous distributions PAS04 - Important discrete and continuous distributions Jan Březina Technical University of Liberec 30. října 2014 Bernoulli trials Experiment with two possible outcomes: yes/no questions throwing coin

More information

Lecture 20. Randomness and Monte Carlo. J. Chaudhry. Department of Mathematics and Statistics University of New Mexico

Lecture 20. Randomness and Monte Carlo. J. Chaudhry. Department of Mathematics and Statistics University of New Mexico Lecture 20 Randomness and Monte Carlo J. Chaudhry Department of Mathematics and Statistics University of New Mexico J. Chaudhry (UNM) CS 357 1 / 40 What we ll do: Random number generators Monte-Carlo integration

More information

Review of Probability. CS1538: Introduction to Simulations

Review of Probability. CS1538: Introduction to Simulations Review of Probability CS1538: Introduction to Simulations Probability and Statistics in Simulation Why do we need probability and statistics in simulation? Needed to validate the simulation model Needed

More information

Monte Carlo Integration. Computer Graphics CMU /15-662, Fall 2016

Monte Carlo Integration. Computer Graphics CMU /15-662, Fall 2016 Monte Carlo Integration Computer Graphics CMU 15-462/15-662, Fall 2016 Talk Announcement Jovan Popovic, Senior Principal Scientist at Adobe Research will be giving a seminar on Character Animator -- Monday

More information

PROBABILITY DISTRIBUTIONS

PROBABILITY DISTRIBUTIONS Review of PROBABILITY DISTRIBUTIONS Hideaki Shimazaki, Ph.D. http://goo.gl/visng Poisson process 1 Probability distribution Probability that a (continuous) random variable X is in (x,x+dx). ( ) P x < X

More information

CDA5530: Performance Models of Computers and Networks. Chapter 2: Review of Practical Random Variables

CDA5530: Performance Models of Computers and Networks. Chapter 2: Review of Practical Random Variables CDA5530: Performance Models of Computers and Networks Chapter 2: Review of Practical Random Variables Definition Random variable (R.V.) X: A function on sample space X: S R Cumulative distribution function

More information

Monte Carlo Simulation for Predicting the Reliability of a Control System for a Geothermal Plant. Corneliu Popescu, Daniela Elena Popescu

Monte Carlo Simulation for Predicting the Reliability of a Control System for a Geothermal Plant. Corneliu Popescu, Daniela Elena Popescu Proceedings World Geothermal Congress 5 Antalya, Turkey, 4-9 April 5 onte Carlo Simulation for Predicting the Reliability of a Control System for a Geothermal Plant Corneliu Popescu, Daniela Elena Popescu

More information

Lecture 11: Probability, Order Statistics and Sampling

Lecture 11: Probability, Order Statistics and Sampling 5-75: Graduate Algorithms February, 7 Lecture : Probability, Order tatistics and ampling Lecturer: David Whitmer cribes: Ilai Deutel, C.J. Argue Exponential Distributions Definition.. Given sample space

More information

ECE 650. Some MATLAB Help (addendum to Lecture 1) D. Van Alphen (Thanks to Prof. Katz for the Histogram PDF Notes!)

ECE 650. Some MATLAB Help (addendum to Lecture 1) D. Van Alphen (Thanks to Prof. Katz for the Histogram PDF Notes!) ECE 65 Some MATLAB Help (addendum to Lecture 1) D. Van Alphen (Thanks to Prof. Katz for the Histogram PDF Notes!) Obtaining Probabilities for Gaussian RV s - An Example Let X be N(1, s 2 = 4). Find Pr(X

More information

Lecture 21: Convergence of transformations and generating a random variable

Lecture 21: Convergence of transformations and generating a random variable Lecture 21: Convergence of transformations and generating a random variable If Z n converges to Z in some sense, we often need to check whether h(z n ) converges to h(z ) in the same sense. Continuous

More information

Chapter 2 The Monte Carlo Method

Chapter 2 The Monte Carlo Method Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful

More information

Problem 1. Problem 2. Problem 3. Problem 4

Problem 1. Problem 2. Problem 3. Problem 4 Problem Let A be the event that the fungus is present, and B the event that the staph-bacteria is present. We have P A = 4, P B = 9, P B A =. We wish to find P AB, to do this we use the multiplication

More information

Special Discrete RV s. Then X = the number of successes is a binomial RV. X ~ Bin(n,p).

Special Discrete RV s. Then X = the number of successes is a binomial RV. X ~ Bin(n,p). Sect 3.4: Binomial RV Special Discrete RV s 1. Assumptions and definition i. Experiment consists of n repeated trials ii. iii. iv. There are only two possible outcomes on each trial: success (S) or failure

More information

EE/CpE 345. Modeling and Simulation. Fall Class 10 November 18, 2002

EE/CpE 345. Modeling and Simulation. Fall Class 10 November 18, 2002 EE/CpE 345 Modeling and Simulation Class 0 November 8, 2002 Input Modeling Inputs(t) Actual System Outputs(t) Parameters? Simulated System Outputs(t) The input data is the driving force for the simulation

More information

The exponential distribution and the Poisson process

The exponential distribution and the Poisson process The exponential distribution and the Poisson process 1-1 Exponential Distribution: Basic Facts PDF f(t) = { λe λt, t 0 0, t < 0 CDF Pr{T t) = 0 t λe λu du = 1 e λt (t 0) Mean E[T] = 1 λ Variance Var[T]

More information

(u v) = f (u,v) Equation 1

(u v) = f (u,v) Equation 1 Problem Two-horse race.0j /.8J /.5J / 5.07J /.7J / ESD.J Solution Problem Set # (a). The conditional pdf of U given that V v is: The marginal pdf of V is given by: (u v) f (u,v) Equation f U V fv ( v )

More information

Fault-Tolerant Computing

Fault-Tolerant Computing Fault-Tolerant Computing Motivation, Background, and Tools Slide 1 About This Presentation This presentation has been prepared for the graduate course ECE 257A (Fault-Tolerant Computing) by Behrooz Parhami,

More information

ECE 510 Lecture 7 Goodness of Fit, Maximum Likelihood. Scott Johnson Glenn Shirley

ECE 510 Lecture 7 Goodness of Fit, Maximum Likelihood. Scott Johnson Glenn Shirley ECE 510 Lecture 7 Goodness of Fit, Maximum Likelihood Scott Johnson Glenn Shirley Confidence Limits 30 Jan 2013 ECE 510 S.C.Johnson, C.G.Shirley 2 Binomial Confidence Limits (Solution 6.2) UCL: Prob of

More information

Monte Carlo Integration

Monte Carlo Integration Monte Carlo Integration SCX5005 Simulação de Sistemas Complexos II Marcelo S. Lauretto www.each.usp.br/lauretto Reference: Robert CP, Casella G. Introducing Monte Carlo Methods with R. Springer, 2010.

More information

Sampling Distributions

Sampling Distributions In statistics, a random sample is a collection of independent and identically distributed (iid) random variables, and a sampling distribution is the distribution of a function of random sample. For example,

More information

2 Continuous Random Variables and their Distributions

2 Continuous Random Variables and their Distributions Name: Discussion-5 1 Introduction - Continuous random variables have a range in the form of Interval on the real number line. Union of non-overlapping intervals on real line. - We also know that for any

More information

Topic 4: Continuous random variables

Topic 4: Continuous random variables Topic 4: Continuous random variables Course 003, 2018 Page 0 Continuous random variables Definition (Continuous random variable): An r.v. X has a continuous distribution if there exists a non-negative

More information

2 Functions of random variables

2 Functions of random variables 2 Functions of random variables A basic statistical model for sample data is a collection of random variables X 1,..., X n. The data are summarised in terms of certain sample statistics, calculated as

More information

8 STOCHASTIC SIMULATION

8 STOCHASTIC SIMULATION 8 STOCHASTIC SIMULATIO 59 8 STOCHASTIC SIMULATIO Whereas in optimization we seek a set of parameters x to minimize a cost, or to maximize a reward function J( x), here we pose a related but different question.

More information

Chapter 2 - Survival Models

Chapter 2 - Survival Models 2-1 Chapter 2 - Survival Models Section 2.2 - Future Lifetime Random Variable and the Survival Function Let T x = ( Future lifelength beyond age x of an individual who has survived to age x [measured in

More information

STAT 430/510: Lecture 10

STAT 430/510: Lecture 10 STAT 430/510: Lecture 10 James Piette June 9, 2010 Updates HW2 is due today! Pick up your HW1 s up in stat dept. There is a box located right when you enter that is labeled "Stat 430 HW1". It ll be out

More information

Two hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER.

Two hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER. Two hours MATH38181 To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER EXTREME VALUES AND FINANCIAL RISK Examiner: Answer any FOUR

More information

Continuous random variables

Continuous random variables Continuous random variables Can take on an uncountably infinite number of values Any value within an interval over which the variable is definied has some probability of occuring This is different from

More information

HW7 Solutions. f(x) = 0 otherwise. 0 otherwise. The density function looks like this: = 20 if x [10, 90) if x [90, 100]

HW7 Solutions. f(x) = 0 otherwise. 0 otherwise. The density function looks like this: = 20 if x [10, 90) if x [90, 100] HW7 Solutions. 5 pts.) James Bond James Bond, my favorite hero, has again jumped off a plane. The plane is traveling from from base A to base B, distance km apart. Now suppose the plane takes off from

More information

p. 6-1 Continuous Random Variables p. 6-2

p. 6-1 Continuous Random Variables p. 6-2 Continuous Random Variables Recall: For discrete random variables, only a finite or countably infinite number of possible values with positive probability (>). Often, there is interest in random variables

More information

3 Modeling Process Quality

3 Modeling Process Quality 3 Modeling Process Quality 3.1 Introduction Section 3.1 contains basic numerical and graphical methods. familiar with these methods. It is assumed the student is Goal: Review several discrete and continuous

More information

Continuous distributions

Continuous distributions CHAPTER 7 Continuous distributions 7.. Introduction A r.v. X is said to have a continuous distribution if there exists a nonnegative function f such that P(a X b) = ˆ b a f(x)dx for every a and b. distribution.)

More information

Chapter 3. Julian Chan. June 29, 2012

Chapter 3. Julian Chan. June 29, 2012 Chapter 3 Julian Chan June 29, 202 Continuous variables For a continuous random variable X there is an associated density function f(x). It satisifies many of the same properties of discrete random variables

More information

Slides 8: Statistical Models in Simulation

Slides 8: Statistical Models in Simulation Slides 8: Statistical Models in Simulation Purpose and Overview The world the model-builder sees is probabilistic rather than deterministic: Some statistical model might well describe the variations. An

More information

Topic 3 - Discrete distributions

Topic 3 - Discrete distributions Topic 3 - Discrete distributions Basics of discrete distributions Mean and variance of a discrete distribution Binomial distribution Poisson distribution and process 1 A random variable is a function which

More information

Error analysis for efficiency

Error analysis for efficiency Glen Cowan RHUL Physics 28 July, 2008 Error analysis for efficiency To estimate a selection efficiency using Monte Carlo one typically takes the number of events selected m divided by the number generated

More information

Lecture : The Indefinite Integral MTH 124

Lecture : The Indefinite Integral MTH 124 Up to this point we have investigated the definite integral of a function over an interval. In particular we have done the following. Approximated integrals using left and right Riemann sums. Defined the

More information

However, reliability analysis is not limited to calculation of the probability of failure.

However, reliability analysis is not limited to calculation of the probability of failure. Probabilistic Analysis probabilistic analysis methods, including the first and second-order reliability methods, Monte Carlo simulation, Importance sampling, Latin Hypercube sampling, and stochastic expansions

More information

1 Review of Probability

1 Review of Probability 1 Review of Probability Random variables are denoted by X, Y, Z, etc. The cumulative distribution function (c.d.f.) of a random variable X is denoted by F (x) = P (X x), < x

More information

Practice Questions for Final

Practice Questions for Final Math 39 Practice Questions for Final June. 8th 4 Name : 8. Continuous Probability Models You should know Continuous Random Variables Discrete Probability Distributions Expected Value of Discrete Random

More information

Assessment of the Performance of a Fully Electric Vehicle Subsystem in Presence of a Prognostic and Health Monitoring System

Assessment of the Performance of a Fully Electric Vehicle Subsystem in Presence of a Prognostic and Health Monitoring System A publication of CHEMICAL ENGINEERING TRANSACTIONS VOL. 33, 2013 Guest Editors: Enrico Zio, Piero Baraldi Copyright 2013, AIDIC Servizi S.r.l., ISBN 978-88-95608-24-2; ISSN 1974-9791 The Italian Association

More information

Reliability Engineering I

Reliability Engineering I Happiness is taking the reliability final exam. Reliability Engineering I ENM/MSC 565 Review for the Final Exam Vital Statistics What R&M concepts covered in the course When Monday April 29 from 4:30 6:00

More information

Continuous random variables

Continuous random variables Continuous random variables Continuous r.v. s take an uncountably infinite number of possible values. Examples: Heights of people Weights of apples Diameters of bolts Life lengths of light-bulbs We cannot

More information

Continuous Probability Distributions. Uniform Distribution

Continuous Probability Distributions. Uniform Distribution Continuous Probability Distributions Uniform Distribution Important Terms & Concepts Learned Probability Mass Function (PMF) Cumulative Distribution Function (CDF) Complementary Cumulative Distribution

More information

Sampling Random Variables

Sampling Random Variables Sampling Random Variables Introduction Sampling a random variable X means generating a domain value x X in such a way that the probability of generating x is in accordance with p(x) (respectively, f(x)),

More information

Continuous Distributions

Continuous Distributions A normal distribution and other density functions involving exponential forms play the most important role in probability and statistics. They are related in a certain way, as summarized in a diagram later

More information

Review for the previous lecture

Review for the previous lecture Lecture 1 and 13 on BST 631: Statistical Theory I Kui Zhang, 09/8/006 Review for the previous lecture Definition: Several discrete distributions, including discrete uniform, hypergeometric, Bernoulli,

More information

1 Review of Probability and Distributions

1 Review of Probability and Distributions Random variables. A numerically valued function X of an outcome ω from a sample space Ω X : Ω R : ω X(ω) is called a random variable (r.v.), and usually determined by an experiment. We conventionally denote

More information

The problems that follow illustrate the methods covered in class. They are typical of the types of problems that will be on the tests.

The problems that follow illustrate the methods covered in class. They are typical of the types of problems that will be on the tests. NUMERICAL ANALYSIS PRACTICE PROBLEMS JAMES KEESLING The problems that follow illustrate the methods covered in class. They are typical of the types of problems that will be on the tests.. Solving Equations

More information

Probability Models. 4. What is the definition of the expectation of a discrete random variable?

Probability Models. 4. What is the definition of the expectation of a discrete random variable? 1 Probability Models The list of questions below is provided in order to help you to prepare for the test and exam. It reflects only the theoretical part of the course. You should expect the questions

More information

EE/CpE 345. Modeling and Simulation. Fall Class 9

EE/CpE 345. Modeling and Simulation. Fall Class 9 EE/CpE 345 Modeling and Simulation Class 9 208 Input Modeling Inputs(t) Actual System Outputs(t) Parameters? Simulated System Outputs(t) The input data is the driving force for the simulation - the behavior

More information

Distributions of Functions of Random Variables. 5.1 Functions of One Random Variable

Distributions of Functions of Random Variables. 5.1 Functions of One Random Variable Distributions of Functions of Random Variables 5.1 Functions of One Random Variable 5.2 Transformations of Two Random Variables 5.3 Several Random Variables 5.4 The Moment-Generating Function Technique

More information

Homework 2 Fall 2018 STAT 305B Due 9/13 (R) NOTE: All work associated with a given problem part MUST be placed DIRECTLY beneath that part.

Homework 2 Fall 2018 STAT 305B Due 9/13 (R) NOTE: All work associated with a given problem part MUST be placed DIRECTLY beneath that part. Homework 2 Fall 208 STAT 305B Due 9/3 (R) Name NOTE: All work associated with a given problem part MUST be placed DIRECTLY beneath that part PROBLEM (20pts) In a recent survey [ http://wwwpewinternetorg/206/0/04/the-politics-of-climate/

More information

risk assessment of systems

risk assessment of systems 12735: Urban Systems Modeling Lec. 05 risk assessment of instructor: Matteo Pozzi C 1 C 1 C 2 C 1 C 2 C 3 C 2 C 3 C 3 1 outline definition of system; classification and representation; two state ; cut

More information

NUMERICAL ANALYSIS PROBLEMS

NUMERICAL ANALYSIS PROBLEMS NUMERICAL ANALYSIS PROBLEMS JAMES KEESLING The problems that follow illustrate the methods covered in class. They are typical of the types of problems that will be on the tests.. Solving Equations Problem.

More information

A MONTE CARLO SIMULATION APPROACH TO THE PRODUCTION AVAILABILITY EVALUATION OF AN OFFSHORE INSTALLATION WITH OPERATIONAL LOOPS

A MONTE CARLO SIMULATION APPROACH TO THE PRODUCTION AVAILABILITY EVALUATION OF AN OFFSHORE INSTALLATION WITH OPERATIONAL LOOPS A MONTE CARLO SIMULATION APPROACH TO THE PRODUCTION AVAILABILITY EVALUATION OF AN OFFSHORE INSTALLATION WITH OPERATIONAL LOOPS ENRICO ZIO, PIERO BARALDI, AND EDOARDO PATELLI Dipartimento Ingegneria Nucleare

More information

Topic 4: Continuous random variables

Topic 4: Continuous random variables Topic 4: Continuous random variables Course 3, 216 Page Continuous random variables Definition (Continuous random variable): An r.v. X has a continuous distribution if there exists a non-negative function

More information