Session #9 Critical Parameter Management & Error Budgeting

Size: px
Start display at page:

Download "Session #9 Critical Parameter Management & Error Budgeting"

Transcription

1 ESD Systems Engineering Session #9 Critical Parameter Management & Error Budgeting Dan Frey

2 Plan for the Session Follow up on session #8 Critical Parameter Management Probability Preliminaries Error Budgeting Tolerance Process Capability Building and using error budgets Next steps

3 S - Curves Atish Banergee We first studied S-curves in technology strategy The question remained why the S-curve has the peculiar shape. Well I found the answer in system dynamics. It is a general phenomenon and not restricted to technology. It can be thought of as two curves:. The lower part of the curve is growth with acceleration The upper part of the s-curve is called a goal-seeking curve and can be thought of as growth with deceleration

4 Trends in Compressor Performance Wisler, D. C., 998, Axial Flow Compressor and Fan Aerodynamics, Handbook of Fluid Dynamics, CRC Press., ed. R. Johnson.

5 Evolution of Jet Engine Performance Ghost JT3C Cruise thrust specific fuel consumption ( lb fuel/hr lb thrust ( JT3D CJ85 JT8D-9 JT9D-3 JT9D-3A CF6-5E/C CF6-6D JT8D-7 JT8D-29 JT9D-7 JT8D-27A JT9D-59A JT9D-7A RB2-524C2 CFM56-2C CF6-5E2/C2 RB2-524D4 JT9D-7R4D (B) JT8D-5 JT8D-7A JT8D-29 TAY CF6-8A/A CFM56-5A RB2-535E4 237 CF6-8C2 CFM56-3 RB2-535C RB2-524D4 UP JT9D-7R4H CFM56-5B V RB2-524D4D CFM56-5C P&W dehavilland RR GE Certification date Adapted from Koff, B. L. "Spanning the World Through Jet Propulsion. AIAA Littlewood Lecture. 99.

6 Plan for the Session Follow up on session #8 Critical Parameter Management Probability Preliminaries Error Budgeting Tolerance Process Capability Building and using error budgets Next steps

7 Critical Parameter Management CPM provides discipline and structure Produce critical parameter documentation For example, a critical parameter drawing Traces critical parameters all the way through to manufacture and use Determines process capability (C p or C pk ) Therefore, requires probabilistic thinking

8 Plan for the Session Follow up on session #8 Critical Parameter Management Probability Preliminaries Error Budgeting Tolerance Process Capability Building and using error budgets Next steps

9 Probability Definitions Sample space a list of all possible outcomes of an experiment Finest grained Mutually exclusive Collectively exhaustive Event - A collection of points in the sample space

10 Concept Question You roll 2 dice Give an example of a single point in the sample space? How might you depict the full sample space? What is an example of an event?

11 Probability Measure Axioms For any event A, P(U)= P( A) If A B=φ, then P(AUB)=P(A)+P(B) For the case of rolling two dice: A = rolling a 7 and B = rolling a on at least one die Is it the case that P(A+B)=P(A)+P(B)?

12 Discrete Random Variables A random variable that can assume any of a set of discrete values Probability mass function p x (x o ) = probability that the random variable x will take the value x o Let s build a pmf for rolling two dice p x (x) random variable x is the total x x=

13 Continuous Random Variables Can take values anywhere within continuous ranges Probability density functions obey three rules P { L < x U} f ( x) dx f x U = L ( x) for all x x f x (x) P{ L < x U } f x ( x)dx = L U x

14 Measures of Central Tendency Expected value E( g( x)) b = a g( x) Mean µ = E(x) f x ( x) dx Arithmetic average Median Mode f x (x) n n i= x i x

15 Measures of Dispersion Variance VAR( x) 2 = σ = E(( x E( x)) 2 ) Standard deviation σ = E(( x E( x)) 2 ) Sample variance n th central moment Covariance S 2 = n E(( x n i ( x i x) E( x)) E(( x E( x))( y E( y))) n ) 2

16 Sums of Random Variables Average of the sum is the sum of the average (regardless of distribution and independence) E ( x + y) = E( x) + E( y) Variance also sums iff independent σ ( x + y) = σ ( x) σ ( y This is the origin of the RSS rule Beware of the independence restriction! ) 2

17 Concept Test A bracket holds a component as shown. The dimensions are independent random variables with standard deviations as noted. Approximately what is the standard deviation of the gap? A). B). C). σ =." σ =." gap

18 Uniform Distribution A reasonable (conservative) assumption when you know the limits of a variable but little else σ = ( U L) 2 3 L U

19 Basic Application I have two spinners x=result of blue spinner y=result of red spinner z=x+y What are the pdfs for variables x, y, and z? P { a < x b} f ( x) dx b = a x f x ( x)dx = f x ( x) for all x

20 Simulation Can Quickly Answer the Question trials=;nbins=trials/; x= random('uniform',,,trials,); y= random('uniform',,2,trials,); z=x+y; subplot(3,,); hist(x,nbins); xlim([ 3]); subplot(3,,2); hist(y,nbins); xlim([ 3]); subplot(3,,3); hist(z,nbins); xlim([ 3]);

21 Probability Distribution of Sums If z is the sum of two random variables x and y z = x + Then the probability density function of z can be computed by convolution y p z ( z) = z x( z ζ ) y( ζ ) dζ

22 Convolution p z ( z) = z x( z ζ ) y( ζ ) dζ

23 Convolution p z ( z) = z x( z ζ ) y( ζ ) dζ

24 Central Limit Theorem The mean of a sequence of n iid random variables with Finite µ E ( ) 2+ δ x E( ) < δ > i x i approximates a normal distribution in the limit of a large n.

25 Normal Distribution f ( x µ ) 2 2σ x( x) = e σ 2π 2-6σ -3σ -σ µ +σ +3σ +6σ 68.3% 99.7% -2ppb

26 Joint Normal Distribution T p( x) = exp ( x ) K ( x ) m µ µ K 2 ( 2π ) The lines of constant probability density are ellipsoids If the matrix K is diagonal, then the variables are uncorrelated and independent correlated uncorrelated

27 Independence Random variables x and y are said to be independent iff f ( x, y) = f ( x) f ( y) xy x y Or, knowledge of x provides no information to update the distribution of y

28 Expectation Shift S=E(y(x))- y(e(x)) S y(e(x)) E(y(x)) f y (y(x)) E(x) Under utility theory (DBD), S is a key difference between probabilistic and deterministic design y(x) x f x (x)

29 Plan for the Session Follow up on session #8 Critical Parameter Management Probability Preliminaries Error Budgeting Tolerance Process Capability Building and using error budgets Next steps

30 Error Budgets A tool for predicting and managing variability in an engineering system A model that propagates errors through a system Links aspects of the design and its environment to tolerance and capability Used for tolerance design, robust design, diagnosis

31 Engineering Tolerances Tolerance --The total amount by which a specified dimension is permitted to vary (ANSI Y4.5M) Every component within spec adds to the yield (Y) p(y) p(q) Y L U q y

32 Tolerance on Position >25%W Lead W Land

33 Tolerance of Form wide tolerance zone THIS ON A DRAWING MEANS THIS

34 GD&T Symbols Geometric Characteristic Symbols For Individual Features For Individual or Related Features For Related Features Type of Tolerance Form Profile Orientation Location Runout Characteristic Straightness Flatness Circularity (Roundness) Cylindricity Profile of a Line Profile of a Surface Angularity Perpendicularity Parallelism Position Concentricity Circular Runout Total Runout Symbol Arrowhead(s) may be filled in.

35 Multiple Tolerances Most products have many tolerances Tolerances are pass / fail All tolerances must be met (dominance) 35

36 Variation in Manufacture Many noise factors affect the system Some noise factors affect multiple dimensions (leads to correlation) 36

37 Process Capability Indices p(q) U 2 L µ Process Capability Index Bias factor Performance Index L U + 2 k L U U + L µ 2 ( U L)/ 2 q ( U L) C /2 p 3σ C C ( k) pk p 37

38 Concept Test Motorola s 6 sigma programs suggest that we should strive for a C p of 2.. If this is achieved but the mean is off target so that k=.5, estimate the process yield.

39 C p and k Determine Yield By definition p(q) Y = p( q)dq FT U L L Y U q If Gaussian YFT = erf Cp ( k) + erf Cp ( + k) This function to maps C p and k to yield 39

40 C p and k Determine Quality Loss L(q) A o Quality Loss = A o [( U L) / 2] 2 U + d 2 L 2 L U + 2 L U q 2 E(Quality Loss) = Ao k + 2 9C p Taguchi's quality loss function ANSI's implied quality loss function

41 Crankshafts What does a crankshaft do? How would you define the tolerances? How does variation affect performance?

42 Printed Wiring Boards What does the second level connection do? How would you define the tolerances? How does variation affect performance?

43 C p and k for the System C p = LL UL k = 8. Y FT = 983%. frequency 5 5 4

44 Producibility Analysis Rolled throughput yield (Y RT )-- The probability that all tolerances are met Motorola s approach Assumes probabilistic independence Y RT = m i= Y FT i Motorola s formula 368 Y RT =. 983 =. 2% Hughes data Y RT = 66. 7% 5

45 Surface Mount Data Side #3 Side # Side to side error Side to side error Lead number Lead number Side #2 2 4 Lead number Side to side error Side #4 2 4 Lead number 6 Side to side error

46 Plan for the Session Follow up on session #8 Critical Parameter Management Probability Preliminaries Error Budgeting Tolerance Process Capability Building and using error budgets Next steps

47 Error Sources Kinematic errors Straightness Squareness Bearings Drive related errors Thermal errors Static loading Dynamics

48 Errors in a Linear Drive Lead deviation (µm) revolution Once per revolution lead error (µm) Cumulative lead error (µm/mm) Nominal travel (mm)

49 Angular Errors ε y ε y X y y z x z x OK, so you put the error in the model. Now what will happen when the machine moves? ε y X y z x

50 A Model of a Robot 5 mm 4 mm Θ z Θ z2 6 mm Z 3 mm mm z Point p x y Base

51 Errors in the Robot Error Description µ σ ε z Drive error of joint # rad. rad ε z2 Drive error of joint #2 rad. rad δ z3 Drive error of joint #3 Z..mm ε x3 Pitch of joint #3 rad.5 rad ε y3 Yaw of joint #3 rad.5 rad xp 2 Parallelism of joint 2 in the x direction.2 rad. rad

52 A Model of a Robot The matrices describe the intended motions and the errors Can be applied to any point on the end effector + Θ Θ Θ + Θ = 6 5 ) cos( sin sin ) cos( mm xp mm xp mm mm mm mm mm mm mm z z z z z z ε ε T + Θ Θ Θ + Θ 4 ) cos( sin sin ) cos( z x y x y z z z z z z Z mm mm mm mm mm mm mm mm δ ε ε ε ε ε ε = 3 ' ' ' 3 T z y x p p p NOTE: These two should be swapped

53 Homework #5 Short answers on TRIZ and probability Error budgeting Two tasks are to be done with the robot Analyze the tasks Discuss changes to the system A Matlab file is available in the HW folder just so you don t have to re-type the matrices

54 Next Steps You can download HW #5 Error Budgetting Due 8:3AM Tues 3 July See you at Thursday s session On the topic Design of Experiments 8:3AM Thursday, 8 July Reading assignment for Thursday All of Thomke Skim Box Skim Frey

HW Solution 12 Due: Dec 2, 9:19 AM

HW Solution 12 Due: Dec 2, 9:19 AM ECS 315: Probability and Random Processes 2015/1 HW Solution 12 Due: Dec 2, 9:19 AM Lecturer: Prapun Suksompong, Ph.D. Problem 1. Let X E(3). (a) For each of the following function g(x). Indicate whether

More information

Recitation 2: Probability

Recitation 2: Probability Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions

More information

Brief Review of Probability

Brief Review of Probability Brief Review of Probability Nuno Vasconcelos (Ken Kreutz-Delgado) ECE Department, UCSD Probability Probability theory is a mathematical language to deal with processes or experiments that are non-deterministic

More information

Statistics for scientists and engineers

Statistics for scientists and engineers Statistics for scientists and engineers February 0, 006 Contents Introduction. Motivation - why study statistics?................................... Examples..................................................3

More information

Review of probability. Nuno Vasconcelos UCSD

Review of probability. Nuno Vasconcelos UCSD Review of probability Nuno Vasconcelos UCSD robability probability is the language to deal with processes that are non-deterministic examples: if I flip a coin 00 times how many can I expect to see heads?

More information

Review (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology

Review (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology Review (probability, linear algebra) CE-717 : Machine Learning Sharif University of Technology M. Soleymani Fall 2012 Some slides have been adopted from Prof. H.R. Rabiee s and also Prof. R. Gutierrez-Osuna

More information

1 Introduction. Systems 2: Simulating Errors. Mobile Robot Systems. System Under. Environment

1 Introduction. Systems 2: Simulating Errors. Mobile Robot Systems. System Under. Environment Systems 2: Simulating Errors Introduction Simulating errors is a great way to test you calibration algorithms, your real-time identification algorithms, and your estimation algorithms. Conceptually, the

More information

Review (Probability & Linear Algebra)

Review (Probability & Linear Algebra) Review (Probability & Linear Algebra) CE-725 : Statistical Pattern Recognition Sharif University of Technology Spring 2013 M. Soleymani Outline Axioms of probability theory Conditional probability, Joint

More information

Course: ESO-209 Home Work: 1 Instructor: Debasis Kundu

Course: ESO-209 Home Work: 1 Instructor: Debasis Kundu Home Work: 1 1. Describe the sample space when a coin is tossed (a) once, (b) three times, (c) n times, (d) an infinite number of times. 2. A coin is tossed until for the first time the same result appear

More information

Introduction to Probability and Statistics (Continued)

Introduction to Probability and Statistics (Continued) Introduction to Probability and Statistics (Continued) Prof. icholas Zabaras Center for Informatics and Computational Science https://cics.nd.edu/ University of otre Dame otre Dame, Indiana, USA Email:

More information

Review: mostly probability and some statistics

Review: mostly probability and some statistics Review: mostly probability and some statistics C2 1 Content robability (should know already) Axioms and properties Conditional probability and independence Law of Total probability and Bayes theorem Random

More information

Joint Probability Distributions and Random Samples (Devore Chapter Five)

Joint Probability Distributions and Random Samples (Devore Chapter Five) Joint Probability Distributions and Random Samples (Devore Chapter Five) 1016-345-01: Probability and Statistics for Engineers Spring 2013 Contents 1 Joint Probability Distributions 2 1.1 Two Discrete

More information

Perhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows.

Perhaps the simplest way of modeling two (discrete) random variables is by means of a joint PMF, defined as follows. Chapter 5 Two Random Variables In a practical engineering problem, there is almost always causal relationship between different events. Some relationships are determined by physical laws, e.g., voltage

More information

for valid PSD. PART B (Answer all five units, 5 X 10 = 50 Marks) UNIT I

for valid PSD. PART B (Answer all five units, 5 X 10 = 50 Marks) UNIT I Code: 15A04304 R15 B.Tech II Year I Semester (R15) Regular Examinations November/December 016 PROBABILITY THEY & STOCHASTIC PROCESSES (Electronics and Communication Engineering) Time: 3 hours Max. Marks:

More information

Problem Set 1. MAS 622J/1.126J: Pattern Recognition and Analysis. Due: 5:00 p.m. on September 20

Problem Set 1. MAS 622J/1.126J: Pattern Recognition and Analysis. Due: 5:00 p.m. on September 20 Problem Set MAS 6J/.6J: Pattern Recognition and Analysis Due: 5:00 p.m. on September 0 [Note: All instructions to plot data or write a program should be carried out using Matlab. In order to maintain a

More information

Single Maths B: Introduction to Probability

Single Maths B: Introduction to Probability Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction

More information

Bivariate distributions

Bivariate distributions Bivariate distributions 3 th October 017 lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.) Bivariate Distributions of the Discrete Type The Correlation Coefficient

More information

Review of Statistics

Review of Statistics Review of Statistics Topics Descriptive Statistics Mean, Variance Probability Union event, joint event Random Variables Discrete and Continuous Distributions, Moments Two Random Variables Covariance and

More information

ECE531: Principles of Detection and Estimation Course Introduction

ECE531: Principles of Detection and Estimation Course Introduction ECE531: Principles of Detection and Estimation Course Introduction D. Richard Brown III WPI 15-January-2013 WPI D. Richard Brown III 15-January-2013 1 / 39 First Lecture: Major Topics 1. Administrative

More information

A Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.

A Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,

More information

Chapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory

Chapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory Chapter 1 Statistical Reasoning Why statistics? Uncertainty of nature (weather, earth movement, etc. ) Uncertainty in observation/sampling/measurement Variability of human operation/error imperfection

More information

Lecture 2: Repetition of probability theory and statistics

Lecture 2: Repetition of probability theory and statistics Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:

More information

Why study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables

Why study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section

More information

Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016

Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 8. For any two events E and F, P (E) = P (E F ) + P (E F c ). Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 Sample space. A sample space consists of a underlying

More information

Discrete Random Variables

Discrete Random Variables CPSC 53 Systems Modeling and Simulation Discrete Random Variables Dr. Anirban Mahanti Department of Computer Science University of Calgary mahanti@cpsc.ucalgary.ca Random Variables A random variable is

More information

Review of Probability. CS1538: Introduction to Simulations

Review of Probability. CS1538: Introduction to Simulations Review of Probability CS1538: Introduction to Simulations Probability and Statistics in Simulation Why do we need probability and statistics in simulation? Needed to validate the simulation model Needed

More information

Multiple Random Variables

Multiple Random Variables Multiple Random Variables This Version: July 30, 2015 Multiple Random Variables 2 Now we consider models with more than one r.v. These are called multivariate models For instance: height and weight An

More information

P (x). all other X j =x j. If X is a continuous random vector (see p.172), then the marginal distributions of X i are: f(x)dx 1 dx n

P (x). all other X j =x j. If X is a continuous random vector (see p.172), then the marginal distributions of X i are: f(x)dx 1 dx n JOINT DENSITIES - RANDOM VECTORS - REVIEW Joint densities describe probability distributions of a random vector X: an n-dimensional vector of random variables, ie, X = (X 1,, X n ), where all X is are

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 2016 MODULE 1 : Probability distributions Time allowed: Three hours Candidates should answer FIVE questions. All questions carry equal marks.

More information

IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES

IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES VARIABLE Studying the behavior of random variables, and more importantly functions of random variables is essential for both the

More information

FINAL EXAM: Monday 8-10am

FINAL EXAM: Monday 8-10am ECE 30: Probabilistic Methods in Electrical and Computer Engineering Fall 016 Instructor: Prof. A. R. Reibman FINAL EXAM: Monday 8-10am Fall 016, TTh 3-4:15pm (December 1, 016) This is a closed book exam.

More information

Probability Theory Review Reading Assignments

Probability Theory Review Reading Assignments Probability Theory Review Reading Assignments R. Duda, P. Hart, and D. Stork, Pattern Classification, John-Wiley, 2nd edition, 2001 (appendix A.4, hard-copy). "Everything I need to know about Probability"

More information

STAT 430/510: Lecture 10

STAT 430/510: Lecture 10 STAT 430/510: Lecture 10 James Piette June 9, 2010 Updates HW2 is due today! Pick up your HW1 s up in stat dept. There is a box located right when you enter that is labeled "Stat 430 HW1". It ll be out

More information

ECE531: Principles of Detection and Estimation Course Introduction

ECE531: Principles of Detection and Estimation Course Introduction ECE531: Principles of Detection and Estimation Course Introduction D. Richard Brown III WPI 22-January-2009 WPI D. Richard Brown III 22-January-2009 1 / 37 Lecture 1 Major Topics 1. Web page. 2. Syllabus

More information

Collision Avoidance Lexicon

Collision Avoidance Lexicon Collision Avoidance Lexicon 2017 An understanding of collision avoidance terminology requires an understanding of position uncertainty terminology. This lexicon therefore includes the terminology of both

More information

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random

More information

ENGR DYNAMICS. Rigid-body Lecture 4. Relative motion analysis: acceleration. Acknowledgements

ENGR DYNAMICS. Rigid-body Lecture 4. Relative motion analysis: acceleration. Acknowledgements ENGR 2030 -DYNAMICS Rigid-body Lecture 4 Relative motion analysis: acceleration Acknowledgements These lecture slides were provided by, and are the copyright of, Prentice Hall (*) as part of the online

More information

Multiple Random Variables

Multiple Random Variables Multiple Random Variables Joint Probability Density Let X and Y be two random variables. Their joint distribution function is F ( XY x, y) P X x Y y. F XY ( ) 1, < x

More information

Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com

Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com 1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix

More information

Algorithms for Uncertainty Quantification

Algorithms for Uncertainty Quantification Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example

More information

Chapter 2. Probability

Chapter 2. Probability 2-1 Chapter 2 Probability 2-2 Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance with certainty. Examples: rolling a die tossing

More information

ECE 450 Homework #3. 1. Given the joint density function f XY (x,y) = 0.5 1<x<2, 2<y< <x<4, 2<y<3 0 else

ECE 450 Homework #3. 1. Given the joint density function f XY (x,y) = 0.5 1<x<2, 2<y< <x<4, 2<y<3 0 else ECE 450 Homework #3 0. Consider the random variables X and Y, whose values are a function of the number showing when a single die is tossed, as show below: Exp. Outcome 1 3 4 5 6 X 3 3 4 4 Y 0 1 3 4 5

More information

Probability theory. References:

Probability theory. References: Reasoning Under Uncertainty References: Probability theory Mathematical methods in artificial intelligence, Bender, Chapter 7. Expert systems: Principles and programming, g, Giarratano and Riley, pag.

More information

1 Probability and Random Variables

1 Probability and Random Variables 1 Probability and Random Variables The models that you have seen thus far are deterministic models. For any time t, there is a unique solution X(t). On the other hand, stochastic models will result in

More information

where r n = dn+1 x(t)

where r n = dn+1 x(t) Random Variables Overview Probability Random variables Transforms of pdfs Moments and cumulants Useful distributions Random vectors Linear transformations of random vectors The multivariate normal distribution

More information

IEOR 3106: Introduction to Operations Research: Stochastic Models. Fall 2011, Professor Whitt. Class Lecture Notes: Thursday, September 15.

IEOR 3106: Introduction to Operations Research: Stochastic Models. Fall 2011, Professor Whitt. Class Lecture Notes: Thursday, September 15. IEOR 3106: Introduction to Operations Research: Stochastic Models Fall 2011, Professor Whitt Class Lecture Notes: Thursday, September 15. Random Variables, Conditional Expectation and Transforms 1. Random

More information

ECE 636: Systems identification

ECE 636: Systems identification ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental

More information

Cams. 774 l Theory of Machines

Cams. 774 l Theory of Machines 774 l Theory of Machines 0 Fea eatur tures es 1. Introduction.. Classification of Followers. 3. Classification of Cams. 4. Terms used in Radial cams. 5. Motion of the Follower. 6. Displacement, Velocity

More information

CS37300 Class Notes. Jennifer Neville, Sebastian Moreno, Bruno Ribeiro

CS37300 Class Notes. Jennifer Neville, Sebastian Moreno, Bruno Ribeiro CS37300 Class Notes Jennifer Neville, Sebastian Moreno, Bruno Ribeiro 2 Background on Probability and Statistics These are basic definitions, concepts, and equations that should have been covered in your

More information

2. Variance and Covariance: We will now derive some classic properties of variance and covariance. Assume real-valued random variables X and Y.

2. Variance and Covariance: We will now derive some classic properties of variance and covariance. Assume real-valued random variables X and Y. CS450 Final Review Problems Fall 08 Solutions or worked answers provided Problems -6 are based on the midterm review Identical problems are marked recap] Please consult previous recitations and textbook

More information

ME 597: AUTONOMOUS MOBILE ROBOTICS SECTION 2 PROBABILITY. Prof. Steven Waslander

ME 597: AUTONOMOUS MOBILE ROBOTICS SECTION 2 PROBABILITY. Prof. Steven Waslander ME 597: AUTONOMOUS MOBILE ROBOTICS SECTION 2 Prof. Steven Waslander p(a): Probability that A is true 0 pa ( ) 1 p( True) 1, p( False) 0 p( A B) p( A) p( B) p( A B) A A B B 2 Discrete Random Variable X

More information

Multivariate Random Variable

Multivariate Random Variable Multivariate Random Variable Author: Author: Andrés Hincapié and Linyi Cao This Version: August 7, 2016 Multivariate Random Variable 3 Now we consider models with more than one r.v. These are called multivariate

More information

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature

More information

Advanced Signal Processing Introduction to Estimation Theory

Advanced Signal Processing Introduction to Estimation Theory Advanced Signal Processing Introduction to Estimation Theory Danilo Mandic, room 813, ext: 46271 Department of Electrical and Electronic Engineering Imperial College London, UK d.mandic@imperial.ac.uk,

More information

Random Variables. Cumulative Distribution Function (CDF) Amappingthattransformstheeventstotherealline.

Random Variables. Cumulative Distribution Function (CDF) Amappingthattransformstheeventstotherealline. Random Variables Amappingthattransformstheeventstotherealline. Example 1. Toss a fair coin. Define a random variable X where X is 1 if head appears and X is if tail appears. P (X =)=1/2 P (X =1)=1/2 Example

More information

Section 8.1. Vector Notation

Section 8.1. Vector Notation Section 8.1 Vector Notation Definition 8.1 Random Vector A random vector is a column vector X = [ X 1 ]. X n Each Xi is a random variable. Definition 8.2 Vector Sample Value A sample value of a random

More information

Outline. Random Variables. Examples. Random Variable

Outline. Random Variables. Examples. Random Variable Outline Random Variables M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno Random variables. CDF and pdf. Joint random variables. Correlated, independent, orthogonal. Correlation,

More information

Intelligent Embedded Systems Uncertainty, Information and Learning Mechanisms (Part 1)

Intelligent Embedded Systems Uncertainty, Information and Learning Mechanisms (Part 1) Advanced Research Intelligent Embedded Systems Uncertainty, Information and Learning Mechanisms (Part 1) Intelligence for Embedded Systems Ph. D. and Master Course Manuel Roveri Politecnico di Milano,

More information

Lecture 10: Probability distributions TUESDAY, FEBRUARY 19, 2019

Lecture 10: Probability distributions TUESDAY, FEBRUARY 19, 2019 Lecture 10: Probability distributions DANIEL WELLER TUESDAY, FEBRUARY 19, 2019 Agenda What is probability? (again) Describing probabilities (distributions) Understanding probabilities (expectation) Partial

More information

L2: Review of probability and statistics

L2: Review of probability and statistics Probability L2: Review of probability and statistics Definition of probability Axioms and properties Conditional probability Bayes theorem Random variables Definition of a random variable Cumulative distribution

More information

Lecture 2: Review of Basic Probability Theory

Lecture 2: Review of Basic Probability Theory ECE 830 Fall 2010 Statistical Signal Processing instructor: R. Nowak, scribe: R. Nowak Lecture 2: Review of Basic Probability Theory Probabilistic models will be used throughout the course to represent

More information

CS491/691: Introduction to Aerial Robotics

CS491/691: Introduction to Aerial Robotics CS491/691: Introduction to Aerial Robotics Topic: Midterm Preparation Dr. Kostas Alexis (CSE) Areas of Focus Coordinate system transformations (CST) MAV Dynamics (MAVD) Navigation Sensors (NS) State Estimation

More information

ECE Homework Set 3

ECE Homework Set 3 ECE 450 1 Homework Set 3 0. Consider the random variables X and Y, whose values are a function of the number showing when a single die is tossed, as show below: Exp. Outcome 1 3 4 5 6 X 3 3 4 4 Y 0 1 3

More information

Math Camp. September 16, 2017 Unit 2. MSSM Program Columbia University Dr. Satyajit Bose

Math Camp. September 16, 2017 Unit 2. MSSM Program Columbia University Dr. Satyajit Bose Math Camp September 16, 2017 Unit 2 MSSM Program Columbia University Dr. Satyajit Bose Math Camp Interlude Partial Derivatives Recall:The derivative f'(x) of a function f(x) is the slope of f(x). Alternatively,

More information

Curriculum Map for Mathematics SL (DP1)

Curriculum Map for Mathematics SL (DP1) Unit Title (Time frame) Topic 1 Algebra (8 teaching hours or 2 weeks) Curriculum Map for Mathematics SL (DP1) Standards IB Objectives Knowledge/Content Skills Assessments Key resources Aero_Std_1: Make

More information

E X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl.

E X A M. Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours. Number of pages incl. E X A M Course code: Course name: Number of pages incl. front page: 6 MA430-G Probability Theory and Stochastic Processes Date: December 13, 2016 Duration: 4 hours Resources allowed: Notes: Pocket calculator,

More information

Preliminary statistics

Preliminary statistics 1 Preliminary statistics The solution of a geophysical inverse problem can be obtained by a combination of information from observed data, the theoretical relation between data and earth parameters (models),

More information

Multivariate probability distributions and linear regression

Multivariate probability distributions and linear regression Multivariate probability distributions and linear regression Patrik Hoyer 1 Contents: Random variable, probability distribution Joint distribution Marginal distribution Conditional distribution Independence,

More information

Part IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015

Part IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015 Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.

More information

Lecture 2: Review of Probability

Lecture 2: Review of Probability Lecture 2: Review of Probability Zheng Tian Contents 1 Random Variables and Probability Distributions 2 1.1 Defining probabilities and random variables..................... 2 1.2 Probability distributions................................

More information

Discrete Probability Refresher

Discrete Probability Refresher ECE 1502 Information Theory Discrete Probability Refresher F. R. Kschischang Dept. of Electrical and Computer Engineering University of Toronto January 13, 1999 revised January 11, 2006 Probability theory

More information

Lecture 11. Probability Theory: an Overveiw

Lecture 11. Probability Theory: an Overveiw Math 408 - Mathematical Statistics Lecture 11. Probability Theory: an Overveiw February 11, 2013 Konstantin Zuev (USC) Math 408, Lecture 11 February 11, 2013 1 / 24 The starting point in developing the

More information

Review of Basic Probability Theory

Review of Basic Probability Theory Review of Basic Probability Theory James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) 1 / 35 Review of Basic Probability Theory

More information

3. Review of Probability and Statistics

3. Review of Probability and Statistics 3. Review of Probability and Statistics ECE 830, Spring 2014 Probabilistic models will be used throughout the course to represent noise, errors, and uncertainty in signal processing problems. This lecture

More information

Summarizing Measured Data

Summarizing Measured Data Performance Evaluation: Summarizing Measured Data Hongwei Zhang http://www.cs.wayne.edu/~hzhang The object of statistics is to discover methods of condensing information concerning large groups of allied

More information

Probability Background

Probability Background Probability Background Namrata Vaswani, Iowa State University August 24, 2015 Probability recap 1: EE 322 notes Quick test of concepts: Given random variables X 1, X 2,... X n. Compute the PDF of the second

More information

Lecture 7: Statistics and the Central Limit Theorem. Philip Moriarty,

Lecture 7: Statistics and the Central Limit Theorem. Philip Moriarty, Lecture 7: Statistics and the Central Limit Theorem Philip Moriarty, philip.moriarty@nottingham.ac.uk NB Notes based heavily on lecture slides prepared by DE Rourke for the F32SMS module, 2006 7.1 Recap

More information

, respectively to the inverse and the inverse differential problem. Check the correctness of the obtained results. Exercise 2 y P 2 P 1.

, respectively to the inverse and the inverse differential problem. Check the correctness of the obtained results. Exercise 2 y P 2 P 1. Robotics I July 8 Exercise Define the orientation of a rigid body in the 3D space through three rotations by the angles α β and γ around three fixed axes in the sequence Y X and Z and determine the associated

More information

ACE 562 Fall Lecture 2: Probability, Random Variables and Distributions. by Professor Scott H. Irwin

ACE 562 Fall Lecture 2: Probability, Random Variables and Distributions. by Professor Scott H. Irwin ACE 562 Fall 2005 Lecture 2: Probability, Random Variables and Distributions Required Readings: by Professor Scott H. Irwin Griffiths, Hill and Judge. Some Basic Ideas: Statistical Concepts for Economists,

More information

EEL 5544 Noise in Linear Systems Lecture 30. X (s) = E [ e sx] f X (x)e sx dx. Moments can be found from the Laplace transform as

EEL 5544 Noise in Linear Systems Lecture 30. X (s) = E [ e sx] f X (x)e sx dx. Moments can be found from the Laplace transform as L30-1 EEL 5544 Noise in Linear Systems Lecture 30 OTHER TRANSFORMS For a continuous, nonnegative RV X, the Laplace transform of X is X (s) = E [ e sx] = 0 f X (x)e sx dx. For a nonnegative RV, the Laplace

More information

Probability Theory for Machine Learning. Chris Cremer September 2015

Probability Theory for Machine Learning. Chris Cremer September 2015 Probability Theory for Machine Learning Chris Cremer September 2015 Outline Motivation Probability Definitions and Rules Probability Distributions MLE for Gaussian Parameter Estimation MLE and Least Squares

More information

LECTURE NOTES FYS 4550/FYS EXPERIMENTAL HIGH ENERGY PHYSICS AUTUMN 2013 PART I A. STRANDLIE GJØVIK UNIVERSITY COLLEGE AND UNIVERSITY OF OSLO

LECTURE NOTES FYS 4550/FYS EXPERIMENTAL HIGH ENERGY PHYSICS AUTUMN 2013 PART I A. STRANDLIE GJØVIK UNIVERSITY COLLEGE AND UNIVERSITY OF OSLO LECTURE NOTES FYS 4550/FYS9550 - EXPERIMENTAL HIGH ENERGY PHYSICS AUTUMN 2013 PART I PROBABILITY AND STATISTICS A. STRANDLIE GJØVIK UNIVERSITY COLLEGE AND UNIVERSITY OF OSLO Before embarking on the concept

More information

Probability and statistics; Rehearsal for pattern recognition

Probability and statistics; Rehearsal for pattern recognition Probability and statistics; Rehearsal for pattern recognition Václav Hlaváč Czech Technical University in Prague Czech Institute of Informatics, Robotics and Cybernetics 166 36 Prague 6, Jugoslávských

More information

WEEK 1 Dynamics of Machinery

WEEK 1 Dynamics of Machinery WEEK 1 Dynamics of Machinery References Theory of Machines and Mechanisms, J.J. Uicker, G.R.Pennock ve J.E. Shigley, 2003 Makine Dinamiği, Prof. Dr. Eres SÖYLEMEZ, 2013 Uygulamalı Makine Dinamiği, Jeremy

More information

ECE 650 1/11. Homework Sets 1-3

ECE 650 1/11. Homework Sets 1-3 ECE 650 1/11 Note to self: replace # 12, # 15 Homework Sets 1-3 HW Set 1: Review Assignment from Basic Probability 1. Suppose that the duration in minutes of a long-distance phone call is exponentially

More information

6.01: Introduction to EECS I. Discrete Probability and State Estimation

6.01: Introduction to EECS I. Discrete Probability and State Estimation 6.01: Introduction to EECS I Discrete Probability and State Estimation April 12, 2011 Midterm Examination #2 Time: Location: Tonight, April 12, 7:30 pm to 9:30 pm Walker Memorial (if last name starts with

More information

HOMEWORK #4: LOGISTIC REGRESSION

HOMEWORK #4: LOGISTIC REGRESSION HOMEWORK #4: LOGISTIC REGRESSION Probabilistic Learning: Theory and Algorithms CS 274A, Winter 2018 Due: Friday, February 23rd, 2018, 11:55 PM Submit code and report via EEE Dropbox You should submit a

More information

Introduction to Statistical Methods for High Energy Physics

Introduction to Statistical Methods for High Energy Physics Introduction to Statistical Methods for High Energy Physics 2011 CERN Summer Student Lectures Glen Cowan Physics Department Royal Holloway, University of London g.cowan@rhul.ac.uk www.pp.rhul.ac.uk/~cowan

More information

Physics 218 Lecture 19

Physics 218 Lecture 19 Physics 218 Lecture 19 Dr. David Toback Physics 218, Lecture XIX 1 Checklist for Today Things due Last Thursday: Read Chapters 12 & 13 Things that were due Monday: Chapter 10 & 11 HW on WebCT Things that

More information

Fundamentals. CS 281A: Statistical Learning Theory. Yangqing Jia. August, Based on tutorial slides by Lester Mackey and Ariel Kleiner

Fundamentals. CS 281A: Statistical Learning Theory. Yangqing Jia. August, Based on tutorial slides by Lester Mackey and Ariel Kleiner Fundamentals CS 281A: Statistical Learning Theory Yangqing Jia Based on tutorial slides by Lester Mackey and Ariel Kleiner August, 2011 Outline 1 Probability 2 Statistics 3 Linear Algebra 4 Optimization

More information

Conditional distributions

Conditional distributions Conditional distributions Will Monroe July 6, 017 with materials by Mehran Sahami and Chris Piech Independence of discrete random variables Two random variables are independent if knowing the value of

More information

Lesson of Mechanics and Machines done in the 5th A-M, by the teacher Pietro Calicchio. THE GEARS CYLINDRICAL STRAIGHT TEETH GEARS

Lesson of Mechanics and Machines done in the 5th A-M, by the teacher Pietro Calicchio. THE GEARS CYLINDRICAL STRAIGHT TEETH GEARS MESA PROJECT Lesson of Mechanics and Machines done in the 5th A-M, 2012-2013 by the teacher Pietro Calicchio. THE GEARS To transmit high power are usually used gear wheels. In this case, the transmission

More information

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models Fatih Cavdur fatihcavdur@uludag.edu.tr March 20, 2012 Introduction Introduction The world of the model-builder

More information

Review of probability

Review of probability Review of probability Computer Sciences 760 Spring 2014 http://pages.cs.wisc.edu/~dpage/cs760/ Goals for the lecture you should understand the following concepts definition of probability random variables

More information

ECE302 Spring 2015 HW10 Solutions May 3,

ECE302 Spring 2015 HW10 Solutions May 3, ECE32 Spring 25 HW Solutions May 3, 25 Solutions to HW Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in italics where

More information

STAT2201. Analysis of Engineering & Scientific Data. Unit 3

STAT2201. Analysis of Engineering & Scientific Data. Unit 3 STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random

More information

Miscellaneous. Regarding reading materials. Again, ask questions (if you have) and ask them earlier

Miscellaneous. Regarding reading materials. Again, ask questions (if you have) and ask them earlier Miscellaneous Regarding reading materials Reading materials will be provided as needed If no assigned reading, it means I think the material from class is sufficient Should be enough for you to do your

More information

Probability Space. J. McNames Portland State University ECE 538/638 Stochastic Signals Ver

Probability Space. J. McNames Portland State University ECE 538/638 Stochastic Signals Ver Stochastic Signals Overview Definitions Second order statistics Stationarity and ergodicity Random signal variability Power spectral density Linear systems with stationary inputs Random signal memory Correlation

More information

Expected value of r.v. s

Expected value of r.v. s 10 Epected value of r.v. s CDF or PDF are complete (probabilistic) descriptions of the behavior of a random variable. Sometimes we are interested in less information; in a partial characterization. 8 i

More information

Lecture 1: August 28

Lecture 1: August 28 36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 1: August 28 Our broad goal for the first few lectures is to try to understand the behaviour of sums of independent random

More information