Week 1 Quantitative Analysis of Financial Markets Distributions A
|
|
- Claude Murphy
- 6 years ago
- Views:
Transcription
1 Week 1 Quantitative Analysis of Financial Markets Distributions A Christopher Ting Christopher Ting : christopherting@smu.edu.sg : : LKCSB 5036 October 29, 2017 Christopher Ting QF 603 October 29, /44
2 Table of Contents 1 Introduction 2 Discrete Distributions 3 Continuous Piecewise Linear Distributions 4 Continuous Distributions 5 Takeaways Christopher Ting QF 603 October 29, /44
3 Introduction It is important to distinguish between discrete distribution versus continuous distribution. Probability distributions can be divided into two broad categories: parametric distributions, which is described by a mathematical function nonparametric distributions, which are not described by a mathematical formula A major advantage of dealing with nonparametric distributions is that assumptions required are minimum. Data speak for themselves. Christopher Ting QF 603 October 29, /44
4 Chapter 4. Learning Outcomes of QA03 Michael Miller, Mathematics and Statistics for Financial Risk Management, 2nd Edition. (Hoboken, NJ: John Wiley & Sons, 2013). Distinguish the key properties and identify common occurrences of each distributions. Discrete Bernoulli distribution Binomial distribution Poisson distribution Continuous Piecewise Linear Uniform distribution Continuous and differential Normal distribution Lognormal distribution Chi-squared distribution Triangular distribution Student s t distribution F distribution Christopher Ting QF 603 October 29, /44
5 Bernoulli Distribution A Bernoulli random variable X is equal to either zero or one. If we define p as the probability that X equals one, we have P ( X = 1 ) = p; P ( X = 0 ) = 1 p. Binary outcomes are common in finance: a bond can default or not default; the return of a stock can be positive or negative; a central bank can decide to raise rates or not to raise rates. The mean and variance of a Bernoulli random variable are µ = p 1 + (1 p) 0 = p σ 2 = p (1 p) 2 + (1 p) (0 p) 2 = p(1 p). Bernoulli Distribution is discrete, and parametric with p being the only parameter. Christopher Ting QF 603 October 29, /44
6 More on Bernoulli Distribution The probability of a Bernoulli random variable can be written as P(X = x) = p x (1 p) 1 x. The cumulative distribution function is F (X = x) = { 1 p, for x = 0; 1, for x = p How can we estimate p of a coin for the head to turn up? Christopher Ting QF 603 October 29, /44
7 More on Bernoulli Distribution (cont d) Throw N times, and count the number (n) of times the head has turned up. Then p = n N. Is this estimator unbiased? To answer this question, we need the binomial distribution. Christopher Ting QF 603 October 29, /44
8 Binomial Distribution The binomial distribution gives the discrete probability distribution P(n, N; p) of obtaining exactly n successes out of N Bernoulli trials. The binomial distribution is given by ( ) N P(n; N, p) = p n (1 p) N n. n The cumulative distribution function is k ( ) N F (k; N, p) = P(X k) = p i (1 p) N i, i where the symbol k is the largest integer smaller than k. i=0 Christopher Ting QF 603 October 29, /44
9 Unbiasedness of p Y The probability of obtaining n successes in N trials is the binomial probability: P(n; N, p). Y The expected value of the estimator p = n/n is therefore given by E ( p ) = = p N n=0 n N N n=1 ( ) N p n( 1 p ) N n N = p n n=1 (N 1)! (N n)!(n 1)! pn 1 (1 p) (N 1) (n 1) = p ( 1 p ) N 1 N 1 = p ( 1 p ) ( N 1 m=0 ( )( N 1 p ) m m 1 p ) N 1 = p ( 1 p ) N p 1 p N! n (N n)!n! N pn 1 (1 p) N n ( ) 1 N 1 = p. 1 p Christopher Ting QF 603 October 29, /44
10 Mean of Binomial Distribution Y Consider the moment generating function M(t), which is the expected value of e tn with t being the (auxiliary) variable. M(t) = E ( e tn) = = N n=0 N ( ) N e tn p n (1 p) N n n n=0 ( ) N (pe t ) n (1 p) N n n = ( pe t + (1 p) ) N Y The first derivative of M(t) with respect to t is M (t) = N ( pe t + (1 p) ) N 1( pe t ). The mean is µ = M (0) = N(p + 1 p)p = Np. Christopher Ting QF 603 October 29, /44
11 Variance of Binomial Distribution Y The second derivative is M (t) = N(N 1) ( pe t +(1 p) ) N 2( pe t ) 2 +N ( pe t +(1 p) ) N 1( pe t ). Y At t = 0, E ( X 2) = M (0) = N(N 1)p 2 + Np. Y Since V ( X ) = E ( X 2) µ 2, we find that V ( X ) = Np(1 p). Y What is your intuition for mean being Np and variance being Np(1 p)? Christopher Ting QF 603 October 29, /44
12 Sample Problem Y Suppose you have four bonds, each with a 10% probability of defaulting over the next year. The event of default for any given bond is independent of the other bonds defaulting. What is the probability that zero, one, two, three, or all of the bonds default? What is the mean number of defaults? The standard deviation? Y Answer: We calculate the probability of each possible outcome as follows: ( ) n Defaults k p k (1 p) n k Probability % 65.61% % 29.16% % 4.86% % 0.36% % 0.01% Christopher Ting QF 603 October 29, /44
13 Binomial Probability Mass Function Christopher Ting QF 603 October 29, /44
14 Poisson Distribution j For a Poisson random variable X, P ( X = n ) = λn n! e λ, where λ is the constant parameter. j The Poisson distribution is often used to model 1 the occurrence of events over time such as the number of bond defaults in a portfolio or the number of crashes in equity markets. 2 jumps in jump-diffusion models Christopher Ting QF 603 October 29, /44
15 Poisson Distribution from Binomial Model j Recall that the probability of obtaining exactly n successes in N Bernoulli trials is given by P ( X = n; N, p ) = N! n!(n n)! pn (1 p) N n. j Viewing the distribution as a function of the expected number of successes λ := Np instead of the sample size N for fixed p, we write P ( X = n; N, λ := Np ) ( ) N! λ n ( = 1 λ ) N n. n!(n n)! N N Christopher Ting QF 603 October 29, /44
16 Poisson Distribution from Binomial Model (cont d) j What happens if the sample size N becomes large, even infinite? P λ (n) := lim N P ( X = n; N, λ := Np, ) = lim N = lim N N(N 1) (N n + 1) n! λ n N n N(N 1) (N n + 1) λ n N n n! = 1 λn n! e λ 1 = λn n! e λ ( 1 λ ) N ( 1 λ ) n N N ( 1 λ N j Poisson distribution is a limiting case of binomial model. ) N ( 1 λ ) n N Christopher Ting QF 603 October 29, /44
17 Mean of Poisson Random Variable j First we show that P λ (n), n = 0, 1, 2,..., indeed adds up to 1. j The mean is P λ (n) = e λ n=0 np λ (n) = e λ n=0 n=0 n=0 λ n n! = e λ e λ = 1. n λn n! = e λ λ n=0 λ n 1 (n 1)! = λ. Christopher Ting QF 603 October 29, /44
18 Variance of Poisson Random Variable j To compute variance, we first compute, knowing that n 2 = n(n 1) + n, n 2 P λ (n) = e λ λ 2 n=0 n=0 λ n 2 (n 2)! + e λ λ j Hence the variance is λ 2 + λ λ 2 = λ. n=0 λ n 1 (n 1)! = λ2 + λ. Christopher Ting QF 603 October 29, /44
19 Poisson Process j If the rate at which events occur over time is constant, and the probability of any one event occurring is independent of all other events, then we say that the events follow a Poisson process: P ( X := N(t + τ) N(t) = n ) = (λτ)n e λτ. n! Here, N(t + τ) N(t) = n is the number of events in the time interval (t, t + τ]. j The mean and variance of a Poisson process are the same: λt. Christopher Ting QF 603 October 29, /44
20 Probability Mass Function and CDF Probability Mass Function Cumulative Distribution Function Source: Christopher Ting QF 603 October 29, /44
21 Sample Problem j Assume that defaults in a large bond portfolio follow a Poisson process. The expected number of defaults each month is four. What is the probability that there are exactly three defaults over the course of one month? Over two months? j Over one month, the probability is P ( X = 3 ) = (λτ)n e λτ = n! j Over two months, the probability is P ( X = 3 ) = (λτ)n e λτ = n! (4 1)3 e 4 1 = 19.5%. 3! (4 2)3 e 4 2 = 2.9%. 3! Christopher Ting QF 603 October 29, /44
22 Uniform Distribution B So far, we have been talking about discrete distributions. B The continuous uniform distribution is one of the most fundamental distributions in statistics. B For all x [b 1, b 2 ], u(b 1, b 2 ) = c. In other words, the probability density is constant and equal to c between b 1 and b 2, and zero everywhere else. B Because the probability of any outcome occurring must be one, you can find the value of c as. Christopher Ting QF 603 October 29, /44
23 Mean, Variance, PDF, and CDF B The mean of the uniform random variable is. B Probability Density Function c B The variance of the uniform random variable is. 0 b 1 b 2 B The cumulative distribution function is. Christopher Ting QF 603 October 29, /44
24 Application of Uniform Random Variable B In a computer simulation, one way to model a Bernoulli variable is to start with a standard uniform variable, which is when b 1 = 0 and b 2 = 1. Christopher Ting QF 603 October 29, /44
25 Triangular Distribution Example d The PDF for a triangular distribution with a minimum of a, a maximum of b, and a mode of c is described by the following two-part function: f(x) = 2(x a), x [a, c] (b a)(c a) 2(b x), x (c, b] (b a)(b c) d When modeling default rates and recovery rates, triangular distributions are useful. d Class Exercise: What are the values of a, b, and c for the example? Christopher Ting QF 603 October 29, /44
26 Normal Distribution C Normal distribution is also referred to as the Gaussian distribution. C For a random variable X, the probability density function for the normal distribution is and we write f(x; µ, σ) = 1 σ 2π e 1 X N(µ, σ 2), 2( x µ σ ) 2, which means X is normally distributed with mean µ and variance σ 2. Christopher Ting QF 603 October 29, /44
27 Properties of Normal Random Variable C Any linear combination of independent normal random variables is also normal. ( ) Z = ax + by N aµ X + bµ Y, a 2 σx 2 + b 2 σy 2. C Example: If the log returns of individual stocks are independent and normally distributed, then the average return of those stocks will also be normally distributed. C The bell shape curve has 0 skewness and kurtosis of 3. Christopher Ting QF 603 October 29, /44
28 Standard Normal Random Variable C Standard normal distribution is N(0, 1) with the probability density function: φ(x) = 1 e 1 2 x2. 2π C Because a linear combination of independent normal distributions is also normal, standard normal distributions are the building blocks of many financial models. C To get a normal variable with a standard deviation of σ and a mean of µ, we simply multiply the standard normal variable ϕ by σ and add µ. X = µ + σϕ N(µ, σ 2). Christopher Ting QF 603 October 29, /44
29 Two Correlated Normal Variables C To create two correlated normal variables, we can combine three independent standard normal variables, X 1, X 2, and X 3, as follows: X A = ρx ρx 2 X B = ρx ρx 3 C Class Exercise: Show that X A and X B are standard normal random variables. C Class Exercise: Show that X A and X B are indeed correlated with correlation coefficient ρ. Christopher Ting QF 603 October 29, /44
30 Log Return and Normal Distribution C Normal distributions are used throughout finance and risk management. C Normally distributed log returns are widely used in financial simulations as well, and form the basis of a number of financial models, including the Black-Scholes option pricing model. C One attribute that makes log returns particularly attractive is that they can be modeled using normal distributions. 1 A normal random variable can realize values ranging from to. 2 Simple return has a minimum, -100%. 3 But log return does not have a minimum as it can potentially be, and thus more amenable to modeling by a normal distribution. Christopher Ting QF 603 October 29, /44
31 Normal Distribution Confidence Intervals One-Tailed Two-Tailed 1.00% % % % % % % % C The normal distribution is symmetrical, 5% of the values are less than 1.64 standard deviations below the mean. C The two-tailed value tells you that 95% of the mass is within ±1.96 standard deviations of the mean. So, % of the outcomes are less than standard deviations from the mean. Christopher Ting QF 603 October 29, /44
32 Lognormal Distribution g Can we use another distribution and model the standard simple returns directly? g Yes, use the lognormal distribution instead. For x > 0, f(x) = 1 xσ 2π e 1 2 ( ) ln(x) µ 2 σ. g If a variable has a lognormal distribution, then the log of that variable has a normal distribution. So, if log returns are assumed to be normally distributed, then one plus the simple return will be lognormally distributed. g Using the lognormal distribution provides an easy way to ensure that returns less than -100% are avoided. Christopher Ting QF 603 October 29, /44
33 More on Lognormal Distribution g The lognormal pdf can also be written as f(x) = e 1 2 σ2 µ 1 σ 2π e ( 1 2 ) ln x (µ σ 2 2 ) σ. It shows that the lognormal distribution is asymmetrical and peaks at exp ( µ σ 2). g Given µ and σ, the mean and variance are given by E ( X ) = e µ+ 1 2 σ2 V ( X ) = ( e σ2 1 ) e 2µ+σ2. g When it comes to modeling, it is often easier to work with log returns and normal distributions than with standard returns and lognormal distributions. Christopher Ting QF 603 October 29, /44
34 Chi-Squared Distribution c If we have k independent standard normal variables, Z 1, Z 2,..., Z k, then the sum of their squares, S, has a chi-squared distribution. S := k Z 2 i ; i=1 S χ 2 k c The variable k is commonly referred to as the degrees of freedom. c For positive values of x, the probability density function for the chi-squared distribution is f(x) = 1 2 k/2 Γ (k/2) x k 2 1 e x 2, where Γ is the gamma function: Γ (n) := 0 x n 1 e x dx. Christopher Ting QF 603 October 29, /44
35 Chi-Square Probability Density Function Christopher Ting QF 603 October 29, /44
36 More on Chi-Squared Distribution c The mean of the distribution is k, and the variance is 2k. c As k increases, the chi-squared distribution becomes increasingly symmetrical. As k approaches infinity, the chi-squared distribution converges to the normal distribution. c The chi-squared distribution is widely used in risk management, and in statistics in general, for hypothesis testing. Christopher Ting QF 603 October 29, /44
37 Student s t Distribution e William Sealy Gosset, an employee at the Guinness brewery in Dublin, used the pseudonym Student for journal publications. e If Z is a standard normal variable and U is a chi-square variable with k degrees of freedom, which is independent of Z, then the random variable X, X = Z, U/k follows a t distribution with k degrees of freedom. e The probability density function of Student s t random variable is f(x) = Γ ( ) k+1 ) k+1 2 ( kπ Γ k ) (1 + x2 2, k 2 where k is the degrees of freedom and Γ (x) is the gamma function. Christopher Ting QF 603 October 29, /44
38 Characteristics of Student s t Distribution e The t distribution is symmetrical around its mean, which is equal to zero. e For low values of k, the t distribution looks very similar to a standard normal distribution, except that it displays excess kurtosis. e As k increases, this excess kurtosis decreases. In fact, as k approaches infinity, the t distribution converges to a standard normal distribution. k e The variance of the t distribution for k > 2 is k 2. As k increases, the variance of the t distribution converges to one, the variance of the standard normal distribution. Christopher Ting QF 603 October 29, /44
39 Comparison of t Distributions Christopher Ting QF 603 October 29, /44
40 F -Distribution A If U 1 and U 2 are two independent chi-squared distributions with k 1 and k 2 degrees of freedom, respectively, then X, X = U 1/k 1 U 2 /k 2 F (k 1, k 2 ) follows an F -distribution with parameters k 1 and k 2. A The probability density function of the F -distribution is f(x) = where B(x, y) is the beta function: B(x, y) = 1 (k 1 x) k 1 k k 2 2 (k 1 x+k 2 ) k1 +k 2 xb ( k 1 /2, k 2 /2 ), 0 z x 1 (1 z) y 1 dz. Christopher Ting QF 603 October 29, /44
41 A Bit More on F -Distribution A The mean and variance of the F -distribution are as follows µ = k 2 k 2 2, for k 2 > 2, ( σ 2 = 2k2 2 k1 + k 2 2 ) ( k 1 k2 2 ) 2 (k2 4), for k 2 > 4. A As k 1 and k 2 increase to infinity, the mean and mode converge to one, and the F -distribution converges to a normal distribution. A The square of a variable with a t distribution has an F -distribution. More specifically, if X is a random variable with a t distribution with k degrees of freedom, then X 2 has an F -distribution with 1 and k degrees of freedom: X 2 F (1, k). Christopher Ting QF 603 October 29, /44
42 F Probability Density Function Christopher Ting QF 603 October 29, /44
43 Takeaways a All the 10 distributions are parametric, being dependent on parameters that can be interpreted intuitively. a Additionally, Student s t, χ 2, and F distributions need degrees of freedom to determine their shape. a Probability mass function is the discrete analogue of probability density function. a χ 2 is the sum of k squared of independent standard normal variables. a t variable is made of a standard normal random variable and a χ 2 random variable, which are independent. a The F random variable is the ratio of two independent χ 2 random variables. Christopher Ting QF 603 October 29, /44
Probability Distributions Columns (a) through (d)
Discrete Probability Distributions Columns (a) through (d) Probability Mass Distribution Description Notes Notation or Density Function --------------------(PMF or PDF)-------------------- (a) (b) (c)
More informationWeek 2 Quantitative Analysis of Financial Markets Bayesian Analysis
Week 2 Quantitative Analysis of Financial Markets Bayesian Analysis Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 October
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationProbabilities & Statistics Revision
Probabilities & Statistics Revision Christopher Ting Christopher Ting http://www.mysmu.edu/faculty/christophert/ : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 January 6, 2017 Christopher Ting QF
More informationProbability. Table of contents
Probability Table of contents 1. Important definitions 2. Distributions 3. Discrete distributions 4. Continuous distributions 5. The Normal distribution 6. Multivariate random variables 7. Other continuous
More informationStatistical Methods in Particle Physics
Statistical Methods in Particle Physics Lecture 3 October 29, 2012 Silvia Masciocchi, GSI Darmstadt s.masciocchi@gsi.de Winter Semester 2012 / 13 Outline Reminder: Probability density function Cumulative
More information1: PROBABILITY REVIEW
1: PROBABILITY REVIEW Marek Rutkowski School of Mathematics and Statistics University of Sydney Semester 2, 2016 M. Rutkowski (USydney) Slides 1: Probability Review 1 / 56 Outline We will review the following
More informationBMIR Lecture Series on Probability and Statistics Fall, 2015 Uniform Distribution
Lecture #5 BMIR Lecture Series on Probability and Statistics Fall, 2015 Department of Biomedical Engineering and Environmental Sciences National Tsing Hua University s 5.1 Definition ( ) A continuous random
More information3 Continuous Random Variables
Jinguo Lian Math437 Notes January 15, 016 3 Continuous Random Variables Remember that discrete random variables can take only a countable number of possible values. On the other hand, a continuous random
More information1 Review of Probability
1 Review of Probability Random variables are denoted by X, Y, Z, etc. The cumulative distribution function (c.d.f.) of a random variable X is denoted by F (x) = P (X x), < x
More informationLecture 2: Review of Probability
Lecture 2: Review of Probability Zheng Tian Contents 1 Random Variables and Probability Distributions 2 1.1 Defining probabilities and random variables..................... 2 1.2 Probability distributions................................
More informationSystem Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models
System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models Fatih Cavdur fatihcavdur@uludag.edu.tr March 20, 2012 Introduction Introduction The world of the model-builder
More informationPlotting data is one method for selecting a probability distribution. The following
Advanced Analytical Models: Over 800 Models and 300 Applications from the Basel II Accord to Wall Street and Beyond By Johnathan Mun Copyright 008 by Johnathan Mun APPENDIX C Understanding and Choosing
More information15 Discrete Distributions
Lecture Note 6 Special Distributions (Discrete and Continuous) MIT 4.30 Spring 006 Herman Bennett 5 Discrete Distributions We have already seen the binomial distribution and the uniform distribution. 5.
More informationStatistics and data analyses
Statistics and data analyses Designing experiments Measuring time Instrumental quality Precision Standard deviation depends on Number of measurements Detection quality Systematics and methology σ tot =
More informationChing-Han Hsu, BMES, National Tsing Hua University c 2015 by Ching-Han Hsu, Ph.D., BMIR Lab. = a + b 2. b a. x a b a = 12
Lecture 5 Continuous Random Variables BMIR Lecture Series in Probability and Statistics Ching-Han Hsu, BMES, National Tsing Hua University c 215 by Ching-Han Hsu, Ph.D., BMIR Lab 5.1 1 Uniform Distribution
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More informationChapter 4: An Introduction to Probability and Statistics
Chapter 4: An Introduction to Probability and Statistics 4. Probability The simplest kinds of probabilities to understand are reflected in everyday ideas like these: (i) if you toss a coin, the probability
More informationChapter 5. Chapter 5 sections
1 / 43 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions
More informationContinuous Distributions
A normal distribution and other density functions involving exponential forms play the most important role in probability and statistics. They are related in a certain way, as summarized in a diagram later
More informationComputer Science, Informatik 4 Communication and Distributed Systems. Simulation. Discrete-Event System Simulation. Dr.
Simulation Discrete-Event System Simulation Chapter 4 Statistical Models in Simulation Purpose & Overview The world the model-builder sees is probabilistic rather than deterministic. Some statistical model
More informationECON 5350 Class Notes Review of Probability and Distribution Theory
ECON 535 Class Notes Review of Probability and Distribution Theory 1 Random Variables Definition. Let c represent an element of the sample space C of a random eperiment, c C. A random variable is a one-to-one
More informationIV. The Normal Distribution
IV. The Normal Distribution The normal distribution (a.k.a., the Gaussian distribution or bell curve ) is the by far the best known random distribution. It s discovery has had such a far-reaching impact
More informationStatistics, Data Analysis, and Simulation SS 2013
Statistics, Data Analysis, and Simulation SS 213 8.128.73 Statistik, Datenanalyse und Simulation Dr. Michael O. Distler Mainz, 23. April 213 What we ve learned so far Fundamental
More informationMultivariate Distributions
IEOR E4602: Quantitative Risk Management Spring 2016 c 2016 by Martin Haugh Multivariate Distributions We will study multivariate distributions in these notes, focusing 1 in particular on multivariate
More informationBrief Review of Probability
Maura Department of Economics and Finance Università Tor Vergata Outline 1 Distribution Functions Quantiles and Modes of a Distribution 2 Example 3 Example 4 Distributions Outline Distribution Functions
More informationStatistics, Data Analysis, and Simulation SS 2017
Statistics, Data Analysis, and Simulation SS 2017 08.128.730 Statistik, Datenanalyse und Simulation Dr. Michael O. Distler Mainz, 27. April 2017 Dr. Michael O. Distler
More informationSUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416)
SUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416) D. ARAPURA This is a summary of the essential material covered so far. The final will be cumulative. I ve also included some review problems
More informationWeek 5 Quantitative Analysis of Financial Markets Characterizing Cycles
Week 5 Quantitative Analysis of Financial Markets Characterizing Cycles Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036
More informationSlides 8: Statistical Models in Simulation
Slides 8: Statistical Models in Simulation Purpose and Overview The world the model-builder sees is probabilistic rather than deterministic: Some statistical model might well describe the variations. An
More informationCommon ontinuous random variables
Common ontinuous random variables CE 311S Earlier, we saw a number of distribution families Binomial Negative binomial Hypergeometric Poisson These were useful because they represented common situations:
More informationFRM QUANTITATIVE ANALYSIS
FRM QUANTITATIVE ANALYSIS of Financial Markets Christopher Ting Lee Kong Chian School of Business Singapore Management University Version 0.1 October 19, 2017 PREFACE This reading material is prepared
More informationBasics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationChapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations
Chapter 5 Statistical Models in Simulations 5.1 Contents Basic Probability Theory Concepts Discrete Distributions Continuous Distributions Poisson Process Empirical Distributions Useful Statistical Models
More informationII. The Normal Distribution
II. The Normal Distribution The normal distribution (a.k.a., a the Gaussian distribution or bell curve ) is the by far the best known random distribution. It s discovery has had such a far-reaching impact
More informationWhy study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables
ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section
More informationMFM Practitioner Module: Quantitative Risk Management. John Dodson. September 23, 2015
MFM Practitioner Module: Quantitative Risk Management September 23, 2015 Mixtures Mixtures Mixtures Definitions For our purposes, A random variable is a quantity whose value is not known to us right now
More informationNormal Random Variables and Probability
Normal Random Variables and Probability An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan 2015 Discrete vs. Continuous Random Variables Think about the probability of selecting
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationChapter 1. Probability, Random Variables and Expectations. 1.1 Axiomatic Probability
Chapter 1 Probability, Random Variables and Expectations Note: The primary reference for these notes is Mittelhammer (1999. Other treatments of probability theory include Gallant (1997, Casella & Berger
More informationLecture 6: Special probability distributions. Summarizing probability distributions. Let X be a random variable with probability distribution
Econ 514: Probability and Statistics Lecture 6: Special probability distributions Summarizing probability distributions Let X be a random variable with probability distribution P X. We consider two types
More information3 Modeling Process Quality
3 Modeling Process Quality 3.1 Introduction Section 3.1 contains basic numerical and graphical methods. familiar with these methods. It is assumed the student is Goal: Review several discrete and continuous
More informationRandom variables. DS GA 1002 Probability and Statistics for Data Science.
Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities
More informationMath489/889 Stochastic Processes and Advanced Mathematical Finance Solutions for Homework 7
Math489/889 Stochastic Processes and Advanced Mathematical Finance Solutions for Homework 7 Steve Dunbar Due Mon, November 2, 2009. Time to review all of the information we have about coin-tossing fortunes
More informationProbability Distribution
Economic Risk and Decision Analysis for Oil and Gas Industry CE81.98 School of Engineering and Technology Asian Institute of Technology January Semester Presented by Dr. Thitisak Boonpramote Department
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationDistributions of Functions of Random Variables. 5.1 Functions of One Random Variable
Distributions of Functions of Random Variables 5.1 Functions of One Random Variable 5.2 Transformations of Two Random Variables 5.3 Several Random Variables 5.4 The Moment-Generating Function Technique
More informationMachine Learning. Theory of Classification and Nonparametric Classifier. Lecture 2, January 16, What is theoretically the best classifier
Machine Learning 10-701/15 701/15-781, 781, Spring 2008 Theory of Classification and Nonparametric Classifier Eric Xing Lecture 2, January 16, 2006 Reading: Chap. 2,5 CB and handouts Outline What is theoretically
More informationChapter 2: Random Variables
ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:
More informationSTATISTICS SYLLABUS UNIT I
STATISTICS SYLLABUS UNIT I (Probability Theory) Definition Classical and axiomatic approaches.laws of total and compound probability, conditional probability, Bayes Theorem. Random variable and its distribution
More informationMATH Notebook 5 Fall 2018/2019
MATH442601 2 Notebook 5 Fall 2018/2019 prepared by Professor Jenny Baglivo c Copyright 2004-2019 by Jenny A. Baglivo. All Rights Reserved. 5 MATH442601 2 Notebook 5 3 5.1 Sequences of IID Random Variables.............................
More informationAPPENDICES APPENDIX A. STATISTICAL TABLES AND CHARTS 651 APPENDIX B. BIBLIOGRAPHY 677 APPENDIX C. ANSWERS TO SELECTED EXERCISES 679
APPENDICES APPENDIX A. STATISTICAL TABLES AND CHARTS 1 Table I Summary of Common Probability Distributions 2 Table II Cumulative Standard Normal Distribution Table III Percentage Points, 2 of the Chi-Squared
More information7 Random samples and sampling distributions
7 Random samples and sampling distributions 7.1 Introduction - random samples We will use the term experiment in a very general way to refer to some process, procedure or natural phenomena that produces
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationDepartment of Mathematics
Department of Mathematics Ma 3/103 KC Border Introduction to Probability and Statistics Winter 2017 Supplement 2: Review Your Distributions Relevant textbook passages: Pitman [10]: pages 476 487. Larsen
More informationRandom Variables. Random variables. A numerically valued map X of an outcome ω from a sample space Ω to the real line R
In probabilistic models, a random variable is a variable whose possible values are numerical outcomes of a random phenomenon. As a function or a map, it maps from an element (or an outcome) of a sample
More informationEEC 686/785 Modeling & Performance Evaluation of Computer Systems. Lecture 18
EEC 686/785 Modeling & Performance Evaluation of Computer Systems Lecture 18 Department of Electrical and Computer Engineering Cleveland State University wenbing@ieee.org (based on Dr. Raj Jain s lecture
More informationDr. Junchao Xia Center of Biophysics and Computational Biology. Fall /13/2016 1/33
BIO5312 Biostatistics Lecture 03: Discrete and Continuous Probability Distributions Dr. Junchao Xia Center of Biophysics and Computational Biology Fall 2016 9/13/2016 1/33 Introduction In this lecture,
More informationIntroduction to Probability Theory for Graduate Economics Fall 2008
Introduction to Probability Theory for Graduate Economics Fall 008 Yiğit Sağlam October 10, 008 CHAPTER - RANDOM VARIABLES AND EXPECTATION 1 1 Random Variables A random variable (RV) is a real-valued function
More informationEstimating the accuracy of a hypothesis Setting. Assume a binary classification setting
Estimating the accuracy of a hypothesis Setting Assume a binary classification setting Assume input/output pairs (x, y) are sampled from an unknown probability distribution D = p(x, y) Train a binary classifier
More informationSOME SPECIFIC PROBABILITY DISTRIBUTIONS. 1 2πσ. 2 e 1 2 ( x µ
SOME SPECIFIC PROBABILITY DISTRIBUTIONS. Normal random variables.. Probability Density Function. The random variable is said to be normally distributed with mean µ and variance abbreviated by x N[µ, ]
More informationStatistics, Data Analysis, and Simulation SS 2015
Statistics, Data Analysis, and Simulation SS 2015 08.128.730 Statistik, Datenanalyse und Simulation Dr. Michael O. Distler Mainz, 27. April 2015 Dr. Michael O. Distler
More informationStatistical Methods in Particle Physics
Statistical Methods in Particle Physics. Probability Distributions Prof. Dr. Klaus Reygers (lectures) Dr. Sebastian Neubert (tutorials) Heidelberg University WS 07/8 Gaussian g(x; µ, )= p exp (x µ) https://en.wikipedia.org/wiki/normal_distribution
More informationExercises and Answers to Chapter 1
Exercises and Answers to Chapter The continuous type of random variable X has the following density function: a x, if < x < a, f (x), otherwise. Answer the following questions. () Find a. () Obtain mean
More informationSystem Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models
System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models Fatih Cavdur fatihcavdur@uludag.edu.tr March 29, 2014 Introduction Introduction The world of the model-builder
More informationSTATISTICAL METHODS FOR SIGNAL PROCESSING c Alfred Hero
STATISTICAL METHODS FOR SIGNAL PROCESSING c Alfred Hero 1999 32 Statistic used Meaning in plain english Reduction ratio T (X) [X 1,..., X n ] T, entire data sample RR 1 T (X) [X (1),..., X (n) ] T, rank
More informationPhysics 403. Segev BenZvi. Parameter Estimation, Correlations, and Error Bars. Department of Physics and Astronomy University of Rochester
Physics 403 Parameter Estimation, Correlations, and Error Bars Segev BenZvi Department of Physics and Astronomy University of Rochester Table of Contents 1 Review of Last Class Best Estimates and Reliability
More informationProbability Background
CS76 Spring 0 Advanced Machine Learning robability Background Lecturer: Xiaojin Zhu jerryzhu@cs.wisc.edu robability Meure A sample space Ω is the set of all possible outcomes. Elements ω Ω are called sample
More informationChapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance.
Chapter 2 Random Variable CLO2 Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance. 1 1. Introduction In Chapter 1, we introduced the concept
More informationName: Firas Rassoul-Agha
Midterm 1 - Math 5010 - Spring 016 Name: Firas Rassoul-Agha Solve the following 4 problems. You have to clearly explain your solution. The answer carries no points. Only the work does. CALCULATORS ARE
More informationPart 3: Parametric Models
Part 3: Parametric Models Matthew Sperrin and Juhyun Park August 19, 2008 1 Introduction There are three main objectives to this section: 1. To introduce the concepts of probability and random variables.
More informationReview for the previous lecture
Lecture 1 and 13 on BST 631: Statistical Theory I Kui Zhang, 09/8/006 Review for the previous lecture Definition: Several discrete distributions, including discrete uniform, hypergeometric, Bernoulli,
More informationSlides for Data Mining by I. H. Witten and E. Frank
Slides for Data Mining by I. H. Witten and E. Frank Predicting performance Assume the estimated error rate is 5%. How close is this to the true error rate? Depends on the amount of test data Prediction
More informationSolutions of the Financial Risk Management Examination
Solutions of the Financial Risk Management Examination Thierry Roncalli January 9 th 03 Remark The first five questions are corrected in TR-GDR and in the document of exercise solutions, which is available
More informationChapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory
Chapter 1 Statistical Reasoning Why statistics? Uncertainty of nature (weather, earth movement, etc. ) Uncertainty in observation/sampling/measurement Variability of human operation/error imperfection
More informationProbability Distributions for Continuous Variables. Probability Distributions for Continuous Variables
Probability Distributions for Continuous Variables Probability Distributions for Continuous Variables Let X = lake depth at a randomly chosen point on lake surface If we draw the histogram so that the
More informationDepartment of Mathematics
Department of Mathematics Ma 3/103 KC Border Introduction to Probability and Statistics Winter 2018 Supplement 2: Review Your Distributions Relevant textbook passages: Pitman [10]: pages 476 487. Larsen
More informationPCMI Introduction to Random Matrix Theory Handout # REVIEW OF PROBABILITY THEORY. Chapter 1 - Events and Their Probabilities
PCMI 207 - Introduction to Random Matrix Theory Handout #2 06.27.207 REVIEW OF PROBABILITY THEORY Chapter - Events and Their Probabilities.. Events as Sets Definition (σ-field). A collection F of subsets
More information1 Exercises for lecture 1
1 Exercises for lecture 1 Exercise 1 a) Show that if F is symmetric with respect to µ, and E( X )
More informationDS-GA 1002 Lecture notes 2 Fall Random variables
DS-GA 12 Lecture notes 2 Fall 216 1 Introduction Random variables Random variables are a fundamental tool in probabilistic modeling. They allow us to model numerical quantities that are uncertain: the
More informationContinuous Random Variables and Continuous Distributions
Continuous Random Variables and Continuous Distributions Continuous Random Variables and Continuous Distributions Expectation & Variance of Continuous Random Variables ( 5.2) The Uniform Random Variable
More informationEC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix)
1 EC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix) Taisuke Otsu London School of Economics Summer 2018 A.1. Summation operator (Wooldridge, App. A.1) 2 3 Summation operator For
More informationChapter 5 continued. Chapter 5 sections
Chapter 5 sections Discrete univariate distributions: 5.2 Bernoulli and Binomial distributions Just skim 5.3 Hypergeometric distributions 5.4 Poisson distributions Just skim 5.5 Negative Binomial distributions
More information16.4. Power Series. Introduction. Prerequisites. Learning Outcomes
Power Series 6.4 Introduction In this Section we consider power series. These are examples of infinite series where each term contains a variable, x, raised to a positive integer power. We use the ratio
More informationProbability Distributions.
Probability Distributions http://www.pelagicos.net/classes_biometry_fa18.htm Probability Measuring Discrete Outcomes Plotting probabilities for discrete outcomes: 0.6 0.5 0.4 0.3 0.2 0.1 NOTE: Area within
More informationRandom Variables. Definition: A random variable (r.v.) X on the probability space (Ω, F, P) is a mapping
Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the
More informationChapter 1. Sets and probability. 1.3 Probability space
Random processes - Chapter 1. Sets and probability 1 Random processes Chapter 1. Sets and probability 1.3 Probability space 1.3 Probability space Random processes - Chapter 1. Sets and probability 2 Probability
More informationLecture 1: August 28
36-705: Intermediate Statistics Fall 2017 Lecturer: Siva Balakrishnan Lecture 1: August 28 Our broad goal for the first few lectures is to try to understand the behaviour of sums of independent random
More informationEE/CpE 345. Modeling and Simulation. Fall Class 5 September 30, 2002
EE/CpE 345 Modeling and Simulation Class 5 September 30, 2002 Statistical Models in Simulation Real World phenomena of interest Sample phenomena select distribution Probabilistic, not deterministic Model
More informationProbability Distributions - Lecture 5
Probability Distributions - Lecture 5 1 Introduction There are a number of mathematical models of probability density functions that represent the behavior of physical systems. In this lecture we explore
More informationStatistical Concepts. Distributions of Data
Module : Review of Basic Statistical Concepts. Understanding Probability Distributions, Parameters and Statistics A variable that can take on any value in a range is called a continuous variable. Example:
More information2008 Winton. Statistical Testing of RNGs
1 Statistical Testing of RNGs Criteria for Randomness For a sequence of numbers to be considered a sequence of randomly acquired numbers, it must have two basic statistical properties: Uniformly distributed
More informationSampling Distributions
Sampling Distributions In statistics, a random sample is a collection of independent and identically distributed (iid) random variables, and a sampling distribution is the distribution of a function of
More informationStat 5101 Notes: Brand Name Distributions
Stat 5101 Notes: Brand Name Distributions Charles J. Geyer September 5, 2012 Contents 1 Discrete Uniform Distribution 2 2 General Discrete Uniform Distribution 2 3 Uniform Distribution 3 4 General Uniform
More informationSimple Linear Regression
Simple Linear Regression Christopher Ting Christopher Ting : christophert@smu.edu.sg : 688 0364 : LKCSB 5036 January 7, 017 Web Site: http://www.mysmu.edu/faculty/christophert/ Christopher Ting QF 30 Week
More informationSet Theory Digression
1 Introduction to Probability 1.1 Basic Rules of Probability Set Theory Digression A set is defined as any collection of objects, which are called points or elements. The biggest possible collection of
More informationActuarial Science Exam 1/P
Actuarial Science Exam /P Ville A. Satopää December 5, 2009 Contents Review of Algebra and Calculus 2 2 Basic Probability Concepts 3 3 Conditional Probability and Independence 4 4 Combinatorial Principles,
More informationIEOR 3106: Introduction to Operations Research: Stochastic Models. Professor Whitt. SOLUTIONS to Homework Assignment 2
IEOR 316: Introduction to Operations Research: Stochastic Models Professor Whitt SOLUTIONS to Homework Assignment 2 More Probability Review: In the Ross textbook, Introduction to Probability Models, read
More informationECE 313 Probability with Engineering Applications Fall 2000
Exponential random variables Exponential random variables arise in studies of waiting times, service times, etc X is called an exponential random variable with parameter λ if its pdf is given by f(u) =
More informationAdvanced Herd Management Probabilities and distributions
Advanced Herd Management Probabilities and distributions Anders Ringgaard Kristensen Slide 1 Outline Probabilities Conditional probabilities Bayes theorem Distributions Discrete Continuous Distribution
More information