Estimation of Truncated Data Samples in Operational Risk Modeling
|
|
- Jeffrey Wheeler
- 6 years ago
- Views:
Transcription
1 Estimation of Truncated Data Samples in Operational Risk Modeling Bakhodir Ergashev FRB of Richmond Prepared for OpRisk North America Conference New York, NY March
2 Caveats The presentation is based on the following working paper (so I am not the sole author): Ergashev, B., Pavlikov, K., Uryasev, S., Sekeris, E. (2012) Estimation of truncated data samples in operational risk modeling The views expressed in this presentation are those of the authors and do not necessarily reflect the position of the Federal Reserve Bank of Richmond or the Federal Reserve System. 2
3 Introduction Basel II AMA Modeling Regulatory capital is the 99.9 percentile of the distribution of annual aggregate losses. A common approach to modeling operational risk exposure is LDA: Annual loss severity and frequency distributions are estimated. The distribution of annual losses is found by convoluting the two distributions. Available samples of loss event data are usually truncated from below ($10K is a common data collection threshold). 3
4 Introduction How to treat truncated data samples while modeling severity and frequency distributions? The literature offers the following three approaches to fitting truncated samples: The naïve approach: treat the data as if it is not truncated. The shifting approach: shift the data to the origin, fit it, and add the threshold value to the fitted distribution. The truncation approach: fit the conditional distribution by explicitly acknowledging the existence of censored loses falling below the threshold. In this research, we focus on the last two approaches. 4
5 Truncation vs. Shifting Shifting approach Numerical algorithms converge fast. The results are stable. Convolution algorithms are more efficient. For heavy tailed distributions the difference is often negligible. The right tail heavily influences the behavior of the left tail. Truncation approach The fitting is not always successful. Frequently, the likelihood surface is ascending with no global maximum. Sometimes frequency estimates are too high making the convolution computationally challenging. The right tail does not influence the behavior of the left tail. 5
6 Findings by Recent Literature Luo, Shevchenko, Donnelly (2007): The shifting approach overstates or understates VaR depending on the chosen combination of the parameters and threshold. Shevchenko (2009): Naïve and shifted models are easy to fit but induced bias can be very large. Opdyke (2011) emphasizes that truncation exacerbates the non-robustness of MLE and proposes robust alternatives to MLE. For truncated lognormal distribution, large contaminations lead to arbitrarily small mean and arbitrarily large standard deviation parameters. Cope (2011) proposes penalized likelihood estimators for estimating distributional parameters in the presence of data truncation. The cost of the reduction in the variance is a small bias in the parameter estimates. Cavallo et al (2012): Overstatement or understatement depends on the characteristics of the data sample. They propose the use of Vuong s test to choose the best fit model; it does not always work, though. Rozenfeld (2010) proposes to calculate capital from truncated data using the shifting approach by utilizing the information on losses falling below threshold. Caveat: some technical derivations of the paper are not clear to me. 6
7 Our Contributions In the case of Poisson frequency and lognormal severity, we derive a necessary and sufficient condition for the existence of the global solution to the likelihood maximization problem under the truncation approach. If this regularity condition is violated, the MLE suggests that lognormal is not an appropriate severity distribution for a given data sample. An alternative severity distribution should be used. Violations of the regularity condition are the main reason for obtaining unstable parameter estimates under the truncating approach. When the regularity condition is satisfied, we offer a simple procedure with explicit formulae for calculating the mean and st.dev. parameters of the truncated lognormal severity. The procedure can be implemented in Excel. With the use of the proposed procedure practitioners avoid the challenges associated with maximizing the likelihood function. 7
8 Our Findings on Capital Bias Using the SLA and the explicit formulae, we approximate capital bias under the truncation and shifting approaches. The approximations are not great, but they reveal the tendencies that are supported by recent literature. To obtain more accurate estimates of capital bias, we conduct a simulation study. The results are as follows: For small samples, both approaches induce significant bias. As the sample size increases, the bias induced by the truncation approach becomes negligible, while the bias induced by the shifting approach does not. Caveat: we explored only the following range: 8 μ 15 and 0.25 σ 4. The main reason our findings are different is that we filter out random samples that violate the regularity condition. 8
9 The Regularity Condition Notations Severity: X is distributed according to truncated lognormal(μ,σ). Frequency is Poisson(λ). L is the data collection threshold. Truncated sample: X 1,, X n, X > L and Y 1,, Y n = (ln X 1,, ln X n ) Sample moments: M = 1 n Statistic A: A = Function G: G t = V M 2 (M ln L) 2. n n i=1 Y i, i=1 Y 2 i. V = 1 n 1 ( 1 t) and F t F t t F t t = φ(t) 1 Ф(t), where φ and Ф are pdf and cdf of the standard normal distribution. 9
10 The Regularity Condition 10
11 The Severity Estimation Procedure 11
12 Derivation of the Estimation Procedure We use the method of moment estimation. The MM estimation is equivalent to the ML estimation in this setting. Let Y be a lognormal r.v. truncated from below at lnl. There exist an explicit system of equations for E(Y) and E(Y 2 ) expressed in terms of cdf and pdf of the standard normal distribution. 12
13 Derivation of the Estimation Procedure We rewrite the system of equations for E(Y) and E(Y 2 ) as: where t = σ = G t 1 = ln L μ σ. E Y ln L F t t var Y (E(Y) ln L) 2 Theorem (Barrow and Cohen, 1954) 1. G t 1, when t, 2. G t 2, when t +, 3. G t is a monotonically increasing function on, +. 13
14 Derivation of the Estimation Procedure The MM system: σ = E Y ln L F t t and G t 1 = var Y (E(Y) ln L) 2. Due to Barrow and Cohen theorem 0 < Statistic A is the sample equivalent of A = var Y (E(Y ln L)) 2 < 1. var Y (E(Y) ln L) 2 V M^2 (M ln L) 2 > 0. A unique solution to the MM system exits when A < 1 and there is no solution when A > 1. We also prove that there is no global maximum of the likelihood function when A >1. 14
15 Capital Bias Quantifying capital bias using the Single Loss Approximation The explicit formulae are presented in the paper for the SLA approximation to capital bias under both approaches. The accuracy of the approximations is not great. They still reveal the tendencies that are supported by our simulation study. Quantifying capital bias by simulation (next few slides) 15
16 Bias Under Shifting Approach Sample Size = % 80% 60% 40% 20% 0% -20% -40% -60% -80% -100% 16
17 Bias Under Shifting Approach Sample Size = % 80% 60% 40% 20% 0% -20% -40% -60% -80% -100% 17
18 Bias Under Truncation Approach Sample Size = % 80% 60% 40% 20% 0% -20% -40% -60% -80% -100% 18
19 Bias Under Truncation Approach Sample Size = % 80% 60% 40% 20% 0% -20% -40% -60% -80% -100%
20 References Barrow, D., Cohen A. (1954) On some functions involving Mill s ratio, The Annals of Mathematical Statistics, 25(2), Bӧcker, K., and Klüppelberg, C. (2005) Operational VaR: Closed Form approximation. Risk, Cavallo A., Rosenthal, B., Wang, X., Yan, J. (2012) Treatment of the Data Collection Threshold in Operational Risk: A Case Study with the Lognormal Distribution, Journal of Operational Risk Vol. 7, Cope, E.W. (2011) Penalized likelihood estimators for truncated data Journal of Statistical Planning and Inference, Vol. 141, Luo, X., Shevchenko, P., and Donnelly, J. (2007) Addressing Impact of Truncation and Parameter Uncertainty on Operational Risk Estimates, Journal of Operational Risk, Vol. 2, pp Opdyke, J.D., (2011) Robust Statistics Vs. MLE for Operational Risk Severity distribution Parameter Estimation, Working Paper. Shevchenko, P. (2009) Implementing loss distribution approach for operational risk, Applied Stochastic Models in Business and Industry, Vol. 26, Rozenfeld, I. (2010) Using Shifted Distributions in Computing Operational Risk Capital. Available at SSRN: or 20
Estimation of Truncated Data Samples in Operational Risk Modeling
2015 The Journal of Risk and Insurance. Vol. 83, No. 3, 613 640 2016). DOI: 10.1111/jori.12062 Estimation of Truncated Data Samples in Operational Risk Modeling Bakhodir Ergashev Konstantin Pavlikov Stan
More informationEstimation of Operational Risk Capital Charge under Parameter Uncertainty
Estimation of Operational Risk Capital Charge under Parameter Uncertainty Pavel V. Shevchenko Principal Research Scientist, CSIRO Mathematical and Information Sciences, Sydney, Locked Bag 17, North Ryde,
More informationEstimating Operational Risk Capital with Greater Accuracy, Precision, and Robustness
Estimating Operational Risk Capital with Greater Accuracy, Precision, and Robustness J.D. Opdyke, Head of Operational Risk Modeling, Quantitative Methods Group, GE Capital J.D.Opdyke@ge.com 1 of 63 Disclaimer
More informationStatistical Distributions and Uncertainty Analysis. QMRA Institute Patrick Gurian
Statistical Distributions and Uncertainty Analysis QMRA Institute Patrick Gurian Probability Define a function f(x) probability density distribution function (PDF) Prob [A
More informationModelling Operational Risk Using Bayesian Inference
Pavel V. Shevchenko Modelling Operational Risk Using Bayesian Inference 4y Springer 1 Operational Risk and Basel II 1 1.1 Introduction to Operational Risk 1 1.2 Defining Operational Risk 4 1.3 Basel II
More informationUsing R in Undergraduate Probability and Mathematical Statistics Courses. Amy G. Froelich Department of Statistics Iowa State University
Using R in Undergraduate Probability and Mathematical Statistics Courses Amy G. Froelich Department of Statistics Iowa State University Undergraduate Probability and Mathematical Statistics at Iowa State
More informationStatistical Contributions to Operational Risk Modeling
University of Wisconsin Milwaukee UWM Digital Commons Theses and Dissertations May 2016 Statistical Contributions to Operational Risk Modeling Daoping Yu University of Wisconsin-Milwaukee Follow this and
More informationRobust Statistics vs. MLE for OpRisk Severity Distribution Parameter Estimation
Robust Statistics vs. MLE for OpRisk Severity Distribution Parameter Estimation John Douglas (J.D.) Opdyke*, President DataMineIt, JDOpdyke@DataMineIt.com Presented at American Bankers Association Operational
More informationASTIN Colloquium 1-4 October 2012, Mexico City
ASTIN Colloquium 1-4 October 2012, Mexico City Modelling and calibration for non-life underwriting risk: from empirical data to risk capital evaluation Gian Paolo Clemente Dept. Mathematics, Finance Mathematics
More informationRobust Statistics vs. MLE for OpRisk Severity Distribution Parameter Estimation (with and without truncation)
Robust Statistics vs. MLE for OpRisk Severity Distribution Parameter Estimation (with and without truncation) John Douglas (J.D.) Opdyke*, President DataMineIt, JDOpdyke@DataMineIt.com Presented at ORX
More informationChapter 9. Non-Parametric Density Function Estimation
9-1 Density Estimation Version 1.2 Chapter 9 Non-Parametric Density Function Estimation 9.1. Introduction We have discussed several estimation techniques: method of moments, maximum likelihood, and least
More informationTest Problems for Probability Theory ,
1 Test Problems for Probability Theory 01-06-16, 010-1-14 1. Write down the following probability density functions and compute their moment generating functions. (a) Binomial distribution with mean 30
More informationExam C Solutions Spring 2005
Exam C Solutions Spring 005 Question # The CDF is F( x) = 4 ( + x) Observation (x) F(x) compare to: Maximum difference 0. 0.58 0, 0. 0.58 0.7 0.880 0., 0.4 0.680 0.9 0.93 0.4, 0.6 0.53. 0.949 0.6, 0.8
More informationTime-varying failure rate for system reliability analysis in large-scale railway risk assessment simulation
Time-varying failure rate for system reliability analysis in large-scale railway risk assessment simulation H. Zhang, E. Cutright & T. Giras Center of Rail Safety-Critical Excellence, University of Virginia,
More informationThree hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER.
Three hours To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER EXTREME VALUES AND FINANCIAL RISK Examiner: Answer QUESTION 1, QUESTION
More informationMultivariate Operational Risk: Dependence Modelling with Lévy Copulas
Multivariate Operational Risk: Dependence Modelling with Lévy Copulas Klaus Böcker Claudia Klüppelberg Abstract Simultaneous modelling of operational risks occurring in different event type/business line
More informationTwo hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER.
Two hours MATH38181 To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER EXTREME VALUES AND FINANCIAL RISK Examiner: Answer any FOUR
More informationExpected Shortfall is not elicitable so what?
Expected Shortfall is not elicitable so what? Dirk Tasche Bank of England Prudential Regulation Authority 1 dirk.tasche@gmx.net Finance & Stochastics seminar Imperial College, November 20, 2013 1 The opinions
More informationSPRING 2007 EXAM C SOLUTIONS
SPRING 007 EXAM C SOLUTIONS Question #1 The data are already shifted (have had the policy limit and the deductible of 50 applied). The two 350 payments are censored. Thus the likelihood function is L =
More informationUsing copulas to model time dependence in stochastic frontier models
Using copulas to model time dependence in stochastic frontier models Christine Amsler Michigan State University Artem Prokhorov Concordia University November 2008 Peter Schmidt Michigan State University
More informationVaR vs. Expected Shortfall
VaR vs. Expected Shortfall Risk Measures under Solvency II Dietmar Pfeifer (2004) Risk measures and premium principles a comparison VaR vs. Expected Shortfall Dependence and its implications for risk measures
More informationAsymptotic distribution of the sample average value-at-risk
Asymptotic distribution of the sample average value-at-risk Stoyan V. Stoyanov Svetlozar T. Rachev September 3, 7 Abstract In this paper, we prove a result for the asymptotic distribution of the sample
More informationEstimating VaR in credit risk: Aggregate vs single loss distribution
Estimating VaR in credit risk: Aggregate vs single loss distribution M. Assadsolimani and D. Chetalova arxiv:172.4388v1 [q-fin.cp] 14 Feb 217 Abstract Using Monte Carlo simulation to calculate the Value
More informationInferring from data. Theory of estimators
Inferring from data Theory of estimators 1 Estimators Estimator is any function of the data e(x) used to provide an estimate ( a measurement ) of an unknown parameter. Because estimators are functions
More information1 Degree distributions and data
1 Degree distributions and data A great deal of effort is often spent trying to identify what functional form best describes the degree distribution of a network, particularly the upper tail of that distribution.
More informationParameter Estimation
Parameter Estimation Chapters 13-15 Stat 477 - Loss Models Chapters 13-15 (Stat 477) Parameter Estimation Brian Hartman - BYU 1 / 23 Methods for parameter estimation Methods for parameter estimation Methods
More informationSYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions
SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu
More informationExpected Shortfall is not elicitable so what?
Expected Shortfall is not elicitable so what? Dirk Tasche Bank of England Prudential Regulation Authority 1 dirk.tasche@gmx.net Modern Risk Management of Insurance Firms Hannover, January 23, 2014 1 The
More informationChapter 9. Non-Parametric Density Function Estimation
9-1 Density Estimation Version 1.1 Chapter 9 Non-Parametric Density Function Estimation 9.1. Introduction We have discussed several estimation techniques: method of moments, maximum likelihood, and least
More informationOverview of Extreme Value Theory. Dr. Sawsan Hilal space
Overview of Extreme Value Theory Dr. Sawsan Hilal space Maths Department - University of Bahrain space November 2010 Outline Part-1: Univariate Extremes Motivation Threshold Exceedances Part-2: Bivariate
More informationACTEX CAS EXAM 3 STUDY GUIDE FOR MATHEMATICAL STATISTICS
ACTEX CAS EXAM 3 STUDY GUIDE FOR MATHEMATICAL STATISTICS TABLE OF CONTENTS INTRODUCTORY NOTE NOTES AND PROBLEM SETS Section 1 - Point Estimation 1 Problem Set 1 15 Section 2 - Confidence Intervals and
More informationLoss Distribution Approach for Operational Risk Capital Modelling under Basel II: Combining Different Data Sources for Risk Estimation
Loss Distribution Approach for Operational Risk Capital Modelling under Basel II: Combining Different Data Sources for Risk Estimation arxiv:1306.1882v1 [q-fin.rm] 8 Jun 2013 Pavel V. Shevchenko (corresponding
More informationRuin, Operational Risk and How Fast Stochastic Processes Mix
Ruin, Operational Risk and How Fast Stochastic Processes Mix Paul Embrechts ETH Zürich Based on joint work with: - Roger Kaufmann (ETH Zürich) - Gennady Samorodnitsky (Cornell University) Basel Committee
More informationModel Fitting. Jean Yves Le Boudec
Model Fitting Jean Yves Le Boudec 0 Contents 1. What is model fitting? 2. Linear Regression 3. Linear regression with norm minimization 4. Choosing a distribution 5. Heavy Tail 1 Virus Infection Data We
More informationDELTA METHOD and RESERVING
XXXVI th ASTIN COLLOQUIUM Zurich, 4 6 September 2005 DELTA METHOD and RESERVING C.PARTRAT, Lyon 1 university (ISFA) N.PEY, AXA Canada J.SCHILLING, GIE AXA Introduction Presentation of methods based on
More informationReformulation of chance constrained problems using penalty functions
Reformulation of chance constrained problems using penalty functions Martin Branda Charles University in Prague Faculty of Mathematics and Physics EURO XXIV July 11-14, 2010, Lisbon Martin Branda (MFF
More informationON THE FAILURE RATE ESTIMATION OF THE INVERSE GAUSSIAN DISTRIBUTION
ON THE FAILURE RATE ESTIMATION OF THE INVERSE GAUSSIAN DISTRIBUTION ZHENLINYANGandRONNIET.C.LEE Department of Statistics and Applied Probability, National University of Singapore, 3 Science Drive 2, Singapore
More informationA Study of Five Parameter Type I Generalized Half Logistic Distribution
Pure and Applied Mathematics Journal 2017; 6(6) 177-181 http//www.sciencepublishinggroup.com/j/pamj doi 10.11648/j.pamj.20170606.14 ISSN 2326-9790 (Print); ISSN 2326-9812 (nline) A Study of Five Parameter
More informationStep-Stress Models and Associated Inference
Department of Mathematics & Statistics Indian Institute of Technology Kanpur August 19, 2014 Outline Accelerated Life Test 1 Accelerated Life Test 2 3 4 5 6 7 Outline Accelerated Life Test 1 Accelerated
More informationIE 303 Discrete-Event Simulation
IE 303 Discrete-Event Simulation 1 L E C T U R E 5 : P R O B A B I L I T Y R E V I E W Review of the Last Lecture Random Variables Probability Density (Mass) Functions Cumulative Density Function Discrete
More informationConsideration of prior information in the inference for the upper bound earthquake magnitude - submitted major revision
Consideration of prior information in the inference for the upper bound earthquake magnitude Mathias Raschke, Freelancer, Stolze-Schrey-Str., 6595 Wiesbaden, Germany, E-Mail: mathiasraschke@t-online.de
More informationABC methods for phase-type distributions with applications in insurance risk problems
ABC methods for phase-type with applications problems Concepcion Ausin, Department of Statistics, Universidad Carlos III de Madrid Joint work with: Pedro Galeano, Universidad Carlos III de Madrid Simon
More informationStandard Error of Technical Cost Incorporating Parameter Uncertainty
Standard Error of Technical Cost Incorporating Parameter Uncertainty Christopher Morton Insurance Australia Group This presentation has been prepared for the Actuaries Institute 2012 General Insurance
More informationOperational risk modeled analytically II: the consequences of classification invariance. Vivien BRUNEL
Operational risk modeled analytically II: the consequences of classification invariance Vivien BRUNEL Head of Risk and Capital Modeling, Société Générale and Professor of Finance, Léonard de Vinci Pôle
More informationIntroduction to Rare Event Simulation
Introduction to Rare Event Simulation Brown University: Summer School on Rare Event Simulation Jose Blanchet Columbia University. Department of Statistics, Department of IEOR. Blanchet (Columbia) 1 / 31
More informationP Values and Nuisance Parameters
P Values and Nuisance Parameters Luc Demortier The Rockefeller University PHYSTAT-LHC Workshop on Statistical Issues for LHC Physics CERN, Geneva, June 27 29, 2007 Definition and interpretation of p values;
More informationPoint and Interval Estimation for Gaussian Distribution, Based on Progressively Type-II Censored Samples
90 IEEE TRANSACTIONS ON RELIABILITY, VOL. 52, NO. 1, MARCH 2003 Point and Interval Estimation for Gaussian Distribution, Based on Progressively Type-II Censored Samples N. Balakrishnan, N. Kannan, C. T.
More informationFall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.
1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n
More informationPractice Problems Section Problems
Practice Problems Section 4-4-3 4-4 4-5 4-6 4-7 4-8 4-10 Supplemental Problems 4-1 to 4-9 4-13, 14, 15, 17, 19, 0 4-3, 34, 36, 38 4-47, 49, 5, 54, 55 4-59, 60, 63 4-66, 68, 69, 70, 74 4-79, 81, 84 4-85,
More informationSharp bounds on the VaR for sums of dependent risks
Paul Embrechts Sharp bounds on the VaR for sums of dependent risks joint work with Giovanni Puccetti (university of Firenze, Italy) and Ludger Rüschendorf (university of Freiburg, Germany) Mathematical
More informationExtreme Value Theory.
Bank of England Centre for Central Banking Studies CEMLA 2013 Extreme Value Theory. David G. Barr November 21, 2013 Any views expressed are those of the author and not necessarily those of the Bank of
More informationMathematical statistics
October 4 th, 2018 Lecture 12: Information Where are we? Week 1 Week 2 Week 4 Week 7 Week 10 Week 14 Probability reviews Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation Chapter
More informationExact Inference for the Two-Parameter Exponential Distribution Under Type-II Hybrid Censoring
Exact Inference for the Two-Parameter Exponential Distribution Under Type-II Hybrid Censoring A. Ganguly, S. Mitra, D. Samanta, D. Kundu,2 Abstract Epstein [9] introduced the Type-I hybrid censoring scheme
More informationHow to make projections of daily-scale temperature variability in the future: a cross-validation study using the ENSEMBLES regional climate models
How to make projections of daily-scale temperature variability in the future: a cross-validation study using the ENSEMBLES regional climate models Jouni Räisänen Department of Physics, University of Helsinki
More informationEstimation MLE-Pandemic data MLE-Financial crisis data Evaluating estimators. Estimation. September 24, STAT 151 Class 6 Slide 1
Estimation September 24, 2018 STAT 151 Class 6 Slide 1 Pandemic data Treatment outcome, X, from n = 100 patients in a pandemic: 1 = recovered and 0 = not recovered 1 1 1 0 0 0 1 1 1 0 0 1 0 1 0 0 1 1 1
More informationStatistical Tools and Techniques for Solar Astronomers
Statistical Tools and Techniques for Solar Astronomers Alexander W Blocker Nathan Stein SolarStat 2012 Outline Outline 1 Introduction & Objectives 2 Statistical issues with astronomical data 3 Example:
More informationRisk Aggregation. Paul Embrechts. Department of Mathematics, ETH Zurich Senior SFI Professor.
Risk Aggregation Paul Embrechts Department of Mathematics, ETH Zurich Senior SFI Professor www.math.ethz.ch/~embrechts/ Joint work with P. Arbenz and G. Puccetti 1 / 33 The background Query by practitioner
More informationEmpirical Examination of Operational Loss Distributions
Empirical Examination of Operational Loss Distributions Svetlozar T. Rachev Institut für Statistik und Mathematische Wirtschaftstheorie Universität Karlsruhe and Department of Statistics and Applied Probability
More informationProbability and Estimation. Alan Moses
Probability and Estimation Alan Moses Random variables and probability A random variable is like a variable in algebra (e.g., y=e x ), but where at least part of the variability is taken to be stochastic.
More informationSimulating Exchangeable Multivariate Archimedean Copulas and its Applications. Authors: Florence Wu Emiliano A. Valdez Michael Sherris
Simulating Exchangeable Multivariate Archimedean Copulas and its Applications Authors: Florence Wu Emiliano A. Valdez Michael Sherris Literatures Frees and Valdez (1999) Understanding Relationships Using
More informationEfficient Estimation of Distributional Tail Shape and the Extremal Index with Applications to Risk Management
Journal of Mathematical Finance, 2016, 6, 626-659 http://www.scirp.org/journal/jmf ISSN Online: 2162-2442 ISSN Print: 2162-2434 Efficient Estimation of Distributional Tail Shape and the Extremal Index
More informationBayesian Inference and MCMC
Bayesian Inference and MCMC Aryan Arbabi Partly based on MCMC slides from CSC412 Fall 2018 1 / 18 Bayesian Inference - Motivation Consider we have a data set D = {x 1,..., x n }. E.g each x i can be the
More informationAN IMPORTANCE SAMPLING METHOD FOR PORTFOLIO CVaR ESTIMATION WITH GAUSSIAN COPULA MODELS
Proceedings of the 2010 Winter Simulation Conference B. Johansson, S. Jain, J. Montoya-Torres, J. Hugan, and E. Yücesan, eds. AN IMPORTANCE SAMPLING METHOD FOR PORTFOLIO CVaR ESTIMATION WITH GAUSSIAN COPULA
More informationWhy Correlation Matters in Cost Estimating
Why Correlation Matters in Cost Estimating Stephen A. Book The Aerospace Corporation P.O. Box 92957 Los Angeles, CA 90009-29597 (310) 336-8655 stephen.a.book@aero.org 32nd Annual DoD Cost Analysis Symposium
More informationMaximum Likelihood Estimation of the Flow Size Distribution Tail Index from Sampled Packet Data
Maximum Likelihood Estimation of the Flow Size Distribution Tail Index from Sampled Packet Data Patrick Loiseau 1, Paulo Gonçalves 1, Stéphane Girard 2, Florence Forbes 2, Pascale Vicat-Blanc Primet 1
More informationEstimating Operational Risk Capital: the Challenges of Truncation, the Hazards of MLE, and the Promise of Robust Statistics *
Estimating Operational Risk Capital: the Challenges of Truncation, the Hazards of MLE, and the Promise of Roust Statistics * Sumitted to Journal of Operational Risk: January, John ( J.D. ) Opdyke President,
More informationLogistic Regression Review Fall 2012 Recitation. September 25, 2012 TA: Selen Uguroglu
Logistic Regression Review 10-601 Fall 2012 Recitation September 25, 2012 TA: Selen Uguroglu!1 Outline Decision Theory Logistic regression Goal Loss function Inference Gradient Descent!2 Training Data
More informationVariations. ECE 6540, Lecture 10 Maximum Likelihood Estimation
Variations ECE 6540, Lecture 10 Last Time BLUE (Best Linear Unbiased Estimator) Formulation Advantages Disadvantages 2 The BLUE A simplification Assume the estimator is a linear system For a single parameter
More informationTruncation and Censoring
Truncation and Censoring Laura Magazzini laura.magazzini@univr.it Laura Magazzini (@univr.it) Truncation and Censoring 1 / 35 Truncation and censoring Truncation: sample data are drawn from a subset of
More informationFitting the generalized Pareto distribution to data using maximum goodness-of-fit estimators
Computational Statistics & Data Analysis 51 (26) 94 917 www.elsevier.com/locate/csda Fitting the generalized Pareto distribution to data using maximum goodness-of-fit estimators Alberto Luceño E.T.S. de
More informationStatistical Methods. Missing Data snijders/sm.htm. Tom A.B. Snijders. November, University of Oxford 1 / 23
1 / 23 Statistical Methods Missing Data http://www.stats.ox.ac.uk/ snijders/sm.htm Tom A.B. Snijders University of Oxford November, 2011 2 / 23 Literature: Joseph L. Schafer and John W. Graham, Missing
More informationMODULE 6 LECTURE NOTES 1 REVIEW OF PROBABILITY THEORY. Most water resources decision problems face the risk of uncertainty mainly because of the
MODULE 6 LECTURE NOTES REVIEW OF PROBABILITY THEORY INTRODUCTION Most water resources decision problems ace the risk o uncertainty mainly because o the randomness o the variables that inluence the perormance
More informationThe Correlation Problem in Operational Risk
The Correlation Problem in Operational Risk Antoine Frachot, Thierry Roncalli and Eric Salomon Groupe de Recherche Opérationnelle Group Risk Management, Crédit Agricole SA, France This version: January
More information4. Distributions of Functions of Random Variables
4. Distributions of Functions of Random Variables Setup: Consider as given the joint distribution of X 1,..., X n (i.e. consider as given f X1,...,X n and F X1,...,X n ) Consider k functions g 1 : R n
More informationAGEC 661 Note Fourteen
AGEC 661 Note Fourteen Ximing Wu 1 Selection bias 1.1 Heckman s two-step model Consider the model in Heckman (1979) Y i = X iβ + ε i, D i = I {Z iγ + η i > 0}. For a random sample from the population,
More informationDepartment of Statistical Science FIRST YEAR EXAM - SPRING 2017
Department of Statistical Science Duke University FIRST YEAR EXAM - SPRING 017 Monday May 8th 017, 9:00 AM 1:00 PM NOTES: PLEASE READ CAREFULLY BEFORE BEGINNING EXAM! 1. Do not write solutions on the exam;
More informationModern Methods of Data Analysis - WS 07/08
Modern Methods of Data Analysis Lecture VIc (19.11.07) Contents: Maximum Likelihood Fit Maximum Likelihood (I) Assume N measurements of a random variable Assume them to be independent and distributed according
More informationIntroduction and Overview STAT 421, SP Course Instructor
Introduction and Overview STAT 421, SP 212 Prof. Prem K. Goel Mon, Wed, Fri 3:3PM 4:48PM Postle Hall 118 Course Instructor Prof. Goel, Prem E mail: goel.1@osu.edu Office: CH 24C (Cockins Hall) Phone: 614
More informationReparametrization of COM-Poisson Regression Models with Applications in the Analysis of Experimental Count Data
Reparametrization of COM-Poisson Regression Models with Applications in the Analysis of Experimental Count Data Eduardo Elias Ribeiro Junior 1 2 Walmes Marques Zeviani 1 Wagner Hugo Bonat 1 Clarice Garcia
More informationIntroduction to Maximum Likelihood Estimation
Introduction to Maximum Likelihood Estimation Eric Zivot July 26, 2012 The Likelihood Function Let 1 be an iid sample with pdf ( ; ) where is a ( 1) vector of parameters that characterize ( ; ) Example:
More informationRecall the Basics of Hypothesis Testing
Recall the Basics of Hypothesis Testing The level of significance α, (size of test) is defined as the probability of X falling in w (rejecting H 0 ) when H 0 is true: P(X w H 0 ) = α. H 0 TRUE H 1 TRUE
More informationFinancial Econometrics and Volatility Models Extreme Value Theory
Financial Econometrics and Volatility Models Extreme Value Theory Eric Zivot May 3, 2010 1 Lecture Outline Modeling Maxima and Worst Cases The Generalized Extreme Value Distribution Modeling Extremes Over
More informationPrimer on statistics:
Primer on statistics: MLE, Confidence Intervals, and Hypothesis Testing ryan.reece@gmail.com http://rreece.github.io/ Insight Data Science - AI Fellows Workshop Feb 16, 018 Outline 1. Maximum likelihood
More informationBayes Decision Theory
Bayes Decision Theory Minimum-Error-Rate Classification Classifiers, Discriminant Functions and Decision Surfaces The Normal Density 0 Minimum-Error-Rate Classification Actions are decisions on classes
More informationNinth ARTNeT Capacity Building Workshop for Trade Research "Trade Flows and Trade Policy Analysis"
Ninth ARTNeT Capacity Building Workshop for Trade Research "Trade Flows and Trade Policy Analysis" June 2013 Bangkok, Thailand Cosimo Beverelli and Rainer Lanz (World Trade Organization) 1 Selected econometric
More informationSequential Importance Sampling for Rare Event Estimation with Computer Experiments
Sequential Importance Sampling for Rare Event Estimation with Computer Experiments Brian Williams and Rick Picard LA-UR-12-22467 Statistical Sciences Group, Los Alamos National Laboratory Abstract Importance
More informationOn the Comparison of Fisher Information of the Weibull and GE Distributions
On the Comparison of Fisher Information of the Weibull and GE Distributions Rameshwar D. Gupta Debasis Kundu Abstract In this paper we consider the Fisher information matrices of the generalized exponential
More informationEstimators as Random Variables
Estimation Theory Overview Properties Bias, Variance, and Mean Square Error Cramér-Rao lower bound Maimum likelihood Consistency Confidence intervals Properties of the mean estimator Introduction Up until
More informationResearch Article Strong Convergence Bound of the Pareto Index Estimator under Right Censoring
Hindawi Publishing Corporation Journal of Inequalities and Applications Volume 200, Article ID 20956, 8 pages doi:0.55/200/20956 Research Article Strong Convergence Bound of the Pareto Index Estimator
More informationStatistics: Learning models from data
DS-GA 1002 Lecture notes 5 October 19, 2015 Statistics: Learning models from data Learning models from data that are assumed to be generated probabilistically from a certain unknown distribution is a crucial
More informationRobustness and bootstrap techniques in portfolio efficiency tests
Robustness and bootstrap techniques in portfolio efficiency tests Dept. of Probability and Mathematical Statistics, Charles University, Prague, Czech Republic July 8, 2013 Motivation Portfolio selection
More informationR Package glmm: Likelihood-Based Inference for Generalized Linear Mixed Models
R Package glmm: Likelihood-Based Inference for Generalized Linear Mixed Models Christina Knudson, Ph.D. University of St. Thomas user!2017 Reviewing the Linear Model The usual linear model assumptions:
More informationFrequency Analysis & Probability Plots
Note Packet #14 Frequency Analysis & Probability Plots CEE 3710 October 0, 017 Frequency Analysis Process by which engineers formulate magnitude of design events (i.e. 100 year flood) or assess risk associated
More informationProblem 1 (20) Log-normal. f(x) Cauchy
ORF 245. Rigollet Date: 11/21/2008 Problem 1 (20) f(x) f(x) 0.0 0.1 0.2 0.3 0.4 0.0 0.2 0.4 0.6 0.8 4 2 0 2 4 Normal (with mean -1) 4 2 0 2 4 Negative-exponential x x f(x) f(x) 0.0 0.1 0.2 0.3 0.4 0.5
More informationAsymptotic distribution of the sample average value-at-risk in the case of heavy-tailed returns
Asymptotic distribution of the sample average value-at-risk in the case of heavy-tailed returns Stoyan V. Stoyanov Chief Financial Researcher, FinAnalytica Inc., Seattle, USA e-mail: stoyan.stoyanov@finanalytica.com
More informationStatistícal Methods for Spatial Data Analysis
Texts in Statistícal Science Statistícal Methods for Spatial Data Analysis V- Oliver Schabenberger Carol A. Gotway PCT CHAPMAN & K Contents Preface xv 1 Introduction 1 1.1 The Need for Spatial Analysis
More informationEstimating and Accounting for the Output Gap with Large Bayesian Vector Autoregressions
Estimating and Accounting for the Output Gap with Large Bayesian Vector Autoregressions James Morley 1 Benjamin Wong 2 1 University of Sydney 2 Reserve Bank of New Zealand The view do not necessarily represent
More informationCPSC 340: Machine Learning and Data Mining. MLE and MAP Fall 2017
CPSC 340: Machine Learning and Data Mining MLE and MAP Fall 2017 Assignment 3: Admin 1 late day to hand in tonight, 2 late days for Wednesday. Assignment 4: Due Friday of next week. Last Time: Multi-Class
More informationECON Introductory Econometrics. Lecture 11: Binary dependent variables
ECON4150 - Introductory Econometrics Lecture 11: Binary dependent variables Monique de Haan (moniqued@econ.uio.no) Stock and Watson Chapter 11 Lecture Outline 2 The linear probability model Nonlinear probability
More informationBootstrapping the Confidence Intervals of R 2 MAD for Samples from Contaminated Standard Logistic Distribution
Pertanika J. Sci. & Technol. 18 (1): 209 221 (2010) ISSN: 0128-7680 Universiti Putra Malaysia Press Bootstrapping the Confidence Intervals of R 2 MAD for Samples from Contaminated Standard Logistic Distribution
More information