APPLICATION OF INFORMATION ENTROPY AND FRACTIONAL CALCULUS IN EMULSIFICATION PROCESSES

Size: px
Start display at page:

Download "APPLICATION OF INFORMATION ENTROPY AND FRACTIONAL CALCULUS IN EMULSIFICATION PROCESSES"

Transcription

1 14 th European Conference on Mixing Warszawa, September 2012 APPLICATION OF INFORMATION ENTROPY AND FRACTIONAL CALCULUS IN EMULSIFICATION PROCESSES Barbara Tal-Figiel Cracow University of Technology, ul. Warszawska 24, Kraków, Poland; Abstract. A new concept of investigation on emulsification process using mechanical mixing and ultrasonication is presented. A description of this process has been proposed based on Rényi s residual entropy and fractional entropy. This method is very useful since it can be applied to measure tail heaviness even for the distributions for which the kurtosis measure does not exist. Rényi generalized Shannon entropy. The cumulative residual entropy (CRE) has been found to be a new measure of information that paralells Shannon entropy. The folded normal, lognormal and folded Cauchy, distributions which are commonly used in reliability modeling, have been characterized using this measure. The analysis of experiments was carried out employing the probability droplet distribution variation with the time of emulsification process. Keywords: Emulsification, Rényi entropy, residual Rényi entropy, shape measure, stochastic order, tail heaviness. 1. INTRODUCTION In most emulsification processes the droplet size distribution is regarded as main criterion for product quality. Unfortunately, basic statistical distribution models utilized frequently, to describe typical liquid-liquid emulsions, fail in the case of contemporary cosmetic and pharmaceutical emulsions, which are usually heavily loaded with surfactants and rheology modifiers therefore their droplet size distributions often can be regarded as heavy tailed. Since many chemical engineering processes, including mixing, can be modeled using the probability terms, information entropy offers a good chance to treat such phenomena [1]. Shannon entropy, used in information theory, does not guarantee the best generalization. Split criteria based on generalized entropies offer different compromise between purity of nodes and overall information gain. Rényi generalizes the Shannon entropy [2,3] as:, ln d, 1, 0. (1) It should be noted, that as β 1, the Rényi entropy tends to Shannon entropy, which can be regarded as the negative expected loglikelihood. Considering Rényi entropy as a function of β, H(X,β) may be called the spectrum of Rényi information. It has been observed that the gradient of the spectrum at β = 1 is the negative half of the variance of the loglikelihood. The variance of the loglikelihood can be used to measure the intrinsic shape of the distribution. Nadarajah and Zografos [4] have derived expressions of L f for different univariate distributions. L f (t) is called residual Rényi information measure or shape measure for used item. These expressions of L f (t) are derived for 3 univariate distributions, that are heavy tailed or for which kurtosis measure does not exist but are useful in reliability analysis. Based on 461

2 Rényi entropy datasets of emulsification process have been tested. This measure has a lot of applications in describing nonlinear dynamical and chaotic systems. Analysis of experiments was carried out employing the probability droplet distribution variation with the time of emulsification process. 2. RÉNYI INFORMATION MEASURES FOR DIFFERENT DISTRIBUTIONS Levy flights are Markovian stochastic processes whose individual jumps have lengths that are distributed with the probability density function (PDF) λ(x) decaying at large x as with 0<α<2. Due to the divergence of their variance,, extremely long jumps may occur, and typical trajectories are self-similar, on all scales showing clusters of shorter jumps intersparsed by long excursions. In fact, the trajectory of a Levy flight has fractal dimension d f = α. Similar to the emergence of the Gaussian as limit distribution of independent identically distributed (IID) random variables with finite variance due to the central limit theorem, Levy stable distributions represent the limit distributions of iid random variables with diverging variance [1 3]. In that sense, the Gaussian distribution represents the limiting case of the basin of attraction of the so-called generalized central limit theorem for α = 2. For sums of independent, IID random variables with proper normalization to the sample size, the generalized central limit theorem guarantees the convergence of the associated PDF to a Levy stable (LS) PDF even though the variance of these random variables diverges. In general, an LS PDF is defined through its characteristic function of the probability density, that is, its Fourier transform:, ;, F, ;, d, ;, where expiµk σ k 1 iβ ωk, a, (2) if α 1, 0 2, ωk, a ln k if α 1. (3) tan Thus, one can see that, in general, the characteristic function and, respectively, the LS PDF are determined by the four real parameters: α, β, μ, and σ. The exponent α [0, 2] is the index of stability, or the Levy index, β [ 1, 1] is the skewness parameter, μ is the shift parameter, and σ > 0 is a scale parameter. The index α and the skewness parameter β play a major role in our considerations, since the former defines the asymptotic decay of the PDF, whereas the latter defines the asymmetry of the distribution. The shift and scale parameters play a lesser role in the sense that they can be eliminated by proper scale and shift transformations,, ;,, ; 0,1. (4) Due to this property, in what follows we set μ = 0, σ = 1, and denote the Levy stable PDF, ; 0,1 by,. We note the important symmetry property of the PDF, namely,,. For instance, the asymptotics of the PDF,, x 0 (x>0) or x have the same behavior as,, x 0 (x<0) or x. One easily recognizes that a stable distribution, is symmetric if and only if β = 0. Stable distributions with skewness parameter β = ±1 are called extremal. One can prove that all extremal stable distributions with 0 < α < 1 are one sided, the support being the positive semiaxis if β=+1, and the negative semiaxis if β= 1. For instance,, is only defined for x

3 Only in three particular cases can the PDF, be expressed in terms of elementary functions: (i) Gaussian distribution, α = 2, p x exp. (5) In the Gaussian case β is irrelevant since tan π = 0, and the variance is equal to 2. In this case, the generalized central limit theorem coincides with the traditional central limit theorem. (ii) Cauchy distribution, α = 1, β = 0, p, x. 6 Entropy functions based on fractional calculus are very interesting. This new entropy has the same properties as the Shannon entropy except additivity. This entropy function satisfies the Lesche and thermodynamic stability criteria. The Rényi entropy has similar properties as the Shannon entropy: it is additive, it has maximum ln(n)for p i =1/n. The residual Rényi entropy is defined as HX, β; t ln F dx, β 1, β 0, 7 where X has probability density function f and survival function. It is to be noted that, as t -, H(X, β; t) tends to Rényi entropy. Looking into the importance of Rényi entropy and corresponding information measure (or measure of tail heaviness, or shape measure), this section is devoted to the measures of shape for different univariate distributions. Here we have calculated Rényi entropy for a used item whose lifetime follows some univariate distribution. The corresponding measure and the Shannon entropy H(X;t) for used item are also reported here. (iii) Folded normal distribution Let the probability density function be given by fx µ exp, x 0. (8) The residual Rényi entropy is given by HX, β; t 1β ln βln21φµ ln 21Φµ ln β, 9 where Φ(.) is the cumulative distribution function of N(0;1). Then the residual Shannon entropy is given by where HX; t lnft ln ; µ F, (10) Ft 21Φ µ, t. (11) The Rényi entropy is then obtained as HX, β ln ln β, (12) which gives Shannon entropy as ln. (13) The corresponding shape measure for the life distribution of a used item is given by t AA" A, (14) A 463

4 where A1 21Φ µ, (15) A 1 µ µ exp, (16) and A " 1 µ exp µ 1µ. (17) The shape measure for the life distribution of a new item is ½. (iv) Folded Cauchy distribution The Rényi entropy is obtained as HX, β ln ln B,β βlnπ, (18) The Shannon entropy is thus ln2. (19) The corresponding shape measure for the life distribution of a used item is given by t ψ ;t ψ 1; t. 20 The shape measure for the life distribution of a new item is 3. (21) (v) Lognormal distribution Let the probability density function be given by f x exp, x 0, 0, 0. (22) The residual Rényi entropy is given by HX, β; t ln 1 σ Φ lnρt 1 σ β ln 1 Φ ln 1, (23) where Φ is the cumulative distribution function of the standard normal variate. The residual Shannon entropy is obtained as HX; t lnd t ln2πeσ lnρ, (24) Where 1Φ, 1 and is the standard normal density function. The Rényi entropy is given by HX, β ln 1 σ. (25) The Shannon entropy is given by HX ln2πeσ lnρ. (26) 3. EXPERIMENTAL An experimental investigation of cosmetic and pharmaceutical emulsions of various types obtained with mechanical mixing with high stirrer speed and ultrasonication has been carried out. Emulsifiers used in experiments were commercial products. SRO and Span 80 are liquids miscible with oils, while sodium lauryl glutamate and Tween 80 are water soluble surfactants. For the mechanical mixing turbine impeller or homogenisator was used. Ultrasonication was 464

5 carried out with generator with operating frequency of 22.5 khz with sonotrode diameter d s =0.02 m and ultrasound field intensity W/m 2. Sample size ranged from ml, depending on the required power density value. Cosmetical type O/W and W/O emulsions were made by stirring 1, 3, 5, 10 and 20 min at rpm. For pharmaceutical emulsions two step emulsification process was used. In the first stage emulsion was prepared by intensive homogenization ( rpm), and in the second stage emulsion was formed by ultrasonication, where irradiation times varied from s. The experimental droplet size distributions were obtained with Malvern Mastersizer 2000 device. The samples of emulsions were used to describe the droplet size distribution at different sampling moments. Figure 1. Wax emulsion droplet and their volumetric size distribution Volume (%) Particle Size Distribution Particle Size (µm) The frequency histograms obtained could be analyzed by means of various distributions. According to experimental results, the droplet size distribution at different sampling moments of investigated emulsions can be described by Folded normal distribution Lognormal distribution Folded Cauchy distribution 4. CONCLUSIONS This paper reviewed two important mathematical tools, namely the fractional calculus and the entropy; these concepts allow to improve the analysis of system dynamics of emulsification processes. The paper analysed multi-droplet systems with integer and fractional order behavior and demonstrated that the above concepts are simple and straightforward to apply. The generalized residual information measure based on Rényi entropy for a continuous random variable is very useful in practice, and its connection to the likelihood is established. An intrinsic loglikelihood-based residual life distribution measure is developed without finiteness of moments and/or smoothness assumptions. The proposed L f (t) measure exists for almost all life distributions even if the traditional kurtosis measure does not exists. This measure can be used in studying residual distributional shapes especially for heavy-tailed distributions. The forms of residual Rényi entropy, residual Shannon entropy, shape measure for the life distribution of used item have been derived for 6 different univariable distributions. Rényi entropy, Shannon entropy and shape measure for the life distribution of a new item have been obtained as particular cases. This, as well as applications of non-standard entropies to the text classification data, where small classes are very important, remain to be explored. The results presented here can serve as a reference for scientists and engineers in many areas. 465

6 5. REFERENCES [1] Ogawa K., Chemical Engineering. A New Perspective, Elsevier, Amsterdam. [2] Rényi A., On Measures of Entropy and Information, Proceedings of the Fourth Berkeley Symp. on Mathematics, Statistics and Probability, University of California Press, Vol [3] Życzkowski K.,2003. Renyi Extrapolation of Shannon Entropy, Open Sys. & Information Dyn. 10, [4] Nadarajah S., Zografos K., Formulas for Rényi Information and Related Measures for Univariate Distributions, Inform. Sciences, 155, [5] Masiuk St., Rakoczy R., Kordas M., Informational Analysis of the Grinding Process of Granular Material Using a Multi-ribbon Blender, Chem. Papers, 63, [6] Ubriaco M.R., Entropies based on fractional calculus, Physics Letters A, 373,

Some New Results on Information Properties of Mixture Distributions

Some New Results on Information Properties of Mixture Distributions Filomat 31:13 (2017), 4225 4230 https://doi.org/10.2298/fil1713225t Published by Faculty of Sciences and Mathematics, University of Niš, Serbia Available at: http://www.pmf.ni.ac.rs/filomat Some New Results

More information

Prof. Thistleton MAT 505 Introduction to Probability Lecture 13

Prof. Thistleton MAT 505 Introduction to Probability Lecture 13 Prof. Thistleton MAT 55 Introduction to Probability Lecture 3 Sections from Text and MIT Video Lecture: Sections 5.4, 5.6 http://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-4- probabilisticsystems-analysis-and-applied-probability-fall-2/video-lectures/lecture-8-continuousrandomvariables/

More information

Probability Distributions for Continuous Variables. Probability Distributions for Continuous Variables

Probability Distributions for Continuous Variables. Probability Distributions for Continuous Variables Probability Distributions for Continuous Variables Probability Distributions for Continuous Variables Let X = lake depth at a randomly chosen point on lake surface If we draw the histogram so that the

More information

Open Problems in Mixed Models

Open Problems in Mixed Models xxiii Determining how to deal with a not positive definite covariance matrix of random effects, D during maximum likelihood estimation algorithms. Several strategies are discussed in Section 2.15. For

More information

Asymptotic distribution of the sample average value-at-risk in the case of heavy-tailed returns

Asymptotic distribution of the sample average value-at-risk in the case of heavy-tailed returns Asymptotic distribution of the sample average value-at-risk in the case of heavy-tailed returns Stoyan V. Stoyanov Chief Financial Researcher, FinAnalytica Inc., Seattle, USA e-mail: stoyan.stoyanov@finanalytica.com

More information

Chapter 4 Continuous Random Variables and Probability Distributions

Chapter 4 Continuous Random Variables and Probability Distributions Chapter 4 Continuous Random Variables and Probability Distributions Part 3: The Exponential Distribution and the Poisson process Section 4.8 The Exponential Distribution 1 / 21 Exponential Distribution

More information

If we want to analyze experimental or simulated data we might encounter the following tasks:

If we want to analyze experimental or simulated data we might encounter the following tasks: Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction

More information

Information geometry for bivariate distribution control

Information geometry for bivariate distribution control Information geometry for bivariate distribution control C.T.J.Dodson + Hong Wang Mathematics + Control Systems Centre, University of Manchester Institute of Science and Technology Optimal control of stochastic

More information

The Inverse Weibull Inverse Exponential. Distribution with Application

The Inverse Weibull Inverse Exponential. Distribution with Application International Journal of Contemporary Mathematical Sciences Vol. 14, 2019, no. 1, 17-30 HIKARI Ltd, www.m-hikari.com https://doi.org/10.12988/ijcms.2019.913 The Inverse Weibull Inverse Exponential Distribution

More information

CIFAR Lectures: Non-Gaussian statistics and natural images

CIFAR Lectures: Non-Gaussian statistics and natural images CIFAR Lectures: Non-Gaussian statistics and natural images Dept of Computer Science University of Helsinki, Finland Outline Part I: Theory of ICA Definition and difference to PCA Importance of non-gaussianity

More information

Model Fitting. Jean Yves Le Boudec

Model Fitting. Jean Yves Le Boudec Model Fitting Jean Yves Le Boudec 0 Contents 1. What is model fitting? 2. Linear Regression 3. Linear regression with norm minimization 4. Choosing a distribution 5. Heavy Tail 1 Virus Infection Data We

More information

Nonlinear Time Series Modeling

Nonlinear Time Series Modeling Nonlinear Time Series Modeling Part II: Time Series Models in Finance Richard A. Davis Colorado State University (http://www.stat.colostate.edu/~rdavis/lectures) MaPhySto Workshop Copenhagen September

More information

Chapter 6. Estimation of Confidence Intervals for Nodal Maximum Power Consumption per Customer

Chapter 6. Estimation of Confidence Intervals for Nodal Maximum Power Consumption per Customer Chapter 6 Estimation of Confidence Intervals for Nodal Maximum Power Consumption per Customer The aim of this chapter is to calculate confidence intervals for the maximum power consumption per customer

More information

SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions

SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu

More information

p(z)

p(z) Chapter Statistics. Introduction This lecture is a quick review of basic statistical concepts; probabilities, mean, variance, covariance, correlation, linear regression, probability density functions and

More information

Asymptotic distribution of the sample average value-at-risk

Asymptotic distribution of the sample average value-at-risk Asymptotic distribution of the sample average value-at-risk Stoyan V. Stoyanov Svetlozar T. Rachev September 3, 7 Abstract In this paper, we prove a result for the asymptotic distribution of the sample

More information

Introduction to Maximum Likelihood Estimation

Introduction to Maximum Likelihood Estimation Introduction to Maximum Likelihood Estimation Eric Zivot July 26, 2012 The Likelihood Function Let 1 be an iid sample with pdf ( ; ) where is a ( 1) vector of parameters that characterize ( ; ) Example:

More information

Gatsby Theoretical Neuroscience Lectures: Non-Gaussian statistics and natural images Parts I-II

Gatsby Theoretical Neuroscience Lectures: Non-Gaussian statistics and natural images Parts I-II Gatsby Theoretical Neuroscience Lectures: Non-Gaussian statistics and natural images Parts I-II Gatsby Unit University College London 27 Feb 2017 Outline Part I: Theory of ICA Definition and difference

More information

EVALUATION OF MIXING PERFORMANCE IN A MAGNETIC MIXER BASED ON INFORMATION ENTROPY

EVALUATION OF MIXING PERFORMANCE IN A MAGNETIC MIXER BASED ON INFORMATION ENTROPY 14 th European Conference on Mixing Warszawa, 1-13 September 212 EVALUATION OF MIXING PERFORMANCE IN A MAGNETIC MIXER BASED ON INFORMATION ENTROPY Rafał Rakoczy, Stanisław Masiuk, Marian Kordas a West

More information

Multivariate Normal-Laplace Distribution and Processes

Multivariate Normal-Laplace Distribution and Processes CHAPTER 4 Multivariate Normal-Laplace Distribution and Processes The normal-laplace distribution, which results from the convolution of independent normal and Laplace random variables is introduced by

More information

Estimation Theory. as Θ = (Θ 1,Θ 2,...,Θ m ) T. An estimator

Estimation Theory. as Θ = (Θ 1,Θ 2,...,Θ m ) T. An estimator Estimation Theory Estimation theory deals with finding numerical values of interesting parameters from given set of data. We start with formulating a family of models that could describe how the data were

More information

Weighted Exponential Distribution and Process

Weighted Exponential Distribution and Process Weighted Exponential Distribution and Process Jilesh V Some generalizations of exponential distribution and related time series models Thesis. Department of Statistics, University of Calicut, 200 Chapter

More information

Random Matrix Eigenvalue Problems in Probabilistic Structural Mechanics

Random Matrix Eigenvalue Problems in Probabilistic Structural Mechanics Random Matrix Eigenvalue Problems in Probabilistic Structural Mechanics S Adhikari Department of Aerospace Engineering, University of Bristol, Bristol, U.K. URL: http://www.aer.bris.ac.uk/contact/academic/adhikari/home.html

More information

1 Appendix A: Matrix Algebra

1 Appendix A: Matrix Algebra Appendix A: Matrix Algebra. Definitions Matrix A =[ ]=[A] Symmetric matrix: = for all and Diagonal matrix: 6=0if = but =0if 6= Scalar matrix: the diagonal matrix of = Identity matrix: the scalar matrix

More information

On the convergence of the iterative solution of the likelihood equations

On the convergence of the iterative solution of the likelihood equations On the convergence of the iterative solution of the likelihood equations R. Moddemeijer University of Groningen, Department of Computing Science, P.O. Box 800, NL-9700 AV Groningen, The Netherlands, e-mail:

More information

Applied Surfactants: Principles and Applications

Applied Surfactants: Principles and Applications Applied Surfactants: Principles and Applications Tadros, Tharwat F. ISBN-13: 9783527306299 Table of Contents Preface. 1 Introduction. 1.1 General Classification of Surface Active Agents. 1.2 Anionic Surfactants.

More information

INVESTIGATIONS OF MASS TRANSFER AND MICROMIXING EFFECTS IN TWO-PHASE LIQUID-LIQUID SYSTEMS WITH CHEMICAL REACTION

INVESTIGATIONS OF MASS TRANSFER AND MICROMIXING EFFECTS IN TWO-PHASE LIQUID-LIQUID SYSTEMS WITH CHEMICAL REACTION 14 th European Conference on Mixing Warszawa, 10-13 September 20 INVESTIGATIONS OF MASS TRANSFER AND MICROMIXING EFFECTS IN TWO-PHASE LIQUID-LIQUID SYSTEMS WITH CHEMICAL REACTION M. Jasińska a, J. Bałdyga

More information

On the convergence of the iterative solution of the likelihood equations

On the convergence of the iterative solution of the likelihood equations On the convergence of the iterative solution of the likelihood equations R. Moddemeijer University of Groningen, Department of Computing Science, P.O. Box 800, NL-9700 AV Groningen, The Netherlands, e-mail:

More information

IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES

IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES VARIABLE Studying the behavior of random variables, and more importantly functions of random variables is essential for both the

More information

International Journal of Scientific & Engineering Research, Volume 7, Issue 8, August ISSN MM Double Exponential Distribution

International Journal of Scientific & Engineering Research, Volume 7, Issue 8, August ISSN MM Double Exponential Distribution International Journal of Scientific & Engineering Research, Volume 7, Issue 8, August-216 72 MM Double Exponential Distribution Zahida Perveen, Mubbasher Munir Abstract: The exponential distribution is

More information

Comparison of Shannon, Renyi and Tsallis Entropy used in Decision Trees

Comparison of Shannon, Renyi and Tsallis Entropy used in Decision Trees Comparison of Shannon, Renyi and Tsallis Entropy used in Decision Trees Tomasz Maszczyk and W lodzis law Duch Department of Informatics, Nicolaus Copernicus University Grudzi adzka 5, 87-100 Toruń, Poland

More information

MFM Practitioner Module: Quantitative Risk Management. John Dodson. September 23, 2015

MFM Practitioner Module: Quantitative Risk Management. John Dodson. September 23, 2015 MFM Practitioner Module: Quantitative Risk Management September 23, 2015 Mixtures Mixtures Mixtures Definitions For our purposes, A random variable is a quantity whose value is not known to us right now

More information

Applied Probability and Stochastic Processes

Applied Probability and Stochastic Processes Applied Probability and Stochastic Processes In Engineering and Physical Sciences MICHEL K. OCHI University of Florida A Wiley-Interscience Publication JOHN WILEY & SONS New York - Chichester Brisbane

More information

Does k-th Moment Exist?

Does k-th Moment Exist? Does k-th Moment Exist? Hitomi, K. 1 and Y. Nishiyama 2 1 Kyoto Institute of Technology, Japan 2 Institute of Economic Research, Kyoto University, Japan Email: hitomi@kit.ac.jp Keywords: Existence of moments,

More information

Statistics and Data Analysis

Statistics and Data Analysis Statistics and Data Analysis The Crash Course Physics 226, Fall 2013 "There are three kinds of lies: lies, damned lies, and statistics. Mark Twain, allegedly after Benjamin Disraeli Statistics and Data

More information

GARCH Models Estimation and Inference

GARCH Models Estimation and Inference GARCH Models Estimation and Inference Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 1 Likelihood function The procedure most often used in estimating θ 0 in

More information

MARSHALL-OLKIN EXTENDED POWER FUNCTION DISTRIBUTION I. E. Okorie 1, A. C. Akpanta 2 and J. Ohakwe 3

MARSHALL-OLKIN EXTENDED POWER FUNCTION DISTRIBUTION I. E. Okorie 1, A. C. Akpanta 2 and J. Ohakwe 3 MARSHALL-OLKIN EXTENDED POWER FUNCTION DISTRIBUTION I. E. Okorie 1, A. C. Akpanta 2 and J. Ohakwe 3 1 School of Mathematics, University of Manchester, Manchester M13 9PL, UK 2 Department of Statistics,

More information

Institute of Actuaries of India

Institute of Actuaries of India Institute of Actuaries of India Subject CT3 Probability and Mathematical Statistics For 2018 Examinations Subject CT3 Probability and Mathematical Statistics Core Technical Syllabus 1 June 2017 Aim The

More information

Notes on Mathematical Expectations and Classes of Distributions Introduction to Econometric Theory Econ. 770

Notes on Mathematical Expectations and Classes of Distributions Introduction to Econometric Theory Econ. 770 Notes on Mathematical Expectations and Classes of Distributions Introduction to Econometric Theory Econ. 77 Jonathan B. Hill Dept. of Economics University of North Carolina - Chapel Hill October 4, 2 MATHEMATICAL

More information

Random Eigenvalue Problems Revisited

Random Eigenvalue Problems Revisited Random Eigenvalue Problems Revisited S Adhikari Department of Aerospace Engineering, University of Bristol, Bristol, U.K. Email: S.Adhikari@bristol.ac.uk URL: http://www.aer.bris.ac.uk/contact/academic/adhikari/home.html

More information

Math 576: Quantitative Risk Management

Math 576: Quantitative Risk Management Math 576: Quantitative Risk Management Haijun Li lih@math.wsu.edu Department of Mathematics Washington State University Week 11 Haijun Li Math 576: Quantitative Risk Management Week 11 1 / 21 Outline 1

More information

CS224W: Analysis of Networks Jure Leskovec, Stanford University

CS224W: Analysis of Networks Jure Leskovec, Stanford University CS224W: Analysis of Networks Jure Leskovec, Stanford University http://cs224w.stanford.edu 10/30/17 Jure Leskovec, Stanford CS224W: Social and Information Network Analysis, http://cs224w.stanford.edu 2

More information

On the entropy flows to disorder

On the entropy flows to disorder On the entropy flows to disorder School of Mathematics University of Manchester Manchester M 9PL, UK (e-mail: ctdodson@manchester.ac.uk) C.T.J. Dodson Abstract. Gamma distributions, which contain the exponential

More information

Advanced analysis and modelling tools for spatial environmental data. Case study: indoor radon data in Switzerland

Advanced analysis and modelling tools for spatial environmental data. Case study: indoor radon data in Switzerland EnviroInfo 2004 (Geneva) Sh@ring EnviroInfo 2004 Advanced analysis and modelling tools for spatial environmental data. Case study: indoor radon data in Switzerland Mikhail Kanevski 1, Michel Maignan 1

More information

ABC methods for phase-type distributions with applications in insurance risk problems

ABC methods for phase-type distributions with applications in insurance risk problems ABC methods for phase-type with applications problems Concepcion Ausin, Department of Statistics, Universidad Carlos III de Madrid Joint work with: Pedro Galeano, Universidad Carlos III de Madrid Simon

More information

HANDBOOK OF APPLICABLE MATHEMATICS

HANDBOOK OF APPLICABLE MATHEMATICS HANDBOOK OF APPLICABLE MATHEMATICS Chief Editor: Walter Ledermann Volume VI: Statistics PART A Edited by Emlyn Lloyd University of Lancaster A Wiley-Interscience Publication JOHN WILEY & SONS Chichester

More information

PROPERTIES AND DATA MODELLING APPLICATIONS OF THE KUMARASWAMY GENERALIZED MARSHALL-OLKIN-G FAMILY OF DISTRIBUTIONS

PROPERTIES AND DATA MODELLING APPLICATIONS OF THE KUMARASWAMY GENERALIZED MARSHALL-OLKIN-G FAMILY OF DISTRIBUTIONS Journal of Data Science 605-620, DOI: 10.6339/JDS.201807_16(3.0009 PROPERTIES AND DATA MODELLING APPLICATIONS OF THE KUMARASWAMY GENERALIZED MARSHALL-OLKIN-G FAMILY OF DISTRIBUTIONS Subrata Chakraborty

More information

Multivariate autoregressive models as tools for UT1-UTC predictions

Multivariate autoregressive models as tools for UT1-UTC predictions Multivariate autoregressive models as tools for UT1-UTC predictions Tomasz Niedzielski 1,2, Wiesław Kosek 1 1 Space Research Centre, Polish Academy of Sciences, Poland 2 Oceanlab, University of Aberdeen,

More information

Tail bound inequalities and empirical likelihood for the mean

Tail bound inequalities and empirical likelihood for the mean Tail bound inequalities and empirical likelihood for the mean Sandra Vucane 1 1 University of Latvia, Riga 29 th of September, 2011 Sandra Vucane (LU) Tail bound inequalities and EL for the mean 29.09.2011

More information

Median Cross-Validation

Median Cross-Validation Median Cross-Validation Chi-Wai Yu 1, and Bertrand Clarke 2 1 Department of Mathematics Hong Kong University of Science and Technology 2 Department of Medicine University of Miami IISA 2011 Outline Motivational

More information

More on Estimation. Maximum Likelihood Estimation.

More on Estimation. Maximum Likelihood Estimation. More on Estimation. In the previous chapter we looked at the properties of estimators and the criteria we could use to choose between types of estimators. Here we examine more closely some very popular

More information

σ(a) = a N (x; 0, 1 2 ) dx. σ(a) = Φ(a) =

σ(a) = a N (x; 0, 1 2 ) dx. σ(a) = Φ(a) = Until now we have always worked with likelihoods and prior distributions that were conjugate to each other, allowing the computation of the posterior distribution to be done in closed form. Unfortunately,

More information

Chapter 9. Non-Parametric Density Function Estimation

Chapter 9. Non-Parametric Density Function Estimation 9-1 Density Estimation Version 1.2 Chapter 9 Non-Parametric Density Function Estimation 9.1. Introduction We have discussed several estimation techniques: method of moments, maximum likelihood, and least

More information

A STUDY ON WEIBULL DISTRIBUTIONS

A STUDY ON WEIBULL DISTRIBUTIONS ABSTRACT A STUDY ON WEIBULL DISTRIBUTIONS Indhumathy.D 1, Seshaiah.C.V 2,Sukkiramathi.K 3 1 Assistant Professor, 2 Professor, 3 Assistant Professor, Department of Mathematics,Sri Ramakrishna Engineering

More information

Shape of the return probability density function and extreme value statistics

Shape of the return probability density function and extreme value statistics Shape of the return probability density function and extreme value statistics 13/09/03 Int. Workshop on Risk and Regulation, Budapest Overview I aim to elucidate a relation between one field of research

More information

Probability Distribution

Probability Distribution Economic Risk and Decision Analysis for Oil and Gas Industry CE81.98 School of Engineering and Technology Asian Institute of Technology January Semester Presented by Dr. Thitisak Boonpramote Department

More information

Expectation, variance and moments

Expectation, variance and moments Expectation, variance and moments John Appleby Contents Expectation and variance Examples 3 Moments and the moment generating function 4 4 Examples of moment generating functions 5 5 Concluding remarks

More information

Chapter 1. Probability, Random Variables and Expectations. 1.1 Axiomatic Probability

Chapter 1. Probability, Random Variables and Expectations. 1.1 Axiomatic Probability Chapter 1 Probability, Random Variables and Expectations Note: The primary reference for these notes is Mittelhammer (1999. Other treatments of probability theory include Gallant (1997, Casella & Berger

More information

Module 3. Function of a Random Variable and its distribution

Module 3. Function of a Random Variable and its distribution Module 3 Function of a Random Variable and its distribution 1. Function of a Random Variable Let Ω, F, be a probability space and let be random variable defined on Ω, F,. Further let h: R R be a given

More information

Some Statistical Inferences For Two Frequency Distributions Arising In Bioinformatics

Some Statistical Inferences For Two Frequency Distributions Arising In Bioinformatics Applied Mathematics E-Notes, 14(2014), 151-160 c ISSN 1607-2510 Available free at mirror sites of http://www.math.nthu.edu.tw/ amen/ Some Statistical Inferences For Two Frequency Distributions Arising

More information

Different methods of estimation for generalized inverse Lindley distribution

Different methods of estimation for generalized inverse Lindley distribution Different methods of estimation for generalized inverse Lindley distribution Arbër Qoshja & Fatmir Hoxha Department of Applied Mathematics, Faculty of Natural Science, University of Tirana, Albania,, e-mail:

More information

Introduction to Probability and Statistics (Continued)

Introduction to Probability and Statistics (Continued) Introduction to Probability and Statistics (Continued) Prof. icholas Zabaras Center for Informatics and Computational Science https://cics.nd.edu/ University of otre Dame otre Dame, Indiana, USA Email:

More information

Parameter Estimation of the Stable GARCH(1,1)-Model

Parameter Estimation of the Stable GARCH(1,1)-Model WDS'09 Proceedings of Contributed Papers, Part I, 137 142, 2009. ISBN 978-80-7378-101-9 MATFYZPRESS Parameter Estimation of the Stable GARCH(1,1)-Model V. Omelchenko Charles University, Faculty of Mathematics

More information

FINITE MIXTURES OF LOGNORMAL AND GAMMA DISTRIBUTIONS

FINITE MIXTURES OF LOGNORMAL AND GAMMA DISTRIBUTIONS The 7 th International Days of Statistics and Economics, Prague, September 9-, 03 FINITE MIXTURES OF LOGNORMAL AND GAMMA DISTRIBUTIONS Ivana Malá Abstract In the contribution the finite mixtures of distributions

More information

Subject CS1 Actuarial Statistics 1 Core Principles

Subject CS1 Actuarial Statistics 1 Core Principles Institute of Actuaries of India Subject CS1 Actuarial Statistics 1 Core Principles For 2019 Examinations Aim The aim of the Actuarial Statistics 1 subject is to provide a grounding in mathematical and

More information

On the entropy flows to disorder

On the entropy flows to disorder On the entropy flows to disorder C.T.J. Dodson School of Mathematics, University of Manchester, Manchester M 9PL, UK ctdodson@manchester.ac.uk May, 9 Abstract Gamma distributions, which contain the exponential

More information

Preparation and Characterization of Oil-in-Water and Water-in-Oil Emulsions. Prepared. For

Preparation and Characterization of Oil-in-Water and Water-in-Oil Emulsions. Prepared. For 1 Preparation and Characterization of Oil-in-Water and Water-in-Oil Emulsions Prepared For Dr. Reza Foudazi, Ph.D. Chemical and Materials Engineering New Mexico State University By Muchu Zhou May 10, 2016

More information

Maximum Likelihood Estimation. only training data is available to design a classifier

Maximum Likelihood Estimation. only training data is available to design a classifier Introduction to Pattern Recognition [ Part 5 ] Mahdi Vasighi Introduction Bayesian Decision Theory shows that we could design an optimal classifier if we knew: P( i ) : priors p(x i ) : class-conditional

More information

Exercises with solutions (Set D)

Exercises with solutions (Set D) Exercises with solutions Set D. A fair die is rolled at the same time as a fair coin is tossed. Let A be the number on the upper surface of the die and let B describe the outcome of the coin toss, where

More information

HANDBOOK OF APPLICABLE MATHEMATICS

HANDBOOK OF APPLICABLE MATHEMATICS HANDBOOK OF APPLICABLE MATHEMATICS Chief Editor: Walter Ledermann Volume II: Probability Emlyn Lloyd University oflancaster A Wiley-Interscience Publication JOHN WILEY & SONS Chichester - New York - Brisbane

More information

New Developments in Tail-Equivalent Linearization method for Nonlinear Stochastic Dynamics

New Developments in Tail-Equivalent Linearization method for Nonlinear Stochastic Dynamics New Developments in Tail-Equivalent Linearization method for Nonlinear Stochastic Dynamics Armen Der Kiureghian President, American University of Armenia Taisei Professor of Civil Engineering Emeritus

More information

Degeneracy in One Dimensional Quantum Systems: Dynamically Shifted Oscillator

Degeneracy in One Dimensional Quantum Systems: Dynamically Shifted Oscillator Degeneracy in One Dimensional Quantum Systems: Dynamically Shifted Oscillator Pirooz Mohazzabi1*, G. Clark Alexander2 1 2 Department of Mathematics and Physics, University of Wisconsin-Parkside, Kenosha,

More information

1 Probability and Random Variables

1 Probability and Random Variables 1 Probability and Random Variables The models that you have seen thus far are deterministic models. For any time t, there is a unique solution X(t). On the other hand, stochastic models will result in

More information

Lecture 3: From Random Walks to Continuum Diffusion

Lecture 3: From Random Walks to Continuum Diffusion Lecture 3: From Random Walks to Continuum Diffusion Martin Z. Bazant Department of Mathematics, MIT February 3, 6 Overview In the previous lecture (by Prof. Yip), we discussed how individual particles

More information

Chapter 1: Revie of Calculus and Probability

Chapter 1: Revie of Calculus and Probability Chapter 1: Revie of Calculus and Probability Refer to Text Book: Operations Research: Applications and Algorithms By Wayne L. Winston,Ch. 12 Operations Research: An Introduction By Hamdi Taha, Ch. 12 OR441-Dr.Khalid

More information

Moments. Raw moment: February 25, 2014 Normalized / Standardized moment:

Moments. Raw moment: February 25, 2014 Normalized / Standardized moment: Moments Lecture 10: Central Limit Theorem and CDFs Sta230 / Mth 230 Colin Rundel Raw moment: Central moment: µ n = EX n ) µ n = E[X µ) 2 ] February 25, 2014 Normalized / Standardized moment: µ n σ n Sta230

More information

The Laplace driven moving average a non-gaussian stationary process

The Laplace driven moving average a non-gaussian stationary process The Laplace driven moving average a non-gaussian stationary process 1, Krzysztof Podgórski 2, Igor Rychlik 1 1 Mathematical Sciences, Mathematical Statistics, Chalmers 2 Centre for Mathematical Sciences,

More information

Frequency Analysis & Probability Plots

Frequency Analysis & Probability Plots Note Packet #14 Frequency Analysis & Probability Plots CEE 3710 October 0, 017 Frequency Analysis Process by which engineers formulate magnitude of design events (i.e. 100 year flood) or assess risk associated

More information

1 Random walks and data

1 Random walks and data Inference, Models and Simulation for Complex Systems CSCI 7-1 Lecture 7 15 September 11 Prof. Aaron Clauset 1 Random walks and data Supposeyou have some time-series data x 1,x,x 3,...,x T and you want

More information

III. The Scaling Hypothesis

III. The Scaling Hypothesis III. The Scaling Hypothesis III.A The Homogeneity Assumption In the previous chapters, the singular behavior in the vicinity of a continuous transition was characterized by a set of critical exponents

More information

Index. Geostatistics for Environmental Scientists, 2nd Edition R. Webster and M. A. Oliver 2007 John Wiley & Sons, Ltd. ISBN:

Index. Geostatistics for Environmental Scientists, 2nd Edition R. Webster and M. A. Oliver 2007 John Wiley & Sons, Ltd. ISBN: Index Akaike information criterion (AIC) 105, 290 analysis of variance 35, 44, 127 132 angular transformation 22 anisotropy 59, 99 affine or geometric 59, 100 101 anisotropy ratio 101 exploring and displaying

More information

INTRODUCTION TO THE THEORY OF LÉVY FLIGHTS

INTRODUCTION TO THE THEORY OF LÉVY FLIGHTS INTRODUCTION TO THE THEORY OF LÉVY FLIGHTS A.V. Chechkin (1), R. Metzler (), J. Klafter (3), and V.Yu. Gonchar (1) (1) Institute for Theoretical Physics NSC KIPT, Akademicheskaya st.1, 61108 Kharkov, Ukraine

More information

= w. These evolve with time yielding the

= w. These evolve with time yielding the 1 Analytical prediction and representation of chaos. Michail Zak a Jet Propulsion Laboratory California Institute of Technology, Pasadena, CA 91109, USA Abstract. 1. Introduction The concept of randomness

More information

Estimation and Confidence Intervals for Parameters of a Cumulative Damage Model

Estimation and Confidence Intervals for Parameters of a Cumulative Damage Model United States Department of Agriculture Forest Service Forest Products Laboratory Research Paper FPL-RP-484 Estimation and Confidence Intervals for Parameters of a Cumulative Damage Model Carol L. Link

More information

On the entropy flows to disorder

On the entropy flows to disorder CHAOS 2009 Charnia, Crete 1-5 June 2009 On the entropy flows to disorder C.T.J. Dodson School of Mathematics University of Manchester, UK Abstract Gamma distributions, which contain the exponential as

More information

On the Concept of Local Fractional Differentiation

On the Concept of Local Fractional Differentiation On the Concept of Local Fractional Differentiation Xiaorang Li, Matt Davison, and Chris Essex Department of Applied Mathematics, The University of Western Ontario, London, Canada, N6A 5B7 {xli5,essex,mdavison}@uwo.ca

More information

Knowable moments and K-climacogram

Knowable moments and K-climacogram Lecture notes on stochastics Part 3 Rome, 3-4 May 208 Knowable moments and K-climacogram Demetris Koutsoyiannis Department of Water Resources and Environmental Engineering School of Civil Engineering National

More information

Implicit sampling for particle filters. Alexandre Chorin, Mathias Morzfeld, Xuemin Tu, Ethan Atkins

Implicit sampling for particle filters. Alexandre Chorin, Mathias Morzfeld, Xuemin Tu, Ethan Atkins 0/20 Implicit sampling for particle filters Alexandre Chorin, Mathias Morzfeld, Xuemin Tu, Ethan Atkins University of California at Berkeley 2/20 Example: Try to find people in a boat in the middle of

More information

A Bivariate Distribution whose Marginal Laws are Gamma and Macdonald

A Bivariate Distribution whose Marginal Laws are Gamma and Macdonald International Journal of Mathematical Analysis Vol. 1, 216, no. 1, 455-467 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/1.12988/ijma.216.6219 A Bivariate Distribution whose Marginal Laws are Gamma Macdonald

More information

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature

More information

Valerio Cappellini. References

Valerio Cappellini. References CETER FOR THEORETICAL PHYSICS OF THE POLISH ACADEMY OF SCIECES WARSAW, POLAD RADOM DESITY MATRICES AD THEIR DETERMIATS 4 30 SEPTEMBER 5 TH SFB TR 1 MEETIG OF 006 I PRZEGORZAłY KRAKÓW Valerio Cappellini

More information

Frontier estimation based on extreme risk measures

Frontier estimation based on extreme risk measures Frontier estimation based on extreme risk measures by Jonathan EL METHNI in collaboration with Ste phane GIRARD & Laurent GARDES CMStatistics 2016 University of Seville December 2016 1 Risk measures 2

More information

On Five Parameter Beta Lomax Distribution

On Five Parameter Beta Lomax Distribution ISSN 1684-840 Journal of Statistics Volume 0, 01. pp. 10-118 On Five Parameter Beta Lomax Distribution Muhammad Rajab 1, Muhammad Aleem, Tahir Nawaz and Muhammad Daniyal 4 Abstract Lomax (1954) developed

More information

Probability distribution functions

Probability distribution functions Probability distribution functions Everything there is to know about random variables Imperial Data Analysis Workshop (2018) Elena Sellentin Sterrewacht Universiteit Leiden, NL Ln(a) Sellentin Universiteit

More information

STATISTICAL INFERENCE IN ACCELERATED LIFE TESTING WITH GEOMETRIC PROCESS MODEL. A Thesis. Presented to the. Faculty of. San Diego State University

STATISTICAL INFERENCE IN ACCELERATED LIFE TESTING WITH GEOMETRIC PROCESS MODEL. A Thesis. Presented to the. Faculty of. San Diego State University STATISTICAL INFERENCE IN ACCELERATED LIFE TESTING WITH GEOMETRIC PROCESS MODEL A Thesis Presented to the Faculty of San Diego State University In Partial Fulfillment of the Requirements for the Degree

More information

Comparative Distributions of Hazard Modeling Analysis

Comparative Distributions of Hazard Modeling Analysis Comparative s of Hazard Modeling Analysis Rana Abdul Wajid Professor and Director Center for Statistics Lahore School of Economics Lahore E-mail: drrana@lse.edu.pk M. Shuaib Khan Department of Statistics

More information

Complex Systems Methods 11. Power laws an indicator of complexity?

Complex Systems Methods 11. Power laws an indicator of complexity? Complex Systems Methods 11. Power laws an indicator of complexity? Eckehard Olbrich e.olbrich@gmx.de http://personal-homepages.mis.mpg.de/olbrich/complex systems.html Potsdam WS 2007/08 Olbrich (Leipzig)

More information

Exponential Family and Maximum Likelihood, Gaussian Mixture Models and the EM Algorithm. by Korbinian Schwinger

Exponential Family and Maximum Likelihood, Gaussian Mixture Models and the EM Algorithm. by Korbinian Schwinger Exponential Family and Maximum Likelihood, Gaussian Mixture Models and the EM Algorithm by Korbinian Schwinger Overview Exponential Family Maximum Likelihood The EM Algorithm Gaussian Mixture Models Exponential

More information

The Instability of Correlations: Measurement and the Implications for Market Risk

The Instability of Correlations: Measurement and the Implications for Market Risk The Instability of Correlations: Measurement and the Implications for Market Risk Prof. Massimo Guidolin 20254 Advanced Quantitative Methods for Asset Pricing and Structuring Winter/Spring 2018 Threshold

More information

Nonparametric Identification of a Binary Random Factor in Cross Section Data - Supplemental Appendix

Nonparametric Identification of a Binary Random Factor in Cross Section Data - Supplemental Appendix Nonparametric Identification of a Binary Random Factor in Cross Section Data - Supplemental Appendix Yingying Dong and Arthur Lewbel California State University Fullerton and Boston College July 2010 Abstract

More information