arxiv:math-ph/ v1 30 May 2005
|
|
- Kory Fleming
- 5 years ago
- Views:
Transcription
1 Nongeneralizability of Tsallis Entropy by means of Kolmogorov-Nagumo averages under pseudo-additivity arxiv:math-ph/ v1 30 May 2005 Ambedkar Dukkipati, 1 M. Narsimha Murty,,2 Shalabh Bhatnagar 3 Department of Computer Science and Automation, Indian Institute of Science, Bangalore , India. Abstract As additivity is a characteristic property of the classical information measure, Shannonentropy, pseudo-additivityoftheformx+ q y = x+y+(1 q)xy isacharacteristic property of Tsallis entropy. Rényi in [1] generalized Shannon entropy by means of Kolmogorov-Nagumo averages, by imposing additivity as a constraint. In this paper we show that there exists no generalization for Tsallis entropy, by means of Kolmogorov-Nagumo averages, which preserves the pseudo-additivity. Key words: Kolmogorov-Nagumo averages, Rényi entropy, Tsallis entropy PACS: Gr, c, Rr The starting point of the theory of generalized measures of information is due to Alfred Rényi [1,2], now having an extensive literature. Rényi introduced generalized information measure, known as α-entropy or Rényi entropy, which is derived by replacing linear averaging in Shannon entropy with the generalized averages, in particular Kolmogorov-Nagumo averages and by posing the additivity of the information measures. On the other hand, however, Tsallis in [3] proposed a non-logarithmic generalization of entropic measure, known as q-entropy or Tsallis entropy which is considered as a useful measure in describing thermostatistical properties of a certain class of physical systems that entail long-range interactions, long-term memories and multi-fractal systems. corresponding author 1 ambedkar@csa.iisc.ernet.in 2 mnm@csa.iisc.ernet.in (Tel: ) 3 shalabh@csa.iisc.ernet.in Preprint submitted to Elsevier Science 2 October 2018
2 Tsallis and Rényi entropy measures are two possible different generalization of the Shannon entropy but are not generalizations of each other. To understand these generalizations, the so called Hartley information measure [4], of a single stochastic event plays a fundamental role. It can be interpreted either as a measure of how unexpected the event is, or as a measure of the information yielded by the event. In a system with the finite configuration space x = {x k } n, Hartley information measure of a single event with probability is defined as H( ) = ln 1, k = 1,...n. (1) Hartley information measure satisfies: (1) H is nonnegative: H( ) 0 (2) H is additive: H(p i p j ) = H(p i )+H(p j ) (3) H is normalized: H( 1 ) = 1. These are 2 both necessary and sufficient [5]. Hartley information measure can be viewed as a random variable and hence we use the notation H = (H 1,...H n ). Shannon entropy is defined as an average Hartley information: [6] n n S(p) = H = H k = ln. (2) The characteristic property of Shannon entropy is additivity, i.e., for two independent probability distributions p and r we have S(pr) = S(p)+S(r), (3) where pr is the joint distribution of p and r. Rényi in [1,2] used a well known idea in mathematics that the linear mean, though most widely used, is not the only possible way of averaging, but one can define the mean with respect to an arbitrary function [7,8] to generalize the Shannon entropy. In the general theory of means, a mean of x = (x 1,x 2,...,x n ) with respect to a probability distribution p = (p 1,p 2,...,p n ) is defined as [7] [ W ] x ψ = ψ 1 ψ(x k ), (4) where ψ is continuous and strictly monotonic (increasing or decreasing) in which case it has an inverse ψ 1 which satisfies the same conditions; ψ is generally called the Kolmogorov-Nagumo function associated with the mean 2
3 (4) 4. If, in particular, ψ is linear, then (4) reduces to the expression of linear averaging, x = n x k. The mean of form (4) is also referred as quasilinear mean. In the definition of Shannon entropy (2), if the linear average of Hartley information is replaced with the generalized average of the form(4), the information corresponding to the probability distribution p with respect to KN-function ψ will be )] [ S ψ (p) = ψ 1 n ] ψ (ln 1pk = ψ 1 ψ(h k ), (5) where H = (H 1,...H n ) is the Hartley information measure associated with p. If we impose the constraint of additivity in S ψ, then ψ should satisfy [1] x+c ψ +C, (6) for any x = (x 1,...,x n ) and a constant C. Rényi employed the above formalism to define an one-parameter family of measures of information (α-entropies) S α = 1 ( n ) 1 α ln p α k, (7) where the KN-function ψ is chosen in (5) as ψ(x) = e (1 α)x, choice motivated by well known theorem in the theory of means (Theorem 89, [7]) that (6) can hold only for linear and exponential functions. Rényi entropy is an oneparametergeneralizationofshannonentropyinthesensethat,thelimitα 1 in (7) retrieves Shannon entropy. On the other hand, Tsallis entropy is given by [3] S q (p) = 1 n p q k q 1, (8) where q is called nonextensive index (q is positive in order to ensure the concavity of S q ). Tsallis entropy too, like Rényi entropy, is an one-parameter 4 A. N. Kolmogorov [9] and M. Nagumo [10] were the firstto investigate the characteristic properties of general means. They considered only the case of equal weights; the generalization to arbitrary weights and the characterization of means of form (4) are due to B. de Finetti [11], B. Jessen [12], T. Kitagawa [13], J. Aczél [8] and many others 3
4 generalization of Shannon entropy in the sense that q 1 in (8) retrieves Shannon entropy. The entropic index q characterizes the degree of nonextensivity reflected in the pseudo-additivity property S q (pr) = S q (p)+ q S q (r) = S q (p)+s q (r)+(1 q)s q (p)s q (r), (9) where p and r are independent probability distributions. Though the derivation of Tsallis entropy, when it was proposed in 1988 is slightly different, one can understand this generalization using q-logarithm (see 11) function: where one would first generalize, logarithm in the Hartley information with q-logarithm and define q-hartley information measure H = ( H 1,..., H n ) as H k = H( ) = ln q 1, k = 1,...n, (10) where q-logarithm is defined as ln q (x) = x1 q 1 1 q, (11) which satisfies pseudo-additivity ln q (xy) = ln q x+ q ln q y and in the limit q 1 we have ln q lnx. Tsallis entropy (8) defined as the average of q-hartley information i.e [14]: S q (p) = H 1 = ln q. (12) Now a natural question arises whether one could generalize Tsallis entropy in the similar lines of derivation of Rényi entropy i.e., by replacing linear average in (12) by KN-averages under the pseudo-additivity. The class of information measures that represent the KN-average of q-hartley information measure is written as [ 1 W ( )] [ S ψ (p) = ln q = ψ 1 1 ψ ln q = ψ 1 W ψ ( H ) ] k.(13) ψ By the pseudo-additivity constraint, ψ should satisfy S ψ (pr) = S ψ (p)+ q S ψ (r) (14) or 4
5 ( ) n n ψ 1 1 p i r j ψ ln q i=1 j=1 p i r j ( )] ( ) = ψ 1 1 n p i ψ ln q + q ψ 1 1 r j ψ ln q, (15) i=1 p i j=1 r j where p and r are independent probability distributions and pr denotes the joint probability distribution of p and r. Equivalently, we need ψ 1 n n p i r j ψ ( H j) p i + H r q i=1 j=1 = ψ 1 p i ψ ( H p ) ] n i + q ψ 1 r j ψ ( H j) r, (16) i=1 j=1 where H p and H r represents the q-hartley information of probability distributions p and r respectively. Note that (16) must hold for arbitrary finite discrete probability distributions p i and r j and for arbitrary numbers H and H r k. If we choose H r k = J independently of j then (16) yields that ψ 1 ψ ( H + q J )] [ = ψ 1 n ψ ( H k) ] p + q J (17) In general ψ satisfies (17) only if ψ satisfies x+ q C ψ + q C, (18) for any x = (x 1,...,x n ), which can be rearranged as x+c +(1 q)xc ψ +C +(1 q) x ψ C (19) or (1+(1 q)c)x+c ψ = (1+(1 q)c) x ψ +C. (20) Since q is independent of other quantities, ψ should satisfy the equation of form (By B = (1+(1 q)c)) Bx+C ψ = B x ψ +C. (21) 5
6 Finally ψ must satisfy x+c ψ +C (22) and Bx ψ = B x ψ, (23) for any x = (x 1,...,x n ) and for any constants B and C, for S ψ to preserve the pseudo-additivity. From the generalized theory of means (22) is satisfied only when ψ is linear or exponential, but the requirement (23) is satisfied only when ψ is linear and it is not satisfied when ψ is exponential. Hence ψ is linear in which case (13) is nothing but Tsallis entropy. This establishes the nongeneralizability of Tsallis entropy by means of KNaverages under pseudo-additivity. References [1] A. Rényi, Some fundamental questions of information theory, MTA III. Oszt. Közl. 10 (1960) , (reprinted in [15], pp ). [2] A. Rényi, On measures of entropy and information, in: Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, University of California Press, Berkeley-Los Angeles, 1961, pp , (reprinted in [15], pp ). [3] C. Tsallis, Possible generalization of Boltzmann Gibbs statistics, J. Stat. Phys. 52 (1988) 479. [4] R. V. L. Hartley, Transmission of information, Bell System Technical Journal 7 (1928) 535. [5] J. Aczel, Z. Daroczy, On Measures of Information and Their Characterization, Academic Press, New York, [6] C. E. Shannon, A mathematical theory of communication, Bell System Technical Journal 27 (1948) 379. [7] G. H. Hardy, J. E. Littlewood, G. Pólya, Inequalities, Cambridge, [8] J. Aczél, On mean values, Bull. Amer. Math. Soc. 54 (1948)
7 [9] A. Kolmogorov, Sur la notion de la moyenne, Atti della R. Accademia Nazionale dei Lincei 12 (1930) [10] M.Nagumo,Übereineklassevonmittelwerte, JapaneseJournalofMathematics 7 (1930) [11] B. de Finetti, Sul concetto di media, Giornale di Istituto Italiano dei Attuarii 2 (1931) [12] B. Jessen, Über die verallgemeinerung des arthmetischen mittels, Acta Sci. Math. 5 (1931) [13] T. Kitagawa, On some class of weighted means, Proceedings Physico- Mathematical Society of Japan 16 (1934) [14] C. Tsallis, F. Baldovin, R. Cerbino, P. Pierobon, Introduction to nonextensive statistical mechanics and thermodynamics, in: F. Mallamace, H. E. Stanley (Eds.), The Physics of Complex Systems: New Advances and Perspectives, Vol. 155, Enrico Fermi International School of Physics, [15] P. Turán (Ed.), Selected Papers of Alfréd Rényi, Akademia Kiado, Budapest,
Thermostatistics based on Kolmogorov Nagumo averages: unifying framework for extensive and nonextensive generalizations
7 June 2002 Physics Letters A 298 (2002 369 374 wwwelseviercom/locate/pla Thermostatistics based on Kolmogorov Nagumo averages: unifying framewor for extensive and nonextensive generalizations Mare Czachor
More informationarxiv:math-ph/ v4 22 Mar 2005
Nonextensive triangle euality and other properties of Tsallis relative-entropy minimization arxiv:math-ph/0501025v4 22 Mar 2005 Ambedkar Dukkipati, 1 M. Narasimha Murty,,2 Shalabh Bhatnagar 3 Department
More informationStability of Tsallis entropy and instabilities of Rényi and normalized Tsallis entropies: A basis for q-exponential distributions
PHYSICAL REVIE E 66, 4634 22 Stability of Tsallis entropy and instabilities of Rényi and normalized Tsallis entropies: A basis for -exponential distributions Sumiyoshi Abe Institute of Physics, University
More informationISSN Article. Tsallis Entropy, Escort Probability and the Incomplete Information Theory
Entropy 2010, 12, 2497-2503; doi:10.3390/e12122497 OPEN ACCESS entropy ISSN 1099-4300 www.mdpi.com/journal/entropy Article Tsallis Entropy, Escort Probability and the Incomplete Information Theory Amir
More informationA Generalized Fuzzy Inaccuracy Measure of Order ɑ and Type β and Coding Theorems
International Journal of Fuzzy Mathematics and Systems. ISSN 2248-9940 Volume 4, Number (204), pp. 27-37 Research India Publications http://www.ripublication.com A Generalized Fuzzy Inaccuracy Measure
More informationarxiv:cond-mat/ v1 10 Aug 2002
Model-free derivations of the Tsallis factor: constant heat capacity derivation arxiv:cond-mat/0208205 v1 10 Aug 2002 Abstract Wada Tatsuaki Department of Electrical and Electronic Engineering, Ibaraki
More informationA von Neumann Morgenstern Representation Result without Weak Continuity Assumption
A von Neumann Morgenstern Representation Result without Weak Continuity Assumption Freddy Delbaen Samuel Drapeau Michael Kupper April 17, 2011 In the paradigm of VON NEUMANN AND MORGENSTERN, a representation
More informationAxiomatic characterization of nonlinear homomorphic means
J. Math. Anal. Appl. 303 (2005) 350 363 www.elsevier.com/locate/jmaa Axiomatic characterization of nonlinear homomorphic means Ge Wang a,,1, Ming Jiang b,2 a CT/Micro-CT Laboratory, Department of Radiology,
More informationEntropy measures of physics via complexity
Entropy measures of physics via complexity Giorgio Kaniadakis and Flemming Topsøe Politecnico of Torino, Department of Physics and University of Copenhagen, Department of Mathematics 1 Introduction, Background
More informationarxiv: v3 [q-fin.st] 14 Mar 2008
Long Memory and Volatility Clustering: is the empirical evidence consistent across stock markets? arxiv:0709.2178v3 [q-fin.st] 14 Mar 2008 Snia R. Bentes*, Rui Menezes**, Diana A. Mendes** *Iscal, Av.
More informationCODING THEOREMS ON NEW ADDITIVE INFORMATION MEASURE OF ORDER
Pak. J. Statist. 2018 Vol. 34(2), 137-146 CODING THEOREMS ON NEW ADDITIVE INFORMATION MEASURE OF ORDER Ashiq Hussain Bhat 1 and M.A.K. Baig 2 Post Graduate Department of Statistics, University of Kashmir,
More informationEntropies and fractal dimensions
Entropies and fractal dimensions Amelia Carolina Sparavigna To cite this version: Amelia Carolina Sparavigna. Entropies and fractal dimensions. Philica, Philica, 2016. HAL Id: hal-01377975
More informationBOLTZMANN-GIBBS ENTROPY: AXIOMATIC CHARACTERIZATION AND APPLICATION
Internat. J. Math. & Math. Sci. Vol. 23, No. 4 2000 243 251 S0161171200000375 Hindawi Publishing Corp. BOLTZMANN-GIBBS ENTROPY: AXIOMATIC CHARACTERIZATION AND APPLICATION C. G. CHAKRABARTI and KAJAL DE
More informationRANDOM WALKS WHOSE CONCAVE MAJORANTS OFTEN HAVE FEW FACES
RANDOM WALKS WHOSE CONCAVE MAJORANTS OFTEN HAVE FEW FACES ZHIHUA QIAO and J. MICHAEL STEELE Abstract. We construct a continuous distribution G such that the number of faces in the smallest concave majorant
More informationarxiv: v1 [cond-mat.stat-mech] 3 Apr 2007
A General Nonlinear Fokker-Planck Equation and its Associated Entropy Veit Schwämmle, Evaldo M. F. Curado, Fernando D. Nobre arxiv:0704.0465v1 [cond-mat.stat-mech] 3 Apr 2007 Centro Brasileiro de Pesquisas
More informationAveraging Operators on the Unit Interval
Averaging Operators on the Unit Interval Mai Gehrke Carol Walker Elbert Walker New Mexico State University Las Cruces, New Mexico Abstract In working with negations and t-norms, it is not uncommon to call
More informationA Probability Distribution Of Functional Random Variable With A Functional Data Analysis Application
A Probability Distribution Of Functional Random Variable With A Functional Data Analysis Application Etienne Cuvelier Institut d Informatiue, FUNDP Namur, Belgium cuvelier.etienne@info.fundp.ac.be Moniue
More informationON THE EXISTENCE OF GREEN'S FUNCTION
526 P. D. LAX. [August The inequality P*(zi,,*») á Pk(pi,,pn) ( Si g Pu, I a» #.). shows that (18) implies that/=0. References 1. E. Laguerre, Sur les fonctions du genre zéro et du genre un, Oeuvres de
More informationEstimators, escort probabilities, and φ-exponential families in statistical physics
Estimators, escort probabilities, and φ-exponential families in statistical physics arxiv:math-ph/425v 4 Feb 24 Jan Naudts Departement Natuurkunde, Universiteit Antwerpen UIA, Universiteitsplein, 26 Antwerpen,
More informationIs There a World Behind Shannon? Entropies for Complex Systems
Is There a World Behind Shannon? Entropies for Complex Systems Stefan Thurner and Rudolf Hanel Abstract In their seminal works, Shannon and Khinchin showed that assuming four information theoretic axioms
More informationPower law distribution of Rényi entropy for equilibrium systems having nonadditive energy
arxiv:cond-mat/030446v5 [cond-mat.stat-mech] 0 May 2003 Power law distribution of Rényi entropy for equilibrium systems having nonadditive energy Qiuping A. Wang Institut Supérieur des Matériaux du Mans,
More information54 D. S. HOODA AND U. S. BHAKER Belis and Guiasu [2] observed that a source is not completely specied by the probability distribution P over the sourc
SOOCHOW JOURNAL OF MATHEMATICS Volume 23, No. 1, pp. 53-62, January 1997 A GENERALIZED `USEFUL' INFORMATION MEASURE AND CODING THEOREMS BY D. S. HOODA AND U. S. BHAKER Abstract. In the present communication
More informationWhat is Entropy? Jeff Gill, 1 Entropy in Information Theory
What is Entropy? Jeff Gill, jgill@ucdavis.edu 1 Entropy in Information Theory There are many definitions of information in various literatures but all of them have the same property of distinction from
More informationarxiv:cond-mat/ v1 8 Jan 2004
Multifractality and nonextensivity at the edge of chaos of unimodal maps E. Mayoral and A. Robledo arxiv:cond-mat/0401128 v1 8 Jan 2004 Instituto de Física, Universidad Nacional Autónoma de México, Apartado
More informationA View on Extension of Utility-Based on Links with Information Measures
Communications of the Korean Statistical Society 2009, Vol. 16, No. 5, 813 820 A View on Extension of Utility-Based on Links with Information Measures A.R. Hoseinzadeh a, G.R. Mohtashami Borzadaran 1,b,
More informationarxiv: v1 [gr-qc] 17 Nov 2017
Tsallis and Kaniadakis statistics from a point of view of the holographic equipartition law arxiv:1711.06513v1 [gr-qc] 17 Nov 2017 Everton M. C. Abreu, 1,2, Jorge Ananias Neto, 2, Albert C. R. Mendes,
More informationPower law distribution of Rényi entropy for equilibrium systems having nonadditive energy
arxiv:cond-mat/0304146v1 [cond-mat.stat-mech] 7 Apr 2003 Power law distribution of Rényi entropy for equilibrium systems having nonadditive energy Qiuping A. Wang Institut Supérieur des Matériaux du Mans,
More informationConvexity/Concavity of Renyi Entropy and α-mutual Information
Convexity/Concavity of Renyi Entropy and -Mutual Information Siu-Wai Ho Institute for Telecommunications Research University of South Australia Adelaide, SA 5095, Australia Email: siuwai.ho@unisa.edu.au
More informationEntropy and Ergodic Theory Lecture 4: Conditional entropy and mutual information
Entropy and Ergodic Theory Lecture 4: Conditional entropy and mutual information 1 Conditional entropy Let (Ω, F, P) be a probability space, let X be a RV taking values in some finite set A. In this lecture
More informationShannon Entropy: Axiomatic Characterization and Application
Shannon Entropy: Axiomatic Characterization and Application C. G. Chakrabarti,Indranil Chakrabarty arxiv:quant-ph/0511171v1 17 Nov 2005 We have presented a new axiomatic derivation of Shannon Entropy for
More informationLogarithmic and Exponential Equations and Change-of-Base
Logarithmic and Exponential Equations and Change-of-Base MATH 101 College Algebra J. Robert Buchanan Department of Mathematics Summer 2012 Objectives In this lesson we will learn to solve exponential equations
More informationProperty of Tsallis entropy and principle of entropy increase
Bull. Astr. Soc. India (2007) 35, 691 696 Property of Tsallis entropy and principle of entropy increase Du Jiulin Department of Physics, School of Science, Tianjin University, Tianjin 300072, China Abstract.
More informationarxiv: v1 [math-ph] 28 Jan 2009
Some properties of deformed q-numbers Thierry C. Petit Lobão Instituto de Matemática, Universidade Federal da Bahia Campus Universitário de Ondina, 4070-0 Salvador BA, Brazil Pedro G. S. Cardoso and Suani
More informationJournal of Inequalities in Pure and Applied Mathematics
Journal of Inequalities in Pure and Applied Mathematics INEQUALITIES FOR GENERAL INTEGRAL MEANS GHEORGHE TOADER AND JOZSEF SÁNDOR Department of Mathematics Technical University Cluj-Napoca, Romania. EMail:
More informationCHAPTER III THE PROOF OF INEQUALITIES
CHAPTER III THE PROOF OF INEQUALITIES In this Chapter, the main purpose is to prove four theorems about Hardy-Littlewood- Pólya Inequality and then gives some examples of their application. We will begin
More informationImage thresholding using Tsallis entropy
Pattern Recognition Letters 25 (2004) 1059 1065 www.elsevier.com/locate/patrec Image thresholding using Tsallis entropy M. Portes de Albuquerque a, *, I.A. Esquef b, A.R. Gesualdi Mello a, M. Portes de
More informationDedicated to Professor Milosav Marjanović on the occasion of his 80th birthday
THE TEACHING OF MATHEMATICS 2, Vol. XIV, 2, pp. 97 6 SOME CLASSICAL INEQUALITIES AND THEIR APPLICATION TO OLYMPIAD PROBLEMS Zoran Kadelburg Dedicated to Professor Milosav Marjanović on the occasion of
More informationJournal of Inequalities in Pure and Applied Mathematics
Journal of Inequalities in Pure and Applied Mathematics THE EXTENSION OF MAJORIZATION INEQUALITIES WITHIN THE FRAMEWORK OF RELATIVE CONVEXITY CONSTANTIN P. NICULESCU AND FLORIN POPOVICI University of Craiova
More informationarxiv: v1 [cond-mat.stat-mech] 17 Jul 2015
A new entropy based on a group-theoretical structure Evaldo M. F. Curado arxiv:1507.05058v1 [cond-mat.stat-mech] 17 Jul 2015 Centro Brasileiro de Pesquisas Fisicas and National Institute of Science and
More informationGroups, entropies and Einstein s likelihood functions
Groups, entropies and Einstein s likelihood functions Gabriele Sicuro in collaboration with P. Tempesta (UCM and ICMAT) Centro Brasileiro de Pesquisas Físicas Rio de Janeiro, Brazil 22nd of June, 2016
More informationA statistical mechanical interpretation of algorithmic information theory
A statistical mechanical interpretation of algorithmic information theory Kohtaro Tadaki Research and Development Initiative, Chuo University 1 13 27 Kasuga, Bunkyo-ku, Tokyo 112-8551, Japan. E-mail: tadaki@kc.chuo-u.ac.jp
More informationBOLTZMANN ENTROPY: PROBABILITY AND INFORMATION
STATISTICAL PHYSICS BOLTZMANN ENTROPY: PROBABILITY AND INFORMATION C. G. CHAKRABARTI 1, I. CHAKRABARTY 2 1 Department of Applied Mathematics, Calcutta University Kolkata 700 009, India E-mail: cgc-math@rediflmail.com
More informationSouthwest Research Institute, San Antonio, TX-78238, USA; Tel.:
Entropy 202, 4, 2375-2396; doi:0.3390/e422375 OPEN ACCESS entropy ISSN 099-4300 www.mdpi.com/journal/entropy Article Expectation Values and Variance Based on L p -Norms George Livadiotis Southwest Research
More informationarxiv:cond-mat/ v1 [cond-mat.stat-mech] 27 Feb 2006
arxiv:cond-mat/060263v [cond-mat.stat-mech] 27 Feb 2006 Thermal and mechanical equilibrium among weakly interacting systems in generalized thermostatistics framework A.M. carfone Istituto Nazionale di
More information3 Undirected Graphical Models
Massachusetts Institute of Technology Department of Electrical Engineering and Computer Science 6.438 Algorithms For Inference Fall 2014 3 Undirected Graphical Models In this lecture, we discuss undirected
More informationOn Generalized Entropy Measures and Non-extensive Statistical Mechanics
First Prev Next Last On Generalized Entropy Measures and Non-extensive Statistical Mechanics A. M. MATHAI [Emeritus Professor of Mathematics and Statistics, McGill University, Canada, and Director, Centre
More informationThe Measure of Information Uniqueness of the Logarithmic Uncertainty Measure
The Measure of Information Uniqueness of the Logarithmic Uncertainty Measure Almudena Colacito Information Theory Fall 2014 December 17th, 2014 The Measure of Information 1 / 15 The Measurement of Information
More informationCHINI S EQUATIONS IN ACTUARIAL MATHEMATICS
Annales Univ. Sci. Budapest. Sect. Comp. 41 (2013) 213 225 CHINI S EQUATIONS IN ACTUARIAL MATHEMATICS Agata Nowak and Maciej Sablik (Katowice Poland) Dedicated to Professors Zoltán Daróczy and Imre Kátai
More informationON ZIPF-MANDELBROT ENTROPY AND 3-CONVEX FUNCTIONS
Adv. Oper. Theory https://doi.org/0.535/aot.80-46 ISSN: 538-5X electronic https://projecteuclid.org/aot ON ZIPF-MANDELBROT ENTROPY AND 3-CONVEX FUNCTIONS SADIA KHALID, DILDA PEČARIĆ, and JOSIP PEČARIĆ3
More informationThe q-exponential family in statistical physics
Journal of Physics: Conference Series The q-exponential family in statistical physics To cite this article: Jan Naudts 00 J. Phys.: Conf. Ser. 0 0003 View the article online for updates and enhancements.
More informationMEASURE-THEORETIC ENTROPY
MEASURE-THEORETIC ENTROPY Abstract. We introduce measure-theoretic entropy 1. Some motivation for the formula and the logs We want to define a function I : [0, 1] R which measures how suprised we are or
More informationFQXI 2014: Foundations of Probability and Information
FQXI 2014: Foundations of Probability and Information CONTINGENT or DERIVABLE To what degree are the Laws of Physics dictated yet arbitrary (i.e. must be discovered)? and to what degree are Laws of Physics
More informationConvex Functions. Daniel P. Palomar. Hong Kong University of Science and Technology (HKUST)
Convex Functions Daniel P. Palomar Hong Kong University of Science and Technology (HKUST) ELEC5470 - Convex Optimization Fall 2017-18, HKUST, Hong Kong Outline of Lecture Definition convex function Examples
More informationModule 7 : Applications of Integration - I. Lecture 20 : Definition of the power function and logarithmic function with positive base [Section 20.
Module 7 : Applications of Integration - I Lecture 20 : Definition of the power function and logarithmic function with positive base [Section 201] Objectives In this section you will learn the following
More informationExperimental Design to Maximize Information
Experimental Design to Maximize Information P. Sebastiani and H.P. Wynn Department of Mathematics and Statistics University of Massachusetts at Amherst, 01003 MA Department of Statistics, University of
More informationLimits from l Hôpital rule: Shannon entropy as limit cases of Rényi and Tsallis entropies
Limits from l Hôpital rule: Shannon entropy as it cases of Rényi and Tsallis entropies Frank Nielsen École Polytechnique/Sony Computer Science Laboratorie, Inc http://www.informationgeometry.org August
More informationMultiplicativity of Maximal p Norms in Werner Holevo Channels for 1 < p 2
Multiplicativity of Maximal p Norms in Werner Holevo Channels for 1 < p 2 arxiv:quant-ph/0410063v1 8 Oct 2004 Nilanjana Datta Statistical Laboratory Centre for Mathematical Sciences University of Cambridge
More informationPonownie o zasadach nieoznaczoności:
.. Ponownie o zasadach nieoznaczoności: Specjalne seminarium okolicznościowe CFT, 19 czerwca 2013 KŻ (CFT/UJ) Entropic uncertainty relations June 19, 2013 1 / 20 Majorization Entropic Uncertainty Relations
More informationarxiv:cond-mat/ v1 [cond-mat.stat-mech] 4 Sep 2003
arxiv:cond-mat/0309093v1 [cond-mat.stat-mech] 4 Sep 2003 Introduction to Nonextensive Statistical Mechanics and Thermodynamics Constantino Tsallis a, Fulvio Baldovin a, Roberto Cerbino b and Paolo Pierobon
More informationA Criterion for the Compound Poisson Distribution to be Maximum Entropy
A Criterion for the Compound Poisson Distribution to be Maximum Entropy Oliver Johnson Department of Mathematics University of Bristol University Walk Bristol, BS8 1TW, UK. Email: O.Johnson@bristol.ac.uk
More informationScale-free network of earthquakes
Scale-free network of earthquakes Sumiyoshi Abe 1 and Norikazu Suzuki 2 1 Institute of Physics, University of Tsukuba, Ibaraki 305-8571, Japan 2 College of Science and Technology, Nihon University, Chiba
More informationAlso, in recent years, Tsallis proposed another entropy measure which in the case of a discrete random variable is given by
Gibbs-Shannon Entropy and Related Measures: Tsallis Entropy Garimella Rama Murthy, Associate Professor, IIIT---Hyderabad, Gachibowli, HYDERABAD-32, AP, INDIA ABSTRACT In this research paper, it is proved
More informationQuotient Evolutionary Space: Abstraction of Evolutionary process w.r.t macroscopic properties
Quotient Evolutionary Space: Abstraction of Evolutionary process w.r.t macroscopic properties Ambedkar Dukkipati, M. Narasimha Murty and Shalabh Bhatnagar Department of Computer Science and Automation
More information3F1 Information Theory, Lecture 1
3F1 Information Theory, Lecture 1 Jossy Sayir Department of Engineering Michaelmas 2013, 22 November 2013 Organisation History Entropy Mutual Information 2 / 18 Course Organisation 4 lectures Course material:
More informationOscillation Criteria for Certain nth Order Differential Equations with Deviating Arguments
Journal of Mathematical Analysis Applications 6, 601 6 001) doi:10.1006/jmaa.001.7571, available online at http://www.idealibrary.com on Oscillation Criteria for Certain nth Order Differential Equations
More informationEntropic Means. Maria Barouti
Entropic Means Maria Barouti University of Maryland Baltimore County Department of Mathematics and Statistics bmaria2@umbc.edu October 22, 2015 bmaria2@umbc.edu M. Barouti Entropic Means 1/38 Problem Description
More informationChapter 2 Review of Classical Information Theory
Chapter 2 Review of Classical Information Theory Abstract This chapter presents a review of the classical information theory which plays a crucial role in this thesis. We introduce the various types of
More informationA Note on the Recursive Calculation of Incomplete Gamma Functions
A Note on the Recursive Calculation of Incomplete Gamma Functions WALTER GAUTSCHI Purdue University It is known that the recurrence relation for incomplete gamma functions a n, x, 0 a 1, n 0,1,2,..., when
More informationThe longest shortest piercing.
The longest shortest piercing. B. Kawohl & V. Kurta. December 8, 21 Abstract: We generalize an old problem and its partial solution of Pólya [7] to the n-dimensional setting. Given a plane domain Ω R 2,
More informationGeneralizedstatistics: yet another generalization
Physica A 340 (2004 110 116 www.elsevier.com/locate/physa Generalizedstatistics: yet another generalization Petr Jizba, Toshihico Arimitsu Institute of Physics, University of Tsukuba, Tsukuba, Ibaraki
More informationarxiv: v4 [cs.it] 17 Oct 2015
Upper Bounds on the Relative Entropy and Rényi Divergence as a Function of Total Variation Distance for Finite Alphabets Igal Sason Department of Electrical Engineering Technion Israel Institute of Technology
More informationSubadditivity of entropy for stochastic matrices
Subadditivity of entropy for stochastic matrices Wojciech S lomczyński 1 PREPRIT 2001/16 Abstract The entropy of irreducible stochastic matrix measures its mixing properties. We show that this quantity
More informationGeneralized Classical and Quantum Dynamics Within a Nonextensive Approach
56 Brazilian Journal of Physics, vol. 35, no. 2B, June, 2005 Generalized Classical and Quantum Dynamics Within a Nonextensive Approach A. Lavagno Dipartimento di Fisica, Politecnico di Torino, I-029 Torino,
More informationAbout Closedness by Convolution of the Tsallis Maximizers
About Closedness by Convolution of the Tsallis Maximizers C. Vignat*, A. O. Hero III and J. A. Costa E.E.C.S., University of Michigan, Ann Arbor, USA (*) L.T.C.I., Université de Marne la Vallée, France
More informationOn the Logarithmic Calculus and Sidorenko s Conjecture
On the Logarithmic Calculus and Sidorenko s Conjecture by Xiang Li A thesis submitted in conformity with the requirements for the degree of Msc. Mathematics Graduate Department of Mathematics University
More informationCOMPLETE MONOTONICITIES OF FUNCTIONS INVOLVING THE GAMMA AND DIGAMMA FUNCTIONS. 1. Introduction
COMPLETE MONOTONICITIES OF FUNCTIONS INVOLVING THE GAMMA AND DIGAMMA FUNCTIONS FENG QI AND BAI-NI GUO Abstract. In the article, the completely monotonic results of the functions [Γ( + 1)] 1/, [Γ(+α+1)]1/(+α),
More informationA Coding Theorem Connected on R-Norm Entropy
Int. J. Contemp. Math. Sciences, Vol. 6, 2011, no. 17, 825-831 A Coding Theorem Connected on -Norm Entropy Satish Kumar and Arun Choudhary Department of Mathematics Geeta Institute of Management & Technology
More informationGENERALIZED INFORMATION ENTROPIES IN QUANTUM PHYSICS
GENERALIZED INFORMATION ENTROPIES IN QUANTUM PHYSICS Mariela Portesi 1, S. Zozor 2, G.M. Bosyk 1, F. Holik 1, P.W. Lamberti 3 1 IFLP & Dpto de Fisica, CONICET & Univ. Nac. de La Plata, Argentina 2 GIPSA-Lab,
More informationPRECISE ASYMPTOTIC IN THE LAW OF THE ITERATED LOGARITHM AND COMPLETE CONVERGENCE FOR U-STATISTICS
PRECISE ASYMPTOTIC IN THE LAW OF THE ITERATED LOGARITHM AND COMPLETE CONVERGENCE FOR U-STATISTICS REZA HASHEMI and MOLUD ABDOLAHI Department of Statistics, Faculty of Science, Razi University, 67149, Kermanshah,
More informationECONOMICS 594: APPLIED ECONOMICS: LECTURE NOTES. By W.E. Diewert, April, 2014.
1 ECONOMICS 594: APPLIED ECONOMICS: LECTURE NOTES By W.E. Diewert, April, 2014. CHAPTER 1: Inequalities 1. Introduction Inequalities play an important role in many areas of economics. Unfortunately, this
More informationComputing and Communications 2. Information Theory -Entropy
1896 1920 1987 2006 Computing and Communications 2. Information Theory -Entropy Ying Cui Department of Electronic Engineering Shanghai Jiao Tong University, China 2017, Autumn 1 Outline Entropy Joint entropy
More informationGeneralized Entropy Composition with Different q Indices: A Trial
arxiv:cond-mat/000458v Apr 2000 Generalized Entropy Composition with Different q Indices: A Trial in International Workshop on Classical and Quantum Complexity and Nonextensive Thermodynamics (Denton-Texas,
More informationA Holevo-type bound for a Hilbert Schmidt distance measure
Journal of Quantum Information Science, 205, *,** Published Online **** 204 in SciRes. http://www.scirp.org/journal/**** http://dx.doi.org/0.4236/****.204.***** A Holevo-type bound for a Hilbert Schmidt
More informationSome properties of deformed q-numbers
402 Thierry C. Petit Lobão et al. Some properties of deformed q-numbers Thierry C. Petit Lobão Instituto de Matemática, Universidade Federal da Bahia Campus Universitário de Ondina, 4070-0 Salvador BA,
More informationHow the Nonextensivity Parameter Affects Energy Fluctuations. (Received 10 October 2013, Accepted 7 February 2014)
Regular Article PHYSICAL CHEMISTRY RESEARCH Published by the Iranian Chemical Society www.physchemres.org info@physchemres.org Phys. Chem. Res., Vol. 2, No. 2, 37-45, December 204. How the Nonextensivity
More informationISSN Article
Entropy 0, 3, 595-6; doi:0.3390/e3030595 OPEN ACCESS entropy ISSN 099-4300 www.mdpi.com/journal/entropy Article Entropy Measures vs. Kolmogorov Compleity Andreia Teieira,,, Armando Matos,3, André Souto,
More informationA possible deformed algebra and calculus inspired in nonextensive thermostatistics
Physica A 340 (2004) 95 101 www.elsevier.com/locate/physa A possible deformed algebra and calculus inspired in nonextensive thermostatistics Ernesto P. Borges a;b; a Escola Politecnica, Universidade Federal
More informationA Mixed-Entropic Uncertainty Relation
A Mied-Entropic Uncertainty Relation Kamal Bhattacharyya* and Karabi Halder Department of Chemistry, University of Calcutta, Kolkata 700 009, India Abstract We highlight the advantages of using simultaneously
More informationDifferent quantum f-divergences and the reversibility of quantum operations
Different quantum f-divergences and the reversibility of quantum operations Fumio Hiai Tohoku University 2016, September (at Budapest) Joint work with Milán Mosonyi 1 1 F.H. and M. Mosonyi, Different quantum
More informationVolatility and Returns in Korean Futures Exchange Markets
Volatility and Returns in Korean Futures Exchange Markets Kyungsik Kim*,, Seong-Min Yoon and Jum Soo Choi Department of Physics, Pukyong National University, Pusan 608-737, Korea Division of Economics,
More informationarxiv:astro-ph/ v1 15 Mar 2002
Fluxes of cosmic rays: A delicately balanced anomalous thermal equilibrium Constantino Tsallis, 1 Joao C. Anjos, 1 Ernesto P. Borges 1,2 1 Centro Brasileiro de Pesquisas Fisicas, Rua Xavier Sigaud 150
More informationActa Academiae Paedagogicae Agriensis, Sectio Mathematicae 30 (2003) A NOTE ON NON-NEGATIVE INFORMATION FUNCTIONS
Acta Academiae Paedagogicae Agriensis, Sectio Mathematicae 30 (2003 3 36 A NOTE ON NON-NEGATIVE INFORMATION FUNCTIONS Béla Brindza and Gyula Maksa (Debrecen, Hungary Dedicated to the memory of Professor
More informationExact Asymptotics in Complete Moment Convergence for Record Times and the Associated Counting Process
A^VÇÚO 33 ò 3 Ï 207 c 6 Chinese Journal of Applied Probability Statistics Jun., 207, Vol. 33, No. 3, pp. 257-266 doi: 0.3969/j.issn.00-4268.207.03.004 Exact Asymptotics in Complete Moment Convergence for
More informationThe Range of a Random Walk on a Comb
The Range of a Random Walk on a Comb János Pach Gábor Tardos Abstract The graph obtained from the integer grid Z Z by the removal of all horizontal edges that do not belong to the x-axis is called a comb.
More informationFrom time series to superstatistics
From time series to superstatistics Christian Beck School of Mathematical Sciences, Queen Mary, University of London, Mile End Road, London E 4NS, United Kingdom Ezechiel G. D. Cohen The Rockefeller University,
More informationarxiv: v3 [nlin.ao] 3 Aug 2013
International Journal of Bifurcation and Chaos c World Scientific Publishing Company Period doubling, information entropy, and estimates for Feigenbaum s constants arxiv:1307.5251v3 [nlin.ao] 3 Aug 2013
More informationENTROPY AND THE EIrR'ENFEST URN MODEL by MARTIN J. KLEIN *)
Klein, Martin J. Physica XXlI 1956 569-575 Synopsis ENTROPY AND THE EIrR'ENFEST URN MODEL by MARTIN J. KLEIN *) Department of Physics, Case Institute of Technology, Cleveland, Ohio, U.S.A. This note concerns
More informationEdge Detection in Gray Level Images Based on Non-Shannon Entropy
Edge Detection in Gray Level Images Based on Non-Shannon Entropy El-Owny, Hassan Badry Mohamed A. Department of Mathematics, Faculty of Science,Aswan University, 81528 Aswan, Egypt. Current: CIT College,
More informationStatic Problem Set 2 Solutions
Static Problem Set Solutions Jonathan Kreamer July, 0 Question (i) Let g, h be two concave functions. Is f = g + h a concave function? Prove it. Yes. Proof: Consider any two points x, x and α [0, ]. Let
More information3. If a choice is broken down into two successive choices, the original H should be the weighted sum of the individual values of H.
Appendix A Information Theory A.1 Entropy Shannon (Shanon, 1948) developed the concept of entropy to measure the uncertainty of a discrete random variable. Suppose X is a discrete random variable that
More information