arxiv: v1 [stat.me] 6 Jun 2016

Transcription

1 A gamma approximation to the Bayesian posterior distribution of a discrete parameter of the Generalized Poisson model arxiv: v1 [stat.me] 6 Jun 2016 Tsung Fei Khang Institute of Mathematical Sciences, Faculty of Science, University of Malaya, Kuala Lumpur, Malaysia. Abstract Let X have a Generalized Poisson distribution with mean kb, where b is a known constant in the unit interval and k is a discrete, non-negative parameter. We show that if an uninformative uniform prior for k is assumed, then the posterior distribution of k can be approximated using the gamma distribution when b is small. Keywords: Generalized Poisson distribution posterior distribution gamma distribution approximation 2000 MSC: 62E17, 62F15 1. Introduction The family of Generalized Poisson distributions (GP) (Consul and Jain, 1973) has been used for more than 40 years to model count data that may be overdispersed or underdispersed. Some of its interesting theoretical properties include a Poisson mixture interpretation (Joe and Zhu, 2005), and a heavier tail compared to the negative binomial distribution (Joe and Zhu, 2005; Nikoloulopoulos and Karlis, 2008). Various chance mechanisms have been found to generate the GP distribution (Shoukri and Consul, 1987). Numerous applications are given in Consul (1989), and in recent years, it has gained increasing popularity in bioinformatics for modelling RNA- Seqcount data(srivastava and Chen,2010; Li and Jiang,2012; Zhang et al., address: tfkhang@um.edu.my (Tsung Fei Khang) Preprint submitted to a future journal June 7, 2016

2 2015; Wang et al., 2015). In this work, we study the posterior distribution of a discrete parameter of the GP model under a particular parametrization. Let X be a random variable following GP(λ 1,λ 2 ). Its probability mass function (pmf) is given by P(X = x λ 1,λ 2 ) = λ 1(λ 1 +xλ 2 ) x 1 e (λ 1+xλ 2 ), (1) x! where x = 0,1,2,..., λ 1 > 0 and λ 2 < 1. Negative values of λ 2 correspond to overdispersion, positive values to underdispersion, and λ 2 = 0 reduces eq.(1) to the Poisson distribution with mean λ 1. Consider the following parametrization: λ 2 = 1 m, λ 1 = kb m, with m = e ab+c. We assume that a,c R and 0 < b < 1 are known constants, and focus our interest on the discrete non-negative parameter k. Under this parametrization, The mean and the variance of the GP model are given by E(X k) = λ 1 /(1 λ 2 ) = kb, Var(X k) = E(X k)/(1 λ 2 ) 2 = kb/m, We are concerned with the posterior probability of the k parameter. In the absence of any prior information, a Bayesian formulation using an improper uniform prior P(k) = 1,k = 0,1,2,... on k yields the posterior distribution of k as P(k X = x) = = = P(X = x k) j=xp(x = x j) k(bk m+x(1 m)) x 1 e bk m j=x j(bj m+x(1 m)) x 1 e bj m k(k +g(x)) x 1 e bk m j=x j(j +g(x))x 1 e b mj, (2) for k x, where g(x) = {(1 m)/(b m)}x. It is easy to check that P(k X = x) is proper even though an improper uniform prior distribution is used. The aim of this paper is to derive a continuous approximation to the posterior distribution eq.(2), so that the posterior mean and variance can be determined directly from the theoretical properties of the approximating distribution. 2

3 2. Results We show that under certain conditions, the gamma distribution approximates the posterior distribution of k. Theorem 1. If P(k X = x) is treated as a density function, then P(k X = x) is approximately equal to the probability density function of the gamma distribution with mean (x+1)/(b m) and variance (x+1)/(b 2 m) for some k l where l > x. Proof. First, we note that the denominator in eq.(2) can be written as (j +g(x)) x e b mj g(x) (j +g(x)) x 1 e b mj. j=x j=x The Lerch transcendent Φ(z,s,a) is given by Φ(z,s,a) = k=0 z k (a+k) s, where z < 1, a 0, 1, 2,..., and s 1,2,... Representing the denominator using the Lerch transcendent, we get e b mx Φ(e b m, x,wx) (w 1)xe b mx Φ(e b m, (x 1),wx), (3) where w = 1+(1 m)/(b m). The following identity (eq.1.11(11) in Erdélyi (1953)) relates the Lerch transcendent with negative argument for s to the Bernoulli polynomials: Φ(z, h,v) = h! ( log 1 ) (h+1) 1 z v z z v B h+r+1 (v)(logz) r, (4) r!(h+r +1) where logz < 2π, v 0, 1, 2,..., h 1, 2,..., and B n (x) is the n-th Bernoulli polynomial with argument x. The Bernoulli polynomial is defined as n ( ) n B n (x) = b n j x j, j j=0 3

4 where b i is the ith Bernoulli number. If we now substitute z = e b m, h = x, v = wx into the identity eq.(4), then we obtain Φ(e b m, x,wx) = e b m(wx) (b m) (x+1) 1 e b m(wx) B x+r+1 (wx)( b m) r r!(x+r +1) For small values of b (0 < b < 1), we note that the sum of Bernoulli polynomials is dominated by the zero-th term. Hence, for the first term in eq.(3), e bw mx Φ(e b m, x,wx) = (b m) B x+1(wx) +O(b m), (5) x+1 x+1 as b 0. An identity involving the Bernoulli polynomials and the sum of nth powers (eq. 1.13(10) in Erdélyi (1953)) gives B n+1 (x) b n+1 n+1 Since B x+1 (x) dominates b x+1, eq.(5) becomes x 1 = r n. e bw mx Φ(e b m, x,wx) [wx] 1 (b m) r x, x+1 where [wx] is the integer part of wx. Here, provided that as x. Now, e bw mx Φ(e b m, x,wx) (b m) x+1, [wx] 1 ( ) r x = o (b, m) x+1 (b m) x+1 [wx] 1 r x < b m{(bw mx) x +(bw mx) x + +(bw mx) x } x! = (bw mx) x+1 x! 4

5 Let the upper bound on the right-hand-side be bounded by some constant ǫ > 0, which can be made arbitrarily close to 0. Thus, (bw mx) x+1 /x! < ǫ, and multiplying both sides by x! and then taking logarithm, we get [(1 m+b m)x] < exp { 1 x+1 ( x )} logi+logǫ. (6) This implies that for some fixed ǫ, the approximation should be reasonably good as long as a,b,c and x are such that the inequality (6) is satisfied. For a,b,c such that m 1, eq.(3) can be approximated as (b m) x+1 ( 1 (w 1)x b m x i=1 ) (b m) x+1. Itfollows thatthedensity functionp(k X = x) (eq.(2)) canbeapproximated using the probability density function of the gamma distribution with mean (x+1)/(b m) and variance (x+1)/(b 2 m). Thus, mk P(k X = x) (b m) x+1 k(k +g(x)) x 1 e b k = k +g(x) (b m) x+1 (k +g(x)) x+1 1 e b mk (b m) x+1 k x+1 1 e b for k l, since g(x) = {(1 m)/(b m)}x and there exists some l > x, such that k +g(x) = k +o(k) when k l. mk, Corollary 1. For k l, where l > x, the probability mass function P(k X = x) can be approximated as P(k X = x) = k+0.5 (b m) x+1 t x+1 1 e b mt dt k {γ(x+1,b m(k +1/2)) γ(x+1,b m(k 1/2))}, where γ(u, v) is the lower incomplete gamma function: γ(u,v) = v 0 t u 1 e t dt. 5

6 2.1. Computational validation The preceding results establish that the gamma family of distribution is a valid approximation to eq.(2). Computational validation result suggests that an improvement to the fit can be obtained by replacing the shape and scale parameters of the gamma distribution in Theorem 1 as follows. Let µ post and σ 2 post be the posterior mean and the posterior variance, respectively. For a gamma distribution with shape parameter α and scale parameter β, its mean and variance are given by αβ and αβ 2, respectively. Given a,b,c and x, we can compute the exact mean and variance of the posterior distribution of k: µ post = σ 2 post = kp(k X = x), k=x k 2 P(k X = x) µ 2 post. k=x Simple algebra then yields α = µ 2 post /σ2 post and β = σ2 post /µ post. The gamma approximation with α and β thus computed fits eq.(2) better than α = x+1, β = 1/(b m) given in Theorem 1. Figure 1 shows the how well the gamma approximation fits the posterior distribution of k with and without adjustment to α and β parameters. In both cases the quality of the gamma approximation deteriorates when x becomes relatively large if the α and β parameters are not adjusted. 3. Acknowledgment I thank Martti Tammi and Joel Zi-Bin Low for stimulating the current work by discussing an applied problem in RNA-Seq count data analysis with me. Vanamamalai Seshadri read and provided feedback on the initial draft. 6

7 a) Density Observed count (X) x b) Density Observed count (X) x Figure 1: Examples of fitting the gamma distribution to the posterior distribution of k for two cases: a) relatively small b parameter: a = 1.5,b = 0.1,c = 0.05 (m = 1.1); b) relatively large b parameters: a = 1.5,b = 0.5,c = 0.05 (m = 2.0). Solid lines indicate gamma approximation with shape and scale parameters determined by matching moments of the posterior distribution of k and the gamma distribution. Broken lines indicate gamma approximation with shape and scale parameters given in Theorem 1. 7

8 References P. C. Consul, G. C. Jain, A generalization of the Poisson distribution., Technometrics 15 (1973) H. Joe, R. Zhu, Generalized Poisson distribution: the property of mixture of Poisson and comparison with negative binomial distribution, Biometrical Journal 47 (2005) A. K. Nikoloulopoulos, D. Karlis, On modelling count data: a comparison of some well-known discrete distributions, Journal of Statistical Computation and Simulation 78 (2008) M. M. Shoukri, P. C. Consul, Some chance mechanisms generating the Generalized Poisson probability models, McGraw-Hill, New York, P. C. Consul, Generalized Poisson Distribution: Properties and Applications, Marcel Dekker, New York, S. Srivastava, L. Chen, A two-parameter generalized Poisson model to improve the analysis of RNA-Seq data, Nucleic Acids Research 47 (2010) W. Li, T. Jiang, Transcriptome assembly and isoform expression level estimation from biased RNA-Seq reads, Bioinformatics 28 (2012) J. Zhang, C. C. J. Kuo, L. Chen, WemIQ: an accurate and robust isoform quantification method for RNA-seq data, Bioinformatics 31 (2015) Z. Wang, J. Wang, C. Wu, M. Deng, Estimation of isoform expression in RNA-seq data using a hierarchical Bayesian model, Journal of Bioinformatics and Computational Biology 13 (2015) A. Erdélyi, Higher Transcendental Function Vol. I, McGraw-Hill, New York,