ON A DIFFERENCE OF JENSEN INEQUALITY AND ITS APPLICATIONS TO MEAN DIVERGENCE MEASURES INDER JEET TANEJA arxiv:math/05030v [math.st] 9 Jan 005 Let Abstract. In this paper we have considered a difference of Jensen s inequality for convex functions proved some of its properties. In particular, we have obtained results for Csiszár [5] f divergence. A result is established that allow us to compare two measures under certain conditions. By the application of this result we have obtained a new inequality for the well known means such as arithmetic, geometric harmonic. Some divergence measures based on these means are also defined.. Jensen Difference { Γ n = P = (p, p,..., p n ) p i > 0, } p i =, n, be the set of all complete finite discrete probability distributions. Let f : I R R be a differentiable convex function on the interval I, x i I o ( I o is the interior of I). Let λ = (λ, λ,..., λ n ) Γ n, then it is well known that ( ) () f λ i x i λ i f(x i ). The above inequality is famous as Jensen inequality. If f is concave, the inequality sign changes. Let us consider the following Jensen difference: ( () F f (λ, X) = λ i f(x i ) f λ i x i ), Here below we shall give two theorems giving properties of Jensen difference. Theorem. Let f : I R R be a differentiable convex function on the interval I, x i o I ( o I is the interior of I), λ = (λ, λ,..., λ n ) Γ n. If η, η o I η x i η, i =,,..., n, then we have the inequalities: (3) 0 F f (λ, X) L f (λ, X) Z f (η, η ), Key words phrases. Jensen difference; Divergence measures; Csiszár s f-divergence; Convex function; Mean inequalities. This paper is a part of author s chapter to appear in Advances in Imaging Electron Physics, 005, Elsevier Publication.
INDER JEET TANEJA where (4) L f (λ, X) = ( )( ) λ i x i f (x i ) λ i x i λ i f (x i ) (5) Z f (η, η ) = 4 (η η ) [f (η ) f (η )]. The above theorem is due to Dragomir [0]. It has been applied by many authors [9],[3]. The measure F(λ, X) has been extensively studied by Burbea Rao [3, 4]. As a consequence of above theorem we have the following corollary. Corollary. For all a, b, υ, ω (0, ), the following inequalities hold: ( ) υf(a) + ωf(b) υa + ωb (6) 0 f υ + ω υ + ω υaf ( ) ( ) (a) + ωbf (b) υa + ωb υf (a) + ωf (b) υ + ω υ + ω υ + ω 4 (b a) (f (b) f (a)). Proof. It follows from Theorem, by taking λ = x = a, x = b, x =... = x n = 0. Now we shall give some examples of Theorem. υ, λ υ+ω = Example. For all x (0, ), let us consider a function { x s, s 0, (7) f s (x) = s ln x, s = 0. ω, λ υ+ω 3 =... = λ n = 0, We can easily check that the function f s (x) is convex in (0, ) for all s. Let there exist η η such that η x i η, i =,,..., n. Applying Theorem for the function f s (x), we have (8) 0 F s (λ, X) Z s (η, η ), s, where [( n ) s λ s i x i n λ i x s i (9) F s (λ, X) = ln ], s 0, ( ) A(λ,X), s = 0. G(λ,X) (0) A(λ, X) = λ i x i, () G(λ, X) = n x λ i i
JENSEN INEQUALITY 3 () Z s (α, β) = 4 (η η ) ( ) η s η s. (3) In particular we have A(λ, X) exp G(λ, X) [ (η η ) 4η η ], η x i η, i =,,..n. The result (3) is due to Dragomir [0]. The following proposition is a particular case of the inequalities (6) gives bounds on Burbea Rao s [3, 4] Jensen difference divergence measure. Proposition. Let f : (0, ) R be a differentiable convex function. Then for all P, Q Γ n, we have [ ( )] f(pi ) + f( ) pi + (4) 0 f (p i )[f (p i ) f ( )]. 4 Proof. Take ω = υ = in (6), we get ( ) f(a) + f(b) a + b (5) 0 f 4 (b a) [f (b) f (a)]. Replace in (5), a by p i b by, sum over all i =,,..., n, we get the required result. Example. Let us consider a convex function [s(s )] [x s s(x )], s 0,, (6) φ s (x) = x ln x, s = 0, x + x ln x, s =, for all x (0, ) s (, ). Then from (4), we get (7) 0 W s (P Q) 4 V s(p Q), where I s (P Q) = [s(s )] n [ (8) W s (P Q) = n ( ) ] p I 0 (P Q) = ln i + p i, s = 0, I(P Q) = H ( P+Q [ p s i +qi s ( p i + ) ] s, s 0,, ) H(P)+H(Q), s =,
4 INDER JEET TANEJA J s (P Q) = (s ) (9) V s (P Q) = J 0 (P Q) = n J(P Q) = n (p i ) ( p s i ) q s i, s 0,, (p i ) p i, s = 0, (p i ) ln ( pi ), s =. The expression H(P) = n p i ln p i, appearing in (8) is the well known Shannon s entropy. The expression J(P Q) appearing in (9) is Jeffreys-Kullback-Leibler s J-divergence (ref. Jeffreys [6] Kullback Leibler [7]). The expression J s (P Q) is due to Burbea Rao [3]. The measures (8) (9) has been studied by Burbea Rao [3] only for positive values of the parameters. Some studies on these generalised measures can be seen in Taneja [8, 0]. Here we have presented them for all s (, ). The function given in (6) is due to Cressie Read [7]. Proposition. Let f : R + R be differentiable convex normalized i.e., f() = 0. If P, Q Γ n, are such that 0 < r p i R <, i {,,..., n}, for some r R with 0 < r R <, then we have (0) 0 C f (P Q) E Cf (P Q) A Cf (r, R), () 0 C f (P Q) B Cf (r, R) A Cf (r, R), where () C f (P Q) = f( p i ), (3) E Cf (P Q) = (p i )f ( p i ), (4) A Cf (r, R) = 4 (R r) (f (R) f (r)) (5) B Cf (r, R) = (R )f(r) + ( r)f(r). R r The inequalities (0) follow in view of (3). The inequalities () follow in view of (6). For details refer to Taneja []. The above proposition is an improvement over the work of Dragomir [, ]. The measure () is known as Csiszár s [5] f-divergence.
JENSEN INEQUALITY 5 Example 3. Under the conditions of Proposition, the inequalities (0) () for the function (6) are given by (6) 0 Φ s (P Q) E Φs (P Q) A Φs (r, R) (7) 0 Φ s (P Q) B Φs (r, R) A Φs (r, R), where [ n K s (P Q) = [s(s )] (8) Φ s (P Q) = K(Q P) = n ln K(P Q) = n p i ln (s ) n (p i ) (9) E Φs (P Q) = (p i ) ln ] p s iqi s, s 0,, ( p i ), s = 0, ( p i ), s =, ( p i ) s, s, ( ) p i, s =, (R r)(r (30) A Φs (r, R) = s r s ), s, 4(s ) 4 (R r) ln( ) R 4 r, s =, (R )(r )+( r)(r s ), (R r)s(s ) s 0,, (R ) ln (3) B Φs (r, R) = r +( r)ln R, (R r) s = 0, (R )r lnr+( r)r ln R (R r), s =. The measure K(P Q) appearing in (8) is the well known Kullback-Leibler s [7] relative information. The measure Φ s (P Q) given in (8) has been extensively studied in [], [3]. Theorem. Let f, f : [a, b] R + R be twice differentiable functions on (a, b) there are α β such that (3) α f (x) f (x) β, x (a, b), f (x) > 0
6 INDER JEET TANEJA If x i [a, b] λ = (λ, λ,..., λ n ) Γ n, then (33) α F f (λ, X) F f (λ, X) β F f (λ, X). (34) (35) α [L f (λ, X) F f (λ, X)] L f (λ, X) F f (λ, X) β [L f (λ, X) F f (λ, X)] α [Z f (η, η ) F f (λ, X)] Z f (η, η ) F f (λ, X) β [Z f (η, η ) F f (λ, X)]. Proof. Consider the mapping g : [a, b] R, defined by (36) g(x) = f (x) αf (x), x [a, b], where the functions f f satisfy the condition (3). Then the function g is twice differentiable on (a, b). This gives g (x) = f (x) αf (x) ( ) g (x) = f f (x) αf (x) = f (x) (x) f (x) α 0, x (a, b). The above expression shows that g is convex on [a, b]. Applying Jensen inequality for the convex function g one gets ( ) g λ i x i λ i g(x i ), i.e., ( ) ( ) f λ i x i αf λ i x i λ i [f (x i ) αf (x)], i.e., [ ( )] ( (37) α λ i f (x i ) f λ i x i λ i f (x i ) f λ i x i ). The expression (37) gives the l.h.s. of the inequalities (33). Again consider the mapping k : [a, b] R given by (38) k(x) = βf (x) f (x), proceeding on similar lines as before, we get the proof of the r.h.s. of the inequalities (33). Now we shall prove the inequalities (34). Applying the inequalities (3) for the convex function g given by (36), we get F g (λ, X) L g (λ, X) Z g (η, η ).
JENSEN INEQUALITY 7 i.e., (39) F f (λ, X) αf f (λ, X) L f (λ, X) αl f (λ, X) Z f (λ, X) αf f (η, η ). Simplifying the first inequality of (39) we get (40) α [L f (λ, X) F f (λ, X)] L f (λ, X) F f (λ, X). Again simplifying the last inequality of (39) we get (4) α [Z f (η, η ) F f (λ, X)] Z f (η, η ) F f (λ, X). The expressions (40) (4) complete the first part of the inequalities (34) (35) respectively. The last part of the inequalities (34) (35) follows by considering the function k(x) given by (38) over the inequalities (3). Particular cases of above theorem can be seen in [], [8], [9], [4]. Applications of the above theorem for the Csiszár s f-divergence are given in the following proposition. Proposition 3. Let f, f : I R + R be two normalized convex mappings, i.e., f () = f () = 0 suppose the assumptions: (i) f f are twice differentiable on (r, R), where 0 < r R < ; (ii) there exists the real constants α, β such that α < β (4) α f (x) f (x) β, f (x) > 0, x (r, R). If P, Q Γ n are discrete probability distributions satisfying the assumption then we have the inequalities: 0 < r p i R <, (43) α C f (P Q) C f (P Q) β C f (P Q), (44) (45) α [E f (P Q) C f (P Q)] E f (P Q) C f (P Q) β [E f (P Q) C f (P Q)], α [A f (r, R) C f (P Q)] A f (r, R) C f (P Q) β [A f (r, R) C f (P Q)] (46) α [B f (r, R) C f (P Q)] B f (r, R) C f (P Q) β [B f (r, R) C f (P Q)]. Proof. It is an immediate consequence of the Theorem.
8 INDER JEET TANEJA. Applications to Mean Divergence Measures Let us consider the following mean of order t: ( ) /t a t +b t, t 0, (47) D t (a, b) = ab, t = 0, max{a, b}, t =, min{a, b}, t =, for all a, b > 0 t R. In particular, we have D (a, b) = H(a, b) = a + b = ab a + b = A(a, b ), D 0 (a, b) = G(a, b) = ab = A(a, b)h(a, b), ( a ) + b ( a, ) D / (a, b) = N (a, b) = = A b D (a, b) = A(a, b) = a + b, where H(a, b), G(a, b) A(a, b) are the well known harmonic, geometric arithmetic means respectively. It is well know [] that the mean of order t given in (47) is monotonically increasing in t, then we can write or equivalently, D (a, b) D 0 (a, b) D / (a, b) D (a, b), (48) H(a, b) G(a, b) N (a, b) A(a, b). We can easily check that the function f(x) = x / is convex in (0, ). This allows us to conclude the following inequality: a + b a + b (49). From (49), we can easily derive that ( a ) ( a )( ) + b + b a + b (50) a + b. Finally, the expressions (48) (50) lead us to following inequalities: (5) H(a, b) G(a, b) N (a, b) N (a, b) A(a, b), where ( a ) ( ) + b a + b N (a, b) =.
JENSEN INEQUALITY 9 Let P, Q Γ n. In (5), replace a by p i b by sum over all i =,,...n we get (5) H(P Q) G(P Q) N (P Q) N (P Q). Based on inequalities (5), we shall build some mean divergence measures. Let us consider the following differences: (53) (54) (55) (56) (57) (58) (59) We can easily verify that We can also write M AG (P Q) = G(P Q), M AH (P Q) = H(P Q), M AN (P Q) = N (P Q), M N G(P Q) = N (P Q) G(P Q), M N N (P Q) = N (P Q) N (P Q). M AG (P Q) = G(P Q) = [N (P Q) G(P Q)] := M N G(P Q) = [ N (P Q)] := M AN (P Q). (60) M AG (P Q) = G(P Q) := h(p Q) (6) M AH (P Q) = H(P Q) := (P Q), where h(p Q) is the well known Hellinger s [5] discrimination (P Q) is known by triangular discrimination. These two measures are well known in the literature of statistics. The measure M AN (P Q) is new has been recently studied by Taneja []. Now we shall prove the convexity of these measures. This is based on the well known result due to Csiszár [5, 6]. Result. If the function f : R + R is convex normalized, i.e., f() = 0, then the f-divergence, C f (P Q) is nonnegative convex in the pair of probability distribution (P, Q) Γ n Γ n. Example 4. Let us consider (6) f AH (x) = (x ), x (0, ), (x + ) in (5), then C f (P Q) = M AH (P Q), where M AH (P Q) is as given by (54). Moreover, f AH(x) (x )(x + 3) = (x + )
0 INDER JEET TANEJA (63) f AH (x) = 4 > 0, x (0, ). (x + ) 3 Example 5. Let us consider (64) f AG (x) = ( x ), x (0, ), in (5), then C f (P Q) = M AG (P Q), where M AG (P Q) is as given by (53). Moreover, x f AG(x) = x (65) f AG(x) = 4x > 0, x (0, ). x Example 6. Let us consider (66) f N N (x) = (x + ) (x + ) x x, x (0, ) 4 in (5), then we have C f (P Q) = M N N (P Q), where M N N (P Q) is as given by (57). Moreover, f N N (x) = x + + x ( x + ) (x + ) 6 x(x + ) f N N (x) = x x5/ + x(x + ) 3/ (67) 8x 5/ (x + ) 3/ = x [ (x + ) 3/ (x 3/ + ) ]. 8x 5/ (x + ) 3/ Since (x + ) 3/ x 3/ +, x (0, ) 3/, then obviously, f N N (x) 0, x (0, ). Example 7. Let us consider (68) f N G(x) = ( x + ) (x + ) 4x, x (0, ), 4 in (5), then C f (P Q) = M N G(P Q), where M N G(P Q) is as given by (56). Moreover, f (x) = x + + x (x + ) N G 4 x(x + ) (69) f N G (x) = (x + )3/ x 3/. 4x 3/ (x + ) 3/ Since (x + ) 3/ x 3/ +, x (0, ) 3/, then obviously, f N G (x) 0, x (0, ).
JENSEN INEQUALITY Example 8. Let us consider (70) f AN (x) = (x + ) ( x + ) (x + ), x (0, ), 4 in (3.), then C f (P Q) = M AN (P Q), where M AN (P Q) is as given by (55). Moreover, (7) f AN (x) = f AN (x) = x + + x x(x + ) 4, (x + ) + x 3/ 8x 3/ (x + ) > 0, x (0, ). x + In the above examples 4-8 the generating function f ( ) () = 0 the second derivative is positive for all x (0, ). This proves the nonegativity convexity of the measures (53)-(57) in the pair of probability distributions (P, Q) Γ n Γ n. The inequality (5) also admits more nonnegative differences, but here we have considered only the convex ones. Based on the Proposition, we can obtain bounds on the mean divergence measures, but we omit these details here. Now we shall apply the inequalities (34) given in Proposition.3 to obtain inequalities among the measures (53)-(57). Theorem 3. The following inequalities among the six mean divergences hold: (7) 8 M AH(P Q) M N N (P Q) 3 M N G(P Q) 4 M AG(P Q) M AN (P Q). The proof of the above theorem is based on the following propositions, where we have proved each part separately. Proposition 4. The following inequality hold: (73) Proof. Let us consider 8 M AH(P Q) M N N (P Q). (74) g AH N N (x) = f AH (x) f N N (x) = 3x 5/ (x + ) 3/, x (0, ), (x + ) 3 [ x x 5/ + x(x + ) 3/ ] where f AH (x) f N N (x) are as given by (63) (67) respectively.
INDER JEET TANEJA From (74), we have g AH 48 x(x + ) N N (x) = (x + ) 4 [ x x 5/ + x(x + ) 3/ ] [ 4x ( x 5/ ) + x (x )(x + ) 5/] = 48x (x + ) ( x) x(x + ) (x + ) 4 [ x x 5/ + x(x + ) 3/ ] [ ( x + ) (x + ) 3/ ( x + x 3/ + x + x + )]. Since (x + ) x +, x (0, ), then (x + ) 3/ ( x + ) ( x + ) (x + ) Thus we conclude that (75) g AH N N (x) x + x 3/ + x + x +. { < 0, x >, > 0, x <. In view of (75), we conclude that the function g AH N N (x) is increasing in x (0, ) decreasing in x (, ), hence (76) M = sup g AH N N (x) = g AH N N () = 8. x (0, ) Applying the inequalities (34) for the measures M AH (P Q) M N N (P Q) along with (76) we get the required result. Proposition 5. The following inequality hold: (77) M N N (P Q) 3 M N G(P Q). Proof. Let us consider (78) g N N N G(x) = f N N (x) f N G (x) = x x5/ + x(x + ) 3/, x (0, ), x [ + x 3/ (x + ) 3/ ] where f N N (x) f N G (x) are as given by (67) (69) respectively. From (78), we have (79) g N 3x x + ( { x) < 0, x >, N N G (x) = x [ x 3/ + (x + ) 3/ ] > 0, x <. In view of (79), we conclude that the function g N N N G(x) is increasing in x (0, ) decreasing in x (, ), hence (80) M = sup g N N N G(x) = g N N N G() = x (0, ) 3.
JENSEN INEQUALITY 3 Applying the inequalities (34) for the measures M N N (P Q) M N G(P Q) along with (80) we get the required result. Proposition 6. The following inequality hold: (8) M N G(P Q) 3 4 M AG(P Q). Proof. Let us consider (8) g N G AG(x) = f N G (x) f AG (x) = + x3/ (x + ) 3/, x (0, ), (x + ) 3/ where f N G (x) f AG (x) are as given by (69) (65) respectively. From (8), we have (83) g N G AG (x) = 3 ( x) (x + ) 5/ { 0, x, 0, x. In view of (83), we conclude that the function g AH N N (x) is increasing in x (0, ) decreasing in x (, ), hence (84) M = sup g N G AG(x) = g N G AG() = 3 x (0, ) 4. Applying the inequalities (34) for the measures M N G(P Q) M AG (P Q) along with (84) we get the required result. Proposition 7. The following inequality hold: (85) Proof. Let us consider 4 M AG(P Q) M AN (P Q). (86) g AG AN (x) = f AG (x) f AN (x) = (x + ) 3/ ( x + ) (x, x (0, ), x + ) where f AG (x) f AN (x) are as given by (65) (7) respectively. From (86), we have (87) g AG AN (x) = 3 ( x) x + ( x + ) (x x + ) { 0, x 0, x. In view of (87), we conclude that the function g AG AN (x) is increasing in x (0, ) decreasing in x (, ), hence (88) M = sup g AG AN (x) = g AG AN () = 4. x (0, ) Applying the inequalities (34) for the measures M AG (P Q) M AN (P Q) along with (88) we get the required result.
4 INDER JEET TANEJA Combining the results given in the Propositions 4-7, we get the proof of the theorem. The expression (73) can also be written as (89) 6 (P Q) M N N (P Q) 3 M N G(P Q) 4 h(p Q) M AN (P Q). Remark. (i) The classical divergence measures I(P Q) J(P Q) appearing in the Section can be written in terms of Kullback-Leibler s relative information as follows: (90) I(P Q) = [ ( K P P + Q ) ( + K Q P + Q )] (9) J(P Q) = K(P Q) + K(Q P). Also we can write (9) J(P Q) = 4 [I(P Q) + T(P Q)], where (93) T(P Q) = (94) (95) (96) = [ ( ) ( )] P + Q P + Q K P + K Q ( ) A(pi, ) A(p i, ) ln, G(p i, ) is the arithmetic geometric mean divergence measure due to Taneja [9]. (ii) Recently, Taneja [] proved the following inequality: 4 (P Q) I(P Q) h(p Q) 4 M AN (P Q) J(P Q) T(P Q). 8 Following the lines of the Propositions 4-7, we can also show that 4 I(P Q) M N N (P Q). Thus combining (89) with (9), (94) (95), we get the following inequalities among the classical mean divergence measures: 6 (P Q) 4 I(P Q) M N N (P Q) 3 M N G(P Q) 4 h(p Q) M AN (P Q) 3 J(P Q) 4 T(P Q) J(P Q). 6
JENSEN INEQUALITY 5 References [] D. ANRICA I. RAŞA, The Jensen Inequality: Refinement Applications, Anal. Num. Theory Approx., 4(985), 05-08. [] E. F. BECKENBACH R. BELLMAN, Inequalities, Springer-Verlag, New York, 97. [3] J. BURBEA, J. C.R. RAO, Entropy Differential Metric, Distance Divergence Measures in Probability Spaces: A Unified Approach, J. Multi. Analysis, (98), 575-596. [4] J. BURBEA, J. C.R. RAO, On the Convexity of Some Divergence Measures Based on Entropy Functions, IEEE Trans. on Inform. Theory, IT-8(98), 489-495. [5] I. CSISZÁR, Information Type Measures of Differences of Probability Distribution Indirect Observations, Studia Math. Hungarica, (967), 99-38. [6] I. CSISZÁR, On Topological Properties of f Divergences, Studia Math. Hungarica, (967), 39-339. [7] P. CRESSIE T.R.C. READ, Multinomial Goodness-of-fit Tests, J. Royal Statist. Soc., Ser. B, 46(984), 440-464. [8] S.S. DRAGOMIR, An Inequality for Twice Differetiable Convex Mappings Applications for the Shannon Rnyi s Entropies, RGMIA Research Report Collection, http://rgmia.vu.edu.au,..(999). [9] S.S. DRAGOMIR, On An Inequality for Logrithmic Mapping Applications for the Shannon Entropy, RGMIA Research Report Collection, http://rgmia.vu.edu.au,..(999). [0] S. S. DRAGOMIR, A Converse Result for Jensen s Discrete Inequality via Gruss Inequality Applications in Information Theory, available on line: http://rgmia.vu.edu.au/authors/ssdragomir.htm, 999. [] S. S. DRAGOMIR, Some Inequalities for the Csiszár s f Divergence - Inequalities for Csiszár s f Divergence in Information Theory - Monograph - Chapter I - Article - http://rgmia.vu.edu.au/monographs/csiszar.htm. [] S. S. DRAGOMIR, Other Inequalities for Csiszár s Divergence Applications - Inequalities for Csiszár s f-divergence in Information Theory - Monograph - Chapter I - Article 4 - http://rgmia.vu.edu.au/monographs/csiszar.htm. [3] S. S. DRAGOMIR, N.M. Dragomir K. PRANESH, An Inequality for Logarithms Applications in Information Theory, Computers Math. with Appl., 38(999), -7. [4] S.S. DRAGOMIR N.M. IONESCU, Some Converse of Jensen s Inequality Anal. Num. Theory Approx., 3(994), 7-78. [5] E. HELLINGER, Neue Begründung der Theorie der quadratischen Formen von unendlichen vielen Veränderlichen, J. Reine Aug. Math., 36(909), 0-7. [6] H. JEFFREYS, An Invariant Form for the Prior Probability in Estimation Problems, Proc. Roy. Soc. Lon., Ser. A, 86(946), 453-46. [7] S. KULLBACK R.A. LEIBLER, On Information Sufficiency, Ann. Math. Statist., (95), 79-86. [8] I. J. TANEJA, On Generalized Information Measures Their Applications, Chapter in: Advances in Electronics Electron Physics, Ed. P.W. Hawkes, Academic Press, 76(989), 37-43. [9] I. J. TANEJA, New Developments in Generalized Information Measures, Chapter in: Advances in Imaging Electron Physics, Ed. P.W. Hawkes, 9(995), 37-36. [0] I. J. TANEJA, Generalized Information Measures their Applications - on line book: http://www.mtm.ufsc.br/ taneja/book/book.html, 00.
6 INDER JEET TANEJA [] I. J. TANEJA, Generalized Relative Information Information Inequalities, Journal of Inequalities in Pure Applied Mathematics. Vol. 5, No., 004, Article, -9. Also in: RGMIA Research Report Collection, http://rgmia.vu.edu.au, 6(3)(003), Article 0. [] I.J. TANEJA, Generalized Symmetric Divergence Measures Inequalities RGMIA Research Report Collection, http://rgmia.vu.edu.au, 7(4)(004), Art. 9 [3] I. J. TANEJA P. KUMAR, Relative Information of Type s, Csiszár f Divergence, Information Inequalities, Information Sciences, 66(-4),004, 05-5. Also in: http://rgmia.vu.edu.au, RGMIA Research Report Collection, 6(3)(003), Article. Inder Jeet Taneja, Departamento de Matemática, Universidade Federal de Santa Catarina, 88.040-900 Florianópolis, SC, Brazil E-mail address: taneja@mtm.ufsc.br URL: http://www.mtm.ufsc.br/ taneja