Events1st International Electronic Conference on Entropy and Its Applications
Published
This submission belongs to the session b. Information Theory of the event 1st International Electronic Conference on Entropy and Its Applications
Published date
03 Nov, 2014
Citation
Takuya Yamano, A Note on Bound for Jensen-Shannon Divergence by Jeffreys, in Proceedings of 1st International Electronic Conference on Entropy and Its Applications, 3 November–21 November 2014, MDPI: Basel, Switzerland, doi: 10.3390/ecea-1-b002
Share
Email
Facebook
Twitter
LinkedIn

A Note on Bound for Jensen-Shannon Divergence by Jeffreys

1. Faculty of Science, Kanagawa University, Yokohama, 221-8686, Japan
Abstract
The Jensen-Shannon divergence JS(p;q) is a similarity measure between two probability distributions p and q. It is presently used in varied disciplines. In this presentation, we provide a lower bound on the Jensen-Shannon divergence by the Jeffrery's J-divergence when p_i≥q_i is satisfied. In the original Lin's paper, the upper bound in terms of the J-divergence was the quarter of it. Recently, the shaper one was reported by Crooks. We discuss upper bounds by transcendental functions of Jeffreys by comparing those values for a binary distribution.
Keywords
Jensen-Shannon divergence
variational distance
Kullback-Leibler divergence
Jeffreys divergence
Manuscript
Maximum Entropy Approach for Reconstructing Bivariate Probability Distributions
Towards the Development of a Universal Expression for the Configurational Entropy of Mixing