This submission belongs to the session b. Information Theory of the event 1st International Electronic Conference on Entropy and Its Applications
Published date
03 Nov, 2014
Citation
Takuya Yamano, A Note on Bound for Jensen-Shannon Divergence by Jeffreys, in Proceedings of 1st International Electronic Conference on Entropy and Its Applications, 3 November–21 November 2014, MDPI: Basel, Switzerland, doi: 10.3390/ecea-1-b002
Share
Email
Facebook
Twitter
LinkedIn
A Note on Bound for Jensen-Shannon Divergence by Jeffreys
Takuya Yamano 1
1. Faculty of Science, Kanagawa University, Yokohama, 221-8686, Japan
Abstract
The Jensen-Shannon divergence JS(p;q) is a similarity measure between two probability distributions p and q. It is presently used in varied disciplines. In this presentation, we provide a lower bound on the Jensen-Shannon divergence by the Jeffrery's J-divergence when p_i≥q_i is satisfied. In the original Lin's paper, the upper bound in terms of the J-divergence was the quarter of it. Recently, the shaper one was reported by Crooks. We discuss upper bounds by transcendental functions of Jeffreys by comparing those values for a binary distribution.
Keywords
Jensen-Shannon divergence
variational distance
Kullback-Leibler divergence
Jeffreys divergence
Manuscript
ECEA-1_A Note on Bound for Jensen-Shannon_Yamano.pdf
Maximum Entropy Approach for Reconstructing Bivariate Probability Distributions
Towards the Development of a Universal Expression for the Configurational Entropy of Mixing