Events4th International Electronic Conference on Entropy and Its Applications
Published
This submission belongs to the session b. Information and Complexity of the event 4th International Electronic Conference on Entropy and Its Applications
Published date
21 Nov, 2017
Citation
Velimir Ilic, Ivan B. Djordjevic, Miomir Stankovic, On a general definition of conditional Renyi entropies, in Proceedings of 4th International Electronic Conference on Entropy and Its Applications, 21 November–1 December 2017, MDPI: Basel, Switzerland, doi: 10.3390/ecea-4-05030
Share
Email
Facebook
Twitter
LinkedIn

On a general definition of conditional Renyi entropies

image
image
1. Mathematical Institute of the Serbian Academy of Sciences and Arts, Belgrade, Serbia
2. University of Arizona, Department of Electrical and Computer Engineering 1230 E. Speedway Blvd, Tucson, AZ
3. University of Nis, Faculty of Occupational Safety, Carnojevica 10a, 18000 Nis, Serbia
Abstract

In recent decades, different definitions of conditional Renyi entropy (CRE) have been introduced. Thus, Arimoto proposed a definition that found an application in information theory, Jizba and Arimitsu proposed a definition that found an application in time series analysis and Renner-Wolf, Hayashi and Cachin proposed definitions that are suitable for cryptographic applications. However, there is still no a commonly accepted definition, nor a general treatment of the CRE-s, which can essentially and intuitively be represented as an average uncertainty about a random variable X if a random variable Y is given. In this paper we fill the gap and propose a three-parameter CRE, which contains all of the previous definitions as special cases that can be obtained by a proper choice of the parameters. Moreover, it satisfies all of the properties that are simultaneously satisfied by the previous definitions, so that it can successfully be used in aforementioned applications. Thus, we show that the proposed CRE is positive, continuous, symmetric, permutation invariant, equal to Rényi entropy for independent X and Y , equal to zero for X = Y and monotonic. In addition, as an example for the further usage, we discuss the properties of generalized mutual information, which is defined using proposed CRE.

Keywords
Renyi entropy
conditional entropy
mutual information
Manuscript
Pattern recognition in nuclear fusion data by means of geometric methods in probabilistic spaces
Characterization of Some Dynamic Network Models