EventsEntropy 2021: The Scientific Tool of the 21st Century
Published
This submission belongs to the session Session 2. Information Theory, Probability and Statistics of the event Entropy 2021: The Scientific Tool of the 21st Century
Published date
05 May, 2021
Citation
Andreia Teixeira, André Souto, Luís Antunes, On Conditional Tsallis Entropy, in Proceedings of Entropy 2021: The Scientific Tool of the 21st Century, 5 May–7 May 2021, MDPI: Basel, Switzerland, doi: 10.3390/Entropy2021-09750
Share
Email
Facebook
Twitter
LinkedIn

On Conditional Tsallis Entropy

image
Luís Antunes 7,8
1. Centre for Health Technology and Services Research (CINTESIS), Faculty of Medicine University of Porto, Porto, Portugal, Portugal
2. Health Information and Decision Sciences Department - MEDCIDS, Faculty of Medicine, University of Porto, Porto, Portugal
3. ARC4DigiT, Polytechnic Institute of Viana do Castelo, Viana do Castelo, Portugal
4. Departamento de Informática Faculdade de Ciências da Universidade de Lisboa, Lisboa, Portugal
5. LASIGE, Universidade de Lisboa, Lisboa, Portugal
6. Instituto de Telecomunicações, Portugal
7. Institute for Systems and Computer Engineering, Technology and Science (INESC-TEC), Porto, Portugal
8. DCC-FCUP, University of Porto, Porto, Portugal
Abstract

Tsallis entropy, a generalisation of Shannon entropy that depends on a parameter alpha, provides an alternative way of dealing with several characteristics of nonextensive physical systems given that the information about the intrinsic fluctuations in the physical system can be characterized by the nonextensivity parameter alpha. It is known that as the parameter alpha approaches 1, the Tsallis entropy corresponds to the Shannon entropy. Unlike for Shannon entropy, but similarly to Rényi entropy (yet another generalisation of Shannon entropy that also depends on a parameter alpha and converges to Shannon entropy when alpha approaches 1), there is no commonly accepted definition for the conditional Tsallis entropy. In this work, we revisit the notion of conditional Tsallis entropy by studying some natural and desirable properties in the existing proposals: when alpha tends to 1, the usual conditional Shannon entropy should be recovered; the conditional Tsallis entropy should not exceed the unconditional Tsallis entropy; and the conditional Tsallis entropy should have values between 0 and the maximum value of the unconditional version. We also introduce a new proposal for conditional Tsallis entropy and compare it with the existing ones.

Keywords
Tsallis entropy
Conditional Tsallis entropies
Manuscript
Oral Presentation
Poster
poster.pdf
A Model-Based Reinforcement Learning Approach for a Rare Disease Diagnostic Task
Predicting Human Responses to Syllogism Tasks Following the Principle of Maximum Entropy