We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Information-Theoretic Analysis of Memoryless Deterministic Systems.
- Authors
Geiger, Bernhard C.; Kubin, Gernot
- Abstract
The information loss in deterministic, memoryless systems is investigated by evaluating the conditional entropy of the input random variable given the output random variable. It is shown that for a large class of systems the information loss is finite, even if the input has a continuous distribution. For systems with infinite information loss, a relative measure is defined and shown to be related to Rényi information dimension. As deterministic signal processing can only destroy information, it is important to know how this information loss affects the solution of inverse problems. Hence, we connect the probability of perfectly reconstructing the input to the information lost in the system via Fano-type bounds. The theoretical results are illustrated by example systems commonly used in discrete-time, nonlinear signal processing and communications.
- Subjects
INFORMATION processing; SIGNAL processing; DETERMINISTIC processes; MEMORYLESS systems; INFORMATION theory
- Publication
Entropy, 2016, Vol 18, Issue 11, p410
- ISSN
1099-4300
- Publication type
Article
- DOI
10.3390/e18110410