Elsevier

Information Sciences

Volume 42, Issue 3, August 1987, Pages 239-253
Information Sciences

Metric bounds on losses in adaptive coding

https://doi.org/10.1016/0020-0255(87)90024-7Get rights and content

Abstract

A noiseless-channel coding system in which the source probabilities change continuously in time is introduced. Using a geometry defined by the second derivative matrix of the information-theoretic entropy function, a bound on the number of excess channel symbols (the redundancy) sent by a retrospective encoder during a fixed time interval is derived. Results on minimal-cost coding and their implications for a real-time coding algorithm are then explored. Underlying most of the discussion here is the assumption made on the separability of the time scales corresponding to the (high) character rate as compared with the rate of change of the source probabilities.

References (7)

There are more references available in the full text version of this article.

Cited by (10)

  • Current trends in finite-time thermodynamics

    2011, Angewandte Chemie - International Edition
  • Finite-time thermodynamics and the optimal control of chemical syntheses

    2009, Zeitschrift fur Anorganische und Allgemeine Chemie
View all citing articles on Scopus

Permanent address: Physics Laboratory, University of Copenhagen, Universitetsparken 5, DK-2100 Copenhagen Ø, Denmark.

View full text