Abstract:
A discrete memoryless two-way channel is defined by a set of transmission probabilitiesP(y, \bar{y}/x, \bar{x}), wherexand are the transmitted signals, andyand\bar{y}are ...Show MoreMetadata
Abstract:
A discrete memoryless two-way channel is defined by a set of transmission probabilitiesP(y, \bar{y}/x, \bar{x}), wherexand are the transmitted signals, andyand\bar{y}are the received signals. Shannon showed that ifxand\bar{x}are generated independently and without regard to the past, then the rates(R, \bar{R})of information transmitted through the opposite channel directions will lie in a region ofG_{I}of the plane. The present paper investigates whetherG_{I}can be exceeded if the past is allowed to influence the selection of the input signals. Two-way channels are analyzed in order to determine the statistical characteristics of matching signal sources. Appendix I shows how independent messages can be encoded so that during communication the channel signal statistics would approach those caused by sources which generate inputs with arbitrary probabilities Pr(x/x_{-1}, \cdot, x_{-l}; y_{-1}, \cdot, y_{-l})and Pr(\bar{x}/ \bar{x}_{-1}, \cdot, \bar{x}_{-l}; \bar{y}_{-1}, \cdot, y_{-l}). Under certain natural restrictions, the binary two-way channel can be canonically decomposed into an interconnection of pairs of oppositely oriented memoryless one-way channels connected in cascade to special channels that are noiseless whenever the signal transmitted in the opposite direction is an appropriate one. Three distinct categories are defined into which the totality of all binary channels can be partitioned, according to the type of their decomposition. If the transmission probabilitiesP(y, \bar{y}/x, \bar{x})are symmetrical, equivalent channel representations can be obtained, consisting of interconnections of switches, binary adders, and independent noise sources. In the light of this characteristics of appropriate source signal generation probabilities are discussed and classes of symmetrical channels determined with the conjecture that here the best possible signal sources are memoryless.
Published in: IEEE Transactions on Information Theory ( Volume: 10, Issue: 1, January 1964)