Abstract
We survey the actual and potential rôles of automata in the modelling of information transmission systems and, in particular, in the encoder, channel and decoder components of such systems. Our focus is on applications of codes in such systems and on the relevance of automaton theoretic methods to these applications. We discuss, for example, the issues of error-detection, fault-tolerance and error-correction for variable-length codes. Beyond reviewing known work in a possibly new setting, we also present some recent results on fault-tolerant decoders for systems in which synchronization errors are likely. We conclude with a kind of research programme, a list of rather general open problems requiring solutions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Béal, M.-P., Berstel, J., Marcus, B.H., Perrin, D., Reutenauer, Ch., Siegel, P.H.: Variable length codes and finite automata. In: Woungang, I., Misra, S., Misra, S.C. (eds.) Selected Topics on Information and Coding Theory. Series on Coding Theory and Cryptology, vol. 7, pp. 505–584. World Scientific, Singapore (2010)
Berstel, J.: Transductions and Context-Free Languages. Leitfäden der angewandten Mathematik und Mechanik, LAMM, vol. 38. B. G. Teubner, Stuttgart (1979)
Berstel, J., Perrin, D.: Theory of Codes. Academic Press, Orlando (1985)
Berstel, J., Perrin, D., Reutenauer, Ch.: Codes and Automata. Encyclopedia of Mathematics and Its Applications, vol. 129. Cambridge University Press, Cambridge (2010)
Duske, J., Jürgensen, H.: Codierungstheorie. BI Wissenschaftsverlag, Mannheim (1977)
Forney Jr., G.D.: The Viterbi algorithm. Proc. IEEE 61(3), 268–278 (1973)
Glebskii, Y.V.: Coding by means of finite automata. Dokl. Akad. Nauk. SSSR 141, 1054–1057 (1961) (in Russian); English translation: Soviet Physics Dokl. 6, 1037–1039 (1962)
Guiaşu, S.: Information Theory with Applications. McGraw-Hill, New York (1977)
Han, Y.-S., Salomaa, K.: Overlap-free languages and solid codes. Internat. J. Foundations Comput. Sci. 22, 1197–1209 (2011)
Ito, M., Jürgensen, H., Shyr, H.J., Thierrin, G.: Outfix and infix codes and related classes of languages. J. Comput. System Sci. 43, 484–508 (1991)
Jégou, H., Malinowski, S., Guillemot, C.: Trellis state aggregation for soft decoding of variable length codes. In: Proceedings of the 2005 IEEE Workshop on Signal Processing Systems: Design and Implementation (SIPS 2005), Athens, Greece, November 2-4, pp. 603–608. IEEE, Piscataway (2005)
Jürgensen, H.: Syntactic monoids of codes. Acta Cybernet. 14, 117–133 (1999)
Jürgensen, H., Katsura, M., Konstantinidis, S.: Maximal solid codes. J. of Automata, Languages and Combinatorics 6, 25–50 (2001)
Jürgensen, H., Konstantinidis, S.: Variable-length codes for error correction. In: Fülöp, Z. (ed.) ICALP 1995. LNCS, vol. 944, pp. 581–592. Springer, Heidelberg (1995)
Jürgensen, H., Konstantinidis, S.: Error correction for channels with substitutions, insertions, and deletions. In: Chouinard, J.-Y., Fortier, P., Gulliver, T.A. (eds.) Information Theory 1995. LNCS, vol. 1133, pp. 149–163. Springer, Heidelberg (1996)
Jürgensen, H., Konstantinidis, S.: Codes. In: Rozenberg, G., Salomaa, A. (eds.) Handbook of Formal Languages, vol. 1, pp. 511–607. Springer, Berlin (1997)
Jürgensen, H., Staiger, L.: Fault-tolerant acceptors for solid codes. In: Proceedings of the 14th Journées Montoises of Theoretical Computer Science, Universite ́ catho-lique de Louvain, Belgium, Louvain-la-Neuve, September 11-14, p. 8 (2012); the proceedings were distributed electronically on a memory stick at the conference
Jürgensen, H., Staiger, L.: Automata for solid codes. Manuscript in Preparation (2013)
Jürgensen, H., Yu, S.S.: Solid codes. J. Inform. Process. Cybernet., EIK 26, 563–574 (1990)
Konstantinidis, S.: Error Correction and Decodability. PhD Thesis, The University of Western Ontario, London, Canada (1996)
Konstantinidis, S.: Structural analysis of error-correcting codes for discrete channels that involve combinations of three basic error types. IEEE Trans. Inform. Theory 45(1), 60–77 (1999)
Konstantinidis, S.: An algebra of discrete channels that involve combinations of three basic error types. Inform. and Comput. 167, 120–131 (2001)
Konstantinidis, S.: Relationships between different error-correcting capabilities of a code. IEEE Trans. Inform. Theory 47(5), 2065–2069 (2001)
Konstantinidis, S.: Transducers and the properties of error-detection, error-correction, and finite-delay decodability. J. UCS 8(2), 278–291 (2002)
Konstantinidis, S., O’Hearn, A.: Error-detecting properties of languages. Theoret. Comput. Sci. 276, 355–375 (2002)
Konstantinidis, S., Perron, S., Wilcox-O’Hearn, L.A.: On a simple method for detecting sychronization errors in coded messages. IEEE Trans. Inform. Theory 49(5), 1355–1363 (2003)
Konstantinidis, S., Santean, N.: On the definition of stochastic λ-transducers. Internat. J. Comput. Math. 86(8), 1300–1310 (2009)
Konstantinidis, S., Silva, P.: Maximal error-detecting capabilities of formal languages. J. of Automata, Languages and Combinatorics 13(1), 55–71 (2008)
Konstantinidis, S., Silva, P.V.: Computing maximal error-detecting capabilities and distances of regular languages. Fund. Inform. 101, 257–270 (2010)
Levenshtein, V.I.: Self-adaptive automata for decoding messages (in Russian). Dokl. Akad. Nauk. SSSR 141, 1320–1323 (1961); Self-adaptive automata for decoding messages. Soviet Physics Dokl. 6, 1042–1045 (1962)
Levenshtein, V.I.: The inversion of finite automata (in Russian). Dokl. Akad. Nauk. SSSR 147, 1300–1303 (1962); The inversion of finite automata. Soviet Physics Dokl. 7, 1081–1084 (1963)
Levenshtein, V.I.: Decoding Automata, Invariant with Respect to the Initial State (in Russian). Problemy Kibernet. 12, 125–136 (1964)
Levenshtein, V.I.: Some Properties of Coding and Self-Adjusting Automata for Decoding Messages (in Russian). Problemy Kibernet. 11, 63–121 (1964); German translation: Über einige Eigenschaften von Codierungen und von selbstkorrigierenden Automaten zur Decodierung von Nachrichten. Probleme der Kybernetik 7, 96–163 (1966); An English translation is available from the Clearinghouse for Federal Scientific and Technical Information, U. S. Department of Commerce, under the title Some Properties of Coding and Self-Adjusting Automata for Decoding Messages, Problems of Cybernetics, Part II, document AD 667 849; it was prepared as document FTD-MT-24-126-67 by the Foreign Technology Division, U. S. Air Force
Levenshtein, V.I.: Binary codes capable of correcting deletions, insertions, and reversals (in Russian). Dokl. Akad. Nauk. SSSR 163(4), 845–848 (1965); Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Dokl. 10, 707–710 (1966)
MacKay, D.J.C.: Information Theory, Inference, and Learning Algorithms, 6th edn. Cambridge University Press, Cambridge (2007)
MacWilliams, F.J., Sloane, N.J.A.: The Theory of Error-Correcting Codes, vol. 2. North-Holland, Amsterdam (1977)
Mansour, M.F., Tewfik, A.H.: Convolutional decoding in the presence of synchronization errors. IEEE J. Selected Areas in Communications 28(2), 218–227 (2010)
Markov, AI.A.: Non-recurrent coding. Problemy Kibernet. 8, 169–186 (1961) (in Russian); German translation: Nicht rekurrente Codierung. Probleme der Kybernetik 8, 154–175 (1962)
Maxted, J.C., Robinson, J.P.: Error recovery for variable length codes. IEEE Trans. Inform. Theory 31(6), 794–801 (1985)
Peterson, W.W., Weldon Jr., E.J.: Error-Correcting Codes, 2nd edn. MIT Press, Cambridge (1972)
Petrich, M., Thierrin, G.: The syntactic monoid of an infix code. Proc. Amer. Math. Soc. 109, 865–873 (1990)
Pless, V.S., Huffman, W.C. (eds.): Handbook of Coding Theory, vol. 2. North-Holland, Elsevier (1998)
Romanov, O.T.: Invariant Decoding Automata without Look-ahead (in Russian). Problemy Kibernet. 17, 233–236 (1966)
Sakarovitch, J.: Elements of Automata Theory. Cambridge University Press, Cambridge (2009); English translation of Éléments de théorie des automates, Vuibert Informatique, Paris (2003)
Shyr, H.J.: Free Monoids and Languages, 3rd edn. Hon Min Book Company, Taichung (2001)
Starke, P.H.: Abstrakte Automaten. VEB Deutscher Verlag der Wissenschaften, Berlin (1969); English translation by I. Shepherd: Abstract Automata. North-Holland, Amsterdam (1972)
Thierrin, G.: Hypercodes, right convex languages and their syntactic monoids. Proc. Amer. Math. Soc. 83(2), 255–258 (1981)
Thierrin, G.: The syntactic monoid of a hypercode. Semigroup Forum 6, 227–231 (1973)
Valkema, E.: Syntaktische Monoide und Hypercodes. Semigroup Forum 13(77), 119–126 (1976/1977)
Yu, S.-S.: Languages and Codes. Tsang Hai Book Publishing Co., Taichung (2005)
Zigangirov, K.Sh.: Sequential decoding for a binary channel with drop-outs and insertions (in Russian). Problemy Peredachi Informatsii 5(2), 23–30 (1969); Sequential decoding for a binary channel with drop-outs and insertions. Problems Inform. Transmission 5(2), 17–22 (1969)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jürgensen, H. (2013). Automata for Codes. In: Konstantinidis, S. (eds) Implementation and Application of Automata. CIAA 2013. Lecture Notes in Computer Science, vol 7982. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39274-0_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-39274-0_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39273-3
Online ISBN: 978-3-642-39274-0
eBook Packages: Computer ScienceComputer Science (R0)