Abstract
Given the enormous increase of research in the field of natural language generation, the need for a systematic account of criteria for assessing natural language generators is stressed. This paper tries to give an answer to a number of recently addressed topics regarding criteria, laying special emphasis on which criteria are necessary and relevant and how they influence design decisions for natural language generators. A minimal number of four closely interrelated criteria is presented. It is argued that values for these criteria are usually available before design decisions are made, and the direct impact of these criteria on selecting alternatives in various dimensions of natural language generation is shown together with selected examples. Finally, problems associated with the classification proposed are addressed and directions for future research in this relatively new field of impact assessment are pointed out.
Preview
Unable to display preview. Download preview PDF.
References
André E., Finkler W., Graf W., Rist T., Schauder A., Wahlster W.: WIP: The Automatic Synthesis of Multimodal Presentations, in Maybury M.T. (ed.), Intelligent Multimedia Interfaces, AAAI Press, Menlo Park, 1992.
Buchberger E.: Eine Systematik natürlichsprachiger Generierung und ihre Anwendung, Ph.D. Dissertation, Univ. of Technology, Vienna, 1992.
Buchberger E., Auterith A.: Generating German Paraphrases from SQL Expressions, in Trappl R.(ed.), Cybernetics and Systems '88, Kluwer, Dordrecht, pp. 885–892, 1988.
Conklin E.J., McDonald D.D.: Salience: The Key to the Selection Problem in Natural Language Generation, in Proceedings of the 20th Annual Meeting of the Association for Computational Linguistics, pp.129–135, 1982.
Dale R., Hovy E.H., Rösner D., Stock O.(eds.): Aspects of Automated Natural Language Generation, Lecture Notes in Artificial Intelligence No. 587, Springer, Berlin, 1992.
Dale R.: Evaluating Natural Language Generation Systems, in Thompson H.S.(ed.), The Strategic Role of Evaluation in Natural Language Processing and Speech Technology, Record of the Workshop, Human Communication Research Centre, University of Edinburgh, UK, 1992.
Davey A.: Discourse Production: A Computer Model of Some Aspects of a Speaker, Edinburgh University Press, 1978.
Dorffner G., Trost H., Buchberger E.: Generating Spoken Output for an Expert System Interface, öGAI-Journal 7(3–4)36–41, 1988.
DUDEN Fremdwörterbuch, Bibliographisches Institut, Mannheim, 1974.
Granville R.: Controlling Lexical Substitution in Computer Text, in Proceedings of the 10th International Conference on Computational Linguistics, pp.381–384, 1984.
Horacek H., Zock M.: New Concepts in Natural Language Generation, Pinter, London, 1993.
Hovy E.H.: Approaches to the Planning of Coherent Text, in Paris C.L., et al.(eds.), Natural Language Generation in Artificial Intelligence and Computational Linguistics, Kluwer, Dordrecht, pp. 83–102, 1991.
Kasper R.T.: An Experimental Parser for Systemic Grammars, in Proceedings of the 12th International Conference on Computational Linguistics, pp.309–312, 1988.
Kempen G., Hoenkamp E.: An Incremental Procedural Grammar for Sentence Formulation, Cognitive Science 11(2)201–258, 1987.
Koskenniemi K.: A General Computational Model for Word-Form Recognition and Production, in Proceedings of the 10th International Conference on Computational Linguistics, pp.178–181, 1984.
Kukich K.: ANA's First Sentences: Sample Output from a Natural Language Stock Report Generator, in Williams M.E., Hogan T.H.(eds.): Proceedings of the Fourth National Online Meeting, New York, 1983.
Mann W.C., Thompson S.A.: Rhetorical Structure Theory: Description and Construction of Text Structures, in Kempen G.(ed.), Natural Language Generation, Martinus Nijhoff, Dordrecht, pp. 85–95, 1987.
Matthiessen C., Bateman J.A.: Text Generation and Systemic-Functional Linguistics, Experiences from English and Japanese, Frances Pinter, London, 1991.
McKeown K.R.: Text Generation: Using Discourse Strategies and Focus Restraints to Generate Natural Language Text, Cambridge University Press, Cambridge, 1985.
Meteer M.(ed.): AAAI90 Workshop on Evaluating Natural Language Generation Systems — Workshop Notes, 1990.
Morik K.: Customers' Requirements for Natural Language Systems. Results of an Inquiry, Report ANS-19, Forschungsstelle f. Informationswissenschaft und Künstliche Intelligenz, Universität Hamburg, 1983.
Neumann G.: A Bidirectional Model for Natural Language Processing, in Fifth Conference of the European Chapter of the Association for Computational Linguistics, pp.245–250, 1991.
Little W., Fowler H.W., Coulson J., Onions C.T.(eds.): The Shorter Oxford English Dictionary, Clarendon, Oxford, 1978.
Pattabhiraman T., Cercone N.: Natural Language Generation Systems and Theories, CSS-IS TR 90-10, Simon Fraser University, 1990.
Rösner D.: The Automated News Agency: SEMTEX — A Text Generator for German, in Kempen G.(ed.), Natural Language Generation, Martinus Nijhoff, Dordrecht, pp. 133–148, 1987.
Stock O.: Natural Language and Exploration of an Information Space: The AlFresco Interactive System, in Proceedings of the 12th International Conference on Artificial Intelligence, Morgan Kaufmann, San Mateo, pp. 972–978, 1991.
Wermter S.: A Hybrid and Connectionist Architecture for a Scanning Understanding, in Neumann B.(ed.), Proceedings of the Tenth European Conference on Artificial Intelligence (ECAI92), Wiley, Chichester, UK, pp. 188–192, 1992.
Wilensky R., Chin D.N., Luria M., Martin J., Mayfield J., Wu D.: The Berkeley UNIX Consultant Project, Computational Linguistics 14(4)35–84, 1988.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1993 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Buchberger, E. (1993). Criteria in natural language generation: Minimal criteria and their impacts. In: Jürgen Ohlbach, H. (eds) GWAI-92: Advances in Artificial Intelligence. Lecture Notes in Computer Science, vol 671. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0019018
Download citation
DOI: https://doi.org/10.1007/BFb0019018
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-56667-0
Online ISBN: 978-3-540-47626-9
eBook Packages: Springer Book Archive