Skip to main content

Criteria in natural language generation: Minimal criteria and their impacts

  • Workshop Contributions
  • Conference paper
  • First Online:
GWAI-92: Advances in Artificial Intelligence

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 671))

  • 162 Accesses

Abstract

Given the enormous increase of research in the field of natural language generation, the need for a systematic account of criteria for assessing natural language generators is stressed. This paper tries to give an answer to a number of recently addressed topics regarding criteria, laying special emphasis on which criteria are necessary and relevant and how they influence design decisions for natural language generators. A minimal number of four closely interrelated criteria is presented. It is argued that values for these criteria are usually available before design decisions are made, and the direct impact of these criteria on selecting alternatives in various dimensions of natural language generation is shown together with selected examples. Finally, problems associated with the classification proposed are addressed and directions for future research in this relatively new field of impact assessment are pointed out.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. André E., Finkler W., Graf W., Rist T., Schauder A., Wahlster W.: WIP: The Automatic Synthesis of Multimodal Presentations, in Maybury M.T. (ed.), Intelligent Multimedia Interfaces, AAAI Press, Menlo Park, 1992.

    Google Scholar 

  2. Buchberger E.: Eine Systematik natürlichsprachiger Generierung und ihre Anwendung, Ph.D. Dissertation, Univ. of Technology, Vienna, 1992.

    Google Scholar 

  3. Buchberger E., Auterith A.: Generating German Paraphrases from SQL Expressions, in Trappl R.(ed.), Cybernetics and Systems '88, Kluwer, Dordrecht, pp. 885–892, 1988.

    Google Scholar 

  4. Conklin E.J., McDonald D.D.: Salience: The Key to the Selection Problem in Natural Language Generation, in Proceedings of the 20th Annual Meeting of the Association for Computational Linguistics, pp.129–135, 1982.

    Google Scholar 

  5. Dale R., Hovy E.H., Rösner D., Stock O.(eds.): Aspects of Automated Natural Language Generation, Lecture Notes in Artificial Intelligence No. 587, Springer, Berlin, 1992.

    Google Scholar 

  6. Dale R.: Evaluating Natural Language Generation Systems, in Thompson H.S.(ed.), The Strategic Role of Evaluation in Natural Language Processing and Speech Technology, Record of the Workshop, Human Communication Research Centre, University of Edinburgh, UK, 1992.

    Google Scholar 

  7. Davey A.: Discourse Production: A Computer Model of Some Aspects of a Speaker, Edinburgh University Press, 1978.

    Google Scholar 

  8. Dorffner G., Trost H., Buchberger E.: Generating Spoken Output for an Expert System Interface, öGAI-Journal 7(3–4)36–41, 1988.

    Google Scholar 

  9. DUDEN Fremdwörterbuch, Bibliographisches Institut, Mannheim, 1974.

    Google Scholar 

  10. Granville R.: Controlling Lexical Substitution in Computer Text, in Proceedings of the 10th International Conference on Computational Linguistics, pp.381–384, 1984.

    Google Scholar 

  11. Horacek H., Zock M.: New Concepts in Natural Language Generation, Pinter, London, 1993.

    Google Scholar 

  12. Hovy E.H.: Approaches to the Planning of Coherent Text, in Paris C.L., et al.(eds.), Natural Language Generation in Artificial Intelligence and Computational Linguistics, Kluwer, Dordrecht, pp. 83–102, 1991.

    Google Scholar 

  13. Kasper R.T.: An Experimental Parser for Systemic Grammars, in Proceedings of the 12th International Conference on Computational Linguistics, pp.309–312, 1988.

    Google Scholar 

  14. Kempen G., Hoenkamp E.: An Incremental Procedural Grammar for Sentence Formulation, Cognitive Science 11(2)201–258, 1987.

    Article  Google Scholar 

  15. Koskenniemi K.: A General Computational Model for Word-Form Recognition and Production, in Proceedings of the 10th International Conference on Computational Linguistics, pp.178–181, 1984.

    Google Scholar 

  16. Kukich K.: ANA's First Sentences: Sample Output from a Natural Language Stock Report Generator, in Williams M.E., Hogan T.H.(eds.): Proceedings of the Fourth National Online Meeting, New York, 1983.

    Google Scholar 

  17. Mann W.C., Thompson S.A.: Rhetorical Structure Theory: Description and Construction of Text Structures, in Kempen G.(ed.), Natural Language Generation, Martinus Nijhoff, Dordrecht, pp. 85–95, 1987.

    Google Scholar 

  18. Matthiessen C., Bateman J.A.: Text Generation and Systemic-Functional Linguistics, Experiences from English and Japanese, Frances Pinter, London, 1991.

    Google Scholar 

  19. McKeown K.R.: Text Generation: Using Discourse Strategies and Focus Restraints to Generate Natural Language Text, Cambridge University Press, Cambridge, 1985.

    Google Scholar 

  20. Meteer M.(ed.): AAAI90 Workshop on Evaluating Natural Language Generation Systems — Workshop Notes, 1990.

    Google Scholar 

  21. Morik K.: Customers' Requirements for Natural Language Systems. Results of an Inquiry, Report ANS-19, Forschungsstelle f. Informationswissenschaft und Künstliche Intelligenz, Universität Hamburg, 1983.

    Google Scholar 

  22. Neumann G.: A Bidirectional Model for Natural Language Processing, in Fifth Conference of the European Chapter of the Association for Computational Linguistics, pp.245–250, 1991.

    Google Scholar 

  23. Little W., Fowler H.W., Coulson J., Onions C.T.(eds.): The Shorter Oxford English Dictionary, Clarendon, Oxford, 1978.

    Google Scholar 

  24. Pattabhiraman T., Cercone N.: Natural Language Generation Systems and Theories, CSS-IS TR 90-10, Simon Fraser University, 1990.

    Google Scholar 

  25. Rösner D.: The Automated News Agency: SEMTEX — A Text Generator for German, in Kempen G.(ed.), Natural Language Generation, Martinus Nijhoff, Dordrecht, pp. 133–148, 1987.

    Google Scholar 

  26. Stock O.: Natural Language and Exploration of an Information Space: The AlFresco Interactive System, in Proceedings of the 12th International Conference on Artificial Intelligence, Morgan Kaufmann, San Mateo, pp. 972–978, 1991.

    Google Scholar 

  27. Wermter S.: A Hybrid and Connectionist Architecture for a Scanning Understanding, in Neumann B.(ed.), Proceedings of the Tenth European Conference on Artificial Intelligence (ECAI92), Wiley, Chichester, UK, pp. 188–192, 1992.

    Google Scholar 

  28. Wilensky R., Chin D.N., Luria M., Martin J., Mayfield J., Wu D.: The Berkeley UNIX Consultant Project, Computational Linguistics 14(4)35–84, 1988.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Hans Jürgen Ohlbach

Rights and permissions

Reprints and permissions

Copyright information

© 1993 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Buchberger, E. (1993). Criteria in natural language generation: Minimal criteria and their impacts. In: Jürgen Ohlbach, H. (eds) GWAI-92: Advances in Artificial Intelligence. Lecture Notes in Computer Science, vol 671. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0019018

Download citation

  • DOI: https://doi.org/10.1007/BFb0019018

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-56667-0

  • Online ISBN: 978-3-540-47626-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics