Skip to main content

A Study on the Reliability of Two Discourse Segmentation Models

  • Conference paper
  • First Online:
Computational Processing of the Portuguese Language (PROPOR 2003)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2721))

  • 438 Accesses

Abstract

This paper describes an experiment we conducted in order to test the reliability of two discourse segmentation models which have been widely used in computational linguistics. The main purpose of the test is to pick one of them for our future research, which aims to assess the role of prosody in structuring discourse in European Portuguese. We compared the models of (1986) and (1997) using spontaneous speech. The latter displayed a higher level of consensus among coders. We also observed that listening to the original speech influenced the level of agreement among coders.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Swerts, M. and R. Collier: On the Controlled Elicitation of Spontaneous Speech. Speech Communication 11(4–5) (1992) 463–468

    Article  Google Scholar 

  2. Swerts, M. and R. Geluykens: The Prosody of Information Units in Spontaneous Monologue. Phonetica 50 (1993) 189–196

    Article  Google Scholar 

  3. Swerts, M. and R. Geluykens: Prosody as a Marker of Information Flow in Spoken Discourse. Language and Speech 37(1) (1994) 21–43

    Google Scholar 

  4. Swerts, M.: Prosodic Features at Discourse Boundaries of Different Strength. Journal of the Acoustical Society of America 101(1) (1997) 514–521

    Article  Google Scholar 

  5. Swerts, M., R. Collier and J. Terken: Prosodic Predictors of Discourse Finality in Spontaneous Monologues. Speech Communication 15 (1994) 79–90

    Article  Google Scholar 

  6. Cutler, A., D. Dahan and W. Donselaar: Prosody in the Comprehension of Spoken Language: A Literature Review. Language and Speech 40(2) (1997) 141–201

    Google Scholar 

  7. Pijper, J.R. and A.A. Sanderman: On the Perceptual Strength of Prosodic Boundaries and its Relation to Suprasegmental Cues. Journal of the Acoustical Society of America 96(4) (1994) 2037–2047

    Article  Google Scholar 

  8. Grosz, B. and J. Hirschberg: Some Intentional Characteristics of Discourse Structure. Proceeding of the International Conference on Spoken Language Processing (1992) 429–432

    Google Scholar 

  9. Grosz, B.J. and C.L. Sidner: Attention, Intention and the Structure of Discourse. Computational Linguistics 12(3) (1986) 175–204

    Google Scholar 

  10. Hirschberg, J. and B. Grosz: Intonational Features of Local and Global Discourse Structure. Proceedings of the Workshop on Spoken Language Systems (1992) 441–446

    Google Scholar 

  11. Hirschberg, J., C.H. Nakatani and B.J. Grosz: Conveying Discourse Structure through Intonation Variation. Proceeding of the ESCA Workshop on Spoken Dialogue Systems: Theories and Applications, Virgo, Denmark, ESCA (1995)

    Google Scholar 

  12. Litman, D.J. and R. Passonneau: Empirical Evidence for Intention-Based Discourse Segmentation. Proc. of the ACL Workshop on Intentionality and Structure in Discourse Relations (1993)

    Google Scholar 

  13. Litman, D.J. and R. Passonneau: Combining Multiple Knowledge Sources for Discourse Segmentation. Proc. of 33rd ACL (1995) 108–115

    Google Scholar 

  14. Nakatani, C.H., B.J. Grosz and J. Hirschberg: Discourse Structure in Spoken Language: Studies on Speech Corpora. Proceeding of the AAAI Symposium Series: Empirical Methods in Discourse Interpretation and Generation (1995)

    Google Scholar 

  15. Nakatani, C.H., B.J. Grosz, D.D. Ahn and J. Hirschberg: Instructions for Annotating Discourses. Technical Report Number TR-21-95. Center for Research in Computing Technology, Harvard University, Cambridge, MA (1995)

    Google Scholar 

  16. Passonneau, R.J. and D.J. Litman: Intention-Based Segmentation: Human Reliability and Correlation with Linguistic Cues. Proc. of the ACL (1993)

    Google Scholar 

  17. Passonneau, R.J. and D.J. Litman: Discourse Segmentation by Human and Automated Means. Computational Linguistics (1997)

    Google Scholar 

  18. Ramilo, M.C. and T. Freitas: A Linguística e a Linguagem dos Média em Portugal: descrição do Projecto REDIP. Paper presented at the XIII International Congress of ALFAL, San José, Costa Rica (2002)

    Google Scholar 

  19. Carletta, J.: Assessing Agreement on Classification Tasks: The Kappa Statistic. Computational Linguistics 22(2) (1996) 249–254

    Google Scholar 

  20. Flammia, G.: Discourse Segmentation of Spoken Dialogue: An Empirical Approach. Ph.D. thesis, MIT (1998)

    Google Scholar 

  21. Beckman, M.E.: A Typology of Spontaneous Speech. In Y. Sagisaka, N. Campbell and N. Higuchi. Computing Prosody: Computational Models for Processing Spontaneous Speech. Springer, New York (1997) 7–26

    Google Scholar 

  22. Collier, R.: On the Communicative Function of Prosody: Some Experiments. IPO Annual Progress Report 28 (1993) 67–75

    Google Scholar 

  23. Oliveira, M.: Pausing Strategies as Means of Information Processing in Spontaneous Narratives. In: B. Bel and I. Marlien (eds.): Proceedings of the 1st International Conference on Speech Prosody, Aix-en-Provence, France (2002) 539–542

    Google Scholar 

  24. Oliveira, M.: Prosodic Features in Spontaneous Narratives. Ph.D. thesis, Simon Fraser University (2000)

    Google Scholar 

  25. Oliveira, M.: The Role of Pause Occurrence and Pause Duration in the Signalling of Narrative Structure. In: E. Ranchhod and N. Mamede (eds.): Advances in Natural Language Processing. Third International Conference, PorTAL 2002, Faro, Portugal (2002) 43–51

    Google Scholar 

  26. Lehiste, I.: Some Phonetic Characteristics of Discourse. Studia Linguistica 36:2 (1982)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Arim, E., Costa, F., Freitas, T. (2003). A Study on the Reliability of Two Discourse Segmentation Models. In: Mamede, N.J., Trancoso, I., Baptista, J., das Graças Volpe Nunes, M. (eds) Computational Processing of the Portuguese Language. PROPOR 2003. Lecture Notes in Computer Science(), vol 2721. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45011-4_11

Download citation

  • DOI: https://doi.org/10.1007/3-540-45011-4_11

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40436-1

  • Online ISBN: 978-3-540-45011-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics