Skip to main content

Chinese Macro Discourse Parsing on Generative Fusion and Distant Supervision

  • Conference paper
  • First Online:
PRICAI 2023: Trends in Artificial Intelligence (PRICAI 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14326))

Included in the following conference series:

  • 450 Accesses

Abstract

Most previous studies on discourse parsing have utilized discriminative models to construct tree structures. However, these models tend to overlook the global perspective of the tree structure as a whole during the step-by-step top-down or bottom-up parsing process. To address this issue, we propose DP-GF, a macro Discourse Parser based on Generative Fusion, which considers discourse parsing from both process-oriented and result-oriented perspectives. Additionally, due to the small size of existing corpora and the difficulty in annotating macro discourse structures, DP-GF addresses the small-sample problems by proposing a distant supervision training method that transforms a relatively large-scale topic structure corpus into a high-quality silver-standard discourse structure corpus. Our experimental results on MCDTB 2.0 demonstrate that our proposed model outperforms the state-of-the-art baselines on discourse tree construction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/renmada/t5-pegasus-pytorch.

  2. 2.

    https://catalog.ldc.upenn.edu/LDC2009T2.

References

  1. Jiang, F., Xu, S., Chu, X., et al.: MCDTB: a macro-level Chinese discourse treebank. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 3493–3504 (2018)

    Google Scholar 

  2. Fan, Y., Jiang, F., Chu, X., et al.: Combining global and local information to recognize Chinese macro discourse structure. In: Proceedings of the 19th Chinese National Conference on Computational Linguistics, pp. 183–194 (2020)

    Google Scholar 

  3. Liu, L., Lin, X., Joty, S., et al.: Hierarchical pointer net parsing. arXiv preprint arXiv:1908.11571 (2019)

  4. Lin, X., Joty, S., Jwalapuram, P., et al.: A unified linear-time framework for sentence-level discourse parsing. arXiv preprint arXiv:1905.05682 (2019)

  5. Koto, F., Lau, J.H., Baldwin, T.: Top-down discourse parsing via sequence labelling. arXiv preprint arXiv:2102.02080 (2021)

  6. Zhou, Y., Chu, X., Li, P., et al.: Constructing Chinese macro discourse tree via multiple views and word pair similarity. In: Natural Language Processing and Chinese Computing: 8th CCF International Conference, pp. 773–786 (2019)

    Google Scholar 

  7. Jiang, F., Chu, X., Li, P., et al.: Chinese paragraph-level discourse parsing with global backward and local reverse reading. In: Proceedings of the 28th International Conference on Computational Linguistics, pp. 5749–5759 (2020)

    Google Scholar 

  8. Jiang, F., Fan, Y., Chu, X., et al.: Hierarchical macro discourse parsing based on topic segmentation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 14, pp. 13152–13160 (2021)

    Google Scholar 

  9. Fan, Y., Jiang, F., Chu, X., et al.: Chinese macro discourse parsing on dependency graph convolutional network. In: Natural Language Processing and Chinese Computing: 10th CCF International Conference, pp. 15–26 (2021)

    Google Scholar 

  10. Kobayashi, N., Hirao, T., Nakamura, K., et al.: Split or merge: which is better for unsupervised RST parsing? In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp. 5797–5802 (2019)

    Google Scholar 

  11. Huber, P., Carenini, G.: Unsupervised learning of discourse structures using a tree autoencoder. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 14, pp. 13107–13115 (2021)

    Google Scholar 

  12. Nishida, N., Nakayama, H.: Unsupervised discourse constituency parsing using Viterbi EM. Trans. Assoc. Comput. Linguist. 8, 215–230 (2020)

    Article  Google Scholar 

  13. Kobayashi, N., Hirao, T., Kamigaito, H., et al.: Improving neural RST parsing model with silver agreement subtrees. In: Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 2021, pp. 1600–1612 (2021)

    Google Scholar 

  14. Zhang, L., Xing, Y., Kong, F., et al.: A top-down neural architecture towards text-level parsing of discourse rhetorical structure. arXiv preprint arXiv:2005.02680 (2020)

  15. Zhang, L., Kong, F., Zhou, G.: Adversarial learning for discourse rhetorical structure parsing. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, pp. 3946–3957 (2021)

    Google Scholar 

  16. Mabona, A., Rimell, L., Clark, S., et al.: Neural generative rhetorical structure parsing. arXiv preprint arXiv:1909.11049 (2019)

  17. He, L., Jiang, F., Bao, X., et al.: Bidirectional macro-level discourse parser based on oracle selection. In: PRICAI 2022: Trends in Artificial Intelligence: 19th Pacific Rim International Conference on Artificial Intelligence, pp. 224–239 (2022)

    Google Scholar 

  18. Raffel, C., Shazeer, N., Roberts, A., et al.: Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res. 21(1), 5485–5551 (2020)

    MathSciNet  Google Scholar 

  19. Chen, P., Bogoychev, N., Heafield, K., et al.: Parallel sentence mining by constrained decoding. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 1672–1678 (2020)

    Google Scholar 

  20. Lu, Y., Lin, H., Xu, J., et al.: Text2event: controllable sequence-to-structure generation for end-to-end event extraction. arXiv preprint arXiv:2106.09232 (2021)

  21. Zhang, W., Li, X., Deng, Y., et al.: Towards generative aspect-based sentiment analysis. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pp. 504–510 (2021)

    Google Scholar 

  22. Zhang, W., Deng, Y., Li, X., et al.: Aspect sentiment quad prediction as paraphrase generation. arXiv preprint arXiv:2110.00796 (2021)

  23. Jiang, F., Fan, Y., Chu, X., et al.: Not just classification: recognizing implicit discourse relation on joint modeling of classification and generation. In: Proceedings of the. Conference on Empirical Methods in Natural Language Processing, pp. 2418–2431 (2021)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiaomin Chu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

He, L., Jiang, F., Bao, X., Fan, Y., Li, P., Chu, X. (2024). Chinese Macro Discourse Parsing on Generative Fusion and Distant Supervision. In: Liu, F., Sadanandan, A.A., Pham, D.N., Mursanto, P., Lukose, D. (eds) PRICAI 2023: Trends in Artificial Intelligence. PRICAI 2023. Lecture Notes in Computer Science(), vol 14326. Springer, Singapore. https://doi.org/10.1007/978-981-99-7022-3_15

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-7022-3_15

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-7021-6

  • Online ISBN: 978-981-99-7022-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics