Skip to main content

RoBERTa: An Efficient Dating Method of Ancient Chinese Texts

  • Conference paper
  • First Online:
Chinese Lexical Semantics (CLSW 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13496))

Included in the following conference series:

  • 448 Accesses

Abstract

To address the dating problem of ancient Chinese texts, this paper proposes to model the text with RoBERTa(Robustly Optimized BERT Pretraining Approach) model, fully learn the contextual information of the text and combine with the ancient Chinese pre-training model for training. The experiments demonstrated the effectiveness of RoBERTa model for the chronological classification of ancient Chinese, and the accuracy of the classification reaches 93.98%. Our work can subsequently help researchers of ancient Chinese to perform automatic dating of ancient Chinese.

Supported by Social Science Foundation Project of Beijing (Grant No. 18YYB003). The corresponding author is Prof. Wei Huangfu.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Dobson, W.A.C.H.: Authenticating and dating archaic Chinese texts. Toung Pao (Second Ser.) 53(4–5), 233–242 (1967)

    Article  Google Scholar 

  2. Lihua, S., Yuqin, L.: Rule-based automatic category application on text category. J. Chin. Inf. Process. 18(4), 9–14 (2004)

    Google Scholar 

  3. Maron, M.E.: Automatic indexing: an experimental inquiry. J. ACM 8(3), 404–417 (1961)

    Article  MATH  Google Scholar 

  4. Cover, T., Hart, P.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13(1), 21–27 (1967)

    Article  MATH  Google Scholar 

  5. Joachims, T.: Text categorization with support vector machines: learning with many relevant features (1998)

    Google Scholar 

  6. McCallum, A., Nigam, K.: A comparison of event models for Naive Bayes text classification (1998)

    Google Scholar 

  7. Bin, L., Tiejun, H., Jun, C., Wen, G.: A new statistical-based method in automatic text classification. J. Chin. Inf. Process. 16(6), 19 (2002)

    Google Scholar 

  8. Kim, Y.: Convolutional neural networks for sentence classification. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1746–1751, Doha, Qatar, October 2014

    Google Scholar 

  9. Tang, D., Qin, B., Liu, T.: Document modeling with gated recurrent neural network for sentiment classification. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 1422–1432, Lisbon, Portugal, September 2015

    Google Scholar 

  10. Graves, A., Schmidhuber, J.: Framewise phoneme classification with bidirectional LSTM networks. In: Proceedings of the IEEE International Joint Conference on Neural Networks, vol. 4, pp. 2047–2052 (2005)

    Google Scholar 

  11. Vaswani, A., et al.: Attention is all you need. arXiv (2017)

    Google Scholar 

  12. Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4171–4186, Minneapolis, Minnesota, June 2019

    Google Scholar 

  13. Liu, Y., et al.: RoBERTa: a robustly optimized BERT pretraining approach (2019)

    Google Scholar 

  14. Xuejin, Y., Huangfu, W.: A machine learning model for the dating of ancient Chinese texts. In: Proceedings of the 2019 International Conference on Asian Language Processing, pp. 115–120 (2019)

    Google Scholar 

  15. Tan, Y.: GuwenBERT: a pre-trained language model for classical Chinese (literary Chinese). https://github.com/Ethan-yt/guwenbert(2021-07-06)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Meiwei Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, M., Qin, Y., Huangfu, W. (2023). RoBERTa: An Efficient Dating Method of Ancient Chinese Texts. In: Su, Q., Xu, G., Yang, X. (eds) Chinese Lexical Semantics. CLSW 2022. Lecture Notes in Computer Science(), vol 13496. Springer, Cham. https://doi.org/10.1007/978-3-031-28956-9_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-28956-9_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-28955-2

  • Online ISBN: 978-3-031-28956-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics