skip to main content
10.1145/3503161.3547925acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Sundial-GAN: A Cascade Generative Adversarial Networks Framework for Deciphering Oracle Bone Inscriptions

Published: 10 October 2022 Publication History

Abstract

Oracle Bone Inscription (OBI) is an early hieroglyph in China, which is the most famous ancient writing system in the world. However, only a small number of OBI characters have been fully deciphered today. Chinese characters have different forms in different historical stages; therefore, it is very difficult to directly translate OBI characters to modern Chinese characters due to the long historic evolutionary process. In this paper, we propose a cascade generative adversarial networks (GAN) framework for deciphering OBI characters, named "Sundial-GAN'', which is a cascaded structure to simulate Chinese characters' evolutionary process from an OBI character to its potential modern Chinese character. We select four representative stages in the evolutionary process of OBI, each of which is implemented by an individual GAN structure based on the characteristics of each evolutionary stage. These structures are cascaded in sequence to accurately simulate the Chinese characters' evolutionary process. For each input OBI character, Sundial-GAN can successfully generate the input's different forms at the four historical stages. Extensive experiments and comparisons demonstrate that generated characters at each stage have high similarities with real existing characters; therefore, the proposed method can significantly improve the efficiency and accuracy of OBI deciphering for archaeological researchers. Compared to direct image-to-image translation methods, our approach allows for a smoother translation process, a better grasp of details, and more effective avoiding random mappings in GANs.

Supplementary Material

MP4 File (MM22-fp0741.mp4)
Oracle Bone Inscription (OBI) is an early hieroglyph in China, which is the most famous ancient writing system in the world. We propose a cascade generative adversarial networks (GAN) framework for deciphering OBI characters, named ``Sundial-GAN'', which is a cascaded structure to simulate Chinese characters' evolutionary process from an OBI character to its potential modern Chinese character. We select four representative stages in the evolutionary process of OBI, each of which is implemented by an individual GAN structure based on the characteristics of each evolutionary stage. These structures are cascaded in sequence to accurately simulate the Chinese characters' evolutionary process. For each input OBI character, Sundial-GAN can successfully generate the input's different forms at the four historical stages. Compared to direct image-to-image translation methods, our approach allows for a smoother translation process, a better grasp of details, and more effective avoiding random mappings in GANs.

References

[1]
Yannis Assael, Thea Sommerschield, Brendan Shillingford, Mahyar Bordbar, John Pavlopoulos, Marita Chatzipanagiotou, Ion Androutsopoulos, Jonathan Prag, and Nando de Freitas. 2022. Restoring and attributing ancient texts using deep neural networks. Nature, Vol. 603, 7900 (2022), 280--283.
[2]
Yunjey Choi, Minje Choi, Munyoung Kim, Jung-Woo Ha, Sunghun Kim, and Jaegul Choo. 2018. Stargan: Unified generative adversarial networks for multi-domain image-to-image translation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 8789--8797.
[3]
Antonia Creswell, Tom White, Vincent Dumoulin, Kai Arulkumaran, Biswa Sengupta, and Anil A Bharath. 2018. Generative adversarial networks: An overview. IEEE Signal Processing Magazine, Vol. 35, 1 (2018), 53--65.
[4]
Ruwei Dai, Chenglin Liu, and Baihua Xiao. 2007. Chinese character recognition: history, status and prospects. Frontiers of Computer Science in China, Vol. 1, 2 (2007), 126--136.
[5]
Yuning Du, Chenxia Li, Ruoyu Guo, Cheng Cui, Weiwei Liu, Jun Zhou, Bin Lu, Yehua Yang, Qiwen Liu, Xiaoguang Hu, et al. 2021. PP-OCRv2: Bag of Tricks for Ultra Lightweight OCR System. arXiv preprint arXiv:2109.03144 (2021).
[6]
Yuning Du, Chenxia Li, Ruoyu Guo, Xiaoting Yin, Weiwei Liu, Jun Zhou, Yifan Bai, Zilin Yu, Yehua Yang, Qingqing Dang, et al. 2020. Pp-ocr: A practical ultra lightweight ocr system. arXiv preprint arXiv:2009.09941 (2020).
[7]
Yoshiyuki Fujikawa, Hengyi Li, Xuebin Yue, Aravinda CV, Lin Meng, et al. 2021. Recognition of Oracle Bone Inscriptions by using Two Deep Learning Models. arXiv preprint arXiv:2105.00777 (2021).
[8]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. Advances in neural information processing systems, Vol. 27 (2014).
[9]
Shaotong Gu. 2018a. Identification of oracle-bone script fonts based on fractal geometry. Journal of Chinese Information Processing, Vol. 32, 10 (2018).
[10]
Shaotong Gu. 2018b. Inpainting method of oracle-bone inscriptions based on iterated function system and fractal interpolation. Science Technology and Engineering, Vol. 18, 36 (2018).
[11]
Jie Gui, Zhenan Sun, Yonggang Wen, Dacheng Tao, and Jieping Ye. 2021. A review on generative adversarial networks: Algorithms, theory, and applications. IEEE Transactions on Knowledge and Data Engineering (2021).
[12]
Jiantang Han. 2012. Chinese characters. Cambridge University Press.
[13]
Wenhui Han, Xinlin Ren, Hangyu Lin, Yanwei Fu, and Xiangyang Xue. 2020b. Self-supervised Learning of Orc-Bert Augmentator for Recognizing Few-Shot Oracle Characters. In Proceedings of the Asian Conference on Computer Vision.
[14]
Xu Han, Yuzhuo Bai, Keyue Qiu, Zhiyuan Liu, and Maosong Sun. 2020a. IsOBS: An Information System for Oracle Bone Script. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 227--233.
[15]
Yin He, Xiaoju He, and Gang Zhang. 2018. Image Segmentation of JiaGuWen Image Based on Wavelet Transform and FCM. In Journal of Tianjin University of Science and Technology.
[16]
Shuangping Huang, Haobin Wang, Yongge Liu, Xiaosong Shi, and Lianwen Jin. 2019. OBC306: A Large-Scale Oracle Bone Character Recognition Dataset. In 2019 International Conference on Document Analysis and Recognition (ICDAR). IEEE, 681--688.
[17]
Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros. 2017. Image-To-Image Translation With Conditional Adversarial Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[18]
F Li and XL Zhou. 1996. The graph theory method of oracle bone inscriptions automatic recognition. J. Electron., Vol. 18, 1 (1996), 41--47.
[19]
Q. Li, Y. Yang, and A. Wang. 2011. Graph isomorphism method for oracle bone inscriptions recognition. Computer Engineering and Application, Vol. 47, 8 (2011).
[20]
Ru Li. 2021. Image Style Transfer with Generative Adversarial Networks. In Proceedings of the 29th ACM International Conference on Multimedia. 2950--2954.
[21]
Guoying Liu, Shuanghao Chen, Jing Xiong, and Qingju Jiao. 2021. An Oracle Bone Inscription Detector Based on Multi-Scale Gaussian Kernels. Applied Mathematics, Vol. 12, 3 (2021), 224--239.
[22]
Guoying Liu, Xu Song, Wenying Ge, Hongyu Zhou, and Jing Lv. 2020b. Oracle-bone-inscription image segmentation based on simple fully convolutional networks. In MIPPR 2019: Pattern Recognition and Computer Vision, Vol. 11430. SPIE, 293--296.
[23]
Mengting Liu, Guoying Liu, Yongge Liu, and Qingju Jiao. 2020a. Oracle-bone inscription recognition based on deep convolutional neural network. Journal of Image and Graphics, Vol. 8, 4 (2020), 114--119.
[24]
Yongge Liu and Guoying Liu. 2017. Oracle bone inscription recognition based on SVM. Journal of Anyang Normal University, Vol. 2 (2017), 54--56.
[25]
Lin Meng. 2017. Recognition of Oracle Bone Inscriptions by Extracting Line Features on Image Processing. In ICPRAM. 606--611.
[26]
Mehdi Mirza and Simon Osindero. 2014. Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784 (2014).
[27]
Deepak Pathak, Philipp Krahenbuhl, Jeff Donahue, Trevor Darrell, and Alexei A Efros. 2016. Context encoders: Feature learning by inpainting. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2536--2544.
[28]
Zhihang Ren. 2021. GAN-aided Serial Dependence Study in Medical Image Perception. In Proceedings of the 29th ACM International Conference on Multimedia. 2945--2949.
[29]
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, 234--241.
[30]
Tamar Rott Shaham, Tali Dekel, and Tomer Michaeli. 2019. Singan: Learning a generative model from a single natural image. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 4570--4580.
[31]
Wenjie Sun, Guangtao Zhai, Zhongpai Gao, Tingzhu Chen, Yucheng Zhu, and Zhaodi Wang. 2020. Dual-View Oracle Bone Script Recognition System via Temporal-Spatial Psychovisual Modulation. In 2020 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR). IEEE, 193--198.
[32]
Ken-ichi Takashima. 1978. Decipherment of the Word Yu in the Shang Oracle Bone Inscriptions and in Pre-Classical Chinese. Early China, Vol. 4 (1978), 19--29.
[33]
Hao Wang, Guosheng Lin, Steven CH Hoi, and Chunyan Miao. 2021a. Cycle-consistent inverse gan for text-to-image synthesis. In Proceedings of the 29th ACM International Conference on Multimedia. 630--638.
[34]
Jiahao Wang, Gang Pan, Di Sun, and Jiawan Zhang. 2021b. Chinese Character Inpainting with Contextual Semantic Constraints. In Proceedings of the 29th ACM International Conference on Multimedia. 1829--1837.
[35]
Qi Wen, Shuang Li, Bingfeng Han, and Yi Yuan. 2021. ZiGAN: Fine-grained Chinese Calligraphy Font Generation via a Few-shot Style Transfer Approach. In Proceedings of the 29th ACM International Conference on Multimedia. 621--629.
[36]
Cheng Xiaoqiang. 2020. Periodic characteristics of the formation of phonogram in Chinese language. In Journal of Lanzhou University of Arts and Science. 75--80.
[37]
Jing Xiong, Qingju Jiao, Guoying Liu, and Yongge Liu. 2019a. Oracle bone inscriptions big knowledge management and service platform. In International Conference of Pioneering Computer Scientists, Engineers and Educators. Springer, 124--136.
[38]
Jing Xiong, Qingju Jiao, Guoying Liu, and Yongge Liu. 2019b. Oracle Bone Inscriptions Big Knowledge Management and Service Platform. In International Conference of Pioneering Computer Scientists, Engineers and Educators. Springer, 124--136.
[39]
Shaozu Yuan, Ruixue Liu, Meng Chen, Baoyang Chen, Zhijie Qiu, and Xiaodong He. 2021. Learning to Compose Stylistic Calligraphy Artwork with Emotions. In Proceedings of the 29th ACM International Conference on Multimedia. 3701--3709.
[40]
Chongsheng Zhang, Ruixing Zong, Shuang Cao, Yi Men, and Bofeng Mo. 2021b. AI-powered oracle bone inscriptions recognition and fragments rejoining. In Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence. 5309--5311.
[41]
Gechuan Zhang, Dairui Liu, Barry Smyth, and Ruihai Dong. 2021a. Deciphering Ancient Chinese Oracle Bone Inscriptions Using Case-Based Reasoning. In International Conference on Case-Based Reasoning. Springer, 309--324.
[42]
Linlin Zhao, Qingsheng Li, Li Zhang, Zhiqiang Luo, Huahua Jiang, Chunzhu Jiang, and Xiangyu Liu. 2020c. A Virtual Teaching Machine System Based on Oracle-bone-script Learning. In 2020 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking (ISPA/BDCloud/SocialCom/SustainCom). IEEE, 1144--1149.
[43]
Zhenquan Zhao, Qingju Jiao, et al. 2020a. Oracle Bone Inscriptions Components Analysis Based on Image Similarity. In 2020 IEEE 9th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), Vol. 9. IEEE, 1666--1670.
[44]
Zhenquan Zhao, Qingju Jiao, et al. 2020b. Oracle Bone Inscriptions Components Analysis Based on Image Similarity. In 2020 IEEE 9th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), Vol. 9. IEEE, 1666--1670.
[45]
X. Zhou and F. Li. 1996. Study on identification methods of oracle bone inscriptions. Journal of Fudan University: Natural Science Edition, Vol. 35, 5 (1996), 481--486.
[46]
Yutong Zhou. 2021. Generative adversarial network for text-to-face synthesis and manipulation. In Proceedings of the 29th ACM International Conference on Multimedia. 2940--2944.
[47]
Jun-Yan Zhu, Taesung Park, Phillip Isola, and Alexei A. Efros. 2017. Unpaired Image-To-Image Translation Using Cycle-Consistent Adversarial Networks. In Proceedings of the IEEE International Conference on Computer Vision (ICCV).io

Cited By

View all
  • (2025)Oracle Character Prototype-Guided Cyclic Disentanglement for Oracle Bone Inscriptions DetectionPattern Recognition and Artificial Intelligence10.1007/978-981-97-8705-0_14(212-226)Online publication date: 8-Feb-2025
  • (2024)Knowledge-Aware Artifact Image Synthesis with LLM-Enhanced Prompting and Multi-Source SupervisionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681533(2719-2728)Online publication date: 28-Oct-2024
  • (2024)Making Visual Sense of Oracle Bones for You and Me2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01203(12656-12665)Online publication date: 16-Jun-2024
  • Show More Cited By

Index Terms

  1. Sundial-GAN: A Cascade Generative Adversarial Networks Framework for Deciphering Oracle Bone Inscriptions

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          MM '22: Proceedings of the 30th ACM International Conference on Multimedia
          October 2022
          7537 pages
          ISBN:9781450392037
          DOI:10.1145/3503161
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Sponsors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 10 October 2022

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. computational arts
          2. end-to-end image translation
          3. generative adversarial networks
          4. oracle bone inscriptions deciphering

          Qualifiers

          • Research-article

          Funding Sources

          • Natural Science Foundation of Fujian Province of China
          • Ser Cymru II programme, UK.

          Conference

          MM '22
          Sponsor:

          Acceptance Rates

          Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)157
          • Downloads (Last 6 weeks)14
          Reflects downloads up to 03 Mar 2025

          Other Metrics

          Citations

          Cited By

          View all
          • (2025)Oracle Character Prototype-Guided Cyclic Disentanglement for Oracle Bone Inscriptions DetectionPattern Recognition and Artificial Intelligence10.1007/978-981-97-8705-0_14(212-226)Online publication date: 8-Feb-2025
          • (2024)Knowledge-Aware Artifact Image Synthesis with LLM-Enhanced Prompting and Multi-Source SupervisionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681533(2719-2728)Online publication date: 28-Oct-2024
          • (2024)Making Visual Sense of Oracle Bones for You and Me2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01203(12656-12665)Online publication date: 16-Jun-2024
          • (2024)Exploiting Hanja-Based Resources in Processing Korean Historic Documents Written by Common LiteratiIEEE Access10.1109/ACCESS.2024.339018112(59909-59919)Online publication date: 2024
          • (2024)Automatic Segmentation of Oracle Bone Inscriptions Using YOLOv8Procedia Computer Science10.1016/j.procs.2024.08.201242(1074-1081)Online publication date: 2024
          • (2024)OBCTeacherInformation Processing and Management: an International Journal10.1016/j.ipm.2024.10386461:6Online publication date: 1-Nov-2024
          • (2024)Linking unknown characters via oracle bone inscriptions retrievalMultimedia Systems10.1007/s00530-024-01327-730:3Online publication date: 15-Apr-2024
          • (2024)Puzzle Pieces Picker: Deciphering Ancient Chinese Characters with Radical ReconstructionDocument Analysis and Recognition - ICDAR 202410.1007/978-3-031-70533-5_11(169-187)Online publication date: 8-Sep-2024
          • (2023)Machine Learning for Ancient Languages: A SurveyComputational Linguistics10.1162/coli_a_0048149:3(703-747)Online publication date: 1-Sep-2023
          • (2023)OraclePoints: A Hybrid Neural Representation for Oracle CharacterProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3612534(7901-7911)Online publication date: 26-Oct-2023
          • Show More Cited By

          View Options

          Login options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media