skip to main content
10.1145/3586183.3606814acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

PColorizor: Re-coloring Ancient Chinese Paintings with Ideorealm-congruent Poems

Published:29 October 2023Publication History

ABSTRACT

Color restoration of ancient Chinese paintings plays a significant role in Chinese culture protection and inheritance. However, traditional color restoration is challenging and time-consuming because it requires professional restorers to conduct detailed literature reviews on numerous paintings for reference colors. After that, they have to fill in the inferred colors on the painting manually. In this paper, we present PColorizor, an interactive system that integrates advanced deep-learning models and novel visualizations to ease the difficulties of color restoration. PColorizor is established on the principle of poem-painting congruence. Given a color-faded painting, we employ both explicit and implicit color guidance implied by ideorealm-congruent poems to associate reference paintings. We propose a mountain-like visualization to facilitate efficient navigation of the color schemes extracted from the reference paintings. This visual representation allows users to easily see the color distribution over time at both the ideorealm and imagery levels. Moreover, we demonstrate the ideorealm understood by deep learning models through visualizations to bridge the communication gap between human restorers and deep learning models. We also adopt intelligent color-filling techniques to accelerate manual color restoration further. To evaluate PColorizor, we collaborate with domain experts to conduct two case studies to collect their feedback. The results suggest that PColorizor could be beneficial in enabling the effective restoration of color-faded paintings.

Skip Supplemental Material Section

Supplemental Material

References

  1. Hyojin Bahng, Seungjoo Yoo, Wonwoong Cho, David Keetae Park, Ziming Wu, Xiaojuan Ma, and Jaegul Choo. 2018. Coloring with Words: Guiding Image Colorization Through Text-Based Palette Generation. In Proceedings of European Conference on Computer Vision. Springer, 431–447.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Baogang Wei, Yonghuai Liu, and Yunhe Pan. 2003. Using hybrid knowledge engineering and image processing in color virtual restoration of ancient murals. IEEE Transactions on Knowledge and Data Engineering 15, 5 (2003), 1338–1343.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. David Borland and Russell M. Taylor Ii. 2007. Rainbow Color Map (Still) Considered Harmful. IEEE Computer Graphics and Applications 27, 2 (2007), 14–17.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Yining Cao, Jane L. E, Zhutian Chen, and Haijun Xia. 2023. DataParticles: Block-Based and Language-Oriented Authoring of Animated Unit Visualizations. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Jianbo Chen, Yelong Shen, Jianfeng Gao, Jingjing Liu, and Xiaodong Liu. 2018. Language-Based Image Editing with Recurrent Attentive Models. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 8721–8729.Google ScholarGoogle ScholarCross RefCross Ref
  6. Shenghui Cheng, Wei Xu, and Klaus Mueller. 2019. ColorMap ND : A Data-Driven Approach and Tool for Mapping Multivariate Data to Color. IEEE Transactions on Visualization and Computer Graphics 25, 2 (2019), 1361–1377.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Zhou Cheng. 1368—1644. Northern Seas. ltfc.net (Website). https://g2.ltfc.net/view/SUHA/61bb72ec33115819641cf354.Google ScholarGoogle Scholar
  8. Zhou Cheng. 1368—1644. Seclusion beyond the Spring Waters in Spring. ltfc.net (Website). https://g2.ltfc.net/view/SUHA/608a6c1fe11ca96100860fd0.Google ScholarGoogle Scholar
  9. Zezhou Cheng, Qingxiong Yang, and Bin Sheng. 2015. Deep Colorization. In Proceedings of IEEE International Conference on Computer Vision. IEEE, 415–423.Google ScholarGoogle Scholar
  10. Katherine Crowson, Stella Biderman, Daniel Kornis, Dashiell Stander, Eric Hallahan, Louis Castricato, and Edward Raff. 2022. VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance. In Proceedings of European Conference on Computer Vision. Springer, 88–105.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Zhu Duan. 1368—1644. Gazing at the Distant River in the Mist. ltfc.net (Website). https://g2.ltfc.net/view/SUHA/608a623142b4355c93c903e7.Google ScholarGoogle Scholar
  12. Zu E and Yu Xinchi. 2022. Shenxian Yijing, Mogu Chuanzhen [Interview with Master Zuo E, Representative Inheritor of the National Intangible Cultural Heritage Project - Traditional Art of Copying and Replicating Ancient Calligraphies and Paintings]. Zijin Cheng 12, 54–75 (2022).Google ScholarGoogle Scholar
  13. Patrick Esser, Robin Rombach, and Bjorn Ommer. 2021. Taming Transformers for High-Resolution Image Synthesis. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 12868–12878.Google ScholarGoogle ScholarCross RefCross Ref
  14. XY Fu, Y Han, ZJ Sun, XJ Ma, and YQ Xu. 2017. Line-drawing enhanced interactive mural restoration for Dunhuang Mogao Grottoes. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences 4 (2017), 99.Google ScholarGoogle Scholar
  15. Sergio Guadarrama, Ryan Dahl, David Bieber, Jonathon Shlens, Mohammad Norouzi, and Kevin Murphy. 2017. PixColor: Pixel Recursive Colorization. In Proceedings of British Machine Vision Conference. British Machine Vision Association, 112–124.Google ScholarGoogle ScholarCross RefCross Ref
  16. Raj Kumar Gupta, Alex Yong-Sang Chia, Deepu Rajan, Ee Sin Ng, and Huang Zhiyong. 2012. Image Colorization using Similar Images. In Proceedings of ACM International Conference on Multimedia. ACM, 369–378.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Mingming He, Dongdong Chen, Jing Liao, Pedro V. Sander, and Lu Yuan. 2018. Deep Exemplar-based Colorization. ACM Transactions on Graphics 37, 4 (2018), 1–16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Ruizhen Hu, Ziqi Ye, Bin Chen, Oliver van Kaick, and Hui Huang. 2023. Self-Supervised Color-Concept Association via Image Colorization. IEEE Transactions on Visualization and Computer Graphics 29, 1 (2023), 247–256.Google ScholarGoogle Scholar
  19. Zhitong Huang, Nanxuan Zhao, and Jing Liao. 2022. UniColor: A Unified Framework for Multi-Modal Colorization with Transformer. ACM Transactions on Graphics 41, 6 (2022), 1–16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Revital Irony, Daniel Cohen-Or, and Dani Lischinski. 2005. Colorization by Example. In Proceedings of Eurographics Conference on Rendering Techniques. Eurographics Association, 201–210.Google ScholarGoogle Scholar
  21. Eungyeup Kim, Sanghyeon Lee, Jeonghoon Park, Somi Choi, Choonghyun Seo, and Jaegul Choo. 2021. Deep Edge-Aware Interactive Colorization against Color-Bleeding Effects. In Proceedings of IEEE International Conference on Computer Vision. IEEE, 14647–14656.Google ScholarGoogle ScholarCross RefCross Ref
  22. Hyunsu Kim, Ho Young Jhoo, Eunhyeok Park, and Sungjoo Yoo. 2019. Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss. In Proceedings of IEEE International Conference on Computer Vision. IEEE, 9055–9064.Google ScholarGoogle ScholarCross RefCross Ref
  23. Manoj Kumar, Dirk Weissenborn, and Nal Kalchbrenner. 2021. Colorization Transformer. In Proceedings of International Conference on Learning Representations.Google ScholarGoogle Scholar
  24. Rensselaer W. Lee. 1940. Ut Pictura Poesis: The Humanistic Theory of Painting. The Art Bulletin 22, 4 (1940), 197–269.Google ScholarGoogle ScholarCross RefCross Ref
  25. Anat Levin, Dani Lischinski, and Yair Weiss. 2004. Colorization using Optimization. In Proceedings of Special Interest Group on Computer Graphics and Interactive Techniques. ACM, 689–694.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Duan Ling. 1996. “Xuanhe Huapu” Tanwei [A Probe into Xuanhe Huapu]. Meishu Yanjiu 4, 31–35 (1996).Google ScholarGoogle Scholar
  27. Yang Liu and Jeffrey Heer. 2018. Somewhere Over the Rainbow: An Empirical Assessment of Quantitative Colormaps. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Qing Luan, Fang Wen, Daniel Cohen-Or, Lin Liang, Ying-Qing Xu, and Heung-Yeung Shum. 2007. Natural Image Colorization. In Proceedings of Eurographics Conference on Rendering Techniques. Eurographics Association, 309–320.Google ScholarGoogle Scholar
  29. Varun Manjunatha, Mohit Iyyer, Jordan Boyd-Graber, and Larry Davis. 2018. Learning to Color from Language. In Proceedings of the Conference of North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 764–769.Google ScholarGoogle ScholarCross RefCross Ref
  30. John Maule, Alice E. Skelton, and Anna Franklin. 2023. The Development of Color Perception and Cognition. Annual Review of Psychology 74 (2023), 87–111.Google ScholarGoogle ScholarCross RefCross Ref
  31. Wang Meng. 1690-1722. Ten Thousand Miles of the Yangtze River. ltfc.net (Website). https://g2.ltfc.net/view/SUHA/6102e0eb5c31e364adf7e065.Google ScholarGoogle Scholar
  32. Zhao Mengfu. 1254—1322. Dongting East Hill. ltfc.net (Website). https://g2.ltfc.net/view/SUHA/635f574709b9265e9e1c075c.Google ScholarGoogle Scholar
  33. Yuji Morimoto, Yuichi Taguchi, and Takeshi Naemura. 2009. Automatic Colorization of Grayscale Images using Multiple Images on the Web. In SIGGRAPH 2009: Talks.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. OpenAI. 2022. Introducing ChatGPT. https://openai.com/blog/chatgpt.Google ScholarGoogle Scholar
  35. Stephen E. Palmer and Karen B. Schloss. 2010. An Ecological Valence Theory of Human Color Preference. Proceedings of the National Academy of Sciences 107, 19 (2010), 8877–8882.Google ScholarGoogle ScholarCross RefCross Ref
  36. Stephen E. Palmer, Karen B. Schloss, and Jonathan Sammartino. 2013. Visual Aesthetics and Human Preference. Annual Review of Psychology 64 (2013), 77–107.Google ScholarGoogle ScholarCross RefCross Ref
  37. Or Patashnik, Zongze Wu, Eli Shechtman, Daniel Cohen-Or, and Dani Lischinski. 2021. StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery. In Proceedings of IEEE International Conference on Computer Vision. IEEE, 2065–2074.Google ScholarGoogle ScholarCross RefCross Ref
  38. Soo-Chang Pei, Yi-Chong Zeng, and Ching-Hua Chang. 2004. Virtual Restoration of Ancient Chinese Paintings Using Color Contrast Enhancement and Lacuna Texture Synthesis. IEEE Transactions on Image Processing 13, 3 (2004), 416–429.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Li Peng. 2014. On the Commonalities of Artistic Principles of Landscape Poetry and Painting in Liu Song Dynasty. Canadian Social Science 10, 6 (2014), 217.Google ScholarGoogle Scholar
  40. Yihao Peng, JiWoong Jang, Jeffrey P. Bigham, and Amy Pavel. 2021. Say It All: Feedback for Improving Non-Visual Presentation Accessibility. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Huy Q. Phan, Hongbo Fu, and Antoni B. Chan. 2018. Color Orchestra: Ordering Color Palettes for Interpolation and Prediction. IEEE Transactions on Visualization and Computer Graphics 24, 6 (2018), 1942–1955.Google ScholarGoogle ScholarCross RefCross Ref
  42. Adobe Photoshop. 2023. Match Colors in Your Image. Website. https://helpx.adobe.com/photoshop/using/matching-replacing-mixing-colors.html.Google ScholarGoogle Scholar
  43. Yingge Qu, Tien-Tsin Wong, and Pheng-Ann Heng. 2006. Manga colorization. ACM Transactions on Graphics 25, 3 (2006), 1214–1220.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Ghulam J. Quadri, Jennifer A. Nieves, Brenton M. Wiernik, and Paul Rosen. 2022. Automatic Scatterplot Design Optimization for Clustering Identification. IEEE Transactions on Visualization and Computer Graphics (2022).Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learning Transferable Visual Models From Natural Language Supervision. In Proceedings of International Conference on Machine Learning. PMLR, 8748–8763.Google ScholarGoogle Scholar
  46. Ragini Rathore, Zachary Leggon, Laurent Lessard, and Karen B. Schloss. 2019. Estimating Color-Concept Associations from Image Statistics. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2019), 1226–1235.Google ScholarGoogle Scholar
  47. Khairi Reda, Pratik Nalawade, and Kate Ansah-Koi. 2018. Graphical Perception of Continuous Quantitative Maps: The Effects of Spatial Frequency and Colormap Design. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Khairi Reda and Danielle Albers Szafir. 2021. Rainbows Revisited: Modeling Effective Colormap Design for Graphical Inference. IEEE Transactions on Visualization and Computer Graphics 27, 2 (2021), 1032–1042.Google ScholarGoogle ScholarCross RefCross Ref
  49. Erik Reinhard, Michael Ashikhmin, Bruce Gooch, and Peter Shirley. 2001. Color Transfer between Images. IEEE Computer Graphics and Applications 21, 5 (2001), 34–41.Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Chitwan Saharia, William Chan, Huiwen Chang, Chris Lee, Jonathan Ho, Tim Salimans, David Fleet, and Mohammad Norouzi. 2022. Palette: Image-to-Image Diffusion Models. In Proceedings of Special Interest Group on Computer Graphics and Interactive Techniques. ACM, 1–10.Google ScholarGoogle Scholar
  51. Karen B. Schloss, Connor C. Gramazio, Allison T. Silverman, Madeline L. Parker, and Audrey S. Wang. 2018. Mapping Color to Meaning in Colormap Data Visualizations. IEEE Transactions on Visualization and Computer Graphic 25, 1 (2018), 810–819.Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Karen B. Schloss, Laurent Lessard, Charlotte S. Walmsley, and Kathleen Foley. 2018. Color Inference in Visual Communication: the Meaning of Colors in Recycling. Cognitive Research: Principles and Implications 3, 1 (2018), 1–17.Google ScholarGoogle ScholarCross RefCross Ref
  53. Karen B. Schloss and Stephen E. Palmer. 2011. Aesthetic Response to Color Combinations: Preference, Harmony, and Similarity. Attention, Perception, & Psychophysics 73 (2011), 551–571.Google ScholarGoogle ScholarCross RefCross Ref
  54. Rainer Schulte. 2014. Translating China for Western Readers: Reflective, Critical, and Practical Essays. SUNY Press.Google ScholarGoogle Scholar
  55. Vidya Setlur and Maureen C. Stone. 2015. A Linguistic Approach to Categorical Color Assignment for Data Visualization. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2015), 698–707.Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Wang shaohua. 2001. Su Shi “Shihua Yilv” de Neihan [The Connotation of Shi Su’s “Congruence between Paintings and Poems”]. Wenyi Lilun Yanjiu77–83 (2001).Google ScholarGoogle Scholar
  57. Xinyu Shi, Ziqi Zhou, Jingwen Zhang, Ali Neshati, Anjul K. Tyagi, Ryan Rossi, Shunan Guo, Fan Du, and Jian Zhao. 2023. De-Stijl: Facilitating Graphics Design with Interactive 2D Color Palette Recommendation. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Maria Shugrina, Wenjia Zhang, Fanny Chevalier, Sanja Fidler, and Karan Singh. 2019. Color Builder: A Direct Manipulation Interface for Versatile Color Theme Authoring. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Li Sixun. 1500. Emperor Taizong Arriving at the Jiucheng Palace. ltfc.net (Website). https://g2.ltfc.net/view/SUHA/6229cf4dc0a0c85ae709de6a.Google ScholarGoogle Scholar
  60. Stephen Smart, Keke Wu, and Danielle A. Szafir. 2019. Color Crafting: Automating the Construction of Designer Quality Color Ramps. IEEE Transactions on Visualization and Computer Graphic 26, 1 (2019), 1215–1225.Google ScholarGoogle ScholarCross RefCross Ref
  61. Jheng-Wei Su, Hung-Kuo Chu, and Jia-Bin Huang. 2020. Instance-Aware Image Colorization. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 7968–7977.Google ScholarGoogle ScholarCross RefCross Ref
  62. Yu Sun, Shuohuan Wang, Shikun Feng, Siyu Ding, Chao Pang, Junyuan Shang, Jiaxiang Liu, Xuyi Chen, Yanbin Zhao, Yuxiang Lu, 2021. Ernie 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation. arXiv preprint arXiv:2107.02137 (2021).Google ScholarGoogle Scholar
  63. Danielle A. Szafir. 2017. Modeling Color Difference for Visualization Design. IEEE Transactions on Visualization and Computer Graphics 24, 1 (2017), 392–401.Google ScholarGoogle ScholarCross RefCross Ref
  64. Yu-Wing Tai, Jiaya Jia, and Chi-Keung Tang. 2005. Local Color Transfer via Probabilistic Segmentation by Expectation-Maximization. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 747–754.Google ScholarGoogle Scholar
  65. Wenbo Tao, Xinli Hou, Adam Sah, Leilani Battle, Remco Chang, and Michael Stonebraker. 2020. Kyrix-s: Authoring Scalable Scatterplot Visualizations of Big Data. IEEE Transactions on Visualization and Computer Graphics 27, 2 (2020), 401–411.Google ScholarGoogle ScholarCross RefCross Ref
  66. Chin Tseng, Ghulam J. Quadri, Zeyu Wang, and Danielle A. Szafir. 2023. Measuring Categorical Perception in Color-Coded Scatterplots. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Barbara Tversky, Maneesh Agrawala, Julie Heiser, Paul Lee, Pat Hanrahan, Phan Doantam, Chris Stolte, and Marie P. Daniel. 2020. Cognitive Design Principles for Automated Generation of Visualizations. In Applied Spatial Cognition. Psychology Press, 53–74.Google ScholarGoogle Scholar
  68. Patricia Vitoria, Lara Raad, and Coloma Ballester. 2020. ChromaGAN: Adversarial Picture Colorization with Semantic Class Distribution. In Proceedings of IEEE Winter Conference on Applications of Computer Vision. IEEE, 2434–2443.Google ScholarGoogle ScholarCross RefCross Ref
  69. Han-Lei Wang, Ping-Hsuan Han, Yu-Mu Chen, Kuan-Wen Chen, XinYi Lin, Ming-Sui Lee, and Yi-Ping Hung. 2018. Dunhuang mural restoration using deep learning. In SIGGRAPH Asia Technical Briefs. ACM, 1–4.Google ScholarGoogle Scholar
  70. Tomihisa Welsh, Michael Ashikhmin, and Klaus Mueller. 2002. Transferring Color to Greyscale Images. ACM Transactions on Graphics 21, 3 (2002), 277–280.Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Shuchen Weng, Hao Wu, Zheng Chang, Jiajun Tang, Si Li, and Boxin Shi. 2022. L-CoDe:Language-Based Colorization Using Color-Object Decoupled Conditions. In Proceedings of AAAI Conference on Artificial Intelligence. AAAI, 2677–2684.Google ScholarGoogle ScholarCross RefCross Ref
  72. Yanze Wu, Xintao Wang, Yu Li, Honglun Zhang, Xun Zhao, and Ying Shan. 2021. Towards Vivid and Diverse Image Colorization with Generative Color Prior. In Proceedings of IEEE International Conference on Computer Vision. IEEE, 14357–14366.Google ScholarGoogle ScholarCross RefCross Ref
  73. Menghan Xia, Wenbo Hu, Tien-Tsin Wong, and Jue Wang. 2022. Disentangled Image Colorization via Global Anchors. ACM Transactions on Graphics 41, 6 (2022), 1–13.Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Wang Ximeng. 1113. A Thousand Li of Rivers and Mountains. ltfc.net (Website). https://g2.ltfc.net/view/SUHA/62429b3b43eebd107d0c2ee8.Google ScholarGoogle Scholar
  75. Zhongyou Xu, Tingting Wang, Faming Fang, Yun Sheng, and Guixu Zhang. 2020. Stylization-Based Architecture for Fast Deep Exemplar Colorization. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 9360–9369.Google ScholarGoogle ScholarCross RefCross Ref
  76. Chuan Yan, John J. Young Chung, Yoon Kiheon, Yotam Gingold, Eytan Adar, and Sungsoo R. Hong. 2022. FlatMagic: Improving Flat Colorization through AI-Driven Design for Digital Comic Professionals. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. An Yang, Junshu Pan, Junyang Lin, Rui Men, Yichang Zhang, Jingren Zhou, and Chang Zhou. 2022. Chinese CLIP: Contrastive Vision-Language Pretraining in Chinese. arXiv preprint arXiv:2211.01335 (2022).Google ScholarGoogle Scholar
  78. Liron Yatziv and Guillermo Sapiro. 2006. Fast Image and Video Colorization using Chrominance Blending. IEEE Transactions on Image Processing 15, 5 (2006), 1120–1129.Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. Chou Ying. 1368-1644. Saying Farewell at Xunyang. ltfc.net (Website). https://g2.ltfc.net/view/SUHA/608a619eaa7c385c8d942ecd.Google ScholarGoogle Scholar
  80. Chou Ying. 1368—1644. Maple Creek Fishing. ltfc.net (Website). https://g2.ltfc.net/view/SUHA/608a61a0aa7c385c8d943112.Google ScholarGoogle Scholar
  81. Chou Ying. 1368—1644. Peach Orchard Wonderland. ltfc.net (Website). https://g2.ltfc.net/view/SUHA/608a61a0aa7c385c8d943115.Google ScholarGoogle Scholar
  82. Chou Ying. 1542-1545. Along the River During the Qingming Festival. ltfc.net (Website). https://g2.ltfc.net/view/SUHA/609672f536bd622e5d1ee9bf.Google ScholarGoogle Scholar
  83. Wei Yishi. 1983. Su Shi “Hui Chong Chunjiang Wanjing” Shangxi [Appreciation of Su Shi’s “Hui Chong Chunjiang Wanjing”]. Beijing Shifan Daxue Xuebao 3, 95–96 (1983).Google ScholarGoogle Scholar
  84. Dong Yuan. 907-960. Residents on the Outskirts of Dragon Abode. ltfc.net (Website). https://g2.ltfc.net/view/SUHA/621dbd0d5495b316e05a3051.Google ScholarGoogle Scholar
  85. Jun Zhang. 2021. Exploring the Application of Traditional Elements in Cultural and Creative Product Design. Art and Design Review 9, 332–340 (2021).Google ScholarGoogle ScholarCross RefCross Ref
  86. Richard Zhang, Phillip Isola, and Alexei A. Efros. 2016. Colorful Image Colorization. In Proceedings of European Conference on Computer Vision. Springer, 649–666.Google ScholarGoogle ScholarCross RefCross Ref
  87. Richard Zhang, Jun-Yan Zhu, Phillip Isola, Xinyang Geng, Angela S. Lin, Tianhe Yu, and Alexei A. Efros. 2017. Real-Time User-Guided Image Colorization with Learned Deep Prior. ACM Transactions on Graphics 36, 4 (2017), 1–11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  88. Yufan Zhou, Ruiyi Zhang, Jiuxiang Gu, Chris Tensmeyer, Tong Yu, Changyou Chen, Jinhui Xu, and Tong Sun. 2022. TiGAN: Text-Based Interactive Image Generation and Manipulation. In Proceedings of AAAI Conference on Artificial Intelligence. AAAI, 3580–3588.Google ScholarGoogle ScholarCross RefCross Ref
  89. Zhe Zhu, Haozhi Huang, Zhipeng Tan, Kun Xu, and Shimin Hu. 2016. Faithful Completion of Images of Scenic Landmarks Using Internet Images. IEEE Transactions on Visualization and Computer Graphics 22, 8 (2016), 1945–1958.Google ScholarGoogle ScholarDigital LibraryDigital Library
  90. Changqing Zou, Haoran Mo, Chengying Gao, Ruofei Du, and Hongbo Fu. 2019. Language-based Colorization of Scene Sketches. ACM Transactions on Graphics 38, 6 (2019), 1–16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  91. Zheng Zou, Peng Zhao, and Xuefeng Zhao. 2021. Virtual Restoration of the Colored Paintings on Weathered Beams in the Forbidden City Using Multiple Deep Learning Algorithms. Advanced Engineering Informatics 50 (2021), 101421.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. PColorizor: Re-coloring Ancient Chinese Paintings with Ideorealm-congruent Poems

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology
      October 2023
      1825 pages
      ISBN:9798400701320
      DOI:10.1145/3586183

      Copyright © 2023 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 October 2023

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate842of3,967submissions,21%

      Upcoming Conference

      UIST '24
    • Article Metrics

      • Downloads (Last 12 months)344
      • Downloads (Last 6 weeks)61

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format