Skip to main content

Interpretable Drawing Psychoanalysis via House-Tree-Person Test

  • Conference paper
  • First Online:
AI 2023: Advances in Artificial Intelligence (AI 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14472))

Included in the following conference series:

  • 562 Accesses

Abstract

As the number of people with psychological disorders continues to increase in recent years, it is particularly important to identify patients at an early stage. As one of the widely recognized methods of drawing psychoanalysis methods, the House-Tree-Person (HTP) test is commonly used for psychological assessment. Among the standards for HTP drawing analysis, the analysis of holistic features such as size and position is the most important evaluation standard. Traditional manual analysis for test results is time-consuming and highly subjective. Although image classification models provide fast and accurate predictions, they lack reliable decision-making interpretation. Existing methods for interpreting classification models can offer a certain degree of interpretation, but they are unable to provide specific interpretation related to psychology. In this paper, we propose a method to quantitatively analyze the interpretable results of decisions made by image classification models in relation to expert knowledge. Specifically, we initially utilize the interpretable method to identify the important features that influence the model’s decision-making process. Then, we use self-annotated files containing important symbols relevant to psychology to segment important features, obtaining psychological features associated with the model’s decision-making process. Finally, we quantitatively analyze the size and position through the psychological features respectively, comparing them with the widely used expert knowledge and rules. The experimental results reveal that the decisions of image classification model on the HTP dataset are consistent with the relevant universal rules of psychological features. The proposed method improves the reliability of image classification algorithm in psychotherapy and psychodiagnosis.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Leibowitz, M.: Interpreting Projective Drawings: A Self-psychological Approach. Routledge, London (2016)

    Google Scholar 

  2. Zhou, A., Xie, P., Pan, C.: Performance of patients with different schizophrenia subtypes on the synthetic house-tree-person test. Soc. Behav. Personal. Int. J. 47(11), 1–8 (2019)

    Google Scholar 

  3. Buck, J.N.: The H-T-P test. J. Clin. Psychol. 6, 78503–78512 (1948)

    Google Scholar 

  4. Liu, L.: Image classification in HTP test based on convolutional neural network model. Comput. Intell. Neurosci. (2021)

    Google Scholar 

  5. Kim, T., Yoon, Y., Lee, K.: Application of deep learning in art therapy. Int. J. Mach. Learn. Comput. 11(6) (2021)

    Google Scholar 

  6. Du, M., Liu, N., Hu, X.: Techniques for interpretable machine learning. Commun. ACM 63(1), 68–77 (2019)

    Article  Google Scholar 

  7. B, Zhou., Khosla, A., Lapedriza, A.: Learning deep features for discriminative localization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2921–2929 (2016)

    Google Scholar 

  8. Ramaswamy, H G.: Ablation-CAM: visual explanations for deep convolutional network via gradient-free localization. In: proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 983–991. IEEE (2020)

    Google Scholar 

  9. Draelos, R.L., Carin, L.: Use HiResCAM instead of Grad-CAM for faithful explanations of convolutional neural networks. arXiv preprint arXiv:2011.08891 (2020)

  10. Fu, R., Hu, Q., Dong, X.: Axiom-based grad-CAM: towards accurate visualization and explanation of CNNs. arXiv preprint arXiv:2008.02312 (2020)

  11. Jiang, P.T., Zhang, C.B., Hou, Q.: LayerCAM: exploring hierarchical class activation maps for localization. IEEE Trans. Image Process. 30, 5875–5888 (2021)

    Article  Google Scholar 

  12. Muhammad, MB., Yeasin, M.: Eigen-CAM: class activation map using principal components. In: 2020 International Joint Conference on Neural Networks (IJCNN), pp. 1–7 (2020)

    Google Scholar 

  13. Wang, H., Wang, Z., Du, M.: Score-CAM: score-weighted visual explanations for convolutional neural networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 24–25 (2020)

    Google Scholar 

  14. Lan, Y., Nagai, Y.: Research about children’s painting education method based on house tree person test. West East J. Soc. Sci. 8 (2019)

    Google Scholar 

  15. Carter, C.K., Hartley, C.: Are children with autism more likely to retain object names when learning from colour photographs or black-and-white cartoons. J. Autism Dev. Disord. 51(9), 3050–062 (2021)

    Article  Google Scholar 

  16. Afolayan, A.: Haitian children’s house-tree-person drawings: global similarities and cultural differences. Ph.D. dissertation, Antioch University (2015)

    Google Scholar 

  17. Di Leo, J.H.: Interpreting Children’s Drawings. Routledge, London (2013)

    Book  Google Scholar 

  18. Lin, M., Chen, Q., Yan, S.: Network in network. arXiv preprint arXiv:1312.4400 (2013)

  19. Selvaraju, RR., Cogswell, M., Das, A.: Grad-CAM: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)

    Google Scholar 

  20. Chattopadhay, A., Sarka, rA., Howlader, P.: Grad-CAM++: generalized gradient-based visual explanations for deep convolutional networks. In: 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 839–847. IEEE (2018)

    Google Scholar 

  21. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)

  22. He, K., Zhang, X., Ren, S.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  23. Deng, J., Dong, W., Socher, R.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255 (2009)

    Google Scholar 

  24. Burns, R.C.: Kinetic-House-Tree-Person Drawings (KHTP): An Interpretative Manual. Brunner/Mazel (1987)

    Google Scholar 

  25. Hongtao, J.: Usage of painting art therapy in mental health education of Chinese college students. High. Educ. Oriental Stud. 1(2) (2021)

    Google Scholar 

Download references

Acknowledgements

The paper has been supported by the National Natural Science Foundation of China (Grant No. 62372468, 61671480), the Shandong Natural Science Foundation (Grant No. ZR2023MF008), the Qingdao Natural Science Foundation(Grant No. 23-2-1-161-zyyd-jch), and the Major Scientific and Technological Projects of CNPC (Grant No. ZD2019-183-008).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Weifeng Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Xie, Y., Pan, T., Liu, B., Chen, H., Liu, W. (2024). Interpretable Drawing Psychoanalysis via House-Tree-Person Test. In: Liu, T., Webb, G., Yue, L., Wang, D. (eds) AI 2023: Advances in Artificial Intelligence. AI 2023. Lecture Notes in Computer Science(), vol 14472. Springer, Singapore. https://doi.org/10.1007/978-981-99-8391-9_18

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-8391-9_18

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-8390-2

  • Online ISBN: 978-981-99-8391-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics