skip to main content
10.1145/3589334.3648150acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article
Open access

SceneDAPR: A Scene-Level Free-Hand Drawing Dataset for Web-based Psychological Drawing Assessment

Published: 13 May 2024 Publication History

Abstract

Sketch-based drawing assessments are useful in understanding individuals' cognitive and psychological states, such as cognitive impairment or mental disorders. Hence, these assessments have been developed and applied on a large scale, such as in schools and workplaces, to screen individuals who may require further clinical examination. However, the interpretation of a large number of drawing assessments solely relies on human experts, requiring much time and cost. To address this issue, we introduce a novel scene-level sketch dataset, SceneDAPR, which can be used to automatically analyze the drawing assessment, Draw-A-Person-in-the-Rain (DAPR), a popular psychological drawing assessment used for identifying stressful experiences and coping behavior. The proposed dataset consists of 6,420 objects depicted in 1,399 scene sketches drawn by humans, along with detailed supplementary information about the participants. SceneDAPR includes free-hand drawings from different age groups: children & adolescents, adults, and seniors. Leveraging the proposed SceneDAPR, we develop a web-based drawing assessment system. The extensive experiments demonstrate that our system shows a robust performance across the different age groups in the object detection task as well as a considerable performance compared to human experts. We believe that the proposed new sketch dataset can be used to develop an automatic system for psychological drawing assessments, which can support human experts by reducing the time and cost of analyzing the drawing assessments for a large population. SceneDAPR and experimental code are available at https://github.com/DSAIL-SKKU/SceneDAPR.

Supplemental Material

MP4 File
Video presentation
MP4 File
Supplemental video

References

[1]
Adobe Inc. Adobe illustrator cc 2022, 2022.
[2]
Lewis Aiken. Personality assessment: Methods & practices (3rd ed. rev.). 1999.
[3]
Brian Allen and Chriscelyn Tussey. Can projective drawings detect if a child experienced sexual or physical abuse? a systematic review of the controlled research. Trauma, violence, & abuse, 13(2):97--111, 2012.
[4]
Galit Amir and Rachel Lev-Wiesel. Dissociation as depicted in the traumatic event drawings of child sexual abuse survivors: A preliminary study. The arts in psychotherapy, 34(2):114--123, 2007.
[5]
Susan Buchalter. Art therapy and creative coping techniques for older adults. Jessica Kingsley Publishers, 2011.
[6]
Holger Caesar, Jasper Uijlings, and Vittorio Ferrari. Coco-stuff: Thing and stuff classes in context. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1209--1218, 2018.
[7]
Suellen M Carney. Draw a person in the rain: A comparison of levels of stress and depression among adolescents. PhD thesis, Pace University, 1992.
[8]
CELSYS, Inc. Clip studio paint v1.5, 2022.
[9]
Shuqing Chen, Daniel Stromer, Harb Alnasser Alabdalrahim, Stefan Schwab, Markus Weih, and Andreas Maier. Automatic dementia screening and scoring by applying deep learning on clock-drawing tests. Scientific Reports, 10(1):1--11, 2020.
[10]
Pinaki Nath Chowdhury, Aneeshan Sain, Ayan Kumar Bhunia, Tao Xiang, Yulia Gryaditskaya, and Yi-Zhe Song. Fs-coco: towards understanding of freehand sketches of common objects in context. In Computer Vision--ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23--27, 2022, Proceedings, Part VIII, pages 253--270. Springer, 2022.
[11]
Hwa-Yeon Chung. Characteristic of response to 'draw a person in the rain' (dapr) based on the level of job stress of female workers. Master's thesis, SeoulWomen's University, 2020.
[12]
Mathias Eitz, James Hays, and Marc Alexa. How do humans sketch objects? ACM Transactions on graphics (TOG), 31(4):1--10, 2012.
[13]
Glenn Jocher et. al. ultralytics/yolov5: v6.1 - YOLOv5n 'Small' models, Roboflow integration, TensorFlow export, OpenCV DNN support, 2022.
[14]
Chengying Gao, Qi Liu, Qi Xu, LiminWang, Jianzhuang Liu, and Changqing Zou. Sketchycoco: Image generation from freehand scene sketches. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5174--5183, 2020.
[15]
Adam Graves, Leslie Jones, and Frances F Kaplan. Draw-a-person-in-the-rain: Does geographic location matter? Art Therapy, 30(3):107--113, 2013.
[16]
Simeng Gu, Yige Liu, Fei Liang, Rou Feng, Yawen Li, Guorui Liu, Mengdan Gao, Wei Liu, Fushun Wang, and Jason H Huang. Screening depressive disorders with tree-drawing test. Frontiers in psychology, 11:1446, 2020.
[17]
David Ha and Douglas Eck. A neural representation of sketch drawings. In International Conference on Learning Representations (ICLR), 2018.
[18]
Emanuel F Hammer. The clinical application of projective drawings. Charles C Thomas, 1958.
[19]
Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. Mask r-cnn. In Proceedings of the IEEE international conference on computer vision, pages 2961--2969, 2017.
[20]
Sie-Nae Huh. Characteristic of response to 'draw a person in the rain' (dapr) based on the level of job stress of female workers. Master's thesis, SeoulWomen's University, 2021.
[21]
Hey-Kyoung Hwang. A study on characteristics of responses to dapr(draw-aperson-in-the-rain) assessments based on the level of daily stress, self-efficacy of baby sitters. Master's thesis, Seoul Women's University, 2020.
[22]
Chiara Ionio and Eleonora Mascheroni. Psychological well-being and graphic representations of self in child victims of violence. The Arts in Psychotherapy, 72:101740, 2021.
[23]
Hongchao Jiang, Yanci Zhang, Zhiwei Zeng, Jun Ji, YuWang, Ying Chi, and Chunyan Miao. Mobile-based clock drawing test for detecting early signs of dementia. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 16048--16050, 2021.
[24]
Seungwan Jin, Hoyoung Choi, and Kyungsik Han. Ai-augmented art psychotherapy through a hierarchical co-attention mechanism. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management, pages 4089--4093, 2022.
[25]
Glenn Jocher, Ayush Chaurasia, and Jing Qiu. YOLO by Ultralytics, January 2023.
[26]
Hyun-Ji Kim. Characteristic of response to ?draw a person in the rain' (dapr) based on the level of job stress of female workers. Master's thesis, Daejin University, 2012.
[27]
Jiwon Kim, Jiwon Kang, Taeeun Kim, Hayeon Song, and Jinyoung Han. Alphadapr: An ai-based explainable expert support system for art therapy. In Proceedings of the 28th International Conference on Intelligent User Interfaces, pages 19--31, 2023.
[28]
Limor Kissos, Limor Goldner, Moshe Butman, Niv Eliyahu, and Rachel Lev-Wiesel. Can artificial intelligence achieve human-level performance? a pilot study of childhood sexual abuse detection in self-figure drawings. Child Abuse & Neglect, 109:104755, 2020.
[29]
Terry K Koo and Mae Y Li. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of chiropractic medicine, 15(2):155--163, 2016.
[30]
Kate Kravits, Randi McAllister-Black, Marcia Grant, and Christina Kirk. Self-care strategies for nurses: A psycho-educational intervention for stress reduction and the prevention of burnout. Applied Nursing Research, 23(3):130--138, 2010.
[31]
Heidi S Lack. The person-in-the-rain projective drawing as a measure of children's coping capacity: a concurrent validity study using rorschach, psychiatric, and life history variables. California School of Professional Psychology-Berkeley/Alameda, 1997.
[32]
Molly Lewis, Anjali Balamurugan, Bin Zheng, and Gary Lupyan. Characterizing variability in shared meaning through millions of sketches. In Proceedings of the Annual Meeting of the Cognitive Science Society, volume 43, 2021.
[33]
Eva Fishell Lichtenberg. Draw-a-person-in-the rain test. In Leonard Handler and A. D. Thomas, editors, Drawings in assessment and psychotherapy: Research and application, pages 164--183. Routledge/Taylor & Francis Group., 2014.
[34]
Karen Machover. Personality projection in the drawing of the human figure: A method of personality investigation. 1949.
[35]
Seungjin Oh. Diagnostic test of art psycology. Dongmunsa, Seoul, Korea, 2014.
[36]
Delphine Picard, Claire Brechet, and René Baldy. Expressive strategies in drawing are related to age and topic. Journal of Nonverbal Behavior, 31(4):243--257, 2007.
[37]
Teresa Raffaelli and Elizabeth Hartzell. A comparison of adults' responses to collage versus drawing in an initial art-making session. Art Therapy, 33(1):21--26, 2016.
[38]
Ochilbek Rakhmanov, Nwojo Nnanna Agwu, and Steve Adeshina. Experimentation on hand drawn sketches by children to classify draw-a-person test images in psychology. In The Thirty-Third International Flairs Conference, 2020.
[39]
Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 28, 2015.
[40]
Jennifer Rusted, Linda Sheppard, and Diane Waller. A multi-centre randomized control group trial on the use of art therapy for older people with dementia. Group Analysis, 39(4):517--536, 2006.
[41]
Justin Thomas, Aamna Al-Shehhi, Ian Grey, and Tai Broach. Exploring cultural variation in the emotional expressivity of online drawings. Computers in Human Behavior Reports, 2:100002, 2020.
[42]
Aaro Toomela. Drawing as a verbally mediated activity: A study of relationships between verbal, motor, and visuospatial skills and drawing in children. International Journal of Behavioral Development, 26(3):234--247, 2002.
[43]
JS Verinis, EF Lichtenberg, and L Henrich. The draw-a-person in the rain technique: Its relationship to diagnostic category and other personality indicators. Journal of Clinical Psychology, 1974.
[44]
Lisa R Willis, Stephen P Joy, and Donna H Kaiser. Draw-a-person-in-the-rain as an assessment of stress and coping resources. The Arts in Psychotherapy, 37(3):233--239, 2010.
[45]
Zhengming Zhang, Xiaoming Deng, Jinyao Li, Yukun Lai, Cuixia Ma, Yongjin Liu, and Hongan Wang. Stroke-based semantic segmentation for scene-level free-hand sketches. The Visual Computer, pages 1--13, 2022.
[46]
Changqing Zou, Qian Yu, Ruofei Du, Haoran Mo, Yi-Zhe Song, Tao Xiang, Chengying Gao, Baoquan Chen, and Hao Zhang. Sketchyscene: Richly-annotated scene sketches. In Proceedings of the european conference on computer vision (ECCV), pages 421--436, 2018.

Cited By

View all
  • (2024)Developing an AI-based Explainable Expert Support System for Art TherapyACM Transactions on Interactive Intelligent Systems10.1145/368964914:4(1-23)Online publication date: 30-Aug-2024

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WWW '24: Proceedings of the ACM Web Conference 2024
May 2024
4826 pages
ISBN:9798400701719
DOI:10.1145/3589334
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2024

Permissions

Request permissions for this article.

Check for updates

Badges

Author Tags

  1. art therapy
  2. drawing assessment
  3. scene-level dataset

Qualifiers

  • Research-article

Funding Sources

Conference

WWW '24
Sponsor:
WWW '24: The ACM Web Conference 2024
May 13 - 17, 2024
Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)322
  • Downloads (Last 6 weeks)35
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Developing an AI-based Explainable Expert Support System for Art TherapyACM Transactions on Interactive Intelligent Systems10.1145/368964914:4(1-23)Online publication date: 30-Aug-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media