skip to main content
10.1145/3544549.3585879acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Work in Progress

Spot The Difference: AI, Please Make This for Me!

Authors Info & Claims
Published:19 April 2023Publication History

ABSTRACT

Play and games are an inseparable part of our lives, and we have been playing various games from our childhood to adulthood. One of the widely recognized games is "Spot-the-Difference", which has been played and employed in a variety of domains, such as education, training, and entertainment. However, designing a custom "Spot-the-Difference" game for a certain domain requires consideration in terms of the level of game difficulty, game interest, and human intervention, therefore, is non-trivial. In this paper, we propose a novel framework based on Human-AI collaboration to automatically generate images for the "Spot-the-Difference" game. We employ Maskformer and Inpainting Stable Diffusion to automatically identify and re-draw a set of regions in the image. Finally, we conducted a user study with 19 participants to evaluate our framework. From the experimental result, we found that AI-generated game images were enjoyable, but there is still room for improvement in the quality of the overall game playing.

Skip Supplemental Material Section

Supplemental Material

3544549.3585879-talk-video.mp4

mp4

18.5 MB

3544549.3585879-video-preview.mp4

mp4

3.6 MB

References

  1. Brandon Burr, Ladonna Atkins, Anita Glee Bertram, Kaye Sears, and Andreae N McGinnis. 2019. “If you stop playing you get old”: investigating reflections of play in older adults. Educational Gerontology 45, 5 (2019), 353–364.Google ScholarGoogle ScholarCross RefCross Ref
  2. Jeongho Cha, Su Yin Kan, and Poh Wai Chia. 2018. Spot the differences Game: An Interactive method that engage students in organic chemistry learning. Journal of Korean chemical society (2018), 159–162.Google ScholarGoogle Scholar
  3. Bowen Cheng, Omkar Parkhi, and Alexander Kirillov. 2022. Pointly-supervised instance segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2617–2626.Google ScholarGoogle ScholarCross RefCross Ref
  4. Bowen Cheng, Alex Schwing, and Alexander Kirillov. 2021. Per-pixel classification is not all you need for semantic segmentation. Advances in Neural Information Processing Systems 34 (2021), 17864–17875.Google ScholarGoogle Scholar
  5. Diane E Frey. 1994. The use of play therapy with adults. Handbook of play therapy 2 (1994), 189–205.Google ScholarGoogle Scholar
  6. Peter Gray. 2015. The decline of play | Peter Gray | TEDxNavesink. Retrieved Accessed 19-Jan-2023 from https://www.youtube.com/watch?v=Bg-GEzM7iTkGoogle ScholarGoogle Scholar
  7. Jonathan Ho, Chitwan Saharia, William Chan, David J Fleet, Mohammad Norouzi, and Tim Salimans. 2022. Cascaded Diffusion Models for High Fidelity Image Generation.J. Mach. Learn. Res. 23 (2022), 47–1.Google ScholarGoogle Scholar
  8. Yaosi Hu, Chong Luo, and Zhenzhong Chen. 2022. Make it move: controllable image-to-video generation with text descriptions. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 18219–18228.Google ScholarGoogle ScholarCross RefCross Ref
  9. Ngan Kuen Lai, Tan Fong Ang, Lip Yee Por, and Chee Sun Liew. 2018. The impact of play on child development-a literature review. European Early Childhood Education Research Journal 26, 5 (2018), 625–643.Google ScholarGoogle ScholarCross RefCross Ref
  10. Yanfen Li, Hanxiang Wang, L Minh Dang, Md Jalil Piran, and Hyeonjoon Moon. 2022. A robust instance segmentation framework for underground sewer defect detection. Measurement 190 (2022), 110727.Google ScholarGoogle ScholarCross RefCross Ref
  11. Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. 2014. Microsoft coco: Common objects in context. In European conference on computer vision. Springer, 740–755.Google ScholarGoogle ScholarCross RefCross Ref
  12. Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. 2021. High-Resolution Image Synthesis with Latent Diffusion Models. arxiv:2112.10752 [cs.CV]Google ScholarGoogle Scholar
  13. Chitwan Saharia, William Chan, Huiwen Chang, Chris Lee, Jonathan Ho, Tim Salimans, David Fleet, and Mohammad Norouzi. 2022. Palette: Image-to-image diffusion models. In ACM SIGGRAPH 2022 Conference Proceedings. 1–10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Robyn Schell, Simone Hausknecht, Fan Zhang, and David Kaufman. 2016. Social benefits of playing Wii Bowling for older adults. Games and Culture 11, 1-2 (2016), 81–103.Google ScholarGoogle ScholarCross RefCross Ref
  15. Liu Yang, Wen Li, Jian Zou, Junnan An, Bin Zeng, Yitao Zheng, Jiming Yang, and Jia Ren. 2022. The application of the spot the difference teaching method in clinical skills training for residents. BMC Medical Education 22, 1 (2022), 1–10.Google ScholarGoogle ScholarCross RefCross Ref
  16. Tianwen Zhang and Xiaoling Zhang. 2022. A mask attention interaction and scale enhancement network for SAR ship instance segmentation. IEEE Geoscience and Remote Sensing Letters 19 (2022), 1–5.Google ScholarGoogle Scholar

Index Terms

  1. Spot The Difference: AI, Please Make This for Me!

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
        April 2023
        3914 pages
        ISBN:9781450394222
        DOI:10.1145/3544549

        Copyright © 2023 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 19 April 2023

        Check for updates

        Qualifiers

        • Work in Progress
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate6,164of23,696submissions,26%

        Upcoming Conference

        CHI '24
        CHI Conference on Human Factors in Computing Systems
        May 11 - 16, 2024
        Honolulu , HI , USA

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      View Full Text

      HTML Format

      View this article in HTML Format .

      View HTML Format