Abstract
Onomatopoeia is used to describe the state and degree of movement. Since onomatopoeia is a linguistic symbol, it is expected that many people will recall the same image corresponding to the onomatopoeia. Is this really true? In this paper, we focus on playing with dolls, collect onomatopoeia uttered during doll play, and construct a corpus of co-occurrence relations between onomatopoeia and doll movements. In order to verify the value of this corpus, we confirm the recall of movement from onomatopoeia and vice versa. As an application example based on this corpus, we also present a prototype of “onomatopoeia camera,” a system that automatically adds onomatopoeia and comic-like expressions to subjects’ movements.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Canelas, A., Neves, R., Horta, N.: Multi-dimensional pattern discovery in financial time series using SAX-GA with extended robustness. In: Proceedings of the 15th Annual Conference Companion on Genetic and Evolutionary Computation (GECCO ’13 Companion), pp. 179–180. ACM, NY, USA (2013). http://doi.acm.org/10.1145/2464576.2464664
Fukusato, T., Morishima, S.: Automatic depiction of onomatopoeia in animation considering physical phenomena. In: Proceedings of the Seventh International Conference on Motion in Games (MIG ’14), pp. 161–169. ACM, NY, USA (2014). http://doi.acm.org/10.1145/2668064.2668096
Garg, Y., Poccia, S.R.: On the effectiveness of distance measures for similarity search in multi-variate sensory data: effectiveness of distance measures for similarity search. In: Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval (ICMR ’17), pp. 489–493. ACM, NY, USA (2017). http://doi.acm.org/10.1145/3078971.3079009
Gomes, E.F., Jorge, A.M., Azevedo, P.J.: Classifying heart sounds using multiresolution time series motifs: An exploratory study. In: Proceedings of the International C* Conference on Computer Science and Software Engineering (C3S2E ’13), pp. 23–30. ACM, NY, USA (2013). http://doi.acm.org/10.1145/2494444.2494458
Kato, A., Fukazawa, Y., Sato, T., Mori, T.: Extraction of onomatopoeia used for foods from food reviews and its application to restaurant search. In: Proceedings of the 21st International Conference on World Wide Web (WWW ’12 Companion), pp. 719–728. ACM, New York, NY, USA (2012). http://doi.acm.org/10.1145/2187980.2188192
Komatsu, T.: Quantifying Japanese Onomatopoeias: toward augmenting creative activities with onomatopoeias. In: Proceedings of the 3rd Augmented Human International Conference (AH ’12), pp. 15:1–15:4. ACM, NY, USA (2012). http://doi.acm.org/10.1145/2160125.2160140
Komatsu, T.: Choreographing robot behaviors by means of Japanese onomatopoeias. In: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI’15) Extended Abstracts, pp. 23–24. ACM, NY, USA (2015). http://doi.acm.org/10.1145/2701973.2702020
Kwon, S., Kim, L.H.: Sound sketching via voice. In: Proceedings of the 5th International Conference on Ubiquitous Information Management and Communication (ICUIMC ’11), pp. 48:1–48:4. ACM, New York, NY, USA (2011). http://doi.acm.org/10.1145/1968613.1968672
Lin, J., Keogh, E., Lonardi, S., Chiu, B.: A symbolic representation of time series, with implications for streaming algorithms. In: Proceedings of the 8th ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery (DMKD ’03), pp. 2–11. ACM, New York, NY, USA (2003). http://doi.acm.org/10.1145/882082.882086
Miyazaki, A., Tomimatsu, K.: Onomato Planets: physical computing of Japanese onomatopoeia. In: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction (TEI ’09), pp. 301–304. ACM, NY, USA (2009). http://doi.acm.org/10.1145/1517664.1517726
Oh, J., Kim, G.J.: Effect of accompanying onomatopoeia with sound feedback toward presence and user experience in virtual reality. In: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (VRST ’18), pp. 81:1–81:2. ACM, New York, NY, USA (2018). http://doi.acm.org/10.1145/3281505.3283401
Yusuf, M., Asaga, C., Watanabe, C.: Onomatopeta!: developing a Japanese onomatopoeia learning-support system utilizing native speakers cooperation. In: Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT ’08) - Volume 03, pp. 173–177. IEEE Computer Society, Washington, DC, USA (2008). https://doi.org/10.1109/WIIAT.2008.300
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Takahashi, T., Sumi, Y. (2023). Mutual Recall Between Onomatopoeia and Motion Using Doll Play Corpus. In: Streitz, N.A., Konomi, S. (eds) Distributed, Ambient and Pervasive Interactions. HCII 2023. Lecture Notes in Computer Science, vol 14036. Springer, Cham. https://doi.org/10.1007/978-3-031-34668-2_18
Download citation
DOI: https://doi.org/10.1007/978-3-031-34668-2_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-34667-5
Online ISBN: 978-3-031-34668-2
eBook Packages: Computer ScienceComputer Science (R0)