Nesra Yannier
Ali Israr
ABSTRACT
Engaging children with traditional approaches in education, especially reading, grows ever more difficult in the face of their attachment to tablets and computer games. We explore the possibility of making the story reading experience more interesting and memorable for children using haptic augmentation. In this paper, we present FeelSleeve, an interface that allows children to feel story events in their hands while they are reading on a mobile device. FeelSleeve uses transducers and audio output from the tablet within a gloved attachment to create vibratory effects that are meaningfully related to story content. We describe a study investigating whether embedding such haptic feedback into stories enhances reading for six to nine year olds. Our results indicate that story events accompanied by haptic feedback are better comprehended and appear to be more salient in memory. These results provide evidence that haptic effects have the potential to improve children's reading experience and make it more memorable.
Supplemental Material
- Alles, D. S. Information transmission by phantom sensations. IEEE Transactions on Man-Machine Systems 11, 1 (1970), 85--91.Google Scholar
Cross Ref
- Back, M., Cohen, J., Gold, R., Harrison, S., & Minneman, S. Listen reader: an electronically augmented paper-based book. In Proc. CHI 2001, ACM Press (2001), 23--29. Google ScholarDigital Library
- Bau, O., Poupyrev, I., Israr, A., & Harrison, C. TeslaTouch: Electrovibration for touch surfaces. In Proceedings of the 23nd annual ACM symposium on User interface software and technology, ACM Press (2010), 283--292. Google ScholarDigital Library
- Békésy, G. v. Human skin perception of traveling waves similar to those on the cochlea. The Journal of the Acoustical Society of America 27, 5 (1955), 830--841.Google ScholarCross Ref
- Brewster, S., Chohan, F. and Brown, L. Tactile feedback for mobile interactions. In Proc. CHI'07, ACM Press (2007), 159--162. Google ScholarDigital Library
- Cholewiak, R.W., Collins A.A., The generation of vibrotactile patterns on a linear array: Influences of body site, time, and presentation mode. Perception & Psychophysics 62, 6 (2000), 1220--1235.Google ScholarCross Ref
- Englekamp, J. & Zimmer, H. D. Memory for action events: A new field of research. Psychological Research 51, 4 (1989), 153--157.Google Scholar
- Enriquez, M., Maclean, K.E. & Chita, C. Haptic Phonemes: Basic building blocks of haptic communication. In Proc. of the 8th International Conference on Multimodal Interfaces, ACM Press (2006), 302--309. Google ScholarDigital Library
- Geldard, F. A. Adventures in tactile literacy. The American Psychologist 12 (1957), 115--124.Google ScholarCross Ref
- Geldard, F.A. & Sherrick, C.E. The Cutaneous "Rabbit": A Perceptual Illusion, Science 178 (1972), 178--179.Google Scholar
- Heibeck, F., Hope, A. & Legault, J. Sensory Fiction MAS S65 Science Fiction to Science Fabrication (2013). Retrieved from http://scifi2scifab.media.mit.edu/ 2013/12/19/sensory-fiction/.Google Scholar
- Israr, A., & Poupyrev, I. Tactile brush: drawing on skin with a tactile grid display. In Proc. of CHI 2011. ACM Press (2011), 2019--2028. Google ScholarDigital Library
- Israr, A. and Poupyrev, I. Control Space of apparent haptic motion. In Proc. of World Haptics Conference, IEEE (2011), 457--462.Google ScholarCross Ref
- Israr, A., Zhao, S., Schwalje, K., Klatzky, R. L. & Lehman, J. Feel Effects: Enriching storytelling with haptic feedback. ACM Transactions on Applied Perception 11, 3 (2014), Article 11. Google ScholarDigital Library
- Jones, M. G., Bokinsky, A., Tretter, T., & Negishi, A. A comparison of learning with haptic and visual modalities. Haptics-e: Electronic J. Haptics Res 4, (2005).Google Scholar
- Kirman, J.H. Tactile apparent movement: The effects of inter stimulus onset interval and stimulus duration. Perception and Psychophysics 15, 1 (1974), 1--6.Google ScholarCross Ref
- Lee, J., Kim, Y. & Kim, G. Funneling and saltation effects for tactile interaction with virtual objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), ACM Press (2012), 3141--3148. Google ScholarDigital Library
- Lévesque, V., Oram, L., MacLean, K., Cockburn, A., Marchuk, N.D., Johnson, D., Colgate, J.E. and Peshkin, M.A. Enhancing physicality in touch interaction with programmable friction. In Proc. CHI 2011, ACM (2011), 2481--2490. Google ScholarDigital Library
- Luk, J., Pasquero, J., Little, S., MacLean, K., Levesque, V. & Hayward, V. A role for haptics in mobile interaction: initial design using a handheld tactile display prototype. In Proc. of CHI 2006, ACM Press (2006), 171--180. Google ScholarDigital Library
- Phillips, L. The Role of Storytelling in Early Literacy Development (1999). http://www.home.aone.net.au/stories/doc/childhd.htmGoogle Scholar
- Pike, M. M., Barnes, M. A., & Barron, R.W. The role of illustrations in children's inferential comprehension. Journal of Experimental Child Psychology 105, 3 (2010), 243--255.Google ScholarCross Ref
- Poupyrev, I. and Maruyama, S., Tactile Interfaces for Small Touch Screens. In Proc. of UIST 2003, ACM Press (2003), 217--220. Google ScholarDigital Library
- Rayner, K., Foorman, B.R., Perfetti, C. A., Pesetsky, D., & Seidenberg, M. S. (2001). How psychological science informs the teaching of reading. Psychological Science in the Public Interest 2, 2 (2002), 31--74.Google Scholar
- Ricci, C. M. & Beal, C. R. The effect of interactive media on children's story memory. Journal of Educational Psychology 94, 1 (2002), 138--144.Google ScholarCross Ref
- Ryokai, K., & Cassell, J. StoryMat: a play space for collaborative storytelling. Ext. Abstracts CHI 1999, ACM Press (1999), 272--273. Google ScholarDigital Library
- Seo, J., & Choi, S. Initial study for creating linearly moving vibrotactile sensation on mobile device. In Proc. Haptics Symposium, IEEE (2010), 67--70. Google ScholarDigital Library
- Sherrick, C.E. and R. Rogers, Apparent Haptic Movement. Perception and Psychophysics 1, 3 (1966), 175--180.Google ScholarCross Ref
- Tanenbaum, J., Tanenbaum, K., & Antle, A. The Reading Glove: designing interactions for object-based tangible storytelling. In Proc.1st Augmented Human International Conference, ACM Press (2010), 19. Google ScholarDigital Library
- Ternes, D., & Maclean, K. E. Designing large sets of haptic icons with rhythm. In Haptics: Perception, Devices and Scenarios, Springer Berlin Heidelberg (2008), 199--208. Google ScholarDigital Library
- Yang, G. H., Jin, M. S., Jin, Y. & Kang, S. T-mobile: Vibrotactile display pad spatial and directional information for hand-held device. In Proc. Intelligent Robots and Systems (IROS), IEEE (2010), 5245--5250.Google Scholar
- Yannier, N., Basdogan, C., Tasiran, S. & Sen, O. L. Using haptics to convey cause-and-effect relations in climate visualization. IEEE Transactions on Haptics 1, 2 (2008), 130--141. Google ScholarDigital Library
- Zhao, S. Feeling Stories: Enriching Story Listening Experience for Children with Haptic Feedback. Unpublished senior honors thesis, Carnegie Mellon University Dept. of Psychology (2014).Google Scholar
- Zhou, Z., Cheok, A. D., Pan, J. & Li, Y. Magic Story Cube: An interactive tangible interface for storytelling. In Proc. of CHI 2004. ACM Press (2004). 364--365. Google ScholarDigital Library
Index Terms
- FeelSleeve: Haptic Feedback to Enhance Early Reading
Recommendations
Feel Effects: Enriching Storytelling with Haptic Feedback
Special Issue SAP 2014Despite a long history of use in communication, haptic feedback is a relatively new addition to the toolbox of special effects. Unlike artists who use sound or vision, haptic designers cannot simply access libraries of effects that map cleanly to media ...
Using haptic inputs to enrich story listening for young children
IDC '15: Proceedings of the 14th International Conference on Interaction Design and ChildrenResearch on children's cognitive development has demonstrated the positive effects of listening to stories. However, traditional story listening is losing its appeal to other entertainment technology such as video games. Hence, there is growing interest ...
FeelCraft: crafting tactile experiences for media using a feel effect library
UIST '14 Adjunct: Adjunct Proceedings of the 27th Annual ACM Symposium on User Interface Software and TechnologyFeelCraft is a media plugin that monitors events and states in the media and associates them with expressive tactile content using a library of feel effects (FEs). A feel effect (FE) is a user-defined haptic pattern that, by virtue of its connection to ...
Comments