Jonas Moll
Skip Abstract Section
Abstract
In the study presented here, two haptic and visual applications for learning geometrical concepts in group work in primary school have been designed and evaluated. The aim was to support collaborative learning among sighted and visually impaired pupils. The first application is a static flattened 3D environment that supports learning to distinguish between angles by means of a 3D haptic device providing touch feedback. The second application is a dynamic 3D environment that supports learning of spatial geometry. The scene is a room with a box containing geometrical objects, which pupils can pick up and move around. The applications were evaluated in four schools with groups of two sighted and one visually impaired pupil. The results showed the support for the visually impaired pupil and for the collaboration to be satisfying. A shared understanding of the workspace could be achieved, as long as the virtual environment did not contain movable objects. Verbal communication was crucial for the work process but haptic guiding to some extent substituted communication about direction. When it comes to joint action between visually impaired and sighted pupils a number of interesting problems were identified when the dynamic and static virtual environments were compared. These problems require further investigation. The study extends prior work in the areas of assistive technology and multimodal communication by evaluating functions for joint haptic manipulation in the unique setting of group work in primary school.
- Bailenson, J. N. and Yee, N. 2008. Virtual interpersonal touch: Haptic interaction and copresence in collaborative virtual environments. Int. J. Multimedia Tools Appl. 37, 5--14. Google Scholar
Digital Library
- Bailenson, J. N., Yee, N., Brave, S., Merget, D., and Koslow, D. 2007. Virtual interpersonal touch: Expressing and recognizing emotions through haptic devices. Hum.-Comput. Interact. 22, 325--353. Google ScholarDigital Library
- Basdogan, C., Ho, C., Srinivasan, M. A., and Slater, M. 2000. An experimental study on the role of touch in shared virtual environments. ACM Trans. Comput.-Hum. Interact. 7, 443--460. Google ScholarDigital Library
- Benford, S., Bowers, J., Fahlén, L. E., and Greenhalgh, C. 1994. Managing mutual awareness in collaborative virtual environments. In Proceedings of the Conference on Virtual Reality Software and Technology. G. Singh, S. K. Feiner, and D. Thalmann Eds., ACM Press, New York, 223--236. Google ScholarDigital Library
- Burke, J. and Murphy, R. 2007. RSVP: An investigation of remote shared visual presence as common ground for human-robot teams. In Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction. C. Breazeal, A. C. Shultz, T. Fong, and S. B. Kiesler Eds., ACM Press, New York, 161--168. Google ScholarDigital Library
- Burke, J., Prewett, M. S., Gray, A. A., Yang, L., Stilson, F. R. B., Coovert, M. D., Elliot, L. R., and Redden, E. 2006. Comparing the effects of visual-auditory and visual-tactile feedback on user performance: A meta-analysis. In Proceedings of the 8th International Conference on Multimodal Interfaces. F. K. H. Quek, J. Yang, D. W. Massaro, A. A. Alwan, and T. J. Hazen Eds., ACM Press, New York, 108--117. Google ScholarDigital Library
- Cherubini, M., Nüssli, M.-A., and Dillenbourg, P. 2008. Deixis and gaze in collaborative work at a distance (over a shared map): A computational model to detect misunderstandings. In Proceedings of the Symposium on Eye Tracking Research & Applications. K.-J. Rääihä and A. T. Duchowski Eds., ACM Press, New York, 173--180. Google ScholarDigital Library
- Clark, H. H. 1996. Using Language. Cambridge University Press, Cambridge, UK.Google Scholar
- Clark, H. H. 2003. Pointing and placing. In Pointing: Where Language, Culture, and Cognition Meet, S. Kita Ed., Lawrence Erlbaum Associates, Mahwah, NJ, 243--268.Google Scholar
- Clark, H. H., and Brennan, S. E. 1991. Grounding in communication. In Perspectives on Socially Shared Cognition, L. Resnick, J. Levine, and S. Teasley Eds., American Psychological Association, Hyattsville, MD, 127--149.Google Scholar
- Crossan, A. and Brewster, S. 2008. Multimodal trajectory playback for teaching shape information and trajectories to visually impaired computer users. ACM Trans. Access. Comput. 1, Article 12. Google ScholarDigital Library
- Decortis, F., Rizzo, A., and Saudelli, B. 2003. Mediating effects of active and distributed instruments on narrative activities. Interact. Comput. 15, 801--830.Google ScholarCross Ref
- Donato, R. 1994. Collective scaffolding in second language learning. In Vygotskian Approaches to Second Language Research, J. P. Lantolf and G. Appel Eds., Ablex, Norwood, NJ, 33--56.Google Scholar
- Dourish, P. and Bellotti, V. 1992. Awareness and coordination in shared workspaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. P. Bauersfeld, J. Bennett, and G. Lynch Eds., ACM Press, New York, 541--547.Google Scholar
- Durlach, N. and Slater, M. 2000. Presence in shared virtual environments and virtual togetherness. J. Presence: Teleoperators Virtual Environ. 9, 214--217. Google ScholarDigital Library
- Edwards, K., Mynatt, E., and Stockton, K. 1995. Access to graphical interfaces for blind users. Interactions 2, 154--167. Google ScholarDigital Library
- Ernst, M. O., and Banks M. S. 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 6870, 429--433.Google Scholar
- Fussell, S. R., Setlock, L. D., Yang, J., Ou, J., Mauer, E. M., and Kramer, A. 2004. Gestures over video streams to support remote collaboration on physical tasks. Hum.-Comput. Interact. 19, 273--309. Google ScholarDigital Library
- Gaver, W. W., Smith, R. B., and O’Shea, T. 1991. Effective sounds in complex systems: The ARKola simulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Reaching through Technology. S. P. Robertson, G. M. Olson, and J. S. Olson Eds., ACM Press, New York, 361--367. Google ScholarDigital Library
- Gibson, J. J. 1979. The Ecological Approach to Visual Perception. Houghton Mifflin, Boston, MA.Google Scholar
- Haans, A. and IJsselstein, W. 2006. Mediated social touch: A review of current research and future directions. Virtual Reality 9, 149--159. Google ScholarDigital Library
- Ho, C., Basdogan, C., Slater, M., Durlach, N., and Srinivasan, M. A. 1998. An experiment on the influence of haptic communication on the sense of being together. In Proceedings of the British Telecom Workshop on Presence in Shared Virtual Environments. BT Labs, Cambridge.Google Scholar
- Jansson, G. 2007. Haptics as a substitute for vision. In Assistive Technology for Vision-Impaired and Blind, M. A. Hersh and M. A. Johnson Eds., Springer, 135--166.Google Scholar
- Kaptelinin, V. 1996. Computer-mediated activity: functional organs in social and developmental contexts. In Context and Consciousness, B. Nardi Ed., MIT Press, Cambridge, MA, 45--68. Google ScholarDigital Library
- Kirk, D., Rodden, T., and Fraser, D. S. 2007. Turn it this way: Grounding collaborative action with remote gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. B. Begole, S. Payne, E. Churchill, R. S. Amant, D. Gilmore, and M. B. Rosson Eds., ACM Press, New York, 1039--1048. Google ScholarDigital Library
- Kraut, R. E., Fish, R. S., Root, R. W., and Chalfonte, B. L. 1993. Informal communication in organizations: Form, function and technology. In Readings in Groupware and Computer-Supported Cooperative Work: Assisting Human-Human Collaboration, R. M. Baecker Ed., Kaufmann, San Francisco, CA, 287--314.Google Scholar
- Lantolf, J. and Thorne, S. L. 2006. Sociocultural Theory and the Genesis of Second Language Development. Oxford University Press, Oxford, UK.Google Scholar
- Lederman, S. J. and Klatzky, R. L. 2009. Haptic perception: A tutorial. Attention, Perception and Psychophysics 71, 1439--1459.Google ScholarCross Ref
- Lee, J.-H. and Spence, C. 2008. Assessing the benefits of multimodal feedback on dual-task performance under demanding conditions. In Proceedings of the 22nd British HCI Group Annual Conference. D. England and R. Beale Eds., British Computer Society, Swinton, 185--192. Google ScholarDigital Library
- Lee, S., and Kim, G. J. 2008. Effects of haptic feedback, stereoscopy, and image resolution on performance and presence in remote navigation. Int. J. Hum.-Comput. Stud. 66, 701--717. Google ScholarDigital Library
- Loomis, J. M. and Lederman, S. J. 1986. Tactual perception. In Handbook of Perception and Human Performance, K. R. Borr, L. Kaufman and J. P. Thomas Eds., Wiley/Interscience, New York, 31:31--31:41.Google Scholar
- Magnusson, C., Rassmus-Gröhn, K., and Eftring, H. 2007. Drawing and guiding gestures in a mathematical task using the AHEAD application. In Proceedings of the the 4th International Conference on Enactive Interfaces (ENACTIVE’07). Association ACROE, Grenoble, 157--161.Google Scholar
- Malone, T. and Crowston, K. 1990. What is coordination theory and how can it help design cooperative work systems? In Proceedings of the ACM Conference on Computer-Supported Cooperative Work. F. Halasz Ed., ACM Press, New York, 357--370. Google ScholarDigital Library
- McCarthy, J., Miles, V., and Monk, A. 1991. An experimental study of common ground in text-based communication. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Reaching through Technology. S. P. Robertson, G. M. Olson, and J. S. Olson Eds., ACM Press, New York, 209--215. Google ScholarDigital Library
- McGookin, D. and Brewster, S. 2007. An initial investigation into non-visual computer supported collaboration. In Proceedings of the Conference on Human Factors in Computing Systems (CHI’07): Extended Abstracts. M. B. Rosson and D. J. Gilmore Eds., ACM Press, New York, 2573--2578. Google ScholarDigital Library
- Moll, J. and Sallnäs, E-L. 2009. Communicative functions of haptic feedback. In Proceedings of the 4th International Conference on Haptic and Audio Interaction Design. M. E. Altinsoy, U. Jekosch, and S. Brewster Eds., Lecture Notes in Computer Science, vol. 5763, Springer, 1--10. Google ScholarDigital Library
- Mynatt, E. and Weber, G. 1994. Nonvisual presentation of graphical user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Celebrating Interdependence. B. Adelson, S. Dumais, and J. S. Olson Eds., ACM Press, New York, 166--172. Google ScholarDigital Library
- Nam, C. S., Shu, J., and Chung, D. 2008. The roles of sensory modalities in collaborative virtual environments (CVEs). Comput. Human Behavior 24, 1404--1417. Google ScholarDigital Library
- Neale, D., Carroll, J., and Rosson, M. B. 2004. Evaluating computer-supported cooperative work: Models and frameworks. In Proceedings of the ACM Conference on Computer Supported Cooperative Work. J. B. Smith, F. D. Smith, and T. W. Malone Eds., ACM Press, New York, 112--121. Google ScholarDigital Library
- Oakley, I., Brewster, S., and Gray, P. 2001. Can you feel the force? An investigation of haptic collaboration in shared editors. In Proceedings of Eurohaptics 2001. C. Baber, M. Faint, S. Wall, and A. M. Wing Eds., Springer, 54--59.Google Scholar
- Otaduy, M. and Lin, M. 2005. Introduction to haptic rendering. In Proceedings of SIGGRAPH 2005: SIGGRAPH Courses. J. Fujii Ed., ACM Press, New York, A3--A33. Google ScholarDigital Library
- Ou, J., Fussell, S. R., Chen, X., Setlock, L. D., and Yang, J. 2003. Gestural communication over video stream: Supporting multimodal interaction for remote collaborative physical tasks. In Proceedings of the 5th International Conference on Multimodal Interfaces. S. L. Oviatt, T. Darrell, M. T. Maybury, and W Wahlster Eds., ACM Press, New York, 107--114. Google ScholarDigital Library
- Plimmer, B., Crossan, A., Brewster, S., and Blagojevic, R. 2008. Multimodal collaborative handwriting training for visually-impaired people. In Proceedings of the 26th Annual SIGCHI Conference on Human Factors in Computing Systems. M. Czerwinski, A. M. Lund, and D. S. Tan Eds., ACM Press, New York, 393--402. Google ScholarDigital Library
- Rassmus-Gröhn, K. 2008. User centered design of non-visual audio-haptics. Doctoral dissertation, Lund University, Lund.Google Scholar
- Rassmus-Gröhn, K., Magnusson, C., and Eftring, H. 2007. Iterative design of an audio-haptic drawing application. In Proceedings of the Conference on Human Factors in Computing Systems (CHI’07): Extended Abstracts. ACM Press, New York, 2627--2632. Google ScholarDigital Library
- Roschelle, J. and Teasley, S. 1995. The construction of shared knowledge in collaborative problem solving. In Computer-Supported Collaborative Learning. C. O’Malley Ed., Springer, 69--197.Google Scholar
- Säljö, R. 2000. Lärande i Praktiken -- ett Sociokulturellt Perspektiv. {Learning put in Practice - a Socio Cultural Perspective}. Bokförlaget Prisma, Stockholm, Sweden.Google Scholar
- Sallnäs, E.-L. 2004. The effects of modality on social presence, presence and performance in collaborative virtual environments. Doctoral Dissertation, Royal Institute of Technology, Stockholm.Google Scholar
- Sallnäs, E.-L., Rassmus-Gröhn, K., and Sjöström, C. 2000. Supporting presence in collaborative environments by haptic force eedback. ACM Trans. Comput.-Hum. Interact. 7, 461--476. Google ScholarDigital Library
- Sallnäs, E.-L., Crossan, A., Archambault, D., Tuominen, E., and Stoeger, B. 2005. Report on development of collaborative tools: User requirements study and design of collaboration support. Tech. rep. IST-2003-511592 STP, Royal Institute of Technology.Google Scholar
- Sallnäs, E.-L., Bjerstedt-Blom, K., Winberg, F., and Severinson-Eklundh, K. 2006. Navigation and control in haptic applications shared by blind and sighted users. In Proceedings of the 1st International Workshop on Haptic and Audio Interaction Design. D. McGookin and S. Brewster Eds., Lecture Notes in Computer Science, vol. 4129, Springer, 68--80. Google ScholarDigital Library
- Sallnäs, E.-L., Moll, J., and Severinson-Eklundh, K. 2007. Group work about geometrical concepts among blind and sighted pupils using haptic interfaces. Poster at Proceedings of World Haptics. IEEE. Google ScholarDigital Library
- Shneiderman, B. 1997. Direct manipulation for comprehensive, predictable and controllable user interfaces. In Proceedings of the 2nd International Conference on Intelligent User Interfaces. J. Moore, E. Edmonds, and A. Puerta Eds., ACM Press, New York, 33--39. Google ScholarDigital Library
- Sjöström, C. 2001. Designing haptic computer interfaces for blind people. In Proceedings of the 6th International Symposium on Signal Processing and its Applications. B. Boashash, S. H. S. Salleh, and K. Abed-Meraim Eds., University of Technology, Malaysia, 68--71.Google ScholarCross Ref
- Storch, N. 2002. Patterns of interaction in ELS pair work. Language Learning 52, 119--158.Google ScholarCross Ref
- Tanhua-Piiroinen, E., Pasto, V., Raisimo, R., and Sallnäs, E.-L. 2008. Supporting collaboration between visually impaired and sighted children in a multimodal learning environment. In Proceedings of the 3rd International Workshop on Haptic and Audio Interaction Design. A. Pirhonen and S. Brewster Eds., Lecture Notes in Computer Science, vol. 5270, Springer, 11--20. Google ScholarDigital Library
- Tibell, L., Ainsworth, S., Bivall Persson, P., and Höst, G. 2009. Haptic influences on reasoning and learning in protein education. In Proceedings of the 9th Nordic Research Symposium on Science Education. A. MacDonald Ed., University of Iceland, Reykjavik, 165--168.Google Scholar
- Vygotsky, L. S. 1978. Mind in Society: The Development of Higher Psychological Processes. Harvard University Press.Google Scholar
- Winberg, F. 2006. Supporting cross-modal collaboration: Adding a social dimension to accessibility. In Proceedings of the 1st International Workshop on Haptic and Audio Interaction Design. D. McGookin and S. Brewster Eds., Lecture Notes in Computer Science, vol. 4129, Springe, 102--110. Google ScholarDigital Library
- Winberg, F. and Bowers, J. 2004. Assembling the senses: Towards the design of co-operative interfaces for visually impaired users. In Proceedings of ACM Conference on Computer Supported Cooperative Work (CSCW’04). J. D. Herbsleb and G. M. Olson Eds., ACM Press, New York, 332--341. Google ScholarDigital Library
- Yu, W., Ramloll, R., and Brewster, S. A. 2001. Haptic graphs for blind computer users. In Haptic Human-Computer Interaction, S. A. Brewster and R. Murray-Smith Eds., Springer, 41--51. Google ScholarDigital Library
Index Terms
- A Haptic Tool for Group Work on Geometrical Concepts Engaging Blind and Sighted Pupils
Recommendations
Group Work About Geometrical Concepts Among Blind and Sighted Pupils Using Haptic Interfaces
WHC '07: Proceedings of the Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator SystemsIn the study presented in this paper two haptic and visual prototypes for learning about geometrical concepts in group work in primary school have been designed and evaluated. The aim was for the prototypes to support collaborative learning between ...
Blind Leading the Sighted: Drawing Design Insights from Blind Users towards More Productivity-oriented Voice Interfaces
Regular Papers and Special Issue on ASSETS 2018Voice-activated personal assistants (VAPAs) are becoming smaller, cheaper, and more accurate, such that they are now prevalent in homes (e.g., Amazon Echo, Sonos One) and on mobile devices (e.g., Google Assistant, Apple Siri) around the world. VAPAs ...
Navigation and control in haptic applications shared by blind and sighted users
HAID'06: Proceedings of the First international conference on Haptic and Audio Interaction DesignHaptic feedback in shared virtual environments can potentially make it easier for a visually impaired person to take part in and contribute to the process of group work. In this paper a task driven explorative evaluation is presented of collaboration ...
Comments