Quentin Bonnard
ABSTRACT
Paper interfaces merge the advantages of the digital and physical world. They can be created using normal paper augmented by a camera+projector system. They are particularly promising for applications in education, because paper is already fully integrated in the classroom, and computers can augment them with a dynamic display. However, people mostly use paper as a document, and rarely for its characteristics as a physical body. In this article, we show how the tangible nature of paper can be used to extract information about the learning activity. We present an augmented reality activity for pupils in primary schools to explore the classification of quadrilaterals based on sheets, cards, and cardboard shapes. We present a preliminary study and an in-situ, controlled study, making use of this activity. From the detected positions of the various interface elements, we show how to extract indicators about problem solving, hesitation, difficulty levels of the exercises, and the division of labor among the groups of pupils. Finally, we discuss how such indicators can be used, and how other interfaces can be designed to extract different indicators.
Supplemental Material
- Bonnard, Q., Verma, H., Kaplan, F., and Dillenbourg, P. Paper interfaces for learning geometry. In 7th European Conference on Technology Enhanced Learning (2012). Google Scholar
Digital Library
- Costanza, E., Giaccone, M., Kueng, O., Shelley, S., and Huang, J. Tangible interfaces for download: initial observations from users' everyday environments. In CHI '10 (2010). Google ScholarDigital Library
- Cuendet, S., Bonnard, Q., Kaplan, F., and Dillenbourg, P. Paper interface design for classroom orchestration. In CHI '11 (2011). Google ScholarDigital Library
- Cuendet, S., Jermann, P., and Dillenbourg, P. Tangible interfaces: when physical-virtual coupling may be detrimental to learning. In BCS '12 Proc. of the 25th BCS Interaction Specialist Group Conference (2012). Google ScholarDigital Library
- Dillenbourg, P., and Jermann, P. Technology for classroom orchestration. New Science of Learning: Cognition, Computers and Collaboration in Education (2010).Google Scholar
- Dimitrakopoulou, A., Bollen, L., Dimitriadis, Y., Harrer, A., Jermann, P., Kollias, V., Marcos, J. A., Martínez, A., and Petrou, A. State of the art of interaction analysis for metacognitive support & diagnosis, 2006.Google Scholar
- Do-Lenh, S., Kaplan, F., and Dillenbourg, P. Paper-based concept map: the effects of tabletop on an expressive collaborative learning task. BCS-HCI '09 (2009). Google ScholarDigital Library
- Fishkin, K. P. A taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous Computing 8, 5 (2004). Google ScholarDigital Library
- García, R. R., Quirós, J. S., Santos, R. G., González, S. M., and Fernanz, S. M. Interactive multimedia animation with macromedia flash in descriptive geometry teaching. Computers & Education 49, 3 (2007). Google ScholarDigital Library
- Hornecker, E., and Buur, J. Getting a grip on tangible interaction: a framework on physical space and social interaction. In CHI '06 (2006). Google ScholarDigital Library
- Jermann, P., Zufferey, G., Schneider, B., Lucci, A., Lépine, S., and Dillenbourg, P. Physical space and division of labor around a tabletop tangible simulation. In CSCL '09 (2009). Google ScholarDigital Library
- Kortenkamp, U., and Dohrmann, C. User interface design for dynamic geometry software. Acta Didactica Napocensia 3 (2010).Google Scholar
- Laborde, C., Keitel, and Ruthven, K. The computer as part of the learning environment: the case of geometry. In Learning from computers:Mathematics education and technology. Springer-Verlag, 1993.Google ScholarCross Ref
- Martin-Gutiérrez, J., Luis Saorin, J., Contero, M., A., M., Pérez-López, D. C., and Ortega, M. Design and validation of an augmented book for spatial abilities development in engineering students. Computers & Graphics 34, 1 (2010). Google ScholarDigital Library
- Oviatt, S., Arthur, A., and Cohen, J. Quiet interfaces that help students think. In UIST '06 (2006). Google ScholarDigital Library
- Perlman, R. Using computer technology to provide a creative learning environment for preschool children. Tech. rep., M.I.T., 1976.Google Scholar
- Pietrzak, T., Malacria, S., Tabard, A., and Lecolinet, E. What do u-note? an augmented note taking system for the classroom. In PaperComp 2010: 1st International Workshop on Paper Computing. Workshop at Ubicomp 2010 (2010).Google Scholar
- Sellen, A. J., and Harper, R. The Myth of the Paperless Office. MIT Press, Cambridge, MA, USA, 2003. Google ScholarDigital Library
- Soller, A., Martínez, A., Jermann, P., and Muehlenbrock, M. From mirroring to guiding: A review of state of the art technology for supporting collaborative learning. International Journal of Artificial Intelligence in Education 15, 4 (2005). Google ScholarDigital Library
- Song, H., Guimbretière, F., Ambrose, M., and Lostritto, C. CubeExplorer: an evaluation of interaction techniques in architectural education. In INTERACT '07 (2007). Google ScholarDigital Library
- Steimle, J., Brdiczka, O., and Muhlhauser, M. CoScribe: integrating paper and digital documents for collaborative knowledge work. IEEE Transactions on Learning Technologies 2 (2009). Google ScholarDigital Library
- Straesser, R. Cabri-géomètre: Does dynamic geometry software (DGS) change geometry and its teaching and learning? International Journal of Computers for Mathematical Learning 6, 3 (2002).Google Scholar
- Wellner, P. Interacting with paper on the DigitalDesk. Communications of the ACM 36, 7 (1993). Google ScholarDigital Library
- Zufferey, G. The Complementarity of Tangible and Paper Interfaces in Tabletop Environments for Collaborative Learning. PhD thesis, 2010.Google Scholar
Index Terms
- Tangible paper interfaces: interpreting pupils' manipulations
Recommendations
Designing pen-and-paper user interfaces for interaction with documents
TEI '09: Proceedings of the 3rd International Conference on Tangible and Embedded InteractionDespite numerous predictions of the paperless office, knowledge work is still characterized by the combined use of paper and digital documents. Digital pen-and-paper user interfaces bridge the gap between both worlds by electronically capturing the ...
Tangible Interfaces: An Analysis of User Experience Using the AR Sandbox Project
IHC '17: Proceedings of the XVI Brazilian Symposium on Human Factors in Computing SystemsThe desire to make the human-computer interaction more natural, and the limitation between real and virtual became practically imperceptible, resulted in the development of Tangible Interfaces (TUI). In TUI physical objects are interpreted by the system ...
The hold-and-move gesture for multi-touch interfaces
MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and servicesWe present the two-finger gesture hold-and-move as an alternative to the disruptive long-tap which utilizes dwell times for switching from panning to object dragging mode in touch interfaces. We make use of a second finger for object selection and ...
Comments