skip to main content
research-article

Sensei: Sensing Educational Interaction

Published:08 January 2018Publication History
Skip Abstract Section

Abstract

We present Sensei, the first system designed to understand social interaction and learning in an early-childhood classroom using a distributed sensor network. Our unobtrusive sensors measure proximity between each node in a dynamic range-based mesh network. The sensors can be worn in the shoes, attached to selected landmarks in the classroom, and placed on Montessori materials. This data, accessible to teachers in a web dashboard, enables teachers to derive deeper insights from their classrooms. Sensei is currently deployed in three Montessori schools and we have evaluated the effectiveness of the system with teachers. Our user studies have shown that the system enhances teachers' capabilities and helps discover insights that would have otherwise been lost. From our evaluation interviews, we have established three major use cases of the system. Sensei augments teachers' manual observations, helps them plan individualized curriculum for each student, and identifies their needs for more interaction with some children. Further, the anonymized data can be used in large-scale research in early childhood development.

Skip Supplemental Material Section

Supplemental Material

References

  1. Pulkit Agrawal, Ross Girshick, and Jitendra Malik. 2014. Analyzing the performance of multilayer neural networks for object recognition. In Computer Vision--ECCV 2014. Springer, 329--344. Google ScholarGoogle ScholarCross RefCross Ref
  2. Afsaneh Asaei, Mohammad Javad Taghizadeh, Marjan Bahrololum, and Mohammed Ghanbari. 2009. Verified speaker localization utilizing voicing level in split-bands. Signal Processing 89, 6 (2009), 1038--1049. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Alain Barrat, Ciro Cattuto, Vittoria Colizza, Jean-FranÃğois Pinton, Wouter Van den Broeck, and Alessandro Vespignani. 2008. High Resolution Dynamical Mapping of Social Interactions With Active RFID. ArXiv e-prints (Nov. 2008). arXiv:cs.CY/0811.4170Google ScholarGoogle Scholar
  4. Horesh Ben Shitrit, Jérôme Berclaz, François Fleuret, and Pascal Fua. 2014. Multi-commodity network flow for tracking multiple people. Pattern Analysis and Machine Intelligence, IEEE Transactions on 36, 8 (2014), 1614--1627.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Paulo Blikstein. 2013. Multimodal learning analytics. In Proceedings of the third international conference on learning analytics and knowledge. ACM, 102--106. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77--101. Google ScholarGoogle ScholarCross RefCross Ref
  7. Mingming Chen, Konstantin Kuzmin, and Boleslaw K Szymanski. 2014. Community detection via maximization of modularity and its variants. IEEE Transactions on Computational Social Systems 1, 1 (2014), 46--65. Google ScholarGoogle ScholarCross RefCross Ref
  8. RF Digital Corp. 2015. Simblee nRF51 Module. (2015). https://www.simblee.com/ Accessed: 2017-08-15.Google ScholarGoogle Scholar
  9. Judy Dunn. 1996. The Emanuel Miller Memorial Lecture 1995 children's relationships: Bridging the divide between cognitive and social development. Journal of Child Psychology and Psychiatry 37, 5 (1996), 507--518. Google ScholarGoogle ScholarCross RefCross Ref
  10. Paul Epstein. 2012. An Observer's Notebook: Learning from Children with the Observation CORE. Montessori Foundation.Google ScholarGoogle Scholar
  11. Matthew S Gast. 2014. Building applications with IBeacon: proximity and location services with bluetooth low energy. “O'Reilly Media, Inc.”.Google ScholarGoogle Scholar
  12. Taher Haveliwala, Sepandar Kamvar, and Glen Jeh. 2003. An analytical comparison of approaches to personalizing pagerank. (2003).Google ScholarGoogle Scholar
  13. Thomas Hofmann. 1999. Probabilistic latent semantic indexing. In Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval. ACM, 50--57. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Kourosh Khoshelham and Sander Oude Elberink. 2012. Accuracy and resolution of kinect depth data for indoor mapping applications. Sensors 12, 2 (2012), 1437--1454. Google ScholarGoogle ScholarCross RefCross Ref
  15. O Kosch, F Thiel, B Ittermann, and F Seifert. [n. d.]. Non-contact cardiac gating with ultra-wideband radar sensors for high field MRI.Google ScholarGoogle Scholar
  16. Suren Kumar, Tim Marks, and Michael Jones. 2014. Improving person tracking using an inexpensive thermal infrared sensor. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 217--224. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Janire Larranaga, Leire Muguira, Juan-Manuel Lopez-Garde, and Juan-Ignacio Vazquez. 2010. An environment adaptive ZigBee-based indoor positioning algorithm. In Indoor Positioning and Indoor Navigation (IPIN), 2010 International Conference on. IEEE, 1--8. Google ScholarGoogle ScholarCross RefCross Ref
  18. Philip Levis, Neil Patel, David Culler, and Scott Shenker. [n. d.]. Trickle: A self-regulating algorithm for code propagation and maintenance in wireless sensor networks.Google ScholarGoogle Scholar
  19. A.S. Lillard. 2005. Montessori: The Science Behind the Genius. Oxford University Press. https://books.google.com/books?id=M4wQco6cEBoCGoogle ScholarGoogle Scholar
  20. Angeline Lillard and Nicole Else-Quest. 2006. Evaluating montessori education. SCIENCE 311, 5795 (2006), 1893.Google ScholarGoogle Scholar
  21. Angeline S Lillard, ON Saracho, and B Spodek. 1998. Playing with a theory of mind. Multiple perspectives on play in early childhood education (1998), 11--33.Google ScholarGoogle Scholar
  22. Claudio Martella, Matthew Dobson, Aart Van Halteren, and Maarten Van Steen. 2014. From proximity sensing to spatio-temporal social graphs. In Pervasive Computing and Communications (PerCom), 2014 IEEE International Conference on. IEEE, 78--87. Google ScholarGoogle ScholarCross RefCross Ref
  23. Rossana Mastrandrea, Julie Fournet, and Alain Barrat. 2015. Contact Patterns in a High School: A Comparison between Data Collected Using Wearable Sensors, Contact Diaries and Friendship Surveys. PLoS ONE 10 (09 2015).Google ScholarGoogle Scholar
  24. Maria Montessori. 2013. The montessori method. Transaction Publishers.Google ScholarGoogle Scholar
  25. Daniel Olguín-Olguín and Alex Pentland. 2010. Sensor-based organisational design and engineering. International Journal of Organisational Design and Engineering 1, 1--2 (2010), 69--97.Google ScholarGoogle Scholar
  26. Lawrence Page, Sergey Brin, Rajeev Motwani, and Terry Winograd. 1999. The PageRank citation ranking: bringing order to the web. (1999).Google ScholarGoogle Scholar
  27. Jing Peng, Ming Zhu, and Kefei Zhang. [n. d.]. New algorithms based on sigma point Kalman filter technique for multi-sensor integrated RFID indoor/outdoor positioning.Google ScholarGoogle Scholar
  28. Deborah A Phillips, Jack P Shonkoff, et al. 2000. From Neurons to Neighborhoods:: The Science of Early Childhood Development. National Academies Press.Google ScholarGoogle Scholar
  29. L. R. Rabiner. 1989. A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77, 2 (Feb 1989), 257--286. https://doi.org/10.1109/5.18626 Google ScholarGoogle ScholarCross RefCross Ref
  30. Nordic Semiconductor. 2014. nRF OpenMesh Library. (2014). https://github.com/NordicSemiconductor/nRF51-ble-bcast-mesh. Accessed:2017-08-15.Google ScholarGoogle Scholar
  31. Juliette Stehlé, Nicolas Voirin, Alain Barrat, Ciro Cattuto, Lorenzo Isella, Jean-François Pinton, Marco Quaggiotto, Wouter Van den Broeck, Corinne Régis, Bruno Lina, et al. 2011. High-resolution measurements of face-to-face contact patterns in a primary school. PloS one 6, 8 (2011), e23176.Google ScholarGoogle ScholarCross RefCross Ref
  32. Arkadiusz Stopczynski, Vedran Sekara, Piotr Sapiezynski, Andrea Cuttone, Mette My Madsen, Jakob Eg Larsen, and Sune Lehmann. 2014. Measuring large-scale social networks with high resolution. PloS one 9, 4 (2014), e95978.Google ScholarGoogle ScholarCross RefCross Ref
  33. P Bruce Uhrmacher. 1995. Uncommon schooling: A historical look at Rudolf Steiner, anthroposophy, and Waldorf education. Curriculum Inquiry 25, 4 (1995), 381--406. Google ScholarGoogle ScholarCross RefCross Ref
  34. Julianne Wurm. 2005. Working in the Reggio way: A beginner's guide for American teachers. Redleaf Press.Google ScholarGoogle Scholar
  35. Po Yang, Wenyan Wu, Mansour Moniri, and Claude C Chibelushi. 2013. Efficient object localization using sparsely distributed passive RFID tags. IEEE transactions on industrial electronics 60, 12 (2013), 5914--5924. Google ScholarGoogle ScholarCross RefCross Ref
  36. Shu-Hui Yang and Pao-Ann Hsiung. 2010. Innovative application of RFID systems to special education schools. In Networking, Architecture and Storage (NAS), 2010 IEEE Fifth International Conference on. IEEE, 299--304. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Piero Zappi, Elisabetta Farella, and Luca Benini. 2010. Tracking motion direction and distance with pyroelectric IR sensors. Sensors Journal, IEEE 10, 9 (2010), 1486--1494. Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Sensei: Sensing Educational Interaction

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
          Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 1, Issue 4
          December 2017
          1298 pages
          EISSN:2474-9567
          DOI:10.1145/3178157
          Issue’s Table of Contents

          Copyright © 2018 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 8 January 2018
          • Accepted: 1 October 2017
          • Revised: 1 August 2017
          • Received: 1 February 2017
          Published in imwut Volume 1, Issue 4

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader