skip to main content
10.1145/3573381.3596475acmconferencesArticle/Chapter ViewAbstractPublication PagesimxConference Proceedingsconference-collections
Work in Progress

Designing an Assistance Tool for Analyzing and Modeling Trainer Activity in Professional Training Through Simulation

Published: 29 August 2023 Publication History

Abstract

Human audience analysis is crucial in numerous domains to understand people’s behavior based on their knowledge and environment. In this paper we focus on simulation-based training which has become a popular teaching approach that requires a trainer able to manage a lot of data at the same time. We present tools that are currently being developed to help trainers from two different fields: training for practical teaching gestures and training in civil defense. In this sense, three technological blocks are built to collect and analyze data about trainers’ and learners’ gestures, gaze, speech and movements. The paper also discusses the future work planned for this project, including the integration of the framework into the Noldus system and its use in civil security training. Overall, the article highlights the potential of technology to improve simulation-based training and provides a roadmap for future development.

References

[1]
Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, 2016. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467 (2016).
[2]
Kemeng Bai, Jianzhong Wang, Hongfeng Wang, and Xinlin Chen. 2022. A Study of Eye-Tracking Gaze Point Classification and Application Based on Conditional Random Field. Applied Sciences 12, 13 (2022). https://doi.org/10.3390/app12136462
[3]
Noldus Information Technology BV. 2023. MediaRecorder: Synchronous Recording of Video and Other Sources. Retrieved March, 2023 from https://www.noldus.com/mediarecorder-human
[4]
Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2017. Realtime multi-person 2d pose estimation using part affinity fields. In Proceedings of the IEEE conference on computer vision and pattern recognition. 7291–7299.
[5]
Yohann Cardin. 2016. L’analyse de l’activité comme préalable à la conception d’un environnement virtuel de formation. Le cas d’une formation à la gestion d’incendies en milieu urbain chez les sapeurs-pompiers. Ph. D. Dissertation. UBO. https://www.hal.inserm.fr/UNIV-UBS/tel-01278346v1
[6]
MMPose Contributors. 2020. OpenMMLab Pose Estimation Toolbox and Benchmark. https://github.com/open-mmlab/mmpose.
[7]
Rose B. CUI Device. 2019. An Introduction to MEMS Microphone Arrays | CUI Devices. Retrieved March, 2023 from https://www.cuidevices.com/blog/an-introduction-to-mems-microphone-arrays
[8]
Hélio Clemente Cuve, Jelka Stojanov, Xavier Roberts-Gaal, Caroline Catmur, and Geoffrey Bird. 2022. Validation of Gazepoint low-cost eye-tracking and psychophysiology bundle. Behavior research methods 54, 2 (2022), 1027–1049. https://doi.org/10.3758/s13428-021-01654-x
[9]
Tilman Dingler, Markus Funk, and Florian Alt. 2015. Interaction Proxemics: Combining Physical Spaces for Seamless Gesture Interaction(PerDis ’15). Association for Computing Machinery, New York, NY, USA, 107–114. https://doi.org/10.1145/2757710.2757722
[10]
Laurie-Anna Dubois. 2017. Apport de l’ergonomie à la formation professionnelle par la simulation: de l’analyse croisée de l’activité de formateurs, de mentors et d’aspirants-policiers à l’amélioration d’un dispositif de formation initiale. Ph. D. Dissertation. Université de Mons (UMONS). https://hal.archives-ouvertes.fr/tel-01714061/
[11]
Viviane Guéraud, Jean-Philippe Pernin, Jean-michel Cagnat, and Gloria Cortès. 1999. Environnements d’apprentissage basés sur la simulation. Outils auteur et expérimentations.Sciences et Technologies de l’Information et de la Communication pour l’Éducation et la Formation 6, 1 (1999), 95–141. https://doi.org/10.3406/stice.1999.1420
[12]
Edward T Hall. 1963. A system for the notation of proxemic behavior. American anthropologist 65, 5 (1963), 1003–1026. https://www.jstor.org/stable/668580
[13]
Marc Labrucherie. 2011. Le pilotage des avions de ligne. In Ph. Alekhine & N. Pehuet (Eds.),. Améliorer la pratique professionnelle par la simulation (2011), 9–36.
[14]
Pupil Labs. 2023. Invisible Glasses. Retrieved March, 2023 from https://pupil-labs.com/products/invisible/
[15]
Matei Mancas, Vincent P Ferrera, Nicolas Riche, and John G Taylor. 2016. From Human Attention to Computational Attention. Vol. 2. Springer. https://doi.org/10.1007/978-1-4939-3435-5
[16]
Allison A Murphy and Louis P Halamek. 2005. Educational Perspectives: Simulation-based training in neonatal resuscitation. NeoReviews 6, 11 (2005), e489–e492. https://doi.org/10.1542/neo.6-11-e489
[17]
Apoorv Nandan and Jithendra Vepa. 2020. Language agnostic speech embeddings for emotion classification. In ICML 2020 Workshop on Self-supervision in Audio and Speech. https://slideslive.com/38930739/language-agnostic-speech-embeddings-for-emotion-classification
[18]
OpenCV. 2021. OpenCV AI Kit: OAK—D. Retrieved March, 2023 from https://store.opencv.ai/products/oak-d
[19]
Pierre Pastré. 2006. Apprendre à faire. Apprendre et faire apprendre (2006), 109–121.
[20]
Rupert Reyneke. 2019. Improving interactive user experience with microinteractions: An application of biometric and affect detection systems on landing pages. Ph. D. Dissertation. Harvard University. https://www.proquest.com/openview/436114f1112f50de9be428b7c42d67f0/1?pq-origsite=gscholar&cbl=18750&diss=y
[21]
Marie-Claude Rivard, Joël Beaulieu, and Mélodie Caspani. 2009. La triade : une stratégie de supervision à redéfinir!Éducation et francophonie 37, 1 (2009), 140–158. https://doi.org/10.7202/037657ar
[22]
François Rocca, Pierre-Henri De Deken, Fabien Grisard, Matei Mancas, and Bernard Gosselin. 2015. Real-time marker-less implicit behavior tracking for user profiling in a TV context. 28th International Conference on Computer Animation and Social Agents (CASA 2015) (2015). https://hdl.handle.net/20.500.12907/41783
[23]
Katrine Roussel. 2017. Les protocoles verbaux (think-aloud protocols): enjeux méthodologiques de validité pour la recherche en contexte scolaire. Canadian Journal for New Scholars in Education/Revue canadienne des jeunes chercheures et chercheurs en éducation 8, 1 (2017), 160–167. https://journalhosting.ucalgary.ca/index.php/cjnse/article/view/30805
[24]
Estefania Salas and Janis Cannon-Bowers. 2000. The anatomy of team training. In, S. Tobias & JD Fletcher (Eds.). Training and retraining: A handbook for business, industry, government, and the military (01 2000), 312–335.
[25]
Renan Samurçay. 2005. Concevoir des situations simulées pour la formation professionnelle: une approche didactique. Toulouse : Octarès. 221–240 pages.
[26]
Stereolabs. 2021. ZED 2 - AI Stereo Camera | Stereolabs. Retrieved March, 2023 from https://www.stereolabs.com/zed-2/
[27]
Viewpoint Systems. 2023. VPS 19 Glasses. Retrieved March, 2023 from https://viewpointsystem.com/en/products/
[28]
Noé Tits, Kevin El Haddad, and Thierry Dutoit. 2018. Asr-based features for emotion recognition: A transfer learning approach. arXiv preprint arXiv:1805.09197 (2018). https://doi.org/10.48550/arXiv.1805.09197
[29]
Tobii. 2023. Tobii Pro Glasses 3. Retrieved March, 2023 from https://www.tobii.com/products/eye-trackers/wearables/tobii-pro-glasses-3.
[30]
Marc Tonsen, Chris Kay Baumann, and Kai Dierkes. 2020. A High-Level Description and Performance Evaluation of Pupil Invisible. CoRR abs/2009.00508 (2020). arXiv:2009.00508https://arxiv.org/abs/2009.00508

Cited By

View all
  • (2024)Eye tracking in a teaching context: comparative study of the professional vision of university supervisor trainers and pre-service teachers in initial training for secondary education in French-speaking BelgiumFrontiers in Education10.3389/feduc.2024.13267529Online publication date: 4-Mar-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
IMX '23: Proceedings of the 2023 ACM International Conference on Interactive Media Experiences
June 2023
465 pages
ISBN:9798400700286
DOI:10.1145/3573381
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 August 2023

Check for updates

Author Tags

  1. Activity recognition and understanding
  2. Assistance tool
  3. Eye-tracking
  4. Simulation-based training

Qualifiers

  • Work in progress
  • Research
  • Refereed limited

Conference

IMX '23

Acceptance Rates

Overall Acceptance Rate 69 of 245 submissions, 28%

Upcoming Conference

IMX '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)15
  • Downloads (Last 6 weeks)0
Reflects downloads up to 24 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Eye tracking in a teaching context: comparative study of the professional vision of university supervisor trainers and pre-service teachers in initial training for secondary education in French-speaking BelgiumFrontiers in Education10.3389/feduc.2024.13267529Online publication date: 4-Mar-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media