skip to main content
10.1145/3197768.3201545acmotherconferencesArticle/Chapter ViewAbstractPublication PagespetraConference Proceedingsconference-collections
short-paper

v-CAT: A Cyberlearning Framework for Personalized Cognitive Skill Assessment and Training

Published: 26 June 2018 Publication History

Abstract

Recent research has shown that hundreds of millions of workers worldwide may lose their jobs to robots and automation by 2030, impacting over 40 developed and emerging countries and affecting more than 800 types of jobs. While automation promises to increase productivity and relieve workers from tedious or heavy-duty tasks, it can also widen the gap, leaving behind workers who lack automation training. In this project, we propose to build a technologically based, personalized vocational cyberlearning training system, where the user is assessed while immersed in a simulated workplace/factory task environment, and the system collecting and analyzing multisensory cognitive, behavioral and physiological data. Such a system, will produce recommendations to support targeted vocational training decision-making. The focus is on collecting and analyzing specific neurocognitive functions that include, working memory, attention, cognitive overload and cognitive flexibility. Collected data are analyzed to reveal, in iterative fashion, relationships between physiological and cognitive performance metrics, and how these relate to work-related behavioral patterns that require special vocational training.

References

[1]
Ashwin Ramesh Babu, Akilesh Rajavenkatanarayanan, Maher Abujelala, and Fillia Makedon. 2017. Votre: A vocational training and evaluation system to compare training approaches for the workplace. In International Conference on Virtual, Augmented and Mixed Reality. Springer, 203--214.
[2]
Morris D Bell, Wayne Zito, Tamasine Greig, and Bruce E Wexler. 2008. Neurocognitive enhancement therapy with vocational services: work outcomes at two-year follow-up. Schizophrenia research 105, 1 (2008), 18--29.
[3]
Christopher Collander, Joseph Tompkins, Alexandros Lioulemes, Michail Theofanidis, Ali Sharifara, and Fillia Makedon. 2017. An Interactive Robot-based Vocational Assessment Game using Lego Assembly. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 346--353.
[4]
Dylan Ebert and Fillia Makedon. 2017. MyoLearn: Using a multimodal armband sensor for vocational safety problem identification. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 248--249.
[5]
Richard C Gershon, Molly V Wagster, Hugh C Hendrie, Nathan A Fox, Karon F Cook, and Cindy J Nowinski. 2013. NIH toolbox for assessment of neurological and behavioral function. Neurology 80, 11 Supplement 3 (2013), S2-S6.
[6]
Shawn N Gieser, Caleb Gentry, James LePage, and Fillia Makedon. 2016. Comparing objective and subjective metrics between physical and virtual tasks. In International Conference on Virtual, Augmented and Mixed Reality. Springer, 3--13.
[7]
Andreas Holzinger. 2016. Interactive machine learning for health informatics: when do we need the human-in-the-loop? Brain Informatics 3, 2 (2016), 119--131.
[8]
Azfar Khalid, Pierre Kirisci, Zied Ghrairi, Jürgen Pannek, and Klaus-Dieter Thoben. 2017. Safety Requirements in Collaborative Human-Robot Cyber-Physical System. In Dynamics in Logistics. Springer, 41--51.
[9]
Séverin Lemaignan, Mathieu Warnier, E Akin Sisbot, Aurélie Clodic, and Rachid Alami. 2017. Artificial cognition for social human-robot interaction: An implementation. Artificial Intelligence 247 (2017), 45--69.
[10]
Alexandros Lioulemes, Michail Theofanidis, Varun Kanal, Konstantinos Tsiakas, Maher Abujelala, Chris Collander, William B Townsend, Angie Boisselle, and Fillia Makedon. 2017. MAGNI Dynamics: A Vision-Based Kinematic and Dynamic Upper-Limb Model for Intelligent Robotic Rehabilitation. World Academy of Science, Engineering and Technology, International Journal of Medical, Health, Biomedical, Bioengineering and Pharmaceutical Engineering 11, 4(2017), 158--167.
[11]
AR Masalimova and AS Chibakov. 2016. Experimental Analytical Model of Conditions and Quality Control of Vocational Training of Workers and Specialists. IEJME-Mathematics Education 11, 6 (2016), 1796.
[12]
Susan R McGurk, Kim T Mueser, Haiyi Xie, Karin Feldman, Yaniv Shaya, Leslie Klein, and Rosemarie Wolfe. 2016. Cognitive remediation for vocational rehabilitation nonresponders. Schizophrenia research 175, 1 (2016), 48--56.
[13]
Michalis Papakostas, Evaggelos Spyrou, Theodoros Giannakopoulos, Giorgos Siantikos, Dimitrios Sgouropoulos, Phivos Mylonas, and Fillia Makedon. 2017. Deep Visual Attributes vs. Hand-Crafted Audio Features on Multidomain Speech Emotion Recognition. Computation 5, 2 (2017), 26.
[14]
Michalis Papakostas, Konstantinos Tsiakas, Theodoros Giannakopoulos, and Fillia Makedon. 2017. Towards predicting task performance from EEG signals. 2017 IEEE International Conference on Big Data (Big Data) (2017), 4423--4425.
[15]
John ER Staddon. 2016. Adaptive behavior and learning. Cambridge University Press.
[16]
Konstantinos Tsiakas, Cheryl Abellanoza, Maher Abujelala, Michalis Papakostas, Tasnim Makada, and Fillia Makedon. {n. d.}. Towards Designing a Socially Assistive Robot for Adaptive and Personalized Cognitive Training. ({n. d.}).
[17]
Konstantinos Tsiakas, Maher Abujelala, Alexandros Lioulemes, and Fillia Makedon. 2016. An intelligent interactive learning and adaptation framework for robot-based vocational training. In Computational Intelligence (SSCI), 2016 IEEE Symposium Series on. IEEE, 1--6.
[18]
Konstantinos Tsiakas, Maria Dagioglou, Vangelis Karkaletsis, and Fillia Makedon. 2016. Adaptive robot assisted therapy using interactive reinforcement learning. In International Conference on Social Robotics. Springer, 11--21.
[19]
Xiao-Wei Wang, Dan Nie, and Bao-Liang Lu. 2014. Emotional state classification from EEG data using machine learning approach. Neurocomputing 129 (2014), 94--106.
[20]
Yun Zhou, Tao Xu, Yanping Cai, Xiaojun Wu, and Bei Dong. 2017. Monitoring Cognitive Workload in Online Videos Learning Through an EEG-Based Brain-Computer Interface. In International Conference on Learning and Collaboration Technologies. Springer, 64--73.

Cited By

View all
  • (2021)Multilevel Longitudinal Analysis of Shooting Performance as a Function of Stress and Cardiovascular ResponsesIEEE Transactions on Affective Computing10.1109/TAFFC.2020.299576912:3(648-665)Online publication date: 1-Jul-2021
  • (2020)A Review of Extended Reality (XR) Technologies for Manufacturing TrainingTechnologies10.3390/technologies80400778:4(77)Online publication date: 10-Dec-2020
  • (2019)CogBeacon: A Multi-Modal Dataset and Data-Collection Platform for Modeling Cognitive FatigueTechnologies10.3390/technologies70200467:2(46)Online publication date: 13-Jun-2019

Index Terms

  1. v-CAT: A Cyberlearning Framework for Personalized Cognitive Skill Assessment and Training

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    PETRA '18: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference
    June 2018
    591 pages
    ISBN:9781450363907
    DOI:10.1145/3197768
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • NSF: National Science Foundation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 June 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Computational Cognitive Modeling
    2. Cyberlearning
    3. User Modeling
    4. Vocational Assessment

    Qualifiers

    • Short-paper
    • Research
    • Refereed limited

    Funding Sources

    • CHS, PFI

    Conference

    PETRA '18

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)5
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 10 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)Multilevel Longitudinal Analysis of Shooting Performance as a Function of Stress and Cardiovascular ResponsesIEEE Transactions on Affective Computing10.1109/TAFFC.2020.299576912:3(648-665)Online publication date: 1-Jul-2021
    • (2020)A Review of Extended Reality (XR) Technologies for Manufacturing TrainingTechnologies10.3390/technologies80400778:4(77)Online publication date: 10-Dec-2020
    • (2019)CogBeacon: A Multi-Modal Dataset and Data-Collection Platform for Modeling Cognitive FatigueTechnologies10.3390/technologies70200467:2(46)Online publication date: 13-Jun-2019

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media