Sarah Masud Preum
Skip Abstract Section
Skip Supplemental Material SectionAbstract
Healthcare cognitive assistants (HCAs) are intelligent systems or agents that interact with users in a context-aware and adaptive manner to improve their health outcomes by augmenting their cognitive abilities or complementing a cognitive impairment. They assist a wide variety of users ranging from patients to their healthcare providers (e.g., general practitioner, specialist, surgeon) in several situations (e.g., remote patient monitoring, emergency response, robotic surgery). While HCAs are critical to ensure personalized, scalable, and efficient healthcare, there exists a knowledge gap in finding the emerging trends, key challenges, design guidelines, and state-of-the-art technologies suitable for developing HCAs. This survey aims to bridge this gap for researchers from multiple domains, including but not limited to cyber-physical systems, artificial intelligence, human-computer interaction, robotics, and smart health. It provides a comprehensive definition of HCAs and outlines a novel, practical categorization of existing HCAs according to their target user role and the underlying application goals. This survey summarizes and assorts existing HCAs based on their characteristic features (i.e., interactive, context-aware, and adaptive) and enabling technological aspects (i.e., sensing, actuation, control, and computation). Finally, it identifies critical research questions and design recommendations to accelerate the development of the next generation of cognitive assistants for healthcare.
Supplemental Material
Available for Download
zip
preum.zip (121.5 KB)
Supplemental movie, appendix, image and software files for, A Review of Cognitive Assistants for Healthcare: Trends, Prospects, and Future Directions
- Azizi Ab Aziz, Ali Saad Fahad, and Faudziah Ahmad. 2017. CAKNA: A personalized robot-based platform for anxiety states therapy. In Intelligent Environments (Workshops). IOS Press, 141--150.Google Scholar
- Saleh Ahmed, Mahboob Qaosar, Rizka Wakhidatus Sholikah, and Yasuhiko Morimoto. 2018. Early dementia detection through conversations to virtual personal assistant. In Proceedings of the AAAI Spring Symposium Series (AAAI’18).Google Scholar
- Dragan Ahmetovic, Cole Gleason, Chengxiong Ruan, Kris Kitani, Hironobu Takagi, and Chieko Asakawa. 2016. NavCog: A navigational cognitive assistant for the blind. In Proceedings of the 18th International Conference on Human-computer Interaction with Mobile Devices and Services. ACM, 90--99.Google ScholarDigital Library
- Rodolfo S. Antunes, Lucas A. Seewald, Vinicius F. Rodrigues, Cristiano A. Da Costa, Rodrigo R. Righi, Andreas Maier, Björn Eskofier, Malte Ollenschläger, Farzad Naderi, Rebecca Fahrig, et al. 2018. A survey of sensors in healthcare workflow monitoring. ACM Comput. Surv. 51, 2 (2018), 42.Google ScholarDigital Library
- Babylon. 2019. Babylon Talk-to-a-Doctor: Our end-to-end services enable providers to deliver flexible, accessible healthcare. Retrieved from https://www.babylonhealth.com/us/our-services/talk-to-a-doctor.Google Scholar
- Omar Badawi and Michael J. Breslow. 2012. Readmissions and death after ICU discharge: Development and validation of two predictive models. PloS One 7, 11 (2012).Google Scholar
- Shahram Bahadori, Amedeo Cesta, Giorgio Grisetti, Luca Iocchi, R. Leone, Daniele Nardi, Angelo Oddi, Federico Pecora, and Riccardo Rasconi. 2003. Robocare: An integrated robotic system for the domestic care of the elderly. In Proceedings of the Workshop on Ambient Intelligence. Citeseer.Google Scholar
- Jérémy Bauchet, Hélène Pigot, Sylvain Giroux, Dany Lussier-Desrochers, Yves Lachapelle, and Mounir Mokhtari. 2009. Designing judicious interactions for cognitive assistance: The acts of assistance approach. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 11--18.Google ScholarDigital Library
- Timothy W. Bickmore, Everlyne Kimani, Ha Trinh, Alexandra Pusateri, Michael K. Paasche-Orlow, and Jared W. Magnani. 2018. Managing chronic conditions with a smartphone-based conversational virtual agent. In Proceedings of the 18th International Conference on Intelligent Virtual Agents. 119--124.Google Scholar
- Marion Blount, Maria R. Ebling, J. Mikael Eklund, Andrew G. James, Carolyn McGregor, Nathan Percival, Kathleen P. Smith, and Daby Sow. 2010. Real-time analysis for intensive care. IEEE Eng. Med. Biol. Mag. 29, 2 (2010), 110.Google ScholarCross Ref
- Antonio Padilha Lanari Bo, Mitsuhiro Hayashibe, and Philippe Poignet. 2011. Joint angle estimation in rehabilitation with inertial sensors and its integration with Kinect. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 3479--3483.Google Scholar
- Nathalie Bricon-Souf and Conrad R. Newman. 2007. Context awareness in health care: A review. Int. J. Med. Inf. 76, 1 (2007), 2--12.Google ScholarCross Ref
- Elizabeth Broadbent, Rebecca Stafford, and Bruce MacDonald. 2009. Acceptance of healthcare robots for the older population: Review and future directions. Int. J. Social Robot. 1, 4 (2009), 319.Google ScholarCross Ref
- Manuel G. Calvo and Daniel Lundqvist. 2008. Facial expressions of emotion (KDEF): Identification under different display-duration conditions. Behav. Res. Meth. 40, 1 (2008), 109--115.Google ScholarCross Ref
- Leo Anthony Celi, Benjamin Fine, and David J. Stone. 2019. An awakening in medicine: The partnership of humanity and intelligent machines. Lancet Dig. Health 1, 6 (2019), e255–e257.Google ScholarCross Ref
- Chien-Yen Chang, Belinda Lange, Mi Zhang, Sebastian Koenig, Phil Requejo, Noom Somboon, Alexander A. Sawchuk, and Albert A. Rizzo. 2012. Towards pervasive physical rehabilitation using Microsoft Kinect. In Proceedings of the 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth’12) and Workshops. IEEE, 159--162.Google Scholar
- Yao-Jen Chang, Shu-Fang Chen, and Jun-Da Huang. 2011. A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities. Res. Dev. Disab. 32, 6 (2011), 2566--2570.Google ScholarCross Ref
- Yao-Jen Chang, Ya-Shu Kang, and Po-Chiao Huang. 2013. An augmented reality (AR)-based vocational task prompting system for people with cognitive impairments. Res. Dev. Disab. 34, 10 (2013), 3049--3056.Google ScholarCross Ref
- Irene Alice Chicchi Giglioli, Federica Pallavicini, Elisa Pedroli, Silvia Serino, and Giuseppe Riva. 2015. Augmented reality: A brand new challenge for the assessment and treatment of psychological disorders. Comput. Math. Meth. Med. 2015 (2015).Google Scholar
- Ângelo Costa, Ester Martinez-Martin, Angel P. Del Pobil, Ricardo Simoes, and Paulo Novais. 2013. Find it–An assistant home agent. In Trends in Practical Applications of Agents and Multiagent Systems. Springer, 121--128.Google Scholar
- Angelo Croatti, Sara Montagna, and Alessandro Ricci. 2017. A personal medical digital assistant agent for supporting human operators in emergency scenarios. In Agents and Multi-agent Systems for Health Care. Springer, 59--75.Google Scholar
- Angelo Croatti, Sara Montagna, Alessandro Ricci, Emiliano Gamberini, Vittorio Albarello, and Vanni Agnoletti. 2019. BDI personal medical assistant agents: The case of trauma tracking and alerting. Artif. Intell. Med. 96 (2019), 187--197.Google ScholarDigital Library
- David DeVault, Ron Artstein, Grace Benn, Teresa Dey, Ed Fast, Alesia Gainer, Kallirroi Georgila, Jon Gratch, Arno Hartholt, Margaux Lhommet, et al. 2014. SimSensei Kiosk: A virtual human interviewer for healthcare decision support. In Proceedings of the International Conference on Autonomous Agents and Multi-agent Systems. 1061--1068.Google Scholar
- NHS Digital. 2018. Overview—Laryngeal (larynx) cancer. Retrieved from https://www.nhs.uk/conditions/laryngeal-cancer/.Google Scholar
- Felipe Augusto dos Santos Mendes, José Eduardo Pompeu, Alexandra Modenesi Lobo, Keyte Guedes da Silva, Tatiana de Paula Oliveira, Andrea Peterson Zomignani, and Maria Elisa Pimentel Piemonte. 2012. Motor learning, retention and transfer after virtual-reality-based training in Parkinson’s disease-Effect of motor and cognitive demands of games: A longitudinal, controlled clinical study. Physiotherapy 98, 3 (2012), 217--223.Google ScholarCross Ref
- Joanna Ejdys and Katarzyna Halicka. 2018. Sustainable adaptation of new technology—The case of humanoids used for the care of older adults. Sustainability 10, 10 (2018), 3770.Google ScholarCross Ref
- Susan Feldman. 2000. The answer machine. Searcher 8, 1 (2000).Google Scholar
- George Ferguson, Jill Quinn, Cecilia Horwitz, M. Swift, J. Allen, and Lucian Galescu. 2010. Towards a personal health management assistant. J. Biomed. Inform. 43, 5 (2010), S13–S16.Google ScholarDigital Library
- Lorenzo Fernandez Maimo, Alberto Huertas Celdran, Angel L. Perales Gomez, García Clemente, J. Félix, James Weimer, and Insup Lee. 2019. Intelligent and dynamic ransomware spread detection and mitigation in integrated clinical environments. Sensors 19, 5 (2019), 1114.Google ScholarCross Ref
- Brian French, Divya Tyamagundlu, Daniel P. Siewiorek, Asim Smailagic, and Dan Ding. 2008. Towards a virtual coach for manual wheelchair users. In Proceedings of the 12th IEEE International Symposium on Wearable Computers. IEEE, 77--80.Google ScholarDigital Library
- Yarin Gal. 2016. Uncertainty in Deep Learning. Ph.D. Dissertation. University of Cambridge.Google Scholar
- Luciano Gamberini, Francesco Martino, Bruno Seraglia, Anna Spagnolli, Malena Fabregat, Francisco Ibanez, Mariano Alcaniz, and Javier Montesa Andrés. 2009. Eldergames project: An innovative mixed reality table-top solution to preserve cognitive functions in elderly people. In Proceedings of the 2nd Conference on Human System Interactions. IEEE, 164--169.Google ScholarCross Ref
- Asma Ghandeharioun, Daniel McDuff, Mary Czerwinski, and Kael Rowan. 2018. EMMA: An emotionally intelligent personal assistant for improving wellbeing. arXiv preprint arXiv:1812.11423 (2018).Google Scholar
- Shameek Ghosh, Sammi Bhatia, and Abhi Bhatia. 2018. Quro: Facilitating user symptom check using a personalised chatbot-oriented dialogue system. Stud. Health Technol. Inform. 252 (2018), 51--56.Google Scholar
- Alex Gillespie, Catherine Best, and Brian O’Neill. 2012. Cognitive function and assistive technology for cognition: A systematic review. J. Int. Neuropsychol. Society 18, 1 (2012), 1--19.Google ScholarCross Ref
- Sylvain Giroux, Nathalie Bier, Hélène Pigot, Bruno Bouchard, Abdenour Bouzouane, Mélanie Levasseur, Mélanie Couture, Carolina Bottari, Bonnie Swaine, Pierre-Yves Therriault, et al. 2015. Cognitive assistance to meal preparation: Design, implementation, and assessment in a living lab. In Proceedings of the AAAI Spring Symposium Series.Google Scholar
- Reginald G. Golledge et al. 1999. Wayfinding Behavior: Cognitive Mapping and Other Spatial Processes. JHU press.Google Scholar
- Pedro Pablo Gomez, Ross E. Willis, and Kent R. Van Sickle. 2015. Development of a virtual reality robotic surgical curriculum using the da Vinci SI surgical system. Surg. Endosc. 29, 8 (2015), 2171--2179.Google ScholarCross Ref
- D. González-Ortega, F. J. Díaz-Pernas, Mario Martínez-Zarzuela, and Miriam Antón-Rodríguez. 2014. A Kinect-based system for cognitive rehabilitation exercises monitoring. Comput. Meth. Prog. Biomed. 113, 2 (2014), 620--631.Google ScholarDigital Library
- Kiryong Ha, Zhuo Chen, Wenlu Hu, Wolfgang Richter, Padmanabhan Pillai, and Mahadev Satyanarayanan. 2014. Towards wearable cognitive assistance. In Proceedings of the 12th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 68--81.Google ScholarDigital Library
- Glenn I. Hawe, Graham Coates, Duncan T. Wilson, and Roger S. Crouch. 2012. Agent-based simulation for large-scale emergency response: A survey of usage and implementation. ACM Comput. Surv. 45, 1 (2012), 8.Google ScholarDigital Library
- Marion Hersh. 2015. Overcoming barriers and increasing independence-Service robots for elderly and disabled people. Int. J. Adv. Robot. Syst. 12, 8 (2015), 114.Google ScholarCross Ref
- Ramón Hervás, José Bravo, and Jesús Fontecha. 2013. An assistive navigation system based on augmented reality and context awareness for people with mild cognitive impairments. IEEE J. Biomed. Health Inform. 18, 1 (2013), 368--374.Google ScholarCross Ref
- Jesse Hoey, Craig Boutilier, Pascal Poupart, Patrick Olivier, Andrew Monk, and Alex Mihailidis. 2012. People, sensors, decisions: Customizable and adaptive technologies for assistance in healthcare. ACM Trans. Interact. Intell. Syst. 2, 4 (2012), 20.Google ScholarDigital Library
- Hossein Mousavi Hondori, Maryam Khademi, Lucy Dodakian, Steven C. Cramer, and Cristina Videira Lopes. 2013. A spatial augmented reality rehab system for post-stroke hand rehabilitation. In Stud. Health Technol. Inform. 184. 279--285.Google Scholar
- Enamul Hoque, Robert F. Dickerson, Sarah M. Preum, Mark Hanson, Adam Barth, and John A. Stankovic. 2015. Holmes: A comprehensive anomaly detection system for daily in-home activities. In Proceedings of the International Conference on Distributed Computing in Sensor Systems. IEEE, 40--51.Google Scholar
- John Hu, Aaron Edsinger, Yi-Je Lim, Nick Donaldson, Mario Solano, Aaron Solochek, and Ronald Marchessault. 2011. An advanced medical robotic system augmenting healthcare capabilities-robotic nursing assistant. In Proceedings of the IEEE International Conference on Robotics and Automation. IEEE, 6264--6269.Google ScholarCross Ref
- Rajibul Huq, Patricia Kan, Robby Goetschalckx, Debbie Hébert, Jesse Hoey, and Alex Mihailidis. 2011. A decision-theoretic approach in the design of an adaptive upper-limb stroke rehabilitation robot. In Proceedings of the IEEE International Conference on Rehabilitation Robotics. IEEE, 1--8.Google ScholarCross Ref
- Inc Intuitive Surgical. 2019. SimNow from da Vinci. Retrieved from https://tinyurl.com/y5ubtgdt.Google Scholar
- Sajid Iqbal, Wasif Altaf, Muhammad Aslam, Waqar Mahmood, and Muhammad Usman Ghani Khan. 2016. Application of intelligent agents in health-care. Artif. Intell. Rev. 46, 1 (2016), 83--112.Google ScholarDigital Library
- David Isern and Antonio Moreno. 2016. A systematic literature review of agents applied in healthcare. J. Med. Syst. 40, 2 (2016), 43.Google ScholarDigital Library
- François Jammes, Antoine Mensch, and Harm Smit. 2007. Service-oriented device communications using the devices profile for web services. In Proceedings of the 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW’07), Vol. 1. IEEE, 947--955.Google ScholarDigital Library
- Minoa Jung, A. Hoerbst, W. O. Hackl, F. Kirrane, D. Borbolla, M. W. Jaspers, M. Oertle, V. Koutkias, L. Ferret, P. Massari, et al. 2013. Attitude of physicians towards automatic alerting in computerized physician order entry systems. Meth. Inf. Med. 52, 02 (2013), 99--108.Google ScholarCross Ref
- Leslie Kay. 1974. A sonar aid to enhance spatial perception of the blind: Engineering design and evaluation. Radio Electron. Eng. 44, 11 (1974), 605--627.Google ScholarCross Ref
- John E. Kelly III and Steve Hamm. 2013. Smart Machines: IBM’s Watson and the Era of Cognitive Computing. Columbia University Press.Google Scholar
- Maryam Khademi, Hossein Mousavi Hondori, Cristina Videira Lopes, Lucy Dodakian, and Steve C. Cramer. 2012. Haptic augmented reality to monitor human arm’s stiffness in rehabilitation. In Proceedings of the IEEE-EMBS Conference on Biomedical Engineering and Sciences. IEEE, 892--895.Google Scholar
- Naofumi Kitsunezaki, Eijiro Adachi, Takashi Masuda, and Jun-ichi Mizusawa. 2013. KINECT applications for the physical rehabilitation. In Proceedings of the IEEE International Symposium on Medical Measurements and Applications (MeMeA’13). IEEE, 294--299.Google ScholarCross Ref
- M. Sun Kohn, J. Sun, S. Knoop, A. Shabo, B. Carmeli, D. Sow, T. Syed-Mahmood, and W. Rapp. 2014. IBM’s health analytics and clinical decision support. Yearb. Med. Inform. 23, 01 (2014), 154--162.Google ScholarCross Ref
- Matthieu Komorowski, Leo A. Celi, Omar Badawi, Anthony C. Gordon, and A. Aldo Faisal. 2018. The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care. Nat. Med. 24, 11 (2018), 1716--1720.Google ScholarCross Ref
- Belinda Lange, Chien-Yen Chang, Evan Suma, Bradley Newman, Albert Skip Rizzo, and Mark Bolas. 2011. Development and evaluation of low cost game-based balance rehabilitation tool using the Microsoft Kinect sensor. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 1831--1834.Google ScholarCross Ref
- Liliana Laranjo, Adam G. Dunn, Huong Ly Tong, Ahmet Baki Kocaballi, Jessica Chen, Rabia Bashir, Didi Surian, Blanca Gallego, Farah Magrabi, Annie Y. S. Lau, et al. 2018. Conversational agents in healthcare: A systematic review. J. Amer. Med. Inform. Assoc. 25, 9 (2018), 1248--1258.Google ScholarCross Ref
- Young Hoon Lee and Gérard Medioni. 2011. RGB-D camera based navigation for the visually impaired. In Proceedings of the Robotics: Science and Systems Conference (RSS’11).Google Scholar
- Young Hoon Lee and Gerard Medioni. 2014. Wearable RGBD indoor navigation system for the blind. In Proceedings of the European Conference on Computer Vision. Springer, 493--508.Google Scholar
- Manning Li, Jie Hou, Henry Zhang, et al. 2014. A tale of two virtual advisors: An empirical study investigating the empowerment effect of mobile mental-health advisory systems on emergency rescuers. In Proceedings of the Pacific Asia Conference on Information Systems (PACIS’14). 227.Google Scholar
- Manning Li, Zhenhui Jack Jiang, Zhiping Fan, and Jie Hou. 2017. Expert or peer? Understanding the implications of virtual advisor identity on emergency rescuer empowerment in mobile psychological self-help services. Inf. Manag. 54, 7 (2017), 866--886.Google ScholarDigital Library
- Ruijiao Li, Bowen Lu, and Klaus D. McDonald-Maier. 2015. Cognitive assisted living ambient system: A survey. Dig. Commun. Netw. 1, 4 (2015), 229--252.Google ScholarCross Ref
- Christine Lisetti, Reza Amini, Ugan Yasavur, and Naphtali Rishe. 2013. I can help you change! An empathic virtual agent delivers behavior change health interventions. ACM Trans. Manag. Inf. Syst. 4, 4 (2013), 19.Google ScholarDigital Library
- Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C. Berg. 2016. SSD: Single shot multibox detector. In Proceedings of the European Conference on Computer Vision. Springer, 21--37.Google Scholar
- Yang Liu, Noelle R. B. Stiles, and Markus Meister. 2018. Augmented reality powers a cognitive assistant for the blind. eLife 7 (2018), e37841.Google Scholar
- MultiMedia LLC. 2016. Intelligent Cognitive Assistants: Workshop Summary and Recommendations. Retrieved from https://www.nsf.gov/crssprgm/nano/reports/2016-1003_ICA_Workshop_Final_Report_2016.pdf.Google Scholar
- Jack M. Loomis, Reginald G. Golledge, and Roberta L. Klatzky. 1998. Navigation system for the blind: Auditory display modes and guidance. Presence 7, 2 (1998), 193--203.Google ScholarDigital Library
- Meiyi Ma, Sarah Masud Preum, and John A. Stankovic. 2017. Cityguard: A watchdog for safety-aware conflict detection in smart cities. In Proceedings of the 2nd International Conference on Internet-of-things Design and Implementation. 259--270.Google Scholar
- Meiyi Ma, John A. Stankovic, and Lu Feng. 2018. CityResolver: A decision support system for conflict resolution in smart cities. In Proceedings of the ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS’18). IEEE, 55--64.Google ScholarDigital Library
- Andrea Britto Mattos and Dario Augusto Borges Oliveira. 2018. Multi-view mouth renderization for assisting lip-reading. In ACM Proc. Internet Access. Things. 28 (Apr. 2018) 1--10.Google ScholarDigital Library
- Alex Mihailidis, Brent Carmichael, and Jennifer Boger. 2004. The use of computer vision in an intelligent environment to support aging-in-place, safety, and independence in the home. IEEE Trans. Inf. Technol. Biomed. 8, 3 (2004), 238--247.Google ScholarDigital Library
- Inc Mimic Technologies. 2019. dV-Trainer. Retrieved from https://mimicsimulation.com/dv-trainer/.Google Scholar
- Adam S. Miner, Nigam Shah, Kim D. Bullock, Bruce A. Arnow, Jeremy Bailenson, and Jeff Hancock. 2019. Key considerations for incorporating conversational AI in psychotherapy. Front. Psychi. 10 (2019).Google Scholar
- Sara Montagna, Angelo Croatti, Alessandro Ricci, Vanni Agnoletti, Vittorio Albarello, and Emiliano Gamberini. 2020. Real-time tracking and documentation in trauma management. Health Inform. J. 26, 1 (2020), 328--341.Google ScholarCross Ref
- Fariba Mostajeran, Nikolaos Katzakis, Oscar Ariza, Jann Philipp Freiwald, and Frank Steinicke. 2019. Welcoming a holographic virtual coach for balance training at home: Two focus groups with older adults. In Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (VR’19). IEEE, 1465--1470.Google ScholarCross Ref
- Sirajum Munir, Mohsin Ahmed, and John Stankovic. 2015. Eyephy: Detecting dependencies in cyber-physical system apps due to human-in-the-loop. In Proceedings of the 12th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services. Citeseer, 170--179.Google ScholarDigital Library
- Sirajum Munir and John A. Stankovic. 2014. DepSys: Dependency aware integration of cyber-physical systems for smart homes. In Proceedings of the ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS’14). IEEE, 127--138.Google Scholar
- David J. Musliner, James A. Hendler, Ashok K. Agrawala, Edmund H. Durfee, Jay K. Strosnider, and C. J. Paul. 1995. The challenges of real-time AI. Computer 28, 1 (1995), 58--66.Google ScholarDigital Library
- Alexander Neumann, Christof Elbrechter, Nadine Pfeiffer-Leßmann, Risto Kõiva, Birte Carlmeyer, Stefan Rüther, Michael Schade, André Ückermann, Sven Wachsmuth, and Helge J. Ritter. 2017. KogniChef: A cognitive cooking assistant. KI-Künstl. Intell. 31, 3 (2017), 273--281.Google ScholarCross Ref
- Quoc-Hung Nguyen, Hai Vu, Thanh-Hai Tran, and Quang-Hoan Nguyen. 2017. Developing a way-finding system on mobile robot assisting visually impaired people in an indoor environment. Multimedia Tools Applic. 76, 2 (2017), 2645--2669.Google ScholarDigital Library
- Ahmed K. Noor. 2015. Potential of cognitive computing and cognitive systems. Open Eng. 5, 1 (2015), 75--88.Google Scholar
- John Oakley. 2018. Intelligent Cognitive Assistants: Workshop Summary and Recommendations. Retrieved from https://www.nsf.gov/crssprgm/nano/reports/ICA2_Workshop_Report_2018.pdf.Google Scholar
- Ziad Obermeyer, Brian Powers, Christine Vogeli, and Sendhil Mullainathan. 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 6464 (2019), 447--453.Google Scholar
- Eshed Ohn-Bar, Kris Kitani, and Chieko Asakawa. 2018. Personalized dynamics models for adaptive assistive navigation systems. In Proceedings of the Conference on Robot Learning. 16--39.Google Scholar
- Nashwan Adnan Othman and Ilhan Aydin. 2018. A new deep learning application based on Movidius NCS for embedded object detection and recognition. In Proceedings of the 2nd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT’18). IEEE, 1--5.Google ScholarCross Ref
- Nicolas Padoy, Tobias Blum, Seyed-Ahmad Ahmadi, Hubertus Feussner, Marie-Odile Berger, and Nassir Navab. 2012. Statistical modeling and recognition of surgical workflow. Med. Image Anal. 16, 3 (2012), 632--641.Google ScholarCross Ref
- Sarah Parsons and Peter Mitchell. 2002. The potential of virtual reality in social skills training for people with autistic spectrum disorders. J. Intell. Disab. Res. 46, 5 (2002), 430--443.Google ScholarCross Ref
- Paul Phamduy, John-Ross Rizzo, Todd E. Hudson, Marina Torre, Kalle Levon, and Maurizio Porfiri. 2017. Communicating through touch: Macro fiber composites for tactile stimulation on the abdomen. IEEE Trans. Haptics 11, 2 (2017), 174--184.Google ScholarCross Ref
- Martha E. Pollack, Laura Brown, Dirk Colbry, Cheryl Orosz, Bart Peintner, Sailesh Ramakrishnan, Sandra Engberg, Judith T. Matthews, Jacqueline Dunbar-Jacob, Colleen E. McCarthy, et al. 2002. Pearl: A mobile robotic assistant for the elderly. In Proceedings of the AAAI Workshop on Automation as Eldercare, Vol. 2002. 85--91.Google Scholar
- Sarah Preum, Sile Shu, Mustafa Hotaki, Ronald Williams, John Stankovic, and Homa Alemzadeh. 2019. CognitiveEMS: A cognitive assistant system for emergency medical services. ACM SIGBED Rev. 16, 2 (2019), 51--60.Google ScholarDigital Library
- Sarah Masud Preum, Abu Sayeed Mondol, Meiyi Ma, Hongning Wang, and John A. Stankovic. 2017. Preclude: Conflict detection in textual health advice. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom’17). IEEE, 286--296.Google Scholar
- Sarah Masud Preum, Abu Sayeed Mondol, Meiyi Ma, Hongning Wang, and John A. Stankovic. 2017. Preclude2: Personalized conflict detection in heterogeneous health applications. Pervas. Mob. Comput. 42 (2017).Google Scholar
- Sarah Masud Preum, Md Rizwan Parvez, Kai-Wei Chang, and John Stankovic. 2018. A corpus of drug usage guidelines annotated with type of advice. In Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC’18).Google Scholar
- Sarah Masud Preum, Sile Shu, Homa Alemzadeh, and John A. Stankovic. 2020. EMSContExt: EMS protocol-driven concept extraction for cognitive assistance in emergency response. In Proceedings of the AAAI Conference on Artificial Intelligence. 13350--13355.Google Scholar
- Sarah Masud Preum, Sile Shu, Jonathan Ting, Vincent Lin, Ronald Williams, John Stankovic, and Homa Alemzadeh. 2018. Towards a cognitive assistant system for emergency response. In Proceedings of the ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS’18). IEEE, 347--348.Google ScholarDigital Library
- Sarah Masud Preum, John A. Stankovic, and Yanjun Qi. 2015. MAPer: A multi-scale adaptive personalized model for temporal human behavior prediction. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. 433--442.Google ScholarDigital Library
- Long Qian, Anton Deguet, and Peter Kazanzides. 2018. ARssist: Augmented reality on a head-mounted display for the first assistant in robotic surgery. Healthc. Technol. Lett. 5, 5 (2018), 194--200.Google ScholarCross Ref
- M. Arif Rahman, Sarah Masud Preum, Ronald D. Williams, Homa Alemzadeh, and John A. Stankovic. 2020. GRACE: Generating summary reports automatically for cognitive assistance in emergency response. In Proceedings of the AAAI Conference on Artificial Intelligence. 13356--13362.Google Scholar
- Vijay Rajanna, Raniero Lara-Garduno, Dev Jyoti Behera, Karthic Madanagopal, Daniel Goldberg, and Tracy Hammond. 2014. Step Up Life: A context aware health assistant. In Proceedings of the 3rd ACM SIGSPATIAL International Workshop on the Use of GIS in Public Health. ACM, 21--30.Google ScholarDigital Library
- Vijay Rajanna, Patrick Vo, Jerry Barth, Matthew Mjelde, Trevor Grey, Cassandra Oduola, and Tracy Hammond. 2016. KinoHaptics: An automated, wearable, haptic assisted, physio-therapeutic system for post-surgery rehabilitation and self-care. J. Med. Syst. 40, 3 (2016), 60.Google ScholarDigital Library
- Emad Rajih, Côme Tholomier, Beatrice Cormier, Vanessa Samouëlian, Thomas Warkus, Moishe Liberman, Hugues Widmer, Jean-Baptiste Lattouf, Abdullah M. Alenizi, Malek Meskawi, et al. 2017. Error reporting from the da Vinci surgical system in robotic surgery: A Canadian multispecialty experience at a single academic centre. Canad. Urolog. Assoc. J. 11, 5 (2017), E197.Google ScholarCross Ref
- Sarvapali D. Ramchurn, Feng Wu, Wenchao Jiang, Joel E. Fischer, Steve Reece, Stephen Roberts, Tom Rodden, Chris Greenhalgh, and Nicholas R. Jennings. 2016. Human–agent collaboration for disaster response. Auton. Agents Multi-agent Syst. 30, 1 (2016), 82--111.Google ScholarDigital Library
- Sandeep Reddy, Sonia Allan, Simon Coghlan, and Paul Cooper. 2020. A governance model for the application of AI in health care. J. Amer. Med. Inform. Assoc. 27, 3 (2020), 491--497.Google ScholarCross Ref
- Hadley Reynolds and Susan Feldman. 2014. Cognitive computing: Beyond the hype. KM World 27 (2014).Google Scholar
- Flavio Ribeiro, Dinei Florencio, Philip A. Chou, and Zhengyou Zhang. 2012. Auditory augmented reality: Object sonification for the visually impaired. In Proceedings of the IEEE 14th International Workshop on Multimedia Signal Processing (MMSP’12). IEEE, 319--324.Google ScholarCross Ref
- Jaime A. Rincon, Angelo Costa, Paulo Novais, Vicente Julian, and Carlos Carrascosa. 2019. A new emotional robot assistant that facilitates human interaction and persuasion. Knowl. Inf. Syst. 60, 1 (2019), 363--383.Google ScholarDigital Library
- Albert Rizzo, Greg Reger, Greg Gahm, JoAnn Difede, and Barbara O. Rothbaum. 2009. Virtual reality exposure therapy for combat-related PTSD. In Post-traumatic Stress Disorder. Springer, 375--399.Google Scholar
- Albert Rizzo, Thomas Talbot, C. D. Combs, J. A. Sokolowski, and C. M. Banks. 2015. Virtual reality standardized patients for clinical training. In The Digital Patient: Advancing Healthcare, Research, and Education. Wiley, 257--272.Google Scholar
- Y. Rogers, H. Sharp, and J. Preece. 2011. Interaction Design: Beyond Human-computer Interaction. Wiley 8 Sons.Google ScholarDigital Library
- Caroline M. Ruminski, Matthew T. Clark, Douglas E. Lake, Rebecca R. Kitzmiller, Jessica Keim-Malpass, Matthew P. Robertson, Theresa R. Simons, J. Randall Moorman, and J. Forrest Calland. 2019. Impact of predictive analytics based on continuous cardiorespiratory monitoring in a surgical and trauma intensive care unit. J. Clin. Monit. Comput. 33, 4 (2019), 703--711.Google ScholarCross Ref
- Barret Rush, Leo Anthony Celi, and David J. Stone. 2019. Applying machine learning to continuously monitored physiological data. J. Clin. Monit. Comput. 33, 5 (2019), 887--893.Google ScholarCross Ref
- Barret Rush, David J. Stone, and Leo Anthony Celi. 2018. From big data to artificial intelligence: Harnessing data routinely collected in the process of care. Crit. Care Med. 46, 2 (2018), 345.Google ScholarCross Ref
- Gopala Sainarayanan, R. Nagarajan, and Sazali Yaacob. 2007. Fuzzy image processing scheme for autonomous navigation of human blind. Appl. Soft Comput. 7, 1 (2007), 257--264.Google ScholarDigital Library
- Daisuke Sato, Uran Oh, Kakuya Naito, Hironobu Takagi, Kris Kitani, and Chieko Asakawa. 2017. NavCog3: An evaluation of a smartphone-based blind indoor navigation assistant with semantic features in a large-scale environment. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 270--279.Google ScholarDigital Library
- Mahadev Satyanarayanan, Wei Gao, and Brandon Lucia. 2019. The computing landscape of the 21st century. In Proceedings of the 20th International Workshop on Mobile Computing Systems and Applications. 45--50.Google ScholarDigital Library
- Tobias Schwarze, Martin Lauer, Manuel Schwaab, Michailas Romanovas, Sandra Böhm, and Thomas Jürgensohn. 2016. A camera-based mobility aid for visually impaired people. KI-Künstl. Intell. 30, 1 (2016), 29--36.Google ScholarCross Ref
- Gaumard Scientific. 2019. Pediatric 8 Neonatal Care Simulators. Retrieved from https://www.gaumard.com/products/pediatric-neonatal.Google Scholar
- Audrey Serna, Hélène Pigot, and Vincent Rialle. 2007. Modeling the progression of Alzheimer’s disease for cognitive assistance in smart homes. User Model. User-adapt. Interact. 17, 4 (2007), 415--438.Google ScholarDigital Library
- Azad Shademan, Ryan S. Decker, Justin D. Opfermann, Simon Leonard, Axel Krieger, and Peter C. W. Kim. 2016. Supervised autonomous robotic soft tissue surgery. Sci. Translat. Med.icine 8, 337 (2016), 337ra64–337ra64.Google Scholar
- Afzal Hussain Shahid and M. P. Singh. 2019. Computational intelligence techniques for medical diagnosis and prognosis: Problems and current developments. Biocyber. Biomed. Eng. 39, 3 (2019), 638--672.Google ScholarCross Ref
- Shraga Shoval, Johann Borenstein, and Yoram Koren. 1998. The Navbelt-A computerized travel aid for the blind based on mobile robotics technology. IEEE Trans. Biomed. Eng. 45, 11 (1998), 1376--1386.Google ScholarCross Ref
- Sile Shu, Sarah Preum, Haydon Pitchford, Ronald Williams, John Stankovic, and Homa Alemzadeh. 2019. A behavior tree cognitive assistant system for emergency medical services. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’19). IEEE.Google ScholarDigital Library
- Daniel Siewiorek, Asim Smailagic, and Anind Dey. 2012. Architecture and applications of virtual coaches. Proc. IEEE 100, 8 (2012), 2472--2488.Google ScholarCross Ref
- Daniel Sonntag. 2015. Kognit: Intelligent cognitive enhancement technology by cognitive models and mixed reality for dementia patients. In Proceedings of the AAAI Fall Symposium Series.Google Scholar
- Daniel Sonntag, Sonja Zillner, Christian Schulz, Markus Weber, and Takumi Toyama. 2013. Towards medical cyber-physical systems: Multimodal augmented reality for doctors and knowledge discovery about patients. In Proceedings of the International Conference of Design, User Experience, and Usability. Springer, 401--410.Google ScholarCross Ref
- Mirjana Spasojevic, Stefan Marti, Davide Di Censo, and Jaime Elliot Nahman. 2018. Cognitive load driving assistant. US Patent App. 15/541,458.Google Scholar
- Eliza Strickland. 2019. IBM Watson, heal thyself: How IBM overpromised and underdelivered on AI health care. IEEE Spect. 56, 4 (2019), 24--31.Google ScholarCross Ref
- Yingli Tian. 2014. RGB-D sensor-based computer vision assistive technology for visually impaired persons. In Computer Vision and Machine Learning with RGB-D Sensors. Springer, 173--194.Google Scholar
- Iwan Ulrich and Johann Borenstein. 2001. The GuideCane-applying mobile robot technologies to assist the visually impaired. IEEE Trans. Syst. Man Cyber. Part A: Syst. Hum. 31, 2 (2001), 131--136.Google ScholarDigital Library
- Bram Van de Laar, Anton Nijholt, and Job Zwiers. 2010. Monitoring user’s brain activity for a virtual coach. In Proceedings of the International Conference on Entertainment Computing. Springer, 511--513.Google ScholarCross Ref
- Hélène Vorobieva, Mariette Soury, Patrick Hède, Christophe Leroux, and Philippe Morignot. 2010. Object recognition and ontology for manipulation with an assistant robot. In Proceedings of the International Conference on Smart Homes and Health Telematics. Springer, 178--185.Google ScholarCross Ref
- David Watson, Lee Anna Clark, and Auke Tellegen. 1988. Development and validation of brief measures of positive and negative affect: The PANAS scales. J. Person. Social Psychol. 54, 6 (1988), 1063.Google ScholarCross Ref
- IBM Watson. 2019. IBM Watson for Oncology. Retrieved from https://tinyurl.com/y5etnmrd.Google Scholar
- Oliver Weede, Andreas Bihlmaier, Jessica Hutzl, Beat P. Müller-Stich, and Heinz Wörn. 2013. Towards cognitive medical robotics in minimal invasive surgery. In Proceedings of the Conference on Advances in Robotics. ACM, 1--8.Google ScholarDigital Library
- Patricia A. H. Williams and Andrew J. Woodward. 2015. Cybersecurity vulnerabilities in medical devices: A complex environment and multifaceted problem. Med. Dev. 8 (2015), 305.Google Scholar
- Laure Wynants, Ben Van Calster, Marc M. J. Bonten, Gary S. Collins, Thomas P. A. Debray, Maarten De Vos, Maria C. Haller, Georg Heinze, Karel G. M. Moons, Richard D. Riley, et al. 2020. Prediction models for diagnosis and prognosis of covid-19 infection: Systematic review and critical appraisal. BMJ 369 (2020).Google Scholar
- Mohammad Samin Yasar and Homa Alemzadeh. 2020. Real-time context-aware detection of unsafe events in robot-assisted surgery. In 50th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'20). IEEE Computer Society, 385–397.Google ScholarCross Ref
- Fereshta Yazdani, Gayane Kazhoyan, Asil Kaan Bozcuoğlu, Andrei Haidu, Ferenc Bálint-Benczédi, Daniel Beßler, Mihai Pomarlan, and Michael Beetz. 2018. Cognition-enabled framework for mixed human-robot rescue teams. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’18). IEEE, 1421--1428.Google ScholarCross Ref
Index Terms
- A Review of Cognitive Assistants for Healthcare: Trends, Prospects, and Future Directions
Recommendations
Web-based database and SMS to facilitate healthcare medical emergency
HIKM '11: Proceedings of the Fourth Australasian Workshop on Health Informatics and Knowledge Management - Volume 120Healthcare and medical emergency are essential systems in human life; so that many countries work toward having it. Investigation of Malaysian case shows that it suffer from locality, missing of unified electronic medical record EMR and lack of ...
“A Second Voice”: Investigating Opportunities and Challenges for Interactive Voice Assistants to Support Home Health Aides
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing SystemsHome health aides are a vulnerable group of frontline caregivers who provide personal and medically-oriented care in patients’ homes. Their work is difficult and unpredictable, involving a mix of physical and emotional labor as they adapt to patients’ ...
Personal assistants for healthcare treatment at home
EACE '05: Proceedings of the 2005 annual conference on European association of cognitive ergonomicsThis paper describes the research plans in the SuperAssist projehct, introducing personal assistants in the care of diabetes patients, assisting the patients themselves, the medical specialists looking after the patients' healthcare, and the technical ...
Comments