skip to main content
research-article

Human–machine Teaming with Small Unmanned Aerial Systems in a MAPE-K Environment

Published: 14 February 2024 Publication History

Abstract

The Human Machine Teaming (HMT) paradigm focuses on supporting partnerships between humans and autonomous machines. HMT describes requirements for transparency, augmented cognition, and coordination that enable far richer partnerships than those found in typical human-on-the-loop and human-in-the-loop systems. Autonomous, self-adaptive systems in domains such as autonomous driving, robotics, and Cyber-Physical Systems, are often implemented using the MAPE-K feedback loop as the primary reference model. However, while MAPE-K enables fully autonomous behavior, it does not explicitly address the interactions that occur between humans and autonomous machines as intended by HMT. In this article, we, therefore, present the MAPE-KHMT framework, which utilizes runtime models to augment the monitoring, analysis, planning, and execution phases of the MAPE-K loop to support HMT despite the different operational cadences of humans and machines. We draw on examples from our own emergency response system of interactive, autonomous, small unmanned aerial systems to illustrate the application of MAPE-KHMT in both a simulated and physical environment, and we discuss how the various HMT models are connected and can be integrated into a MAPE-K solution.

References

[1]
Sophia J. Abraham, Zachariah Carmichael, Sreya Banerjee, Rosaura G. VidalMata, Ankit Agrawal, Md Nafee Al Islam, Walter J. Scheirer, and Jane Cleland-Huang. 2021. Adaptive autonomy in human-on-the-loop vision-based robotics systems. In Proceedings of the 1st IEEE/ACM Workshop on AI Engineering - Software Engineering for AI. IEEE, 113–120. DOI:
[2]
Ankit Agrawal, Sophia J. Abraham, Benjamin Burger, Chichi Christine, Luke Fraser, John M. Hoeksema, Sarah Hwang, Elizabeth Travnik, Shreya Kumar, Walter J. Scheirer, Jane Cleland-Huang, Michael Vierhauser, Ryan Bauer, and Steve Cox. 2020. The next generation of human-drone partnerships: Co-designing an emergency response system. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, 1–13. DOI:
[3]
Ankit Agrawal and Jane Cleland-Huang. 2021. Explaining autonomous decisions in swarms of human-on-the-loop small unmanned aerial systems. In Proceedings of the 9th AAAI Conference on Human Computation and Crowdsourcing, Ece Kamar and Kurt Luther (Eds.). AAAI Press, 15–26. Retrieved from https://ojs.aaai.org/index.php/HCOMP/article/view/18936
[4]
Ankit Agrawal and Jane Cleland-Huang. 2021. RescueAR: Augmented reality supported collaboration for UAV driven emergency response systems. CoRR abs/2110.00180 (2021).
[5]
Ankit Agrawal, Jane Cleland-Huang, and Jan-Philipp Steghöfer. 2020. Model-driven requirements for humans-on-the-loop multi-UAV missions. In Proceedings of the 10th IEEE International Model-Driven Requirements Engineering. IEEE, 1–10. DOI:
[6]
Amal Ahmed Anda and Daniel Amyot. 2019. Arithmetic semantics of feature and goal models for adaptive cyber-physical systems. In Proceedings of the 27th IEEE International Requirements Engineering Conference, Daniela E. Damian, Anna Perini, and Seok-Won Lee (Eds.). IEEE, 245–256. DOI:
[7]
Paolo Arcaini, Raffaela Mirandola, Elvinia Riccobene, Patrizia Scandurra, Alberto Arrigoni, Daniele Bosc, Federico Modica, and Rita Pedercini. 2020. Smart home platform supporting decentralized adaptive automation control. In Proceedings of the 35th Annual ACM Symposium on Applied Computing. ACM, New York, 1893–1900.
[8]
Paolo Arcaini, Elvinia Riccobene, and Patrizia Scandurra. 2015. Modeling and analyzing MAPE-K feedback loops for self-adaptation. In Proceedings of the 10th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 13–23. DOI:
[9]
Uwe Aßmann, Sebastian Götz, Jean-Marc Jézéquel, Brice Morin, and Mario Trapp. 2014. A Reference Architecture and Roadmap for [email protected] Systems. Springer International Publishing, Cham, 1–18. DOI:
[10]
Stuart Ballingall, Majid Sarvi, and Peter Sweatman. 2020. Safety assurance concepts for automated driving systems. SAE Int. J. Adv. Curr. Pract. Mobil. 2, 2020-01-0727 (2020), 1528–1537.
[11]
Luciano Baresi, Liliana Pasquale, and Paola Spoletini. 2010. Fuzzy goals for requirements-driven adaptation. In Proceedings of the 18th IEEE International Requirements Engineering Conference. IEEE, 125–134.
[12]
Ezio Bartocci, Radu Grosu, Atul Karmarkar, Scott A. Smolka, Scott D. Stoller, Erez Zadok, and Justin Seyster. 2012. Adaptive runtime verification. In Proceedings of the International Conference on Runtime Verification. Springer, 168–182.
[13]
Nelly Bencomo and Amel Belaggoun. 2014. A world full of surprises: Bayesian theory of surprise to quantify degrees of uncertainty. In Proceedings of the 36th International Conference on Software Engineering. ACM, 460–463. DOI:
[14]
Nelly Bencomo, Sebastian Götz, and Hui Song. 2019. [email protected]: A guided tour of the state of the art and research challenges. Softw. Syst. Mod. 18, 5 (2019), 3049–3082. DOI:
[15]
Gábor Bergmann, István Dávid, Ábel Hegedüs, Ákos Horváth, István Ráth, Zoltán Ujhelyi, and Dániel Varró. 2015. Viatra 3: A reactive model transformation platform. In Proceedings of the International Conference on Theory and Practice of Model Transformations. Springer, 101–110.
[16]
Jason M. Bindewald, Christina F. Rusnock, and Michael E Miller. 2018. Measuring human trust behavior in human–machine teams. In Proceedings of the AHFE International Conference on Human Factors in Simulation and Modeling. Springer, 47–58.
[17]
Francesco N. Biondi, Monika Lohani, Rachel Hopman, Sydney Mills, Joel M. Cooper, and David L. Strayer. 2018. 80 MPH and out-of-the-loop: Effects of real-world semi-automated driving on driver workload and arousal. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 62. SAGE Publications, 1878–1882.
[18]
Barry W. Boehm and Richard Turner. 2004. Balancing agility and discipline: Evaluating and integrating agile and plan-driven methods. In Proceedings of the 26th International Conference on Software Engineering. IEEE Computer Society, 718–719. DOI:
[19]
Victor Braberman, Nicolas D’Ippolito, Jeff Kramer, Daniel Sykes, and Sebastian Uchitel. 2015. Morph: A reference architecture for configuration and behaviour self-adaptation. In Proceedings of the 1st International Workshop on Control Theory for Software Engineering. ACM, New York, 9–16.
[20]
Victor Braberman, Nicolas D’Ippolito, Jeff Kramer, Daniel Sykes, and Sebastian Uchitel. 2017. An extended description of MORPH: A reference architecture for configuration and behaviour self-adaptation. In Software Engineering for Self-Adaptive Systems III. Assurances. Springer International Publishing, Cham, 377–408.
[21]
Thomas Brand and Holger Giese. 2018. Towards software architecture runtime models for continuous adaptive monitoring. In Proceedings of the 13th International WS on [email protected] Conference. 72–77.
[22]
Thomas Brand and Holger Giese. 2019. Modeling approach and evaluation criteria for adaptable architectural runtime model instances. In Proceedings of the ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems (MODELS’19). IEEE, 227–232.
[23]
Jennifer Brings, Marian Daun, Thorsten Weyer, and Klaus Pohl. 2020. Goal-based configuration analysis for networks of collaborative cyber-physical systems. In Proceedings of the 35th Annual ACM Symposium on Applied Computing. ACM, New York, 1387–1396.
[24]
Gloria L. Calhoun, Heath A. Ruff, Kyle J. Behymer, and Elizabeth Marie Mersch. 2017. Operator-autonomy teaming interfaces to support multi-unmanned vehicle missions. In Advances in Human Factors in Robots and Unmanned Systems. Springer, 113–126.
[25]
Radu Calinescu, Naif Alasmari, and Mario Gleirscher. 2021. Maintaining driver attentiveness in shared-control autonomous driving. In Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 90–96.
[26]
Benjamin Camblor, Jean-Marc Salotti, Charles Fage, and David Daney. 2022. Degraded situation awareness in a robotic workspace: Accident report analysis. Theor. Iss. Ergon. Sci. 23, 1 (2022), 60–79.
[27]
Lorena Castañeda, Norha M. Villegas, and Hausi A. Müller. 2014. Self-adaptive applications: On the development of personalized web-tasking systems. In Proceedings of the 9th International Symposium on Software Engineering for Adaptive and Self-managing Systems. ACM, New York, 49–54.
[28]
Crystal Chao and Andrea Thomaz. 2016. Timed Petri nets for fluent turn-taking over multimodal interaction resources in human-robot collaboration. Int. J. Robot. Res. 35, 11 (2016), 1330–1353.
[29]
Jessie Chen, Michael Barnes, and Michelle Harper-Sciarini. 2011. Supervisory control of multiple robots: Human-performance issues and user-interface design. IEEE Trans. Syst., Man Cybern., Part C 41 (072011), 435–454. DOI:
[30]
Tao Chen and Rami Bahsoon. 2017. Self-adaptive and online QoS modeling for cloud-based software services. IEEE Trans. Softw. Eng. 43, 5 (2017), 453–475. DOI:
[31]
Betty H. C. Cheng, Robert Jared Clark, Jonathon Emil Fleck, Michael Austin Langford, and Philip K. McKinley. 2020. AC-ROS: Assurance case driven adaptation for the robot operating system. In Proceedings of the 23rd ACM/IEEE International Conference on Model Driven Engineering Languages and Systems. 102–113.
[32]
Muhammed Tawfiq Chowdhury and Jane Cleland-Huang. 2023. Engineering challenges for AI-supported computer vision in small uncrewed aerial systems. In Proceedings of the 2nd International Conference on AI Engineering – Software Engineering for AI. IEEE, 12 pages.
[33]
Jane Cleland-Huang, Ankit Agrawal, Md Nafee Al Islam, Eric Tsai, Maxime Van Speybroeck, and Michael Vierhauser. 2020. Requirements-driven configuration of emergency response missions with small aerial vehicles. In Proceedings of the 24th ACM International Systems and Software Product Line Conference. ACM, New York, 1–12. DOI:
[34]
Jane Cleland-Huang, Ankit Agrawal, Michael Vierhauser, Michael Murphy, and Mike Prieto. 2022. Extending MAPE-K to support Human–machine Teaming. In Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 120–131. Retrieved from https://ieeexplore.ieee.org/document/9800015
[35]
Carlos Hernandez Corbato, Darko Bozhinoski, Mario Garzon Oviedo, Gijs van der Hoorn, Nadia Hammoudeh Garcia, Harshavardhan Deshpande, Jon Tjerngren, and Andrzej Wasowski. 2020. MROS: Runtime adaptation for robot control architectures. arXiv:2010.09145 (2020).
[36]
Praveen Damacharla, Ahmad Y. Javaid, Jennie J. Gallimore, and Vijay K. Devabhaktuni. 2018. Common metrics to benchmark human–machine teams (HMT): A review. IEEE Access 6 (2018), 38637–38655. DOI:
[37]
Rogério de Lemos. 2020. Human in the loop: What is the point of no return? In Proceedings of the IEEE/ACM 15th International Symposium on Software Engineering for Adaptive and Self-managing Systems. ACM, New York, 165–166. DOI:
[38]
Ewen Denney and Ganesh Pai. 2012. A lightweight methodology for safety case assembly. In Proceedings of the International Conference on Computer Safety, Reliability, and Security. Springer, 1–12.
[39]
Ewen Denney, Ganesh Pai, and Ibrahim Habli. 2015. Dynamic safety cases for through-life safety assurance. In Proceedings of the 37th IEEE International Conference on Software Engineering, Vol. 2. IEEE, 587–590.
[40]
Ewen Denney, Ganesh Pai, and Josef Pohl. 2012. Heterogeneous aviation safety cases: Integrating the formal and the non-formal. In Proceedings of the 17th International Conference on Engineering of Complex Computer Systems. IEEE, 199–208.
[41]
Rui Ding, Hucheng Zhou, Jian-Guang Lou, Hongyu Zhang, Qingwei Lin, Qiang Fu, Dongmei Zhang, and Tao Xie. 2015. Log2: A cost-aware logging mechanism for performance diagnosis. In Proceedings of the USENIX Technical Conference. 139–150.
[42]
Dronology. 2020. Research Incubator and Dataset. Retrieved from https://dronology.info
[43]
F. E. Emery and E. L. Trist. 1960. Socio-technical systems. In Management Science Models and Techniques, Vol. 9, C. W. Churchman and M. Verhulst (Eds.). Pergamon, 83–97.
[44]
Mica R. Endsley. 2011. Designing for Situation Awareness: An Approach to User-centered Design (2nd ed.). CRC Press, Inc., Boca Raton, FL.
[45]
Mica R. Endsley. 2017. Autonomous driving systems: A preliminary naturalistic study of the Tesla Model S. J. Cognit. Eng. Decis. Mak. 11, 3 (2017), 225–238.
[46]
Naeem Esfahani, Eric Yuan, Kyle R. Canavera, and Sam Malek. 2016. Inferring software component interaction dependencies for adaptation support. ACM Trans. Auton. Adapt. Syst. 10, 4 (2016), 26:1–26:32. DOI:
[47]
Christoph Evers, Romy Kniewel, Kurt Geihs, and Ludger Schmidt. 2014. The user in the loop: Enabling user participation for self-adaptive applications. Fut. Gen. Comput. Syst. 34 (2014), 110–123. DOI:
[48]
Antonio Filieri, Giordano Tamburrelli, and Carlo Ghezzi. 2016. Supporting self-adaptation via quantitative verification and sensitivity analysis at run time. IEEE Trans. Softw. Eng. 42, 1 (2016), 75–99. DOI:
[49]
Joel E. Fischer, Chris Greenhalgh, Wenchao Jiang, Sarvapali D. Ramchurn, Feng Wu, and Tom Rodden. 2021. In-the-loop or on-the-loop? Interactional arrangements to support team coordination with a planning agent. Concurr. Comput.: Pract. Exper. 33, 8 (2021), e4082.
[50]
Flight Safety Foundation. 2019. Preliminary Report B737-800MAX. Retrieved from https://flightsafety.org/preliminary-report-b737-800max-et-avj
[51]
Lex Fridman, Bryan Reimer, Bruce Mehler, and William T. Freeman. 2018. Cognitive load estimation in the wild. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, 1–9.
[52]
Hargyo T. N Ignatius and Rami Bahsoon. 2021. A conceptual reference model for human as a service provider in cyber physical systems. International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS’21). IEEE.
[53]
Antoine Gaume, Gérard Dreyfus, and François-Benoît Vialatte. 2019. A cognitive brain–computer interface monitoring sustained attentional variations during a continuous task. Cognit. Neurodyn. 13, 3 (2019), 257–269.
[54]
Ilias Gerostathopoulos and Evangelos Pournaras. 2019. TRAPPed in traffic? A self-adaptive framework for decentralized traffic optimization. In Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 32–38.
[55]
Holger Giese, Nelly Bencomo, Liliana Pasquale, Andres Ramirez, Paola Inverardi, Sebastian Wätzoldt, and Siobhán Clarke. 2014. Living with uncertainty in the age of runtime models. [email protected]: Foundations, Applications, and Roadmaps. Lecture Notes in Computer Science, Vol. 8378. Springer, Cham, 47–100. DOI:
[56]
Georg Hägele and Dirk Söffker. 2017. A simplified situational environment risk and system reliability assessment for behavior assurance of autonomous and semi-autonomous aerial systems: A simulation study. In Proceedings of the International Conference on Unmanned Aircraft Systems. IEEE, 951–960.
[57]
Sandra G. Hart. 1986. NASA task load index (TLX), V1.0. NASA Human Performance Research Group (1986). https://ntrs.nasa.gov/citations/20000021487hhttps://ntrs.nasa.gov/api/citations/20000021487/downloads/20000021487.pdf
[58]
Nicolas Hili, Mojtaba Bagherzadeh, Karim Jahed, and Juergen Dingel. 2020. A model-based architecture for interactive run-time monitoring. Softw. Syst. Model. 19 (2020), 959–981.
[59]
Barbara Christine Hoekenga. 2007. Mind Over Machine: What Deep Blue Taught us About Chess, Artificial Intelligence, and the Human Spirit. Dissertation Massachusetts Institute of Technology. https://dspace.mit.edu/handle/1721.1/42144
[60]
Chao Huang, Hailong Huang, Junzhi Zhang, Peng Hang, Zhongxu Hu, and Chen Lv. 2021. Humanmachine cooperative trajectory planning and tracking for safe automated driving. IIEEE Transactions on Intelligent Transportation Systems 23, 8 (2021), 12050–12063.
[61]
Muhammad Usman Iftikhar, Gowri Sankar Ramachandran, Pablo Bollansée, Danny Weyns, and Danny Hughes. 2017. DeltaIoT: A self-adaptive internet of things exemplar. In Proceedings of the 12th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 76–82.
[62]
Didac Gil De La Iglesia and Danny Weyns. 2015. MAPE-K formal templates to rigorously design behaviors for self-adaptive systems. ACM Trans. Auton. Adapt. Syst. 10, 3 (2015), 1–31.
[63]
Hargyo T. N. Ignatius and Rami Bahsoon. 2021. A conceptual reference model for human as a service provider in cyber physical systems. In Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems (SEAMS’21). IEEE, 1–10.
[64]
Md Nafee Al Islam, Muhammed Tawfiq Chowdhury, Ankit Agrawal, Michael Murphy, Raj Mehta, Daria Kudriavtseva, Jane Cleland-Huang, Michael Vierhauser, and Marsha Chechik. 2023. Configuring mission-specific behavior in a product line of collaborating small unmanned aerial systems. J. Syst. Softw. 197 (2023), 111543. DOI:
[65]
Md Nafee Al Islam, Yihong Ma, Pedro Alarcon Granadeno, Nitesh V. Chawla, and Jane Cleland-Huang. 2022. RESAM: Requirements elicitation and specification for deep-learning anomaly models with applications to UAV flight controllers. In Proceedings of the 30th IEEE International Requirements Engineering Conference. IEEE, 153–165. DOI:
[66]
J. Y. Chen, K. Procci, M. Boyce, J. Wright, A. Garcia, and M. Barnes.2014. Situation Awareness–based Agent Transparency. Report No. ARL-TR-6905. Aberdeen Proving Ground, MD: U.S. Army Research Laboratory.
[67]
Sharmin Jahan, Matthew Pasco, Rose Gamble, Philip McKinley, and Betty Cheng. 2019. MAPE-SAC: A framework to dynamically manage security assurance cases. In Proceedings of the 4th International Workshops on Foundations and Applications of Self* Systems. IEEE, 146–151.
[68]
Pooyan Jamshidi, Javier Cámara, Bradley Schmerl, Christian Käestner, and David Garlan. 2019. Machine learning meets quantitative planning: Enabling self-adaptation in autonomous robots. In Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 39–50.
[69]
Yuchen Jiang, Shen Yin, and Okyay Kaynak. 2018. Data-driven monitoring and safety control of industrial cyber-physical systems: Basics and beyond. IEEE Access 6 (2018), 47374–47384.
[70]
Jianxin Jiao, Feng Zhou, Nagi Gebraeel, and Vincent Duffy. 2020. Towards augmenting cyber-physical-human collaborative cognition for human-automation interaction in complex manufacturing and operational environments. Int. J. Product. Res. 58 (032020), 1–23. DOI:
[71]
Donia Kateb, Nicola Zannone, Assaad Moawad, Patrice Caire, Grégory Nain, Tejeddine Mouelhi, and Yves Le Traon. 2015. Conviviality-driven access control policy. Requir. Eng. J. 20 (112015). DOI:
[72]
T. P. Kelly. 2001. Concepts and Principles of Compositional Safety Cases, COMSA/2001/1/1. Technical Report, University of York, York.
[73]
Jeffrey Kephart. 2020. Keynote: Viewing autonomic computing through the lens of embodied artificial intelligence: A self-debate. In Proceedings of the 15th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE.
[74]
J. O. Kephart and D. M. Chess. 2003. The vision of autonomic computing. Computer 36, 1 (2003), 41–50. DOI:
[75]
Glen Klien, David D. Woods, Jeffrey M. Bradshaw, Robert R. Hoffman, and Paul J. Feltovich. 2004. Ten challenges for making automation a “team player” in joint human-agent activity. IEEE Intell. Syst. 19, 6 (2004), 91–95.
[76]
Torkel Klingberg. 2009. The Overflowing Brain: Information Overload and the Limits of Working Memory. Oxford University Press.
[77]
Margarita Konaev and Husanjot Chahal. 2021. Building trust in human–machine teams. Retrieved from https://www.brookings.edu/techstream/building-trust-in-human-machine-teams
[78]
Jeamin Koo, Jungsuk Kwac, Wendy Ju, Martin Steinert, Larry Leifer, and Clifford Nass. 2015. Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. Int. J. Interact. Des. Manuf. 9, 4 (2015), 269–275.
[79]
Shitij Kumar, Celal Savur, and Ferat Sahin. 2020. Survey of human-robot collaboration in industrial settings: Awareness, intelligence, and compliance. IEEE Trans. Syst., Man Cybern.: Syst. PP (122020), 1–18. DOI:
[80]
Nancy G. Leveson. 2011. The Use of Safety Cases in Certification and Regulation. Technical Report. MIT.
[81]
Nianyu Li, Sridhar Adepu, Eunsuk Kang, and David Garlan. 2020. Explanations for human-on-the-loop: A probabilistic model checking approach. In Proceedings of the IEEE/ACM 15th International Symposium on Software Engineering for Adaptive and Self-managing Systems. ACM, New York, 181–187.
[82]
Nianyu Li, Javier Cámara, David Garlan, Bradley Schmerl, and Zhi Jin. 2021. Hey! Preparing humans to do tasks in self-adaptive systems. In Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 48–58. DOI:
[83]
Yixiang Lim, Nichakorn Pongsakornsathien, Alessandro Gardi, Roberto Sabatini, Trevor Kistan, Neta Ezer, and Daniel J. Bursch. 2021. Adaptive human-robot interactions for multiple unmanned aerial vehicles. Robotics 10, 1 (2021). DOI:
[84]
Eric Lloyd, Shihong Huang, and Emmanuelle Tognoli. 2017. Improving human-in-the-loop adaptive systems using brain-computer interaction. In Proceedings of the IEEE/ACM 12th International Symposium on Software Engineering for Adaptive and Self-managing Systems (SEAMS’17). IEEE, 163–174.
[85]
Robert Loh, Y. Bian, and Tim Roe. 2009. UAVs in civil airspace: Safety requirements. IEEE Aerosp. Electron. Syst. Mag. 24, 1 (2009), 5–17. DOI:
[86]
Joseph B. Lyons, Kevin T. Wynne, Sean Mahoney, and Mark A. Roebke. 2019. Trust and human–machine teaming: A qualitative study. In Artificial Intelligence for the Internet of Everything. Elsevier, 101–116.
[87]
Azad M. Madni and Carla C. Madni. 2018. Architectural framework for exploring adaptive human–machine teaming options in simulated dynamic environments. Systems 6, 4 (2018). DOI:
[88]
Pattie Maes. 1987. Concepts and experiments in computational reflection. In Proceedings of the Conference on Object-Oriented Programming Systems, Languages and Applications (OOPSLA’87). Association for Computing Machinery, New York, NY, 147–155. DOI:
[89]
Paulo Henrique Maia, Lucas Vieira, Matheus Chagas, Yijun Yu, Andrea Zisman, and Bashar Nuseibeh. 2019. Dragonfly: A tool for simulating self-adaptive drone behaviours. In Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 107–113.
[90]
Owen McAree, Jonathan M. Aitken, and Sandor M. Veres. 2016. A model based design framework for safety verification of a semi-autonomous inspection drone. In Proceedings of the 11th International Conference on Control. IEEE, 1–6.
[91]
Patricia McDermott, Cindy Dominguez, Nicholas Kasdaglis, Matthew Ryan, and Isabel Trahan. 2018. Human-machine Teaming Systems Engineering Guide. Technical report # MP180941, Mitre Corp. Bedford, Bedford, MA.
[92]
Patricia L. McDermott, Katherine E. Walker, Cynthia O. Dominguez, Alex Nelson, and Nicholas Kasdaglis. 2018. Quenching the Thirst for Human–machine Teaming Guidance: Helping Military Systems Acquisition Leverage Cognitive Engineering Research. The MITRE Corporation. Retrieved from https://www.mitre.org/publications/technical-papers/quenching-the-thirst-for-human-machine-teaming-guidance-helping
[93]
Christopher A. Miller, Joseph Mueller, Christopher Geib, David LaVergne, Phillip Walker, and Joshua Hamell. 2019. User interaction approaches for managing multiple UAS in the national airspace. In Proceedings of the Integrated Communications, Navigation and Surveillance Conference (ICNS’19). IEEE, 1–16. DOI:
[94]
Gabriel Moreno, Cody Kinneer, Ashutosh Pandey, and David Garlan. 2019. DARTSim: An exemplar for evaluation and comparison of self-adaptation approaches for smart cyber-physical systems. In Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 181–187.
[95]
Henry Muccini and Mahyar Tourchi Moghaddam. 2018. IOT architectural styles. In Proceedings of the European Conference on Software Architecture. Springer, 68–85.
[96]
Harish Narayanappa, Mukul S. Bansal, and Hridesh Rajan. 2010. Property-aware program sampling. In Proceedings of the 9th ACM SIGPLAN-SIGSOFT WS on Program Analysis for Software Tools and Engineering. 45–52.
[97]
Amin Nourmohammadi, Mohammad Jafari, and Thorsten O. Zander. 2018. A survey on unmanned aerial vehicle remote control using brain–computer interface. IEEE Trans. Hum.-mach. Syst. 48, 4 (2018), 337–348.
[98]
Olessia Ogorodnikova. 2008. Human weaknesses and strengths in collaboration with robots. Period. Polytech. Mechan. Eng. 52, 1 (2008), 25–33.
[99]
Oskar Palinko, Andrew L. Kun, Alexander Shyrokov, and Peter Heeman. 2010. Estimating cognitive load using remote eye tracking in a driving simulator. In Proceedings of the Symposium on Eye-tracking Research & Applications. ACM, New York, 141–144.
[100]
April Rose Panganiban, Gerald Matthews, and Michael D. Long. 2020. Transparency in autonomous teammates: Intention to support as teaming information. J. Cognit. Eng. Decis. Mak. 14, 2 (2020), 174–190.
[101]
Juan Parra-Ullauri, Antonio Garcia-Dominguez, Nelly Bencomo, and Luis Garcia-Paucar. 2022. History-aware explanations: Towards enabling human-in-the-loop in self-adaptive systems. In Proceedings of the 25th International Conference on Model Driven Engineering Languages and Systems. ACM. Retrieved from http://dro.dur.ac.uk/37030/
[102]
Colin Paterson, Radu Calinescu, Suresh Manandhar, and Di Wang. 2019. Using unstructured data to improve the continuous planning of critical processes involving humans. In Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 25–31. DOI:
[103]
Xin Peng, Bihuan Chen, Yijun Yu, and Wenyun Zhao. 2010. Self-tuning of software systems through goal-based feedback loop control. In Proceedings of the 18th IEEE International Requirements Engineering Conference. IEEE, 104–107.
[104]
Alexandre Pouget, Jan Drugowitsch, and Adam Kepecs. 2016. Confidence and certainty: Distinct probabilistic quantities for different goals. Nat. Neurosci. 19, 3 (2016), 366.
[105]
Andres J. Ramirez, Betty H. C. Cheng, and Philip K. McKinley. 2010. Adaptive monitoring of software requirements. In Proceedings of the 1st International Workshop on [email protected]. IEEE, 41–50.
[106]
Nicolas Regis, Frédéric Dehais, Emmanuel Rachelson, Charles Thooris, Sergio Pizziol, Mickaël Causse, and Catherine Tessier. 2014. Formal detection of attentional tunneling in human operator-automation interactions. IEEE Trans. Hum.-mach. Syst. 44, 3 (2014), 326–336. DOI:
[107]
R. Siqueira Reis, A. A. Hino, and C. R. Añez. 2010. Perceived stress scale. J. Health Psychol. 15, 1 (2010), 107–114.
[108]
Owen Reynolds, Antonio García-Domínguez, and Nelly Bencomo. 2020. Automated provenance graphs for [email protected]. In Proceedings of the ACM/IEEE 23rd International Conference on Model Driven Engineering Languages and Systems. ACM, New York, 1–10. DOI:
[109]
Owen Reynolds, Antonio García-Domínguez, and Nelly Bencomo. 2020. Towards automated provenance collection for runtime models to record system history. In Proceedings of the 12th System Analysis and Modelling Conference12–21.
[110]
Karina A. Roundtree, Michael A. Goodrich, and Julie A. Adams. 2019. Transparency: Transitioning from human–machine systems to human-swarm systems. J. Cognit. Eng. Decis. Mak. 13, 3 (2019), 171–195.
[111]
Günther Ruhe, Armin Eberlein, and Dietmar Pfahl. 2003. Trade-off analysis for requirements selection. Int. J. Softw. Eng. Knowl. Eng. 13, 04 (2003), 345–366.
[112]
Luca Sabatucci and Massimo Cossentino. 2015. From means-end analysis to proactive means-end reasoning. In Proceedings of the 10th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 2–12.
[113]
Lucas Sakizloglou, Sona Ghahremani, Matthias Barkowsky, and Holger Giese. 2022. Incremental execution of temporal graph queries over runtime models with history and its applications. Software and Systems Modeling 21, 5 (2022), 1789–1829.
[114]
Lucas Sakizloglou, Sona Ghahremani, Thomas Brand, Matthias Barkowsky, and Holger Giese. 2020. Towards highly scalable runtime models with history. In Proceedings of the IEEE/ACM 15th International Symposium on Software Engineering for Adaptive and Self-managing Systems. ACM, 188–194.
[115]
Md Nafee Al Islam, Jane Cleland-Huang, Myra Cohen, Salil Purandare, and Urjoshi Sinha. 2023. Self-adaptive mechanisms for misconfigurations in small uncrewed aerial systems. In Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems.
[116]
Lindsay Sanneman and Julie A. Shah. 2020. A situation awareness-based framework for design and evaluation of explainable AI. In Explainable, Transparent Autonomous Agents and Multi-Agent Systems. Springer International Publishing, Cham, 94–110.
[117]
Filippo Santoni de Sio and Jeroen van den Hoven. 2018. Meaningful human control over autonomous systems: A philosophical account. Front. Robot. AI 5 (2018), 15. DOI:
[118]
Daniela Schmid, Bernd Korn, and Neville Stanton. 2020. Evaluating the reduced flight deck crew concept using cognitive work analysis and social network analysis: Comparing normal and data-link outage scenarios. Cognit., Technol. Work 22 (022020). DOI:
[119]
Karma Sherif and Omolola Jewisimi. 2018. Electronic performance monitoring friend or foe: Empowering employees through data analytics. In Proceedings of the 24th Americas Conference on Information Systems. Association for Information Systems. Retrieved from https://aisel.aisnet.org/amcis2018/CultureIS/Presentations/7
[120]
J. Shi, J. Wan, H. Yan, and H. Suo. 2011. A survey of cyber-physical systems. In Proceedings of the International Conference on Wireless Communications and Signal Processing. 1–6. DOI:
[121]
Charles D. Spielberger, Fernando Gonzalez-Reigosa, Angel Martinez-Urrutia, Luiz F. S. Natalicio, and Diana S. Natalicio. 1971. The state-trait anxiety inventory. Revist. Interamer. Psicol./Interamer. J. Psychol. 5, 3 & 4 (1971).
[122]
Tim Claudius Stratmann and Susanne Boll. 2016. Demon hunt—The role of Endsley’s demons of situation awareness in maritime accidents. In Human-centered and Error-resilient Systems Development. Springer International Publishing, Cham, 203–212.
[123]
Alistair G. Sutcliffe, Neil A. M. Maiden, Shailey Minocha, and Darrel Manuel. 1998. Supporting scenario-based requirements engineering. IEEE Trans. Softw. Eng. 24, 12 (1998), 1072–1088.
[124]
Aurélien Vialon, Kenji Tei, and Samir Aknine. 2017. Soft-goal approximation context awareness of goal-driven self-adaptive systems. In Proceedings of the IEEE International Conference on Autonomic Computing. IEEE, 233–238. DOI:
[125]
Michael Vierhauser, Sean Bayley, Jane Wyngaard, Wandi Xiong, Jinghui Cheng, Joshua Huseman, Robyn R. Lutz, and Jane Cleland-Huang. 2021. Interlocking safety cases for unmanned autonomous systems in shared airspaces. IEEE Trans. Softw. Eng. 47, 5 (2021), 899–918. DOI:
[126]
Michael Vierhauser, Jane Cleland-Huang, Sean Bayley, Thomas Krismayer, Rick Rabiser, and Pau Grünbacher. 2018. Monitoring CPS at runtime—A case study in the UAV domain. In Proceedings of the 44th Euromicro Conference on Software Engineering and Advanced Applications. IEEE, 73–80.
[127]
Michael Vierhauser, Md Nafee Al Islam, Ankit Agrawal, Jane Cleland-Huang, and James Mason. 2021. Hazard analysis for human-on-the-loop interactions in sUAS systems. In Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. ACM, New York, 8–19.
[128]
Norha M. Villegas, Gabriel Tamura, Hausi A. Müller, Laurence Duchien, and Rubby Casallas. 2013. DYNAMICO: A reference model for governing control objectives and context relevance in self-adaptive software systems. In Software Engineering for Self-Adaptive Systems II: International Seminar, Dagstuhl Castle, Germany, October 24–29, 2010 Revised Selected and Invited Papers. Springer, 265–293.
[129]
Thomas Vogel and Holger Giese. 2012. A language for feedback loops in self-adaptive systems: Executable runtime megamodels. In Proceedings of the 7th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 129–138.
[130]
Thomas Vogel, Andreas Seibel, and Holger Giese. 2010. The role of models and megamodels at runtime. In Proceedings of the International Conference on Model Driven Engineering Languages and Systems. Springer, 224–238.
[131]
Guy H. Walker, Neville A. Stanton, Paul M. Salmon, and Daniel P. Jenkins. 2008. A review of sociotechnical systems theory: A classic concept for new command and control paradigms. Theor. Iss. Ergon. Sci. 9, 6 (2008), 479–499. DOI:
[132]
Martin Weißbach, Philipp Chrszon, Thomas Springer, and Alexander Schill. 2017. Decentrally coordinated execution of adaptations in distributed self-adaptive software systems. In Proceedings of the 11th International Conference on Self-adaptive and Self-organizing Systems. IEEE, 111–120.
[133]
Danny Weyns and Jesper Andersson. 2013. On the challenges of self-adaptation in systems of systems. Proceedings of the 1st ACM SIGSOFT/SIGPLAN International Workshop on Software Engineering for Systems-of-Systems. 47–51. DOI:
[134]
Choon Yue Wong and Gerald Seet. 2017. Workload, awareness and automation in multiple-robot supervision. Int. J. Advanc. Robot. Syst. 14, 3 (2017), 1–16. DOI:
[135]
Robert H. Wortham, Andreas Theodorou, and Joanna J. Bryson. 2017. Robot transparency: Improving understanding of intelligent behaviour for designers and users. In Proceedings of the Annual Conference towards Autonomous Robotic Systems. Springer, 274–289.
[136]
Enes Yigitbas, Kadiray Karakaya, Ivan Jovanovikj, and Gregor Engels. 2021. Enhancing human-in-the-loop adaptive systems through digital twins and VR interfaces. In Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems (SEAMS’21). IEEE, 30–40.
[137]
Yijun Yu, Danny Barthaud, Blaine A. Price, Arosha K. Bandara, Andrea Zisman, and Bashar Nuseibeh. 2019. LiveBox: A self-adaptive forensic-ready service for drones. IEEE Access 7 (2019), 148401–148412. DOI:
[138]
Zijian Zhang, Jaspreet Singh, Ujwal Gadiraju, and Avishek Anand. 2019. Dissonance between human and machine understanding. Proc. ACM Hum.-comput. Interact., Vol. 3. ACM, New York, 1–23. DOI:

Cited By

View all
  • (2024)Optimizing Resource Management With Edge and Network Processing for Disaster Response Using Insect Robot SwarmsExploring the Micro World of Robotics Through Insect Robots10.4018/979-8-3693-6150-4.ch003(39-60)Online publication date: 20-Sep-2024
  • (2024)Ethical Considerations in Drone CybersecurityCybersecurity Issues and Challenges in the Drone Industry10.4018/979-8-3693-0774-8.ch003(42-87)Online publication date: 26-Jan-2024
  • (2024)Knowledge-based Cyber Physical Security at Smart Home: A ReviewACM Computing Surveys10.1145/369876857:3(1-36)Online publication date: 11-Nov-2024
  • Show More Cited By

Index Terms

  1. Human–machine Teaming with Small Unmanned Aerial Systems in a MAPE-K Environment

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Autonomous and Adaptive Systems
      ACM Transactions on Autonomous and Adaptive Systems  Volume 19, Issue 1
      March 2024
      224 pages
      EISSN:1556-4703
      DOI:10.1145/3613495
      Issue’s Table of Contents

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 14 February 2024
      Online AM: 04 September 2023
      Accepted: 23 August 2023
      Revised: 24 June 2023
      Received: 30 October 2022
      Published in TAAS Volume 19, Issue 1

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Self-adaptive systems
      2. human-machine teaming
      3. autonomous systems
      4. MAPE-K

      Qualifiers

      • Research-article

      Funding Sources

      • US National Science Foundation (NSF)
      • University of Notre Dame
      • Linz Institute of Technology

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)754
      • Downloads (Last 6 weeks)112
      Reflects downloads up to 20 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Optimizing Resource Management With Edge and Network Processing for Disaster Response Using Insect Robot SwarmsExploring the Micro World of Robotics Through Insect Robots10.4018/979-8-3693-6150-4.ch003(39-60)Online publication date: 20-Sep-2024
      • (2024)Ethical Considerations in Drone CybersecurityCybersecurity Issues and Challenges in the Drone Industry10.4018/979-8-3693-0774-8.ch003(42-87)Online publication date: 26-Jan-2024
      • (2024)Knowledge-based Cyber Physical Security at Smart Home: A ReviewACM Computing Surveys10.1145/369876857:3(1-36)Online publication date: 11-Nov-2024
      • (2024)The IDEA of Us: An Identity-Aware Architecture for Autonomous SystemsACM Transactions on Software Engineering and Methodology10.1145/365443933:6(1-38)Online publication date: 28-Jun-2024
      • (2024)HIFuzz: Human Interaction Fuzzing for Small Unmanned Aerial VehiclesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642958(1-14)Online publication date: 11-May-2024
      • (2024)Engineering Ethical-Aware Collective Adaptive SystemsLeveraging Applications of Formal Methods, Verification and Validation. REoCAS Colloquium in Honor of Rocco De Nicola10.1007/978-3-031-73709-1_15(238-252)Online publication date: 27-Oct-2024

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media