skip to main content
10.1145/3357766.3359535acmconferencesArticle/Chapter ViewAbstractPublication PagessplashConference Proceedingsconference-collections
research-article

High-level mission specification for multiple robots

Published: 20 October 2019 Publication History

Abstract

Mobile robots are increasingly used in our everyday life to autonomously realize missions. A variety of languages has been proposed to support roboticists in the systematic development of robotic applications, ranging from logical languages with well-defined semantics to domain-specific languages with user-friendly syntax. The characteristics of both of them have distinct advantages, however, developing a language that combines those advantages remains an elusive task. We present PROMISE, a novel language that enables domain experts to specify missions on a high level of abstraction for teams of autonomous robots in a user-friendly way, while having well-defined semantics. Our ambition is to permit users to specify high-level goals instead of a series of specific actions the robots should perform. The language contains a set of atomic tasks that can be executed by robots and a set of operators that allow the composition of these tasks in complex missions. The language is supported by a standalone tool that permits mission specification through a textual and a graphical interface and that can be integrated within a variety of frameworks. We integrated PROMISE with a software platform providing functionalities such as motion control and planning. We conducted experiments to evaluate the correctness of the specification and execution of complex robotic missions with both simulators and real robots. We also conducted two user studies to assess the simplicity of PROMISE. The results show that PROMISE effectively supports users to specify missions for robots in a user-friendly manner.

Supplementary Material

MP4 File (3357766.3359535.mp4)
Video Presentation

References

[1]
2004. PAL Robotics. http://pal-robotics.com/.
[2]
2017. Bosch Center of AI. https://www.bosch-ai.com/.
[3]
Marco Autili, Lars Grunske, Markus Lumpe, Patrizio Pelliccione, and Antony Tang. 2015. Aligning qualitative, real-time, and probabilistic property specification patterns using a structured english grammar. Transactions on Software Engineering (2015).
[4]
Jonathan Bohren and Steve Cousins. 2010. The SMACH high-level executive [ROS news]. IEEE Robotics & Automation Magazine 17, 4 (2010), 18-20.
[5]
Darko Bozhinoski, Davide Di Ruscio, Ivano Malavolta, Patrizio Pelliccione, and Massimo Tivoli. 2015. FLYAQ: Enabling Non-expert Users to Specify and Generate Missions of Autonomous Multicopters. In International Conference on Automated Software Engineering (ASE). IEEE Computer Society.
[6]
Herman Bruyninckx, Markus Klotzbucher, Nico Hochgeschwender, Gerhard Kraetzschmar, Luca Gherardi, and Davide Brugali. 2013. The BRICS Component Model: A Model-based Development Paradigm for Complex Robotics Software Systems. In Proceedings of the 28th Annual ACM Symposium on Applied Computing (SAC '13). ACM, New York, NY, USA, 1758-1764.
[7]
Miguel Campusano and Johan Fabry. 2017. Live robot programming: The language, its implementation, and robot API independence. Science of Computer Programming 133 (2017), 1-19.
[8]
Federico Ciccozzi, Davide Di Ruscio, Ivano Malavolta, and Patrizio Pelliccione. 2016. Adopting MDE for Specifying and Executing Civilian Missions of Mobile Multi-Robot Systems. Journal of IEEE Access (2016).
[9]
Alessandro Cimatti, Edmund Clarke, Fausto Giunchiglia, and Marco Roveri. 1999. NuSMV: A new symbolic model verifier. In International conference on Computer Aided Verification (CAV). Springer, 495-499.
[10]
Davide Di Ruscio, Ivano Malavolta, Patrizio Pelliccione, and Massimo Tivoli. 2016. Automatic Generation of Detailed Flight Plans from Highlevel Mission Descriptions. In International Conference on Model Driven Engineering Languages and Systems (MODELS). ACM.
[11]
Patrick Doherty, Fredrik Heintz, and Jonas Kvarnstrom. 2013. Highlevel mission specification and planning for collaborative unmanned aircraft systems using delegation. Unmanned Systems 1, 01 (2013), 75-119.
[12]
Patrick Doherty, Fredrik Heintz, and David Landen. 2012. A Distributed Task Specification Language for Mixed-Initiative Delegation. In Principles and Practice of Multi-Agent Systems, Nirmit Desai, Alan Liu, and Michael Winikoff (Eds.). Springer Berlin Heidelberg.
[13]
Swaib Dragule, Bart Meyers, and Patrizio Pelliccione. 2017. A Generated Property Specification Language for Resilient Multirobot Missions. In Software Engineering for Resilient Systems, Alexander Romanovsky and Elena A. Troubitsyna (Eds.). Springer International Publishing, Cham, 45-61.
[14]
Eclipse. 2006. Xtext. https://www.eclipse.org/Xtext/.
[15]
Georgios E Fainekos, Antoine Girard, Hadas Kress-Gazit, and George J Pappas. 2009. Temporal logic motion planning for dynamic robots. Automatica 45, 2 (2009), 343-352.
[16]
Cameron Finucane, Gangyuan Jing, and Hadas Kress-Gazit. 2010. LTLMoP: Experimenting with language, temporal logic and robot control. In International Conference on Intelligent Robots and Systems (IROS). IEEE, 1988-1993.
[17]
Sergio Garcia, Claudio Menghi, Patrizio Pelliccione, Thorsten Berger, and Rebekka Wohlrab. 2018. An Architecture for Decentralized, Collaborative, and Autonomous Robots. In International Conference on Software Architecture (ICSA).
[18]
Sergio Garcia, Patrizio Pelliccione, Claudio Menghi, Thorsten Berger, and Tomas Bures. 2019. PROMISE Implementation. https://github.com/SergioGarG/PROMISE_implementation.
[19]
Sebastian Gotz, Max Leuthauser, Jan Reimann, Julia Schroeter, Christian Wende, Claas Wilke, and Uwe Aßmann. 2012. A Role-Based Language for Collaborative Robot Applications. In Leveraging Applications of Formal Methods, Verification, and Validation. Springer Berlin Heidelberg.
[20]
Meng Guo and Dimos V. Dimarogonas. 2015. Multi-agent plan reconfiguration under local LTL specifications. The International Journal of Robotics Research 34, 2 (2015), 218-235.
[21]
Meng Guo, Karl H Johansson, and Dimos Dimarogonas. 2013. Revising motion planning under linear temporal logic specifications in partially known workspaces. In International Conference on Robotics and Automation.
[22]
David Harel and Michal Politi. 1998. Modeling reactive systems with statecharts: the STATEMATE approach. McGraw-Hill, Inc.
[23]
Alan R. Hevner, Salvatore T. March, Jinsoo Park, and Sudha Ram. 2004. Design Science in Information Systems Research. MIS Q. (2004).
[24]
Gerard J. Holzmann. 2002. The Logic of Bugs. In Symposium on Foundations of Software Engineering (SIGSOFT '02/FSE-10).
[25]
Louis Hugues and Nicolas Bredeche. 2006. Simbad: an autonomous robot simulation package for education and research. In International Conference on Simulation of Adaptive Behavior. Springer, 831-842.
[26]
D. Isla. 2005. Handling Complexity in the Halo 2 AI. In In Game Developers Conference.
[27]
Markus Klotzbucher and Herman Bruyninckx. 2012. Coordinating robotic tasks and systems with rFSM statecharts. (2012).
[28]
Nathan Koenig and Andrew Howard. 2004. Design and use paradigms for gazebo, an open-source multi-robot simulator. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)(IEEE Cat. No. 04CH37566), Vol. 3. IEEE, 2149-2154.
[29]
Hadas Kress-Gazit. 2011. Robot challenges: Toward development of verication and synthesis techniques. IEEE Robotics & Automation Magazine 18, 4 (2011), 108-109.
[30]
Douglas C MacKenzie, Jonathan M Cameron, and Ronald C Arkin. 1995. Specification and execution of multiagent missions. In IEEE/RSJ International Conference on Intelligent Robots and Systems.
[31]
Stephane Magnenat, Philippe Retornaz, Michael Bonani, Valentin Longchamp, and Francesco Mondada. 2011. ASEBA: A Modular Architecture for Event-Based Control of Complex Robots. IEEE/ASME Transactions on Mechatronics 16, 2 (April 2011), 321-329.
[32]
Shahar Maoz and Jan Oliver Ringert. 2015. GR(1) Synthesis for LTL Specification Patterns. In Foundations of Software Engineering (FSE). ACM, 96-106.
[33]
Shahar Maoz and Jan Oliver Ringert. 2019. Spectra: A Specification Language for Reactive Systems. arXiv preprint arXiv:1904.06668 (2019).
[34]
Mauricio Matamoros, Caleb Rascon, Justin Hart, Dirk Holz, and Loy van Beek. 2018. RoboCup@Home 2018: Rules and Regulations. http://www.robocupathome.org/rules/2018_rulebook.pdf.
[35]
Claudio Menghi, Sergio García, Patrizio Pelliccione, and Jana Tumova. 2018. Multi-Robot LTL Planning Under Uncertainty. In International Symposium on Formal Methods (FM).
[36]
Claudio Menghi, Christos Tsigkanos, Thorsten Berger, and Patrizio Pelliccione. 2019. PsALM: Specification of Dependable Robotic Missions. In International Conference on Software Engineering (ICSE): Companion Proceeedings.
[37]
Claudio Menghi, Christos Tsigkanos, Thorsten Berger, Patrizio Pelliccione, and Carlo Ghezzi. 2018. Property specification patterns for robotic missions. In 2018 IEEE/ACM 40th International Conference on Software Engineering: Companion (ICSE-Companion). IEEE, 434-435.
[38]
Arne Nordmann, Nico Hochgeschwender, and Sebastian Wrede. 2014. A survey on domain-specific languages in robotics. In Simulation, Modeling, and Programming for Autonomous Robots. Springer, 195- 206.
[39]
James L. Peterson. 1977. Petri Nets. ACM Comput. Surv. 9, 3 (Sept. 1977), 223-252.
[40]
Emmanuel Pot, Jérôme Monceaux, Rodolphe Gelin, and Bruno Maisonnier. 2009. Choregraphe: a graphical tool for humanoid robot programming. In RO-MAN 2009-The 18th IEEE International Symposium on Robot and Human Interactive Communication. IEEE, 46-51.
[41]
Morgan Quigley, Ken Conley, Brian Gerkey, Josh Faust, Tully Foote, Jeremy Leibs, Rob Wheeler, and Andrew Y Ng. 2009. ROS: an opensource Robot Operating System. ICRA workshop on open source software 3, 3.2 (2009), 5.
[42]
European Union's Horizon 2020 research and innovation programme. 2017. Co4Robots. http://www.co4robots.eu/.
[43]
PAL Robotics. 2015. TIAGo. http://tiago.pal-robotics.com/.
[44]
C. Schlegel, T. Hassler, A. Lotz, and A. Steck. 2009. Robotic software systems: From code-driven to model-driven designs. In Advanced Robotics, 2009. ICAR 2009. International Conference on.
[45]
Douglas C. Schmidt. 2006. Guest Editor's Introduction: Model-Driven Engineering. Computer 39, 2 (Feb. 2006), 25-31.
[46]
Benjamin Schwartz, Ludwig Nägele, Andreas Angerer, and Bruce A. MacDonald. 2014. Towards a graphical language for quadrotor missions. CoRR (2014).
[47]
Daniel Castro Silva, Pedro Henriques Abreu, Luis Paulo Reis, and Eugénio Oliveira. 2014. Development of a Flexible Language for Mission Description for Multi-robot Missions. Inf. Sci. (2014).
[48]
SPARC. 2016. Robotics 2020 Multi-Annual Roadmap. https://eu-robotics.net/sparc/upload/about/files/H2020-Robotics-Multi-Annual-Roadmap-ICT-2016.pdf.
[49]
S. Srinivas, R. Kermani, K. Kim, Y. Kobayashi, and G. Fainekos. 2013. A graphical language for LTL motion and mission planning. In 2013 IEEE International Conference on Robotics and Biomimetics.
[50]
Andreas Steck, Alex Lotz, and Christian Schlegel. 2011. Model-driven Engineering and Run-time Model-usage in Service Robotics. In Proceedings of the 10th ACM International Conference on Generative Programming and Component Engineering (GPCE '11). 73-82.
[51]
Georgia Tech. 2006. MissionLab. https://www.cc.gatech.edu/ai/robotlab/research/MissionLab/.
[52]
Ulrike Thomas, Gerd Hirzinger, Bernhard Rumpe, Christoph Schulze, and Andreas Wortmann. 2013. A new skill based robot programming language using UML/P Statecharts. In 2013 IEEE International Conference on Robotics and Automation. IEEE, 461-466.
[53]
TypeFox. 2011. Xtend. https://www.eclipse.org/xtend/.
[54]
Alphan Ulusoy, Stephen L Smith, Xu Chu Ding, Calin Belta, and Daniela Rus. 2011. Optimal multi-robot path planning with temporal logic constraints. In International Conference on Intelligent Robots and Systems.
[55]
Vladimir Viyovi?, Mirjam Maksimovi?, and Branko Perisic. 2014. Sirius: A rapid development of DSM graphical editor. In IEEE 18th International Conference on Intelligent Engineering Systems INES 2014. IEEE, 233-238.
[56]
Fei-Yue Wang, Konstantinos J Kyriakopoulos, Athanasios Tsolkas, and George N Saridis. 1991. A Petri-net coordination model for an intelligent mobile robot. IEEE Transactions on Systems, Man, and Cybernetics 21, 4 (1991), 777-789.
[57]
W. Wei, K. Kim, and G. Fainekos. 2016. Extended LTLvis motion planning interface. In 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC). 004194-004199.
[58]
Melonee Wise and Tully Foote. 2010. Turtlebot 2. https://www.turtlebot.com/turtlebot2/.
[59]
Claes Wohlin, Per Runeson, Martin Host, Magnus C Ohlsson, Bjorn Regnell, and Anders Wesslen. 2012. Experimentation in software engineering. Springer Science & Business Media.
[60]
Eric M Wolff, Ufuk Topcu, and Richard M Murray. 2013. Automaton-guided controller synthesis for nonlinear systems with temporal logic. In International Conference on Intelligent Robots and Systems (IROS). IEEE, 4332-4339.
[61]
Vittorio A Ziparo, Luca Iocchi, Daniele Nardi, Pier Francesco Palamara, and Hugo Costelha. 2008. Petri net plans: a formal model for representation and execution of multi-robot plans. In Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems-Volume 1. International Foundation for Autonomous Agents and Multiagent Systems, 79-86.

Cited By

View all
  • (2024)Handling uncertainty in the specification of autonomous multi-robot systems through mission adaptationProceedings of the 19th International Symposium on Software Engineering for Adaptive and Self-Managing Systems10.1145/3643915.3644099(25-36)Online publication date: 15-Apr-2024
  • (2024)Towards a Unified Flow Description Language for CPPSs: An Example with Material Flows2024 IEEE 29th International Conference on Emerging Technologies and Factory Automation (ETFA)10.1109/ETFA61755.2024.10710795(1-8)Online publication date: 10-Sep-2024
  • (2024)Verification-Oriented Specification of Multi-agent Interaction PatternsAgents and Robots for reliable Engineered Autonomy10.1007/978-3-031-73180-8_3(38-53)Online publication date: 13-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SLE 2019: Proceedings of the 12th ACM SIGPLAN International Conference on Software Language Engineering
October 2019
215 pages
ISBN:9781450369817
DOI:10.1145/3357766
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2019

Permissions

Request permissions for this article.

Check for updates

Badges

Author Tags

  1. Multi-robot
  2. domain-specific language
  3. mission specification

Qualifiers

  • Research-article

Conference

SLE '19
Sponsor:

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)44
  • Downloads (Last 6 weeks)6
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Handling uncertainty in the specification of autonomous multi-robot systems through mission adaptationProceedings of the 19th International Symposium on Software Engineering for Adaptive and Self-Managing Systems10.1145/3643915.3644099(25-36)Online publication date: 15-Apr-2024
  • (2024)Towards a Unified Flow Description Language for CPPSs: An Example with Material Flows2024 IEEE 29th International Conference on Emerging Technologies and Factory Automation (ETFA)10.1109/ETFA61755.2024.10710795(1-8)Online publication date: 10-Sep-2024
  • (2024)Verification-Oriented Specification of Multi-agent Interaction PatternsAgents and Robots for reliable Engineered Autonomy10.1007/978-3-031-73180-8_3(38-53)Online publication date: 13-Oct-2024
  • (2024)Exploring the Convergence of Artificial Intelligence and Mechatronics in Autonomous DrivingComputational Intelligent Techniques in Mechatronics10.1002/9781394175437.ch9(297-316)Online publication date: 13-Sep-2024
  • (2023)Behavior Trees and State Machines in Robotics ApplicationsIEEE Transactions on Software Engineering10.1109/TSE.2023.326908149:9(4243-4267)Online publication date: Sep-2023
  • (2023)Mission Specification Patterns for Mobile Robots: Providing Support for Quantitative PropertiesIEEE Transactions on Software Engineering10.1109/TSE.2022.323005949:4(2741-2760)Online publication date: 1-Apr-2023
  • (2023)ROSMC: A High-Level Mission Operation Framework for Heterogeneous Robotic Teams2023 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA48891.2023.10161133(5473-5479)Online publication date: 29-May-2023
  • (2023)Command & Control in UAVs Fleets: Coordinating Drones for Ground Missions in Changing ContextsVerification and Evaluation of Computer and Communication Systems10.1007/978-3-031-49737-7_12(163-177)Online publication date: 19-Dec-2023
  • (2023)How to early integrate operational diagnosis objectives in model‐driven engineering processes: A methodological proposal based on fault and behavior treesSystems Engineering10.1002/sys.2174027:3(585-597)Online publication date: 26-Dec-2023
  • (2022)Assured Mission Adaptation of UAVsACM Transactions on Autonomous and Adaptive Systems10.1145/351309116:3-4(1-27)Online publication date: 6-Jul-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media