Amr Moussa
ABSTRACT
The rapid expansion of robotics relies on properly configuring and testing hardware and software. Due to the expense and hazard of real-world testing on hardware, robot system testing increasingly utilizes extensive simulation. Creating robot simulation tests requires specialized skills in robot programming and simulation tools. While there are many platforms and tool-kits to create these simulations, they can be cumbersome when combined with automated testing. We present Maktub: a tool for creating tests using Unity and ROS. Maktub leverages the extensive 3D manipulation capabilities of Unity to lower the barrier in creating system tests for robots. A key idea of Maktub is to make tests without needing robotic software development skills. A video demonstration of Maktub can be found here: https://youtu.be/c0Bacy3DlEE, and the source code can be found at https://github.com/RobotCodeLab/Maktub.
- A. Afzal, C. Le Goues, and C. Timperley. 5555. Mithra: Anomaly Detection as an Oracle for Cyberphysical Systems. IEEE Transactions on Software Engineering01 (oct 5555), 1–1. https://doi.org/10.1109/TSE.2021.3120680Google Scholar
- Afsoon Afzal, Deborah S Katz, Claire Le Goues, and Christopher S Timperley. 2021. Simulation for robotics test automation: Developer perspectives. In 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST). IEEE, 263–274.Google ScholarCross Ref
- Afsoon Afzal, Claire Le Goues, Michael Hilton, and Christopher Steven Timperley. 2020. A study on challenges of testing robotic systems. In 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST). IEEE, 96–107.Google ScholarCross Ref
- Víctor Hugo Andaluz, Fernando A Chicaiza, Cristian Gallardo, Washington X Quevedo, José Varela, Jorge S Sánchez, and Oscar Arteaga. 2016. Unity3D-MatLab simulator in real time for robotics applications. In International Conference on Augmented Reality, Virtual Reality and Computer Graphics. Springer, 246–263.Google ScholarCross Ref
- E. T. Barr, M. Harman, P. McMinn, M. Shahbaz, and S. Yoo. 2015. The Oracle Problem in Software Testing: A Survey. IEEE Transactions on Software Engineering 41, 05 (may 2015), 507–525. https://doi.org/10.1109/TSE.2014.2372785Google ScholarDigital Library
- Alessio Gambi, Tri Huynh, and Gordon Fraser. 2019. Generating effective test cases for self-driving cars from police reports. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 257–267.Google ScholarDigital Library
- Alessio Gambi, Marc Mueller, and Gordon Fraser. 2019. Automatically testing self-driving cars with search-based procedural content generation. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis. 318–328.Google ScholarDigital Library
- Sergio García, Daniel Strüber, Davide Brugali, Thorsten Berger, and Patrizio Pelliccione. 2020. Robotics Software Engineering: A Perspective from the Service Robotics Domain. Association for Computing Machinery, New York, NY, USA, 593–604. https://doi.org/10.1145/3368089.3409743Google ScholarDigital Library
- Uriel H Hernandez-Belmonte, Victor Ayala-Ramirez, Raul E Sanchez-Yanez, Carr Salamanca-Valle Km, and Palo Blanco. 2011. A mobile robot simulator using a game development engine. In Proceedings of the 1st Robotics Summer Meeting. 27–28.Google Scholar
- Mirella Santos Pessoa de Melo, José Gomes da Silva Neto, Pedro Jorge Lima da Silva, João Marcelo Xavier Natario Teixeira, and Veronica Teichrieb. 2019. Analysis and Comparison of Robotics 3D Simulators. In 2019 21st Symposium on Virtual and Augmented Reality (SVR). 242–251. https://doi.org/10.1109/SVR.2019.00049Google ScholarCross Ref
- Mojtaba Shahin, Muhammad Ali Babar, and Liming Zhu. 2017. Continuous Integration, Delivery and Deployment: A Systematic Review on Approaches, Tools, Challenges and Practices. IEEE Access PP (03 2017). https://doi.org/10.1109/ACCESS.2017.2685629Google Scholar
- Kenta Takaya, Toshinori Asai, Valeri Kroumov, and Florentin Smarandache. 2016. Simulation environment for mobile robots testing using ROS and Gazebo. 96–101. https://doi.org/10.1109/ICSTCC.2016.7790647Google Scholar
- Christopher Steven Timperley, Afsoon Afzal, Deborah S Katz, Jam Marcos Hernandez, and Claire Le Goues. 2018. Crashing simulated planes is cheap: Can simulation detect robotics bugs early?. In 2018 IEEE 11th International Conference on Software Testing, Verification and Validation (ICST). IEEE, 331–342.Google ScholarCross Ref
Index Terms
- Maktub: Lightweight Robot System Test Creation and Automation
Recommendations
Research on Test Flakiness: from Unit to System Testing
ASE '22: Proceedings of the 37th IEEE/ACM International Conference on Automated Software EngineeringTest flakiness has been a common problem in the software automation testing, affecting the effectiveness and productivity of test automation. Many studies have been published to tackle test flakiness in the software research community, and existing ...
System testing for object-oriented systems with test case prioritization
This paper presents an approach to generate test cases from UML 2.0 sequence diagrams and subsequently prioritize those test cases using model information encapsulated in the sequence diagrams. The test cases generated according to the proposed approach ...
Multi-objective black-box test case selection for system testing
GECCO '17: Proceedings of the Genetic and Evolutionary Computation ConferenceTesting is a fundamental task to ensure software quality. Regression testing aims to ensure that changes to software do not introduce new failures. As resources are often limited and testing comprises a vast amount of test cases, different regression ...
Comments