Abstract
Automated planning systems (APS) are maturing to the point that they have been used in experimental mode on both the NASA Deep Space 1 spacecraft and the NASA Earth Orbiter 1 satellite. One challenge is to improve the test coverage of APS to ensure that no unsafe plans can be generated. Unsafe plans can cause wasted resources or damage to hardware. Model checkers can be used to increase test coverage for large complex distributed systems and to prove the absence of certain types of errors. In this work we have built a generalized tool to convert the input models of an APS to Promela, the modeling language of the Spin model checker. We demonstrate on a mission sized APS input model, that we with Spin can explore a large part of the space of possible plans and verify with high probability the absence of unsafe plans.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Smith, M., Holzmann, G., Cucullu, G., Smith, B.: Model Checking Autonomous Planners: Even the Best Laid Plans Must be Verified. In: IEEE Aerospace Conference, Big Sky, Montana (March 2005)
Holzmann, G.: The Model Checker Spin. IEEE Transactions on Software Engineering 23(5), 279–295 (1997)
Holzmann, G.: The Spin Model Checker: Primer and Reference Manual 2003, 608 pgs. Addison-Wesley, Reading (2003)
Holzmann, G., Bosnacki, D.: The Design of a Multi-Core Extension of the Spin Model Checker. IEEE Transactions on Software Engineering 33(10), 659–674 (2007)
Khatib, L., Muscettola, N., Havelund, K.: Verification of Plan Models using UPPAAL. In: First Goddard Workshop on Formal Approaches to Agent-Based Systems (March 2000)
Havelund, K., Lowry, M., Penix, J.: Formal Analysis of a Space Craft Controller using Spin. IEEE Transactions on Software Engineering 27(8) (August 2001)
Havelund, K., Lowry, M., Park, S., Pecheur, C., Penix, J., Visser, W., White, J.L.: Formal Analysis of the Remote Agent - Before and After Flight. In: The Fifth NASA Langley Formal Methods Workshop, Virginia (June 2000)
Feather, M., Smith, B.: Automatic Generation of Test Oracles: From Pilot Studies to Applications. In: Proceedings of the Fourteenth IEEE International Conference on Automated Software Engineering (ASE 1999), Cocoa Beach, FL, October 1999, pp. 63–72. IEEE Computer Society, Los Alamitos (1999)
Penix, J., Pecheur, C., Havelund, K.: Using Model Checking to Validate AI Planner Domain Models. In: 23 Annual NASA Goddard Software Engineering Workshop, Goddard, Maryland (December 1998)
Cichy, B., Chien, S., Schaffer, S., Tran, D., Rabideau, G., Sherwood, R.: Validating the Autonomous EO-1 Science Agent. In: International Workshop on Planning and Scheduling for Space (IWPSS 2004), Darmstadt, Germany (June 2004)
Smith, M., Holzmann, G., Ettessami, K.: Events and Constraints: a Graphical Editor for Capturing Logic Properties of Programs. In: 5th International Symposium on Requirements Engineering, Toronto, Canada, August 2001, pp. 14–22 (2001)
Chien, S., Knight, R., Stechert, A., Sherwood, R., Rabideau, G.: Using Iterative Repair to Improve Responsiveness of Planning and Scheduling. In: International Conference on Artificial Intelligence Planning Systems (AIPS 2000), Breckenridge, CO (April 2000)
Fukunaga, A., Rabideau, G., Chien, S.: ASPEN: An Application Framework for Automated Planning and Scheduling of Spacecraft Control and Operations. In: Proceedings of International Symposium on Artificial Intelligence, Robotics and Automation in Space (i-SAIRAS 1997), Tokyo, Japan, pp. 181–187 (1997)
Smith, B., Sherwood, R., Govindjee, A., Yan, D., Rabideau, G., Chien, S., Fukunaga, A.: Representing Spacecraft Mission Planning Knowledge in Aspen. In: AIPS 1998 Workshop on Knowledge Engineering and Acquisition for Planning (June 1998); Workshop notes published as AAI Technical Report WS-98-03
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Havelund, K., Groce, A., Holzmann, G., Joshi, R., Smith, M. (2009). Automated Testing of Planning Models. In: Peled, D.A., Wooldridge, M.J. (eds) Model Checking and Artificial Intelligence. MoChArt 2008. Lecture Notes in Computer Science(), vol 5348. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00431-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-00431-5_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-00430-8
Online ISBN: 978-3-642-00431-5
eBook Packages: Computer ScienceComputer Science (R0)