Abstract
Experimental aerospace projects often require flight vehicle platforms for testing, such as high-altitude balloons, sounding rockets, unmanned aerial systems (UAS), and CubeSats. The system telemetry transmitted by these vehicles is crucial to understanding overall performance. A growing desire to implement greater levels of system autonomy and AI-enhanced control into these systems merits introducing rigorous safety analysis from formal methods techniques, such as Runtime Verification (RV). RV depends heavily upon the accuracy and robustness of the specifications it reasons over, and the task of developing a comprehensive set of system specifications often poses a significant challenge. To aid specification development for new systems, we provide an analysis on the process of implementing RV into four real aerospace systems of increasing complexity. We design and validate fourteen formal specifications for a real high-altitude balloon mission and draw on three past formal specification efforts on a sounding rocket, UAS Traffic Management (UTM) system, and CubeSat to compare specification patterns and overlapping system needs. We identify four common temporal logic subformulas for specifications within and between these systems, providing metrics on development resources, frequency, and perceived automation difficulty. We generalize our results and discuss considerations for automatically generating formal specifications in aerospace projects.
Keywords
This project/material is based upon work supported by the Iowa Space Grant Consortium under NASA Award No. 80NSSC20M0107. Work partially supported by NSF CAREER Award CNS-1552934, NASA ECF NNX16AR57G, and NSF PFI: BIC grant CNS-1257011. Thanks to Kaili Henry and Yang He for their work on specification development and Matthew Nelson for providing resources from HABET. Reproducibility artifacts are available at http://temporallogic.org/research/AerospaceSystems-NFM22/.
Z. Luppen—The work in this manuscript was performed for the completion of a master’s degree prior to Mr. Luppen’s employment at SpaceX. The data referenced herein is not related to nor gathered from any SpaceX resources.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
AeroVironment, I.: Vapor uas: Helicopter drone with drop delivery (2021). https://www.avinc.com/uas/vapor
Aurandt, A., Jones, P., Rozier, K.Y.: Runtime verification triggers real-time, autonomous fault recovery on the CySat-I. In: Proceedings of the 14th NASA Formal Methods Symposium (NFM 2022). Springer, Caltech, California, USA, May 2022
Balloonnews, Balloonnews: 10 ways that a high altitude balloon flight can go wrong August 2014. https://balloonnews.wordpress.com/2014/04/10/10-ways-that-a-high-altitude-balloon-flight-can-go-wrong/
Basta, T., Miller, S., Clark, R.T.: Weather Balloon Altitude Control System. Montana State University (2014–2015)
Bekker, D.L., et al.: Grifex payload data system architecture for on-orbit focal plane array evaluation. In: Proceedings of the American Geophysical Union, Fall Meeting 2012 (2012)
Cauwels, M., Hammer, A., Hertz, B., Jones, P.H., Rozier, K.Y.: Integrating runtime verification into an automated UAS traffic management system. In: Muccini, H., Avgeriou, P., Buhnova, B., Camara, J., Caporuscio, M., Franzago, M., Koziolek, A., Scandurra, P., Trubiani, C., Weyns, D., Zdun, U. (eds.) ECSA 2020. CCIS, vol. 1269, pp. 340–357. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59155-7_26
Dabney, J.B., Badger, J.M., Rajagopal, P.: Adding a verification view for an autonomous real-time system architecture. In: AIAA Scitech 2021 Forum, p. 0566, January 2021. https://doi.org/10.2514/6.2021-0566
ESRA Board of Directors: 2019 spaceport america cup (2019). http://www.soundingrocket.org/2019-sa-cup.html
Fisher, M., Mascardi, V., Rozier, K.Y., Schlingloff, B.-H., Winikoff, M., Yorke-Smith, N.: Towards a framework for certification of reliable autonomous systems. Auton. Agent. Multi-Agent Syst. 35(1), 1–65 (2020). https://doi.org/10.1007/s10458-020-09487-2
Garg, K.: Autonomous Navigation System for High Altitude Balloons. Ph.D. thesis, Luleå Technical University, Graphic Production 2019 (2019)
Geist, J., Rozier, K.Y., Schumann, J.: Runtime observer pairs and bayesian network reasoners on-board FPGAs: flight-certifiable system health management for embedded systems. In: Bonakdarpour, B., Smolka, S.A. (eds.) RV 2014. LNCS, vol. 8734, pp. 215–230. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11164-3_18
Gross, K.H., et al.: Formally Verified Run Time Assurance Architecture of a 6U CubeSat Attitude Control System, pp. 1–15. AIAA Infotech (2020). https://doi.org/10.2514/6.2016-0222, https://arc.aiaa.org/doi/abs/10.2514/6.2016-0222
Hammer, A., Cauwels, M., Hertz, B., Jones, P., Rozier, K.Y.: Integrating runtime verification into an automated UAS traffic management system. Innovations in Systems and Software Engineering: A NASA Journal, July 2021. https://doi.org/10.1007/s11334-021-00407-5
Hertz, B., Luppen, Z., Rozier, K.Y.: Integrating runtime verification into a sounding rocket control system. In: Dutle, A., Moscato, M.M., Titolo, L., Muñoz, C.A., Perez, I. (eds.) NFM 2021. LNCS, vol. 12673, pp. 151–159. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-76384-8_10
Kempa, B., Zhang, P., Jones, P.H., Zambreno, J., Rozier, K.Y.: Embedding Online Runtime Verification for Fault Disambiguation on Robonaut2. In: Proceedings of the 18th International Conference on Formal Modeling and Analysis of Timed Systems (FORMATS). Lecture Notes in Computer Science (LNCS), vol. TBD, p. TBD. Springer, Vienna, Austria (September 2020). TBD, http://research.temporallogic.org/papers/KZJZR20.pdf
eXploration Lab, T.M.: Grifex (2021). https://exploration.engin.umich.edu/blog/?page_id=2684
Li, J., Vardi, M.Y., Rozier, K.Y.: Satisfiability checking for mission-time LTL. In: Dillig, I., Tasiran, S. (eds.) CAV 2019. LNCS, vol. 11562, pp. 3–22. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-25543-5_1
Luppen, Z., Jacks, M., Baughman, N., Stilic, M., Nasers, R., Lee, D.Y., Rozier, K.Y., Cutler, J.: Runtime verification of the dynamic performance degradation of the grifex cubesat (under review). In: NASA Formal Methods. Springer International Publishing (2022)
M2I: Make to innovate (m:2:i) (2021). https://m2i.aere.iastate.edu/
M2I: Project goals (habet) (2021). https://m2i.aere.iastate.edu/habet/project-goals-and-scope-of-work/
Manna, Z., Pnueli, A.: Temporal Verification of Reactive Systems: Safety. Springer, New York (2012). https://books.google.com/books?id=lfIGCAAAQBAJ
Marshall, R.: Cutdown mechanisms, March 2021. https://sites.google.com/site/ki4mcw/Home/cutdown-mechanisms
Merkert, R., Bushell, J.: Managing the drone revolution: a systematic literature review into the current use of airborne drones and future strategic directions for their effective control. J. Air Transp. Manage. 89, 101929 (2020). https://doi.org/10.1016/j.jairtraman.2020.101929. https://doi.org/10.1016/j.jairtraman.2020.101929
Meyer, J.J., Flaten, J.A., Candler, G.V.: Pdf, April 2021
Tolmasoff, M., Santos, R.D., Venturini, C.: Improving mission success of cubesats. In: Proceedings of the U.S. Space Program Mission Assurance Improvement Workshop, May 2007
Moldwin, M., Sharma, S., Deshmukh, A., Scott, C., Cutler, J.: Machine learning algorithms for spacecraft magnetic field interference cancellation: enabling satellite magnetometry without a boom. Earth and Space Science Open Archive, p. 1 (2019). https://doi.org/10.1002/essoar.10500304.1. https://www.essoar.org/doi/abs/10.1002/essoar.10500304.1
Moosbrugger, P., Rozier, K.Y., Schumann, J.: R2U2: monitoring and diagnosis of security threats for unmanned aerial systems. Formal Methods Syst. Design 51(1), 31–61 (2017). https://doi.org/10.1007/s10703-017-0275-x
Muñoz, C., Carreño, V., Dowek, G.: Formal analysis of the operational concept for the small aircraft transportation system. In: Butler, M., Jones, C.B., Romanovsky, A., Troubitsyna, E. (eds.) Rigorous Development of Complex Fault-Tolerant Systems. LNCS, vol. 4157, pp. 306–325. Springer, Heidelberg (2006). https://doi.org/10.1007/11916246_16
NASA CubeSat Launch Initiative: CubeSat 101, 1st edn. California Polytechnic State University, San Luis Obispo (Cal Poly) CubeSat Systems Engineer Lab (2017)
Norton, C.D., Pasciuto, M.P., Pingree, P., Chien, S., Rider, D.: Spaceborne flight validation of nasa esto technologies. In: 2012 IEEE International Geoscience and Remote Sensing Symposium, pp. 5650–5653 (2012). https://doi.org/10.1109/IGARSS.2012.6352330
Papp, D.: Archery release becomes reusable balloon cutdown mechanism, March 2021. https://hackaday.com/2021/03/27/archery-release-becomes-reusable-balloon-cutdown-mechanism/
Peng, Z., Lu, Y., Miller, A., Johnson, C., Zhao, T.: A probabilistic model checking approach to analysing reliability, availability, and maintainability of a single satellite system. In: 2013 European Modelling Symposium, pp. 611–616, November 2013. https://doi.org/10.1109/EMS.2013.102
Phillips, T., et al.: Space weather ballooning. Space Weather 14(10), 697–703 (2016). https://doi.org/10.1002/2016SW001410. https://agupubs.onlinelibrary.wiley.com/doi/abs/10.1002/2016SW001410
Pike, L., Goodloe, A., Morisset, R., Niller, S.: Copilot: A hard real-time runtime monitor. In: Proceedings of the 1st International Conference on Runtime Verification. LNCS, Springer (November 2010), preprint available at https://leepike.github.io/pub_pages/rv2010.html
Pike, L., et al.: Copilot - realtime programming language and runtime verification framework, March 2022. https://copilot-language.github.io/
Pingree, P., et al.: Cove, marina, and the future of on-board processing (obp) platforms for cubesat science missions, December 2012
Reinbacher, T., Rozier, K.Y., Schumann, J.: Temporal-logic based runtime observer pairs for system health management of real-time systems. In: Ábrahám, E., Havelund, K. (eds.) TACAS 2014. LNCS, vol. 8413, pp. 357–372. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-642-54862-8_24
Rozier, K.Y., Schumann, J., Ippolito, C.: Intelligent Hardware-Enabled Sensor and Software Safety and Health Management for Autonomous UAS. Technical Memorandum NASA/TM-2015-218817, NASA, NASA Ames Research Center, Moffett Field, CA 94035, USA, May 2015
Rozier, K.Y.: Specification: the biggest bottleneck in formal methods and autonomy. In: Blazy, S., Chechik, M. (eds.) VSTTE 2016. LNCS, vol. 9971, pp. 8–26. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-48869-1_2
Rozier, K.Y., Schumann, J.: R2U2: tool overview. In: Proceedings of International Workshop on Competitions, Usability, Benchmarks, Evaluation, and Standardisation for Runtime Verification Tools (RV-CUBES). vol. 3, pp. 138–156. Kalpa Publications, Seattle, WA, USA, September 2017. TBD. https://easychair.org/publications/paper/Vncw
Schumann, J., Moosbrugger, P., Rozier, K.Y.: R2U2: monitoring and diagnosis of security threats for unmanned aerial systems. In: Bartocci, E., Majumdar, R. (eds.) RV 2015. LNCS, vol. 9333, pp. 233–249. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-23820-3_15
Schumann, J., Moosbrugger, P., Rozier, K.Y.: Runtime analysis with R2U2: a tool exhibition report. In: Falcone, Y., Sánchez, C. (eds.) RV 2016. LNCS, vol. 10012, pp. 504–509. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46982-9_35
Schumann, J., Rozier, K.Y., Reinbacher, T., Mengshoel, O.J., Mbaya, T., Ippolito, C.: Towards real-time, on-board, hardware-supported sensor and software health management for unmanned aerial systems. Int. J. Prognostics Health Manage. (IJPHM) 6(1), 1–27 (2015)
Science, H.A.: Intro to weather balloons (2021). https://www.highaltitudescience.com/pages/intro-to-weather-balloons
Seibert, G.: The history of sounding rockets and their contribution to European space research. ESA History Study Reports, November 2006
Wong, K.: Nasa’s deuce-carrying rocket fails to collect data due to technical glitch, November 2017. https://www.aerospace-technology.com/news/newsnasas-deuce-carrying-rocket-fails-to-collect-data-due-to-technical-glitch-5962942
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Luppen, Z. et al. (2022). Elucidation and Analysis of Specification Patterns in Aerospace System Telemetry. In: Deshmukh, J.V., Havelund, K., Perez, I. (eds) NASA Formal Methods. NFM 2022. Lecture Notes in Computer Science, vol 13260. Springer, Cham. https://doi.org/10.1007/978-3-031-06773-0_28
Download citation
DOI: https://doi.org/10.1007/978-3-031-06773-0_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-06772-3
Online ISBN: 978-3-031-06773-0
eBook Packages: Computer ScienceComputer Science (R0)