Abstract
Organic computing (OC) recognizes that the behaviors of deployed systems can be much more interesting than those predicted by simulation. By exploiting self-X properties such as self-organization, self-optimization, self-protection, and context-awareness, OC researchers are developing methods for creating robust, trustworthy systems. This paper presents two examples of unanticipated behaviors that we have observed in our OC test bed of robotic toy cars, an unmodeled phenomenon with surprisingly large effects and an agent behavior that was believed (incorrectly) to be so rare that it could be ignored. We discuss the use of computational reflection as a tool for identifying such situations, consider the challenges posed by the large variety of such situations faced by real systems, and list lessons learned about the importance of test beds for advancing OC research.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Levinson N, Turner CS (1993) An investigation of the therac-25 accidents. IEEE Comput 26:18–41
Lions PJL (1996) Ariane 5 flight 501 failure: Report by the inquiry board, tech. rep. http://esamultimedia.esa.int/docs/esa-x-1819eng.pdf, last access 15 October 2011
Isbell D, Savage D (1999) Mars climate orbiter failure board releases report, numerous nasa actions underway in response. http://mars.jpl.nasa.gov/msp98/news/mco991110.html, last access 30 October 2011
Garfinkel S (2005) History’s worst software bugs, Wired, November 2005. http://www.wired.com/software/coolapps/news/2005/11/69355, last access 12 August 2011
IntelPR (2001) Intel identifies chipset design error, implementing solution. http://newsroom.intel.com/community/intel_newsroom/blog/2011/01/31/intel-identifies-chipset-design-error-implementing-solution, last access 8 September 2011
Bongard J, Zykov V, Lipson H (2006) Resilient machines through continuous self-modeling. Science 314:1118–1121
Bellman K, Landauer C, Nelson P (2008) Systems engineering for organic computing: The challenge of shared design and control between OC systems and their human engineers. In: Würtz R (ed) Organic Computing, vol 21 of Understanding Complex Systems, Springer, Berlin/Heidelberg, pp 25–80
von Uexküll J (1957) Streifzüge durch die unwelten von tieren und menschen (1934), translated and edited by Schiller CH as: A stroll through the worlds of animals and men. In: Schiller CH (ed) Instinctive Behavior: The Development of a Modern Concept, International Universities Press, New York, pp 5–80. Also reprinted in Semiotica 89(4):319–391 (1992)
Rüting T (2004) History and significance of jakob von uexküll and of his institute in Hamburg. Sign System Studies 32(1/2):35–72
Maes P (1987) Concepts and experiments in computational reflection. In: Conference proceedings on Object-oriented programming systems, languages and applications, OOPSLA ’87, ACM, New York, NY, USA, pp 147–155
Shen J, Abraham JA (1998) Native mode functional test generation for processors with applications to self test and design validation. Proceedings of the International Test Conference, pp 990–999
O’Hearn P, Reynolds J, Yang H (2001) Local reasoning about programs that alter data structures. In: Fribourg L (ed) CSL 2001 and EACSL 2001. LNCS, vol 2142, pp 1–19
O’Hearn PW (2004) Resources, concurrency and local reasoning. In: Theoretical Computer Science, Springer, pp 49–67
Cai H, Shao Z, Vaynberg A (2007) Certified self-modifying code. In: Proceedings of PLDI 2007, CA
Hinchey MG, Rash JL, Rouff CA (2005) Requirements to design to code: Towards a fully formal approach to automatic code generation. Tech. Rep. NASA/TM-2005-212774
Vassev EI (2008) Towards a framework for specification and code generation of automatic systems. PhD thesis, Montreal, PQ, Canada, Canada
Wang L (2004) Issues on software testing for safety-critical real-time automation systems. In: The 23rd Digital Avionics Systems Conference, DASC 04, vol. 2, pp. 2
Ren Z, Zhou G, Pyles A, Keally M, Mao W, Wang H (2011) Bodyt2: Throughput and time delay performance assurance for heterogeneous BSNs. In: 2011 Proceedings IEEE INFOCOM, pp 2750–2758
Wang Y, Wang X (2010) Power optimization with performance assurance for multi-tier applications in virtualized data centers. In: 39th International Conference on Parallel Processing Workshops (ICPPW), pp 512–519
Lama P, Zhou X (2012) Efficient server provisioning with control for end-to-end response time guarantee on multitier clusters. IEEE T Parall Distr 23:78–86
Dalal S, Ho Y-Y, Jain A, McIntosh A (2002) Application performance assurance using end-to-end user level monitoring. In: Proceedings of International Conference on Dependable Systems and Networks, DSN 2002, pp 694–703
Steghöfer J-P, Kiefhaber R, Leichtenstern K, Bernard Y, Klejnowski L, Reif W, Ungerer T, André E, Hähner J, Müller-Schloer C (2010) Trustworthy organic computing systems: Challenges and perspectives. In: Xie B, Branke J, Sadjadi S, Zhang D, Zhou X (eds) Autonomic and Trusted Computing, vol. 6407 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, pp 62–76
Landauer C (2011) Abstract infrastructure for real systems: Reflection and autonomy in real time. In: Second IEEE Workshop on Self-Organizing Real-Time Systems, Newport Beach, California, USA, March 2011
Bellman KL, Landauer C, Nelson PR (2010) Managing variable and cooperative time behavior. In: First IEEE Workshop on Self-Organizing Real-Time Systems, Carmona, Spain, May 2010
Landauer C, Bellman KL (1996) Knowledge-based integration infrastructure for complex systems. Int J Intell Control Syst 1(1):133–153
Landauer C, Bellman KL (1996) Integration systems and interaction spaces. In Proceedings of FroCoS’96: The First International Workshop on Frontiers of Combining Systems, 26–29 March 1996, Munich, pp 161–178
Landauer C, Bellman KL (1997) Model-based simulation design with wrappings. In Proceedings of OOS ’97: Object Oriented Simulation Conference, Phoenix, pp 169–174
Landauer C, Bellman KL (2011) How to build self-modeling systems (tutorial). In: Fifth IEEE International Conference on Self-Adaptive and Self-Organizing Systems, Ann Arbor, Michigan, USA
Nguyen MH (2011) Implementation of a Self Organizing Real Time System Using the Wrappings Process. Master’s thesis, California State Polytechnic University Pomona, Pomona, Californa, USA
Ogre3D http://www.ogre3d.org/, last access January 2012
B. P. Library http://bulletphysics.org/, last access January 2012
Blender http://www.blender.org/, last access January 2012
OpenCV http://opencv.willowgarage.com/wiki/, last access January 2012
Yang C-CJ (2011) Terrain Prediction for Demonstration of the Wrappings Infrastructure in Self-Organizing Real-Time Systems. Master’s thesis, California State Polytechnic University Pomona, Pomona, Californa, USA
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nelson, P., Nguyen, M. & Yang, CC. Cautionary Tales: Lessons Learned About Unanticipated Behaviors in OC Systems. Informatik Spektrum 35, 87–92 (2012). https://doi.org/10.1007/s00287-012-0596-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00287-012-0596-5