Skip to main content
Log in

Cautionary Tales: Lessons Learned About Unanticipated Behaviors in OC Systems

  • HAUPTBEITRAG
  • UNANTICIPATED BEHAVIORS IN OC SYSTEMS
  • Published:
Informatik-Spektrum Aims and scope

Abstract

Organic computing (OC) recognizes that the behaviors of deployed systems can be much more interesting than those predicted by simulation. By exploiting self-X properties such as self-organization, self-optimization, self-protection, and context-awareness, OC researchers are developing methods for creating robust, trustworthy systems. This paper presents two examples of unanticipated behaviors that we have observed in our OC test bed of robotic toy cars, an unmodeled phenomenon with surprisingly large effects and an agent behavior that was believed (incorrectly) to be so rare that it could be ignored. We discuss the use of computational reflection as a tool for identifying such situations, consider the challenges posed by the large variety of such situations faced by real systems, and list lessons learned about the importance of test beds for advancing OC research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Levinson N, Turner CS (1993) An investigation of the therac-25 accidents. IEEE Comput 26:18–41

    Article  Google Scholar 

  2. Lions PJL (1996) Ariane 5 flight 501 failure: Report by the inquiry board, tech. rep. http://esamultimedia.esa.int/docs/esa-x-1819eng.pdf, last access 15 October 2011

  3. Isbell D, Savage D (1999) Mars climate orbiter failure board releases report, numerous nasa actions underway in response. http://mars.jpl.nasa.gov/msp98/news/mco991110.html, last access 30 October 2011

  4. Garfinkel S (2005) History’s worst software bugs, Wired, November 2005. http://www.wired.com/software/coolapps/news/2005/11/69355, last access 12 August 2011

  5. IntelPR (2001) Intel identifies chipset design error, implementing solution. http://newsroom.intel.com/community/intel_newsroom/blog/2011/01/31/intel-identifies-chipset-design-error-implementing-solution, last access 8 September 2011

  6. Bongard J, Zykov V, Lipson H (2006) Resilient machines through continuous self-modeling. Science 314:1118–1121

    Article  Google Scholar 

  7. Bellman K, Landauer C, Nelson P (2008) Systems engineering for organic computing: The challenge of shared design and control between OC systems and their human engineers. In: Würtz R (ed) Organic Computing, vol 21 of Understanding Complex Systems, Springer, Berlin/Heidelberg, pp 25–80

  8. von Uexküll J (1957) Streifzüge durch die unwelten von tieren und menschen (1934), translated and edited by Schiller CH as: A stroll through the worlds of animals and men. In: Schiller CH (ed) Instinctive Behavior: The Development of a Modern Concept, International Universities Press, New York, pp 5–80. Also reprinted in Semiotica 89(4):319–391 (1992)

  9. Rüting T (2004) History and significance of jakob von uexküll and of his institute in Hamburg. Sign System Studies 32(1/2):35–72

    Google Scholar 

  10. Maes P (1987) Concepts and experiments in computational reflection. In: Conference proceedings on Object-oriented programming systems, languages and applications, OOPSLA ’87, ACM, New York, NY, USA, pp 147–155

  11. Shen J, Abraham JA (1998) Native mode functional test generation for processors with applications to self test and design validation. Proceedings of the International Test Conference, pp 990–999

  12. O’Hearn P, Reynolds J, Yang H (2001) Local reasoning about programs that alter data structures. In: Fribourg L (ed) CSL 2001 and EACSL 2001. LNCS, vol 2142, pp 1–19

  13. O’Hearn PW (2004) Resources, concurrency and local reasoning. In: Theoretical Computer Science, Springer, pp 49–67

  14. Cai H, Shao Z, Vaynberg A (2007) Certified self-modifying code. In: Proceedings of PLDI 2007, CA

  15. Hinchey MG, Rash JL, Rouff CA (2005) Requirements to design to code: Towards a fully formal approach to automatic code generation. Tech. Rep. NASA/TM-2005-212774

  16. Vassev EI (2008) Towards a framework for specification and code generation of automatic systems. PhD thesis, Montreal, PQ, Canada, Canada

  17. Wang L (2004) Issues on software testing for safety-critical real-time automation systems. In: The 23rd Digital Avionics Systems Conference, DASC 04, vol. 2, pp. 2

  18. Ren Z, Zhou G, Pyles A, Keally M, Mao W, Wang H (2011) Bodyt2: Throughput and time delay performance assurance for heterogeneous BSNs. In: 2011 Proceedings IEEE INFOCOM, pp 2750–2758

  19. Wang Y, Wang X (2010) Power optimization with performance assurance for multi-tier applications in virtualized data centers. In: 39th International Conference on Parallel Processing Workshops (ICPPW), pp 512–519

  20. Lama P, Zhou X (2012) Efficient server provisioning with control for end-to-end response time guarantee on multitier clusters. IEEE T Parall Distr 23:78–86

    Article  Google Scholar 

  21. Dalal S, Ho Y-Y, Jain A, McIntosh A (2002) Application performance assurance using end-to-end user level monitoring. In: Proceedings of International Conference on Dependable Systems and Networks, DSN 2002, pp 694–703

  22. Steghöfer J-P, Kiefhaber R, Leichtenstern K, Bernard Y, Klejnowski L, Reif W, Ungerer T, André E, Hähner J, Müller-Schloer C (2010) Trustworthy organic computing systems: Challenges and perspectives. In: Xie B, Branke J, Sadjadi S, Zhang D, Zhou X (eds) Autonomic and Trusted Computing, vol. 6407 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, pp 62–76

  23. Landauer C (2011) Abstract infrastructure for real systems: Reflection and autonomy in real time. In: Second IEEE Workshop on Self-Organizing Real-Time Systems, Newport Beach, California, USA, March 2011

  24. Bellman KL, Landauer C, Nelson PR (2010) Managing variable and cooperative time behavior. In: First IEEE Workshop on Self-Organizing Real-Time Systems, Carmona, Spain, May 2010

  25. Landauer C, Bellman KL (1996) Knowledge-based integration infrastructure for complex systems. Int J Intell Control Syst 1(1):133–153

    Article  Google Scholar 

  26. Landauer C, Bellman KL (1996) Integration systems and interaction spaces. In Proceedings of FroCoS’96: The First International Workshop on Frontiers of Combining Systems, 26–29 March 1996, Munich, pp 161–178

  27. Landauer C, Bellman KL (1997) Model-based simulation design with wrappings. In Proceedings of OOS ’97: Object Oriented Simulation Conference, Phoenix, pp 169–174

  28. Landauer C, Bellman KL (2011) How to build self-modeling systems (tutorial). In: Fifth IEEE International Conference on Self-Adaptive and Self-Organizing Systems, Ann Arbor, Michigan, USA

  29. Nguyen MH (2011) Implementation of a Self Organizing Real Time System Using the Wrappings Process. Master’s thesis, California State Polytechnic University Pomona, Pomona, Californa, USA

  30. Ogre3D http://www.ogre3d.org/, last access January 2012

  31. B. P. Library http://bulletphysics.org/, last access January 2012

  32. Blender http://www.blender.org/, last access January 2012

  33. OpenCV http://opencv.willowgarage.com/wiki/, last access January 2012

  34. Yang C-CJ (2011) Terrain Prediction for Demonstration of the Wrappings Infrastructure in Self-Organizing Real-Time Systems. Master’s thesis, California State Polytechnic University Pomona, Pomona, Californa, USA

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Phyllis R. Nelson.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nelson, P., Nguyen, M. & Yang, CC. Cautionary Tales: Lessons Learned About Unanticipated Behaviors in OC Systems. Informatik Spektrum 35, 87–92 (2012). https://doi.org/10.1007/s00287-012-0596-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00287-012-0596-5

Keywords

Navigation