skip to main content
article

The risks of large organizations in developing complex systems

Published: 01 September 2005 Publication History

Abstract

The risks to the large organization of being able to complete the development of large software intensive systems on time and in budget include not just the defining and maintaining of proper requirements and work processes, but also in the defining and maintaining of the proper organizational work structures. Bureaucratic structures prevalent in large organizations can be inefficient and irrational especially in regards to unplanned surprises, exigencies, contingencies, and the emergent properties that are the normal part of the development and integration of first-of and one-of-a-kind large systems. All large software intensive systems, at their true core, are experiments, and experimentation and bureaucracy have proved to be, over time, destructively antithetical in basic values. Conway's law, first stated in 1968, has by the lights of 2005 provided only a superficial explanation of the antipathy of bureaucracy towards the unknown and risk. The belief that "[o]rganizations which design systems...are constrained to produce designs which are copies of the communication structures of these organizations", can be easily refuted by noting that hierarchical organizations have been quite successful in designing and implementing networked systems subsequent to the invention of Ethernet and TCP/IP. The example provided by Conway was not sufficient by itself to draw the conclusion was made, a common fallacy of cause and effect, but he was certainly on an interesting path of investigation. Large system development failures cannot be prevented soley through improved planning, requirements, processes and software. Improvement must also come from the recognition of the limits of organization, planning and process; the recognition of the basic antipathy between bureaucracy and risk; the recognition of the need for organizational structures that scale yet remain responsive; the recognition of the need for better attitudes towards faults and failures, and the recognition that in order to reduce the risks that are inherent when the technical becomes political, that one must reduce the risks of speaking truth to power. The short article that follows is intended to raise more questions than provide answers, and the references are intended to provide a starting point for further research.

References

[1]
Melvin E. Conway, "How Do Committees Invent", Datamation, 1968, http://www.melconway.com/research/committees.html
[2]
R. L. Ackoff, "The Future of Operational Research is Past", J Opl Res Soc, Vol 30, 2, 93--104. Pergamon Press Ltd, 1979. www.sociate.com/texts/AckoffFutureofORIsPast.pdf
[3]
C. West Churchman, "A Philosophy for Complexity, from Managing Complexity" http://groups.haas.berkeley.edu/gem/essays/complex.html
[4]
Frank W. Elwell, Verstehen: Max Weber's Home Page www.faculty.rsu.edu/~felwell/Theorists/Weber/Whome.htm
[5]
Michael C. Jackson, Systems Thinking: Creative Holism for Managers, Wiley, 2003
[6]
Jonathan B. King, "Learning to Solve the Right Problems: The Case of Nuclear Power in America" http://classes.bus.oregonstate.edu/ba350/REQUIRED%20READINGS/A-King.doc
[7]
M. Landau, "On The Concept of Self-correcting Organizations", public administration review, November/December 1973 pp. 533--542
[8]
M. Landau & R. Stout Jr., "To Manage Is Not To Control: or the Folly of Type II Errors", public administration review, March/April 1979, pp 148--156
[9]
Charles E. Lindblom "The Science of Muddling Through", Public Administration Review 19 (Spring 1959):80
[10]
Yogesh Malhotra, "Is Knowledge Management Really an Oxymoron?", http://www.brint.org/KMOxymoron.pdf
[11]
Henry Mintzberg, "A Note on that Dirty Word "Efficiency"" http://www.vrconline.ca/english/resources/print/10A-1-8.pdf
[12]
Elting E. Morison, Men, Machines, Modern Times, MIT Press, 1976
[13]
Peter G. Neumann, Computer Related Risks, Addison-Wesley, 1995
[14]
Wanda Orlikowski, "Awareness is the First and Critical Thing", www.dialogonleadership.org/Orlikowski-1999.html
[15]
Poppendiek, "Wicked Problems, May 2002" www.poppendiek.com/wicked.htm
[16]
H. Rittel, and M. Webber, "Dilemmas in a General Theory of Planning", pp 155--169, Policy Sciences Vol 4. 1973, Elsevier
[17]
Robert Schaefer, "Systems of Systems and Coordinated Atomic Actions", CACM, SEN, Vol.30, No.1, Jan 2005
[18]
Robert Schaefer, "Deeper Questions: The Metaproblem of Large Organizations Developing Complex Systems and the Limits of Process", CACM, SEN, Vol.30, No.4, July 2005
[19]
Edward Yourdon, Death March, Prentice Hall, 1999
[20]
Shoshana Zuboff, In The Age of the Smart Machine, Basic Books, 1988

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM SIGSOFT Software Engineering Notes
ACM SIGSOFT Software Engineering Notes  Volume 30, Issue 5
September 2005
462 pages
ISSN:0163-5948
DOI:10.1145/1095430
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2005
Published in SIGSOFT Volume 30, Issue 5

Check for updates

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Feb 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media