Skip to main content
SpringerLink
Log in

A review of interoperability assessment models

  • Review
  • Published:
Journal of Zhejiang University SCIENCE C Aims and scope Submit manuscript

Abstract

Interoperability is the ability of systems to provide services to and accept services from other systems, and to use the services exchanged so as to operate together in a more effective manner. The fact that interoperability can be improved means that the metrics for measuring interoperability can be defined. For the purpose of measuring the interoperability between systems, an interoperability assessment model is required. This paper deals with the existing interoperability assessment models. A comparative analysis among these models is provided to evaluate the similarities and differences in their philosophy and implementation. The analysis yields a set of recommendations for any party that is open to the idea of creating or improving an interoperability assessment model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Amanowicz, M., Gajewski, P., 1996. Military Communications and Information Systems Interoperability. Proc. IEEE Military Communications Conf., p.280–283. [doi:10.1109/MILCOM.1996.568629]

    Chapter  Google Scholar 

  • Berre, A.J., Elvesaeter, B., Figay, N., Guglielmina, C., Johnsen, S.G., Karlsen, D., Knothe, T., Lippe, S., 2007. The ATHENA Interoperability Framework. In: Gonçalves, R.J., Müller, J.P., Mertins, K., et al. (Eds.), Enterprise Interoperability II: New Challenges and Approaches, p.569–580. [doi:10.1007/978-1-84628-858-6_62]

    Chapter  Google Scholar 

  • Breitfelder, K., Messina, D., 2000. IEEE 100: the Authoritative Dictionary of IEEE Standards Terms (7th Ed.). IEEE Press. [doi:10.1109/IEEESTD.2000.322230]

    Google Scholar 

  • Carney, D., Oberndorf, P., 2004. Integration and Interoperability Models for Systems of Systems. Proc. System and Software Technology Conf., p.1–35.

    Google Scholar 

  • Chairman Joint Chiefs of Staff, 2004. Department of Defense Dictionary of Military and Associated Terms, Joint Publication 1-02. Washington, D.C., USA.

    Google Scholar 

  • Chairman Joint Chiefs of Staff, 2008. DoD Dictionary of Military and Associated Terms, Joint Publication 1-02. Washington, D.C., USA.

    Google Scholar 

  • Chen, D., 2006. Enterprise Interoperability Framework. Proc. Enterprise Modelling and Ontologies for Interoperability, EMOI-Interop.

    Google Scholar 

  • Chen, D., Vallespir, B., Daclin, N., 2008. An Approach for Enterprise Interoperability Measurement. Proc. MoDISE-EUS, p.1–12.

    Google Scholar 

  • Clark, T., Jones, R., 1999. Organisational Interoperability Maturity Model for C2. Proc. Command and Control Research and Technology Symp.

    Google Scholar 

  • Clark, T., Moon, T., 2001. Interoperability for joint and coalition operations. Austr. Defence Force J., (151):23–36.

    Google Scholar 

  • Department of Defense (DoD), 1998. Levels of Information Systems Interoperability (LISI).

    Google Scholar 

  • Department of Defense (DoD), 1999. Realizing the Potential of C4I. Technical Report, National Academy Press, Washington, D.C., USA.

    Google Scholar 

  • Department of Defense (DoD), 2001a. Chairman of the Joint Chiefs of Staff Instruction. CJCSI 2800.01C.

    Google Scholar 

  • Department of Defense (DoD), 2001b. DoD Dictionary of Military and Associated Terms, Joint Publication JP1-02. Washington, D.C., USA.

    Google Scholar 

  • Dimario, M.J., 2006. System of Systems Interoperability Types and Characteristics in Joint Command and Control. Proc. IEEE/SMC Int. Conf. on System of Systems Engineering, p.236–241. [doi:10.1109/SYSOSE.2006.1652302]

    Google Scholar 

  • DoD Directive, 1980. Standardization and Interoperability of Weapons Systems and Equipment within the North Atlantic Treaty Organization. DoD, Washington D.C., USA.

    Google Scholar 

  • Ford, T., Colombi, J., Graham, S., Jacques, D., 2007a. The Interoperability Score. Proc. 5th Annual Conf. on Systems Engineering Research, p.1–10.

    Google Scholar 

  • Ford, T., Colombi, J., Graham, S., Jacques, D., 2007b. Survey on Interoperability Measurement. Technical Report, DTIC Document.

    Google Scholar 

  • Ford, T., Colombi, J., Graham, S., Jacques, D., 2008. Measuring System Interoperability (An i-Score Improvement). CSER.

    Google Scholar 

  • Geraci, A., Katki, F., Mcmonegal, L., Meyer, B., Lane, J., Wilson, P., Radatz, J., Yee, M., Porteous, H., Springsteel, F., 1991. IEEE Standard Computer Dictionary: a Compilation of IEEE Standard Computer Glossaries. IEEE Press. [doi:10.1109/IEEESTD.1991.106963]

    Google Scholar 

  • Guijarro, L., 2009. Semantic interoperability in egovernment initiatives. Comput. Stand. Inter., 31(1):174–180. [doi:10. 1016/j.csi.2007.11.011]

    Article  Google Scholar 

  • Hall, J., Koukoulas, S., 2008. Semantic Interoperability for E-Business in the ISP Service Domain. ICE-B, p.390–396.

    Google Scholar 

  • Hamilton, J.A.Jr, Rosen, J.D., Summers, P.A., 2002. An Interoperability Road Map for C4ISR Legacy Systems. Technical Report, DTIC Document.

    Google Scholar 

  • Heiler, S., 1995. Semantic interoperability. ACM Comput. Surv., 27(2):271–273. [doi:10.1145/210376.210392]

    Article  Google Scholar 

  • Jochem, R., 2010. Enterprise Interoperability Assessment. 8th Int. Conf. of Modeling and Simulation, p.1–9.

    Google Scholar 

  • Kasunic, M., 2001. Measuring Systems Interoperability: Challenges and Opportunities. Version 1.0. Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA.

    Google Scholar 

  • Kasunic, M., 2003. Measuring Systems Interoperability. Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA, p.1–18.

    Google Scholar 

  • Kasunic, M., Anderson, W., 2004. Measuring Systems Interoperability: Challenges and Opportunities. Technical Report CMU/SEI-2004-TN-003, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA.

    Google Scholar 

  • Kinder, T., 2003. Mrs Miller moves house: the interoperability of local public services in Europe. J. Eur. Soc. Policy, 13(2):141–157. [doi:10.1177/0958928703013002003]

    Article  Google Scholar 

  • Kingston, G., 2005. An Organisational Interoperability Agility Model. Technical Report, Defence Science and Technology Organisation Canberra (Australia).

    Google Scholar 

  • Kosanke, K., 2006. ISO Standards for Interoperability: a Comparison. Interperability of Enterprise Software and Applications. Springer, p.55–64. [doi:10.1007/1-84628-152-0_6]

    Chapter  Google Scholar 

  • LaVean, G.E., 1980. Interoperability in defense communications. IEEE Trans. Commun., 28(9):1445–1455. [doi:10.1109/TCOM.1980.1094832]

    Article  Google Scholar 

  • Leite, M.J., 1998. Interoperability Assessment. Technical Report, PRC Inc., Arlington, VA.

    Google Scholar 

  • Levine, L., Meyers, B.C., Morris, E.J., 2003. Technical Note CMU/SEI-2003-TN-016. Proc. System of Systems Interoperability Workshop.

    Google Scholar 

  • Lewis, G.A., Wrage, L., 2006. Model Problems in Technologies for Interoperability: Web Services. Technical Report CMU/SEI-2006-TN-021.

    Google Scholar 

  • Mensh, D., Kite, R., Darby, P., 1989. A methodology for quantifying interoperability. Nav. Eng. J., 101.3:251.

    Article  Google Scholar 

  • Meyers, B.C., Smith, J.D., 2007. Programmatic Interoperability. Technical Report CMU/SEI-2008-TN-012, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA.

    Google Scholar 

  • Meyers, B.C., Monarch, I., Levine, L., Smith, J.I.I., 2005. Including Interoperability in the Acquisition Process. CMU/SEI-2005-TR-004, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA.

    Google Scholar 

  • Morris, E., Levine, L., Meyers, C., Place, P., Plakosh, D., 2004a. System of Systems Interoperability (SOSI): Final Report. Citeseer, ESC-TR-2004-004.

    Google Scholar 

  • Morris, E., Levine, L., Meyers, C., Plakosh, D., 2004b. System of Systems Interoperability (SOSI): Final Report. CMU/SEI-2004-TR-004, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA.

    Google Scholar 

  • Munk, S., 2002. An analysis of basic interoperability related terms, system of interoperability types. Acad. Appl. Res. Mil. Sci., 1:117–131.

    Google Scholar 

  • Novakouski, M., Lewis, G.A., 2012. Interoperability in the E-Government. CMU/SEI-2011-TN-014, Carnegie Mellon University, Pittsburgh, PA.

    Google Scholar 

  • Presson, P.E., 1983. Software Metrics and Interoperability. Proc. AIAA Computers in Aerospace IV Conf. [doi:10.2514/6.1983-2406]

    Google Scholar 

  • Radatz, J., Geraci, A., Katki, F., 1990. IEEE Standard Glossary of Software Engineering Terminology. IEEE Standard, p.1–84. [doi:10.1109/IEEESTD.1990.101064]

    Google Scholar 

  • Ruggaber, R., 2005. ATHENA — Advanced Technologies for Interoperability of Heterogeneous Enterprise Networks and Their Applications. In: Konstantas, D., Bourrières, J.P., Léonard, M., et al. (Eds.), Interoperability of Enterprise Software and Applications. Springer London, p.459–460. [doi:10.1007/1-84628-152-0_45]

    Google Scholar 

  • Schade, U., 2005. Towards the Edge and Beyond: the Role of Interoperability. 10th Int. Command and Control Research and Technology Symp.

    Google Scholar 

  • Stewart, K., 2004. Non-technical Interoperability: the Challenge of Command Leadership in Multinational Operations. ADA465749, QinetiQ Ltd., Centre for Human Sciences, Farnborough, United Kingdom.

    Google Scholar 

  • Stewart, K., Clarke, H., Goillau, P., Verrall, N., Widdowson, M., 2004. Non-technical Interoperability in Multinational Forces. QinetiQ Ltd., Centre for Human Sciences, Farnborough, United Kingdom.

    Google Scholar 

  • United States Joint Forces Command, 2001. Capstone Requirements Document: Global Information Grid (GIG). JROCM 134-01.

    Google Scholar 

  • USA and Australia, 2004. Review of Operational Level Interoperability Between the Military Forces of Australia and the United States of America.

    Google Scholar 

  • van der Veer, H., Wiles, A., 2008. Achieving Technical Interoperability—the ETSI Approach. ETSI White Paper.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Computer Science & Information Technology, University of Malaya, Kuala Lumpur, 50603, Malaysia

    Reza Rezaei, Thiam-kian Chiew & Sai-peck Lee

Authors
  1. Reza Rezaei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thiam-kian Chiew
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sai-peck Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Reza Rezaei.

Additional information

Project (No. RG055-11ICT) supported by the University of Malaya Research Grant (UMRG), Malaysia

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rezaei, R., Chiew, Tk. & Lee, Sp. A review of interoperability assessment models. J. Zhejiang Univ. - Sci. C 14, 663–681 (2013). https://doi.org/10.1631/jzus.C1300013

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1631/jzus.C1300013

Key words

CLC number

Search

Navigation