Skip to main content
SpringerLink
Log in

A benchmarking service for the manufacturing control research community

  • Published:
Journal of Intelligent Manufacturing Aims and scope Submit manuscript

Abstract

This paper presents the development—by the IMS Network of Excellence (cf. http://www. ims-noe.org)—of a web-based benchmarking service for manufacturing control systems. The paper first discusses the rationale behind this development. Next, the architecture and usage of the benchmarking service is presented and illustrated. Finally, the paper addresses the current status of the benchmarking service.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Bartolotta, A., Corradi, E., & Garetti, M. (1999). Developing an ontology for the modelling of manufacturing systems. In Proceedings of international conference on enterprise modelling, IEMC99. Verdal, Norway.

  • Bongaerts, L., Cavalieri, S., Macchi, M., Taisch, M., & Wyns, J. (1999a). A benchmark framework for manufacturing control. In H. Van Brussel, & P. Valckenaers (Eds.), Proceedings of the second international workshop on intelligent manufacturing systems IMS 1999 (pp. 225–236). Leuven, Belgium, September 22–24.

  • Bongaerts, L., Indrayadi, Y., Van Brussel, H., & Valckenaers, P. (1999b). Predictability of hierarchical, heterarchical, and holonic control. In: Proceedings of the 2nd international workshop on intelligent manufacturing systems 1999 (pp. 167–176). Leuven, Belgium, September 22–24.

  • A.W. Booth (2000) ArticleTitleObject oriented modeling for flexible manufacturing systems The Journal of Flexible Manufacturing Systems 10 301–314 Occurrence Handle10.1023/A:1008078001585

    Article  Google Scholar 

  • Brambilla, P., Terzi, S., & Cavalieri, S. (2004). Towards a performance measurement system for the evaluation of scheduling solutions. In Proceedings of the 11th IFAC symposium on information control problems in manufacturing, INCOM 2004, 6 pages, CD-ROM.

  • R.W. Brennan (2000) ArticleTitlePerformance comparison and analysis of reactive and planning-based control architectures for manufacturing Robotics and computer integrated manufacturing 16 191–200 Occurrence Handle10.1016/S0736-5845(00)00007-7

    Article  Google Scholar 

  • S. Cavalieri M. Macchi P. Valckenaers (2003) ArticleTitleBenchmarking the performance of manufacturing control systems: Design principles for a web-based simulated testbed Journal of Intelligent Manufacturing 14 IssueID1 43–57 Occurrence Handle10.1023/A:1022287212706

    Article  Google Scholar 

  • K.H. Choi S.C. Kim S.H. Yook (2000) ArticleTitleMulti-agent hybrid shop floor control systems International Journal of Production Research 38 IssueID17 4193–4203 Occurrence Handle10.1080/00207540050205019

    Article  Google Scholar 

  • Drummond, M. (1995). Scheduling benchmarks and related resources. URL: http://icwww. arc.nasa.gov/ic/projects/xfr/papers/benchmark-article.html.

  • Fox, B., & Ringer, M. (1995). Planning and scheduling benchmarks. Benchmarks secretary of the AAAI special interest group in manufacturing. URL: http://www.neosoft.com/.

  • S. Hanks M.E. Pollack P. Cohen (1993) ArticleTitleBenchmarks, testbeds, controlled experimentation, and the design of agent architectures. AI Magazine 14 IssueID4 17–42

    Google Scholar 

  • Jensen M.T. (2001). Robust and flexible scheduling with evolutionary computation. Ph.D. thesis, Department of Computer Science, University of Aarhus, Denmark

  • K. Kempf R. Uzsoy S. Smith K. Gary (2000) ArticleTitleEvaluation and comparison of production schedules Computers in Industry 42 203–220 Occurrence Handle10.1016/S0166-3615(99)00071-8

    Article  Google Scholar 

  • Mignon, D. J., Honkomp, S. J., Reklaitis, G. V. (1995). Framework for investigating schedule robustness under uncertainty. Computers in Chemical Engineering, 19(Supplement), S615–S620.

    Google Scholar 

  • Parunak, V. D. (1993). MASCOT: A virtual factory for research and development in manufacturing scheduling and control. ITI Tech Memo.

  • P. Peeters H. Van Brussel P. Valckenaers J. Wyns L. Bongaerts M. Kollingbaum T. Heikkilae (2001) ArticleTitlePheromone-based emergent shop floor control systems for flexible flow shops Artificial Intelligence in Engineering 15 IssueID4 343–352 Occurrence Handle10.1016/S0954-1810(01)00026-7

    Article  Google Scholar 

  • Saint Germain, B., Valckenaers, P., Van Brussel, H., Hadeli, Bochmann, O., Zamfirescu, C., Verstraete, P. (2003a). Multi-agent manufacturing control: An industrial case study. Intelligent Manufacturing Systems 2003, Proceedings from the 7th IFAC Workshop, Budapest, Hungary, 6–8 April 2003, ISBN 0-08-044289 7, pp. 207–212.

  • Saint Germain, B., Valckenaers, P., Zamfirescu, C., Bochmann, O., Van Brussel, H. (2003b). Benchmarking of manufacturing control systems in simulation. Proceedings of the 3rd international workshop on performance measurement (IFIP WG5.7 Special Interest Group on Performance Measurement), pp. 357–369, IFIP, Bergamo.

  • Terzi, S., Cavalieri, S., Macchi, M., Garetti, M., Panetto, H. (2003). Development of a reference architecture for benchmarking service of manufacturing systems. Intelligent manufacturing systems 2003, Proceedings from the 7th IFAC Workshop, Budapest, Hungary, 6–8 April 2003, ISBN 0-08-044289 7, pp. 193–200.

  • P. Valckenaers H. Brussel ParticleVan M. Kollingbaum O. Bochmann (2001) ArticleTitleMulti-agent coordination and control using stigmergy applied to manufacturing control Lecture Notes in Artificial Intelligence 2086 317–334

    Google Scholar 

  • H. Brussel ParticleVan J. Wyns P. Valckenaers L. Bongaerts P. Peeters (1998) ArticleTitleReference architecture for holonic manufacturing systems: PROSA Computers in Industry 37 255–274 Occurrence Handle10.1016/S0166-3615(98)00102-X

    Article  Google Scholar 

  • Wyns, J. (1999) Reference architecture for holonic manufacturing systems – the key to support evolution and reconfiguration. Ph.D. thesis, K.U. Leuven, ISBN 90-5682-164-4

  • C. Zamfirescu P. Valckenaers H. Hadeli Brussel ParticleVan B. Saint Germain (2003) ArticleTitleA case study for modular plant control Lecture notes in Artificial Intelligence 2744 268–279

    Google Scholar 

  • D. Zhang H.C. Zhang (1997) ArticleTitleAn object-oriented integration test-bed for process planning and production scheduling Integrated Computer-Aided Engineering 4 IssueID4 319–335

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. K.U.Leuven – P.M.A, Celestijnenlaan 300B, B-3001, Leuven, Belgium

    Paul Valckenaers, Bart Saint Germain, Paul Verstraete,  Hadeli & Hendrik Van Brussel

  2. Dipartimento di Ingegneria Industriale, Università degli Studi di Bergamo, Viale Marconi, 5, I-24044, Dalmine, Italy

    Sergio Cavalieri & Sergio Terzi

  3. Università degli Studi di Firenze, Via Cesare Lombroso 6/17, I-50134, Firenze, Italy

    Romeo Bandinelli

Authors
  1. Paul Valckenaers
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sergio Cavalieri
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bart Saint Germain
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Paul Verstraete
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hadeli
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Romeo Bandinelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Sergio Terzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Hendrik Van Brussel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Paul Valckenaers.

Additional information

Received: February 2005/Accepted: January 2006

Rights and permissions

Reprints and permissions

About this article

Cite this article

Valckenaers, P., Cavalieri, S., Germain, B.S. et al. A benchmarking service for the manufacturing control research community. J Intell Manuf 17, 667–679 (2006). https://doi.org/10.1007/s10845-006-0036-y

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10845-006-0036-y

Keywords

Search

Navigation