The ImageCLEF Management System

Abstract

The ImageCLEF image retrieval track has been part of CLEF (Cross Language Evaluation Forum) since 2003. Organizing ImageCLEF and its large participation of research groups involves a considerable amount of work and data to manage. Goal of the management system described in this paper was to create a system for the organization of ImageCLEF to reduce manual work and professionalize the structures. All ImageCLEF sub tracks having a page in a single run submission system reduces work of organizers and makes submissions easier for participants. The system was developed as a web application using Java and JavaServer Faces (JSF) on Glassfish with a Postgres 8.3 database. The main functionality consists of user, collection and subtrack management as well as run submissions. The system has two main user groups, participants and administrators. The main task for participants is to register for subtasks and then submit runs. Administrators create collections for the sub tasks and can define the data and constraints for submissions. The described system was used for ImageCLEF 2009 with 86 subscribed users and more than 300 submitted runs in 7 subtracks. The system has proved to significantly reduce manual work and will be used for upcoming ImageCLEF events and other evaluation campaigns.