Skip to main content

Advertisement

SpringerLink
Log in

DILIGENT: integrating digital library and Grid technologies for a new Earth observation research infrastructure

  • REGULAR PAPER
  • Published:
International Journal on Digital Libraries Aims and scope Submit manuscript

Abstract

This paper introduces DILIGENT, a digital library infrastructure built by integrating digital library and Grid technologies and resources. This infrastructure allows different communities to dynamically build specialised digital libraries capable to support the entire e-Science knowledge production and consumption life-cycle by using shared computing, storage, content, and application resources. The paper presents some of the main software services that implement the DILIGENT system. Moreover, it exemplifies the provided features by presenting how the DILIGENT infrastructure is being exploited in supporting the activity of user communities working in the Earth Science Environmental sector.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. DIGITAL LIBRARIES: Future Directions for a European Research Programme. Brainstorming report, DELOS, San Cassiano, Alta Badia, Italy (2001)

  2. Altintas, I., Berkley, C., Jaeger, E., Jones, M., Ludäscher, B., Mock, S.: Kepler: An Extensible System for Design and Execution of Scientific Workflows. In: Franklin, M.J., Moon, B., Ailamaki, A. (eds.) Proc. of the 16th Intl. Conf. on Scientific and Statistical Database Management (SSDBM’04), Santorini Island, Greece, June 21–23 (2004)

  3. Arms, W.Y.: Digital Libraries. The MIT Press (2001)

  4. Atkins, D.E., Droegemeier, K.K., Feldman, S.I., Garcia- Molina, H., Klein, M.L., Messerschmitt, D.G., Messina, P., Ostriker, J.P., Wright, M.H.: Revolutionizing science and engineering through cyberinfrastructure. Report of the National Science Foundation Blue-Ribbon Advisory Panel on Cyberinfrastructure (2003)

  5. Banks, T.: Web Services Resource Framework (WSRF)—Primer. Committee draft 01, OASIS (2005). http://docs.oasis-open.org/wsrf/wsrf-primer-1.2-primer-cd-01.pdf

  6. Booth, D., Haas, H., McCabe, F., Newcomer, E., Champion, M., Ferris, C., Orchard, D.: Web Services Architecture. Tech. rep., W3C (2004). URL: http://www.w3.org/TR/ws-arch/. W3C Working Group Note

  7. Bush V. (1945). As we may think. The Atlantic Monthly 176(1): 101–108

    Google Scholar 

  8. Candela, L., Castelli, D., Pagano, P., Simi, M.: Moving digital Library Service Systems to the Grid. In: Türker, C., Agosti, M., Schek, H.J. (eds.) Peer-to-Peer, Grid, and Service-Orientation in Digital Library Architectures, no. 3664 in Lecture Notes in Computer Science, pp. 236–259. Springer, Heidelberg (2005)

  9. Candela, L., Castelli, D., Pagano, P., Simi, M.: OpenDLibG: Extending OpenDLib by exploiting a gLite Grid Infrastructure. In: 10th European Conference on Research and Advanced Technology for Digital Libraries, ECDL 2006 (2006)

  10. Castelli, D., Candela, L., Pagano, P., Simi, M.: DILIGENT: A DL Infrastructure for Supporting Joint Research. In: Society, I.C. (ed.) 2nd IEEE-CS International Symposium Global Data Interoperability—Challenges and Technologies, pp. 56–69 (2005)

  11. Czajkowski, K., Fitzgerald, S., Foster, I., Kesselman, C.: Grid information services for distributed resource sharing. In: Proceedings of the Tenth IEEE International Symposium on High-Performance Distributed Computing (HPDC-10). IEEE Press (2001)

  12. DILIGENT: A DIgital Library Infrastructure on Grid ENabled Technology. http://www.diligentproject.org/. IST-2003-004260

  13. Droegemeier, K.K., Chandrasekar, V., Clark, R., Gannon, D., Graves, S., Joseph, E., Ramamurthy, M., Wilhelmson, R., Brewster, K., DOmenico, B., Leyton, T., Morris, V., Murray, D., Plate, B., Ramachandran, R., Reed, D., Rushing, J., Weber, D., Wilson, A., Xue, M., Yalda, S.: Linked environments for atmospheric discovery (lead): a cyberinfrastructure for mesoscale meteorology research and education. In: 20th Conf. on Interactive Info. Processing Systems for Meteorology, Oceanography, and Hydrology, Seattle. Am. Meteor. Soc. (2004)

  14. EGEE: Enabling Grids for E-sciencE. http://public.eu-egee.org/. INFSO 508833

  15. EGEE: gLite: Lightweight middleware for Grid computing. http://glite.web.cern.ch/glite/

  16. Foster, I.: What is the Grid? A three point checklist. GRIDtoday 1(6) (2002)

  17. Foster, I., Kesselman, C.: The Grid: Blueprint for a Future Computing Infrastructure. Morgan-Kaufmann (2004)

  18. Foster, I., Kesselman, C., Nick, J., Tuecke, S.: The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration. Open Grid Service Infrastructure WG, Global Grid Forum (2002)

  19. Foster I., Kesselman C. and Tuecke S. (2001). The anatomy of the Grid: enabling scalable virtual organization. Int. J. High Perform. Comput. Appl. 15(3): 200–222

    Article  Google Scholar 

  20. Fox E.A., Akscyn R.M., Furuta R. and Leggett J.J. (1995). Digital Libraries. Commun. ACM 38(4): 23–28

    Google Scholar 

  21. Fox E.A. and Marchionini G. (1998). Toward a worldwide Digital Library. Commun. ACM 41(4): 29–32

    Article  Google Scholar 

  22. Geisler, G., Giersch, S., McArthur, D., McClelland, M.: Creating virtual collections in Digital Libraries: Benefits and Implementation Issues. In: Proceedings of the Second ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 210–218. ACM Press (2002). DOI:http://doi.acm.org/10.1145/544220.544265

  23. Gillmann, M., Weikum, G., Wonner, W.: Workflow management with service quality guarantees. In: Franklin, M.J., Moon, B., Ailamaki, A. (eds.) Proc. of the 2002 ACM SIGMOD Int. Conf. on Management of Data, Madison, June 3–6, pp. 228–239. ACM Press (2002)

  24. Globus Alliance: The Globus Alliance Website. http://www.globus.org/

  25. Ioannidis Y. (2005). Digital libraries at a crossroads. Int. J. Digital Libraries 5(4): 255–265

    Article  MathSciNet  Google Scholar 

  26. Ioannidis Y., Maier D., Abiteboul S., Buneman P., Davidson S., Fox E., Halevy A., Knoblock C., Rabitti F., Schek H. and Weikum G. (2005). Digital library information-technology infrastructures. Int. J. Digital Libraries 5(4): 266–274

    Article  Google Scholar 

  27. Lagoze, C., Arms, W., Gan, S., Hillmann, D., Ingram, C., Krafft, D., Marisa, R., Phipps, J., Saylor, J., Terrizzi, C., Hoehn, W., Millman, D., Allan, J., Guzman-Lara, S., Kalt, T.: Core services in the architecture of the national science digital library (NSDL). In: Proceedings of the second ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 201–209. ACM Press (2002). DOI:http://doi.acm.org/10.1145/544220.544264

  28. Lagoze, C., Krafft, D.B., Payette, S., Jesuroga, S.: What is a Digital Library anyway? D-Lib Magaz. 11(11) (2005)

  29. Lagoze, C., Payette, S., Shin, E., Wilper, C.: Fedora: An architecture for complex objects and their relationships. J. Digital Libraries, Special Issue on Complex Objects (2005)

  30. Lagoze, C., Van de Sompel, H.: The OAI Protocol for Metadata Harvesting. http://www.openarchives.org/OAI/openarchivesprotocol.html

  31. Lagoze, C., Van de Sompel, H.: The open archives initiative: building a low-barrier interoperability framework. In: Proceedings of the first ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 54–62. ACM Press (2001). DOI:http://doi.acm.org/10.1145/379437.379449

  32. Larson, R.R., Sanderson, R.: Grid-based digital libraries: Cheshire3 and distributed retrieval. In: JCDL ’05: Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 112–113. ACM Press, New York, (2005)

  33. Lazcano A., Schuldt H., Alonso G. and Schek H.J. (2001). WISE: Process based E-Commerce. Bull. IEEE Tech. Committ. Data Eng. 24(1): 46–51

    Google Scholar 

  34. Lesk, M.: Expanding Digital Library research: media, genre, place and subjects. In: Proceedings of the International Symposium on Digital Library 1999: ISDL’99, pp. 51–57. Tsukuba, (1999)

  35. Licklider, J.C.R.: Libraries of the Future. MIT Press (1965)

  36. Lomow, G., Newcomer, E.: Understanding SOA with Web Services. Independent Technology Guides. Addison Wesley Professional (2005)

  37. MacKenzie, C.M., Laskey, K., McCabe, F., Brown, P., Metz, R.: Reference Model for Service Oriented Architecture 1.0. Tech. rep., OASIS (2006). Public Review Draft 1.0

  38. Metha B., Levy M., Meredith G., Andrews T., Beckman B., Klein J. and Mital A. (2001). BizTalk Server 2000 Business Process Orchestration. IEEE Data Eng. Bull. 24(1): 35–39

    Google Scholar 

  39. Moore, R.W., Marciano, R.: Building preservation environments. In: Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2005), p. 424 (2005)

  40. Old Dominion University Digital Library Research Group: Digital Library GRID Project. http://128.82.7.230/grid/

  41. Qi, L., Jin, H., Foster, I., Gawor, J.: HAND: Highly Available Dynamic Deployment Infrastructure for Globus Toolkit 4. Submitted for Publication (2006)

  42. Rajasekar, A., Moore, R., Berman, F., Schottlaender, B.: From digital preservation lifecycle management for multi-media collections. In: 8th International Conference on Asian Digital Libraries, ICADL 2005, Bangkok, December 2005, pp. 380–384. Springer, Heidelberg (2005)

  43. Rajasekar A., Wan M., Moore R., Schroeder W., Kremenek G., Jagatheesan A., Cowart C., Zhu B., Chen S.Y. and Olschanowsky R. (2003). Storage resource broker—managing distributed data in a Grid. Comput. Soc. India J. Spec. Issue SAN 33(4): 42–54

    Google Scholar 

  44. Schuldt H., Alonso G., Beeri C. and Schek H.J. (2002). Atomicity and isolation for transactional processes. ACM Trans. Database Systems (TODS) 27(1): 63–116

    Article  Google Scholar 

  45. Schuler C., Schuldt H., Türker C., Weber R. and Schek H.J. (2005). Peer-to-Peer execution of (transactional) processes. Int. J. Cooperative Inf. Systems (IJCIS) 14(4): 377–405

    Article  Google Scholar 

  46. Schuler, C., Weber, R., Schuldt, H., Schek, H.J.: Scalable Peer-to-Peer process management—The OSIRIS approach. In: Proceedings of the 2nd International Conference on Web Services (ICWS’2004), pp. 26–34. IEEE Computer Society, San Diego (2004)

  47. Tansley, R., Bass, M., Smith, M.: DSpace as an open archival information system: current status and future directions. In: Koch, T., Sølvberg, I. (eds.) Research and Advanced Technology for Digital Libraries, 7th European Conference, ECDL 2003, Trondheim, August 17–22, 2003, Proceedings, Lecture Notes in Computer Science, pp. 446–460. Springer, Heidelberg (2003)

  48. Tierney, B., Aydt, R., Gunter, D., Smith, W., Swany, M., Taylor, V., Wolski, R.: A Grid Monitoring Architecture. Tech. Rep. GFD.6, Global Grid Forum Document Series (2002)

  49. Unidata: Providing data, tools, and community leadership for enhanced earth-system education and research web page. http://www.unidata.ucar.edu

  50. IBM WebSphere Application Server Enterprise Process Choreographer. http://www7b.software.ibm.com/wsdd/zones/was/wpc. html

  51. Wiederhold G., Wegner P. and Ceri S. (1992). Towards megaprogramming. Commun. ACM 35(11): 89–99

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Information Science and Technologies (ISTI), Italian National Research Council (CNR), Via G. Moruzzi, 1, 56124, Pisa, Italy

    Leonardo Candela, Henri Avancini, Donatella Castelli, Andrea Manzi, Pasquale Pagano & Manuele Simi

  2. Department of Computer Science, University of Basel, Bernoullistrasse 16, 4056, Basel, Switzerland

    Fuat Akal, Christoph Langguth, Heiko Schuldt, Michael Springmann & Laura Voicu

  3. European Space Agency (ESA), European Space Research Institute (ESRIN), Via G. Galilei, 64, 00044, Frascati (RM), Italy

    Luigi Fusco & Veronica Guidetti

Authors
  1. Leonardo Candela
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fuat Akal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Henri Avancini
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Donatella Castelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Luigi Fusco
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Veronica Guidetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Christoph Langguth
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Andrea Manzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Pasquale Pagano
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Heiko Schuldt
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Manuele Simi
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Michael Springmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Laura Voicu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Leonardo Candela.

Additional information

This work is partially funded by the European Commission in the context of the DILIGENT project, under the 2nd call of FP6 IST priority.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Candela, L., Akal, F., Avancini, H. et al. DILIGENT: integrating digital library and Grid technologies for a new Earth observation research infrastructure. Int J Digit Libr 7, 59–80 (2007). https://doi.org/10.1007/s00799-007-0023-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00799-007-0023-8

Keywords

Search

Navigation