Skip to main content
SpringerLink
Log in

The Hyperdatabase Project – From the Vision to Realizations

  • Conference paper
Sharing Data, Information and Knowledge (BNCOD 2008)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5071))

Included in the following conference series:

Abstract

In the future we expect an ever increasing number of data sources, reaching from traditional databases and large document and multimedia collections and information sources from the web, down to embedded information sources in mobile “smart” objects as they occur in a pervasive computing environment. Therefore not only the immense amount of information demands new thoughts but also the number of different information sources and their coordination poses a great challenge for the development of an appropriate information infrastructure. This was the starting point for the creation of the hyperdatabase project at ETH Zurich, almost 10 years ago. In view of this continuous, almost infinite “information space” that is distributed, heterogeneous, and changes continuously, the challenges for a new infrastructure for the information space were the following: First, it should provide convenient tools for accessing information via sophisticated search facilities and for combining or integrating search results from different sources. Second, the new infrastructure should facilitate distributed application development for analyzing and processing information. Third, transactional (workflow) processes should ensure consistent propagation of information changes and simultaneous invocations of several (web) services and data stream operations. Finally, the implementation of such an infrastructure should provide functions for recoverability, scalability, and availability by avoiding central global components and by self-configuration and adaptation features. In this paper we will elaborate some of the aspects in these areas and report on our hyperdatabase research and experiences with realizations in several projects such as ETHWorld. OSIRIS, PowerDB, and Digital Libraries started at ETH and are continued at the University of Basel.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abiteboul, S., Agrawal, R., Bernstein, P.A., Carey, M.J., Ceri, S., Croft, W.B., DeWitt, D.J., Franklin, M.J., Garcia-Molina, H., Gawlick, D., Gray, J., Haas, L.M., Halevy, A.Y., Hellerstein, J.M., Ioannidis, Y.E., Kersten, M.L., Pazzani, M.J., Lesk, M., Maier, D., Naughton, J.F., Schek, H.-J., Sellis, T.K., Silberschatz, A., Stonebraker, M., Snodgrass, R.T., Ullman, J.D., Weikum, G., Widom, J., Zdonik, S.B.: The Lowell Database Research Self-Assessment. Communications of the ACM 48(5), 111–118 (2005)

    Article  Google Scholar 

  2. Agosti, M., Berretti, S., Brettlecker, G., Bimbo, A.D., Ferro, N., Fuhr, N., Keim, D.A., Klas, C.-P., Lidy, T., Milano, D., Norrie, M.C., Ranaldi, P., Rauber, A., Schek, H.-J., Schreck, T., Schuldt, H., Signer, B., Springmann, M.: DelosDLMS – The Integrated DELOS Digital Library Management System. In: Thanos, C., Borri, F., Candela, L. (eds.) Digital Libraries: Research and Development. LNCS, vol. 4877, pp. 36–45. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  3. Akal, F.: Replication in a Database Cluster with Freshness and Correctness Guarantees. PhD Thesis, ETH Zurich (2007)

    Google Scholar 

  4. Akal, F., Böhm, K., Schek, H.-J.: OLAP Query Evaluation in a Database Cluster: A Performance Study on Intra-Query Parallelism. In: Manolopoulos, Y., Návrat, P. (eds.) ADBIS 2002. LNCS, vol. 2435, pp. 218–231. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  5. Akal, F., Schuldt, H., Schek, H.-J.: Toward Replication in Grids for Digital Libraries with Freshness and Correctness Guarantees. Concurrency and Computation: Practice and Experience 19(16) (November 2007)

    Google Scholar 

  6. Akal, F., Türker, C., Schek, H.-J., Breitbart, Y., Grabs, T., Veen, L.: Fine-Grained Replication and Scheduling with Freshness and Correctness Guarantees. In: Proceedings of the 31st International Conference on Very Large Data Bases, Trondheim, Norway, August 2005, pp. 565–576 (2005)

    Google Scholar 

  7. Bergenti, F., Cáceres, C., Fernández, A., Fröhlich, N., Helin, H., Keller, O., Kinnunen, A., Klusch, M., Laamanen, H., Lopes, A., Ossowski, S., Schuldt, H., Schumacher, M.: Context-aware Service Coordination for Mobile e-Health Applications. In: Proceedings of the European Conference on eHealth (ECEH 2006), Fribourg, Switzerland, October 2006, pp. 119–130 (2006)

    Google Scholar 

  8. Brettlecker, G., Schuldt, H.: The OSIRIS-SE (Stream-Enabled) Infrastructure for Reliable Data Stream Management on Mobile Devices. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, Beijing, China, June 2007, pp. 1097–1099. ACM Press, New York (2007)

    Google Scholar 

  9. Brettlecker, G., Schuldt, H., Schek, H.-J.: Efficient and Coordinated Checkpointing for Reliable Distributed Data Stream Management. In: Manolopoulos, Y., Pokorný, J., Sellis, T.K. (eds.) ADBIS 2006. LNCS, vol. 4152, pp. 296–312. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  10. Candela, L., Akal, F., Avancini, H., Castelli, D., Fusco, L., Guidetti, V., Langguth, C., Manzi, A., Pagano, P., Schuldt, H., Simi, M., Springmann, M., Voicu, L.: DILIGENT: Integrating Digital Library and Grid Technologies for a new Earth Observation Research Infrastructure. International Journal on Digital Libraries 7(1-2), 59–80 (2007)

    Article  Google Scholar 

  11. Codd, E.F.: The Capabilities of Relational Database Management Systems. IBM Research Report, San Jose, California, RJ3132 (1981)

    Google Scholar 

  12. Grabs, T.: Storage and Retrieval of XML Documents with a Cluster of Database Systems. PhD Thesis, ETH Zurich (2003)

    Google Scholar 

  13. Grabs, T., Böhm, K., Schek, H.-J.: High-level Parallelism in a Database Cluster: A Feasibility Study Using Document Services. In: Proceedings of the 17th International Conference on Data Engineering (ICDE 2001), Heidelberg, Germany, April 2001, pp. 121–130. IEEE Computer Society Press, Los Alamitos (2001)

    Chapter  Google Scholar 

  14. Grabs, T., Böhm, K., Schek, H.-J.: PowerDB-IR – Information Retrieval on Top of a Database Cluster. In: Proceedings of the 2001 ACM CIKM International Conference on Information and Knowledge Management, Atlanta, Georgia, USA, November 2001, pp. 411–418. ACM Press, New York (2001)

    Chapter  Google Scholar 

  15. Gray, J., Helland, P., O’Neil, P.E., Shasha, D.: The Dangers of Replication and a Solution. In: Proceedings of the 1996 ACM SIGMOD International Conference on Management of Data, Montreal, Quebec, Canada, June 1996, pp. 173–182. ACM Press, New York (1996)

    Google Scholar 

  16. Gray, J., Mylopoulos, J., Schek, H.-J.: Future Directions of Database Research — Changes in the VLDB Conference PC Structure (1999), http://www.vldb.org/future.html

  17. Lopes, A., Costa, P., Bergenti, F., Klusch, M., Blankenburg, B., Möller, T., Schuldt, H.: Context-aware Secure Service Composition Planning and Execution on E-Health Environments. In: Proceedings of the European Conference on eHealth (ECEH 2006), Fribourg, Switzerland, October 2006, pp. 179–190 (2006)

    Google Scholar 

  18. Mlivoncic, M.: Efficient Evaluation Techniques for Complex Similarity Queries on Large Media Collections. PhD Thesis, ETH Zurich (2006)

    Google Scholar 

  19. Mlivoncic, M., Schuler, C., Türker, C.: Hyperdatabase Infrastructure for Management and Search of Multimedia Collections. In: Proceedings of the Sixth Thematic Workshop of the EU Network of Excellence DELOS: Digital Library Architectures – Peer-to-Peer, Grid, and Service-Orientation, S. Margherita di Pula, Cagliari, Italy, June 2004, pp. 25–36. Edizioni Libreria Progetto, Padova (2004)

    Google Scholar 

  20. Pu, C., Schwan, K., Walpole, J.: Infosphere Project: System Support for Information Flow Applications. SIGMOD Record 30(1), 25–34 (2001)

    Article  Google Scholar 

  21. Röhm, U.: Online Analytical Processing with a Cluster of Databases. PhD Thesis, ETH Zurich (2002)

    Google Scholar 

  22. Schek, H.-J.: The Hyperdatabase Network – New Middleware for Searching and Maintaining the Information Space. In: Vojtáš, P., Bieliková, M., Charron-Bost, B., Sýkora, O. (eds.) SOFSEM 2005. LNCS, vol. 3381, pp. 42–46. Springer, Heidelberg (2005)

    Google Scholar 

  23. Schek, H.-J., Böhm, K., Grabs, T., Röhm, U., Schuldt, H., Weber, R.: Hyperdatabases. In: Proceedings of the First International Conference on Web Information Systems Engineering (WISE 2000), Hong Kong, China, June 2000, pp. 14–25. IEEE Computer Society Press, Los Alamitos (2000)

    Chapter  Google Scholar 

  24. Schek, H.-J., Schuldt, H.: DelosDLMS – Infrastructure for the Next Generation of Digital Library Management Systems. ERCIM, Special Issue on European Digital Library (66) (July 2006)

    Google Scholar 

  25. Schek, H.-J., Schuldt, H., Weber, R.: Hyperdatabases: Infrastructure for the Information Space. In: Proceedings of the Sixth IFIP Working Conference on Visual Database Systems (VDB 2002), Bisbane, Australia, May 2002, pp. 1–15. Kluwer, Dordrecht (2002)

    Google Scholar 

  26. Schuldt, H.: Transactional Process Management over Component Systems. PhD Thesis, ETH Zurich (2000)

    Google Scholar 

  27. Schuldt, H.: Process Locking: A Protocol based on Ordered Shared Locks for the Execution of Transactional Processes. In: Proceedings of the 20th ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems (PODS 2001), Santa Barbara, CA, USA, May 2001, ACM, New York (2001)

    Google Scholar 

  28. Schuldt, H., Alonso, G., Beeri, C., Schek, H.-J.: Atomicity and Isolation for Transactional Processes. ACM Transactions of Database Systems (TODS) 27(1), 63–116 (2002)

    Article  Google Scholar 

  29. Schuler, C.: Distributed Peer-to-Peer Process Management – Realization of a Hyperdatabase. PhD Thesis, ETH Zurich (2004) (in German)

    Google Scholar 

  30. Schuler, C., Schuldt, H., Türker, C., Weber, R., Schek, H.-J.: Peer-to-peer Execution of (Transactional) Processes. International Journal on Cooperative Information Systems 14(4), 377–406 (2005)

    Article  Google Scholar 

  31. Schuler, C., Türker, C., Schek, H.-J., Weber, R., Schuldt, H.: Scalable Peer-to-Peer Process Management. International Journal of Business Process Integration and Management (IJBPIM) 1(2), 129–142 (2006)

    Article  Google Scholar 

  32. Schuler, C., Weber, R., Schuldt, H., Schek, H.-J.: Peer-to-Peer Process Execution with OSIRIS. In: Orlowska, M.E., Weerawarana, S., Papazoglou, M.P., Yang, J. (eds.) ICSOC 2003. LNCS, vol. 2910, pp. 483–498. Springer, Heidelberg (2003)

    Google Scholar 

  33. Schuler, C., Weber, R., Schuldt, H., Schek, H.-J.: Scalable Peer-to-Peer Process Management – The OSIRIS Approach. In: Proceedings of the IEEE International Conference on Web Services (ICWS 2004), San Diego, CA, USA, June 2004, pp. 26–34. IEEE Computer Society Press, Los Alamitos (2004)

    Chapter  Google Scholar 

  34. Silberschatz, A., Zdonik, S.B.: Database Systems - Breaking Out of the Box. SIGMOD Record 26(3), 36–50 (1997)

    Article  Google Scholar 

  35. Weber, R.: Similarity Search in High-Dimensional Vector Spaces. PhD Thesis, ETH Zurich (2000)

    Google Scholar 

  36. Weber, R., Bolliger, J., Gross, T.R., Schek, H.-J.: Architecture of a Networked Image Search and Retrieval System. In: Proceedings of the 1999 ACM CIKM International Conference on Information and Knowledge Management, Kansas City, Missouri, USA, November 1999, pp. 430–441. ACM Press, New York (1999)

    Chapter  Google Scholar 

  37. Weber, R., Schek, H.-J., Blott, S.: A Quantitative Analysis and Performance Study for Similarity-Search Methods in High-Dimensional Spaces. In: Proceedings of 24th International Conference on Very Large Data Bases (VLDB 1998), August 1998, pp. 194–205. Morgan Kaufmann, San Francisco (1998)

    Google Scholar 

  38. Weber, R., Schuler, C., Neukomm, P., Schuldt, H., Schek, H.-J.: Web Service Composition with O’GRAPE and OSIRIS. In: Aberer, K., Koubarakis, M., Kalogeraki, V. (eds.) VLDB 2003. LNCS, vol. 2944, pp. 1081–1084. Springer, Heidelberg (2004)

    Google Scholar 

  39. Wiederhold, G., Wegner, P., Ceri, S.: Toward Megaprogramming. Commununications of the ACM 35(11) (1992)

    Google Scholar 

  40. Zhang, A., Nodine, M.H., Bhargava, B.K.: Global Scheduling for Flexible Transactions in Heterogeneous Distributed Database Systems. IEEE Transactions on Knowledge and Data Engineering (TKDE) 13(3), 439–450 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Professor Emeritus of the Swiss Federal Institute of Technology (ETH),  , Zurich, Switzerland

    Hans-Jörg Schek

  2. Database and Information Systems Group Department of Computer Science, University of Basel, Switzerland

    Heiko Schuldt

Authors
  1. Hans-Jörg Schek
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Heiko Schuldt
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Alex Gray Keith Jeffery Jianhua Shao

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Schek, HJ., Schuldt, H. (2008). The Hyperdatabase Project – From the Vision to Realizations. In: Gray, A., Jeffery, K., Shao, J. (eds) Sharing Data, Information and Knowledge. BNCOD 2008. Lecture Notes in Computer Science, vol 5071. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70504-8_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-70504-8_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-70503-1

  • Online ISBN: 978-3-540-70504-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation