In a few years, access to the content of multimedia data will be a problem of phenomenal proportions, as digital cameras may produce high data rates, and multimedia archives steadily run into petabytes of storage space. As a consequence, in the field of large-scale distributed Multimedia Content Analysis (MMCA) there is an urgent need for the coordinated handling of vast amounts of distributed and replicated data collections.
Any sustainable solution to the management problem of distributed (multimedia) data in Grids has to follow a layered approach, starting from a new generation of network controllers and, through a novel middleware, up to an interface to applications.
In this paper we report on our first steps of our bigger plan in this direction. Specifically, we introduce a new transport protocol layer (called HI-TP), which is capable of taking advantage of the storage capabilities of network devices, such as routers. The paper presents the protocol definition, and discusses initial performance results for basic transmission functionality. Results indicate that our protocol is capable of achieving higher throughput than traditional transport protocols, even in networks with significant latency.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
 References
G. Allen, K. Davis, T. Goodale, A. Hutanu, H. Kaiser, T. Kielmann, A. Merzky, R. van Nieuwpoort, A. Reinefeld, F. Schintke, T. Schütt, E. Seidel, and B. Ullmer. The Grid Application Toolkit: Towards Generic and Easy Application Programming Interfaces for the Grid. Proceedings of the IEEE, 93(3):534-550, 2005.
A. Bassi, S. Denazis, and P. Giacomin. Towards a Noah’s Ark for the Upcoming Data Deluge. In 3rd VLDB Workshop on Data Management in Grids, Sept. 2007.
D. Egnor. Airhook: Reliable, Efficient Transmission Control for Networks that Suck.
Y. Gu and R. Grossman. UDT: UDP-based Data Transfer for High-Speed Wide Area Networks. Computer Networks, 51(7):1777-1799, May 2007.
D. Koelma et al. Horus C++ Reference, Version 1.1. Technical report, ISIS, Faculty of Science, University of Amsterdam, The Netherlands, Jan. 2002.
R. Medeiros, W. Cirne, F. Brasileiro, and J. Sauv é . Faults in Grids: Why are they so bad and What can be done about it? In Proceedings of the Fourth International Workshop on Grid Computing, 2003.
J. Plank, A. Bassi, M. Beck, T. Moore, M. Swany, and R. Wolski. Managing Data Storage in the Network. IEEE Internet Computing, 6(5):50-58, Sept. 2001.
J. Postel. User Datagram Protocol, Aug. 1980. Internet standard RFC 768.
J. Postel. Transmission Control Protocol, Sept. 1981. Internet standard RFC 793.
F. Seinstra, J. Geusebroek, D. Koelma, C. Snoek, M. Worring, and A. Smeulders. High-Performance Distributed Video Content Analysis with Parallel-Horus. IEEE Multimedia, 15(4):64-75, Oct. 2007.
F. Seinstra, D. Koelma, and A. Bagdanov. Finite State Machine-Based Optimization of Data Parallel Regular Domain Problems Applied in Low-Level Image Processing. IEEE Transactions on Parallel and Distributed Systems, 15(10):865-877, Oct. 2004.
F. Seinstra, C. Snoek, D. Koelma, J. Geusebroek, and M. Worring. User Transparent Parallel Processing of the 2004 NIST TRECVID Data Set. In Proceedings of the International Parallel & Distributed Processing Symposium (IPDPS 2005), Denver, Colorado, USA, Apr. 2005.
C. Snoek, M. Worring, J. Geusebroek, D. Koelma, F. Seinstra, and A. Smeulders. The MediaMill TRECVID 2005 Semantic Video Search Engine. In Proceedings of the 3rd TRECVID Workshop, Gathersburg, USA, Nov. 2005.
C. Snoek, M. Worring, J. Geusebroek, D. Koelma, F. Seinstra, and A. Smeulders. The Semantic Pathfinder: Using an Authoring Metaphor for Generic Multimedia Indexing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(10):1678-1689, 2006.
Stichting MultimediaN. MultimediaN, Project proposal Bsik, Feb. 2003. http://www.multimedian.nl/.
R. van Nieuwpoort, T. Kielmann, and H. Bal. User-friendly and Reliable Grid Computing Based on Imperfect Middleware. In Proceedings of SC’07, Nov. 2007.
R. van Nieuwpoort, J. Maassen, G. Wrzesinska, R. Hofman, C. Jacobs, T. Kielmann, and H. Bal. Ibis: a Flexible and Efficient Java-based Grid Programming Environment. Concurrency and Computation: Practice and Experience, 17(7-8):1079-1107, 2005.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Giacomin, P., Bassi, A., Seinstra, F.J., Kielmann, T. (2008). Towards Coordinated Data Management For High-Performance Distributed Multimedia Content Analysis. In: Gorlatch, S., Fragopoulou, P., Priol, T. (eds) Grid Computing. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-09457-1_12
Download citation
DOI: https://doi.org/10.1007/978-0-387-09457-1_12
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-09456-4
Online ISBN: 978-0-387-09457-1
eBook Packages: Computer ScienceComputer Science (R0)