skip to main content
10.1145/2809948.2809950acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Large-scale Efficient and Effective Video Similarity Search

Published: 22 October 2015 Publication History

Abstract

Recently, the rich diversity of the video capture devices and the high usage of the Internet have generated a great amount of video data, which attracts the attention of researchers with respect to the development of novel effective and efficient video retrieval approaches. In this paper, we investigate the effectiveness and efficiency of the lower-bounding filter distance functions of the well-known similarity measure Earth Mover's Distance (EMD) on signature databases, including the recently introduced Independent Minimization for Signatures (IM-Sig). We conduct the experiments on a public dataset comprising various categories with visually similar videos, and another large-scale real world video dataset consisting of 350,000 near-duplicate videos. To the best of our knowledge, this is the first work investigating the effectiveness and efficiency of the lower-bounding filter distance functions on databases consisting of signatures, i.e adaptive-binned representations. The experimental evaluation indicates both high effectiveness and efficiency of the IM-Sig, outperforming the state-of-the-art techniques.

References

[1]
R. Agrawal, C. Faloutsos, and A. N. Swami. Efficient similarity search in sequence databases. In FODO, pages 69--84, 1993.
[2]
R. K. Ahuja, T. L. Magnanti, and J. B. Orlin. Network Flows: Theory, Algorithms, and Applications. Pearson Education Limited, England, 2014.
[3]
I. Assent, A. Wenning, and T. Seidl. Approximation techniques for indexing the earth mover's distance in multimedia databases. In ICDE, page 11, 2006.
[4]
I. Assent, M. Wichterich, and T. Seidl. Adaptable distance functions for similarity-based multimedia retrieval. Datenbank-Spektrum, 6(19):23--31, 2006.
[5]
M. S. Bazaraa, J. J. Jarvis, and H. D. Sherali. Linear Programming and Network Flows. John Wiley & Sons, USA, 2010.
[6]
C. Beecks, M. S. Uysal, and T. Seidl. Signature Quadratic Form Distance. CIVR, pages 438--445, 2010.
[7]
D. Broccolo, C. Macdonald, S. Orlando, I. Ounis, R. Perego, F. Silvestri, and N. Tonellotto. Load-sensitive selective pruning for distributed search. In CIKM, pages 379--388, 2013.
[8]
B. B. Cambazoglu, I. S. Altingovde, R. Ozcan, and O. Ulusoy. Cache-based query processing for search engines. ACM Trans. Web, 6(4):14:1--14:24, Nov. 2012.
[9]
C. Faloutsos, M. Ranganathan, and Y. Manolopoulos. Fast subsequence matching in time-series databases. SIGMOD, 23(2):419--429, May 1994.
[10]
F. Hillier and G. Lieberman. Introduction to Linear Programming. McGraw-Hill, 1990.
[11]
M. E. Houle, X. Ma, M. Nett, and V. Oria. Dimensional testing for multi-step similarity search. In ICDM, pages 299--308, 2012.
[12]
F. Korn, N. Sidiropoulos, C. Faloutsos, E. L. Siegel, and Z. P. Fast nearest neighbor search in medical image databases. In VLDB, pages 215--226, 1996.
[13]
H.-P. Kriegel, P. Kröger, P. Kunath, and M. Renz. Generalizing the optimality of multi-step k-nearest neighbor query processing. In SSTD, p.75--92, 2007.
[14]
M. Redi, N. OHare, R. Schifanella, M. Trevisiol, and A. Jaimes. 6 seconds of sound and vision: Creativity in micro-videos. In CVPR, pages 4272--4279. IEEE, 2014.
[15]
Y. Rubner, C. Tomasi, and L. Guibas. A metric for distributions with applications to image databases. In ICCV98, pages 59--66, 1998.
[16]
B. E. Ruttenberg and A. K. Singh. Indexing the earth mover's distance using normal distributions. PVLDB, 5(3):205--216, 2011.
[17]
T. Seidl and H. Kriegel. Optimal multi-step k-nearest neighbor search. In SIGMOD, pages 154--165, 1998.
[18]
S. Shirdhonkar and D. Jacobs. Approximate earth mover's distance in linear time. In CVPR, p.1--8,2008.
[19]
H. Tamura, S. Mori, and T. Yamawaki. Textural features corresponding to visual perception. TSMC, 8(6):460--473, 1978.
[20]
Y. Tang, L. H. U, Y. Cai, N. Mamoulis, and R. Cheng. Earth mover's distance based similarity search at scale. PVLDB, 7(4):313--324, 2013.
[21]
M. S. Uysal, C. Beecks, J. Schmücking, and T. Seidl. Efficient filter approximation using the Earth Mover's Distance in very large multimedia databases with feature signatures. In CIKM, pages 979--988, 2014.
[22]
M. S. Uysal, C. Beecks, J. Schmücking, and T. Seidl. Efficient similarity search in scientific databases with feature signatures. In SSDBM, p.30:1--30:12, 2015.
[23]
M. S. Uysal, C. Beecks, and T. Seidl. On efficient query processing with the Earth Mover's Distance. In PIKM@CIKM, pages 25--32, 2014.
[24]
M. S. Uysal, C. Beecks, and T. Seidl. On efficient content-based near-duplicate video detection. In CBMI, pages 1--6, 2015.
[25]
R. J. Vanderbei. Linear Programming: Foundations and Extensions. 1996.
[26]
M. Wichterich, I. Assent, P. Kranen, and T. Seidl. Efficient emd-based similarity search in multimedia databases via flexible dimensionality reduction. In SIGMOD, pages 199--212, 2008.
[27]
J. Xu, Z. Zhang, A. K. H. Tung, and G. Yu. Efficient and effective similarity search over probabilistic data based on earth mover's distance. PVLDB, 3(1):758--769, 2010.

Cited By

View all
  • (2018)An Integrated Signature-Based Framework for Efficient Visual Similarity Detection and Measurement in Video ShotsACM Transactions on Information Systems10.1145/319078436:4(1-38)Online publication date: 27-May-2018
  • (2018)Video Similarity Measurement and SearchRecent Advances in Computer Vision10.1007/978-3-030-03000-1_4(85-112)Online publication date: 15-Dec-2018
  • (2016)Approximation-Based Efficient Query Processing with the Earth Mover's DistanceProceedings, Part II, of the 21st International Conference on Database Systems for Advanced Applications - Volume 964310.1007/978-3-319-32049-6_11(165-180)Online publication date: 16-Apr-2016

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
LSDS-IR '15: Proceedings of the 2015 Workshop on Large-Scale and Distributed System for Information Retrieval
October 2015
32 pages
ISBN:9781450337816
DOI:10.1145/2809948
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. earth mover's distance
  2. effective similarity search
  3. efficient similarity search
  4. filter distance
  5. lower bound
  6. multimedia databases
  7. video databases

Qualifiers

  • Research-article

Funding Sources

  • DFG

Conference

CIKM'15
Sponsor:

Acceptance Rates

LSDS-IR '15 Paper Acceptance Rate 3 of 5 submissions, 60%;
Overall Acceptance Rate 3 of 5 submissions, 60%

Upcoming Conference

CIKM '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2018)An Integrated Signature-Based Framework for Efficient Visual Similarity Detection and Measurement in Video ShotsACM Transactions on Information Systems10.1145/319078436:4(1-38)Online publication date: 27-May-2018
  • (2018)Video Similarity Measurement and SearchRecent Advances in Computer Vision10.1007/978-3-030-03000-1_4(85-112)Online publication date: 15-Dec-2018
  • (2016)Approximation-Based Efficient Query Processing with the Earth Mover's DistanceProceedings, Part II, of the 21st International Conference on Database Systems for Advanced Applications - Volume 964310.1007/978-3-319-32049-6_11(165-180)Online publication date: 16-Apr-2016

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media