skip to main content
10.1145/3018896.3018936acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccConference Proceedingsconference-collections
research-article

FRAMSTIM: framework for large scale multimedia content feature extraction based on MPI one-sided communication

Authors Info & Claims
Published:22 March 2017Publication History

ABSTRACT

Every day a large number of images are made available throw social networks and different IoT embedded sensors. R&D devoted to the development of applications based on visual pattern recognition has attracted a large population of researchers in both side academic and industry. Extraction of relevant features is challenging and known to be one of the key issues in many applications where the visual pattern recognition is applied (object recognition and tracking, image identification, multimedia document categorization, indexing and retrieval, deep learning based visual feature coding, video surveillance, robotic, activity recognition). Furthermore the extraction features from a big volume of image and video data is time and resources consuming. In the context of the ITEA2 project H4H/PerfCloud ( Performance in the Cloud) we have developed parallel OpenMP threads video engine search. To scale the extraction of visual features from a large volume of streaming visual content, we have developed a framework based on OpenMP and MPI one-sided communication where the computation and communication are overlapped thanks to the RDMA approach.

References

  1. Joyce Miranda dos Santos, Edleno Silva de Moura, Altigran Soares da Silva, João Marcos B. Cavalcanti, Ricardo da Silva Torres, Márcio Luiz A. Vidal, J.2015, signature-based bag of visual words method for image indexing and search. Pattern Recognition Letters Volume 65, 1 November 2015, Pages 1--7 Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. M. Joint, P.A. Moellic, P.Hede, P. Adam,P.2004, PIRIA: a general tool for indexing, search, and retrieval of multimedia content, Proceedings of the SPIE, Volume 5298, p. 116--125, 2004Google ScholarGoogle ScholarCross RefCross Ref
  3. Hannes Fassolda and Jakub Rosnerb, P. 2015. A Real-time GPU Implementation of the SIFT Algorithm for Large-Scale Video Analysis Tasks, Proc. SPIE 9400, Real-Time Image and Video. Processing 2015Google ScholarGoogle Scholar
  4. Kristleifur Daðason, Herwig Lejsek, Ársæll Þ. Jóhansson, Björn Þór Jónsson, Laurent Amsaleg, J. 2010, GPU acceleration of Eff2 descriptors using CUDA. ACM Multimedia 2010, pages 1167--1170 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Jaco Cronje, P.2011, BFROST: Binary Features from Robust Orientation Segment Tests accelerated on the GPU, 22nd Annual Symposium of the Pattern Recognition Association of South Africa (PRASA), Emerald Casino and Resort, Vanderbijlpark, South Africa, 22--25 November 2011Google ScholarGoogle Scholar
  6. M. Flickner, P.1995,Query by image and video content: the QBIC system, in Computer, vol. 28, no. 9, pp. 23--32, Sep 1995 Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Elham Sagheb Hossein Pour, J.2015, A Survey of Multithreading Image Analysis. arXiv preprint arXiv:1506.04472Google ScholarGoogle Scholar
  8. Jing Huang, S. Ravi Kumar, Mandar Mitra, Wei-Jing Zhu, and Ramin Zabih, P.1997, Image indexing using color correlograms. In IEEE Conference on Computer Vision and Pattern Recognition, pages 762---768, 1997 Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. X. Chen, X. Yang, R. Zhang, A. Liu and S. Zheng, J.2010, Edge region color autocorrelogram: A new low-level feature applied in CBIR, 2010 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Shanghai, 2010, pp. 1--4Google ScholarGoogle Scholar
  10. Jean Michel Marie-Julie, Hassane Essafi, P. 1998, Image Indexing by Using a Rotation and Scale Invariant Partition. ECMAST 1998: 163--176 Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Jean Michel Marie-Julie - Hassane Essafi,P.1996, Fast parallel multimedia database access based on wavelet multiresolution pyramidal decomposition, MVA '96 IAPR Workshop on Machine Vision Applications, November. 12--14, 1996, Tokyo, JapanGoogle ScholarGoogle Scholar
  12. G. Zhao, T. Ahonen, J. Matas and M. Pietikainen, J.2012, Rotation-Invariant Image and Video Description With Local Binary Pattern Features, in IEEE Transactions on Image Processing, vol. 21, no. 4 Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. M. Pietikäinen, J.2011,Local Binary Patterns for Still Images, in Computer Vision Using Local Binary Patterns, Computational Imaging and Vision 40, pages 13--47, London Limited 2011Google ScholarGoogle ScholarCross RefCross Ref
  14. Bingjing Zhang, Judy Qiu, Stefan Lee, David, P.2014, Crandall. Large-Scale Image Classification using High Performance Clustering, 2014Google ScholarGoogle Scholar
  15. Elisavet Chatzilari, Georgios Liaros, Spiros Nikolopoulos, and Yiannis Kompatsiaris, P.2013,A comparative study on mobile visual recognition. Machine Learning and Data Mining in Pattern Recognition 9th International Conference, MLDM 2013 New York, NY, USA, July 19--25, 2013 Proceeding Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Li Zhuo n, Bo Cheng, Jing Zhang, J.2014. A comparative study of dimensionality reduction methods for large-scale image retrieval. Neurocomputing, Volume 141, October 2014, pages 202--210Google ScholarGoogle Scholar
  17. Shamonin, D. P., Bron, E. E., Lelieveldt, B. P., J.2010. Smits, M., Klein, S., Staring, M., Fast parallel image registration on CPU and GPU for diagnostic classification of Alzheimer's disease. Frontiers in neuroinformatics. 7--2013Google ScholarGoogle Scholar
  18. Yuzhong Yan, Lei Huang, P.2014. Large-Scale Image Processing Research Cloud. CLOUD COMPUTING 2014 : The Fifth International Conference on Cloud Computing, GRIDs, and VirtualizationGoogle ScholarGoogle Scholar
  19. J. Qiu, B. Zhang, Mammoth Data in the Cloud: Clustering Social Images. In Clouds, Grids and Big Data, IOS Press, 2013Google ScholarGoogle Scholar
  20. D. Mera, M. Batko and P. Zezula, P2014,Towards Fast Multimedia Feature Extraction: Hadoop or Storm, Multimedia (ISM), 2014 IEEE International Symposium on, Taichung, 2014, pp. 106--109 Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. https://itea3.org/project/h4h.htmlGoogle ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    ICC '17: Proceedings of the Second International Conference on Internet of things, Data and Cloud Computing
    March 2017
    1349 pages
    ISBN:9781450347747
    DOI:10.1145/3018896

    Copyright © 2017 ACM

    Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 22 March 2017

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article

    Acceptance Rates

    ICC '17 Paper Acceptance Rate213of590submissions,36%Overall Acceptance Rate213of590submissions,36%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader