František Mejzlík
Miroslav Kratochvíl
ABSTRACT
We present an extended version of SOMHunter, an interactive retrieval tool designed for known-item and ad-hoc search tasks over image and video datasets. Even though SOMHunter has achieved significant success at the most recent Video Browser Showdown 2020 competition, lifelog datasets and related search tasks constitute a different challenge with specific problems to be addressed. The presented version of SOMHunter integrates functionality required to deal with lots of highly similar images collected in typical lifelogs. Additionally, we employ search in available metadata including date and time filters.
- Chia-Chun Chang, Min-Huan Fu, Hen-Hsen Huang, and Hsin-Hsi Chen. 2019. An Interactive Approach to Integrating External Textual Knowledge for Multimodal Lifelog Retrieval. In Proceedings of the ACM Workshop on Lifelog Search Challenge (Ottawa ON, Canada) (LSC '19). Association for Computing Machinery, New York, NY, USA, 41--44. https://doi.org/10.1145/3326460.3329163Google Scholar
Digital Library
- Ingemar J Cox, Matthew L Miller, Thomas P Minka, Thomas V Papathomas, and Peter N Yianilos. 2000. The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments. IEEE transactions on image processing, Vol. 9, 1 (2000), 20--37.Google Scholar
- Cathal Gurrin, Klaus Schoeffmann, Hideo Joho, Andreas Leibetseder, Liting Zhou, Aaron Duane, Duc-Tien Dang-Nguyen, Michael Riegler, Luca Piras, Minh-Triet Tran, Jakub Lokovc, and Wolfgang Hürst. 2019 a. [Invited papers] Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018). ITE Transactions on Media Technology and Applications, Vol. 7, 2 (2019), 46--59. https://doi.org/10.3169/mta.7.46Google ScholarCross Ref
- Cathal Gurrin, Klaus Schoeffmann, Hideo Joho, Bernd Munzer, Rami Albatal, Frank Hopfgartner, Liting Zhou, and Duc-Tien Dang-Nguyen. 2019 b. A Test Collection for Interactive Lifelog Retrieval. In MultiMedia Modeling, Ioannis Kompatsiaris, Benoit Huet, Vasileios Mezaris, Cathal Gurrin, Wen-Huang Cheng, and Stefanos Vrochidis (Eds.). Springer International Publishing, Cham, 312--324.Google Scholar
- Cathal Gurrin, Alan F. Smeaton, and Aiden R. Doherty. 2014. LifeLogging: Personal Big Data. Found. Trends Inf. Retr., Vol. 8, 1 (June 2014), 1--125. https://doi.org/10.1561/1500000033Google ScholarDigital Library
- Omar Shahbaz Khan, Björn Þór Jónsson, Jan Zahálka, Stevan Rudinac, and Marcel Worring. 2019. Exquisitor at the Lifelog Search Challenge 2019. In Proceedings of the ACM Workshop on Lifelog Search Challenge (Ottawa ON, Canada) (LSC '19). Association for Computing Machinery, New York, NY, USA, 7--11. https://doi.org/10.1145/3326460.3329156Google ScholarDigital Library
- Teuvo Kohonen. 1998. The self-organizing map. Neurocomputing, Vol. 21, 1--3 (1998), 1--6.Google ScholarCross Ref
- Miroslav Kratochvíl, Patrik Veselý, Frantisek Mejzlík, and Jakub Lokovc. 2020. SOM-Hunter: Video Browsing with Relevance-to-SOM Feedback Loop. In MultiMedia Modeling, Yong Man Ro, Wen-Huang Cheng, Junmo Kim, Wei-Ta Chu, Peng Cui, Jung-Woo Choi, Min-Chun Hu, and Wesley De Neve (Eds.). Springer International Publishing, Cham, 790--795.Google Scholar
- Nguyen-Khang Le, Dieu-Hien Nguyen, Trung-Hieu Hoang, Thanh-An Nguyen, Thanh-Dat Truong, Duy-Tung Dinh, Quoc-An Luong, Viet-Khoa Vo-Ho, Vinh-Tiep Nguyen, and Minh-Triet Tran. 2019 a. Smart Lifelog Retrieval System with Habit-Based Concepts and Moment Visualization. In Proceedings of the ACM Workshop on Lifelog Search Challenge (Ottawa ON, Canada) (LSC '19). Association for Computing Machinery, New York, NY, USA, 1--6. https://doi.org/10.1145/3326460.3329155Google ScholarDigital Library
- Tu-Khiem Le, Van-Tu Ninh, Duc-Tien Dang-Nguyen, Minh-Triet Tran, Liting Zhou, Pablo Redondo, Sinead Smyth, and Cathal Gurrin. 2019 b. LifeSeeker: Interactive Lifelog Search Engine at LSC 2019. In Proceedings of the ACM Workshop on Lifelog Search Challenge (Ottawa ON, Canada) (LSC '19). Association for Computing Machinery, New York, NY, USA, 37--40. https://doi.org/10.1145/3326460.3329162Google ScholarDigital Library
- Andreas Leibetseder, Bernd Münzer, Manfred Jürgen Primus, Sabrina Kletz, Klaus Schoeffmann, Fabian Berns, and Christian Beecks. 2019. LifeXplore at the Lifelog Search Challenge 2019. In Proceedings of the ACM Workshop on Lifelog Search Challenge (Ottawa ON, Canada) (LSC '19). Association for Computing Machinery, New York, NY, USA, 13--17. https://doi.org/10.1145/3326460.3329157Google ScholarDigital Library
- Xirong Li, Chaoxi Xu, Gang Yang, Zhineng Chen, and Jianfeng Dong. 2019. W2VV+: Fully Deep Learning for Ad-Hoc Video Search. In Proceedings of the 27th ACM International Conference on Multimedia (Nice, France) (MM '19). Association for Computing Machinery, New York, NY, USA, 1786--1794. https://doi.org/10.1145/3343031.3350906Google ScholarDigital Library
- Jakub Lokovc, Adam Blavz ek, and Tomávs Skopal. 2014. Signature-Based Video Browser. In MultiMedia Modeling, Cathal Gurrin, Frank Hopfgartner, Wolfgang Hurst, Håvard Johansen, Hyowon Lee, and Noel O'Connor (Eds.). Springer International Publishing, Cham, 415--418.Google Scholar
- Jakub Lokovc, Werner Bailer, Klaus Schoeffmann, Bernd Mü nzer, and George Awad. 2018. On Influential Trends in Interactive Video Retrieval: Video Browser Showdown 2015--2017. IEEE Trans. Multimedia, Vol. 20, 12 (2018), 3361--3376. https://doi.org/10.1109/TMM.2018.2830110Google ScholarDigital Library
- Jakub Lokovc, Gregor Kovalvcik, Tomás Soucek, Jaroslav Moravec, and Pvremysl vCech. 2019 a. VIRET: A Video Retrieval Tool for Interactive Known-item Search. In Proceedings of the 2019 on International Conference on Multimedia Retrieval (Ottawa ON, Canada) (ICMR '19). ACM, New York, NY, USA, 177--181. https://doi.org/10.1145/3323873.3325034Google ScholarDigital Library
- Jakub Lokovc, Tomávs Souvcek, Premysl vCech, and Gregor Kovalvc'ik. 2019 b. Enhanced VIRET Tool for Lifelog Data. In Proceedings of the ACM Workshop on Lifelog Search Challenge (Ottawa ON, Canada) (LSC '19). Association for Computing Machinery, New York, NY, USA, 25--26. https://doi.org/10.1145/3326460.3329159Google ScholarDigital Library
- Isadora Nguyen Van Khan, Pranita Shrestha, Min Zhang, Yiqun Liu, and Shaoping Ma. 2019. A Two-Level Lifelog Search Engine at the LSC 2019. In Proceedings of the ACM Workshop on Lifelog Search Challenge (Ottawa ON, Canada) (LSC '19). Association for Computing Machinery, New York, NY, USA, 19--23. https://doi.org/10.1145/3326460.3329158Google ScholarDigital Library
- Luca Rossetto, Ralph Gasser, Silvan Heller, Mahnaz Amiri Parian, and Heiko Schuldt. 2019 a. Retrieval of Structured and Unstructured Data with Vitrivr. In Proceedings of the ACM Workshop on Lifelog Search Challenge (Ottawa ON, Canada) (LSC '19). Association for Computing Machinery, New York, NY, USA, 27--31. https://doi.org/10.1145/3326460.3329160Google ScholarDigital Library
- L. Rossetto, R. Gasser, J. Lokoc, W. Bailer, K. Schoeffmann, B. Muenzer, T. Soucek, P. A. Nguyen, P. Bolettieri, A. Leibetseder, and S. Vrochidis. 2020. Interactive Video Retrieval in the Age of Deep Learning - Detailed Evaluation of VBS 2019. IEEE Transactions on Multimedia (2020), 1--1. https://doi.org/10.1109/TMM.2020.2980944Google Scholar
- Luca Rossetto, Heiko Schuldt, George Awad, and Asad A. Butt. 2019 b. V3C -- A Research Video Collection. In MultiMedia Modeling, Ioannis Kompatsiaris, Benoit Huet, Vasileios Mezaris, Cathal Gurrin, Wen-Huang Cheng, and Stefanos Vrochidis (Eds.). Springer International Publishing, Cham, 349--360.Google Scholar
Index Terms
- SOMHunter for Lifelog Search
Recommendations
Enhanced SOMHunter for Known-item Search in Lifelog Data
LSC '21: Proceedings of the 4th Annual on Lifelog Search ChallengeSOMHunter represents a modern light-weight framework for known-item search in datasets of visual data like images or videos. The framework combines an effective W2VV++ text-to-image search approach, a traditional Bayesian like model for maintenance of ...
SOMHunter: Lightweight Video Search System with SOM-Guided Relevance Feedback
MM '20: Proceedings of the 28th ACM International Conference on MultimediaIn the last decade, the Video Browser Showdown (VBS) became a comparative platform for various interactive video search tools competing in selected video retrieval tasks. However, the participation of new teams with an own, novel tool is prohibitively ...
Fast Instance Search Based on Approximate Bichromatic Reverse Nearest Neighbor Search
MM '14: Proceedings of the 22nd ACM international conference on MultimediaIn the TRECVID Instance Search (INS) task, it is known that use of BM25, which is an improvement of the TFIDF,greatly improves retrieval performance. Its calculation, however, requires tremendous amount of computational cost and this fact makes its use ...
Comments