Yan Huang
ABSTRACT
The booming of mobile devices and networks leads to an explosive growth in video resources. Efficient video research styles are appealing for facilely exploring video content appropriate to user's intention with a low cognitive load. The style of input becomes particularly relevant during the process of finding a target video clip in a large-scale database on tablets or other mobile devices. Some users have strong allegiance to input text, while others only input sketches. In this paper, we present the first systematic comparison of these two input styles and analyze the responses and feedbacks of users. An elaborated user study was conducted to test two different styles of inputting the semantics. Some users preferred to text input because it could describe their objective easily in a short time, yet some users also liked sketch because it helped illustrate the action or orientation clearly and immediately. Combining text with sketch ("sketch-text") is efficient for searching video of complex queries. The evaluation results show users' enjoying "sketch-text" and its higher performance than other input styles.
- Google Video Search, http://video.google.com/.Google Scholar
- Microsoft Bing Video Search, http://www.bing.com/videos.Google Scholar
- YouTube Videos, https://www.youtube.com/videos.Google Scholar
- Adcock, J., Cooper, M., Pickens, J. Experiments in interactive video search by addition and subtraction. Proceedings of the 2008 international conference on Content-based image and video retrieval, 2008: 465--474. Google ScholarDigital Library
- Cuixia Ma, Yongjin Liu, Hongan Wang, Dongxing Teng, Guozhong Dai. Sketch-based annotation and visualization in video authoring. IEEE Transactions on Multimedia, 2012, 14(4):1153--1165. Google ScholarDigital Library
- Yongjin Liu, Cuixia Ma, Qiufang Fu, Xiaolan Fu, Shengfeng Qin, Lexing Xie. A sketch-based approach for interactive organization of video clips. ACM Transactions on Multimedia Computing, Communications and Applications, 2014, 11(1). Google ScholarDigital Library
- Hu, R., James, S., Wang, T., Collomosse, J. Markov random fields for sketch based video retrieval. Proceedings of the 3rd ACM conference on International conference on multimedia retrieval, 2013: 279--286. Google ScholarDigital Library
- Yuan, J., Zha, Z. J., Zheng, Y. T., Wang, M., Zhou, X., Chua, T. S. Learning concept bundles for video search with complex queries. Proceedings of the 19th ACM international conference on Multimedia, 2011: 453--462. Google ScholarDigital Library
- Cross, A., Bayyapunedi, M., Cutrell, E., Agarwal, A., Thies, W. TypeRighting: combining the benefits of handwriting and typeface in online educational videos. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 2013: 793--796. Google ScholarDigital Library
- Tarashima, S., Irie, G., Tsutsuguchi, K., Arai, H., Taniguchi, Y. Fast image/video collection summarization with local clustering. Proceedings of the 21st ACM international conference on Multimedia, 2013:725--728. Google ScholarDigital Library
- Monserrat, T. J. K. P., Zhao, S., McGee, K., Pandey, A. V. NoteVideo: facilitating navigation of blackboard-style lecture videos. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2013:1139--1148. Google ScholarDigital Library
- Jain A K, Vailaya A. Shape-based retrieval: A case study with trademark image databases {J}. Pattern recognition, 1998, 31 (9): 1369--1390.Google Scholar
- Di Sciascio E, Mongiello M. Query by sketch and relevance feedback for content-based image retrieval over the web {J}. Journal of Visual Languages & Computing, 1999, 10(6): 565--584. Google ScholarDigital Library
- Tseng K Y, Lin Y L, Chen Y H, et al. Sketch-based image retrieval on mobile devices using compact hash bits{C}, Proceedings of the 20th ACM international conference on Multimedia, 2012:913--916. Google ScholarDigital Library
- Chang S F, Chen W, Meng H J, et al. VideoQ: an automated content based video search system using visual cues{C}, Proceedings of the fifth ACM international conference on Multimedia. 1997: 313--324. Google ScholarDigital Library
- Hu R, Collomosse J P. Motion-sketch Based Video Retrieval Using a Trellis Levenshtein Distance{C}, ICPR. 2010: 121--124. Google ScholarDigital Library
- Craggs, B., Kilgallon Scott, M., Alexander, J. ThumbReels: query sensitive web video previews based on temporal, crowdsourced, semantic tagging. Proceedings of the 32nd annual ACM conference on Human factors in computing systems, 2014: 1217--1220. Google ScholarDigital Library
- Collomosse, J. P., McNeill, G., Qian, Y. Storyboard sketches for content based video retrieval. IEEE 12th International Conference on Computer Vision, 2009: 245--252.Google Scholar
- Morikawa, C., de Silva, G. C. User interaction techniques for multimedia retrieval. Proceedings of the 2012 Joint International Conference on Human-Centered Computer Environments, 2012: 68--75. Google ScholarDigital Library
- Monroy-Hernandez, A., Hill, B. M., Gonzanlez-Rivero, J. Computers can't give credit: How automatic attribution falls short in an online remixing community. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2011: 3421--343. Google ScholarDigital Library
- Exploring the Benefits of Text and Sketch in Video Retrieval of Complex Queries
Recommendations
Style-sensitive 3D model retrieval through sketch-based queries
Multimedia in technology enhanced learningTraditional sketch-based 3D model retrieval methods are content-based, which return the search results by ranking the geometric similarities among a free-hand drawing and 3D model candidates. These conventional methods do not consider personal drawing ...
‘CADSketchNet’ - An Annotated Sketch dataset for 3D CAD Model Retrieval with Deep Neural Networks▪
Highlights- The goal of this paper is to create a sketch dataset that is suitable for developing deep learning-based solutions to the problem of search and retrieval in 3D CAD models.
- A sketch dataset of query images, called ‘CADSketchNet’ has ...
Graphical abstractDisplay Omitted
AbstractOngoing advancements in the fields of 3D modelling and digital archiving have led to an outburst in the amount of data stored digitally. Consequently, several retrieval systems have been developed depending on the type of data stored in these ...
Free-hand sketch based image and video retrieval
MM '10: Proceedings of the 18th ACM international conference on MultimediaWe present an overview of our work to date on a sketch based retrieval of image and video. We present a fast technique for extracting motion trajectories from videos and a Viterbi matching approach for retrieving video clips using free-hand sketched ...
Comments