Abstract
As a new information sharing platform, microblog has got explosive growth in recent years and has become an important source for public opinion mining. A variety of information like the reviews of brands/products or the trends of events can be socially sensed from such kind of data. However, it is still a challenging task to search relevant microblogs as the user generated content tends to be mixed with noise. Besides short text, image is getting popular in microblogs due to its power in visual information conveying. In this paper, we leverage textual and visual cues integratedly and propose a general re-ranking approach for microblog retrieval via multi-graph semi-supervised learning. We argue that the different types of information in microblogs correspond to different relationships among microblogs and each type of the relationship can be represented as a similarity graph. We then integrate different graphs into a unified framework and solve them simultaneously for microblog re-ranking. Extensive experiments on a recently published Brand-Social-Net dataset showed the effectiveness of the proposed method and marginal improvements have been achieved in accuracy as compared to the single graph model based method.
Similar content being viewed by others
Notes
The CITROEN C4 is a small family car produced by French automaker CITROEN since autumn 2004
C4 also stands for other 63 things according to wikipedia in oct, 2014.
References
Angelini M, Ferro N, Jvelin K, Keskustalo H, Pirkola A, Santucci G, Silvello G (2013) Cumulated relative position: a metric for ranking evaluation. IIR:57–60
Deng J, Berg AC, Fei-Fei L (2011) Hierarchical semantic indexing for large scale image retrieval. IEEE Conf Comput Vis Pattern Recog:785–792
Duan YJ, Jiang L, Qin T, Zhou M, Shum H-Y (2010) An empirical study on learning to rank of tweets. In: Proceeding COLING ’10 proceedings of the 23rd international conference on computational linguistics, pp 295–303
Frakes WB, Baeza-Yates R (1992) Information retrieval: data structures and algorithms
Ganainy E, Wei Z, Magdy W, Gao W (2013) QCRI at TREC 2013 Microblog Track. TREC 2013 Microblog Track
Gao Y, Wang M, Tao D, Ji R, Dai Q (2012) 3D object retrieval and recognition with hypergraph analysis. IEEE Trans Image Process 22(9):4290–4303
Gao Y, Wang M, Zha Z-J, Shen JL, Li XL, Wu XD (2013) Visual-textual joint relevance learning for tag-based social image search. IEEE Trans Image Process 22(1):363–376
Gao Y, Wang Fl, Luan HB, Chua T-S (2014) Brand data gathering from live social media streams. ICMR
Han ZY, Li XW, Yang MY, Qi HL, Li S, Zhao TJ (2012) HIT at TREC 2012 Microblog Track. TREC 2012 Microblog Track
He J, Li M, Zhang H-J, Tong H, Zhang C (2004) Manifold-ranking based image retrieval. In: Proceedings of the 12th annual ACM international conference on Multimedia, pp 9–16
Hong RC, Wang M, Gao Y, Tao DC, Li XL, Wu XD (2014) Image annotation by multiple-instance learning with discriminative feature mapping and selection. IEEE T Cybern 44(5):669–680
Li H, Wang X, Tang J, Zhao C (2013) Combining global and local matching of multiple features for precise item image retrieval. Multimedia Syst 19(1):37–49
Manning CD, Raghavan P, Schütze H (2008) Introduction to information retrieval, 1
Martins F, Mourao A, Magalhaes J (2013) NovaSearch at TREC 2013 Microblog Track:Experiments with reranking using Wikipedia. TREC 2013 Microblog Track
Naveed N, Gottron T, Kunegis J, Alhadi AC (2011) Searching microblogs: coping with sparsity and document quality. CIKM 2011:183–188
Rui Y, Huang TS, Ortega M, Mehrotra S (1998) Relevance feedback: a power tool for interactive content-based image retrieval. IEEE Trans Circ Syst Video Technol 8(5):644–655
Siddiquie B, Feris RS, Davis LS (2011) Image ranking and retrieval based on multi-attribute queries. IEEE Conf Comput Vis Pattern Recog:801–808
Tang JH, Hong RC, Yan SC, Chua T-S, Qi G-J, Jain R (2011) Image annotation by kNN-sparse graph-based label propagation over noisily-tagged web images. ACM Trans Intell Syst Technol 2(2)
Tang S, Zheng Y-T, Wang Y, Chua T-S (2012) Sparse ensemble learning for concept detection. IEEE Trans Multimedia 14(1):43–54
Teevan J, Ramage D, Morris MR (2011) #TwitterSearch: a comparison of microblog search and web search. WSDM 2011:35–44
Wang M, Hua X-S, Hong R, Tang J, Qi G-J, Song Y (2009) Unified video annotation via multigraph learning. IEEE Trans Circ Syst Video Technol 19(5):733–746
Wang X, Liu K, Tang X (2011) Query-specific visual semantic spaces for web image re-ranking. IEEE Conf Comput Vis Pattern Recog:857–864
Wu HC, Luk RWP, Wong KF, Kwok KL (2008) Interpreting TF-IDF term weights as making relevance decisions. ACM Trans Inf Syst 26(3):4290–4303
Yang J, Yu K, Gong Y, Huang T (2009) Linear spatial pyramid matching using sparse coding for image classification. In: IEEE conference on computer vision and pattern recognition, pp 1794–1801
Yang Y, Yang Y, Huang Z, Shen HT, Nie FP (2011) Tag localization with spatial correlations and joint group sparsity. IEEE Comput Vis Pattern Recog:881–888
Yang Y, Yang Y, Shen HT (2013) Effective transfer tagging from image to video ACM transactions on multimedia computing. Commun Appl 9(2):14
Yang Y, Zha Z-J, Gao Y, Zhu X, Chua T-S (2014) Exploiting web images for semantic video indexing via robust sample-specific. Loss IEEE Trans Multimedia 16(6):1677–1689
Yang Y, Wang X, Guand T, Shene Jl, Yua L (2014) A multi-dimensional image quality prediction model for user-generated images in social networks. Inf Sci Int J 281:601–610
Zhang H, Zha Z-J, Yan S, Bian J, Chua T-S (2012) Attribute feedback. ACM Multimedia:79–88
Zhou XS, Huang TS (2003) Relevance feedback in image retrieval: A comprehensive review. Multimedia Syst 8(6):536–544
Zhou D, Bousquet O, Lal TN, Weston J, Schölkopf B (2003) Learning with local and global consistency. In: NIPS, vol 16, pp 321–328
Acknowledgments
This work was supported by the Natural Science Foundation of China (61173104, 61472059) and the Fundamental Research Funds for the Central Universities (DUT13JR03, DUT14QY03).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, H., Guan, Y., Liu, L. et al. Re-ranking for microblog retrieval via multiple graph model. Multimed Tools Appl 75, 8939–8954 (2016). https://doi.org/10.1007/s11042-014-2336-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-2336-0