ABSTRACT
We present a novel and efficient constrained tensor factorization algorithm that first represents a video archive, of multimedia news stories concerning a news event, as a sparse tensor of order 4. The dimensions correspond to extracted visual memes, verbal tags, time periods and cultures. The iterative algorithm then approximately but accurately ex- tracts coherent quad-clusters, each of which represents a significant summary of an important independent aspect of the news event. We give examples of quad-clusters extracted from tensors with at least 108 entries derived from the international news coverage of the Ebola epidemic, AirAsia flight Q8501 and Zika virus. We show the method is fast, can be tuned to give preferences to any subset of its four dimensions, and exceeds three existing methods in performance.
- Hierarchical biclustering toolbox. https://sites.google.com/site/kittipat/hierarchical-biclustering.Google Scholar
- Microsoft translator text api. https://www.microsoft.com/en-us/translator/translatorapi.aspx.Google Scholar
- A. Banerjee, S. Basu, and S. Merugu. Multi-way clustering on relation graphs. SIAM International Conference on Data Mining, 2007.Google ScholarCross Ref
- A. Banerjee, I. Dhillon, J. Ghosh, S. Merugu, and D. Modha. A generalized maximum entropy approach to bregman co-clustering and matrix approximation. JMLR, 2007. Google ScholarDigital Library
- R. Cai, L. Lu, and A. Hanjalic. Co-clustering for auditory scene categorization. IEEE TRANSACTIONS ON MULTIMEDIA, 2008. Google ScholarDigital Library
- W.-S. Chu, Y. Song, and A. Jaimes. Video co-summarization: Video summarization by visual co-occurrence. CVPR, 2015.Google ScholarCross Ref
- I. Dhillon. Coclustering documents and words using bipartite spectral graph partitioning. KDD, 2001. Google ScholarDigital Library
- I. Dhillon, S. Mallela, and Modha. Information-theoretic co-clustering. KDD, 2003. Google ScholarDigital Library
- C. Ding, W. P. T. Li, and H. Park. Orthogonal nonnegative matrix trifactorizations for clustering. KDD, 2006. Google ScholarDigital Library
- E. Dumont and G. Q. enot. Automatic story segmentation for tv news video using multiple modalities. International Journal of Digital Multimedia Broadcasting, 2012.Google ScholarCross Ref
- S. Essid and C. Favotte. Smooth nonnegative matrix factorization for unsupervised audiovisual document structuring. IEEE TRANSACTIONS ON MULTIMEDIA, 2013. Google ScholarDigital Library
- G. Irie, D. Liu, Z. Li, and S.-F. Chang. A bayesian approach to multimodal visual dictionary learning. CVPR, 2013. Google ScholarDigital Library
- M. Jiang, A. Beutel, B. H. P. Cui, S. Yang, and C. Faloutsos. A general suspiciousness metric for dense blocks in multimodal data. ICDM, 2015. Google ScholarDigital Library
- B. Jou, H. Li, and J. G. Ellis. Structured exploration of who, what, when, and where in heterogeneous multimedia news sources. ACM MM, 2013. Google ScholarDigital Library
- Y.-R. LIN, H. SUNDARAM, M. D. CHOUDHURY, and A. KELLIHER. Discovering multirelational structure in social media streams. TOMM, 2012. Google ScholarDigital Library
- H. Liu, Z. Wu, X. Li, D. Cai, and T. S. Huang. Constrained nonnegative matrix factorization for image representation. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012. Google ScholarDigital Library
- A. Messina, M. Montagnuolo, R. D. Massa, and R. Borgotallo. Hyper media news: a fully automated platform for large scale analysis, production and distribution of multimodal news content. Multimed Tools Appl, 2013. Google ScholarDigital Library
- T. Opsahl, F. Agneessens, and J. Skvoretzc. Node centrality in weighted networks: Generalizing degree and shortest paths. Social Networks, 2010.Google Scholar
- E. E. Papalexakis, N. D. Sidiropoulos, and R. Bro. From k-means to higher-way co-clustering: multilinear decomposition with sparse latent factors. IEEE Transactions on Signal Processing, 2012. Google ScholarDigital Library
- J. R. K. Ruilin Xu, Chun-Yu Tsai. An adaptive anchor frame detection algorithm based on background detection for news video analysis. IEEE ICALIP, 2016.Google Scholar
- H. Shan and A. Banerjee. Bayesian co-clustering. ICDM, 2008. Google ScholarDigital Library
- R. TIBSHIRANIT. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society., 1996.Google Scholar
- X. WANG, L. XIE, M. LU, B. MA, E. S. CHNG, and H. LI. Broadcast news story segmentation using conditional random fields and multimodal features. IEICE TRANS. INF. and SYST, 2012.Google Scholar
- X. Wu, A. G. Hauptmann, and C.-W. Ngo. Measuring novelty and redundancy with multiple modalities in cross-lingual broadcast news. Computer Vision and Image Understanding, 2008. Google ScholarDigital Library
- X. Wu, C.-W. Ngo, and Q. Li. Threading and autodocumenting news videos. IEEE Signal Processing Magazine, 2006.Google Scholar
- J. Yang and J. Leskovec. Overlapping community detection at scale: A nonnegative matrix factorization approach. WSDM, 2013. Google ScholarDigital Library
- Q. Zhou, G. Xu, and Y. Zong. Web co-clustering of usage network using tensor decomposition. IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technologies., 2009. Google ScholarDigital Library
Index Terms
News Event Understanding by Mining Latent Factors From Multimodal Tensors
Recommendations
Further results on Cauchy tensors and Hankel tensors
In this article, we present various new results on Cauchy tensors and Hankel tensors. We first introduce the concept of generalized Cauchy tensors which extends Cauchy tensors in the current literature, and provide several conditions characterizing ...
On norm compression inequalities for partitioned block tensors
AbstractWhen a tensor is partitioned into subtensors, some tensor norms of these subtensors form a tensor called a norm compression tensor. Norm compression inequalities for tensors focus on the relation of the norm of this compressed tensor to the norm ...
$M$-Tensors and Some Applications
We introduce $M$-tensors. This concept extends the concept of $M$-matrices. We denote $Z$-tensors as the tensors with nonpositive off-diagonal entries. We show that $M$-tensors must be $Z$-tensors and the maximal diagonal entry must be nonnegative. The ...
Comments