skip to main content
research-article

Boosted Multifeature Learning for Cross-Domain Transfer

Published: 05 February 2015 Publication History

Abstract

Conventional learning algorithm assumes that the training data and test data share a common distribution. However, this assumption will greatly hinder the practical application of the learned model for cross-domain data analysis in multimedia. To deal with this issue, transfer learning based technology should be adopted. As a typical version of transfer learning, domain adaption has been extensively studied recently due to its theoretical value and practical interest. In this article, we propose a boosted multifeature learning (BMFL) approach to iteratively learn multiple representations within a boosting procedure for unsupervised domain adaption. The proposed BMFL method has a number of properties. (1) It reuses all instances with different weights assigned by the previous boosting iteration and avoids discarding labeled instances as in conventional methods. (2) It models the instance weight distribution effectively by considering the classification error and the domain similarity, which facilitates learning new feature representation to correct the previously misclassified instances. (3) It learns multiple different feature representations to effectively bridge the source and target domains. We evaluate the BMFL by comparing its performance on three applications: image classification, sentiment classification and spam filtering. Extensive experimental results demonstrate that the proposed BMFL algorithm performs favorably against state-of-the-art domain adaption methods.

References

[1]
Samir Al-Stouhi and Chandan K. Reddy. 2011. Adaptive boosting for transfer learning using dynamic updates. In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases. 60--75.
[2]
Bing-Kun Bao, Weiqing Min, Ke Lu, and Changsheng Xu. 2013. Social event detection with robust highorder co-clustering. In Proceedings of the 3rd ACM Conference on International Conference on Multimedia Retrieval (ICMR'13). ACM, New York, 135--142.
[3]
Shai Ben-David, John Blitzer, Koby Crammer, and Fernando Pereira. 2006. Analysis of representations for domain adaptation. In Proceedings of the Annual Conference on Neural Information Processing Systems. 137--144.
[4]
Shai Ben-David, Tyler Lu, Teresa Luu, and Dávid Pál. 2010. Impossibility theorems for domain adaptation. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics. 129--136.
[5]
Yoshua Bengio. 2009. Learning deep architectures for AI. Found. Trends Machine Learn. 2, 1, 1--127.
[6]
Alessandro Bergamo and Lorenzo Torresani. 2010. Exploiting weakly-labeled Web images to improve object classification: a domain adaptation approach. In Proceedings of the Annual Conference on Neural Information Processing Systems. 181--189.
[7]
John Blitzer, Mark Dredze, and Fernando Pereira. 2007. Biographies, Bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification. In Proceedings of the Annual Conference on Neural Information Processing Systems.
[8]
John Blitzer, Sham Kakade, and Dean P. Foster. 2011. Domain adaptation with coupled subspaces. J. Machine Learn. Rese. 15, 173--181.
[9]
John Blitzer, Ryan T. McDonald, and Fernando Pereira. 2006. Domain adaptation with structural correspondence learning. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 120--128.
[10]
Karsten M. Borgwardt, Arthur Gretton, Malte J. Rasch, Hans-Peter Kriegel, Bernhard Schölkopf, and Alexander J. Smola. 2006. Integrating structured biological data by kernel maximum mean discrepancy. In Proceedings of the International Conference on Intelligent Systems for Molecular Biology. 49--57.
[11]
Markus Brenner and Ebroul Izquierdo. 2012. Social event detection and retrieval in collaborative photo collections. In Proceedings of the 2nd ACM International Conference on Multimedia Retrieval (ICMR'12). ACM, New York, 21:1--21:8.
[12]
Lorenzo Bruzzone and Mattia Marconcini. 2010. Domain Adaptation Problems: A DASVM classification technique and a circular validation strategy. IEEE Trans. Pattern Anal. Mach. Intell. 32, 5, 770--787.
[13]
Minmin Chen, Kilian Q. Weinberger, and Yixin Chen. 2011. Automatic feature decomposition for single view co-training. In Proceedings of the International Conference on Machine Learning. 953--960.
[14]
Minmin Chen, Zhixiang Eddie Xu, Kilian Q. Weinberger, and Fei Sha. 2012. Marginalized denoising autoencoders for domain adaptation. In Proceedings of the International Conference on Machine Learning.
[15]
Wenyuan Dai, Qiang Yang, Gui-Rong Xue, and Yong Yu. 2007. Boosting for transfer learning. In Proceedings of the 30th International Conference on Machine Learning. 193--200.
[16]
Hal Daumé III. 2007. Frustratingly Easy Domain Adaptation. In Proceedings of the Annual Conference on Neural Information Processing Systems.
[17]
Lixin Duan, Ivor W. Tsang, Dong Xu, and Tat-Seng Chua. 2009a. Domain adaptation from multiple sources via auxiliary classifiers. In Proceedings of the International Conference on Machine Learning. 37.
[18]
Lixin Duan, Ivor Wai-Hung Tsang, Dong Xu, and Stephen J. Maybank. 2009b. Domain Transfer SVM for video concept detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1375--1381.
[19]
Lixin Duan, Dong Xu, Ivor Wai-Hung Tsang, and Jiebo Luo. 2010. Visual event recognition in videos by learning from web data. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1959--1966.
[20]
Wolfgang Effelsberg. 2013. A personal look back at twenty years of research in multimedia content analysis. ACM Trans. Multimedia Comput. Commun. Appl. 9, 43:1--43:4.
[21]
Yoav Freund and Robert E. Schapire. 1996. Experiments with a new boosting algorithm. In Proceedings of the International Conference on Machine Learning. 148--156.
[22]
Xavier Glorot, Antoine Bordes, and Yoshua Bengio. 2011. Domain adaptation for large-scale sentiment classification: A deep learning approach. In Proceedings of the International Conference on Machine Learning. 513--520.
[23]
Boqing Gong, Kristen Grauman, and Fei Sha. 2013. Connecting the dots with landmarks: discriminatively learning domain-invariant features for unsupervised domain adaptation. In Proceedings of the International Conference on Machine Learning. 222--230.
[24]
Boqing Gong, Yuan Shi, Fei Sha, and Kristen Grauman. 2012. Geodesic flow kernel for unsupervised domain adaptation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2066--2073.
[25]
Raghuraman Gopalan, Ruonan Li, and Rama Chellappa. 2011. Domain adaptation for object recognition: An unsupervised approach. In Proceedings of the IEEE International Conference on Computer Vision. 999--1006.
[26]
Gregory Griffin, Alex Holub, and Pietro Perona. 2007. Caltech-256 object category dataset. Tech. Rep. 7694, California Institute of Technology.
[27]
Amaury Habrard, Jean-Philippe Peyrache, and Marc Sebban. 2013. Boosting for Unsupervised Domain Adaptation. In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases. 433--448.
[28]
Jiayuan Huang, Alexander J. Smola, Arthur Gretton, Karsten M. Borgwardt, and Bernhard Schölkopf. 2006. Correcting sample selection bias by unlabeled data. In Proceedings of the Annual Conference on Neural Information Processing Systems. 601--608.
[29]
I.-H. Jhuo, D. Liu, D. T. Lee, and S.-F. Chang. 2012. Robust visual domain adaptation with low-rank reconstruction. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2168--2175.
[30]
Xin Jin, Andrew C. Gallagher, Liangliang Cao, Jiebo Luo, and Jiawei Han. 2010. The wisdom of social multimedia: using flickr for prediction and forecast. In Proceedings of the ACM International Conference on Multimedia (MM'10). 1235--1244.
[31]
B. Kulis, K. Saenko, and T. Darrell. 2011. What you saw is not what you get: Domain adaptation using asymmetric kernel transforms. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1785--1792.
[32]
Kevin Lai and Dieter Fox. 2010. Object recognition in 3D point clouds using web data and domain adaptation. Int. J. Rob. Res. 29, 8, 1019--1037.
[33]
S. Liu, Z. Song, G. Liu, C. Xu, H. Lu, and S. Yan. 2012. Street-to-shop: Cross-scenario clothing retrieval via parts alignment and auxiliary set. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
[34]
Xueliang Liu and Benoit Huet. 2013. Heterogeneous features and model selection for event-based media classification. In Proceedings of the 3rd ACM Conference on International Conference on Multimedia Retrieval (ICMR'13). ACM, New York, 151--158.
[35]
Wenting Lu, Jingxuan Li, Tao Li, Weidong Guo, Honggang Zhang, and Jun Guo. 2013. Web multimedia object classification using cross-domain correlation knowledge. IEEE Trans. Multimedia 15, 8.
[36]
Ge Ma and Jiebo Luo. 2013. Is a picture worth 1000 votes? Analyzing the sentiment of election related social photos. In Proceedings of the IEEE International Conference on Multimedia and Expo. 1--6.
[37]
Zhigang Ma, Yi Yang, Yang Cai, Nicu Sebe, and Alexander G. Hauptmann. 2012. Knowledge adaptation for ad hoc multimedia event detection with few exemplars. In Proceedings of the ACM International Conference on Multimedia (MM'12). 469--478.
[38]
Mor Naaman. 2012. Social multimedia: highlighting opportunities for search and mining of multimedia data in social media applications. Multimedia Tools Appl. 56, 1, 9--34.
[39]
Jie Ni, Qiang Qiu, and Rama Chellappa. 2013. Subspace interpolation via dictionary learning for unsupervised domain adaptation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 692--699.
[40]
Salvatore Orlando, Francesco Pizzolon, and Gabriele Tolomei. 2013. SEED: A framework for extracting social events from press news. In Proceedings of the 22nd International Conference on World Wide Web Companion (WWW'13 Companion). International World Wide Web Conferences Steering Committee, 1285--1294.
[41]
Sinno Jialin Pan, Ivor W. Tsang, James T. Kwok, and Qiang Yang. 2009. Domain adaptation via transfer component analysis. In Proceedings of the 21st International Joint Conference on Artificial Intelligence. 1187--1192.
[42]
Sinno Jialin Pan and Qiang Yang. 2010. A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22, 10, 1345--1359.
[43]
Georgios Petkos, Symeon Papadopoulos, and Yiannis Kompatsiaris. 2012. Social event detection using multimodal clustering and integrating supervisory signals. In Proceedings of the 2nd ACM International Conference on Multimedia Retrieval (ICMR'12). ACM, New York, 23:1--23:8.
[44]
Guojun Qi, Charu C. Aggarwal, and Thomas S. Huang. 2011. Towards semantic knowledge propagation from text corpus to web images. In Proceedings of the International World Wide Web Conference (WWW'11). 297--306.
[45]
Guo-Jun Qi, Charu C. Aggarwal, Qi Tian, Heng Ji, and Thomas S. Huang. 2012. Exploring context and content links in social media: A latent space method. IEEE Trans. Pattern Anal. Mach. Intell. 34, 5, 850--862.
[46]
Shengsheng Qian, Tianzhu Zhang, and Changsheng Xu. 2014a. Boosted multi-modal supervised latent Dirichlet allocation for social event classification. In Proceedings of the 22nd International Conference on Pattern Recognition.
[47]
Shengsheng Qian, Tianzhu Zhang, and Changsheng Xu. 2014b. Social event classification via boosted multi-modal supervised latent Dirichlet allocation. ACM Trans. Multimedia Comput. Commun. Appl.
[48]
M. Sugiyama, A. Schwaighofer, N. D. Lawrence, and J. Candela Quiñonero, 2009. Covariate shift by kernel mean matching. In Dataset Shift in Machine Learning, MIT Press, 131--160.
[49]
Timo Reuter and Philipp Cimiano. 2012. Event-based classification of social media streams. In Proceedings of the 2nd ACM International Conference on Multimedia Retrieval (ICMR'12). ACM, New York, 22:1--22:8.
[50]
Suman Deb Roy, Tao Mei, Wenjun Zeng, and Shipeng Li. 2012. SocialTransfer: Cross-domain transfer learning from social streams for media applications. In Proceedings of the ACM International Conference on Multimedia (MM'12). 649--658.
[51]
Kate Saenko, Brian Kulis, Mario Fritz, and Trevor Darrell. 2010. Adapting visual category models to new domains. In Proceedings of the European Conference on Computer Vision. 213--226.
[52]
Cees Snoek, Marcel Worring, Jan van Gemert, Jan-Mark Geusebroek, and Arnold W. M. Smeulders. 2006. The challenge problem for automated detection of 101 semantic concepts in multimedia. In Proceedings of the ACM International Conference on Multimedia. 421--430.
[53]
Chenhao Tan, Lillian Lee, Jie Tang, Long Jiang, Ming Zhou, and Ping Li. 2011. User-level sentiment analysis incorporating social networks. In Proceedings of the 17th International Conference on Knowledge Discovery and Data Mining. 1397--1405.
[54]
Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol. 2008. Extracting and composing robust features with denoising autoencoders. In Proceedings of the International Conference on Machine Learning. 1096--1103.
[55]
Chang Wang and Sridhar Mahadevan. 2009. Manifold alignment without correspondence. In Proceedings of the International Joint Conference on Artificial Intelligence. 1273--1278.
[56]
Yanxiang Wang, Hari Sundaram, and Lexing Xie. 2012. Social event detection with interaction graph modeling. In Proceedings of the 20th ACM International Conference on Multimedia (MM'12). ACM, New York, 865--868.
[57]
XuLei Yang, Qing Song, and Yue Wang. 2007. A weighted support vector machine for data classification. Int. J. Pattern Recognit Artif Intell. 21, 5, 961--976.
[58]
Xiaoshan Yang, Tianzhu Zhang, and Changsheng Xu. 2014. Cross domain feature learning in social multimedia. IEEE Trans. Multimedia.
[59]
Yi Yang, Zhigang Ma, Alexander G. Hauptmann, and Nicu Sebe. 2013. Feature selection for multimedia analysis by sharing information among multiple tasks. IEEE Trans. Multimedia 15, 3, 661--669.
[60]
Yi Yao and Gianfranco Doretto. 2010. Boosting for transfer learning with multiple sources. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1855--1862.
[61]
Maia Zaharieva, Matthias Zeppelzauer, and Christian Breiteneder. 2013. Automated social event detection in large photo collections. In Proceedings of the 3rd ACM Conference on International Conference on Multimedia Retrieval (ICMR'13). ACM, New York, 167--174.
[62]
Tianzhu Zhang, Bernard Ghanem, Si Liu, Changsheng Xu, and Narendra Ahuja. 2013. Low-rank sparse coding for image classification. In Proceedings of the International Conference on Computer Vision.
[63]
Tianzhu Zhang, Jing Liu, Si Liu, Yi Ouyang, and Hanqing Lu. 2009. Boosted exemplar learning for human action recognition. In Proceedings of the IEEE 12th International Conference on Computer Vision Workshops.
[64]
Tianzhu Zhang, Jing Liu, Si Liu, Changsheng Xu, and Hanqing Lu. 2011. Boosted exemplar learning for action recognition and annotation. IEEE Trans. Circuits Syst. Video Technol. 21, 7, 853--866.
[65]
Tianzhu Zhang and Changsheng Xu. 2014. Cross-domain multi-event tracking via CO-PMHT. ACM Trans. Multimedia Comput. Commun. Appl. 10, 4, 31.
[66]
Ji Zhu, Hui Zou, Saharon Rosset, and Trevor Hastie. 2009. Multi-class AdaBoost. Statistics and Its Interface 2, 3.

Cited By

View all
  • (2025)Unified Text-Image Space Alignment with Cross-Modal Prompting in CLIP for UDAACM Transactions on Multimedia Computing, Communications, and Applications10.1145/3715699Online publication date: 5-Feb-2025
  • (2023)A Powerful Zero-Watermarking Algorithm for Copyright Protection of Color Images Based on Quaternion Radial Fractional Hahn Moments and Artificial Bee Colony AlgorithmCircuits, Systems, and Signal Processing10.1007/s00034-023-02379-242:9(5602-5633)Online publication date: 26-Apr-2023
  • (2022)Relative Alignment Network for Source-Free Multimodal Video Domain AdaptationProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548009(1652-1660)Online publication date: 10-Oct-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications
ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 11, Issue 3
January 2015
173 pages
ISSN:1551-6857
EISSN:1551-6865
DOI:10.1145/2733235
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 February 2015
Accepted: 01 September 2014
Revised: 01 August 2014
Received: 01 March 2014
Published in TOMM Volume 11, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Domain adaptation
  2. boosting
  3. denoising auto-encoder
  4. multifeature

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • National Program on Key Basic Research Project (973 Program, Project No. 2012CB316304)
  • Singapore National Research Foundation under its International Research Centre@Singapore Funding Initiative
  • National Natural Science Foundation of China
  • National Natural Science Foundation of China (61225009, 61303173)
  • IDM Programme Office

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 03 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Unified Text-Image Space Alignment with Cross-Modal Prompting in CLIP for UDAACM Transactions on Multimedia Computing, Communications, and Applications10.1145/3715699Online publication date: 5-Feb-2025
  • (2023)A Powerful Zero-Watermarking Algorithm for Copyright Protection of Color Images Based on Quaternion Radial Fractional Hahn Moments and Artificial Bee Colony AlgorithmCircuits, Systems, and Signal Processing10.1007/s00034-023-02379-242:9(5602-5633)Online publication date: 26-Apr-2023
  • (2022)Relative Alignment Network for Source-Free Multimodal Video Domain AdaptationProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548009(1652-1660)Online publication date: 10-Oct-2022
  • (2022)Domain-invariant Graph for Adaptive Semi-supervised Domain AdaptationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/348719418:3(1-18)Online publication date: 4-Mar-2022
  • (2022)Robust color image watermarking using multiple fractional-order moments and chaotic mapMultimedia Tools and Applications10.1007/s11042-022-12282-881:17(24347-24375)Online publication date: 1-Jul-2022
  • (2022)Robust color image watermarking using multi-core Raspberry pi clusterMultimedia Tools and Applications10.1007/s11042-022-12037-581:12(17185-17204)Online publication date: 1-May-2022
  • (2022)Quaternion cartesian fractional hahn moments for color image analysisMultimedia Tools and Applications10.1007/s11042-021-11432-881:1(737-758)Online publication date: 1-Jan-2022
  • (2021)A Novel HDR Image Zero-Watermarking Based on Shift-Invariant Shearlet TransformSecurity and Communication Networks10.1155/2021/66627002021Online publication date: 1-Jan-2021
  • (2021)Reversible Color Image Watermarking Using Fractional-Order Polar Harmonic Transforms and a Chaotic Sine MapCircuits, Systems, and Signal Processing10.1007/s00034-021-01756-z40:12(6121-6145)Online publication date: 1-Dec-2021
  • (2019)Deep Semantic Mapping for Heterogeneous Multimedia Transfer Learning Using Co-Occurrence DataACM Transactions on Multimedia Computing, Communications, and Applications10.1145/324105515:1s(1-21)Online publication date: 24-Jan-2019
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media