Skip to main content
SpringerLink
Log in

Active domain adaptation with noisy labels for multimedia analysis

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

Supervised learning methods require sufficient labeled examples to learn a good model for classification or regression. However, available labeled data are insufficient in many applications. Active learning (AL) and domain adaptation (DA) are two strategies to minimize the required amount of labeled data for model training. AL requires the domain expert to label a small number of highly informative examples to facilitate classification, while DA involves tuning the source domain knowledge for classification on the target domain. In this paper, we demonstrate how AL can efficiently minimize the required amount of labeled data for DA. Since the source and target domains usually have different distributions, it is possible that the domain expert may not have sufficient knowledge to answer each query correctly. We exploit our active DA framework to handle incorrect labels provided by domain experts. Experiments with multimedia data demonstrate the efficiency of our proposed framework for active DA with noisy labels.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8

Similar content being viewed by others

References

  1. Allwein, E.L., Schapire, R.E., Singer, Y.: Reducing multiclass to binary: A unifying approach for margin classifiers. JMLR 1(1), 113–141 (2000)

    MathSciNet  Google Scholar 

  2. Aodha, O.M., Campbell, N.D., Kautz, J., Brostow, G.J.: Hierarchical subquery evaluation for active learning on a graph. In: CVPR (2014)

  3. Argyrious, A., Evegenious, T.: Multi-task feature learning. In: NIPS (2007)

  4. Biggio, B., Nelson, B., Laskov, P.: Support vector machines under adversarial label noise. J. Mach. Learn. Res. 20, 97–112 (2011)

    Google Scholar 

  5. Bonilla, E., Chai, K., Williams, C.: Multi-task gaussian process prediction. In: NIPS (2008)

  6. Chang, C.C., Lin, C.J.: Libsvm: a library for support vector machines (2001)

  7. Chang, X., Nie, F., Yang, Y., Huang, H.: A convex formulation for semi-supervised multi-label feature selection. In: AAAI (2014)

  8. Dai, W., Yang, Q., Yu, Y.: Boosting for transfer learning. In: ICML (2007)

  9. Daume, H.: Frustratingly easy domain adaptation. In: ACL (2007)

  10. Du, J., Ling, C. X.: Active learning with human-like noisy oracle. In: ICDM (2010)

  11. Duan, L., Xu, D., Tsang, I. W.: Visual event recognition in videos by learning from web data. In: CVPR (2010)

  12. Elhamifar, E., Sapiro, G., Sastry, S: A convex optimization framework for active learning. In: ICCV (2013)

  13. Evgeniou, T., Pontil, M.: Regularized multi-task learning. In: SIGKDD (2004)

  14. Freund, Y., Schapire, R.: A short introduction to boosting. J.Japanese Soc. Artif. Intell. 14(5), 771–780 (1999)

    Google Scholar 

  15. Golovin, D., Krause, A., Ray, D.: Near-optimal bayesian active learning with noisy observations. In: NIPS (2010)

  16. Gretton, A., Borgwardt, K., Scholkopt, B.: A kernel method for the two-sample-problem. In: NIPS (2006)

  17. Han, Y., Wu, F., Zhuang, Y., He, X.: Multi-label transfer learning with sparse representation. TCSVT 20, 1110–1121 (2010)

    Google Scholar 

  18. Han, Y., Wu, F., Tao, D., Shao, J., Zhuang, Y., Jiang, J.: Sparse unsupervised dimensionality reduction for multiple view data. TCSVT 22, 1485–1496 (2012)

    Google Scholar 

  19. Han, Y., Yang, Y., Ma, Z., Shen, H., Sebe, N., Zhou, X.: Image attribute adaptation. TMM 16, 1115–1126 (2014)

    Google Scholar 

  20. Hoi, S., Jin, R., Lyu, M.: Large-scale text categorization by batch mode active learning. In: WWW (2006)

  21. Hua, G., Long, C., Yang, M., Gao, Y.: Collaborative active learning of a kernel machine ensemble for recognition. In: ICCV (2013)

  22. Huang, J., Smola, A., Scholkopf, B.: Correcting sample selection bias by unlabeled data. In: NIPS (2007)

  23. Kulis, B., Saenko, K., Darrell, T.: What you saw is not what you get: Domain adaptation using asymmetric kernel transforms. In: CVPR (2011)

  24. Li, X., Guo, Y.: Multi-level adaptive active learning for scene classification. In: ECCV (2014)

  25. Liang, L., Grauman, K.: Beyond comparing image pairs: Setwise active learning for relative attributes. In: CVPR (2014)

  26. Maron, O., Lozano-Perez, T.: A framework for multiple-instance learning. In: NIPS (1998)

  27. Mihalkova, L., Huynh, T., Mooney, R.: Mapping and revising markov logic networks for transfer learning. In: AAAI (2007)

  28. Natarajan, N., Dhillon, I.S., Ravikumar, P., Tewari, A.: Learning with noisy labels. In: NIPS (2013)

  29. Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowledge Data Eng. 22(10), 1345–1359 (2010)

    Article  Google Scholar 

  30. Rajagopal, A.K., Subramanian, R., Ricci, E., Vieriu, R. L., Lanz, O., Sebe, N., et al.: Exploring transfer learning approaches for head pose classification from multi-view surveillance images. IJCV 109(1–2), 146–167 (2014)

    Article  Google Scholar 

  31. Saenko, K., Kulis, B., Fritz, M., Darrell, T.: Adapting visual category models to new domains. In: ECCV (2010)

  32. Sheng, V., Provost, F., Ipeirotis, P.: Get another label? Improving data quality and data mining using multiple, noisy labelers. In: KDD (2008)

  33. Shi, X., Fan, W., Ren, J.: Actively transfer domain knowledge. In: ECML (2008)

  34. Sogawa, Y., Ueno, T., Kawahara, Y., Washio, T.: Active learning for noisy oracle via density power divergence. Neural Netw. 46, 133–143 (2013)

    Article  MATH  Google Scholar 

  35. Stiefelhagen, R., Bowers, R., Fiscus, J.G.: Multimodal technologies for perception of humans. CLEAR, 2007 (2007)

  36. Tong, S., Koller, D.: Support vector machine active learning with applications to text classification. In: ICML (2000)

  37. Wang, X., Huang, T.K., Schneider, J.: Active transfer learning under model shift. In: ICML (2014)

  38. Yan, R., Yang, J., Hauptmann, A.G.: Automatically labeling video data using multi-class active learning. In: ICCV (2003)

  39. Yan, Y., Ricci, E., Subramanian, R., Lanz, O., Sebe, N.: No matter where you are: Flexible graph-guided multi-task learning for multi-view head pose classification under target motion. In: ICCV (2013)

  40. Yan, Y., Subramanian, R., Lanz, O., Sebe, N.: Active Transfer Learning for Multiview Head-pose Classification. ICPR (2012)

  41. Yan, Y., Yang, Y., Shen, H., Meng, D., Liu, G., Hauptmann, A., Sebe, N.: Complex event detection via event oriented dictionary learning. In: AAAI (2015)

  42. Yan, Y., Ricci, E., Subramanian, R., Liu, G., Sebe, N.: Multitask Linear Discriminant Analysis for View Invariant Action Recognition. IEEE Transactions on Image Processing, vol. 23, no. 12, (2014)

  43. Yang, J., Yan, R., Hauptmann, A.G.: Cross-domain video concept detection using adaptive svms. In: ACM MM (2007)

  44. Yang, L., Hanneke, S., Carbonell, J.: A theory of transfer learning with application to actively transfer. JMLR (2012)

  45. Yang, Y., Nie, F., Xu, D., Luo, J., Zhuang, Y., Pan, Y.: A multimedia retrieval framework based on semi-supervised ranking and relevance feedback. TPAMI 34, 723–742 (2012)

    Article  Google Scholar 

  46. Yang, Y., Ma, Z., Nie, F., Chang, X., Hauptmann, A. G.: Multi-class active learning by uncertainty sampling with diversity maximization. IJCV, 11 (2014)

  47. Yao, Y., Dorretto, G.: Boosting for transfer learning with multiple sources. In: CVPR (2010)

  48. Zhang, J., Han, Y., Tang, J., Hu, Q., Jiang, J.: What can we learn about motion videos from still images? In: ACM MM (2014)

Download references

Acknowledgments

This work was partially supported by the MIUR Cluster project Active Ageing at Home, the EC project xLiMe and A*STAR Singapore under the Human-Centered Cyber-physical Systems (HCCS) grant.

Author information

Authors and Affiliations

  1. Department of Computer Science and Information Engineering, University of Trento, Trento, Italy

    Gaowen Liu, Yan Yan, Jingkuan Song & Nicu Sebe

  2. Advanced Digital Sciences Center, UIUC, Singapore, Singapore

    Ramanathan Subramanian

  3. Department of Computer Science, University of Delaware, Newark, DE, USA

    Guoyu Lu

Authors
  1. Gaowen Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yan Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ramanathan Subramanian
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jingkuan Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Guoyu Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Nicu Sebe
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yan Yan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, G., Yan, Y., Subramanian, R. et al. Active domain adaptation with noisy labels for multimedia analysis. World Wide Web 19, 199–215 (2016). https://doi.org/10.1007/s11280-015-0343-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11280-015-0343-3

Keywords

Search

Navigation