skip to main content
10.1145/2733373.2807999acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
abstract

Weakly Supervised Learning of Part-based Models for Interaction Prediction via LDA

Published:13 October 2015Publication History

ABSTRACT

In this paper, we focus on interaction prediction which infers to what interaction might happen in the near future. Each interaction is modeled by mixtures of deformable parts in order to provide higher tolerance to part configurations. In our weakly supervised learning setting, part detectors are learned from training data without bounding boxes around the true locations of the people in each frame. The discriminating features are obtained using a two-layer Linear Discriminant Analysis (LDA) classification to promise maximal separability for parts and interactions respectively. Experimental results demonstrate that the proposed system is effective in learning part-based models in less annotated information and achieves comparable performance to state-of-the-art fully supervised approaches.

References

  1. M. Ryoo, "Human activity prediction: Early recognition of ongoing activities from streaming videos," in Computer Vision (ICCV), 2011 IEEE International Conference on. IEEE, 2011, pp. 1036--1043. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. M. Raptis and L. Sigal, "Poselet key-framing: A model for human activity recognition," in Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on. IEEE, 2013, pp. 2650--2657. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. T. Lan, T.-C. Chen, and S. Savarese, "A hierarchical representation for future action prediction," in Computer Vision--ECCV 2014. Springer, 2014, pp. 689--704.Google ScholarGoogle Scholar
  4. I. Endres, K. Shih, J. Jiaa, and D. Hoiem, "Learning collections of part models for object recognition," in Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on. IEEE, 2013, pp. 939--946. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. M. Juneja, A. Vedaldi, C. Jawahar, and A. Zisserman, "Blocks that shout: Distinctive parts for scene classification," in Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on. IEEE, 2013, pp. 923--930. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. C. Doersch, A. Gupta, and A. A. Efros, "Mid-level visual element discovery as discriminative mode seeking," in Advances in Neural Information Processing Systems, 2013, pp. 494--502.Google ScholarGoogle Scholar
  7. Y. Yang and D. Ramanan, "Articulated pose estimation with flexible mixtures-of-parts," in Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. IEEE, 2011, pp. 1385--1392. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. B. Hariharan, J. Malik, and D. Ramanan, "Discriminative decorrelation for clustering and classification," in Computer Vision--ECCV 2012. Springer, 2012, pp. 459--472. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, vol. 1. IEEE, 2005, pp. 886--893. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. H. Wang and C. Schmid, "Action recognition with improved trajectories," in Computer Vision (ICCV), 2013 IEEE International Conference on. IEEE, 2013, pp. 3551--3558. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. M. S. Ryoo and J. K. Aggarwal, "UT-Interaction Dataset, ICPR contest on Semantic Description of Human Activities (SDHA)," http://cvrc.ece.utexas.edu/SDHA2010/Human_Interaction.html, 2010.Google ScholarGoogle Scholar

Index Terms

  1. Weakly Supervised Learning of Part-based Models for Interaction Prediction via LDA

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      MM '15: Proceedings of the 23rd ACM international conference on Multimedia
      October 2015
      1402 pages
      ISBN:9781450334594
      DOI:10.1145/2733373

      Copyright © 2015 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 13 October 2015

      Check for updates

      Qualifiers

      • abstract

      Acceptance Rates

      MM '15 Paper Acceptance Rate56of252submissions,22%Overall Acceptance Rate995of4,171submissions,24%

      Upcoming Conference

      MM '24
      MM '24: The 32nd ACM International Conference on Multimedia
      October 28 - November 1, 2024
      Melbourne , VIC , Australia

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader