Skip to main content
SpringerLink
Log in

An improved belief propagation method for dynamic collage

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

This paper presents a new photo browsing technique, dynamic collage. Although previous photo collage techniques have innate advantages for viewing several photos collectively, they only focus on a static two-dimensional arrangement of photos so that the scalability is limited. In dynamic collage, new photos are incrementally inserted into the collage one by one while the old photos are removed accordingly, the positions of photos in the canvas are updated with a local and incremental manner to form a new layout so as to maximize visibility of all the important information embedded in the current collage meanwhile maintaining the visual continuity of two successive collages. To achieve this goal, a carefully designed optimization method based on belief propagation is employed. Unlike most traditional applications of belief propagation on pairwise MRF, we apply belief propagation on factor graph to optimize terms which cannot be represented by pairwise restricted belief propagation. We propose a novel approximate method to reduce the computation complexity, and this approximate method suggests a direction for using belief propagation on factor graph to optimize high order potential functions similar to ours.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. ACDSee: http://www.acdsee.com/

  2. Chen, J.C., Chu, W.T., Kuo, J.H., Weng, C.Y., Wu, J.L.: Tiling slideshow. In: Proceedings of ACM Multimedia 2006, pp. 25–34 (2006)

  3. Christel, M.G., Hauptmann, A.G., Wactlar, H.D., Ng, T.D.: Collages as dynamic summaries for news video. In: Proceedings of ACM Multimedia 2002, pp. 561–569 (2002)

  4. Diakopoulos, N., Essa, I.: Mediating photo collage authoring. In: Proceedings of ACM Symposium on User Interface Software and Technology 2005, pp. 183–186 (2005)

  5. Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient belief propagation for early vision. Int. J. Comput. Vis. 70(1), 41–54 (2006)

    Article  Google Scholar 

  6. Freeman, W.T., Pasztor, E.C., Carmichael, O.T.: Learning low-level vision. Int. J. Comput. Vis. 40(1), 25–47 (2000)

    Article  MATH  Google Scholar 

  7. Geigel, J., Loui, A.: Using genetic algorithms for album page layouts. IEEE Multimed. 10(4), 16–27 (2003)

    Article  Google Scholar 

  8. Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)

    Article  Google Scholar 

  9. Kang, H., Matsushita, Y., Tang, X., Chen, X.: Space-time video montage. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR’06), vol. 2, pp. 1331–1338 (2006)

  10. Liu, T., Sun, J., Zheng, N.N., Tang, X., Shum, H.Y.: Learning to detect a salient object. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR’07), pp. 1–8 (2007)

  11. Ma, Y.F., Zhang, H.J.: Contrast-based image attention analysis by using fuzzy growing. In: Proceedings of ACM Multimedia 2003, pp. 374–381 (2003)

  12. Mei, T., Zhu, C.Z., Zhou, H.Q., Hua, X.S.: Spatio-temporal quality assessments for home videos. In: Proceedings of ACM Multimedia 2005, pp. 439–442 (2005)

  13. Picasa: http://picasa.google.com/

  14. PicLens: http://www.piclens.com/

  15. Potetz, B.: Efficient belief propagation for vision using linear constraint nodes. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR’07), pp. 1–8 (2007)

  16. Rother, C., Bordeaux, L., Hamadi, Y., Blake, A.: Auto-collage. ACM Trans. Graph. 25(3), 847–852 (2006)

    Article  Google Scholar 

  17. Rother, C., Kumar, S., Kolmogorov, V., Blake, A.: Digital tapestry. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 1, pp. 589–596 (2005)

  18. Sun, J., Zheng, N.N., Shum, H.Y.: Stereo matching using belief propagation. IEEE Trans. Pattern Anal. Mach. Intell. 25(7), 787–800 (2003)

    Article  Google Scholar 

  19. Tang, K.L., Tang, C.K., Wong, T.T.: Dense photometric stereo using tensorial belief propagation. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 1, pp. 132–139 (2005)

  20. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR’01), vol. 1, pp. 511–518 (2001)

  21. Wang, J., Sun, J., Quan, L., Tang, X., Shum, H.Y.: Picture collage. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR’06), vol. 1, pp. 347–354 (2006)

  22. Wang, T., Mei, T., Hua, X.S., Liu, X.L., Zhou, H.Q.: Video collage: a novel presentation of video sequence. In: Proceedings of IEEE International Conference on Multimedia and Expo (ICME’07), pp. 1479–1482 (2007)

Download references

Author information

Authors and Affiliations

  1. Visual Computing Group, Microsoft Research Asia, Beijing, China

    Yingzhen Yang, Yichen Wei & Yasuyuki Matsushita

  2. State Key Lab of CAD&CG, Zhejiang University, Hangzhou, China

    Yingzhen Yang, Chunxiao Liu & Qunsheng Peng

Authors
  1. Yingzhen Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yichen Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chunxiao Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Qunsheng Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yasuyuki Matsushita
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qunsheng Peng.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yang, Y., Wei, Y., Liu, C. et al. An improved belief propagation method for dynamic collage. Vis Comput 25, 431–439 (2009). https://doi.org/10.1007/s00371-009-0346-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-009-0346-0

Keywords

Search

Navigation