skip to main content
10.1145/2632856.2632943acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicimcsConference Proceedingsconference-collections
research-article

View Synthesis Framework for Real-time Navigation of Free Viewpoint Videos

Authors Info & Claims
Published:10 July 2014Publication History

ABSTRACT

Free viewpoint videos allow users to change the focus of attention arbitrarily. Since it is not feasible to record and compress a large number of videos at all possible angles, most of the views are usually synthesized on demand. In addition, to allow the transition of the view changes smoothly, it is often desirable to render the videos as if only one camera was used from one viewpoint to another continuously. To achieve this feature, a sufficient amount of video frames at various viewpoints between the previously and presently chosen focuses need to be synthesized in a timely fashion. A virtual view can be synthesized using many approaches which lead to different video qualities at the cost of various degrees of computation efforts. In this paper, a synthesis framework for continuous transition between two viewpoints is considered. When the viewpoint is switched from one to another, more viewpoints need to be synthesized for farther distance so that the subjective quality can be smoother.

References

  1. Masayuki Tanimoto, "Overview of Free Viewpoint Television," Signal Processing: Image Communication, vol. 21, no. 6, pp. 454--461, July 2006.Google ScholarGoogle ScholarCross RefCross Ref
  2. Masayuki Tanimoto, "FTV (Free Viewpoint Television) Creating Ray-Based ImageEngineering", Proc. of ICIP2005, pp. II-25--II-28, 2005.Google ScholarGoogle Scholar
  3. Masayuki Tanimoto, "Free Viewpoint Television - FTV", Picture Coding Symposium2004, Session 5, December 2004.Google ScholarGoogle Scholar
  4. M. Tanimoto and T. Fujii, "FTV --- Free Viewpoint Television", ISO/IEC JTC1/SC29/WG11, M8595, July 2002.Google ScholarGoogle Scholar
  5. M. Domański, M. Gotfryd, and K. Wegner, "View synthesis software and assessment of its performance", ISO/IEC JTC1/SC29/WG11, M15672, July 2008.Google ScholarGoogle Scholar
  6. O. Stankiewicz, K. Wegner, "Depth Map Estimation Software version 3", ISO/IEC JTC1/SC29/WG11, M15540, July 2008.Google ScholarGoogle Scholar
  7. M. Tanimoto, T. Fujii, and K. Suzuki, "Reference Software of Depth Estimation and View Synthesis for FTV/3DV", ISO/IEC JTC1/SC29/WG11, M15836, October 2008.Google ScholarGoogle Scholar
  8. M. Tanimoto, T. Fujii and K. Suzuki, "View Synthesis Algorithm in View Synthesis Reference Software 2.0 (VSRS2.0)", ISO/IEC JTC1/SC29/WG11, M16090, February 2009.Google ScholarGoogle Scholar
  9. M. Tanimoto, T. Fujii and K. Suzuki, "Experiment of view synthesis using multi-view depth", ISO/IEC JTC1/SC29/WG11, M14889, October 2007.Google ScholarGoogle Scholar
  10. L. Azzari, F. Battisti, and A. Gotchev, "Comparative analysis of occlusion-filling techniques in depth image-based rendering for 3D videos", Proc. ACM Multimedia 2010 - MoViD: ACM Workshop on Mobile Video Delivery, 25-29 October 2010, Florence, Italy. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest and Clifford Stein" Introduction to Algorithms" Chapter 16, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. G. Gutin, A. Yeo and A. Zverovich, "Traveling salesman should not be greedy: domination analysis of greedy-type heuristics for the TSP", Discrete Applied Mathematics 117 (2002), 81--86.Google ScholarGoogle ScholarCross RefCross Ref
  13. A. J. Viterbi, "Error bounds for convolutional codes and an asymptotically optimum decoding algorithm," IEEE Trans. Inform. Theory, vol. IT--13, pp. 260--269, April 1967. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. G. David Forney, Jr," The Viterbi Algorithm: A Personal History" MIT Cambridge, MA 02139 USAGoogle ScholarGoogle Scholar
  15. Fei Sun, Student Member and Tong Zhang, Member "Low-Power State-Parallel Relaxed Adaptive Viterbi Decoder" IEEE Transactions on circuits and systems. VOL. 54, NO. 5, MAY 2007.Google ScholarGoogle Scholar
  16. Sriram Swaminathan, Russell Tessier, Dennis Goeckel, and Wayne Burleson "A Dynamically Reconfigurable Adaptive Viterbi Decoder" Department of Electrical and Computer Engineering. University of Massachusetts, Amherst, MA. 01003.Google ScholarGoogle Scholar
  17. A. Kubota, A. Smolic, M. Magnor, M. Tanimoto, T. Chen, and C. Zhang, "Multi-View Imaging and 3DTV," IEEE Signal Processing Magazine, vol. 24, no. 6, pp. 10--21, Nov. 2007.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. View Synthesis Framework for Real-time Navigation of Free Viewpoint Videos

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Other conferences
            ICIMCS '14: Proceedings of International Conference on Internet Multimedia Computing and Service
            July 2014
            430 pages
            ISBN:9781450328104
            DOI:10.1145/2632856

            Copyright © 2014 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 10 July 2014

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed limited

            Acceptance Rates

            Overall Acceptance Rate163of456submissions,36%
          • Article Metrics

            • Downloads (Last 12 months)0
            • Downloads (Last 6 weeks)0

            Other Metrics

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader