skip to main content
10.1145/2945078.2945097acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
poster

Video reshuffling: automatic video dubbing without prior knowledge

Published: 24 July 2016 Publication History

Abstract

Numerous video have been translated using "dubbing," spurred by the recent growth of video market. However, it is very difficult to achieve the visual-audio synchronization. That is to say in general a new audio does not synchronize with actor's mouth motion. This discrepancy can disturb comprehension of video contents. There-fore many methods have been researched so far to solve this problem.

Supplementary Material

ZIP File (a19-furukawa.zip)
Supplemental files.

References

[1]
Bregler, C., Covell, M., and Slaney, M. 1997. Video rewrite: Driving visual speech with audio. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques, ACM Press/Addison-Wesley Publishing Co., 353--360.
[2]
Ezzat, T., Geiger, G., and Poggio, T. 2002. Trainable videorealistic speech animation, vol. 21. ACM.
[3]
Irie, A., Takagiwa, M., Moriyama, K., and Yamashita, T. 2011. Improvements to facial contour detection by hierarchical fitting and regression. In Pattern Recognition (ACPR), 2011 First Asian Conference on, IEEE, 273--277.
[4]
Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. In ACM Transactions on Graphics (TOG), vol. 22, ACM, 313--318.
[5]
Saito, S., Sakamoto, R., and Morishima, S. 2014. Patchmove: Patch-based fast image interpolation with greedy bidirectional correspondence.
[6]
Tamaki, T. 2009. Pose estimation and rotation matrices. IEICE Technical Report. SIS 109, 203, 59--64.
[7]
Thies, J., Zollhöfer, M., Stamminger, M., Theobalt, C., and Niessner, M. 2016. Face2face: Real-time face capture and reenactment of rgb videos. In Proc. Computer Vision and Pattern Recognition (CVPR), IEEE, June 2016.

Cited By

View all
  • (2020)AlignNet: A Unifying Approach to Audio-Visual Alignment2020 IEEE Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV45572.2020.9093345(3298-3306)Online publication date: Mar-2020

Index Terms

  1. Video reshuffling: automatic video dubbing without prior knowledge

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGGRAPH '16: ACM SIGGRAPH 2016 Posters
    July 2016
    170 pages
    ISBN:9781450343718
    DOI:10.1145/2945078
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 24 July 2016

    Check for updates

    Author Tags

    1. computer graphics
    2. face analysis
    3. face synthesis

    Qualifiers

    • Poster

    Conference

    SIGGRAPH '16
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 15 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2020)AlignNet: A Unifying Approach to Audio-Visual Alignment2020 IEEE Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV45572.2020.9093345(3298-3306)Online publication date: Mar-2020

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media