Skip to main content
SpringerLink
Log in

Scrolling Subtitle Processing of Frame Rate Up-Conversion Based on Global Text Motion Estimation

  • Conference paper
  • First Online:
Digital TV and Wireless Multimedia Communication (IFTC 2016)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 685))

  • 911 Accesses

Abstract

Motion compensated frame rate up-conversion (MC-FRUC) is a popular practical video processing technique to increase frame rate, which mainly composes of motion estimation (ME) and motion compensated frame interpolation (MCFI). However, for scrolling text embedded in videos, such as subtitle or scrolling TV news, ME usually fails to produce true trajectory when the scrolling motion of subtitle is irrelevance with background’s movements. In this paper, we propose an effective scrolling subtitle post-processing technique to reduce artifacts such as text broken and motion blur around subtitle regions. True global text motion estimation is put forward to predict the motion vector of subtitle after detecting the text area in the intermediate frame. Finally, a fusion of subtitle and background method is proposed to obtain a correct intermediate frame. Experimental results show that the proposed algorithm can significantly reduce the broken artifact with low complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. de Haan, P.W.G., Biezen, H.H., Ojo, O.A.: True-motion estimation with 3-D recursive search block matching. IEEE Trans. Circ. Syst. Video Technol. 3(5), 368–379 (1993)

    Article  Google Scholar 

  2. Choi, B.D., Han, J.W., Kim, C.S.K., Ko, S.J.: Overlapped block motion compensation: an estimation-theoretic approach. IEEE Trans. Image Process. 3(9), 693–699 (1994)

    Google Scholar 

  3. Choi, B.D., Han, J.W., Kim, C.S., Ko, S.J.: Motion compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation. IEEE Trans. Circ. Syst. Video Technol. 17(4), 407–416 (2007)

    Article  Google Scholar 

  4. Bellers, E.B., van Gurp, J.W., Janssen, J.G.W.M., Braspenning, J.R., Wittebrood, R.: Solving occlusion in frame-rate up-conversion. In: Proceedings of IEEE International Conference on Consumer Electronics, pp. 1–2 (2007)

    Google Scholar 

  5. Hong, W.: Low-complexity occlusion handling for motion-compensated frame rate up-conversion. In: Proceedings of IEEE International Conference on Consumer Electronics, pp. 1–2 (2009)

    Google Scholar 

  6. Kang, S.J., Yoo, D.G., Lee, S.K., Kim, Y.H.: Multiframe-based bilateral motion estimation with emphasis on stationary caption processing for frame rate up-conversion. IEEE Trans. Consum. Electron. 54(4), 1830–1838 (2008)

    Article  Google Scholar 

  7. Guo, Z.Y., Gao, L.C.: Stationary subtitle processing for real-time frame rate up-conversion. In: Proceedings of IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp. 1–4 (2013)

    Google Scholar 

  8. Gim, G.Y., Kim, Y.J., Ahn, T.G., Park, S.H.: Horizontal scrolling text processing for frame rate conversion. In: Proceedings of IEEE International Conference on Consumer Electronics-Berlin (2012)

    Google Scholar 

  9. Choi, B.T., Le, S.H., Ko, S.J.: New frame rate up-conversion using bi-directional motion estimation. IEEE Trans. Consum. Electron. 46(3), 603–609 (2000)

    Article  Google Scholar 

  10. Wang, A.D., Vincent, P.B., Klepko, R.: Motion-compensated frame rate conversionpart II: new algorithms for frame interpolation. IEEE Trans. Broadcast. 56, 142–149 (2010)

    Article  Google Scholar 

Download references

Acknowledgment

This work was supported in part by Chinese National Key S&T Special Program (2013ZX01033001-002-002), National Natural Science Foundation of China (6113300961221001, 61301116), the Shanghai Key Laboratory of Digital Media Processing and Transmissions (STCSM 12DZ2272600).

Author information

Authors and Affiliations

  1. Institute of Image Communication and Network Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China

    Guirui Li, Xiaoyun Zhang & Zhiyong Gao

Authors
  1. Guirui Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaoyun Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhiyong Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Guirui Li .

Editor information

Editors and Affiliations

  1. Shanghai Jiao Tong University, Shanghai, China

    Xiaokang Yang

  2. Shanghai Jiao Tong University, Shanghai, China

    Guangtao Zhai

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Li, G., Zhang, X., Gao, Z. (2017). Scrolling Subtitle Processing of Frame Rate Up-Conversion Based on Global Text Motion Estimation. In: Yang, X., Zhai, G. (eds) Digital TV and Wireless Multimedia Communication. IFTC 2016. Communications in Computer and Information Science, vol 685. Springer, Singapore. https://doi.org/10.1007/978-981-10-4211-9_4

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-4211-9_4

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-4210-2

  • Online ISBN: 978-981-10-4211-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation