Abstract
This paper presents a method for automatic removal of local defects such as blotches and impulse noise in old motion picture films. The method is fully automatic and includes the following steps: fuzzy prefiltering, motion-compensated blotch detection, and spatiotemporal inpainting. The fuzzy prefilter removes small defective areas such as impulse noise. Modified bidirectional motion estimation with a predictive diamond search is utilized to estimate the motion vectors. The blotches are detected by the rank-ordered-difference method. Detected missing regions are interpolated by a new exemplar-based inpainting approach that operates on three successive frames. The performance of the proposed method is demonstrated on an artificially corrupted image sequence and on a real motion picture film. The results of the experiments show that the proposed method efficiently removes flashing and still blotches and impulse noise from image sequences.
This work was supported in part by the Research Foundation of Karadeniz Technical University under Grant 2004.112.004.01.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Thoma, R., Bierling, M.: Motion compensating interpolation considering covered and uncovered background. Signal Processing: Image Commun. 1(2), 191–212 (1989)
Kim, M.K., Kim, J.K.: Efficient motion estimation algorithm for bidirectional prediction scheme. IEE Electron. Lett. 30(8), 632–633 (1994)
Goh, W.B., Chong, M.N., Kalra, S., Krishnan, D.: Bi-directional 3D auto-regressive model approach to motion picture restoration. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Atlanta, USA, pp. 2275–2278 (1996)
Kokaram, A.C., Morris, R.D., Fitzgerald, W.J., Rayner, J.W.: Detection of missing data in image sequences. IEEE Trans. Image Processing 4(11), 1496–1508 (1995)
Nadenau, M.J., Mitra, S.K.: Blotch and scratch detection in image sequences based on rank ordered differences. In: Proceedings of the 5th International Workshop on Time-Varying Image Processing and Moving Object Recognition, Florence, Italy, pp. 1–7 (1996)
Armstrong, S., Kokaram, A.C., Rayner, P.J.W.: Restoring video images taken from scratched 2-inch tape. In: Marshall, S., Harvey, N., Shah, D. (eds.) Workshop on Non-Linear Model Based Image Analysis (NMBIA 1998), pp. 83–88. Springer, Heidelberg (1998)
Gangal, A., Kayıkcioglu, T., Dizdaroglu, B.: An improved motion-compensated restoration method for damaged color motion picture films. Signal Processing: Image Commun. 19, 353–368 (2004)
Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based inpainting. IEEE Trans. Image Processing 13(9), 1200–1212 (2004)
Bertalmio, M., Vese, L., Sapiro, G.: Simultaneous structure and texture image inpainting. IEEE Trans. Image Processing 12(8), 882–889 (2003)
Kwan, H.K.: Fuzzy filters for noisy image filtering. In: Proceedings of the 2003 International Symposium on Circuits and Systems (ISCAS 2003), vol. 4, pp. 161–164 (2003)
Tourapis, A.M., Shen, G., Liou, M.L., Au, O.C., Ahmad, I.: A new predictive diamond search algorithm for block based motion estimation. In: Ngan, K.N., Sikora, T., Sun, M.T. (eds.) Proceedings of Visual Communication and Image Processing, Perth, Australia, pp. 1365–1373 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gangal, A., Dizdaroglu, B. (2006). Automatic Restoration of Old Motion Picture Films Using Spatiotemporal Exemplar-Based Inpainting. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2006. Lecture Notes in Computer Science, vol 4179. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11864349_6
Download citation
DOI: https://doi.org/10.1007/11864349_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44630-9
Online ISBN: 978-3-540-44632-3
eBook Packages: Computer ScienceComputer Science (R0)