Wei-Qi Yan
Mohan S Kankanhalli
ABSTRACT
Many amateur videographers, like home video enthusiasts, may capture videos that are not of a professional quality. Many minor but visually annoying distortions like lighting imbalance and shaking artifacts could be introduced by the unskilled operations of the video camcorder. Since home videos constitute footage of great sentimental value, such videos cannot be summarily discarded. Unlike movies and sitcoms, shot re-takes of important events, such as wedding ceremonies are just not possible. Therefore, such distortions need to be corrected. In this paper, we present a novel method to detect segments of videos that have lighting and shaking artifacts. These segments can then be subjected to a restoration process that can remove these artifacts. We present techniques to correct lighting artifacts by appropriately adjusting the luminance. In order to remove the shaking artifact, image mosaicing is first employed to build a mosaic frame for the segment with the aid of edge blending techniques. Subsequently a Bezier-curve based blending of motion trajectory is employed to perform motion-compensated filtering of the shaking artifact. The restored video is then created by appropriately cropping the mosaic frame based on the compensated motion trajectory. We have implemented the developed techniques and the experimental results on home videos demonstrate the effectiveness of our approach. Detection and removal of artifacts are significant in other videos as well as those obtained from autonomous vehicles, robots and remote sensing.
- Burt, P. J. and Adelson, E. H. A multiresolution spline with application to image mosaics, ACM Transaction on Graphics, Vol. 2, No. 4, October 1983, 217--236. Google Scholar
Digital Library
- Casares, J., Myers, B. A., and Long, A. C. Bhatnagar, R. Stevens, S. M. Dabbish, L. Corbett, A. Simplifying video editing with intelligent interaction (submitted). http://www-2.cs.cmu.edu/~silver/publications.html.Google Scholar
- Chen. T. Video stabilization algorithm using a block-based parameteric motion model. Project report, 2000. http://www-isl.stanford.edu/~tingchenGoogle Scholar
- Farin. G. Curves and surfaces for computer aided geometric design: a practical guide (3rd Edition). Academic Press, Imprint Boston, 1992. Google ScholarDigital Library
- Filippo V., Alfio C., Massimo M. and Giuseppe M. Robust digital image stabilizing algorithm using block motion vectors, in Proceedings of International Coneference on Consumer Electronics(ICCE'02), (Los Angeles, June, 2002), 234--235.Google Scholar
- Girgensohn, A., Bly, S., Shipman, F., Boreczky, J. and Wilcox, L. Home video editing made easy-balancing automation and user control, in Proceedings of INTERACT '01, IOS Press, 464--471, 2001.Google Scholar
- Girgensohn, A., Boreczky, J., Chiu, P., Doherty, J., Foote, J., Golovchinsky, G., Uchihashi, S. and Wilcox, L. A semi-automatic approach to home video editing, in Proceedings of UIST '00 (San Diego, CA USA, 2000), ACM Press, 81--89. Google ScholarDigital Library
- Gove R. J., Video stabilization system and method. Texas Instruments. United States Patent 5973733, October 26, 1999.Google Scholar
- Hansen; M. W. and McDowell L. K. Apparatus and method for removing blank areas from real-time stabilized images by inserting background information. Sarnoff Corporation, Princeton New Jersey. United States Patent 6211913, April 3, 2001.Google Scholar
- Jimber, D., Foote, J. and Lertsithichai, S. FlyAbout: spatially indexed panoramic video, in Proceedings of ACM Multimedia 2001 (Ottawa, CA, Oct. 2001). Google ScholarDigital Library
- Jin, J., Zhu, Z. G., Xu, G.Y and Yang, Y.D. Digital video sequence stabilization based on 2.5D motion estimation and inertial motion filtering, Real-Time Imaging Journal, Vol. 7, No. 4, August 2001, Academic Press, 357--365. Google ScholarDigital Library
- Jones, R. C., DeMenthon, D. and Doermann, D. S. Building mosaics from video using MPEG motion vectors, in Proceedings of ACM Multimedia 1999 (Orlando, 1999). Google ScholarDigital Library
- Latecki, L. J., Wildt, D. and Hu. J. Extraction of key frames from videos by optimal color composition matching and polygon simplification, in Proceedings of the workshop on multimedia signal processing (Cannes, October 2001).Google ScholarCross Ref
- Lienhart, R. Abstracting home video automatically, In proceedings of ACM Multimedia 1999(Orlando, 1999). Google ScholarDigital Library
- Lienhart, R. Dynamic video summarization of home video, in Proceedings of SPIE 3972: Storage and Retrieval for Media Databases 2000, 378--389, Jan. 2000.Google Scholar
- Ma, W.Y. and Zhang, H. J. An indexing and browsing system for home video, in Proceedings of EUSIPCO'2000, (Tampere, Sept. 2000), 5--8.Google Scholar
- McMillan, L. and Bishop, G. Plenoptic modeling: an image-based rendering system, in Proceedings of SIGGRAPH 95 (Los Angels, California, August 6--11, 1995), 1995, 39--46. Google ScholarDigital Library
- Morimoto, C. H. and Chellapa R. Fast electronic digital image stabilization, in: Proceedings of IEEE International Conference on Pattern Recognition, Vienna, Aug. 1996. Google ScholarDigital Library
- Morimoto, C. H. and Chellapa R. Fast electronic digital image stabilization for off-road navigation, to appear in IEE Journal of Real Time Image Processing. http://www.cfar.umd.edu/~carlos Google ScholarDigital Library
- Sato T. Camera with a shake detection function. Olympus Optical Co., Ltd., Japan. United States Patent 6067418, May 23, 2000.Google Scholar
- Shiomi Y. Image stabilizing device. Canon Kabushiki Kaisha, Japan. United States Patent 6282376, August 28, 2001.Google Scholar
- Shum, H.Y. and Szeliski, R. Construction of panoramic image mosaics with global and local alignment, in Proceedings of IJCV (Feb. 2000), 36(2), 101--130. Google ScholarDigital Library
- Tekalp, A.M. Digital video processing, Prentice Hall, 1995. Google ScholarDigital Library
- Yamazaki T. and Ishikawa Y. Image-shake preventing apparatus. Canon Kabushiki Kaisha, Japan, United States Patent 6263162, July 17, 2001.Google Scholar
- Zhang, H.J., Kankanhalli, A. and Smoliar, S.W. Automatic partitioning of full-motion video, ACM Multimedia System, 1993, 1, 10--28. Google ScholarDigital Library
- Operating Instructions of Sony Digital Video Camera Recorder. DCR-TRV15E/TRV17E. Sony Corporation, 2001.Google Scholar
- Operating Instructions of Sony Digital Video Camera Recorder. DCR-PC101E. Sony Corporation, 2002.Google Scholar
- http://www.comp.nus.edu.sg/~yanwq/rahv.htmlGoogle Scholar
Index Terms
- Detection and removal of lighting & shaking artifacts in home videos
Recommendations
Extraction and separation of high-amplitude artifacts in electroencephalograms from epileptic patients
BioMed'06: Proceedings of the 24th IASTED international conference on Biomedical engineeringElectroencephalogram (EEG) recordings are often distorted by high-amplitude artifacts which hamper its correct visual inspection. In this work we present a method which can be applied separately to each channel to extract high-amplitude components. The ...
Automatic removal of eye-blink artifacts for neurofeedback training systems
i-CREATe '13: Proceedings of the 7th International Convention on Rehabilitation Engineering and Assistive TechnologyEye-blink is one of the most eminent artifacts in Brain-Computer Interface (BCI) systems. Only a small amount of eye blink can significantly affect the accuracy of EEG-based data classification. Automatic eye-blink artifact removal system is a crucial ...
Less complexity-aware intelligent 1-dimensional CNN with weighted deep features for artifacts removal in EEG signals
AbstractElectroencephalogram (EEG) signals contains a major role in examining the behavior of brain activity. Moreover, these signals are contaminated with artifacts, which may affect the EEG signal analysis. The EEG performs as the low spatial ...
Comments