Mosaics from MPEG-2 video

Mark A. Robertson; Thomas S. Heath

doi:10.1117/12.479706

1 July 2003 Mosaics from MPEG-2 video

Mark A. Robertson, Thomas S. Heath

Proceedings Volume 5016, Computational Imaging; (2003) https://doi.org/10.1117/12.479706
Event: Electronic Imaging 2003, 2003, Santa Clara, CA, United States

Abstract

Construction of panoramic mosaics from video is well established in both the research and commercial communities, but current methods generally perform the time-consuming registration procedure entirely from the sequence's pixel data. Video sequences usually exist in compressed format, often MPEG-2; while specialized hardware and highly-optimized software can often quickly create accurate mosaics from a video sequence's pixels, these products do not make efficient use of all information available in a compressed video stream. In particular, MPEG video files generally contain significant information about global camera motion in their motion vectors. This paper describes how to exploit the motion vector information so that global motion can be estimated extremely quickly and accurately, which leads to accurate panoramic mosaics. The major obstacle in generating mosaics with this method is variable quality of MPEG motion vectors, both within a stream from a particular MPEG encoder and between streams compressed with different encoders. The paper discusses methods of robustly estimating global camera motion from the observed motion vectors, including the use of least absolute value estimators, variable model order for global camera motion, and motion vector weighting depending on their estimated accuracy. Experimental results are presented to demonstrate the performance of the algorithm.

Citation Download Citation

Mark A. Robertson and Thomas S. Heath "Mosaics from MPEG-2 video", Proc. SPIE 5016, Computational Imaging, (1 July 2003); https://doi.org/10.1117/12.479706

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available