Abstract
This paper presents a motion analysis algorithm (MAA) and a hybrid coding method for contour image sequence compression. The contour image sequence consists of objects moving and rotating in a 3-D world with occlusion, shape, and size variations from frame to frame. The MAA separates the moving image sequence into several object-oriented subsequences (OOSs). In each OOS, the component is either stationary or moves smoothly, and the motion parameters can be easily estimated. The first and last frames of OOS are key frames, and the others are in-between frames. The key frames are unpredictable, and the entire frames need to be encoded. The in-between frames are compensable, and they are encoded by the motion parameter coding. The hybrid coder uses vectorgraph coding to remove spatial redundancy of the key frames and motion parameter coding to reduce the temporal redundancy of the OOSs. The motion parameters are encoded as combinations of 2-D translation, 2-D rotation, and scaling. There are many applications for contour image sequence compression. The cartoon image sequence (a sequence of line drawing sketches) and the high-frame-rate videophone for sign language transmission are good examples. Experiments show that our method encodes the contour image sequence at a very high compression ratio without losing intelligibility.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
B.G. Haskell, F.W. Mounts, and J.C. Candy, “Interframe Coding of Viedotelephone Pictures,”Proceedings of the IEEE, vol. 60, no. 7, 1972.
B.D. Haskell, P.L. Gordon, R.L. Schmidt, and J.V. Scattagilia, “Interframe Coding of 525-line Monochrome Television at 1.5 Mbits,”IEEE Transactions on Communication, vol. COM-25, 1977.
C. Cafforio and F. Rocca, “Methods for measuring small displacements of television images,”IEEE Transactions on Information Theory, vol. IT-22, no. 5, 1976.
J.D. Robbins and A.N. Netravali, “Interframe Television Coding Using Movement Compensation,”International Conference on Communication, Boston, 1979.
K.A. Prabhu and A.N. Netravali, “Pel-Recursive Motion Compensated Color Coding,”International Conference on Communication, Philadelphia, 1982.
S. Tsuli, M. Osada, and M. Yachida, “Tracking and Segmentation of Moving Objects in Dynamic Line Images,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-2, no. 6, 1980.
G. Spelling, “Video Transmission of ASL and Finger Spelling,”IEEE Transactions on Communication, vol. 29, no. 12, 1981.
G. Spelling, M. Landy, Y. Cohen, and M. Pavel, “Intelligent Encoding of ASL Image Sequences at Extremely Low Information Rates,”Computer Vision, Graphics, and Image Processing, vol. 31, 1985, pp. 335–391.
D. Pearson, “Visual Communication System for the Deaf,”IEEE Transactions on Communication, vol. 29, no. 12, 1981.
D. Pearson and J.A. Robinson, “Visual Communication at Very Low Rate,”IEEE Proceedings, vol. 73, no. 4, 1985.
M.S. Landy and Y. Cohen, “Vectorgraph Coding of Line Drawing,”Computer Vision, Graphics, and Image Processing, vol. 30, 1985, pp. 331–334.
Y. Cohen, M.S. Landy, and M. Pavel, “Hierarchical Coding of Binary Images,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-7, no. 3, 1985.
P. Letellier, M. Nadler, and I. Abramatic, “The Telesign Project,”IEEE Proceedings, vol. 73, no. 4, 1985.
J.W. Roach and J.K. Aggarwal, “Determining the Movement of Objects from Sequence of Images,”IEEE Transactions on Pattern Analysis and Machine Intelligence, 1980, pp. 554–562.
S. Haynes and R. Jain, “Detection of Moving Edges,”Computer Vision, Graphics, and Image Processing, vol. 21, 1983.
Y. Liu and T.S. Huang, “Estimation of Rigid Body Motion Using Straight Line Correspondence,”Computer Vision, Graphics, and Image Processing, vol. 43, 1988.
S. Ullman,The Interpretation of Visual Motion, Cambridge, MA: MIT Press, 1979.
S.T. Barnard and W.B. Thompson, “Disparity Analysis of Images,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 2, 1980.
J.M. Prager and M.A. Aribib, “Computing the Optical Flow,”Computer Vision, Graphics, and Image Processing, vol. 24, 1983, pp. 271–304.
I.K. Sethi and R. Jain, “Finding Trajectories of Feature Points in Monocular Image Sequence,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-9, 1987, pp. 56–73.
Jerkin, “Tracking Three Dimensional Moving Light Display,”Proceedings of the Workshop Motion: Represent. Contr., Toronto, Canada, 1983, pp. 66–70.
M.C. Ibsion and I. Zapalowski, “On the Use of Relaxation Labelling in the Corresponding Problem,”Pattern Recognition Letters, vol. 4, 1986, pp. 103–109.
V.S.S. Hwang, “Tracking Feature Points in Time-Varying Images Using an Opportunistic Selection Approaches,”Pattern Recognition, vol. 22, 1989, pp. 247–256.
C.L. Huang, “Very Very Low Bandwidth Visual Communication for the Deaf,” Technical Report, NSC78-0404-Eooz-16, National Tsing-Hus University, Hsin-Chu, Taiwan, ROC.
T. Sakai, M. Nagao, and H. Matsushima, “Extraction of Invariant Picture Sub-structure by Computer,”Computer Vision, Graphics, and Image Processing, vol. 1, 1972, pp. 81–96.
U. Ramer, “An Interactive Procedure for Polygonal Approximation of Plane Curves,”Computer Vision, Graphics, and Image Processing, vol. 1, 1972.
B.K.P. Horn,Robot Vision, Cambridge, MA: MIT Press, 1986.
E.C. Hildreth, “Computations Underlying the Measurement of Visual Motion,”Artificial Intelligence, vol. 23, 1984, pp. 309–354.
A.L. Yuille and N.M. Grzytwacz, “The Motion Coherence Theory,”Proceedings of the Second ICCV, 1988, pp. 344–353.
M. Kunt, M. Benard, R. Leonardi, “Recent Results in High Compression Image Coding,”IEEE Transactions on Circuits and Systems, vol. CAS-34, 1987, pp. 1306–1336.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Huang, CL. Contour image sequence compression through motion analysis and hybrid coding method. Multidim Syst Sign Process 3, 267–296 (1992). https://doi.org/10.1007/BF01942045
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01942045