Abstract
Video compositing, the editing and integrating of many video sequences into a single presentation, is an integral part of advanced multimedia services. Single-user compositing systems have been suggested in the past, but when they are extended to accommodate many users, the amount of memory required quickly grows out of hand. We propose two new architectures for digital video compositing in a multiuser environment that are memory-efficient and can operate in real time. Both architectures decouple the task of memory management from compositing processing. We show that under hard throughput and bandwidth constraints, a memory less solution for transferring data from many video sources to many users does not exist. We overcome this using (i) a dynamic memory buffering architecture and (ii) a constant memory bandwidth solution that transforms the sources-to-users transfer schedule into two schedules, then pipelines the computation. The architectures support opaque overlapping of images, arbitrarily shaped images, and images whose shapes dynamically change from frame to frame.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
CITT Recommendation H.261 (1990) Video codec for audiovisual services atp×64kbits/s. CDM XV-R37-E
Wallace G (1991) The JPEG still picture compression standard. Commun ACM 34(4): 30–44
Committee Draft of Standard ISO 1 1 172 (1990) Coding of moving pictures and associated audio. ISO/ MPEG 90/176
CCITT Draft Recommendation I.150 (1992) B-ISDN Asynchronous transfer mode functional characteristics. CCITT SG XVIII, TD 65
Lyles JB, Swinehart DC (1992) The emerging gigabit environment and the role of local ATM. IEEE Commun Magazine 30(4):52–58
Chen MS, Barzilai T, Vin, HM (1992) Software architecture of DiCE: A distributed collaboration environment. 4th IEEE Com-Soc International Workshop on Multimedia Communications, Monterey, Calif, pp 172–185
Rosenberg J., Kraut RE, Gomez, L., Buzzard, CA (1992) Multimedia communications for users. IEEE Commun Magazine 30(5):20–36
Chen WL, Haskell P, Messerschmitt DG, Yun LC (1993) Structured video: concept and display architecture. Submitted for publication
Kamata H, Katsuyama T, Sizuki T, Minakuchi Y, Yano K (1989) Communication workstations for BISDN: monster kaufmultimedia oriented super terminal). Proceedings of Global Communivations Conference Dallas, pp 959–964
Katseff HP, Gaglianello RD, London TB, Robinson BS, Swicker DB (1991) Experiences with the Liaison Network Multimedia Workstation. Proceedings of the USENIX Symposium on Experiences with Distributed and Multiprocessor Systems, Atlanta, pp 341–350
Electronic Engineering Times (1992) Pixel, S3 field advanced graphics chips, ISS. no 704, pp 4, Aug 3
Vin HM, Rangan PV, Ranmanathan S (1991) Hierarchical conferencing architectures for inter-group multimedia collaboration. Proceedings of the ACM Conference on Organizational Computing Systems, Atlanta, Georgia
Ramanathan S, Rangan PV, Vin HM, Kaeppner T (1992) Optimal communication architectures for multimedia conferencing in distributed systems. Proceedings of the 12th International Conference on Distributed Computing Systems, Yokohama, Japan
Rangan PV, Vin HM, Ramanathan S (1993) Communication architectures and algorithms for media mixing in multimedia conferences. IEEE/ACM Trans, on Networking, vol 1, no 1
Smith BC, Rowe L (1993) Algorithms for manipulating compressed images. IEEE Computer Graphics and Applications, Vol 13, No 5, Sept 1993, pp 34–43
Chang SF, Chen WL, Messerschmitt DG (1992) Video compositing in the DCT domain. IEEE Workshop on Visual Signal Processing and Communications, Raleigh, NC
Chang, SF, Messerschmitt DG (1992) Compositing motioncompensated video within the networks. IEEE 4th Workshop on Multimedia Communications, Monterey, Calif
Porter T, Duff T (1984) Compositing digital images. Computer Graphics 18(3):253–259
Lukacs, M (1992) An advanced digital network video bridge for multipoint with individual customer control. Private communication, Bell Communications Research, NJ
Cypress Semiconductor BiCMOS/CMOS Databook (1993) Commercial and Military Specs., San Jose, Calif
Salters, RH (1992) Fast DRAMs for sharper TV. IEEE Spectrum 10:40–42
Jones, F (1992) A new era of fast dynamic RAMs. IEEE Spectrum 10:43–49
Mirsky L, Perfect H (1966) System of representatives. J Math Anal Appl 15:520–568
Huizer CM, Baker K, Mehtani R, DeBlock J, Dijkstra H, Hynes PJ, Lammerts JAM, Lecoutere MM, Popp A, van Roermund AHM, Sheridan P, Sluyter RJ, Welten FP (1989) A programmable 1400 MOPS video signal processor. Proceedings of IEEE Custom Integrated Circuits Conference, pp 24.3.1–24.3.4, San Diego, Calif
Kaufman A, Cohen D, Yagel R (1993) Volume Graphics. IEEE Computer 26(7):51–64
Karlsson G, Vetterli M (1990) Packet video and its integration into the network architecture. IEEE J Select Areas Comm 7(5):739–751
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yun, L.C., Messerschmitt, D.G. On architectures for video compositing. Multimedia Systems 2, 181–190 (1994). https://doi.org/10.1007/BF01210449
Issue Date:
DOI: https://doi.org/10.1007/BF01210449