Skip to main content
Log in

A Computational Memory Architecture for MPEG-4 Applications with Mobile Devices

  • Published:
Journal of VLSI signal processing systems for signal, image and video technology Aims and scope Submit manuscript

Abstract

This paper presents a Computational Memory architecture for MPEG-4 applications with mobile devices. The proposed architecture is used for real-time block-based motion estimation, which is the most computational intensive task in the video encoder. It uses the exhaustive block-matching algorithm (EBMA) for motion estimation. The proposed architecture consists of embedded SRAMs and a number of block-matching units working in parallel to process video data while stored in the memory. The block-matching units access the embedded SRAMs simultaneously, which increases the speed of the architecture.

The architecture processes CIF format video sequences (i.e., the frame size is 352 × 288 pixels) with block size of 16 × 16 pixels and ±15 pixels search range. The proposed architecture has been designed, prototyped, and simulated for 0.18 μm TSMC CMOS technology. The simulation shows that the proposed architectures processes up to 126 CIF frames per second with clock frequency 100 MHz. The synthesized prototype of the proposed architecture includes 200 KB memory and it has an area of 33.75 mm2 and consumes 986.96 mW @100 MHz.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. ISO/IEC JTC/SC29/WGll N1730, “MPEG-4 Overview,” July 1997.

  2. A. Murat Tekalp, Digital Video Processing, Prentice-Hall, Inc., 1995.

  3. T. Koga, K. Iinuma, A. Hirano, Y. Iijima, and T. Ishiguro, “Motion-Compensated Interframe Coding for Video Conferencing,” in Proceedings National Telecommunications Conference, New Orleans, LA, 1981, pp. G.5.3.1–G.5.3.5

  4. M. Ghanbari, “The Cross-Search Algorithm for Motion Estimation,” IEEE Transactions on Communications, vol. 38, 1990, pp. 950–953.

    Article  Google Scholar 

  5. D. Keitel-Schulz and N. Wehn, “Embedded DRAM Development: Technology, Physical Design, and Application Issues,” IEEE Design & Test of Computers, vol. 18, no. 3, 2001, pp. 7–15.

    Article  Google Scholar 

  6. A.P. Chandrakasan and R.W. Brodersen “Minimizing Power Consumption in Digital CMOS Circuits,” IEEE Proceedings, vol. 83, 1995, pp. 498–523.

    Article  Google Scholar 

  7. A.P. Chandrakasan, S. Sheng, and R.W. Brodersen, “Low Power CMOS Digital Design,” IEEE Journal of Solid State Circuits, vol. 27, no. 4, 1992, pp. 473–484.

    Article  Google Scholar 

  8. D.G. Elliott, M. Stumm, W.M. Snelgrove, C. Cojocaru, and R. Mckenzie, “Computational RAM: Implementing Processors in Memory,” IEEE Design & Test of Computers, vol. 16, no. 1, 1999, pp. 32–41.

    Article  Google Scholar 

  9. H. Ai, N. Li, T. Li, M.K. Mandal, and B.F. Cockburn, “Efficient Parallel Implementation of Motion Estimation on the Computational RAM Architecture,” in Proceedings IEEE Canadian Conference on Electrical and Computer Engineering, vol. 2, May 2002, pp. 609–613.

    Google Scholar 

  10. B.S.-H. Kwan, B.F. Cockburn, and D.G. Elliott, “Implementation of DSP-RAM: An Architecture for Parallel Digital Signal Processing in Memory,” in Proceedings IEEE Canadian Conference on Electrical and Computer Engineering, vol. 1, May 2001, pp. 341–345.

    Google Scholar 

  11. Z. Wang, B.F. Cockburn, D.G. Elliott, and W.A. Krzymien, “DSP-RAM: A Logic-Enhanced Memory Architecture for Communication Signal Processing,” in Proceedings IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, Aug. 1999, pp. 475–478.

  12. G. Fujita, T. Onoye, and I. Shirakawa, “A New Motion Estimation Core Dedicated to h.263 Video Coding,” in Proceedings IEEE International Symposium on Circuits and Systems ISCAS 1997, vol. 2, June 1997, pp. 1161–1164.

    Article  Google Scholar 

  13. A. Ohtani, Y. Matsumoto, M. Gion, H. Yoshida, T. Araki, A. Ubukata, M. Serizawa, K. Aoki, A. Sota, A. Nagata, and K. Aono, “A Motion Estimation Processor for MPEG2 Video Real Time Encoding at Wide Search Range,” in Proceedings IEEE Custom Integrated Circuits Conference, 1995, pp. 405–408.

  14. J.F. Shen, L.G. Chen, H.C. Chang, and T.C. Wang, “Low Power Full-Search Block-Matching Motion Estimation Chip for h.263+,” in Proceedings IEEE International Symposium on Circuits and Systems ISCAS 1999, vol. 4, May/June, 1999, pp. 299–302.

    Google Scholar 

  15. W. Badawy and M. Bayoumi, “Algorithm-Based Low-Power VLSI Architecture for 2-D Mesh Video-Object Motion Tracking,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 12, no. 4, 2002, pp. 227–237.

    Article  Google Scholar 

  16. M. Miyama, O. Tooyama, N. Takamatsu, K. Nakamura, A. Kato, J. Miyakoshi, K. Hashimoto, S. Komatsu, M. Yagi, M. Morimoto, K. Taki, and M. Yoshimoto, “An Ultra Low Power, Real-Time MPEG2 MP@HL Motion Estimation Processor Core with SIMD Datapath Architecture Optimized for Gradient Descent Search Algorithm,” in Proceedings IEEE Custom Integrated Circuits Conference, 2002, pp. 167–170.

  17. P. Pirsch, N. Demassieux, and W. Gehrke, “VLSI Architectures for Video Compression—A Survy,” IEEE Proceedings, vol. 83, no. 2, 1995, pp. 220–246.

    Article  Google Scholar 

  18. M. Sayed and W. Badawy, A New Class of Computational RAM Architectures for Real-Time MPEG-4 Applications, in Proceedings 3rd IEEE International Workshop on System-on-Chip for Real Time Applications IWSOC, June/July, 2003, pp. 328–332.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohammed Sayed.

Additional information

Mohammed Sayed received his B.Sc. degree from Zagazig University, Zagazig, Egypt, in 1997 and a postgraduate diploma in VLSI design from the Information Technology Institute (ITI), Cairo, Egypt, in 1998. In 2003 he received his M.Sc. degree from University of Calgary, Calgary, Canada. From 1998 to 2001 he was a research and teaching assistant at the Electronics & Communications Engineering Department, Zagazig University, Egypt. In 2001 he became a research assistant at the Department of Electrical and Computer Engineering, University of Calgary, Canada. His current research interests are System-on-Chip, Embedded Memories, and Digital Video Processing.

Mr. Sayed received a number of scholarships and awards such as iCORE Scholarship from 2003 to 2005, SMC Industrial Collaboration Award in June 2003, and the Micronet Annual Workshop Best Paper Award in April 2002. He has a number of journal and conference publications and a number of contributions to the MPEG-4 standard (ISO/IEC JTC1/SC29/WG11 MPEG2002/ M8562 and M8563).

Wael Badawy is an associate professor in the Department of Electrical and Computer Engineering. He holds an adjunct professor in the Department of Mechanical Engineering, University of Alberta.

Dr. Badawy's research interests are in the areas of: Microelectronics, VLSI architectures for video applications with low-bit rate applications, digital video processing, low power design methodologies, and VLSI prototyping. His research involves designing new models, techniques, algorithms, architectures and low power prototype for novel system and consumer products. Dr. Badawy authored and co-authored more than 100 peer reviewed Journal and Conference papers and about 30 technical reports. He is the Guest Editor for the special issue on System on Chip for Real-Time Applications in the Canadian Journal on Electrical and Computer Engineering, the Technical Chair for the 2002 International Workshop on SoC for real-time applications, and a technical reviewer in several IEEE journals and conferences. He is currently a member of the IEEE-CAS Technical Committee on Communication. Dr. Badawy was honored with the “2002 Petro Canada Young Innovator Award”, “2001 Micralyne Microsystems Design Award” and the 1998 Upsilon Pi Epsilon Honor Society and IEEE Computer Society Award for Academic Excellence in Computer Disciplines. He is currently the Chairman of the Canadian Advisor Committee (CAC) and Head of the Canadian Delegation on ISO/IEC/JTC1/SC6 “Telecommunications and Information Exchange Between Systems”. Member, The Canadian Advisory Committee for the Standards Council of Canada—Subcommittee 29: Coding of Audio, Picture Multimedia and Hypermedia Information, and Canadian Delegate, The ISO/IEC MPEG standard committee. He is a voting Member on the VSI Alliance. He is also the Chair of the IEEE-Southern Alberta Society-Computer Chapter.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sayed, M., Badawy, W. A Computational Memory Architecture for MPEG-4 Applications with Mobile Devices. J VLSI Sign Process Syst Sign Image Video Technol 42, 35–42 (2006). https://doi.org/10.1007/s11265-005-4161-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-005-4161-1

Keywords

Navigation