skip to main content
10.1145/1542245.1542256acmconferencesArticle/Chapter ViewAbstractPublication PagesmmsysConference Proceedingsconference-collections
research-article

SLIPstream: scalable low-latency interactive perception on streaming data

Published:03 June 2009Publication History

ABSTRACT

A critical problem in implementing interactive perception applications is the considerable computational cost of current computer vision and machine learning algorithms, which typically run one to two orders of magnitude too slowly to be used interactively. Fortunately, many of these algorithms exhibit coarse-grained task and data parallelism that can be exploited across machines. The SLIPstream project focuses on building a highly-parallel runtime system called Sprout that can harness the computing power of a cluster to execute perception applications with low latency. This paper makes the case for using clusters for perception applications, describes the architecture of the Sprout runtime, and presents two compute-intensive yet interactive applications.

References

  1. Visual Object Instance Recognition. http://people.csail.mit.edu/rahimi/projects/objrec/.Google ScholarGoogle Scholar
  2. D. J. Abadi, Y. Ahmad, M. Balazinska, U. Çetintemel, M. Cherniack, J. Hwang, W. Lindner, A. S. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and S. Zdonik. The Design of the Borealis Stream Processing Engine. In Proc. Innovative Data Systems Research, 2005.Google ScholarGoogle Scholar
  3. J. Allard, V. Gouranton, L. Lecointre, S. Limet, E. Melin, B. Raffin, and S. Robert. FlowVR: a middleware for large scale virtual reality applications. In Proc. Euro-Par, 2004.Google ScholarGoogle ScholarCross RefCross Ref
  4. L. Amini, H. Andrade, R. Bhagwan, F. Eskesen, R. King, P. Selo, Y. Park, and C. Venkatramani. SPC: A Distributed, Scalable Platform for Data Mining. In Proceedings of the Workshop on Data Mining Standards, Services, and Platforms, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. A. F. Bobick and J. W. Davis. The recognition of human movement using temporal templates. PAMI, 23(3), 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. I. Buck, T. Foley, D. Horn, J. Sugerman, K. Fatahalian, M. Houston, and P. Hanrahan. Brook for GPUs: Stream Computing on Graphics Hardware. In SIGGRAPH, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. S. Chandrasekaran, O. Cooper, A. Deshpande, M. J. Franklin, J. M. Hellerstein, W. Hong, S. Krishnamurthy, S. Madden, V. Raman, F. Reiss, and M. Shah. TelegraphCQ: Continuous Dataflow Processing for an Uncertain World. In Proceedings of the Conference on Innovative Data Systems Research, 2003.Google ScholarGoogle Scholar
  8. M. Cherniack, H. Balakrishnan, M. Balazinska, D. Carney, U. Cetintemel, Y. Xing, and S. Zdonik. Scalable Distributed Stream Processing. In Proceedings of the Conference on Innovative Data Systems Research, 2003.Google ScholarGoogle Scholar
  9. J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. CACM, 51(1), 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. P. Dollar, V. Rabaud, G. Cottrell, and S. Belongie. Behavior recognition via sparse spatio-temporal features. In IEEE Workshop on PETS, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  11. L. Girod, Y. Mei, R. Newton, S. Rost, A. Thiagarajan, H. Balakrishnan, and S. Madden. XStream: a Signal-Oriented Data Stream Management System. In Proc. International Conference on Data Engineering, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. M. Gordon, W. Thies, and S. Amarasinghe. Exploiting Coarse-Grained Task, Data, and Pipeline Parallelism in Stream Programs. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems, October 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. J. Gummaraju, J. Coburn, Y. Turner, and M. Rosenblum. Streamware: programming general-purpose multicore processors using streams. In Proc. Architectural Support for Programming Languages and Operating Systems, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. J. Hartigan and M. Wang. A k-means clustering algorithm. Applied Statistics, 28:100--108, 1979.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: distributed data-parallel programs from sequential building blocks. In Proceedings of European Conference on Computer Systems, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. T. Johnson, M. S. Muthukrishnan, V. Shkapenyuk, and O. Spatscheck. Query-aware partitioning for monitoring massive network data streams. In Proc. SIGMOD, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. U. J. Kapasi, S. Rixner, W. J. Dally, B. Khailany, J. H. Ahn, P. Mattson, and J. D. Owens. Programmable Stream Processors. IEEE Computer, pages 54--62, August 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Y. Ke, R. Sukthankar, and M. Hebert. Efficient visual event detection using volumetric features. In Proceedings of International Conference on Computer Vision, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Y. Ke, R. Sukthankar, and M. Hebert. Event detection in crowded videos. In Proceedings of International Conference on Computer Vision, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  20. K. Knobe, J. M. Rehg, A. Chauhan, R. S. Nikhil, and U. Ramachandran. Scheduling constrained dynamic applications on clusters. In Proc. Supercomputing, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. I. Laptev and T. Lindeberg. Space-time interest points. In Proc. International Conference on Computer Vision, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. J.-D. Lesage and B. Raffin. A Hierarchical Component Model for Large Parallel Interactive Applications. The Journal of Supercomputing, July 2008.Google ScholarGoogle Scholar
  23. D. Lowe. Distinctive image features form scale-invariant keypoints. IJCV, 60(2), 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. U. Ramachandran, R. Nikhil, J. M. Rehg, Y. Angelov, A. Paul, S. Adhikari, K. Mackenzie, N. Harel, and K. Knobe. Stampede: a cluster programming middleware for interactive stream-oriented applications. IEEE Trans. Parallel and Distributed Systems, 14(11), 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. C. Schuldt, I. Laptev, and B. Caputo. Recognizing human actions: A local SVM approach. In Proc. International Conference on Pattern Recognition, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. V. N. Vapnik. The Nature of Statistical Learning Theory. Springer, 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In Proc. Computer Vision and Pattern Recognition, 2001.Google ScholarGoogle ScholarCross RefCross Ref
  28. J. Wolf, N. Bansal, K. Hildrum, S. Parekh, D. Rajan, R. Wagle, K.-L. Wu, and L. Fleischer. SODA: an optimizing scheduler for large-scale stream-based distributed computer systems. In Proc. ACM/IFIP/USENIX Middleware, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. C. Wren, F. Sparacino, A. Azarbayejani, T. Darrell, T. Starner, A. Kotani, C. Chao, M. Hlavac, K. Russell, and A. Pentland. Perceptive spaces for performance and entertainment: Untethered interaction using computer vision and audition. Applied AI, 11(4), 1996.Google ScholarGoogle Scholar
  30. D. Zhang, Z.-Z. Li, H. Song, and L. Liu. A Programming Model for an Embedded Media Processing Architecture. In Embedded Computer Systems: Architectures, Modeling, and Simulation, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. SLIPstream: scalable low-latency interactive perception on streaming data

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          NOSSDAV '09: Proceedings of the 18th international workshop on Network and operating systems support for digital audio and video
          June 2009
          142 pages
          ISBN:9781605584331
          DOI:10.1145/1542245

          Copyright © 2009 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 3 June 2009

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate118of363submissions,33%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader