Article

The ThreadMill architecture for stream-oriented human communication analysis applications

Authors:

Paulo Barthelmess,

Clarence A. EllisAuthors Info & Claims

ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

Pages 61 - 68

https://doi.org/10.1145/1027933.1027945

Published: 13 October 2004 Publication History

Abstract

This work introduces a new component software architecture - ThreadMill - whose main purpose is to facilitate the development of applications in domains where high volumes of streamed data need to be efficiently analyzed. It focuses particularly on applications that target the analysis of human communication e.g. in speech and gesture recognition. Applications in this domain usually employ costly signal processing techniques, but offer in many cases ample opportunities for concurrent execution in many different phases. ThreadMill's abstractions facilitate the development of applications that take advantage of this potential concurrency by hiding the complexity of parallel and distributed programming. As a result, ThreadMill applications can be made to run unchanged on a wide variety of execution environments, ranging from a single-processor machine to a cluster of multi-processor nodes. The architecture is illustrated by an implementation of a tracker for hands and face of American Sign Language signers that uses a parallel and concurrent version of the Joint Likelihood Filter method.

References

[1]

G. A. Agha. ACTORS: A Model of Concurrent Computation in Distributed Systems. Cambridge Press, 1986.

Digital Library

[2]

D. Arita and R. Taniguchi. RPV-II: A stream-based real-time parallel vision system and its application to real-time volume reconstruction. In B. Schiele and G. Sagerer, editors, Proceedings of the Second International Workshop on Computer Vision Systems (ICVS), volume 2095 of Lecture Notes in Computer Science, pages 174--189, Vancouver, Canada, 2001. Springer-Verlag.

Digital Library

[3]

P. Barthelmess. ThreadMill: A highly configurable architecture for human communication analysis applications. PhD thesis, Computer Science Department, University of Colorado at Boulder, November 2003.

Digital Library

[4]

A. Cheyer and D. Martin. The Open Agent Architecture. Journal of Autonomous Agents and Multi-Agent Systems, 4(1/2):143--148, March 2001.

Digital Library

[5]

G. Eisenhauer, F. E. Bustamante, and K. Schwan. Native data representation: An efficient wire format for high-performance distributed computing. IEEE Transactions on Parallel and Distributed Systems, 13(12):1234--1246, 2002.

Digital Library

[6]

G. Fink, N. Jungclaus, F. Kummert, H. Ritter, and G. Sagerer. A distributed system for integrated speech and image understanding. In International Symposium on Artificial Intelligence, pages 117--126, Cancun, Mexico, 1996.

[7]

R. J. Firby, R. E. Kahn, P. N. Prokopopowitz, and M. J. Swain. An architecture for vision and action. In C. Mellish, editor, Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, pages 72--79, San Francisco, 1995. Morgan Kaufmann.

Digital Library

[8]

M. P. I. Forum. MPI: A Message-Passing Interface Standard, 1994.

[9]

A. R. Francois and G. G. Medioni. A modular software architecture for real-time video processing. In Proceedings of the International Workshop on Computer Vision Systems, pages 35--49, Vancouver, B.C., Canada, July 2001.

Digital Library

[10]

E. Gamma, R. Halm, R. E. Johnson, and J. Vlissides. Design Patterns: elements of reusable object-oriented software. Addison Wesley, 1995.

Digital Library

[11]

M. M. Gorlick and R. R. Razouk. Using Weaves for software construction and analysis. In L. Belady, D. Barstow, and K. Torii, editors, Proceedings of the 13th International Conference on Software Engineering, pages 23--34, Austin, Texas, May 1991. IEEE Computer Society Press.

Digital Library

[12]

R. A. Kahn. Perseus: An Extensible Vision System for Human-Machine Interaction. PhD thesis, University of Chicago, August 1996.

Digital Library

[13]

A. Gursoy and L. Kale. Performance and modularity benefits of message-driven execution. Journal of Parallel and Distributed Computing, 64(4):461--480, 2004.

Digital Library

[14]

L. V. Kale. The virtualization approach to parallel programming: Runtime optimizations and the state of the art. In Los Alamos Computer Science Institute Symposium - LACSI 2002, Albuquerque, 2002. "State of the field" paper.

[15]

M. Kohler, S. Schroter, and H. Muller. The ARGUS-architecture for global computer-vision-based interaction and its application in domestic environments. In Proc. Human Computer Interaction 1999 (HCI'99), pages 296--300, Munich, Germany, August 1999.

Digital Library

[16]

Mitre Corporation. Galaxy Communicator Documentation, 2002. Available on the web at http://communicator.sourceforge.net/sites/MITRE/distributions/GalaxyCommunicator/docs/manual/index.html.

[17]

P. Oreizy, M. M. Gorlick, R. N. Taylor, D. Heimbigner, G. Johnson, N. Medvidovic, A. Quilici, D. S. Rosenblum, and A. L. Wolf. An architecture-based approach to self-adaptive software. IEEE Intelligent Systems and Their Applications, 14(3):54--62, May/June 1999.

Digital Library

[18]

U. Ramachandran, R. Nikhil, J. M. Rehg, Y. Angelov, A. Paul, S. Adhikari, K. Mackenzie, N. Harel, and K. Knobe. Stampede: A cluster programming middleware for interactive stream-oriented applications. IEEE Transactions on Parallel and Distributed Systems, pages 1140--1154, November 2003.

Digital Library

[19]

C. Rasmussen. Integrating Multiple Visual Cues for Robust Tracking. PhD thesis, Yale University, 2000.

Digital Library

Cited By

Barthelmess PEllis C(2004)A Distributed and Parallel Component Architecture for Stream-Oriented ApplicationsOn the Move to Meaningful Internet Systems 2004: CoopIS, DOA, and ODBASE10.1007/978-3-540-30469-2_38(1427-1444)Online publication date: 2004
https://doi.org/10.1007/978-3-540-30469-2_38

Index Terms

The ThreadMill architecture for stream-oriented human communication analysis applications
1. Computing methodologies
  1. Distributed computing methodologies
    1. Distributed programming languages
  2. Parallel computing methodologies
    1. Parallel programming languages
2. Software and its engineering
  1. Software notations and tools
  2. Software organization and properties
    1. Software system structures
      1. Software architectures

Recommendations

Scaling communication-intensive applications on BlueGene/P using one-sided communication and overlap
IPDPS '09: Proceedings of the 2009 IEEE International Symposium on Parallel&Distributed Processing

In earlier work, we showed that the one-sided communication model found in PGAS languages (such as UPC) offers significant advantages in communication efficiency by decoupling data transfer from processor synchronization. We explore the use of the PGAS ...
Analysis of communication data: compression network
PAS '95: Proceedings of the First Aizu International Symposium on Parallel Algorithms/Architecture Synthesis

The paper reports the effect of compressed message delivery (a compression network) on a parallel processing system such as workstation clusters. Compression network is simulated on a massively parallel processor, the Thinking Machines CM-5, using the ...
Experimental Application-Driven Architecture Analysis of an SIMD/MIMD Parallel Processing System

An experimental analysis of the architecture of an SIMD/MIMD parallel processing system is presented. Detailed implementations of parallel fast Fourier transform (FFT) programs were used to examine the performance of the prototype of the PASM (...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

October 2004

368 pages

ISBN:1581139950

DOI:10.1145/1027933

General Chairs:
Rajeev Sharma
Advanced Interfaces
,
Trevor Darrell
Massachusetts Institute of Technology
,
Program Chairs:
Mary Harper
Purdue University, West Lafayette, IN
,
Gianni Lazzari
ITC-IRST
,
Matthew Turk
University of California, Santa Barbara, CA

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICMI04

Sponsor:

ICMI04: Sixth International Conference on Multimodal Interfaces 2004

October 13 - 15, 2004

PA, State College, USA

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
196
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Barthelmess PEllis C(2004)A Distributed and Parallel Component Architecture for Stream-Oriented ApplicationsOn the Move to Meaningful Internet Systems 2004: CoopIS, DOA, and ODBASE10.1007/978-3-540-30469-2_38(1427-1444)Online publication date: 2004
https://doi.org/10.1007/978-3-540-30469-2_38

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten