skip to main content
10.1145/2159616.2159618acmconferencesArticle/Chapter ViewAbstractPublication Pagesi3dConference Proceedingsconference-collections
research-article

Tabletop Ensemble: touch-enabled virtual percussion instruments

Published:09 March 2012Publication History

ABSTRACT

We present an interactive virtual percussion instrument system, Tabletop Ensemble, that can be used by a group of collaborative users simultaneously to emulate playing music in real world while providing them with flexibility of virtual simulations. An optical multi-touch tabletop serves as the input device. A novel touch handling algorithm for such devices is presented to translate users' interactions into percussive control signals appropriate for music playing. These signals activate the proposed sound simulation system for generating realistic user-controlled musical sounds. A fast physically-based sound synthesis technique, modal synthesis, is adopted to enable users to directly produce rich, varying musical tones, as they would with the real percussion instruments. In addition, we propose a simple coupling scheme for modulating the synthesized sounds by an accurate numerical acoustic simulator to create believable acoustic effects due to cavity in music instruments. This paradigm allows creating new virtual percussion instruments of various materials, shapes, and sizes with little overhead. We believe such an interactive, multi-modal system would offer capabilities for expressive music playing, rapid prototyping of virtual instruments, and active exploration of sound effects determined by various physical parameters in a classroom, museum, or other educational settings. Virtual xylophones and drums with various physics properties are shown in the presented system.

Skip Supplemental Material Section

Supplemental Material

p7-ren.mp4

References

  1. Adrien, J.-M. 1991. Representations of musical signals. MIT Press, Cambridge, MA, USA, ch. The missing link: modal synthesis, 269--298. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Bilbao, S. 2009. Numerical Sound Synthesis. Wiley Online Library.Google ScholarGoogle Scholar
  3. Bonneel, N., Drettakis, G., Tsingos, N., Viaud-Delmon, I., and James, D. 2008. Fast modal sounds with scalable frequency-domain synthesis. In ACM SIGGRAPH 2008 papers, ACM, New York, NY, USA, SIGGRAPH '08, 24:1--24:9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Boyd, J. P. 2001. Chebyshev and Fourier Spectral Methods: Second Revised Edition, 2 revised ed. Dover Publications, December.Google ScholarGoogle Scholar
  5. Brebbia, C. A. 1991. Boundary Element Methods in Acoustics, 1 ed. Springer, October.Google ScholarGoogle Scholar
  6. Bruyns, C. 2006. Modal synthesis for arbitrarily shaped objects. Computer Music Journal 30, 3, 22--37. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Buxton, W., Hill, R., and Rowley, P. 1985. Issues and techniques in touch-sensitive tablet input. In ACM SIGGRAPH Computer Graphics, vol. 19, ACM, 215--224. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Chandak, A., Lauterbach, C., Taylor, M., Ren, Z., and Manocha, D. 2008. Ad-frustum: Adaptive frustum tracing for interactive sound propagation. IEEE Transactions on Visualization and Computer Graphics 14, 1707--1722. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Chuchacz, K., O'Modhrain, S., and Woods, R. 2007. Physical models and musical controllers: designing a novel electronic percussion instrument. In NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression, ACM, New York, NY, USA, 37--40. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Cook, P. 2002. Real sound synthesis for interactive applications. AK Peters, Ltd. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Davidson, P., and Han, J. 2006. Synthesis and control on large scale multi-touch sensing displays. In Proceedings of the 2006 conference on New interfaces for musical expression, IRCAM-Centre Pompidou, 216--219. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Deines, E., Michel, F., Bertram, M., Hagen, H., and Nielson, G. 2006. Visualizing the phonon map. In Eurovis. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Framework Named pipes, M. I. 2011. Named pipes.Google ScholarGoogle Scholar
  14. Funkhouser, T., Tsingos, N., and Jot, J.-M. 2003. Survey of methods for modeling sound propagation in interactive virtual environment systems. Presence and Teleoperation.Google ScholarGoogle Scholar
  15. Funkhouser, T., Tsingos, N., Carlbom, I., Elko, G., Sondhi, M., West, J. E., Pingali, G., Min, P., and Ngan, A. 2004. A beam tracing method for interactive architectural acoustics. The Journal of the Acoustical Society of America 115, 2, 739--756.Google ScholarGoogle ScholarCross RefCross Ref
  16. Guski, R., and Troje, N. 2003. Audiovisual phenomenal causality. Perception & psychophysics 65, 5, 789.Google ScholarGoogle Scholar
  17. Han, J. 2005. Low-cost multi-touch sensing through frustrated total internal reflection. In Proceedings of the 18th annual ACM symposium on User interface software and technology, ACM, 115--118. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Hochenbaum, J., and Vallis, O. 2009. Bricktable: A musical tangible multi-touch interface. Proceedings of Berlin Open Converence 09.Google ScholarGoogle Scholar
  19. Kaltenbrunner, M., Jorda, S., Geiger, G., and Alonso, M. 2006. The reactable*: A collaborative musical instrument.Google ScholarGoogle Scholar
  20. Miranda, E., and Wanderley, M. 2006. New digital musical instruments: control and interaction beyond the keyboard. AR Editions, Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. O'Brien, J., Shen, C., and Gatchalian, C. 2002. Synthesizing sounds from rigid-body simulations. In Proc. of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, ACM Press New York, NY, USA, 175--181. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Raghuvanshi, N., and Lin, M. 2006. Interactive sound synthesis for large scale environments. In Proceedings of the 2006 symposium on Interactive 3D graphics and games, ACM, 101--108. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Raghuvanshi, N., Narain, R., and Lin, M. C. 2009. Efficient and accurate sound propagation using adaptive rectangular decomposition. IEEE Transactions on Visualization and Computer Graphics 15 (September), 789--801. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Raghuvanshi, N., Snyder, J., Mehra, R., Lin, M., and Govindaraju, N. 2010. Precomputed wave simulation for real-time sound propagation of dynamic sources in complex scenes. ACM Trans. Graph. 29 (July), 68:1--68:11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Ren, Z., Yeh, H., and Lin, M. C. 2011. Example-Guided Physically-Based Sound Synthesis. UNC Techinical Report.Google ScholarGoogle Scholar
  26. Rosenberg, I., and Perlin, K. 2009. The unmousepad: an interpolating multi-touch force-sensing input pad. In ACM SIG-GRAPH 2009 papers, ACM, 1--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Sakamoto, S., Ushiyama, A., and Nagatomo, H. 2006. Numerical analysis of sound propagation in rooms using the finite difference time domain method. The Journal of the Acoustical Society of America 120, 5, 3008.Google ScholarGoogle ScholarCross RefCross Ref
  28. Schöening, J., Hook, J., Motamedi, N., Olivier, P., Echtler, F., Brandl, P., Muller, L., Daiber, F., Hilliges, O., Loechtefeld, M., Roth, T., Schmidt, D., and von Zadow, U. 2009. Building interactive multi-touch surfaces. Journal of Graphics, GPU, and Game Tools 14, 3, 35--55.Google ScholarGoogle ScholarCross RefCross Ref
  29. Shabana, A. 1997. Vibration of discrete and continuous systems. Springer Verlag.Google ScholarGoogle Scholar
  30. Si, H. 2011. TetGen: A Quality Tetrahedral Mesh Generator and a 3D Delaunay Triangulator.Google ScholarGoogle Scholar
  31. Thompson, L. L. 2006. A review of finite-element methods for time-harmonic acoustics. The Journal of the Acoustical Society of America 119, 3, 1315--1330.Google ScholarGoogle ScholarCross RefCross Ref
  32. Van Den Doel, K., and Pai, D. 1998. The sounds of physical shapes. PRESENCE-CAMBRIDGE MASSACHUSETTS-7, 382--395. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Weinberg, G., and Driscoll, S. 2007. The interactive robotic percussionist: new developments in form, mechanics, perception and interaction design. In Proceedings of the ACM/IEEE international conference on Human-robot interaction, ACM, New York, NY, USA, HRI '07, 97--104. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. XAudio2, M. 2011. XAudio2.Google ScholarGoogle Scholar

Index Terms

  1. Tabletop Ensemble: touch-enabled virtual percussion instruments

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          I3D '12: Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
          March 2012
          220 pages
          ISBN:9781450311946
          DOI:10.1145/2159616

          Copyright © 2012 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 9 March 2012

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate148of485submissions,31%

          Upcoming Conference

          I3D '24
          Symposium on Interactive 3D Graphics and Games
          May 8 - 10, 2024
          Philadelphia , PA , USA

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader