Skip to main content
SpringerLink
Log in
Book cover

International Conference on Human-Computer Interaction

HCII 2020: HCI International 2020 - Late Breaking Papers: Multimodality and Intelligence pp 209–218Cite as

Automatic Page-Turner for Pianists with Wearable Motion Detector

  • Conference paper
  • First Online:

  • 1414 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12424))

Abstract

This study describes a novel combination of wearable devices and digital music notation system to support hands-free page turning during music performances. Our proposed system follows the pianist’s hands and traces the movements of both wrists in three-axes and sends data to the central computer via a WIFI connection. We used the MIDI format as a standard digital notation system in our study which contains more than 128 notes in 10 octaves. Each piece of music includes a series of smaller and equal sections called measures. Using the MIDI numbering format, the median value of all notes in each measure is available. By comparing the normalized median values and data from the wearables with cross-correlation and dynamic time warping techniques, we can sync these two series, predict the current playing measure, and turn the page at the correct time. The motivation and structure of this study are for pianists; however, this project has the potential to customized for other instruments.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Wolberg, G., Schipper, I.: Page turning solutions for musicians: a survey. Work 41, 37–52 (2012)

    Article  Google Scholar 

  2. Aluţei, A.M., Chetran, B.V., Lungu, I., Mândru, D.: Automatic page turner. In: Solid State Phenomena, pp 27–32 (2010)

    Google Scholar 

  3. Abueg, E., Coughlin, J., Hanumara, N., et al.: Implementation of a re-usable adhesive in a novel automated page-turner. In: Proceedings of the IEEE 30th Annual Northeast Bioengineering Conference, 2004, pp. 208–209 (2004)

    Google Scholar 

  4. Suteparuk, P.: Detection of piano keys pressed in video. Dept Comput Sci, Stanford Univ, Stanford, CA, USA, Technical report (2014)

    Google Scholar 

  5. Takegawa, Y., Terada, T., Nishio, S.: Design and implementation of a real-time fingering detection system for piano performance. Int. Comput. Music Conf ICMC 74, 67–74 (2006)

    Google Scholar 

  6. Oka, A., Hashimoto, M.: Marker-less piano fingering recognition using sequential depth images. In: FCV 2013 - Proc 19th Korea-Japan Joint Workshop on Frontiers of Computer Vision, vol. 4, pp. 1–4 (2013). https://doi.org/10.1109/FCV.2013.6485443

  7. Machnacz, J.H.: Page turner for sheet music and the like (1972)

    Google Scholar 

  8. Carr, D.J., Lucero, L.: Portable page turner for music sheets (1993)

    Google Scholar 

  9. Solutions to Hold and Wirelessly Control your Tablet | AirTurn. https://www.airturn.com/products/categories/bluetooth-pedals

  10. All – PageFlip. https://www.pageflip.com/collections/all

  11. Kora, S., Lim, B.B.L., Wolf, J.: A hands-free music score turner using Google glass. J. Comput. Inf. Syst. 59, 297–307 (2019)

    Google Scholar 

  12. Tang, Z., Yan, C., Ren, S., Wan, H.: HeadPager: page turning with computer vision based head interaction. In: Chen, C.-S., Lu, J., Ma, K.-K. (eds.) ACCV 2016. LNCS, vol. 10118, pp. 249–257. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-54526-4_19

    Chapter  Google Scholar 

  13. Tabone, A.: Automated page turner for musicians. University of Malta (2019)

    Google Scholar 

  14. NGIMU – x-io Technologies. https://x-io.co.uk/ngimu/

  15. McKay, C.: Automatic Genre Classification of MIDI Recordings. McGill University, Canada (2004)

    Google Scholar 

  16. Free music composition and notation software|MuseScore

    Google Scholar 

  17. Caron, F., Duflos, E., Pomorski, D., Vanheeghe, P.: GPS/IMU data fusion using multisensor Kalman filtering: introduction of contextual aspects. Inf. fusion 7, 221–230 (2006)

    Google Scholar 

Download references

Acknowledgements

This study was funded by the Natural Sciences and Engineering Research Council of Canada.

Author information

Authors and Affiliations

  1. Carleton University, Ottawa, ON, K1S5B6, Canada

    Seyed Ali Mirazimzadeh & Victoria McArthur

Authors
  1. Seyed Ali Mirazimzadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Victoria McArthur
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Seyed Ali Mirazimzadeh .

Editor information

Editors and Affiliations

  1. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

  2. The Open University of Japan, Chiba, Japan

    Masaaki Kurosu

  3. Siemens Corporation, Princeton, NJ, USA

    Helmut Degen

  4. University of Central Florida, Orlando, FL, USA

    Lauren Reinerman-Jones

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mirazimzadeh, S.A., McArthur, V. (2020). Automatic Page-Turner for Pianists with Wearable Motion Detector. In: Stephanidis, C., Kurosu, M., Degen, H., Reinerman-Jones, L. (eds) HCI International 2020 - Late Breaking Papers: Multimodality and Intelligence. HCII 2020. Lecture Notes in Computer Science(), vol 12424. Springer, Cham. https://doi.org/10.1007/978-3-030-60117-1_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-60117-1_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-60116-4

  • Online ISBN: 978-3-030-60117-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation