Skip to main content
SpringerLink
Log in

A novel method to musicalize shape and visualize music and a novel technique in music cryptography

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Since many years ago, musicians have composed music based on the images that they have had in their minds. On the other hand, music affects people’s imagination while hearing it. This research provides a method that can transform shape to music and music to shape. This method defines musical notations for horizontal, diagonal and vertical line segments, filled circle and curve with different colors, which are the basis of many shapes in transforming shapes into music. Then these primary mappings are generalized to more complex forms to transform any shape. Moreover, music can be transformed into shape by this method. For this transformation, primary musical notations such as simple notes, notes joined by a legato, notes with a staccato, notes joined by a legato and have crescendo or decrescendo and notes with an accent or a trill are defined. These primary musical notations are generalized to more complex forms to transform any music into shape. Also, the method of this research can be used in music cryptography. It employs mapping of notes in a twelve-tone equal musical system into shapes and mappings of shapes with an equal line width and different colors into music.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data availability

All data and material are available and can be shared on demand.

References

  1. Apel W (2003) The Harvard dictionary of music, 4th edn. Belknap Press: An Imprint of Harvard University Press, Cambridge

  2. Berman G (1999) Synesthesia and the arts. Leonardo 32(1):15–22

  3. Boenn G (2018) Computational models of rhythm and meter. Springer International Publishing, New York

  4. Burk P, Polansky L, Repetto D, Roberts M, Rockmore D (2011) Music and computers: a theoretical and historical approach. Preface to the Archival Version (Spring, 2011)

  5. Calude CS (2013) Information and randomness: an algorithmic perspective. In: Texts in theoretical computer science. An EATCS series. Springer-Verlag, Berlin Heidelberg

    Google Scholar 

  6. Campen V (2010) Cretien. The hidden sense: Synesthesia in art and science. The MIT Press, Cambridge

  7. Fornari J, Maia I (2011) Interactive notation: Towards a cmputer model for interactive musical composition. Revista EIMAS. http://www.ufjf.br/anais_eimas/ISSN. Accessed 2011

  8. Goldreich O (2019) On the foundations of cryptography providing sound foundations for cryptography: on the work of shafi goldwasser and silvio micali. ACM Books, New York, pp 411–496

  9. Güçlütürk Y, van Lier R (2019) Decomposing complexity preferences for music. Front Psychol 10:674

    Article  Google Scholar 

  10. Halpern AR, Bower GH (1982) Musical expertise and melodic structure in memory for musical notation. Am J Psychol 95(1):31–50. https://doi.org/10.2307/1422658

  11. Hargreaves DJ, MacDonald R, Miell D (2012) Explaining musical imaginations: creativity, performance, and perception. Musical imaginations. In: Multidisciplinary perspectives on creativity, performance, and perception. Oxford University Press, Oxford, pp 1–14

  12. Isaacson EJ (2005) What you see is what you get: on visualizing music. Proceedings of ISMIR 2005, 6th International Conference on Music Information Retrieval, London, UK 11–15 September 2005

  13. Kennedy M, Bourne J (2004) The concise Oxford dictionary of music. Oxford University Press, Oxford

  14. Kumar C, Dutta S, Chakraborty S (2015) Hiding messages using musical notes: a fuzzy logic approach. Int J Secur Appl 9(1):237–248

    Google Scholar 

  15. Kumar C, Dutta S, Chakraborty S (2015) A hybrid Polybius-Playfair music cipher. Int J Multimed Ubiquit Eng 10(8):187–198

    Article  Google Scholar 

  16. Kuo Y-T, Chuang M-C (2013) A proposal of a color music notation system on a single melody for music beginners. Int J Music Educ 31(4):394–412

    Article  Google Scholar 

  17. Lamaute N, et al (2016) A substitution cipher for musical cryptography. In: Proceedings of Student-Faculty Research Day, CSIS, Pace University

  18. London J et al (2019) Tapping doesn’t help: Synchronized self-motion and judgments of musical tempo. Atten Percept Psychophysiol 81.7:2461–2472

    Article  Google Scholar 

  19. Maršık L, Pokorny J, Ilcık M (2014) Towards a harmonic complexity of musical pieces. Procedings of the Annual International Workshop on Databases, Texts, Specifications, and Objects (DATESO)

    Google Scholar 

  20. Milhaud D (2018) South Bay chamber music society. Accessed date: 10/21/2020

  21. Nikitin N, Rozaliev V, Orlova Y (2017) Program for sound generation based on image color spectrum with using the recurrent neural network. IV International research conference “Information technologies in Science, Management, Social sphere and Medicine” (ITSMSSM 2017). Atlantis Press

  22. Patterson RD, Gaudrain E, Walters TC (2010) “The perception of family and register in musical tones”. Music perception. Springer, New York, NY, pp 13–50

    Google Scholar 

  23. Percino G, Klimek P, Thurner S (2014) Instrumentational complexity of music genres and why simplicity sells. PLoS One 9(12):e115255

    Article  Google Scholar 

  24. Plack CJ, Oxenham AJ, Fay RR (eds) (2006) Pitch: neural coding and perception, vol 24. Springer Science & Business Media

  25. Pryer A (2011) Graphic notation. In: Latham A (ed) The Oxford companion. Oxford University Press, Oxford

  26. Puckette M (1996) Pure data: another integrated computer music environment. Proceedings of the second intercollege computer music concerts, pp 37–41

    Google Scholar 

  27. Qadir AM, Varol N (2019) A Review Paper on Cryptography. 2019 7th International Symposium on Digital Forensics and Security (ISDFS). IEEE

  28. Rodrıguez-González S, Pérez-Lancho B (2018) Modeling a Synaesthete System to Generate a Tonal Melody from a Color Distribution. International Joint Conference SOCO’18-CISIS’18-ICEUTE’18: San Sebastián, Spain, June 6–8, 2018 Proceedings. Vol. 771. Springer

  29. Sams E (1979) Musical cryptography. Cryptologia 3(4):193–201

    Article  Google Scholar 

  30. Sams E (2016) Musical Cryptography (Crypt. 1979), Ericsams.org. [Online]. Available: http://ericsams.org/index.php/on-cryptography/333-musical-cryptography. [Accessed: 21- Apr- 2016]

  31. Seaberg M (2011) Tasting the universe: people who see colors in words and rainbows in symphonies. Red Wheel/Weiser

  32. Shmulevich I, Povel D-J (2000) Complexity measures of musical rhythms. Rhythm perception and production, pp 239–244

    Google Scholar 

  33. Smith SM, Williams GN (1997) A visualization of music. Proceedings. Visualization’97 (Cat. No. 97CB36155). IEEE

  34. Stokley SR (2018) Historic look on color theory. Johnson & Wales University, Providence

  35. Strayer HR (2013) From neumes to notes: The evolution of music notation. Music Offerings 4.1:1

    Google Scholar 

  36. Tesla N (2007) The strange life of Nikola Tesla, vol 1. Library of Alexandria

  37. Thul E, Toussaint GT (2008) Rhythm complexity measures: A comparison of mathematical models of human perception and performance. ISMIR

  38. Tucker GM, Jones AV, Latham A (2011) The Oxford companion to music. Oxford University Press, Oxford

  39. Vuust P, Witek MAG (2014) Rhythmic complexity and predictive coding: a novel approach to modeling rhythm and meter perception in music. Front Psychol 5:1111

    Article  Google Scholar 

  40. Weiß C, Müller M (2015) Tonal complexity features for style classification of classical music. 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE

  41. Xing B, Zhang K, Zhang L, Wu X, Dou J, Sun S (2019) Image–music synesthesia-aware learning based on emotional similarity recognition. IEEE Access 7:136378–136390

    Article  Google Scholar 

  42. Yastrebtsev V On NA (1999) Rimsky-Korsakov’s color sound- contemplation Russkaya muzykalnaya gazeta, 1908, N 39–40 (in Russian), cited by Hiilnl Galeyev

Download references

Author information

Authors and Affiliations

  1. School of Mathematics, Statistics and Computer Science, College of Science, University of Tehran, Tehran, Iran

    Yasaman Mashhadi Hashem Marandi & Hedieh Sajedi

  2. School of Music, College of the Arts and Media, Central Michigan University, Mount Pleasant, MI, USA

    Sepehr Pirasteh

Authors
  1. Yasaman Mashhadi Hashem Marandi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hedieh Sajedi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sepehr Pirasteh
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Yasaman invented the study, proposed the system design and did the analyses and prepared materials. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Hedieh Sajedi.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Marandi, Y.M.H., Sajedi, H. & Pirasteh, S. A novel method to musicalize shape and visualize music and a novel technique in music cryptography. Multimed Tools Appl 80, 7451–7477 (2021). https://doi.org/10.1007/s11042-020-09962-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09962-8

Keywords

Search

Navigation