Skip to main content
SpringerLink
Log in

Analyzing the perception of Chinese melodic imagery and its application to automated composition

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This study investigated the influence of two music elements, mode and rhythm, on melodic imagery. By modulating different parameters of mode and rhythm, this study produced various melody samples. Kansei engineering was adopted as a research method for designing the experimental process. A set of music assessment rules was established by regularizing the existing modes and rhythms and analyzing and comparing their differences. The results were applied to automated composition in order to develop a comprehensive automated composition system. Before the hearing experiment, 39 adjective pairs were selected for the survey of melodic imagery by reviewing literature and engaging in discussions with experts. A Markov chain was adopted for analyzing the current modal music to establish a Markov switching table for the Chinese pentatonic scale, and metrical complexity was used for generating rhythms. Finally, 30 music samples were produced using the automated composition system by applying the various combinations of modes and rhythms. The hearing experiment was conducted on 35 participants for examining their perception of melodic imagery. Item analysis and a reliability test were performed on the experimental data for eliminating invalid samples and items. Thus, 14 adjective pairs with a Cronbach’s α of 0.887 were obtained, indicating favorable reliability. In addition, this study involved conducting factor analysis and extracting three imagery factors, namely passionate–apathetic, beautiful–ugly, and romantic–rigid. Subsequently, multivariate analysis of variance was conducted in this study for determining the relationship between modes and metrical complexity and the 14 adjective pairs, and the estimated means were calculated. Multidimensional scaling was adopted for producing a two-dimensional perceptual map for the construction of a database. The experimental results of this study showed that modes and rhythms in music can effectively help musicians or computer composition systems compose melodies that create various perceptual imageries.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22

Similar content being viewed by others

References

  1. Cronbach LJ (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16(3):297–334

    Article  Google Scholar 

  2. Farnsworth PR (1954) A study of the Hevner adjective list. J Aesthet Art Criticism: 97–103

  3. Gabrielsson A (1973) Similarity ratings and dimension analyses of auditory rhythm patterns. 1. Scand J Psychol 14(1):138–160

    Article  Google Scholar 

  4. Gabrielsson A (1973) Similarity ratings and dimension analyses of auditory rhythm patterns. II. Scand J Psychol 14(1):161–176

    Article  Google Scholar 

  5. Hevner K (1936) Experimental studies of the elements of expression in music. Am J Psychol 48:246–268

    Article  Google Scholar 

  6. Hiller LA, Isaacson LM (1959) Experimental music; composition with an electronic computer by Lejaren A. Hiller, Jr. and Leonard M. Isaacson. New York, McGraw-Hill

  7. Ishihara S, Nagamachi M, Masaki J (2011) Music and Kansei: relations between modes, melodic ranges, rhythms, and Kansei

  8. Jindo T, Hirasago K (1997) Application studies to car interior of Kansei engineering. Int J Ind Ergon 19(2):105–114

    Article  Google Scholar 

  9. Keith M (1991) From polychords to polya: adventures in musical combinatorics. Vinculum Press

  10. Lerdahl F, Jackendoff R (1985) A generative theory of tonal music. MIT press

  11. Livingstone SR, Brown AR (2005) Dynamic response: real-time adaptation for music emotion. Paper presented at the Proceedings of the second Australasian conference on Interactive entertainment

  12. Longuet-Higgins C, Lee C–S (1984) The rhythmic interpretation of monophonic music. Music Percept: 424–441

  13. Morris RD (1987) Composition with pitch-classes: a theory of compositional design. Yale University Press New Haven

  14. Nagamachi M (1995) Kansei engineering: a new ergonomic consumer-oriented technology for product development. Int J Ind Ergon 15(1):3–11

    Article  MathSciNet  Google Scholar 

  15. Nagamachi M (2002) Kansei engineering as a powerful consumer-oriented technology for product development. Appl Ergon 33(3):289–294

    Article  Google Scholar 

  16. Papadopoulos G, Wiggins G (1999) AI methods for algorithmic composition: a survey, a critical view and future prospects. In: AISB symposium on musical creativity. Edinburgh, UK, pp. 110–117

  17. Pearson K (1901) On lines and planes of closest fit to system of points in space. Philos Mag 2(11):559–572

  18. Sangenya T, Fujisawa TX, Nagata N (2008) Creation of a sound-image scale-Quantification of the images of chord progressions with impression evaluation used. In: Systems, Man and Cybernetics, 2008. SMC 2008. IEEE International Conference on. pp. 1905–1909

  19. Scherer R (2005) What are emotions? And how can they be measured? Soc Sci Inf 44(4):695–729

    Article  Google Scholar 

  20. Schubert E (2003) Update of the Hevner adjective checklist. Percept Mot Skills 96(3c):1117–1122

    Article  Google Scholar 

  21. Toussaint G (2002) A mathematical analysis of African, Brazilian, and Cuban clave rhythms. Paper presented at the Townson University

  22. Toussaint G (2002) A mathematical analysis of African, Brazilian, and Cuban clave rhythms. In Bridges: mathematical connections in art, music, and science. Bridges Conference, 157–168

  23. Tung J-S (1981) The Chinese music meanings study (in Chinese). Chinese Music News Magzine, Taipei

    Google Scholar 

  24. Weaver E (1939) Syncopation: a study of musical rhythms. J Gen Psychol 20(2):409–429

    Article  Google Scholar 

  25. Xenakis I (1965) Free stochastic music from the computer. Programme of stochastic music in Fortran. Gravesaner Blätter 26:54–92

    Google Scholar 

Download references

Acknowledgments

The authors are appreciative of the support from the National Science Council Projects of Taiwan: NSC 101-2410-H-155-033-MY3 and NSC 101-2627-E-155-001-MY3

Author information

Authors and Affiliations

  1. Department of Information Communications, Kainan University, No.1 Kainan Road, Luzhu Shiang, Taoyuan, Taiwan, 33857, Republic of China

    Chih-Fang Huang

  2. Master Program of Sound and Music Innovative Technologies, National Chiao-Tung University, 1001 University Road, Hsinchu, Taiwan, 300, Republic of China

    Yu-Shian Lian

  3. Department of Mechanical Engineering, National Chiao-Tung University, 1001 University Road, Hsinchu, Taiwan, 300, Republic of China

    Wei-Po Nien & Wei-Hua Chieng

Authors
  1. Chih-Fang Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yu-Shian Lian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wei-Po Nien
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wei-Hua Chieng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chih-Fang Huang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, CF., Lian, YS., Nien, WP. et al. Analyzing the perception of Chinese melodic imagery and its application to automated composition. Multimed Tools Appl 75, 7631–7654 (2016). https://doi.org/10.1007/s11042-015-2686-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2686-2

Keywords

Search

Navigation