Authors:
Januka Dharmapriya
1
;
Lahiru Dayarathne
1
;
Tikiri Diasena
1
;
Shiromi Arunathilake
1
;
Nihal Kodikara
1
and
Primal Wijesekera
2
Affiliations:
1
University of Colombo School of Computing, Colombo 07, Sri Lanka
;
2
University of California, Berkeley, U.S.A.
Keyword(s):
Emotion Recognition, Fractal Art, Information Processing, Music Emotion, Music Information Retrieval, Music Visualization, Random Forest Regression.
Abstract:
Emotion based music visualization is an emerging multidisciplinary research concept. Fractal arts are generated by executing mathematical instructions through computer programs. Therefore in this research, several multidisciplinary concepts, various subject areas are considered and combined to generate artistic but computationally created visualizations. The main purpose of this research is to obtain the most suitable emotional fractal art visualization for a given song segment and evaluate the entertainment value generated through the above approach. Due to the novice nature of previous findings, limited availability of emotionally annotated musical databases and fractal art music visualizing tools, obtaining accurate emotional visualization using fractal arts is a computationally challenging task. In this study, Russell’s Circumplex Emotional Model was used to obtain emotional categories. Emotions were predicted using machine learning models trained with MediaEval Database for Emot
ional Analysis of Music. A regression approach was used with the WEKA machine learning tool for emotion prediction. Effectiveness of the results compared with several regression models available in WEKA. According to the above comparison, the random forest regression approach provided the most reliable results compared to other models (accuracy of 81% for arousal and 61% for valence). Relevant colour for the emotion was obtained using Itten’s circular colour model and it was mapped with a fractal art generated using the JWildfire Fractal Art Generating tool. Then fractal art was animated according to the song variations. After adding enhanced features to the above approach, the evaluation was conducted considering 151 participants. Final Evaluation unveiled that Emotion Based Music Visualizations with Fractal Arts can be used to visualize songs considering emotions and most of the visualizations can exceed the entertainment value generated by currently available music visualization patterns.
(More)