ABSTRACT
In this paper, we propose the emotion-based Impressionism slideshow system with automatic music accompaniment. While conventional image slideshow systems accompany images with music manually, our proposed approach explores the affective content of painting to automatically recommend music based on emotions. This is achieved by association discovery between painting features and emotions, and between emotions and music features respectively. To generate more harmonic Impressionism presentation, a linear arrangement method is proposed based on modified traveling salesman algorithm. Moreover, some animation effects and synchronization issues for affective content of Impressionism fine arts are considered. Experimental result shows our emotion-based accompaniment brings better browsing experience of aesthetics.
- Chen, J. C., Chu, W. T., Kuo, J. H., Weng, C. Y. and Wu, J. L. Tiling Slideshow. In Proc. of ACM Intl. Conference on Multimedia (MM'06), 2006. Google ScholarDigital Library
- Cutzu, F., Hammoud, R. and Leykin, A. Estimating the Photorealism of Images: Distinguishing Paintings from Photographs. In Proc. of IEEE Intl. Conference on Computer Vision and Pattern Recognition (CVPR'03), 2003.Google ScholarCross Ref
- Hua, X. S., Lu, L. and Zhang H. J. Content Based Photograph Slide Show with Incidental Music. In Proc. of Intl. Symposium on Circuits and Systems (ISCAS'03), 2003.Google Scholar
- Hua, X. S., Lu, L. and Zhang H. J. Photo2Video - A System for Automatically Converting Photographic Series into Video. In Proc. of ACM Intl. Conference on Multimedia (MM'04), 2004. Google ScholarDigital Library
- Kuo, F. F., Chiang, M. F., Shan, M. K. and Lee, S. Y. Emotion-based Music Recommendation by Association Discovery from Film Music, In Proc. of ACM Intl. Conference on Multimedia (MM'05), 2005. Google ScholarDigital Library
- Pan, J. Y., Yang, H. J., Faloutsos, C. and Duygulu, P. Automatic Multimedia Cross-modal Correlation Discovery. In Proc. of Intl. Conference on Knowledge Discovery and Data Mining (KDD'04), 2004. Google ScholarDigital Library
- Rubner, Y., Tomasi, C. and Guibas L. The Earth Mover's Distance as a Metric for Image Retrieval. Intl. Journal of Computer Vision, 40(2), 2000. Google ScholarDigital Library
- Sudipto, G., Rajeev, R., and Kyuseok, S. ROCK: A Robust Clustering Algorithm for Categorical Attributes. Information Systems, 25(5), 2000. Google ScholarDigital Library
Index Terms
- Emotion-based impressionism slideshow with automatic music accompaniment
Recommendations
Emotion-based music recommendation by association discovery from film music
MULTIMEDIA '05: Proceedings of the 13th annual ACM international conference on MultimediaWith the growth of digital music, the development of music recommendation is helpful for users. The existing recommendation approaches are based on the users' preference on music. However, sometimes, recommending music according to the emotion is ...
A Synaesthetic Approach for Image Slideshow Generation
ICME '12: Proceedings of the 2012 IEEE International Conference on Multimedia and ExpoIn this paper, we present a novel automatic image slideshow system that explores a new medium between images and music. It can be regarded as a new image selection and slideshow composition criterion. Based on the idea of ``hearing colors, seeing sounds"...
Generation of Affective Accompaniment in Accordance With Emotion Flow
The emotion expressed by a music piece varies as the music unrolls in time. To create such dynamic expression, we develop an algorithm that automatically generates the accompaniment for a melody according to the emotion flow specified by a user. The ...
Comments