Abstract
Today’s technology makes it possible to easily access huge amounts of complex data. As a consequence, techniques are needed for accessing the semantics of such data and supporting the user in selecting relevant information. While meta-languages such as XML have been proposed, they are not suitable for complex data such as images, video, sounds or any other non-verbal channel of communication, because those data have very subjective semantics, i.e., whose interpretation varies over time and between subjects. Yet, providing access to subjective semantics is becoming critical with the significant increase in interactive systems such as web-based systems or socially interactive robots. In this work, we attempt to identify the requirements for providing access to the subjective semantics of complex data. In particular, we focus on how to support the analysis of those dimensions that give rise to multiple subjective interpretations of the data. We propose a data warehouse as a support for the mining process involved. A unique characteristic of the data warehouse lays in its ability to store multiple hierarchical descriptions of the multimedia data.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ekman, P.: An Argument for Basic Emotions. Cognition and Emotion 6(3/4), 169–200 (1992)
von Laban, R.: The mastery of movement, Princeton (1988)
Arijon, D.: Grammar of the film language. Silman James (1991)
Bianchi, N., Bottoni, P., Mussio, P., Rezzonico, G., Strepparava, M.G.: Participatory Interface Design: From Naive Models to Systems. In: International Conference on Human Computer Interaction (1997)
Ekman, P., Friesen, W.V.: Facial Action Coding System. Consulting Psychologists Press, Palo Alto (1976)
Schiphorst, T., Fels, S.: Affect Space: Semantics of Caress. In: Communication of Art, Science, Technology (CAST 2001), pp. 285–287 (2001)
Canamero, L.D., Fredslund, J.: I Show You How I Like You: Human-Robot Interaction through Emotional Expression and Tactile Stimulation. Dept. of Computer Science Technical Report DAIMI PB 544, University of Aarhus, Denmark (2000)
Breazeal, C.: Early Experiments using Motivations to Regulate Human-Robot Interaction. In: Canamero, D. (ed.) Emotional and Intelligent: The Tangled Knot of Cognition. Papers from the 1998 AAAI Fall Symposium (1998); AAAI Technical Report FS-98-03. AAAI Press, Menlo Park (1998)
Tojo, T., Matsusaka, Y., Ishi, T., Kobayashi, T.: A Conversational Robot Using Facial and Body Expressions. In: Proceedings of IEEE International Conference of Systems, Man and Cybernetics, pp. 858–863 (2000)
Camurri, A., Hashimoto, S., Ricchetti, M., Ricci, A., Suzuki, K., Trocca, R., Volpe, G.: EyesWeb – Toward Gesture and Affect Recognition in Dance/Music Interactive Systems. Computer Music Journal 24(1), 57–69 (2000)
Picard, R.W.: Affective Computing, MIT Press, Cambridge (1997)
(2001), http://www.cardesignnews.com/autoshows/2001/tokyo/preview/toyota-pod/
Inder, R., Bianchi-Berthouze, N., Kato, T.: K-DIME: A Software Framework for Kansei Filtering of Internet Material. In: Proceedings of IEEE International Conference on Systems, Man and Cybernetics, vol. 6, Tokyo, Japan, pp. 241–246 (1999)
Yoshida, K., Kato, T., Yanoru, T.: A Study of Database Systems with Kansei Information. In: IEEE International Conference on Systems Man and Cybernetics 1999, vol. 6, Tokyo, Japan, pp. 253–256 (1999)
Hattori, R., Fujiyoshi, M., Iida, M.: An Education System on WWW for Study Color Impression of Art Paintings Applied NetCatalog. In: IEEE International Conference on Systems Man and Cybernetics 1999, vol. 6, Tokyo, Japan, pp. 218–223 (1999)
Dorai, C., Venkatesh, S. (eds.): Media Computing: Computational Aesthetics. Kluwer Academic Publishers, Dordrecht (2002)
Imai, T., Yamauchi, K., Ishi, N.: Color Coordination System on Case Based Reasoning System using Neural Networks. In: IEEE International Conference on Systems Man and Cybernetics 1999, vol. 6, Tokyo, Japan, pp. 224–229 (1999)
Lee, S., Harada, A.: A Design Approach by Objective and Subjective Evaluation of Kansei Information. In: Proceedings of International Workshop on Robot and Human Communication, pp. 327–332. IEEE Press, Hamamatsu (1998)
Shibata, T., Kato, T.: ”Kansei” Image Retrieval System for Street Landscape. Discrimination and Graphical Parameters based on correlation of Two Images. In: IEEE International Conference on Systems Man and Cybernetics 1999, vol. 6, Tokyo, Japan, pp. 247–252 (1999)
Pashler, H.: Attention and Visual Perception: Analyzing Divided Attention. International Journal of Visual Cognition 2, 71–100 (1996)
Bianchi-Berthouze, N., Lisetti, C.: Modeling Multimodal Expression of Users’ Affective Subjective Experience. International Journal on User Modeling and User- Adapted Interaction 12(1), 49–84 (2002)
Nakata, T.: Generation of whole-body expressive movement based on somatic theories. In: Proceedings of the second international workshop on Epigenetic Robotics, pp. 105–114 (2002)
Rui, Y., Huang, T.S., Ortega, M., Mehrotra, S.: Relevance Feedback: A power tool in interactive content-based image retrieval. IEEE Transaction on Circuits and Systems for Video Technology 8(5), 644–655 (1998)
Smeulders, A., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-Based Image Retrieval at the end of the early Years. IEEE Transaction on Pattern Analysis and Machine Intelligence 22(12), 10–12 (2000)
Bianchi-Berthouze, N.: Mining Multimedia Subjective Feedback. International Journal of Information Systems. Kluwer Academic Publishers (2002)
Jaimes, A., Chang, S.F.: A Conceptual Framework for Indexing Visual Information at Multiple Levels. In: Internet Imaging 2000, IS&T/SPIE. San Jose, CA (2000)
Timpf, S.: Abstraction, levels of detail, and hierarchies in map series. In: Freksa, C., Mark, D.M. (eds.) COSIT 1999. LNCS, vol. 1661, pp. 125–140. Springer, Heidelberg (1999)
Bianchi-Berthouze, N., Berthouze, L.: Exploring Kansei in Multimedia Information. International Journal on Kansei Engineering 2(1), 1–10 (2001)
Agrawal, R., Gerhrke, J., Gunopulos, D., Raghavan, P.: Automatic Subspace Clustering of High Dimensional Data for Data Mining Applications. In: Proceedings of ACM SIGMOD International Conference on Management of Data, Seattle, Washington (1998)
PostgreSQL (2003), http://www.postgresql.org/
Kobayashi, S.: Colorist: a practical handbook for personal and professional use. Kodansha Press (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bianchi-Berthouze, N., Hayashi, T. (2003). Subjective Interpretation of Complex Data: Requirements for Supporting Kansei Mining Process. In: Zaïane, O.R., Simoff, S.J., Djeraba, C. (eds) Mining Multimedia and Complex Data. PAKDD 2002. Lecture Notes in Computer Science(), vol 2797. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39666-6_1
Download citation
DOI: https://doi.org/10.1007/978-3-540-39666-6_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20305-6
Online ISBN: 978-3-540-39666-6
eBook Packages: Springer Book Archive