Abstract
In processing multimedia technologies or decision-making in visual cognition systems, combination by both simple average and weighted average are used. In this paper, we extend each visual cognition system to a scoring system using Combinatorial Fusion Analysis (CFA). We investigate the performance of the combined system in terms of individual system’s performance and confidence. Twelve experiments are conducted and our main results are: (a) The combined systems perform better only if the two individual systems are relatively good, and (b) overall, rank combination is better than score combination. In addition, we compare the three types of averages: simple average M1, weighted average M2 using σ, and weighted average M3 using σ 2, where σ is related to confidence of each system. Our results exhibit a novel way to better make joint decisions in visual cognition using Combinatorial Fusion.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bahrami, B., Olsen, K., Latham, P., Roepstroff, A., Rees, G., Frith, C.: Optimally interacting minds. Science 329(5995), 1081–1085 (2010)
Ernst, M.O., Banks, M.S.: Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429–433 (2002)
Ernst, M.O.: Learning to integrate arbitrary signals from vision and touch. Journal of Vision 7(5), 7, 1–14 (2007)
Ernst, M.O.: Decisions made better. Science 330(6010), 1477 (2010)
Gepshtein, S., Burge, J., Ernst, O., Banks, S.: The combination of vision and touch depends on spatial proximity. J. Vis. 5(11), 1013–1023 (2009)
Gold, J.I., Shadlen, N.: The neural basis of decision making. Annual Review of Neuroscience 30, 535–574 (2007)
Hillis, J.M., Ernst, M.O., Banks, M.S., Landy, M.S.: Combining sensory information: mandatory fusion within, but not between, senses. Science 298(5598), 1627–1630 (2002)
Hsu, D.F., Taksa, I.: Comparing rank and score combination methods for data fusion in information retrieval. Information Retrieval 8(3), 449–480 (2005)
Hsu, D.F., Chung, Y.S., Kristal, B.S.: Combinatorial Fusion Analysis: methods and practice of combining multiple scoring systems. In: Hsu, H.H. (ed.) Advanced Data Mining Technologies in Bioinformatics. Idea Group Inc. (2006)
Hsu, D.F., Kristal, B.S., Schweikert, C.: Rank-Score Characteristics (RSC) function and cognitive diversity. Brain Informatics, 42–54 (2010)
Kepecs, A., Uchida, N., Zariwala, H., Mainen, Z.: Neural correlates, computation and behavioural impact of decision confidence. Nature 455, 227–231 (2008)
Lin, K.-L., Lin, C.-Y., Huang, C.-D., Chang, H.-M., Yang, C.-Y., Lin, C.-T., Tang, C.Y., Hsu, D.F.: Feature selection and combination criteria for improving accuracy in protein structure prediction. IEEE Transactions on NanoBioscience 6(2), 186–196 (2007)
Lunghi, C., Binda, P., Morrone, C.: Touch disambiguates rivalrous perception at early stages of visual analysis. Current Biology 20(4), R143–R144 (2010)
Lyons, D.M., Hsu, D.F.: Combining multiple scoring systems for target tracking using rank–score characteristics. Information Fusion 10(2), 124–136 (2009)
McMunn-Coffran, C., Paolercio, E., Liu, H., Tsai, R., Hsu, D.F.: Joint decision making in visual cognition using Combinatorial Fusion Analysis. In: Conference Proceedings of the IEEE International Conference on Cognitive Informatics and Cognitive Computing, pp. 254–261 (August 2011)
McMunn-Coffran, C., Paolercio, E., Fei, Y., Hsu, D.F.: Combining visual cognition systems for joint decision making using Combinatorial Fusion. In: Proceedings of the 11th IEEE International Conference on Cognition Informatics and Cognition Computing, pp. 313–322 (2012)
Ng, K.B., Kantor, P.B.: Predicting the effectiveness of naive data fusion on the basis of system characteristics. J. Am. Soc. Inform. Sci. 51(12), 1177–1189 (2000)
Tong, F., Meng, M., Blake, R.: Neural basis of binocular rivalry. Trends in Cognitive Sciences 10(11), 502–511 (2006)
Yang, J.M., Chen, Y.F., Shen, T.W., Kristal, B.S., Hsu, D.F.: Consensus scoring for improving enrichment in virtual screening. Journal of Chemical Information and Modeling 45, 1134–1146 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Batallones, A., McMunn-Coffran, C., Sanchez, K., Mott, B., Hsu, D.F. (2012). Comparative Study of Joint Decision-Making on Two Visual Cognition Systems Using Combinatorial Fusion. In: Huang, R., Ghorbani, A.A., Pasi, G., Yamaguchi, T., Yen, N.Y., Jin, B. (eds) Active Media Technology. AMT 2012. Lecture Notes in Computer Science, vol 7669. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35236-2_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-35236-2_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35235-5
Online ISBN: 978-3-642-35236-2
eBook Packages: Computer ScienceComputer Science (R0)