Abstract
When searching images on the web, users are often confronted with irrelevant results due to ambiguous queries. Consider a search term like ’Bill’: Results will probably consist of multiple images depicting Bill Clinton, Bill Cosby and money bills. Given that the user is only interested in pictures of money bills, most of the results are irrelevant. We built a demo application that exploits EEG and eye-tracking data for the disambiguation of one of two possible interpretations of an ambiguous search term. The demo exhibits the integration of sensor input into a modern web application.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Blankertz, B., Lemm, S., Treder, M., Haufe, S., Mller, K.-R.: Single-trial analysis and classification of ERP components a tutorial. NeuroImage 56, 814–825 (2011)
Friedman, J.H.: Regularized discriminant analysis. J. Amer. Statist. Assoc. 84, 165–175 (1989)
Gerson, A.D., Parra, L.D., Sajda, P.: Cortically Coupled Computer-Vision for Rapid Image Search. Neural Systems and Rehabilitation Engineering 14, 174–179 (2006)
Ledoit, O., Wolf, M.: A well-conditioned estimator for large-dimensional covariance matrices. J. of Multivariate Analysis 88, 365–411 (2004)
Hardoon, D.R., Pasupa, K.: Image ranking with implicit feedback from eye movements. In: Proceedings of the 6th Biennial Symposium on Eye Tracking Research & Applications (ETRA), pp. 291–298. ACM, New York (2010)
Hajimirza, S.N., Proulx, M.J., Izquierdo, E.: Reading users’ minds from their eyes: a method for implicit image annotation. IEEE Transactions on Multimedia, 805–815 (2012). IEEE press, New York
Ušćumlić, M., Chavarriaga, R., Milln, J.R.: An Iterative Framework for EEG-based Image Search: Robust Retrieval with Weak Classifiers. PLoS ONE 8, e72018 (2013)
Kauppi, J.-P., Kandemir, M., Saarinen, V.-M., Hirvenkari, L., Parkkonen, L., Klami, A., Hari, R., Kaski, S.: Towards brain-activity-controlled information retrieval: Decoding image relevance from MEG signals. NeuroImage 112, 288–298 (2015)
Jangraw, D.C., Wang, J., Lance, B.J., Chang, S.-F., Sajda, P.: Neurally and ocularly informed graph-based models for searching 3D environments. J. of Neural Engineering 11, 046003 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Golenia, JE., Wenzel, M., Blankertz, B. (2015). Live Demonstrator of EEG and Eye-Tracking Input for Disambiguation of Image Search Results. In: Blankertz, B., Jacucci, G., Gamberini, L., Spagnolli, A., Freeman, J. (eds) Symbiotic Interaction. Symbiotic 2015. Lecture Notes in Computer Science(), vol 9359. Springer, Cham. https://doi.org/10.1007/978-3-319-24917-9_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-24917-9_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24916-2
Online ISBN: 978-3-319-24917-9
eBook Packages: Computer ScienceComputer Science (R0)