Abstract
Given its complexity, understanding the behavior of users on the Web has been one of the most challenging tasks for data mining-related fields. Historically, most of the approaches have considered web logs as the main source of data. This has led to several successful cases, both in industry and academia, but has also presented several issues and limitations. Given the new challenges and the need for personalization, improvement is required in the overall understanding of the processes that lie behind web browsing decision making. The use of neurodata to support this analysis represents a huge opportunity in terms of understanding the actions taken by the user on the web in a more comprehensive way. Techniques such as eye tracking, pupil dilation and EEG analysis could provide valuable information to craft more robust models. This chapter overviews the current state of the art of the use of neurodata for web-based analysis, providing a description and analysis in terms of the feasibility and effectiveness of each strategy given a specific problem.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
E.W. Anderson, K.C. Potter, L.E. Matzen, J.F. Shepherd, G. Preston, C.T. Silva. A user study of visualization effectiveness using eeg and cognitive load, in Computer Graphics Forum, vol. 30 (Wiley Online Library, 2011), pp. 791–800
J.R. Anderson, R.S. Michalski, R.S. Michalski, T.M. Mitchell, et al. Machine Learning: An Artificial Intelligence Approach, vol. 2 (Morgan Kaufmann, 1986)
T. Arce, P.E. Román, J. Velásquez, V. Parada, Identifying web sessions with simulated annealing. Expert Syst. Appl. 41(4, Part 2), 1593–1600 (2014)
T. Baccino, Eye Movements and Concurrent Event-Related Potentials: Eye Fixation-Related Potential Investigations in Reading (Oxford University Press, New York, NY, USA, 2011)
T. Baccino, V. Drai-Zerbib, A new cognitive engineering technique: eye-fixation-related potentials, in The 5th PSU-UNS International Conference on Engineering and Technology (ICET-2011) (2011)
R. Baeza-Yates, C. Castillo, E.N. Efthimiadis, Characterization of national web domains. ACM Trans. Internet Technol. (TOIT) 7(2), 9 (2007)
Y. Bengio, Learning deep architectures for ai. Found. Trends Mach. Learn. 2(1), 1–127 (2009)
Y. Bengio, A. Courville, P. Vincent, Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013)
Y. Bengio, Y. LeCun, et al. Scaling learning algorithms towards ai. Large-scale Kernel Mach. 34(5) (2007)
J.M. Benítez, J.L. Castro, I. Requena, Are artificial neural networks black boxes? IEEE Trans. Neural Netw. 8(5), 1156–1164 (1997)
M. Bensch, A.A. Karim, J. Mellinger, T. Hinterberger, M. Tangermann, M. Bogdan, W. Rosenstiel, N. Birbaumer, Nessi: an eeg-controlled web browser for severely paralyzed patients. Comput. Intell. Neurosci. (2007)
B. Berendt, B. Mobasher, M. Nakagawa, M. Spiliopoulou. The impact of site structure and user environment on session reconstruction in web usage analysis, in WEBKDD 2002—Mining Web Data for Discovering Usage Patterns and Profiles (Springer, 2003), pp. 159–179
H. Berger, Uber das Elektrenkephalogramm des Menschen. Archiv fur Psychiatrie und Nervenkrankheiten 17(6–7), 777–789 (2009). Aug
T. Berners-Lee, J. Hendler, O. Lassila et al., The semantic web. Sci. Am. 284(5), 28–37 (2001)
G. Boening, K. Bartl, T. Dera, S. Bardins, E. Schneider, T. Brandt. Mobile eye tracking as a basis for real-time control of a gaze driven head-mounted video camera, in Proceedings of the 2006 Symposium on Eye Tracking Research & Applications (ACM, 2006), p. 56
A.M. Brouwer, B. Reuderink, J. Vincent, M.A. van Gerven, J.B. van Erp, Distinguishing between target and nontarget fixations in a visual search task using fixation-related potentials. J Vis 13(3), 17 (2013)
G. Buscher, E. Cutrell, M.R. Morris, What do you see when you’re surfing?: Using eye tracking to predict salient regions of web pages, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI’09, New York, NY, USA (ACM, 2009), pp. 21–30
G. Buscher, A. Dengel, R. Biedert, L.V. Elst, Attentive documents: eye tracking as implicit feedback for information retrieval and beyond. ACM Trans. Interact. Intell. Syst. 1(2), 9:1–9:30 (2012)
G. Buscher, S.T. Dumais, E. Cutrell, The good, the bad, and the random: an eye-tracking study of ad quality in web search, in Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR’10, New York, NY, USA (ACM, 2010), pp. 42–49
G.T. Buswell, How People Look at Pictures: A Study of the Psychology of Perception in Art (University of Chicago Press, Chicago, USA, 1935)
G. Buzsaki, Rhythms of the Brain (Oxford University Press, New York, NY, USA, 2006)
G. Buzsaki, A. Draguhn, Neuronal oscillations in cortical networks. Science 304(5679), 1926–1929 (2004)
M.C. Chen, J.R. Anderson, M.H. Sohn. What can a mouse cursor tell us more?: correlation of eye/mouse movements on web browsing, in CHI’01 extended abstracts on Human factors in computing systems (ACM, 2001), pp. 281–282
M. Corbetta, G.L. Shulman, Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3(3), 201–215 (2002)
R.F. Dell, P.E. Román, J.D. Velásquez. Web user session reconstruction using integer programming, in IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, 2008. WI-IAT’08, vol. 1 (IEEE, 2008), pp. 385–388
H. Deubel, W.X. Schneider, Saccade target selection and object recognition: evidence for a common attentional mechanism. Vis. Res. 36(12), 1827–1837 (1996)
D.T. Duchowski, Eye Tracking Methodology (Springer, London, UK, 2006)
D. Easley, J. Kleinberg, Networks, Crowds, and Markets, vol. 8 (Cambridge Univ Press, 2010)
K.A. Ehinger, B. Hidalgo-Sotelo, A. Torralba, A. Oliva, Modeling search for people in 900 scenes: a combined source model of eye guidance. Vis. Cogn. 17(6–7), 945–978 (2009)
T. Foulsham, G. Underwood, What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. J. Vis. 8(2), 1–17 (2008)
A. Frey, G. Ionescu, B. Lemaire, F. Lopez-Orozco, T. Baccino, A. Guerin-Dugue, Decision-making in information seeking on texts: an eye-fixation-related potentials investigation. Front Syst. Neurosci. 7, 39 (2013)
Q. Guo, E. Agichtein, Towards predicting web searcher gaze position from mouse movements, in CHI’10 Extended Abstracts on Human Factors in Computing Systems (ACM, 2010)
G. Healy, A.F. Smeaton, Eye fixation related potentials in a target search task. Conf. Proc. IEEE Eng. Med. Biol. Soc. 4203–4206 (2011)
D.A. Hensher, Atribute Processing, Heuristics, and Preference Construction in Choice Analysis (Bingley, Emerald, UK, 2010)
S.A. Hillyard, E.K. Vogel, S.J. Luck, Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. Philos. Trans. R. Soc. Lond., B, Biol. Sci. 353(1373), 1257–1270 (1998)
J.E. Hoffman, B. Subramaniam, The role of visual attention in saccadic eye movements. Percept. Psychophys. 57(6), 787–795 (1995)
J. Huang, R. White, G. Buscher, User see, user point: gaze and cursor alignment in web search, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI’12, New York, NY, USA (ACM, 2012), pp. 1341–1350
J. Huang, R.W. White, G.Buscher, K. Wang, Improving searcher models using mouse cursor activity, in Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR’12, New York, NY, USA (ACM, 2012), pp. 195–204
G. Iachello, J. Hong, End-user privacy in human-computer interaction. Found. Trends Human-Comput. Interact. 1(1), 1–137 (2007)
N. Indurkhya, F.J. Damerau, Handbook of Natural Language Processing, vol. 2 (CRC Press, 2010)
P.G. Ipeirotis, L. Gravano, When one sample is not enough: improving text database selection using shrinkage, in Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data (ACM, 2004), pp. 767–778
D.E. Irwin, Visual Memory Within and Across Fixations (Springer, New York, NY, USA, 1992)
L. Itti, C. Koch, A saliency-based search mechanism for overt and covert shifts of visual attention. Vis. Res. 40(10–12), 1489–1506 (2000)
W. James, The Principles of Psychology, vol. I (Harvard University Press, Cambridge, MA, USA, 1981)
S. Janzen, W. Maass, Ontology-based natural language processing for in-store shopping situations, in IEEE International Conference on Semantic Computing, 2009, ICSC’09 (IEEE, 2009), pp. 361–366
J.E. Kamienkowski, M.J. Ison, R.Q. Quiroga, M. Sigman, Fixation-related potentials in visual search: a combined EEG and eye tracking study. J. Vis. 12(7), 4 (2012)
E. Kowler, Eye movements: the past 25 years. Vis. Res. 51(13), 1457–1483 (2011)
E. Kowler, E. Anderson, B. Dosher, E. Blaser, The role of attention in the programming of saccades. Vis. Res. 35(13), 1897–1916 (1995)
I. Krajbich, C. Armel, A. Rangel, Visual fixations and the computation and comparison of value in simple choice. Nat. Neurosci. 13(10), 1292–1298 (2010)
V.V. Kryssanov, K. Kakusho, E.L. Kuleshov, M. Minoh, Modeling hypermedia-based communication. Inf. Sci. 174(1), 37–53 (2005)
M. Kudelka, V. Snasel, Z. Horak, A. Ella Hassanien, A. Abraham, J.D. Velásquez, A novel approach for comparing web sites by using microgenres. Eng. Appl. Artif. Intell. 35, 187–198 (2014)
Y. Lee, Handwritten digit recognition using k nearest-neighbor, radial-basis function, and backpropagation neural networks. Neural Comput. 3(3), 440–449 (1991)
P. Loyola, G. Martínez, K. Muñoz, J.D. Velásquez, P. Maldonado, A. Couve, Combining eye tracking and pupillary dilation analysis to identify website key objects. Neurocomputing 168, 179–189 (2015)
P. Loyola, J.D. Velásquez, Characterizing web user visual gaze patterns: A graph theory inspired approach, in Brain Informatics and Health (Springer International Publishing, 2014), pp. 586–594
S.J. Luck, An Introduction to the Event-Related Potential Technique (MIT Press, Cambridge, MA, USA, 2005)
S.J. Luck, S.A. Hillyard, Electrophysiological correlates of feature analysis during visual search. Psychophysiology 31(3), 291–308 (1994)
S.J. Luck, S.A. Hillyard, Spatial filtering during visual search: evidence from human electrophysiology. J. Exp. Psychol. Hum. Percept. Perform. 20(5), 1000–1014 (1994)
H. B. McMahan, G. Holt, D. Sculley, M. Young, D. Ebner, J. Grady, L. Nie, T. Phillips, E. Davydov, D. Golovin, S. Chikkerur, D. Liu, M. Wattenberg, A.M. Hrafnkelsson, T. Boulos, J. Kubica, Ad click prediction: a view from the trenches, in Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD’13, New York, NY, USA (ACM, 2013), pp. 1222–1230
M. Moloney, F. Bannister, A privacy control theory for online environments, in 42nd Hawaii International Conference on System Sciences, 2009. HICSS’09 (IEEE, 2009), pp. 1–10
K.P. Murphy, Machine Learning: A Probabilistic Perspective (The MIT Press, 2012)
V. Navalpakkam, L. Jentzsch, R. Sayres, S. Ravi, A. Ahmed, A. Smola, Measurement and modeling of eye-mouse behavior in the presence of nonlinear page layouts, in Proceedings of the 22nd International Conference on World Wide Web, WWW’13, Republic and Canton of Geneva, Switzerland (International World Wide Web Conferences Steering Committee, 2013), pp. 953–964
A.R. Nikolaev, C. Nakatani, G. Plomp, P. Jurica, C. van Leeuwen, Eye fixation-related potentials in free viewing identify encoding failures in change detection. Neuroimage 56, 1598–1607 (2011)
P. Nunez, R. Srinivasan, Electric Fields of the Brain (Oxford University Press, New York, NY, USA, 2006)
H. Obendorf, H. Weinreich, E. Herder, M. Mayer, Web page revisitation revisited: implications of a long-term click-stream study of browser usage, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM, 2007), pp. 597–606
T. Ohno, Eyeprint: support of document browsing with eye gaze trace, in Proceedings of the 6th International Conference on Multimodal Interfaces (ACM, 2004), pp. 16–23
J.L. Orquin, S. Mueller Loose, Attention and choice: a review on eye movements in decision making. Acta. Psychol. (Amst) 144(1), 190–206 (2013)
S.K. Pal, V. Talwar, P. Mitra, Web mining in soft computing framework: relevance, state of the art and future directions. IEEE Trans. Neural Netw. 13(5), 1163–1177 (2002)
B. Pang, L. Lee, Opinion mining and sentiment analysis. Foundations and trends in information retrieval 2(1–2), 1–135 (2008)
D. Parkhurst, K. Law, E. Niebur, Modeling the role of salience in the allocation of overt visual attention. Vis. Res. 42(1), 107–123 (2002)
R. Peña-Ortiz, J. Sahuquillo, A. Pont, J.A. Gil, Dweb model: representing web 2.0 dynamism. Comput. Commun. 32(6), 1118–1128 (2009)
M. Perkowitz, O. Etzioni, Towards adaptive web sites: conceptual framework and case study. Artif. intell. 118(1), 245–275 (2000)
T.W. Picton, S. Bentin, P. Berg, E. Donchin, S.A. Hillyard, R. Johnson, G.A. Miller, W. Ritter, D.S. Ruchkin, M.D. Rugg, M.J. Taylor, Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria. Psychophysiology 37(2), 127–152 (2000)
M.I. Posner, C.R. Snyder, B.J. Davidson, Attention and the detection of signals. J. Exp. Psychol. 109(2), 160–174 (1980)
D. Quah. Digital Goods and the New Economy (LSE Economics Department, 2002)
A. Rajaraman, J.D. Ullman, Mining of Massive Datasets (Cambridge University Press, New York, NY, USA, 2011)
P. Rama, T. Baccino, Eye fixationrelated potentials (EFRPs) during object identification. Vis. Neurosci. 27, 187–192 (2010)
K. Rayner, G.W. McConkie, S. Ehrlich, Eye movements and integrating information across fixations. J. Exp. Psychol. Hum. Percept. Perform. 4(4), 529–544 (1978)
P.E. Román, J.D. Velásquez, Cognitive science forweb usage analysis, in Advanced Techniques in Web Intelligence-2 (Springer Berlin Heidelberg, 2013), pp. 35–73
P.E. Román, J.D. Velásquez, A web browsing cognitive model, in Knowledge Engineering, Machine Learning and Lattice Computing with Applications (Springer, Berlin Heidelberg, 2013), pp. 31–40
P.E. Román, J.D. Velásquez, A neurology-inspired model of web usage. Neurocomputing 131, 300–311 (2014)
U. Rutishauser, C. Koch, Probabilistic modeling of eye movement data during conjunction search via feature-based attention. J. Vis. 7(6), 5 (2007)
M. Shepherd, J.M. Findlay, R.J. Hockey, The relationship between eye movements and spatial attention. Q. J. Exp. Psychol. A 38(3), 475–491 (1986)
M. Spaniol, D. Denev, A. Mazeika, G. Weikum, P. Senellart, Data quality in web archiving, in Proceedings of the 3rd Workshop on Information Credibility on the Web (ACM, 2009), pp. 19–26
J. Srivastava, R. Cooley, M. Deshpande, P.-N. Tan, Web usage mining: Discovery and applications of usage patterns from web data. ACM SIGKDD Explorations Newsletter 1(2), 12–23 (2000)
G. Takács, I. Pilászy, B. Németh, D. Tikk, Major components of the gravity recommendation system. ACM SIGKDD Explor. Newsl. 9(2), 80–83 (2007)
Y. Takeda, M. Sugai, A. Yagi, Eye fixation related potentials in a proof reading task. Int. J. Psychophysiol. 40, 181–186 (2001)
Y.-H. Tao, T.-P. Hong, W.-Y. Lin, W.-Y. Chiu, A practical extension of web usage mining with intentional browsing data toward usage. Expert Syst. Appl. 36(2), 3937–3945 (2009)
B.W. Tatler, Current understanding of eye guidance. Vis. Cogn. 17(6–7), 777–789 (2009)
B.W. Tatler, M.M. Hayhoe, M.F. Land, D.H. Ballard, Eye guidance in natural vision: reinterpreting salience. J. Vis. 11(5), 5 (2011)
A. Torralba, A. Oliva, M.S. Castelhano, J.M. Henderson, Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychol. Rev. 113(4), 766–786 (2006)
J.D. Velásquez, Web site keywords: a methodology for improving gradually the web site text content. Intell. Data Anal. 16(2), 327–348 (2012)
J.D. Velásquez, Combining eye-tracking technologies with web usage mining for identifying website keyobjects. Eng. Appl. Artif. Intell. 26(56), 1469–1478 (2013)
J.D. Velásquez, Web mining and privacy concerns: some important legal issues to be consider before applying any data and information extraction technique in web-based environments. Expert Syst. Appl. 40(13), 5228–5239 (2013)
J.D. Velásquez, L.E. Dujovne, G. L’Huillier, Extracting significant website key objects: a semantic web mining approach. Eng. Appl. Artif. Intell. 24(8), 1532–1541 (2011)
J.D. Velásquez, V. Palade, Adaptive web sitesa knowledge extraction from web data approach, in Proceedings of the 2008 Conference on Adaptive Web Sites: A Knowledge Extraction from Web Data Approach (Ios Press, 2008), pp. 1–272
E.K. Vogel, S.J. Luck, The visual N1 component as an index of a discrimination process. Psychophysiology 37(2), 190–203 (2000)
R.W. White, S.M. Drucker, Investigating behavioral variability in web search, in Proceedings of the 16th International Conference on World Wide Web (ACM, 2007), pp. 21–30
M. Wischnewski, A. Belardinelli, W. Schneider, J. Steil, Where to look next? Combining static and dynamic proto-objects in a TVA-based model of visual attention. Cogn. Comput. 2(4), 326–343 (2010)
S.S. Won, J. Jin, J.I. Hong, Contextual web history: using visual and contextual cues to improve web browser history, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM, 2009), pp. 1457–1466
S. Xu, H. Jiang, F. Lau. User-oriented document summarization through vision-based eye-tracking, in Proceedings of the 14th International Conference on Intelligent User Interfaces (ACM, 2009), pp. 7–16
A.L. Yarbus, Eye Movements and Vision (Plenum Press, New York, NY, USA, 1967)
N. Zhong, Impending brain informatics research from web intelligence perspective. Int. J. Inf. Technol. Decis. Mak. 5(04), 713–727 (2006)
Y. Zhou, H. Leung, P. Winoto, Mnav: a markov model-based web site navigability measure. IEEE Trans. Softw. Eng. 33(12), 869–890 (2007)
Acknowledgments
The authors would like to acknowledge the continuous support of the Chilean Millennium Institute of Complex Engineering Systems (ICM: P-05-004-F, CONICYT: FBO16), the Fondecyt Project 1160117, and the FONDEF-CONICYT CA12I10061 - AKORI project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Loyola, P., Brunetti, E., Martinez, G., Velásquez, J.D., Maldonado, P. (2016). Leveraging Neurodata to Support Web User Behavior Analysis. In: Zhong, N., Ma, J., Liu, J., Huang, R., Tao, X. (eds) Wisdom Web of Things. Web Information Systems Engineering and Internet Technologies Book Series. Springer, Cham. https://doi.org/10.1007/978-3-319-44198-6_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-44198-6_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-44196-2
Online ISBN: 978-3-319-44198-6
eBook Packages: Computer ScienceComputer Science (R0)