Abstract
This article analyses three aspects of human and robotic eyes: (1) the eye as an object that evokes visceral reactions from observers when it is exposed or threatened; (2) the eye and brain, sensor and computer as mediators of vision and interpreters of visual worlds; and (3) the gaze as a mode of communication in interpersonal/human–robot interaction. Taking an interdisciplinary approach, this article draws on neuroscience, human–robot interaction, critical humanities, feminism and film studies to interrogate these three aspects of eyes as they relate to the design, theorisation and experience of social robots. We argue that some of the meanings and imaginaries associated with biological eyes are transferred and translated into robotic eyes, vision and gaze, or eye machines, following the tendency towards anthropomorphism. These imaginaries are made visible particularly in science fiction. We argue that photography, the cinematic apparatus, digital sensors and artificial intelligence are not only engineering innovations but have also contributed to transformations in the contemporary collective visual world. Our multimethod cultural studies analysis of eye machines has relevance for cultural theorists, designers and engineers.
Similar content being viewed by others
References
Emery NJ (2000) The eyes have it: the neuroethology, function and evolution of social gaze. Neuroscience and Biobehavioral Reviews. Neurosci Biobehav Rev 24:581–604
Vacek S, Schimmel C, Dillmann R (2007) Road-marking analysis for autonomous vehicle guidance. Proc Eur Conf Mob Robot 1–6
Bertozzi M, Broggi A, Fasciol A, Nichele S (2000) Stereo Vision-based Vehicle Detection. IEEE Intelligent Vehicles Symposium. Dearbon, MI, pp 39–44
Aryananda L (2002) Recognizing and remembering individuals: Online and unsupervised face recognition for humanoid robot. IEEE Int Conf Intell Robot Syst 2:1202–1207. https://doi.org/10.1109/irds.2002.1043897
Bartlett MS, Littlewort G, Fasel I, Movellan JR (2003) Real time face detection and facial expression recognition: development and applications to human computer interaction. IEEE Comput Soc Conf Comput Vis Pattern Recognit Work. https://doi.org/10.1109/CVPRW.2003.10057
Foucault M (1977) Discipline and Punish. Vintage Books, New York
Shimada M, Yoshikawa Y, Asada M et al (2011) Effects of observing eye contact between a robot and another person. Int J Soc Robot 3:143–154. https://doi.org/10.1007/s12369-010-0072-9
Zwickel J, Müller HJ (2009) Eye movements as a means to evaluate and improve robots. Int J Soc Robot 1:357–366. https://doi.org/10.1007/s12369-009-0033-3
Lang C, Wachsmuth S, Hanheide M, Wersing H (2012) Facial communicative signals: valence recognition in task-oriented human-robot interaction. Int J Soc Robot 4:249–262. https://doi.org/10.1007/s12369-012-0145-z
Pugh A (1983) Robot vision. Springer, Berlin
Gunkel DJ (2016) Another alterity: Rethinking ethics in the face of the machine. In: Gunkel DJ, Marcondes Filho C, Mersch D (eds) The changing face of alterity: communication, technology and other subjects. IOS Press, Amsterdam, pp 197–218
Dinnen Z, McBean S (2018) The Face as Technology New Form 93:122–137. https://doi.org/10.3898/newf:93.07.2017
Chesher C, Andreallo F (2020) Robotic faciality: The philosophy, science and art of robot faces. Int J Soc Robot. https://doi.org/10.1007/s12369-020-00623-2
Rose G (2016) Visual methodologies. Sage, London
Jenks C (1995) Visual culture. Taylor & Francis, Abington
Lister M, Wells L (2004) Seeing beyond belief: Cultural Studies as an approach to analysing the visual. In: van Leeuwen T, Tewitt C (eds) The handbook of visual analysis. Sage, London, pp 61–91
Dixon W (1995) It looks at you: the returned gaze of cinema. State University of New York Press, Albany, NY
Gray A (2003) Research practice for cultural studies: Ethnographic methods and lived cultures. Sage, London
Kristeva J (1982) Powers of horror : an essay on abjection / Julia Kristeva
Heidegger M, Macquarrie J, Robinson E (1962) Being and time. Basil Blackwell, Oxford
Todo T (2018) SEER: Simulative Emotional Expression Robot. https://doi.org/https://doi.org/10.1145/3214907.3214921
Personal Robotics Group (2008) Official MDS Robot Video—First test of expressive ability. In: [YouTube video]. https://youtu.be/aQS2zxmrrrA
Softbank Robotics (2020) Humanoid and programmable robots
Hall ET (1982) The hidden dimension. Anchor, New York NY
Gibson JJ (1950) The perception of the visual world. Riverside Press, Cambridge MA
Aaland M (2007) Shooting digital: Pro tips for taking great pictures with your digital camera. Sybex, Indianapolis IN
Lehoux D (2007) Observers, objects, and the embedded eye; or, seeing and knowing in Ptolemy and Galen. Isis 98:447–467
Illich I (1995) The scopic past and the ethics of the gaze: A plea for the historical study of ocular perception. Work Pap No 6 Univ Park PA Sci Technol Soc Stud
Ruocco SR (1987) Robot sensors and transducers. Springer, Netherlands
Adams M (2012) Robotic navigation and mapping with radar. Artech House, Norwood
Tzafestas SG (2013) Introduction to mobile robot control. Elsevier, Saint Louis
Young A (2019) Retinal prosthetics: science fiction or a vision for the future? In: Eyenews
Hassaballah M, Awad AI (2020) Computer vision: Principles and applications. Taylor & Francis, Boca Raton
Dreyfus H (1995) What computers still can’t do. MIT Press, Cambridge
Raji ID, Gebru T, Mitchell M, et al (2020) Saving Face: Investigating the ethical concerns of facial recognition auditing. AIES 2020—Proc AAAI/ACM Conf AI, Ethics, Soc 145–151. https://doi.org/https://doi.org/10.1145/3375627.3375820
de Castro LN, Von Zuben FJ (2004) Recent developments in biologically inspired computing. Idea Group Publishing, Hershey PA
Haxby JV, Hoffman EA, Gobbini MI (2000) The distributed human neural system for face perception. Trends Cogn Sci 4223–233(4):223–233. https://doi.org/10.1016/S1364-6613(00)01482-0
Senju A, Vernetti A, Kikuchi Y et al (2013) Cultural background modulates how we look at other persons’ gaze. Int J Behav Dev 37:131–136. https://doi.org/10.1177/0165025412465360
Kovács ÁZ, Sári LB (2017) Space, gender, and the gaze in literature and art. Cambridge Scholars Publisher, Newcastle-upon-Tyne
Srinivasan V, Murphy RR, Bethel CL (2015) A reference architecture for social head gaze generation in social robotics. Int J Soc Robot 7:601–616. https://doi.org/10.1007/s12369-015-0315-x
Zheng M, AjJ M, Croft EA, Meng MQH (2015) Impacts of robot head gaze on robot-to-human handovers. Int J Soc Robot 7:783–798. https://doi.org/10.1007/s12369-015-0305-z
Duarte N, Raković M, Tasevski J et al (2018) Action anticipation: Reading the intentions of humans and robots. IEEE Robot Autom Lett 3:4132–4139
Billing E, Sciutti A, Sandini G (2019) Proactive eye-gaze in human-robot interaction. Anticipation and anticipatory systems: humans meet Artificial Intelligence. Örebro, Sweden, pp 10–13
Tamura Y, Akashi T, Yano S, Osumi H (2016) Human visual attention model based on analysis of magic for smooth human–robot interaction. Int J Soc Robot 8:685–694. https://doi.org/10.1007/s12369-016-0354-y
Mutlu B, Shiwa T, Kanda T, et al. (2009) Footing in human-robot conversations. 2009 4th ACM/IEEE Int Conf Human-Robot Interact 2:61. https://doi.org/https://doi.org/10.1145/1514095.1514109
Admoni H, Scassellati B (2017) Social Eye Gaze in Human-Robot Interaction: a review. J Human-Robot Interact 6:25. https://doi.org/10.5898/jhri.6.1.admoni
Sartre J-P (2011) Being and nothingness: An essay on phenomenological ontology
Eggers D (2013) The circle. Knopf, New York
Lacan J (1978) The four fundamental concepts of psychoanalysis. Norton & Co, New York
Mulvey L (1975) Visual pleasure and narrative cinema. Screen 16:6–18
Doane MA (1999) Film and the masquerade: Theorising the female spectator. In: Thornam S (ed) Feminist film theory: A reader. pp 132–145
Mulvey L Afterthoughts on “Visual pleasure and narrative cinema” inspired by ‘Duel in the Sun’ (King Vidor, 1946). Framework 0:12–15
Halberstam J (2005) In a queer time and place: transgender bodies, subcultural lives. New York University Press, New York and London
The Tonight Show Starring Jimmy Fallom (2017) Tonight Showbotics: Jimmy Meets Sophia the Human-Like Robot. In: [YouTube video]. https://youtu.be/Bg_tJvCA8zw. Accessed 5 Apr 2020
Softbank Robotics (2018) Understanding autonomous life settings. http://doc.aldebaran.com/2-1/nao/nao_life.html. Accessed 6 May 2020
Andreallo F, Chesher C (2019) Prosthetic soul mates: sex robots as media for companionship. M/C J 22:
Foxx 11 Los Angeles (2017) Realistic-looking robot with soft skin, soothing voice. In: [YouTube video]. https://youtu.be/851Tx479ivM
Sparrow R (2017) Robots, rape, and representation. Int J Soc Robot 9:465–477. https://doi.org/10.1007/s12369-017-0413-z
Kubes T (2019) New materialist perspectives on sex robots. A feminist dystopia/utopia? Soc Sci, https://doi.org/https://doi.org/10.3390/socsci8080224
Funding
No external funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
Chris Chesher is the main guest editor of this special issue. He has removed himself from reviewing this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chesher, C., Andreallo, F. Eye Machines: Robot Eye, Vision and Gaze. Int J of Soc Robotics 14, 2071–2081 (2022). https://doi.org/10.1007/s12369-021-00777-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12369-021-00777-7