Skip to main content
SpringerLink
Log in

Biometrics in ambient intelligence

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

The security concerns due to the September 11 and later terroristic attacks, fostered the development of more advanced techniques for biometric identification. This had a positive impact to research and deployment of these technologies, founding a basis for security-related applications. At the same time, the privacy concerns for the misuse of personal information have hindered the application of the same technologies wherever their introduction could not be enforced. The risk is for the scientific development to be blocked by contradictory needs, which, in turn, often derive from misconceptions or misunderstanding of the real potential of biometric technologies. Within this context, ambient intelligence allows to consider the relation between biometrics and privacy under a different perspective. In fact, as most of times we are able to maintain social relations without the need to know each other’s identity (consider for example the case of a customer relating with an attendant at a department store), in the same way biometric technologies can facilitate the man–machine interaction (to better provide useful services) without the need to determine the user’s full identity. Also in the case of security applications, most often may be sufficient to retrieve ancillary information about a subject rather than determining his/her identity. This paper analyzes the potential of biometric technologies within the general scope of ambient intelligence, trying to identify some key technological issues which may respond to privacy concerns. Some example applications are considered where by exploiting the information contained in biometric data, such as the facial expression or other, non visual, measurements, it is possible to better relate the user with the environment and provide a substantial input to drive the services provided, without compromising his privacy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. A description of the project can be found under the Screening Technologies to detect intentions of humans in the page: http://www.dhs.gov/xabout/structure/gc_1224537081868.shtm.

References

  • Aarts E, Diederiks E (2006) Ambient lifestyle, from concept to experience. Bis Publishers, Amsterdam

    Google Scholar 

  • Ambekar O, Pauwels E, Schouten B (2007) Binding low level features to support opportunistic person identification, 28th Symposium on information theory, Enschede, The Netherlands, May 24–25

  • AMIGO-Ambient Intelligence for the Networked Home Environment (2004) European project IST 004182 [online]. Available: http://www.hitechprojects.com/euprojects/amigo/

  • Arandjelovic O and Cipolla R (2004) Face Recognition from face motion manifolds using Robust kernel resistor-average distance. In: Proceedings of FaceVideo, p 88

  • Arun A, Ross, Karthik Nandakumar, Anil K Jain (2006) Handbook of Biometrics. Springer, ISBN: 978-0-387-22296-7

  • Bicego M, Grosso EE, Tistarelli M (2006) Person authentication from video of faces: a behavioral and physiological approach using Pseudo Hierarchical Hidden Markov Models. In: Proceedings first international conference on Biometrics LNCS 3832, Hong Kong, China, pp 113–120

  • Black J, Ellis J, Rosin J (2002) Multi-view image surveillance and tracking, IEEE Workshop on Motion and Video Computing

  • Busso C, Deng Z, Yildirim S, Bulut M, Lee, Kazemzadeh A, Lee S, Neumann U, Narayanan S (2004) Analysis of emotion recognition using facial expressions, speech and multimodal information. In: Proceedings of the 6th international conference on multimodal interfaces, (State College, PA, USA, ICMI 2004, pp 205–211. http://doi.acm.org/10.1145/1027933.1027968

  • Castellano G, Kessous L, Caridakis G (2008) Emotion recognition through multiple modalities: face, body gesture, speech. In: Peter C, Beale R (eds) Affect and emotion in human computer interaction LNCS, vol 4868. Springer, Heidelberg

    Google Scholar 

  • CAVIAR<context aware vision using image-based active recognition (2002) European project IST 2001 37540 [online]. Available: http://homepages.inf.ed.ac.uk/rbf/CAVIAR/

  • Cehllappa R, Zhou SK (2004) Face tracking and recognition from video. In: Jain AK, Li SZ (eds) Handbook of face recognition. Springer, New York, pp 169–192

    Google Scholar 

  • Chen LS (2000) Joint processing of audio-visual information for the recognition of emotional expressions in humancomputer interaction. PhD Thesis, University of Illinois at Urbana, Champaign

  • Chen LS and Huang TS (2000) Emotional expressions in audiovisual human computer interaction. In: Proceedings of ICME 2000, New York, pp 423–426

  • CHIL-Computers In the Human Interaction Loop (2004) European project IST 506909 [online]. Available: http://chil.server.de/servlet/is/101/

  • COGNIRON-the cognitive robot companion (2004) European project IST 002020 [online]. Available: http://www.cogniron.org/fina/Home.php

  • Cohen I, Sebe N, Garg A, Chen LS, Huang TS (2003) Facial expression recognition from video sequences: temporal and static modeling. Comput Vis Image Underst 91(12):160187

    Google Scholar 

  • Cook DJ (2005) Prediction algorithms for smart environments in smart environments: technologies, protocols, and applications. In: Cook DJ, Das SK (eds) Series on parallel and distributed computing. Wiley, pp 175–192

  • Cook Diane J, Das Sajal K (2005) Smart environments: technology, protocols and applications]. Wiley-Interscience, USA

    Google Scholar 

  • Cook D, Youngblood M, Heierman E, Gopalratnam K, Rao S, Litvin A, Khawaja F (2003) Mavhom: an agent-based smart home. In: Proceedings of IEEE PerCom, pp 521–524

  • Datcu D, Rothkrantz L (2008) Automatic bi-modal emotion recognition system based on fusion of facial expressions and emotion extraction from speech. IEEE face and gesture conference FG2008, ISBN: 978-1-4244-2154-1

  • Dee HM, Velastin SA (2007) How close are we to solving the problem of automated visual surveillance? A review of real-world surveillance, scientific progress and evaluative mechanisms. Springer, New York

  • Eagle N, Pentland A (2006) Eigenbehaviors: identifying structure in routine, In: Proceedings of Ubicomp

  • Ekman P (1994) Strong evidence for universals in facial expressions: a reply to Russells mistaken critique. Psychol Bull 115(2):268–287

    Article  Google Scholar 

  • Ekman P, Friesen WV (1978) Facial action coding system: investigators guide. Consulting Psychologists Press, Palo Alto

    Google Scholar 

  • Essa I, Pentland A (1995) Facial expression recognition using visually extracted facial action parameters. In: Proceedings of international workshop on automatic face and gesture recognition, Zurich, Switzerland

  • Fasel B, Luettin J (2003) Automatic facial expression analysis: a survey. Pattern Recogn 36:259275

    Article  Google Scholar 

  • Fatakusi O, Kittler J, Poh N (2008) Quality controlled multimodal fusion of biometric experts in progress in pattern recognition, image analysis and applications Lecture notes Computer Science, vol 4756. Springer, Berlin, pp 881–890

    Google Scholar 

  • Fleuret F, Berclaz J, Lengagne R, Fua P (2008) Multi-camera people tracking with a prob-abilistic occupancy map. IEEE Trans Pattern Analysis Mach Intell 30(2):267–282

    Article  Google Scholar 

  • Friedewald M, Da Costa O, Punie Y, Alahuhta P, Heinonen S (2004) Perspectives of ambient intelligence in the home environment, telematics and informatics, vol 22. Elsevier publishing, The Netherlands, pp 221–238

    Google Scholar 

  • Gunes H and Piccardi M (2006) A bimodal face and body gesture database for automatic analysis of human nonverbal affective behavior. In: Proceedings of the 18th International Conference on Pattern Recognition (ICPR 2006), vol 1, pp 1148–1153

  • Gunes H, Piccardi M (2009) Automatic temporal segment detection and affect recognition from face and body display. IEEE Trans Syst Man Cybern B, Special issue human comput 39(1):64–84

    Google Scholar 

  • Gunes H, Piccardi M, Pantic M (2008) From the lab to the real world: affect recognition using multiple cues and modalities. In: Jimmy O (ed) Affective computing, focus on emotion expression, synthesis and recognition, I-Tech Education and Publishing, Vienna, Austria, ISBN: 978-3-902613-23-3

  • Hall D, Pelisson F, Riff O, Crowley JL (2004) Brand identification using gaussian derivative histograms. Mach Vis Appl 16(1):41–46

    Article  Google Scholar 

  • Haritaǒglu S, Harwood D, Davis L (2000) W4: real-time surveillance of people and their activities. IEEE Trans Pattern Analysis Mach Intell 22(8):809–830

    Article  Google Scholar 

  • Horn BKP, Schunck BG (1981) Determining optical flow. Artif Intell 17(1–3):185–204

    Article  Google Scholar 

  • Howell AJ, Buxton H (1996) Towards unconstrained face recognition from image sequences. In: Proceedings of the IEEE International conference on Automatic Face and Gesture Recognition (FGR 1996), Killington, VT, pp 224–229

  • Jain AK, Dass SC, Nandakumar K (2004) Soft biometric traits for personal recognition systems, In: Proceedings of international conference on Biometric Authentication (ICBA), LNCS 3072, pp 731–738

  • Kanade T, Cohn J, Tian Y (2000) Comprehensive database for facial expression analysis. In: Proceedings of the 4th IEEE international conference on automatic face and gesture recognition (FG 2000), pp 46–53

  • Kang J, Cohen I, Medioni G (2004) Tracking people in crowded scenes across multiple cameras, Asian Conference on Computer Vision

  • Kidd C, Orr R, Abowd G, Atkeson C, Essa I, MacIntyre B, Mynatt E, Starner T, Newstetter W (1999) The aware home: a living laboratory for ubiquitous computing research. In: Proceedings of CoBuild, pp 191–199

  • Kittler J, Poh N, Fatakusi O, Messer K, Kryszczuk K, Richiardi J, Drygajlo A (2007) Quality dependent fusion of intramodal and multimodal biometric experts. In: Proceedings of SPIE defense and security symposium, Workshop on Biometric Technology for Human Identification, vol 6539

  • Li Y, Gong S, Liddell H (2000) Support vector regression and classification based multiview face detection and recognition. In: Proceedings of the IEEE international conference on Automatic Face and Gesture Recognition (FGR 2000), Grenoble, France, pp 300–305

  • Li Y, Gong S, Liddell H (2001) Modelling faces dynamically across views and over time. In: Proceedings IEEE international conference on Computer Vision, Vancouver, Canada, pp 554–559

  • Liberty CCTV (2008) http://www.liberty-human-rights.org.uk/ issues/3-privacy/32-cctv/index.shtml

  • Linnartz JP, Tuyls P (2003) New shielding functions to enhance privacy and prevent misuse of biometric templates. In: Proceedings AVBPA 2003, LNCS: 2688, Springer, Berlin, pp 393–402

  • Liu X, Chen T (2003) Video-based face recognition using adaptive hidden Markov models. In: Proceedings CVPR03 (I), pp 340–345

  • Lucas SM, Huang TK (2004) Sequence recognition with scanning N-tuple ensembles. In: Proceedings ICPR04 (III), vol 135, pp 410–413

  • Lucas SM (1998) Continuous n-tuple classifier and its application to real-time face recognition. In: IEE Proceedings-Vision Image and Signal Processing, vol 145, p 343

  • Magnusson MS (2000) Discovering hidden time patterns in behavior: T-patterns and their detection. Behav Res Methods Instrum Comput 32(1):93–110

    Article  Google Scholar 

  • Maltoni D, Maio D, Jain AK, Prabhakar S (2008) Handbook of fingerprint recognition, 2nd edn. Springer, Heidelberg

    Google Scholar 

  • Matey JR, Naroditsky O, Hanna K, Kolczynski R, LoIacono D, Mangru S, Tinker M, Zappia T, Zhao WY, Iris on the Move™: acquisition of images for Iris recognition in less constrained environments. In: Proceedings of IEEE. 94(11):1936–47

  • Maurer DE, Baker JP (2007) Fusing multimodal biometrics with quality estimates via a Bayesian belief network. Pattern Recogn 41(3):821–832

    Article  Google Scholar 

  • Mittal A, Davis L (2003) M2tracker: a multi-view approach to segmenting and tracking people in a cluttered scene. Int J Comput Vis 51(3):189–203

    Article  Google Scholar 

  • Mitsubishi Electric Research Laborotories: ambient intelligence for better buildings (2009) [online]. Available: http://www.merl.com/projects/ulrs/

  • Morros R, Salah Albert Ali, Schouten Ben, Perales Carlos Segura, Serrano Jordi Luque, Ambekar Onkar, Kayalar Ceren, Keskin Cem, Akarun Lale (2008) Multimodal identification and localization of users in a smart environment. J Multimodal Interfaces 2(2):75–91

    Article  Google Scholar 

  • Mozer MC (2005) Lessons from an adaptive home. In: Cook DJ, Das SK (eds) Smart environments: technologies, protocols and applications. Wiley Series on Parallel and Distributed Computing, New York, pp 273–294

    Google Scholar 

  • National Science and Technology Council (2007) Subcommittee on Biometrics (Duane Blackburn co-chair). The National Biometrics Challenge. http://www.biometrics.gov/Documents/biochallengedoc.pdf

  • Nixon MS, Tan TN, Chellappa R (2006) Human identification based on gait. Springer, New York

    Book  Google Scholar 

  • OXYGEN-MIT project Oxygen, Pervasive Human-Centered Computing (2001) MIT research project (2001). Available: http://oxygen.csail.mit.edu/

  • Paleari M, Benmokhtar R, Huet B (2009) Evidence theory based multimodal emotion recognition MMM, 15th International Multimedia Modeling Conference, Antipolis, France, pp 435–446

  • Pantic M, Rothkrantz LJM (2000) Automatic analysis of facial expressions: the state of the art. IEEE Trans PAMI 22(12):1424–1445

    Google Scholar 

  • Pauwels E, Salah AA, Tavenard R (2007) Sensor Networks for Ambient Intelligence, Workshop on Multimedia Signal Processing (MMSP), Crete

  • Phillips PJ, Flynn PJ, Scruggs T, Bowyer KW, Worek W (2006) Preliminary face recognition grand challenge results. In: Proceedings 7th International Conference On Automatic Face And Gesture Recognition, pp 15–24

  • Phillips PJ, Wechsler H, Huang J, Rauss P (1998) The FERET database and evaluation procedure for face-recognition algorithms. Image Vis Comput J 16(5):295–306

    Article  Google Scholar 

  • Poh N, Heusch G, Kittler J (2007) On combination of face authentication experts by a mixture of quality dependent fusion qualifiers. In: LNCS 4472, Multiple classifiers systems (MCS), Prague, pp 344–356

  • Ratliff MS, Patterson E (2008) Emotion recognition using facial expressions with active appearance models. In: Proceedings of IASTED human computer interaction, pp 92–138

  • Raytchev B, Murase H (2001) Unsupervised face recognition from image sequences. In: Proceedings ICIP01(I), pp 1042–1045

  • Raytchev B, Murase HH (2002) VQ-Faces: unsupervised face recognition from image sequences. In: Proceedings ICIP02 (II), pp 809–812

  • Raytchev B, Murase H (2003) Unsupervised recognition of multi-viewface sequences based on pairwise clustering with attraction and repulsion. Comput Vis Image Underst 91(1–2):22–52

    Article  Google Scholar 

  • Rejman-Greene M (2004) Privacy issues in the application of biometrics: a european perspective in biometric systems. In: Wayman J, Jain A, Maltoni D, Maio D (eds) Biometric systems. Springer, Berlin

    Google Scholar 

  • Rosalind W Picard (2000) Affective computing MIT Press, London

  • Schouten B, Jacobs B (2008) Biometrics and their use in e-passports, image and vision computing (IMAVIS), special issue on multimodal biometrics, Elsevier Publishers, The Netherlands

  • Schouten BAM, Deravi F, García-Mateo C, Tistarelli M, Snijder M, Meints M, Dittmann J (2008) BioSecure: white paper for research in biometrics beyond BioSecure. CWI report 2008, PNA-R0803, ISSN:1386–3711

  • Sebe N, Cohen I, Cozman FG, Gevers T, Huang TS (2005) Learning probabilistic classifiers for human computer interaction applications. Multimed Syst 10(6):484–498

    Article  Google Scholar 

  • Sebe N, Cohen I, Gevers T, Huang TS (2006) Emotion recognition based on joint visual and audio cues. In: Proceedings of the 18th international conference on pattern recognition (ICPR 2006), vol 1, pp 1136–1139

  • Shan C, Braspenning R (2009) Recognizing Facial Expressions Automatically from Video. In: Nakashima H, Augusto J, Aghajan H (eds) Handbook of Ambient Intelligence and Smart Environments, Springer

  • Tabassi E, Wilson C, Watson C (2004) NIST Fingerprint Image Quality, NIST Res Rep NISTIR7151

  • The BioSecure Network of Excellence (2004). http://www.biosecure.info

  • The Ministry of the Interior and Kingdom Relations, The Netherlands (2005) 2b or not to 2b. http://www.minbzk.nl/contents/pages/43760/evaluatierapport1.pdf

  • Tistarelli M (1996) Multiple constraints to compute optical flow. IEEE Trans PAMI 18(12):1243–1250

    Google Scholar 

  • Tistarelli M, Bicego M, Grosso E (2008) Dynamic face recognition: from human to machine vision. In: Tistarelli M and Bigun J (eds) Image Vis Comput special issue on multimodal biometrics. doi:10.1016/j.imavis.2007.05.006

  • Tretiak O, Pastor L (1984) Velocity estimation from image sequences with second order differential operators. In: Proceedings of 7th IEEE international conference on pattern recognition, pp 16–19

  • Velastin SA, Boghossian BA, Lo BPL, Sun J, Vicencio-Silva MA (2005) PRISMATICA: towards ambient intelligence in public transport environments. Part A. IEEE Trans Syst Man Cybern 35(1):164–182

    Google Scholar 

  • Waibel A, Steusloff H, Stiefelhagen R (2004) Chil—computers in the human interaction loop, NIST ICASSP Meeting Recognition Workshop, Montreal, Canada

  • Wayman J, Jain A, Maltoni D, Maio D (2004) Biometric systems. Springer, London

    Google Scholar 

  • Wechsler H (2007) Reliable face recognition methods: system design, implementation and evaluation. Springer, Heidelberg

    Book  Google Scholar 

  • Wren C, Minnen D, Rao S (2006) Similarity-based analysis for large networks of ultra-low resolution sensors. Pattern Recogn 39:1918–1931

    Article  MATH  Google Scholar 

  • Video-based Threat Assessment and Biometrics Network - ViTAB (2006). http://dircweb.king.ac.uk/vitab/

  • Zeng Z, Pantic M, Roisman GI, Huang TS (2009) A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans PAMI 31(1):39–58

    Google Scholar 

  • Zhang DD (2004) Palmprint authentication. Springer, London

    Google Scholar 

  • Zhou SK, Krueger V, Chellappa R (2003) Probabilistic recognition of human faces from video. Comput Vis Image Underst 91(1–2):214–245

    Article  Google Scholar 

  • Zhou SK, Chellappa R, Moghaddam B (2004) Visual tracking and recognition using appearance-adaptive models in particle filters. Image Process 13(11):1491–1506

    Article  Google Scholar 

  • Zhou SK, Chellappa R, Zhao W (2006) Unconstrained face recognition. Springer, New York

    MATH  Google Scholar 

Download references

Acknowledgments

Funding from the European Union COST action 2101 “Biometrics for Identity Documents and Smart Cards” and from the Sardinia Regional Research Authority are also acknowledged.

Author information

Authors and Affiliations

  1. Computer Vision Laboratory, University of Sassari, piazza Duomo 6, 07041, Alghero, Italy

    Massimo Tistarelli

  2. Fontys University of Applied Sciences, Rachelsmolen 1, 5612 MA, Eindhoven R1, The Netherlands

    Ben Schouten

Authors
  1. Massimo Tistarelli
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ben Schouten
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Massimo Tistarelli.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tistarelli, M., Schouten, B. Biometrics in ambient intelligence. J Ambient Intell Human Comput 2, 113–126 (2011). https://doi.org/10.1007/s12652-010-0033-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-010-0033-z

Keywords

Search

Navigation