Abstract
Experiences in pervasive computing environments often rely on estimates of the location and/or behaviour of participants to tailor interaction and/or content to the particular user context. In this paper, we present a novel computer vision method for the indirect monitoring of user position and behaviour. The technique classifies activities based on measurements of the disruptions those activities cause in the surrounding ambient light field. The potential advantages of the method are increased privacy, an ability to recognise high level behaviours and events, and applicability in dimly lit environments. Initial experiments show the technique to be capable of recognising user position within an enclosed environment with at least 75% accuracy. A study of time-based events further shows it to be capable of discriminating between different paths taken through an enclosed space by different sized groups of users with 84% accuracy. We conclude by discussing possible applications of the technique in pervasive computing environments.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bascon SM, Moreno HG, Carralero IA, Jimenez PG, Ferreras FL (2002) Integration of illumination changes into MPEG-2. In: International conference on TELEC’2002
Bayoumi S (2006) Behaviour classification from disruptions in ambient illumination, Ph.D. Thesis, University of Nottingham
Ben-Arie J, Wang Z, Pandit P, Rajaram S (2002) Human activity recognition using multidimensional indexing. IEEE Trans Pattern Anal Mach Intell 24(8):1091–1104
Bobick A, Davis J (2001) The recognition of human movement using temporal templates. IEEE Trans Pattern Anal Mach Intell 23(3):257–267
Brown B, MacColl I, Chalmers M et al (2003) Lessons from the lighthouse: collaboration in a shared mixed reality system. In: Proceedings of CHI’03. ACM Press, Ft. Florida, pp 577–584
Cohen I, Li H (2003) Inference of human postures by classification of 3D Human body shape. In: IEEE International Workshop on Analysis and Modeling of Faces and Gestures (ICCV’03)
Corradini A (2001) Dynamic time warping for off-line recognition of a small gesture vocabulary. In: IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and gestures in real time systems (RATFG-RTS’01)
Elgammal A, Harwood D, Davis L (2000) Non-parametric model for background subtraction. In: 6th European Conference on Computer Vision, Dublin, Ireland
Flintham M, Anastasi R, Benford S et al (2003) Where on-line meets on-the-streets: experiences with mobile mixed reality games. In: Proceedings of CHI’03. ACM Press, Florida, pp 569–576
Forsyth D, Ponce J (2002) computer vision-a modern approach. Prentice Hall, Englewood Cliffs
Friedman M, Kandel A (1999) Introduction to pattern recognition, statistical, structural, neural and fuzzy logic approaches. Imperial College Press, London
Fujiyoshi H, Lipton A, Kanade T (2004) Real-time human motion analysis by image skeletonization. IEICE Trans Inf Syst E87-D(1):113–120
Kerridge J, Armitage A,Binnie D, Lei L (2004) Monitoring the movement of pedestrians using low-cost infrared detectors: initial findings. In: Proceedings US Transport Research Board Annual Meeting
Kidd C, Orr R, Abowd G, Atkeson C, Essa I, MacIntyre B, Mynatt E, Starner T, Newstetter W (1999) The aware home: a living laboratory for ubiquitous computing research. In: Proceedings of CoBuild’99. Springer, Pittsburgh, USA, pp 191–198
Lambrou T, Linney A, Speller R, Todd-Pokropek A (2002) Statistical classification of digital mammograms using features from the spatial and wavelet domains. In: Proceedings of medical image understanding and analysis, University of Portsmouth, 22–23 July 2002
Li J, Wang J, Wiederhold G (2000) Classification of textured and non-textured images using region segmentation. In: Proceedings of 7th international conference on image processing, Vancouver, BC, pp 754–757
Marshall J, Mills S, Benford S (2006) Using object interactions to improve particle filter performances. In: Proceedings of 2006 British Machine Vision Conference
McCarthy JF, Costa TJ, Liongosari ES (2001) Unicast, outcast and groupcast: three steps toward ubiquitous peripheral displays. In: Proceedings of UbiComp 2001, Atlanta, GA, Springer, pp 332–345
Moreno H, Bascon S, Ferreras F, Rodriguez F (2001) Extracting illumination from images by using the wavelet transform. In: International conference on image processing, Thessaloniki, Greece
Mrowka E, Dorado A, Pedrycz W, Izquierdo E (2004) Dimensionality reduction for content-based image classification. In: 8th International conference on information visualisation (IV’04)
Not E, Petrelli D et al (1997) Person-oriented guided visits in a physical museum. In: ICHIM’97, Archives and Museum Informatics, Paris
Proceedings of the sixth IEEE international workshop on visual surveillance, Graz, Austria, 2006
Randall J, Amft O, Bohn J, Burri M (2007) Luxtrace: indoor positioning using building illumination. Pers Ubiquitous Comput 11(6):417–428
Ravi N, Iftode I (2007) FiatLux: fingerprinting rooms using light intensity, in Pervasive 2007
Raviv TR, Shashua A (2001) The quotient image: class based re-rendering and recognition with varying illumination. IEEE Trans Pattern Anal Mach Intell 23(2):129–139
Russell DM, Drews C, Sue A (2002) Social aspects of using large public interactive displays for collaboration. In: Ubicomp’02, Goteburg, Sweden, pp 229–236
Sparacino F, Davenport G, Pentland A (2000) Media in performance: interactive spaces for dance, theater, circus, and museum exhibits. IBM Syst J 39(3&4):479–510
Stauffer C, Eric W (2000) Learning patterns of activity using real-time tracking. IEEE Trans Pattern Anal Mach Intell 22(8):747–757
Tapia E, Marmasse N, Intille S, Larson K (2004) MITes: Wireless portable sensors for studying behaviour. In: 6th international conference on ubiqutous computing, Nottingham, England
Thomas BH, Close B, Donoghue J, Squires J, De Bondi P, Piekarski W (2002) ARQuake: a first person indoor/outdoor augmented reality application. J Pers Ubiquitous Comput, Springer, Berlin
Underhill P (2002) Why we buy. Texere, NY
Urtasun R, Fua P (2004) 3D Human body tracking using deterministic temporal motion models. In: European conference on computer vision
Varma M, Zisserman A (2005) A statistical approach to texture classification from single images. In: International Journal of Computer Vision, Springer, Berlin
Villar N, Schmidt A, Kortuem G, Gellersen H-W (2003) Interacting with proactive community displays. Comput Graph Mag 27(6):849–857
Wactlar H, Christel M, Hauptmann A, Stevens S (2003) A System of video information capture, indexing and retrieval for interpreting human activity. In: IEEE international symposium on image and signal processing and analysis (ISPA’03)
Weiss Y (2001) Deriving intrinsic images from image sequences. In: 9th international conference in computer vision (ICCV ‘01), Vancouver, BC, Canada
Whyte WH (1971) The social life of small urban spaces. Anchor Books, NY
Young J (2004) Graphics glossary. http://graphics.comsci.us/glossary/
Zimmerman TG, Paradiso JA, Allport D, Gershenfeld N (1995) applying electric field sensing to human–computer interfaces. In: CHI 95
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bayoumi, S., Pridmore, T. & Koleva, B. Exploiting ambient illumination to locate and recognise user behaviour in enclosed environments. Pers Ubiquit Comput 14, 335–345 (2010). https://doi.org/10.1007/s00779-009-0234-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-009-0234-7