skip to main content
10.1145/1878039.1878048acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Space speaks: towards socially and personality aware visual surveillance

Published: 29 October 2010 Publication History

Abstract

There is a complex unwritten code which regulates human interactions. In this paper we present a camera based monitoring system that explores the relationship between proxemics, visual attention and personality traits during interaction. People's relative positions an head poses are extracted with a multi-target tracking algorithm and used to (i) estimate, under the 'thin slices' hypothesis, the level of extroversion and neuroticism of a person, to (ii) learn a model of people interactive behavior that improves, once integrated in the algorithm, the accuracy of the tracking estimates, and to (iii) steer a set of active cameras to the subject found to exhibit the most peculiar interaction pattern. We report on experimental results in a natural scenario where people engage in a party

References

[1]
1} N. Ambady and R. Rosenthal. Thin slices of expressive behaviors as predictors of interpersonal consequences: A meta-analysis. Psychological Bulletin, 111:256--274, 1992.
[2]
S. Argamon, S. Dhawle, M. Koppel, and J. Pennbaker. Lexical predictors of personality type. Interface and the Classification Society of North America, 2005.
[3]
M. Argyle. Bodily Communication (2nd ed.). Madison: International Universities Press, 1988.
[4]
A. D. Bimbo, F. Dini, G. Lisanti, and F. Pernici. Exploiting distinctive visual landmark maps in pan-tilt-zoom camera networks. CVIU, 114, 2010.
[5]
J. Bowlby. Attachment and Loss. Hogarth Press, 1969.
[6]
A. G. Brooks and R. C. Arkin. Behavioral overlays for non-verbal communication expression on a humanoid robot. Autonomous Robots, 22(1):55--74, 2007.
[7]
M. Cristani, V.Murino, and A. Vinciarelli. Socially intelligent surveillance and monitoring: Analysing social dimensions of physical space. IEEE SISM, 2010.
[8]
N. Cristianini and J. Shawe-Taylor. An Introduction to Support Vector Machines and other kernel-based learning methods. Cambridge University Press, 2000.
[9]
S. DeJulio and K. Duffy. Neuroticism and proxemic behavior. Perceptual and Motor Skills, 45:51--55, 1977.
[10]
D. Friedman, A. Steed, and M. Slater. Spatial Social Behavior in Second Life. Springer, 2007.
[11]
E. T. Hall. The hidden dimension. Anchor Books, 1963.
[12]
W. Ickinger and S. Morris. Psychological characteristics and interpersonal distance. www.sharktown.com/proxemics/intro.html, 2001.
[13]
O. P. John and S. Srivastava. The big five trait taxonomy: History, measurement, and theoretical perspectives. In L. A. Pervin and O. P. John, editors, Handbook of Personality: Theory and Research, pages 102--138. Guilford Press, New York, 1999.
[14]
O. Lanz. Approximate bayesian multibody tracking. IEEE TPAMI, September 2006.
[15]
O. Lanz and R. Brunelli. Dynamic head location and pose from video. IEEE MFI, September 2006.
[16]
B. Lepri, N. Mana, A. Cappelletti, F. Pianesi, and M. Zancanaro. Modeling personality of participants during group interaction. UMAP, 2009.
[17]
F. Mairesse and M. Walker. Automatic recognition of personality in conversation. HLT-NAACL, 2006.
[18]
D. Pedersen. Correlates of behavioral personal space. Psychological Reports, 32(3):828--830, 1973.
[19]
S. Pellegrini, A. Ess, K. Schindler, and L. van Gool. You'll never walk alone: Modeling social behavior for multi-target tracking. ICCV, 2009.
[20]
M. Perugini and L. DiBlas. Analyzing personality-related adjectives from an eticemic perspective: the big five marker scale (bfms) and the italian ab5c taxonomy. In De Raad, B. and Perugini, M. (Eds.), Big Five Assessment, Hogrefe und Huber Publishers. GAottingen, 281--304, 2002.
[21]
F. Pianesi, N. Mana, A. Cappelletti, B. Lepri, and M. Zancanaro. Multimodal recognition of personality traits in social interactions. ICMI, 2008.
[22]
E. Ricci and J.-M. Odobez. Learning large margin likelihoods for realtime head pose tracking. IEEE ICIP, 2009.
[23]
A. Vinciarelli, M. Pantic, and H. Bourlard. Social signal processing: Survey of an emerging domain. Image and Vision Computing, 2009.
[24]
P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. CVPR, 1, 2001.
[25]
J. L. Williams. Personal space and its relation to extraversion introversion. Canadian Journal of Behavioural Science, 3(2):156--160, 1971.
[26]
F. Yamaoka, T. Kanda, H. Ishiguro, and N. Hagita. A model of proximity control for information-presenting robots. IEEE Trans. on Robotics, 26:187--195, 2010.

Cited By

View all
  • (2024)Enabling Social Robots to Perceive and Join Socially Interacting Groups Using F-formation: A Comprehensive OverviewACM Transactions on Human-Robot Interaction10.1145/368207213:4(1-48)Online publication date: 23-Oct-2024
  • (2024)Towards Automatic Social Involvement EstimationProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3688615(612-616)Online publication date: 4-Nov-2024
  • (2024)Psychology-Guided Environment Aware Network for Discovering Social Interaction Groups from VideosACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365729520:8(1-23)Online publication date: 13-Jun-2024
  • Show More Cited By

Index Terms

  1. Space speaks: towards socially and personality aware visual surveillance

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MPVA '10: Proceedings of the 1st ACM international workshop on Multimodal pervasive video analysis
    October 2010
    68 pages
    ISBN:9781450301671
    DOI:10.1145/1878039
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 October 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. guided vision based on high-level reasoning
    2. human behavior modeling based on observations
    3. multi-camera tracking

    Qualifiers

    • Research-article

    Conference

    MM '10
    Sponsor:
    MM '10: ACM Multimedia Conference
    October 29, 2010
    Firenze, Italy

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)27
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Enabling Social Robots to Perceive and Join Socially Interacting Groups Using F-formation: A Comprehensive OverviewACM Transactions on Human-Robot Interaction10.1145/368207213:4(1-48)Online publication date: 23-Oct-2024
    • (2024)Towards Automatic Social Involvement EstimationProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3688615(612-616)Online publication date: 4-Nov-2024
    • (2024)Psychology-Guided Environment Aware Network for Discovering Social Interaction Groups from VideosACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365729520:8(1-23)Online publication date: 13-Jun-2024
    • (2024)Toward Grouping in Large Scenes With Occlusion-Aware Spatio–Temporal TransformersIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.332486834:5(3919-3929)Online publication date: May-2024
    • (2024)GigaVision: When Computer Vision Meets Gigapixel VideographyPlenoptic Imaging and Processing10.1007/978-981-97-6915-5_6(327-389)Online publication date: 16-Oct-2024
    • (2024)Generalized Multi_stage Feature for Deep Age Estimation from a Human Face Image13th International Conference on Information Systems and Advanced Technologies “ICISAT 2023”10.1007/978-3-031-60594-9_17(149-158)Online publication date: 31-Jul-2024
    • (2023)Watch your watchProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620249(193-210)Online publication date: 9-Aug-2023
    • (2023)Generating Socially Acceptable Robot Poses for Approaching Conversational Groups with Generative Adversarial Networks2023 42nd Chinese Control Conference (CCC)10.23919/CCC58697.2023.10240460(4478-4484)Online publication date: 24-Jul-2023
    • (2023)Co-Located Human–Human Interaction Analysis Using Nonverbal Cues: A SurveyACM Computing Surveys10.1145/362651656:5(1-41)Online publication date: 25-Nov-2023
    • (2023)DLP-personality detection: a text-based personality detection framework with psycholinguistic features and pre-trained featuresMultimedia Tools and Applications10.1007/s11042-023-17015-z83:13(37275-37294)Online publication date: 29-Sep-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media