Skip to main content
SpringerLink
Log in

Pervasive Social Computing: augmenting five facets of human intelligence

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Pervasive Social Computing is a novel collective paradigm, derived from pervasive computing, social media, social networking, social signal processing, etc. This paper reviews Pervasive Social Computing as an integrated computing environment, which promises to augment five facets of human intelligence: physical environment awareness, behavior awareness, community awareness, interaction awareness, and content awareness. Reviews of related studies are given, and their generic architectures are designed. The resulting architecture for Pervasive Social Computing is presented. A prototype is developed and examined, in order to investigate the characteristics exhibited by Pervasive Social Computing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  • Aarabi P, Hughes D, Mohajer K, Emami M (2001) The automatic measurement of facial beauty. In: Proceedings of IEEE international conference on systems, man, and cybernetics, pp 2644–2647

  • Agre PE, Douglas S (eds) (1996) Reinventing technology, rediscovering community-critical explorations of computing as a social practice. Ablex Publishing Corporation, Greenwich

    Google Scholar 

  • Alexa (2011) Alexa, http://www.alexa.com/. Accessed 15 June 2011

  • Atukorala K, Wijekoon D, Tharugasini M, Perera I, Silva C (2009) SmartEye integrated solution to home automation, security and monitoring through mobile phones. In: Proceedings of the 2009 third international conference on next generation mobile applications, services and technologies, pp 64–69

  • Baldauf M, Fröhlich P (2009) Supporting hand gesture manipulation of projected content with mobile phones. In: Proceedings of the workshop on mobile interaction with the real world (MIRW)

  • Beadle HWP, Maguire JrGQ, Smith MT (1997) Using location and environment awareness in mobile communications. In: Proceedings of 1997 international conference on information, communications and signal processing, vol 3, pp 1781–1785

  • Ben Mokhtar S, Capra L (2009) From pervasive to social computing: algorithms and deployments. In: Proceedings of the 2009 international conference on pervasive services, ICPS ‘09, pp 169–178

  • Bertot JC, Jaeger PT, Munson S, Glaisyer T (2010) Social media technology and government transparency. Computer 43:53–59

    Article  Google Scholar 

  • Broll G, Siorpaes S, Rukzio E, Paolucci M, Hamard J, Wagner M, Schmidt A (2007) Supporting mobile service usage through physical mobile interaction. Proc Percom 2007:262–271

    Google Scholar 

  • Bush V (1945) As we may think. Atlantic Monthly 7:1–19

    Google Scholar 

  • Charron C, Favier J, Li C (2006) Social computing: how networks erode institutional power, and what to do about it, forrester customer report. February 13

  • Chetan S (2005) Mobile Gaia: a middleware for ad-hoc pervasive computing. In: Consumer communications and networking conference, pp 223–228

  • Chibelushi CC, Deravi F, Mason JSD (2002) A review of speech-based bimodal recognition. IEEE Trans Multimedia 4:23–37

    Article  Google Scholar 

  • Cho J, Tomkins A (2007) Guest editors’ introduction: social media and search. Internet Comput IEEE 11:13–15

    Article  Google Scholar 

  • Darrell T, Gordon G, Harville M, Woodfill J (2000) Integrated person tracking using stereo, color, and pattern detection. Int J Comput Vis 37(2):175–185

    Article  MATH  Google Scholar 

  • David K (2011) Wired and shrewd, young Egyptians guide revolt, http://www.nytimes.com/2011/02/10/world/middleeast/10youth.html?_r=2. Accessed 15 June 2011

  • Dey AK (2000) Providing architectural support for building context-aware applications. Dissertation, Georgia Institute of Technology

  • Dietz P, Leigh D (2001) Diamond touch: a multiuser touch technology. In: Proceedings of UIST’01, ACM, NY, pp 219–226

  • Dryer DC, Eisbach C, Ark WS (1999) At what cost pervasive? a social computing view of mobile computing systems. IBM Syst J 38:652–676

    Article  Google Scholar 

  • Eagle N, Pentland A (2006) Reality mining: sensing complex social signals. J Pers Ubiquitous Comput 10(4):255–268

    Article  Google Scholar 

  • Ekman P, Friesen W (2002) Facial action coding system (FACS): manual

  • FingerWorks (2011) FingerWorks. http://www.fingerworks.com. Accessed by 15 June 2011

  • Fragopanagos N, Taylor J (2005) Emotion recognition in human–computer interaction. Neural Netw 18(4):389–405

    Article  Google Scholar 

  • Gilbert E, Karahalios K (2009) Predicting tie strength with social media. In: CHI ‘09: Proceedings of the 27th international conference on human factors in computing systems, pp 211–220

  • Greenberg S (2001) Context as a dynamic construct. J Human-Comput Interact 16(2):257–268

    Article  Google Scholar 

  • Hardy R, Rukzio E, Holleis P, Wagner M (2010) Mobile interaction with static and dynamic NFC-based displays. In: Proceeding of MobileHCI’10

  • Hosio S, Jurmu M, Kukka H, Riekki J, Ojala T (2010) Supporting distributed private and public user interfaces in urban environments. In: Proceedings of the eleventh workshop on mobile computing systems and applications, pp 25–30

  • Howard R (1993) The virtual community: homesteading on the electronic frontier. Addison Wesley, Reading

    Google Scholar 

  • Howard Philip N (2011) The Arab Spring’s cascading effects, http://www.miller-mccune.com/politics/the-cascading-effects-of-the-arab-spring-28575/. Accessed 15 June 2011

  • Ito A, Wang X, Suzuki M, Makino S (2005) Smile and laughter recognition using speech processing and face recognition from conversation video. In: Proceedings of international conference on cyberworlds, pp 437–444

  • Jacobs S, Egert CA, Barnes SB (2009) Social media theory and practice: lessons learned for a pioneering course. In: Frontiers in education conference, pp 1–5

  • Jaimes A, Omura K, Nagamine T, Hirata K (2004) Memory cues for meeting video retrieval. In: Proceedings of workshop on continuous archival and retrieval of personal experiences, pp 74–85

  • Jones CM, Jonsson I (2005) Automatic recognition of affective cues in the speech of car drivers to allow appropriate responses. In: Proceedings of the 17th Australia conference on computer-human interaction, pp 1–10

  • Kellogg WA (2005) Research and emerging trends in social computing. In: Proceedings of the 2005 international symposium on collaborative technologies and systems, pp 4–4

  • Kennedy L, Ellis D (2004) Laughter detection in meetings. In: Proceedings of the NIST meeting recognition workshop, pp 118–121

  • Kolvenbach S, Grather W, Klockner K (2004) Making community work aware. In: Proceedings of 12th Euromicro conference on parallel, distributed and network-based processing, pp 358–363

  • Kurvinen E, Oulasvirta A (2004) Towards socially aware pervasive computing: a turntaking approach. In: Proceedings of the second ieee international conference on pervasive computing and communications (PerCom’04), p 346

  • Lee JD, Caven B, Haake S (2001) Speech-based Interaction with In-vehicle Computers: the effect of speech-based E-mail on drivers’ attention to the roadway. Hum Factors 43:631–640

    Article  Google Scholar 

  • Lee FSL, Vogel D, Limayem M (2003) Virtual community informatics: a review and research agenda. J Inform Technol Theory Appl 5:47–61

    Google Scholar 

  • Licklider JCR, Taylor Robert W (1968) The computer as a communication device. Sci Technol 76:21–31

    Google Scholar 

  • Mana N, Pianesi F (2006) HMM-based synthesis of emotional facial expressions during speech in synthetic talking heads. In:Proceedings of the 8th international conference on Multimodal interfaces, pp 380–387

  • Mass Multimedia (2011) Mass multimedia, Inc. http://www.touchscreens.com. Accessed by 15 June 2011

  • McDonald (2011). McDonald’s pilots RFID self-ordering system in Korea, http://www.rfidupdate.com/articles/index.php?id=1444. Accessed by 15 June 2011

  • Mistry P, Maes P, Chang L (2009) WUW—wear Ur world: a wearable gestural interface. In: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, pp 4111–4116

  • Murugesan S (2007) Understanding Web 2.0. IT Professional 9:34–41

    Article  Google Scholar 

  • Nate Anderson AT (2011) Tweeting tyrants out of tunisia: global internet at its best, http://www.wired.com/threatlevel/2011/01/tunisia/. Accessed 15 June 2011

  • Neumann G, Erol S (2009) From a social wiki to a social workflow system. In: Proceedings of business process management workshops, pp 698–708

  • NTTDoCoMo (2011) i-mode Felica, http://www.nttdocomo.co.jp/english/service/imode/make/content/felica/index.html. Accessed by 15 June 2011

  • O’Toole AJ, Price T, Vetter T, Bartlett J, Blanz V (1999) 3D shape and 2D surface textures of human faces: the role of “average” in attractiveness and age. Image Vis Comput 18(1):9–19

    Article  Google Scholar 

  • Oikonomopoulos A, Pantic M, Patras I (2008) B-spline polynomial descriptors for human activity recognition. In: Proceedings of IEEE conference on computer vision and pattern recognition

  • Ozer L, Wolf W (2002) Real-time posture and activity recognition. In: Proceedings of workshop on motion and video computing, pp 133–138

  • Pantic M, Rothkrantz L (2003) Toward an affect-sensitive multimodal human-computer interaction. Proc IEEE 91(9):1370–1390

    Article  Google Scholar 

  • Pantic M, Pentland A, Nijholt A, Huang T (2008) Human-centred intelligent human-computer interaction (HCI2): how far are we from attaining it? Int J Auton Adapt Commun Syst 1(2):168–187

    Article  Google Scholar 

  • Parameswaran M (2007) Social computing: an overview. Commun Assoc Inform Syst 19:762–780

    Google Scholar 

  • Pentland A (2007) Automatic mapping and modeling of human networks. Physics A 378:59–67

    Article  Google Scholar 

  • Pope R (2007) Vision-based human motion analysis: an overview. Comput Vis Image Underst 108(1–2):4–18

    Article  Google Scholar 

  • Rabiner LR, Juang B (1993) Fundamentals of speech recognition. Prentice-Hall, Inc., Englewood Cliffs (Chapter 4)

    Google Scholar 

  • Reilly D, Rodgers M, Argue R, Nunes M, Inkpen K (2006) Marked-up maps: combining paper maps and electronic information resources. Pers Ubiquitous Comput 10(4):215–226

    Article  Google Scholar 

  • Román M, Hess C, Cerqueira R, Ranganathan A, Campbell RH, Nahrstedt K (2002) Gaia: a middleware platform for active spaces. SIGMOBILE Mob Comput Commun Rev 6:65–67

    Article  Google Scholar 

  • Savidis A, Zidianakis M, Kazepis N, Dubulakis S, Gramenos D, Stephanidis C (2008) An integrated platform for the management of mobile location-aware information systems. In: Pervasive ‘08: proceedings of the 6th international conference on pervasive computing, pp 128–145

  • Schmidt A (2002) Ubiquitous computing –computing in context. Dissertation, Lancaster University

  • Schuler D (1994) Social computing. Comm ACM 37(1):28–29

    Article  Google Scholar 

  • Scott J (2010) Overview of social computing in sharepoint 2010, http://jornata.com/Presentations/Jamison-Overview%20of%20Social%20Computing%20in%20SharePoint%202010.Pptx, Accessed 15 June 2011

  • SMART Board (2011) Smart technologies SMART board. http://www.smarttech.com/SmartBoard. Accessed by 15 June 2011

  • Smith M, Barash V, Getoor L, Lauw HW (2008) Leveraging social context for searching social media. In: Proceeding of the 2008 ACM workshop on Search in social media, pp 91–94

  • Social_computing (2011) http://en.wikipedia.org/wiki/Social_computing

  • Speech_recognition (2011) Speech_recognition, http://en.wikipedia.org/wiki/Speech_recognition#cite_note-2. Accessed by 15 June 2011

  • Sumi Y, Mase K (2000) Supporting awareness of shared interests and experiences in community. SIGGROUP Bull 21:35–42

    Google Scholar 

  • Tabatabaei SG, Kadir WM, Ibrahim S (2008) A comparative evaluation of state-of-the-art approaches for web service composition, pp 488–493

  • TabletPC (2011) Microsoft Corporation. http://www.microsoft.com/windowsxp/tabletpc/. Accessed by 15 June 2011

  • Toivanen J, Vayrynen E, Seppanen T (2004) Automatic recognition of emotion from spoken Finnish: a preliminary study. Lang Speech 47:383–412

    Article  Google Scholar 

  • Tong Y, Liao W, Ji Q (2007) Facial action unit recognition by exploiting their dynamic and semantic relationships. IEEE Trans Pattern Anal Mach Intell 29(10):1683–1699

    Article  Google Scholar 

  • Touchpad (2011) Synaptics Inc. http://www.synaptics.com/products/touchpad.cfm. Accessed by 15 June 2011

  • Tran MH, Han J, Colman A (2009) Social context: supporting interaction awareness in ubiquitous environments. In: 6th Annual international mobile and ubiquitous systems: networking & services, pp 1–10

  • Truong K, van Leeuwen D (2007) Automatic discrimination between laughter and speech. Speech Commun 49(2):144–158

    Article  Google Scholar 

  • Valstar M, Gunes H, Pantic M (2007) How to distinguish posed from spontaneous smiles using geometric features. In: Proceedings of the international conference on multimodal interfaces, pp 38–45

  • Vinciarelli A, Pantic M, Bourlard H, Pentland A (2008) Social signal processing: state-of-the-art and future perspectives of an emerging domain. In: Proceeding of the 16th ACM international conference on Multimedia, MM ‘08, pp 1061–1070

  • Wang SJ, Middleton B, Prosser LA, Bardon CG, Spurr CD, Carchidi PJ, Kittler AF, Goldszer RC, Fairchild DG, Sussman AJ, Kuperman GJ, Bates DW (2003) A cost-benefit analysis of electronic medical records in primary care. Am J Med 114:397

    Article  Google Scholar 

  • Wang F, Carley KM, Zeng D, Mao W (2007) Social computing: from social informatics to social intelligence. Intell Syst IEEE 22:79–83

    Article  Google Scholar 

  • Want R, Fishkin K, Gujar A, Harrison B (1999) Bridging physical and virtual worlds with electronic tags. In: Proceedings of CHI 1999, pp 370–377

  • Weiser M (1991) The computer for the 21st century. Sci Am 265:94–104

    Article  Google Scholar 

  • Zeng Z, Pantic M, Roisman G, Huang T (2008) A survey of affect recognition methods: Audio, visual and spontaneous expressions. IEEE Trans Pattern Anal Mach Intell 31(1):39–58

    Article  Google Scholar 

  • Zeng D, Hsinchun Chen, Lusch R, Shu-Hsing Li (2010) Social media analytics and intelligence. Intell Syst IEEE 25:13–16

    Article  Google Scholar 

  • Zhao QA, Stasko JT (2002) What’s happening?: promoting community awareness through opportunistic, peripheral interfaces. In: Proceedings of the working conference on advanced visual interfaces, pp 69–74

  • Zhou J, Gilman E, Palola J, Riekki J, Ylianttila M, Sun J (2011) Context-aware pervasive service composition and its implementation. Pers Ubiquit Comput 15(3):291–303

    Article  Google Scholar 

Download references

Acknowledgments

This work was carried out in the Pervasive Service Computing project, funded in the Ubiquitous Computing and Diversity of Communication (MOTIVE) program by the Academy of Finland. The first author would like to thank Prof. Hans Arno Jacobsen from Electrical and Computer Engineering Department, University of Toronto for hosting him for carrying on this study.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, University of Oulu, Oulu, Finland

    Jiehan Zhou, Junzhao Sun, Kumaripaba Athukorala, Dinesh Wijekoon & Mika Ylianttila

  2. Department of Electrical and Computer Engineering, University of Toronto, Toronto, ON, Canada

    Jiehan Zhou

Authors
  1. Jiehan Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Junzhao Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kumaripaba Athukorala
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dinesh Wijekoon
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mika Ylianttila
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiehan Zhou.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhou, J., Sun, J., Athukorala, K. et al. Pervasive Social Computing: augmenting five facets of human intelligence. J Ambient Intell Human Comput 3, 153–166 (2012). https://doi.org/10.1007/s12652-011-0081-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-011-0081-z

Keywords

Search

Navigation