Skip to main content
SpringerLink
Log in

Emotion-Age-Gender-Nationality Based Intention Understanding in Human–Robot Interaction Using Two-Layer Fuzzy Support Vector Regression

  • Published:
International Journal of Social Robotics Aims and scope Submit manuscript

Abstract

An intention understanding model based on two-layer fuzzy support vector regression is proposed in human–robot interaction, where fuzzy c-means clustering is used to classify the input data, and intention understanding is mainly obtained by emotion, with identification information such as age, gender, and nationality. It aims to realize the transparent communication by understanding customers’ order intentions at a bar, in such a way that the social relationship between bar staffs and customers becomes smooth. To demonstrate the aptness of intention understanding model, experiments are designed in term of relationship between emotion-age-gender-nationality and order intention. Results show that the proposal obtains an intention understanding accuracy of 70 %/72 %/80 % with clusters number \(C= \) 2/3/6 (according to different genders/ages/nationalities), which is 23 %/26 %/33 % and 35.5 %/37.5 %/45.5 % higher than that of support vector regression (SVR) and back propagation neural networks (BPNN), respectively; the computational time of proposal is about 0.976 s/0.935 s/0.67 s with clusters number \(C=\) 2/3/6, while 1.889 s for SVR and 3.505 s for BPNN. Additionally, the preliminary application experiment is performed in the developing human–robot interaction system, called mascot robot system, where the experiment is performed in a scenario of “drinking at a bar”, result shows that the bar lady robot obtains an accuracy of 77.8 % for understanding customers’ order intentions and receives a satisfaction evaluation of “satisfied”. According to the preliminary application, the proposal is being extended to an ordering system in the bar for business communication.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

References

  1. Kirby R, Forlizzi J, Simmons R (2010) Affective social robots. Robot Automous Syst 58:322–332

    Article  Google Scholar 

  2. Murphy RR, Nomura T, Billard A, Burke JL (2010) Human–robot interaction. IEEE Robot Autom Mag 17(2):85–89

    Article  Google Scholar 

  3. Young JE, Sung J, Voida A, Sharlin E, Igarashi T, Christensen HI, Grinter RE (2011) Evaluating human–robot interaction. Int J Soc Robot 3(1):53–67

    Article  Google Scholar 

  4. Mitssunaga N, Miyashita T, Ishiguro H, Kogure K, Hagita N (2006) Robovie-IV: a communication robot interacting with people daily in an office. In: Proceedings of international conference on intelligent robots and system, Beijing, China, pp 5066–5072

  5. Fasola J, Mataric M (2012) Using socially assistive human–robot interaction to motivate physical exercise for older adults. Proc IEEE 100(8):2512–2526

    Article  Google Scholar 

  6. Mitsunaga N, Smith C, Kanda T, Ishiguro H, Hagita N (2008) Adapting robot behavior for human–robot interaction. IEEE Trans Robot 24(4):911–916

    Article  Google Scholar 

  7. Calinon S, Sardellitti I, Caldwell DG (2010) Learning-based control strategy for safe human–robot interaction exploiting task and robot redundancies. In: IEEE/RSJ international conference on intelligent robots and systems, Taibei, Taiwan, pp 249–254

  8. Broz F, Nourbakhsh I, Simmons R (2013) Planning for human–robot interaction in socially situated tasks. Int J Soc Robot 5(2):193–241

    Article  Google Scholar 

  9. Chen L-F, Liu Z-T, Dong F-Y, Yamazaki Y, Wu M, Hirota K (2013) Adapting multi-robot behavior to communication atmosphere in humans–robots interaction using fuzzy production rule based friend-Q learning. J Adv Comput Intell Intell Inf 17(2):291–301

    Google Scholar 

  10. Chen L-F, Liu Z-T, Wu M, Dong F-Y, Yamazaki Y, Wu M, Hirota K (2014) Multi-robot behavior adaptation to local and global communication atmosphere in humans–robots interaction. J Multimodal User Interfaces 8(3):289–303

    Article  Google Scholar 

  11. Drenner A, Janssen M, Kottas A et al (2013) Coordination and longevity in multi-robot teams involving miniature robots. J Intell Robot Syst 72(2):263–284

    Article  Google Scholar 

  12. Geiger A, Lauer M, Urtasun R (2011) A generative model for 3D urban scene understanding from movable platforms. In: IEEE conference on computer vision and pattern recognition, Colorado, USA, pp 1945–1952

  13. Roberson MJ, Bohg J, Skantze GL, Gustafson J, Carlson R, Rasolzadeh B, Kragic D (2011) Enhanced visual scene understanding through human–robot dialog. In: IEEE/RSJ international conference on intelligent robots and systems, San Francisco, USA, pp 3342–3348

  14. Bergh MV, Carton D, Nijs RD, Mitsou N, Landsiedel C, Kuehnlenz K, Wollherr D, Gool LV, Buss M (2011) Real-time 3D hand gesture interaction with a robot for understanding directions from humans. In: IEEE international symposium on robot and human interactive communication, Atlanta, USA, pp 357–362

  15. Mohiyeddini C, Pauli R, Bauer S (2009) The role of emotion in bridging the intention behaviour gap: the case of sports participation. Psychol Sport Exerc 10(2):226–234

    Article  Google Scholar 

  16. Olsson A, Ochsner KN (2007) The role of social cognition in emotion. Cogn-Emot Interact 12(2):65–71

    Google Scholar 

  17. Vapnik VN (2000) The nature of statistical learning theory. Springer, New York

    Book  MATH  Google Scholar 

  18. Bottou L, Vapnik VN (1992) Local learning algorithms. Neutal Comput 4(6):888–900

    Google Scholar 

  19. Shafi A, Vishanth W (2009) Understanding citizens’ behavioural intention in the adoption of e-government services in the state of Qatar. In: European conference on information systems, Verona, Italy

  20. Orji RO (2010) Impact of gender and nationality on acceptance of a digital library: an empirical validation of nationality based UTAUT using SEM. J Emerg Trends Comput Inf Sci 1(2):68–79

    Google Scholar 

  21. Holland C, Hill R (2007) The effect of age, gender and driver status on pedestrians’ intentions to cross the road in risky situations intentions to cross the road in risky situations. Accid Anal Prev 39(2):224–237

    Article  Google Scholar 

  22. Keysar B (1994) The illusory transparencyof intentoin: linguistic perspective taking in tex. Cogn Psychol 26(2):165–208

    Article  Google Scholar 

  23. Hanheide M, Lohse M, Zender H (2012) Expectations, intentions, and actions in human–robot interaction. Int J Soc Robot 4(2):107–108

    Article  Google Scholar 

  24. Hirota K, Dong F (2008) Development of mascot robot system in NEDO project. In: International IEEE conference on intelligent systems, Varna, Bulgaria, pp 1–38-1-44

  25. Cortes C, Vapnik VN (1995) Support-vector networks. Mach Learn 20(3):273–297

    MATH  Google Scholar 

  26. Yu H, Kim J, Kim Y, Hwang S, Lee YH (2012) An efficient method for learning nonlinear ranking SVM functions. Inf Sci 209:37–48

    Article  MathSciNet  Google Scholar 

  27. Tarabalka Y, Fauvel M, Chanussot J, Benediktsson JA (2010) SVM- and MRF-based method for accurate classification of hyperspectral images. IEEE Geosci Remote Sens Lett 7(4):736–740

    Article  Google Scholar 

  28. Moavenian M, Khorrami H (2010) A qualitative comparison of artificial neural networks and support vector machinesin ECG arrhythmias classification. Expert Syst Appl 37(4):3088–3093

    Article  Google Scholar 

  29. Suykens JAK, Vandewalle J, Moor BD (2001) Optimal control by least squares support vector machines. Neural Netw 14(1):23–25

    Article  Google Scholar 

  30. Ismail S, Shabri A, Samsudin R (2011) A hybrid model of self-organizing maps (SOM) and least square supportvector machine (LSSVM) for time-series forecasting. Expert Syst Appl 38(8):10574–10578

    Article  Google Scholar 

  31. Huang C (2012) A reduced support vector machine approach for interval regression analysis. Inf Sci 217:56–64

    Article  MATH  Google Scholar 

  32. Ferreira JP, Crisostomo MM, Coimbra AP (2013) Adaptive PD controller modeled via support vector regression for a biped robot. IEEE Trans Control Syst Technol 21(3):941–949

    Article  Google Scholar 

  33. Dunn JC (1973) A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. J Cybern 3(3):32–57

    Article  MathSciNet  MATH  Google Scholar 

  34. Bezdek JC (1980) A convergence theorem for the fuzzy ISODATA clustering algorithms. IEEE Trans Pattern Anal Mach Intell PAMI 2(1):1–8

    Article  MATH  Google Scholar 

  35. Dong WM, Wong FS (1987) Fuzzy weighted averages and implementation of the extension principle. Fuzzy Sets Syst 21(2):183–199

    Article  MathSciNet  MATH  Google Scholar 

  36. Keltner D, Haidt J (1999) Social functions of emotions at four levels of anysis. Cogn Emot 13(5):505–521

    Article  Google Scholar 

  37. Spoor JR, Kelly JR (2004) The evolutionary significance of affect in groups: communication and group bonding. Group Process Intergroup Prelations 7(4):398–412

    Article  Google Scholar 

  38. Klauer KC, Musch J (2003) Affective priming: findings and theories. Psychology of evaluation: affective processes in cognition and emotion. Lawrence Erlbaum, USA, pp 7–49

  39. Jain AK, Dubes RC (1988) Algorithms for clustering data. Prentice Hall, Englewood Cliffs

    MATH  Google Scholar 

  40. Liu Z-T, Mu Z, Chen L-F et al (2012) Emotion recognition of violin music based on strings music theory for mascot robot system. In: 9th international conference on informatics in control, automation and robotics, Rome, Italy, pp 5–14

  41. Yamazaki Y, Hatakeyama Y, Dong F-Y, Nomoto K, Hirota K (2008) Fuzzy inference based mentality expression for eye robot in affinity pleasure-arousal space. J Adv Comput Intell Intell Inf 12(3):304–313

    Google Scholar 

  42. Farchi G, Fidanza F, Giampaoli S, Mariotti S, Menotti A (2000) Alcohol and survival in the Italian rural cohorts of the seven countries study. Int J Epidemiol 29:667–671

    Article  Google Scholar 

  43. Tang Y-K, Dong F-Y, Yuhki M, Yamazaki Y, Shibata T, Hirota K (2013) Deep level situation understanding and its application to casual communication between robots and humans. In: Internaitonal conference on informatics in control. Automation and robotics, Reykjavik, Iceland, pp 292–299

  44. Liu Z-T, Wu M, Li D-Y, Chen L-F, Dong F-Y, Yamazaki Y, Hirota K (2013) Communication atmosphere in humans–robots interaction based on the concept of fuzzy atmosphere generated by emotional states of humans and robots. J Autom Mobile Robot Intell Syst 7(2):52–63

    Google Scholar 

  45. Kelley R, Tavakkoli A, King C, Nicolescu M, Nicolescu M, Bebis G (2008) Understanding human intentions via hidden markov models in autonomous mobile robots. In: Proceedings of the 3rd ACM/IEEE international conference on human robot interaction, Amsterdam, Netherlands, pp 367–374

  46. Bicho E, Erlhagen W, Sousa E et al (2012) The power of prediction: robots that read intentions. In: IEEE/RSJ international conference on intelligent robots and systems, Vilamoura, Portugal, pp 5458–5459

Download references

Acknowledgments

We thank reviewers for their valuable suggestions on improving the quality of the paper. We are also grateful to Jiajun Lu and Maslina Binti Zolkepli for their help with the paper’s revision. This work was supported by the National Natural Science Foundation of China under Grant Nos. 61210011 and 61403422.

Author information

Authors and Affiliations

  1. Department of Computational Intelligence and Systems Science, Tokyo Institute of Technology, Yokohama, 226-8502, Japan

    Lue-Feng Chen, Fang-Yan Dong & Kaoru Hirota

  2. School of Automation, China University of Geosciences, Wuhan, 430074, China

    Zhen-Tao Liu, Min Wu & Min Ding

Authors
  1. Lue-Feng Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhen-Tao Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Min Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Min Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fang-Yan Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Kaoru Hirota
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lue-Feng Chen.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, LF., Liu, ZT., Wu, M. et al. Emotion-Age-Gender-Nationality Based Intention Understanding in Human–Robot Interaction Using Two-Layer Fuzzy Support Vector Regression. Int J of Soc Robotics 7, 709–729 (2015). https://doi.org/10.1007/s12369-015-0290-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12369-015-0290-2

Keywords

Search

Navigation