Abstract
In this study, we analyzed color changed by wetness in various areas on palm to clarify the influence of highlights. To improve the accuracy of emotion estimation, it is necessary to suggest other modalities combined with the conventional modalities. Therefore, we focused on emotional sweating, which is reliable modality of contact methods but not used in non-contact methods. We analyzed the color change in images containing a few highlights to clarify the influence of sharp highlights because the highlights can be noise for the analysis of internal reflection change by getting wet. The sharp highlight means the bright pixels in images of gloss material. We also analyzed areas separated from pixels representing sharp highlights to unveil the influence of the sharp highlights. As a result, we found that sharp highlights have a little influence on the analysis and better detection can be performed on pixels not containing sharp highlight area.
Similar content being viewed by others
References
THE WIDE IMAGE, “Ageing Japan: Robot’s role in future of elder care”. <https://widerimage.reuters.com/story/ageing-japan-robots-role-in-future-of-elder-care>. Accessed 31 May 2019
FORTUNE, “Pepper the Robot Has a New Job at HSBC Bank”. <http://fortune.com/2018/06/27/pepper-the-robot-hsbc-job/>. Accessed 31 May 2019
DailyMail, “Pepper the ‘emotional’ robot sells out in ONE MINUTE: 1,000 models of the Japanese humanoid sell for $1,600 each”. <http://www.dailymail.co.uk/sciencetech/article-3134746/Pepper-emotional-robot-sells-ONE-MINUTE-1-000-models-Japanese-humanoid-sell-1-600-each.html>. Accessed 8 Feb 2019
McDuff D, Kaliouby RE, Cohn JF et al (2015) Predicting ad liking and purchase intent: large-scale analysis of facial responses to ads. IEEE Trans Affect Comput 6(3):223–235
Mansoorizadeh M, Charkari NM (2010) Multimodal information fusion application to human emotion recognition from face and speech. Multimed Tools Appl 49(2):277–297
Monkaresi H, Bosch N, Calvo RA et al (2017) Automated detection of engagement using video-based estimation of facial expressions and heart rate. IEEE Trans Affect Comput 8(1):15–28
Okada G, Masui K, Tsumura N (2018), Advertisement effectiveness estimation based on crowdsourced multimodal affective responses. In: Proceedings of the IEEE Conference on computer vision and pattern recognition workshops, pp 1263–1271
Wilke K, Martin A, Terstegen L et al (2007) A short history of sweat gland biology. Int J Cosmet Sci 29(3):169–179
International League of Polygraph Examiners, “Polygraoh/Lie Detector FAQs”. <http://www.theilpe.com/faq_eng.html>. Accessed 31 May 2019
Uchida M, Nomura I, Tsumura N (2018), Color-based non-contact analysis of skin changed by sweating for emotion estimation. Society for Imaging Science and Technology, In Color and Imaging Conference, Vancouver Canada, Nov 12–16, 2018, vol 2018(1): 253–258
Lekner J, Dorf MC (1988) Why some things are getting darker when wet. Appl Opt 27(7):1278–1280
Twomey SA, Bohren CF, Mergenthaler JL (1986) Reflectance and albedo differences between wet and dry surfaces. Appl Opt 25:431–437
Motoyoshi I, Nishida S, Sharan L et al (2007) Image statistics and the perception of surface qualities. Nature 447(7141):206
Sawayama M, Adelson EH, Nishida S (2017) Visual wetness perception based on image color statistics. J Vis 17(5):7
Poynton C (2003) Digital video and HDTV. Morgan-Kaufmann, California, p 226
Wu H-Y, Rubinstein M, Shih E, Guttag J, Durand F, Freeman W (2016) Eulerian video magnification for revealing subtle changes in the world. ACM Trans Graph 60(1):87–95
Poh MZ, McDuff D, Picard RW (2011) Advancements in noncontact, multiparameter physiological measurements using a webcam. IEEE Trans Biomed Eng 58(1):7–11
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Uchida, M., Tsumura, N. Skin color image analysis for evaluating wetness on palm with reducing influence of sharp highlights. Artif Life Robotics 24, 505–511 (2019). https://doi.org/10.1007/s10015-019-00543-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10015-019-00543-z