Abstract
This paper presents a novel strategy to implement a CAPTCHA (Completely Automated Public Turing test to tell Computers and Humans Apart). The aim of these tests is to easily and reliably distinguish between real human users and (malicious) bots. The approach underlying FATCHA is to exploit real time capture of human actions instead of human ability to recognize visual or auditory items. The latter approach explicitly requires proposing a challenge difficult for an automatic responder but easy for a human. However, it is often the case that pursuing the first feature takes to lose the second one. Moreover the user task may be hindered by specific disabilities. According to FATCHA approach the system rather asks the user to carry out some trivial gesture, e.g., rotating or moving the head. The webcam, which is available in almost all computers or mobile devices, captures the user gesture, and the server (hosting the service to protect) matches it with the requested one. It is possible to extend the service with a second module that allows the user to authenticate himself by face recognition instead of using a password. On the contrary, FATCHA gesture challenge can be used as a liveliness test to avoid biometric spoofing. Multimodal interaction is the base for both an advanced Human Interactive Proof (HIP) test and for robust/comfortable authentication.
Similar content being viewed by others
References
Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: Application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041
Almazyad AS, Ahmad Y, Kouchay SA (2011) Multi-modal captcha: a user verification scheme. In: International conference on information science and applications (ICISA), 2011, pp 1–7. IEEE
Bianchini CS, Borgia F, De Marsico M (2012) Swift-a signwriting editor to bridge between deaf world and e-learning. In: IEEE 12th international conference on advanced learning technologies (ICALT), 2012, pp 526–530. IEEE
Bursztein E, Bethard S, Fabry C, Mitchell JC, Jurafsky D (2010) How good are humans at solving captchas? A large scale evaluation. Accessed: 2015-12-04. http://www.stanford.edu/jurafsky/burszstein_2010_captcha.pdf
Bursztein E, Martin M, Mitchell J (2011) Text-based captcha strengths and weaknesses. In: Proceedings of the 18th ACM conference on computer and communications security, pp 125–138. ACM
Bushell D (2011) In search of the perfect CAPTCHA. Accessed: 2015-12-04. http://www.smashingmagazine.com/2011/03/in-search-of-the-perfect-captcha/
Datta R, Li J, Wang JZ (2005) Imagination: a robust image-based captcha generation system. In: Proceedings of the 13th annual ACM international conference on multimedia, pp 331– 334. ACM
De Marsico M, Marchionni L, Novelli A, Oertel M (2015) Fatcha: the captcha are you!. In: Proceedings of the 11th biannual conference on italian SIGCHI chapter, pp 118–125. ACM
Gossweiler R, Kamvar M, Baluja S (2009) What’s up captcha?: a captcha based on image orientation. In: Proceedings of the 18th international conference on world wide web, pp 841–850. ACM
Goswami G, Singh R, Vatsa M, Powell B, Noore A (2012) Face recognition captcha. In: IEEE fifth international conference on biometrics: theory, applications and systems (BTAS), 2012, pp 412–417. IEEE
Hernandez-Castro CJ, Ribagorda A, Saez Y (2010) Side-channel attack on the humanauth captcha. In: Proceedings of the 2010 international conference on security and cryptography (SECRYPT), pp 1–7. IEEE
May M (2005) Inaccessibility of captcha. Alternatives to visual turing tests on the web. I: W3C (red.), W3C Working Group Note, work in progress
Misra D, Gaj K (2006) Face recognition captchas. In: International conference on internet and web applications and services/advanced international conference on telecommunications, 2006. AICT-ICIW’06, pp 122–122. IEEE
Mori G, Malik J (2003) Recognizing objects in adversarial clutter: Breaking a visual captcha. In: IEEE computer society conference on computer vision and pattern recognition, 2003. Proceedings. 2003, vol 1, pp i–134. IEEE
Pantic M, Rothkrantz LJ (2004) Facial action recognition for facial expression analysis from static face images. IEEE Trans Syst Man Cybern Part B Cybern 34(3):1449–1461
Petrie H, Bevan N (2009) The evaluation of accessibility, usability and user experience. The universal access handbook, pp 10–20
Poh N, Blanco-Gonzalo R, Wong R, Sanchez-Reillo R (2016) Blind subjects faces database. IET Biom 5(1):20–27
Power C, Freire A, Petrie H, Swallow D (2012) Guidelines are only half of the story: accessibility problems encountered by blind users on the web. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 433–442. ACM
Rathgeb C, Uhl A (2011) A survey on biometric cryptosystems and cancelable biometrics. EURASIP J Inf Secur 2011(1):1–25
Roshanbin N, Miller J (2013) A survey and analysis of current captcha approaches. Journal of Web Engineering 12(1–2):1–40
Rui Y, Liu Z (2004) Artifacial: Automated reverse turing test using facial features. Multimedia Systems 9(6):493–502
Schapire RE (2003) The boosting approach to machine learning: an overview. In: Nonlinear estimation and classification, pp 149–171. Springer
Shirali-Shahreza M, Shirali-Shahreza S (2007) Captcha for blind people. In: IEEE international symposium on signal processing and information technology, 2007, pp 995–998. IEEE
Shirali-Shahreza M, Shirali-Shahreza S (2008) Motion captcha. In: Conference on human system interactions, 2008, pp 1042–1044. IEEE
Shirali-Shahreza MH, Shirali-Shahreza M (2007) Localized captcha for illiterate people. In: International conference on intelligent and advanced systems, 2007. ICIAS 2007, pp 675–679. IEEE
Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition, 2001. CVPR 2001, vol 1, pp i–511. IEEE
Von Ahn L, Maurer B, McMillen C, Abraham D, Blum M (2008) Recaptcha: human-based character recognition via web security measures. Science 321(5895):1465–1468
W3C - Web Accessibility Initiative: Captcha alternatives and thoughts. http://www.w3.org/WAI/GL/wiki/Captcha_Alternatives_and_thoughts (2015). Last Modified: 2015-08-28; Accessed: 2015-12-04
Weinland D, Ronfard R, Boyer E (2011) A survey of vision-based methods for action representation, segmentation and recognition. Comput Vis Image Underst 115(2):224–241
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
De Marsico, M., Marchionni, L., Novelli, A. et al. FATCHA: biometrics lends tools for CAPTCHAs. Multimed Tools Appl 76, 5117–5140 (2017). https://doi.org/10.1007/s11042-016-3518-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-016-3518-8