Abstract
Electronic signatures are widely used in financial business, telecommuting, and identity authentication. Offline electronic signatures are vulnerable to copy or replay attacks. Contact-based online electronic signatures are limited by indirect contact such as handwriting pads and may threaten the health of users. Consider combining hand shape features and writing process features to form electronic signatures, the article proposes an in-air handwritten signature verification system with millimeter-wave(mmWave) radar, namely mmHSV. First, the biometrics of the handwritten signature process are modeled, and phase-dependent biometrics and behavioral features are extracted from the mmWave radar mixture signal. Secondly, a handwritten feature recognition network based on few-sample learning is presented to fuse multi-dimensional features and determine user legitimacy. Finally, mmHSV is implemented and evaluated with commercial mmWave devices in different scenarios and attack mode conditions. Experimental results show that the mmHSV can achieve accurate, efficient, robust and scalable handwritten signature verification. Area Under Curve (AUC) is 98.96%, False Acceptance Rate (FAR) is 5.1% at the fixed threshold, AUC is 97.79% for untrained users.
- [1] . 2009. Biometric authentication: A review. International Journal of u-and e-Service, Science and Technology 2, 3 (2009), 13–28.Google Scholar
- [2] . 2020. Silentsign: Device-free handwritten signature verification through acoustic sensing. In Proceedings of the 2020 IEEE International Conference on Pervasive Computing and Communications (PerCom’20). IEEE, 1–10.Google ScholarCross Ref
- [3] . 1990. STL: A seasonal-trend decomposition. Journal of Official Statistics 6, 1 (1990), 3–73.Google Scholar
- [4] . 2019. ASSV: Handwritten signature verification using acoustic signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1–22.Google ScholarDigital Library
- [5] . 2017. A novel video-based system for in-air signature verification. Computers & Electrical Engineering 57 (2017), 1–14. Google ScholarDigital Library
- [6] . 2019. Wearables-driven freeform handwriting authentication. IEEE Transactions on Biometrics, Behavior, and Identity Science 1, 3 (2019), 152–164.Google ScholarCross Ref
- [7] . 2020. Through fog high-resolution imaging using millimeter wave radar. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11464–11473.Google ScholarCross Ref
- [8] . 2017. Learning dynamic siamese network for visual object tracking. In Proceedings of the IEEE International Conference on Computer Vision. 1763–1771.Google ScholarCross Ref
- [9] . 2006. Dimensionality reduction by learning an invariant mapping. In Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), Vol. 2. IEEE, 1735–1742.Google ScholarDigital Library
- [10] . 2016. One-class writer-independent offline signature verification using feature dissimilarity thresholding. IEEE Transactions on Information Forensics and Security 11, 6 (2016), 1226–1238.Google ScholarDigital Library
- [11] . 2005. Exact indexing of dynamic time warping. Knowledge and Information Systems 7, 3 (2005), 358–386.Google ScholarCross Ref
- [12] . 2019. Fingerpass: Finger gesture-based continuous user authentication for smart homes using commodity wifi. In Proceedings of the 20th ACM International Symposium on Mobile Ad Hoc Networking and Computing. 201–210.Google ScholarDigital Library
- [13] . 2018. Recurrent adaptation networks for online signature verification. IEEE Transactions on Information Forensics and Security 14, 6 (2018), 1624–1637.Google ScholarDigital Library
- [14] . 2020. Handwritten signature authentication using smartwatch motion sensors. In Proceedings of the 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC’20). IEEE, 1589–1596.Google ScholarCross Ref
- [15] . 2020. VocalPrint: Exploring a resilient and secure voice authentication via mmWave biometric interrogation. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 312–325.Google ScholarDigital Library
- [16] . 2022. mTransSee: Enabling environment-independent mmWave sensing based gesture recognition via transfer learning. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1–28.Google ScholarDigital Library
- [17] . 2021. Wavoice: A noise-resistant multi-modal speech recognition system fusing mmWave and audio signals. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 97–110.Google ScholarDigital Library
- [18] . 2000. Mel frequency cepstral coefficients for music modeling. In Proceedings of the International Symposium on Music Information Retrieval. Citeseer.Google Scholar
- [19] . 2020. Contactless simultaneous measurement method for breathing and heartbeat rates using millimeter-waves. In Proceedings of the 2020 14th International Symposium on Medical Information Communication Technology (ISMICT’20). IEEE, 1–4.Google ScholarCross Ref
- [20] . 2021. mmWrite: Passive handwriting tracking using a single millimeter-wave radio. IEEE Internet of Things Journal 8, 17 (2021), 13291–13305.Google ScholarCross Ref
- [21] . 2021. SquiggleMilli: Approximating SAR imaging on mobile millimeter-wave devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1–26.Google ScholarDigital Library
- [22] . 2012. Online signature verification based on generative models. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 42, 4 (2012), 1231–1242.Google ScholarDigital Library
- [23] . 2007. Toward accurate dynamic time warping in linear time and space. Intelligent Data Analysis 11, 5 (2007), 561–580.Google ScholarDigital Library
- [24] . 2020. mmASL: Environment-independent asl gesture recognition using 60 ghz millimeter-wave signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1–30.Google ScholarDigital Library
- [25] . 2016. Evaluation of handwriting characteristic for two-factor authentication interface on touch-pad panel. In Proceedings of the ICE-B. 106–111.Google ScholarDigital Library
- [26] . 2016. Online signature verification based on stable features extracted dynamically. IEEE Transactions on Systems, Man, and Cybernetics: Systems 47, 10 (2016), 2663–2676.Google ScholarCross Ref
- [27] . 2021. mmHRV: Contactless heart rate variability monitoring using millimeter-wave radio. IEEE Internet of Things Journal 8, 22 (2021), 16623–16636.Google ScholarCross Ref
- [28] . 2021. SVSV: Online handwritten signature verification based on sound and vibration. Information Sciences 572 (2021), 109–125. Google ScholarDigital Library
- [29] . 2020. mmTrack: Passive multi-person localization using commodity millimeter wave radio. In Proceedings of the IEEE INFOCOM 2020-IEEE Conference on Computer Communications. IEEE, 2400–2409.Google ScholarDigital Library
- [30] . 2021. CardiacWave: A mmWave-based scheme of non-contact and high-definition heart activity computing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1–26.Google ScholarDigital Library
- [31] . 2017. Challenge-response authentication using in-air handwriting style verification. IEEE Transactions on Dependable and Secure Computing 17, 1 (2017), 51–64.Google ScholarDigital Library
- [32] . 2020. MU-ID: Multi-user identification through gaits using millimeter wave radios. In Proceedings of the IEEE INFOCOM 2020-IEEE Conference on Computer Communications. IEEE, 2589–2598.Google ScholarDigital Library
- [33] . 2022. CornerRadar: RF-based indoor localization around corners. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1–24.Google ScholarDigital Library
- [34] . 2018. Latern: Dynamic continuous hand gesture recognition using FMCW radar sensor. IEEE Sensors Journal 18, 8 (2018), 3278–3289.Google ScholarCross Ref
- [35] . 2021. Smartphone-based handwritten signature verification using acoustic signals. Proceedings of the ACM on Human–Computer Interaction 5, ISS (2021), 1–26.Google ScholarDigital Library
Index Terms
- mmHSV: In-Air Handwritten Signature Verification via Millimeter-Wave Radar
Recommendations
mmSign: mmWave-based Few-Shot Online Handwritten Signature Verification
Handwritten signature verification has become one of the most important document authentication methods that are widely used in the financial, legal, and administrative sectors. Compared to offline methods based on static signature images, online ...
Hindi Off-Line Signature Verification
ICFHR '12: Proceedings of the 2012 International Conference on Frontiers in Handwriting RecognitionHandwritten Signatures are one of the widely used biometrics for document authentication as well as human authorization. The purpose of this paper is to present an off-line signature verification system involving Hindi signatures. Signature verification ...
Online handwritten signature verification using feature weighting algorithm relief
Online handwritten signatures are widely used as a reliable identity authentication technology in industries such as banking, insurance and hospitals. Most existing online handwritten signature verification schemes usually choose the same feature sets ...
Comments