skip to main content
research-article

RF-Copybook: A Millimeter Level Calligraphy Copybook based on commodity RFID

Published: 08 January 2018 Publication History

Abstract

As one of the best ways to learn and appreciate the Chinese culture, Chinese calligraphy is widely practiced and learned all over the world. Traditional calligraphy learners spend a great amount of time imitating the image templates of reputed calligraphers. In this paper, we propose an RF-based Chinese calligraphy template, named RF-Copybook, to precisely monitor the writing process of the learner and provide detail instructions to improve the learner's imitating behavior. With two RFID tags attached on the brush pen and three antennas equipped at the commercial RFID reader side, RF-Copybook tracks the pen's 3-dimensional movements precisely. The key intuition behind RF-Copybook's idea is that: (i) when there is only direct path signal between the tag and the antenna, the phase measured at the reader changes linearly with the distance, (ii) the reader offers very fine-grained phase readings, thus a millimeter level accuracy of antenna-tag distance can be obtained, (iii) by combing multiple antenna-tag distances, we can quantify the writing process with stroke based feature models. Extensive experiments show that RF-Copybook is robust against the environmental noise and achieves high accuracies across different environments in the estimation of the brush pen's elevation angle, nib's moving speed and position.

References

[1]
Fadel Adib, Zachary Kabelac, and Dina Katabi. 2015. Multi-person localization via RF body reflections. In USENIX NSDI. 279--292.
[2]
Fadel Adib, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2014. 3D tracking via body radio reflections. In USENIX NSDI. 317--329.
[3]
Sandip Agrawal, Ionut Constandache, Shravan Gaonkar, Romit Roy Choudhury, Kevin Caves, and Frank Deruyter. 2011. Using mobile phones to write in air. In ACM Mobisys. 15--28.
[4]
Kamran Ali, Alex X Liu, Wei Wang, and Muhammad Shahzad. 2015. Keystroke recognition using WiFi signals. In ACM MobiCom. 90--102.
[5]
EPCglobal EPC Gen2. 2017. www.gs1.org/epcglobal. (2017).
[6]
Aug EPCglobal Inc. 2007. Low Level Reader Protocol, Version 1.0. 1. (2007).
[7]
Inc Impinj. 2017. www.impinj.com/products/readers/speedway-revolution/. (2017).
[8]
Manikanta Kotaru, Kiran Joshi, Dinesh Bharadia, and Sachin Katti. 2015. SpotFi: decimeter level localization using WiFi. Acm Sigcomm Computer Communication Review 45, 4 (2015), 269--282.
[9]
Swarun Kumar, Stephanie Gil, Dina Katabi, and Daniela Rus. 2014. Accurate indoor localization with zero start-up cost. In ACM MobiCom. 483--494.
[10]
Josh HM Lam and Yeung Yam. 2011. Application of brush footprint geometric model for realization of robotic Chinese calligraphy. In International Conference on Cognitive Infocommunications. 1--5.
[11]
Wei Li, Yuping Song, and Changle Zhou. 2014. Computationally evaluating and synthesizing Chinese calligraphy. Neurocomputing 135 (2014), 299--305.
[12]
Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota. 2016. FingerIO: using active sonar for fine-grained finger tracking. In ACM CHI. 1515--1525.
[13]
Abhinav Parate, Meng-Chieh Chiu, Chaniel Chadowitz, Deepak Ganesan, and Evangelos Kalogerakis. 2014. RisQ: Recognizing Smoking Gestures with Inertial Sensors on a Wristband. In ACM Mobisys. 149--161.
[14]
Taiwoo Park, Jinwon Lee, Inseok Hwang, Chungkuk Yoo, Lama Nachman, and Junehwa Song. 2011. E-gesture: a collaborative architecture for energy-efficient gesture recognition with hand-worn sensor and mobile devices. In ACM SenSys. 260--273.
[15]
Souvik Sen, Romit Roy Choudhury, Bozidar Radunovic, and Tom Minka. 2011. Precise indoor localization using PHY layer information. In ACM Mobisys. 413--414.
[16]
Souvik Sen, Bo Radunovic, Romit Roy Choudhury, and Tom Minka. 2012. You are facing the Mona Lisa: spot localization using PHY layer information. In ACM Mobisys. 183--196.
[17]
Longfei Shangguan and Kyle Jamieson. 2016. Leveraging electromagnetic polarization in a two-antenna whiteboard in the air. In ACM CoNEXT. 443--456.
[18]
Longfei Shangguan, Zheng Yang, Alex X Liu, Zimu Zhou, and Yunhao Liu. 2015. Relative localization of RFID tags using spatial-temporal phase profiling. In USENIX NSDI.
[19]
Cao Shi, Jianguo Xiao, Wenhua Jia, and Canhui Xu. 2013. Character feature integration of Chinese calligraphy and font. In DRR. 86580M.
[20]
Li Sun, Souvik Sen, Dimitrios Koutsonikolas, and Kyu Han Kim. 2015. WiDraw: enabling hands-free drawing in the air on commodity WiFi devices. In ACM MobiCom. 77--89.
[21]
Yuandong Sun, Huihuan Qian, and Yangsheng Xu. 2014. A geometric approach to stroke extraction for the Chinese calligraphy robot. In IEEE International Conference on Robotics and Automation. 3207--3212.
[22]
Alien Tags. 2017. www.alientechnology.com/tags/. (2017).
[23]
He Wang, Tsung Te Lai, and Romit Roy Choudhury. 2015. MoLe: Motion Leaks through Smartwatch Sensors. In ACM MobiCom. 155--166.
[24]
Ju Wang, Hongbo Jiang, Jie Xiong, Kyle Jamieson, Xiaojiang Chen, Dingyi Fang, and Binbin Xie. 2016. LiFS: low human-effort, device-free localization with fine-grained subcarrier information. In ACM MobiCom. 243--256.
[25]
Jue Wang and Dina Katabi. 2013. Dude, where's my card? RFID positioning that works with multipath and non-line of sight. ACM Sigcomm Computer Communication Review 43, 4 (2013), 51--62.
[26]
Jue Wang, Deepak Vasisht, and Dina Katabi. 2014. RF-IDraw: virtual touch screen in the air using RF signals. ACM Sigcomm Computer Communication Review 44, 4 (2014), 235--246.
[27]
Mengdi Wang, Qian Fu, Zhongke Wu, Xingce Wang, and Xia Zheng. 2014. A hierarchical evaluation approach of learning Chinese calligraphy. Journal of Computational Information Systems 10, 18 (2014), 8093--8107.
[28]
Yan Wang, Jian Liu, Yingying Chen, Marco Gruteser, Jie Yang, and Hongbo Liu. 2014. E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures. In ACM MobiCom. 617--628.
[29]
Teng Wei and Xinyu Zhang. 2015. mTrack: high-precision passive tracking using millimeter wave radios. In ACM MobiCom. 117--129.
[30]
Sam Tak-sum Wong, Howard Leung, and Horace Ho-shing Ip. 2006. Fitting ellipses to a region with application in calligraphic stroke reconstruction. In IEEE Image Processing. 397--400.
[31]
Yingfei Wu, Yueting Zhuang, Yunhe Pan, and Jiangqin Wu. 2006. Web based chinese calligraphy learning with 3D visualization method. In IEEE Multimedia and Expo. 2073--2076.
[32]
Lei Yang, Yekui Chen, Xiang Yang Li, Chaowei Xiao, Mo Li, and Yunhao Liu. 2014. Tagoram: real-time tracking of mobile RFID tags to high precision using COTS devices. In ACM MobiCom. 237--248.
[33]
Lijie Yang and Xiaoshan Li. 2009. Animating the brush-writing process of Chinese calligraphy characters. In IEEE/ACIS Conference on Computer and Information Science. 683--688.
[34]
Sangki Yun, Yi Chao Chen, and Lili Qiu. 2015. Turning a mobile device into a mouse in the air. In ACM Mobisys. 15--29.
[35]
Yueting Zhuang, Xiafen Zhang, Weiming Lu, and Fei Wu. 2005. Web-Based Chinese Calligraphy Retrieval and Learning System. In ICWL. 186--196.

Cited By

View all
  • (2024)SuperSight: Sub-cm NLOS Localization for mmWave BackscatterProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661857(278-291)Online publication date: 3-Jun-2024
  • (2024)ScribeProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314117:4(1-31)Online publication date: 12-Jan-2024
  • (2023)The Indoor Positioning Method Time Difference of Arrival with Conic Curves Utilizing a Novel Networking RFID SystemElectronics10.3390/electronics1215323612:15(3236)Online publication date: 26-Jul-2023
  • Show More Cited By

Index Terms

  1. RF-Copybook: A Millimeter Level Calligraphy Copybook based on commodity RFID

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 1, Issue 4
    December 2017
    1298 pages
    EISSN:2474-9567
    DOI:10.1145/3178157
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 January 2018
    Accepted: 01 October 2017
    Revised: 01 August 2017
    Received: 01 May 2017
    Published in IMWUT Volume 1, Issue 4

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Antenna-tag Distance
    2. Chinese Calligraphy
    3. Phase
    4. RFID

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)19
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 03 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)SuperSight: Sub-cm NLOS Localization for mmWave BackscatterProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661857(278-291)Online publication date: 3-Jun-2024
    • (2024)ScribeProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314117:4(1-31)Online publication date: 12-Jan-2024
    • (2023)The Indoor Positioning Method Time Difference of Arrival with Conic Curves Utilizing a Novel Networking RFID SystemElectronics10.3390/electronics1215323612:15(3236)Online publication date: 26-Jul-2023
    • (2023)RF SignWireless Communications & Mobile Computing10.1155/2023/13411932023Online publication date: 1-Jan-2023
    • (2022)Investigating Cross-Modal Approaches for Evaluating Error Acceptability of a Recognition-Based Input TechniqueProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35172626:1(1-24)Online publication date: 29-Mar-2022
    • (2022)On Privacy Risks of Watching YouTube over Cellular Networks with Carrier AggregationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35172616:1(1-22)Online publication date: 29-Mar-2022
    • (2022)InDepthProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35172606:1(1-25)Online publication date: 29-Mar-2022
    • (2022)Ultra Low-Latency Backscatter for Fast-Moving Location TrackingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35172426:1(1-22)Online publication date: 29-Mar-2022
    • (2022)Towards Robust Gesture Recognition by Characterizing the Sensing Quality of WiFi SignalsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35172416:1(1-26)Online publication date: 29-Mar-2022
    • (2022)EyeQoEProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35172406:1(1-26)Online publication date: 29-Mar-2022
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media