skip to main content
10.1145/3666025.3699321acmconferencesArticle/Chapter ViewAbstractPublication PagessensysConference Proceedingsconference-collections
research-article

ASLiquid: Non-Intrusive Liquid Counterfeit Identification with Your Earphones

Published: 04 November 2024 Publication History

Abstract

As society progresses, liquid identification plays an increasingly important role in human life. But for now, minority of existing liquid identification solutions on the market can meet daily requirements of being ubiquitous, cost-effective and non-intrusive enough. In this work, we propose ASLiquid, the first liquid counterfeit identification system with commercial off-the-shelf earphones. Our core insight is that earphones can effectively induce acoustic resonance in container, and this phenomenon is observed highly associated with the changes in liquid density and solute compositions. Deploying ASLiquid introduces three main challenges: hardware heterogeneity among different earphones, diversity of user operations, and data complexity due to variations in liquid volume and device placement. To address these issues, we first propose to eliminate the existence of hardware noise and frequency response diversity for an earphone-irrelevant solution. Afterwards, we design a user operation adaptation algorithm to extract valuable feature data during each measurement period. To alleviate problems in data complexity, we propose a spectrum projection algorithm that can effectively generate CFR data of unknown liquid volumes and a VAE based anomaly detection model for counterfeit identification. We evaluate our system with six different earphones and under various conditions. Experimental results reveal that ASLiquid can achieve F1 scores of 95%-99.25% for seven frequently occurring liquid counterfeit tasks, even in specialized attacks on liquids with 1% difference in mass fraction and different types of solutions but with the same density.

References

[1]
2021. Alcoholic Drinks Market Size, Share and Trends Analysis Report By Type (Beer, Spirits, Wine, Cider, Perry and Rice Wine, Hard Seltzer). https://www.grandviewresearch.com/industry-analysis/alcoholic-drinks-market-report/.
[2]
2022. Warning to Christmas shoppers after police uncover $60,000 worth of counterfeit perfume. https://www.cityoflondon.police.uk/.
[3]
2022. What is Fake Alcohol? https://cpdonline.co.uk/knowledge-base/mental-health/fake-alcohol/.
[4]
2023. Earphones And Headphones Market Size. https://www.grandviewresearch.com/industry-analysis/earphone-and-headphone-market.
[5]
RK Amiet. 1978. Refraction of sound by a shear layer. Journal of Sound and Vibration 58, 4 (1978), 467--482.
[6]
Kecheng An, Qian Zhang, and Elaine Kwong. 2021. Viscocam: Smartphone-based drink viscosity control assistant for dysphagia patients. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1--25.
[7]
Yin Bi, Mingsong Lv, Chen Song, Wenyao Xu, Nan Guan, and Wang Yi. 2015. AutoDietary: A wearable acoustic sensor system for food intake recognition in daily life. IEEE Sensors Journal 16, 3 (2015), 806--816.
[8]
Chao Cai, Henglin Pu, Peng Wang, Zhe Chen, and Jun Luo. 2021. We hear your pace: Passive acoustic localization of multiple walking persons. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 2 (2021), 1--24.
[9]
Gaoshuai Cao, Kuang Yuan, Jie Xiong, Panlong Yang, Yubo Yan, Hao Zhou, and Xiang-Yang Li. 2020. Earphonetrack: involving earphones into the ecosystem of acoustic motion tracking. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 95--108.
[10]
Ashutosh Dhekne, Mahanth Gowda, Yixuan Zhao, Haitham Hassanieh, and Romit Roy Choudhury. 2018. Liquid: A wireless liquid identifier. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. 442--454.
[11]
Xiaoran Fan, Longfei Shangguan, Siddharth Rupavatharam, Yanyong Zhang, Jie Xiong, Yunfei Ma, and Richard Howard. 2021. HeadFi: bringing intelligence to all headphones. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 147--159.
[12]
Yaxiang Fan, Gongjian Wen, Deren Li, Shaohua Qiu, Martin D Levine, and Fei Xiao. 2020. Video anomaly detection and localization via gaussian mixture fully convolutional variational autoencoder. Computer Vision and Image Understanding 195 (2020), 102920.
[13]
Chao Feng, Jie Xiong, Liqiong Chang, Ju Wang, Xiaojiang Chen, Dingyi Fang, and Zhanyong Tang. 2019. Wimi: Target material identification with commodity wi-fi devices. In 2019 IEEE 39th International Conference on Distributed Computing Systems. 700--710.
[14]
Anthony P French. 1983. In vino veritas: A study of wineglass acoustics. American Journal of Physics 51, 8 (1983), 688--694.
[15]
Yang Gao, Wei Wang, Vir V Phoha, Wei Sun, and Zhanpeng Jin. 2019. EarEcho: Using ear canal echo for wearable authentication. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1--24.
[16]
Jort F Gemmeke, Daniel PW Ellis, Dylan Freedman, Aren Jansen, Wade Lawrence, R Channing Moore, Manoj Plakal, and Marvin Ritter. 2017. Audio set: An ontology and human-labeled dataset for audio events. In IEEE international conference on acoustics, speech and signal processing. IEEE, 776--780.
[17]
Xiuzhen Guo, Long Tan, Tao Chen, Chaojie Gu, Yuanchao Shu, Shibo He, Yuan He, Jiming Chen, and Longfei Shangguan. 2024. Exploring Biomagnetism for Inclusive Vital Sign Monitoring: Modeling and Implementation. In ACM International Conference on Mobile Computing and Networking (MobiCom).
[18]
Unsoo Ha, Junshan Leng, Alaa Khaddaj, and Fadel Adib. 2020. Food and Liquid Sensing in Practical Environments using RFIDs. In 17th USENIX Symposium on Networked Systems Design and Implementation. 1083--1100.
[19]
Jingyang Hu, Hongbo Jiang, Daibo Liu, Zhu Xiao, Qibo Zhang, Jiangchuan Liu, and Schahram Dustdar. 2023. Combining IMU With Acoustics for Head Motion Tracking Leveraging Wireless Earphone. IEEE Transactions on Mobile Computing (2023).
[20]
Yongzhi Huang, Kaixin Chen, Yandao Huang, Lu Wang, and Kaishun Wu. 2021. A portable and convenient system for unknown liquid identification with smartphone vibration. IEEE Transactions on Mobile Computing 22, 4 (2021), 1894--1911.
[21]
Yongzhi Huang, Kaixin Chen, Jiayi Zhao, Lu Wang, and Kaishun Wu. 2023. Beverage deterioration monitoring based on surface tension dynamics and absorption spectrum analysis. IEEE Transactions on Mobile Computing (2023).
[22]
Franz Huber. 2018. A logical introduction to probability and induction. Oxford University Press.
[23]
Gregor Jundt, Adrian Radu, Emmanuel Fort, Jan Duda, Holger Vach, and Neville Fletcher. 2006. Vibrational modes of partly filled wine glasses. The Journal of the Acoustical Society of America 119, 6 (2006), 3793--3798.
[24]
Zhaohui Li, Wei Luo, Yongmin Zhang, Jianxi Chen, Yuanchao Shu, and Yaoxue Zhang. 2024. ASLiquid: Non-Intrusive Liquid Counterfeit Identification with Your Earphones. In Proceedings of the 22nd conference on embedded networked sensor systems. 338--350.
[25]
Yumeng Liang, Anfu Zhou, Huanhuan Zhang, Xinzhe Wen, and Huadong Ma. 2021. FG-LiquID: A contact-less fine-grained liquid identifier by pushing the limits of millimeter-wave sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1--27.
[26]
NN Misra, Yash Dixit, Ahmad Al-Mallahi, Manreet Singh Bhullar, Rohit Upadhyay, and Alex Martynenko. 2020. IoT, big data, and artificial intelligence in agriculture and food industry. IEEE Internet of things Journal 9, 9 (2020), 6305--6324.
[27]
AH Narten and HA Levy. 1971. Liquid water: Molecular correlation functions from x-ray diffraction. The Journal of Chemical Physics 55, 5 (1971), 2263--2269.
[28]
Vasileios Papapanagiotou, Christos Diou, and Anastasios Delopoulos. 2017. Chewing detection from an in-ear microphone using convolutional neural networks. In Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 1258--1261.
[29]
Jialun Peng, Dong Liu, Songcen Xu, and Houqiang Li. 2021. Generating diverse structure for image inpainting with hierarchical VQ-VAE. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10775--10784.
[30]
Allan D Pierce. 1974. Diffraction of sound around corners and over wide barriers. The Journal of the Acoustical Society of America 55, 5 (1974), 941--955.
[31]
Fei Shang, Panlong Yang, Yubo Yan, and Xiang-Yang Li. 2023. Contactless and fine-grained liquid identification utilizing sub-6GHz signals. IEEE Transactions on Mobile Computing (2023).
[32]
Bangjie Sun, Sean Rui Xiang Tan, Zhiwei Ren, Mun Choon Chan, and Jun Han. 2022. Detecting counterfeit liquid food products in a sealed bottle using a smartphone camera. In Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services. 42--55.
[33]
Xue Sun, Wenwen Deng, Xudong Wei, Dingyi Fang, Baochun Li, and Xiaojiang Chen. 2023. Akte-liquid: Acoustic-based liquid identification with smartphones. ACM Transactions on Sensor Networks 19, 1 (2023), 1--24.
[34]
Denis Terwagne and John WM Bush. 2011. Tibetan singing bowls. Nonlinearity 24, 8 (2011), R51.
[35]
Hoang Truong, Alessandro Montanari, and Fahim Kawsar. 2022. Non-invasive blood pressure monitoring with multi-modal in-ear sensing. In IEEE International Conference on Acoustics, Speech and Signal Processing. 6--10.
[36]
Haoran Wan, Shuyu Shi, Wenyu Cao, Wei Wang, and Guihai Chen. 2021. Resptracker: multi-user room-scale respiration tracking with commercial acoustic devices. In IEEE International Conference on Computer Communications. 1--10.
[37]
Anran Wang, Jacob E Sunshine, and Shyamnath Gollakota. 2019. Contactless infant monitoring using white noise. In The 25th Annual International Conference on Mobile Computing and Networking. 1--16.
[38]
Zi Wang, Sheng Tan, Linghan Zhang, Yili Ren, Zhi Wang, and Jie Yang. 2021. Eardynamic: An ear canal deformation based continuous user authentication using in-ear wearables. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1--27.
[39]
Chenshu Wu, Feng Zhang, Beibei Wang, and KJ Ray Liu. 2020. msense: Towards mobile material sensing with a single millimeter-wave radio. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 3 (2020), 1--20.
[40]
Binbin Xie, Jie Xiong, Xiaojiang Chen, Eugene Chai, Liyao Li, Zhanyong Tang, and Dingyi Fang. 2019. Tagtag: material sensing with commodity RFID. In Proceedings of the 17th conference on embedded networked sensor systems. 338--350.
[41]
Yanni Yang, Yanwen Wang, Jiannong Cao, and Jinlin Chen. 2022. HearLiquid: Nonintrusive Liquid Fraud Detection Using Commodity Acoustic Devices. IEEE Internet of Things Journal 9, 15 (2022), 13582--13597.
[42]
Zhijian Yang, Yu-Lin Wei, Sheng Shen, and Romit Roy Choudhury. 2020. Ear-ar: indoor acoustic augmented reality on earphones. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--14.
[43]
Zhigang Yin, Mohan Liyanage, Agustin Zuniga, Petteri Nurmi, and Huber Flores. 2023. Hedgehog: Detecting Drink Spiking on Wearables. In Proceedings of the 24th International Workshop on Mobile Computing Systems and Applications. 61--67.
[44]
Shichao Yue and Dina Katabi. 2019. Liquid testing with your smartphone. In Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services. 275--286.
[45]
Fusang Zhang, Zhi Wang, Beihong Jin, Jie Xiong, and Daqing Zhang. 2020. Your smart speaker can" hear" your heartbeat! Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1--24.
[46]
Shijia Zhang, Taiting Lu, Hao Zhou, Yilin Liu, Runze Liu, and Mahanth Gowda. 2023. I Am an Earphone and I Can Hear My User's Face: Facial Landmark Tracking Using Smart Earphones. ACM Transactions on Internet of Things 5, 1 (2023), 1--29.

Index Terms

  1. ASLiquid: Non-Intrusive Liquid Counterfeit Identification with Your Earphones

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SenSys '24: Proceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems
    November 2024
    950 pages
    ISBN:9798400706974
    DOI:10.1145/3666025
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 November 2024

    Check for updates

    Author Tags

    1. liquid identification
    2. acoustic sensing
    3. earable computing

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    Acceptance Rates

    Overall Acceptance Rate 198 of 990 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 365
      Total Downloads
    • Downloads (Last 12 months)365
    • Downloads (Last 6 weeks)73
    Reflects downloads up to 02 Mar 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media