SolarSense is a self-powered sensing system for gesture recognition using solar cell arrays, thereby offering a sustainable approach to human-computer interaction (HCI) within industrial settings. The system effectively employed the sensing and energy harvesting capabilities of solar cells, achieving over 97.0% accuracy in recognizing diverse gestures. The design incorporates a low-power wireless data acquisition chip, a signal processing framework, and a user interface to realize robotic control and text input applications. SolarSense enhances HCI with its eco-friendly and user-centric approach, which is suitable for Internet of things (IoT) scenarios. Demo: https://youtu.be/RmPolChw_c4.

References

[1]

Lingchen Chen, Feng Wang, Hui Deng, and Kaifan Ji. 2013. A survey on hand gesture recognition. In 2013 International conference on computer sciences and applications. IEEE, 313--316.

Digital Library

Google Scholar

[2]

Jiarong Li, Changshuo Ge, Jun Tao, Jingyang Wang, Xiaomin Xu, Xinlei Chen, Weihua Gui, Xiaojun Liang, and Wenbo Ding. 2023. SolareSkin: Self-powered Visible Light Sensing Through a Solar Cell E-Skin. In Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing. 664--669.

Digital Library

Google Scholar

[3]

Jiarong Li, Changsheng Wu, Ishara Dharmasena, Xiaoyue Ni, Zihan Wang, Haixu Shen, Shao-Lun Huang, and Wenbo Ding. 2020. Triboelectric nanogenerators enabled internet of things: A survey. Intelligent and Converged Networks 1, 2 (2020), 115--141.

Crossref

Google Scholar

[4]

Jiarong Li, Zixuan Xie, Zihan Wang, Zenan Lin, Chengyue Lu, Zihao Zhao, Yuchao Jin, Jihong Yin, Shilong Mu, and Chaobo Zhang. 2023. A triboelectric gait sensor system for human activity recognition and user identification. Nano Energy 112 (2023), 108473.

Crossref

Google Scholar

[5]

Mirco Moencks, Elisa Roth, Thomas Bohné, and Per Ola Kristensson. 2022. Humancomputer interaction in industry: a systematic review on the applicability and value-added of operator assistance systems. Foundations and Trends in Human-Computer Interaction 16, 2-3 (2022), 65--213.

Digital Library

Google Scholar

Cited By

View all

Almania NAlhouli SSahoo D(2024)Dynamic Hover Gesture Classification using Photovoltaic Sensor and Machine LearningProceedings of the 2024 8th International Conference on Advances in Artificial Intelligence10.1145/3704137.3704160(268-275)Online publication date: 17-Oct-2024
https://dl.acm.org/doi/10.1145/3704137.3704160
Li JGe CXu CGong JGui WZhang CLiang XDing WGanesan DLane NShi W(2024)VLocSense: Integrated VLC System for Indoor Passive Localization and Human SensingProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3694729(2022-2027)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3694729
Li J(2024)PhD Forum Abstract: Ubiquitous Sensing System for Activity and Gesture Recognition via Optical and Energy-Harvesting Technologies2024 23rd ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN)10.1109/IPSN61024.2024.00062(323-324)Online publication date: 13-May-2024
https://doi.org/10.1109/IPSN61024.2024.00062

Index Terms

Demo: SolarSense: A Self-powered Ubiquitous Gesture Recognition System for Industrial Human-Computer Interaction
1. Human-centered computing
  1. Ubiquitous and mobile computing

Recommendations

Self-Powered Gesture Recognition with Ambient Light
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

We present a self-powered module for gesture recognition that utilizes small, low-cost photodiodes for both energy harvesting and gesture sensing. Operating in the photovoltaic mode, photodiodes harvest energy from ambient light. In the meantime, the ...
Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware

Human-Computer Interaction (HCI) exists ubiquitously in our daily lives. It is usually achieved by using a physical controller such as a mouse, keyboard or touch screen. It hinders Natural User Interface (NUI) as there is a strong barrier between the ...
Enabling Finger-Gesture Interaction with Kinect
VINCI '15: Proceedings of the 8th International Symposium on Visual Information Communication and Interaction

A large number of tracking and gesture recognition algorithms and technologies have been developed in the field of human-computer interactions thanks to the introduction of cameras with depth sensors such as Microsoft's Kinect. Most of the techniques ...

Comments

Information & Contributors

Information

Published In

MOBISYS '24: Proceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services

June 2024

778 pages

ISBN:9798400705816

DOI:10.1145/3643832

Chairs:
Tadashi Okoshi,
JeongGil Ko,
Program Chair:
Robert LiKamWa

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).

In-Cooperation

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 June 2024

Check for updates

Author Tags

Qualifiers

Demonstration

Funding Sources

Shenzhen Ubiquitous Data Enabling Key Lab
Guangdong Innovative and Entrepreneurial Research Team Program
Major Key Project of Peng Cheng Laboratory
National Natural Science Foundation of China
Shenzhen Science and Technology Program
Tsinghua Shenzhen International Graduate School-Shenzhen Pengrui Young Faculty Program of the Shenzhen Pengrui Foundation

Conference

MOBISYS '24

Sponsor:

SIGMOBILE

MOBISYS '24: 22nd Annual International Conference on Mobile Systems, Applications and Services

June 3 - 7, 2024

Minato-ku, Tokyo, Japan

Acceptance Rates

Overall Acceptance Rate 274 of 1,679 submissions, 16%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
119
Total Downloads

Downloads (Last 12 months)119
Downloads (Last 6 weeks)13

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Almania NAlhouli SSahoo D(2024)Dynamic Hover Gesture Classification using Photovoltaic Sensor and Machine LearningProceedings of the 2024 8th International Conference on Advances in Artificial Intelligence10.1145/3704137.3704160(268-275)Online publication date: 17-Oct-2024
https://dl.acm.org/doi/10.1145/3704137.3704160
Li JGe CXu CGong JGui WZhang CLiang XDing WGanesan DLane NShi W(2024)VLocSense: Integrated VLC System for Indoor Passive Localization and Human SensingProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3694729(2022-2027)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3694729
Li J(2024)PhD Forum Abstract: Ubiquitous Sensing System for Activity and Gesture Recognition via Optical and Energy-Harvesting Technologies2024 23rd ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN)10.1109/IPSN61024.2024.00062(323-324)Online publication date: 13-May-2024
https://doi.org/10.1109/IPSN61024.2024.00062

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Self-Powered Gesture Recognition with Ambient Light

Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware

Enabling Finger-Gesture Interaction with Kinect

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations