Emi Tamaki
ABSTRACT
Hand gesture input has been of growing importance in 3D content and VR/AR. However, a hand gesture detection system by camera was small in scope. And EMG was affected by noise from other electronic devices. Muscle deformation sensor system could only detect large muscles deformation related to wrist gestures because the sensor is covered to prevent light leakage noise. In this research, a device that covers the only sensor side circularly as light noise reduction case and has 14ch photo reflector sensors can detect small muscles deformation: FirstVR is suggested (Fig1, 2). Results of our experiment shows that recognition accuracy average of more than 90% is achieved with three types of PIP joint angles. In the future, FirstVR is expected to be used not only for content inputting finger movements indoors and outdoors but also for muscle displacement recording system.
- Leapmotion, INC.,"Leapmotion" https://www.leapmotion.com 2018/09/20 accessedGoogle Scholar
- Microsoft, "Xbox One Kinect", https://developer.microsoft.com/en-us/windows/kinect 2018/09/20 accessedGoogle Scholar
- Facebook Technologies, LLC, "Oculus rift controller" https://www.oculus.com/rift/accessories/2018/09/20 accessedGoogle Scholar
- HTC Corporation Legal Terms, "HTC VIVE controller" https://www.vive.com/us/support/vive-pro-hmd/ category_howto/about-the-controllers.html 2018/09/20 accessedGoogle Scholar
- Data Glove Ultra Series, 5DT Data Glove 5 Ultra/5DT Data Glove 14 Ultra.Google Scholar
- The CyberGlove, Immersion Corporation, 18-joint angles sensor.Google Scholar
- J. Chu, I. Moon, Y. Lee, S. Kim and M. Mun, "A Supervised Feature-Projection-Based Real-Time EMG Pattern Recognition for Multifunction Myoelectric Hand Control," in IEEE/ASME Transactions on Mechatronics, vol. 12, no. 3, pp. 282--290, June 2007.Google ScholarCross Ref
- Lv B., Sheng X., Guo W., Zhu X., Ding H. (2017) Towards Finger Gestures and Force Recognition Based on Wrist Electromyography and Accelerometers. In: Huang Y., Wu H., Liu H., Yin Z. (eds) Intelligent Robotics and Applications. ICIRA 2017. Lecture Notes in Computer Science, vol 10462. Springer, ChamGoogle Scholar
- Z. Lu, X. Chen, Q. Li, X. Zhang and P. Zhou, "A Hand Gesture Recognition Framework and Wearable Gesture-Based Interaction Prototype for Mobile Devices," in IEEE Transactions on Human-Machine Systems, vol. 44, no. 2, pp. 293--299, April 2014.Google ScholarCross Ref
- Y. Sugiura, F. Nakamura, W. Kawai, T. Kikuchi and M. Sugimoto, "Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors," 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE), Kanazawa, 2017, pp. 1082--1087.Google Scholar
- S. Cho, M. Yoshikawa, K. Baba, K. Ogawa, J. Takamatsu and T. Ogasawara, "Hand motion recognition based on forearm deformation measured with a distance sensor array," 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, 2016, pp. 4955--4958.Google Scholar
- A. Kato, Y. Matsumoto, Y. Kobayashi, S. Sugano and M. G. Fujie, "Estimating a joint angle by means of muscle bulge movement along longitudinal direction of the forearm," 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO), Zhuhai, 2015, pp. 614--619.Google Scholar
Index Terms
- FirstVR: A Muscle Deformation Sensors Array Device to Detect Finger Gestures and Noise Reduction Case
Recommendations
PossessedHand: techniques for controlling human hands using electrical muscles stimuli
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsIf a device can control human hands, the device can be useful for HCI and tangible application's output. To aid the controlling of finger movement, we present PossessedHand, a device with a forearm belt that can inform when and which fingers should be ...
Gesture Recognition System using Optical Muscle Deformation Sensors
ICECC '19: Proceedings of the 2019 2nd International Conference on Electronics, Communications and Control EngineeringDue to the spread of VR(Virtual Reality)/AR(Augmented Reality) applications, gesture input method will be required. In this research, a gesture recognition system is suggested using the optical muscle deformation sensors. Our gesture recognition system ...
Human-Machine Interaction based on Hand Gesture Recognition using Skeleton Information of Kinect Sensor
ICAIT'2018: Proceedings of the 3rd International Conference on Applications in Information TechnologyThe hand gesture provides a natural and intuitive communication medium for the human and machine interaction. Because, it can use in virtual reality, language detection, computer games, and other human-computer or human-machine instruction applications. ...
Comments