Elle Luo
ABSTRACT
Eyelid stickers are thin strips that temporarily create a crease when attached to the eyelid. The direct contact with the crease that increases and decreases the pressure on the eyelid sticker provides a novel opportunity for sensing blinking. We present Eslucent, an on-skin wearable capacitive sensing device that affords blink detection, building on the form factor of eyelid stickers. It consists of an art layer, conductive thread, fiber eyelid stickers, coated with conductive liquid, and applied the device onto the eyelid crease with adhesive temporary tattoo paper. Eslucent detects blinks during intentional blinking and four involuntary activities by a falling edge detection algorithm in a user study of 14 participants. The average precision was 82% and recall was 70% while achieving the precision and recall of more than 90% in intentional blinking. By embedding interactive technology into a daily beauty product, Eslucent explores a novel wearable form factor for blink detection.
Supplemental Material
Available for Download
zip
p58-luo.zip (75.8 MB)
Supplemental files.
- Andreas Bulling, Jamie A Ward, Hans Gellersen, and Gerhard Troster. 2010. Eye movement analysis for activity recognition using electrooculography. IEEE transactions on pattern analysis and machine intelligence 33, 4 (2010), 741--753.Google Scholar
Digital Library
- Fabio Lo Castro. 2008. Class I infrared eye blinking detector. Sensors and actuators A: Physical 148, 2 (2008), 388--394.Google Scholar
- Michael Chau and Margrit Betke. 2005. Real time eye tracking and blink detection with usb cameras. Technical Report. Boston University Computer Science Department.Google Scholar
- Jordan Crook. 2013. The Google Glass Wink Feature Is Real. https://techcrunch.com/2013/05/09/the-google-glass-wink-feature-is-real/Google Scholar
- Artem Dementyev and Christian Holz. 2017. DualBlink: A Wearable Device to Continuously Detect, Track, and Actuate Blinking For Alleviating Dry Eyes and Computer Vision Syndrome. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 1 (2017), 1.Google ScholarDigital Library
- Meirav Devash. 2018. Eyelid Lifting Strips promise a more wide-awake look. https://www.allure.com/story/magicstripes-eyelid-lifting-strips-reviewGoogle Scholar
- Christine Dierk, Sarah Sterman, Molly Jane Pearce Nicholas, and Eric Paulos. 2018. Häiriö: Human hair as interactive material. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 148--157.Google ScholarDigital Library
- Christine Dierk, Tomás Vega Gálvez, and Eric Paulos. 2017. AlterNail: Ambient, batteryless, stateful, dynamic displays at your fingertips. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 6754--6759.Google ScholarDigital Library
- Matjaz Divjak and Horst Bischof. 2009. Eye Blink Based Fatigue Detection for Prevention of Computer Vision Syndrome.. In MVA. 350--353.Google Scholar
- Patricia J Flanagan, Katia Vega, and Hugo Fuks. 2012. Blinklifier: The power of feedback loops for amplifying expressions through bodily worn objects. In Proceedings of APCHI. 641--642.Google Scholar
- Kyosuke Fukuda. 2001. Eye blinks: new indices for the detection of deception. International Journal of Psychophysiology 40, 3 (2001), 239--245.Google ScholarCross Ref
- Nur Al-huda Hamdan, Adrian Wagner, Simon Voelker, Jürgen Steimle, and Jan Borchers. 2019. Springlets: Expressive, flexible and silent on-skin tactile interfaces. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--14.Google ScholarDigital Library
- Shoya Ishimaru, Kai Kunze, Koichi Kise, Jens Weppner, Andreas Dengel, Paul Lukowicz, and Andreas Bulling. 2014. In the blink of an eye: combining head motion and eye blink frequency for activity recognition with Google Glass. In Proceedings of the 5th augmented human international conference. ACM, 15.Google ScholarDigital Library
- Hsin-Liu Cindy Kao, Miren Bamforth, David Kim, and Chris Schmandt. 2018. Skinmorph: texture-tunable on-skin interface through thin, programmable gel. In Proceedings of the 2018 ACM International Symposium on Wearable Computers. ACM, 196--203.Google Scholar
- Hsin-Liu Cindy Kao, Abdelkareem Bedri, and Kent Lyons. 2018. SkinWire: Fabricating a Self-Contained On-Skin PCB for the Hand. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (2018), 116.Google Scholar
- Hsin-Liu Cindy Kao, Artem Dementyev, Joseph A Paradiso, and Chris Schmandt. 2015. NailO: fingernails as an input surface. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 3015--3018.Google Scholar
- Hsin-Liu Cindy Kao, Christian Holz, Asta Roseway, Andres Calvo, and Chris Schmandt. 2016. DuoSkin: Rapidly prototyping on-skin user interfaces using skin-friendly materials. In Proceedings of the 2016 ACM International Symposium on Wearable Computers. ACM, 16--23.Google Scholar
- Hsin-Liu Cindy Kao, Manisha Mohan, Chris Schmandt, Joseph A Paradiso, and Katia Vega. 2016. Chromoskin: Towards interactive cosmetics using thermochromic pigments. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 3703--3706.Google Scholar
- Aleksandra Królak and Paweł Strumiłło. 2012. Eye-blink detection system for human-computer interaction. Universal Access in the Information Society 11, 4 (2012), 409--419.Google ScholarDigital Library
- Juyoung Lee, Hui-Shyong Yeo, Murtaza Dhuliawala, Jedidiah Akano, Junichi Shimizu, Thad Starner, Aaron Quigley, Woontack Woo, and Kai Kunze. 2017. Itchy nose: discreet gesture interaction using EOG sensors in smart eyewear. In Proceedings of the 2017 ACM International Symposium on Wearable Computers. 94--97.Google ScholarDigital Library
- Xin Liu, Katia Vega, Pattie Maes, and Joe A Paradiso. 2016. Wearability factors for skin interfaces. In Proceedings of the 7th Augmented Human International Conference 2016. 1--8.Google ScholarDigital Library
- Joanne Lo, Doris Jung Lin Lee, Nathan Wong, David Bui, and Eric Paulos. 2016. Skintillates: Designing and creating epidermal interactions. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems. ACM, 853--864.Google ScholarDigital Library
- Eric Markvicka, Guanyun Wang, Yi-Chin Lee, Gierad Laput, Carmel Majidi, and Lining Yao. 2019. ElectroDermis: Fully Untethered, Stretchable, and Highly-Customizable Electronic Bandages. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 632.Google ScholarDigital Library
- Aditya Shekhar Nittala, Anusha Withana, Narjes Pourjafarian, and Jürgen Steimle. 2018. Multi-touch skin: A thin and flexible multi-touch sensor for on-skin input. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 33.Google ScholarDigital Library
- Monalisa Pal, Anwesha Banerjee, Shreyasi Datta, Amit Konar, DN Tibarewala, and R Janarthanan. 2014. Electrooculography based blink detection to prevent computer vision syndrome. In 2014 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT). IEEE, 1--6.Google ScholarCross Ref
- SciPy.org. 2015. Scipy Signal Savgol Filter. https://docs.scipy.org/doc/scipy-0.15.1/reference/generated/scipy.signal.savgol_filter.htmlGoogle Scholar
- Marcos Serrano, Barrett M Ens, and Pourang P Irani. 2014. Exploring the use of hand-to-face input for interacting with head-worn displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3181--3190.Google ScholarDigital Library
- TinyCircuits. 2020. TinyDuino Overview. https://tinycircuits.com/pages/tinyduino-overviewGoogle Scholar
- Katia Vega, Abel Arrieta, Felipe Esteves, and Hugo Fuks. 2014. FX e-makeup for muscle based interaction. In International Conference of Design, User Experience, and Usability. Springer, 643--652.Google ScholarCross Ref
- Katia Vega, Marcio Cunha, and Hugo Fuks. 2015. Hairware: the conscious use of unconscious auto-contact behaviors. In Proceedings of the 20th International Conference on Intelligent User Interfaces. 78--86.Google ScholarDigital Library
- Katia Vega and Hugo Fuks. 2014. Beauty tech nails: interactive technology at your fingertips. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. 61--64.Google Scholar
- Katia Vega and Hugo Fuks. 2014. Beauty technology: body surface computing. Computer 47, 4 (2014), 71--75.Google ScholarDigital Library
- Katia Vega and Hugo Fuks. 2016. Beauty Technology: Designing Seamless Interfaces for Wearable Computing. Springer.Google ScholarDigital Library
- Yanan Wang, Shijian Luo, Yujia Lu, Hebo Gong, Yexing Zhou, Shuai Liu, and Preben Hansen. 2017. AnimSkin: fabricating epidermis with interactive, functional and aesthetic color animation. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, 397--401.Google ScholarDigital Library
- Yanfang Wang, Sonia S Toor, Ramesh Gautam, and David B Henson. 2011. Blink frequency and duration during perimetry and their relationship to test-retest threshold variability. Investigative ophthalmology & visual science 52, 7 (2011), 4546--4550.Google Scholar
- Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. Iskin: flexible, stretchable and visually customizable on-body touch sensors for mobile computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2991--3000.Google ScholarDigital Library
- Martin Weigel, Aditya Shekhar Nittala, Alex Olwal, and Jürgen Steimle. 2017. Skinmarks: Enabling interactions on body landmarks using conformal skin electronics. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 3095--3105.Google ScholarDigital Library
- Anusha Withana, Daniel Groeger, and Jürgen Steimle. 2018. Tacttoo: A thin and feel-through tattoo for on-skin tactile output. In The 31st Annual ACM Symposium on User Interface Software and Technology. ACM, 365--378.Google ScholarDigital Library
- Koki Yamashita, Takashi Kikuchi, Katsutoshi Masai, Maki Sugimoto, Bruce H Thomas, and Yuta Sugiura. 2017. CheekInput: turning your cheek into an input surface by embedded optical sensors on a head-mounted display. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology. 1--8.Google ScholarDigital Library
Index Terms
- Eslucent: an eyelid interface for detecting eye blinking
Recommendations
SkinWire: Fabricating a Self-Contained On-Skin PCB for the Hand
Current wearable form factors often house electronics using an enclosure that is attached to the body. This form factor, while wearable, tends to protrude from the body and therefore can limit wearability. While emerging research in on-skin interfaces ...
Comparative Study on Blink Detection and Gaze Estimation Methods for HCI, in Particular, Gabor Filter Utilized Blink Detection Method
ITNG '11: Proceedings of the 2011 Eighth International Conference on Information Technology: New GenerationsBlink detection is used for a variety of applications such as Human-Computer Interaction, wearable computing, etc. Blink detection method with Gabor filter is proposed to realize high accurate blink detection. The blink detection accuracy is evaluated ...
Pupil vs. Eyelid: Evaluating the Accuracy of Blink Detection in Pupil-based Eye Tracking Devices
AbstractSpontaneous eye blinks as a means to tap into human cognitive and affective processes have been demonstrated to offer valuable insight in various fields of application, such as human-computer-interaction and driver drowsiness detection. ...
Comments