Abstract
Color picker is a necessary interactive component in visualization system. Current color pickers are based on the WIMP paradigm and are mainly designed for mouse, touch and ray interactions. In the context of immersive and remote interaction, mid-air interaction is an important method. However, common solution of color selection using hands is simulating cursors or rays with fingers, which does not take full advantage of mid-air interaction—intuition, naturalness and remote interaction. This results in fatigue and long selection time. In this paper, we proposed a mid-air interaction metaphor for color selection which enabled users to select hue, saturation and lightness simultaneously using mutually independent and intuitive hand motions. We conducted a user study to evaluate the performance of the interaction technique. Results showed that the metaphor improved the efficiency of color selection with mid-air interaction. Questionnaire results showed that the metaphor enhanced users’ perception of color space; the semantics of hand motions were consistent with users’ intention of color selection; the metaphor was easy to learn and memorize.
Graphic Abstract
Similar content being viewed by others
Notes
A-Painter: paint in VR in your browser
Tilt Brush: painting from a new perspective
Gravity Sketch: the first pro-level VR app for artists
Adobe color
CIELAB color space
Delta E (CIE 2000)
Color management: current practice and the adoption of a new standard
References
Benko H (2009) Beyond flat surface computing: Challenges of depth-aware and curved interfaces. In: Proceedings of the 17th international conference on multimedia 2009, pp 935–944. https://doi.org/10.1145/1631272.1631462
Benko H, Wilson A (2010) Multi-point interactions with immersive omnidirectional visualizations in a dome. In: ACM International Conference on Interactive Tabletops and Surfaces, pp 19–28. https://doi.org/10.1145/1936652.1936657
Cui J, Sourin A (2018) Mid-air interaction with optical tracking for 3d modeling. Comput Gr 74:1. https://doi.org/10.1016/j.cag.2018.04.004
Douglas S, Kirkpatrick A (1999) Model and representation: the effect of visual feedback on human performance in a color picker interface. ACM Trans Gr 18:96–127. https://doi.org/10.1145/318009.318011
Ebbinason A, Kanna B (2014) Colorfingers: Improved multi-touch color picker. SIGGRAPH Asia 2014 Technical Briefs. https://doi.org/10.1145/2669024.2669033
Feisner E, Reed R (2014) Digital color media and technology, color studies, pp 42–64. https://doi.org/10.5040/9781501303364.ch-005
Gonzalez B, Latulipe C (2011) Bicep: bimanual color exploration plugin. In: CHI ’11 Extended Abstracts on Human Factors in Computing Systems, pp 1483–1488. https://doi.org/10.1145/1979742.1979795
Grossman T, Balakrishnan R (2006) The design and evaluation of selection techniques for 3d volumetric displays. In: Proceedings of the 19th annual ACM symposium on user interface software and technology, pp 3–12. https://doi.org/10.1145/1166253.1166257
Grossman T, Wigdor D, Balakrishnan R (2005) Multi-finger gestural interaction with 3d volumetric displays. ACM Trans Gr 24:931. https://doi.org/10.1145/1029632.1029644
Hinckley K (1997) Haptic issues for virtual manipulation. University of Virginia
Jalal G, Maudet N, Mackay WE (2015) Color portraits: from color picking to interacting with color. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems, association for computing machinery, New York, NY, USA, pp 4207–4216. https://doi.org/10.1145/2702123.2702173
Li T, Li Y, Qin X (2019) Exploring the effects of visual feedback on freehand grasping interaction in virtual environments. J Comput-Aided Des Comput Gr 031(010):1711–1718
Liang J, Green M (1994) Jdcad: a highly interactive 3d modeling system. Comput Gr 18:499–506. https://doi.org/10.1016/0097-8493(94)90062-0
Liu X, Song P, Goh WB, Hutama W, Fu CW, Liu X (2012) A handle bar metaphor for virtual object manipulation with mid-air interaction. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 1297–1306. https://doi.org/10.1145/2207676.2208585
Meier B (1988) Ace: A color expert system for user interface design. In: Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software, pp 117–128. https://doi.org/10.1145/62402.62424
Pula J, Yuen C (2017) Eyes and stroke: the visual aspects of cerebrovascular disease. Stroke Vasc Neurol 2:210–220. https://doi.org/10.1136/svn-2017-000079
Rahman M, Gustafson S, Irani P, Subramanian S (2009) Tilt techniques: investigating the dexterity of wrist-based input. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 1943–1952. https://doi.org/10.1145/1518701.1518997
Ren G, O’Neill E (2013) 3d selection with freehand gesture. Comput Gr 37(3):101–120. https://doi.org/10.1016/j.cag.2012.12.006
Smith A (1978) Color gamut transform pairs. In: Proceedings of the 5th annual conference on computer graphics and interactive techniques, vol 12, pp 12–19. https://doi.org/10.1145/800248.807361
Vanacken L, Grossman T, Coninx K (2007) Exploring the effects of environment density and target visibility on object selection in 3d virtual environments. 3D User Interfaces. https://doi.org/10.1109/3DUI.2007.340783
Vogel D, Balakrishnan R (2005) Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings of the 18th annual ACM symposium on User interface software and technology, pp 33–42. https://doi.org/10.1145/1095034.1095041
Acknowledgements
This work was supported by National Natural Science Foundation of China (61702042).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Supplementary file 1.
Rights and permissions
About this article
Cite this article
Zhou, W., Li, T., Li, S. et al. Color-in-fist: a metaphor for color selection with mid-air interaction. J Vis 25, 207–218 (2022). https://doi.org/10.1007/s12650-021-00792-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12650-021-00792-w