Abstract
We propose six 3D operation patterns with multiple input channels of a digital pen: these patterns allow users to transfer pre-existing knowledge of physical pens to digital pens on performing 3D operations simply, naturally, intuitively, and fluidly. A prototype system was designed under the patterns and implemented. An informal user study showed that eight novices grasped to perform 3D operations with the prototype system within several minutes and gained more fun than with the typical interfaces.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bi, X., Moscovich, T., Ramos, G., Balakrishnan, R., Hinckley, K.: An exploration of pen rolling for pen-based interaction. In: Proceedings of UIST 2008, pp. 191–200. ACM (2008)
Grandi, J.G., Debarba, H.G., Nedel, L., Maciel, A.: Design and evaluation of a handheld-based 3D user interface for collaborative object manipulation. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI 20117, pp. 5881–5891. ACM Press (2017). https://doi.org/10.1145/3025453.3025935
Harada, S., Saponas, T.S., Landay, J.A.: Voicepen: augmenting pen input with simultaneous non-linguistic vocalization. In: Proceedings of ICMI 2007, pp. 178–185. ACM (2007)
Jacob, R.J., Girouard, A., Hirshfield, L.M., Horn, M.S., Shaer, O., Solovey, E.T., Zigelbaum, J.: Reality-based interaction: a framework for post-wimp interfaces. In: Proceeding of the Twenty-Sixth Annual CHI Conference on Human Factors in Computing Systems - CHI 2008, pp. 201–210. ACM Press (2008)
Joseph, J., LaViola, J.: Sketching and gestures 101. In: Proceedings of ACM SIGGRAPH 2007 courses, p. 2. ACM Press (2007)
Kazi, R.H., Grossman, T., Cheong, H., Hashemi, A., Fitzmaurice, G.: Dreamsketch: Early stage 3D design explorations with sketching and generative design. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology - UIST 2017, pp. 401–414. ACM Press (2017)
Kolhoff, P., Preuß, J., Loviscach, J.: Walking with pens. In: Proceedings of EUROGRAPHICS 2005, pp. 33–36 (2005)
Li, Y., Luo, X., Zheng, Y., Xu, P., Fu, H.: Sweepcanvas: sketch-based 3D prototyping on an rgb-d image. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology - UIST 2017, pp. 387–399. ACM Press (2017)
Liu, C., Ren, X.: Making pen-based operation more seamless and continuous. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5726, pp. 261–273. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-03655-2_32
Nealen, A., Igarashi, T., Sorkine, O., Alexa, M.: Fibermesh: designing freeform surfaces with 3D curves. In: Proceedings of ACM SIGGRAPH, pp. 41–50. ACM Press (2007)
Okawa, M., Yoshida, K.: Text and user generic model for writer verification using combined pen pressure information from ink intensity and indented writing on paper. IEEE Trans. Hum.-Mach. Syst. 45(3), 339–349 (2015)
Oshita, M.: Pen-to-mime: a pen-based interface for interactive control of a human figure. In: Proceedings of Eurographics Workshop on Sketch-Based Interfaces and Modeling 2004, pp. 43–52. Eurographics Association (2004)
Pereira, J.P., Jorge, J.A., Branco, V.A., Ferreira, F.N.: Calligraphic interfaces: mixed metaphors for design. In: Proceedings of Interactive Systems: Design, Specification and Verification, DSV-IS 2003, pp. 154–170 (2003)
Ramos, G., Boulos, M., Balakrishnan, R.: Pressure widgets. In: Proceedings of CHI 2004, pp. 487–494. ACM (2004)
Schmidt, R., Singh, K., Balakrishnan, R.: Sketching and composing widgets for 3D manipulation. In: Proceedings of EUROGRAPHICS 2008, vol. 27, pp. 3–12. Blackwell Publishing, Hoboken (2008)
Tian, F., Xu, L., Wang, H., Zhang, X., Liu, Y., Setlur, V., Dai, G.: Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces. In: Proceedings of CHI 2008, pp. 1371–1380. ACM (2008)
Tompkin, J., Muff, S., McCann, J., Pfister, H., Kautz, J., Alexa, M., Matusik, W.: Joint 5D pen input for light field displays. In: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST 2015, pp. 637– 647. ACM Press (2015)
Wang, X.M., Wang, P., Liu, C.Y.: PP-menus: localizing pie menus by pressure. In: Proceedings of International Conference on Control and Automation, pp. 532–540. DEStech Publications, Inc., Lancaster (2016)
Wigdor, D., Balakrishnan, R.: Tilttext: using tilt for text input to mobile phones. In: Proceedings of UIST 2003, pp. 81–90. ACM (2003)
Wu, P.C., Wang, R., Kin, K., Twigg, C., Han, S., Yang, M.H., Chien, S.Y.: Dodecapen: accurate 6dof tracking of a passive stylus. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology - UIST 2017, pp. 365–374. ACM Press (2017). https://doi.org/10.1145/3126594.3126664
Zakaria, M.N., Shukri, S.R.M.: A sketch-and-spray interface for modeling trees. In: Butz, A., Fisher, B., Krüger, A., Olivier, P., Owada, S. (eds.) SG 2007. LNCS, vol. 4569, pp. 23–35. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73214-3_3
Zeleznik, R.C., Herndon, K.P., Hughes, J.F.: Sketch: an interface for sketching 3D scenes. In: Proceedings of ACM SIGGRAPH 2007 Courses, pp. 19–24. ACM (2007)
Zhu, H., Song, Y., Nie, D., Peng, X.: Real-time 3D collaborative satellite orbit design system based on message queue and p2p structure. In: 2017 IEEE 21st International Conference on Computer Supported Cooperative Work in Design (CSCWD), pp. 503–508. IEEE, April 2017. https://doi.org/10.1109/cscwd.2017.8066745
Acknowledgment
Supported by the Fundamental Research Funds for the Central Universities Grants No. lzujbky-2016-k07.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Liu, C., Zhang, J., Ma, K. (2018). Natural and Fluid 3D Operations with Multiple Input Channels of a Digital Pen. In: Huang, DS., Gromiha, M., Han, K., Hussain, A. (eds) Intelligent Computing Methodologies. ICIC 2018. Lecture Notes in Computer Science(), vol 10956. Springer, Cham. https://doi.org/10.1007/978-3-319-95957-3_61
Download citation
DOI: https://doi.org/10.1007/978-3-319-95957-3_61
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-95956-6
Online ISBN: 978-3-319-95957-3
eBook Packages: Computer ScienceComputer Science (R0)