Skip to main content
SpringerLink
Log in

An intuitive user interaction method using multi-sensors for pencil drawing filter of NPR rendering in mobile devices

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The user interface is one of the most important factors to use various functions of mobile device easily. Recently, the importance of the user interface has been increased after Apple emphasized emotional UX(User eXperience) by applying multi-touches to iPhone. Mobile device Manufacturers have tried to apply embedded sensors to apps as user interface. Microphone was applied to execute functions combined with voice recognition and GPS sensor was used to find a location in navigation apps or game apps. Like these services, several sensors have roles of interface between user and device. In this paper, we propose an intuitive user interaction method using multi-sensors in NPR(Non-Photorealistic) rendering. The proposed method renders pencil drawing filter for a given photo image with the direction and strength of line strokes which are applied in vector fields. At this point, the method changes direction of stroke with x-coordinate values and y-coordinate values and control the strength of the stroke with z-coordinate values after catching three coordinate values in real-time from the orientation sensor on a mobile device. The method also adjusts brightness of image by transforming intensity of light from the light sensor. The light sensor updates intensity of light source continuously. If the user brings the mobile device closer to the external light source, the light sensor value will increase and the intensity of brightness becomes stronger. In addition, the user can make an attenuation effect with orientation sensor combined with light sensor for specific scope in a photo image and change the attenuation scope by moving action of his holding mobile device. This is a user interaction method for emotional image processing using sensors in mobile devices. We developed an app which generated pencil drawing filter effect for a photo image. We experimented sensor based emotional user interaction and compared various results of image processing effects using two combinatorial sensors. Finally, this paper proved efficiency through the experimental results and evaluated the effectiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Kim J (2011) Digisensus. ChosunBiz Article

  2. Kim Y (2012) Mobile UI technology trends and market outlook. ETRI Electron Telecommun Trends

  3. Kim E-G, Yeom MI-R, Kim J-H (2011) Development of android-based application for measure a space coordinate and an area using of orientation sensor. J Korean Assoc Inform Educ, p 439–447

  4. KT AIT (2010) Mobile applications catalyst: smartphone sensors. Technol Hot Issues

  5. Lee H, Park J, Lee J (2011) Sensibility UX technology trends. ETRI Electron and Telecommun Trends 26(5)

  6. Lim C (2010) Emotion ICT industry status and prospects. KEIT PD issue report

  7. Ma J-y, Yong H-s, Park J, Yoon KH (2005) Pencil hatching effect using sharpening and blurring spatial filter. Korea Comput Graph Soc 11(1):8–12

    Google Scholar 

  8. Mao X, Nagasaka Y, Imamiya A (2001) Automatic generation of pencil drawing from 2D Images using line integral convolution. Proceedings of 7th International Conference on Computer Aided Design and Computer Graphics CAD/GRAPHICS2001, pp 240–248

  9. Mao X, Nagasaka Y, Imamiya A (2004) Enhanced LIC pencil filter. Proc Int Conf Comput Graph, Imaging Visualization, p 251--256

  10. Mobile Device User Interface (2010) ABI Research

  11. Morgan JP (2010) Mobile advertising: an in depth look at the future of mobile advertising

  12. Na Y et al. (2012) Touch-based smart terminal UX technology. KEIT PD Issue Report

  13. Next-Generation Interfaces (2011) Future UI needs and R&D strategy, ETRI

  14. Yong H-j, Back J-w, Jang T-J (2006) Stereo vision based virtual reality game using position/orientation sensors and vibrotactile device. Proc Conf Korean Hum Comput Interact, p 88–93

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Daejin University, Pocheon, Korea

    Jong-Jin Jung, Ji-Yeon Kim & Pan-Seop Shin

  2. Department of Computer Engineering, Chosun University, Gwangju, Korea

    Hyun-Sook Chung

Authors
  1. Jong-Jin Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ji-Yeon Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hyun-Sook Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pan-Seop Shin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pan-Seop Shin.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jung, JJ., Kim, JY., Chung, HS. et al. An intuitive user interaction method using multi-sensors for pencil drawing filter of NPR rendering in mobile devices. Multimed Tools Appl 74, 2371–2389 (2015). https://doi.org/10.1007/s11042-014-2054-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-2054-7

Keywords

Search

Navigation