Skip to main content

Advertisement

SpringerLink
Log in

Image-based haptic roughness estimation and rendering for haptic palpation from in vivo skin image

  • Original Article
  • Published:
Medical & Biological Engineering & Computing Aims and scope Submit manuscript

Abstract

Despite the advancement of measuring technologies, there was a need for palpation by hands to be able to better diagnose skin diseases and to learn about the tactile properties of in vivo skin surface. However, directly touching in vivo skin surface can cause secondary infections or damages. Therefore, a technology providing infection- and damage-free skin palpations and precise haptic skin roughness rendering is needed. A multidimensional (2D and 3D) rendering system was developed for multimodal (visual and haptic) rendering that can run with any given in vivo input skin images. For haptic rendering, a commercial haptic device with 3 degrees of freedom (3DOF), Geomagic Touch X, was used. To improve haptic roughness rendering, a force shading algorithm that reduces force discontinuity on rough surface patches but preserves the original roughness values was implemented and applied. In addition, a new image-based roughness estimation method was introduced and the results were compared with haptic roughness results to verify roughness rendering in the system. The developed haptic roughness rendering system will help to diagnose abnormalities on in vivo skin surfaces by virtual haptic palpation with no concern about secondary infections or damages (caused by touch interactions) especially in case of psoriasis, atopic dermatitis, or aging, which results in significant changes of skin roughness. Besides, the system can also be a good tool to examine skin condition changes before and after the use of skin care products (cosmetics). In addition, the proposed 2D skin roughness estimation method can be applied for mobile applications to provide an online roughness estimation tool with a simple phone camera.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2.
Fig. 3.
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Akbari AA, Fard AM, Chegini AG (2006) An effective image based surface roughness estimation approach using neural network. In: Automation Congress, 2006. WAC'06. World IEEE, pp 1–6

  2. Bloemen MC, Van Gerven MS, Van Der Wal MB, Verhaegen PD, Middelkoop E (2011) An objective device for measuring surface roughness of skin and scars. J Am Acad Dermatol 64(4):706–715

    Article  PubMed  Google Scholar 

  3. Cook T, Alexander H, Cohen M (1977) Experimental method for determining the 2-dimensional mechanical properties of living human skin. Med Biol Eng Comput 15(4):381–390

    Article  CAS  PubMed  Google Scholar 

  4. Fadzil MA, Prakasa E, Fitriyah H, Nugroho H, Affandi AM, Hussein SH (2010) Validation on 3D surface roughness algorithm for measuring roughness of psoriasis lesion. Biol Biomed Sci 7(4):205–2010

    Google Scholar 

  5. Friedman PM, Skover GR, Payonk G, Kauvar AN, Geronemus RG (2002) 3D in-vivo optical skin imaging for topographical quantitative assessment of non-ablative laser technology. Dermatol Surg 28(3):199–204

    PubMed  Google Scholar 

  6. Kawada A, Konishi N, Oiso N, Kawara S (2008) Evaluation of anti-wrinkle effects of a novel cosmetic containing niacinamide. J Dermatol 35(10):637–642

    Article  CAS  PubMed  Google Scholar 

  7. Kim K (2016) Roughness based perceptual analysis towards digital skin imaging system with haptic feedback. Skin Res Technol 22:334–340

    Article  CAS  PubMed  Google Scholar 

  8. Kim K, Lee S (2015) Perception-based 3D tactile rendering from a single image for human skin examinations by dynamic touch. Skin Res Technol 21(2):164–174

    Article  CAS  PubMed  Google Scholar 

  9. Kim E, Nam GW, Kim S, Lee H, Moon S, Chang I (2007) Influence of polyol and oil concentration in cosmetic products on skin moisturization and skin surface roughness. Skin Res Technol 13(4):417–424

    Article  PubMed  Google Scholar 

  10. Kottner J, Schario M, Bartels NG, Pantchechnikova E, Hillmann K, Blume-Peytavi U (2013) Comparison of two in vivo measurements for skin surface topography. Skin Res Technol 19(2):84–90

    Article  PubMed  Google Scholar 

  11. Lagarde JM, Rouvrais C, Blabk D (2005) Topography and anisotropy of the skin surface with ageing. Skin Res Technol 11(2):110–119

    Article  CAS  PubMed  Google Scholar 

  12. Lee O, Lee K, Oh C, Kim K, Kim M (2014) Prototype tactile feedback system for examination by skin touch. Skin Res Technol 20(3):307–314

    Article  CAS  PubMed  Google Scholar 

  13. Levy JL, Servant JJ, Jouve E (2004) Botulinum toxin A: a 9-month clinical and 3D in vivo profilometric crow's feet wrinkle formation study. J Cosmet Laser Ther 6(1):16–20

    Article  PubMed  Google Scholar 

  14. Lim JS (1990) Two-dimensional signal and image processing. Prentice Hall, Englewood Cliffs 1990, 710 p

    Google Scholar 

  15. Lou MS, Chen JC, Li CM (1998) Surface roughness prediction technique for CNC end-milling. J Ind Technol 15(1):1–6

    Google Scholar 

  16. Masaki H (2010) Role of antioxidants in the skin: anti-aging effects. J Dermatol Sci 58(2):85–90

    Article  CAS  PubMed  Google Scholar 

  17. Pena Ferreira MR, Costa PC, Bahia FM (2010) Efficacy of anti-wrinkle products in skin surface appearance: a comparative study using non-invasive methods. Skin Res Technol 16(4):444–449

    Article  PubMed  Google Scholar 

  18. Phong BT (1975) Illumination for computer generated pictures. Commun ACM 18(6):311–317

    Article  Google Scholar 

  19. Piantanelli A, Maponi P, Scalise L, Serresi S, Cialabrini A, Basso A (2005) Fractal characterisation of boundary irregularity in skin pigmented lesions. Med Biol Eng Comput 43(4):436–442

    Article  CAS  PubMed  Google Scholar 

  20. Ring J, Eberlein-Konig B, Schafer T, Huss-Marp J, Darsow U, Mohrenschlager M, Behrendt H (2000) Skin surface pH, stratum corneum hydration, trans-epidermal water loss and skin roughness related to atopic eczema and skin dryness in a population of primary school children: clinical report. Acta Derm Venereol 80:188–191

    Article  PubMed  Google Scholar 

  21. Ruspini DC, Kolarov K, Khatib O (1997) The haptic display of complex graphical environments. In: Proceedings of the 24th annual conference on computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co., pp. 345–352

  22. Schrader K, Bielfeldt S (1991) Comparative studies of skin roughness measurements by image analysis and several in vivo skin testing methods. J Soc Cosmet Chem 42(6):385–391

    Google Scholar 

  23. Trojahn C, Dobos G, Schario M, Ludriksone L, Blume-Peytavi U, Kottner J (2015) Relation between skin micro-topography, roughness, and skin age. Skin Res Technol 21(1):69–75

    Article  CAS  PubMed  Google Scholar 

  24. Yamada H, Inoue Y, Shimokawa Y, Sakata K (2017) Skin stiffness determined from occlusion of a horizontally running microvessel in response to skin surface pressure: a finite element study of sacral pressure ulcers. Med Biol Eng Comput 55(1):79–88

    Article  PubMed  Google Scholar 

  25. Yamamoto Y, Yamamoto T (1986) Characteristics of skin admittance for dry electrodes and the measurement of skin moisturisation. Med Biol Eng Comput 24(1):71–77

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

This work was supported by Incheon National University Research Grant in 2016 (grant no. 2016). The author would like to thank the Dermatology Atlas Center in Brazil for providing the clinical skin images for the experiments.

Author information

Authors and Affiliations

  1. Department of Information and Telecommunication Engineering, Incheon National University, 119 Academy-ro, Yeonsu-gu, Incheon, 22012, South Korea

    Kwangtaek Kim

Authors
  1. Kwangtaek Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kwangtaek Kim.

Ethics declarations

Conflict of interest

The author declares that there are no conflicts of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kim, K. Image-based haptic roughness estimation and rendering for haptic palpation from in vivo skin image. Med Biol Eng Comput 56, 413–420 (2018). https://doi.org/10.1007/s11517-017-1700-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11517-017-1700-4

Keywords

Search

Navigation