skip to main content
10.1145/2534329.2534351acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article

Socket virtual design based on low cost hand tracking and haptic devices

Published: 17 November 2013 Publication History

Abstract

This paper concerns a research project that aims at developing an innovative platform to design lower limb prosthesis. The platform is centered on the virtual model of the amputee and is based on a computer-aided and knowledge-guided approach. In particular, the paper focuses on the module, named Socket Modeling Assistant-SMA, conceived to design the socket, the most critical component of the whole prosthesis. The underlining idea is to experiment low-cost devices, such the Leap Motion, to manipulate the 3D virtual model of the socket using hands as traditional done by the prosthetist. The goal is to make available a modeling tool that permits to replicate/emulate manual operations usually performed by the prosthetist during the traditional development process. First, we first describe the traditional socket development process; then the SMA software architecture and the guidelines used to develop the interaction algorithms (integrated within SMA) that exploit the Leap Motion and Falcon devices. Finally preliminary tests and results will be illustrated.

References

[1]
Abu-Tair, M., and Marshall, A. 2009. An empirical model for multi-contact point haptic network traffic. In Proceedings of the 2nd International Conference on Immersive Telecommunications.
[2]
Bordegoni, M., Ferrise, F., Covarrubias, M., and Antolini, M. 2010. Haptic and sound interface for shape rendering. Presence: Teleoperators and Virtual Environments, vol. 19, 4, 341--363.
[3]
Bordegoni, M., and Ferrise, F. 2013. Designing interaction with consumer products in a multisensory VR environment. Virtual and Physical Prototyping, vol. 8, 1--21.
[4]
Buzan, T. 2002. How to mind map, HarperCollins UK.
[5]
Coles, T. R., Meglan, D., and John, N. W. 2011. The role of haptics in medical training simulators: a survey of the state of the art. Haptics, IEEE Transactions on, vol. 4, 1, 51--66.
[6]
Colombo, G., Facoetti, G., Regazzoni, D., and Rizzi, C. 2013. A full virtual approach to design and test lower limb prosthesis: This paper reports a software platform for design and validation of lower limb prosthesis in a completely virtual environment, potentially replacing current manual process. Virtual and Physical Prototyping, vol. 8, 2, 97--111.
[7]
Colombo, G., Facoetti, G., Rizzi, C., Vitali, A., and Zanello, A., 2013. Automatic 3D Reconstruction of Transfemoral Residual Limb from MRI Images. In Digital Human Modeling and Applications in Health, Safety, Ergonomics, and Risk Management. Human Body Modeling and Ergonomics. Springer, 324--332.
[8]
Colombo, G., Facoetti, G., Morotti, R., and Rizzi, C. 2011. Physically based modelling and simulation to innovate socket design. Computer-Aided Desing and Applications, vol. 8, 4, 617--631.
[9]
Colombo, G., De Angelis, F., and Formentini, L. 2010. Integration of virtual reality and haptics to carry out ergonomic tests on virtual control boards. International Journal of Product Development, vol. 11, 1, 47--61.
[10]
Goh, J. C. H., Lee, P. V. S., Toh, S. L., and Ooi, C. K. 2005. Development of an integrated CAD-FEA process for below-knee prosthetic sockets. Clinical Biomechanics, vol. 20, 6, 623--629.
[11]
Hutchins, M., Adcock, M., Stevenson, D., and Krumpholz, A. 2005. The design of perceptual representations for practical networked multimodal virtual training environments. In Proceedings of the 11th International Conference on Human-Computer Interaction.
[12]
Katsura, S., Iida, W., and Ohnishi, K. 2005. Medical mechatronics---An application to haptic forceps. Annual Reviews in Control, vol 29, 2, 237--245.
[13]
Leap Developers 2013. Leap Motion Devices. Available at: https://www.leapmotion.com/.
[14]
Liang, H., Yuan, J., and Thalmann, D. 2012. Hand pose estimation by combining fingertip tracking and articulated ICP. In Proceedings of the 11th SIGGRAPH 2012 International Conference on Virtual-Reality Continuum and its Applications in Industry.
[15]
Meier, U., Lòpez, O., Monserrat, C., Juan, M., C., and Alcaniz, M. 2005. Real-time deformable models for surgery simulation: a survey. Computer methods and programs in biomedicine, vol. 77, 3, 183--197.
[16]
Melax, S., Keselman, L., and Orsten, S. 2013. Dynamics based 3D skeletal hand tracking. In Proceedings of the SIGGRAPH 2013 Symposium on Interactive 3D Graphics and Games.
[17]
Narumi, T., Kajinami, T., Tanikawa, T., and Hirose, M. 2010. Meta cookie. In SIGGRAPH 2010 Posters.
[18]
Ninu, A., Dosen, S., Farina, D., Rarray, F., and Dietl, H. 2013. A novel wearable vibro-tactile haptic device. In Consumer Electronics (ICCE), 2013 IEEE International Conference on.
[19]
Ohnishi, K., Katsura, S., and Shimono, T. 2010. Motion control for real-world haptics. Industrial Electronics Magazine, IEEE, vol. 4, 2, 16--19.
[20]
Perez-Gutierrez, B., Martinez, D. M., and Rojas, O. E. 2010. Endoscopic endonasal haptic surgery simulator prototype: A rigid endoscope model. In Virtual Reality Conference (VR), 2010 IEEE.
[21]
Portnoy, S., Yizhar, Z., Shabsin, N., Itzchak, Y., Kristal, A., Dotan-Marom, Y., Siev-Ner, I., and Gefen, A. 2008. Internal mechanical conditions in the soft tissues of a residual limb of a trans-tibial amputee. Journal of biomechanics, vol. 41, 9, 1897--1909.
[22]
Prisacariu, V. A., and Reid, I. 2012. 3D hand tracking for human computer interaction. Image and Vision Computing, vol. 30, 3, 236--250.
[23]
Riener, R., and Harders, M. 2012. Virtual Reality in Medicine Springer, ed., London.
[24]
Schultz, R. 2013. AYAM web site. Available at: http://ayam.sourceforge.net/ayam.html.
[25]
Sela, G., Subag, J., Lindblad, A., Albocher, D., Schein, S., and Elber, G. 2007. Real-time haptic incision simulation using FEM-based discontinuous free-form deformation. Computer-Aided Design, vol. 39, 8, 685--693.
[26]
Sewell, P., Noroozi, S., Vinney, J., Amali, R., and Andrews, S. 2012. Static and dynamic pressure prediction for prosthetic socket fitting assessment utilising an inverse problem approach. Artificial Intelligence in Medicine, vol. 54, 1, 29--41.
[27]
Sewell, P., Noroozi, S., Vinney, J., Amali, R., and Andrews, S. 2012. Patient-Specific Optimization of Prosthetic Socket Construction and Fabrication Using Innovative Manufacturing Processes. In Materialise World Conference 2010.
[28]
Wang, R. Y., and Popović, J., 2009. Real-time hand-tracking with a color glove. In ACM Transactions on Graphics (TOG).

Cited By

View all
  • (2020)Reconstrucción 3D para el desarrollo de prótesis de miembro inferiorRevista UIS Ingenierías10.18273/revuin.v19n1-202000719:1(73-85)Online publication date: 1-Jan-2020
  • (2016)Visual Representation of Dynamic Pressure Map on the Digital Human Model of Patient with a Lower Limb ProsthesisDigital Human Modeling: Applications in Health, Safety, Ergonomics and Risk Management10.1007/978-3-319-40247-5_15(140-149)Online publication date: 23-Jun-2016
  • (2016)Virtual Tailor for Garment DesignVirtual, Augmented and Mixed Reality10.1007/978-3-319-39907-2_62(653-661)Online publication date: 19-Jun-2016
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRCAI '13: Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
November 2013
325 pages
ISBN:9781450325905
DOI:10.1145/2534329
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 November 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D modeling
  2. hand tracking
  3. haptic interaction
  4. lower limb prosthesis

Qualifiers

  • Research-article

Funding Sources

  • Fondazione Cariplo (Intesa Bank, Italy)

Conference

VRCAI 2013
Sponsor:

Acceptance Rates

VRCAI '13 Paper Acceptance Rate 35 of 75 submissions, 47%;
Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2020)Reconstrucción 3D para el desarrollo de prótesis de miembro inferiorRevista UIS Ingenierías10.18273/revuin.v19n1-202000719:1(73-85)Online publication date: 1-Jan-2020
  • (2016)Visual Representation of Dynamic Pressure Map on the Digital Human Model of Patient with a Lower Limb ProsthesisDigital Human Modeling: Applications in Health, Safety, Ergonomics and Risk Management10.1007/978-3-319-40247-5_15(140-149)Online publication date: 23-Jun-2016
  • (2016)Virtual Tailor for Garment DesignVirtual, Augmented and Mixed Reality10.1007/978-3-319-39907-2_62(653-661)Online publication date: 19-Jun-2016
  • (2015)Multi-material design and 3D printing method of lower limb prosthetic socketsProceedings of the 3rd 2015 Workshop on ICTs for improving Patients Rehabilitation Research Techniques10.1145/2838944.2838955(42-45)Online publication date: 1-Oct-2015
  • (2015)SimplyNURBS: A Software Library to Model NURBS for Medical ApplicationsComputer-Aided Design and Applications10.1080/16864360.2015.103334612:6(794-802)Online publication date: 29-Apr-2015
  • (2015)A Mobile Application for the Stereoacuity TestDigital Human Modeling. Applications in Health, Safety, Ergonomics and Risk Management: Ergonomics and Health10.1007/978-3-319-21070-4_32(315-326)Online publication date: 21-Jul-2015
  • (2015)Low Cost Hand-Tracking Devices to Design Customized Medical DevicesVirtual, Augmented and Mixed Reality10.1007/978-3-319-21067-4_36(351-360)Online publication date: 21-Jul-2015
  • (2014)A real-time reconstructed 3D environment augmented with virtual objects rendered with correct occlusion2014 IEEE Games Media Entertainment10.1109/GEM.2014.7048102(1-8)Online publication date: Oct-2014
  • (2014)A Low Cost Haptic Mouse for Prosthetic Socket ModelingDigital Human Modeling. Applications in Health, Safety, Ergonomics and Risk Management10.1007/978-3-319-07725-3_50(508-515)Online publication date: 2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media