Abstract
Bone sawing is widely used for mandibular angle reduction. In this paper, we develop a surgical simulator for mandibular angle reduction with real-time collision detection, bone reconstruction and force haptic. A volume-based model was organized following the CT or MRI image sequence arrangement. The surgical instrument was simplified into two triangles in geometric model. Then, a new volume-based collision detection method was used to meet the real-time requirements of the simulator. Currently, most of the bone sawing operations regarded the swept surface as the real cut surface of bone. Due to the high-speed reciprocating of the bone saw operation, we innovatively used Marching Cubes Method for the real-time reconstruction of the bone internal sawing part and provided the users with a fine cutting surface. In addition, to obtain a well virtual effect, a simplified bone removal and reconstruction method is carried out to implement the real-time topological changing of the mandibular surface. This paper presents a mechanistic model for prediction of the force during bone sawing, and the simulated force is similar to the measured force in real surgery. Eventually, we realized the high quality visual rendering and tactile rendering, the refresh rate of the force reaches 1000 Hz, and visual refresh frequency up to 30 Hz. To validate the effectiveness of the system, some experiments of simulator evaluation based on the patient-specific data was constructed. Results shown that the virtual orthopedic surgical simulation system can provide inexperienced interns and students with a low-cost, repeatable surgical training platform.
Graphical Abstract
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Agus M, Brelstaff GJ, Giachetti A, Gobbetti E, Zanetti G, Zorcolo A, Picasso B, Franceschini SS (2004) Physics-based burr haptic simulation: tuning and evaluation. In: Proceedings of international symposium on haptic interfaces for virtual environment and teleoperator systems, 2004, pp 128–135
Basdogan C, Srinivasan AA (2002) Haptic rendering in virtual environments. In: Stanney K (ed) Handbook of virtual environments. Lawrence Erlbaum Inc, Hillsdale, pp 117–134
Bielser D, Gross MH (2000) Interactive simulation of surgical cuts. In: Proceedings of the eighth pacific conference on computer graphics and applications, 2000, pp 116–442
Chen RJ, Lin HW, Chang YH, Wu CT, Lee ST (2011) Development of an augmented reality force feedback virtual surgery training platform. Int J Autom Smart Technol 1(1):41–45
Cotin S, Delingette H, Ayache N (1999) Real-time elastic deformations of soft tissues for surgery simulation. IEEE Trans Vis Comput Graph 5(1):62–73
Dan M, Sewell C, Blevins N, Barbagli F, Salisbury K (2004) A collaborative virtual environment for the simulation of temporal bone surgery. In: Proceedings of medical image computing and computer-assisted intervention—Miccai 2004, International Conference Saint-Malo, France, September 26–29, 2004, pp 319–327
Dyn N, Levine D, Gregory JA (1990) A butterfly subdivision scheme for surface interpolation with tension control. ACM Trans Graph 9(2):160–169
Forsslund J, Sallnas EL, Palmerius KJ (2009) A user-centered designed foss implementation of bone surgery simulations. In: 2009 Third Joint EuroHaptics conference and symposium on Haptic interfaces for virtual environment and teleoperator systems, World Haptics 2009, pp 391–392
Gibson SFF, Samosky J, Mor A, Fyock C, Grimson WEL, Kanade T, Kikinis R, Lauer HC, Mckenzie N, Nakajima S (1997) Simulating arthroscopic knee surgery using volumetric object representations, real-time volume rendering and haptic feedback. In: Joint conference on computer vision, virtual reality and robotics in medicine and medial robotics and computer-assisted surgery, pp 369–378
Hsieh M, Tsai M, Yeh Y (2012) An amputation simulator with bone sawing haptic interaction. Biomed Eng Appl Basis Commun 18(05):229–236
Kim YH, Cho BC, Lo LJ (2009) Facial contouring surgery for asians. Semin Plast Surg 23(1):22
Kneebone R (2003) Simulation in surgical training: educational issues and practical implications. Med Educ 37(3):267
Lo SH (1998) 3d mesh refinement in compliance with a specified node spacing function. Comput Mech 21(1):11–19
Loop CT (1987) Smooth subdivision surfaces based on triangles. Department of Mathematics, the University of Utah, Masters Thesis
Lorensen WE, Cline HE (1987) Marching cubes: a high resolution 3d surface construction algorithm. In: Conference on computer graphics and interactive techniques, pp 163–169
Osa T, Abawi CF, Sugita N, Chikuda H, Sugita S, Tanaka T, Oshima H, Moro T, Tanaka S, Mitsuishi M (2015) Hand-held bone cutting tool with autonomous penetration detection for spinal surgery. IEEE/ASME Trans Mechatron 20(6):3018–3027
Owa S, Nishimoto K, Altnta O, Lee SK, Eun CN (2010) Toward stable and realistic haptic interaction for tooth preparation simulation. J Comput Inf Sci Eng 10(2):441–452
Peng Y, Jia R, Wang Y, Zhang M (2011) A virtual endoscopy system for virtual medicine. Comput Anim Virtual Worlds 22(2–3):277–284
Peng Y, Ma Y, Wang Y, Shan J (2017) The application of interactive dynamic virtual surgical simulation visualization method. Multimed Tools Appl 1–18
Petersik A, Pflesser B, Tiede U, Hne KH, Leuwer R (2003) Realistic haptic interaction in volume sculpting for surgery simulation. In: International conference on surgery simulation and soft tissue modeling, pp 194–202
Shewchuk JR (2002) Delaunay refinement algorithms for triangular mesh generation. Comput Geom 47(7):741–778
Sofronia RE, Davidescu A, Savii GG (2012a) Towards a virtual reality simulator for orthognathic basic skils. Appl Mech Mater 162:352–357
Sofronia RE, Savii GG, Davidescu A (2012b) Real-time collision detection for long thin medical instruments in virtual reality-based simulators. In: International conference on optimization of electrical and electronic equipment, pp 1107–1112
Tsai MD, Hsieh MS, Tsai CH (2007) Bone drilling haptic interaction for orthopedic surgical simulator. Comput Biol Med 37(12):1709
Vankipuram M, Kahol K, Mclaren A, Panchanathan S (2010) A virtual reality simulator for orthopedic basic skills: a design and validation study. J Biomed Inform 43(5):661
Wang Q, Chen H, Wu W, Jin HY, Heng PA (2013) Real-time mandibular angle reduction surgical simulation with haptic rendering. IEEE Trans Inf Technol Biomed Publ IEEE Eng Med Biol Soc 16(6):1105–1114
Wang Q, Qin J, Wang W, Shan J, Zhang J, Liu X, Heng PA (2015) Haptic rendering of drilling process in orthopedic surgical simulation based on the volumetric object. In: IEEE international conference on digital signal processing, pp 1098–1101
Yang DB, Park CG (1991) Mandibular contouring surgery for purely aesthetic reasons. Aesthetic Plast Surg 15(1):53
Acknowledgements
This work is supported by the Natural Science Foundation of Shandong Province under Grant No. ZR2015FM013, the National Natural Science Foundation of China under Grant No. 61502279, the National key research and development project of China under Grant No. 2016YFC0801406, the National key research and development project of the Shandong Province under Grant No. 2016GSF120012, by Special Project Fund of Taishan Scholars of Shandong Province, Leading Talent Project of Shandong University of Science and Technology Guangdong province science and technology plan project (No. 2016A020220013), The Science and Technology Plan Project of Guangzhou (No. 201704020141), a Grant from Shenzhen Science and Technology Program (JSGG20170414112714341).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yan, Y., Li, Q., Wang, Q. et al. Real-time bone sawing interaction in orthopedic surgical simulation based on the volumetric object. J Vis 21, 239–252 (2018). https://doi.org/10.1007/s12650-017-0455-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12650-017-0455-1