ABSTRACT
Besides the great benefit of minimizing intrusions made in body, endoscopic surgery has the advantage of producing abundant documentation regarding the procedure as well. Recordings can be used not only to document the surgery but as a mean for learning and improving experts knowledge too. To minimize time and effort that experts invest in preparing informative endoscopic videos, tools that can automatically identify interesting parts in videos are needed. To achieve this, an annotated data set is required. This paper presents an approach for collecting endoscopic videos and related experts knowledge. For this, a social network with integrated video annotation and presentation tools is used. Experts can upload, annotate and share their videos with other physicians. In the background their interactions with the videos are recorded, interpreted and used to derive predictive models or improve existing ones. Once a prediction model is derived, its results will be displayed to physicians as suggestions, which can be integrated into their video annotations. Physicians choice to either keep these suggestions or discard them will serve as a feedback to the learned model and used to refine the derived knowledge.
- K. S. B. Münzer and L. Böszörmenyi. Relevance segmentation of laparoscopic videos. IEEE International Symposium on Multimedia, pages 84--91, December 2013. Google ScholarDigital Library
- L. Bouarfa, O. Akman, A. Schneider, P. P. Jonker, and J. Dankelman. In-vivo real-time tracking of surgical instruments in endoscopic video. Minimally Invasive Therapy Allied Technologies, 21(3):129--134, 2012.Google ScholarCross Ref
- Y. Cao, W. Tavanapong, K. Kim, J. Wong, J. Oh, and P. de Groen. A framework for parsing colonoscopy videos for semantic units. Multimedia and Expo, 2004. ICME '04. 2004 IEEE International Conference, 3(2):1879--1882, June 2004.Google Scholar
- D. Iakovidis, S. Tsevas, and A. Polydorou. Reduction of capsule endoscopy reading times by unsupervised image mining. Computerized Medical Imaging and Graphics, 34(6):471 -- 478, September 2010.Google ScholarCross Ref
- D. K. Iakovidis, D. E. Maroulis, and S. A. Karkanis. An intelligent system for automatic detection of gastrointestinal adenomas in video endoscopy. Computers in Biology and Medicine, 36(10):1084 -- 1103, 2006.Google ScholarCross Ref
- R. Laiola Guimar\ aes, P. Cesar, and D. C. Bulterman. Creating and sharing personalized time-based annotations of videos on the web. Proceedings of the 10th ACM Symposium on Document Engineering, 10(10):27 -- 36, 2010. Google ScholarDigital Library
- L. A. Leiva and R. Vivo. Web browsing behavior analysis and interactive hypervideo. ACM Trans. Web 7, 6(2):492--525, February 2009. Google ScholarDigital Library
- M. Lux, O. Marques, K. Schoeffmann, L. Boeszoermenyi, and G. Lajtai. A novel tool for summarization of arthroscopic videos. Computers in Biology and Medicine, 46:521--544, September 2009. Google ScholarDigital Library
- M. Lux and M. Riegler. Annotation of endoscopic videos on mobile devices: A bottom-up approach. ACM Multimedia Systems Conference, 4:141 -- 145, January 2009. Google ScholarDigital Library
- N. Padoy, T. Blumb, S. A. Ahmadib, H. Feussnerc, M. O. Bergerd, and N. Navabb. Medical image analysis. ACM Trans. Program. Lang. Syst., 16(3):632 -- 641, April 2012.Google Scholar
- M. Swan. Emerging patient-driven health care models: an examination of health social networks,consumer personalized medicine and quantified self-tracking. International journal of environmental research and public health, 3(2):1879--1882, June 2004.Google Scholar
Index Terms
- Learning recognition of semantically relevant video segments from endoscopy videos contributed and edited in a private social network
Recommendations
Expert driven semi-supervised elucidation tool for medical endoscopic videos
MMSys '15: Proceedings of the 6th ACM Multimedia Systems ConferenceIn this paper, we present a novel application for elucidating all kind of videos that require expert knowledge, e.g., sport videos, medical videos etc., focusing on endoscopic surgery and video capsule endoscopy. In the medical domain, the knowledge of ...
Annotation of endoscopic videos on mobile devices: a bottom-up approach
MMSys '13: Proceedings of the 4th ACM Multimedia Systems ConferenceVideo annotation is a tedious task. But especially in medical domain the knowledge of experts for the interpretation of videos is of high value. Typically medical doctors do not have time for extensive annotation, but are used to manual notes, speech ...
Dealing with the video tidal wave: the relevance of expertise for video tagging
HT '10: Proceedings of the 21st ACM conference on Hypertext and hypermediaThe vast amounts of video that need to be tagged preclude the exclusive use of professional indexers. Thus a significant amount of video will need to be tagged by non-experts. Are the tags created by experts demonstrably superior to those of non-experts,...
Comments