Yanping Hu
ABSTRACT
When frogmen perform underwater tasks, the visibility and permeability of the surrounding environment are poor due to the influence of slit, sewage and sediment, and the visual distance is only about 3-5 meters. However, integrating multi-beam imaging sonar on the top of frogman's helmet and displaying real-time sonar image information through AR glasses can expand frogman's "field of view" to 100 meters. This system satisfies the big view field of target monitoring and searching and the small view field of target recognition and tracking, thus greatly improving frogman's underwater situational awareness ability. Helmet display system, as a typical application of AR technology, has been widely used in F35 fighter plane and BMW motorcycle. However, due to the limited display area, low underwater visibility and difficult interaction, there is no helmet display system suitable for underwater Frogman. To this end, we design and implement a monocular silicon-based perspective VR visualization system for underwater frogman, which breaks through a series of key technologies that sonar, camera and underwater environment information multi-source data fusion, multi-window adaptive layout technology, sonar image real-time visualization technology and camera image real-time visualization technology, and realizes multi-source information integration and VR panoramic visualization for underwater frogman operation.
- Yu Hanjin, Shuai Ran, Zheng Weigang, Design of Visual Helmet with Low Visibility Underwater, Inverter World, No. 12, 2017.Google Scholar
- http://www.sohu.com/a/245279342_276499.Google Scholar
- http://auto.163.com/16/0106/14/BCLCPMNC000854CH.html.Google Scholar
- https://www.tuicool.com/articles/IzENVz.Google Scholar
- http://dy.163.com/v2/article/detail/DJ0JK0UU0515HFPP.htmlGoogle Scholar
- AIR FORCE MIL-STD-1787 C CONT. DIST.-2001 aircraft display symbology.Google Scholar
- Van Orden K F, Divita J, Shim M J. Redundant Use of Luminance and Flashing with Shape and Color as Highlighting Codes in Symbolic Displays [J]. Human Factors, 1993, 35: 195--204.Google ScholarCross Ref
- Montgomery D A, Sorkin K D. Observer sensitivity to element reliability in a multi-element visual display[J]. Human Factors, 1996, 38(3): 484--494.Google ScholarCross Ref
- Michelle Yeh, Christopher D. Wickens. Attentional Filtering in the Design of Electronic Map Displays: A Comparison of Color Coding, Intensity Coding, and Decluttering Techniques [J]. Human Factors, 2001, 43(4): 543--562.Google ScholarCross Ref
- Peinecke N, Knabl P M, Schmerwitz S, et a1. An evaluation environment for a helmet-mounted synthetic degraded visual environment display[C]/Digital Avionics Systems Conference(DASC), 2014 IEEE/AIAA 33rd. IEEE, 2014:2C2-1--2C2-7.Google Scholar
- Doehler H U, Schmerwitz S, Lueken T. Visual-conformal display format for helicopter guidance[C]/ SPIE Defense Security. International Society for Optics and Photonics, 2014: 90870J-90870J. 12.Google Scholar
- General requirements for ergonomics design of GJB 1062A-2008 military visual display, published by Military Standard Distribution Department of General Equipment Department, December 2008.Google Scholar
- Guo Xiaochao, Liu Baoshan, Ma Cedar, Eli. Information display needs of new fighter pilots during Tactical Navigation [J].Ergonomics, 2003, 01:5.10--22.Google Scholar
- Wang Haiyan, Bian Ting, Xue Chengqi. Research on Display and Control Interface Layout Design of New Generation Fighter [J]. Electromechanical Engineering, 201l, 27(4): 57--61.Google Scholar
- Fu Yaqiang, Xu Baihua. Principles and methods of symbolic system evaluation for airborne helmet-mounted displays [J]. Aerospace Medicine and Medical Engineering, 2013, 26 (5): 415--419.Google Scholar
- Wu Xiaoli, Xue Chengqi, Tang Wencheng, Shao Jiang, Li Jing. An Experimental Study on Visual Limitation of Target Search in Radar Situation Interface [J]. Journal of Southeast University (Natural Science Edition), 2014, 06: 1166--1170.Google Scholar
- Zhang Qiang, Research on Information Layout Optimization of Helmet Display Interface, Southeast University, 2015.Google Scholar
- Research on Information Encoding Method of Helmet Display Interface Based on Visual Cognition Theory, Southeast University, Shao Jiang, 2016.Google Scholar
- Zhou Fangfang, Zeng Yuan, Zhao Ying, Zhang Rong, Wang Jinsong, Jinlei, Zheng Wei, Wang Yunhai, Cooperative Visual Analysis Method of Radio Spectrum and Radio Signal Data, Journal of Computer Aided Design and Graphics, January 2017.Google Scholar
- Hutong Wu, Shicao Jia, Jinsong Wang, Jiawan Zhang. M3: visual exploration of spatial relationships between flight trajectories. Journal of Visualization (2018) 10.Google Scholar
Index Terms
- Underwater Frogman Situational Awareness and AR Helmet Display and Control System
Recommendations
Exploring the Performance of Graphically Designed AR Markers
MUM '20: Proceedings of the 19th International Conference on Mobile and Ubiquitous MultimediaThe design of graphical augmented reality (AR) markers requires compromise between the aesthetic appearance and tracking reliability. To investigate the topic, we created a virtual reality (VR) pipeline to evaluate marker performance, and validated it ...
A safe low-cost HMD for underwater VR experiences
SA '16: SIGGRAPH ASIA 2016 Mobile Graphics and Interactive ApplicationsRecently, consumer head-mounted VR displays (HMDs) like the Oculus Rift1 and Samsung Gear VR2 have driven much research into interesting applications that include full-body sensory experiences. For example, PaperDude VR [Bolton et al. 2014] uses the ...
Optimized HMD system for underwater VR experience
SIGGRAPH '17: ACM SIGGRAPH 2017 PostersMany people exercise in water. However, when they swim in the pool, they may get bored. Therefore, studies on virtural reality (VR) and augmented reality (AR) in water have been made. Aquacave[Yamashita et al. 2016] allows you to experience VR in an ...
Comments