ABSTRACT
To solve the issues in credibility assessment for training simulators such as the afterthought assessment, both human-in-the-loop and hardware-in-the-loop simulation, a new credibility assessment framework for training simulators is presented comprehensively. An overview of representative credibility assessment methodologies for training simulators is summarized and the problems which including the complex tailoring process of existing credibility assessment framework and the one-sided assessment measurement are analyzed. Then, a new credibility assessment framework which comprises project processes, technical processes and information artifacts is developed. Different evaluation perspectives including system function evaluation, system performance evaluation, sense fidelity evaluation and training effectiveness evaluation are considered in technical processes. Finally, an application case is given to demonstrate how to use the framework proposed to assess the credibility of training simulators.
- Lemmers A., Roza M., Voogd J., and F. van Heck. 2003. V&V study of an F-16 familiarization training simulator. Fall SIW Proceeding, 13F-SIW-016.Google Scholar
- Department of Defense. 1996. Verification Validation and Accreditation (VV&A) Recommended Practice Guide. Technical Report. USA: US Department of Defense.Google Scholar
- IEEE. 1997. Verification, Validation, and Accreditation for Distributed Interactive Simulation, IEEE Std 1278.4-1997(R2002). Technical Report.Google Scholar
- IEEE, An Overlay to the High Level Architecture Federation Development and Execution Process, IEEE Std 1516. Technical Report.Google Scholar
- SISO. 2013. GM-VV Vol. 3: Reference Manual, SISO-GUIDE-001.3-2013. Technical Report.Google Scholar
- Roza M., Lemmers A., F. van Heck. 2013. Verification and Validation of Distributed Air Operation Mission Training Environment. In Proceedings of the AIAA Modeling and Simulation Technology Conference, Boston, USA.Google ScholarCross Ref
- Voogd, J., M. Roza, A. van Lier. 2011. The GM-VV Tailored for a Naval Ship-Handling Training Simulation. 2011 International Simulation Multi-Conference, (Den Haag, The Netherlands, June 2011).Google Scholar
- Brade, D., S. Pohl, S. Youngblood. 2005. Preliminary Convention Report: First Combined Con-vention on International VV&A Standardization En-deavors (CConVV&A). Munich, Germany October 20-23.Google Scholar
- Brade, D. et al. 2005. WEAG THALES JP11.20 2005. Final state of the REVVA methodology. Spring SIW-05, San Diego.Google Scholar
- ITOP. 2004. General Procedure for Modeling and Simulation Verification and Validation Information Exchange. Technical Report. International Test Operations Procedure 1-1-002, WGE 7.2.Google Scholar
- Lynn M., Michelle F. 2015. A validation study of driving errors using a driving simulator. Transportation Research Part F, (Jan. 2015), 14--21.Google Scholar
- Geraint L. H., Thomas P. C., Pritam S., et al. 2015. Validation of a pediatric single-port laparoscopic surgery simulator. Journal of Pediatric Surgery (Mar. 2015) 1762--1766..Google Scholar
- Ganesh S., Baichun L., Amie M., et al. 2015. "Face validation of the Virtual Electrosurgery Skill Trainer". Surg Endosc (Mar. 2015), 730--738.Google Scholar
- VanderVliet G. M., Wilkinson C. H., Roscoe M. F. 2001. Verification, Validation, and Accreditation of a flight simulator: the Jship experience. In Proceedings of the AIAA Modeling and Simulation Technology Conference, (Montreal, Canada, August 2001).Google Scholar
- Roza, M. J. Voogd, D. Sebalj. 2014. The Generic Methodology for Verification and Validation (GM-VV) to support acceptance of models, simulations and data. National Aerospace Laboratory NLR, (Mar. 2014).Google Scholar
- Voogd, J., M. Roza, A. Lemmers. 2013. Implementing GM-VV enterprise, project and technical levels. Simulation Interoperability Workshop, (Orlando, FL, September 16-20, 2013).Google Scholar
Recommendations
Machine Learning for the Peer Assessment Credibility
WWW '18: Companion Proceedings of the The Web Conference 2018The peer assessment approach is considered to be one of the best solutions for scaling both assessment and peer learning to global classrooms, such as MOOCs. However, some academic staff hesitate to use a peer assessment approach for their classes due ...
Why People Trust Wikipedia Articles: Credibility Assessment Strategies Used by Readers
OpenSym '22: Proceedings of the 18th International Symposium on Open CollaborationWe examine how a diverse global readership assigns trust to Wikipedia articles, and the strategies they use to assess Wikipedia’s credibility. Through surveys and interviews, we develop and refine a Wikipedia trust taxonomy that describes the ...
Credibility Assessment of Simulation Test for Antiaircraft Missile
ETCS '09: Proceedings of the 2009 First International Workshop on Education Technology and Computer Science - Volume 03A full building flow of simulation model was analyzed aiming at assessing credibility problem of simulation test for antiaircraft missile, and the works on credibility assessment of simulation within full life cycle such as concept model, data ...
Comments