Cited 2 times since 2017 (0.3 per year) source: EuropePMC Simulation in healthcare : journal of the Society for Simulation in Healthcare, Volume 12, Issue 6, 1 1 2017, Pages 377-384 Increasing Authenticity of Simulation-Based Assessment in Diagnostic Radiology. van der Gijp A, Ravesloot CJ, Tipker CA, de Crom K, Rutgers DR, van der Schaaf MF, van der Schaaf IC, Mol CP, Vincken KL, Ten Cate OTJ, Maas M, van Schaik JPJ
Introduction
Clinical reasoning in diagnostic imaging professions is a complex skill that requires processing of visual information and image manipulation skills. We developed a digital simulation-based test method to increase authenticity of image interpretation skill assessment.
Methods
A digital application, allowing volumetric image viewing and manipulation, was used for three test administrations of the national Dutch Radiology Progress Test for residents. This study describes the development and implementation process in three phases. To assess authenticity of the digital tests, perceived image quality and correspondence to clinical practice were evaluated and compared with previous paper-based tests (PTs). Quantitative and qualitative evaluation results were used to improve subsequent tests.
Results
Authenticity of the first digital test was not rated higher than the PTs. Test characteristics and environmental conditions, such as image manipulation options and ambient lighting, were optimized based on participants' comments. After adjustments in the third digital test, participants favored the image quality and clinical correspondence of the digital image questions over paper-based image questions.
Conclusions
Digital simulations can increase authenticity of diagnostic radiology assessments compared with paper-based testing. However, authenticity does not necessarily increase with higher fidelity. It can be challenging to simulate the image interpretation task of clinical practice in a large-scale assessment setting, because of technological limitations. Optimizing image manipulation options, the level of ambient light, time limits, and question types can help improve authenticity of simulation-based radiology assessments.
