Throwing out Babies with the Bathwater: Guidelines for Simulation (Based) Research.

A number of recent publications about the state of the science in simulation research, as well as framework proposing ways to synchronize simulation research led to what would be the obvious next step: development of standardized reporting guidlines for simulation research. 

This step has been very recently undertaken by the INSPIRE network, which posted a call for participation in a collaborative project with the goal to develop standardized reporting guidelines for simulation-based research (see Haji et al., 2013 for an alternative view on the use of "based").  A guideline is a statement by which to determine a course of action and a structure put in place to streamline a particular processes according to a set routine or sound practice. 

Curently, there are numerous reporting guidelines (CONSORT, STROBE, SQUIRE etc) for various types of studies.  Unfortunately, a reporting guideline does not exist for simulation research.  As a result, the nature of how simulation studies are reported is highly variable. By developing a standardize reporting guideline, INSPIRE is hoping to raise the bar for simulation research.

I usually do not take the "devil's advocate" position, but in this case I will.  The proposal calls for guidelines for standardized reporting for simulation research.  The questions I pose are: Are we ready for such guidelines?  Education, which simulation is a part of, is a complex system, which needs to be researched using multiple lenses, methodologies, experimental paradigms.  Do we know what methods are best to research this complex system? Are we running into the danger of following , perhaps prematurely formed guidelines and thus not accepting unorthodox approaches that do not fit with the guidelines?  Throwing a babies with the bathwater.

If anyone is wishing to participate in the INSPIRE project feel free to contact me and I will relay the information.  I would also like to read what our community has to say about this initiative.  Perfect timing? Premature? If developed, these guidlines will have a very direct effect on what we do, how we do it, and how we report on what we did? Thankfully, by definition following a guideline is never mandatory as guidelines are not binding and are not enforced.  Perhaps this guideline building exercise will lead all of us to a better understating of where we currently stand in simulation research.

I think it is worth having a conversation about...