Interestingly,
participants did not register statistically significant increases in the first 2 items on the self-efficacy survey related to understanding patient condition and specific goals from pre- to post-training, yet observer scores revealed statistically significant improvements on the shared mental model subscale of the ORTAS teame valuation scale.
Several reasons could explain this apparent discrepancy.
First, although not significant, increases were present in both these items from pre- to post-intervention.
Because the pre-intervention scores for these items were relatively high to begin with (ie, approaching a mean of 4.5), the high value blunted the difference seen.
This high value might reflect a degree of overestimation as discussed.
Observer ratings, on the other hand, were not hampered by this elevated pre-intervention score and, as a result, reflected the improvement in shared mental model that participants demonstrated after the debriefing.
Additionally, theobserver ratings were based on an overall team function impression, not individual evaluations.
The team as a whole could have improved considerably in aspects of shared mental model, even though individual members themselves did not show substantial improvements.