of the sample might lead to similar problems, for
example, with determining the demographic characteristics
of those individuals comprising such an
“expert group.” Legree (1995) demonstrated that the
ratings of experts and nonexperts on a situational
judgment inventory were highly correlated (r=.72 and
.95), indicating that a fairly knowledgeable nonexpert
consensus was as sensitive to relative differences in
solution quality as were the experts. Mayer, Salovey,
Caruso, and Sitarenios (2003) have shown that an
expert panel shows more within-group consistency
than a general sample in selecting the “correct”
answer on emotional intelligence items; however,
there appears to be a great deal of between-group
agreement in terms of these items, suggesting that
both expert panels and general samples tend to agree
on the overall correct answers to emotional intelligence
items.