Two subject matter experts reviewed the attitudes toward science, engineering, math, and 21st
century learning scales in this first draft of the pilot 4th through 5th grade student survey. They
rated each item as “Essential,” “Useful but not Essential,” or “Not Necessary,” and the research
team then calculated Lawshe’s content validity ratio for each survey item. The experts’ responses
were similar to the responses of the experts who reviewed the items at the 6th through 12th grade
reading level. The engineering questions that measured specific attitudes received lower ratings
than more generic engineering questions, and the science, math, and 21st century learning scales
were rated positively overall. These CVR results and those from the experts’ responses to the 6th
through 12th grade survey were considered together in future edits to the surveys.