Measurement Validity and Reliability Reliability and Validity

Gomez, D., Haas, B., Ahmed, N. Tien, H., & Nathens, A. (2011). Disaster preparedness of Canadian trauma centres: the perspective of medical directors of trauma.

Canadian Journal of Surgery, 54(1): 9-17.

The dependent variable examined in this study was the disaster preparedness of trauma centers. The dependent variable was measured using a questionnaire which was distributed to twenty-nine trauma centers in Canada. The medical director of each trauma center was invited to respond to the questions on the instrument. The researchers then employed descriptive statistics to describe the state of preparedness based on measures within the instrument.

The question of validity is essentially does the instrument measure what it purports to measure. The issue of validity in a study has several components that may be separated into categories of internal and external validity. Elements such as face validity, content and construct validity are important considerations in any research program. Several approaches...

In considering content validity where the fit between the nominal and operational definitions are considered, the study appears to have adequate content validity (Trochim 2005). The researchers noted that they reviewed literature on disaster preparedness and based on that review identified 6 domains that were critical to disaster preparedness. Consequently, "disaster preparedness' would have adequate content validity since it was anchored in the existing theory and constructed using a highly deductive approach to variable construction. The nature of the research does not permit an adequate evaluation of other types of validity in particular concurrent and predictive validity which would be linked to specific correlational tests. There was no report on these tests and consequently it is not possible to report on these types of validity.
The opinion of medical directors was used as the independent variable to determine the state of disaster preparedness. The researchers noted that this particular approach was not anchored in…