Skip to main content

Table 5 Summary of findings linked to validity evidence category

From: Illuminating the complexities of conflict with evolution: validation of the scales of evolutionary conflict measure (SECM)

Evidence type

Finding

Evidence based on test content

 Logical analysis

Experts agreed the items were representative of the literature review and the target construct

Evidence based on internal structure

 Item fit

Acceptable

 Dimensionality

Three dimensions (personal conflict, family conflict, community conflict) supported

 Precision

Acceptable

 Reliability

Acceptable

 Measurement invariance

Present. Pre-post comparisons of SECM measures would be appropriate

Evidence based on relationships with other variables

 Convergence with measure of similar construct

Family conflict was significantly correlated with a modified IOS item. Evidence of convergence needed for personal and community conflict

Evidence based on response processes

 Respondent cognition related to test

Partially addressed (i.e., “community”). Evidence is also needed to evaluate respondents’ interpretations of items not studied (e.g., using methods such as “think-aloud” interviews)

Validity generalization

 Validity studies in different geographic, institutional, and demographic contexts

Not addressed. Evidence needed to evaluate if the inferences made from the instrument generalize to other contexts

Evidence of consequences

 Outcomes of instrument use

Not addressed. Consequences (e.g., positive, negative) of instrument implementation for respondents and associated educational programs and systems