Skip to main content

Table 2 Inter-rater reliability (Cohen’s κ) and percent agreement for student observations

From: Testing the effectiveness of two natural selection simulations in the context of a large-enrollment undergraduate laboratory class

Behavior category

Physical treatment (36 observations)

Virtual treatment (60 observations)

% Agreement

Cohen’s κ

% Agreement

Cohen’s κ

Gaze

0.72

0.50

0.97

0.77

Verbal

0.83

0.61

0.80

0.52

Motor

0.75

0.65

0.88

0.79

Affect

0.86

0.76

0.93

0.75

  1. By two observers in two class sections (one for each treatment)