Skip to main content

Table 4 Reliability estimates for the categorization of pre-exam and exam questions ( N= 42) into Bloom’s levels of learning by two independent reviewers compared with categorizations of assessments used in the analysis

From: Impact of pre-lab learning activities, a post-lab written report, and content reduction on evolution-based learning in an undergraduate plant biodiversity lab

Independent reviewer

K qw

SE

Lower 95%CI

Upper 95%CI

K qwmax

AdjustedK qw

1

0.863

0.035

0.793

0.932

0.954

0.904

2

0.870

0.006

0.861

0.884

0.931

0.937

  1. K qw  = quadratic weighted kappa, SE = standard error, CI = 95% confidence interval, K qwmax  = the maximum quadratic weighted kappa for the observed marginal frequencies, and Adjusted K qw  = the observed proportion of the K qwmax (Cohen [1968], Sim and Wright [2005]).