To measure inter-observer agreement across the ordinal categories
for each guideline and consensus statement, a weighted kappa (kw)
was calculated using SAS version 9.2 software. This takes into
account the degree of disagreement between the observers by
assigning less weight to agreement, as categories are further
apart.15,16 An overall kw was also calculated across all guidelines and
consensus statement. A kappa value of