This is test for differences between the ratings of the two raters (or k nominal responses with paired observations). Maxwell's chi-square statistic tests for overall disagreement between the two raters. The statistically significant Maxwell test statistic indicates that the raters disagree significantly in at least one category.
Ratings of rater #1 (rows) and rater #2 (columns)
A B C D Total
A 8 5 1 0 14
B 3 6 3 2 14
C 2 4 5 1 12
D 0 1 2 7 10
Total 13 16 11 10 50