My research partners and I first encountered
this in 2007 when we tried to
get turkers to rate the quality of Wikipedia
articles, which has been a difficult
thing for researchers to do with
automated tools. With high hopes, we
posted a number of articles to Mechanical
Turk, paying turkers $0.05 to make
judgments about their quality and to
write what improvements they thought
the article needed. We got results remarkably
quickly: 200 ratings within
two days.