> Yes, there is a question over the representativeness of Mechanical Turk workers.
There are more fundamental issues. Having run several studies either with MTurk or panel providers who use MTurk to source some/most of their respondents, I have trouble trusting any study with an MTurk sample that doesn't explicitly show 1. how they verified respondent location and demographics and 2. how they controlled for bots and mindless click-throughs.
Even though they used a convenience sample, issues like reading comprehension (which you can get from non-native English speakers VPN'ing through a US-based IP) and participants trying to get through the study as quickly as possible - or automating their responses altogether - absolutely matter.
There are more fundamental issues. Having run several studies either with MTurk or panel providers who use MTurk to source some/most of their respondents, I have trouble trusting any study with an MTurk sample that doesn't explicitly show 1. how they verified respondent location and demographics and 2. how they controlled for bots and mindless click-throughs.
Even though they used a convenience sample, issues like reading comprehension (which you can get from non-native English speakers VPN'ing through a US-based IP) and participants trying to get through the study as quickly as possible - or automating their responses altogether - absolutely matter.