Misunderstanding standardized language in research interviews
Leaving the interpretation of words up to participants in standardized survey interviews, aptitude tests, and experiment instructions can lead to unintended interpretation; more collaborative interviewing methods can promote uniform understanding. In two laboratory studies (a factorial experiment and a more naturalistic investigation), respondents interpreted ordinary survey concepts like ‘household furniture’ and ‘living in a house’ quite differently than intended in strictly standardized interviews, when the interpretation was left entirely up to them. Comprehension was more accurate when interviewers responded to requests for clarification with non-standardized paraphrased definitions, and most accurate when interviewers also provided clarification whenever they suspected respondents needed it.