Our venue operator and user surveys are currently in the pilot testing phase in Bangladesh, Brazil, Chile and the Philippines. This phase has two parts:
1. Cognitive testing to check for comprehension problems with the survey questions.
2. Field testing to check for potential problems in the entire survey adminstration process (e.g. structure, content, flow and length of the questionnaires) as well as the actual data collected.
We begin with cognitive testing on a small scale, after which we make revisions to the survey instruments to address issues revealed by the cognitive tests. Next we carry out the field testing with a larger number of locations and respondents.
This strategy enables us to use the results of the cognitive testing to eliminate comprehension of survey questions as a potential major source of delays during field testing. For example, we are likely to get a more accurate estimate of the length of the surveys if interviewers don’t have to spend too much time trying to explain what specific survey questions mean.
Our survey implementation teams have been given detailed guidance in our survey testing guidelines.