With all research, there is a given amount of error to deal with. Bias may arise during surveys and focus groups (for example, interviewers leading the respondents) or be present in the design and wording of the questions themselves. There could be sample errors or respondent errors. Using the Internet to administer surveys removes the bias that may arise from an interviewer. However, with no interviewer to explain questions, there is potential for greater respondent error. This is why survey design is so important, and why it is crucial to test and run pilots of the survey before going live.
Respondent errors also arise when respondents become too familiar with the survey process. The general industry standard is to limit respondents to being interviewed once every six months.
Sample error is a fact of market research. Some people are just not interested, nor will they ever be interested, in taking part in research. Are these people fundamentally different from those who do? Is there a way of finding out? To some extent, web analytics, which track the behaviour of all visitors to your website, can be useful in determining this.
When conducting online research, it is crucial to understand who is in the target market, and what the best way to reach that target market is. Web surveys can exclude groups of people due to access or ability. It is vital to determine if is this is acceptable to the survey, and to use other means of capturing data if not.
