Saturday, March 19, 2011

Administering Questionnaires


Main Methods of Administration


-          face to face interviews

-          telephone

-          postal self administered questionnaires

-          internet surveys

o   e-mail

o   attachment

o   interactive  questionnaire

o   web pages

o   combined web page and e-mail

 

Computer Assisted Questionnaire Administration

 

-          advantages

o   complex branching

o   piping à feeds answer into later questions

o   feedback – eg mistakes / non response

o   error checking à expect numeric, got alpha  / answer outside of expected range

o   consistency – eg, 18 yo, then answers has 4 children.

o   enforce question answering requirements à eg, pick only one

o   more engaging interface

o   range of response types à dropdowns, radio boxes, sliding scales

o   random question order

o   order of answering

o   automatic coding and data file creation

o   sample controls

 

 

Four Methods Compared – Strengths and Weaknesses

 

-          response rates

o   unable to calculate response rate for many internet questionnaires

o   response rate = (number returned) / (n in sample – ineligible – unreachable))

-          obtaining representative samples

o   non responders tend to be older / less educated / non English speaking background

o   to obtain random sample – necessary to have some control over who completes questionnaire

-          survey method effects on questionnaire design

o   interviewer effect

o   opened questions

-          quality of answers

o   social desirability

-          implementing the survey

o   staff availability

o   speed of completion

o   cost

 

 

Multi Mode Methods of Administration

 

-          mode effects

-          mixed mode methods are more defensible if different methods used for different variables rather than different respondents

o   income data via postal questionnaire

o   attitudinal and behavioural data via phone survey

 

Maximizing Response rates in Personal interviews

 

-          call back

-          timing

-          advance notification

-          confident approach

-          don't look like a salesperson

-          dress in neat / neutral manner

-          explain purpose / confidentiality

-          written confirmation

-          identity card with photo

-          make voluntary nature of survey clear

-          busy, call back

-          more experienced interviewer to handle initial refusals

 

Ensuring Quality in Personal Interviews

 

-          training and supervision

-          techniques for personal interviewing

 

 

Smooth Implementation of Personal Interviews

 

 

 

Maximizing Response Rates in Postal Surveys

 

-          cover letter

-          envelope – don't look like bulk mail.

-          incentives

-          select main out date – eg avoid holidays

-          follow-ups

-          undelivered questionnaires

 

 

Smooth Implementation of Postal Questionnaires

 

Maximising Response rates in Phone Surveys

 

-          locating the respondent

-          gaining cooperation

 

 

Ensuring Quality in Phone Surveys

 

-          random digit dialing

-          issue of mobile phones

 

 

Smooth implementation of phone surveys

 

 

Maximising Response rates in Internet Surveys

 

 

 

Ensuring Quality in Internet Surveys

 

 

Smooth Implimenattion of Internet Surveys

 

 

Questionniare Administration Checklist

 

 

 

 

 

 

 

 

 

 

 

No comments: