1 / 25

Introduction to Questionnaire Design

Workshop objectives. By the end of this session you will be able to:Understand why questionnaires are used and when to use themUnderstand the process of constructing a questionnaireAcknowledge the key features of good question design. Questionnaire design in the context of the survey process. Re

shanna
Download Presentation

Introduction to Questionnaire Design

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


    1. Introduction to Questionnaire Design Dr Christine Thomas Dr Rachel Slater Doctoral training workshop – March 2011

    2. Workshop objectives By the end of this session you will be able to: Understand why questionnaires are used and when to use them Understand the process of constructing a questionnaire Acknowledge the key features of good question design

    3. Questionnaire design in the context of the survey process Research aim and research questions Identify the population and sample Decide how to collect replies Design your questionnaire Run a pilot survey Carry out main survey Analyse the data Report findings and dissemination

    5. Questionnaire design in the context of the survey process Research aim and research questions Identify the population and sample Decide how to collect replies Design your questionnaire Run a pilot survey Carry out main survey Analyse the data Write up findings and dissemination

    6. What is a questionnaire A research tool for data collection Usually a set of structured questions for which answers can be coded and analysed quantitatively Can also include open questions Can be self-administered or through interview On-line, postal, telephone, face-to-face Can also be used for qualitative analysis using semi-structured questions (face-to-face or by telephone)

    7. Why use a questionnaire? Strengths and limitations?

    8. Strengths Can target large number of people Reach respondents in widely dispersed locations Can be relatively low cost in time and money Relatively easy to get information from people quickly Standardised and structured questions Analysis can be straight-forward and responses pre-coded

    9. Strengths Can cover activities and behaviour, knowledge, attitudes, preferences Use to describe, compare or explain Effective for collecting quantitative data – information that can be counted or measured Low pressure for respondents Lack of interviewer bias (possibility of ‘ghost interviewer’ effect)

    10. Limitations Low response rate – bias, lack of confidence in results Unsuitable for some people e.g. poor literacy, visually impaired, young children, not online Question wording can have major effect on answers Misunderstandings cannot be corrected

    11. Limitations No opportunities to probe and develop answers No control over the context and order questions are answered No check on incomplete responses Seeks information only by asking, can we trust what people say? e.g. issues with over-reporting

    12. Maximising the response rate You are about to carry out a survey using a questionnaire, what will you do to maximise the response rate? In groups of 3 or 4, 5 minutes

    13. Techniques for maximising the response rate Good design Thoughtful layout, easy to follow, simple questions, appearance, length, degree of interest and importance, thank people for taking part Pre-notification Explanation of selection Sponsorship, e.g. letter of introduction / recommendation Cover letter

    14. Techniques for maximising the response rate Incentives Small future incentives, e.g. prize draw Understanding why their input is important Reminders Confidentiality Anonymity Pre-paid return envelopes

    15. Clear specification

    16. How not to get results ! Be aware of bias Yes Prime Minister clip http://www.youtube.com/watch?v=3gMcZic1d4U

    17. Political questionnaire exercise In groups of 3 or 4, spend 15 minutes What research question(s) do you think the questionnaire is trying to answer? What are you reactions to: The question wording and structure? The answer options? Which are open questions and which are closed questions? How could the questions be improved?

    18. Question wording – things to avoid Abbreviations Alternative meanings (tea, cool, dinner) Ambiguity and vague wording (fairly, generally, you – the respondent, household, family?) Doubled barrelled – ‘do you speak English or French?’ Double negatives Inappropriate categories

    19. Question wording – things to avoid Leading questions Memory issues Social desirability Question complexity

    20. Other things to think about Missing categories – include ‘other’, ‘don’t know’ and ‘not applicable’ Sensitive questions Question ordering Open or closed questions? Closed question – choice of alternative replies Open question – written text (or spoken answers)

    21. Open and closed questions (from Oppenheim, 1992)

    22. Your questionnaire Any questions about designing your questionnaire?

    23. Create a questionnaire Your mission is to find out something interesting about students doing PhDs Firstly decide what you want to find out – what is the research question? Design 2-3 questions for a questionnaire

    24. Readings Oppenheim, A.N. (1992) Questionnaire Design, Interviewing and Attitude Measurement. Pinter Publishers, London. Moser, C. and Kalton, G. (2001) Survey Methods in Social Investigation. Ashgate, Aldershot. Sapsford, R. (2001) Survey Research. Sage Publications. Foddy, W. (1994) Constructing Questions for Interviews and Questionnaires. Cambridge University Press, Cambridge. De Vaus, D.A. (1990) Surveys in Social Research. Allen and Unwin, London. Hoinville, G and Jowell, R. (1982) Survey Research Practice. Heinemann, London. Fink, A. (Ed.)(1995) The Survey Kit. Sage, London. Fowler, Floyd J. (2002) Survey Research Methods. Sage, London

    25. Other resources Doing Political Research DVD (OU) ESRC offer courses in questionnaire design (and statistical analysis) through CASS (Courses in Applied Social Surveys). See: http://www.esrcsocietytoday.ac.uk/ESRCInfoCentre/research/resources/CASS.aspx http://www.s3ri.soton.ac.uk/cass/programme.php The Open university’s OpenLearn survey research http://labspace.open.ac.uk/course/view.php?id=4197&topic=all AACS (OU) run SPSS training courses

More Related