1 / 46

Questionnaire Design

The Survey Process. Hypothesis and planned analysis dictate what to collect and howBalance content value to sample burden. Questionnaire Basics. Use when other data unavailable or inadequateDecide if using sample or cohortConsider best method of administrationNeed for qualitative and quantita

moeshe
Download Presentation

Questionnaire Design

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


    1. Questionnaire Design Diana M. Bensyl, PhD, MA EIS Field Assignments Branch, EFAB Supervisor

    2. The Survey Process Hypothesis and planned analysis dictate what to collect and how Balance content value to sample burden

    3. Questionnaire Basics Use when other data unavailable or inadequate Decide if using sample or cohort Consider best method of administration Need for qualitative and quantitative items Purpose will influence content Secondary analysis Medical recordsPurpose will influence content Secondary analysis Medical records

    4. Use of Findings Surveillance or descriptive epidemiology Outbreak investigation Evaluation or needs assessment Theory or hypothesis testing (exploratory)

    5. Structuring a Useful Survey Basic structure Data collection methods Developing survey items Standardization

    6. Survey Purpose Specific objectives Outline basic analyses (shell tables) Scope of information needed What do you know already? What else can guide you? Think these through before you write items Structure questions and responses so they are easily analyzeable. Draft an outline of the final report , detailing how to answer the fundamental data analysis concerns. This pinpoints exactly which pieces of information will be required and leads to the construction of a "data analysis plan"—which connects the data collection objectives to each of the specific questions and how they should be asked. Think these through before you write items Structure questions and responses so they are easily analyzeable. Draft an outline of the final report , detailing how to answer the fundamental data analysis concerns. This pinpoints exactly which pieces of information will be required and leads to the construction of a "data analysis plan"—which connects the data collection objectives to each of the specific questions and how they should be asked.

    7. Survey Opening ID self, organization Explain purpose Describe questions and how they’ll be asked Time estimate Permission to refuse Assurance of confidentiality HELLO, My name is Dr. Bensyl from CDC. We are gathering information about people’s experiences at Camp X. I would like to ask you some multiple choice questions about health and health practices. This should take about 15 minutes. You do not have to answer any question you do not want to, and you can end the interview at any time. Any information you give me will be confidential. HELLO, My name is Dr. Bensyl from CDC. We are gathering information about people’s experiences at Camp X. I would like to ask you some multiple choice questions about health and health practices. This should take about 15 minutes. You do not have to answer any question you do not want to, and you can end the interview at any time. Any information you give me will be confidential.

    8. Survey Body Begin with easy, non-intrusive questions Most important questions near beginning Sensitive questions near end During the past 30 days, have you had at least one drink of any alcoholic beverage such as beer, wine, a malt beverage or liquor? During the past 30 days, how many times have you driven when you’ve had too much to drink? During the past 30 days, have you had at least one drink of any alcoholic beverage such as beer, wine, a malt beverage or liquor? During the past 30 days, how many times have you driven when you’ve had too much to drink?

    9. Survey Closing Thank for participation Offer how and when results available That was my last question. Everyone’s answers will be combined to help us provide information about the health practices of people in this state. If you have any questions about the survey, please call (give appropriate state telephone number). Thank you very much for your time and cooperation. That was my last question. Everyone’s answers will be combined to help us provide information about the health practices of people in this state. If you have any questions about the survey, please call (give appropriate state telephone number). Thank you very much for your time and cooperation.

    10. Tips Be culturally sensitive Logical order with appropriate transitions Pre-coded responses facilitate data entry

    11. Structuring a Useful Survey Basic structure Data collection methods Developing survey items Standardization

    12. Questionnaire Method Considerations Cost Time Logistics Resources Question content Resources: how many questionnaires vs # of staffResources: how many questionnaires vs # of staff

    13. Method Effects on Data Collection Length of the questionnaire Complexity of the questionnaire Reading level of items Disclosure of sensitive information Data quality (e.g., completeness) Ease of data entry and analysis Once you’ve chosen a method, then you need to make sure that you work within the constraints of that method.Once you’ve chosen a method, then you need to make sure that you work within the constraints of that method.

    14. Types of Survey Data Collection Self-administered (written) Telephone Personal interview Internet

    15. Self-Administered Pros Less expensive Easy to administer Individual or group Mail Anonymous May aid disclosure of sensitive information

    16. Self-Administered Cons Must consider reading level & directions Need simple format (few or no skips) If anonymous, cannot address inconsistent or missing responses Variable response rates (depend on situation & setting)

    17. Telephone Interview Pros Can be automated Complex survey formats possible Minimize inconsistent/missing responses May aid disclosure of sensitive information CATI Com A computerized questionnaire is administered to respondents over the telephone. The interviewer sits in front of a computer screen Upon command, the computer dials the telephone number to be called. When contact is made, the interviewer reads the questions posed on the computer screen and records the respondent's answers directly into the computer. Interim and update reports can be compiled instantaneously, as the data are being collected. CATI software has built-in logic, which also enhances data accuracy. The program will personalize questions and control for logically incorrect answers, such as percentage answers that do not add up to 100 percent. The software has built-in branching logic, which will skip questions that are not applicable or will probe for more detail when warranted. puter-assisted telephone interviewingCATI Com A computerized questionnaire is administered to respondents over the telephone. The interviewer sits in front of a computer screen Upon command, the computer dials the telephone number to be called. When contact is made, the interviewer reads the questions posed on the computer screen and records the respondent's answers directly into the computer. Interim and update reports can be compiled instantaneously, as the data are being collected. CATI software has built-in logic, which also enhances data accuracy. The program will personalize questions and control for logically incorrect answers, such as percentage answers that do not add up to 100 percent. The software has built-in branching logic, which will skip questions that are not applicable or will probe for more detail when warranted. puter-assisted telephone interviewing

    18. Telephone Interview Cons Can be expensive Requires trained staff or special software Time consuming Surveys need to be brief Uncomfortable for many respondents Not everyone has a phone Many people monitor calls

    19. Personal Interview Pros Complex survey formats can be used Response rates generally high Interviewer presence is motivating Can be short or long Minimizes inconsistent or missing responses Easy to diagnose question content problems

    20. Personal Interview Cons Expensive Requires trained staff Complex logistics Time consuming Least anonymity Can inhibit disclosure of sensitive information

    21. Internet Survey Pros and Cons Pros Low cost Fast Eases data analysis Might be good for sensitive topics Cons Cannot control who responds Survey easily terminated

    22. Structuring a Useful Survey Basic structure Data collection methods Developing survey items Standardization

    23. Operationalization of Variables

More Related