1 / 90

Presented by Mark R. Winkelman, Owner Winkelman Consulting October 18, 2012

Annual Fall Conference North Dakota Council of Educational Leaders “Understanding & Using the Youth Risk Behavior Survey (YRBS)”. Presented by Mark R. Winkelman, Owner Winkelman Consulting October 18, 2012. Presentation Topics. What is the YRBS? How is the YRBS administered?

muncel
Download Presentation

Presented by Mark R. Winkelman, Owner Winkelman Consulting October 18, 2012

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Annual Fall ConferenceNorth Dakota Council of Educational Leaders“Understanding & Using the Youth Risk Behavior Survey (YRBS)” Presented by Mark R. Winkelman, Owner Winkelman Consulting October 18, 2012

  2. Presentation Topics • What is the YRBS? • How is the YRBS administered? • General overview of YRBS results and their use • Closing/Questions & Answers

  3. What is the YRBS?

  4. What is the YRBS? • An assessment of major youth health/risk factors, including intentional and unintentional injuries, tobacco use, alcohol and other drug use, sexual behaviors, dietary behaviors, and physical activity • Developed and tested by the Centers for Disease Control and Prevention (CDC)

  5. What is the YRBS? • A proven process that utilizes a strict protocol that assures the most reliable, accurate data possible • A coordinated effort by the Department of Public Instruction (DPI), the Department of Health (DoH), and many other stakeholders

  6. What is the YRBS? • Conducted during the spring of odd numbered years (2001, 2003, 2005, 2007, 2009, 2011, 2013, etc.) • Mark your calendars, because the next YRBS will be administered soon (Jan.-Apr. 2013) • A survey of both high school (grades 9-12) and middle school (grades 7-8) students • A separate, age-appropriate survey is used for each group of students

  7. What is the YRBS? • A much more comprehensive process in North Dakota • A dual YRBS sample with both “selected” and “voluntary” samples for both high school and middle school students (more details to come!)

  8. What is the YRBS? • A wealthy of information that benefits numerous state, regional, local organizations, school districts, and individual school buildings • Planning & program development • Grants & funding • Most participating school buildings receive a copy of their results at no cost to their school(more details on the next page)

  9. What is the YRBS? • Highly confidential • Student participation is anonymous • Individual school/district data is not shared (including with DPI & DoH) unless (1) the school or district shares the data themselves or (2) gives written permission for it to be shared • Has analysis guidelines that prevent administrators and/or principals from figuring out an individual student’s answers. • School buildings with fewer than 25 completed surveys do not get any individual school results • The results for an individual question are not included in individual school results if the behavior is reported by fewer than 6 students

  10. How is the YRBS administered?

  11. How is the YRBS administered? • Questionnaire development • For both the high school (NDH) and middle school (NDM) surveys: • CDC provides lists of tested “core” and “optional” questions that can be used on each • A maximum number of questions allowed on the NDH (99) and NDM (50-60) is set • ND stakeholders review the questions to reach consensus as to the CDC questions and/or “state added” questions that will actually appear on each questionnaire

  12. How is the YRBS administered? • Establish Sampling Frame • Using the 2011 YRBS as an example, in November 2010, DPI generated final 2010-2011 school year enrollment numbers for all ND school buildings (grades K-12) • Lists of eligible NDH & NDM school buildings were created

  13. How is the YRBS administered? • Establish Sampling Frame(continued) • First, ineligible school buildings were removed from the lists of “eligible” school buildings for selected samples • Non-public/religious schools (i.e. St. Mary’s) • Special needs schools (i.e. Anne Carlsen or district special education units) • Technical schools (i.e. James Valley Area Career & Technical Center) • State institutions (i.e. ND Center for Distance Education)

  14. How is the YRBS administered? • Establish Sampling Frame(continued) • Second, a list of “eligible” school buildings was developed for each of the four samples: • NDH “selected” YRBS sample: Public & BIA school buildings with 25+ high school students (gr. 9-12) • NDH “voluntary” YRBS sample: Public, BIA & non-public or religious school buildings with 25+ high school students (gr. 9-12) • NDM “selected” YRBS sample: Public & BIA school buildings with 10+ middle school students (gr. 7-8) • NDM “voluntary” YRBS sample: Public, BIA & non-public or religious school buildings with 25+ middle school students (gr. 7-8)

  15. How is the YRBS administered? • Establish Sampling Frame(continued) • Definition: “Selected” samples… • Include only the “selected” school buildings/classes required for the statewide YRBS sample to be analyzed by CDC • Provide weighted results that are representative of all public/BIA school students in the state • 2011 “Selected” NDH: 1,911 YRBS surveys • 2011 “Selected” NDM: 2,141 YRBS surveys

  16. How is the YRBS administered? • Establish Sampling Frame(continued) • Definition: “Voluntary” samples… • Include both (1) additional classes from “selected” school buildings that request a larger sample and (2) school buildings not chosen for the “selected” sample that still want to participate in the YRBS • Provide results that are neither weighted nor representative of all students in the state • 2011 “Voluntary” NDH: additional 8,425 YRBS surveys (10,336 total from 113 high school buildings) • 2011 “Voluntary” NDM: additional 5,289 YRBS surveys (7,430 total from 106 middle school buildings)

  17. How is the YRBS administered? • Establish Sampling Frame(continued) • Third, the lists of “eligible” school buildings for the “selected” NDH & NDM samples were sent to Westat • The lower the anticipated “school participation rate”, the larger the number of school buildings in the “selected” sample • In ND, we assume a worst case scenario of a 71% “school participation rate” even though we typically achieved higher school participation rates (NDH & NDM both 96% in 2011)

  18. How is the YRBS administered? • Establish Sampling Frame(continued) • The more students a school building has… • The higher the probability that the school will be selected for participation in the “selected” YRBS • Therefore, the larger school buildings in ND will always be chosen for participation in the “selected” YRBS • The more “classes” that will be selected for participation in the “selected” YRBS

  19. How is the YRBS administered? • Establish Sampling Frame(continued) • Examples of classes to be possibly selected from a… • “Large” school (1,487 students): • YRBS: 8,19,31,42,54,65,76,88,99,111,122,133 • “Medium” school (87 students): • YRBS: 1,5,9 • “Small” school (10-25 students): • YRBS: 2,4

  20. How is the YRBS administered? • Participation & Eligibility • Participation in the YRBS is voluntary. However, a high response rate from “selected” schools is required for the State to receive weighted CDC data. • Which school buildings are eligible? • NDH “Selected and/or Voluntary” (25+ students) • NDM “Selected and/or Voluntary” (25+ students), but NDM “Selected only” (10-24 students)

  21. How is the YRBS administered? • Gaining participation • Each school building receives an information/participation packet based on the survey(s) for which they are “eligible” • NDH “Selected and Voluntary” or NDH “Voluntary only” (25+ students) • NDM “Selected only” (10-24 students) • NDM “Selected and Voluntary” or NDM “Voluntary only” (25+ students)

  22. How is the YRBS administered? • Gaining participation(continued) • “Selected” school buildings have options to… • Complete only the minimum sample • The classes chosen for the “selected” sample • Complete a statistically significant sample • The classes chosen for the “selected” sample plus the number of additional “voluntary” classes needed to achieve a sample with roughly a ±5.0% maximum margin of error • Refuse to participate • But, we work very hard to persuade all “selected” school buildings to participate

  23. How is the YRBS administered? • Gaining participation(continued) • “Voluntary” school buildings have options to… • Complete a statistically significant sample • The number of “voluntary” classes needed to achieve a sample with roughly a ±5.0% maximum margin of error • Refuse to participate • Tobacco prevention coordinators, district health units, education cooperatives, university researchers, etc. may also persuade “voluntary” schools in their region/program to participate

  24. How is the YRBS administered? • Gaining participation(continued) • Any school that chooses to participate… • Provides the contact information for their YRBS “School Survey Administrator” • The person who will responsible for distributing surveys to the classes participating in the YRBS • Separate lists of all NDH and/or NDM classes • For a time when the most students are in the building or class (2nd period, homeroom, required courses, etc.) without duplication • Teacher name, class name, predominant grade, ability to complete without assistance, and number of students for each class

  25. How is the YRBS administered? • Selecting the samples • Classes are sorted by grade • The classes are then numbered (1, 2, 3, etc.) • To choose “selected” classes using the earlier “Medium” school example (87 students; YRBS classes: 1,5,9) • If they have 5 classes, the 1st & 5th class on the list would complete the “selected” YRBS • If they have 9+ classes, the 1st, 5th & 9th class on the list would complete the “selected” YRBS

  26. How is the YRBS administered? • Selecting the samples (continued) • To choose “voluntary” classes for a “selected” school using the earlier example with five classes (YRBS classes: 1,5,9)… • The 2nd, 3rd & 4th class would complete the “voluntary” YRBS – all classes not already completing a “selected” YRBS • To choose “voluntary” classes for a “voluntary only” school… • A random number generator would be used to select classes until the desired sample size is achieved

  27. How is the YRBS administered? • Distributing surveys • For each “selected” and “voluntary” class chosen, the appropriate materials are provided… • “Selected” YRBS (for number of students + 2) • Instructions for the survey administrator/teacher, YRBS questionnaires, unique color scanner answer sheets & privacy envelopes • “Voluntary” YRBS (for number of students + 2) • Instructions for the survey administrator/teacher, YRBS questionnaires, unique color scanner answer sheets & privacy envelopes

  28. How is the YRBS administered? • Distributing surveys (continued) • All class packets are labeled, placed in a box, additional survey administrator instructions and a class list (with classes participating in each survey identified) are placed in the box, and the box is mailed to the school

  29. How is the YRBS administered? • Completing surveys • The school survey administrator distributes the class packets to the appropriate teachers or administers the surveys personally to each class • Instructions are read to students • Survey materials are distributed to each student • Students read the survey instructions, complete their survey, place all materials in the privacy envelope, seal the envelope and return it to the survey administrator or teacher

  30. How is the YRBS administered? • Completing surveys(continued) • The teacher/survey administrator places the following materials in the class envelope, seals it, and returns it to the school survey administrator • A completed class sampling information form (total students in the class and the number absent the day of the test) for calculating student participation rate • All privacy envelopes (containing completed surveys and materials) • All unused survey materials

  31. How is the YRBS administered? • Collecting the surveys • The school survey administrator boxes and mails back all completed materials • Winkelman Consulting… • Records all school buildings that returned boxes • Records all class envelopes returned • Confirms class materials were completed • Reviews/cleans all scanner answer sheets (erased answers, stray marks, etc.) • Follows-up with school buildings that have not returned/completed all needed materials • Completes school/class sampling information for CDC/Westat documentation

  32. How is the YRBS administered? • Analyzing the data • A minimum overall response rate of 60% is required to obtain weighted CDC data • 2011 NDH YRBS • School Participation Rate: 96% (68 of 71) • Student Participation Rate: 88% (1,920 of 2,173) • Overall Participation Rate: 84% (96% * 88%) • 2011 NDM YRBS • School Participation Rate: 96% (72 of 75) • Student Participation Rate: 90% (2,144 of 2,368) • Overall Participation Rate: 87% (96% * 90%)

  33. How is the YRBS administered? • Analyzing the data(continued) • CDC/Westat (“selected” data) and Winkelman Consulting (“voluntary” data)… • Scan the answer sheets • Clean and edit the data • Out of range • Repeating responses • Inconsistent responses • Excessive missing data

  34. How is the YRBS administered? • Analyzing the data(continued) • Code the Q data into QN data. • CDC NDHq9. How often do you wear a seat belt when riding in a car driven by someone else? • Never, Rarely, Sometimes, Most of the time, or Always • CDC NDHqn9. Percentage of students who never or rarely wore a seat belt when riding in a car driven by someone else. • Yes or No

  35. How is the YRBS administered? • Analyzing the data(continued) • Run tables by demographic factors (grade, gender, race, etc.) • Winkelman Consulting also… • Merges selected and voluntary data • Generates a statewide report that includes: • CDC weighted statewide QN results • Winkelman Consulting non-weighted regional (by Human Service Regions) QN results • Winkelman Consulting non-weighted urban-rural QN results • Urban: towns with 1,000+ student in K-12 • Rural: towns with < 1,000 student in K-12

  36. How is the YRBS administered? • Analyzing the data(continued) • Generates individual school buildingreports that include: • All data included in the statewide report plus the school buildings results (see the “Sample High School 2011 ND YRBS Report” handout). Again… • School buildings with fewer than 25 completed surveys do not get any individual school results • School buildings with at least 25 completed surveys do not get results for individual questions for which behaviors were reported by fewer than 6 students, but will receive results for behaviors reported by 6 or more students

  37. How is the YRBS administered? • Analyzing the data(continued) • Limitations: CDC weighted statewide data • The statewide data is collected by randomly selecting school buildings, as well as classes within each building. Given that these school buildings/classes were selected at random and a high participation rate was achieved, the CDC was able to generate weighted data that is highly representative of all students (in the grades surveyed) from eligible school buildings in the state of North Dakota. • Therefore, the statewide results do not have any limitations and can be used to (1) project the results to all school students in these grades and (2) compare changes in results from one survey year to another.

  38. How is the YRBS administered? • Analyzing the data(continued) • Limitations: Winkelman Consulting non-weighted regional & urban/rural data • As was noted earlier, the vast majority of the data used for the regional and urban/rural results was not collected from randomly selected school buildings and/or classes. Given that most of these school buildings/classes “volunteered” to participate and were not selected at random, even though a high participation rate was achieved, Winkelman Consulting is not able to generate weighted data that is representative of all students (in the grades surveyed) from eligible school buildings in either the state or an individual region or segment.

  39. How is the YRBS administered? • Analyzing the data(continued) • Limitations: Winkelman Consulting non-weighted regional & urban/rural data • Because of this, the regional and urban/rural data cannot be used to (1) project the results to all public students (in the grades surveyed) in a region or segment or (2) compare changes in results for a region or segment from one survey year to another. Also, noticeable differences may be seen between the results for a region/segment and the statewide data simply because the students from schoolbuildings/classes that completed "voluntary" YRBS surveys are more (or less) likely to have a certain behavior than the "average" student represented by the random, weighted, representative statewide data.

  40. How is the YRBS administered? • Analyzing the data(continued) • Limitations: Winkelman Consulting non-weighted individual school building data • Like statewide YRBS or any other sample, the results are accurate to within the stated margin of error • See the margin or error chart near the bottom of p. 4 of the “Sample High School 2011 ND YRBS Report” handout • Like any sample, the results may need to be weighted if the grade/gender distribution of the sample is not representative of the actual student grade/gender distribution • See the grade/gender chart near the top of p. 4 of the “Sample High School 2011 ND YRBS Report” handout

  41. How is the YRBS administered? • Analyzing the data(continued) • Limitations: Winkelman Consulting non-weighted individual school building data • So, as long as your results have (1) a reasonable margin of error and (2) a grade/gender distribution that is representative your student, your individual school/district results do not have any limitations and can be used to (1) project the results to all school students in these grades and (2) compare changes in results from one survey year to another.

  42. General overview of YRBS results and their use

  43. Overview: YRBS results & use • For your planning… • What risk behaviors are higher with your students? • How do your students compare to others in ND, in your region, schools of “similar” size, and/or the U.S.? • What are the trends for your students? • How do trends for your students compare to others in ND? • In which segments is the behavior higher/lower for your students? • Grade, Gender, etc.

  44. Overview: YRBS results & use • Your students’ behaviors • Participating school data is available for 2001-2011 if the school building had 25+ completed surveys • If you are not able to find past reports for your school, feel free to contact me • As can be seen in the “Sample High School 2011 ND YRBS Report” handout…

  45. Overview: YRBS results & use • “Sample” high injury behaviors • 26.3% rode one or more times during the past 30 days in a car or other vehicle driven by someone who had been drinking alcohol • 53.8% texted or e-mailed while driving a car or other vehicle on one or more of the past 30 days • 63.5% talked on a cell phone while driving a car or other vehicle on one or more of the past 30 days

  46. Overview: YRBS results & use • “Sample” high violence behaviors • 23.4% had been bullied on school property during the past 12 months • “Sample” high tobacco behaviors • 31.4% ever tried cigarette smoking, even one or two puffs

  47. Overview: YRBS results & use • “Sample” high alcohol behaviors • 68.3% had at least one drink of alcohol on one or more days during their life • 31.3% had at least one drink of alcohol on one or more of the past 30 days • 28.1% had five or more drinks of alcohol in a row, that is, within a couple of hours, on one or more of the past 30 days

  48. Overview: YRBS results & use • “Sample” high drug behaviors • 20.1% were offered, sold, or given an illegal drug by someone on school property during the past 12 months • “Sample” high sexual behaviors • 22.5% ever had sexual intercourse • 31.3% have ever given or received oral sex

  49. Overview: YRBS results & use • “Sample” high physical activity behaviors • 27.8% watched three or more hours per day of TV on an average school day • 52.5% were physically active for a total of at least 60 minutes per day on five or more of the past seven days • 62.3% exercised or participated in physical activity for at least 20 minutes that made them sweat and breathe hard

  50. Overview: YRBS results & use • Some Positive NDH Trends • Injury & Violence • Percentage of students who rode one or more times during the past 30 days in a car or other vehicle driven by someone who had been drinking alcohol (43.5% in 2001 to 25.1% in 2011) • Percentage of students who drove a car or other vehicle one or more times during the past 30 days when they had been drinking alcohol (26.8% in 2001 to 11.7% in 2011)

More Related