1 / 22

Effect on Faculty Ratings of Paper Based versus Web Based Student Course Assessments

Effect on Faculty Ratings of Paper Based versus Web Based Student Course Assessments. Dr. Juliana Lancaster Director of Institutional Effectiveness Dr. Michael Furick Assistant Professor of Business. Introducing GGC. The 35 th member of the University System of Georgia

molimo
Download Presentation

Effect on Faculty Ratings of Paper Based versus Web Based Student Course Assessments

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Effect on Faculty Ratings of Paper Based versus Web Based Student Course Assessments Dr. Juliana Lancaster Director of Institutional Effectiveness Dr. Michael Furick Assistant Professor of Business

  2. Introducing GGC • The 35th member of the University System of Georgia • Opened its doors to an inaugural junior class of 120 students in fall 2006 • The first freshmen class of 337 was admitted fall 2007 with total enrollment of 787. • First graduation was held on June 28, 2008 • Enrollment has grown to over 3000 students • Accredited by SACS in June 2009

  3. Introducing GGC • GGC’s mission supports access to baccalaureate degrees that meet the economic development needs of the growing and diverse population of the northeast Atlanta metropolitan region. • GGC offers majors in: Biology Education Mathematics Exercise Science English History Information Technology Political Science Psychology Business Administration Criminal Justice/Criminology

  4. Importance of Student Course Evaluations • Formative Assessment: Used by faculty to improve and shape the quality of our own teaching • Summative Assessment: Used to determine overall performance, may be used in personnel decisions • Programmatic Assessment: Used to evaluate the role of a course within a degree program

  5. Summarize Lit Review (2 slides)

  6. General Interest Questions • Do you do paper or web? • Who gets to see results? • Who should see results?

  7. Paper vs Web Systems

  8. Is Web really better…..or worse? • Will most students actually do a web based evaluation? • Will the students who do a web based evaluation be different from the overall student population? • Will the evaluation ratings be affected by changes in which students complete evaluations?

  9. Shifting Delivery at GGC Semester Modality Distribution of Form/ Access Information Fall 2007 PaperIn-class Spring 2008 On-line Passwords distributed by faculty in class Summer 2008- On-line Passwords distributed by Summer 2009 system to student email Fall 2009 On-line Active links to course surveys in student portal

  10. Study Design • Compared Fall 2007 (paper), Spring 2009 (web with email delivery) and Fall 2009 (web with portal delivery) • Sampled all evaluations of faculty who have been at GGC continuously since Fall 2007 (N=78) • Used only items that have remained (near) constant on evaluation instrument (N=11)

  11. Slide or two with distributions

  12. Questions • Did overall response rates change? • Did profile of respondents change? • Did ratings change in a consistent way?

  13. Clicker responses to three questions

  14. Did overall response rates change? • Response rates for web based semesters are lower than for paper based semester.

  15. Did profile of respondents change?Expected Grade by Semester

  16. Did profile of respondents change? • Looked at expected grade as reported by respondent. • Overall pattern is highly similar, suggesting web did not attract more unhappy students.

  17. Did ratings change in a consistent way?

  18. Did ratings change in a consistent way? • Overall, ratings have shown a steady upward trend for this set of faculty. • For 10 of 11 items analyzed, Fall 09 mean ratings were significantly higher than Fall 07 ratings. • For one item, ratings dropped for the Spring 09 term but rose again in Fall 09

  19. General Conclusions • Shifting from paper to online evaluations does cause a reduction in response rates • The reduction is spread across expected grades and across the spectrum of ratings • Overall, our mean evaluations have risen over time. • Next step: Replicate study with some paper and some online surveys in Spring 2011

More Related