120 likes | 347 Views
Institute of Criminal Justice Justice Studies e -Marking Pilot Using GradeMark (a tool, within the Turn-it-in Suite) Semester 1 of 2010-11. Electronic Coursework Submission ✔. e -Marking ?. e -Feedback to Students ✔ & Student e -Feedback ✔. Further work….
E N D
Institute of Criminal JusticeJustice Studiese-Marking Pilot • Using GradeMark (a tool, within the Turn-it-in Suite) • Semester 1 of 2010-11 Electronic Coursework Submission ✔ e-Marking ? e-Feedback to Students✔&Studente-Feedback ✔ Further work… ICJS e-Marking Pilot Project • Project Team: Peter Allen-Worth, Jerry Collingwood, Martin Hampton,Gareth Hedges,Thomas Langston, Paul Norman,Francis Pakes, Vicky Purrington, Sandra Sparius, Alison Wakefield Dr Paul NormanFHSS Learning and Teaching Conference, 23 June 2011
ICJS Starting point Online coursework submission allows the possibility of the use of online marking Realising a range of potential advantages to students requires consideration of markers perspective. This small-scale pilot considered the technical set-up, experience of markers and the administration of marking, alongside a survey of student feedback on the experience
The Markers • Markers: ‘without obligation’ participation • Training event: video & hands-on workshop (1st & 2nd marking) • Feedback on QuickMark sets Handout on ‘how to’ • 25% trained - took-up first marking. All at desk-tops. New e-marker “…online marking about twice as time-consuming as paper based marking, because of the challenges of reading on screen and, in the case of second marking, the difficulties in flicking between scripts and [Question] papers when compared with the ability to lay things out on a table”. Experienced e-marker: around 50% longer(using voice recognition, feedback detailed) v. Time Savings: gaining and returning markingexperience of use of the tool
The Marked Work • 36 Distance Learners – 59 items of coursework • 58% Students 30-39 years old • 25% Students 40-49 years old • Feedback on Using the Tool (37% response rate):73% - found the submission system ‘easy’ or ‘very easy’ 35% - found retrieval ‘easy’ or ‘very easy’ • Feedback on e-Marked Work (37% response rate): 63% - found the e-marked work better than hard-copy. None felt it was worse. • Key positives: - ease of use - ability to see QuickMark comments in exact place - legibility of feedback, and comments on script - inserted links to ASK Helpsheets“very useful way to assist students with improving work”
Recommendations: GradeMark tool & Guidance to Students • Feedback to Turnitin2, to - develop the QuickMark comment sets, - enable auto-creation of Second Marker’s sample - enable auto-cap of late submissions (with full grade) • The University of Portsmouth should plan for the full integration of online marking system with the Student Records System, via roll-out of Moodle. • Develop Student Guidance to ensure maximum value to students reviewing online feedback on coursework (PDF copy + on-screen links to ASK Guides, etc.) • Log nature of any problems encountered by students submitting, retrieving or interpreting marked coursework
Recommendations: Staff Development / exploit tool features • ICJS staff should be made aware of the online marking opportunities via annual staff development sessions, drawing upon the developing experience of using GradeMark within Turnitin2, and including the OriginalityCheck, Feedback Rubrics and PeerReview tools. • ICJS staff should be encouraged and supported to experiment with a range of learning technologies in the context of online marking. These could include the use of wireless tablets, voice-activated software, and widescreen monitors.
Report, feedback and follow-up • See Report of the ICJS eMarking pilot at: http://www.port.ac.uk/staffessentials/departments/faculties/humanitiesandsocialsciences/learningandteaching/events/conference2011/abstracts2011/#d.en.134297 • If you would like to provide any comments and/or feedback on the ICJS eMarking Pilot, please send to paul.norman@port.ac.uk • If you are an ICJS member of academic staff and interested in exploring e-marking: contact Peter Allen-Worth or Tom Langston for information on the tool, forthcoming training events, and developments in your teaching area. • Further work (on rubrics) was undertaken in Semester 2 to campus-based students). Student feedback currently being gathered. ICJS will participate in the UoP Pilot 2011-12