1 / 21

Assessment, Validation and Moderation

Assessment, Validation and Moderation. Context. What’s happening in the VET sector How does this impact on you Defining the terms: Best Practice Validation Moderation What’s the difference?. Reflection. Last time you witnessed “best practice” Last time you were involved in validation

jena-wall
Download Presentation

Assessment, Validation and Moderation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Assessment, Validation and Moderation

  2. Context What’s happening in the VET sector How does this impact on you Defining the terms: Best Practice Validation Moderation What’s the difference?

  3. Reflection • Last time you witnessed “best practice” • Last time you were involved in validation • Last time you were involved in moderation • Roadblocks? • Organisation’s policies or processes • Where to find them • User friendly • Outcomes of current processes

  4. Current drivers Funding structures- accredited programs New AQTF 2010 NQC guidelines/VRQA Guidelines Shrinking workforce Compliance and complexity

  5. 10-point manifesto *500 Tips on Assessment: Brown, S., Race, P., Smith, B., 1996. • Assessment should be based on an understanding of how students learn. • Assessment should accommodate individual differences in students. • The purposes of assessment need to be clearly explained. • Assessment needs to be valid.

  6. Assessment instruments and processes need to be reliable and consistent. • All assessment forms should allow students to receive feedback on their learning and their performance. • Assessment should provide staff and students with opportunities to reflect on their practice and their learning. • Assessment should be an integral component of course design, and not something bolted on afterwards. • The amount of assessment should be appropriate. • Assessment criteria need to be understandable, explicit and public.

  7. Validation and Moderation Validation is the process for checking if something satisfies a certain criterion – did the assessment tool (all the tasks used to gather evidence) produce valid, reliable, sufficient, current and authentic evidence to enable reasonable judgements to be made? Moderation is the process for ensuring consistency and accuracy in making an assessment judgment – it is the process of bringing assessment judgements into alignment. Validation is quality review and Moderation in quality control.

  8. Validation and Moderation

  9. Validity Is the evidence relevant to the benchmark? Can you infer competence from the evidence? Is it consistent with the other evidence presented by the candidate? Are the 4 dimensions of competency met: task skills, task management skills, contingency management and work/environment skills

  10. Authenticity Can it be substantiated that the evidence is the candidate’s own work? (related to products and documents) Electronic evidence: is the source verifiable, has it been tampered with? Has the evidence been verified by a reliable third party, where relevant?

  11. Sufficiency Is the scope of the UoC addressed? the performance criteria evidence guide critical aspects of evidence competency over a period of time is demonstrated competency in different contexts is demonstrated

  12. Reliability Isassessment consistent? For example: Do all assessors use and know how to use the assessment tools? Is there a marked variation in the amount/quality of evidence collected? Do assessors consistently have a marked difference in the results? Are there processes in place to reduce inconsistency between assessor judgements?

  13. Fairness Is the information about assessment easily understood and accessed by all potential candidates? Do all candidates receive feedback about their assessments? Do assessors make assumptions about the candidates? Is the timing of the assessment appropriate? Do candidates get the support that they need? Are candidates over-assessed?

  14. Flexibility Are candidates’ needs identified before assessment? Are these needs taken into account when planning assessment? Can assessment tools, context and timing of assessment be adjusted to meet the needs of candidates?

  15. AQTF Validation part of continuous improvement - make sure RPL is included Range of strategies for validation-ensure you have a plan for validation Validation must be planned and improvements monitored and reviewed

  16. Audit issues Generic strategies for training and assessment Lack of industry consultation to inform strategies Poor assessment tools and processes-particularly unpacking units of competency Lack of effective validation of assessment Currency of staff competencies

  17. Lack of systematic processes, especially data collection and analysis Data on client services Evidence of meaningful improvements Partnership agreements: responsibilities, monitoring and review ‘torpid’ policies and procedures

  18. Validation and Moderation CI Process

More Related