Training of Trainers

1. Training of Trainers Evaluation of Training By Senior Sort Term International Expert: Kyriakos DIMITRIOU Place: UCCI Tashkent Training Centre Ташкент - July 9, 2014

2. Evaluation Generally speaking, evaluation is used to determine the degree to which program objectives are met through the procedures used. If we want to define “evaluation in training” as a term, we could say that is a systematic procedure to give a “value” qualitative and quantitative in a training session, using concrete criteria and methodology.

3. The procedure

4. Evaluation; “What” • Curriculum (content) • Way of delivery (methods, techniques) • Training facilitation • Duration • Material • Usefulness • Impact • Trainer • Learners (self-evaluation) • External factors (facilities etc) • General satisfaction

5. Evaluation; “When” When the evaluation is taking place? The answer in this question is: During all phases of the training program • Before (ex ante) • During (on going) or interim (in the middle) • After (ex post)

6. Ex ante Ex-ante evaluation enables analysis of the anticipated impacts of the planned programme. It’s a quite demanding process in comparison with on going and ex post evaluation. • Structure of the activity • Sequence of priorities • Internal coherence and • External coherence

7. Ex-ante assesses Ex-ante evaluation assesses whether the objectives are clear, coherent and adjusted to the situation, helps the realistic numeric quantification of these and defines indicators enabling the monitoring of implementation, as well as reporting on results achieved. Indicators relate to financial resources, physical attributes, results and impact.

8. On going / Ex post evaluation a) determine what the participants have learned b) give the learners time to reflect on their learning c) gather useful feedback in an organized manner, to help with future training planning d) ensure learners’ follow-up (their training with relevant actions to apply, improve, develop and reinforce learning attained).

9. Evaluation; “By whom” Who is responsible to evaluate? Everyone has the right to evaluate any actor (participant). Usually: Learners Trainer and External evaluator (usually on behalf of beneficiaries, stakeholders) INTERNAL

10. Evaluation; “How” Quite a lot of ways is the answer and by various means (techniques): • Each “actor” evaluates others • Self evaluation Means: • Questionnaires • Interviews (personal, group) • Round tables, focus groups etc

11. Bloom's Taxonomy in evaluation • Benjamin S Bloom (1913-99) -USA Taxonomy means “a set of classification principles”, or “a structure”. Bloom's Taxonomy model is in three parts, or “overlapping domains”. Bloom used rather academic language, but the meanings are simple to understand: • Cognitive domain (intellectual capability, ie., knowledge, or“think”) • Affective domain (feelings, emotions and behavior, ie., attitude, or “feel”) • Psychomotor domain (manual and physical skills, ie., skills, or “do”)

12. Simplification /1 Cognitive (knowledge) • Recall data • Understand • Apply (use) • Analyse (structure/elements) • Synthesize (create/build) • Evaluate (assess, judge in relational terms)

13. Simplification /2 Affective (attitude) • Receive (awareness) • Respond (react) • Value (understand and act) • Organise personal value system • Internalize value system (adopt behavior)

14. Simplification /3 Psychomotor (skills) • Imitation (copy) • Manipulation (follow instructions) • Develop Precision • Articulation (combine, integrate related skills) • Naturalization (automate, become expert)

15. Evaluating Training Programs: Kirkpatrick's 4 Levels The most widely used and popular model for the evaluation of training programs is known as "The Four Levels of Learning Evaluation" The model was created by Donald L. Kirkpatrick in a series of articles that appeared in the US Training and Development Journal. Kirkpatrick redefined the evaluation model with his 1998 book "Evaluating Training Programs: The Four Levels."

16. Level 1: Reaction • Level 1: Reaction Kirkpatrick refers to Level one as a measure of customer (learner) satisfaction. Most of the forms that people fill out at the end of a training or a similar (coaching, mentoring) activity are instruments for measuring Level 1.

17. Level 2: Learning Kirkpatrick defines learning as the extent to which participants change attitudes, increase knowledge, and/or increase skill as a result of attending a program. Level 3: Behaviour Level three can be defined as the extent to which a change in behaviour has occurred because someone attended a training program

18. Level 4: Results This involves measuring the final results that occurred because a person attended a training session. This can include increased production, improved work quality, reduced turnover, etc. Level four can be difficult because you must determine what final results occurred because of attendance and participation in a training program

19. Evaluation has a meaning when • Is a procedure to collect valid, reliable and useful information and data • Extend in explaining of the results • Is combined with feedback • Is not only quantitative • Its results are used by appropriate persons in terms of improvement