Results of TSA 2005

1. Results of TSA 2005 A Report on the Basic Competencies of Students at the End of Key Stages 1 and 2 in Chinese, English and Mathematics

2. Background to the TSA • The 2000 report of the Education Commission sets out detailed proposals for two kinds of basic competency assessment: • Student Assessment • System Assessment (now renamed ‘Territory-wide System Assessment’ (TSA)) • HKEAA commissioned to develop and administer both projects for EMB

3. Purposes of the TSA • Provide the Government and schools with information on standards • Monitor the effectiveness of policies • School improvement

4. Scope of TSA • Chinese Language, English Language and Mathematics • P3 in 2004 • P3 and P6 in 2005 • P3, P6 and S3 in 2006

5. Administration of the Assessment • Written Assessments • 68,000 P3 students and 78,000 P6 students from some 700 schools • Conducted over 2 days in July • Students randomly assigned • Oral Assessment • 12 or 24 students randomly selected from each school • Conducted over two days in May • Two oral assessors

6. Changes in 2005 • All written papers centrally marked by an external panel of experienced teachers • One internal and one external assessors to assess oral language

7. Setting the Standards P3 standards • Set in 2004 using expert panels and international benchmarking P6 standards • Set using expert panels to fine tune standards established empirically with reference to P3 standards

8. Territory-wide P3 Results

9. Territory-wide P3 Results

10. Territory-wide P6 Results

11. P3 versus P6

12. Absenteeism Rate • A survey was conducted in August 2005 on absenteeism rates in primary schools by the HKEAA. • The figures showed that the average daily absenteeism rate in the month of June was 1.5% but that the average absenteeism rate on the two days was 1.8%. • A total of 58 schools were found to have absenteeism rates of 5% or more for P.3 written assessments, while 50 schools were found to have absenteeism rates of 5% or more for P.6 written assessments.

13. Absenteeism Rate • Based on a worst-case scenario in which all absences over 1.5% were of students who would have failed to achieve basic competency • The maximum distortion in the territory-wide estimates of the percent meeting the standard – around 0.3% for P.6 and around 0.6% for P.3.

14. Absenteeism Rate • Schools with absenteeism rates of 5% or more may not truly reflect the percentages had they been in full attendance. • Hence, these results are not recommended as the sole indicators for the development of learning and teaching programme.

15. Confidentiality • EMB and HKEAA will maintain confidentiality of individual schools’ results at all times. • School results are for school improvement purposes. • Schools will be able to access their own results electronically via the internet, using confidentiality protocols.

16. Territory-wide System Assessment 2005 Release of Results 8 December 2005

17. Results are released in the form of three reports: • School Report– Summary of school data with percentages of students achieving Basic Competency, and the average percentages for each of the subject papers. • Item Analysis Report (sorted by Sub-paper)– detailed analysis of school percentages for each of the items, following the question paper sequence. • Item Analysis Report (sorted by Basic Competency)– detailed analysis of school percentages for each of the items, in sequence of Basic Competencies. • Note: Reports excluding SEN to be released in mid-January TSA 2005 Results

18. Results are released on the TSA website through online access to “www.systemassessment.edu.hk”. Schools can download the reports from the TSA website from 12 December 2005 to 31 January 2006. TSA 2005 Results – New Initiative in 2005

19. Schools will receive a sealed envelope through registered mail with the new passwords to access the website and the reports. • Logon User Name • Logon Password • PDF Password for downloading reports TSA 2005 Results – Reports Security

20. The PDF password, additional password on file level, provides greater security for the files. Reminder to Schools – Please keep all the passwords in a safe and secure place.. TSA 2005 Results – Reports Security

21. TSA 2005 Results – Reports Download • Select ‘Login’

22. TSA 2005 Results – Reports Download • Input the Login Name and User Password

23. TSA 2005 Results – Reports Download Procedure • Select Download Assessment Reports

24. TSA 2005 Results – Reports Download Procedure • Select the Report to be downloaded

25. TSA 2005 Results – Reports Download Procedure • Read through the Protocol from EMB …

26. TSA 2005 Results – Reports Download Procedure • And then click the ‘I Accept’ before downloading the report

27. TSA 2005 Results – Reports Download Procedure • Then the system prompts for the file level password • Input the PDF Password and then click ‘OK’ • The report will then be displayed

28. Three ways for enquiries: • Schools not yet receiving a sealed envelope through registered mail on 13 December or later – call Administrative Team at 2325 0161. • Technical problems during download – Call our hotline at 2591 3099. • Questions on school data – Fill in the Recheck Request Form (on the website) and fax to 2591 0728. TSA 2005 Results – Enquiries

29. Details of the background to TSA, the development process, administration, marking and standards-setting • Extensive competency-by-competency analyses of student performance in each subject, with exemplars • Discussion of the way forward and proposed improvements for the future TSA 2005 Report

30. Thank You