210 likes | 353 Views
The PBRF and bibliometric measures. Introduction. Use of bibliometrics by the Ministry of Education Part 1 – presentation of latest bibliometric results Part 2 – what if bibliometrics was used to allocate PBRF funding? – a case study. Bibliometrics. Thomson Reuters bibliometrics dataset
E N D
Introduction • Use of bibliometrics by the Ministry of Education • Part 1 – presentation of latest bibliometric results • Part 2 – what if bibliometrics was used to allocate PBRF funding? – a case study
Bibliometrics • Thomson Reuters bibliometrics dataset • Reasonably stable • Long time series • External to the PBRF system – can triangulate and calibrate • International benchmarking • Limitations of bibliometrics • Useful monitoring tool • But don’t see bibliometrics as a way of dispensing research funding at this time
Bibliometrics measures – NZ universities • Share of world publications • Share of world citations • Relative impact: (citations per paperNZ universities) (citations per paperworld)
Share of world publications and citations Source: Thomson Reuters
Relative impact – NZ vs Australia Source: Thomson Reuters
Relative impact – by panel Source: Thomson Reuters
Relative impact – by panel Source: Thomson Reuters
Relative impact – by panel Source: Thomson Reuters
Relative impact – by panel Source: Thomson Reuters
Relative impact – by panel Source: Thomson Reuters
NZ vs Australian universities 2003-2007 Source: Thomson Reuters
What if citations were used to allocate PBRF funding? • Case study – Earth Science • Method • Compare funding allocated to each university in 2007 via the PBRF quality evaluation with what would have been allocated if based on citations
Funding via relative impact in 2007 • Relative impact in five year overlapping time periods • Use three year weighted average • 1999-2003 (15%) • 2000-2004 (35%) • 2001-2005 (50%) • Then adjust by PBRF FTE
Relative impact Source: Thomson Reuters
Issues • Capturing all indexed research vs 4 nominated research outputs • Size of NZ subject areas
Ministry of Education monitoring • Ministry of Education reports assessing research performance can be found at the Education Counts website: www.educationcounts.govt.nz