1 / 43

c.spencer@ncl.ac.uk

E-Journals. c.spencer@ncl.ac.uk. Manchester 2006. Three main stages …. > Downloading the data > Analysis – trends, costs KPIs > Reporting – graphs, tables. Today …. Follow handout www.lib-stats.org.uk Workshop Guide (NO password this week) Download files (right click – save target as)

arich
Download Presentation

c.spencer@ncl.ac.uk

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. E-Journals c.spencer@ncl.ac.uk Manchester 2006

  2. Three main stages … > Downloading the data > Analysis – trends, costs KPIs > Reporting – graphs, tables

  3. Today … • Follow handout • www.lib-stats.org.uk • Workshop Guide (NO password this week) • Download files (right click – save target as) • Normally from web form: e.g. http://usagereports.elsevier.com/asp/main.aspx

  4. From web logs …

  5. To COUNTER …

  6. To Key Performance Indicators …

  7. To Usage Report …

  8. To Benchmarking …

  9. To committee report… … empirical evidence based on usage data suggests we should cancel our “Big Deal” subscription to Science Direct …!

  10. Check performance by Local Benchmarking

  11. Problems • Publishers (vendors), Gateways, Agents Aggregators and Hosts all potentially provide stats, but who counts what? Check COUNTER • At Ncl Users can download from any of these • Do we need to collect stats from all these sources and merge together? – Sometimes! • Merging script needed

  12. Multiple Stats - What to Count Users can download articles from any of these service providers…

  13. Merge stats from? …

  14. Problems • Agents’ subscribed lists may not match publishers’ lists! • Cf Swets and Blackwells – • Agents’ downloaded data in different format to publishers – merging script needed • Downloaded data may include third party subscriptions – error - need to filter

  15. Spurious data! NPG reports usage, but we didn’t subscribe ‘till 2005!

  16. Some data is in a different format

  17. Gathering the Data - Preparation • In 2003 JTR secured limited funding for one person to investigate the collection of usage data for Newcastle’s e-journals. Sadly there was little time for planning as pressure to provide evidence of value mounted. In an ideal world need to plan 3 months’ ahead – Project Manager and small team to assist in the process • I completely underestimated how long it would take just to get passwords sorted, let alone collect the data!

  18. Gathering the Data – Project Management • Overall Strategy - decision making - Ideally a team effort, where activities are broken down to match skills • Decide what to collect – COUNTER only for e-j,s, database, e-books, portal stats, Institutional Repository, Open Access • Whole process very time consuming and costly!

  19. Team Skills • Good training is the key – see UKSG • Clear communication essential • Good IT – spreadsheets/databases/web • Numerate – calculation of costs etc, Statistics knowledge useful • Able to convert stats into management reports

  20. Who does what? • Obtaining the data • Responsibility for the operational aspects; weekly/monthly or quarterly downloads • maintaining on-line passwords, liaise with others in library • dealing with queries – who will have access to the data? e.g. “Hi Cliff, Any chance of some usage stats on the three titles below before I have to sell my children into slavery to resubscribe this year?”

  21. Who does what • Organising the data • What format • Storage - Spreadsheet or Database - Backup • Housed with other types of library stats, e.g. Include subscription data, need to liaise with others • Output – Reports - Library Management System for analysis?

  22. Who does what • Analysis • By package, individual titles or subject • Key Performance Indicators • Report generation • Monthly/Quarterly/Yearly returns • Trend analysis

  23. Qualitative V Quantitative • Newcastle is a quantitative study of e-journal data i.e based on numbers. Lots of criticism for not having a parallel qualitative study which measures value through focus groups – i.e. words. Beware very time consuming to set up and process results.

  24. Downloading the data • Most COUNTER sites allow you to download through a web form. COUNTER does not set standards for the type of interface. Cf: Elsevier, Wiley, Swets etc • All require login and password. May have dozens of these, and they can change so need to manage this.

  25. Downloading the data • Reports are downloaded monthly and reported quarterly/yearly - e-mail alerts to those who want them • Separate folders for each “vendor” • Excel (.csv) used for initial download, and exported to any other platform – database driven web pages soon • Yearly summation – Jan-Dec – Reports • KPI,s populated from stats

  26. File types - .CSV most flexible As NCL moves to database rather than spreadsheet application – .XML is the way to go.

  27. What’s the most useful data? • Don’t know! This is a decision for each library, but our list of KPI,s may help • I believe our initiative to Benchmark across several libraries nationwide may be very beneficial in answering this question. See later • It may be that we need publishers to provide more data than we already have.

  28. Automated Data Collection • Downloading statistics manually from each individual vendor is time consuming and costly to administrate • Web services and data streaming (already common in on-line shopping) can help • All automated services will be expensive!

  29. SUSHI (Yummy!) • “The goal of the group is to devise a protocol/web service for the automated collection of COUNTER statistics from the publishers.  Initiate the calls to the publishers using a web service, to log in, to request the COUNTER report (JR1 for now), to retrieve the report (payload) and then load it into the local ERM system.” Ted Koppel Verde Product Manager

  30. Verde may use SUSHI

  31. And MPS offers… A single point of access for all your vendor usage statistics • Consolidation. View and analyze usage statistics across platforms in the consolidated journal and database report.Dashboard Analysis. Analyze usage statistics at a glance with the ScholarlyStats Dashboard Reports.Collection. Find all vendor usage data in one place with easy access to your raw vendor reports.Archive. Access historical usage statistics reports for year-on-year usage analysis.Administration. Assemble and administer all usage statistics vendor access details in one place.Access for your library staff. Provide you library staff with access to your usage statistics

  32. Dashboard Reports

  33. MPS Output

  34. In Future … • Web Services Technology will automate data collection - SUSHI • All stats through in-house portal • Local XML Database with all relevant data • National Database to compare usage

  35. Portals – logical place for stats collection?

  36. Results from SFX Portal How do these tally with stats from vendors?

  37. Swets V Kluwer Q. Why are there so many extra titles in the Kluwer list? Are these down to e+print titles, or are, some recent additions not acknowledged by Swets?

  38. More Problems! • Journals changing publisher – how to track? • Free e+print. Sometimes extra titles appear which are not listed in a package. Check to see if these are bundled (free) as part of a print sub. Two journals currently published by Blackwell Publishing and accessible through Blackwell Synergy are transferring to Nature Publishing Group from 2006 -- Kidney International and Journal of Investigative Dermatology

  39. Usage? • Usage data is derived from an a activity. A user “clicking” on an internet web link to download information constitutes a measurable and observable statistic. How many clicks in the last scenario, and how many activities? Luckily computers are good at record keeping! • Beware synonyms: for Click read download, abstract, page view, chapter, hits, searches,TOC, turnaway etc. • Need to be sure what we are counting – enter Project COUNTER – a standard to ensure that we are measuring the same kinds of data from each publisher. Without this standardisation our analysis would not be credible. Not all data however is COUNTER complaint – do we still count this?

  40. Online-Research • Consider for a moment how complicated collecting usage data is • I log onto my desktop, e-mail reveals a TOC about a new chemistry journal issue. This has a link to the publisher’s web site – abstract but no full text. I log into the library portal to check journal rights – full text but only via Open Access and not available for three months. I decide to get article from BL via e-ill, set up a transaction, downloaded to desktop in pdf format – no interactive chemical structure in pdf so go to on line Sci finder database to check. Disagree with paper’s conclusions so decide to e-mail author and check credentials on CAS database. Download full text of other papers I discover while browsing …

  41. From swets

  42. Save as .xls

More Related