170 likes | 270 Views
R. Murthy, MD, A. Shepard, MD, A. Swartz, BS, A. Woodward, MD, C. Reickert, MD, H.M. Horst, MD and I. Rubinfeld, MD, MBA Department of Surgery, Henry Ford Hospital, Detroit, MI Center for Health Systems Research, Henry Ford Health System.
E N D
R. Murthy, MD, A. Shepard, MD, A. Swartz, BS, A. Woodward, MD, C. Reickert, MD, H.M. Horst, MD and I. Rubinfeld, MD, MBA Department of Surgery, Henry Ford Hospital, Detroit, MI Center for Health Systems Research, Henry Ford Health System Effect of the New Standards for Case Logging on Resident Operative Volume: Doing Better Cases or Better Numbers?
Background • The operating room experience is arguably the most important aspect of surgery residency training (Patient Care). • Operative case volume is an important component of surgical training – the American Board of Surgery and ACGME minimum case requirement has increased from 500 to 750. • In 2009, the ACGME modified the designation of major (index) operative cases to include many new types including some previously considered “minor.”
Changes in Case Classification • Rationale not completely clear, but ostensibly to update what a surgical trainee’s operative experience should be in the ‘new era’ of surgical training. • Some changes make sense – e.g. roux-en-y gastric bypass, inguinal hernia repair, open and lap appendectomy. • Others do not – e.g. breast biopsy, toe amputation, I&D perirectal abscess. • Impact of these changes unknown.
ACGME Op Log System • Web-based case logging system introduced in 2002, uses CPT codes to categorize cases. • Mandated method to document operative experience • Limitations of Op Log data: • Dependent on self-reporting • Subjective / value judgments • Unclear number of re-codes • Not audited • Logging stopped at “perceived” threshold of “enough” • Does not reflect the “universe of case”
National Surgical Quality Improvement Project (NSQIP) • The Bad: • Not designed for resident education or to analyze an individual surgeon • Sampling methodology • No resident input. • No focus on education. • The Good: • Large national quality database. • Reliable, validated, audited. • Describes the universe of available cases rather than just those logged.
Study Purpose • To assess the potential effect of the recent changes in what constitutes a major (index) case on the educational value of the resident operative experience.
Methods • We analyzed all general and vascular surgery cases in the NSQIP (National Surgical Quality Improvement Project) database • NSQIP public use files (PUF) from 2005 to 2008 were reviewed. • Primary CPT case coding was mapped to the ACGME major (index) case category using both the old and new classification schemes. • We also ranked by volume, looked at the top 20 procedure codes and summarized those by category
Methods • Cases with and without resident coverage were analyzed. • Non-specialty data (e.g. Urology, Cardiac Surgery, Gynecology) were analyzed exclusively to avoid bias. • Categorical variables were analyzed with chi-square. • Data analysis was performed with SPSS software (SPSS Inc. Chicago, IL. Version 19).
Results • There was a progressive increase in hospitals enrolled in NSQIP from 2005 to 2008.
Top 20 Procedures Summarized by Category: New Major Cases, Not Previously Designated as Major
Category-based Discussion • Bariatric surgery and lap colectomy: • Likely previously counted as something else • Highly technical • Increasingly fellow (not resident) cases • Appendectomy, inguinal hernia repair, AK and BK amputations a reasonable call. • Breast biopsy and peri-rectal abscess: Are these really major cases?
Conclusions • Some cases newly classified as major are technically advanced procedures (e.g. roux-en-y gastric bypass). • Other cases newly classified as major, are clearly not (e.g. breast lesion excision). • There is potential for the major case category to be diluted by less demanding case types.
Implications for Surgical Training • Are we preserving case volumes at the expense of case quality and complexity? • Can we rely on the learners to maintain the data? • Is it enough of a perspective of the broader view of surgery? • Was this decision transparent and made with appropriate due diligence?