Abstract: Background: Routine preoperative screening tests before low-risk surgery cannot be justified if the risks to patients are not outweighed by benefits. Several studies and professional guidelines suggest avoiding screening tests prior to minor operations. We aimed to assess the prevalence and patient characteristics associated with low-value preoperative tests (LVTs) prior to carpal tunnel release (CTR) at an academic medical center. Methods: From electronic medical records, we identified patients aged ≥18 who underwent CTR from 2015 to 2017. We determined the occurrence of 9 common LVTs, such as complete blood count (CBC), basic metabolic profile (BMP), and electrocardiogram (ECG), in the 30 days prior to CTR. Multivariable logistic and Poisson regression were used to identify factors associated with receiving any LVT and the number of LVTs, respectively. Results: Among 572 patients, 248 (43.4%) had at least 1 LVT. The most common tests were ECG (31.3% of CTRs), CBC (27.3% of CTRs), and BMP (23.6% of CTRs). Patient factors associated with higher odds of receiving LVT included older age, higher Elixhauser comorbidity score, and general or regional anesthesia (vs monitored anesthesia care). Conclusions: Low-value preoperative tests were frequently received by patients undergoing CTR and were associated with anesthesia type, age, and number of comorbidities. Although our study focused on CTR, these results likely have implications for other commonly performed low-risk procedures. These findings can help guide efforts to improve the quality and value of surgery for carpal tunnel syndrome and facilitate the development of strategies to reduce LVT, such as audit feedback and provider education.

Abstract: The American Academy of Orthopaedic Surgeons and American Society for Surgery of the Hand recently proposed three quality measures for carpal tunnel syndrome (CTS): Measure 1 - Discouraging routine use of Magnetic resonance imaging (MRI) for diagnosis of CTS; Measure 2 - Discouraging the use of adjunctive surgical procedures during carpal tunnel release (CTR); and Measure 3 - Discouraging the routine use of occupational and/or physical therapy after CTR. The goal of this study were to 1) Assess the feasibility of using the specifications to calculate the measures in real-world healthcare data and identify aspects of the specifications that might be clarified or improved; 2) Determine if the measures identify important variation in treatment quality that justifies expending resources for their further development and implementation; 3) Assess the facility- and surgeon-level reliability of measures. Methods The measures were calculated using national data from the Veterans Health Administration (VA) Corporate Data Warehouse for three fiscal years (FY; 2016–18). Facility- and surgeon-level performance and reliability were examined. To expand the testing context, the measures were also tested using data from an academic medical center. Results The denominator of Measure 1 was 132,049 VA patients newly diagnosed with CTS. The denominators of Measures 2 and 3 were 20,813 CTRs received by VA patients. The median facility-level performances on the three measures were 96.5, 100, and 94.7%, respectively. Of 130 VA facilities, none had 〈  90% performance on Measure 1. Among 111 facilities that performed CTRs, only 1 facility had 〈  90% performance on Measure 2. In contrast, 21 facilities (18.9%) and 333 surgeons (17.8%) had lower than 90% performance on Measure 3 (Median facility- and surgeon-level reliability for Measure 3 were very high (0.95 and 0.96 respectively). Conclusions Measure 3 displayed adequate facility- and surgeon-level variability and reliability to justify its use for quality monitoring and improvement purposes. Measures 1 and 2 lacked quality gaps, suggesting they should not be implemented in VA and need to be tested in other healthcare settings. Opportunities exist to refine the specifications of Measure 3 to ensure that different organizations calculate the measure in the same way.

Abstract: The American Academy of Orthopaedic Surgeons recently proposed quality measures for the initial surgical treatment of carpal tunnel syndrome (CTS). One measure addressed avoidance of adjunctive surgical procedures during carpal tunnel release; and a second measure addressed avoidance of routine use of clinic-based occupational and/or physical therapy (OT/PT) after carpal tunnel release. However, for quality measures to serve their intended purposes, they must be tested in real-world data to establish that gaps in quality exist and that the measures yield reliable performance information. Questions/purposes (1) Is there an important quality gap in clinical practice for avoidance of adjunctive surgical procedures during carpal tunnel release? (2) Is there an important quality gap in avoiding routine use of clinic-based occupational and/or physical therapy after carpal tunnel release? (3) Do these two quality measures have adequate beta-binomial signal-to-noise ratio (SNR) and split-sample reliability (SSR)? Methods This retrospective comparative study used a large national private insurance claims database, the 2018 Optum Clinformatics® Data Mart. Ideally, healthcare quality measures are tested within data reflective of the providers and payors to which the measures will be applied. We previously tested these measures in a large public healthcare system and a single academic medical center. In this study, we sought to test the measures in the broader context of patients and providers using private insurance. For both measures, we included the first carpal tunnel release from 28,083 patients performed by one of 7236 surgeons, irrespective of surgical specialty (including, orthopaedic, plastic, neuro-, and general surgery). To calculate surgeon-level descriptive and reliability statistics, analyses were focused on the 66% (18,622 of 28,083) of patients who received their procedure from one of the 24% (1740 of 7236) of surgeons with at least five carpal tunnel releases in the database. No other inclusion/exclusion criteria were applied. To determine whether the measures reveal important gaps in treatment quality (avoidance of adjunctive procedures and routine therapy), we calculated descriptive statistics (median and interquartile range) of the performance distribution stratified by surgeon-level annual volume of carpal tunnel releases in the database (5+, 10+, 15+, 20+, 25+, and 30+). Like the Centers for Medicare & Medicaid Services (CMS), we considered a measure “topped out” if median performance was greater than 95%, meaning the opportunity for further quality improvement is low. We calculated the surgeon-level beta-binomial SNR and SSR for each measure, each stratified by the number of carpal tunnel releases performed by each surgeon in the database. These are standard measures of reliability in health care quality measurement science. The SNR quantifies the proportion of variance that is between rather than within surgeons, and the SSR is the correlation of performance scores when each surgeons’ patients are split into two random samples and then corrected for sample size. Results We found that 2% (308 of 18,622) of carpal tunnel releases involved an adjunctive procedure. The results showed that avoidance of adjunctive surgical procedures during carpal tunnel release had a median (IQR) performance of 100% (100% to 100%) at all case volumes. Only 8% (144 of 1740) of surgeons with at least five cases in the database had less than 100% performance, and only 5% (84 of 1740) had less than 90% performance. This means adjunctive procedures were rarely performed and an important quality gap does not exist based on the CMS criterion. Regarding the avoidance of routine therapy, there was a larger quality gap: For surgeons with at least five cases in the database, median performance was 89% (75% to 100%), and 25% (435 of 1740) of these surgeons had less than 75% performance. This signifies that the measure is not topped out and may reveal an important quality gap. Most patients receiving clinic-based OT/PT had only one visit in the 6 weeks after surgery. Median (IQR) SNRs of the first measure, which addressed avoidance of adjunctive surgical procedures, and the second measure, which addresses avoidance of routine use clinic-based OT/PT, were 1.00 (1.00 to 1.00) and 0.86 (0.67 to 1.00), respectively. The SSR for these measures were 0.87 (95% CI 0.85 to 0.88) and 0.75 (95% CI 0.73 to 0.77), respectively. All of these reliability statistics exceed National Quality Forum’s emerging minimum standard of 0.60. Conclusion The first measure, the avoidance of adjunctive surgical procedures during carpal tunnel release, lacked an important quality gap suggesting it is unlikely to be useful in driving improvements. The second measure, avoidance of routine use of clinic-based OT/PT, revealed a larger quality gap and had very good reliability, suggesting it may be useful for quality monitoring and improvement purposes. Clinical Relevance As healthcare systems and payors use the second measure, avoidance of routine use of clinic-based OT/PT, to encourage adherence to clinical practice guidelines (such as provider profiling, public reporting, and payment policies), it will be critically important to consider what proportion of patients receiving OT/PT should be considered routine practice and therefore inconsistent with guidelines. The value or potential harm of this measure depends on this judgement.

Abstract: The American Society of Anesthesiologists Physical Status (ASA-PS) classification system was developed to categorize the fitness of patients before surgery. Increasingly, the ASA-PS has been applied to other uses including justification of inpatient admission. Our objectives were to develop and cross-validate a statistical model for predicting ASA-PS; and 2) assess the concurrent and predictive validity of the model by assessing associations between model-derived ASA-PS, observed ASA-PS, and a diverse set of 30-day outcomes. Methods Using the 2014 American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) Participant Use Data File, we developed and internally cross-validated multinomial regression models to predict ASA-PS using preoperative NSQIP data. Accuracy was assessed with C-Statistics and calibration plots. We assessed both concurrent and predictive validity of model-derived ASA-PS relative to observed ASA-PS and 30-day outcomes. To aid further research and use of the ASA-PS model, we implemented it into an online calculator. Results Of the 566,797 elective procedures in the final analytic dataset, 8.9% were ASA-PS 1, 48.9% were ASA-PS 2, 39.1% were ASA-PS 3, and 3.2% were ASA-PS 4. The accuracy of the 21-variable model to predict ASA-PS was C = 0.77 +/− 0.0025. The model-derived ASA-PS had stronger association with key indicators of preoperative status including comorbidities and higher BMI (concurrent validity) compared to observed ASA-PS, but less strong associations with postoperative complications (predictive validity). The online ASA-PS calculator may be accessed at https://s-spire-clintools.shinyapps.io/ASA_PS_Estimator/ Conclusions Model-derived ASA-PS better tracked key indicators of preoperative status compared to observed ASA-PS. The ability to have an electronically derived measure of ASA-PS can potentially be useful in research, quality measurement, and clinical applications.