SCAHPS: Status of the AAO-HNSF Pilot Project
By Kris Schulz, MPH and Jean Brereton, MBA The Surgical Consumer Assessment of Healthcare Providers and Systems (SCAHPS®) is a standardized tool sponsored by the American College of Surgeons and the Surgical Quality Alliance that asks consumers and patients to report on and evaluate their experiences and satisfaction with their surgical care. The survey covers topics such as communication skills of providers (surgeon and anesthesiologist) and front-office staff and assesses all phases of the surgery (pre-, intra-, post-operative) for inpatient and outpatient settings. The SCAHPS consists of 45 items: • 12 items about care before surgery • 11 items about care during surgery (including eight items about anesthesiology) • Nine items about care after surgery • Two items about office staff during visits • One item rating the surgeon • One eligibility item • Nine “About You” items Health plans, insurers, and specialty boards may use the data from the SCAHPS for quality improvement activities and other financial incentive programs. Specifically, beginning in 2011, the American Board of Otolaryngology will require assessment of the interpersonal and communication skills of the surgeon using the SCAHPS or an equivalent survey. Given that this is a new tool and there is lack of data on implementing this type of survey and assessing its value, the AAO-HNSF Board of Directors leadership supported the development of this pilot project to: 1. Describe the tool itself and the utility of the scores that assess physician-patient communication to improvement, and 2. Describe the feasibility and challenges of implementing a patient experience survey in busy academic and private otolaryngology—head and neck surgery practices. A copy of the AHRQ Surgical SCAHPS survey can be downloaded at: www.cahps.ahrq.gov/content/products/PDF/Surgical_Eng.doc. Project Status Survey data collection, which is conducted through Dynamic Clinical Systems, a third-party vendor for data security and credibility reasons, began last August and continued through May. Four sites are participating in the pilot – two academic medical centers and two private practice sites. An interim analysis based on 135 completed surveys was performed earlier this year on data collected through November 2010 and aggregate summary reports with blinded surgeon level information were sent to all participants to begin familiarizing the surgeons with the composite scoring process. At press time, there were 281 surveys completed across four sites and 12 surgeons, with one month remaining in the data collection process. When the final analysis occurs at the conclusion of data collection, the data will be used to develop a manuscript detailing the challenges and lessons learned from the logistical aspect of implementing a patient experience survey, and summary level findings from the responses. Depending on sample sizes, comparisons and correlations will be explored on items such as procedure type and patient demographics. The individual sites and surgeons that participated will also receive data to assist with determining benchmark physicians in key areas or survey composites from which to potentially learn approach, technique, and best practices for improvement opportunities. An example of one of the composites from the survey as reported on in the interim analysis is provided at right.
By Kris Schulz, MPH and Jean Brereton, MBA
The Surgical Consumer Assessment of Healthcare Providers and Systems (SCAHPS®) is a standardized tool sponsored by the American College of Surgeons and the Surgical Quality Alliance that asks consumers and patients to report on and evaluate their experiences and satisfaction with their surgical care. The survey covers topics such as communication skills of providers (surgeon and anesthesiologist) and front-office staff and assesses all phases of the surgery (pre-, intra-, post-operative) for inpatient and outpatient settings. The SCAHPS consists of 45 items:
• | 12 items about care before surgery |
• | 11 items about care during surgery (including eight items about anesthesiology) |
• | Nine items about care after surgery |
• | Two items about office staff during visits |
• | One item rating the surgeon |
• | One eligibility item |
• | Nine “About You” items |
Health plans, insurers, and specialty boards may use the data from the SCAHPS for quality improvement activities and other financial incentive programs. Specifically, beginning in 2011, the American Board of Otolaryngology will require assessment of the interpersonal and communication skills of the surgeon using the SCAHPS or an equivalent survey. Given that this is a new tool and there is lack of data on implementing this type of survey and assessing its value, the AAO-HNSF Board of Directors leadership supported the development of this pilot project to:
1. | Describe the tool itself and the utility of the scores that assess physician-patient communication to improvement, and |
2. | Describe the feasibility and challenges of implementing a patient experience survey in busy academic and private otolaryngology—head and neck surgery practices. |
A copy of the AHRQ Surgical SCAHPS survey can be downloaded at: www.cahps.ahrq.gov/content/products/PDF/Surgical_Eng.doc.
Survey data collection, which is conducted through Dynamic Clinical Systems, a third-party vendor for data security and credibility reasons, began last August and continued through May. Four sites are participating in the pilot – two academic medical centers and two private practice sites. An interim analysis based on 135 completed surveys was performed earlier this year on data collected through November 2010 and aggregate summary reports with blinded surgeon level information were sent to all participants to begin familiarizing the surgeons with the composite scoring process. At press time, there were 281 surveys completed across four sites and 12 surgeons, with one month remaining in the data collection process.
When the final analysis occurs at the conclusion of data collection, the data will be used to develop a manuscript detailing the challenges and lessons learned from the logistical aspect of implementing a patient experience survey, and summary level findings from the responses. Depending on sample sizes, comparisons and correlations will be explored on items such as procedure type and patient demographics. The individual sites and surgeons that participated will also receive data to assist with determining benchmark physicians in key areas or survey composites from which to potentially learn approach, technique, and best practices for improvement opportunities.
An example of one of the composites from the survey as reported on in the interim analysis is provided at right.