AAO-HNSF Develops Quality Knowledge Products for Members
The AAO-HNSF develops quality knowledge products (QKPs), including clinical practice guidelines (CPGs) and clinical consensus statements (CCSs) to support evidence-based decisions in patient care for its members, the wider clinical community, and the general public. The Foundation developed and published its first QKP in 2006 and has since published at least one new QKP each year. In March, the Foundation published the Clinical Practice Guideline: Sudden Hearing Loss. Two CCSs have been submitted for publication (Appropriate Use of CT Imaging for Paranasal Sinus Disease and Tracheostomy Care) and three CPGs are currently under development (Improving Voice Outcomes after Thyroid Surgery, Tympanostomy Tubes in Children and Bell’s Palsy). CPGs will now be updated every five years post publication. Each update will identify any new evidence relevant to the guideline and determine if the document can be reaffirmed or whether a minor or major revision is required. The Foundation’s first CPG on Acute Otitis Externa recently turned five and is currently undergoing an update. Moving forward, each year, the Foundation will update at least one of its CPGs to ensure content remains current and relevant. CPG Development Process Guidelines are developed using an explicit and transparent a priori protocol for creating actionable statements based on the strength of supporting evidence and the associated balance of benefit and harm. The Academy’s methodology is outlined in the “Clinical Practice Guideline Development Manual,” which is available at http://www.entnet.org/guidelines. Guideline development occurs during a 12- to 14-month period and the development panel includes a variety of stakeholders representing multiple specialties, subspecialties, and consumers. The guideline panel convenes via conference call three times and two in-person meetings take place at the AAO-HNS/F headquarters. A final draft of the guideline is distributed for peer review to internal and external stakeholders, and then goes through a two-week public comment period. The manuscript is then sent to the Foundation’s Board of Directors for approval prior to submission to Otolaryngology–Head and Neck Surgery, at which point the guideline undergoes traditional peer review by journal editors. Guidelines are ultimately published in Otolaryngology–Head and Neck Surgery as supplements. Copies of each guideline are made available for free on the Academy’s website, and are referenced on the National Guidelines Clearinghouse website at http://www.guideline.gov. CCS Development Process Each CCS is developed utilizing a modified Delphi methodology to systematically achieve consensus among a panel of topic experts. A CCS may be single- or multi-specialty depending on the topic and should reflect the expert views of a panel of individuals well versed on the topic of interest. Each CCS panel is composed of 10 to 12 stakeholders who carefully review and discuss the current literature to identify gaps in research where evidence is lacking. The panel is asked to complete a qualitative survey to further refine the scope of the CCS. An initial list of statements are developed based on the qualitative survey results and compiled into a survey format using a Likert scale. Panel members are asked to rate their agreement with each statement on the survey. Each survey is followed by a conference call during which results are presented and statements discussed. Statements are categorized as “consensus,” “near consensus,” and “no consensus” based on their mean score. Multiple iterations of the survey may be necessary to revise statements and achieve consensus. Final results are compiled and the panel for submission to Otolaryngology–Head and Neck Surgery develops a manuscript. A manual outlining the Academy’s methodology is being developed. Oversight: Guideline Development Task Force (GDTF) The GDTF oversees the development and prioritization of topics for AAO-HNSF CPGs and CCSs. The GDTF is lead by Seth R. Schwartz, MD, MPH, chair and Richard M. Rosenfeld, MD, MPH, past-chair and current AAO-HNSF Senior Consultant for Quality and Guidelines. The GDTF is composed of subspecialty society representatives from American Broncho-Esophagological Association, American Neurotology Society, American Rhinologic Society, American Head and Neck Society, American Laryngological Association, The American Laryngological, Rhinological and Otological Society, Inc. (The Triological Society), American Otological Society, American Academy of Facial Plastic and Reconstructive Surgery, American Academy of Otolaryngic Allergy, American Society of Pediatric Otolaryngology and representatives from the AAO-HNS Board of Governors, Association of Otolaryngology Administrators, American Board of Otolaryngology, and Society Otorhinolaryngology and Head-Neck Nurses. The group meets biannually at the Academy’s headquarters and reviews guideline development methodology, progress, and prioritizes upcoming products. All AAO-HNS/F Scientific and Education Committees are encouraged to submit topics to the GDTF for consideration. Topics are presented and voted on at the fall/winter GDTF meeting. Approved future CPG/CCS topics include: Tinnitus; Chronic and Recurrent Pediatric Sinusitis; Allergic Rhinitis; and Septoplasty. The GDTF produces a newsletter that highlights the group’s activities and provides updates on guideline and consensus statement development; recent editions of the GDTF newsletter are available on the Academy’s website. National Guideline Clearinghouse (NGC) All of the Foundation CPGs are posted on the NGC. The NGC is an initiative of the Agency for Healthcare Research and Quality (AHRQ) and the U.S. Department of Health and Human Services. The NGC mission is to provide physicians and other health professionals, healthcare providers, health plans, integrated delivery systems, purchasers, and others an accessible mechanism for obtaining objective, detailed information on CPGs and to further their dissemination, implementation, and use. NGC provides structured, standardized summaries containing information derived from guidelines using the NGC Template of Guideline Attributes. Guidelines must meet the NGC Inclusion Criteria to be included in the clearinghouse. Visit http://guideline.gov/ to learn more. Podcasts – New in 2011 at www.otojournal.org In January 2011, the Foundation began developing podcasts related to clinical practice guidelines and other provocative articles published in Otolaryngology–Head and Neck Surgery. Each recording is, on average, 12-to-15 minutes in length and features a lively discussion between the editor in chief, corresponding author, and an associate editor who is a content expert for that field. The intent is to explore and to expand upon ideas and concepts in the original article, not to simply repeat what has already been published. We suggest that members refer to the complete published article, in addition to the Podcast, to get the most from your learning experience. Electronic Access Statistics: Otolaryngology–Head and Neck Surgery (Journal) and National Guidelines Clearinghouse (NGC) Sudden Hearing Loss Journal data available in September NGC data not available (posted May 2012) Indications for Polysomnography for Sleep-Disorder Breathing prior to Tonsillectomy in Children 2011 #2 Most-Accessed Article in Journal (3,719 full text downloads, Jan 2011-Dec 2011) Viewed 2,621 times on the NGC (December 2011–March 2012) Tonsillectomy in Children 2011 No. 1 Most-Accessed Article in OTO Journal (13,003 full text downloads, January 2011-December 2011) Viewed 14,775 times on the NGC (January 2011–March 2012) Dysphonia (Hoarseness) Viewed 14,136 times on the NGC (April 2010–March 2012) Benign Paroxysmal Positional Vertigo (BPPV) 2011 No. 9 Most-Accessed Article in Journal (902 full text downloads, January 2011-December 2011) Viewed 29,885 times on the NGC (April 2009–March 2012) Cerumen Impaction Viewed 21,265 times on the NGC (April 2009–March 2012) Adult Sinusitis 2011 No. 4 Most-Accessed Article in Journal (1,276 full text downloads, January 2011-December 2011) Viewed 50,341 times on the NGC (July 2008–March 2012) Acute Otitis Externa Viewed 57,620 times on the NGC (July 2006–March 2012) Journal data represents January 2011-March 2012 only. NGC data are from the time the guideline was originally posted to the NGC. Get Involved with Guidelines In March, the Foundation announced the first year of the G-I-N Scholars Program. The Foundation is funding four members to attend the annual Guidelines International Network (G-I-N) North America (NA) Conference in New York, NY. In exchange, recipients must agree to serve on an upcoming CPG panel. Recipients may serve as either a panel member or as assistant chair if he or she has prior guideline experience. This year’s G-I-N Scholars include: David O. Francis, MD; Lisa Michelle Ishii, MD; Melissa A. Pynnonen, MD; and Gordon H. Sun, MD. The call for applications to attend the 2013 G-I-N Conference, which will take place in North America, will be released in August. The Future The Foundation maintains awareness of ongoing progress in the field of guideline development. As such, the Foundation’s guideline development manual is reviewed and updated on a periodic basis to reflect the most up-to-date methodological techniques. Furthermore, the Foundation has just started its third year of collaboration with Richard N. Shiffman, MD, MCIS, and the Yale Center for Medical Informatics as part of the GuideLines Into DEcision Support (GLIDES) project sponsored by the Agency for Healthcare Research and Quality (AHRQ). The project explores how the translation of clinical knowledge into clinical decision support (CDS) tools can be routinely applied in practice, and taken to scale, to improve the quality of healthcare delivery in the United States. As part of this collaboration, the Sudden Hearing Loss guideline panel pilot tested Bridgewiz, an action statement development tool, and eGLIA, a guideline implementability appraisal tool. The three CPGs currently under development will also adopt and test the Bridgewiz and eGLIA tools. In March 2011, the Institute of Medicine (IOM) released two consensus reports: “Finding What Works in Health Care: Standards for Systematic Reviews” and “Clinical Practice Guidelines We Can Trust.” These reports were produced following a congressional mandate in the Medicare Improvement for Patients and Providers Act of 2008 for two independent studies: one to develop standards for conducting systematic reviews and the other to develop standards for trustworthy clinical practice guidelines. The IOM report, “Clinical Practice Guidelines We Can Trust,” highlighted eight standards for developing rigorous and trustworthy clinical practice guidelines including: transparency; conflict of interest; guideline development group composition; CPG–SR intersection; establishing evidence foundations for and strength of recommendations; articulation of recommendations; external review; and updating. In April, the manuscript “Guidelines International Network: Toward International Standards for Clinical Practice Guidelines” was published in the Annals of Internal Medicine. The article presents G-I-N’s proposed set of standards for guideline development including: panel composition; decision-making process; conflicts of interest; guideline objective; development methods; evidence review; basis of recommendations; ratings of evidence and recommendations; guideline review; updating processes; and funding. Amir Qaseem, MD, PhD, MHA, an author of the manuscript, will be speaking at the GDTF Meeting in July. The Academy has reviewed both the IOM reports and the G-I-N manuscript and believes that the current Foundation guideline development methodology, to a large extent, meets both sets of standards. However, we recognize that the Academy’s methodology needs to reflect current best practices and thus we are continuously striving to strengthen our process. For more information, email the Research and Quality Improvement business unit, quality@entnet.org. Copies of the Academy’s guidelines, the guideline development manual, and the GDTF newsletters are available at http://www.entnet.org/guidelines.
The AAO-HNSF develops quality knowledge products (QKPs), including clinical practice guidelines (CPGs) and clinical consensus statements (CCSs) to support evidence-based decisions in patient care for its members, the wider clinical community, and the general public. The Foundation developed and published its first QKP in 2006 and has since published at least one new QKP each year. In March, the Foundation published the Clinical Practice Guideline: Sudden Hearing Loss. Two CCSs have been submitted for publication (Appropriate Use of CT Imaging for Paranasal Sinus Disease and Tracheostomy Care) and three CPGs are currently under development (Improving Voice Outcomes after Thyroid Surgery, Tympanostomy Tubes in Children and Bell’s Palsy).
CPGs will now be updated every five years post publication. Each update will identify any new evidence relevant to the guideline and determine if the document can be reaffirmed or whether a minor or major revision is required. The Foundation’s first CPG on Acute Otitis Externa recently turned five and is currently undergoing an update. Moving forward, each year, the Foundation will update at least one of its CPGs to ensure content remains current and relevant.
CPG Development Process
Guidelines are developed using an explicit and transparent a priori protocol for creating actionable statements based on the strength of supporting evidence and the associated balance of benefit and harm. The Academy’s methodology is outlined in the “Clinical Practice Guideline Development Manual,” which is available at http://www.entnet.org/guidelines. Guideline development occurs during a 12- to 14-month period and the development panel includes a variety of stakeholders representing multiple specialties, subspecialties, and consumers. The guideline panel convenes via conference call three times and two in-person meetings take place at the AAO-HNS/F headquarters. A final draft of the guideline is distributed for peer review to internal and external stakeholders, and then goes through a two-week public comment period. The manuscript is then sent to the Foundation’s Board of Directors for approval prior to submission to Otolaryngology–Head and Neck Surgery, at which point the guideline undergoes traditional peer review by journal editors. Guidelines are ultimately published in Otolaryngology–Head and Neck Surgery as supplements. Copies of each guideline are made available for free on the Academy’s website, and are referenced on the National Guidelines Clearinghouse website at http://www.guideline.gov.
CCS Development Process
Each CCS is developed utilizing a modified Delphi methodology to systematically achieve consensus among a panel of topic experts. A CCS may be single- or multi-specialty depending on the topic and should reflect the expert views of a panel of individuals well versed on the topic of interest. Each CCS panel is composed of 10 to 12 stakeholders who carefully review and discuss the current literature to identify gaps in research where evidence is lacking. The panel is asked to complete a qualitative survey to further refine the scope of the CCS. An initial list of statements are developed based on the qualitative survey results and compiled into a survey format using a Likert scale. Panel members are asked to rate their agreement with each statement on the survey. Each survey is followed by a conference call during which results are presented and statements discussed. Statements are categorized as “consensus,” “near consensus,” and “no consensus” based on their mean score. Multiple iterations of the survey may be necessary to revise statements and achieve consensus. Final results are compiled and the panel for submission to Otolaryngology–Head and Neck Surgery develops a manuscript. A manual outlining the Academy’s methodology is being developed.
Oversight: Guideline Development Task Force (GDTF)
The GDTF oversees the development and prioritization of topics for AAO-HNSF CPGs and CCSs. The GDTF is lead by Seth R. Schwartz, MD, MPH, chair and Richard M. Rosenfeld, MD, MPH, past-chair and current AAO-HNSF Senior Consultant for Quality and Guidelines. The GDTF is composed of subspecialty society representatives from American Broncho-Esophagological Association, American Neurotology Society, American Rhinologic Society, American Head and Neck Society, American Laryngological Association, The American Laryngological, Rhinological and Otological Society, Inc. (The Triological Society), American Otological Society, American Academy of Facial Plastic and Reconstructive Surgery, American Academy of Otolaryngic Allergy, American Society of Pediatric Otolaryngology and representatives from the AAO-HNS Board of Governors, Association of Otolaryngology Administrators, American Board of Otolaryngology, and Society Otorhinolaryngology and Head-Neck Nurses.
The group meets biannually at the Academy’s headquarters and reviews guideline development methodology, progress, and prioritizes upcoming products. All AAO-HNS/F Scientific and Education Committees are encouraged to submit topics to the GDTF for consideration. Topics are presented and voted on at the fall/winter GDTF meeting. Approved future CPG/CCS topics include: Tinnitus; Chronic and Recurrent Pediatric Sinusitis; Allergic Rhinitis; and Septoplasty.
The GDTF produces a newsletter that highlights the group’s activities and provides updates on guideline and consensus statement development; recent editions of the GDTF newsletter are available on the Academy’s website.
National Guideline Clearinghouse (NGC)
All of the Foundation CPGs are posted on the NGC. The NGC is an initiative of the Agency for Healthcare Research and Quality (AHRQ) and the U.S. Department of Health and Human Services. The NGC mission is to provide physicians and other health professionals, healthcare providers, health plans, integrated delivery systems, purchasers, and others an accessible mechanism for obtaining objective, detailed information on CPGs and to further their dissemination, implementation, and use. NGC provides structured, standardized summaries containing information derived from guidelines using the NGC Template of Guideline Attributes. Guidelines must meet the NGC Inclusion Criteria to be included in the clearinghouse. Visit http://guideline.gov/ to learn more.
Podcasts – New in 2011 at www.otojournal.org
In January 2011, the Foundation began developing podcasts related to clinical practice guidelines and other provocative articles published in Otolaryngology–Head and Neck Surgery. Each recording is, on average, 12-to-15 minutes in length and features a lively discussion between the editor in chief, corresponding author, and an associate editor who is a content expert for that field. The intent is to explore and to expand upon ideas and concepts in the original article, not to simply repeat what has already been published. We suggest that members refer to the complete published article, in addition to the Podcast, to get the most from your learning experience.
Electronic Access Statistics: Otolaryngology–Head and Neck Surgery (Journal) and National Guidelines Clearinghouse (NGC)
Sudden Hearing Loss
- Journal data available in September
- NGC data not available (posted May 2012)
Indications for Polysomnography for Sleep-Disorder Breathing prior to Tonsillectomy in Children
- 2011 #2 Most-Accessed Article in Journal (3,719 full text downloads, Jan 2011-Dec 2011)
- Viewed 2,621 times on the NGC (December 2011–March 2012)
Tonsillectomy in Children
- 2011 No. 1 Most-Accessed Article in OTO Journal (13,003 full text downloads, January 2011-December 2011)
- Viewed 14,775 times on the NGC (January 2011–March 2012)
Dysphonia (Hoarseness)
- Viewed 14,136 times on the NGC (April 2010–March 2012)
Benign Paroxysmal Positional Vertigo (BPPV)
- 2011 No. 9 Most-Accessed Article in Journal (902 full text downloads, January 2011-December 2011)
- Viewed 29,885 times on the NGC (April 2009–March 2012)
Cerumen Impaction
- Viewed 21,265 times on the NGC (April 2009–March 2012)
Adult Sinusitis
- 2011 No. 4 Most-Accessed Article in Journal (1,276 full text downloads, January 2011-December 2011)
- Viewed 50,341 times on the NGC (July 2008–March 2012)
Acute Otitis Externa
- Viewed 57,620 times on the NGC (July 2006–March 2012)
Journal data represents January 2011-March 2012 only. NGC data are from the time the guideline was originally posted to the NGC.
Get Involved with Guidelines
In March, the Foundation announced the first year of the G-I-N Scholars Program. The Foundation is funding four members to attend the annual Guidelines International Network (G-I-N) North America (NA) Conference in New York, NY. In exchange, recipients must agree to serve on an upcoming CPG panel. Recipients may serve as either a panel member or as assistant chair if he or she has prior guideline experience. This year’s G-I-N Scholars include: David O. Francis, MD; Lisa Michelle Ishii, MD; Melissa A. Pynnonen, MD; and Gordon H. Sun, MD. The call for applications to attend the 2013 G-I-N Conference, which will take place in North America, will be released in August.
The Future
The Foundation maintains awareness of ongoing progress in the field of guideline development. As such, the Foundation’s guideline development manual is reviewed and updated on a periodic basis to reflect the most up-to-date methodological techniques. Furthermore, the Foundation has just started its third year of collaboration with Richard N. Shiffman, MD, MCIS, and the Yale Center for Medical Informatics as part of the GuideLines Into DEcision Support (GLIDES) project sponsored by the Agency for Healthcare Research and Quality (AHRQ). The project explores how the translation of clinical knowledge into clinical decision support (CDS) tools can be routinely applied in practice, and taken to scale, to improve the quality of healthcare delivery in the United States. As part of this collaboration, the Sudden Hearing Loss guideline panel pilot tested Bridgewiz, an action statement development tool, and eGLIA, a guideline implementability appraisal tool. The three CPGs currently under development will also adopt and test the Bridgewiz and eGLIA tools.
In March 2011, the Institute of Medicine (IOM) released two consensus reports: “Finding What Works in Health Care: Standards for Systematic Reviews” and “Clinical Practice Guidelines We Can Trust.” These reports were produced following a congressional mandate in the Medicare Improvement for Patients and Providers Act of 2008 for two independent studies: one to develop standards for conducting systematic reviews and the other to develop standards for trustworthy clinical practice guidelines. The IOM report, “Clinical Practice Guidelines We Can Trust,” highlighted eight standards for developing rigorous and trustworthy clinical practice guidelines including: transparency; conflict of interest; guideline development group composition; CPG–SR intersection; establishing evidence foundations for and strength of recommendations; articulation of recommendations; external review; and updating.
In April, the manuscript “Guidelines International Network: Toward International Standards for Clinical Practice Guidelines” was published in the Annals of Internal Medicine. The article presents G-I-N’s proposed set of standards for guideline development including: panel composition; decision-making process; conflicts of interest; guideline objective; development methods; evidence review; basis of recommendations; ratings of evidence and recommendations; guideline review; updating processes; and funding. Amir Qaseem, MD, PhD, MHA, an author of the manuscript, will be speaking at the GDTF Meeting in July.
The Academy has reviewed both the IOM reports and the G-I-N manuscript and believes that the current Foundation guideline development methodology, to a large extent, meets both sets of standards. However, we recognize that the Academy’s methodology needs to reflect current best practices and thus we are continuously striving to strengthen our process.
For more information, email the Research and Quality Improvement business unit, quality@entnet.org. Copies of the Academy’s guidelines, the guideline development manual, and the GDTF newsletters are available at http://www.entnet.org/guidelines.