Abstract
Objective
An increasing number of clinical practice guidelines (CPGs) have emerged over recent years. To have clinical utility, they need to be rigorously developed and scientifically robust. Instruments have been developed to assess the quality of clinical guideline development and reporting. The aim of this study was to evaluate CPGs from the European Society for Vascular Surgery (ESVS) using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) instrument.
Methods
CPGs published by the ESVS during the period January 2011 to January 2023 were included. Two independent reviewers assessed the guidelines after receiving training in the use and application of the AGREE II instrument. Inter-reviewer reliability was assessed with the intraclass correlation coefficient. Maximum scaled scores were 100. Statistical analysis was performed using SPSS Statistics v.26.
Results
Sixteen guidelines were included in the study. Good inter-reviewer score reliability was found on statistical analysis (>0.9). The mean ± standard deviation domain scores were 68.1 ± 20.3% for scope and purpose, 57.1 ± 21.1% for stakeholder involvement, 67.8 ± 19.5% for rigour of development, 78.1 ± 20.6% for clarity of presentation, 50.3 ± 15.4% for applicability, 77.6 ± 17.6% for editorial independence, and 69.8 ± 20.1% for overall quality. Stakeholder involvement and applicability have improved in quality over time but are still the lowest scoring domains.
Conclusion
Most ESVS clinical guidelines are of high quality and reporting. There is scope for improvement, specifically by addressing the domains of stakeholder involvement and clinical applicability.
An increasing number of clinical practice guidelines (CPGs) have emerged over recent years. To have clinical utility, they need to be rigorously developed and scientifically robust. Instruments have been developed to assess the quality of clinical guideline development and reporting. The aim of this study was to evaluate CPGs from the European Society for Vascular Surgery (ESVS) using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) instrument.
Methods
CPGs published by the ESVS during the period January 2011 to January 2023 were included. Two independent reviewers assessed the guidelines after receiving training in the use and application of the AGREE II instrument. Inter-reviewer reliability was assessed with the intraclass correlation coefficient. Maximum scaled scores were 100. Statistical analysis was performed using SPSS Statistics v.26.
Results
Sixteen guidelines were included in the study. Good inter-reviewer score reliability was found on statistical analysis (>0.9). The mean ± standard deviation domain scores were 68.1 ± 20.3% for scope and purpose, 57.1 ± 21.1% for stakeholder involvement, 67.8 ± 19.5% for rigour of development, 78.1 ± 20.6% for clarity of presentation, 50.3 ± 15.4% for applicability, 77.6 ± 17.6% for editorial independence, and 69.8 ± 20.1% for overall quality. Stakeholder involvement and applicability have improved in quality over time but are still the lowest scoring domains.
Conclusion
Most ESVS clinical guidelines are of high quality and reporting. There is scope for improvement, specifically by addressing the domains of stakeholder involvement and clinical applicability.
| Original language | English |
|---|---|
| Pages (from-to) | 304-312 |
| Number of pages | 9 |
| Journal | European Journal of Vascular and Endovascular Surgery |
| Volume | 66 |
| Issue number | 3 |
| Early online date | 15 Jun 2023 |
| DOIs | |
| Publication status | Published - 1 Sept 2023 |
Bibliographical note
Funding Information:The authors acknowledge the support given by the Linder Foundation and the Royal College of Surgeons of England . They also acknowledge Darsika Karunarasan (statistician) for support in the statistical analysis.
Publisher Copyright:
© 2023