edoc

Health system guidance appraisal-concept evaluation and usability testing

Ako-Arrey, Denis E. and Brouwers, Melissa C. and Lavis, John N. and Giacomini, Mita K. and Agree HS Team, . (2016) Health system guidance appraisal-concept evaluation and usability testing. Implementation science, 11. p. 3.

[img] PDF - Published Version
Available under License CC BY (Attribution).

693Kb

Official URL: http://edoc.unibas.ch/41967/

Downloads: Statistics Overview

Abstract

Health system guidance (HSG) provides recommendations aimed to address health system challenges. However, there is a paucity of methods to direct, appraise, and report HSG. Earlier research identified 30 candidate criteria (concepts) that can be used to evaluate the quality of HSG and guide development and reporting requirements. The objective of this paper was to describe two studies aimed at evaluating the importance of these 30 criteria, design a draft HSG appraisal tool, and test its usability.; This study involved a two-step survey process. In step 1, respondents rated the 30 concepts for appropriateness to, relevance to, and priority for health system decisions and HSG. This led to a draft tool. In step 2, respondents reviewed HSG documents, appraised them using the tool, and answered a series of questions. Descriptive analyses were computed.; Fifty participants were invited in step 1, and we had a response rate of 82 %. The mean response rates for each concept within each survey question were universally favorable. There was also an overall agreement about the need for a high-quality tool to systematically direct the development, appraisal, and reporting of HSG. Qualitative feedback and a consensus process by the team led to refinements to some of the concepts and the creation of a beta (draft) version of the HSG tool. In step 2, 35 participants were invited and we had a response rate of 74 %. Exploratory analyses showed that the quality of the HSGs reviewed varied as a function of the HSG item and the specific document assessed. A favorable consensus was reached with participants agreeing that the HSG items were easy to understand and easy to apply. Moreover, the overall agreement was high for the usability of the tool to systematically direct the development (85 %), appraisal (92 %), and reporting (81 %) of HSG. From this process, version 1.0 of the HSG appraisal tool was generated complete with 32 items (and their descriptions) and 4 domains.; The final tool, named the Appraisal of Guidelines for Research and Evaluation for Health Systems (AGREE-HS) (version 1), defines expectations of HSG and facilitates informed decisions among policymakers on health system delivery, financial, and governance arrangements.
Faculties and Departments:09 Associated Institutions > Swiss Tropical and Public Health Institute (Swiss TPH)
09 Associated Institutions > Swiss Tropical and Public Health Institute (Swiss TPH) > Department of Swiss Centre for International Health (SCIH) > Systems Strengthening and Health Promotion (Prytherch)
UniBasel Contributors:Bosch-Capblanch, Xavier
Item Type:Article, refereed
Article Subtype:Research Article
Publisher:BioMed Central
ISSN:1748-5908
Note:Publication type according to Uni Basel Research Database: Journal article
Language:English
Identification Number:
edoc DOI:
Last Modified:25 Aug 2016 07:14
Deposited On:19 Apr 2016 12:06

Repository Staff Only: item control page