<?xml version='1.0'?>
<!DOCTYPE art SYSTEM 'http://www.biomedcentral.com/xml/article.dtd'>
<art>
   <ui>1478-4505-7-S1-S6</ui>
   <ji>1478-4505</ji>
   <fm>
      <dochead>Guide</dochead>
      <bibl>
         <title>
            <p>SUPPORT Tools for Evidence-informed Policymaking in health 6: Using research evidence to address how an option will be implemented</p>
         </title>
         <aug>
            <au ca="yes" id="A1"><snm>Fretheim</snm><fnm>Atle</fnm><insr iid="I1"/><email>atle.fretheim@nokc.no</email></au>
            <au id="A2"><snm>Munabi-Babigumira</snm><fnm>Susan</fnm><insr iid="I2"/><email>sub@nokc.no</email></au>
            <au id="A3"><snm>Oxman</snm><mi>D</mi><fnm>Andrew</fnm><insr iid="I2"/><email>oxman@online.no</email></au>
            <au id="A4"><snm>Lavis</snm><mi>N</mi><fnm>John</fnm><insr iid="I3"/><email>lavisj@mcmaster.ca</email></au>
            <au id="A5"><snm>Lewin</snm><fnm>Simon</fnm><insr iid="I4"/><email>simon.lewin@nokc.no</email></au>
         </aug>
         <insg>
            <ins id="I1"><p>Norwegian Knowledge Centre for the Health Services, P.O. Box 7004, St. Olavs plass, N-0130 Oslo, Norway; Section for International Health, Institute of General Practice and Community Medicine, Faculty of Medicine, University of Oslo, Norway</p></ins>
            <ins id="I2"><p>Norwegian Knowledge Centre for the Health Services, P.O. Box 7004, St. Olavs plass, N-0130 Oslo, Norway</p></ins>
            <ins id="I3"><p>Centre for Health Economics and Policy Analysis, Department of Clinical Epidemiology and Biostatistics, and Department of Political Science, McMaster University, 1200 Main St. West, HSC-2D3, Hamilton, ON, Canada, L8N 3Z5</p></ins>
            <ins id="I4"><p>Norwegian Knowledge Centre for the Health Services, P.O. Box 7004, St. Olavs plass, N-0130 Oslo, Norway; Health Systems Research Unit, Medical Research Council of South Africa</p></ins>
         </insg>
         <source>Health Research Policy and Systems</source>
         <supplement>
            <title>
               <p>SUPPORT Tools for evidence-informed health Policymaking (STP)</p>
            </title>
            <editor>Andy Oxman and Stephen Hanney</editor>
            <sponsor>
               <note>This series of articles was prepared as part of the SUPPORT project, which was supported by the European Commission&#8217;s 6th Framework INCO programme, contract 031939. The Norwegian Agency for Development Cooperation (Norad), the Alliance for Health Policy and Systems Research, and the Milbank Memorial Fund funded a peer review meeting where an earlier version of the series was discussed. The Canada Research Chairs Program provides salary support to John Lavis, who has authored several articles in this series, in his role as Chair Canada Research Chair in Knowledge Transfer and Exchange. None of the funders had a role in drafting, revising or approving the content of this series. </note>
            </sponsor>
            <note>Guides</note>
            <url>http://www.biomedcentral.com/content/pdf/1478-4505-7-S1-info.pdf</url>
         </supplement>
         <issn>1478-4505</issn>
         <pubdate>2009</pubdate>
         <volume>7</volume>
         <issue>Suppl 1</issue>
         <fpage>S6</fpage>
         <url>http://www.health-policy-systems.com/content/7/S1/S6</url>
         <xrefbib><pubidlist><pubid idtype="pmpid">20018113</pubid><pubid idtype="doi">10.1186/1478-4505-7-S1-S6</pubid></pubidlist></xrefbib>
      </bibl>
      <history><pub><date><day>16</day><month>12</month><year>2009</year></date></pub></history>
      <cpyrt><year>2009</year><collab>Fretheim et al; licensee BioMed Central Ltd.</collab><note>This is an open access article distributed under the terms of the Creative Commons Attribution License (<url>http://creativecommons.org/licenses/by/2.0</url>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</note></cpyrt>
      <abs>
         <sec>
            <st>
               <p>Abstract</p>
            </st>
            <p><it>This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers</it>.</p>
            <p>After a policy decision has been made, the next key challenge is transforming this stated policy position into practical actions. What strategies, for instance, are available to facilitate effective implementation, and what is known about the effectiveness of such strategies? We suggest five questions that can be considered by policymakers when implementing a health policy or programme. These are: 1. What are the potential barriers to the successful implementation of a new policy? 2. What strategies should be considered in planning the implementation of a new policy in order to facilitate the necessary behavioural changes among healthcare recipients and citizens? 3. What strategies should be considered in planning the implementation of a new policy in order to facilitate the necessary behavioural changes in healthcare professionals? 4. What strategies should be considered in planning the implementation of a new policy in order to facilitate the necessary organisational changes? 5. What strategies should be considered in planning the implementation of a new policy in order to facilitate the necessary systems changes?</p>
         </sec>
      </abs>
   </fm>
   <bdy>
      <sec>
         <st>
            <p>About STP</p>
         </st>
         <p><it>This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers. The series is intended to help such people ensure that their decisions are well-informed by the best available research evidence. The SUPPORT tools and the ways in which they can be used are described in more detail in the Introduction to this series </it><abbrgrp><abbr bid="B1">1</abbr></abbrgrp>. <it>A glossary for the entire series is attached to each article </it>(see Additional File <supplr sid="S1">1</supplr>). <it>Links to Spanish, Portuguese, French and Chinese translations of this series can be found on the SUPPORT website </it><url>http://www.support-collaboration.org</url>. <it>Feedback about how to improve the tools in this series is welcome and should be sent to: </it><email>STP@nokc.no</email>.</p>
         <suppl id="S1">
            <title>
               <p>Additional file 1</p>
            </title>
            <caption>
               <p/>
            </caption>
            <text>
               <p>Glossary</p>
            </text>
            <file name="1478-4505-7-S1-S6-S1.doc">
   <p>Click here for file</p>
</file>
         </suppl>
      </sec>
      <sec>
         <st>
            <p>Scenarios</p>
         </st>
         <p><it>Scenario 1: You are a senior civil servant with responsibility for the rollout of a new reform programme in the health services. You want to ensure that implementation takes place as effectively as possible</it>.</p>
         <p><it>Scenario 2: You work in the Ministry of Health and have been instructed to prepare an implementation plan for the rollout of the government's recently adopted reform programme for the health services. You wish to explore what types of strategies to consider in such a plan</it>.</p>
         <p><it>Scenario 3: You work in an independent unit that supports the Ministry of Health in its use of evidence in policymaking. You are preparing a document on the effects of various interventions that could be included in a national implementation strategy for the new health services reform programme, and need guidance on how to do this</it>.</p>
      </sec>
      <sec>
         <st>
            <p>Background</p>
         </st>
         <p>For policymakers (Scenario 1), this article suggests a number of questions that they might ask their staff to consider when the implementation of a new policy is being planned.</p>
         <p>For those who support policymakers (Scenarios 2 and 3), this article suggests a number of questions that we believe are worth considering when discussing programme implementation and potentially useful approaches.</p>
         <p>The process of translating policy into practice can be challenging and is often done in an unsystematic way. Careful planning is needed to prevent otherwise good policies being hampered by poor implementation. But the implementation process is not always a straightforward one: it may involve a complex set of actions at various levels of the health system as well as within communities.</p>
         <p>Two key issues should be considered by those responsible for policy implementation, namely: "How can the activities related to the policy option be implemented to produce real changes on the ground?", and "Which strategies are available to facilitate effective implementation?"</p>
         <p>A number of entry points can be used when planning policy implementation. Our suggested approach entails first identifying barriers to implementation, and then tailoring the implementation strategies to address the barriers - and facilitators - that are found.</p>
         <p>This article is the third of three articles about clarifying evidence needs (see also Articles 4 and 5). (Figure <figr fid="F1">1</figr> outlines the processes involved in clarifying these needs).</p>
         <fig id="F1"><title><p>Figure 1</p></title><caption><p>Clarifying evidence needs</p></caption><text>
   <p><b>Clarifying evidence needs</b>.</p>
</text><graphic file="1478-4505-7-S1-S6-1"/></fig>
      </sec>
      <sec>
         <st>
            <p>Questions to consider</p>
         </st>
         <p>1. What are the potential barriers to the successful implementation of a new policy?</p>
         <p>2. What strategies should be considered in planning the implementation of a new policy in order to facilitate the necessary behavioural changes among healthcare recipients and citizens?</p>
         <p>3. What strategies should be considered in planning the implementation of a new policy in order to facilitate the necessary behavioural changes in healthcare professionals?</p>
         <p>4. What strategies should be considered in planning the implementation of a new policy in order to facilitate the necessary organisational changes?</p>
         <p>5. What strategies should be considered in planning the implementation of a new policy in order to facilitate the necessary systems changes?</p>
         <sec>
            <st>
               <p>1. What are the potential barriers to the successful implementation of a new policy?</p>
            </st>
            <p>A useful starting point for anyone wanting to elicit change is the identification of likely barriers to change. Knowing what - and where - the major hurdles are that may affect successful implementation is useful during the planning process. These challenges will often vary from policy to policy, and between different contexts. Both research findings on barriers to policy implementation in other settings, and lessons learnt from previous experiences may be informative, but they may not be sufficient.</p>
            <p>There is no standard approach to identifying barriers to change. This process is often done informally by taking <it>perceived </it>barriers into account and in an implicit and unsystematic way. We propose a more structured approach to identifying barriers.</p>
            <p>The people who will be affected by a policy - the stakeholders - are the ones likely to be best placed to foresee possible barriers to policy implementation. A number of methods can be used to explore the views of stakeholder groups about new policies including, for example, a 'mixed methods approach' for undertaking a so-called 'diagnostic analysis'. This approach may include brainstorming, focus group discussions, interviews and other qualitative methods, or a combination of these. Such activities can provide new insights into stakeholders' perceptions and identify both barriers - and facilitators - to policy implementation. Surveys can also be useful. For example, respondents could be asked to rate the extent to which a list of potential barriers actually represents obstacles to change. Practical examples of such processes are provided in Table <tblr tid="T1">1</tblr><abbrgrp><abbr bid="B2">2</abbr><abbr bid="B3">3</abbr></abbrgrp>.</p>
            <tbl id="T1"><title><p>Table 1</p></title><caption><p>Examples of how barriers to policy implementation can be identified</p></caption><tblbdy cols="1">
      <r>
         <c ca="left">
            <p>
               <b>Accessing antiretroviral therapy (ART) in Tanzania </b>
               <abbrgrp>
                  <abbr bid="B3">3</abbr>
               </abbrgrp>
            </p>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>ART has been freely available in selected reference hospitals in Tanzania since 2005 as part of the national government's policy to make ART more widely accessible. Making medicines available, however, does not automatically result in patients being able to access them. In order to identify barriers to ART access in a particular setting where the drugs were made available, a team of researchers conducted focus group discussions with community members and in-depth interviews with treatment seekers. The researchers found that "transportation and supplementary food costs, the referral hospital's reputation for being unfriendly and confusing, and difficulties in sustaining long-term treatment would limit accessibility." They noted too that a "fear of stigma framed all [patient] concerns, posing challenges for contacting referrals those who did not want their status disclosed or who had expressed reluctance to identify a "treatment buddy" as required by the programme".</p>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>
               <b>Cholesterol-screening in the United States </b>
               <abbrgrp>
                  <abbr bid="B2">2</abbr>
               </abbrgrp>
            </p>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>American researchers examined the barriers to participation in cholesterol screenings in both adults and children in West Virginia in the United States. Using the theory of 'planned behaviour' as a conceptual framework to provide a model for understanding decision making within particular belief systems and cultures, the researchers postulated that an individual's intention to perform an action is a central factor in determining whether an individual <it>will </it>perform that action. The researchers conducted semi-structured interviews using interview guides designed to elicit information relevant to the key constructs of the theory of planned behaviour. Their findings suggest that environmental, financial, <it>and </it>attitudinal barriers affected levels of participation in these health screenings. These include concerns about the outcomes of testing, the use of needles, privacy, a lack of knowledge in the community, and local traditional cultural beliefs.</p>
         </c>
      </r>
   </tblbdy></tbl>
            <p>Several frameworks and checklists have been developed to help identify potential barriers to implementing health interventions. These are often based on a combination of behavioural theories, empirical data, and common sense, and may be useful tools in guiding the process of identifying barriers. Some frameworks cover a broad range of potential barriers in various parts of the health system. For example, in one framework, barriers are categorised according to the level at which the constraints operate <abbrgrp><abbr bid="B4">4</abbr></abbrgrp>. These levels include: the household and community, delivery of health services, health sector policy and strategic management, public policies cutting across sectors, and environmental and contextual characteristics. Examples of barriers identified at each of these levels are shown in Table <tblr tid="T2">2</tblr>.</p>
            <tbl id="T2"><title><p>Table 2</p></title><caption><p>Constraints to improving access to priority health interventions, by level (from <abbrgrp><abbr bid="B4">4</abbr></abbrgrp>)</p></caption><tblbdy cols="2">
      <r>
         <c ca="left">
            <p>
               <b>Level of constraint</b>
            </p>
         </c>
         <c ca="left">
            <p>
               <b>Types of constraint</b>
            </p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>I. Community and household level</p>
         </c>
         <c ca="left">
            <p>&#8226; Lack of demand for effective interventions</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left">
            <p>&#8226; Barriers to the use of effective interventions (physical, financial, social)</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>II. Health services delivery level</p>
         </c>
         <c ca="left">
            <p>&#8226; Shortage and distribution of appropriately qualified staff</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left">
            <p>&#8226; Weak technical guidance, programme management and supervision</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left">
            <p>&#8226; Inadequate drugs and medical supplies</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left">
            <p>&#8226; Lack of equipment and infrastructure, including poor accessibility of health services</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>III. Health sector policy and strategic management level</p>
         </c>
         <c ca="left">
            <p>&#8226; Weak and overly-centralised systems for planning and management</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left">
            <p>&#8226; Weak drug policies and supply system</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left">
            <p>&#8226; Inadequate regulation of pharmaceutical and private sectors and improper industry practices</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left">
            <p>&#8226; Lack of inter-sectoral action and partnership for health between government and civil society</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left">
            <p>&#8226; Weak incentives to use inputs efficiently and respond to user needs and preferences</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left">
            <p>&#8226; Reliance on donor funding that reduces flexibility and ownership</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left">
            <p>&#8226; Donor practices that damage country policies</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>IV. Public policies cutting across sectors</p>
         </c>
         <c ca="left">
            <p>&#8226; Government bureaucracy (civil service rules and remuneration, centralised management systems, civil service reforms)</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left">
            <p>&#8226; Poor availability of communication and transport infrastructure</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>V. Environmental and contextual characteristics</p>
         </c>
         <c ca="left">
            <p>&#8226; Governance and overall policy framework</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left" indent="1">
            <p>- Corruption, weak government, weak rule of law and</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left" indent="1">
            <p>- enforceability of contracts</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left" indent="1">
            <p>- Political instability and insecurity</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left" indent="1">
            <p>- Low priority attached to social sectors</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left" indent="1">
            <p>- Weak structures for public accountability</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left" indent="1">
            <p>- Lack of free press</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left">
            <p>&#8226; Physical environment</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left" indent="1">
            <p>- Climatic and geographic predisposition to disease</p>
         </c>
      </r>
      <r>
         <c>
            <p/>
         </c>
         <c ca="left" indent="1">
            <p>- Physical environment unfavourable to service delivery</p>
         </c>
      </r>
   </tblbdy></tbl>
            <p>We have adopted a similar approach by focusing on constraints to policy implementation at three levels in the health system:</p>
            <p>&#8226; Among healthcare recipients and citizens</p>
            <p>&#8226; Among healthcare professionals</p>
            <p>&#8226; At the organisational level</p>
            <p>Once the likely barriers to policy implementation have been identified, the next step is to identify implementation strategies or interventions that can address these (Table <tblr tid="T3">3</tblr> shows examples of possible links between barriers and interventions among healthcare recipients and citizens). The choice of strategies should also be guided by the available evidence of their effectiveness and costs, as well as stakeholders' views, etc. The issue of how to find and assess evidence that may be relevant is addressed in other articles in this series <abbrgrp><abbr bid="B5">5</abbr><abbr bid="B6">6</abbr><abbr bid="B7">7</abbr><abbr bid="B8">8</abbr><abbr bid="B9">9</abbr></abbrgrp>.</p>
            <tbl id="T3"><title><p>Table 3</p></title><caption><p>Examples of possible links between barriers and interventions among healthcare recipients and citizens</p></caption><tblbdy cols="2">
      <r>
         <c ca="left">
            <p>
               <b>Identified barrier to policy implementation</b>
            </p>
         </c>
         <c ca="left">
            <p>
               <b>Possible interventions to address identified barriers</b>
            </p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Current programmes are ineffective or of uncertain effectiveness</p>
         </c>
         <c ca="left">
            <p>&#8226; Review the components of ongoing programmes, as well as the evidence from systematic reviews regarding other possible options for evidence of effectiveness</p>
            <p>&#8226; Conduct rigorous evaluations of programmes</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Poor satisfaction with care</p>
         </c>
         <c ca="left">
            <p>&#8226; Improve evidence-based strategies to improve the quality of care delivered</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>The relevant services are not within physical reach of some patients/citizens in need of them</p>
         </c>
         <c ca="left">
            <p>&#8226; Creation of new services</p>
            <p>&#8226; Hiring of new personnel</p>
            <p>&#8226; Redistribution of resources</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Denial of the severity of their problem</p>
         </c>
         <c ca="left">
            <p>&#8226; Education and community awareness programmes</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Transportation costs</p>
         </c>
         <c ca="left">
            <p>&#8226; Provision of transportation or financial support for transport</p>
         </c>
      </r>
   </tblbdy></tbl>
         </sec>
         <sec>
            <st>
               <p>2. What strategies should be considered in planning the implementation of a new policy in order to facilitate the necessary behavioural changes among healthcare recipients and citizens?</p>
            </st>
            <p>The behaviour of healthcare recipients and citizens, particularly in relation to the use of health services (e.g. under-utilisation, non-adherence to recommended lifestyle changes or treatment schedules, etc.), may be a potentially significant obstacle to successful policy implementation. It is necessary to understand why the targeted recipients behave in particular ways as this will influence the choices they make in utilising health services. Well-conducted qualitative studies can provide insights into the behaviour of healthcare recipients <abbrgrp><abbr bid="B10">10</abbr></abbrgrp>.</p>
            <p>One framework that can be used to identify factors that may influence the behaviour of healthcare recipients and citizens was proposed by a WHO working group on adherence to long-term therapies. They suggested five dimensions to consider <abbrgrp><abbr bid="B11">11</abbr></abbrgrp>:</p>
            <p>&#8226; Socio-economic related factors</p>
            <p>&#8226; Health system and healthcare-related factors</p>
            <p>&#8226; Therapy-related factors</p>
            <p>&#8226; Factors-related to the particular health conditions of patients</p>
            <p>&#8226; Patient-related factors</p>
            <p>As these factors are related more specifically to clinical interventions, they may be particularly useful when considering barriers to the delivery of care arrangements. For example, some of the socio-economic factors that can affect adherence to treatment among patients with tuberculosis include: a lack of effective social support networks and unstable living circumstances, cultural and lay beliefs, ethnicity, gender, age, the high cost of medication and transport, and the role of criminal justice <abbrgrp><abbr bid="B11">11</abbr><abbr bid="B12">12</abbr></abbrgrp>.</p>
            <p>The Cochrane Consumer and Communication Review Group has extensively documented the effects of interventions to improve interactions between consumers and healthcare providers and systems, and has developed a taxonomy of interventions that target healthcare recipients and citizens <abbrgrp><abbr bid="B13">13</abbr></abbrgrp>. This may be helpful when conceptualising and considering what kinds of interventions to use. The taxonomy includes:</p>
            <p>&#8226; Provision of education or information</p>
            <p>&#8226; Support for changing behaviour</p>
            <p>&#8226; Support for developing skills and competencies</p>
            <p>&#8226; Personal support</p>
            <p>&#8226; Facilitation of communication and decision making, and</p>
            <p>&#8226; System participation</p>
            <p>Several studies and reviews have evaluated the effects of interventions that address constraints to effective health service delivery at the level of healthcare recipients and citizens. In one review, the authors found positive effects from community participation in overcoming such constraints <abbrgrp><abbr bid="B14">14</abbr></abbrgrp>. In this instance, community participation was obtained using a variety of intervention approaches, including: health education (e.g. meetings, group teachings), encouraging a participative approach (mobilising leaders and stakeholders to understand and buy into the intervention), using an outreach strategy (targeting households and high-risk groups), and the training and supervision of providers (e.g. nurses and/or mothers). These interventions resulted in increased health-related knowledge and community empowerment and improved coverage in immunisation and sanitation practices.</p>
            <p>Financial incentives, such as conditional cash transfers, may be worth considering if socio-economic related barriers are seen as playing an important role. This is because evidence, particularly from low- and middle-income countries, indicates that these may have an impact on the use of health services <abbrgrp><abbr bid="B15">15</abbr></abbrgrp> (see Table <tblr tid="T4">4</tblr> for details). A further illustrative example of evidence on the impacts of financial incentives is provided in Table <tblr tid="T5">5</tblr><abbrgrp><abbr bid="B16">16</abbr></abbrgrp>.</p>
            <tbl id="T4"><title><p>Table 4</p></title><caption><p>Summary of key findings from systematic review of conditional cash transfer programmes in low- and middle-income countries <abbrgrp><abbr bid="B15">15</abbr></abbrgrp></p></caption><tblbdy cols="1">
      <r>
         <c ca="left">
            <p>&#8226; Overall, the evidence suggests that conditional cash transfer (CCT) programmes are effective in increasing the use of preventive services for children and women, and sometimes in improving health status</p>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>&#8226; Only one study evaluated the effect of providing different amounts of cash (from $1 to $3). The overall effect of the increase was a near doubling in the proportion of people returning for their HIV-test results (72% of people who had received incentives compared to 39% of those who had not)</p>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>&#8226; While the flows of money required for CCT programmes may be significant, the actual transfer budget may account for between only 4 to 28% of a total programme budget</p>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>&#8226; The cost-effectiveness of CCT programmes compared with classic supply-side interventions (e.g. improving the quantity and quality of infrastructure and services) has not been examined, as most CCT programmes have been implemented in settings with relatively adequate (health) infrastructures</p>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>&#8226; Unanticipated perverse effects can occur. For instance, one programme reported unexpected increases in the fertility rate when CCTs were used, possibly because only pregnant women were eligible for the subsidy</p>
         </c>
      </r>
   </tblbdy></tbl>
            <tbl id="T5"><title><p>Table 5</p></title><caption><p>Example of evidence that can inform the design of an implementation strategy targeted at healthcare recipients and citizens</p></caption><tblbdy cols="1">
      <r>
         <c ca="left">
            <p>
               <b>Cash rewards for learning HIV-status, in Malawi </b>
               <abbrgrp>
                  <abbr bid="B16">16</abbr>
               </abbrgrp>
            </p>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Potential barriers to obtaining results from HIV-testing include the monetary costs of time and travel, and psychological costs (for example, stress, worry and fear, or the experience of social stigma). Monetary incentives may compensate directly for time and transport costs - and potentially for any psychological costs incurred. In a field experiment in rural Malawi, individuals were randomly assigned monetary incentives to learn their HIV results after testing. Where no incentives were offered, one-third of those tested obtained their results. In contrast, where small monetary incentives were provided, two-thirds went to obtain their HIV-test results.</p>
         </c>
      </r>
   </tblbdy></tbl>
            <p>If patient-related factors, such as a lack of information appear to be important barriers to policy implementation, interventions to improve information provision might be worth considering. A systematic review has shown that mass media interventions, for example, "can encourage increased utilisation of health services". But this finding should be approached with caution given that the study was based almost exclusively on studies from high-income countries <abbrgrp><abbr bid="B17">17</abbr></abbrgrp> and therefore may not be applicable to other settings.</p>
         </sec>
         <sec>
            <st>
               <p>3. What strategies should be considered in planning the implementation of a new policy in order to facilitate the necessary behavioural changes in healthcare professionals?</p>
            </st>
            <p>The implementation of a policy or programme will often require changes in the behaviour of those healthcare professionals responsible for implementing the policy on the ground. Changes in professional behaviour do not always necessarily happen automatically. Active and directed approaches may therefore be necessary. The identification of barriers to change or factors that influence professional practice may help to inform the design of interventions for policy implementation. Cabana and colleagues conducted a systematic review of research addressing barriers to guideline adherence among physicians <abbrgrp><abbr bid="B18">18</abbr></abbrgrp> and identified seven main categories of barriers. These can be used as a framework for identifying barriers to policy implementation among healthcare professionals:</p>
            <p>&#8226; Lack of awareness</p>
            <p>&#8226; Lack of familiarity</p>
            <p>&#8226; Lack of agreement</p>
            <p>&#8226; Lack of self-efficacy</p>
            <p>&#8226; Lack of outcome-expectancy</p>
            <p>&#8226; Inertia of previous practice</p>
            <p>&#8226; External barriers</p>
            <p>Examples of how identifying barriers can inform implementation are provided in Table <tblr tid="T6">6</tblr>.</p>
            <tbl id="T6"><title><p>Table 6</p></title><caption><p>Examples of possible links between barriers and interventions among healthcare professionals</p></caption><tblbdy cols="2">
      <r>
         <c ca="left">
            <p>
               <b>Identified barrier to policy implementation</b>
            </p>
         </c>
         <c ca="left">
            <p>
               <b>Possible interventions to address identified barriers</b>
            </p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Lack of knowledge</p>
         </c>
         <c ca="left">
            <p>&#8226; Information delivery methods (educational outreach, training)</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Disagreement with policy</p>
         </c>
         <c ca="left">
            <p>&#8226; Identify opinion leaders who can act as advocates for the new policy</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Time consuming</p>
         </c>
         <c ca="left">
            <p>&#8226; Offer economic compensation</p>
         </c>
      </r>
   </tblbdy></tbl>
            <p>The Effective Practice and Organisation of Care (EPOC) Review Group in the Cochrane Collaboration has developed a taxonomy of provider-targeted interventions which provides an overview of the types of interventions that may be considered for implementation purposes <abbrgrp><abbr bid="B19">19</abbr></abbrgrp>. These are:</p>
            <p>&#8226; Educational materials</p>
            <p>&#8226; Educational meetings</p>
            <p>&#8226; Educational outreach visits</p>
            <p>&#8226; Local opinion leaders</p>
            <p>&#8226; Local consensus processes</p>
            <p>&#8226; Peer review</p>
            <p>&#8226; Audit and feedback</p>
            <p>&#8226; Reminders and prompts</p>
            <p>&#8226; Tailored interventions</p>
            <p>&#8226; Patient-mediated interventions</p>
            <p>&#8226; Multi-faceted interventions</p>
            <p>Several strategies aimed at achieving behavioural change among healthcare professionals have been rigorously assessed <abbrgrp><abbr bid="B20">20</abbr><abbr bid="B21">21</abbr><abbr bid="B22">22</abbr><abbr bid="B23">23</abbr></abbrgrp>. Typically, these have taken the form of evaluations of guideline implementation strategies targeted directly at healthcare professionals. Most, but not all, have been conducted in high-income settings <abbrgrp><abbr bid="B24">24</abbr></abbrgrp>. The findings demonstrate that many interventions can influence professional behaviour effectively to a modest or moderate extent. But passive interventions, such as the circulation of guidelines or the hosting of educational meetings, seem only to have smaller impacts. Educational outreach visits and multi-faceted interventions that specifically target identified barriers to change are among the more promising approaches.</p>
            <p>Financial incentives may be used as a means of influencing professional behaviour but these have been evaluated almost entirely in high-income settings. These can be effective in influencing individual healthcare professionals when simple and well-defined behavioural goals are provided, such as increases in the delivery of immunisations - at least in the short term <abbrgrp><abbr bid="B25">25</abbr></abbrgrp>. However, several potentially negative consequences of such programmes have been identified and the use of financial incentives may not necessarily be cost-effective.</p>
            <p>Regulatory measures are inexpensive and potentially effective means of eliciting changes in professional behaviour but may be poorly received by professional groups <abbrgrp><abbr bid="B26">26</abbr></abbrgrp>. The impact of regulations per se as a means of achieving behavioural change among healthcare professionals has not been reviewed systematically, therefore available knowledge about their effectiveness is limited <abbrgrp><abbr bid="B27">27</abbr></abbrgrp>.</p>
            <p>See Table <tblr tid="T7">7</tblr> for further illustrative examples of evidence on the effects of interventions to achieve behavioural change among healthcare professionals <abbrgrp><abbr bid="B28">28</abbr><abbr bid="B29">29</abbr></abbrgrp>.</p>
            <tbl id="T7"><title><p>Table 7</p></title><caption><p>Examples of evidence that can inform the design of implementation strategies targeted at healthcare professionals</p></caption><tblbdy cols="1">
      <r>
         <c ca="left">
            <p>
               <b>Financial incentives to health workers to increase institutional deliveries in India </b>
               <abbrgrp>
                  <abbr bid="B28">28</abbr>
               </abbrgrp>
            </p>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>In 2005, the Indian government introduced the Janani Suraksha Yojana (JSY) programme which aimed to reduce maternal and neonatal mortality through the promotion of institutional deliveries. Cash payments to community health workers (ASHAs) for institutional deliveries among women under their care was one of the key programme components. Since the introduction of the programme, many Indian states have seen a substantial increase in institutional deliveries. However, an evaluation of one such programme suggests that the financial incentives for ASHA probably played a small if any role in this.    </p>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>
               <b>Educational outreach visits to improve asthma care in South Africa </b>
               <abbrgrp>
                  <abbr bid="B29">29</abbr>
               </abbrgrp>
            </p>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>South African researchers found that two 30-minute educational outreach visits to general practitioners conducted by a trained pharmacist led to clinically important improvements in symptom scores for children with asthma.</p>
         </c>
      </r>
   </tblbdy></tbl>
         </sec>
         <sec>
            <st>
               <p>4. What strategies should be considered in planning the implementation of a new policy in order to facilitate the necessary organisational changes?</p>
            </st>
            <p>Many organisational change strategies see the measures that should be taken as steps in a process that leads to change. Defining why there is a need for change and identifying barriers to change are tasks that are typically included in this process.</p>
            <p>Pexton has proposed a list of the most common barriers to organisational change and this can also be used as a framework for barrier-identification <abbrgrp><abbr bid="B30">30</abbr></abbrgrp>:</p>
            <p>&#8226; Cultural complacency (resistance or scepticism)</p>
            <p>&#8226; Lack of communication</p>
            <p>&#8226; Lack of alignment and accountability</p>
            <p>&#8226; Passive or absent leadership</p>
            <p>&#8226; Micro-management</p>
            <p>&#8226; An overloaded workforce</p>
            <p>&#8226; Inadequate systems and structures</p>
            <p>Ways to address each of these types of barriers are suggested in Table <tblr tid="T8">8</tblr>.</p>
            <tbl id="T8"><title><p>Table 8</p></title><caption><p>Proposed list of common organisational barriers to change (adapted from <abbrgrp><abbr bid="B30">30</abbr></abbrgrp>)</p></caption><tblbdy cols="2">
      <r>
         <c ca="left">
            <p>
               <b>Barriers</b>
            </p>
         </c>
         <c ca="left">
            <p>
               <b>Strategies to address barriers</b>
            </p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Cultural complacency (resistance or scepticism)</p>
         </c>
         <c ca="left">
            <p>&#8226; Deliver a few quick 'measurable wins' to demonstrate why change is needed</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Lack of communication</p>
         </c>
         <c ca="left">
            <p>&#8226; Develop a communication strategy targeted to identified communication barriers in the organisation</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Lack of alignment and accountability</p>
         </c>
         <c ca="left">
            <p>&#8226; Institute appropriate management structures</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Passive or absent leadership</p>
         </c>
         <c ca="left">
            <p>&#8226; Engage leaders in the proposed changes</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Micro-management</p>
         </c>
         <c ca="left">
            <p>&#8226; Empower the team and establish vision for the organisation among team members</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Overloaded workforce</p>
         </c>
         <c ca="left">
            <p>&#8226; Demonstrate the benefits of rethinking workflow to team members and of using new processes or technologies to reduce non value-added steps</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Inadequate systems and structures</p>
         </c>
         <c ca="left">
            <p>&#8226; Institute appropriate systems and structures to support the initiative</p>
         </c>
      </r>
      <r>
         <c cspan="2">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>Lack of control plans to measure and sustain results</p>
         </c>
         <c ca="left">
            <p>&#8226; Develop mechanisms to assess progress and maintain any positive results attained</p>
         </c>
      </r>
   </tblbdy></tbl>
            <p>Examples of the tools and approaches often recommended to organisations assessing preparations for change include <abbrgrp><abbr bid="B31">31</abbr></abbrgrp>:</p>
            <p>&#8226; Analytic models for understanding complexity, interdependence and fragmentation (such as Weisbord's six-box organisational model, the 7S model, and process models)</p>
            <p>&#8226; Tools for assessing why change is needed, such as SWOT analysis</p>
            <p>&#8226; Tools for determining who and what can change, such as force field analysis and total quality management</p>
            <p>&#8226; Tools for making changes, such as organisational development, action research and project management</p>
            <p>Most commonly used organisational change strategies are based almost entirely on theory, or else on one-off applications and opinion. Sometimes these are supplemented with case studies or anecdotes, mainly from high-income settings <abbrgrp><abbr bid="B31">31</abbr></abbrgrp>. Evidence about the effectiveness of these strategies is hard to come by, making it difficult to predict whether or not a specific method is likely to lead to the desired organisational change.</p>
            <p>Although the impacts of such change management strategies are uncertain, they may still be useful as processes allowing for active reflection on how change in an organisation can be facilitated.</p>
         </sec>
         <sec>
            <st>
               <p>5. What strategies should be considered in planning the implementation of a new policy in order to facilitate the necessary systems changes?</p>
            </st>
            <p>When a policy is to be implemented, changes at the general level of a health system may be necessary. These may include changes to governance arrangements, financial arrangements and delivery arrangements <abbrgrp><abbr bid="B32">32</abbr></abbrgrp>. For example, when considering the financing of a policy option, should all costs be incurred by the government, or are additional sources of funding needed? Can the current system cope with the additional bureaucratic or logistical workload, or is a new mechanism needed to deliver the service? The body of evidence on how to implement such changes is small: those making decisions will usually have to draw on case studies and experiences in other jurisdictions. For particular policy implementation issues systematic reviews may be useful, such as those related to the costs of scaling up interventions <abbrgrp><abbr bid="B33">33</abbr></abbrgrp> or factors that may affect the sustainability of health programmes <abbrgrp><abbr bid="B34">34</abbr></abbrgrp>. In a recent overview, the authors summarised the evidence from systematic reviews on the effects of governance, financial and delivery arrangements, and implementation strategies that have the potential to improve the delivery of cost-effective interventions in primary health care in LMICs <abbrgrp><abbr bid="B27">27</abbr></abbrgrp>.</p>
            <p>When identifying the need for system changes it may be useful to review the components of a health system and to identify where changes are required. Table <tblr tid="T9">9</tblr> shows a framework that can be used as a starting point for such analyses <abbrgrp><abbr bid="B35">35</abbr></abbrgrp>.</p>
            <tbl id="T9"><title><p>Table 9</p></title><caption><p>Various components of health systems (adapted from Lavis et al <abbrgrp><abbr bid="B35">35</abbr></abbrgrp>)</p></caption><tblbdy cols="3">
      <r>
         <c ca="left">
            <p>
               <b>Delivery arrangements</b>
            </p>
         </c>
         <c ca="left">
            <p>
               <b>Financial arrangements</b>
            </p>
         </c>
         <c ca="left">
            <p>
               <b>Governance arrangements</b>
            </p>
         </c>
      </r>
      <r>
         <c cspan="3">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>&#8226; To whom care is provided and the efforts made to reach them (such as interventions to ensure culturally appropriate care)</p>
         </c>
         <c ca="left">
            <p>&#8226; Financing - e.g. how revenue is raised for programmes and services (such as through community-based insurance schemes)</p>
         </c>
         <c ca="left">
            <p>&#8226; Policy authority - who makes policy decisions (such as whether such decisions are centralised or decentralised)?</p>
         </c>
      </r>
      <r>
         <c cspan="3">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>&#8226; By whom care is provided (such as providers working autonomously versus those who work as part of multidisciplinary teams)</p>
         </c>
         <c ca="left">
            <p>&#8226; Funding - e.g. how clinics are paid for the programmes and services they provide (such as through global budgets)</p>
         </c>
         <c ca="left">
            <p>&#8226; Organisational authority - e.g. who owns and manages clinics (such as whether private for-profit clinics exist)</p>
         </c>
      </r>
      <r>
         <c cspan="3">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>&#8226; Where care is provided - e.g. whether care is delivered in the home or community health facilities</p>
         </c>
         <c ca="left">
            <p>&#8226; Remuneration - e.g. how providers are remunerated (such as via capitation)</p>
         </c>
         <c ca="left">
            <p>&#8226; Commercial authority - e.g. who can sell and dispense drugs and how they are regulated</p>
         </c>
      </r>
      <r>
         <c cspan="3">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>&#8226; With what information and communication technology is care provided - e.g. whether record systems are conducive to providing continuity of care</p>
         </c>
         <c ca="left">
            <p>&#8226; Financial incentives - e.g. whether patients are paid to adhere to care plans</p>
         </c>
         <c ca="left">
            <p>&#8226; Professional authority - e.g. who is licensed to deliver services, how their scope of practice is determined, and how they are accredited</p>
         </c>
      </r>
      <r>
         <c cspan="3">
            <hr/>
         </c>
      </r>
      <r>
         <c ca="left">
            <p>&#8226; How the quality and safety of care is monitored - e.g. whether quality-monitoring systems are in place</p>
         </c>
         <c ca="left">
            <p>&#8226; Resource allocation - e.g. whether drug formularies are used to decide which medications patients receive for free</p>
         </c>
         <c ca="left">
            <p>&#8226; Consumer and stakeholder involvement - who is invited to participate in policymaking processes from outside government and how their views are taken into consideration</p>
         </c>
      </r>
   </tblbdy></tbl>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Conclusion</p>
         </st>
         <p>A consideration of the aspects of policy implementation described in this article should enable policymakers and those who support them to employ a structured approach that includes the use of research findings in the design of implementation strategies. Currently, implementation plans often are developed on an ad hoc basis, and are rarely informed by available evidence. As the approach outlined in this article is not widely used, we encourage the sharing of experiences in this area of evidence-informed policy implementation.</p>
      </sec>
      <sec>
         <st>
            <p>Resources</p>
         </st>
         <sec>
            <st>
               <p>Useful documents and further reading</p>
            </st>
            <p>Shared decision-making in health care. Achieving evidence-based patient choice (2<sup>nd </sup>edition, Edited by Edwards A and Elwyn G). Oxford University Press, 2009.</p>
            <p>Changing Professional Practice (Edited by: Thorsen T and M&#228;kel&#228; M) Copenhagen: Danish Institute for Health Services Research and Development, 1999. <url>http://www.dsi.dk/projects/cpp/Monograph/DSI9905.pdf</url></p>
            <p>Grol R, Wensing M, Eccles M. Improving Patient Care: The Implementation of Change in Clinical Practice. Oxford: Elsevier, 2005.</p>
            <p>Fretheim A, Sch&#252;nemann HJ, Oxman AD. Improving the use of research evidence in guideline development: 15. Disseminating and implementing guidelines. Health Research Policy and Systems 2006, 4:27. <url>http://www.health-policy-systems.com/content/4/1/27</url></p>
            <p>NorthStar - how to design and evaluate healthcare quality improvement interventions. The ReBEQI Collaboration 2005: <url>http://www.rebeqi.org/?pageID=34&amp;ItemID=35</url></p>
            <p>Iles V, Sutherland K. Organisational Change. A review for health care managers, professionals and researchers. 2001. London, National Co-ordinating Centre for NHS Service Delivery and Organisation R &amp; D <url>http://www.sdo.nihr.ac.uk/files/adhoc/change-management-review.pdf</url>.</p>
            <p/>
         </sec>
         <sec>
            <st>
               <p>Links to websites</p>
            </st>
            <p>Cochrane Consumers and Communication Review Group Resource Bank: <url>http://www.latrobe.edu.au/chcp/cochrane/resourcebank/index.html</url> - The Cochrane Consumers and Communication Review Group is part of the Cochrane Collaboration, an international, non-profit organisation that aims to help people make well-informed decisions about healthcare. The Consumers and Communication Review Group co-ordinates the production of systematic reviews of interventions which affect consumers' interactions with healthcare professionals, services and researchers. This resource bank is a list of Cochrane systematic reviews relevant to people's health communication and participation needs, and has been produced by manually searching The Cochrane Library.</p>
            <p>Cochrane Effective Practice and Organisation of Care (EPOC) Review Group: <url>http://www.epoc.cochrane.org/en/index.html</url> - EPOC is a Collaborative Review Group of the Cochrane Collaboration and produces systematic reviews of educational, behavioural, financial, regulatory and organisational interventions that are designed to improve healthcare professional practice and the organisation of health care services.</p>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Competing interests</p>
         </st>
         <p>The authors declare that they have no competing interests.</p>
      </sec>
      <sec>
         <st>
            <p>Authors' contributions</p>
         </st>
         <p>AF prepared the first draft of this article. SMB, ADO, JNL and SL contributed to drafting and revising it.</p>
      </sec>
   </bdy>
   <bm>
      <ack>
         <sec>
            <st>
               <p>Acknowledgements</p>
            </st>
            <p>Please see the Introduction to this series for acknowledgements of funders and contributors. In addition, we would like to acknowledge Valerie Iles for helpful comments on an earlier version of this article.</p>
            <p>This article has been published as part of <it>Health Research Policy and Systems </it>Volume 7 Supplement 1, 2009: SUPPORT Tools for evidence-informed health Policymaking (STP). The full contents of the supplement are available online at <url>http://www.health-policy-systems.com/content/7/S1</url>.</p>
         </sec>
      </ack>
      <refgrp><bibl id="B1"><title><p>SUPPORT Tools for evidence-informed health Policymaking (STP). Introduction</p></title><aug><au><snm>Lavis</snm><fnm>JN</fnm></au><au><snm>Oxman</snm><fnm>AD</fnm></au><au><snm>Lewin</snm><fnm>S</fnm></au><au><snm>Fretheim</snm><fnm>A</fnm></au></aug><source>Health Res Policy Syst</source><pubdate>2009</pubdate><volume>7</volume><issue>Suppl 1</issue><fpage>I1</fpage><xrefbib><pubidlist><pubid idtype="doi">10.1186/1478-4505-7-S1-I1</pubid><pubid idtype="pmpid" link="fulltext">20018098</pubid></pubidlist></xrefbib></bibl><bibl id="B2"><title><p>Preventive care in Appalachia: use of the theory of planned behavior to identify barriers to participation in cholesterol screenings among West Virginians</p></title><aug><au><snm>Deskins</snm><fnm>S</fnm></au><au><snm>Harris</snm><fnm>CV</fnm></au><au><snm>Bradlyn</snm><fnm>AS</fnm></au><au><snm>Cottrell</snm><fnm>L</fnm></au><au><snm>Coffman</snm><fnm>JW</fnm></au><au><snm>Olexa</snm><fnm>J</fnm></au><au><snm>Neal</snm><fnm>W</fnm></au></aug><source>J Rural Health</source><pubdate>2006</pubdate><volume>22</volume><fpage>367</fpage><lpage>74</lpage><xrefbib><pubidlist><pubid idtype="doi">10.1111/j.1748-0361.2006.00060.x</pubid><pubid idtype="pmpid" link="fulltext">17010036</pubid></pubidlist></xrefbib></bibl><bibl id="B3"><title><p>Barriers to accessing antiretroviral therapy in Kisesa, Tanzania: a qualitative study of early rural referrals to the national program</p></title><aug><au><snm>Mshana</snm><fnm>GH</fnm></au><au><snm>Wamoyi</snm><fnm>J</fnm></au><au><snm>Busza</snm><fnm>J</fnm></au><au><snm>Zaba</snm><fnm>B</fnm></au><au><snm>Changalucha</snm><fnm>J</fnm></au><au><snm>Kaluvya</snm><fnm>S</fnm></au><au><snm>Urassa</snm><fnm>M</fnm></au></aug><source>AIDS Patient Care STDS</source><pubdate>2006</pubdate><volume>20</volume><fpage>649</fpage><lpage>57</lpage><xrefbib><pubidlist><pubid idtype="doi">10.1089/apc.2006.20.649</pubid><pubid idtype="pmpid" link="fulltext">16987051</pubid></pubidlist></xrefbib></bibl><bibl id="B4"><title><p>Expanding access to priority health interventions: a framework for understanding the constraints to scaling-up</p></title><aug><au><snm>Hanson</snm><fnm>K</fnm></au><au><snm>Ranson</snm><fnm>MK</fnm></au><au><snm>Oliveira-Cruz</snm><fnm>V</fnm></au><au><snm>Mills</snm><fnm>A</fnm></au></aug><source>J Int Dev</source><pubdate>2003</pubdate><volume>15</volume><fpage>1</fpage><lpage>14</lpage><xrefbib><pubid idtype="doi">10.1002/jid.963</pubid></xrefbib></bibl><bibl id="B5"><title><p>SUPPORT Tools for evidence-informed health Policymaking (STP). 7. Finding systematic reviews</p></title><aug><au><snm>Lavis</snm><fnm>JN</fnm></au><au><snm>Oxman</snm><fnm>AD</fnm></au><au><snm>Grimshaw</snm><fnm>J</fnm></au><au><snm>Johansen</snm><fnm>M</fnm></au><au><snm>Boyko</snm><fnm>JA</fnm></au><au><snm>Lewin</snm><fnm>S</fnm></au><au><snm>Fretheim</snm><fnm>A</fnm></au></aug><source>Health Res Policy Syst</source><pubdate>2009</pubdate><volume>7</volume><issue>Suppl 1</issue><fpage>S7</fpage><xrefbib><pubidlist><pubid idtype="doi">10.1186/1478-4505-7-S1-S7</pubid><pubid idtype="pmpid" link="fulltext">20018114</pubid></pubidlist></xrefbib></bibl><bibl id="B6"><title><p>SUPPORT Tools for evidence-informed health Policymaking (STP). 9. Assessing the applicability of the findings of a systematic review</p></title><aug><au><snm>Lavis</snm><fnm>JN</fnm></au><au><snm>Oxman</snm><fnm>AD</fnm></au><au><snm>Souza</snm><fnm>NM</fnm></au><au><snm>Lewin</snm><fnm>S</fnm></au><au><snm>Gruen</snm><fnm>RL</fnm></au><au><snm>Fretheim</snm><fnm>A</fnm></au></aug><source>Health Res Policy Syst</source><pubdate>2009</pubdate><volume>7</volume><issue>Suppl 1</issue><fpage>S9</fpage><xrefbib><pubidlist><pubid idtype="doi">10.1186/1478-4505-7-S1-S9</pubid><pubid idtype="pmpid">20018116</pubid></pubidlist></xrefbib></bibl><bibl id="B7"><title><p>SUPPORT Tools for evidence-informed health Policymaking (STP). 11. Finding and using research evidence about local conditions</p></title><aug><au><snm>Lewin</snm><fnm>S</fnm></au><au><snm>Oxman</snm><fnm>AD</fnm></au><au><snm>Lavis</snm><fnm>JN</fnm></au><au><snm>Fretheim</snm><fnm>A</fnm></au><au><snm>Garc&#237;a Mart&#237;</snm><fnm>S</fnm></au><au><snm>Munabi-Babigumira</snm><fnm>S</fnm></au></aug><source>Health Res Policy Syst</source><pubdate>2009</pubdate><volume>7</volume><issue>Suppl 1</issue><fpage>S11</fpage><xrefbib><pubidlist><pubid idtype="doi">10.1186/1478-4505-7-S1-S11</pubid><pubid idtype="pmpid" link="fulltext">20018101</pubid></pubidlist></xrefbib></bibl><bibl id="B8"><title><p>SUPPORT Tools for evidence-informed health Policymaking (STP). 8. Deciding how much confidence to place in a systematic review</p></title><aug><au><snm>Lewin</snm><fnm>S</fnm></au><au><snm>Oxman</snm><fnm>AD</fnm></au><au><snm>Lavis</snm><fnm>JN</fnm></au><au><snm>Fretheim</snm><fnm>A</fnm></au></aug><source>Health Res Policy Syst</source><pubdate>2009</pubdate><volume>7</volume><issue>Suppl 1</issue><fpage>S8</fpage><xrefbib><pubidlist><pubid idtype="doi">10.1186/1478-4505-7-S1-S8</pubid><pubid idtype="pmpid" link="fulltext">20018115</pubid></pubidlist></xrefbib></bibl><bibl id="B9"><title><p>SUPPORT Tools for evidence-informed health Policymaking (STP). 10. Taking equity into consideration when assessing the findings of a systematic review</p></title><aug><au><snm>Oxman</snm><fnm>AD</fnm></au><au><snm>Lavis</snm><fnm>JN</fnm></au><au><snm>Lewin</snm><fnm>S</fnm></au><au><snm>Fretheim</snm><fnm>A</fnm></au></aug><source>Health Res Policy Syst</source><pubdate>2009</pubdate><volume>7</volume><issue>Suppl 1</issue><fpage>S9</fpage><xrefbib><pubidlist><pubid idtype="doi">10.1186/1478-4505-7-S1-S9</pubid><pubid idtype="pmpid" link="fulltext">20018116</pubid></pubidlist></xrefbib></bibl><bibl id="B10"><aug><au><snm>Green</snm><fnm>J</fnm></au><au><snm>Thorogood</snm><fnm>N</fnm></au></aug><source>Qualitative methods for health research</source><publisher>London: London School of Hygiene &amp; Topical Medicine</publisher><pubdate>2004</pubdate></bibl><bibl id="B11"><aug><au><cnm>World Health Organization (WHO)</cnm></au></aug><source>Adherence to long-term therapies: evidence for action</source><publisher>Geneva, World Health Organization (WHO)</publisher><pubdate>2003</pubdate><url>http://www.who.int/chp/knowledge/publications/adherence_full_report.pdf</url></bibl><bibl id="B12"><title><p>Patient adherence to tuberculosis treatment: a systematic review of qualitative research</p></title><aug><au><snm>Munro</snm><fnm>SA</fnm></au><au><snm>Lewin</snm><fnm>SA</fnm></au><au><snm>Smith</snm><fnm>HJ</fnm></au><au><snm>Engel</snm><fnm>ME</fnm></au><au><snm>Fretheim</snm><fnm>A</fnm></au><au><snm>Volmink</snm><fnm>J</fnm></au></aug><source>PLoS Med</source><pubdate>2007</pubdate><volume>4</volume><fpage>e238</fpage><xrefbib><pubidlist><pubid idtype="doi">10.1371/journal.pmed.0040238</pubid><pubid idtype="pmcid">1925126</pubid><pubid idtype="pmpid" link="fulltext">17676945</pubid></pubidlist></xrefbib></bibl><bibl id="B13"><aug><au><snm>Santesso</snm><fnm>N</fnm></au><au><snm>Ryan</snm><fnm>R</fnm></au><au><snm>Hill</snm><fnm>S</fnm></au><au><snm>Grimshaw</snm><fnm>J</fnm></au></aug><source>A Taxonomy of Interventions Directed at Consumers to Promote Evidence-based Prescribing and Drug Use</source><publisher>Poster presentation at The Canadian Agency for Drugs and Technologies in Health Symposium</publisher><pubdate>2007</pubdate><url>http://www.latrobe.edu.au/chcp/assets/downloads/CADTH07_poster.pdf</url></bibl><bibl id="B14"><title><p>Approaches to overcoming constraints to effective health service delivery: A review of the Evidence</p></title><aug><au><snm>Oliveira-Cruz</snm><fnm>V</fnm></au><au><snm>Hanson</snm><fnm>K</fnm></au><au><snm>Mills</snm><fnm>A</fnm></au></aug><source>J Int Dev</source><pubdate>2003</pubdate><volume>15</volume><fpage>41</fpage><lpage>65</lpage><xrefbib><pubid idtype="doi">10.1002/jid.965</pubid></xrefbib></bibl><bibl id="B15"><title><p>Conditional cash transfers for improving uptake of health interventions in low- and middle-income countries: a systematic review</p></title><aug><au><snm>Lagarde</snm><fnm>M</fnm></au><au><snm>Haines</snm><fnm>A</fnm></au><au><snm>Palmer</snm><fnm>N</fnm></au></aug><source>JAMA</source><pubdate>2007</pubdate><volume>298</volume><fpage>1900</fpage><lpage>10</lpage><xrefbib><pubidlist><pubid idtype="doi">10.1001/jama.298.16.1900</pubid><pubid idtype="pmpid" link="fulltext">17954541</pubid></pubidlist></xrefbib></bibl><bibl id="B16"><title><p>The Demand for, and Impact of, Learning HIV Status</p></title><aug><au><snm>Thornton</snm><fnm>R</fnm></au></aug><source>American Economic Review</source><pubdate>2008</pubdate><volume>98</volume><fpage>1829</fpage><lpage>63</lpage><xrefbib><pubid idtype="doi">10.1257/aer.98.5.1829</pubid></xrefbib></bibl><bibl id="B17"><title><p>Mass media interventions: effects on health services utilisation</p></title><aug><au><snm>Grilli</snm><fnm>R</fnm></au><au><snm>Ramsay</snm><fnm>C</fnm></au><au><snm>Minozzi</snm><fnm>S</fnm></au></aug><source>Cochrane Database Syst Rev</source><pubdate>2002</pubdate><volume>1</volume><fpage>CD000389</fpage><xrefbib><pubid idtype="pmpid" link="fulltext">11869574</pubid></xrefbib></bibl><bibl id="B18"><title><p>Why don't physicians follow clinical practice guidelines? A framework for improvement</p></title><aug><au><snm>Cabana</snm><fnm>MD</fnm></au><au><snm>Rand</snm><fnm>CS</fnm></au><au><snm>Powe</snm><fnm>NR</fnm></au><au><snm>Wu</snm><fnm>AW</fnm></au><au><snm>Wilson</snm><fnm>MH</fnm></au><au><snm>Abboud</snm><fnm>PA</fnm></au><au><snm>Rubin</snm><fnm>HR</fnm></au></aug><source>JAMA</source><pubdate>1999</pubdate><volume>282</volume><fpage>1458</fpage><lpage>65</lpage><xrefbib><pubidlist><pubid idtype="doi">10.1001/jama.282.15.1458</pubid><pubid idtype="pmpid" link="fulltext">10535437</pubid></pubidlist></xrefbib></bibl><bibl id="B19"><aug><au><cnm>Cochrane Effective Practice and Organisation of Care Review Group</cnm></au></aug><source>Data Collection Check List</source><pubdate>2002</pubdate><url>http://www.epoc.cochrane.org/Files/Website%20files/Documents/Reviewer%20Resources/datacollectionchecklist.pdf</url></bibl><bibl id="B20"><title><p>Strategies for improving the quality of health care in maternal and child health in low- and middle-income countries: an overview of systematic reviews</p></title><aug><au><snm>Althabe</snm><fnm>F</fnm></au><au><snm>Bergel</snm><fnm>E</fnm></au><au><snm>Cafferata</snm><fnm>ML</fnm></au><au><snm>Gibbons</snm><fnm>L</fnm></au><au><snm>Ciapponi</snm><fnm>A</fnm></au><au><snm>Aleman</snm><fnm>A</fnm></au><au><snm>Colantonio</snm><fnm>L</fnm></au><au><snm>Palacios</snm><fnm>AR</fnm></au></aug><source>Paediatr Perinat Epidemiol</source><pubdate>2008</pubdate><volume>22</volume><issue>Suppl 1</issue><fpage>42</fpage><lpage>60</lpage><xrefbib><pubidlist><pubid idtype="doi">10.1111/j.1365-3016.2007.00912.x</pubid><pubid idtype="pmpid" link="fulltext">18237352</pubid></pubidlist></xrefbib></bibl><bibl id="B21"><title><p>Changing provider behavior: an overview of systematic reviews of interventions</p></title><aug><au><snm>Grimshaw</snm><fnm>JM</fnm></au><au><snm>Shirran</snm><fnm>L</fnm></au><au><snm>Thomas</snm><fnm>R</fnm></au><au><snm>Mowatt</snm><fnm>G</fnm></au><au><snm>Fraser</snm><fnm>C</fnm></au><au><snm>Bero</snm><fnm>L</fnm></au><au><snm>Grilli</snm><fnm>R</fnm></au><au><snm>Harvey</snm><fnm>E</fnm></au><au><snm>Oxman</snm><fnm>AD</fnm></au><au><snm>O'Brien</snm><fnm>MA</fnm></au></aug><source>Med Care</source><pubdate>2001</pubdate><volume>39</volume><fpage>II2</fpage><lpage>45</lpage><xrefbib><pubidlist><pubid idtype="doi">10.1097/00005650-200108002-00002</pubid><pubid idtype="pmpid">11583120</pubid></pubidlist></xrefbib></bibl><bibl id="B22"><title><p>Effectiveness and efficiency of guideline dissemination and implementation strategies</p></title><aug><au><snm>Grimshaw</snm><fnm>JM</fnm></au><au><snm>Thomas</snm><fnm>RE</fnm></au><au><snm>MacLennan</snm><fnm>G</fnm></au><au><snm>Fraser</snm><fnm>C</fnm></au><au><snm>Ramsay</snm><fnm>CR</fnm></au><au><snm>Vale</snm><fnm>L</fnm></au><au><snm>Whitty</snm><fnm>P</fnm></au><au><snm>Eccles</snm><fnm>MP</fnm></au><au><snm>Matowe</snm><fnm>L</fnm></au><au><snm>Shirran</snm><fnm>L</fnm></au><etal/></aug><source>Health Technol Assess</source><pubdate>2004</pubdate><volume>8</volume><fpage>iii</fpage><lpage>72</lpage><xrefbib><pubid idtype="pmpid" link="fulltext">14960256</pubid></xrefbib></bibl><bibl id="B23"><title><p>The effectiveness of clinical guideline implementation strategies--a synthesis of systematic review findings</p></title><aug><au><snm>Prior</snm><fnm>M</fnm></au><au><snm>Guerin</snm><fnm>M</fnm></au><au><snm>Grimmer-Somers</snm><fnm>K</fnm></au></aug><source>J Eval Clin Pract</source><pubdate>2008</pubdate><volume>14</volume><fpage>888</fpage><lpage>97</lpage><xrefbib><pubid idtype="pmpid" link="fulltext">19018923</pubid></xrefbib></bibl><bibl id="B24"><title><p>Bridging the implementation gap between knowledge and action for health</p></title><aug><au><snm>Haines</snm><fnm>A</fnm></au><au><snm>Kuruvilla</snm><fnm>S</fnm></au><au><snm>Borchert</snm><fnm>M</fnm></au></aug><source>Bull World Health Organ</source><pubdate>2004</pubdate><volume>82</volume><fpage>724</fpage><lpage>31</lpage><xrefbib><pubidlist><pubid idtype="pmcid">2623035</pubid><pubid idtype="pmpid">15643791</pubid></pubidlist></xrefbib></bibl><bibl id="B25"><aug><au><snm>Oxman</snm><fnm>AD</fnm></au><au><snm>Fretheim</snm><fnm>A</fnm></au></aug><source>An overview of research on the effects of results-based financing. Report Nr 16-2008</source><publisher>Oslo, Nasjonalt kunnskapssenter for helsetjenesten</publisher><pubdate>2008</pubdate><url>http://www.kunnskapssenteret.no/binary?download=true&amp;id=5800</url></bibl><bibl id="B26"><title><p>The effects of mandatory prescribing of thiazides for newly treated, uncomplicated hypertension: interrupted time-series analysis</p></title><aug><au><snm>Fretheim</snm><fnm>A</fnm></au><au><snm>Havelsrud</snm><fnm>K</fnm></au><au><snm>MacLennan</snm><fnm>G</fnm></au><au><snm>Kristoffersen</snm><fnm>DT</fnm></au><au><snm>Oxman</snm><fnm>AD</fnm></au></aug><source>PLoS Med</source><pubdate>2007</pubdate><volume>4</volume><fpage>e232</fpage><xrefbib><pubidlist><pubid idtype="doi">10.1371/journal.pmed.0040232</pubid><pubid idtype="pmcid">1904466</pubid><pubid idtype="pmpid" link="fulltext">17622192</pubid></pubidlist></xrefbib></bibl><bibl id="B27"><title><p>Supporting the delivery of cost-effective interventions in primary health-care systems in low-income and middle-income countries: an overview of systematic reviews</p></title><aug><au><snm>Lewin</snm><fnm>S</fnm></au><au><snm>Lavis</snm><fnm>JN</fnm></au><au><snm>Oxman</snm><fnm>AD</fnm></au><au><snm>Bastias</snm><fnm>G</fnm></au><au><snm>Chopra</snm><fnm>M</fnm></au><au><snm>Ciapponi</snm><fnm>A</fnm></au><au><snm>Flottorp</snm><fnm>S</fnm></au><au><snm>Marti</snm><fnm>SG</fnm></au><au><snm>Pantoja</snm><fnm>T</fnm></au><au><snm>Rada</snm><fnm>G</fnm></au><etal/></aug><source>Lancet</source><pubdate>2008</pubdate><volume>372</volume><fpage>928</fpage><lpage>39</lpage><xrefbib><pubidlist><pubid idtype="doi">10.1016/S0140-6736(08)61403-8</pubid><pubid idtype="pmpid" link="fulltext">18790316</pubid></pubidlist></xrefbib></bibl><bibl id="B28"><aug><au><snm>Uttekar</snm><fnm>BP</fnm></au><au><snm>Barge</snm><fnm>S</fnm></au><au><snm>Khan</snm><fnm>W</fnm></au><au><snm>Deshpande</snm><fnm>Y</fnm></au><au><snm>Uttekar</snm><fnm>V</fnm></au><au><snm>Sharma</snm><fnm>J</fnm></au><au><snm>Shahane</snm><fnm>S</fnm></au><au><snm>Chakrawar</snm><fnm>B</fnm></au><au><cnm>Shahane</cnm></au></aug><source>Assessment of ASHA and Janani Suraksha Yojana in Rajasthan</source><publisher>Vadodora, India, Centre for Operations Research &amp; Training (CORT)</publisher><pubdate>2007</pubdate><url>http://www.cortindia.com/RP/RP-2007-0302.pdf</url></bibl><bibl id="B29"><title><p>Educational outreach to general practitioners reduces children's asthma symptoms: a cluster randomised controlled trial</p></title><aug><au><snm>Zwarenstein</snm><fnm>M</fnm></au><au><snm>Bheekie</snm><fnm>A</fnm></au><au><snm>Lombard</snm><fnm>C</fnm></au><au><snm>Swingler</snm><fnm>G</fnm></au><au><snm>Ehrlich</snm><fnm>R</fnm></au><au><snm>Eccles</snm><fnm>M</fnm></au><au><snm>Sladden</snm><fnm>M</fnm></au><au><snm>Pather</snm><fnm>S</fnm></au><au><snm>Grimshaw</snm><fnm>J</fnm></au><au><snm>Oxman</snm><fnm>AD</fnm></au></aug><source>Implement Sci</source><pubdate>2007</pubdate><volume>2</volume><fpage>30</fpage><xrefbib><pubidlist><pubid idtype="doi">10.1186/1748-5908-2-30</pubid><pubid idtype="pmcid">2200659</pubid><pubid idtype="pmpid" link="fulltext">17892588</pubid></pubidlist></xrefbib></bibl><bibl id="B30"><aug><au><snm>Pexton</snm><fnm>C</fnm></au></aug><source>Overcoming Organizational Barriers to Change in Healthcare</source><pubdate>2009</pubdate><url>http://www.ftpress.com/articles/article.aspx?p=1327759</url></bibl><bibl id="B31"><aug><au><snm>Iles</snm><fnm>V</fnm></au><au><snm>Sutherland</snm><fnm>K</fnm></au></aug><source>Organisational Change: A review for health care managers, professionals and researchers</source><publisher>London, National Co-ordinating Centre for NHS Service Delivery and Organisation R &amp; D</publisher><pubdate>2001</pubdate><url>http://www.sdo.nihr.ac.uk/files/adhoc/change-management-review.pdf</url></bibl><bibl id="B32"><title><p>Use of research to inform public policymaking</p></title><aug><au><snm>Lavis</snm><fnm>JN</fnm></au><au><snm>Posada</snm><fnm>FB</fnm></au><au><snm>Haines</snm><fnm>A</fnm></au><au><snm>Osei</snm><fnm>E</fnm></au></aug><source>Lancet</source><pubdate>2004</pubdate><volume>364</volume><fpage>1615</fpage><lpage>21</lpage><xrefbib><pubidlist><pubid idtype="doi">10.1016/S0140-6736(04)17317-0</pubid><pubid idtype="pmpid" link="fulltext">15519634</pubid></pubidlist></xrefbib></bibl><bibl id="B33"><title><p>Costs of scaling up health interventions: a systematic review</p></title><aug><au><snm>Johns</snm><fnm>B</fnm></au><au><snm>Torres</snm><fnm>TT</fnm></au></aug><source>Health Policy Plan</source><pubdate>2005</pubdate><volume>20</volume><fpage>1</fpage><lpage>13</lpage><xrefbib><pubidlist><pubid idtype="doi">10.1093/heapol/czi001</pubid><pubid idtype="pmpid" link="fulltext">15689425</pubid></pubidlist></xrefbib></bibl><bibl id="B34"><title><p>Sustainability science: an integrated approach for health-programme planning</p></title><aug><au><snm>Gruen</snm><fnm>RL</fnm></au><au><snm>Elliott</snm><fnm>JH</fnm></au><au><snm>Nolan</snm><fnm>ML</fnm></au><au><snm>Lawton</snm><fnm>PD</fnm></au><au><snm>Parkhill</snm><fnm>A</fnm></au><au><snm>McLaren</snm><fnm>CJ</fnm></au><au><snm>Lavis</snm><fnm>JN</fnm></au></aug><source>Lancet</source><pubdate>2008</pubdate><volume>372</volume><fpage>1579</fpage><lpage>89</lpage><xrefbib><pubidlist><pubid idtype="doi">10.1016/S0140-6736(08)61659-1</pubid><pubid idtype="pmpid" link="fulltext">18984192</pubid></pubidlist></xrefbib></bibl><bibl id="B35"><title><p>Examining the role of health services research in public policymaking</p></title><aug><au><snm>Lavis</snm><fnm>JN</fnm></au><au><snm>Ross</snm><fnm>SE</fnm></au><au><snm>Hurley</snm><fnm>JE</fnm></au><au><snm>Hohenadel</snm><fnm>JM</fnm></au><au><snm>Stoddart</snm><fnm>GL</fnm></au><au><snm>Woodward</snm><fnm>CA</fnm></au><au><snm>Abelson</snm><fnm>J</fnm></au></aug><source>Milbank Quarterly</source><pubdate>2002</pubdate><volume>80</volume><fpage>125</fpage><lpage>54</lpage><xrefbib><pubidlist><pubid idtype="doi">10.1111/1468-0009.00005</pubid><pubid idtype="pmpid" link="fulltext">11933791</pubid></pubidlist></xrefbib></bibl></refgrp>
   </bm>
</art>