The M&E framework provides an easy-to-follow approach to monitor and evaluate your A&C strategy.
The five steps are:
- Implementation
- Partnership
- Reach
- Effectiveness
- Maintenance
From these five components, you can construct your own M&E framework that is appropriate to your strategy and plans. Select the approaches below that fit best with what you will be doing.
The framework can be applied at two levels:
- Individual level
– which focuses on individual stakeholders (decision-makers or target audience), their actions, attitudes, and concerns.
- Setting level
– which focuses on the environment individuals are in, where the project is being implemented, coalitions with different stakeholders, similar institutions, and organisations.
THE M&E FRAMEWORK IN FIVE STEPS
Implementation
Implementation refers to the complete instalment of the project according to the initial plans:
- Is the program being delivered as intended?
- Are we achieving the objectives?
Implementation
What to measure in the IMPLEMENTATION component?
WHAT TO MEASURE | INDICATORS: THE UNIT OF MEASUREMENT | EXAMPLE |
---|---|---|
Outreach: |
|
|
Advocating: Attempting to influence change by communicating with target audience: decision-makers, influencers. |
|
|
Partnership
Partnership checks up on the support and execution of activities from all partners involved in the strategy, and the influence the partnership is having.
- Have coalitions and/or partnerships been created to develop or advance the strategy?
- What influence is the partnership having with other organisations?
What to measure in the PARTNERSHIP component?
WHAT TO MEASURE | INDICATORS: THE UNIT OF MEASUREMENT | EXAMPLE |
---|---|---|
Partnerships, coalitions or alliances: |
|
|
New involved stakeholders: New organisations not formally in the partnership that have decided to support or adopt the issue. Funding support for the issue. |
|
|
Reach
Reach is a measure of refers to the number or percentage of the audience exposed to your strategy, such as messages, products and outreach efforts:
- What percentage of the target audience has been reached by the A&C strategy?
- To what extent are the messages reaching decision-makers?
- What percentage of the target audience is taking the issue into consideration?
What to measure in the REACH component?
WHAT TO MEASURE | INDICATORS: THE UNIT OF MEASUREMENT | EXAMPLE |
---|---|---|
Reach: |
|
|
Relevance: The importance target audience gives to the issue |
|
|
Effectiveness/Efficiency
- This component assesses the impact of your A&C strategy, both at the individual and setting levels.
At the individual level:
It can measure changes in attitudes, in knowledge levels and in the target audience’s understanding of and engagement with the issues and concerns.
At a setting level:
it can measure the process of change, such as:
- Are your target audiences aware of the issue you are advocating for?
- Have the target audiences changed their attitudes, knowledge or behavior after being exposed to your intervention?
- Are there policy changes underway or in the plans?
- Is there an increase in political commitment?
-
Quick tips
Remember to conduct a baseline assessment of your target audience BEFORE you start reaching out to your target audiences so you can return later and measure the Reach and Effectiveness of your efforts.
What to measure in the EFFECTIVENESS component?
WHAT TO MEASURE | INDICATORS: THE UNIT OF MEASUREMENT | EXAMPLE |
---|---|---|
Awareness: |
|
|
Attitudes: Target audience’s perceptions around the A&C issues. |
|
|
Impact: Changes (positive or negative) in participation and engagement with the issue. |
|
|
Political commitment: Willingness of decision-makers and/or target audiences to act in support of an issue. |
|
|
Goals/Results:
|
|
|
Maintenance
Maintenance is the measure that looks at both short- and long-term changes at both individual and setting level. It is crucial to keep a close look at this component and make sure that desired changes are sustained over time.
- Is there funding and resources to sustain the immunisation changes that have been implemented?
- Does your organisation and/or partnership have the resources and support needed to continue to implement the strategy?
What to measure in the MAINTENANCE component?
WHAT TO MEASURE | INDICATORS: THE UNIT OF MEASUREMENT | EXAMPLE |
---|---|---|
Policy maintenance: |
|
|
Organisational capacity: The ability of the advocacy partners to maintain the initial support of the issue. |
|
|
Funding for ongoing advocacy and support base growth: Sustainable funding and individuals who can be relied on for sustained advocacy on an issue. |
|
|
What M&E methods can I use to collect my data?
In the table below, you will find the most common data and evidence collection methods for monitoring and evaluation. Some are quantitative, meaning they measure or count things, others are qualitative, meaning they seek out people’s thoughts, opinions and views through interviews, statements or documents.
Depending on your resources and the results you want to achieve, you may use a single method or a combination of methods.
METHOD | DEFINITION | WHERE TO APPLY |
---|---|---|
Survey |
|
|
Document review (qualitative/quantitative) |
|
|
Case study (qualitative/quantitative) |
|
|
Observation (qualitative/quantitative) |
|
|
Interview and Focus group (qualitative) |
|
|