Skip to content

http://miptoolkit.com/

Increase font size Decrease font size Default font size default color orange color green color
You are here: Home Modules Module 4: Monitor and Evaluate Develop a range of process and outcome indicators to evaluate your program
Develop a range of process and outcome indicators to evaluate your program Print E-mail
Module 4: Monitor and Evaluate

Ontario Public Health PractionersYou’ll need to develop markers to measure process and outcomes at the intervention’s different socio-ecological levels. These markers, usually called indicators, are either quantitative or qualitative signs of change. Go back to your framework and find indicators for each of its elements.Specify the type of each indicator — does it measure:

  • Impact
  • Outcome
  • Output
  • Structure
  • Process

As you define your indicators, state whether they’re qualitative or quantitative measures. Rank them according to importance, given the resources you have for monitoring and evaluating your program. For more information on indicators, refer to Example 22 - Process and outcome measures: MSCS project

Develop indicators for each socio-ecological system level

iStock_000004996421XSmallYou need to choose indicators for all the socio-ecological levels you’re aiming at. See Example 23 -Indicators at socio-ecological system levels: MSCS project

Identify indicators that measure synergies or successes at more than one level

  • Identify the synergies you anticipate from targeting more than one system level.
  • Identify process measures that capture synergies.

Identify the synergies anticipated as a result of targeting more than one system level

To measure synergy as an outcome, you may have to look at a combination of other indicators from more than one system level. It might be insufficient to only look at findings from one system level to identify if synergy occurred. In the example below, measuring increased level of satisfaction at the individual level would not have been sufficient to determine whether organizational barriers had been removed. Neither would an increase in service utilization measured at the organizational lavel. Analyzing findings from both levels together provided insights about the interventions that contributed to achieving the reduction of access barriers.

For more information on finding synergies refer to Example 25 - Finding synergies: MSCS project

Identify process measures for synergies

Process measures can be used to measure synergies as well. Planned shifts in values, culture or other norms often result from applying more than one intervention, aimed at different socio-ecological system levels, at the same time. You should select some process measures from your range of indicators to capture those shifts. Refer to Example 26 - Process measures: MSCS project.

Develop a range of incremental indicators

Develop some indicators for measuring incremental or sequential successes, for situation where successfully reaching one goal depends on success in an earlier step. Refer to Example 27 - Achievements at one system level depend on success at other system levels: MSCS project.

Develop flexible indicators

You may want to leave room to adjust your indicators if circumstances change. If your intervention is aimed at more than one group, find indicators that will show their uniqueness. Senior women with low literacy skills, for example, will need different outreach and educational activities from the general population, and the indicators should reflect that.

Develop indicators for longer-term changes

When you have indicators for impact, outcome, output, structure and process, you need to consider whether they are better for measuring long- or short-term changes. Review your indicators and decide whether they’re best for short or long-term outcomes. Be realistic. Can your long-term indicators be used to measure sustainability, as well? Refer to Example 28 - Sustainability: MSCS project

Last Updated on Sunday, 31 May 2009 17:59