Box 3.A1.2. Example: Canada and evaluation frameworks
An important element to include in an evaluation strategy is a draft evaluation
framework, as it outlines proposed evaluation questions and identifies the data required
to address these questions. The evaluation framework is an important preparatory tool in
the evaluation process because it allows the head of evaluation to give advance
consideration to the evaluation approach, to identify data requirements for the evaluation
and to determine how these requirements will be met. Additional data requirements
identified in the evaluation framework beyond the scope of those data already collected
may require adjustments or additions to the monitoring data being collected on the
programme. In some cases, the additional data required will be collected by evaluators as
part of the evaluation process.
The draft evaluation framework should include:
● initial evaluation questions covering the five core evaluation issues and other issues as
identified by the programme manager and others (e.g. the deputy head);
● indicators;
● data sources and methods of data collection (note that in some cases, the data source
may be the monitoring data collected on the programme as it is implemented);
● where applicable, information on what baseline data needs to be collected and timelines
for data collection; and
● where required, a description of simple adjustments that can be made to administrative
protocols and procedures (e.g. third-party reporting templates, financial record keeping)
by the programme area to ensure that the evaluation’s data requirements are met.
The head of evaluation should work with the programme manager to revisit and revise
(as required) the evaluation framework (e.g. on an annual basis) and to develop a final
evaluation framework at the start of the evaluation process.
Source: Supporting Effective Evaluations: a Guide to Developing Performance Measurement Strategies, available at:
www.tbs-sct.gc.ca/cee/dpms-esmr/dpms-esmr07-eng.asp