Evaluate a model or a theory
Types of evaluation models
Are there several theories of change at play? Determine how much the theory of change is contested: Is it widely agreed to? Funnell, S. Each step in this process adds to the contribution claim and helps address the weaknesses identified at the previous step. There may also be interactions among the various program interventions, or between policies, which increase the challenge of evaluating such policies. They contribute greatly to effective managing for results Mayne As noted in A guide to developing departmental evaluation plans Treasury Board of Canada Secretariat, , departments can choose their units of evaluation based on configurations that allow them to both a undertake evaluations of reasonable units of effect that meet the information needs of evaluation users and b meet their legal and policy obligations.
The Truth of the Work: Theories of Change in a changing world. Similar to the policy and horizontal evaluation initiatives referred to above, these evaluations may benefit from developing both program-level and subprogram-level theories of change and testing these as part of the evaluation process.
They open the black box of the intervention, allowing evaluators to arrive at findings on why interventions are working or are not working. At this stage in the analysis, a theory of change for the intervention has been developed and the available evidence supporting the theory of change has been gathered.
Three evaluation models
This sometimes involves undertaking evaluations of multiple lowest-level elements of the Program Alignment Architecture PAA , usually at the subactivity or sub-subactivity level. Reporting on performance The theory of change provides a framework for the intervention, and collectively the department, to tell its performance story. ActKnowledge uses TOC as a foundation for organizational capacity building, clarifying goals, evaluation and organization change. For lower-risk interventions, the confidence level requirements are generally lower; accordingly, the scope of evidence and the depth of analysis required are generally lower. These include evaluating policies, horizontal initiatives, low-risk programs, grants and contributions, and cluster groupings of interventions. Practical suggestions are highlighted. Choosing from evaluation approaches can be an overwhelming process, but Evaluation Theory, Models, and Applications, Second Edition updates the core evaluation concepts with the latest research, making this complex field accessible in just one book. Each step in this process adds to the contribution claim and helps address the weaknesses identified at the previous step. The challenge to federal evaluators is to build a base of practical experience in using theory-based approaches.
Thus far in the evaluation process, no new data have been gathered. Hatry, H.
Horizontal initiatives have an additional challenge, in that their component interventions are being managed by different departments. The appendices contain more examples of documented theories of change and also guidelines and tools to support people working with theory of change.
The review report is structured around nine topics that were identified through scoping interviews with key DFID staff and partners.
Reconstructing program theories: Methods available and problems to be solved. For evaluation data, this would include developing common interview guides and data collection tools, as well as deciding what data should be collected for which context and for which external factors.
Who is the father of evaluation theory
An accompanying page presents a range of resource links on logic or outcomes modelling. Ling Eds. Developing and using a program theory matrix for program evaluation and performance monitoring. Evaluation Review, 21 4 , — Gather evidence on the identified external influences i. Much of the literature discusses this experience. The appendices contain more examples of documented theories of change and also guidelines and tools to support people working with theory of change.
This perspective becomes useful when the various program interventions use different policy mechanisms.
based on 44 review