An encyclopedia entry that introduces evaluation as a discipline… evaluation
Category Archives: EPSE 591 Program Evaluation
EPSE 591 Readings
what is impact evaluation?
Thanks to google and a question raised in my program evaluation class, here are some short definitions and links to more elaboration. As I said in class, impacts sound like outcomes to me (perhaps longer term ones), but I see that the term is appropriated by the causation through experimentation evaluation crowd.
Impact evaluation assesses the changes that can be attributed to a particular intervention, such as a project, program or policy, both the intended ones, as well as ideally the unintended ones.
A type of outcome evaluation that focuses on the broad, long-term impacts or results of program activities. For example, an impact evaluation could show that a decrease in a community’s crime rate is the direct result of a program designed to provide community policing.
A form of outcome evaluation that assesses the net effect of a program by comparing program outcomes with an estimate of what would have happened in the absence of a program.
Sometimes associated with the establishment of causal attribution between a development Activity and immediate, intermediate or longer-term outcomes or results.
measures the programs causal effect on the outcomes it seeks to achieve. The specific technique for estimating impacts varies according to the setting but all methodologies center on ways of constructing a plausible comparison or control group to establish the counterfactual.
a scientifically rigorous methodology to establish a causal association between programs and what they aimed to achieve beyond the outcomes on individuals targeted by the program(s).
It is usually undertaken at the end of an intervention to determine overall achievements in relation to the stated objectives. It attempts to establish a cause and effect relationship to show the extent to which the intervention has resulted in changing the circumstances of the target beneficiaries.
A study of the attribution of changes in the outcome to the intervention. Impact evaluations have either an experimental or quasi-experimental design.
A Practical Guide for Engaging Stakeholders in Developing Evaluation Questions
This guide provides the reader with a five-step process for involving stakeholders in developing evaluation questions, and includes a set of four worksheets to facilitate this process. Good resource written by Hallie Preskill.
Download the Engaging Stakeholders Guide.
Paul Taylor, Normative Discourse
Taylor argues that normative discourse can be distinguished from “scientific, mathematical and historical discourse, and from any other ‘universe’ of discourse in which language is used for purposes other than making and justifying of evaluations and prescriptions.”
Chapter 1 The Process of Evaluation
Chapter 3 Justification of Value Judgements
Chapter 4 Value Systems and Points of View
Chapter 7 The Concept of Prescribing
Chapter 8 Prescribing and Evaluating
Chapter 10 Wittgenstein’s conception of language
Logic Models–learn the basics in 15 minutes!
Eric Greg of Usable Knowledge has created a tutorial that gives the basics of logic modelling in about 15 minutes. Naturally there is more to be learned, especially once you actually try to create a logic model but this will familiarize you with the terms, intents, and processes.