Why It Matters
Workforce agencies can evaluate service delivery strategies, learn which strategies are effective for their service population, and use that knowledge to shape future funding opportunities. As agencies learn which strategies are effective, they can require or encourage providers to use those strategies. This approach can be useful in cases where programs are newer or where few evidence-based strategies exist.
An evaluation is simply a systematic process to measure and understand the demonstrable effect of an action. Evaluation can occur before program launch (formative or theory-based evaluation), as a mechanism to understand the needs of the individuals who will be impacted. It can also occur during the program’s delivery to inform continuous process improvement (process/implementation evaluation). Finally, it can take place at program completion to understand the degree to which the program has met its intended goals (outcome or impact evaluation).
Overview
Any evaluation will begin by determining your research questions. Research questions can address both how the work was carried out, to inform future process changes or new program design efforts, as well as what results were achieved. The stage of the work and the target research questions will directly inform the type of evaluation chosen.
Process
Was the intervention delivered as designed? Where there were deviations, what caused them?
What are the strengths and weaknesses of the process?
How accessible and accepted was the intervention approach?
Which aspects of the intervention were most used?
What considerations arose for organizational capacity, partnership or collaboration?
Outcomes and Goals
What are the long-term effects of the intervention, both intended and unintended?
What type of changes occurred in participant attitudes, beliefs, or knowledge as a result of their experience?
What type of changes occurred in participant behavior?
What was the cost relative to the benefits?
To what extent did the intervention meet or exceed the stated goals?
What external factors impacted the results for individuals?