Evaluation questions
Evaluation questions are the high-level questions that an evaluation is designed to answer. Evaluation is all about asking and answering questions that matter—about programs, processes, products, policies and initiatives. Evaluation questions are part of a simple logic: ask questions, get answers, take action based on the answers.
Evaluation questions should be developed and agreed on at the beginning of an evaluation (i.e., during planning), which makes it easier to decide what data to collect, how to analyze it, and how to report it. Try not to have too many evaluation questions (5-7 is usually enough).
Good evaluation questions:
Are broad, overarching questions
Can be answered (with data that can be collected)
Are developed as a team with stakeholders
Reflect diverse perspectives and experiences
Are aligned with goals and objectives
Focus the evaluation
Communicate to others what the evaluation will and will not address (i.e., scope)
Consider how results will feed into improving the program
Evaluation questions differ depending on the type of evaluation being done. Below are some examples of evaluation questions related to different evaluation goals.
Judgement of merit
(e.g., outcome evaluation)
How well did the program work?
Which groups of users benefited from the program?
What unintended outcomes were produced?
Learning
(e.g., process evaluation):
Is the program being implemented correctly?
Are the target audiences of the program being reached?
How satisfied are program users?
What are the strengths and weaknesses of the program?
How can positive impacts be increased?
How can costs be reduced?
Monitoring
Are results being produced as expected? What are the program participation and drop-out rates? Are the program outputs changing?
Accountability
Are funds being used properly?
Are goals and targets being met?
Are staff qualified?
Is the program following the approved plan?