What's one of the most common mistakes in planning an evaluation? Going straight to deciding data collection methods. Before you choose data collection methods, you need a good understanding of why the evaluation is being done.
Whether you are commissioning an evaluation, designing one or implementing one, having - and sharing - a very clear understanding of what is being evaluated is paramount.
How do we ensure we address all the important aspects of an evaluation when we're planning it? How do we manage to consider the different options without being overwhelmed?
Evaluation journals play an important role in documenting, developing, and sharing theory and practice.
Data analysis is sometimes the weak link in an evaluation plan. Answering key evaluation questions requires thoughtful analysis - and this needs appropriate tools.
One of the most effective ways of learning about the evaluation field is to attend a conference, present your work and interact with other professionals.
Global voluntary networks are complex beasts with dynamic and unpredictable actions and interactions. How can we evaluate the results of a network like this? Whose results are we even talking about?
How do we ensure our evaluations are conducted ethically? Where do we go for advice and guidance, especially when we don't have a formal process for ethical review?
Many organisations are having to find ways of doing more for less – including doing evaluation with fewer resources.
Many evaluations use a theory of change approach, which identifies how activities are understood to contribute to a series of outcomes and impacts. These can help guide data collection, analysis and reporting.
In Aoteoroa New Zealand the use of rubrics has been adopted across a number of institutions to help ensure there is transparent and clear assessment that respects and includes diverse lines of evidence in evaluation.
The term "rubric" is often used in education to refer to a systematic way of setting out the expectations for students in terms of what would constitute poor, good and excellent performance.
There is increasing recognition that a theory of change can be useful when planning an evaluation. A theory of change is an explanation of how activities are understood to contribute to a series of outcomes and impacts.
Evaluating projects which deal with sensitive issues, such as illegal practices, stigmatized practices, personal behaviour or traumatizing events, are very difficult to manage, as is collecting data on those issues.
There is increasing discussion about the potential relevance of ideas and methods for addressing complexity in evaluation. But what does this mean? And is it the same as addressing complication?
It is neither relevant nor useful to either only criticise randomised control trials (RCT) or treat them as the only choice for rigorous impact evaluation (IE).
