Download the full Evaluation Guide as a pdf documentMeasuring success
A fuller version of this model, showing possible indicators for the benefits of engagement is given in Annex 2, along with a model showing possible costs.
An alternative model, for use when there are clear targets, has been developed by Vivian Twyford in Australia for use with some of the International Association of Public Participation principles and values (see table on next page).
These two models provide a couple of examples of the types of indicators that can be used to measure the success of engagement exercises, depending on the objectives of the exercise.
It can be very useful to think about the indicators / success factors for engagement while refining the objectives of the engagement exercise overall. There is no point carefully deciding on objectives if there is no effective way of measuring whether they have been achieved.
- Success factors answer the question: how will we know if it is a success? It is a success if … Success factors are usually quite broad statements (e.g. the engagement reached a ‘broad range’ of people; engagement was effective).
- Indicators do the same thing, but are usually more specific and are essentially ‘headlines’ that illustrate the point – they are not comprehensive evidence that something has been achieved, they simply spotlight a specific aspect (e.g. people understood what was going on; people felt they influenced the final policy; policymakers felt the final policy was improved by the public input).
Indicators need to be meaningful (so those reading them will understand why they are important) and measurable (so data can be collected relatively easily). They may use qualitative data (e.g. from interviews with participants, decision-makers etc) and quantitative data (e.g. surveys, demographic analysis).
Vivian Twyford’s model of analysis (see table on next page) separates success measures and indicators, as well as offering targets.
Further examples of criteria are given in Annex 3, which contains a summary of the evaluation of the Your Health, Your Care, Your Say initiative.