Doing the evaluation
How to do itCollecting data
Getting baseline, ongoing and/or data on completion of engagement process, through methods such as:
- desk research (e.g. reviewing all documentation produced by the programme);
- observation (e.g. attendance at workshops; listening in to online debates);
- interviews (e.g. with participants, consultant team, commissioners of the work);
- questionnaires to participants (e.g. by telephone or online);
- group working (e.g. group reflections on progress);
- online (e.g. feedback on progress through various online discussion groups).
You will need to work out when you should collect the data, for example:
- at the beginning of the process to benchmark
- at the end of each public event (if more than one)
- at the end of the whole process
- later … depending on the long term objectives of the exercise.
You will also need to decide who you want to collect data from. In a public engagement exercise you will generally want to get data from the following:
- the public participants
- the policy-makers who are being influenced by the process
- whoever commissioned the process
- whoever designed and implemented the process (could be different)
- facilitators.
And, finally, consider what data you want, which is likely to include:
- quantitative data i.e. actual statistics, or data that can be converted to statistics
- qualitative data on specific questions that can be analysed according to views on specific issues
- quotes
- specific examples to back up general points
- personal / organisational stories
- photos, charts, etc.