What is it: The checklist provides a common evaluation board, with a list of key aspected to be assessed that can be adapted and completed with specific information on each tool employed.
The information can be gathered mainly through semi-structured interviews but also surveys or other tools can be used depending on time and resources available. The main topics are related to: effectiveness, efficiency and resources, participation and collaboration, expectations and social learning / capabilities acquired, and relationship with other DIGNITY tasks.
When to use it: The tool is meant to be used after the application/implementation of the tools of Framing and Bridging phases.
Flexibility: As mentioned above, the collection of information can be done through different methods, which can be adapted to the time and resources available.

QUANTITATIVE AND QUALITATIVE

Time / Duration: LONG
This method should be carried out throughout the whole process, specifically during the framing and bridging phase. Therefore, the amount of time taken depends on the length of the overall process. It is based on the implementation of several in-depth interviews, mainly addressed to tools’ and pilots’ responsibles. The interviews might last approximately one hour.

Cost: Mainly personnel resources: needed to carry out the interviews,transcripts and data analysis.

Materials: In case of interviews, a template is commonly used (a battery of open questions is provided).

Expertise: Social scientists and/or experts of the different tools under assessment should collaborate in order to perform a more accurate analysis and data interpretation.

Stakeholders involved: This method is primarily addressed to the responsibles of the different tools and pilots.
It allows responsibles to express their personal vision and opinions on the process/results using their own perceptions and terminology.

Nº of participants: Overall, all involved tools and pilots responsibles should be interviewed.

Elaboration of a set of questions to be included in the checklist:

• Contact with the participants/interviewees.
• Application of the method (interview, survey), to collect perceptions and opinions.
• Transcription and analysis of data and elaboration of an evaluation report.

Main outcomes: It can be described as a learning and evaluation tool, which provides essential information on the degree of success of specific interventions. This is useful to gain a proper understanding to be used for future projects and for exchanging experiences and best practices. Moreover, the evaluation process also serves the purpose of encouraging upscaling and transferability of interventions, promoting positive results to relevant stakeholders.

Tips / Remarks / Suggestions: The tool is flexible and adaptable to the characteristics of the project and pilots involved, as well as time and resources available. Its correct application is key for the improvement of pilot experiences and for a proper transferability of the results.

Limitations of the method: The quality of the results depends on the correct implementation and analysis of the methods. The main limitation is its qualitative approach, which may represent a communication challenge in technological environments.