Incomplete Story? How Theory of Change Can Fill Plot Holes

This session will occur virtually on Wednesday, May 31st at 10 AM EST (GMT -5).

This demonstration aims to find ways to work around an evaluation where data is limited to fill in plot holes. Using a ToC as a tool, participants will learn how to adapt the narrative through innovative data collection and reporting practices and negotiate with project owners. In doing so, participants will strengthen their ability to problem solve, effectively communicate, and accurately reflect the impact of a given project.

Oftentimes, evaluators are faced with the challenge of evaluating projects with an inadequate M&E strategy. Poor reporting practices, missing data, and ill-suited indicators foster a culture of misrepresenting project accomplishments. Failing to address these issues challenges the integrity of findings, the credentials of evaluators, and even the reputation of the funding organization.

How do we deal with the problem of missing or incomplete data? Theories of Change (ToC) provide a useful roadmap to help capture the full story – from the intent of projects to how change is expected to happen. It also helps to identify gaps in data collection and data availability to align with the needs of the evaluation. We think of these gaps as plot holes that must be addressed. This demonstration will lead participants through a hypothetical project where we explore how to: (A) identify when, where, and to what extent data is missing or unsuitable; (B) indicate what metrics or data are needed to conduct the evaluation; and (C) negotiate with project teams or project owners to understand gaps, fill plot holes, and tell the full story.