Tuesday, April 12, 2022

Using theory of change to evaluate information literacy initiatives: workshop at #LILAC22

Yesterday Pam McKinney and I gave a workshop at the LILAC conference in Manchester, UK: Using theory of change to evaluate information literacy initiatives. We had 32 participants and it was wonderful seeing people's engagement in working on their own ideas during the major part of the session. We started with a very brief introduction to ToC and the slides are embedded below.

This is our abstract: "Theory of Change (ToC) is a participative approach to evaluating the impact of projects, programmes and initiatives. Librarians and information professionals engaged in change processes, development projects and research studies can use ToC to generate evaluation data and articulate the impact of their activities, working closely with stakeholders such as students, academic staff, teachers and other professionals. The ToC process generates new understandings of how and why project successes have been achieved, and can form the basis of justifications for current and future funding. ToC has been widely used to evaluate the success and impact of projects in a variety of sectors (often community and public sector initiatives), and in educational development (Hart, Dierks-O’Brien & Powell, 2009) including Information Literacy initiatives (McKinney, 2014; McKinney, Jones & Turkington, 2011). causal narrative between project activities and outcomes. A plan and evaluation framework is then developed from these indicators, and stakeholders design data collection instruments. Connell & Kubisch (1998) have identified that a good ToC should be plausible, doable and testable. In the version of the ToC process used in CILASS projects, stakeholders are asked to identify the drivers for change in the current situation; the longer term impact they envisage the project will have; the intermediate outcomes that the project is expected to achieve; activities that would need to be undertaken to achieve outcomes and enabling factors and resources required to support the project (Hart, Dierks-O’Brien & Powell, 2009). Stakeholders collaboratively design a Theory of Change poster that defines key project indicators and develops a causal narrative between project activities and outcomes. A plan and evaluation framework is then developed from these indicators, and stakeholders design data collection instruments. Connell & Kubisch (1998) have identified that a good ToC should be plausible, doable and testable."

 

No comments: