Overcoming existing evaluation cultures and processes

A post on evaluation and complexity on Rick Davies monitoring and evaluation news site has a link to a great powerpoint on evaluation and the science of complexity by Ben Ramalingam. Ben notes that for many organisations, evaluations are at the centre of a vicious circle that includes pressure to show results and impacts, and poor learning and accountability amongst others.

Further, Ben notes that “Evaluations are still largely focused on reports as opposed to changed behaviours, ways of thinking and attitudes”. This seems very true, and I am sure many of us would recollect knowing of reports that have been produced for the report’s sake, and not what is in it.

A nice slide from Ben Ramalingam's powerpoint


The image, taken from one of Ben’s slides, encapsulates well the idea that existing process and culture can overshadow the ability to undertake more effective evaluation.

In another post, Ben notes “Some of the issues for evaluation include the tension between learning and accountability, the limits of attribution, how evaluations are or are not used, equality and power, and ideological debates about methodologies, such as the dominance of randomised controlled trials (RCTs)……Although there is a wealth of evaluation methods in theory, in practice they are largely required to conform to scientific management principles……..In contrast, complexity theory (theories) talks about systems that are interconnected, driven by feedback, where the properties of the system are not predictable but emerge from the relationships within that system……..It may be that we need to stop focusing on projects, and look more broadly at the societies that we work in and across sectors and institutions rather than within them. Evaluations may need to be more centred on real-time learning and helping managers adapt what they do.”

This is what Show me the Change is about- discussing how as a community of practice we can overcome the real or imagined culture that can negatively impact on more novel, experimental, and altogether better evaluation practice and processes.

So if you are interested in evaluation, behaviour change and sustainability in a complex workd, take part in the conversations that matter, on 4-6 May in Melbourne.

Outside of IF 8
     
Tags: , ,
| March 29th, 2010 | Posted in Evaluation |

3 Responses to “Overcoming existing evaluation cultures and processes”

  1. Tweets that mention Show Me The Change » Blog Archive » Overcoming existing evaluation cultures and processes -- Topsy.com Says:

    [...] This post was mentioned on Twitter by Viv McWaters, ShowMeTheChange. ShowMeTheChange said: New Blog post: Overcoming existing evaluation cultures & processes http://bit.ly/9UY9he [...]

  2. Rosien Herweijer Says:

    While your event looks to evaluate behaviours, this blog and Ben’s presentation highlight how important behaviours of evaluators are.

    Surprisingly enough in development cooperation – a sector which has a long standing tradition of evaluation – there is little attention for the behaviours of evaluators, see also http://herweijer.wordpress.com/2010/03/30/learning-and-accountability/

    Ben’s presentation makes a strong case for looking at interconnected systems with properties that emerge from relationships within the systems. His argument is elegant and exiting, system theory and the complexity paradigm are very attractive however also quite abstract. The challenge is to embrace complexity as well as agency.

    For some interesting events connecting evaluation with complexity and behaviours check:

    http://www.cdi.wur.nl/UK/newsagenda/agenda/Improving_the_Quality_of_Evaluative_Practice_by_Embracing_Complexity.htm

    http://www.evaluators5-0.net/

  3. admin Says:

    Thanks Rosien, I think you’re right – there has been little attention given to the behaviour of the evaluators. Thanks for the links.
    Viv

Leave a Reply