Thanks to our resident cartoonist Simon Kneebone who spent the first 2 days listening … and drawing … and sharing these cartoons with the world. If you use these cartoons for anything, please acknowledge the ’source’ and ‘Simon Kneebone’ 
To view and download individual cartoons, please visit the conference Flickr site here.
Show me the Change
Complexity and the Art of Evaluation – Reporting Sheet
Topic: Connecting Diverse Fields to the Practice of Evaluating Behaviour Change
Leader: Geoff Brown
Participants: Mark Boulet, Che Sutherland, Kirsty Fenton, Sue Lewis, Colin Hocking, Vera L
Key Points:
• Feel Blue – Touch Green (Dr. Mardie Townsend, La Trobe University)
• Greensteps Program deliberately sets out to recruit students from across various disciplines to educate for sustainability – because sustainability is much broader
• “Working across the disciplines is “Really HARD!!” – lots of struggles
• Key Question: “When is making connections across ‘diverse’ fields (eg, human health, global health) needed?”
• Some connections like people-health and sustainable transport
• What are key topics that bring us together across disciplines?
• Resilience and Adaptation
• General observation that links between healthcare and sustainability are present
• Health/Quit campaign network has a wealth of knowledge about people and behaviour change
• Concept of “Real Synthesis” is a mid-level theory that brings together connections between high-level theories and lower level insights into specific problem focussed studies (eg, well design evaluation of a program) – can result in a expert
• Observation that within the “Sustainability” field
• Barrier to collaboration between the different fields can be the difference in language and clinging to expertise in their field
• From Discipline to Discipline – we need to look for common ways in which we do our work (our tactics and approaches)
• Another thing that cuts across disciplines is the emotions that our target groups
SHOW ME THE CHANGE
Complexity and the Art of Evaluation – Reporting Sheet
Leader: Steton Kantmon
Participants: Amy O’Brien, Pam Beattie, Nicole, Kate Patken, Keren Winterford, Catherine Doran, Natalie Moxham, Jen Orange, Narelle Chambers, Liz Franzmaan, Rob Catchlove, Julie Richmond.
Key Points:
|
Drivers |
Barriers |
|
|
|
Learning |
|
One open space session was called to produce an inventory of evaluation tools in current practice. The two attached files are the results of that session. Both are in .pdf format.
There is general agreement that word of mouth marketing is a critical element of changing behaviour. Whether it is a family member, colleague, neighbour, or friend, we are more likely to take on the advice and behaviours that are modelled by those we trust. This is the basis of effective communication (think also of the 6 degrees of separation experiment). Mark Earls, the author of Herd: how to change mass behaviour by harnessing our true nature provides great examples of how social networks are key to changing mass behaviour.
Mark recently posted a blog about how important it is to understand social networks.
Mark notes: Social networks are not channels for advertisers or for the adverts/memes you, your clients or any of your so-called “influentials” create, social networks are for all of the people who participate in the network.
So if word of mouth is an element of your behaviour change program (as it should be), how can you track its spread, and find out whom the key people are in networks? Well, social network analysis is one way! So what is a social network analysis?
Andrew Rixon, from Babelfish Group, notes in an e-booklet on enhancing collaboration that Social Network Analysis is the technique of analysing roles and social networks…. The outcomes of social network analysis provides surprising and insightful results allowing structure(s) to become visible and discussable.
Making such networks visible should surely be one of the goals of evaluation. In this way, for those who have read Gladwell’s Tipping Point, you can find out who the mavens, connectors and salesmen are.
Interested in finding out more on Social Network Analysis?
Andrew Rixon will be holding a post-conference workshop on this very topic, so check out the program of post conference workshops and register online.
The conference has already attracted a great number of participants from a wide variety of backgrounds. And as this conference is not one where “experts” will be doing all the “talking to you”, the diversity of people will make for passionate and thought-provoking conversations.
If you have already registered, who else do you know who has something to share or someting to learn from this conference? Why not let them know that you’ll be there, and that you would value their participation and exchange of ideas. You can download a conference e-card from here, which you can use to email those whom you think should also attend.
Download the conference e-card
This phrase, from the original in French “plus ça change, plus c’est la même chose” is very pertinent in our quest to change behaviours.
In a WWF report, Crompton (2008: 5) states: “The results of experiments examining the ‘foot-in-the-door’ approach (the hope that individuals can be led up a virtuous ladder of ever more far-reaching behavioural changes) are fraught with contradictions”.
What does this mean in terms of evaluation? Well, for one, self-reporting of changes may lead to socially-desirable answers that overestimate the amount of actual change.
So how do we undertake better evaluations? Well, hopefully this will all be revealed in the conversations that take place at Show me the Change. Which leads me to the following…………
A recent post on Rick Davies Evaluation News Site on the Paris Declaration on aid effectiveness made me think about what we can collectively achieve from Show me the Change.
Based on the diversity of people attending I am sure that the conversations will be passionate and inspiring and the amount of knowledge exchange based on practical experiences will lead to better practices…. So how about working towards an Abbotsford Declaration on Behaviour Change Evaluation as a marker for this event, and as a building block for future behaviour change programs and their evaluation!
Show Me The Change is linked to a range of conferences in Australia and around the world. It seems like it is ‘the time’ for people to explore complexity and rethink the way we have been approaching behaviour change and it’s evaluation.
One such gathering is in Melbourne. Hosted by the folks at ALARA (Action Learning Action Research Association), this event is sure to attract people from our’s and visa-versa!
Ross Colliver was kind enough to provide some words to describe the conference …
Eighth ALARA World Congress 2010
Participatory Action Research and Action Learning
Appreciating our Pasts, Comprehending our Presents
Prefiguring our Futures
Eighth ALARA World Congress 2010 on Participatory Action Research and Action Learning, September 6-9th 2010, Melbourne, Australia. Plus two pre-congress skill-sharing days (4th-5th)
Meet people actively engaged in Action Research / Action Learning and its applied fields. Be stimulated by critical dialogues and reflections the the Praxis Streams of Social Ecology, Community Development, International Development, Health and Wellbeing, Systems /Business / Organisational Development, Education and Learning, and Decolonising Practice, including cross-cultural learning with Indigenous Peoples.
Meet practitioners of the ‘new’ generation. Talk and listen to ‘Elders’ who have contributed to the early growth periods of these methodologies and who continue to be initiators and innovators. Become part of local, regional and global networks practicing PAR /AR / AL.
Engage with like-minded people in conversations about philosophies underpinning action research, debate issues of power, deepen your understanding of methodologies. Brush up on the basics, gather materials, shared-knowledge and contacts to take Action Research / Action Learning with you into workplaces, associations, organisations and lives.
Ross Colliver
TTDG
0411 226519
Thanks to Glenn Elliot at LaTrobe Uni for sending me this link!
Here is a 10 minute, narrated slideshow that gets into the nitty-gritty detail of confidence stats, confidence intervals and p-values.
The thing to note here is the ‘key message’ – in the psychology field (and probably many others), decisions are often made about the ’success’ of research experiments based on a single number … the “P-Value”. This video highlights the randomness, variability and complexity of research.
It also uses a nice musical theme to reinforce it’s message. I wonder what numbers we get too focused on when running our behaviour change programs AND are they really measures of our success and brilliance … or are they simply an example of randomness and chance?
Yes, we are about to ‘go live’ with the full conference program, post conference workshops and an online system so you can book your place at Show Me The Change!
Conference Design Team & Steering Committee
