Since joining, Clear Horizon earlier this year, I’ve really enjoyed engaging with clients on different ways to elicit and present program outcomes.  An interesting and compelling way to collect program outcomes is through personal stories of change using the Most Significant Change (MSC) technique . Globally, there is increasing interest and application of the MSC technique from a range of organisations and funders, who recognise the value of narrative-based outcomes. MSC is a relatively ver...
Recently Clear Horizon ran a Masterclass entitled “Organisational outcomes and meaningful measures”. This Masterclass arose from of our own organisational strategic planning sessions where it became apparent we need to consolidate our knowledge in this space. We are increasingly requested to provide monitoring and evaluation (M&E) support at an organisational level, rather than at the project or program level. This has presented both opportunities and challenges, as organisational M&E has di...

This slide show provides an overview of the SIPSI methodology as presented at the AES 2016 conference. It also provides a case study of how it was used in DFAT Indonesia. 

SIPSI technique.pdf

I have been involved in evaluation since the early 2000’s and understand that it has been a discipline that has always understood the complexity of the world in which programs are designed and implemented. In many cases evaluation (and here I am talking about the discipline of evaluation) has not been able to fully respond to the complexity of the so-called “wicked problems” as well as it might. I should clarify that it was not always a shortcoming of ‘evaluation’. Rather it was often the re...
Recently we have noticed a groundswell of interest in how to evaluate policy influence; a notoriously slippery thing to catch hold of. This is in part due to the multitude of forces that drive policy change but also because change usually happens over a long period with many different actors and interests. In addition, external ‘environmental’ factors such as unforeseen events often change the agenda, creating opportunities and risks for policy makers. How do we untangle this morass? This is...
Last week I presented a keynote at the  Australian Association for Environmental Education annual conference. The conference theme was “future making”. As a mega science fiction nerd, this got me excited and thinking about the future trends and innovations that are going to affect us as evaluators. In the short term I can see that other fields are going disrupt the space of evaluators in positive and interesting ways. Human-centred Design Human-centred Design is changing the way services are...
In this blog one of our Senior Consultants Stuart Raetz shares his experience of Summit Workshops. A ‘summit workshop’ is a workshop that Clear Horizon often runs at the end of a collaborative outcomes reporting (COR) evaluation. The summit is usually the grand finale to an evaluation, which may have run for months or even years. Recently I’ve run a few summits that have coincided with the end of a program.  When this happens summit workshops are a great opportunity for people to look back o...
Evidence-based mantra . The day kicked off with Kathryn Newcomer, President Elect of American Evaluation Association (AEA), who described the “evidence-based mantra” that has American decision-makers in its grips. Kathryn gave us a fascinating glimpse into how evidence does, and doesn’t, influence government policy in America. She painted a picture of a myriad of actors demanding and collecting evidence on impact - in particular ‘DEBIS’ – “demonstrated evidence-based intervention solutions”....
  A gap in policy evaluation . On day 2 of the conference, John Owen, our keynote speaker, gave us a comprehensive overview of the territory of evaluation thinking and practice in Australasia. He did some analysis of articles in the AES journal over the last few years and found some interesting things. The thing that stood out for me was that there was very little written on policy evaluation – it was mostly on program evaluation, and setting up evaluation systems. Fascinating given the impo...
Great first day at the AES conference in Perth and I am proud that Clear Horizon is sponsoring such a great event. A great start with a strong focus on Culture . Our very own Director, Carina Calzoni, opened the conference and handed over to Shaun Nannup for the welcome to country. Shaun described the landscapes of WA vividly and invited us to centre ourselves, then link arms and focus on the 10% of all the inputs from our senses that we actually take in. Following Shaun was a great keynote ...