By Sarah Butler, Consultant

  • It was interesting to learn more about the application of randomised control trials. I have a better understanding of where they’re appropriate. At the same time, learning more about them reinforced the value of the type of work we do at Clear Horizon
  • I was interested in Bill Trochim’s concept of pieces of evidence (i.e. pieces of evidence used in a court room) versus a synthetic body of evidence. This has really changed my view of what evidence and evidence-based decision or policy making is really about
  • At Clear Horizon we work a lot with peoples’ anecdotes and/or narratives. On a personal level, i think there’s scope for me to strengthen this methodological preference by asking interviewees for evidence to triangulate their views, i.e. that as the evaluator you could chase-up after the interview
  • There was a lot of discussion around systematic reviews, especially in the context of evidence based decision making. Given the relatively standardised approach to the performance stories we’ve been undertaking for the Australian Government (and others), i think there’s opportunity to explore these types of approaches
  • I think there’s an opportunity to develop capacity in Concept Mapping - Bill Trochims computer-supported nominal group technique tool . perhaps we could become accredited practitioners?
  • PSRs could be really useful for large organisations such as CSIRO who are attempting to conduct systematic evaluation across their component businesses as well as flagship projects, which are like a large slice of investment
  • DPI is doing some interesting experimentation in the area of cost-benefit analysis - it’s an interesting pasture and i like the approach (collaborative, multi disciplinary team) they’re taking. For a methodology that results that people invest a lot of faith in, it’s incredibly fuzzy and arbitrary! As part of their work, DPI are also tackling the counterfactual. I’d like to learn more about how DPI are approaching it… a secondment??!! As DPI is an important client, i think it’s important to learn more about these approaches.