Implementation Is Key to Ensuring Research Benefits Communities
Global leader on why evidence is crucial to improving health, education, and well-being of families
Dr. Robyn Mildon leads the Centre for Evidence and Implementation (CEI), an international organization that works to advance the implementation of evidence in policy and practice. Based in Australia, CEI also has offices in Singapore, the United Kingdom, and Norway, with work spanning 18 countries.
Mildon has been a leading figure in translating complex scientific research into actionable practices in the real world. CEI’s work also tries to reduce the time between when discoveries are made and when governments or practitioners use them. Here, she shares how partnered research is key to shortening that time frame. CEI is Pew’s co-host for the Global Innovation Conference for Research, Policy, and Practice in Singapore in November.
This interview has been edited for clarity and length.
-
Tell us about a recent project or partnership that you’re proud of.
We’ve worked with the local government in Victoria, Australia, where we decreased the number of children removed from their homes and sent into the child welfare system. This was a statewide reform effort that CEI helped with, by developing the practice model, along with the coaching and implementation framework to scale it from 11 agencies in 2020 to 34 agencies statewide by 2022. We wanted to accelerate the use of evidence in what we know about early childhood interventions in Victoria faster than what we’ve been doing before.
We worked with direct service delivery providers so that they had the tools they needed to coach and train parents on issues like trauma psychoeducation or co-regulation skills.
And we’re seeing promising results: We found that there was an 18% reduction in the number of children entering care. That’s 229 children who were able to stay with their families.
-
When people hear the word “innovation,” they often think about new technologies or inventions. In your view, what are some ways that CEI has brought innovation into a project or partnership?
Innovation doesn’t always mean creating something new. It can also mean looking at something from a new perspective—for instance, leaning on the evidence we have and seeing how we can implement it better. We shouldn’t try to continually do something new because it produces research waste and it decreases sustainability. There is a staggering amount of commissioned research that is never used or doesn’t produce tangible benefits to the community. This happens because research is not published, it has design flaws, or it’s just unusable.
So encouraging partners and government entities to use the research that we have at our disposal—and not necessarily doing more commissioned work for the sake of it—is a huge innovation that we believe is important.
-
Let’s talk more about local context. Can you share examples of how that plays a role in your work?
We should continue to do the things that we know work and adapt them for a local context. What will work for New York City may not necessarily work for Kuala Lumpur.
For example, when it comes to mental health, specifically anxiety and depression, we know that there is strong evidence that even brief sessions in therapy can help. But in some specific regions and countries, there’s stigma around someone being able to say they feel sad or they feel anxious. That also translates to some providers or researchers not being able to find funding on the issue because of the stigma that exists.
But even in several other countries where we work, such as Australia and the U.S., we also see a gap between what the evidence says works and the mental health care that people receive.
The clear through line is that making effective care easy to reach and implement is important. For example, we need to put interventions or weave services into places where people already are, such as building mental health support in primary care visits. Telehealth, or other digital tools, are also good vehicles to deliver mental health services. The cost is lower, and the opportunity to reach more people is greater.
-
Around the world, researchers, funders, policymakers, and practitioners are grappling with issues such as artificial intelligence (AI), mis- and disinformation, and trust in science. How have these issues impacted the day-to-day work of CEI and your partners?
We do use AI in our day-to-day work, but there’s a human involved every step of the way. It’s important to be clear and transparent about that. If you do a side-by-side comparison though, AI can’t get what we do right on its own. For example, if you’re looking at what works for promoting executive functioning of kids in an early childhood setting, AI can’t come up with those solutions on its own.
-
Will AI help advance research and the work you’re doing?
My colleague Julian Elliott at the Future Evidence Foundation has insights. Research in the future will be faster, easier, and cheaper. We will likely have 10 times more research papers than we do today.
But there’s a question: Is this an equitable advancement? Some places still struggle with getting access to broadband internet, for instance. There’s also concern around research slop, or inaccuracies produced in studies from using AI irresponsibly.
So I’d stress that the rigor we bring to curating sound, usable data is critical right now. We also need to keep up with the pace of bringing evidence to decision-makers. AI can help, but the scientific community’s role in synthesizing evidence must keep up. And we must learn to scale and implement across different contexts more rapidly.
-
Looking ahead to the Global Innovation Conference for Research, Policy, and Practice this November, what conversations are you most excited to have with attendees, and what do you hope participants will take away from the conference?
I’m looking forward to learning more about the promising innovations happening in Southeast Asia, and meeting researchers, practitioners, and funders. During the previous conference in Cape Town, we had many conversations around parsing evidence and synthesizing it. This year, I’m excited that sections of the programming will talk about implementing the work. It’s often assumed that implementation is the easy thing when it’s arguably the hardest part.
What are the main ingredients of an intervention that people need to implement? How do you communicate that to the people on the ground? And how do you measure the success of those interventions properly? How do you apply that programming to this region so that it’s culturally appropriate?
I’m eager to have these conversations in Singapore.