Beyond Measures and Monitoring: Realizing the Potential of Feedback-Informed Treatment 

Written by: Jon Hook, PhD

Psychotherapy faces a critical and often unspoken crisis of effectiveness: despite decades of accumulated experience, advanced degrees, and the proliferation of specific treatment models, the data consistently shows that therapists do not actually get better at treating clients over time. In fact, without specific intervention, our outcomes stagnate or even decline as our careers progress. This is a profound issue for a field dedicated to growth and healing. We care about this because the current paradigm of training—focusing on the "medical model" of specific diagnoses and interventions—is failing to move the needle on client recovery. This journal club explores the 2015 article by Scott D. Miller, Mark Hubble, Daryl Chow, and Jason Seidel, "Beyond Measures and Monitoring," which argues that the key to improving therapy outcomes lies not in learning new models, but in rigorously measuring and improving the therapist's own contribution to the alliance through Feedback-Informed Treatment (FIT).

The Illusion of Effectiveness

Before we can improve, we must confront the gap between our perception and reality. Research by Walfish et al. (2012) reveals a startling "Lake Wobegon" effect in our field: the vast majority of therapists rate themselves in the 80th percentile of effectiveness, and zero percent rate themselves as below average. Furthermore, while we often estimate our success rates at 85% or higher, rigorous meta-analyses place the actual recovery rate closer to 60–70%. Even more concerning is our blindness to deterioration; while we believe less than 1% of our clients get worse, the data shows that 5–10% of adults (and up to 24% of adolescents) deteriorate while in care. Without objective measurement, we miss nearly 100% of these cases until the client drops out. This illusion of effectiveness prevents us from recognizing the need for change and improvement.

The "What" vs. The "How"

Miller and colleagues challenge us to shift our focus from the "ingredients" of therapy to the "process" of the therapist. We often operate under the assumption that the "cure" lies in matching the right specific treatment model (CBT, EMDR, DBT, etc.) to the specific diagnosis. However, Wampold and Imel’s (2015) meta-analytic reviews reveal that "specific ingredients"—the unique techniques of a model—account for approximately 1% of the variance in treatment outcomes. In stark contrast, "Therapist Effects" (the individual contribution of the clinician) account for 5–9% of the variance, and the Therapeutic Alliance accounts for another 8–10%. This means the "How"—the bond, the agreement on goals, and the therapist's ability to facilitate interpersonal skills—is significantly more powerful than the "What." To improve outcomes, we must stop obsessing over the 1% and start targeting the 13% variance controlled by the relationship and the therapist.

Feedback Informed Treatment (FIT) and Deliberate Practice

FIT is the proposed solution to this stagnation, but the authors warn against viewing it merely as a tool or a "GPS." While FIT systems (using measures like the Outcome Rating Scale and Session Rating Scale) act as an early warning system that can double effect sizes and cut dropout rates in half, measurement alone is insufficient. The article highlights a "decline effect" where monitoring outcomes without changing behavior results in no long-term improvement in therapist skills. The missing link is "Deliberate Practice."

Drawing from the science of expertise, the authors note that top-performing therapists (the top 25%) spend nearly three times as much time engaged in solitary, rigorous reflection on their work compared to average therapists. FIT provides the data necessary for this practice. By identifying specific deficits—such as an inability to form alliances with certain demographics or a failure to repair ruptures—therapists can engage in targeted practice to improve their baseline performance.

Conclusion

Ultimately, the path to superior clinical outcomes is not found in the accumulation of more workshops or certifications in new modalities. It is found in the humble, rigorous, and often uncomfortable process of measuring our actual impact and using that data to challenge our self-perception. Miller et al. demonstrate that we cannot improve what we do not measure, but measurement is only the first step. By moving our focus from the "ingredients" of therapy to the "process" of the therapist, and by utilizing feedback to drive deliberate practice, we can bridge the gap between being an average therapist and a superior one, ensuring that we are truly serving the clients who entrust us with their care.

References

Delgadillo, J., Deisenhofer, A.-K., Probst, T., Shimokawa, K., Lambert, M. J., & Kleinstäuber, M. (2022). Progress feedback narrows the gap between more and less effective therapists: A therapist effects meta-analysis of clinical trials. Journal of Consulting and Clinical Psychology, 90(7), 559–567. https://doi.org/10.1037/ccp0000747

de Jong, K., Conijn, J. M., Gallagher, R. A., Reshetnikov, P., Heijenbrok-Kal, M., & van Os, J. (2021). Using progress feedback to improve outcomes and reduce drop-out, treatment duration, and deterioration: A multilevel meta-analysis. Clinical Psychology Review, 85, 102002. https://doi.org/10.1016/j.cpr.2021.102002

Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61(2), 155–163. https://doi.org/10.1002/jclp.20108

Miller, S. D., Hubble, M. A., Chow, D., & Seidel, J. (2015). Beyond measures and monitoring: Realizing the potential of feedback-informed treatment. Psychotherapy, 52(4), 449–457. https://doi.org/10.1037/pst0000031

Walfish, S., McAlister, B., O’Donnell, P., & Lambert, M. J. (2012). An investigation of self-assessment bias in mental health providers. Psychological Reports, 110(2), 639–644. https://doi.org/10.2466/02.07.17.PR0.110.2.639-644

Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work (2nd ed.). Routledge.