Brain tangled in measuring tape with a single plant growing upwards.

Rethinking Therapy: Are We Evaluating Mental Health Treatment the Right Way?

"Exploring ethical and scientific perspectives on psychotherapy evaluation to improve treatment outcomes."


Psychotherapy, in its myriad forms, is often a source of debate, torn between passionate advocacy and skeptical scrutiny. The pressure to demonstrate effectiveness comes from various sources, from individual needs to financial considerations. With hundreds of therapeutic approaches available, discussions arise about which methods work best and how we can scientifically evaluate them.

It's essential to consider both the therapeutic processes and their effects. Unfortunately, evaluations often rely on 'dominant' scientific criteria borrowed from different fields, which may not align with the unique nature of psychotherapy, particularly psychoanalysis. Therefore, we should debate and question assessment methods by examining their scientific basis and how well they match the subject of study.

Evaluation extends beyond numbers and metrics; it is integral to analysis and expectations in any therapeutic encounter. Whether seeking improvement, symptom reduction, or self-discovery, these goals involve both conscious and unconscious desires. The belief in a 'cure' reflects the method and technical approach rather than an ethical stance, encompassing functional and psychological dimensions. While direct symptom suppression may not be the goal, expecting improvement remains crucial.

AI Search Multiple angles on this topic

Tracking Mental Health and Treatment

The CDC’s National Center for Health Statistics provides topic-specific mental health statistics through its FastStats application. CDC’s Mental Health Data Channel presents state and nationally representative trends in youth and adult mental health over time across the United States. SAMHSA’s data also include diagnoses, treatment outcomes, demographics, and substance-use characteristics for people receiving services through state administrative data systems.

Evidence, Assessment, and Individual Needs

Evidence-based psychotherapy is presented as having important strengths, but also challenges and misconceptions that may discourage or limit its use. Mental health counseling standards emphasize assessment and evaluation as critical to effective counseling, making them central skills in professional education and practice. Recent work on psychotherapy argues that scientific methodology should be balanced with personalized care, while case-study methods offer distinctive strengths alongside areas for improvement.

From Early Methods to Client-Centered Care

Attempts to assess and treat mental distress existed before the development of modern scientific psychology, often dated to Wilhelm Wundt’s opening of the first psychological clinic in 1879. The history of psychotherapy has since become an object of dedicated historical research. A notable milestone came in 1942, when Carl Rogers published Counseling and Psychotherapy and proposed respect and a non-judgmental approach as foundations of effective treatment.

The Inserm Report: A Call for Rethinking Evaluation?

Brain tangled in measuring tape with a single plant growing upwards.

In France, the conversation surrounding psychotherapy evaluation often begins with a critical look at the Inserm report (2004). It questioned established methods and championed randomized controlled trials (RCTs). While generating considerable criticism, the report sparked important discussions about the scientific basis for evaluating different psychotherapeutic approaches.

Before dissecting a study's methodology, its objectives must be considered. The Inserm report reviewed existing scientific literature based on the medical model rather than conducting its own evaluative protocol or meta-analysis. Commissioned by the Ministry of Health as part of the Mental Health Plan of 2001, the expert group aimed to address the effectiveness of various psychotherapies through international research.

  • The expert group categorized 16 psychiatric disorders using the DSM (Diagnostic and Statistical Manual of Mental Disorders) to evaluate which therapies were most effective.
  • The group concluded that cognitive-behavioral therapy was 'established' for 15 disorders, family therapy for 5, and psychoanalysis for only 1.
  • This conclusion was based on studies using specific criteria for scientific evidence.
AI Search Multiple angles on this topic

Collaboration at the Center

Recent psychotherapy research is examining processes, outcomes, integration, and implementation in an effort to optimize evidence-based mental health care. Evidence across hundreds of studies indicates that psychotherapy as a highly collaborative treatment is robustly linked to psychotherapy outcomes. Current review work also includes mediators, moderators, and predictors of change in psychodynamic internet-delivered interventions.

When Therapy Has Negative Effects

Research on psychotherapy increasingly addresses the possibility that treatment can have negative effects, as well as the difficulty of interpreting those effects in context. A 2023 meta-analysis describes clients’ negative experiences as vast and heterogeneous and presents itself as the most comprehensive synthesis of those experiences to date. Other recent work examines how adverse experiences are conceptualized and assessed, while a systematic review and quantitative meta-analysis specifically investigates the relationship between self-criticism and psychotherapy outcomes.

Comparing Delivery and Explanatory Models

Comparative psychotherapy research includes studies of telehealth delivered by video, telephone, or both versus face-to-face treatment in primary health care settings. Other work reports mixed associations between social comparison and mental health: concurrent social comparison correlated with depressive symptoms, yet it predicted lower loneliness and anxiety two to three weeks later. A separate analysis argues for a holistic, psychosocial view of mental ill health rather than relying only on biomedical or alternative perspectives.

However, it's important to ask whether the scientific criteria used in these evaluations are appropriate for psychotherapy. Applying the medical model, which focuses on isolated variables and measurable outcomes, may overlook the complex interplay of human relationships central to psychotherapeutic work.

Beyond Numbers: Toward a More Holistic Evaluation

The pursuit of scientific rigor in psychotherapy evaluation has led to a focus on objective metrics and standardized methodologies. However, this approach risks overlooking the human element at the heart of therapeutic practice.

AI Search Multiple angles on this topic

Evidence and Therapist Expertise

A 2023 review included 102 meta-analyses and 650,514 patients and reported an advantage for psychotherapy and pharmacotherapy over control conditions in treating mental disorders in adults. Research on therapist expertise has examined whether psychotherapy outcomes can be predicted from therapists’ interpersonal skills, including through a five-year longitudinal study of a therapist assessment protocol. APA assessment guidelines likewise emphasize the core knowledge and skills psychologists should develop to deliver assessment services competently.

A More Responsive Future

Future evaluation may need to combine established outcome measures with closer attention to individual experience and context. It is reasonable to expect continued interest in collaborative, personalized, and digitally delivered care, but the available material here does not establish which approaches will prove most effective. Any forward-looking claims should therefore remain provisional until supported by comparative research.

Beyond Narrow Measures

Mental health treatment operates within scientific, clinical, social, and institutional contexts that may not be captured by a single outcome measure. The material suggests that assessment should account for individual needs, therapeutic relationships, adverse experiences, and broader psychosocial conditions. A broader evaluation framework may therefore be useful, although its practical design and effectiveness require further evidence.

From Research to Practice

Practice-research networks are being illustrated through four international case studies from the United States, the United Kingdom, and Norway. These cases present different models of how research and practice can function together in mental health. APA case examples show recommended depression interventions across the lifespan, including interpersonal psychotherapy for adults, behavioral therapy, and cognitive therapy.

A more comprehensive approach would acknowledge the subjective experiences of both therapist and patient, the nuances of the therapeutic relationship, and the broader contextual factors that influence treatment outcomes. It would seek to integrate quantitative data with qualitative insights, recognizing that numbers alone cannot capture the full complexity of the healing process.

Ultimately, rethinking psychotherapy evaluation requires a shift in perspective, one that values both scientific rigor and human understanding. By embracing a more holistic and nuanced approach, we can move closer to developing truly effective and ethical mental health treatments.

About this Article -

Written with AI assistance from published research, and reviewed by the Mystum team. See our About page for more information.

This article is based on research published under:

DOI-LINK: 10.1016/j.inan.2018.07.014, Alternate LINK

Title: Évaluation, Psychothérapies Et Psychanalyse : Réflexions Et Perspectives Éthiques, Épistémologiques Et Scientifiques

Subject: General Medicine

Journal: In Analysis

Publisher: Elsevier BV

Authors: A. Blanc

Published: 2018-09-01

Everything You Need To Know

1

Why is it so difficult to evaluate psychotherapy effectively?

Psychotherapy evaluation is complex because it involves both the therapeutic processes and their effects. Evaluations risk relying on scientific criteria borrowed from other fields, which may not align with psychotherapy's unique nature, especially psychoanalysis. A suitable assessment method should match the subject of study and consider the human relationships central to psychotherapeutic work, rather than solely focusing on isolated variables and measurable outcomes as in the medical model.

2

What is the Inserm report and what was its main objective?

The Inserm report questioned established methods and championed randomized controlled trials (RCTs). It reviewed existing scientific literature based on the medical model to address the effectiveness of various psychotherapies through international research. The expert group categorized 16 psychiatric disorders using the DSM (Diagnostic and Statistical Manual of Mental Disorders) to evaluate the therapies that were most effective.

3

What specific conclusions did the Inserm report make regarding different types of therapy?

According to the Inserm report, cognitive-behavioral therapy was 'established' for 15 disorders, family therapy for 5, and psychoanalysis for only 1. These conclusions were based on studies using specific criteria for scientific evidence. However, the appropriateness of these scientific criteria for psychotherapy remains a point of contention, as applying the medical model may overlook the complex interplay of human relationships central to psychotherapeutic work.

4

How does focusing solely on objective metrics potentially undermine the evaluation of psychotherapy?

While the pursuit of scientific rigor in psychotherapy evaluation has led to a focus on objective metrics and standardized methodologies, such as those used in randomized controlled trials (RCTs), this approach risks overlooking the human element at the heart of therapeutic practice. It's crucial to consider that evaluation extends beyond numbers and metrics; it is integral to analysis and expectations in any therapeutic encounter, encompassing both conscious and unconscious desires.

5

What role does the concept of a 'cure' play in psychotherapy, and how does it relate to evaluation methods like those discussed in the Inserm report?

The belief in a 'cure' in psychotherapy reflects the method and technical approach rather than an ethical stance, encompassing functional and psychological dimensions. While direct symptom suppression may not always be the goal, expecting improvement remains crucial. The Inserm report sparked important discussions about the scientific basis for evaluating different psychotherapeutic approaches, questioning whether the medical model and its focus on isolated variables are entirely appropriate for understanding the complexities of human relationships in therapy.

Newsletter Subscribe

Subscribe to get the latest articles and insights directly in your inbox.