In the morning I'd awake and I couldn't remember
What is love and what is hate? - the calculations error
What is love and what is hate? - the calculations error
Flaming Lips (Morning of the Magicians)
Cognitive behaviour therapy for psychosis can be adapted for minority ethnic groups: A randomised controlled trial
Shanaya Rathod, Peter Phiri, Scott Harris, Charlotte Underwood, Mahesh Thagadur, Uma Padmanabi & David Kingdon
Recently I have commented on what I see as methodologically poor, biased and spun studies of CBT for psychosis - every time I want to blog on someting else, out comes another questionable study - this time 'in press' at Schizophrenia Research, which I think requires comment - in particular, the gap between the reality and presentation of findings
This is an RCT looking at the use of CBT in UK minority groups with a diagnosis of schizophrenia
A total, n = 33 participants, who were randomly allocated to CBT for psychosis (CBTp n = 16) and treatment as usual (TAU n = 17). Although a relatively small study, the authors did a power analysis based on previous pilot studies and suggest that a minimum of 12 per arm of the trial would be sufficiently powered - obviously they exceed this expectation.
Did the CBT group show any benefit (i.e. reduction of symptoms) over the TAU group?
Well, the authors say yes in the abstract:
Results: Post-treatment, the intervention group showed statistically significant reductions in symptomatology on overall CPRS scores, CaCBTp Mean (SD) = 16.23 (10.77), TAU = 18.60 (14.84); p = 0.047,with a difference in change of 11.31 (95% CI:0. 14 to 22.49); Schizophrenia change: CaCBTp = 3.46 (3.37); TAU = 4.78 (5.33) diff 4.62 (95% CI: 0.68 to 9.17); p = 0.047 and positive symptoms (delusions; p = 0.035, and hallucinations; p = 0.056). At 6 months follow-up, MADRAS change = 5.6 (95% CI: 2.92 to 7.60); p < 0.001. Adjustment was made for age, gender and antipsychotic medication.
Conclusion: Participants in the CaCBTp group achieved statistically significant results post-treatment compared to those in the TAU group with some gains maintained at follow-up. High levels of satisfaction with the CaCBTp were reported
Flaming Lips - In the Morning of the Magicians
The key aspect here though is the bolded statement, added casually at the end of the results about 'adjustment'. Table 1 from the paper presented below indicates (as the authors rightly admit) that the TAU group were older, had longer duration of illness and greater medication and they duly adjusted analyses for these variables
Table 2 Results
Maybe someone can explain to me, what is happening here? Is it blatant author spinning to get further funding (as they mention this in the discussion). Is it collusion from reviewers, who let this through? Failure to spot the obvious by reviewers?
Perhaps I am overly critical - letters on a postcard (in the comments section please)
wish you would post this stuff on Facebook too. Tx for all you do
ReplyDeleteThis comment has been removed by the author.
DeleteSo the Abstract is factually correct ... but like all effective advertising copy they simply delete the second half of the final sentence, allowing the reader to infer something that isn't actually stated. The full version of the final sentence should presumably be something like, "Adjustment was made for age, gender and antipsychotic medication which rendered all significant effects non-significant"
ReplyDeleteErrors of ommission and 'selight of hand' are amongst the most pernicious & possibly widespread of problems in psychology research.
DeleteThe problem here is that the authors make massive inferences - to quote:
"1. The current study can inform a fully-powered PHASE III trial."
-Perhaps.... that such a trial is not justified on basis of this study?
"2. An effective treatment based on cultural explanations will ensure better quality of care for this group of patients due to better
engagement and outcomes. Offering CaCBTp offers choice and an evidence based alternative or adjunct to psychotropic medication
(DoH:DRE, 2003; Inside Outside: Sashidharan, 2003)."
-CBT not shown to be an effective treatment in this group; and certainly no evidence-base here that it is an alternative (or adjunct) to psychotropic medication
"3. Implications for policy makers include the training of staff and dissemination of this therapy within resource constraints. Provision of
CBT is a cost effective way of managing patients with psychosis in the community as the relapse rate is found to be low (Turkington et al., 2006a,b)."
-massive extrapolations not based on anything here
"4. There are implications for further development of clinical or public health practice due to the role of this treatment in early intervention,
relapse prevention and effective community care."
- more massive extrapolation not based on this evidence
I'm also surprised that there is zero mention of the adjusted results in the paper, I checked it over multiple times just to make sure. Would love to know if I was missing something too. Also, this would be the near the best possible delivery conditions of this therapy since the authors created this particular version, so not showing an actual effect definitely raises serious obstacles to the implications they present.
ReplyDeleteNo JT - they dont mention the 16 nonsignificant adjusted score analyses at all in the discussion or the abstract
DeleteThe implications they draw are astounding in content
Unless some error has been made in the version that is posted on the 'Schizophrenia Research' website, then I really have to wonder what the reviewers/action editor were thinking when they let this one through as it is!
I heard from a source that these authors are alien lizards working for world domination.
ReplyDeleteAdjustment was made for the fact that the source was David Icke.
We may need a codebreaker for that one....What was your conclusion? Are they the CBT equivalents of the Royal family?
ReplyDelete