Blir musikkterapi-studien trukket tilbake?

En norsk musikkterapi-studie har blitt kritisert både nasjonalt og internasjonalt. Blir den trukket tilbake?

Den 8. mai publiserte jeg en analyse av artikkelen: “Kognitiv-atferdsterapi kombinert med musikkterapi for kronisk utmattelse etter Epstein-Barr-virusinfeksjon hos ungdom: en mulighetsstudie”.

Malik SAsprusten TTPedersen M, et al
Cognitive–behavioural therapy combined with music therapy for chronic fatigue following Epstein-Barr virus infection in adolescents: a feasibility study

Les analysen her: Kurere ME med musikk?

To dager senere publiserte Dagens Medisin min kronikk der jeg påpeker noen av problemene ved studien: ME-pasienter lider under forskning.

Den 12. mai svarte Vegard B. B. Wyller at: «Svertekampanjer styrker ikke pasientenes interesser».

En uke senere publiserte tidsskriftet BMJ Paediatrics Open, Michiel Tacks e-respons til artikkelen: Unøyaktighet ved rapportering av CEBA del II –  Inaccuracy in reporting CEBA part II

DrPH David Tuller og flere av kollegene hans har skrevet til BMJ med kritikk mot studien flere ganger. Les mer her: BMJ responds to appeals about Norways CBT/Music Therapy study.

For to uker siden sendte jeg inn en e-respons til artikkelen til BMJ. I dag har jeg blitt informert om at den ble avvist “fordi den var for lang og overlappet betydelig med e-responsen som allerede var på nettet.” BMJ informerer meg også om at:

Vi gjennomgår for øyeblikket den opprinnelige artikkelen i lys av bekymringene uttrykt i den publiserte e-responsen. Avgjørelsen ble tatt av sjefsredaktøren.

Dette er gode nyheter. Forhåpentligvis vil gjennomgangen bli gjort med et høyt nivå av forskningsintegritet. Og hvem vet; kanskje blir artikkelen trukket tilbake?

Også andre har kritisert artikkelen. Professor Ola D. Saugstad i et webinar 12. mai, se fra 28 minutter: https://www.facebook.com/watch/?v=557130228323478.

Seniorforsker Ph.D Sigmund Olafsen i Dagens Medisin 10. juni 2020: Utfordringene i ME-debatten

Vegard B. B. Wyller svarte på kritikken og kaller det «uredelig retorikk»: Feil om kognitiv atferdsterapi ved ME.

Forskning.no har skrevet en lengre artikkel om studien «Norske forskere testet musikkterapi mot kronisk utmattelse».

Her er min e-respons til artikkelen:

Switched outcome measures, cherry-picked results and unfounded conclusions

Nina E. Steinkopf, Former HSE- and Quality Director, now: ME-patient, June 22, 2020

The study results essentially disprove the authors’ own hypotheses about the benefits of cognitive and music therapy. The researchers have switched outcome measures, cherry-picked results and drawn unfounded conclusions that may cause patients being treated with inexpedient or potentially harmful treatments. This is yet another example of poor research that reflects the researchers pre-determined psychosomatic views rather than honest scientific investigation. ME-patients suffer.

Myalgic Encephalomyelitis (ME) has been classified as a neurological disease by WHO since 1969. In 2017 the US health authorities removed the advice about cognitive behavioral therapy and graded exercise therapy as treatment for ME. Every month, new research articles are published, consistently showing nonconformities in the immune system and in the energy production in ME-patients.

In this article, young people with chronic fatigue following an acute EBV infection were treated with a “recently developed mental training program”, with elements of cognitive therapy and music therapy. (1)

The study refers to the disease CFS/ME although only 14% of the participants in the intervention group met strict (Canadian) CFS / ME diagnostic criteria. Participants were adolescents between the ages of 12 and 20 with prolonged fatigue following an acute EBV infection. The level of function at baseline was 8 000 steps per day, close to twice the level of mild degree ME as described in the articles’ reference no. 34. (2)

Hypotheses

The study protocol hypothesizes that CFS / ME is a sustained arousal response, and that personality, emotions and psychological trauma contribute to disease development and maintenance. It is argued that cognitive behavioral therapy (CBT) and graded exercise therapy (GET) have a positive effect, and that no risk of side effects exists.

There is no basis in either research literature or in broad patient surveys for such claims. The authors refer to studies with major methodological weaknesses. Notably, in the PACE study, participants were defined as cured even though they had lower functional levels at the end of the study compared to baseline. The hypothesis was that ME patients have activity phobia, an hypothesis not supported by the results. (3)

In the FITNET study, the intervention had no long-term effect. The objective outcome measures which demonstrated no improvement were omitted in the article. (4)

In the SMILE study, no objective endpoints were used. It has a 3 000-word long correction due to violation of basic ethical and methodological principles. For example, half of the participants were registered retrospectively, and the endpoints were changed midway through the study. (5)

A Cochrane review has been revised several times and is now under a new, complete update. (6)

Health authorities, including the Norwegian Health Directorate and the Center for Disease Control in the US, state that Post Exertional Malaise (PEM) is a cardinal symptom of ME. The studies referred to above did not use diagnostic criteria sets with PEM as a mandatory symptom. Indeed, there are no studies showing that CBT, GET or similar interventions are effective in treating ME when using criteria with PEM as an inclusion criterion.

Intervention

The purpose of the Malik et al. study was to see whether a mental exercise program with elements from cognitive therapy and music therapy could improve the level of function. The training program has, according to the research protocol, many similarities with the pseudoscientific method Lightning Process.

Before the intervention, the participants and their parents were taught that personality, thoughts and feelings can influence the development of the disease. They were informed about the importance of motivation, and that an increasing effort was required in order to change the “situation” and their «negative illness behavior». This was substantiated by a testimony from a recovered person.

The «situation», which was chronic fatigue following an infection, is described by the research team as negative illness behavior, disease attribution, and «avoidance». The hypothesis is that this will contribute to maintaining the fatigue. The parents became involved as – according to the protocol – they can reinforce negative illness behavior and attribution, which in turn could have a negative impact on the prognosis of their child.

The therapy aimed to control negative thoughts and emotions that could hinder higher activity. Music was used to evoke good feelings. The therapy was individually tailored, and the therapists knew in advance the results of extensive psychological tests that had been taken six months earlier. During the program, the focus was shifted towards the personality of the children, the parents, and the family dynamics. Thus both participants and their parents were implicitly made co-responsible for the «situation», the outcome of the therapy and the study results.

Results

According to the protocol, the results of a number of biomarkers were to be reported. However, outcome measures have been switched. The study reports only one objective outcome measure: the number of steps per day. After 3 months, the intervention group experienced a significant decline of 11% or 23% (the latter decline when the “per protocol” method was used). Thus the mental training program provided no increase in measurable activity. On the contrary, the results showed a reduction in the objectively measured activity level. This surprised the researchers but did not seem to change their conclusion or in recommending the intervention and further studies. Rather, they speculate that the reduced level of function is due to the participants not being treated with even more therapy; with GET.

The article defines «healthy» as a certain drop in subjectively reported fatigue. The study concludes with 65% recovery in the intervention group after 15 months. The actual results show that 8 participants recovered – compared to 7 in the control group, but the share is higher due to high dropout rate in the intervention group. The definition of healthy is post-hoc, and this becomes the main selling point in the abstract.

Similar to the PACE study, this study invents – after the data are known – a new measure that fits their initial hypothesis, while the main and objective outcome measure shows the opposite result. Informed readers can make their own judgement on this research practice.

At the same time, participants in the intervention group became more depressed, more exhausted, had more pain and a decrease in the level of function, although the small number of participants make all differences statistically insignificant, with an exception for the reduction in steps after three months for the intervention group. These results are suppressed in the abstract and conclusion. Instead, the researchers cherry-pick one subjective outcome measure to oversell results. The only objective measure disproves their conclusion. Moreover, the study would have been more trustworthy if the results of biomarkers and clinical examinations at follow-up had been included – as promised in the research protocol.

The results must also be seen in the light of the fact that 38% of the participants in the intervention group withdrew from the study. The researchers claim the high dropout rate to be due to fear of school absenteeism. Other more self-critical but plausible reasons, for instance that some participants became unwell of the therapy, are not discussed.

As user representatives, the organization Recovery Norway was involved (again contrary to the research protocol, which states that the Norwegian ME-Association would be involved). The organization, whose representatives were involved in the design of the study, was formally established in January 2018. The study design dates back to June 2015. The organization was started by, amongst others, a group of Lightning Process instructors, and a major activity has been the marketing and lobbying for the method. Again, the user group was selectively picked to support the approach, with some retrospective justification.

The article is peer reviewed, but the review process seems not to provide the scientific confidence one expects from a good journal. The first reviewer is Maria Loades, a researcher who has the same approach to ME as the authors. The second review was by an IT researcher who had only read the abstract. Both stated that the researchers’ conclusions were exaggerated.

In conclusion, even with the many shortcomings, on balance the results of the study disprove the authors’ hypothesis. Normally one would expect scientists to look for alternative explanations. In this case, the researchers interpret them as positive and believe the study justifies a full-scale clinical trial.

Consequences

This study, authored by a well-regarded yet controversial research team in Norway, might be used as a basis for decision-making by the health and welfare authorities and be referred to as basis for recommending or even mandating cognitive treatments for ME. This can lead to patients being treated with inexpedient or potentially harmful treatments.

A thorough analysis of the article shows that the study is yet another example of poor research seeking to justify an outdated approach to ME. (7)

References:

  1. Malik S, Asprusten TT, Pedersen M, et al. Cognitive – behavioral therapy combined with music therapy for chronic fatigue following Epstein-Barr virus infection in adolescents: a feasibility study. BMJ Paediatrics Open 2020; 4: e000620. doi: 10.1136 / bmjpo-2019-000620
  2. Sulheim D, Fagermoen E, Winger A, et al. Disease mechanisms and clonidine treatment in adolescent chronic fatigue syndrome: a combined cross-sectional and randomized clinical trial. JAMA Pediatr. Published online February 3, 2014. doi:10.1001/jamapediatrics.2013.4647.
  3. Dougall D, Johnson A, Goldsmith K, Sharpe M, Angus B, Chalder T, White P. Adverse events and deterioration reported by participants in the PACE trial of therapies for chronic fatigue syndrome. J Psychosom Res. 2014 Jul;77(1):20-6.
  4. Nijhof SL, Bleijenberg G, Uiterwaal CS, et al. Effectiveness of internet-based cognitive behavioural treatment for adolescents with chronic fatigue syndrome (FITNET): a randomised controlled trial. Lancet 2012; 379: 1412-8.
  5. Crawley E, Mills N, Hollingworth W, Deans Z, Sterne JA, Donovan JL, Beasant L, Montgomery A. Comparing specialist medical care with specialist medical care plus the Lightning Process for chronic fatigue syndrome or myalgic encephalomyelitis (CFS/ME): study protocol for a randomised controlled trial (SMILE Trial). Trials. 2013 Dec 26;14:444.
  6. Larun L, Brurberg KG, Odgaard-Jensen J, et al. Exercise therapy for chronic fatigue syndrome. Cochrane Database Syst Rev 2016;2:CD003200.doi:10.1002/14651858.CD003200.pub4 pmid:http://www.ncbi.nlm.nih.gov/pubmed/26852189
  7. Cure ME with music? https://melivet.com/2020/05/08/kurere-me-med-musikk/

Conflict of Interest: None declared

————————-

Skrevet av Nina E. Steinkopf

Tidl. HMS- og Kvalitetsdirektør i internasjonal petroleumsvirksomhet, nå; ME-syk og skribent

 

Tilbaketråkk: Wyller er ingen ME-ekspert

6 tanker på “Blir musikkterapi-studien trukket tilbake?

  1. Denne studien er jo et svært merkelig produkt. Til og med folk som er godt over på den psykosomatiske siden innrømmer jo det.

    Her er noen av de mange problemene jeg ser ved denne studien:

    – Outcome swapping svekker studiens troverdighet

    – Det at biomarkørene som ble samlet inn ble «begravet», og ikke rapporteres virker svært lite tillitsvekkende. Spesielt siden dette ikke begrunnes.

    – Nedgradering fra «fully powered RCT» til «feasibility study». Har man beskrevet noe så viktig som type studie i studieprotokollen burde man holde seg til det og ikke forandre det underveis.

    – Peer Review hvor den ene ikke har lest forbi abstract, samt at dette slapp gjennom i journalen.

    – Intervensjonsgruppa gikk mindre 2000 skritt mindre enn kontrollgruppa uten at dette diskuteres skikkelig.

    – Det at over halvparten sa nei til intervensjonen i utgangspunktet og at så mange av de som faktisk var positive til intervensjonen endret mening underveis og trakk seg ut.

    – Post-exertional Malaise var i utgangspunktet ikke en utfallsvariabel, men ble lagt til retrospektivt. Dette presenteres også som et positivt utfall, men er ikke en gang statistisk signifikant.

    – Det at midler som er øremerket til ME-forskning ikke brukes på ME-syke, men ungdommer som føler seg utmattede etter kyssesyken, men ikke kan kvalifisere til ME-diagnose (8000 skritt i starten av studien samt vanlig oppmøte på skole høres svært usannsynlig ut ved skikkelig ME).

    – Det at «pasientorganisasjonen» (av friske mennesker) som er tilknyttet studien ikke var stiftet da studien startet.

    Kort oppsummert: Man trenger ikke være «ME-aktivist» for å være svært kritisk til denne studien. Man trenger bare være normalt oppegående og ha noen studiepoeng forskningsmetode i bagasjen, så ser man at dette er en studie som er så slurvete gjennomført at resultatene vanskelig kan tolkes som noe som helst. Håper helsemyndighetene får med seg dette, og at de ikke lar seg manipulere av medieoppslagene hvor Wyller og gjengen fremstiller seg selv som stakkars martyrer.

    Likt av 2 personer

  2. Tilbaketråkk: Norsk ME-forskning: Vegard Bruun Bratholm Wyller med tvilsom og kritikkverdig forskningspraksis – ToTo NeuroImmunologisk Kurativ Behandling

  3. Tilbaketråkk: Musikkterapi-studien er trukket tilbake | MElivet

  4. Tilbaketråkk: Musikkterapi-studien er trukket tilbake, endret og re-publisert: Resultatene er verre enn først rapportert. | MElivet

Legg igjen en kommentar

Dette nettstedet bruker Akismet for å redusere spam. Lær hvordan dine kommentardata behandles..