Misplaced Pages

The PACE trial was a large and controversial trial which compared the effects of cognitive behavioural therapy (CBT), graded exercise therapy (GET), adaptive pacing therapy, and specialist medical care for people with myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS).

The investigators reported that both CBT and GET were “moderately” effective at treating ME/CFS. The results have been questioned due to methodological weaknesses in the study design. For instance, the definition of recovery was weakened after the data was collected, leading to a larger share of recovered participants. Analyses under the original protocol did not find significant effects. As of 2021, graded exercise therapy and cognitive behavioural therapy (intended as a treatment) are no longer recommended by the National Institute for Health and Care Excellence for people with ME/CFS.

Initial study and findings

The £5 million trial was funded by various branches of the UK government, including the Department for Work and Pensions. Notable authors include psychiatrists Michael Sharpe and Peter White, along with psychotherapist Trudie Chalder.

Study design

641 patients were selected and divided into four groups. The first group only received specialist medical care (SMC). The second group received SMC and cognitive behavioural therapy (CBT). The third group received SMC and graded exercise therapy (GET). The fourth group received SMC and adaptive pacing therapy (APT), not to be confused with pacing (a recommended management strategy for people with ME/CFS).

SMC consisted of specialists giving advice to patients, such as “to avoid extremes of activity and rest”, and the prescription of drugs to help manage symptoms. CBT was done on the basis of a theory that regards ME/CFS as being reversible and that “fear of engaging in activity” and “avoidance of activity” are linked and interact with physiological processes to perpetuate fatigue. APT consisted of telling patients not to do activity, if it increases their symptoms; however, patients were encouraged to increase activity if their symptoms were manageable. GET was done on the basis of theories that assumed that ME/CFS is perpetuated by reversible physiological changes of deconditioning and avoidance of activity.

Outcome measures were assessed at the beginning of the trial, and then at 12, 24, and 52 weeks. Subjective outcome measures included self-rated fatigue and physical functioning questionnaires. Objective outcome measures were a six-minute walking test, a fitness test, reception of benefits due to illness, and number of days out of work due to illness. Two and a half years later, there was another follow up using only subjective measures.

The study design had various strengths. The large sample size and randomised allocation of patients into groups of near equal size, increased the precision of findings and, therefore, the likelihood of finding statistically significant outcomes. Additionally the subjects received a substantial amount of therapy (GET or CBT), over an extended duration, which contributed increased precision in the findings.

Initial findings

The findings were published in 2011 and concluded GET and CBT were “moderately effective” treatments. 52 weeks after the beginning of the trial, self-reported fatigue scores were significantly lower and self-rated physical function scores significantly higher for the GET and CBT groups than for the SMC and APT groups. The average scores on a 6-minute walking distance test were higher for the GET group than for the other groups. However, the mean distance walked (334 metres) was still well below the mean for healthy elderly people (631 metres) and over 30% of patients in the GET group did not do the test at 52 weeks. The CBT group did not perform significantly differently from the SMC and APT groups on this measure. The results from a step fitness at 52 weeks test showed no significant differences in performance across groups.

A 2013 paper examined the proportion of patients who could be classified as “recovered” after the trial. A patient was considered recovered if they obtained a specified threshold score on the fatigue and physical function self-report scales, if they rated their health as "much better" or "very much better", and if they also failed to meet the authors' case definition of CFS. According to the primary measures of recovery reported in the paper, 22% recovered after CBT, 22% after GET, but only 8% after APT and 7% after SMC.

Although patients were selected based on the Oxford Criteria (which is much broader than modern definitions of ME/CFS, only requiring chronic fatigue as a symptom), subgroup analysis found equivalent results for patients meeting the Oxford criteria and London ME criteria or the 1994 CDC criteria.

A follow-up conducted 2.5 years after the commencement of the trial reported no significant differences between the various treatment groups on the primary self-report measures. That is, the treatment-specific effects evident at 52 weeks were no longer evident at 2.5 years.

Controversies and criticism

After being published, the trial generated considerable criticism and concerns which were voiced through letters to the editor, patient groups, and groups of researchers and healthcare professionals. Lancet Editor Richard Horton defended the trial, calling the critics "a fairly small, but highly organized, very vocal and very damaging group of individuals who have, I would say, actually hijacked this agenda and distorted the debate so that it actually harms the overwhelming majority of patients."

The study continued receiving criticism from within the scientific community. Ronald Davis of Stanford University wrote, "I'm shocked that the Lancet published it The PACE study has so many flaws and there are so many questions you'd want to ask about it that I don't understand how it got through any kind of peer review". In an analysis of the study's design, the mathematician Professor Rebecca Goldin wrote that "There were problems with the study on almost all levels the flaws in this design were enough to doom its results from the start."

Outcome switching

After the initial data was collected, the method for scoring the subjective primary outcome measures of patient reported physical functioning and patient reported fatigue was changed, i.e. it used a more sensitive measure of the same primary outcome. Outcome switching is a practice that can lead to bias and undermine reliability, as studies may cherry pick a statistically significant outcome. According to the authors, the switch was done in order to "improve the variance of the measure" and was “approved by the independent PACE Trial Steering Committee and Data Monitoring and Ethics Committee”. An analysis under the original protocol found no statistically significant difference in improvement rates. The improvement rates in the GET and CBT groups were around 20%, rather than the 60% reported with switched outcomes.

There was also a change in how recovery (a secondary outcome) was defined. One of the original requirements was that patients would need to score over 85 on a survey of physical functioning, indicative of what healthy working-age people score. This was changed to a score of over 60. This meant that some were above 60 on this metric at the start of the trial, as the criterion for entry was a score of under 65. However, no patients were counted as recovered at trial entry, as they also needed to not meet the Oxford, CDC or London criteria for ME/CFS any more, and rate their overall health as much or very much better in order to be classed as recovered. Recovery rates under the original protocol were much lower and no statistical difference was found between the groups.

Subjective primary outcome measures

There has been considerable criticism due to the original findings only being supported by subjective (participant reported) primary outcome measures. Professor Jonathan Edwards of University College London wrote that “ makes non-starter in the eyes of any physician or clinical pharmacologist familiar with problems of systematic bias in trial execution."

The authors responded that a number of objective measures were taken, and the GET group had significant improvement in the 6 minute walking time. However, this was the only statistically significant improvement in objective outcome measures. In a reanalysis of the data Wilshire et al. noted that over 30% of the GET group did not complete the walking test, and that the GET group only walked 10% farther than controls after a year of exercise therapy. The other objective outcome measures included a fitness test, employment, and reception of disability benefits. None of these measures yielded a statistically significant improvement. The authors replied that participants may have lost their job after becoming ill, and that getting better and getting a job are not the same. The authors said they chose patient-reported primary outcomes as they thought patients themselves were the best people to judge the state of their own health.

Possible placebo from patient newsletter

The patient newsletter given throughout the study subtly praised CBT, GET, and “activity management” by saying a government committee had approved them as treatments, while critiquing biomedical research in ME/CFS. This raised concerns of a possible placebo effect, especially given the subjective outcome measures.

The authors responded that the newsletter's mention of the NICE guidelines included all 3 treatments being compared in the trial. However, the newsletter did not include “adaptive pacing therapy”, it did include “activity management” of which adaptive pacing therapy might be classified as a subtype. David Tuller of University of California, Berkeley replied that trial participants would not necessarily be aware that the authors considered “adaptive pacing therapy” as a subtype of “activity management”. He also said that, even if all three treatments were included, the positive bias resulting from it will impact the reliability of the trial outcomes.

Alleged lack of informed consent

Multiple authors of the PACE trial noted potential conflicts of interest in their scientific publications, having worked for or received royalties from disability insurance companies who would benefit from there being a treatment for ME/CFS. These potential conflicts of interest, however, were not disclosed to trial participants. 42 scientists criticised this in an open letter saying it meant there was a lack of informed consent and breached the Helsinki Protocol.

Request for data and allegations of harassment

The full research data for the PACE trial was requested by both patients acting as citizen scientists, and by other researchers, in order to verify the results through reanalyses. However, the request was initially denied and several of the researchers involved in the PACE trial, reported to the press that they had been verbally abused by patients. This was criticised by patients and advocates as being a coordinated effort to dismiss legitimate concerns about the methodology behind psychosocial studies into ME. However, these allegations continued to gain traction, and some of the authors began saying they were harassed on Twitter (now X).

The argument that ME/CFS patients and their organisations were militant and using methods of harassment was used by the authors to argue against a release of the trial's data. The Information Commissioner dismissed these claims as "wild speculations" and the tribunal found them to be “grossly exaggerated”. The judge subsequently ordered a release of the data.

Reanalysis

After the data was made public, several researchers published a reanalysis of the PACE trial data, but drawing the conclusion that the CBT and GET treatments were not effective and possibly not safe. The full PACE trial data showed that the treatments did not result in patients being able to return to work or study, and that they were not able to walk significantly further after treatment.

The reanalysis using the original primary outcome measures still showed there was a small improvement in one of the two subjective measures at 52 weeks for the GET and CBT groups. However, this difference was not sustained in the long-term follow-up. The GET group experienced twice the rate of adverse outcomes compared to controls, hence the conclusion that the treatment may be unsafe.

Health Research Authority inquiry

The UK Health Research Authority began an inquiry into the PACE trial in 2018, in response to questions from MP Carol Monaghan. The inquiry looked into conflicts of interest, making data publicly available to other researchers, and whether changing the outcome measures was appropriate. The HRA published its findings in January 2019, and found that the PACE trial exceeded transparency expectations, and there were no regulatory concerns regarding the conduct of the trial. They note that some of the other criticisms of the trial that were brought to their attention are outside their remit, so they are unable to comment on them.

Legacy and influence

The PACE trial was a major piece of evidence used by influential health authorities to recommend cognitive behavioural therapy and graded exercise therapy for people with ME/CFS, such as the CDC (US) and NICE (UK). After many years of controversy and criticism of the trial, the CDC (in 2017), then NICE (in 2021) stopped recommending graded exercise therapy and cognitive behavioural therapy (as a treatment). As of 2024, the Cochrane guidelines conclude that GET likely reduces fatigue for those diagnosed under older criteria sets, partially based on evidence from the PACE trial.

References

1. ^ White PD, Goldsmith KA, Johnson AL, Potts L, Walwyn R, DeCesare JC, Baber HL, Burgess M, Clark LV, Cox DL, Bavinton J, Angus BJ, Murphy G, Murphy M, O'Dowd H, Wilks D, McCrone P, Chalder T, Sharpe M (March 2011). "Comparison of adaptive pacing therapy, cognitive behaviour therapy, graded exercise therapy, and specialist medical care for chronic fatigue syndrome (PACE): a randomised trial". Lancet. 377 (9768): 823–36. doi:10.1016/S0140-6736(11)60096-2. PMC 3065633. PMID 21334061.
2. ^ Wilshire CE, Kindlon T, Courtney R, Matthees A, Tuller D, Geraghty K, Levin B (March 2018). "Rethinking the treatment of chronic fatigue syndrome-a reanalysis and evaluation of findings from a recent major trial of graded exercise and CBT". BMC Psychology. 6 (1): 6. doi:10.1186/s40359-018-0218-3. PMC 5863477. PMID 29562932.
3. ^ "An open letter to Dr. Richard Horton and The Lancet". www.virology.ws. 13 November 2015. Archived from the original on 20 April 2016. Retrieved 2016-05-02.
4. ^ Vink, Mark; Vink-Niese, Alexandra (2022-05-12). "The Updated NICE Guidance Exposed the Serious Flaws in CBT and Graded Exercise Therapy Trials for ME/CFS". Healthcare. 10 (5): 898. doi:10.3390/healthcare10050898. ISSN 2227-9032. PMC 9141828. PMID 35628033.
5. ^ White, Peter D.; Chalder, Trudie; Sharpe, Michael (February 2015). "The planning, implementation and publication of a complex intervention trial for chronic fatigue syndrome: the PACE trial". BJPsych Bulletin. 39 (1): 24–27. doi:10.1192/pb.bp.113.045005. ISSN 2056-4694. PMC 4495840. PMID 26191420.
6. Torjesen, Ingrid (2018-08-22). "Pressure grows on Lancet to review "flawed" PACE trial". BMJ. 362: k3621. doi:10.1136/bmj.k3621. ISSN 0959-8138. PMID 30135174.
7. White, Peter D.; Sharpe, Michael C.; Chalder, Trudie; DeCesare, Julia C.; Walwyn, Rebecca; the PACE trial group (2007-03-08). "Protocol for the PACE trial: A randomised controlled trial of adaptive pacing, cognitive behaviour therapy, and graded exercise as supplements to standardised specialist medical care versus standardised specialist medical care alone for patients with the chronic fatigue syndrome/myalgic encephalomyelitis or encephalopathy". BMC Neurology. 7 (1): 6. doi:10.1186/1471-2377-7-6. ISSN 1471-2377. PMC 2147058. PMID 17397525.
8. ^ Sharpe M, Goldsmith KA, Johnson AL, Chalder T, Walker J, White PD (December 2015). "Rehabilitative treatments for chronic fatigue syndrome: long-term follow-up from the PACE trial" (PDF). The Lancet. Psychiatry. 2 (12): 1067–74. doi:10.1016/S2215-0366(15)00317-X. PMID 26521770.
9. Vink, Mark (January 2017). "Assessment of Individual PACE Trial Data: in Myalgic Encephalomyelitis/Chronic Fatigue Syndrome, Cognitive Behavioral and Graded Exercise Therapy are Ineffective, Do Not Lead to Actual Recovery and Negative Outcomes may be Higher than Reported". J Neurol Neurobiol. 3 (1): 5 – via ResearchGate.
10. Kewley AJ (May 2011). "The PACE trial in chronic fatigue syndrome". Lancet. 377 (9780): 1832, author reply 1834–35. doi:10.1016/S0140-6736(11)60681-8. PMID 21592552.
11. Chalder T, Goldsmith KA, White PD, Sharpe M, Pickles AR (February 2015). "Rehabilitative therapies for chronic fatigue syndrome: a secondary mediation analysis of the PACE trial". The Lancet. Psychiatry. 2 (2): 141–52. doi:10.1016/S2215-0366(14)00069-8. PMID 26359750.
12. ^ White PD, Goldsmith K, Johnson AL, Chalder T, Sharpe M (October 2013). "Recovery from chronic fatigue syndrome after treatments given in the PACE trial". Psychological Medicine. 43 (10): 2227–35. doi:10.1017/S0033291713000020. PMC 3776285. PMID 23363640.
13. "IACFS/ME Statement on the PACE Trial: The Issue of Illness 'Reversal'". The International Association for Chronic Fatigue Syndrome/ME (IACFS/ME). 24 February 2011. Archived from the original on 18 July 2011. Retrieved 2011-08-03.
14. "PACE: 'surprising and disappointing'". Action for ME. 18 February 2011. Archived from the original on 25 February 2011. Retrieved 3 August 2011.
15. Britton, Tony (18 February 2011). "ME Association press statement about the results of the PACE study". ME Association. Archived from the original on 27 July 2011. Retrieved 3 August 2011.
16. McCleary, Kimberly. "Falling off the PACE" (PDF). The CAA (CFIDS) Association of America. Archived from the original (PDF) on 25 June 2011. Retrieved 26 July 2011.
17. White, P. D.; Goldsmith, K.; Johnson, A. L.; Chalder, T.; Sharpe, M. (August 2013). "Letter to the Editor: Response to correspondence concerning 'Recovery from chronic fatigue syndrome after treatments in the PACE trial'". Psychological Medicine. 43 (8): 1791–1792. doi:10.1017/S0033291713001311. ISSN 0033-2917. PMID 23866117.
18. "Comparison of treatments for chronic fatigue syndrome - the PACE trial". ABC Radio National. 2011-04-15. Archived from the original on 12 December 2019. Retrieved 2020-05-24.
19. Rehmeyer, Julie (13 November 2015). "The Debate Over Chronic Fatigue Syndrome Is Suddenly Shifting". Slate Magazine. Archived from the original on 15 August 2019. Retrieved 24 May 2020.
20. #MEAction (2015-10-24). "Investigative Journalist Exposes PACE Trial". #MEAction Network. Retrieved 2024-05-05.
21. Goldin, Rebecca (21 March 2016). "PACE: The research that sparked a patient rebellion and challenged medicine". Sense About Statistics. Archived from the original on 21 December 2016.
22. Altman DG, Moher D, Schulz KF (February 2017). "Harms of outcome switching in reports of randomised trials: CONSORT perspective". BMJ (Clinical Research Ed.). 356: j396. doi:10.1136/bmj.j396. PMID 28196813. S2CID 206916748.
23. ^ Racaniello, Vincent (2015-10-30). "PACE trial investigators respond to David Tuller | Virology Blog". Retrieved 2024-04-27.
24. ^ Geraghty, Keith J (2017). "Further commentary on the PACE trial: Biased methods and unreliable outcomes". Journal of Health Psychology. 22 (9): 1209–1216. doi:10.1177/1359105317714486. ISSN 1359-1053. PMID 28805517.
25. ^ Racaniello, Vincent (2016-02-10). "An open letter to The Lancet, again | Virology Blog". Retrieved 2024-04-27.
26. Edwards J (August 2017). "PACE team response shows a disregard for the principles of science". Journal of Health Psychology. 22 (9): 1155–1158. doi:10.1177/1359105317700886. PMID 28805520.
27. ^ Coyne, James (October 29, 2015), Uninterpretable: Fatal flaws in PACE Chronic Fatigue Syndrome follow-up study, PLoS One Blog, archived from the original on May 6, 2016
28. ^ PACE Trial Management Group(December 2008), PACE trial participants' newsletter #3, https://www.qmul.ac.uk/wiph/media/the-wolfson-institute-of-population-health-wiph/documents/participantsnewsletter3.pdf, access-date 27-04-2024
29. Tuller, David (2015-10-30). "David Tuller responds to the PACE investigators | Virology Blog". Retrieved 2024-05-05.
30. ^ Blease C, Geraghty KJ (September 2018). "Are ME/CFS Patient Organizations "Militant"? : Patient Protest in a Medical Controversy". Journal of Bioethical Inquiry. 15 (3): 393–401. doi:10.1007/s11673-018-9866-5. PMID 29971693. S2CID 49677273.
31. Hawkes N (June 2011). "Dangers of research into chronic fatigue syndrome". BMJ. 342: d3780. doi:10.1136/bmj.d3780. PMID 21697226. S2CID 27301336.
32. Tuller D (2016-02-01). "Trial By Error, Continued: A Few Words About Harassment | Virology Blog". Retrieved 2024-04-15.
33. Monbiot, George (2024-03-12). "'You don't want to get better': the outdated treatment of ME/CFS patients is a national scandal". The Guardian. ISSN 0261-3077. Retrieved 2024-04-30.
34. Kelland, Katie (2019-03-13). "Online activists are silencing us, scientists say". Reuters. Retrieved 2024-04-30.
35. "TRIBUNAL ORDERS RELEASE OF WITHHELD DATA FROM CONTROVERSIAL £5 MILLION CHRONIC FATIGUE SYNDROME STUDY" (PDF). ME Action Press Release. 2016-08-16. pp. 1–2. Retrieved 2024-05-01.
36. Vink M (August 2017). "PACE trial authors continue to ignore their own null effect". Journal of Health Psychology. 22 (9): 1134–1140. doi:10.1177/1359105317703785. PMID 28805519. S2CID 206713549.
37. Vink M, Vink-Niese A (2018-10-08). "Graded exercise therapy for myalgic encephalomyelitis/chronic fatigue syndrome is not effective and unsafe. Re-analysis of a Cochrane review". Health Psychology Open. 5 (2): 2055102918805187. doi:10.1177/2055102918805187. PMC 6176540. PMID 30305916.
38. Twisk FN, Maes M (2009). "A review on cognitive behavorial therapy (CBT) and graded exercise therapy (GET) in myalgic encephalomyelitis (ME) / chronic fatigue syndrome (CFS): CBT/GET is not only ineffective and not evidence-based, but also potentially harmful for many patients with ME/CFS". Neuro Endocrinology Letters. 30 (3): 284–99. PMID 19855350.
39. Vink M, Vink-Niese F (September 2019). "Work Rehabilitation and Medical Retirement for Myalgic Encephalomyelitis/Chronic Fatigue Syndrome Patients. A Review and Appraisal of Diagnostic Strategies". Diagnostics. 9 (4): 124. doi:10.3390/diagnostics9040124. PMC 6963831. PMID 31547009.
40. Hawkes, Nigel (7 February 2019). "PACE chronic fatigue trial was properly conducted, says UK research watchdog". BMJ. 364: l639. doi:10.1136/bmj.l639. PMID 30733199.
41. NICE guideline committee (February 2014), NICE guidelines (CG53) - Chronic fatigue syndrome / myalgic encephalomyelitis (or encephalopathy): review decision
42. ^ Tuller, David (2017-07-10). "Trial By Error: The CDC Drops CBT/GET | Virology Blog". Retrieved 2024-04-30.
43. Larun, Lillebeth; Brurberg, Kjetil G; Odgaard-Jensen, Jan; Price, Jonathan R (2019-10-02). Cochrane Common Mental Disorders Group (ed.). "Exercise therapy for chronic fatigue syndrome". Cochrane Database of Systematic Reviews. 2021 (3): CD003200. doi:10.1002/14651858.CD003200.pub8. PMC 6953363. PMID 31577366.

• Clinical trials