Speaking for the motion was Hideyuki Sakurai from the University of Tsukuba's Proton Medical Research Center (PRMC) in Japan, a site that has performed around 3000 proton beam treatments to date. Sakurai remains firmly convinced that there is no need for randomized trials of proton versus photon therapy. "We are conducting six phase II trials at PMRC – but there are no randomized phase III trials in our institute," he said, before listing a number of reasons as to why this is the case.
First up: the ethical considerations. Can the patient accept the results of a coin flip? Sakurai explained that the two arms in a randomized trial need to be substantially equivalent from the patient's view. But while biological processes are fraught with uncertainty, physics is different, he said, explaining that protons are known to deliver less dose to normal tissue than photons. "This is the first doubt for comparing protons versus X-rays," he said. "The physics is well known before the clinical trials."
Other issues to consider include cost, lack of resources (few particle therapy centres per population) and time requirements for randomized trials. For example, health insurance in Japan covers radiotherapy but not particle therapy. So who pays the treatment fees for the patients randomized to receive protons? For rapid progression of proton therapy, Sakurai proposes non-randomized phase I and II studies instead.
Sakurai then looked at the appropriateness of randomized clinical trials for some specific disease examples. For paediatric cancers, the case is pretty much closed. With the absolute indications for proton therapy in such cases, randomized comparisons with photon radiotherapy are not just unnecessary, but unethical, he told the ESTRO delegates.
Likewise, for hepatocellular carcinoma (HCC), physics studies suggest that proton therapy can save more liver function than photon radiotherapy. Sakurai proposed that randomized trials for HCC should examine proton therapy versus radiofrequency ablation (for small tumours) or surgery (for large tumours), but not compare photons with protons.
In some cases, such as localized prostate cancer and early stage lung cancer, there are no clear advantages of proton therapy over advanced radiotherapy modalities. Intensity-modulated radiotherapy (IMRT) offers high local control and a low incidence of side-effects for treating localized prostate cancer, while stereotactic body radiation therapy offers similar performance for early stage lung cancer.
Sakurai noted that one would expect good results from both arms in randomized trials for these diseases. Such trials could really only prove that expensive proton therapy is non-inferior to lower-cost X-ray treatments.
Sakurai wrapped up by noting that with increasing physics-based (dosimetric) evidence of proton therapy's superiority, and increasing clinical evidence from non-randomized studies, the fact that there's no evidence from randomized trials is not a reason for denial. "Ongoing studies with more patients and longer follow up will demonstrate the true indications of particle therapy," he concluded.
The burden of proof
Refuting Sakurai's argument, W Robert Lee from Duke University Medical Center (Durham, NC) told the assembled audience that, within science, the burden of proof always lies with the claimants. "The claim is that proton therapy is superior to photon therapy. If proton advocates believe this to be the case, then they must prove it by accumulating evidence," he said.
"Evidence" comes in many forms: from intuitive, to that gained via personal experience, to anecdotal. But what's really needed, said Lee, is scientific evidence, that's hypothesis-based, empirical, reproducible and falsifiable. And, he says, it's accepted that randomized clinical trials are the best way to provide such evidence.
Without such rigorous trials, Lee suggested, results can be subject to confirmation bias – the tendency for people to favour information that confirms their preconceptions or hypotheses, regardless of whether the information is true.
Lee pointed out that while the physics of protons may indeed be predictable, the actual delivery of proton therapy comes with many uncertainties. These include CT approximations, tissue inhomogeneities, and uncertainties in acceleration energy, scattering systems and compensator density.
Thus the actual location of the distal margin on any given day is uncertain and, as such, one must be highly cautious about the use of dose-volume histograms to argue for superiority. Clinical results in patients are more meaningful. But, there is a complete lack of evidence from randomized trials comparing protons and photons.
"Statements about superiority in any realm of clinical medicine, in the absence of randomized clinical trials should be viewed with suspicion," Lee concluded. "To aver that protons are superior in the absence of randomized clinical trials isn't evidence-based medicine – it's faith-based medicine."