Before explaining the meaning of publication bias, it is important to stress that this is not necessarily a form of deliberate fraud, because it is easy to conceive of situations when it can occur due to an unconscious pressure to get a particular result. Imagine a Chinese researcher who conducts an acupuncture trial and achieves a positive result. Acupuncture is a major source of prestige for China, so the researcher quickly and proudly publishes his positive result in a journal. He may even be promoted for his work. A year later he conducts a second similar trial, but on this occasion the result is negative, which is obviously disappointing. The key point is that this second piece of research might never be published for a whole range of possible reasons: maybe the researcher does not see it as a priority, or he thinks that nobody will be interested in reading about a negative result, or he persuades himself that this second trial must have been badly conducted, or he feels that this latest result would offend his peers. Whatever the reason, the researcher ends up having published the positive results of the first trial, while leaving the negative results of the second trial buried in a drawer. This is publication bias.
When this sort of phenomenon is multiplied across China, then we have dozens of published positive trials, and dozens of unpublished negative trials. Therefore, when the WHO conducted a review of the published literature that relied heavily on Chinese research its conclusion was bound to be skewed–such a review could never take into account the unpublished negative trials.
The WHO report was not just biased and misleading; it was also dangerous because it was endorsing acupuncture for a whole range of conditions, some of which were serious, such as coronary heart disease. This begs the question, how and why did the WHO write a report that was so irresponsible?
The WHO has an excellent record when it comes to conventional medicine, but in the area of alternative medicine it seems to prioritize political correctness above truth. In other words, criticism of acupuncture might be perceived as criticism of China, of ancient wisdom and of Eastern culture as a whole. Moreover, usually when expert panels are assembled in order to review scientific research, the protocol is to include experts with informed but diverse opinions. And, crucially, the panel should include critical thinkers who question and challenge any assumptions; otherwise the panel’s deliberations are a meaningless waste of time and money. However, the WHO acupuncture panel did not include a single critic of acupuncture. It was quite simply a group of believers who unsurprisingly were less than objective in their assessment. Most worrying of all, the report was drafted and revised by Dr Zhu‑Fan Xie, who was Honorary Director of the Institute of Integrated Medicines in Beijing, which fully endorses the use of acupuncture for a range of disorders. It is generally in appropriate for someone with such a strong conflict of interest to be so closely involved in writing a medical review.
If we cannot trust the WHO to summarize adequately the vast number of clinical trials concerning acupuncture, then to whom do we turn? Fortunately, several academics around the world have made up for the WHO’s failure by providing their own summaries of the research. Thanks to these groups, we can at long last answer the question that has lingered throughout this chapter–is acupuncture effective?
The Cochrane Collaboration
Doctors are confronted each year with hundreds of new results from clinical trials, which might cover everything from re‑testing an existing mainstream treatment to initial testing of a controversial alternative therapy. Often there will be several trials focused on the same treatment for the same ailment, and results can be difficult to interpret and sometimes contradictory. With not enough hours in the day to deal with patients, it would be impractical and nonsensical for doctors to read through each research paper and come to their own conclusions. Instead, they rely heavily on those academics who devote themselves to making sense of all this research, and who publish conclusions that help doctors advise patients about the best form of treatment.
Perhaps the most famous and respected authority in this field is the Cochrane Collaboration, a global network of experts coordinated via its headquarters in Oxford. Firmly adhering to the principles of evidence‑based medicine, the Cochrane Collaboration sets itself the goal of examining clinical trials and other medical research in order to offer digestible conclusions about which treatments are genuinely effective for which conditions. Before revealing the Cochrane Collaboration’s findings on acupuncture, we will first briefly look at its origins and how it came to be held in such high regard. In this way, by establishing the Cochrane Collaboration’s reputation, we hope that you will accept their conclusions about acupuncture in due course.
The Cochrane Collaboration is named after Archie Cochrane, a Scotsman who abandoned his medical studies at University College Hospital, London, in 1936 to serve in the Spanish Civil War as part of a Field Ambulance Unit. Then in the Second World War h e joined the Royal Army Medical Corps as a captain and served in Egypt, but he was captured in 1941 and spent the rest of the war providing medical help to fellow prisoners. This was when he first became aware of the importance of evidence‑based medicine. He later wrote that the prison authorities would encourage him by claiming that he was at liberty to decide how to treat his patients: ‘I had con siderable freedom of choice of therapy: my trouble was that I did not know which to use and when. I would gladly have sacrificed my freedom for a little knowledge.’ In order to arm himself with more know ledge he conducted his own trials among his fellow prisoners–he earned their support by telling them about James Lind and the role of clinical trials in working out the best treatment for patients with scurvy.
Whilst Cochrane was clearly a fervent advocate of the scientific method and clinical trials, it is important to note that he also realized the medical value of human compassion, as demonstrated by numerous events throughout his life. One of the most poignant examples occurred during his time as a prisoner of war at Elsterhorst, Germany, when he found himself in the hopeless position of treating a Soviet prisoner who was ‘moribund and screaming’. All Cochrane could offer was aspirin. As he later recalled:
I finally instinctively sat down on the bed and took him in my arms, and the screaming stopped almost at once. He died peacefully in my arms a few hours later. It was not the pleurisy that caused the screaming but loneliness. It was a wonderful education about the care of the dying.