There is no way to know when our
observations about complex events in nature are complete. Our knowledge
is finite, Karl Popper emphasised, but our ignorance is infinite. In
medicine, we can never be certain about the consequences of our
interventions, we can only narrow the area of uncertainty. This
admission is not as pessimistic as it sounds: claims that resist
repeated energetic challenges often turn out to be quite reliable. Such
‘‘working truths’’ are the
building blocks for the reasonably solid structures that support our
everyday actions at the bedside.
William A. Silverman. Where’s the evidence? 1998
We have been colleagues for many years, sharing not only professional
camaraderie but also a deep-seated conviction that medical treatments,
whether new or old, should be based on sound evidence. Our collective
experience of healthcare and healthcare research suggests this is often
not the case. And that is what encouraged us to write this book.
IE’s curiosity about the evidence underpinning the treatments she
prescribed to patients was heightened during her career in medical
research. When she became a medical journalist at The Lancet she
encountered flagrant attempts by some pharmaceutical companies and
researchers to economise with the truth by distorting or embellishing
their research results. HT’s unexpected invitation to participate in a
clinical trial of doubtful quality made her realise that she ought to
be an active participant in the quest for progress concerning her
treatment, not a more or less passive recipient of care. She went on to
campaign vigorously for collaboration between health professionals and
patients to ensure worthwhile research with good quality patient
information. IC’s obsession with rigorous assessment of the effects of
the things that doctors do to their patients began when he was working
in a Palestinian refugee camp: some of his patients seemed to be dying
because he was practising in ways that he had
been taught at medical school. Since then he has strenuously promoted
the view that decisions in healthcare should be informed by unbiased
evidence from relevant research, particularly the results of systematic
reviews of controlled trials.
Every year, studies into the effects of treatments generate a mountain
of results. Sadly, much of this research fails to address the needs of
patients, and even when it does, the evidence is often unreliable. We
hope our book will point the way to wider understanding of how
treatments can and should be tested fairly. This is not a best
treatments guide to the effects of individual therapies. Rather, we
highlight issues that are fundamental to ensuring that research is
soundly based and designed to answer questions that matter to patients
and the health professionals to whom they turn for help.
In Chapter 1 we describe how some new treatments have had harmful
effects that were unexpected; the hoped-for effects of others failed to
materialise; and some predictions that treatments would not work were
proved wrong. Furthermore, some useful results of research have not
been applied in practice. In Chapter 2 we highlight the fact that many
commonly used treatments and screening tests have not been adequately
evaluated. Chapter 3 gives some ‘technical details’ – here we outline
the basis for fair testing of treatments, emphasising the importance of
paying attention to reducing potential biases and taking
account of the play of chance; this chapter also introduces concepts
such as randomised clinical trials and placebos, and the need to review
systematically all the relevant evidence. In Chapter 4 we describe some
of the numerous uncertainties that pervade almost every aspect of
healthcare, and how to tackle them. Chapter 5 contrasts the key
differences between good, bad, and unnecessary research into the
effects of treatments. In Chapter 6 we point out how much of the
research that is done is distorted by commercial and academic
priorities and fails to address issues that are likely to make a real
difference to the well-being of patients. Chapter 7 maps what patients
could do to ensure better testing of treatments. And in Chapter 8 we
present our blueprint for a revolution in testing treatments –
practical measures that could be started now to bring this about.
Each chapter is referenced with a key selection of source material;
other sources of information are included in the Additional Resources
section at the end of the book. For those who wish to explore issues in
more detail, a good starting point is the James Lind Library at
www.jameslindlibrary. org.
This site also hosts an e-mail contact point for readers of Testing
Treatments – do send us your comments to
testingtreatments@jameslindlibrary.org.
Although we describe the harm that some inadequately tested treatments
have caused, it is certainly not our intention to undermine patients’
trust in their health professionals. Our aim is to improve
communication and boost confidence. But this will only happen if
patients can help their doctors critically assess treatment options. We
hope that you, the reader, will emerge from this book sharing some of
our passion for the subject and go on to ask awkward questions about
treatments, identify gaps in medical knowledge, and get involved in
research to find answers for the benefit of everybody.