eCAM Advance Access published online on May 21, 2009
eCAM, doi:10.1093/ecam/nep044
How Much of CAM is Based on Research Evidence?
Complementary Medicine, Peninsula Medical School, Universities of Exeter and Plymouth, Exeter, UK
 |
Abstract |
|---|
 Top Abstract MethodsResultsDiscussionReferences |
|---|
The aim of this article is to provide a preliminary estimate of how much CAM is evidence-based. For this purpose, I calculated the percentage of 685 treatment/condition pairings evaluated in the ‘Desktop Guide to Complementary and Alternative Medicine’ which ere supported by sound data. The resulting figure was 7.4%. For a range of reasons, it might be a gross over-estimate. Further investigations into this subject are required to arrive at more representative figures.
Keywords: Complementary and alternative medicine – effectiveness – evidence – evidence-based medicine
A lively discussion exists about the question as to how much of conventional medicine might be based on sound evidence (1). One figure that is often cited is 15% (2). It presents, however, unreliable and out-dated information: the figure can be traced back to a small survey conducted in 1960/61 of prescribing practises of family doctors in a northern British town, which looked toward controlling prescribing costs (3). Other experts have published more convincing data showing that an average of 76% of interventions are supported by some form of compelling evidence, with an average of 37% of interventions being supported by randomized clinical trials (RCTs) (3). A recent systematic review (4) of the topic found that, in general internal medicine, over 50% (5) and in psychiatry over 65% (6) of interventions are based on positive data from RCTs.
The discussion about the evidence-base of CAM is far less lively. Here I present a first attempt to generate some data and hopefully a constructive discussion on this potentially important subject.
|
Methods |
|---|
|
TopAbstractMethodsResultsDiscussionReferences |
|---|
As a basis for my assessment, I used our own book The Desktop Guide to Complementary and Alternative Medicine (6). In this book, we evaluate the research evidence from clinical trials and systematic reviews as it pertains to any type of CAM for a wide range of conditions (n = 46). For each condition, we compiled a ‘summary of clinical evidence’ table in which the treatments are categorized according to the ‘weight’ and ‘direction’ of the evidence. The ‘weight’ is conceptualized as a composite measure of the quantity, quality and level of the research evidence, which refers to the confidence that can be placed on that evidence (6). The quantity refers to the total patient sample included in all clinical trials—there could, for instance, be five studies with an average of 20 patients resulting in a total sample of 100; this would be less than a single study with a sample of 300. The quality of the trial evidence refers to the likelihood of bias, usually estimated with a score such as the Jadad score (7). The level of the evidence refers to the hierarchy of research evidence where systematic reviews are on top and opinion or anecdotal evidence at the bottom. The ‘direction’ of the evidence signals whether the effect is clearly positive, tentatively positive, uncertain, tentatively negative or clearly negative (6). The book has a full methods section to maximize transparency and reproducibility. It describes our assessments in more detail (6).
For the purpose of this analysis, I have simply counted the number of treatments which obtained the maximum ‘weight’ and also were rated as ‘clearly positive’ in our ‘summary of clinical evidence’ tables. This provided the number of treatments that are supported by good evidence (if one therapy was effective for two indications it was counted twice). Subsequently, this figure was put in relation to the total number of treatment/condition pairings from all the ‘summary of clinical evidence’ tables in our book (6).
|
Results |
|---|
|
TopAbstractMethodsResultsDiscussionReferences |
|---|
Fifty-one treatments were characterized as having maximum ‘weight’ of evidence as well as being ‘clearly positive’. The total number of treatment/condition pairings was 685. Consequently, 7.4% of them were based on sound evidence. Table 1 provides a list of these 51 treatment/condition pairings.
|
|
Discussion |
|---|
|
TopAbstractMethodsResultsDiscussionReferences |
|---|
The estimate that 7.4% of CAM is based on sound evidence may well be over-optimistic. We selected the conditions for inclusion in our book (6) on the basis of two main criteria: first, the condition had to be relevant, i.e. commonly seen in primary care or frequently treated with CAM and/or there had to be sufficient trial data to write a chapter. Thus, this evidence summarized in the present article represents a positive selection. Had we chosen different conditions for our book, the percentage would most likely have been lower.
A glance at Table 1 furthermore informs us that several of the included modalities, e.g. exercise, group behaviour therapy, stress management, fiber intake or biofeedback, could easily be classified as conventional interventions rather than CAM. Had we excluded them, the percentage of evidence-based CAM would have declined further.
Finally, several cases of ‘sound’ evidence included in Table 1 might need revision in the light of evidence that has emerged since the publication of our book. Examples include saw palmetto (Serenoa repens) (8), glucosamine (9–12), Ginkgo biloba (13–16) and acupuncture which, according to recent findings, may not be more efficacious than sham acupuncture (17,18).
Another concern is that the present analysis merely relates to the question of how many therapies might be supported by sound research evidence. It does not address the question of how solidly CAM practice is evidence-based. This would require an assessment of which treatments are used and how often. Such a research project would be complex but would certainly be a valuable contribution to the literature.
Although my estimate of how much of CAM is evidence-based draws on a critical evaluation of the available evidence, it still presents a rather optimistic view. Further investigations into this subject are required to arrive at more representative figures.
|
Footnotes |
|---|
For reprints and all correspondence: Edzard Ernst, Complementary Medicine, Peninsula Medical School, Universities of Exeter and Plymouth, 25 Victoria Park Road, Exeter EX2 4NT, UK. E-mail: edzard.ernst{at}pms.ac.uk
|
References |
|---|
|
TopAbstractMethodsResultsDiscussionReferences |
|---|
- Ernst E. How much of general practice is based on evidence? Br J Gen Pract ( 2004;) 54:: 316–7.[Medline]
- Smith R. Where is the wisdom ... the poverty of medical evidence. Br Med J ( 1991;) 303:: 798–9.
[Free Full Text] - Imrie R, Ramey DW. The evidence for evidence-based medicine. Complement Ther Med ( 2000;) 8:: 123–6.[CrossRef][Web of Science][Medline]
- Matzen P. [How evidence-based is medicine? A systematic literature review.] [Article in Danish]. Ugeskr Laeger ( 2003;) 165:: 1431–5.[Medline]
- Gill P, Dowell AC, Neal RD, Smith N, Heywood P, Wilson AE. Evidence based general practice: a retrospective study of interventions in one training practice. Br Med J ( 1996;) 312:: 819–21.
[Abstract/Free Full Text] - Ernst E, Pittler MH, Wider B, Boddy K. The Desktop Guide to Complementary and Alternative Medicine ( 2006;) 2nd. Edinburgh: Mosby/Elsevier.
- Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Contr Clin Trials ( 1996;) 17:: 1–12.[CrossRef]
- Bent S, Kane C, Shinohara K, Neuhaus J, Hudes ES, Goldberg H, et al. Saw palmetto for benign prostatic hyperplasia. N Engl J Med ( 2006;) 354:: 557–66.
[Abstract/Free Full Text] - Clegg DO, Reda DJ, Harris CL, Klein MA, O’Dell JR, Hooper MM, et al. Glucosamine, chondroitin sulfate, and the two in combination for painful knee osteoarthritis. N Engl J Med ( 2006;) 354:: 795–808.
[Abstract/Free Full Text] - Rozendaal RM, Koes BW, van Osch GJ, Uitterlinden EJ, Garling EH, Willemsen SP, et al. Effect of glucosamine sulfate on hip osteoarthritis: a randomized trial. Ann Intern Med ( 2008;) 148:: 268–77.
[Abstract/Free Full Text] - Kawasaki T, Kurosawa H, Ideda H, Kim SG, Osawa A, Takazawa Y, et al. Additive effects of glucosamine or risedronate for the treatment of osteoarthritis of the knee combined with home exercise: a prospective randomized 18-month trial. J Bone Miner Metab ( 2008;) 26:: 279–87.[CrossRef][Web of Science][Medline]
- Messier SP, Mihalko S, Loeser RF, Legault C, Jolla J, Pfruender J, et al. Glucosamine/chondroitin combined with exercise for the treatment of knee osteoarthritis: a preliminary study. Osteoarthritis Cartilage ( 2007;) 15:: 1256–66.[CrossRef][Web of Science][Medline]
- Canter P, Ernst E. Ginkgo biloba is not a smart drug: an updated systematic review of randomized clinical trials testing the nootropic effects of G. biloba extracts in healthy people. Hum Psychopharmacol ( 2007;) 22:: 265–78.[CrossRef][Web of Science][Medline]
- Dodge HH, Zitzelberger T, Oken BS, Howieson D, Kaye J. A randomized placebo-controlled trial of Ginkgo biloba for the prevention of cognitive decline. Neurology ( 2008;) 70:(19 Pt 2): 1809–17.
[Abstract/Free Full Text] - DeKosky ST, Williamson JD, Fitzpatrick AL, Kronmal RA, Ives DG, Saxton JA, et al. Ginkgo biloba for prevention of dementia: a randomized controlled trial. J Am Med Assoc ( 2008;) 300:: 2253–62.
[Abstract/Free Full Text] - McCarney R, Fisher P, Iliffe S, Van Haselen R, Griffin M, van der Meulen J, et al. Ginkgo biloba for mild to moderate dementia in a community setting: a pragmatic, randomised, parallel-group, double-blind, placebo-controlled trial. Int J Geriatr Psychiatry ( 2008;) 23:: 1222–30.[CrossRef][Web of Science][Medline]
- Ernst E. Acupuncture - a critical analysis. J Intern Med ( 2006;) 259:: 125–37.[CrossRef][Web of Science][Medline]
- Moffett HH. Sham acupuncture may be as efficacious as true acupuncture: a systematic review of clinical trials. J Alt Comp Med ( 2009;) 15:: 213–6.[CrossRef][Web of Science][Medline]
CiteULike 
Connotea 
Del.icio.us What's this?
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||