Skip Navigation



eCAM Advance Access published online on November 1, 2009
eCAM, doi:10.1093/ecam/nep170
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF) Freely available
Right arrow E-letters: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when E-letters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Google Scholar
Right arrow Articles by Stock-Schröer, B.
Right arrow Articles by Baumgartner, S.
PubMed
Right arrow PubMed Citation
Right arrow Articles by Stock-Schröer, B.
Right arrow Articles by Baumgartner, S.
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?


© The Author(s) 2009. Published by Oxford University Press.
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/2.5/uk/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reporting Experiments in Homeopathic Basic Research—Description of the Checklist Development

B. Stock-Schröer1, H. Albrecht1, L. Betti2, G. Dobos3, C. Endler4, K. Linde5, R. Lüdtke1, F. Musial3, R. van Wijk6, C. Witt7 and S. Baumgartner8

1Karl and Veronica Carstens-Foundation, D-Essen, Germany, 2Department of Agro-Environmental Science and Technology, Faculty of Agriculture, Bologna University, I-Bologna, Italy, 3Chair of Complementary and Integrative Medicine, University of Duisburg-Essen, D-Essen, Germany, 4Interuniversity College for Health and Development, A-Graz, Austria, 5Institute of General Practice, Technical University, D-Munich, 6International Institute of Biophysics, D-Neuss, 7Institute for Social Medicine, Epidemiology and Health Economics, Charité University Medical Center, D-Berlin, Germany and 8Institute of Complementary Medicine KIKOM, University of Bern, CH-Bern, Switzerland


   Abstract
Top
 Abstract
Introduction
 Methods
 Results
 Discussion
 Acknowledgements
 References
 
The objective of this study was to develop a criteria catalogue serving as a guideline for authors to improve quality of reporting experiments in basic research in homeopathy. A Delphi Process was initiated including three rounds of adjusting and phrasing plus two consensus conferences. European researchers who published experimental work within the last 5 years were involved. A checklist for authors provide a catalogue with 23 criteria. The ‘Introduction’ should focus on underlying hypotheses, the homeopathic principle investigated and state if experiments are exploratory or confirmatory. ‘Materials and methods’ should comprise information on object of investigation, experimental setup, parameters, intervention and statistical methods. A more detailed description on the homeopathic substances e.g. manufacture, dilution method, starting point of dilution is required. A further result of the Delphi process is to raise scientists’ awareness of reporting blinding, allocation, replication, quality control and system performance controls. The part ‘Results’ should provide the exact number of treated units per setting which were included in each analysis and state missing samples and drop outs. Results presented in tables and figures are as important as appropriate measures of effect size, uncertainty and probability. ‘Discussion’ in a report should depict more than a general interpretation of results in the context of current evidence but also limitations and an appraisal of aptitude for the chosen experimental model. Authors of homeopathic basic research publications are encouraged to apply our checklist when preparing their manuscripts. Feedback is encouraged on applicability, strength and limitations of the list to enable future revisions.

Keywords: criteria catalogue – Delphi – fundamental research – guideline – publication


   Introduction
Top
 Abstract
 Introduction
Methods
 Results
 Discussion
 Acknowledgements
 References
 
Homeopathy is a widely used and highly controversial complementary therapy. The central aspect of the dispute is the use of highly diluted, ‘potentized’ remedies which, according to conventional scientific thinking, make any biological activity highly unlikely. But also the validity of the fundamental tenet of homeopathy—the Similia Principle (like cures like)—is not generally accepted by the scientific community. Therefore, any publication of a research study in homeopathy, particularly if reporting positive results, is subjected to special scrutiny. Clinical research is of utmost importance to investigate efficacy and effectiveness. Basic research is needed to investigate possible mechanisms of action. However, as clinical research so far has failed to prove or disprove specific effects of homeopathy in general and of high potencies in particular, laboratory research is also needed to investigate whether homeopathic preparations have biological activity.

Published experiments can be assigned to four main areas of basic research on homeopathy: animal research, plant bioassays, in vitro models and physicochemical research (1). The HomBrex Database lists more than 1100 experiments published in about 900 publications in different fields of basic research (2). To appreciate and understand the methods and findings of such studies, a high degree of transparency is required from authors. Reviews have shown that many experiments differ in design and quality (3). Over the years, several efforts have been made to enhance the quality of basic research in homeopathy. Schulte proposed a set of standards for ultra high dilution research (4), Linde et al. worked out checklists for preparing and reviewing publications (5) and also suggestions on methodological standards (6) have been published. Moreover scoring systems for assessing quality were generated: the first for the use in experimental toxicology (7) the second for physicochemical research into homeopathic potentization (8). The latter score was modified and used in a systematic review on in vitro experiments (3).

It seemed reasonable to try to bring together all aspects of former evaluation scores and to develop with a team of experienced researchers a basic score applicable (possibly in a slightly adjusted format) in all fields of basic research on homeopathy. During the discussion process it was decided to shift the focus from the development of a scoring system to the development of a reporting checklist for authors, peer reviewers and editors (and possibly readers and authors of systematic reviews) similar to publication guidelines in clinical research (CONSORT, REDHOT). This article describes and discusses the development process of the checklist (REHBaR—Reporting Experiments in Homeopathic Basic Research). A second publication will focus on the last step of the Delphi Process (round V), where the discussed criteria and their detailed explanations as a result of the whole process are given, supported and further evidenced from other publications.


   Methods
Top
 Abstract
 Introduction
 Methods
Results
 Discussion
 Acknowledgements
 References
 
The Delphi Process: A Consensus Method

From the existing consensus methods we chose a Delphi approach. Delphi may be characterized as a method for structuring a group communication process so that the process is effective in allowing a group of individuals, as a whole, to deal with a complex problem. In order to obtain a useful result for their objective there is a need to structure a group communication process (9). This Delphi technique is applicable to a variety of questions ending up with different outcomes. In our case, the goal was to create an agreed checklist with criteria important for improving the quality of reports in basic research. A search for papers in the databases PubMed and CAMbase with the following keywords was conducted until July 2009: guideline, reporting, publication, catalogue, basic, clinical, fundamental, research, author, quality, CONSORT.

Preparatory Work

Before starting the Delphi process a preliminary collection of 58 potentially relevant items was compiled as preparatory work. The collection comprised all items included in the two scores developed for systematic reviews in basic research (7,8). Additional items were included on the basis of informal discussion with experts and the corresponding author.

The Delphi Process (Round I–V)

In the Delphi process there were a total of five rounds, including two consensus conferences (see Fig. 1). In Delphi I, the list of 58 items primed in the preparatory phase by the initiators was sent to all participants. All experts were asked to rate the importance of each item on a 5-point Likert scale, and to add further items. Delphi II—the first conference—offered the opportunity to clarify misunderstandings and misconceptions and discuss the objective of the catalogue in general. In Delphi III a modified catalogue was prepared taking into account the revised objective (see ‘Results’), which was again discussed in the conference Delphi IV. In Delphi V, the reporting document was prepared and iteratively revised in an internal review process.


Figure 1
View larger version (48K):
[in this window]
[in a new window]
[Download PowerPoint slide]
  		Figure 1 Flow chart of the Delphi process realized from October 2007 to March 2009 among a group of European research on homeopathy for developing the checklist REHBaR.

 
Team of Experts

Members of the panel were S. Baumgartner, L. Betti, C. Endler and R. van Wijk as leading European researchers in homeopathic experiments with plants, animals, evolutionary biology as well as biochemical and biophysical research. K. Linde and C. Witt were involved in Delphi for two reasons: first they are well known experts in the field of clinical research concerned with quality questions, and secondly both are experienced in basic research and developed a score for quality assessment in basic research (7,8). R. Lüdtke was responsible for the statistical aspects, H. Albrecht, G. Dobos and F. Musial for general support in questions of basic research.


   Results
Top
 Abstract
 Introduction
 Methods
 Results
Discussion
 Acknowledgements
 References
 
Delphi Round I: Rating and Selection of Items

In the first round, all members of the team rated the relevance of the 58 items included in the preliminary list. Out of 58 items, 18 were rated as ‘absolutely necessary’ (mean: 3.5–4) and 31 items as ‘moderately necessary’ (mean: 2.5–3). No item was rated ‘moderately unnecessary’ or ‘strongly unnecessary’, but nine items received neutral rating (mean: 2). Only one item was added and discussed in the conference.

Delphi Round II: The First Consensus Conference

In the first conference we came to the conclusion that our initial intention—creating a new evaluation score—should be postponed. A criteria catalogue for improving the quality of reporting experiments was considered a priority. The main reason for this was that accurate reporting is a precondition for a valid quality assessment. Furthermore, the importance of quality scoring, in clinical research, is currently under discussion. For example, the current version of the Handbook of the Cochrane Collaboration, a worldwide network for performing systematic reviews on clinical research, explicitly discourages the use of quality scores (10): it is argued that while this method of scoring is simple, it is not supported by empirical evidence. The calculation of summary scores involves assigning ‘weights’ to different items in the scale, and it is difficult to justify the weights assigned. Furthermore, scales have been shown to be unreliable assessments of validity (11). Therefore it is regarded as preferable to use simple approaches for assessing validity that can be fully reported (i.e. how each trial was rated on each criterion).

Delphi Round III: Phrasing of the Checklist

As a result, a checklist for adequate reporting was then compiled and worded in this round following existing examples in clinical research, mainly CONSORT (12) and STROBE (13).

Delphi Round IV: The Second Consensus Conference

Another conference was held in order to discuss the reassessed first checklist looking at the purposes of exploratory and confirmatory experiments. The final list, unanimously agreed upon, is presented in Table 1: ‘Items to be included when Reporting Experiments in Homeopathic Basic Research’. It was then decided to refrain from establishing an evaluation score. As an additional step, the group selected those items from the first list that were considered to be the minimum essential information needed for reviewing publications in this field. This new catalogue includes all parts readers should know to clearly follow the experiments and to fully understand the results. The catalogue will be published after an internal reviewing process and test of practicability.


View this table:
[in this window]
[in a new window]

  		Table 1 Items to be included when reporting experiments in REHBaR

 
Delphi Round V: Rewording of the Checklist Supplemented with Explanations

In the last round detailed explanations for each item based on the first catalogue were written, reassessed by all participants and supplemented with examples (available from the corresponding author). Often it is not possible to give all information due to space limitations of the journal. Therefore we recommend authors to refer to a website address to make further information available. If certain methods or the procedure of positive and negative controls are already published, it may be sufficient to refer to that publication. As publications often report on several experiments performed with regard to one research question, the report should distinguish between the single experiments and make them obvious to the reader. Furthermore, it is important to make clear if the experiment was designed for explorative or confirmatory purpose and whether it followed a specific hypothesis or not.


   Discussion
Top
 Abstract
 Introduction
 Methods
 Results
 Discussion
Acknowledgements
 References
 
Accurate reporting is a prerequisite for critical interpretation of any research study and its findings. Without accurate reporting it is not possible to assess the merits of a study. Any positive findings of basic research experiments on high dilutions or potencies are likely to stir controversy in the academic community. If details in the publication (or an additional accessible report) are insufficient to allow repetition of experiments performed or to assess potential threats to validity, the value of a potentially important experiment is strongly compromised. In an 18-month Delphi process we have tried to come up with a checklist aimed at helping authors to prepare high quality manuscripts on their homeopathic basic research experiments, and at helping peer reviewers, editors and readers to check whether reporting accurately reflects their experiments.

Shortcomings in reporting experiments are not at all unique to homeopathy but a general phenomenon. The limited space in journals, specific style and editorial pressure often force authors to shorten their paper to an extent where a detailed description becomes impossible. However, even with limited space, a good manuscript can provide a lot of relevant details, and the internet makes it possible to make more detailed reports easily available to interested researchers. In clinical and epidemiological research several checklists to improve reporting quality have been developed within the last number of years. The first attempt to improve quality of reporting randomized clinical trials was the CONSORT statement in 1996 (14). This document has been revised in 2001 (12) and 2005 (15), and recently further documents have become available for improving the reporting of abstracts (16), pragmatic trials (17), non-pharmacological trials (18) (see also http://www.consort-statement.org/). The necessity of CONSORT was recently encouraged by the poor standards common in reporting RCTS in Tai Chi interventions (19) as well as the poor standard of reporting in Chinese journals (20).

QUORUM provides a guideline for reporting meta-analyses (21,22). An evolution of this guideline was developed by an international group: Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) (23). For observational studies, including cohort, case-control and cross-sectional studies STROBE emerged (13), recently extended with STREGA (STRengthening the Reporting of Genetic Association studies) (24). Comparable lists are available for trials in acupuncture: STRICTA (25) is already discussed (26) and assessed (27). For complete and accurate reporting of studies of diagnostic accuracy (STARD) an item list was compiled (28). Standards for Quality Improvement Reporting Excellence (SQUIRE) were published to enhance reporting on quality improvement studies in health care (29). RedHot (30), an unofficial extension for CONSORT, was established to assist reporting on homeopathic treatments in clinical trials. A further CONSORT statement was compiled (31) concerning randomized, controlled trials of herbal interventions, evaluated in a systematic review of instruments developed to critically assess the quality of trials on the efficacy of natural health products (32). A complete collection of available reporting guidelines can be found at EQUATOR (Enhancing the QUAlity and Transparency Of health Research), a new international initiative based on a network concept (33).

Basic research is different from clinical and epidemiological research, and reporting guidelines comparable to those described above for clinical research do not exist in this area outside of homeopathy. In biological sciences there are some groups working on standards of data presentation. These initiatives were derived from research groups dealing with microarray experiments and provide several checklists on how to report and deal with large numbers of data (34). An overview of these activities can be found at the homepage of MIBBI (Minimum Information for Biological and Biomedical Investigations) http://www.mibbi.org or the MGED (Microarray Gene Expression Data) society.

Our checklist is compiled for experiments on homeopathy and how to report each step of experiment which is important to understand and appreciate the results.

A first proposal for a reporting guideline in homeopathy was introduced in 1991 (35). It focused on experiments dealing with ultra low dose effects (serial dilutions and potencies).

The group refrained from establishing a score for assessing quality, as had been common in the past, in clinical research (36). In the current state it was thought that it is not feasible to propose clear-cut criteria for assessing what constitutes good and bad basic research beyond generally accepted standards. Furthermore, a lot of basic research experiments are explorative and often procedures cannot follow a predictable outline. Research questions tend to be more complex than the methodologically straightforward question of efficacy. Unexpected effects are common, either due to the potentization process, the level of potentization or the substance itself. In exploratory experiments it is often not obvious to which part of the intervention the effect refers to and to what extent. A precise description of the manufacturing and the Pharmacopoeias of the test and control substances are therefore indispensable. If the expected effect is caused by the succussion process only, unpotentized solvent is the adequate control. If the effect is expected to be caused by a potentized substance, a potentized solvent or another potentized substance (at the same potency level) is adequate. When investigation was performed on the Similia Principle, a variety of substances, which represent different degrees of similarity with the diseased state, can be chosen as control. It is important to explain why which control was selected relating to the underlying questions of research e.g. the Similia Principle or Isopathy. In this context the role of individualization in experiments performed about the Similia Principle or the definition of Isopathy should be taken into account.

Whether quality assessment scores make sense in the future remains to be discussed. In clinical research there is a clear trend to assess single components of quality and investigate their impact on outcomes instead of using questionable summary scores. ‘One commonly-used scale was developed by Jadad and colleagues for randomized trials in pain research (37). The use of this scale is explicitly discouraged. As well as suffering from the generic problems of scales, it has a strong emphasis on reporting rather than conduct, and does not cover one of the most important potential biases in randomized trials, namely allocation concealment.’ (Cochrane Handbook, Chapter 8.3.3) (10).

REHBaR was developed with a standard consensus method among an international team of researchers with experience in basic and clinical research in homeopathy, experimental physiology, general research methodology and statistics. All members commented on intermediate and the final version of the checklist. Obviously, the team was a relatively small sample of individuals, and other researchers might have introduced other items. The current list has to be considered as a first try and it is hoped that it proves useful to enhance the quality of reporting basic research experiments in homeopathy. We encourage the use of the list, critical feedback and hope to be able to provide an improved version in a few years.


  Footnotes
 
For reprints and all correspondence: B. Stock-Schröer, Karl and Veronica Carstens-Foundation, D-Essen, Germany. Tel: +49 201 5630510; Fax: +49 201 5630530; E-mail: b.stock-schroeer{at}carstens-stiftung.de


   Acknowledgements
Top
 Abstract
 Introduction
 Methods
 Results
 Discussion
 Acknowledgements
References
 
The authors are grateful to logistic support by the German Karl and Veronica Carstens-Foundation offering a platform for communication and coordination of the Delphi process. Furthermore, the foundation provided a grant for two consensus conferences.


   References
Top
 Abstract
 Introduction
 Methods
 Results
 Discussion
 Acknowledgements
 References
 

  1. Baumgartner S, Shah D, Schaller J, Kampfer U, Thurneysen A, Heusser P. Reproducibility of dwarf pea shoot growth stimulation by homeopathic potencies of gibberellic acid. Complement Ther Med ( 2008;) 16:: 183–91.[CrossRef][Web of Science][Medline]
  2. Van Wijk R, Albrecht H. Classification of systems and methods used in biological basic research on homeopathy. Homeopathy ( 2007;) 96:: 247–51.[CrossRef][Web of Science][Medline]
  3. Witt CM, Bluth M, Albrecht H, Weisshuhn TE, Baumgartner S, Willich SN. The in vitro evidence for an effect of high homeopathic potencies—a systematic review of the literature. Complement Ther Med ( 2007;) 15:: 128–38.[CrossRef][Web of Science][Medline]
  4. Schulte J. About quality and standards in ultra high dilution research and research on homeopathy. In: Ultra High Dilution—Physiology and Physics —Endler PCSJ, ed. ( 1994;) Dordrecht: Kluwer Academic Publishers. 171–6.
  5. Linde KMD, Jonas WB, Hornung J. Ways to enhance the quality and acceptance of clinical and laboratory studies in homeopathy. Brit Hom J ( 1994;) 83:: 3–7.[CrossRef]
  6. Baumgartner S, Heusser P, Thurneysen S. Methodological standards and problems in preclinical homoeopathic potency research. Forsch Komplementarmed ( 1998;) 5:: 27–32.[Web of Science][Medline]
  7. Linde K, Jonas WB, Melchart D, Worku F, Wagner H, Eitel F. Critical review and meta-analysis of serial agitated dilutions in experimental toxicology. Hum Exp Toxicol ( 1994;) 13:: 481–92.[Abstract/Free Full Text]
  8. Becker-Witt C, Weisshuhn TE, Ludtke R, Willich SN. Quality assessment of physical research in homeopathy. J Altern Complement Med ( 2003;) 9:: 113–32.[CrossRef][Web of Science][Medline]
  9. Linstone H, Turoff M. The Delphi method: techniques and applications. ( 2002;) (last accessed 21 October 2009). http://www.is.njit.edu/pubs/delphibook/.
  10. Higgins J, Altman D. Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.1. (last accessed 21 October 2009). In: Colaboration TC (ed). 2008. http://www.cochrane-handbook.org.
  11. Juni P, Witschi A, Bloch R, Egger M. The hazards of scoring the quality of clinical trials for meta-analysis. JAMA ( 1999;) 282:: 1054–60.[Abstract/Free Full Text]
  12. Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. J Am Podiatr Med Assoc ( 2001;) 91:: 437–42.[Abstract/Free Full Text]
  13. Vandenbroucke JP, von Elm E, Altman DG, Gotzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the reporting of observational studies in epidemiology (STROBE): explanation and elaboration. Ann Intern Med ( 2007;) 147:: W163–94.[Medline]
  14. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA ( 1996;) 276:: 637–9.[Abstract/Free Full Text]
  15. Moher D, Schulz KF, Altman D. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials 2001. Explore (NY) ( 2005;) 1:: 40–5.[Medline]
  16. Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, et al. CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med ( 2008;) 5:: e20.[CrossRef][Medline]
  17. Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ ( 2008;) 337:: a2390.[Abstract/Free Full Text]
  18. Boutron I, Tubach F, Giraudeau B, Ravaud P. Methodological differences in clinical trials evaluating nonpharmacological and pharmacological treatments of hip and knee osteoarthritis. JAMA ( 2003;) 290:: 1062–70.[Abstract/Free Full Text]
  19. Li JY, Zhang YF, Smith GS, Xue CJ, Luo YN, Chen WH, et al. Quality of reporting of randomized clinical trials in Tai Chi interventions—A systematic review. eCAM ( 2009;) (Advance Access published on April 7); doi:10.1093/ecam/nep022.
  20. Xu L, Li J, Zhang M, Ai C, Wang L. Chinese authors do need CONSORT: reporting quality assessment for five leading Chinese medical journals. Contemp Clin Trials ( 2008;) 29:: 727–31.[CrossRef][Web of Science][Medline]
  21. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of reporting of meta-analyses. Lancet ( 1999;) 354:: 1896–900.[CrossRef][Web of Science][Medline]
  22. Turpin DL. CONSORT and QUOROM guidelines for reporting randomized clinical trials and systematic reviews. Am J Orthod Dentofacial Orthop ( 2005;) 128:: 681–5.; discussion 686.[CrossRef][Web of Science][Medline]
  23. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol ( 2009;) 62:: 1006–12.[CrossRef][Web of Science][Medline]
  24. Little J, Higgins JP, Ioannidis JP, Moher D, Gagnon F, von Elm E, et al. STrengthening the REporting of Genetic Association Studies (STREGA): an extension of the STROBE statement. PLoS Med ( 2009;) 6:: e22.[CrossRef][Medline]
  25. MacPherson H, White A, Cummings M, Jobst K, Rose K, Niemtzow R. Standards for reporting interventions in controlled trials of acupuncture: the STRICTA recommendations. Complement Ther Med ( 2001;) 9:: 246–9.[CrossRef][Web of Science][Medline]
  26. Prady SL, MacPherson H. Assessing the utility of the standards for reporting trials of acupuncture (STRICTA): a survey of authors. J Altern Complement Med ( 2007;) 13:: 939–43.[CrossRef][Web of Science][Medline]
  27. Prady SL, Richmond SJ, Morton VM, MacPherson H. A systematic evaluation of the impact of STRICTA and CONSORT recommendations on quality of reporting for acupuncture trials. PLoS ONE ( 2008;) 3:: e1577.[CrossRef][Medline]
  28. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. Toward complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Acad Radiol ( 2003;) 10:: 664–9.[CrossRef][Web of Science][Medline]
  29. Davidoff F, Batalden P, Stevens D, Ogrinc G, Mooney SE. Publication guidelines for quality improvement studies in health care: evolution of the SQUIRE project. BMJ ( 2009;) 338:: a3152.[Abstract/Free Full Text]
  30. Dean ME, Coulter MK, Fisher P, Jobst KA, Walach H. Reporting data on homeopathic treatments (RedHot): a supplement to CONSORT. J Altern Complement Med ( 2007;) 13:: 19–23.[CrossRef][Web of Science][Medline]
  31. Gagnier JJ, Boon H, Rochon P, Moher D, Barnes J, Bombardier C. Reporting randomized, controlled trials of herbal interventions: an elaborated CONSORT statement. Ann Intern Med ( 2006;) 144:: 364–7.[Abstract/Free Full Text]
  32. Whelan AM, Jurgens TM, Lord L. Evaluating the quality of randomized controlled trials that examine the efficacy of natural health products: a systematic review of critical appraisal instruments. eCAM ( 2008;) (Advance Access published January 18, 2008); doi:10.1093/ecam/nem186.
  33. Simera I, Moher D, Hoey J, Schulz KF, Altman DG. The EQUATOR network and reporting guidelines: helping to achieve high standards in reporting health research studies. Maturitas ( 2009;) 63:: 4–6.[CrossRef][Web of Science][Medline]
  34. Taylor CF, Field D, Sansone SA, Aerts J, Apweiler R, Ashburner M, et al. Promoting coherent minimum reporting guidelines for biological and biomedical investigations: the MIBBI project. Nat Biotechnol ( 2008;) 26:: 889–96.[CrossRef][Web of Science][Medline]
  35. Hornung J, Linde K. Guidelines for the exact description of the preparation and mode of application of serial dilutions and potencies in publications on ultra low dose effects and homeopathic research—a proposal. Berlin J Res Homeopath ( 1991;) 1:: 121–3.
  36. Moher D, Jadad AR, Nichol G, Penman M, Tugwell P, Walsh S. Assessing the quality of randomized controlled trials: an annotated bibliography of scales and checklists. Control Clin Trials ( 1995;) 16:: 62–73.[Web of Science][Medline]
  37. Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials ( 1996;) 17:: 1–12.[CrossRef][Web of Science][Medline]
Received April 24, 2009; accepted October 2, 2009


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?



This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF) Freely available
Right arrow E-letters: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when E-letters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Google Scholar
Right arrow Articles by Stock-Schröer, B.
Right arrow Articles by Baumgartner, S.
PubMed
Right arrow PubMed Citation
Right arrow Articles by Stock-Schröer, B.
Right arrow Articles by Baumgartner, S.
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?