The American Medical Association House of Delegates will gather later this month in Chicago, where it will consider a vast array of resolutions directing their lobbyists in Washington as well as advising their physician members throughout the country.

Resolution 611 deals with "Evidence-Based Policy Development" and would require

RESOLVED, That our American Medical Association House of Delegates resolutions should include, whenever possible or applicable, appropriate reference citations to facilitate independent review by delegates prior to policy development. (Directive to Take Action)

Great idea -- as far as it goes. But evidence-based public health is more than a platitude . Two problems: timing and content.

We can hope that the controversy generated when AMA approved an anti-salt resolution last year might be the genesis of this year's resolution to get serious about basing resolutions on evidence. Evidence-based considerations were missing-in-action last year. Opinion trumped facts. So the timing's bad; it puts the cart before the horse.

The content is also suspect. It's a tepid gesture that will allow any proposer to claim his or her resolution is "evidence-based" merely by including literature citations. That's even worse than what has been passed-off as "evidence-based" policy recommendations by the experts on the Dietary Guidelines Advisory Committee (DGAC). We had recommended the DGAC model their analysis on international "evidence-based" standards. They didn't. Just as everyone wants to be felt to be fair, honest, to say nothing of attractive, witty, etc., self-proclaiming these virtues can often be wildly misleading.

What is "evidence-based" health policy?

Let's give credit where it's due. Back in 1972 A.L. "Archie" Cochrane penned his pathbreaking book, Effectiveness and Efficiency: Random Reflections on Health Services. This is the original textbook on "evidence-based medicine", a term familiar to most doctors and other healthcare professionals today. Cochrane's classic text has had a profound influence on the practice of medicine and on the evaluation of medical interventions. He was the first to set out clearly the vital importance of randomized controlled trials (RCTs) in assessing the effectiveness of treatments, and his work led directly to the setting-up of the Cochrane Collaboration , now a world-wide endeavor dedicated to tracking down, evaluating and synthesizing RCTs in all areas of medicine .

In my reading on the subject, for a recommendation to be evidence-based it should be developed using a structured and rigorous methodology based on a pre-determined set of criteria for grading the strength of any proposed recommendation. Consideration would be limited, most likely, to evidence found in randomized controlled trials and comparative controlled trials identified and synthesized using methods defined by the Cochrane Collaboration. An expert panel should first define evidence of outcomes important to individual subjects and, in aggregate, to the population, by determining the required strength of the evidence considered valid for inclusion in the review. Then, in blinded fashion, the evidence should then be graded against those criteria. The Cochrane methodology is preferred as a means to minimize bias since it outlines an objective and systematic approach to literature search, study selection, data extraction and data synthesis. Anything short of this dilutes the meaning of "evidence-based." To call the AMA approach "evidence-based" is whistling past the park.

Cochrane's home base, Oxford University, hosts a Centre for Evidence-based Medicine which answers the question "What is EBM? by extracting from an editorial in the British Medical Journal back in 1996:

Evidence-Based Medicine, whose philosophical origins extend back to mid-19th century Paris and earlier, remains a hot topic for clinicians, public health practitioners, purchasers, planners, and the public. There are now frequent workshops in how to practice and teach it; undergraduate and post-graduate training programmes are incorporating it (or pondering how to do so); British centres for evidence-based practice have been established or planned in adult medicine, child health, surgery, pathology, pharmacotherapy, nursing, general practice, and dentistry; the Cochrane Collaboration and the York Centre for Review and Dissemination in York are providing systematic reviews of the effects of health care; new evidence-based practice journals are being launched; and it has become a common topic in the lay media. But enthusiasm has been mixed with some negative reaction. Criticism has ranged from evidence-based medicine being old-hat to it being a dangerous innovation, perpetrated by the arrogant to serve cost-cutters and suppress clinical freedom. As evidence-based medicine continues to evolve and adapt, now is a useful time to refine the discussion of what it is and what it is not.

Evidence-based medicine is the conscientious, explicit and judicious use of current best evidence in making decisions about the care of individual patients. The practice of evidence-based medicine means integrating individual clinical expertise with the best available external clinical evidence from systematic research. By individual clinical expertise we mean the proficiency and judgement that individual clinicians acquire through clinical experience and clinical practice. Increased expertise is reflected in many ways, but especially in more effective and efficient diagnosis and in the more thoughtful identification and compassionate use of individual patients' predicaments, rights, and preferences in making clinical decisi ons about their care. By best available external clinical evidence we mean clinically relevant research, often from the basic sciences of medicine, but especially from patient centred clinical research into the accuracy and precision of diagnostic tests (including the clinical examination), the power of prognostic markers, and the efficacy and safety of therapeutic, rehabilitative, and preventive regimens. External clinical evidence both invalidates previously accepted diagnostic tests and treatments and replaces them with new ones that are more powerful, more accurate, more efficacious, and safer.

Good doctors use both individual clinical expertise and the best available external evidence, and neither alone is enough. Without clinical expertise, practice risks becoming tyrannised by evidence, for even excellent external evidence may be inapplicabl e to or inappropriate for an individual patient. Without current best evidence, practice risks becoming rapidly out of date, to the detriment of patients.

This description of what evidence-based medicine is helps clarify what evidence-based medicine is not. Evidence-based medicine is neither old-hat nor impossible to practice. The argument that everyone already is doing it falls before evidence of striking variations in both the integration of patient values into our clinical behaviour and in the rates with which clinicians provide interventions to their patients. The difficulties that clinicians face in keeping abreast of all the medical advances reported in primary journals are obvious from a comparison of the time required for reading (for general medicine, enough to examine 19 articles per day, 365 days pe r year) with the time available (well under an hour per week by British medical consultants, even on self-reports.

The argument that evidence-based medicine can be conducted only from ivory towers and armchairs is refuted by audits in the front lines of clinical care where at least some inpatient clinical teams in general medicine, psych iatry (JR Geddes, et al, Royal College of Psychiatrists winter meeting, January 1996), and surgery (P McCulloch, personal communication) have provided evidence-based care to the vast majority of their patients. Such studies show that busy clinicians who devote their scarce reading time to selective, efficient, patient-driven searching, appraisal and incorporation of the best available evidence can practice evidence-based medicine.

Evidence-based medicine is not "cook-book" medicine. Because it requires a bottom-up approach that integrates the best external evidence with individual clinical expertise and patient-choice, it cannot result in slavish, cook-book approaches to individual patient care. External clinical evidence can inform, but can never replace, individual clinical expertise, and it is this expertise that decides whether the external evidence applies to the individual patient at all and, if so, how it should be integrated into a clinical decision. Similarly, any external guideline must be integrated with individual clinical expertise in deciding whether and how it matches the patient's clinical state, predicament, and preferences, and thus whether it should be applied. Clinicians who fear top-down cook-books will find the advocates of evidence-based medicine joining them at the barricades.

Evidence-based medicine is not cost-cutting medicine. Some fear that evidence-based medicine will be hijacked by purchasers and managers to cut the costs of health care. This would not only be a misuse of evidence-based medicine but suggests a fundamental misunderstanding of its financial consequences. Doctors practising evidence-based medicine will identify and apply the most efficacious interventions to maximise the quality and quantity of life for individual patients; this may raise rather than lower the cost of their care.

Evidence-based medicine is not restricted to randomised trials and meta-analyses. It involves tracking down the best external evidence with which to answer our clinical questions. To find out about the accuracy of a diagnostic test, we need to find proper cross-sectional studies of patients clinically suspected of harbouring the relevant disorder, not a randomised trial. For a question about prognosis, we need proper follow-up studies of patients assembled at a uniform, early point in the clinical course of their disease. And sometimes the evidence we need will come from the basic sciences such as genetics or immunology. It is when asking questions about therapy that we should try to avoid the non-experimental approaches, since these routinely lead to false-positive conclusions about efficacy. Because the randomised trial, and especially the systematic review of several randomised trials, is so much more likely to inform us and so much less likely to mislead us, it has become the "gold standard" for judging whether a treatment does more good than harm. However, some questions about therapy do not require randomised trials (successful interventions for otherwise fatal conditions) or cannot wait for the trials to be conducted. And if no randomised trial has been carried out for our patient's predicament, we follow the trail to the next best external evidence and work from there.

Despite its ancient origins, evidence-based medicine remains a relatively young discipline whose positive impacts are just beginning to be validated, and it will continue to evolve. This evolution will be enhanced as seve ral undergraduate, post-graduate, and continuing medical education programmes adopt and adapt it to their learners' needs. These programmes, and their evaluation, will provide further information and understanding about what evidence-based medicine is, and what it is not.

Authors:

David L. Sackett, Professor, NHS Research and Development Centre for Evidence-Based Medicine, Oxford. William M. C. Rosenberg, Clinical Tutor in Medicine, Nuffield Department of Clinical Medicine, Oxford. J. A. Muir Gray, Director of Research and Development, Anglia and Oxford Regional Health Auhtority, Milton Keynes R. Brian Haynes, Professor of Medicine and Clinical Epidemiology, McMaster University Hamilton, Canada W. Scott Richardson, Rochester, USA

The AMA does not welcome "outside" comments (hence this blog), but AMA members may wish to share their thoughts on how their association may be over-reaching by claiming an evidence-based procedure. The contact is Susan L. Hubbell, MD, chair, Reference Committee F, and, again, the proposal is Resolution 611 .