Evidence Based Medicine
Evidence Based Medicine
Evidence Based Medicine
Evidence-based[edit]
The term "evidence-based medicine", as it is currently used, has two main tributaries.
Chronologically, the first is the insistence on explicit evaluation of evidence of effectiveness when
issuing clinical practice guidelines and other population-level policies. The second is the
introduction of epidemiological methods into medical education and individual patient-level
decision-making.[citation needed]
The term "evidence-based" was first used by David M. Eddy in the course of his work on
population-level policies such as clinical practice guidelines and insurance coverage of new
technologies. He first began to use the term "evidence-based" in 1987 in workshops and a
manual commissioned by the Council of Medical Specialty Societies to teach formal methods for
designing clinical practice guidelines. The manual was widely available in unpublished form in
the late 1980s and eventually published by the American College of Medicine.[16][17] Eddy first
published the term "evidence-based" in March, 1990 in an article in the Journal of the American
Medical Association that laid out the principles of evidence-based guidelines and population-level
1
policies, which Eddy described as "explicitly describing the available evidence that pertains to a
policy and tying the policy to evidence. Consciously anchoring a policy, not to current practices or
the beliefs of experts, but to experimental evidence. The policy must be consistent with and
supported by evidence. The pertinent evidence must be identified, described, and analyzed.
Medical education[edit]
The term "evidence-based medicine" was introduced slightly later, in the context of medical
education. This branch of evidence-based medicine has its roots in clinical epidemiology. In the
autumn of 1990, Gordon Guyatt used it in an unpublished description of a program at McMaster
University for prospective or new medical students.[21] Guyatt and others first published the term
two years later (1992) to describe a new approach to teaching the practice of medicine.[1]
In 1996, David Sackett and colleagues clarified the definition of this tributary of evidence-based
medicine as "the conscientious, explicit and judicious use of current best evidence in making
decisions about the care of individual patients. ... [It] means integrating individual clinical
expertise with the best available external clinical evidence from systematic research."[22] This
branch of evidence-based medicine aims to make individual decision making more structured
and objective by better reflecting the evidence from research.[23][24] Population-based data are
applied to the care of an individual patient,[25] while respecting the fact that practitioners have
clinical expertise reflected in effective and efficient diagnosis and thoughtful identification and
compassionate use of individual patients' predicaments, rights, and preferences.
Progress[edit]
Both branches of evidence-based medicine spread rapidly. On the evidence-based guidelines
and policies side, explicit insistence on evidence of effectiveness was introduced by the
American Cancer Society in 1980.[31] The U.S. Preventive Services Task Force (USPSTF) began
issuing guidelines for preventive interventions based on evidence-based principles in 1984.[32] In
1985, the Blue Cross Blue Shield Association applied strict evidence-based criteria for covering
new technologies.[33] Beginning in 1987, specialty societies such as the American College of
Physicians, and voluntary health organizations such as the American Heart Association, wrote
many evidence-based guidelines. In 1991, Kaiser Permanente, a managed care organization in
the US, began an evidence-based guidelines program.[34] In 1991, Richard Smith wrote an
editorial in the British Medical Journal and introduced the ideas of evidence-based policies in the
UK.[35] In 1993, the Cochrane Collaboration created a network of 13 countries to produce of
systematic reviews and guidelines.[36] In 1997, the US Agency for Healthcare Research and
Quality (AHRQ, then known as the Agency for Health Care Policy and Research, or AHCPR)
established Evidence-based Practice Centers (EPCs) to produce evidence reports and
technology assessments to support the development of guidelines.[37] In the same year,
a National Guideline Clearinghouse that followed the principles of evidence-based policies was
created by AHRQ, the AMA, and the American Association of Health Plans (now America's
Health Insurance Plans).[38] In 1999, the National Institute for Clinical Excellence (NICE) was
created in the UK.[39] A central idea of this branch of evidence-based medicine is that evidence
should be classified according to the rigor of its experimental design, and the strength of a
recommendation should depend on the strength of the evidence.
Current practice[edit]
In the early 21st century, the term evidence-based medicine was applied to both the programs
that are designing evidence-based guidelines, and to programs that teach evidence-based
medicine to practitioners. By 2000, "evidence-based medicine" had become an umbrella term for
the emphasis on evidence in both population-level and individual-level decisions. In subsequent
years, use of the term "evidence-based" had extended to other levels of the health care system.
An example is "evidence-based health services", which seek to increase the competence of
health service decision makers and the practice of evidence-based medicine at the
organizational or institutional level.[45] The concept had also spread outside of healthcare; for
example, in his 1996 inaugural speech as President of the Royal Statistical Society, Adrian Smith
2
proposed that "evidence-based policy" should be established for education, prisons and policing
policy and all areas of government work.
Methods[edit]
Steps[edit]
The steps for designing explicit, evidence-based guidelines were described in the late 1980s:
Formulate the question (population, intervention, comparison intervention, outcomes, time
horizon, setting); search the literature to identify studies that inform the question; interpret each
study to determine precisely what it says about the question; if several studies address the
question, synthesize their results (meta-analysis); summarize the evidence in "evidence tables";
compare the benefits, harms and costs in a "balance sheet"; draw a conclusion about the
preferred practice; write the guideline; write the rationale for the guideline; have others review
each of the previous steps; implement the guideline.[11]
For the purposes of medical education and individual-level decision making, five steps of EBM in
practice were described in 1992[47] and the experience of delegates attending the 2003
Conference of Evidence-Based Health Care Teachers and Developers was summarized into five
steps and published in 2005.[48] This five step process can broadly be categorized as:
3
Level III: Opinions of respected authorities, based on clinical experience, descriptive
studies, or reports of expert committees.
Systematic reviews may include randomized controlled trials that have low risk of bias, or,
observational studies that have high risk of bias. In the case of randomized controlled trials, the
quality of evidence is high, but can be downgraded in five different domains.[66]
Risk of bias: Is a judgement made on the basis of the chance that bias in included
studies has influenced the estimate of effect.
Imprecision: Is a judgement made on the basis of the chance that the observed estimate
of effect could change completely.
Indirectness: Is a judgement made on the basis of the differences in characteristics of
how the study was conducted and how the results are actually going to be applied.
Inconsistency: Is a judgement made on the basis of the variability of results across the
included studies.
Publication bias: Is a judgement made on the basis of the question whether all the
research evidence has been taken to account.
In the case of observational studies per GRADE, the quality of evidence starts of lower and may
be upgraded in three domains in addition to being subject to downgrading.[66]
Large effect: This is when methodologically strong studies show that the observed effect
is so large that the probability of it changing completely is less likely.
Plausible confounding would change the effect: This is when despite the presence of a
possible confounding factor which is expected to reduce the observed effect, the effect
estimate still shows significant effect.
Dose response gradient: This is when the intervention used becomes more effective with
increasing dose. This suggests that a further increase will likely bring about more effect.
Meaning of the levels of quality of evidence as per GRADE:[65]
High Quality Evidence: The authors are very confident that the estimate that is presented
lies very close to the true value. One could interpret it as "there is very low probability of
further research completely changing the presented conclusions."
Moderate Quality Evidence: The authors are confident that the presented estimate lies
close to the true value, but it is also possible that it may be substantially different. One could
also interpret it as: further research may completely change the conclusions.
Low Quality Evidence: The authors are not confident in the effect estimate and the true
value may be substantially different. One could interpret it as "further research is likely to
change the presented conclusions completely."
Very low quality Evidence: The authors do not have any confidence in the estimate and it
is likely that the true value is substantially different from it. One could interpret it as "new
research will most probably change the presented conclusions completely."
Categories of recommendations[edit]
In guidelines and other publications, recommendation for a clinical service is classified by the
balance of risk versus benefit and the level of evidence on which this information is based. The
U.S. Preventive Services Task Force uses:[67]
Level A: Good scientific evidence suggests that the benefits of the clinical service
substantially outweigh the potential risks. Clinicians should discuss the service with eligible
patients.
Level B: At least fair scientific evidence suggests that the benefits of the clinical service
outweighs the potential risks. Clinicians should discuss the service with eligible patients.
4
Level C: At least fair scientific evidence suggests that there are benefits provided by the
clinical service, but the balance between benefits and risks are too close for making general
recommendations. Clinicians need not offer it unless there are individual considerations.
Level D: At least fair scientific evidence suggests that the risks of the clinical service
outweighs potential benefits. Clinicians should not routinely offer the service to asymptomatic
patients.
Level I: Scientific evidence is lacking, of poor quality, or conflicting, such that the risk
versus benefit balance cannot be assessed. Clinicians should help patients understand the
uncertainty surrounding the clinical service.
GRADE guideline panelists may make strong or weak recommendations on the basis of further
criteria. Some of the important criteria are the balance between desirable and undesirable effects
(not considering cost), the quality of the evidence, values and preferences and costs (resource
utilization).[66]
Statistical measures[edit]
Evidence-based medicine attempts to express clinical benefits of tests and treatments using
mathematical methods. Tools used by practitioners of evidence-based medicine include:
Likelihood ratio
5
Evidence-based medicine attempts to objectively evaluate the quality of clinical research by
critically assessing techniques reported by researchers in their publications.
Trial design considerations. High-quality studies have clearly defined eligibility criteria
and have minimal missing data.
Generalizability considerations. Studies may only be applicable to narrowly defined
patient populations and may not be generalizable to other clinical contexts.
Follow-up. Sufficient time for defined outcomes to occur can influence the prospective
study outcomes and the statistical power of a study to detect differences between a
treatment and control arm.
Power. A mathematical calculation can determine if the number of patients is sufficient to
detect a difference between treatment arms. A negative study may reflect a lack of benefit, or
simply a lack of sufficient quantities of patients to detect a difference.
The theoretical ideal of EBM (that every narrow clinical question, of which hundreds of
thousands can exist, would be answered by meta-analysis and systematic reviews of
multiple RCTs) faces the limitation that research (especially the RCTs themselves) is
expensive; thus, in reality, for the foreseeable future, there will always be much more
demand for EBM than supply, and the best humanity can do is to triage the application of
scarce resources.
Research produced by EBM, such as from randomized controlled trials (RCTs), may not
be relevant for all treatment situations.[73] Research tends to focus on specific populations, but
individual persons can vary substantially from population norms. Since certain population
segments have been historically under-researched (racial minorities and people with co-
morbid diseases), evidence from RCTs may not be generalizable to those populations.
[74]
Thus EBM applies to groups of people, but this should not preclude clinicians from using
their personal experience in deciding how to treat each patient. One author advises that "the
knowledge gained from clinical research does not directly answer the primary clinical
question of what is best for the patient at hand" and suggests that evidence-based medicine
should not discount the value of clinical experience.[60] Another author stated that "the
practice of evidence-based medicine means integrating individual clinical expertise with the
best available external clinical evidence from systematic research."[75]
Research can be influenced by biases such as publication bias and conflict of interest in
academic publishing. For example, studies with conflicts due to industry funding are more
likely to favor their product.[76][77]
There is a lag between when the RCT is conducted and when its results are published.[78]
There is a lag between when results are published and when these are properly applied.
[79]
6
7