Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/380095685

Understanding Evidence Levels in Evidence-Based Medicine: A Guide for


Healthcare Professionals

Article · April 2024

CITATIONS READS

6 133

13 authors, including:

Indunil Karunarathna Konara Kusumarathna


Ministry of Health, Sri Lanka Teaching Hospital, Badulla, SriLanka
36 PUBLICATIONS 156 CITATIONS 24 PUBLICATIONS 137 CITATIONS

SEE PROFILE SEE PROFILE

Pradeep Jayathilaka Thushari Wijewardane


Ministry of Health, Sri Lanka Teaching Hospital Badulla
21 PUBLICATIONS 112 CITATIONS 4 PUBLICATIONS 26 CITATIONS

SEE PROFILE SEE PROFILE

All content following this page was uploaded by Indunil Karunarathna on 25 April 2024.

The user has requested enhancement of the downloaded file.


Understanding Evidence Levels in Evidence-Based
Medicine: A Guide for Healthcare Professionals
Indunil Karunarathna 1 , K.Kusumarathna1 , P.Jayathilaka2 , B.Rathnayake 2 , S Bandara3 , M Abeykoon 4 , N Priyalath 5
,I
Gunarathna 6 , D Disanayake 7 , P Kurukulasooriya 7 , Achala Samarasinghe 8, Charaka Rathnayake9, C J Withanagama 10
1. Department of Anaesthesiology , Intensive Care and Pain Medicine, Teaching Hospital Badulla, Sri Lanka.
2. Department of Medicine, Teaching Hospital Badulla, Sri Lanka.
3. Accident Service, National Hospital Colombo, Sri Lanka.
4. Department of Microbiology, National Hospital Kandy, Sri Lanka.
5. Department of Emergency Medicine, Teaching Hospital Badulla, Sri Lanka.
6. Department of Anaesthesiology , Intensive Care and Pain Medicine, National Hospital Kandy, Sri Lanka.
7. Department of Surgery, Teaching Hospital Badulla, Sri Lanka.
8. Department of Surgery, Base Hospital Diyatalawa, Sri Lanka.
9. Department of Nephrology, Teaching Hospital Badulla, Sri Lanka.
10. Department of Cardiology, Teaching Hospital Badulla, Sri Lanka.

Abstract: In the realm of evidence-based medicine (EBM), understanding the hierarchy of evidence is paramount for healthcare
professionals to make informed clinical decisions. This article provides a comprehensive overview of evidence levels in EBM,
ranging from Level I, which comprises systematic reviews and meta-analyses of randomized controlled trials (RCTs), to Level V,
encompassing expert opinion and descriptive studies. Each evidence level is elucidated with examples and insights into its
significance in guiding clinical practice. By grasping the nuances of evidence levels, clinicians can critically appraise research
findings, integrate the best available evidence with clinical expertise and patient preferences, and ultimately optimize patient
care. This primer serves as a valuable resource for healthcare practitioners seeking to navigate the complex landscape of
evidence-based medicine.

Keywords: Levels of evidence, Evidence-based medicine, Randomized controlled trials, Systematic reviews, Clinical
recommendations, Research methodology, Bias, Specialty-specific evidence, Canadian Task Force, American Society of Plastic
Surgeons, Centre for Evidence-Based Medicine, Critical appraisal, Study design.

Key Points:  Understanding the levels of evidence helps clinicians and


researchers assess the quality and reliability of research
 Levels of evidence were initially developed to assist in findings, informing clinical decision-making.
grading the strength of recommendations based on  It's essential to critically appraise research studies beyond
available research. just their assigned level of evidence, considering factors
 The Canadian Task Force on the Periodic Health such as study design, methodology, and potential biases.
Examination first introduced levels of evidence in 1979,  While randomized controlled trials are often considered
aiming to base health recommendations on the strength of the gold standard, poorly designed RCTs may yield
scientific evidence. misleading results, highlighting the importance of careful
 The hierarchy of evidence typically places randomized scrutiny and critical appraisal.
controlled trials (RCTs) at the highest level due to their  Tailoring levels of evidence to specific specialties and
rigorous design and reduced risk of bias. research questions ensures that recommendations are
 Various organizations and journals have modified the based on the most relevant and reliable scientific
original levels of evidence to suit different specialties and evidence available.
research questions, such as treatment, prognosis,
diagnosis, and economic analysis. Introduction:
 The type and quality of evidence needed can vary
depending on the research question, with different study In the ever-evolving landscape of healthcare, the importance
designs being more appropriate for different types of of evidence-based medicine (EBM) cannot be overstated.
inquiries. EBM integrates the best available research evidence with
 The American Society of Plastic Surgeons (ASPS) and clinical expertise and patient values to inform decision-making
the Centre for Evidence-Based Medicine (CEBM) are and improve patient outcomes. Central to the concept of EBM
examples of organizations that have developed their own is the hierarchy of evidence, which categorizes research
classifications of evidence tailored to their respective studies based on their methodological rigor and quality.
fields. Understanding evidence levels is crucial for healthcare
professionals to critically appraise research findings and make

Uva Clinical | Understanding Evidence Levels in Evidence-Based Medicine: A Guide for Healthcare Professionals 1
informed clinical decisions. In this article, we delve into the studies, such as narrative reviews, expert commentaries, and
different levels of evidence in EBM and their significance in qualitative studies. While expert opinion can offer valuable
guiding clinical practice. insights based on clinical experience and expertise, it is
subjective and may vary among individuals. Descriptive
Level I Evidence: Systematic Reviews and Meta-Analyses of studies provide a qualitative understanding of phenomena but
Randomized Controlled Trials (RCTs) At the top of the lack the rigor of analytical studies. While Level V evidence
evidence hierarchy are systematic reviews and meta-analyses may inform clinical practice in the absence of higher-level
of RCTs. These studies provide the highest level of evidence evidence, it should be interpreted cautiously and supplemented
as they rigorously synthesize findings from multiple RCTs on with stronger evidence whenever possible.
a particular topic. By pooling data from diverse studies,
systematic reviews and meta-analyses offer robust conclusions Conclusion: Evidence levels in EBM serve as a hierarchical
about the efficacy and safety of interventions. They provide framework for evaluating the quality and strength of research
clinicians with evidence-based recommendations that are evidence. By understanding the hierarchy of evidence,
derived from the collective results of high-quality research. healthcare professionals can critically appraise research
findings, make evidence-based decisions, and deliver optimal
Level II Evidence: Individual Randomized Controlled Trials care to patients. While Level I evidence from systematic
Individual RCTs represent the gold standard for evaluating the reviews and meta-analyses of RCTs represents the pinnacle of
effectiveness of healthcare interventions. In these studies, evidence hierarchy, clinicians must consider evidence from all
participants are randomly allocated to treatment or control levels in the context of patient preferences and clinical
groups, minimizing bias and allowing for causal inferences to expertise. By integrating the best available evidence with
be drawn. Level II evidence from well-designed RCTs clinical judgment and patient values, healthcare professionals
provides valuable insights into the efficacy, safety, and can uphold the principles of evidence-based medicine and
tolerability of interventions. Clinicians can rely on findings strive for excellence in patient care.
from individual RCTs to inform their clinical decisions,
particularly when supported by multiple studies or systematic Levels of evidence provide a systematic way to assess the
reviews. quality and strength of scientific evidence supporting a
particular intervention, treatment, or practice. These levels are
Level III Evidence: Well-Designed Controlled Trials Without commonly used in evidence-based medicine to guide clinical
Randomization, Cohort Studies, or Case-Control Studies decision-making. Here are the typical levels of evidence,
Level III evidence encompasses various study designs, ranked from strongest to weakest:
including well-designed controlled trials without
randomization, cohort studies, and case-control studies. While Level I: Evidence from systematic reviews or meta-analyses
these study designs may lack the randomization present in of randomized controlled trials (RCTs).
RCTs, they still provide valuable insights into the associations Level II: Evidence from at least one properly designed
between exposures and outcomes. Cohort studies follow a randomized controlled trial.
group of individuals over time to assess the incidence of Level III: Evidence from well-designed controlled trials
outcomes, while case-control studies compare individuals with without randomization, cohort or case-control analytical
a particular outcome (cases) to those without the outcome studies, multiple time-series designs, or dramatic results from
(controls). Although Level III evidence is considered weaker uncontrolled experiments.
than RCTs, it can still contribute valuable information to Level IV: Evidence from well-designed case series, case-
clinical decision-making, especially when RCT data are control studies, or historically controlled studies.
limited or unavailable. Level V: Evidence from expert opinion or descriptive studies,
such as case reports or expert committees.
Level IV Evidence: Case Series, Case Reports, and Higher levels of evidence, such as Level I and Level II,
Historically Controlled Studies At Level IV, we find case generally carry more weight in guiding clinical practice
series, case reports, and historically controlled studies. These decisions because they are based on rigorous study designs
study designs are characterized by their observational nature with minimized bias. Lower levels of evidence, such as Level
and lack of control groups. Case series and case reports III, IV, and V, provide increasingly weaker support for clinical
describe the experiences of individual patients or small groups recommendations and may be subject to more uncertainty and
of patients with a particular condition or intervention. While potential bias.
these studies may provide anecdotal evidence or generate
hypotheses, they are limited in their ability to establish History of Evidence Base:
causality or generalizability. Historically controlled studies
compare outcomes before and after an intervention but are The concept of levels of evidence traces back to the late 1970s
prone to biases such as confounding and secular trends. when the Canadian Task Force on the Periodic Health
Examination sought to develop evidence-based
Level V Evidence: Expert Opinion and Descriptive Studies recommendations for periodic health exams. Their goal was to
Level V evidence includes expert opinion and descriptive establish a systematic approach for evaluating the
Uva Clinical | Understanding Evidence Levels in Evidence-Based Medicine: A Guide for Healthcare Professionals 2
effectiveness of various interventions by considering evidence diagnosis, or economic/decision analysis. Recognizing this
from the medical literature. To achieve this, they devised a diversity, it became apparent that the type and level of
system of rating evidence, which formed the basis for grading evidence required for each category of question needed to be
recommendations. tailored accordingly.

In 1979, the Task Force introduced a system of rating For instance, the American Society of Plastic Surgeons
evidence, which classified evidence into different grades based (ASPS) developed levels of evidence specifically tailored for
on its quality and reliability. For instance, Grade A prognosis. This adaptation acknowledges that questions
recommendations were assigned when there was robust related to prognosis, which inquire about the natural course of
evidence supporting the inclusion of a particular condition in a disease or condition without interventions, require different
the periodic health exam. This early framework laid the types of studies compared to questions about treatment
groundwork for the subsequent development of levels of efficacy. In prognosis research, the emphasis is on
evidence. understanding what will happen if no intervention is
undertaken. Consequently, cohort studies or systematic
Further refinement and expansion of the levels of evidence reviews of cohort studies are considered the highest level of
were undertaken by David Sackett, a pioneer in evidence- evidence for prognosis questions, as they provide valuable
based medicine, in his work on antithrombotic agents in 1989. insights into the natural history of a condition.
Sackett's contribution expanded upon the initial framework
established by the Canadian Task Force, providing more In contrast, the Centre for Evidence-Based Medicine (CEBM)
detailed criteria for assessing the quality of evidence. has developed levels of evidence focused on treatment
questions. This classification system acknowledges that
Both systems, as described by the Canadian Task Force and randomized controlled trials (RCTs) are often the gold
Sackett, positioned randomized controlled trials (RCTs) at the standard for assessing treatment efficacy. However, it also
apex of the evidence hierarchy. RCTs were deemed to offer the recognizes that not all RCTs are created equal, and poorly
highest level of evidence due to their rigorous design, which designed RCTs may not offer robust evidence. As a result, the
minimizes bias and systematic errors. By randomly assigning CEBM classification system accounts for the quality of data
participants to different treatment groups, RCTs effectively when assigning levels of evidence. For example, poorly
control for confounding variables that could otherwise distort designed RCTs are grouped together with cohort studies,
results. reflecting their comparable levels of evidence.
Conversely, case series and expert opinions were relegated to Table 1: Grades of Recommendation
the lowest levels of evidence. These forms of evidence are
susceptible to bias, often influenced by the subjective Grade of
Level of
experiences or opinions of the authors without adequate Recomme Type of Study
Evidence
control of confounding factors. ndation
Systematic review of (homogeneous)
Overall, the levels of evidence framework developed by the A 1a randomized
Canadian Task Force and refined by Sackett provided a controlled trials
structured approach to evaluating evidence, enabling clinicians Individual randomized controlled trials
and researchers to make informed decisions based on the A 1b (with narrow
strength and reliability of available evidence. This framework confidence intervals)
continues to be a cornerstone of evidence-based medicine, Systematic review of (homogeneous)
guiding medical practice and research methodology B 2a cohort studies
worldwide. of "exposed" and "unexposed" subjects
Individual cohort study / low-quality
Evolution of evidence-based medicine: B 2b randomized
control studies
The evolution of evidence-based medicine has led to the Systematic review of (homogeneous)
recognition that a one-size-fits-all approach to levels of B 3a
case-control studies
evidence may not adequately address the diverse range of B 3b Individual case-control studies
research questions across different medical specialties. Case series, low-quality cohort or case-
C 4
Consequently, various organizations and journals have control studies
developed modifications or variations of the classification Expert opinions based on non-systematic
system to better suit their specific needs and the nature of the D 5 reviews of
questions being asked. results or mechanistic studies

Different specialties often pose distinct types of research


questions, such as those pertaining to treatment, prognosis,

Uva Clinical | Understanding Evidence Levels in Evidence-Based Medicine: A Guide for Healthcare Professionals 3
These modifications to the levels of evidence framework Level IX: Evidence from opinion of authorities and/or reports
underscore the importance of tailoring the classification of expert committee.
system to the specific research questions at hand and
considering the quality of the data available. By doing so, Remember: Randomized controlled trials represent a higher
researchers and clinicians can better evaluate the strength and level of evidence than studies where subject selection is not
reliability of evidence, ultimately enhancing the practice of random.
evidence-based medicine across diverse medical specialties.
Controlled studies carry a higher level of evidence than those
Table 2: Levels of Evidence: without control groups.

Table 3: levels provide a framework for evaluating the


strength of evidence in therapeutic studies:

Level Type of Evidence

1A Systematic review (with homogeneity) of RCTs

1B Individual RCT (with narrow confidence intervals)

1C All or none study

Systematic review (with homogeneity) of cohort


2A studies

Individual Cohort study (including low quality RCT,


Levels of evidence based on the criteria provided:
2B e.g. <80% follow-up)
Filtered evidence:
2C "Outcomes" research; Ecological studies
Level I: Evidence from a systematic review of all relevant
randomized controlled trials. Systematic review (with homogeneity) of case-control
Level II: Evidence from a meta-analysis of all relevant 3A studies
randomized controlled trials.
Level III: Evidence from evidence summaries developed from 3B Individual Case-control study
systematic reviews.
Level IV: Evidence from guidelines developed from Case series (and poor quality cohort and case-control
systematic reviews. 4 study)
Level V: Evidence from meta-syntheses of a group of
descriptive or qualitative studies. Expert opinion without explicit critical appraisal or
Level VI: Evidence from evidence summaries of individual based on physiology bench research or "first
studies. 5 principles"
Level VII: Evidence from one properly designed randomized
controlled trial. These levels provide a framework for evaluating the strength of
Unfiltered evidence: evidence in therapeutic studies, ranging from systematic reviews of
randomized controlled trials (RCTs) at Level 1A to expert opinion at
Level VIII: Evidence from nonrandomized controlled clinical Level 5.
trials, nonrandomized clinical trials, cohort studies, case
series, case reports, and individual qualitative studies.

Uva Clinical | Understanding Evidence Levels in Evidence-Based Medicine: A Guide for Healthcare Professionals 4
Table 4: Strength of recommendations:

Grade Descriptor Qualifying Evidence Implications for Practice

Strong Level I evidence or consistent findings from Clinicians should follow a strong recommendation unless a clear
A recommendation multiple studies of levels II, III, or IV and compelling rationale for an alternative approach is present

Levels II, III, or IV evidence and findings Generally, clinicians should follow a recommendation but should
B Recommendation are generally consistent remain alert to new information and sensitive to patient preferences

Clinicians should be flexible in their decision-making regarding


Levels II, III, or IV evidence, but findings appropriate practice, although they may set bounds on alternatives;
C Option are inconsistent patient preference should have a substantial influencing role

Clinicians should consider all options in their decision making and


be alert to new published evidence that clarifies the balance of
Level V evidence: little or no systematic benefit versus harm; patient preference should have a substantial
D Option empirical evidence influencing role

These grades provide guidance on the strength of recommendations for clinical practice based on the available evidence, ranging from strong
recommendations supported by high-quality evidence to options based on limited or inconsistent evidence.

Strength of Recommendation Taxonomy (SORT): findings. While assigning a level to research papers helps
readers gauge the quality of evidence, it's essential to
The Strength of Recommendation Taxonomy (SORT) used by recognize that the designated level doesn't always guarantee
the American Academy of Family Physicians categorizes the quality of the research itself. This is particularly pertinent
recommendations based on the quality and consistency of in fields like Plastic Surgery, where innovation and technique
available evidence. Here's how it works: articles are integral to advancing the specialty, even if they
may have lower levels of evidence.
A: Recommendation based on consistent and good-quality
patient-oriented evidence: This includes evidence from well- Randomized Controlled Trials (RCTs) are often considered the
conducted randomized controlled trials (RCTs), meta- gold standard in evidence hierarchy, typically receiving the
analyses, or systematic reviews of RCTs. highest level of evidence designation. However, not all RCTs
are conducted equally, and their results should be critically
B: Recommendation based on inconsistent or limited-
evaluated. It's important to assess factors such as
quality patient-oriented evidence: This category involves
randomization, blinding, sample size, withdrawals, confidence
evidence from observational studies, unsystematic clinical
intervals, and power analysis when interpreting RCT findings.
experience, or randomized controlled trials with some
Tools like the Jadad scale can assist in judging the quality of
limitations.
RCTs, although basic considerations can also be helpful.
C: Recommendation based on consensus, usual practice,
For instance, a study by Bhandari et al. evaluated the quality
opinion, disease-oriented evidence, or case series for
of surgical RCTs published in the Journal of Bone and Joint
studies of diagnosis, treatment, prevention, or screening:
Surgery (JBJS). They found that a significant proportion of
This category includes evidence from expert opinion, clinical
papers scored below the threshold for high quality, primarily
experience, or reports of expert committees.
due to issues with randomization, blinding, and patient
SORT grades help clinicians evaluate the strength of exclusion criteria. Interestingly, another study observed
recommendations in clinical review articles and make similar quality scores for level 1 and level 2 studies,
informed decisions about patient care. challenging the assumption that level 1 studies inherently have
superior quality.
Interpretation of levels:
Surgeons can refer to user guides published in journals like the
Understanding the levels of evidence in research is crucial for Canadian Journal of Surgery and the Journal of Bone and Joint
accurately interpreting the strength and reliability of scientific Surgery for assistance in appraising levels of evidence. These

Uva Clinical | Understanding Evidence Levels in Evidence-Based Medicine: A Guide for Healthcare Professionals 5
guides provide valuable frameworks for evaluating research 3. Can you provide examples of Level I evidence and
quality and understanding the implications of different levels explain why it is considered the strongest form of
of evidence. Additionally, resources like publications in the evidence?
Journal of the American Medical Association offer broader
insights applicable across medical disciplines, aiding surgeons 4. How do lower levels of evidence, such as expert opinions
in making informed decisions based on the available evidence. and case reports, contribute to clinical decision-making?

Conclusion: 5. What factors should clinicians consider when appraising


evidence from clinical studies?
In conclusion, understanding the levels of evidence in
evidence-based medicine is essential for healthcare 6. How does evidence-based medicine help clinicians make
practitioners striving to provide high-quality patient care. By informed decisions about patient care?
recognizing the hierarchy of evidence, clinicians can critically
7. In what situations might lower levels of evidence be more
evaluate research findings and apply the most robust evidence
appropriate or applicable than higher levels of evidence?
to clinical decision-making.
8. What role do patient values and preferences play in
Systematic reviews and meta-analyses of randomized
evidence-based practice?
controlled trials (Level I evidence) provide the strongest
evidence for clinical interventions, offering insights into 9. How can healthcare professionals stay updated on the
treatment efficacy and safety. As evidence moves down the latest evidence and research findings in their field?
hierarchy to lower levels, such as observational studies and
expert opinions, the reliability and applicability of findings 10. Can you provide examples of how evidence-based
may diminish. However, lower-level evidence still holds value medicine has positively impacted patient outcomes or
in certain contexts, particularly when higher-level evidence is healthcare practices?
lacking or when considering patient preferences and clinical
expertise.
References:
Clinicians should approach evidence appraisal with a critical
mindset, considering factors such as study design, sample size, 1. McCarthy CM, Collins ED, Pusic AL. Where do we find the best
bias, and clinical relevance. Additionally, integrating patient evidence? Plast Reconstr Surg. 2008;122:1942–1947. [PubMed] [Google
values and preferences into the decision-making process is Scholar]

essential for patient-centered care. 2. Chung KC, Swanson JA, Schmitz D, Sullivan D, Rohrich RJ. Introducing
evidence-based medicine to plastic and reconstructive surgery. Plast Reconstr
By mastering the principles of evidence-based medicine and Surg. 2009;123:1385–1389. [PMC free article] [PubMed] [Google Scholar]
applying them judiciously in clinical practice, healthcare
3. Chung KC, Ram AN. Evidence-based medicine: the fourth revolution in
professionals can enhance patient outcomes, improve American medicine? Plast Reconstr Surg. 2009;123:389–398. [PMC free
healthcare quality, and contribute to the advancement of article] [PubMed] [Google Scholar]
medical knowledge.
4. Rohrich RJ. So you want to be better: the role of evidence-based medicine in
plastic surgery. Plast Reconstr Surg. 2010;126:1395–1398. [PubMed] [Google
Authors’ Contributions: Scholar]

The manuscript's conception and writing were undertaken by 5. Burns PB, Chung KC. Developing good clinical questions and finding the
best evidence to answer those questions. Plast Reconstr Surg. 2010;126:613–
I.K. Contributions to the manuscript's revisions were made by
618. [PMC free article] [PubMed] [Google Scholar]
other co-authors. All authors participated in the article's
creation, provided substantial input during the revision 6. Sprague S, McKay P, Thoma A. Study design and hierarchy of evidence for
process, and approved the final submitted version. surgical decision making. Clin Plast Surg. 2008;35:195–205. [PubMed] [Google
Scholar]

Declaration of Interest: 7. The periodic health examination. Canadian Task Force on the Periodic Health
Examination. Can Med Assoc J. 1979;121:1193–1254. [PMC free
article] [PubMed] [Google Scholar]
No conflicts of interest were declared by the authors.
8. Sackett DL. Rules of evidence and clinical recommendations on the use of
antithrombotic agents. Chest. 1989;95:2S–4S. [PubMed] [Google Scholar]
Questions:
9. American Society of Plastic Surgeons. [Accessed December 17,
2010]; Available
1. What are the different levels of evidence in evidence-
at: http://www.plasticsurgery.org/Medical_Professionals/Health_Policy_and_Ad
based medicine, and how are they categorized? vocacy/Health_Policy_Resources/Evidence-
based_GuidelinesPractice_Parameters/Description_and_Development_of_Evide
2. Why is it important for healthcare practitioners to nce-based_Practice_Guidelines/ASPS_Evidence_Rating_Scales.html.
understand the hierarchy of evidence?
Uva Clinical | Understanding Evidence Levels in Evidence-Based Medicine: A Guide for Healthcare Professionals 6
10. Centre for Evidence Based Medicine. [Accessed December 17, 26. Duvic M, Moore D, Menter A, Vonderheid EC. Cutaneous T-cell lymphoma
2010]; Available at http://www.cebm.net. in association with silicone breast implants. J Am Acad Dermatol. 1995;32:939–
942. [PubMed] [Google Scholar]
11. Jadad AR, Moore RA, Carroll D, et al. Assessing the quality of reports of
randomized clinical trials: is blinding necessary? Control Clin 27. Lipworth L, Tarone RE, McLaughlin JK. Breast implants and lymphoma
Trials. 1996;17:1–12. [PubMed] [Google Scholar] risk: a review of the epidemiologic evidence through 2008. Plast Reconstr
Surg. 2009;123:790–793. [PubMed] [Google Scholar]
12. Bhandari M, Richards RR, Sprague S, Schemitsch EH. The quality of
reporting of randomized trials in the Journal of Bone and Joint Surgery from 28. Lipworth L, Tarone RE, Friis S, et al. Cancer among Scandinavian women
1988 through 2000. J Bone Joint Surg Am. 2002;84-A:388– with cosmetic breast implants: a pooled long-term follow-up study. International
396. [PubMed] [Google Scholar] Journal of Cancer. 2009;124:490–493. [PubMed] [Google Scholar]

13. Poolman RW, Struijs PA, Krips R, Sierevelt IN, Lutz KH, Bhandari M. Does 29. Deapen DM, Hirsch EM, Brody GS. Cancer risk among Los Angeles women
a "Level I Evidence" rating imply high quality of reporting in orthopaedic with cosmetic breast implants. Plast Reconstr Surg. 2007;119:1987–
randomised controlled trials? BMC Med Res Methodol. 2006;6:44. [PMC free 1992. [PubMed] [Google Scholar]
article] [PubMed] [Google Scholar]
30. Brisson J, Holowaty EJ, Villeneuve PJ, et al. Cancer incidence in a cohort of
14. Urschel JD, Goldsmith CH, Tandan VR, Miller JD. Users' guide to evidence- Ontario and Quebec women having bilateral breast augmentation. Int J
based surgery: how to use an article evaluating surgical interventions. Evidence- Cancer. 2006;118:2854–2862. [PubMed] [Google Scholar]
Based Surgery Working Group. Can J Surg. 2001;44:95–100. [PMC free
article] [PubMed] [Google Scholar] 31. Pukkala E, Boice JD, Jr, Hovi SL, et al. Incidence of breast and other
cancers among Finnish women with cosmetic breast implants, 1970–1999. J
15. Thoma A, Farrokhyar F, Bhandari M, Tandan V. Users' guide to the surgical Long Term Eff Med Implants. 2002;12:271–279. [PubMed] [Google Scholar]
literature. How to assess a randomized controlled trial in surgery. Can J
Surg. 2004;47:200–208. [PMC free article] [PubMed] [Google Scholar] 32. Brinton LA, Lubin JH, Burich MC, Colton T, Brown SL, Hoover RN.
Cancer risk at sites other than the breast following augmentation
16. Bhandari M, Guyatt GH, Swiontkowski MF. User's guide to the orthopaedic mammoplasty. Ann Epidemiol. 2001;11:248–256. [PubMed] [Google Scholar]
literature: how to use an article about prognosis. J Bone Joint Surg Am. 2001;83-
A:1555–1564. [PubMed] [Google Scholar] 33. Denkler K. A comprehensive review of epinephrine in the finger: to do or
not to do. Plast Reconstr Surg. 2001;108:114–124. [PubMed] [Google Scholar]
17. Guyatt GH, Sackett DL, Cook DJ. Users' guides to the medical literature. II.
How to use an article about therapy or prevention. A. Are the results of the study 34. Thomson CJ, Lalonde DH, Denkler KA, Feicht AJ. A critical look at the
valid? Evidence-Based Medicine Working Group. JAMA. 1993;270:2598– evidence for and against elective epinephrine use in the finger. Plast Reconstr
2601. [PubMed] [Google Scholar] Surg. 2007;119:260–266. [PubMed] [Google Scholar]

18. Guyatt GH, Haynes RB, Jaeschke RZ, et al. Users' Guides to the Medical 35. Lalonde D, Bell M, Benoit P, Sparkes G, Denkler K, Chang P. A multicenter
Literature: XXV. Evidence-based medicine: principles for applying the Users' prospective study of 3,110 consecutive cases of elective epinephrine use in the
Guides to patient care. Evidence-Based Medicine Working fingers and hand: the Dalhousie Project clinical phase. J Hand Surg
Group. JAMA. 2000;284:1290–1296. [PubMed] [Google Scholar] Am. 2005;30:1061–1067. [PubMed] [Google Scholar]

19. Loiselle F, Mahabir RC, Harrop AR. Levels of evidence in plastic surgery 36. Chowdhry S, Seidenstricker L, Cooney DS, Hazani R, Wilhelmi BJ. Do not
research over 20 years. Plast Reconstr Surg. 2008;121:207e– use epinephrine in digital blocks: myth or truth? Part II. A retrospective review
211e. [PubMed] [Google Scholar] of 1111 cases. Plast Reconstr Surg. 2010;126:2031–2034. [PubMed] [Google
Scholar]
20. McCarthy JE, Chatterjee A, McKelvey TG, Jantzen EM, Kerrigan CL. A
detailed analysis of level I evidence (randomized controlled trials and meta- 37. Wilhelmi BJ, Blackwell SJ, Miller JH, et al. Do not use epinephrine in
analyses) in five plastic surgery journals to date: 1978 to 2009. Plast Reconstr digital blocks: myth or truth? Plast Reconstr Surg. 2001;107:393–
Surg. 2010;126:1774–1778. [PubMed] [Google Scholar] 397. [PubMed] [Google Scholar]

21. Chung KC, Kalliainen LK, Spilson SV, Walters MR, Kim HM. The 38. Concato J, Shah N, Horwitz RI. Randomized, controlled trials, observational
prevalence of negative studies with inadequate statistical power: an analysis of studies, and the hierarchy of research designs. N Engl J Med. 2000;342:1887–
the plastic surgery literature. Plast Reconstr Surg. 2002;109:1– 1892. [PMC free article] [PubMed] [Google Scholar]
6. [PubMed] [Google Scholar]

22. Newman MK, Zemmel NJ, Bandak AZ, Kaplan BJ. Primary breast
lymphoma in a patient with silicone breast implants: a case report and review of
the literature. J Plast Reconstr Aesthet Surg. 2008;61:822–
825. [PubMed] [Google Scholar]

23. Gaudet G, Friedberg JW, Weng A, Pinkus GS, Freedman AS. Breast
lymphoma associated with breast implants: two case-reports and a review of the
literature. Leuk Lymphoma. 2002;43:115–119. [PubMed] [Google Scholar]

24. Sahoo S, Rosen PP, Feddersen RM, Viswanatha DS, Clark DA, Chadburn A.
Anaplastic large cell lymphoma arising in a silicone breast implant capsule: a
case report and review of the literature. Arch Pathol Lab Med. 2003;127:e115–
e118. [PubMed] [Google Scholar]

25. Keech JA, Jr, Creech BJ. Anaplastic T-cell lymphoma in proximity to a
saline-filled breast implant. Plast Reconstr Surg. 1997;100:554–
555. [PubMed] [Google Scholar]

Uva Clinical | Understanding Evidence Levels in Evidence-Based Medicine: A Guide for Healthcare Professionals 7

View publication stats

You might also like