Download as pdf or txt
Download as pdf or txt
You are on page 1of 2

Letters

Meta-analysis in Research on Nutrition 1. Barnard ND, Willett WC, Ding EL. The misuse of meta-analysis in nutrition
research. JAMA. 2017;318(15):1435-1436.
To the Editor Dr Barnard and colleagues1 questioned the valid-
2. Leosdottir M, Nilsson PM, Nilsson JA, Månsson H, Berglund G. Dietary fat
ity of meta-analyses in nutrition research, highlighting the
intake and early mortality patterns—data from the Malmö Diet and Cancer
industry-funded meta-analysis by Chowdhury et al in 2014 Study. J Intern Med. 2005;258(2):153-165.
that failed to support the diet-heart hypothesis, that excess 3. de Souza RJ, Mente A, Maroleanu A, et al. Intake of saturated and trans
saturated fat intake causes cardiovascular disease. Their unsaturated fatty acids and risk of all cause mortality, cardiovascular disease,
argument was that nutritional epidemiological studies are and type 2 diabetes: systematic review and meta-analysis of observational
studies. BMJ. 2015;351:h3978.
complex interventions that do not lend themselves to aggre-
4. Hamley S. The effect of replacing saturated fat with mostly n-6
gation, compared, for example, with drug trials. However,
polyunsaturated fat on coronary heart disease: a meta-analysis of randomised
meta-analyses are useful summaries, offering the reader an controlled trials. Nutr J. 2017;16(1):30.
overview of the available literature, while addressing the 5. Kearns CE, Schmidt LA, Glantz SA. Sugar industry and coronary heart disease
issue of type 2 error by pooling associations or effect mea- research: a historical analysis of internal industry documents. JAMA Intern Med.
sures of individual studies or trials. 2016;176(11):1680-1685.
For example, Barnard and colleagues faulted the 2014
meta-analysis for giving more weight to the Malmö Diet and In Reply A thorough systematic review does provide a helpful
Cancer Study2 (n = 28 098) than to the Oxford Vegetarian Study overview of the literature. However, meta-analysis is a sepa-
(n = 1100), which had results strongly supportive of the diet- rate step, and study findings can be buried in a poorly planned
heart hypothesis. They pointed out that mean saturated fat in- meta-analysis.
takes in the Malmö study were not low enough to test the hy- The meta-analysis by Chowdhury et al1 illustrates the chal-
pothesis that very low intakes of saturated fat protect against lenges. As we noted in our Viewpoint, it combined findings
cardiovascular disease. However, intakes did have sufficient from heterogeneous populations with very different diet pat-
range to test the hypothesis that very high intakes of satu- terns. In making a case for the relative weights given to the
rated fat are harmful compared with intakes closer to those Oxford Vegetarian Study and the Malmö Diet and Cancer Study
specified by dietary guidelines. Men in the Malmö study in the in the Chowdhury et al meta-analysis, Dr Thornley and col-
highest quartile of fat intake (average 47.7% of energy) expe- leagues incorrectly reported the sizes of their data sets. There
rienced the lowest rate of cardiovascular disease deaths (haz- were 20 440 (not 28 098) participants reported for Malmö and
ard ratio [HR], 0.65 [95% CI, 0.45-0.94]).2 There was no dif- 10 802 (not 1100) in Oxford.1 As noted by the authors of the
ference between highest vs lowest saturated fat intake for Malmö study, the high range of saturated fat intake made their
cardiovascular disease mortality in men (22.3% vs 12.3% of en- study of limited value for testing the association between satu-
ergy; HR, 0.94 [95% CI, 0.58-1.53]) or for any cause of death rated fat intake and cardiovascular disease, and saturated fat
in men or women.2 If the hypothesis were true that excess satu- was not compared with other sources of calories.2
rated fat intake caused cardiovascular disease, a dose- Thornley and colleagues cite 2 additional meta-analyses
response relationship would likely be observed. Yet other re- as evidence of the innocuous nature of saturated fat. Al-
cent meta-analyses, including several not funded by industry, though our commentary focused on the limitations of meta-
also fail to support the hypothesis.3,4 Barnard and colleagues analysis rather than a readjudication of saturated fat’s risks,
ignored both evidence of publication bias in favor of the diet- we note that one of Thornley and colleagues’ suggested ar-
heart hypothesis4 and evidence that the sugar industry in the ticles reported, “In large prospective studies, when polyun-
1960s and 1970s supported fat research to deflect attention saturated fats replace saturated fats, risk of CHD [coronary heart
away from sugar as a cause of cardiovascular disease.5 disease] is reduced.”3 Had Chowdhury et al used participant-
We believe that the authors missed the bigger picture level data rather than published aggregate data, such a sub-
shown by the many meta-analyses that address the question stitution analysis would have been possible. Participant-
of the health effects of saturated fat. Statistical evidence sup- level data are not always available; accessing them requires the
porting advice to limit saturated fat intake, after decades of re- cooperation of the original investigators.
search, is still extremely weak. These meta-analyses should be However, the value of substitution analyses in this area
taken seriously and dietary guidelines changed accordingly. was demonstrated in a study of participants in the Nurses’
Health Study and the Health Professionals Follow-up Study
Simon Thornley, MBChB, MPH in which replacement of 5% of energy from saturated fat with
George Henderson equivalent energy from unsaturated fat was associated with a
Grant Schofield, BSc, PhD 27% lower risk of total mortality and lower mortality due to
cardiovascular disease, cancer, and neurodegenerative
Author Affiliations: Millennium Institute, Auckland University of Technology, disease.4 Similarly, in an earlier pooled analysis of individual-
Auckland, New Zealand. level data from prospective studies, replacing 5% of energy
Corresponding Author: George Henderson, Auckland University of from saturated fat with an equivalent quantity of polyunsat-
Technology, PO Box 92006, Auckland 1142, New Zealand urated fat was associated with a 26% lower risk of coronary
(puddleg@gmail.com).
heart disease death.5 This finding is supported by controlled
Conflict of Interest Disclosures: The authors have completed and submitted
feeding studies showing that this substitution leads to ben-
the ICMJE Form for Disclosure of Potential Conflicts of Interest. Dr Schofield
reported receiving royalties for a book on low-carbohydrate eating. No other eficial effects on blood lipids.6 In the pooled analysis, replac-
disclosures were reported. ing saturated fat with carbohydrates (mainly refined starch

1050 JAMA March 13, 2018 Volume 319, Number 10 (Reprinted) jama.com

© 2018 American Medical Association. All rights reserved.

Downloaded From: by a INSEAD User on 03/14/2018


Letters

and sugar in most populations) was associated with a some- CORRECTION


what higher risk of coronary heart disease. The Chowdhury
Typo in the Discussion: In the Original Investigation entitled “Effect of Antibiotic
et al analysis was not able to distinguish between the sources Prophylaxis on Surgical Site Infections Following Removal of Orthopedic Implants
of energy that would replace saturated fat. Had it pursued Used for Treatment of Foot, Ankle, and Lower Leg Fractures: A Randomized Clinical
stronger methods, it may have yielded something other than Trial”1 published in the December 26, 2017, issue of JAMA, in the Discussion section,
it reads, “There were numerically more deep SSIs in the saline group than in the
a null result. cefazolin group (1 patient [0.9%] in the cefazolin group vs 7 patients [2.9%] in
Well-conducted systematic reviews are helpful. To the ex- the saline group)….” It should read, “There were numerically more deep SSIs in the
tent that meta-analysis is done only when appropriate and uses saline group than in the cefazolin group (1 patient [0.4%] in the cefazolin group
vs 7 patients [2.9%] in the saline group)….” This article was corrected online.
the best available methodology, consumers of research find-
1. Backes M, Dingemans SA, Dijkgraaf MGW, et al. Effect of antibiotic
ings are better served.
prophylaxis on surgical site infections following removal of orthopedic implants
used for treatment of foot, ankle, and lower leg fractures: a randomized clinical
Neal D. Barnard, MD trial. JAMA. 2017;318(24):2438-2445.
Walter C. Willett, MD, DrPH
Author Added to Byline: In the article entitled “Effect of Therapeutic Hypother-
Eric L. Ding, ScD
mia Initiated After 6 Hours of Age on Death or Disability Among Newborns With
Hypoxic-Ischemic Encephalopathy: A Randomized Clinical Trial,”1 published in the
Author Affiliations: Physicians Committee for Responsible Medicine, October 24/31, 2017, issue of JAMA, an author was omitted from the byline due to
Washington, DC (Barnard); Department of Nutrition, Harvard T.H. Chan School an oversight by a principal investigator and coordinator at one of the centers. Amir
of Public Health, Boston, Massachusetts (Willett, Ding). M. Khan’s name should have appeared in the byline, which should have read as
Corresponding Author: Neal D. Barnard, MD, Physicians Committee for follows: Abbot R. Laptook, MD; Seetha Shankaran, MD; Jon E. Tyson, MD, MPH;
Responsible Medicine, 5100 Wisconsin Ave, Ste 400, Washington, DC 20016 Breda Munoz, PhD; Edward F. Bell, MD; Ronald N. Goldberg, MD; Nehal A. Parikh,
(nbarnard@pcrm.org). DO, MS; Namasivayam Ambalavanan, MD; Claudia Pedroza, PhD; Athina Pappas,
Conflict of Interest Disclosures: The authors have completed and submitted MD; Abhik Das, PhD; Aasma S. Chaudhary, BS, RRT; Richard A. Ehrenkranz, MD;
the ICMJE Form for Disclosure of Potential Conflicts of Interest. Dr Barnard Angelita M. Hensman, MS, RNC-NIC; Krisa P. Van Meurs, MD; Lina F. Chalak, MD,
reported serving as president of the Physicians Committee for Responsible MSCS; Amir M. Khan, MD; Shannon E. G. Hamrick, MD; Gregory M. Sokol, MD;
Medicine and Barnard Medical Center; receiving personal fees for lectures Michele C. Walsh, MD, MS; Brenda B. Poindexter, MD, MS; Roger G. Faix, MD; Kristi
related to nutrition and health; and receiving royalties for books related to L. Watterberg, MD; Ivan D. Frantz III, MD; Ronnie Guillet, MD, PhD; Uday Devaskar,
nutrition and health. Dr Willett reported receiving research support from the MD; William E. Truog, MD; Valerie Y. Chock, MD, MS-Epi; Myra H. Wyckoff, MD;
National Institutes of Health and the Breast Cancer Research Foundation; Elisabeth C. McGowan, MD; David P. Carlton, MD; Heidi M. Harmon, MD, MS; Jane
royalties for books related to nutrition and epidemiology; and honoraria for E. Brumbaugh, MD; C. Michael Cotten, MD, MHS; Pablo J. Sánchez, MD; Anna Maria
lectures with the Culinary Institute of America. Dr Ding reported receiving Hibbs, MD; Rosemary D. Higgins, MD. In the Author Affiliations section, Dr Khan
research funding from the American Heart Association, American Diabetes should have been listed along with Drs Tyson and Pedroza as follows: “Depart-
Association, the Robert Wood Johnson Foundation, the Qatar National ment of Pediatrics, McGovern Medical School at the University of Texas Health Sci-
Research Fund, and the Nordea Foundation; consulting for the Physicians ence Center at Houston (Tyson, Pedroza, Khan).” The Author Contributions sec-
Committee for Responsible Medicine and Naturex; receiving personal fees from tion should have read as follows: “Author Contributions: Ms Munoz and Dr Pedroza
the University of Connecticut, the University of Arizona, the University of had full access to all of the data in the study and take responsibility for the integ-
California at Berkeley, and the European Commission; and being a board rity of the data and the accuracy of the data analysis. Concept and design: Laptook,
member of the nonprofit ToxinAlert.org, a minority shareholder in Epidemic Shankaran, Tyson, Bell, Parikh, Ambalavanan, Pedroza, Pappas, Das, Ehrenkranz,
Health, a health economist at the nonprofit Microclinic International, and a Hensman, Chalak, Frantz, Devaskar, Carlton, Sánchez, Higgins. Acquisition, analy-
faculty lecturer at Management Center Innsbruck, Austria. sis, or interpretation of data: Laptook, Shankaran, Munoz, Bell, Goldberg, Parikh,
Ambalavanan, Pedroza, Pappas, Das, Chaudhary, Ehrenkranz, Hensman, Van Meurs,
1. Chowdhury R, Warnakula S, Kunutsor S, et al. Association of dietary, Chalak, Khan, Hamrick, Sokol, Walsh, Poindexter, Faix, Watterberg, Frantz, Guillet,
circulating, and supplement fatty acids with coronary risk: a systematic review Devaskar, Truog, Chock, Wyckoff, McGowan, Harmon, Brumbaugh, Cotten,
and meta-analysis. Ann Intern Med. 2014;160(6):398-406. Sánchez, Hibbs, Higgins. Drafting of the manuscript: Laptook, Tyson, Munoz,
2. Wallström P, Sonestedt E, Hlebowicz J, et al. Dietary fiber and saturated fat Ambalavanan, Pedroza, Khan, Sánchez. Critical revision of the manuscript for im-
intake associations with cardiovascular disease differ by sex in the Malmö Diet portant intellectual content: Laptook, Shankaran, Tyson, Bell, Goldberg, Parikh,
and Cancer Cohort: a prospective study. PLoS One. 2012;7(2):e31637. Ambalavanan, Pappas, Das, Chaudhary, Ehrenkranz, Hensman, Van Meurs, Chalak,
3. de Souza RJ, Mente A, Maroleanu A, et al. Intake of saturated and trans Hamrick, Sokol, Walsh, Poindexter, Faix, Watterberg, Frantz, Guillet, Devaskar,
unsaturated fatty acids and risk of all cause mortality, cardiovascular disease, Truog, Chock, Wyckoff, McGowan, Carlton, Harmon, Brumbaugh, Cotten, Sánchez,
and type 2 diabetes: systematic review and meta-analysis of observational Hibbs, Higgins. Statistical analysis: Shankaran, Tyson, Munoz, Pedroza, Das.
studies. BMJ. 2015;351:h3978. Obtained funding: Shankaran, Bell, Ambalavanan, Hensman, Walsh, Faix, Frantz
III, Truog, Carlton, Cotten, Sánchez. Administrative, technical, or material support:
4. Wang DD, Li Y, Chiuve SE, et al. Association of specific dietary fats with total Bell, Goldberg, Chaudhary, Hensman, Chalak, Khan, Hamrick, Faix, Devaskar, Chock,
and cause-specific mortality. JAMA Intern Med. 2016;176(8):1134-1145. Wyckoff, McGowan, Carlton, Hibbs, Higgins. Supervision: Shankaran, Bell, Goldberg,
5. Jakobsen MU, O’Reilly EJ, Heitmann BL, et al. Major types of dietary fat and Das, Hensman, Sokol, Poindexter, Faix, Frantz, Truog, Wyckoff, Carlton, Cotten,
risk of coronary heart disease: a pooled analysis of 11 cohort studies. Am J Clin Nutr. Higgins.” This article was corrected online.
2009;89(5):1425-1432. 1. Laptook AR, Shankaran S, Tyson JE, et al; Eunice Kennedy Shriver National
6. Mensink RP, Zock PL, Kester ADM, Katan MB. Effects of dietary fatty acids Institute of Child Health and Human Development Neonatal Research Network.
and carbohydrates on the ratio of serum total to HDL cholesterol and on serum Effect of therapeutic hypothermia initiated after 6 hours of age on death or
lipids and apolipoproteins: a meta-analysis of 60 controlled trials. Am J Clin Nutr. disability among newborns with hypoxic-ischemic encephalopathy:
2003;77(5):1146-1155. a randomized clinical trial. JAMA. 2017;318(16):1550-1560.

jama.com (Reprinted) JAMA March 13, 2018 Volume 319, Number 10 1051

© 2018 American Medical Association. All rights reserved.

Downloaded From: by a INSEAD User on 03/14/2018

You might also like