Professional Documents
Culture Documents
Meta-Analysis in Research On Nutrition: To The Editor
Meta-Analysis in Research On Nutrition: To The Editor
Meta-analysis in Research on Nutrition 1. Barnard ND, Willett WC, Ding EL. The misuse of meta-analysis in nutrition
research. JAMA. 2017;318(15):1435-1436.
To the Editor Dr Barnard and colleagues1 questioned the valid-
2. Leosdottir M, Nilsson PM, Nilsson JA, Månsson H, Berglund G. Dietary fat
ity of meta-analyses in nutrition research, highlighting the
intake and early mortality patterns—data from the Malmö Diet and Cancer
industry-funded meta-analysis by Chowdhury et al in 2014 Study. J Intern Med. 2005;258(2):153-165.
that failed to support the diet-heart hypothesis, that excess 3. de Souza RJ, Mente A, Maroleanu A, et al. Intake of saturated and trans
saturated fat intake causes cardiovascular disease. Their unsaturated fatty acids and risk of all cause mortality, cardiovascular disease,
argument was that nutritional epidemiological studies are and type 2 diabetes: systematic review and meta-analysis of observational
studies. BMJ. 2015;351:h3978.
complex interventions that do not lend themselves to aggre-
4. Hamley S. The effect of replacing saturated fat with mostly n-6
gation, compared, for example, with drug trials. However,
polyunsaturated fat on coronary heart disease: a meta-analysis of randomised
meta-analyses are useful summaries, offering the reader an controlled trials. Nutr J. 2017;16(1):30.
overview of the available literature, while addressing the 5. Kearns CE, Schmidt LA, Glantz SA. Sugar industry and coronary heart disease
issue of type 2 error by pooling associations or effect mea- research: a historical analysis of internal industry documents. JAMA Intern Med.
sures of individual studies or trials. 2016;176(11):1680-1685.
For example, Barnard and colleagues faulted the 2014
meta-analysis for giving more weight to the Malmö Diet and In Reply A thorough systematic review does provide a helpful
Cancer Study2 (n = 28 098) than to the Oxford Vegetarian Study overview of the literature. However, meta-analysis is a sepa-
(n = 1100), which had results strongly supportive of the diet- rate step, and study findings can be buried in a poorly planned
heart hypothesis. They pointed out that mean saturated fat in- meta-analysis.
takes in the Malmö study were not low enough to test the hy- The meta-analysis by Chowdhury et al1 illustrates the chal-
pothesis that very low intakes of saturated fat protect against lenges. As we noted in our Viewpoint, it combined findings
cardiovascular disease. However, intakes did have sufficient from heterogeneous populations with very different diet pat-
range to test the hypothesis that very high intakes of satu- terns. In making a case for the relative weights given to the
rated fat are harmful compared with intakes closer to those Oxford Vegetarian Study and the Malmö Diet and Cancer Study
specified by dietary guidelines. Men in the Malmö study in the in the Chowdhury et al meta-analysis, Dr Thornley and col-
highest quartile of fat intake (average 47.7% of energy) expe- leagues incorrectly reported the sizes of their data sets. There
rienced the lowest rate of cardiovascular disease deaths (haz- were 20 440 (not 28 098) participants reported for Malmö and
ard ratio [HR], 0.65 [95% CI, 0.45-0.94]).2 There was no dif- 10 802 (not 1100) in Oxford.1 As noted by the authors of the
ference between highest vs lowest saturated fat intake for Malmö study, the high range of saturated fat intake made their
cardiovascular disease mortality in men (22.3% vs 12.3% of en- study of limited value for testing the association between satu-
ergy; HR, 0.94 [95% CI, 0.58-1.53]) or for any cause of death rated fat intake and cardiovascular disease, and saturated fat
in men or women.2 If the hypothesis were true that excess satu- was not compared with other sources of calories.2
rated fat intake caused cardiovascular disease, a dose- Thornley and colleagues cite 2 additional meta-analyses
response relationship would likely be observed. Yet other re- as evidence of the innocuous nature of saturated fat. Al-
cent meta-analyses, including several not funded by industry, though our commentary focused on the limitations of meta-
also fail to support the hypothesis.3,4 Barnard and colleagues analysis rather than a readjudication of saturated fat’s risks,
ignored both evidence of publication bias in favor of the diet- we note that one of Thornley and colleagues’ suggested ar-
heart hypothesis4 and evidence that the sugar industry in the ticles reported, “In large prospective studies, when polyun-
1960s and 1970s supported fat research to deflect attention saturated fats replace saturated fats, risk of CHD [coronary heart
away from sugar as a cause of cardiovascular disease.5 disease] is reduced.”3 Had Chowdhury et al used participant-
We believe that the authors missed the bigger picture level data rather than published aggregate data, such a sub-
shown by the many meta-analyses that address the question stitution analysis would have been possible. Participant-
of the health effects of saturated fat. Statistical evidence sup- level data are not always available; accessing them requires the
porting advice to limit saturated fat intake, after decades of re- cooperation of the original investigators.
search, is still extremely weak. These meta-analyses should be However, the value of substitution analyses in this area
taken seriously and dietary guidelines changed accordingly. was demonstrated in a study of participants in the Nurses’
Health Study and the Health Professionals Follow-up Study
Simon Thornley, MBChB, MPH in which replacement of 5% of energy from saturated fat with
George Henderson equivalent energy from unsaturated fat was associated with a
Grant Schofield, BSc, PhD 27% lower risk of total mortality and lower mortality due to
cardiovascular disease, cancer, and neurodegenerative
Author Affiliations: Millennium Institute, Auckland University of Technology, disease.4 Similarly, in an earlier pooled analysis of individual-
Auckland, New Zealand. level data from prospective studies, replacing 5% of energy
Corresponding Author: George Henderson, Auckland University of from saturated fat with an equivalent quantity of polyunsat-
Technology, PO Box 92006, Auckland 1142, New Zealand urated fat was associated with a 26% lower risk of coronary
(puddleg@gmail.com).
heart disease death.5 This finding is supported by controlled
Conflict of Interest Disclosures: The authors have completed and submitted
feeding studies showing that this substitution leads to ben-
the ICMJE Form for Disclosure of Potential Conflicts of Interest. Dr Schofield
reported receiving royalties for a book on low-carbohydrate eating. No other eficial effects on blood lipids.6 In the pooled analysis, replac-
disclosures were reported. ing saturated fat with carbohydrates (mainly refined starch
1050 JAMA March 13, 2018 Volume 319, Number 10 (Reprinted) jama.com
jama.com (Reprinted) JAMA March 13, 2018 Volume 319, Number 10 1051