Professional Documents
Culture Documents
2
2
Supplemental content
IMPORTANCE Sex-associated differences in immune response are known, but a meta-analysis
suggested men, compared with women, derive greater value from immunotherapy for
advanced solid-organ malignant neoplasms. However, methodologic concerns and
subsequent trials have placed these results in doubt.
MAIN OUTCOMES AND MEASURES Overall survival, with a test for heterogeneity between
women and men, to assess the null hypothesis that no difference in the survival advantage
of immunotherapy exists by patient sex.
RESULTS This meta-analysis included 23 randomized clinical trials that reported on 9322 men
(67.9%) and 4399 women (32.1%); the age of most patients was in the 70s. An overall
survival benefit of immunotherapy was found for both men (hazard ratio [HR], 0.75; 95% CI,
0.69-0.81; P < .001) and women (HR, 0.77; 95% CI, 0.67-0.88; P = .002). Random-effects
meta-analysis of study-level differences in response to immunotherapy demonstrated no
statistically significant difference between the sexes (I2 = 38%; P = .60). Subgroup analyses
according to disease site, line of therapy, class of immunotherapy, study methodology, and
representation of women recapitulated these findings.
(Reprinted) 529
© 2019 American Medical Association. All rights reserved.
W
omen and men differ in their immunologic
response to both foreign and self-antigens, with Key Points
women typically having stronger innate and adap-
Question Do women derive less advantage from immune
tive immune responses.1 Compared with men, women not only checkpoint inhibitors, compared with standard systemic therapy,
experience a higher prevalence of systemic autoimmune in the treatment of advanced solid-organ malignant neoplasm?
disease1,2 but also have a greater response to vaccination
Findings In this systematic review and meta-analysis of 23
and a lower severity and prevalence of many infectious
randomized clinical trials of immunotherapy for advances
conditions.1,3,4 In oncology, differences in immune response solid-organ cancers including 9322 men and 4399 women, overall
have been postulated to underlie observed differences in preva- survival from immunotherapy was found in both men and women,
lence and mortality from many cancers.5,6 with no statistically significant differences between the sexes.
Immune checkpoint inhibitors targeting cytotoxic
Meaning The response to immune checkpoint inhibitors does not
T-lymphocyte antigen-4 (CTLA-4) and programmed cell death appear to differ on the basis of patient sex.
1 (PD-1) have demonstrated higher efficacy than standard of
care (SOC) chemotherapeutic approaches in several malig-
nant neoplasms. Sex hormone modulation of the PD-1/ We included studies that compared immunotherapy for
programmed cell death 1 ligand 1 (PD-L1) pathway has been metastatic cancers with other systemic treatment regimens,
demonstrated in animal models.7,8 Thus, it has been postu- including chemotherapy-based regimens and those that used
lated that the advantages of immunotherapy may vary accord- other targeted therapies. Analyses that examined immuno-
ing to patient sex.9 Recently, Conforti et al10 found in a meta- therapy-chemotherapy combinations compared with chemo-
analysis of randomized clinical trials that men derived greater therapy alone were also included. However, studies that com-
value from immune checkpoint inhibitors compared with pared various immunotherapy regimens were excluded.
women (hazard ratio [HR], 0.72 [95% CI, 0.65-0.79] vs 0.86
[95% CI, 0.79-0.93]; P = .002). However, another recent analy- Outcome and Exposure of Interest
sis has presented conflicting data: No difference in advan- The outcome of interest was overall survival (OS) and whether
tages between nivolumab and everolimus was seen among OS was reported as the primary or secondary outcome of the
men and women with metastatic renal cell carcinoma.11 original study. Studies that reported other measures of onco-
The Conforti et al10 meta-analysis demonstrated a difference logic response, including progression-free survival and objec-
between patient sex, which presents a number of limitations that tive response rate (without OS data) were excluded as these
preclude strong conclusions from being drawn from the data set. may not be comparable across histologic subtypes.
First, the meta-analysis included a limited subset of approved im- We sought to examine whether patient sex modified the
munotherapeutic agents. Second, several comprehensive and up- association between immunotherapy (compared to chemo-
dated studies that met the inclusion criteria, including those with therapy) and OS. Studies that did not report analyses strati-
a more robust representation of female patients, have been pub- fied by sex in the original trials were excluded. Furthermore,
lished since the Conforti et al10 literature review. to exclude ecologic bias, we excluded studies that reported
To address these concerns, we performed a systematic subgroup analyses for 1 sex only.
review and meta-analysis that examine the association of pa-
tient sex with the advantages of immunotherapy in patients Search Strategy and Review Method
with advanced cancer. We used a more contemporary and com- To perform this present analysis, we updated a previous rele-
prehensive literature search strategy. vant systematic review by Conforti et al10 that used MEDLINE
(PubMed), Embase, and Scopus from inception of these databases
to November 30, 2017, to identify phase 2 or 3 randomized clini-
cal trials for the agents ipilimumab, tremelimumab, nivolumab,
Methods and pembrolizumab. In this update, we expanded the literature
This systematic review and meta-analysis followed the Pre- search for previously included agents from November 30, 2017,
ferred Reporting Items for Systematic Reviews and Meta- to October 2, 2018. We expanded the search criteria to include
analyses (PRISMA) guidelines. 12 The study protocol was atezolizumab, durvalumab, and avelumab and searched the rele-
registered with PROSPERO. vant databases from inception to October 2, 2018. References from
review articles, editorials, and included studies were reviewed
Types of Studies and cross-referenced to ensure completeness. No limitations were
We included randomized clinical trials. Observational stud- placed regarding publication language or publication year. After
ies (whether cohort or case-control in design), editorials, com- the literature search, we excluded all duplicates. References from
mentaries, and review articles were excluded. Publications that review articles, commentaries, editorials, included studies, and
were not subject to peer review (ie, reports of data from the conference publications of relevant medical societies were
National Vital Statistics System and dissertations or theses) reviewed and cross-referenced to ensure completeness.
were also excluded. To prevent the duplication of patients used We (M.B. and Z.K.) performed study selection independently,
in our analyses, we selected 1 study (when more than 1 was pub- and we resolved disagreements by consensus with the primary
lished about the same patient cohort), on the basis of contem- author (C.J.D.W.). Titles and abstracts were used to screen for
porary timing, cohort size, and granularity of data reported. initial study inclusion. Full-text reviews were performed if the
(continued)
et al27 performed OS analysis on only a sex subgroup among 847 a survival advantage for both sexes (men HR, 0.71 [95% CI, 0.55-
patients with intermediate- or poor-risk disease, demonstrating 0.92]; women HR, 0.52 [95% CI, 0.34-0.78]).
Abbreviations: ccRCC, clear cell renal cell carcinoma; Cont, control group; HR, hazard ratio; ICC, investigator’s choice of chemotherapy; Int, intervention group;
IQR, interquartile range; NR, not reported; NSCLC, non–small cell lung cancer; PD-L1, programmed cell death 1 ligand 1; SCLC, small cell lung cancer.
a
Sex subgroup analysis performed in population with positive PD-L1.
The median age of patients included was typically in the 70s; lection bias because of this criterion. Generally, all studies were
however, in 2 trials, the median age was in the 60s.30,32 Most stud- at low risk for attrition and reporting bias. Several studies were
ies tended to have short follow-up, although 3 trials (13%) had a unblinded and were thus at risk for performance and detection
median follow-up of 24 months or more.24,27,34 Overall, all but bias; however, for the outcome of OS, such a lack of blinding is
7 studies18,21,24,25,28,30,36 (30%) showed an OS advantage for pa- likely inconsequential as blinding is unlikely to affect the outcome.
tients who received immunotherapy compared with the control
group. In subgroup analyses, 14 studies15-17,19,20,22,23,26,27,29,31-33,35 Primary Analysis
(61%) demonstrated a survival advantage from immunotherapy Meta-analysis of the available literature demonstrated a statis-
among men and 7 studies20,22,27,31,33-35 (30%) showed this advan- tically significant advantage in OS for patients who received
tage among women. immunotherapy compared with other systemic therapies
(HR, 0.75, 95% CI, 0.70-0.81; P < .001; I2 = 61%). Compared with
Risk of Bias SOC systemic therapy, an OS advantage of immunotherapy
Risk of bias of the included trials is shown in the eTable in the was observed for both men (HR, 0.75; 95% CI, 0.69-0.81;
Supplement. All trials included random-sequence generation and P < .001) and women (HR, 0.77; 95% CI, 0.67-0.88; P = .002);
were at low risk for selection bias. There was intermittent report- however, we found no statistically significant difference
ing of allocation concealment; several studies were at risk for se- in OS advantage between the sexes (P = .60; I2 = 38%) (Table 2,
Figure 2. Forest Plot of Association Between Overall Survival and Immunotherapy (IO) and Standard of Care (SOC) Stratified by Patient Sex
0 0.25 0.50 0.75 1.00 1.25 1.50 1.75 0 0.25 0.50 0.75 1.00 1.25 1.50 1.75
HR (95% CI) HR (95% CI)
Figure 2). Statistically significant heterogeneity was demon- These conflicting results may be explained in a number of
strated among both men (tau2 = 0.02; χ2 = 51.67; P = .003; ways. First, we excluded 3 trials, which were included in Conforti
I2 = 57%) and women (tau2 = 0.07; χ2 = 62.29; P < .001; I2 = 65%). et al,10 that compared various immunotherapy regimes.38-40 By
including only those trials that compared an immunotherapy
Subgroup Analysis group with a nonimmunotherapy control, we were able to specif-
We performed a number of subgroup analyses according to dis- ically assess the association of sex with response to immuno-
ease site, line of therapy, class of immunotherapy, and study therapy.Second,weexpandedthesearchcriteriatoincludeimmu-
methodology. No statistically significant differences in the ef- notherapy agents that were not considered in Conforti et al.10 The
ficacy of immunotherapy were found between men and resulting search included a trial of atezolizumab in patients with
women in any of these analyses (Table 2). Finally, we exam- NSCLC.31 This trial demonstrated a greater net value of immuno-
ined for the effect of the prevalence of women in the study co- therapy for women (HR, 0.64; 95% CI, 0.49-0.85) than for men
hort. Again, no statistically significant differences were dem- (HR, 0.79; 95% CI, 0.64-0.97). Because this trial was large (n =
onstrated among these subgroups (Table 2). 850 patients), it contributed considerably to the pooled HR effect.
Third, we updated the search previously performed and
identified 7 recent large trials that have been published since
the end date for inclusion in the Conforti et al 10 meta-
Discussion analysis. Gandhi et al20 in KEYNOTE 189 tested pembroli-
Contrary to the published meta-analysis by Conforti et al,10 which zumab plus platinum chemotherapy (n = 410) vs pla-
suggested a greater immunotherapy advantage compared with cebo plus platinum chemotherapy (n = 206) in the first-line
SOC systemic therapy for men than women, the present analy- setting among patients with NSCLC. KEYNOTE 189 included
sis found no difference in OS from immune checkpoint inhibi- 363 men and 253 women and noted a strong OS advantage from
tors when comparing the efficacy of these treatments between immunotherapy among women (HR, 0.29; 95% CI, 0.19-
the sexes. Furthermore, when assessing several subgroup analy- 0.44) compared with men (HR, 0.70; 95% CI, 0.50-0.99).
ses, including disease site, line of therapy, class of immuno- Motzer et al27 in CheckMate 214 tested nivolumab plus ipili-
therapy, and study methodology, we could not demonstrate any mumab (n = 425) and the tyrosine-kinase inhibitor sunitinib
significant sex-associated differences in efficacy. (n = 422) in the first-line setting among intermediate- and poor-
risk patients with clear cell renal cell carcinoma. CheckMate immunotherapy group and a nonimmunotherapy control group;
214 had 615 men and 232 women and also found a strong OS the broad inclusion of all approved immunotherapy agents; and
advantage from immunotherapy among women (HR, 0.52; the rigorous, up-to-date search strategy. As a result, this analy-
95% CI, 0.34-0.78) compared with men (HR, 0.71; 95% CI, sis provides a comprehensive assessment of the association of
0.55-0.92). KEYNOTE 407 tested first-line pembrolizumab vs patient sex with response to immunotherapy compared with
saline placebo (plus carboplatin and either paclitaxel or nonimmunotherapy, including data on more than 13 000 pa-
nanoparticle albumin-bound paclitaxel) among patients with tients. Furthermore, we undertook several subgroup analyses
NSCLC.35 Although women made up only 18.6% of partici- in an attempt to ascertain any differences in immunotherapy ef-
pants in KEYNOTE 407, they had a remarkable immuno- ficacy between the sexes.
therapy treatment advantage (HR, 0.42; 95% CI, 0.22-0.81) This analysis has several limitations. First, it relies on pub-
compared with men (HR, 0.69; 95% CI, 0.51-0.94). Taken to- lished clinical trial subgroup HRs and not on individual patient-
gether, the present meta-analysis provides a more specific level data. Second, residual confounding is possible in that dif-
assessment of the research question while including a greater ferences other than sex contribute to immunotherapy response
number of immunotherapy agents and an updated search. and OS. Third, differences in outcomes between men and wom-
Small samples sizes may result in an elevated false discov- en may be ascribed to other factors (including differences in life-
ery rate41 or even false-positive results.42 Meta-analyses of such style, comorbidities, incidence of autoimmune diseases, and
trials may propagate such findings by enhancing the statistical other factors) that are unaccounted for in clinical trials. Fourth,
power of these small subgroup analyses. To explore the final hy- as in all clinical trials, the included studies are at risk for having
pothesis that the representation of women in a study may me- nongeneralizable results (the so-called efficacy-effectiveness gap)
diate observed differences in immunotherapy efficacy between because of referral bias and strict inclusion criteria, among other
men and women, we performed a stratified analysis. We found factors, that result in the underrepresentation of uninsured, low-
no statistically significant difference in outcomes between men income, and minority populations. Meta-analysis of these trials,
and women regardless of the proportion of women in the study such as the one we performed, is subject to the same limitations.
cohort. The effect estimates favored men in studies with study Finally, the trials that we excluded because of a lack of published
cohorts composed of less than 20% women, but the results were sex-subgroup analyses may demonstrate sex differences if ana-
very comparable in the other subgroups. Trials with an under- lyzed in this fashion.
representation of women may present spurious results for
sex-specific subgroup analyses, as evidenced by the wide CIs
when less than 20% of the cohort represented is women.
Six20,27,31,34,36,37 of the 7 trials included in this meta-analysis but
Conclusions
not included in the Conforti et al10 study had more than 27% In this contemporary meta-analysis of all available immuno-
women representation, with 2 trials20,31 having more than 38% therapy clinical trials across all disease sites, we found no
women inclusion. difference in immunotherapy efficacy or OS between
women and men. Contrary to findings of a previous analysis,
Strengths and Limitations we found no evidence that sex should be considered when
The strengths of this meta-analysis include the strict methodo- deciding whether to offer immunotherapy to patients with
logic inclusion criteria that required the comparison between an advanced cancers.
ARTICLE INFORMATION Department of Surgery, Medical College of Georgia Illumina, Tempus, and Novartis. Dr Patel's university
Accepted for Publication: October 10, 2018. at Augusta University, Augusta (Klaassen); Georgia receives research funding from Bristol-Myers
Cancer Center, Augusta University, Augusta, Squibb, Eli Lilly, Fate, Incyte, AstraZeneca/
Published Online: January 3, 2019. Georgia (Klaassen). MedImmune, Merck, Pfizer, Roche/Genentech,
doi:10.1001/jamaoncol.2018.5904 Xcovery, Fate Therapeutics, Genocea, and Iovance.
Author Contributions: Drs Wallis and Klaassen had
Author Affiliations: Division of Urology, full access to all of the data in the study and take Dr Pal reported receiving personal fees from
Department of Surgery, University of Toronto, responsibility for the integrity of the data and the Genentech, Pfizer, and BMS outside of the
Toronto, Ontario, Canada (Wallis); School of accuracy of the data analysis. submitted work. No other disclosures were
Medicine, Royal College of Surgeons in Ireland, Concept and design: Wallis, Hamid, Pal, Klaassen. reported.
Dublin, Ireland (Butaney); Center for Outcomes Acquisition, analysis, or interpretation of data:
Research, Department of Urology, Houston Wallis, Butaney, Satkunasivam, Freedland, Patel, REFERENCES
Methodist Hospital, Houston, Texas Hamid, Klaassen. 1. Klein SL, Flanagan KL. Sex differences in immune
(Satkunasivam); Division of Urology, Department of Drafting of the manuscript: Wallis, Patel, Hamid, responses. Nat Rev Immunol. 2016;16(10):626-638.
Surgery, Cedars-Sinai Medical Center, Los Angeles, Klaassen. doi:10.1038/nri.2016.90
California (Freedland); Urology Section, Durham VA Critical revision of the manuscript for important
Medical Center, Durham, North Carolina 2. Whitacre CC, Reingold SC, O’Looney PA.
intellectual content: All authors. A gender gap in autoimmunity. Science. 1999;283
(Freedland); Moores Cancer Center-La Jolla, Statistical analysis: Wallis, Satkunasivam.
Department of Medicine, University of California, (5406):1277-1278. doi:10.1126/science.283.5406.1277
Administrative, technical, or material support:
San Diego, La Jolla (Patel); Translational Research & Wallis, Butaney, Patel, Pal, Klaassen. 3. vom Steeg LG, Klein SL. SeXX matters in
Immunooncology, The Angeles Clinic & Research Supervision: Patel, Pal, Klaassen. infectious disease pathogenesis. PLoS Pathog.
Institute, Los Angeles, California (Hamid); 2016;12(2):e1005374. doi:10.1371/journal.ppat.
Department of Medical Oncology and Experimental Conflict of Interest Disclosures: Dr Freedland 1005374
Therapeutics, City of Hope Comprehensive Cancer reported receiving grants from Merck outside of the
submitted work. Dr Patel reported receiving 4. Klein SL, Jedlicka A, Pekosz A. The Xs and Y of
Center, Duarte, California (Pal); Division of Urology, immune responses to viral vaccines. Lancet Infect Dis.
scientific advisory income from AstraZeneca, BMS,
2010;10(5):338-349. doi:10.1016/S1473-3099(10) 18. Carbone DP, Reck M, Paz-Ares L, et al; 30. Ribas A, Kefford R, Marshall MA, et al. Phase III
70049-9 CheckMate 026 Investigators. First-line nivolumab randomized clinical trial comparing tremelimumab
5. Cook MB, Dawsey SM, Freedman ND, et al. Sex in stage IV or recurrent non–small-cell lung cancer. with standard-of-care chemotherapy in patients
disparities in cancer incidence by period and age. N Engl J Med. 2017;376(25):2415-2426. doi:10. with advanced melanoma. J Clin Oncol. 2013;31(5):
Cancer Epidemiol Biomarkers Prev. 2009;18(4): 1056/NEJMoa1613493 616-622. doi:10.1200/JCO.2012.44.6112
1174-1182. doi:10.1158/1055-9965.EPI-08-1118 19. Ferris RL, Blumenschein G Jr, Fayette J, et al. 31. Rittmeyer A, Barlesi F, Waterkamp D, et al; OAK
6. Cook MB, McGlynn KA, Devesa SS, Nivolumab for recurrent squamous-cell carcinoma Study Group. Atezolizumab versus docetaxel in
Freedman ND, Anderson WF. Sex disparities in of the head and neck. N Engl J Med. 2016;375(19): patients with previously treated non-small-cell lung
cancer mortality and survival. Cancer Epidemiol 1856-1867. doi:10.1056/NEJMoa1602252 cancer (OAK): a phase 3, open-label, multicentre
Biomarkers Prev. 2011;20(8):1629-1637. doi:10. 20. Gandhi L, Rodríguez-Abreu D, Gadgeel S, et al; randomised controlled trial. Lancet. 2017;389
1158/1055-9965.EPI-11-0246 KEYNOTE-189 Investigators. Pembrolizumab plus (10066):255-265. doi:10.1016/S0140-6736(16)
chemotherapy in metastatic non–small-cell lung 32517-X
7. Polanczyk MJ, Hopke C, Vandenbark AA,
Offner H. Treg suppressive activity involves cancer. N Engl J Med. 2018;378(22):2078-2092. 32. Robert C, Thomas L, Bondarenko I, et al.
estrogen-dependent expression of programmed doi:10.1056/NEJMoa1801005 Ipilimumab plus dacarbazine for previously
death-1 (PD-1). Int Immunol. 2007;19(3):337-343. 21. Govindan R, Szczesna A, Ahn MJ, et al. Phase III untreated metastatic melanoma. N Engl J Med.
doi:10.1093/intimm/dxl151 trial of ipilimumab combined with paclitaxel and 2011;364(26):2517-2526. doi:10.1056/
carboplatin in advanced squamous non–small-cell NEJMoa1104621
8. Polanczyk MJ, Hopke C, Vandenbark AA,
Offner H. Estrogen-mediated immunomodulation lung cancer. J Clin Oncol. 2017;35(30):3449-3457. 33. Robert C, Long GV, Brady B, et al. Nivolumab in
involves reduced activation of effector T cells, doi:10.1200/JCO.2016.71.7629 previously untreated melanoma without BRAF
potentiation of Treg cells, and enhanced expression 22. Herbst RS, Baas P, Kim DW, et al. mutation. N Engl J Med. 2015;372(4):320-330. doi:
of the PD-1 costimulatory pathway. J Neurosci Res. Pembrolizumab versus docetaxel for previously 10.1056/NEJMoa1412082
2006;84(2):370-378. doi:10.1002/jnr.20881 treated, PD-L1-positive, advanced non-small-cell 34. Antonia SJ, Villegas A, Daniel D, et al; PACIFIC
9. Botticelli A, Onesti CE, Zizzari I, et al. The sexist lung cancer (KEYNOTE-010): a randomised Investigators. Overall survival with durvalumab
behaviour of immune checkpoint inhibitors in controlled trial. Lancet. 2016;387(10027):1540-1550. after chemoradiotherapy in Stage III NSCLC
cancer therapy? Oncotarget. 2017;8(59):99336- doi:10.1016/S0140-6736(15)01281-7 [published online September 25, 2018]. N Engl J Med.
99346. doi:10.18632/oncotarget.22242 23. Kang YK, Boku N, Satoh T, et al. Nivolumab in 2018. doi:10.1056/NEJMoa1809697
10. Conforti F, Pala L, Bagnardi V, et al. Cancer patients with advanced gastric or 35. Paz-Ares L, Luft A, Vicente D, et al;
immunotherapy efficacy and patients’ sex: gastro-oesophageal junction cancer refractory to, KEYNOTE-407 Investigators. Pembrolizumab plus
a systematic review and meta-analysis. Lancet Oncol. or intolerant of, at least two previous chemotherapy chemotherapy for squamous non–small-cell lung
2018;19(6):737-746. doi:10.1016/S1470-2045(18) regimens (ONO-4538-12, ATTRACTION-2): cancer. N Engl J Med. 2018;379(21)2040-2051.
30261-4 a randomised, double-blind, placebo-controlled, doi:10.1056/NEJMoa1810865
phase 3 trial. Lancet. 2017;390(10111):2461-2471. 36. Barlesi F, Vansteenkiste J, Spigel D, et al.
11. Graham J, Abdel-Rahman O, Choueiri TK, doi:10.1016/S0140-6736(17)31827-5
Heng DYC; International mRCC Database Avelumab versus docetaxel in patients with
Consortium. Re: Fabio Conforti, Laura Pala, 24. Larkin J, Minor D, D’Angelo S, et al. Overall platinum-treated advanced non-small-cell lung
Vincenzo Bagnardi, et al. Cancer immunotherapy survival in patients with advanced melanoma who cancer (JAVELIN Lung 200): an open-label,
efficacy and patients’ sex: a systematic review and received nivolumab versus investigator’s choice randomised, phase 3 study [published online
meta-analysis. Lancet Oncol 2018;19:737-46. Eur Urol. chemotherapy in CheckMate 037: a randomized, September 21, 2018]. Lancet Oncol. 2018;
2018;S0302-2838(18)30482-2. doi:10.1016/j.eururo. controlled, open-label phase III trial. J Clin Oncol. S1470-2045(18)30673-9. doi:10.1016/S1470-2045
2018.07.004 2018;36(4):383-390. doi:10.1200/JCO.2016.71.8023 (18)30673-9
12. Moher D, Liberati A, Tetzlaff J, Altman DG; 25. Maio M, Scherpereel A, Calabrò L, et al. 37. Horn L, Mansfield AS, Szczęsna A, et al;
PRISMA Group. Preferred Reporting Items for Tremelimumab as second-line or third-line IMpower133 Study Group. First-line atezolizumab
Systematic Reviews and Meta-analyses: the treatment in relapsed malignant mesothelioma plus chemotherapy in extensive-stage small-cell
PRISMA statement. J Clin Epidemiol. 2009;62(10): (DETERMINE): a multicentre, international, lung cancer [published online September 25, 2018].
1006-1012. doi:10.1016/j.jclinepi.2009.06.005 randomised, double-blind, placebo-controlled N Engl J Med. 2018. doi:10.1056/NEJMoa1809064
phase 2b trial. Lancet Oncol. 2017;18(9):1261-1273. 38. Robert C, Schachter J, Long GV, et al;
13. Higgins JP, Altman DG, Gøtzsche PC, et al; doi:10.1016/S1470-2045(17)30446-1
Cochrane Bias Methods Group; Cochrane Statistical KEYNOTE-006 Investigators. Pembrolizumab
Methods Group. The Cochrane Collaboration’s tool 26. Motzer RJ, Escudier B, McDermott DF, et al; versus ipilimumab in advanced melanoma. N Engl J
for assessing risk of bias in randomised trials. BMJ. CheckMate 025 Investigators. Nivolumab versus Med. 2015;372(26):2521-2532. doi:10.1056/
2011;343:d5928. doi:10.1136/bmj.d5928 everolimus in advanced renal-cell carcinoma. N Engl NEJMoa1503093
J Med. 2015;373(19):1803-1813. doi:10.1056/ 39. Hodi FS, Chesney J, Pavlick AC, et al. Combined
14. Higgins JP, Thompson SG, Deeks JJ, Altman DG. NEJMoa1510665
Measuring inconsistency in meta-analyses. BMJ. nivolumab and ipilimumab versus ipilimumab alone
2003;327(7414):557-560. doi:10.1136/bmj.327.7414. 27. Motzer RJ, Tannir NM, McDermott DF, et al; in patients with advanced melanoma: 2-year overall
557 CheckMate 214 Investigators. Nivolumab plus survival outcomes in a multicentre, randomised,
ipilimumab versus sunitinib in advanced renal-cell controlled, phase 2 trial. Lancet Oncol. 2016;17(11):
15. Bellmunt J, de Wit R, Vaughn DJ, et al; carcinoma. N Engl J Med. 2018;378(14):1277-1290. 1558-1568. doi:10.1016/S1470-2045(16)30366-7
KEYNOTE-045 Investigators. Pembrolizumab as doi:10.1056/NEJMoa1712126
second-line therapy for advanced urothelial 40. Hodi FS, O’Day SJ, McDermott DF, et al.
carcinoma. N Engl J Med. 2017;376(11):1015-1026. 28. Reck M, Luft A, Szczesna A, et al. Phase III Improved survival with ipilimumab in patients with
doi:10.1056/NEJMoa1613683 randomized trial of ipilimumab plus etoposide and metastatic melanoma. N Engl J Med. 2010;363(8):
platinum versus placebo plus etoposide and 711-723. doi:10.1056/NEJMoa1003466
16. Borghaei H, Paz-Ares L, Horn L, et al. platinum in extensive-stage small-cell lung cancer.
Nivolumab versus docetaxel in advanced 41. Button KS, Ioannidis JP, Mokrysz C, et al. Power
J Clin Oncol. 2016;34(31):3740-3748. doi:10. failure: why small sample size undermines the
nonsquamous non–small-cell lung cancer. N Engl J 1200/JCO.2016.67.6601
Med. 2015;373(17):1627-1639. doi:10.1056/ reliability of neuroscience. Nat Rev Neurosci. 2013;
NEJMoa1507643 29. Reck M, Rodríguez-Abreu D, Robinson AG, 14(5):365-376. doi:10.1038/nrn3475
et al; KEYNOTE-024 Investigators. Pembrolizumab 42. Hackshaw A. Small studies: strengths and
17. Brahmer J, Reckamp KL, Baas P, et al. versus chemotherapy for PD-L1-positive
Nivolumab versus docetaxel in advanced limitations. Eur Respir J. 2008;32(5):1141-1143.
non–small-cell lung cancer. N Engl J Med. 2016;375 doi:10.1183/09031936.00136408
squamous-cell non–small-cell lung cancer. N Engl J (19):1823-1833. doi:10.1056/NEJMoa1606774
Med. 2015;373(2):123-135. doi:10.1056/
NEJMoa1504627