Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

Research

JAMA Oncology | Original Investigation

Association of Patient Sex With Efficacy


of Immune Checkpoint Inhibitors
and Overall Survival in Advanced Cancers
A Systematic Review and Meta-analysis
Christopher J. D. Wallis, MD, PhD; Mohit Butaney, MD; Raj Satkunasivam, MD, MS; Stephen J. Freedland, MD;
Sandip P. Patel, MD; Omid Hamid, MD; Sumanta K. Pal, MD; Zachary Klaassen, MD

Supplemental content
IMPORTANCE Sex-associated differences in immune response are known, but a meta-analysis
suggested men, compared with women, derive greater value from immunotherapy for
advanced solid-organ malignant neoplasms. However, methodologic concerns and
subsequent trials have placed these results in doubt.

OBJECTIVE To perform an updated, comprehensive meta-analysis that assesses the efficacy


of immunotherapy in advanced cancers according to patient sex.

DESIGN, SETTING, AND PARTICIPANTS A systematic review of studies (n = 23) indexed in


MEDLINE (PubMed), Embase, and Scopus from inception of these databases to October 2,
2018, was conducted. Randomized clinical trials that compared immunotherapy with
standard of care in the treatment of advanced solid-organ malignant neoplasms were
included if overall survival was reported as an outcome and if data stratified by patient sex
were available. Observational studies, editorials, commentaries, review articles,
non–peer-reviewed publications, studies that compared various immunotherapy regimens,
studies that reported other measures of oncologic response, and studies that reported
subgroup analyses for 1 sex only were excluded.

MAIN OUTCOMES AND MEASURES Overall survival, with a test for heterogeneity between
women and men, to assess the null hypothesis that no difference in the survival advantage
of immunotherapy exists by patient sex.

RESULTS This meta-analysis included 23 randomized clinical trials that reported on 9322 men
(67.9%) and 4399 women (32.1%); the age of most patients was in the 70s. An overall
survival benefit of immunotherapy was found for both men (hazard ratio [HR], 0.75; 95% CI,
0.69-0.81; P < .001) and women (HR, 0.77; 95% CI, 0.67-0.88; P = .002). Random-effects
meta-analysis of study-level differences in response to immunotherapy demonstrated no
statistically significant difference between the sexes (I2 = 38%; P = .60). Subgroup analyses
according to disease site, line of therapy, class of immunotherapy, study methodology, and
representation of women recapitulated these findings.

CONCLUSIONS AND RELEVANCE Stratified analyses demonstrated no statistically significant


association of patient sex with the efficacy of immunotherapy in the treatment of advanced
cancers using overall survival as the outcome.

Author Affiliations: Author


affiliations are listed at the end of this
article.
Corresponding Author: Christopher
J. D. Wallis, MD, PhD, Division of
Urology, Department of Surgery,
University of Toronto, 149 College St,
JAMA Oncol. 2019;5(4):529-536. doi:10.1001/jamaoncol.2018.5904 Room 503G, Toronto, ON M5T 1P5,
Published online January 3, 2019. Canada (wallis.cjd@gmail.com).

(Reprinted) 529
© 2019 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ on 04/05/2021


Research Original Investigation Association of Patient Sex With Efficacy of Immune Checkpoint Inhibitors and Overall Survival in Advanced Cancers

W
omen and men differ in their immunologic
response to both foreign and self-antigens, with Key Points
women typically having stronger innate and adap-
Question Do women derive less advantage from immune
tive immune responses.1 Compared with men, women not only checkpoint inhibitors, compared with standard systemic therapy,
experience a higher prevalence of systemic autoimmune in the treatment of advanced solid-organ malignant neoplasm?
disease1,2 but also have a greater response to vaccination
Findings In this systematic review and meta-analysis of 23
and a lower severity and prevalence of many infectious
randomized clinical trials of immunotherapy for advances
conditions.1,3,4 In oncology, differences in immune response solid-organ cancers including 9322 men and 4399 women, overall
have been postulated to underlie observed differences in preva- survival from immunotherapy was found in both men and women,
lence and mortality from many cancers.5,6 with no statistically significant differences between the sexes.
Immune checkpoint inhibitors targeting cytotoxic
Meaning The response to immune checkpoint inhibitors does not
T-lymphocyte antigen-4 (CTLA-4) and programmed cell death appear to differ on the basis of patient sex.
1 (PD-1) have demonstrated higher efficacy than standard of
care (SOC) chemotherapeutic approaches in several malig-
nant neoplasms. Sex hormone modulation of the PD-1/ We included studies that compared immunotherapy for
programmed cell death 1 ligand 1 (PD-L1) pathway has been metastatic cancers with other systemic treatment regimens,
demonstrated in animal models.7,8 Thus, it has been postu- including chemotherapy-based regimens and those that used
lated that the advantages of immunotherapy may vary accord- other targeted therapies. Analyses that examined immuno-
ing to patient sex.9 Recently, Conforti et al10 found in a meta- therapy-chemotherapy combinations compared with chemo-
analysis of randomized clinical trials that men derived greater therapy alone were also included. However, studies that com-
value from immune checkpoint inhibitors compared with pared various immunotherapy regimens were excluded.
women (hazard ratio [HR], 0.72 [95% CI, 0.65-0.79] vs 0.86
[95% CI, 0.79-0.93]; P = .002). However, another recent analy- Outcome and Exposure of Interest
sis has presented conflicting data: No difference in advan- The outcome of interest was overall survival (OS) and whether
tages between nivolumab and everolimus was seen among OS was reported as the primary or secondary outcome of the
men and women with metastatic renal cell carcinoma.11 original study. Studies that reported other measures of onco-
The Conforti et al10 meta-analysis demonstrated a difference logic response, including progression-free survival and objec-
between patient sex, which presents a number of limitations that tive response rate (without OS data) were excluded as these
preclude strong conclusions from being drawn from the data set. may not be comparable across histologic subtypes.
First, the meta-analysis included a limited subset of approved im- We sought to examine whether patient sex modified the
munotherapeutic agents. Second, several comprehensive and up- association between immunotherapy (compared to chemo-
dated studies that met the inclusion criteria, including those with therapy) and OS. Studies that did not report analyses strati-
a more robust representation of female patients, have been pub- fied by sex in the original trials were excluded. Furthermore,
lished since the Conforti et al10 literature review. to exclude ecologic bias, we excluded studies that reported
To address these concerns, we performed a systematic subgroup analyses for 1 sex only.
review and meta-analysis that examine the association of pa-
tient sex with the advantages of immunotherapy in patients Search Strategy and Review Method
with advanced cancer. We used a more contemporary and com- To perform this present analysis, we updated a previous rele-
prehensive literature search strategy. vant systematic review by Conforti et al10 that used MEDLINE
(PubMed), Embase, and Scopus from inception of these databases
to November 30, 2017, to identify phase 2 or 3 randomized clini-
cal trials for the agents ipilimumab, tremelimumab, nivolumab,
Methods and pembrolizumab. In this update, we expanded the literature
This systematic review and meta-analysis followed the Pre- search for previously included agents from November 30, 2017,
ferred Reporting Items for Systematic Reviews and Meta- to October 2, 2018. We expanded the search criteria to include
analyses (PRISMA) guidelines. 12 The study protocol was atezolizumab, durvalumab, and avelumab and searched the rele-
registered with PROSPERO. vant databases from inception to October 2, 2018. References from
review articles, editorials, and included studies were reviewed
Types of Studies and cross-referenced to ensure completeness. No limitations were
We included randomized clinical trials. Observational stud- placed regarding publication language or publication year. After
ies (whether cohort or case-control in design), editorials, com- the literature search, we excluded all duplicates. References from
mentaries, and review articles were excluded. Publications that review articles, commentaries, editorials, included studies, and
were not subject to peer review (ie, reports of data from the conference publications of relevant medical societies were
National Vital Statistics System and dissertations or theses) reviewed and cross-referenced to ensure completeness.
were also excluded. To prevent the duplication of patients used We (M.B. and Z.K.) performed study selection independently,
in our analyses, we selected 1 study (when more than 1 was pub- and we resolved disagreements by consensus with the primary
lished about the same patient cohort), on the basis of contem- author (C.J.D.W.). Titles and abstracts were used to screen for
porary timing, cohort size, and granularity of data reported. initial study inclusion. Full-text reviews were performed if the

530 JAMA Oncology April 2019 Volume 5, Number 4 (Reprinted) jamaoncology.com

© 2019 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ on 04/05/2021


Association of Patient Sex With Efficacy of Immune Checkpoint Inhibitors and Overall Survival in Advanced Cancers Original Investigation Research

abstracts were insufficient for determining if the studies met


Figure 1. PRISMA Diagram
the inclusion or exclusion criteria. We (C.J.D.W., M.B., and Z.K.)
developed a data extraction form by consensus. One of us (M.B.)
20 Records identified 59 Records identified
performed all of the data extraction, and two of us (C.J.D.W. and from Conforti et al10 from databases
Z.K.) conducted independent verification.
Study characteristics, including first author, year of pub- 57 Remained after
duplicates removed
lication, study design, phase, type of therapy (anti–PD-L1 or
anti–CTLA-4), line of therapy, underlying malignant neo-
plasm, and baseline demographic characteristics were 40 Excluded after abstract
review
extracted. In addition, outcome information, including the HR
(with 95% CI) for death, stratified by patient sex, was 4 Excluded
2 IO vs IO 17 Underwent full-text
abstracted. A risk-of-bias assessment was conducted using the 1 IO vs vaccine review
Cochrane Collaboration tool for assessing risk of bias.13 1 Conference abstract

40 Excluded after full-text


Assessment of Heterogeneity and Statistical Analysis review
7 No OS subgroup for sex
We identified heterogeneity using the Q test. Heterogeneity was 1 Review manuscript
estimated using the DerSimonian-Laird method and was quan- 1 RFS end point
1 PFS end point
tified using I2 values.14
Meta-analysis was performed using Review Manager, version
5.3 (Nordic Cochrane Centre). We used the inverse variance tech- 16 Included 7 Included

nique for meta-analysis of HRs. Because of the clinical heteroge-


neity inherent in the data, we used random-effects models for all
meta-analyses.Toassessthedifferencesbetweenthesexesineach 23 Studies included in
meta-analysis
study while accounting for study-level associations, we made cal-
culations using log HR and then assessed whether the variations
IO indicates immunotherapy; OS, overall survival; PFS, progression-free
differed from the null using the χ2 test.14 All reported P values are survival; RFS, relapse-free survival.
2-sided, and P = .05 was used to indicate statistical significance.

Subgroup Analyses Characteristics of Identified Trials


We performed a number of prespecified subgroup analyses to Table 1 lists the main characteristics of the 23 trials. In total,
assess the potential association of oncologic and methodologic 13 721 patients were included, of which 9322 (67.9%) were men
factors in effect modification of patient sex with immunotherapy and 4399 (32.1%) were women; the age of most patients was
efficacy. We considered subgroups, including disease site (mela- in the 70s. All studies enrolled patients within the past de-
noma, non–small cell lung cancer [NSCLC], and other tumor cade, and most trials were published in the past 3 years. Only
sites), line of therapy (first line and subsequent), class of immu- 2 studies18,29 (9%) evaluated OS as a secondary end point (the
notherapy (anti–CTLA-4, anti–PD-1, and anti–PD-L1), and study primary end point was progression-free survival), both of which
methodology (various immunotherapies vs chemotherapy allowed crossover to immunotherapy at the time of disease
alone, immunotherapy-chemotherapy combination vs chemo- progression. There were 11 trials (48%) for patients with
therapy alone). NSCLC,16-18,20-22,29,31,34-36 4 (17%) for melanoma,24,30,32,33 2 (9%)
To assess the degree to which the relative underrepresen- for clear cell renal cell carcinoma,26,27 2 (9%) for SCLC,28,37 and
tation of women in these trials may contribute to the previ- 1 (4%) each for urothelial carcinoma,15 head and neck squa-
ously observed differences in outcome between women and mous carcinoma,19 mesothelioma,25 and gastric or gastro-
men, we performed a stratified analysis according to the pro- esophageal carcinoma. 23 Most trials evaluated immuno-
portion of women in each study. We categorized the included therapy after previous systemic therapy failure; however, 11
studies according to whether women represented less than 20%, trials (48%) assessed the efficacy for OS in the first-line
20% to 30%, 30% to 40%, or 40% or more of the study cohort. setting.18,20,21,27-30,32,33,35,37 Most trials used a PD-L1 or PD-1
inhibitor as the immunotherapy agent, whereas 6 trials (26%)
used a CTLA-4 inhibitor.21,25,27,28,30,32 Most study designs in-
cluded immunotherapy vs SOC, but 6 trials20,21,28,32,35,37 (26%)
Results were designed as immunotherapy and SOC vs SOC alone.
Literature Search Results Several trials had unique designs that may warrant further
The literature search identified 57 unique references. After a explanation. The KEYNOTE 010 trial22 was unique in that it tested
full-text review of 17 studies, we identified 7 relevant clinical 2 doses of pembrolizumab (2 mg/kg and 10 mg/kg) vs docetaxel
trials for inclusion, in addition to 16 trials included from the among patients with NSCLC, with an overall pooled HR for OS of
Conforti et al10 meta-analysis. Thus, a total of 23 trials15-37 were 0.67 (95% CI, 0.56-0.80). In the CheckMate 214 study, Motzer
included in the present meta-analysis (Figure 1). All trials in- et al27 randomized 1096 patients with advanced clear cell renal
cluded a subgroup analysis, stratified by sex, that compared the cell carcinoma to receive both an anti–PD-1 (nivolumab) and an
intervention group with the control group, with an HR for OS. anti–CTLA-4 (ipilimumab) agent vs sunitinib; however, Motzer

jamaoncology.com (Reprinted) JAMA Oncology April 2019 Volume 5, Number 4 531

© 2019 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ on 04/05/2021


Research Original Investigation Association of Patient Sex With Efficacy of Immune Checkpoint Inhibitors and Overall Survival in Advanced Cancers

Table 1. Characteristics and Outcomes of the 23 Trials Included in the Meta-analysis


Age,
Median Follow-up,
Control (Range Median
Disease Lines of Intervention Treatment or IQR), (Range or Sex, No. Overall Survival HR (95% CI)
Source Site Trial Name Therapy (No.) (No.) y IQR), mo Men Women Overall Men Women
Antonia NSCLC PACIFIC >1 Durvalumab Placebo 64 25.2 500 213 0.68 0.78 0.46
et al,34 (476) (237) (23-90) (0.2-43.1) (0.47- (0.59- (0.30-
2018 0.998) 1.03) 0.73)
Barlesi NSCLC JAVELIN >1 Avelumab (396) Docetaxel Int: 64 18.3 (IQR, 367 162 0.90 0.83 1.08
et al,36 Lung 200 (396) (58-69); 13.2-22.7) (0.72- (0.64- (0.74-
2018 Cont: 63 1.12) 1.08)a 1.59)a
(57-69)
Bellmunt Urothelial KEYNOTE >1 Pembrolizumab ICC (272) 66 14.1 402 140 0.73 0.73 0.78
et al,15 carcinoma 045 (270) (26-88) (9.9-22.1) (0.59- (0.56- (0.49-
2017 0.91) 0.94) 1.24)
Borghaei NSCLC CheckMate >1 Nivolumab Docetaxel 62 13.2 (NR) 319 263 0.73 0.73 0.78
et al,16 057 (292) (290) (21-85) (0.59- (0.56- (0.58-
2015 0.89) 0.96) 1.04)
Brahmer NSCLC CheckMate >1 Nivolumab Docetaxel 63 11.0 (NR) 208 64 0.59 0.57 0.67
et al,17 017 (135) (137) (39-85) (0.44- (0.41- (0.36-
2015 0.79) 0.78) 1.25)
Carbone NSCLC CheckMate 1 Nivolumab ICC (270) 64 13.5 (NR) 332 209 1.02 0.97 1.15
et al,18 026 (271) (29-89) (0.80- (0.74- (0.79-
2017 1.30) 1.26) 1.66)
Ferris Head & CheckMate >1 Nivolumab ICC (121) 60 5.1 300 61 0.70 0.65 0.93
et al,19 neck 141 (240) (28-83) (0-16.8) (97.73% CI, (0.48- (0.47-
2016 squamous 0.51-0.96) 0.88) 1.85)
carcinoma
Gandhi NSCLC KEYNOTE 1 Pembrolizumab Placebo + Int: 65 10.5 363 253 0.49 0.70 0.29
et al,20 189 + platinum platinum (34-84); (0.2-20.4) (0.38- (0.50- (0.19-
2018 (410) (206) Cont: 64 0.64) 0.99) 0.44)
(34-84)
Govindan NSCLC NR 1 Ipilimumab + Placebo + 64 Int: 12.5 635 114 0.91 0.85 1.33
et al,21 paclitaxel + paclitaxel + (28-85) (NR); (0.77- (0.71- (0.84-
2017 carboplatin carboplatin Cont: 11.8 1.07) 1.02) 2.11)
(388) (361) (NR)
Herbst NSCLC KEYNOTE >1 Pembrolizumab Docetaxel 63 (IQR, 13.1 (IQR, 634 399 Pooled: 0.65 0.69
et al,22 010 2 mg/kg (345); (343) 54-70) 8.6-17.7) 0.67 (0.52- (0.51-
2016 pembrolizumab (0.56- 0.81) 0.94)
10 mg/kg (346) 0.80)
Horn SCLC IMpower133 1 Atezolizumab Placebo + Int: 64 13.9 (NR) 261 142 0.70 0.74 0.65
et al,37 + carboplatin + carbo- (28-90); (0.54- (0.54- (0.42-
2018 etoposide (201) platin + Cont: 64 0.91) 1.02) 1.00)
etoposide (26-87)
(202)
Kang Gastric or ATTRACTION-2 >1 Nivolumab Placebo 62 (IQR, Int: 8.87 348 145 0.63 0.59 0.83
et al,23 gastroeso- (330) (163) 53-69) (IQR, (0.51- (0.46- (0.56-
2017 phageal 6.57-12.37); 0.78) 0.75) 1.23)
junction Cont: 8.59
carcinoma (IQR,
5.65-11.37)
Larkin Melanoma NR >1 Nivolumab ICC (133) 61 苲 261 144 0.95 0.85 1.07
et al,24 (272) (23-88) 24 (NR) (0.73- (0.62- (0.69-
2018 1.24) 1.17) 1.65)
Maio Meso- DETERMINE >1 Tremelimumab Placebo 67 (IQR, NR 434 137 0.92 0.91 1.12
et al,25 thelioma (382) (189) 60-73) (0.76- (0.73- (0.72-
2017 1.12) 1.13) 1.75)
Motzer ccRCC CheckMate >1 Nivolumab Everolimus 62 14 (NR) 619 202 0.73 0.73 0.84
et al,26 025 (410) (411) (18-88) (98.5% CI, (0.58- (0.57-
2015 0.57-0.93) 0.92) 1.24)
Motzer ccRCC CheckMate 1 Nivolumab + Sunitinib Int: 62 25.2 (NR) 615 232 0.63 0.71 0.52
et al,27 214 ipilimumab (422) (26-85); (99.8% CI, (0.55- (0.34-
2018 (425) Cont: 51 0.44-0.89) 0.92) 0.78)
(21-85)
Paz-Ares NSCLC KEYNOTE 1 Pembrolizumab Placebo + Int: 65 7.8 455 104 0.64 0.69 0.42
et al,35 407 + ICC (278) ICC (281) (29-87); (0.1-19.1) (0.49- (0.51- (0.22-
2018 Cont: 65 0.85) 0.94) 0.81)
(36-88)
Reck SCLC NR 1 Ipilimumab + Placebo + 63 Int: 10.5 643 311 0.94 1.07 1.06
et al,28 etoposide + etoposide + (36-85) (NR); (0.81- (0.89- (0.81-
2016 platinum (478) platinum Cont: 10.2 1.09) 1.28) 1.37)
(476) (NR)
Reck NSCLC KEYNOTE 1 Pembrolizumab ICC (151) 65 11.2 187 118 0.60 0.54 0.96
et al,29 024 (154) (33-90) (6.3-19.7) (0.41- (0.36- (0.56-
2016 0.89) 0.80) 1.64)

(continued)

et al27 performed OS analysis on only a sex subgroup among 847 a survival advantage for both sexes (men HR, 0.71 [95% CI, 0.55-
patients with intermediate- or poor-risk disease, demonstrating 0.92]; women HR, 0.52 [95% CI, 0.34-0.78]).

532 JAMA Oncology April 2019 Volume 5, Number 4 (Reprinted) jamaoncology.com

© 2019 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ on 04/05/2021


Association of Patient Sex With Efficacy of Immune Checkpoint Inhibitors and Overall Survival in Advanced Cancers Original Investigation Research

Table 1. Characteristics and Outcomes of the 23 Trials Included in the Meta-analysis


Age,
Median Follow-up,
Control (Range Median
Disease Lines of Intervention Treatment or IQR), (Range or Sex, No. Overall Survival HR (95% CI)
Source Site Trial Name Therapy (No.) (No.) y IQR), mo Men Women Overall Men Women
Ribas Melanoma NR 1 Tremelimumab ICC (327) 57 NR 372 283 0.88 (NR); 0.93 0.81
et al,30 (328) (22-90) P = .13 (0.74- (0.62-
2013 1.17) 1.06)
Rittmeyer NSCLC OAK >1 Atezolizumab Docetaxel 64 21 (NR) 520 330 0.73 0.79 0.64
et al,31 (425) (425) (33-85) (0.62- (0.64- (0.49-
2017 0.87) 0.97) 0.85)
Robert Melanoma NR 1 Ipilimumab + Placebo + 56.9 54 (NR) 301 201 0.72 0.70 0.86
et al,32 dacarbazine dacar- (NR) (0.59- (0.55- (0.63-
2011 (250) bazine 0.87) 0.90) 1.17)
(252)
Robert Melanoma CheckMate 1 Nivolumab Dacar- 65 Int: 8.9 246 172 0.42 0.34 0.56
et al,33 066 (210) bazine (18-87) (NR); (0.25- (0.22- (0.33-
2015 (208) Cont: 6.8 0.73) 0.54) 0.95)
(NR)

Abbreviations: ccRCC, clear cell renal cell carcinoma; Cont, control group; HR, hazard ratio; ICC, investigator’s choice of chemotherapy; Int, intervention group;
IQR, interquartile range; NR, not reported; NSCLC, non–small cell lung cancer; PD-L1, programmed cell death 1 ligand 1; SCLC, small cell lung cancer.
a
Sex subgroup analysis performed in population with positive PD-L1.

Table 2. Differences in Efficacy of Immunotherapy in Men and Women by Subgroups


Test for
Study, Participants, No. Pooled HR (95% CI) for IO vs SOC Difference
Variable No. (%) Men Women Men Women I2, % P Value
Overall 23 9322 4399 0.75 (0.69-0.81) 0.77 (0.67-0.88) 38 .60
Disease site
Melanoma 4 (17) 1180 800 0.68 (0.48-0.97) 0.83 (0.68-1.00) 16 .36
NSCLC 11 (48) 4520 2125 0.79 (0.71-0.88) 0.72 (0.56-0.93) 61 .79
Other tumors 8 (35) 3622 1474 0.76 (0.66-0.89) 0.83 (0.69-1.00) 0 .47
Line of therapy
First line 11 (48) 4410 2139 0.75 (0.64-0.87) 0.73 (0.57-0.94) 58 .92
Subsequent 12 (52) 4912 2260 0.73 (0.66-0.80) 0.79 (0.68-0.91) 2 .38
Class of immunotherapya
Anti–CTLA-4 6 (26) 3000 1278 0.86 (0.76-0.98) 0.91 (0.73-1.13) 26 .62
Anti–PD-1 18 (78) 7198 3495 0.70 (0.65-0.77) 0.70 (0.60-0.83) 44 .94
Abbreviations: CTLA-4, cytotoxic
Study methodology
T-lymphocyte antigen-4; HR, hazard
Non-IO + IO vs non-IO 6 (26) 2658 1125 0.80 (0.68-0.94) 0.69 (0.45-1.07) 69 .55 ratio; IO, immunotherapy;
IO vs non-IO 17 (74) 6664 3274 0.73 (0.66-0.80) 0.79 (0.69-0.89) 14 .33 NSCLC, non–small cell lung cancer;
Proportion of women, % PD-1, programmed cell death 1;
<20 3 (13) 1390 279 0.75 (0.63-0.90) 0.82 (0.41-1.64) 58 .65 SOC, standard of care chemotherapy.
a
20-30 7 (30) 3126 1133 0.72 (0.64-0.81) 0.72 (0.57-0.91) 33 .93 Motzer et al27 included both classes
31-39 8 (35) 3205 1815 0.81 (0.70-0.94) 0.88 (0.73-1.06) 0 .52 of immunotherapy in subgroups as
agents from both categories used in
≥40 5 (22) 1601 1172 0.67 (0.52-0.87) 0.63 (0.44-0.90) 71 .76
the exposure arm.

The median age of patients included was typically in the 70s; lection bias because of this criterion. Generally, all studies were
however, in 2 trials, the median age was in the 60s.30,32 Most stud- at low risk for attrition and reporting bias. Several studies were
ies tended to have short follow-up, although 3 trials (13%) had a unblinded and were thus at risk for performance and detection
median follow-up of 24 months or more.24,27,34 Overall, all but bias; however, for the outcome of OS, such a lack of blinding is
7 studies18,21,24,25,28,30,36 (30%) showed an OS advantage for pa- likely inconsequential as blinding is unlikely to affect the outcome.
tients who received immunotherapy compared with the control
group. In subgroup analyses, 14 studies15-17,19,20,22,23,26,27,29,31-33,35 Primary Analysis
(61%) demonstrated a survival advantage from immunotherapy Meta-analysis of the available literature demonstrated a statis-
among men and 7 studies20,22,27,31,33-35 (30%) showed this advan- tically significant advantage in OS for patients who received
tage among women. immunotherapy compared with other systemic therapies
(HR, 0.75, 95% CI, 0.70-0.81; P < .001; I2 = 61%). Compared with
Risk of Bias SOC systemic therapy, an OS advantage of immunotherapy
Risk of bias of the included trials is shown in the eTable in the was observed for both men (HR, 0.75; 95% CI, 0.69-0.81;
Supplement. All trials included random-sequence generation and P < .001) and women (HR, 0.77; 95% CI, 0.67-0.88; P = .002);
were at low risk for selection bias. There was intermittent report- however, we found no statistically significant difference
ing of allocation concealment; several studies were at risk for se- in OS advantage between the sexes (P = .60; I2 = 38%) (Table 2,

jamaoncology.com (Reprinted) JAMA Oncology April 2019 Volume 5, Number 4 533

© 2019 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ on 04/05/2021


Research Original Investigation Association of Patient Sex With Efficacy of Immune Checkpoint Inhibitors and Overall Survival in Advanced Cancers

Figure 2. Forest Plot of Association Between Overall Survival and Immunotherapy (IO) and Standard of Care (SOC) Stratified by Patient Sex

A Overall survival for men B Overall survival for women


Source HR (95% CI) Favors IO Favors SOC HR (95% CI) Favors IO Favors SOC
Antonia et al,34 2018a 0.78 (0.59-1.03) 0.46 (0.30-0.73)
Barlesi et al,36 2018a 0.83 (0.64-1.08) 1.08 (0.74-1.59)
Bellmunt et al,15 2017 0.73 (0.56-0.94) 0.78 (0.49-1.24)
Borghaei et al,16 2015 0.73 (0.56-0.96) 0.78 (0.58-1.04)
Brahmer et al,17 2015 0.57 (0.41-0.78) 0.67 (0.36-1.25)
Carbone et al,18 2017 0.97 (0.74-1.26) 1.15 (0.79-1.66)
Ferris et al,19 2016 0.65 (0.48-0.88) 0.93 (0.47-1.85)
Gandhi et al,20 2018a 0.70 (0.50-0.99) 0.29 (0.19-0.44)
Govindan et al,21 2017 0.85 (0.71-1.02) 1.33 (0.84-2.11)
Herbst et al,22 2016 0.65 (0.52-0.81) 0.69 (0.51-0.94)
Horn et al,37 2018a 0.74 (0.54-1.02) 0.65 (0.42-1.00)
Kang et al,23 2017 0.59 (0.46-0.75) 0.83 (0.56-1.23)
Larkin et al,24 2018 0.85 (0.62-1.17) 1.07 (0.69-1.65)
Maio et al,25 2017 0.91 (0.73-1.13) 1.12 (0.72-1.75)
Motzer et al,26 2015 0.73 (0.58-0.92) 0.84 (0.57-1.24)
Motzer et al,27 2018a 0.71 (0.55-0.92) 0.52 (0.34-0.78)
Paz-Ares et al,35 2018a 0.69 (0.51-0.94) 0.42 (0.22-0.81)
Reck et al,28 2016 1.07 (0.89-1.28) 1.06 (0.81-1.37)
Reck et al,29 2016 0.54 (0.36-0.80) 0.96 (0.56-1.64)
Ribas et al,30 2013 0.93 (0.74-1.17) 0.81 (0.62-1.06)
Rittmeyer et al,31 2017a 0.79 (0.64-0.97) 0.64 (0.49-0.85)
Robert et al,32 2011 0.70 (0.55-0.90) 0.86 (0.63-1.17)
Robert et al,33 2015 0.34 (0.22-0.54) 0.56 (0.33-0.95)

0 0.25 0.50 0.75 1.00 1.25 1.50 1.75 0 0.25 0.50 0.75 1.00 1.25 1.50 1.75
HR (95% CI) HR (95% CI)

HR indicates hazard ratio.


a
New studies included in this meta-analysis.

Figure 2). Statistically significant heterogeneity was demon- These conflicting results may be explained in a number of
strated among both men (tau2 = 0.02; χ2 = 51.67; P = .003; ways. First, we excluded 3 trials, which were included in Conforti
I2 = 57%) and women (tau2 = 0.07; χ2 = 62.29; P < .001; I2 = 65%). et al,10 that compared various immunotherapy regimes.38-40 By
including only those trials that compared an immunotherapy
Subgroup Analysis group with a nonimmunotherapy control, we were able to specif-
We performed a number of subgroup analyses according to dis- ically assess the association of sex with response to immuno-
ease site, line of therapy, class of immunotherapy, and study therapy.Second,weexpandedthesearchcriteriatoincludeimmu-
methodology. No statistically significant differences in the ef- notherapy agents that were not considered in Conforti et al.10 The
ficacy of immunotherapy were found between men and resulting search included a trial of atezolizumab in patients with
women in any of these analyses (Table 2). Finally, we exam- NSCLC.31 This trial demonstrated a greater net value of immuno-
ined for the effect of the prevalence of women in the study co- therapy for women (HR, 0.64; 95% CI, 0.49-0.85) than for men
hort. Again, no statistically significant differences were dem- (HR, 0.79; 95% CI, 0.64-0.97). Because this trial was large (n =
onstrated among these subgroups (Table 2). 850 patients), it contributed considerably to the pooled HR effect.
Third, we updated the search previously performed and
identified 7 recent large trials that have been published since
the end date for inclusion in the Conforti et al 10 meta-
Discussion analysis. Gandhi et al20 in KEYNOTE 189 tested pembroli-
Contrary to the published meta-analysis by Conforti et al,10 which zumab plus platinum chemotherapy (n = 410) vs pla-
suggested a greater immunotherapy advantage compared with cebo plus platinum chemotherapy (n = 206) in the first-line
SOC systemic therapy for men than women, the present analy- setting among patients with NSCLC. KEYNOTE 189 included
sis found no difference in OS from immune checkpoint inhibi- 363 men and 253 women and noted a strong OS advantage from
tors when comparing the efficacy of these treatments between immunotherapy among women (HR, 0.29; 95% CI, 0.19-
the sexes. Furthermore, when assessing several subgroup analy- 0.44) compared with men (HR, 0.70; 95% CI, 0.50-0.99).
ses, including disease site, line of therapy, class of immuno- Motzer et al27 in CheckMate 214 tested nivolumab plus ipili-
therapy, and study methodology, we could not demonstrate any mumab (n = 425) and the tyrosine-kinase inhibitor sunitinib
significant sex-associated differences in efficacy. (n = 422) in the first-line setting among intermediate- and poor-

534 JAMA Oncology April 2019 Volume 5, Number 4 (Reprinted) jamaoncology.com

© 2019 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ on 04/05/2021


Association of Patient Sex With Efficacy of Immune Checkpoint Inhibitors and Overall Survival in Advanced Cancers Original Investigation Research

risk patients with clear cell renal cell carcinoma. CheckMate immunotherapy group and a nonimmunotherapy control group;
214 had 615 men and 232 women and also found a strong OS the broad inclusion of all approved immunotherapy agents; and
advantage from immunotherapy among women (HR, 0.52; the rigorous, up-to-date search strategy. As a result, this analy-
95% CI, 0.34-0.78) compared with men (HR, 0.71; 95% CI, sis provides a comprehensive assessment of the association of
0.55-0.92). KEYNOTE 407 tested first-line pembrolizumab vs patient sex with response to immunotherapy compared with
saline placebo (plus carboplatin and either paclitaxel or nonimmunotherapy, including data on more than 13 000 pa-
nanoparticle albumin-bound paclitaxel) among patients with tients. Furthermore, we undertook several subgroup analyses
NSCLC.35 Although women made up only 18.6% of partici- in an attempt to ascertain any differences in immunotherapy ef-
pants in KEYNOTE 407, they had a remarkable immuno- ficacy between the sexes.
therapy treatment advantage (HR, 0.42; 95% CI, 0.22-0.81) This analysis has several limitations. First, it relies on pub-
compared with men (HR, 0.69; 95% CI, 0.51-0.94). Taken to- lished clinical trial subgroup HRs and not on individual patient-
gether, the present meta-analysis provides a more specific level data. Second, residual confounding is possible in that dif-
assessment of the research question while including a greater ferences other than sex contribute to immunotherapy response
number of immunotherapy agents and an updated search. and OS. Third, differences in outcomes between men and wom-
Small samples sizes may result in an elevated false discov- en may be ascribed to other factors (including differences in life-
ery rate41 or even false-positive results.42 Meta-analyses of such style, comorbidities, incidence of autoimmune diseases, and
trials may propagate such findings by enhancing the statistical other factors) that are unaccounted for in clinical trials. Fourth,
power of these small subgroup analyses. To explore the final hy- as in all clinical trials, the included studies are at risk for having
pothesis that the representation of women in a study may me- nongeneralizable results (the so-called efficacy-effectiveness gap)
diate observed differences in immunotherapy efficacy between because of referral bias and strict inclusion criteria, among other
men and women, we performed a stratified analysis. We found factors, that result in the underrepresentation of uninsured, low-
no statistically significant difference in outcomes between men income, and minority populations. Meta-analysis of these trials,
and women regardless of the proportion of women in the study such as the one we performed, is subject to the same limitations.
cohort. The effect estimates favored men in studies with study Finally, the trials that we excluded because of a lack of published
cohorts composed of less than 20% women, but the results were sex-subgroup analyses may demonstrate sex differences if ana-
very comparable in the other subgroups. Trials with an under- lyzed in this fashion.
representation of women may present spurious results for
sex-specific subgroup analyses, as evidenced by the wide CIs
when less than 20% of the cohort represented is women.
Six20,27,31,34,36,37 of the 7 trials included in this meta-analysis but
Conclusions
not included in the Conforti et al10 study had more than 27% In this contemporary meta-analysis of all available immuno-
women representation, with 2 trials20,31 having more than 38% therapy clinical trials across all disease sites, we found no
women inclusion. difference in immunotherapy efficacy or OS between
women and men. Contrary to findings of a previous analysis,
Strengths and Limitations we found no evidence that sex should be considered when
The strengths of this meta-analysis include the strict methodo- deciding whether to offer immunotherapy to patients with
logic inclusion criteria that required the comparison between an advanced cancers.

ARTICLE INFORMATION Department of Surgery, Medical College of Georgia Illumina, Tempus, and Novartis. Dr Patel's university
Accepted for Publication: October 10, 2018. at Augusta University, Augusta (Klaassen); Georgia receives research funding from Bristol-Myers
Cancer Center, Augusta University, Augusta, Squibb, Eli Lilly, Fate, Incyte, AstraZeneca/
Published Online: January 3, 2019. Georgia (Klaassen). MedImmune, Merck, Pfizer, Roche/Genentech,
doi:10.1001/jamaoncol.2018.5904 Xcovery, Fate Therapeutics, Genocea, and Iovance.
Author Contributions: Drs Wallis and Klaassen had
Author Affiliations: Division of Urology, full access to all of the data in the study and take Dr Pal reported receiving personal fees from
Department of Surgery, University of Toronto, responsibility for the integrity of the data and the Genentech, Pfizer, and BMS outside of the
Toronto, Ontario, Canada (Wallis); School of accuracy of the data analysis. submitted work. No other disclosures were
Medicine, Royal College of Surgeons in Ireland, Concept and design: Wallis, Hamid, Pal, Klaassen. reported.
Dublin, Ireland (Butaney); Center for Outcomes Acquisition, analysis, or interpretation of data:
Research, Department of Urology, Houston Wallis, Butaney, Satkunasivam, Freedland, Patel, REFERENCES
Methodist Hospital, Houston, Texas Hamid, Klaassen. 1. Klein SL, Flanagan KL. Sex differences in immune
(Satkunasivam); Division of Urology, Department of Drafting of the manuscript: Wallis, Patel, Hamid, responses. Nat Rev Immunol. 2016;16(10):626-638.
Surgery, Cedars-Sinai Medical Center, Los Angeles, Klaassen. doi:10.1038/nri.2016.90
California (Freedland); Urology Section, Durham VA Critical revision of the manuscript for important
Medical Center, Durham, North Carolina 2. Whitacre CC, Reingold SC, O’Looney PA.
intellectual content: All authors. A gender gap in autoimmunity. Science. 1999;283
(Freedland); Moores Cancer Center-La Jolla, Statistical analysis: Wallis, Satkunasivam.
Department of Medicine, University of California, (5406):1277-1278. doi:10.1126/science.283.5406.1277
Administrative, technical, or material support:
San Diego, La Jolla (Patel); Translational Research & Wallis, Butaney, Patel, Pal, Klaassen. 3. vom Steeg LG, Klein SL. SeXX matters in
Immunooncology, The Angeles Clinic & Research Supervision: Patel, Pal, Klaassen. infectious disease pathogenesis. PLoS Pathog.
Institute, Los Angeles, California (Hamid); 2016;12(2):e1005374. doi:10.1371/journal.ppat.
Department of Medical Oncology and Experimental Conflict of Interest Disclosures: Dr Freedland 1005374
Therapeutics, City of Hope Comprehensive Cancer reported receiving grants from Merck outside of the
submitted work. Dr Patel reported receiving 4. Klein SL, Jedlicka A, Pekosz A. The Xs and Y of
Center, Duarte, California (Pal); Division of Urology, immune responses to viral vaccines. Lancet Infect Dis.
scientific advisory income from AstraZeneca, BMS,

jamaoncology.com (Reprinted) JAMA Oncology April 2019 Volume 5, Number 4 535

© 2019 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ on 04/05/2021


Research Original Investigation Association of Patient Sex With Efficacy of Immune Checkpoint Inhibitors and Overall Survival in Advanced Cancers

2010;10(5):338-349. doi:10.1016/S1473-3099(10) 18. Carbone DP, Reck M, Paz-Ares L, et al; 30. Ribas A, Kefford R, Marshall MA, et al. Phase III
70049-9 CheckMate 026 Investigators. First-line nivolumab randomized clinical trial comparing tremelimumab
5. Cook MB, Dawsey SM, Freedman ND, et al. Sex in stage IV or recurrent non–small-cell lung cancer. with standard-of-care chemotherapy in patients
disparities in cancer incidence by period and age. N Engl J Med. 2017;376(25):2415-2426. doi:10. with advanced melanoma. J Clin Oncol. 2013;31(5):
Cancer Epidemiol Biomarkers Prev. 2009;18(4): 1056/NEJMoa1613493 616-622. doi:10.1200/JCO.2012.44.6112
1174-1182. doi:10.1158/1055-9965.EPI-08-1118 19. Ferris RL, Blumenschein G Jr, Fayette J, et al. 31. Rittmeyer A, Barlesi F, Waterkamp D, et al; OAK
6. Cook MB, McGlynn KA, Devesa SS, Nivolumab for recurrent squamous-cell carcinoma Study Group. Atezolizumab versus docetaxel in
Freedman ND, Anderson WF. Sex disparities in of the head and neck. N Engl J Med. 2016;375(19): patients with previously treated non-small-cell lung
cancer mortality and survival. Cancer Epidemiol 1856-1867. doi:10.1056/NEJMoa1602252 cancer (OAK): a phase 3, open-label, multicentre
Biomarkers Prev. 2011;20(8):1629-1637. doi:10. 20. Gandhi L, Rodríguez-Abreu D, Gadgeel S, et al; randomised controlled trial. Lancet. 2017;389
1158/1055-9965.EPI-11-0246 KEYNOTE-189 Investigators. Pembrolizumab plus (10066):255-265. doi:10.1016/S0140-6736(16)
chemotherapy in metastatic non–small-cell lung 32517-X
7. Polanczyk MJ, Hopke C, Vandenbark AA,
Offner H. Treg suppressive activity involves cancer. N Engl J Med. 2018;378(22):2078-2092. 32. Robert C, Thomas L, Bondarenko I, et al.
estrogen-dependent expression of programmed doi:10.1056/NEJMoa1801005 Ipilimumab plus dacarbazine for previously
death-1 (PD-1). Int Immunol. 2007;19(3):337-343. 21. Govindan R, Szczesna A, Ahn MJ, et al. Phase III untreated metastatic melanoma. N Engl J Med.
doi:10.1093/intimm/dxl151 trial of ipilimumab combined with paclitaxel and 2011;364(26):2517-2526. doi:10.1056/
carboplatin in advanced squamous non–small-cell NEJMoa1104621
8. Polanczyk MJ, Hopke C, Vandenbark AA,
Offner H. Estrogen-mediated immunomodulation lung cancer. J Clin Oncol. 2017;35(30):3449-3457. 33. Robert C, Long GV, Brady B, et al. Nivolumab in
involves reduced activation of effector T cells, doi:10.1200/JCO.2016.71.7629 previously untreated melanoma without BRAF
potentiation of Treg cells, and enhanced expression 22. Herbst RS, Baas P, Kim DW, et al. mutation. N Engl J Med. 2015;372(4):320-330. doi:
of the PD-1 costimulatory pathway. J Neurosci Res. Pembrolizumab versus docetaxel for previously 10.1056/NEJMoa1412082
2006;84(2):370-378. doi:10.1002/jnr.20881 treated, PD-L1-positive, advanced non-small-cell 34. Antonia SJ, Villegas A, Daniel D, et al; PACIFIC
9. Botticelli A, Onesti CE, Zizzari I, et al. The sexist lung cancer (KEYNOTE-010): a randomised Investigators. Overall survival with durvalumab
behaviour of immune checkpoint inhibitors in controlled trial. Lancet. 2016;387(10027):1540-1550. after chemoradiotherapy in Stage III NSCLC
cancer therapy? Oncotarget. 2017;8(59):99336- doi:10.1016/S0140-6736(15)01281-7 [published online September 25, 2018]. N Engl J Med.
99346. doi:10.18632/oncotarget.22242 23. Kang YK, Boku N, Satoh T, et al. Nivolumab in 2018. doi:10.1056/NEJMoa1809697

10. Conforti F, Pala L, Bagnardi V, et al. Cancer patients with advanced gastric or 35. Paz-Ares L, Luft A, Vicente D, et al;
immunotherapy efficacy and patients’ sex: gastro-oesophageal junction cancer refractory to, KEYNOTE-407 Investigators. Pembrolizumab plus
a systematic review and meta-analysis. Lancet Oncol. or intolerant of, at least two previous chemotherapy chemotherapy for squamous non–small-cell lung
2018;19(6):737-746. doi:10.1016/S1470-2045(18) regimens (ONO-4538-12, ATTRACTION-2): cancer. N Engl J Med. 2018;379(21)2040-2051.
30261-4 a randomised, double-blind, placebo-controlled, doi:10.1056/NEJMoa1810865
phase 3 trial. Lancet. 2017;390(10111):2461-2471. 36. Barlesi F, Vansteenkiste J, Spigel D, et al.
11. Graham J, Abdel-Rahman O, Choueiri TK, doi:10.1016/S0140-6736(17)31827-5
Heng DYC; International mRCC Database Avelumab versus docetaxel in patients with
Consortium. Re: Fabio Conforti, Laura Pala, 24. Larkin J, Minor D, D’Angelo S, et al. Overall platinum-treated advanced non-small-cell lung
Vincenzo Bagnardi, et al. Cancer immunotherapy survival in patients with advanced melanoma who cancer (JAVELIN Lung 200): an open-label,
efficacy and patients’ sex: a systematic review and received nivolumab versus investigator’s choice randomised, phase 3 study [published online
meta-analysis. Lancet Oncol 2018;19:737-46. Eur Urol. chemotherapy in CheckMate 037: a randomized, September 21, 2018]. Lancet Oncol. 2018;
2018;S0302-2838(18)30482-2. doi:10.1016/j.eururo. controlled, open-label phase III trial. J Clin Oncol. S1470-2045(18)30673-9. doi:10.1016/S1470-2045
2018.07.004 2018;36(4):383-390. doi:10.1200/JCO.2016.71.8023 (18)30673-9

12. Moher D, Liberati A, Tetzlaff J, Altman DG; 25. Maio M, Scherpereel A, Calabrò L, et al. 37. Horn L, Mansfield AS, Szczęsna A, et al;
PRISMA Group. Preferred Reporting Items for Tremelimumab as second-line or third-line IMpower133 Study Group. First-line atezolizumab
Systematic Reviews and Meta-analyses: the treatment in relapsed malignant mesothelioma plus chemotherapy in extensive-stage small-cell
PRISMA statement. J Clin Epidemiol. 2009;62(10): (DETERMINE): a multicentre, international, lung cancer [published online September 25, 2018].
1006-1012. doi:10.1016/j.jclinepi.2009.06.005 randomised, double-blind, placebo-controlled N Engl J Med. 2018. doi:10.1056/NEJMoa1809064
phase 2b trial. Lancet Oncol. 2017;18(9):1261-1273. 38. Robert C, Schachter J, Long GV, et al;
13. Higgins JP, Altman DG, Gøtzsche PC, et al; doi:10.1016/S1470-2045(17)30446-1
Cochrane Bias Methods Group; Cochrane Statistical KEYNOTE-006 Investigators. Pembrolizumab
Methods Group. The Cochrane Collaboration’s tool 26. Motzer RJ, Escudier B, McDermott DF, et al; versus ipilimumab in advanced melanoma. N Engl J
for assessing risk of bias in randomised trials. BMJ. CheckMate 025 Investigators. Nivolumab versus Med. 2015;372(26):2521-2532. doi:10.1056/
2011;343:d5928. doi:10.1136/bmj.d5928 everolimus in advanced renal-cell carcinoma. N Engl NEJMoa1503093
J Med. 2015;373(19):1803-1813. doi:10.1056/ 39. Hodi FS, Chesney J, Pavlick AC, et al. Combined
14. Higgins JP, Thompson SG, Deeks JJ, Altman DG. NEJMoa1510665
Measuring inconsistency in meta-analyses. BMJ. nivolumab and ipilimumab versus ipilimumab alone
2003;327(7414):557-560. doi:10.1136/bmj.327.7414. 27. Motzer RJ, Tannir NM, McDermott DF, et al; in patients with advanced melanoma: 2-year overall
557 CheckMate 214 Investigators. Nivolumab plus survival outcomes in a multicentre, randomised,
ipilimumab versus sunitinib in advanced renal-cell controlled, phase 2 trial. Lancet Oncol. 2016;17(11):
15. Bellmunt J, de Wit R, Vaughn DJ, et al; carcinoma. N Engl J Med. 2018;378(14):1277-1290. 1558-1568. doi:10.1016/S1470-2045(16)30366-7
KEYNOTE-045 Investigators. Pembrolizumab as doi:10.1056/NEJMoa1712126
second-line therapy for advanced urothelial 40. Hodi FS, O’Day SJ, McDermott DF, et al.
carcinoma. N Engl J Med. 2017;376(11):1015-1026. 28. Reck M, Luft A, Szczesna A, et al. Phase III Improved survival with ipilimumab in patients with
doi:10.1056/NEJMoa1613683 randomized trial of ipilimumab plus etoposide and metastatic melanoma. N Engl J Med. 2010;363(8):
platinum versus placebo plus etoposide and 711-723. doi:10.1056/NEJMoa1003466
16. Borghaei H, Paz-Ares L, Horn L, et al. platinum in extensive-stage small-cell lung cancer.
Nivolumab versus docetaxel in advanced 41. Button KS, Ioannidis JP, Mokrysz C, et al. Power
J Clin Oncol. 2016;34(31):3740-3748. doi:10. failure: why small sample size undermines the
nonsquamous non–small-cell lung cancer. N Engl J 1200/JCO.2016.67.6601
Med. 2015;373(17):1627-1639. doi:10.1056/ reliability of neuroscience. Nat Rev Neurosci. 2013;
NEJMoa1507643 29. Reck M, Rodríguez-Abreu D, Robinson AG, 14(5):365-376. doi:10.1038/nrn3475
et al; KEYNOTE-024 Investigators. Pembrolizumab 42. Hackshaw A. Small studies: strengths and
17. Brahmer J, Reckamp KL, Baas P, et al. versus chemotherapy for PD-L1-positive
Nivolumab versus docetaxel in advanced limitations. Eur Respir J. 2008;32(5):1141-1143.
non–small-cell lung cancer. N Engl J Med. 2016;375 doi:10.1183/09031936.00136408
squamous-cell non–small-cell lung cancer. N Engl J (19):1823-1833. doi:10.1056/NEJMoa1606774
Med. 2015;373(2):123-135. doi:10.1056/
NEJMoa1504627

536 JAMA Oncology April 2019 Volume 5, Number 4 (Reprinted) jamaoncology.com

© 2019 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ on 04/05/2021

You might also like