Professional Documents
Culture Documents
Magnetic Resonance Imaging - 2023 - Li - Diagnosis of Major Depressive Disorder Using Machine Learning Based On
Magnetic Resonance Imaging - 2023 - Li - Diagnosis of Major Depressive Disorder Using Machine Learning Based On
Magnetic Resonance Imaging - 2023 - Li - Diagnosis of Major Depressive Disorder Using Machine Learning Based On
Background: Previous studies have found qualitative structural and functional brain changes in major depressive disorder
(MDD) patients. However, most studies ignored the complementarity of multisequence MRI neuroimaging features and
cannot determine accurate biomarkers.
Purpose: To evaluate machine-learning models combined with multisequence MRI neuroimaging features to diagnose
patients with MDD.
Study Type: Prospective.
Subjects: A training cohort including 111 patients and 90 healthy controls (HCs) and a test cohort including 28 patients
and 22 HCs.
Field Strength/Sequence: A 3.0 T/T1-weighted imaging, resting-state functional MRI with echo-planar sequence, and
single-shot echo-planar diffusion tensor imaging.
Assessment: Recruitment and integration were used to reflect the dynamic changes of functional networks, while gray
matter volume and fractional anisotropy were used to reflect the changes in the morphological and anatomical network.
We then fused features with significant differences in functional, morphological, and anatomical networks to evaluate a
random forest (RF) classifier to diagnose patients with MDD. Furthermore, a support vector machine (SVM) classifier was
used to verify the stability of neuroimaging features. Linear regression analyses were conducted to investigate the relation-
ships among multisequence neuroimaging features and the suicide risk of patients.
Statistical Tests: The comparison of functional network attributes between patients and controls by two-sample t-test.
Network-based statistical analysis was used to identify structural and anatomical connectivity changes between MDD and
HCs. The performance of the model was evaluated by receiver operating characteristic (ROC) curves.
Results: The performance of the RF model integrating multisequence neuroimaging features in the diagnosis of depres-
sion was significantly improved, with an AUC of 93.6%. In addition, we found that multisequence neuroimaging features
could accurately predict suicide risk in patients with MDD (r = 0.691).
Data Conclusion: The RF model fusing functional, morphological, and anatomical network features performed well in diag-
nosing patients with MDD and provided important insights into the pathological mechanisms of MDD.
Evidence Level: 1.
Technical Efficacy: Stage 2.
J. MAGN. RESON. IMAGING 2023;58:1420–1430.
*Address reprint requests to: P.W., Department of Radiology, Yantai Affiliated Hospital of Binzhou Medical University, Yantai, Shandong, People’s Republic of
China, 264100. E-mail: wangpeiyuan1640@163.com, N.M., Department of Radiology, Yantai Yuhuangding Hospital, Qingdao University, Yantai, Shandong, Peo-
ple’s Republic of China, 264000. E-mail: maoning@pku.edu.cn, or T.C., Department of Radiology, Yantai Yuhuangding Hospital, Qingdao University, Yantai,
Shandong, People’s Republic of China, 264000. E-mail: chutongpeng@163.com
Qinghe Li and Fanghui Dong are co-first authors on the paper.
Contract grant sponsor: National Natural Science Foundation of China; Contract grant number: 82001775, 62176140, 61773244; Contract grant sponsor: Natural
Science Foundation of Shandong Province; Contract grant number: ZR2021MH120; Contract grant sponsor: “Taishan Scholar”; Contract grant number:
tsqn202103197.
From the 1Department of Radiology, Yantai Affiliated Hospital of Binzhou Medical University, Yantai, Shandong, People’s Republic of China; 2School of
Medical Imaging, Binzhou Medical University, Yantai, Shandong, People’s Republic of China; 3Department of Radiology, Yantai Yuhuangding Hospital,
Qingdao University, Yantai, Shandong, People’s Republic of China; and 4School of Compute Science and Technology, Shandong Technology and Business
University, Yantai, Shandong, People’s Republic of China
Additional supporting information may be found in the online version of this article
FIGURE 1: Workflow of the analysis. (a) Multimodel brain network modeling. Constructing morphological, anatomical, and functional
networks separately. (b) Feature extraction and selection of brain network. (c) Prediction. Machine learning model is used to
diagnose MDD and predict the suicide risk in patients with MDD. MDD = major depressive disorder; LASSO = least absolute
shrinkage and selection operator; RF = random forest; SVM = support vector machine.
co-registered images were normalized into the Montreal Neu- analysis. The Pearson correlation coefficient was used to
rological Institute (MNI) space. estimate the internode functional connections between the
Structural image data were preprocessed using the Com- nodal time courses. Similar to many previous dynamic
putational Anatomy Toolbox (CAT12, http://www.neuro. studies, we set the window length to 50 seconds and the
uni-jena.de/cat/). Each image was checked by an experienced sliding step to one repetition time.15,17 We used a multi-
neuroradiologist for artifacts and manually reoriented to layer community detection algorithm to divide the brain
adjust the origin of an image at the anterior commissure. network into communities,18 and then a multilayer net-
Next, the structural T1-weighted images were normalized to work model was used to describe the time-varying charac-
MNI space and resampled to 3 3 3 mm. Then, all the teristics of the whole brain layer by layer.17 Each node in
normalized images were segmented into gray matter (GM), one network layer is connected to itself in the other layers,
white matter, and cerebrospinal fluid. thus providing a “temporal link” or connectivity between
adjacent time points. The multilayer network model can
Functional Network optimize the module division of nodes in time and space,
For each individual, we used the sliding window incorporate connectivity information from adjacent win-
approach15 to construct dynamic brain connectomes in the dows, and depict the time flow between adjacent network
Dynamic BC toolbox (v2.2; http://restfmri.net/forum/ layers.17 We then calculated the recruitment and integra-
DynamicBC). Specifically, the whole brain was divided tion attributes of each brain node to quantify changes in
into 90 regions according to the anatomical automatic community structure over time based on probability and
labeling (AAL) template,16 and the average fMRI time reflect the dynamic interaction within and between differ-
series of each brain region was extracted for subsequent ent functional systems.
patients and control group. Demographic data values are default mode network (DMN), particularly the VIS and CC
expressed as mean standard deviation. (Fig. 2). Compared to HCs, the connections of morphologi-
Two-sample t-test was performed to screen for features cal network differences in patients with MDD were mainly
with significant differences in functional networks between located in the CC and subcortical networks (SC) (Fig. 3). In
patients and HCs (P < 0.05). Moreover, network-based statis- the Anatomical network, the brain regions with FA differ-
tical analysis (NBS) was used to identify altered connectivity ences between MDD patients and HCs were mainly located
in patients with MDD anatomical and morphological net- in the CC and sensorimotor network (SM) (Fig. 4). We fused
works.22 First, we set the threshold to P < 0.01 to find these the features of the three brain network differences and
suprathreshold connections. Next, the statistical significance selected 27 key features that were most closely related to
of the size of each observed component in the network was MDD through LASSO (see Supplemental Table S1).
calculated using the nonparametric permutation method
(1000 permutations). Suprathreshold connections that were Discriminative Analysis
significant at a corrected level of P < 0.01 were reported. Compared to the diagnosis of single sequence brain network
The performance of RF and SVM classifiers was evalu- features, the classification performance of the model integrat-
ated using receiver operating characteristic (ROC) curves and ing the three brain network features was significantly
area under the curve (AUC), sensitivity, specificity, and accu- improved (see Supplemental Table S2). The RF model
racy to evaluate the diagnostic efficacy of the model. The showed the best performance in MDD diagnosis, with an
Delong test was used to compare the AUC of the model. In accuracy of 88.24%, a sensitivity of 94.44%, a specificity of
addition, a two-sample t-test was used to compare the differ- 84.85%, and an AUC of 93.69% (Fig. 5b and Table 2).
ence in NGASR scores between patients and HCs (P < 0.05 From Fig. 5a, the classification result obtained with SVM is
indicating statistical significance). similar to that obtained with the proposed RF model. The
classification effect of fusing three brain network feature sets
Results is obviously higher than that of single sequence feature sets.
Demographic Data All identified connections are displayed in Figs. 2–4.
Details of the demographic data are presented in Table 1. The top 10 brain regions with the most significant contribu-
There were no significant differences between the two groups tions were selected for display in Table 3 and Fig. 6. The
with respect to age (t = 0.923, P = 0.498), gender average feature importance scores of these 10 features indi-
(t = 0.135, P = 0.713), and education level (t = 1.237, cated that the most discriminative features were located in the
P = 0.07). The MDD group had a significantly higher total VIS, CC, DMN, and SC. Among the 10 features that con-
HAMD score (t = 0.607) than the HCs. tributed the most to the model, eight were from the structural
network and two from the functional network.
Network Analysis
Patients with MDD demonstrated remarkably distinct struc- Predict the Suicide Risk of MDD Patients
tural and functional aberrance compared with HCs. In the As shown in Supplemental Table S3, NGASR scores of
functional network, the brain regions with two attributes MDD patients with suicide risk were significantly higher than
(recruitment and integration) difference in patients with those of MDD patients without suicide risk. We performed a
MDD were mainly located in the visual network (VIS), cog- regression analysis to predict the suicide risk of patients with
nitive control network (CC), auditory network (AUD), and MDD based on the selection of the 10 features with the
MDD = major depressive disorder; HCs = healthy controls; HAMD = Hamilton Depression Scale; BMI = body mass index.
*Denotes significance.
FIGURE 2: Comparison of dynamic network measurements between MDD and HCS. (a) Recruitment. (b) Integration. MDD = major
depressive disorder; HCs = healthy controls; L = left; R = right.
largest weight from the multisequence neuroimaging features. multilayer network of dynamic functional connections to
As shown in Fig 7, regression analyses indicated that multi- describe the time-varying characteristics among the layers of
sequence brain image features had the highest positive corre- brain regions, which helps us understand how dynamic inter-
lation between the predicted results and actual NGASR actions between brain networks affect the clinical symptoms
scores (r = 0.691). of patients. Moreover, we found that multisequence neuroim-
aging features can predict the suicide risk of patients with
MDD, which provides important insights into the pathologi-
Discussion cal mechanism of MDD.
In this prospective study, we integrated functional, morpho- Compared with a single sequence study, the RF model
logical, and anatomical network features to diagnose MDD, integrating three brain network feature sets greatly improved
and the RF model achieved a good classification performance. the performance of MDD diagnosis, which indicates that dif-
Compared with previous single and multisequence studies, ferent sequences of brain networks indeed carry complemen-
the RF classifier with multisequence neuroimaging features tary information related to the disease.5,23–25 This study
had higher sensitivity and accuracy. Furthermore, the results provides multidimensional feature information for diagnosing
showed that our neuroimaging features had good stability in MDD by building brain networks with different sequences.
comparison to the SVM classifier. In rs-fMRI, we used a A recent multisequence study based on traditional static
FIGURE 3: Morphological network changes in MDD patients; (a) connections with significantly increased volume; (b) connections with
significantly reduced volume; navy blue, nodes in SM; wathet, nodes in CC; yellow, nodes in VIS; green, nodes in DMN; orange,
nodes in SC; red, nodes in AUD. SM = sensorimotor network; CC = cognitive control network; VIS = visual network; DMN = default
mode network; SC = subcortical network; AUD = auditory network; L = left; R = right.
connections achieved a good classification performance, but information and has potential diagnostic value. The accuracy
its sensitivity was significantly lower than that of our study.13 of the anatomical network feature set was relatively low, indi-
The reason may be that there is time flow between brain cating that the information provided by the anatomical net-
regions, which provides rich dynamic brain network informa- work is limited. This is consistent with several previous
tion for diagnosing MDD. In addition, the results showed studies that functional network feature sets are more impor-
that the SVM model integrating three types of brain network tant for the diagnosis of mental diseases.26,27 In addition,
feature sets achieved the best classification performance, when we fused multisequence neuroimaging features to diag-
which further indicates that our neuroimaging features have nose MDD, we found that functional and structural networks
good stability. yielded more discriminative features, further verifying
In the present study, the features of the brain network our view.
integrating three different sequences provided more useful In the functional network, compared with HCs, we
information than a single sequence. In single-sequence diag- found that the integration and recruitment degree of the VIS
nosis, compared with structural and anatomical networks, the and CC in MDD patients was significantly reduced, indicat-
feature set of the functional network achieved the best classifi- ing that the network has been reconstructed, which not only
cation performance, which indicates that the time flow in the reduces connections within the system but also reduces func-
brain region structure contains a large amount of biological tional interactions between brain networks. Studies have
FIGURE 4: Increased brain regions of anatomical network in MDD patients; navy blue, nodes in SM; wathet, nodes in CC; yellow,
nodes in VIS; green, nodes in DMN; orange, nodes in SC; red, nodes in AUD. SM = sensorimotor network; CC = cognitive control
network; VIS = visual network; DMN = default mode network; SC = subcortical network; AUD = auditory network; L = left;
R = right.
FIGURE 5: The receiver operator characteristic (ROC) curves of different models: fMRI, DTI, sMRI and multimodal. (a) Support vector
machine (SVM) classifier, (b) random forest (RF) classifier. AUC = area under the receiver operating characteristic curve;
fMRI = functional MRI; sMRI = structural MRI; DTI = diffusion tensor imaging.
shown that an increase in flexibility scores leads to a decrease In previous studies on network disorders in patients with
in the recruitment value.17,28 In this regard, we believe that MDD, abnormalities in the DMN and AUD may affect the
the reduction in the integration score will make the network emotional and cognitive activities of the brain.30,31 Therefore,
more flexible, causing fragmentation of whole-brain networks. we infer that an increase in cross-network communication
This excessive flexibility indicates that the patient network ability may be a compensatory mechanism for maintaining
module lacks collaboration and stability, which reduces the basic cognitive processes.
recruitment value of the network.29 It is worth noting that In the present study, abnormal morphological connec-
the recruitment and integration values of the DMN and tions were mainly located in the CC and DMN. According
AUD in the MDD group were significantly higher than those to recent studies, structural abnormalities in the CC have
of the control group, which indicates that the information consistently been found in MDD, especially in patients with
interaction ability between networks has an increasing trend. cognitive impairment.32,33 Menon proposed a classic triple
Method Modality ACC (%) SPC (%) SEN (%) AUC (%)
Bhaumik et al SVM fMRI 76.1 68.9 81.5 NA
Ramasubbu et al SVM fMRI 66.0 72.0 59.0 NA
Qiu et al SVM sMRI 72.0 69.0 75.0 NA
Su et al RF fMRI 75.9 82.6 42.7 62.9
Yang et al SVM sMRI + fMRI 84.0 81.0 88.0 91.0
Benedatta et al SVM sMRI + DTI 72.9 73.3 74.3 79.0
Maglanoc et al SVM fMRI + sMRI + DTI 61.9 42.9 69.9 61.9
Our proposed RF Multimodal 88.2 94.4 84.8 93.7
ACC = accuracy; SPC = specificity; SEN = sensitivity; AUC = area under the receiver operating characteristic curve; RF = random
forest; SVM = support vector machine; fMRI = functional MRI; sMRI = structural MRI; DTI = diffusion tensor imaging; NA = not
available.
jWj is the absolute value of the regression coefficient of the connection strength of regions A and B through LASSO.
LASSO = least absolute shrinkage and selection operator; fMRI = functional MRI; sMRI = structural MRI; NA = not available;
L = left hemisphere; R = right hemisphere.
network model, which emphasized that the abnormal connec- in the early stage of the disease. The CC and VIS are the
tion between the CC and DMN played an important role in main fiber bundles that connect the contralateral homologous
switching networks and further led to the separation of the brain system.35,36 We inferred that local information
networks.34 Based on this model, we infer that the increased processing between the hemispheres of patients with MDD
flexibility of the CC in MDD patients may lead to changes may be interrupted. However, whether this conjecture is cor-
in DMN morphological connections, which in turn leads to rect requires further investigation.
cognitive impairment and low mood. Furthermore, our study In addition, the results showed that multisequence neu-
shows that the altered anatomical connections in patients roimaging features can accurately predict suicide risk in
with MDD mainly involve the CC and the VIS. Compared patients with MDD. In our study, the predicted scores were
with HCs, the anatomical connection of patients with MDD higher than the scale’s scores. We speculate that the suicide
was significantly enhanced, indicating that the integrity of risk of patients may be higher than previously thought and
white matter fibers in patients with MDD may be damaged recommend lowering the suicide risk score threshold.
FIGURE 6: Subnetworks that contribute the largest 10 neuroimage features in the random forest (RF) classifier. Red, CC; green, SC;
orange, VIS; and blue, DMN. CC = cognitive control network; SC = subcortical network; VIS = visual network; DMN = default mode
network; L = left; R = right.
Acknowledgments
The authors thank everyone who contributed to this research.
Author Contribution
Qinghe Li, Fanghui Dong: Investigation, Data curation, For-
mal analysis, Writing - original draft. Qun Gai, Kaili Che:
Investigation, Conceptualization, Data curation, Formal anal-
FIGURE 7: Prediction of suicide risk of MDD patients based on
ysis, Writing - original draft. Heng Ma, Feng Zhao: Data
the top 10 neuroimaging features with the largest feature
weight in the random forest (RF) classifier. MDD = major curation. Tongpeng Chu, Ning Mao, Peiyuan Wang:
depressive disorder Methodology, Investigation, Writing - review and editing.
References 21. Cutcliffe JR, Barker P. The Nurses’ global assessment of suicide risk
(NGASR): Developing a tool for clinical practice. J Psychiatr Ment
1. Zhang J, Wang J, Wu Q, et al. Disrupted brain connectivity networks in Health Nurs 2004;11(4):393-400.
drug-naive, first-episode major depressive disorder. Biol Psychiatry
2011;70(4):334-342. 22. Tyan YS, Liao JR, Shen CY, Lin YC, Weng JC. Gender differences in the
structural connectome of the teenage brain revealed by generalized
2. Ren X, Yu S, Dong W, Yin P, Xu X, Zhou M. Burden of depression in q-sampling MRI. Neuroimage Clin 2017;15:376-382.
China, 1990-2017: Findings from the global burden of disease study
2017. J Affect Disord 2020;268:95-101. 23. Su D, Zhang X, He K, Chen Y. Use of machine learning approach to
predict depression in the elderly in China: A longitudinal study.
3. Holma KM, Haukka J, Suominen K, et al. Differences in incidence of J Affect Disord 2021;282:289-298.
suicide attempts between bipolar I and II disorders and major depres-
sive disorder. Bipolar Disord 2014;16(6):652-661. 24. Bhaumik R, Jenkins LM, Gowins JR, et al. Multivariate pattern analysis
strategies in detection of remitted major depressive disorder using
4. Kim JH, Suh SI, Lee HJ, Lee JH, Lee MS. Cortical and subcortical gray resting state functional connectivity. Neuroimage Clin 2017;16:
matter alterations in first-episode drug-naive adolescents with major 390-398.
depressive disorder. Neuroreport 2019;30(17):1172-1178.
25. Ramasubbu R, Brown MR, Cortese F, et al. Accuracy of automated clas-
5. Qiu L, Huang X, Zhang J, et al. Characterization of major depressive sification of major depressive disorder as a function of symptom sever-
disorder using a multiparametric classification approach based on high ity. Neuroimage Clin 2016;12:320-331.
resolution structural images. J Psychiatry Neurosci 2014;39(2):78-86.
26. Achalia R, Sinha A, Jacob A, et al. A proof of concept machine learning
6. Davis AD, Hassel S, Arnott SR, et al. White matter indices of medication analysis using multimodal neuroimaging and neurocognitive measures
response in major depression: A diffusion tensor imaging study. Biol as predictive biomarker in bipolar disorder. Asian J Psychiatr 2020;50:
Psychiatry Cogn Neurosci Neuroimaging 2019;4(10):913-924. 101984.
7. Peng X, Lau WKW, Wang C, Ning L, Zhang R. Impaired left amygdala 27. Yang J, Zhang M, Ahn H, et al. Development and evaluation of a multi-
resting state functional connectivity in subthreshold depression individ- modal marker of major depressive disorder. Hum Brain Mapp 2018;
uals. Sci Rep 2020;10(1):17207. 39(11):4420-4439.
8. Koutsouleris N, Kambeitz-Ilankovic L, Ruhrmann S, et al. Prediction 28. Mattar MG, Cole MW, Thompson-Schill SL, Bassett DS. A functional
models of functional outcomes for individuals in the clinical high-risk cartography of cognitive systems. PLoS Comput Biol 2015;11(12):
state for psychosis or with recent-onset depression: A multimodal multi- e1004533.
site machine learning analysis. JAMA Psychiatry 2018;75(11):1156- 29. Braun U, Schafer A, Bassett DS, et al. Dynamic brain network
1172. reconfiguration as a potential schizophrenia genetic risk mechanism
9. Yang J, Yin Y, Zhang Z, et al. Predictive brain networks for major modulated by NMDA receptor function. Proc Natl Acad Sci U S A
depression in a semi-multimodal fusion hierarchical feature reduction 2016;113(44):12568-12573.
framework. Neurosci Lett 2018;665:163-169. 30. Tian S, Zhang S, Mo Z, et al. Antidepressants normalize brain flexibility
10. Sun K, Liu Z, Chen G, et al. A two-center radiomic analysis for differen- associated with multi-dimensional symptoms in major depressive
tiating major depressive disorder using multi-modality MRI data under patients. Prog Neuropsychopharmacol Biol Psychiatry 2020;100:
different parcellation methods. J Affect Disord 2022;300:1-9. 109866.