Hierarchical Microstructure Informed Tractography

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 14

BRAIN CONNECTIVITY

Volume XX, Number XX, 2021


ª Mary Ann Liebert, Inc.
DOI: 10.1089/brain.2020.0907

Hierarchical Microstructure Informed Tractography

Mario Ocampo-Pineda,1 Simona Schiavi,1 François Rheault,2 Gabriel Girard,3–5


Laurent Petit,6 Maxime Descoteaux,2 and Alessandro Daducci1

Abstract
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

Background: Tractography uses diffusion magnetic resonance imaging to noninvasively infer the macroscopic
pathways of white matter fibers and it is the only available technique to probe in vivo the structural connec-
tivity of the brain. However, despite this unique and compelling ability and its wide range of possible neuro-
logical applications, tractography is still limited, lacks anatomical precision, and suffers from a serious
sensitivity/specificity trade-off. For this reason, in the past few years, tractography postprocessing techniques
have emerged and proved effective for improving the quality of the reconstructions. Among them, the Convex
Optimization Modeling for Microstructure Informed Tractography formulation allows incorporating the ana-
tomical prior that fibers are naturally organized in fascicles, and has obtained exceptional results in increasing
the accuracy of the estimated tractograms.
Methods: We propose an extension to this idea and introduce a multilevel grouping of the streamlines to capture
the white matter arrangement in fascicles and subfascicles. We tested our proposed formulation in synthetic and
in vivo data.
Results: Our experiments show that using multiple levels allows considering information about the white matter
organization more adequately and helps to improve further the accuracy of the resulting tractograms.
Conclusion: This new formulation represents a further important step toward a more accurate structural connec-
tivity estimation.

Keywords: diffusion MRI; hierarchical organization; microstructure informed tractography; tractography

Impact Statement
Tractography is an invaluable tool for studying noninvasively the neuronal architecture of the brain, but recent studies have
shown that the presence of a large number of false positives can significantly bias any connectivity analysis. Recently, a fil-
tering technique called Convex Optimization Modeling for Microstructure Informed Tractography (COMMIT)-2 has proven
particularly effective in dramatically reducing their incidence by considering the prior knowledge that white matter fibers are
organized in fascicles. In this work, we propose an extension to this method, which allows us to increase further the anatom-
ical accuracy of tractography reconstructions. Our new formulation represents an additional step forward toward a more ve-
ridical characterization of brain connectivity.

Introduction as it is mostly composed of densely packed axons organized


in fiber tracts called fascicles (Mandonnet et al., 2018) that

D iffusion-weighted magnetic resonance imaging


(DW-MRI) is a noninvasive imaging modality that pro-
vides information on the movements of water molecules
hinder the motion of water molecules. Tractography algo-
rithms are capable of inferring their macroscopic trajectories
by exploiting the fact that diffusion occurs predominantly
within brain tissues (Basser and Pierpaoli, 1996; Le Bihan along the main direction of the fibers (Basser et al., 2000).
et al., 1986). This is particularly relevant in the white matter, In this context, a set of fibers is represented with a streamline,

1
Department of Computer Science, University of Verona, Verona, Italy.
2
Sherbrooke Connectivity Imaging Lab (SCIL), Université de Sherbrooke, Sherbrooke, Canada.
3
Center for BioMedical Imaging (CIBM), Lausanne, Switzerland.
4
University Hospital Center (CHUV) and University of Lausanne (UNIL), Lausanne, Switzerland.
5
Signal Processing Lab (LTS5), École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
6
Groupe d’Imagerie Neurofonctionnelle, Université de Bordeaux, CNRS, CEA, IMN, UMR 5293, Bordeaux, France.

1
2 OCAMPO-PINEDA ET AL.

a set of streamlines with similar trajectories is commonly problem. The Linear Fascicle Evaluation (Pestilli et al., 2014)
called bundle, and the set of all reconstructed streamlines and the Convex Optimization Modeling for Microstructure
is called tractogram. Tractography provides an invaluable Informed Tractography (Convex Optimization Modeling for
tool in neuroscience research as it allows one to study Microstructure Informed Tractography [COMMIT]; Daducci
in vivo and noninvasively the anatomy of the brain, its devel- et al., 2013, 2015) use similar approaches, as both estimate
opment, as well as potential alterations due to neurodegener- the contributions of the streamlines from the full DW-MR sig-
ative diseases along specific fiber tracts ( Jeurissen et al., nal by solving a linear system. The filtering with all these meth-
2017; Yeh et al., 2020). It is possible to use the reconstructed ods showed promising results for improving the quality of the
streamlines as regions of interest (ROIs) and evaluate quan- tractograms (Daducci et al., 2013, 2015; Pestilli et al., 2014;
titatively all along their course additional information from Smith et al., 2013, 2015), but none of them proved effective
other modalities, for example, myelin content, which may in reducing the false positives (Schiavi et al., 2020).
provide better insight into the evolution of pathology. Trac- To tackle this limitation, COMMIT was recently extended
tography makes it also possible to investigate in vivo the to take into account the fundamental knowledge that fibers
structural connectivity of the brain, that is, the macroscopic in the brain are naturally organized in fascicles. In fact, de-
map of the neuronal connections through the white matter, velopmental neurobiology studies have demonstrated that
also known as connectome (Hagmann, 2005; Sporns et al., ‘‘axons, as they grow, remain neighbors with axons that
2005). The connectome is an abstraction of the neural com- come from neighboring neurons in the presynaptic structure,
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

plexity of brain connections and can be represented as a net- and therefore arrive at the postsynaptic structure already to-
work, where nodes correspond to gray matter regions and pographically arranged’’ (Udin and Fawcett, 1988). The
edges to the connections between them. With this formalism novel formulation, called COMMIT2 (Schiavi et al., 2020),
and using graph theory (Bullmore and Sporns, 2009), it is proved effective in increasing the specificity of the tracto-
possible to investigate alterations of the connectivity due to grams without decreasing their sensitivity. However, if
neurological conditions (Griffa et al., 2013). both true- and false-positive streamlines are reconstructed
Despite these unique opportunities, several studies have between two cortical regions, as illustrated in Figure 1
recently exposed the poor anatomical accuracy of tractog- (top), then COMMIT2 would promote or penalize them as
raphy, showing, in particular, that the estimated tracto- a whole and would not be able to disentangle them.
grams are not truly quantitative and present problems In this work, we propose a strategy to further improve the
such as partial, duplicate, and false-positive streamlines, accuracy of the tractograms by extending the assumption
that is, pathways that are recovered but are not anatomically made in COMMIT2 and considering that fibers in the brain
valid (Drakesmith et al., 2015; Girard et al., 2020; Maier- are anatomically organized in fascicles and subfascicles,
Hein et al., 2017; Rheault et al., 2020b; Schilling et al., for example, the pyramidal tract is formed by the corticospi-
2019; Thomas et al., 2014; Zalesky et al., 2016). In partic- nal tract and the corticobulbar tract (Chenot et al., 2019;
ular, Zalesky et al. (2016) investigated the topological prop- Nieuwenhuys et al., 2008). This biological organization of
erties of the networks estimated with tractography and the fibers naturally induces a hierarchy in the reconstructed
concluded that specificity (true-negative rate) is more im- streamlines, which in turn could be exploited to provide
portant than sensitivity (true-positive rate) for the study of more information to the filtering procedure. To test the effec-
brain connectivity. Maier-Hein et al. (2017) conducted a tiveness of this additional anatomical prior, we created a
large comparison study and showed that false-positive nested arrangement of the streamlines into bundles and sub-
streamlines are a major problem that affects all tractogra- bundles by refining the parcellation-based approach of
phy algorithms. Therefore, it is clear that the presence of COMMIT2 using clustering techniques. The proposed
false positives in the estimated tractograms represents a method was tested both on synthetic and in vivo data.
crucial limitation of tractography that can heavily bias
any analysis based on this technique. Materials and Methods
A number of postprocessing solutions have been recently
Microstructure informed tractography
proposed to tackle this problem and improve the quality of the
tractograms. This class of methods is called Microstructure Given a tractogram T and the corresponding DW-MRI
Informed Tractography (Daducci et al., 2016) and their ratio- I 2 Rnþv · nd with nd q-space samples acquired in nv = nx ny nz
nale is that tractography needs more information to overcome voxels, the acquired data can be seen as I = A(T) þ g,
the problem of anatomical inaccuracy. In general, these ap- where A : T ! I is an operator describing the signal con-
proaches combine the input tractogram with signal forward tribution of each streamline to I and g is the acquisition
models and evaluate the contribution of each streamline to noise. The goal of tractography is to solve the inverse prob-
the acquired data, filtering out the most implausible or lem, that is, finding the set of streamlines T ~ that best de-
those that are not supported by the data. The Spherical- scribes the acquired image I. Microstructure informed
deconvolution Informed Filtering of Tractograms (SIFT; tractography has been recently proposed as a new paradigm
Smith et al., 2013) considers the integral of the fiber orienta- to combine the estimated streamlines with tissue microstruc-
tion distribution to be proportional to the volume of the white ture models with the aim of improving the quality of the trac-
matter tissue inside the voxel and uses this value to optimize tograms (Daducci et al., 2016). In particular, the COMMIT
the streamline density and to remove streamlines that do not framework allows combining an arbitrary biophysical model
fit the data. SIFT2 (Smith et al., 2015) does not remove for the white matter tissue [see Alexander et al. (2019); Nov-
streamlines, but it rather attempts to determine the cross- ikov et al. (2019) and references therein] to each streamline to
sectional area of each streamline and uses this information estimate their actual contribution. The DW-MR signal in all
as a multiplier in the streamline connectivity quantification voxels is expressed as the linear combination of the
HIERARCHICAL MICROSTRUCTURE INFORMED TRACTOGRAPHY 3
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

FIG. 1. Possible improvement over the COMMIT2 formulation. Top: This simplistic example shows some representative
streamlines between two cortical regions obtained with a generic tractography algorithm. This bundle consists of three TP
sub-bundles (blue, red, and green), but there are also some streamlines that seem to describe implausible trajectories (purple),
which are probably FPs. However, using the parcellation-based approach introduced in COMMIT2, all these streamlines are
grouped together as one unique bundle and considered a whole, and so, they cannot be differentiated in true and false tra-
jectories. Bottom: Example of an actual bundle of streamlines from in vivo data as reconstructed in the input tractogram
and after filtering with COMMIT2, using either large or small groups, and with COMMIT2tree using both large and small
groups in a hierarchical structure. This bundle consists of plausible streamlines that directly connect the brainstem to the post-
central gyrus (cyan arc), as well as of implausible streamlines that incorrectly pass through the corpus callosum (orange
arrow). COMMIT, Convex Optimization Modeling for Microstructure Informed Tractography; FP, false positive; TP, true
positive. Color images are available online.

contributions from the streamlines that cross that voxel, possi- To address the problem of false positives, COMMIT was
bly in addition to partial volume with other tissues, for exam- recently extended by Schiavi et al. (2020), who added a reg-
ple, cerebrospinal fluid, as follows: ularization term to take into account that fibers in the brain
are naturally organized in fascicles and the streamlines can
y = Ax þ g , (1) be grouped in bundles:
where the vector y 2 Rnþd nv
is the concatenation of the nd
DW-MRI measurements acquired in the nv voxels of I, the argmin jjAx  yjj22 þ k + x(g) jjx(g) jj2 : (2)
matrix A 2 Rnd nv · nc encodes nc compartments with the sig- x0 g2G
nal associated to all the streamlines in T and possibly
other tissues inside each voxel according to a given multi-
In this formulation, called COMMIT2, G represents a par-
compartment model, and g accounts for both acquisition
tition of the streamlines into groups and x(g) are the coeffi-
noise and modeling errors. The unknowns x 2 Rnþc represent
cients of those belonging to group g 2 G. This additional
the actual contributions of all the compartments encoded in
penalty term promotes solutions that explain the measured
A, which are needed to explain the acquired data I, and
DW-MR signal using a minimal number of groups and the
can be estimated using non-negative least squares:
parameter k  0 controls the trade-off between the data
argmin jjAx  yjj22 : and the regularization term. As suggested in Wang and
x0 Leng (2008), each component of the regularization term
4 OCAMPO-PINEDA ET AL.

pffiffiffiffiffiffiffiffi
was scaled by the following factor to cope with the possible jgd j
bias introduced by groups with different cardinality: x(gd ) = , (5)
pffiffiffiffiffiffi jjx(g d)
0 jj2
jgj
x(g) = (g) , (3) where jgd j is the cardinality of the group gd and x0(gd ) are the
jjx0 jj2 contributions of the streamlines that belong to the group gd
obtained as described above. The regularization in Eq. (4)
where jgj is the cardinality of the group g and x0(g) are the cor-
is also called Hierarchical Group Lasso and was intro-
responding contributions estimated without regularization,
duced by Zhao et al. (2009). Different implementations
that is, k = 0.
exist of this formulation, and for our application, we
implemented the one proposed by Jenatton et al. (2011).
Adding priors on the hierarchical organization of the fibers
The main advantage of this formulation is that its complex-
In the previous formulation, the partition G was created ity is linear in the number of streamlines and levels, so in-
using a parcellation-based approach, that is, grouping to- creasing the number of levels does not significantly affect
gether all the streamlines connecting the same pair of cortical the computation time [for further details, we refer the
regions. However, as Eq. (2) promotes or penalizes each reader to the mathematical proofs contained in Jenatton
group of streamlines as a whole, if a group contains both et al. (2011)]. In the remaining of the article, we refer to
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

true- and false-positive streamlines, as shown in Figure 1 this approach as COMMIT2tree. Figure 2 visually com-
(top), they will be promoted or penalized together. In Figure 1 pares the differences between COMMIT, COMMIT2,
(bottom), we present an example of an actual bundle of and COMMIT2tree formulations.
streamlines as reconstructed with tractography from in vivo
data where this situation happens. This bundle consists of
two distinct sub-bundles: the streamlines that directly con- Illustrative toy example. Figure 3 shows a simple syn-
nect the brainstem to the postcentral gyrus, which are thetic example to illustrate how the introduction of the hier-
known to be correct from anatomy, and those that incorrectly archical regularization can improve the accuracy of the
pass through the corpus callosum. Applying COMMIT2 tractograms. The ground truth consists of four ROIs (A, B,
using a gray matter parcellation as in Schiavi et al. (2020) re- C, and D) connected by three streamlines (S1, S2, and S3).
sults in a single group for this bundle, which does not allow From this data set, a generic tractography algorithm (top
disentangling the true-positive streamlines from the false row, center) reconstructed the three true-positive stream-
positives. If, instead, smaller groups are used, for example, lines as well as two false positives (S4 and S5). This tracto-
obtained from a finer parcellation or a clustering procedure, gram was then filtered with COMMIT, COMMIT2, and
some invalid structures are lost but at the price of losing also COMMIT2tree. Without any prior information, COMMIT
some of the true-positive streamlines that were connected keeps all five streamlines (top row, right), as they are all
to the inferior part of the postcentral gyrus (see below for a compatible with the underlying data. COMMIT2 groups
discussion on this topic). However, if we combine the previ- streamlines based on a partition with a single level and
ous groups in a hierarchical way, the false-positive stream- attempts to find solutions that explain the data with the min-
lines can be removed and more true positives can be kept. imum number of groups. If large groups are used (bottom
Inspired by this example, we propose to modify COMMIT2 row, left), for example, streamlines that connect the same
and make it more flexible, allowing the possibility to group pair of ROIs, the group formed by S3 and S4 is necessary
the streamlines into multiple levels to capture the natural hi- to explain the data in the top-right voxel, which is covered
erarchical organization of the fibers in fascicles and subfas- only by S3. Therefore, both S3 and S4 are kept even though
cicles (Chenot et al., 2019). S4 is a false positive. This choice, in turn, requires to keep
To take into account this organization of the stream- also S5 to explain the data in the remaining voxels using
lines, we implemented the hierarchical sparse encoding the minimum number of groups. This causes the removal
approach proposed by Jenatton et al. (2011), which uses of the true positives S1 and S2 because they are no longer
sparsity-inducing norms as regularization terms to pro- necessary to fit the data. In general, if small groups are
mote tree-structured sparse solutions. The set of groups used (bottom row, center), for example, dividing B into
G is defined as a tree-structured set of groups with n levels, two subregions B1 and B2, and C into C1 and C2, we obtain
where each level d represents a partition of all the stream- more groups consisting of fewer streamlines each; in this ex-
lines. The root G0 contains all the streamlines of the tracto- ample every group has a single streamline. This situation
gram in one group, and the partitions in the lower levels contains many ambiguous configurations as seen before for
called G1 , . . . , Gn are created by splitting each group COMMIT (top row, right) and, as groups are treated as inde-
gd  1 2 Gd  1 , creating a nested structure. The recon- pendent entities, these ambiguities cannot be solved. Please
struction problem can be written as follows: note that this situation was already analyzed in Schiavi
et al. (2020; Fig. 3). On the contrary, the grouping imple-
n
mented in COMMIT2tree is more flexible and helps to disen-
argmin jjAx  yjj22 þ k + + x(gd ) jjx(gd ) jj2 , (4)
x0 d = 1 gd 2Gd
tangle ambiguous configurations such as the one presented
here. In fact, according to the hierarchical structure, the
where Gd represents a partition into groups of level d, x(gd ) are groups S3–S4 can be further subdivided into two groups
the coefficients of the streamlines in group gd 2 Gd , and (bottom row, right), that is, one containing the true positive
k  0 controls the regularization strength. Note that if n = 1, S3 and the other one the false positive S4. This allows
then Eq. (4) reduces to Eq. (2). The scaling factor to balance COMMIT2tree to remove all the false positives and keep
groups with different cardinality is modified as follows: the true positives.
HIERARCHICAL MICROSTRUCTURE INFORMED TRACTOGRAPHY 5
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

FIG. 2. Visual comparison between the COMMIT, COMMIT2, and COMMIT2tree formulations. COMMIT considered the
streamlines as independent entities, and COMMIT2 added a regularization term to take into account that streamlines are in-
stead naturally organized in bundles. With COMMIT2tree we propose to improve this regularization by allowing a multilevel
hierarchical organization of the streamlines, where every bundle may be composed of several sub-bundles and each can be
selectively promoted or penalized. Color images are available online.

Data and experiments (2012)]. For a more direct comparison with COMMIT2,
For the scope of this work and to keep the presentation we adopted the same forward model as in Schiavi et al.
simple, we demonstrate the improvements of COMMIT2tree (2020), which associates a contribution to each streamline
proportional to its cross-sectional area using a map of the
over the previous formulation using a hierarchical structure
with only two levels; however, our proposed formulation intra-axonal signal fraction (IASF).
can easily accommodate any number of levels. In the first
level, we grouped the streamlines connecting the same pair Quantitative evaluation on synthetic data. To quantita-
of cortical regions as in COMMIT2. Then, to capture the tively evaluate the performance of our proposed formulation
presence of possible sub-bundles, we constructed a second with respect to COMMIT2, we adopted the same synthetic
level where we subdivided these parcellation-based groups phantom used in Schiavi et al. (2020). We compared the sen-
by clustering the streamlines in each with QuickBundles sitivity and specificity of the tractograms after filtering with
(Garyfallidis et al., 2012). In brief, QuickBundles is an unsu- both techniques by assessing the number of valid bundles
pervised clustering algorithm for tractography data sets, (VB), that is, true-positive connections in the corresponding
which does not require knowing the number of clusters in ad- connectomes, and invalid bundles (IB), that is, false-positive
vance, but it rather uses a threshold to group streamlines ones. The phantom is shown in Figure 4A and consists of 27
based on distance metrics. In this work, we used the Average ground-truth bundles between 53 ROIs that mimic challeng-
of Pointwise Euclidean Metric. The algorithm is very fast ing configurations such as branching, kissing, and crossing
and well suited for large tractograms, as its complexity is with different curvatures and sizes (Caruyer et al., 2014).
O(kN), where k is the number of clusters and N the number The IASF map of this phantom was computed from the
of streamlines [for technical details see Garyfallidis et al. ground-truth geometry. The corresponding DW-MR signal
6 OCAMPO-PINEDA ET AL.
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

FIG. 3. Illustrative toy example. First row: ground-truth streamline configuration as well as representative streamlines recon-
structed with a generic tractography algorithm, that is, raw tractogram, and after filtering with COMMIT. Second row: results
after filtering with COMMIT2 (single level, once using large groups and another with small groups) and COMMIT2tree (multiple
levels, combining parcellation and clustering). S1, S2, and S3, in green shades, represent TP streamlines, while S4 and S5, in red
shades, are FPs. A–D are ROIs connected by the streamlines. In COMMIT2 with small groups, the ROI B was divided into B1 and
B2, and C into C1 and C2. ROI, regions of interest. Color images are available online.

was generated using the Composite Hindered And Restricted et al., 2013). These bundles were extracted with RecobundlesX
Model of Diffusion (Assaf and Basser, 2005) along 64 direc- (Garyfallidis et al., 2018; Rheault, 2020), a multiatlas, multipa-
tions with b = 3000 s/mm2 and Rician noise was added with a rameter segmentation tool that uses bundles manually seg-
signal-to-noise ratio of 30. All tractograms and the corre- mented by an expert neuroanatomist as reference (description
sponding connectomes were estimated using the MRtrix3 in Appendix A1). We performed RecobundlesX using nine dif-
software (Tournier et al., 2019). First, we computed the ferent parameter configurations and a threshold for the voting
fiber orientation distributions in each voxel using Con- system of 75%. If a streamline had been selected as true posi-
strained Spherical Deconvolution (Tournier et al., 2007). tive, it was not taken into account in the segmentation of the
Then, we reconstructed 1 million streamlines with both de- false-positive bundles. The intersections of streamlines in dif-
terministic (Tournier et al., 2012) and probabilistic (Tournier ferent bundles were eliminated, that is, each streamline could
et al., 2010) algorithms, using a white matter mask as seeding only belong to one bundle. We also reported the voxel coverage
region and default parameters. Finally, we assigned each of each of them, that is, the number of voxels traversed by the
endpoint of a streamline to a node if that point fell within streamlines associated with each bundle. We segmented the T1-
2 mm from one of the 53 gray matter ROIs. A streamline weighted image using the FMRIB’s Automated Segmentation
was considered connecting two nodes if both endpoints Tool (Zhang et al., 2001) to derive the multitissue image and
were assigned, otherwise it was discarded from the analysis. perform the multishell, multitissue constrained spherical decon-
volution ( Jeurissen et al., 2014) on the preprocessed DW-MRI
Qualitative evaluation on in vivo data. To appreciate the data (Glasser et al., 2013). We generated 5 million streamlines
improved quality of the tractograms, we visually inspected of length between 20 and 200 mm with the probabilistic algo-
known true- and false-positive bundles in 10 subjects (5 rithm (Tournier et al., 2010), using Anatomically Con-
males and 5 females of ages 26–30 years) of the open access strained Tractography (Smith et al., 2012) and default
data of the Human Connectome Project (HCP; Van Essen parameters. As in the synthetic experiments, the white matter
HIERARCHICAL MICROSTRUCTURE INFORMED TRACTOGRAPHY 7
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

FIG. 4. Quantitative comparison on synthetic data between COMMIT2 and COMMIT2tree. We compared the VB (reported
in green) and IB (reported in red) in the connectomes generated on a synthetic phantom (A, top) for which we know the
ground-truth connectivity (A, bottom). (B) Compares the quality of connectomes estimated from the probabilistic
(top row) and deterministic (bottom row) tractograms before (raw tractogram) and after filtering with COMMIT2 and
COMMIT2tree; performances of COMMIT are reported for reference. IB, invalid bundles; VB, valid bundles. Color images
are available online.

mask was used as seeding region. The IASF map needed by Figure 5 evaluates the effectiveness of the multilevel for-
the forward model used in COMMIT2 and COMMIT2tree mulation in real brain data, where the fiber configurations
was computed using the Spherical Mean Technique are expected to be more complex. We qualitatively com-
(Kaden et al., 2016). Besides inspecting individual bun- pared known true- and false-positive bundles obtained in
dles, we also compared the resulting connectomes, which one HCP subject after filtering the tractograms with COM-
were created using the 85 gray matter ROIs defined in MIT2 and COMMIT2tree. The volume coverage of the bun-
the Desikan–Killiany atlas (Desikan et al., 2006) derived dles is reported in terms of number of voxels and, in the last
from the T1-weighted images using FreeSurfer, and replac- two cases, we also report the estimated contributions
ing the brainstem with its last part, that is, medulla oblon- (weight). The filtering with COMMIT2 does not negatively
gata (Iglesias et al., 2015). Finally, as edge weights we affect the true-positive bundles, that is, their volume is com-
used the streamline count for the raw tractograms and the parable with the raw tractogram, and, as expected, the false-
sum of the estimated streamline contributions for COM- positive bundles are sensibly thinned, that is, reduced vol-
MIT2 and COMMIT2tree. For each connectome, we report ume coverage. The introduction of the additional level in
its density, that is, the ratio between the actual and the pos- the regularization term of COMMIT2tree further improved
sible connections. these performances. On the one hand, the voxel coverage
of the true-positive bundles is comparable but the estimated
contributions are larger, which translates into a higher like-
Results
lihood to be true positives. On the other hand, the contribu-
Figure 4 compares the sensitivity and specificity of the tions of the false positives are further reduced and all of
tractograms estimated from the synthetic data with both de- them are almost completely removed. These results were
terministic and probabilistic tracking, before and after filter- consistent across all the 10 subjects (Table 1).
ing with COMMIT2 and COMMIT2tree. As a reference, To better appreciate the improved anatomical accuracy of
results with COMMIT are also reported. All reconstructions the tractograms, in Figure 6 we visually inspect two repre-
included the 27 true-positive bundles and, as expected, the sentative bundles as reconstructed in each of the 10 subjects.
raw tractograms were contaminated by a large number of They correspond to the streamlines connecting the medulla
false-positive bundles, respectively, IB = 441 (probabilistic) oblongata to, respectively, the right precentral gyrus (Bundle
and IB = 235 (deterministic). Only few IB were removed 1) and the left precentral gyrus (Bundle 2). As can be seen,
with COMMIT, whereas COMMIT2 was able to drastically these bundles have streamlines that are coherent and well or-
reduce them from 441 to 20 (probabilistic) and from 235 to ganized in two sub-bundles, and one of these describes an
17 (deterministic). Using the proposed multilevel regulariza- implausible pathway passing through the corpus callosum.
tion, COMMIT2tree was able to further improve these results, The streamlines in the raw tractogram are colored based
although not substantially. Using different distance metrics on their local orientation, whereas for COMMIT2 and
in the clustering did not produce particular effects on the re- COMMIT2tree they are colored according to the estimated
sults (Supplementary Fig. S1), probably due to the simple sum of the streamline contributions in each sub-bundle. To
geometry of this phantom. make this visual comparison more effective, we use two
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

8
FIG. 5. TP and FP bundles estimated in one HCP subject. We report the raw tractogram and after filtering it with COMMIT2 and COMMIT2tree. The voxel coverage is reported
for all the bundles, and for the filtered ones, it is also reported the sum of the streamline contributions estimated (weight). The performance of both methods is similar, the TPs keep
comparable coverage with the raw tractogram, and the FPs are drastically reduced. Green arrows highlight the cases where COMMIT2tree assigned larger contributions to the TPs
and further reduced the FP bundles than COMMIT2. HCP, Human Connectome Project. Color images are available online.
Table 1. Stability Across the 10 Human Connectome Project Subjects
COMMIT2 COMMIT2tree
INPUT
Voxels Voxels Weight Voxels Weight
TPs
#1 18,968 – 5229 12,983 – 4997 2.92 – 1.80 10,678 – 4421 2.82 – 2.12
#2 39,920 – 3637 30,892 – 4108 3.88 – 1.82 21,160 – 5285 3.90 – 2.15
#3 44,899 – 2995 37,840 – 3143 12.73 – 3.24 31,203 – 3780 14.76 – 4.15
#4 28,403 – 3681 26,101 – 3372 18.95 – 4.16 24,243 – 3214 17.99 – 4.13
#5 57,300 – 6645 43,324 – 7729 10.03 – 4.39 34,406 – 6835 14.26 – 5.52
FPs
#1 19,362 – 4924 7847 – 3134 0.09 – 0.04 1211 – 1256 0.01 – 0.01
#2 22,037 – 5221 4110 – 6605 0.04 – 0.08 229 – 686 0.01 – 0.01
#3 10,066 – 6567 3617 – 3077 0.05 – 0.05 1333 – 1511 0.02 – 0.03
#4 20,908 – 7060 10,805 – 3720 0.13 – 0.08 897 – 2036 0.01 – 0.02
#5 11,243 – 5714 3876 – 3013 0.03 – 0.03 474 – 634 0.01 – 0.02
Voxel coverage (voxels) and estimated sum of streamline contributions (weight) of the five TP bundles and the five FP bundles shown in
Figure 5. TPs: #1 (yellow), #2 (dark blue), #3 (cyan), #4 (fuchsia), #5 (dark red). FPs: #1 (green), #2 (light red), #3 (orange), #4 (light blue),
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

#5 (magenta).
COMMIT, Convex Optimization Modeling for Microstructure Informed Tractography; FP, false positive; TP, true positive.

FIG. 6. Visual inspection of two representative bundles across the 10 HCP subjects. Reconstructed streamlines belonging
to two representative bundles that connect, respectively: medulla oblongata with the precentral gyrus left (Bundle 1), and
medulla oblongata with the precentral gyrus right (Bundle 2), as obtained across the 10 subjects before (raw tractogram)
and after filtering the tractograms with COMMIT2 and COMMIT2tree. For display and visual inspection purposes, the filtered
bundles of streamlines are divided into two sub-bundles, TPs and FPs; these definitions were not used in the filtering proce-
dure. The colormaps display the sum of the streamline contribution per sub-bundle, cool for TP and hot for FP. For all the
bundles, the contributions estimated with COMMIT2tree are better than the ones estimated with COMMIT2, the FPs have
smaller contributions and the TPs are more significant. The yellow and green arrows point to the region in the raw tractogram
with FP sub-bundles after filtering with COMMIT2 and COMMIT2tree, respectively, highlighting their voxel coverage and
the sum of the streamline contributions. Color images are available online.

9
10 OCAMPO-PINEDA ET AL.

different colormaps, cool for the true-positive streamlines ificity and sensitivity. In a recent international challenge
and hot for the false positives. As expected, since COM- (Maier-Hein et al., 2017), it was suggested that a possible
MIT2 treats all the streamlines in each bundle as a whole, way to overcome this issue would be to inject microstructural
it is not able to completely remove any false-positive sub- and anatomical prior during tractography reconstruction. A
bundles that are included in such bundles. However, if sub- step forward in this direction was achieved by the recent
groups of streamlines are considered in the filtering as done work of Schiavi et al. (2020), where microstructure informed
in COMMIT2tree, it is possible to assign low contributions tractography was combined with the anatomical prior that
to these false positives or even remove them completely. white matter fibers (axons) are organized in fascicles giving
For all the subjects, there is an evident improvement origin to COMMIT2. Using the prior knowledge that bundles
using COMMIT2tree: lower values are assigned to all the are organized in sub-bundles (Chenot et al., 2019; Mandonnet
false positives compared with COMMIT2, for example, et al., 2018), in this work, we extended COMMIT2 proposing
yellow and green arrows, and in some subjects it was able the use of a multilevel organization of the streamlines to iden-
to completely remove them. Moreover, COMMIT2tree tify streamlines following implausible trajectories inside VB.
assigned higher contributions than COMMIT2 to all the This new formulation, called COMMIT2tree, considers parti-
true positives. We can also appreciate that the patterns of tions of the streamlines with different granularity and orga-
the streamlines of these two bundles are consistent across nizes them in a hierarchical structure, which provides more
subjects. Table 2 reports the mean and standard deviation degrees of freedom than COMMIT2 but in a constrained
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

among the 10 subjects of the sum of the streamline contri- clever way. The subgroups used in COMMIT2tree share ana-
butions and the voxel coverage for each sub-bundle. tomical constraints such as the starting and ending region in
Figure 7 compares the estimated connectomes in one the gray matter, but they have different geometrical properties,
HCP subject before and after filtering the tractogram recon- that is, the trajectory. Figure 6 clearly shows that by consider-
structed with probabilistic tractography with COMMIT2 and ing this way of grouping in the optimization, more false-
COMMIT2tree. To assess how well each filtered tractogram ex- positive streamlines inside true-positive bundles are removed,
plains the input data, we report the input IASF map used for the boosting further the accuracy of the final tractogram.
filtering and the one predicted from the filtered tractograms, In synthetic data, the connectivity graphs obtained after
using Eq. (1), as well as the root mean square error (RMSE) filtering the tractograms with COMMIT2 and COMMIT2tree
between the input and the fitted maps. We observe that the con- showed comparable results. However, the simple geometry
nectome of the raw tractogram is very dense (density = 0.896), of this phantom does not allow us to fully exploit the advan-
which is an expected result for probabilistic tracking, whereas tages of our proposed multilevel regularization, as the bun-
after the filtering with COMMIT2 and COMMIT2tree, the con- dles consist of regular and smooth tubes. Nonetheless, our
nectomes are sparser and have comparable density between findings indicate that this enhanced formulation results in a
them (0.245 and 0.307, respectively). Despite sparser, the cor- stable and robust regularization of the original problem. In
responding tractograms seem to explain well the input IASF particular, Figure 4 shows that adding more levels to the
map; the RMSE map is comparable and shows very small er- structure does not affect the stability of the method, but
rors in the white matter, with higher values located in voxels at can slightly improve the quality of the estimated tractograms.
the interface with cortical and subcortical gray matter. To evaluate the quality of the in vivo reconstructions, we
analyzed 10 HCP subjects and we looked both at the anatom-
ical accuracy of individual bundles and at the overall struc-
Discussion
tural connectivity estimated after filtering the tractograms
Tractography is a unique technique that is able to describe with COMMIT2 and COMMIT2tree. The density of the fil-
the major neural pathways in the white matter. In the last de- tered connectomes was about one-third of the unfiltered
cades, it has been used to study the structural network orga- one, showing again similar performances of both methods.
nization of the brain, but its anatomical inaccuracy and These results confirm and extend the results presented in
limitations have been exposed in different studies (Drake- Schiavi et al. (2020), which were in agreement with the the-
smith et al., 2015; Girard et al., 2020; Maier-Hein et al., ory of the economy of brain networks (Bullmore and Sporns,
2017; Rheault et al., 2020b; Schilling et al., 2019; Thomas 2012). However, when looking more closely at the individual
et al., 2014; Zalesky et al., 2016). One of the major limita- bundles, before and after the filtering, it is evident that a signif-
tions still unresolved is the intrinsic trade-off between spec- icant improvement was achieved by COMMIT2tree. In fact, in

Table 2. Quantitative Comparison of Sub-Bundle Across the 10 Human Connectome Project Subjects
COMMIT2 COMMIT2tree
Voxels Weight Voxels Weight
Bundle 1
TP 20,280 – 2159 2.75 – 0.81 17,733 – 2181 3.18 – 0.76
FP 9325 – 3471 0.14 – 0.08 2842 – 2689 0.01 – 0.01
Bundle 2
TP 20,252 – 2577 2.97 – 0.71 17,819 – 2166 3.41 – 0.76
FP 10,195 – 3876 0.18 – 0.12 4122 – 4300 0.02 – 0.02
Mean and standard deviation of the sum of the streamline contributions (weight) and voxel coverage (voxels) for the TP and FP sub-
bundles in Figure 6. Bundle 1: Medulla oblongata and precentral gyrus left. Bundle 2: Medulla oblongata and precentral gyrus right.
HIERARCHICAL MICROSTRUCTURE INFORMED TRACTOGRAPHY 11

Figure 5 and Table 1 we can appreciate how COMMIT2tree termined as the value that overall produced visually
was able to filter more the false-positive bundles than COM- satisfactory results. However, optimizing the value of k on a
MIT2 without negatively affecting the true positives, in par- subject-specific basis might considerably improve the perfor-
ticular because of its capability to remove invalid streamlines mance of the filtering. Second, the results presented here
inside VB (Fig. 6; Table 2). From a quantitative point of show that the quality of the anatomical prior, that is, structure
view, we observe that both methodologies assigned lower definition and how streamlines are grouped, plays a fundamen-
contributions to the false positives than the true positives; no- tal role in the optimization procedure. The original COMMIT
tably, it is important to note that COMMIT2tree assigned was only data driven and the filtering did not improve signifi-
higher contributions to the true positives and smaller values cantly the anatomical accuracy of the tractograms; COMMIT2
to the false positives compared with its predecessor. This is added the prior that white matter fibers are organized in fasci-
an important property when one is interested in network cles which, instead, had a big impact on the performance. In
properties relying on connection strengths. COMMIT2tree we added geometrical priors based on the tra-
Although COMMIT2tree was able to further improve the an- jectories described by the streamlines and we built a hierarchi-
atomical accuracy of the tractograms, it did not eliminate com- cal structure to combine both anatomical (based on which
pletely all known false positives in every analyzed subject. gray matter regions the streamlines connect) and geometrical
This may be partly due to the regularization parameter (clustering the streamlines based on their trajectory) informa-
k used and to the actual groups created with clustering in tion. However, different definitions of structures can be imple-
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

each subject. First, in our experiments, we used the same reg- mented in our formulation. For example, we could use more
ularization strength for all subjects, which was empirically de- than two levels to create the hierarchy as well as explore

FIG. 7. Connectomes estimated in one HCP subject. In the first row, we show the estimated connectomes; in the case of the
raw tractograms, we used the number of streamlines, whereas for COMMIT2 and COMMIT2tree, the sum of the streamline
contributions was used. In the second row, we present the IASF maps used as input and estimated to perform a visual inspec-
tion. The third row presents RMSE maps of the estimations, along with their mean and standard deviation for a quantitative
comparison. IASF, intra-axonal signal fraction; RMSE, root mean square error. Color images are available online.
12 OCAMPO-PINEDA ET AL.

different strategies to group the streamlines and inject addi- formation about the white matter structure in a more specific
tional prior information [e.g., see Côté et al. (2015); Siless way. This improved formulation, that is, COMMIT2tree, not
et al. (2018) and references therein]. All these aspects will only reduces the number of false-positive connections in the
be the subject of future research. estimated tractograms as COMMIT2 but it is also able to filter
It is worth noting that using a finer partitioning of the stream- out implausible streamlines within true-positive bundles,
lines may create groups that might capture better the plausible boosting even further the quality of the reconstructions. Our
and implausible sub-bundles; for instance, in the extreme case new formulation represents an additional step forward to im-
where all groups have a cardinality equal to 1, that is, they con- prove the anatomical accuracy of the tractograms and our un-
sist of a single streamline, true- and false-positive streamlines derstanding of how different brain regions are interconnected.
are clearly separated in distinct groups. However, as the granu-
larity of this partitioning becomes smaller, the number of gen- Code and Data Availability
erated groups increases accordingly. However, since the groups The numerical phantom used as validation is publicly
are treated as independent entities in the penalty term in available and can be downloaded from https://github.com/
Eq. (4), this process has the side effect of gradually reintroduc- ecaruyer/phantomas. The in vivo MRI data used are from
ing the ambiguous configurations that, instead, COMMIT2 was 5 males and 5 females subjects of ages 26–30 years from
able to disentangle using a coarser partition. Supplementary the Open Access Data from the HCP and are available at
Figure S2 shows that, indeed, the performances gradually dete-
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

https://www.humanconnectome.org. The code is open


riorate as the groups become smaller. As it is not possible to source and freely available at https://github.com/daducci/
predict a priori the behavior of the algorithm using partitions COMMIT.
with different granularity, our proposed approach represents
an effective way to consider and take advantage of more than Acknowledgments
one granularity in the filtering procedure. Clearly, future re-
search will be required to identify the optimal configuration Data were provided by the Human Connectome Project,
of groups in this multilevel structure. WU-Minn Consortium (Principal Investigators: David Van
Finally, it is important to note that the proposed approach is Essen and Kamil Ugurbil; 1U54MH091657) funded by the
still a filtering procedure, and so, even if it can be applied on 16 NIH Institutes and Centers that support the NIH Blueprint
any type of input tractograms (coming from either determinis- for Neuroscience Research; and by the McDonnell Center for
tic or probabilistic tractography approaches), it is still limited Systems Neuroscience at Washington University.
on the quality of the input reconstruction. Clearly, if a bundle
Authors’ Contributions
is not present in the original tractograms, it will not be recov-
ered by COMMIT2tree. So, particular attention should be All the authors, M.O.-P., S.S., F.R., G.G., L.P., M.D., and
given to this aspect. Another important factor that affects A.D., contributed significantly to the work. M.O.-P., S.S., and
the results is the selection of the regularization parameter k. A.D. conceptualized the problem. M.O.-P., S.S., G.G., and
As it was analyzed in Schiavi et al. (2020), a high value of A.D. developed, implemented, and tested the technical frame-
this parameter would result in a very strong filtering and work. L.P. manually segmented the in vivo VB and IB toward
would end up in removing too many connections. On the con- which we compared our method. M.O.-P., F.R., and M.D. con-
trary, a too low value would end up in removing only a few. ceptualized and developed the in vivo validation framework.
Up until now, and for both COMMIT2 and COMMIT2tree for- M.O.-P., S.S., F.R., G.G, L.P., M.D., and A.D. wrote the article.
mulations, we do not know a close formula to define the best
value of this parameter according to the input tractogram, sig- Author Disclosure Statement
nal, and structure for grouping the streamlines. Thresholds for No competing financial interests exist.
upper and lower bounds when using the adaptive group lasso
approach such as ours have been suggested for the case of in- Funding Information
dependent and identically distributed columns of the matrix A,
but they still need to be generalized to our case. In the exper- This work was supported by the Rita Levi Montalcini
iments presented in this work, the choice was made based on Programme for young researchers of the Italian Ministry of
the knowledge we have on known bundles: that is, we choose Education, University and Research.
the largest value that was able to filter out the known IB from Supplementary Material
the input tractogram while keeping all the known valid ones.
Supplementary Figure S1
Supplementary Figure S2
Conclusion
The anatomical accuracy of tractography has been heavily References
challenged in the past few years and seriously questioned Alexander DC, Dyrby TB, Nilsson M, Zhang H. 2019. Imaging
the use of this technique for mapping reliably the structural brain microstructure with diffusion MRI: practicality and ap-
connectivity of the brain. Our group recently developed a plications. NMR Biomed 32:e3841.
postprocessing filtering procedure called COMMIT2 that Assaf Y, Basser PJ. 2005. Composite hindered and restricted
allowed a dramatic increase in the accuracy of the reconstruc- model of diffusion (CHARMED) MR imaging of the
tions. However, this formulation did not consider the fact that human brain. Neuroimage 27:48–58.
fibers in the brain are anatomically organized in fascicles and Basser PJ, Pajevic S, Pierpaoli C, Duda J, Aldroubi A. 2000.
subfascicles. In this work, we showed that taking into account In vivo fiber tractography using DT-MRI data. Magn Reson
this multilevel organization of the fibers allows considering in- Med 44:625–632.
HIERARCHICAL MICROSTRUCTURE INFORMED TRACTOGRAPHY 13

Basser PJ. Pierpaoli C. 1996. Microstructural and physiological Jenatton R, Mairal J, Obozinski G, Bach F. 2011. Proximal
features of tissues elucidated by quantitative-diffusion-tensor methods for hierarchical sparse coding. J Mach Learn Res
MRI. J Magn Reson Ser B 111:209–219. 12:2297–2334.
Bullmore E, Sporns O. 2009. Complex brain networks: graph Jeurissen B, Descoteaux M, Mori S, Leemans A. 2017. Diffusion
theoretical analysis of structural and functional systems. MRI fiber tractography of the brain. NMR Biomed 32:e3785.
Nat Rev Neurosci 10:186–198. Jeurissen B, Tournier J-D, Dhollander T, Connelly A, Sijbers J.
Bullmore E, Sporns O. 2012. The economy of brain network or- 2014. Multi-tissue constrained spherical deconvolution for
ganization. Nat Rev Neurosci 13:336–349. improved analysis of multi-shell diffusion MRI data. Neuro-
Caruyer E, Daducci A, Descoteaux M, Houde JC, Thiran JP, image 103:411–426.
Verma R. 2014. Phantomas: a flexible software library to Kaden E, Kelm ND, Carson RP, Does MD, Alexander DC. 2016.
simulate diffusion MR phantoms. In: Proc Intl Soc Mag Multi-compartment microscopic diffusion imaging. Neuro-
Reson Med, May 2014, Milan, Italy, 2666. image 139:346–359.
Chenot Q, Tzourio-Mazoyer N, Rheault F, Descoteaux M, Cri- Le Bihan D, Breton E, Lallemand D, Grenier P, Cabanis E,
vello F, Zago L, et al. 2019. A population-based atlas of Laval-Jeantet M. 1986. MR imaging of intravoxel incoherent
the human pyramidal tract in 410 healthy participants. motions: application to diffusion and perfusion in neurologic
Brain Struct Funct 224:599–612. disorders. Radiology 161:401–407.
Côté M-A, Garyfallidis E, Larochelle H, Descoteaux M. 2015. Maier-Hein KH, Neher PF, Houde J-C, Côté M-A, Garyfallidis
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

Cleaning up the mess: tractography outlier removal using E, Zhong J, et al. 2017. The challenge of mapping the human
hierarchical QuickBundles clustering. In: Proc Intl Soc connectome based on diffusion tractography. Nat Commun 8:
Mag Reson Med, 30 May–5 June 2015, Toronto, Ontario, 1349.
Canada, 2844. Mandonnet E, Sarubbo S, Petit L. 2018. The nomenclature of
Daducci A, Dal Palú A, Descoteaux M, Thiran JP. 2016. Micro- human white matter association pathways: proposal for a sys-
structure informed tractography: pitfalls and open challenges. tematic taxonomic anatomical classification. Front Neuroa-
Front Neurosci 10:247. nat 12:94.
Daducci A, Dal Palù A, Lemkaddem A, Thiran JP. 2015. Nieuwenhuys R, Voogd J, van Huijzen C. 2008. The Human
COMMIT: convex optimization modeling for microstructure Central Nervous System. Berlin, Heidelberg: Springer.
informed tractography. IEEE Trans Med Imag 34:246–257. Novikov DS, Fieremans E, Jespersen SN, Kiselev VG. 2019.
Daducci A, Dal Palù A, Lemkaddem A, Thiran JP. 2013. A con- Quantifying brain microstructure with diffusion MRI: theory
vex optimization framework for global tractography. In: and parameter estimation. NMR Biomed 32:e3998.
2013 IEEE 10th International Symposium on Biomedical Pestilli F, Yeatman JD, Rokem A, Kay KN, Wandell BA. 2014.
Imaging, San Francisco, CA, USA, pp. 524–527. Evaluation and statistical inference for human connectomes.
Desikan RS, Ségonne F, Fischl B, Quinn BT, Dickerson BC, Nat Methods 11:1058–1063.
Blacker D, et al. 2006. An automated labeling system for sub- Rheault F. 2020. Analysis and reconstruction of white matter
dividing the human cerebral cortex on MRI scans into gyral beams. Sherbrooke, Canada: University of Sherbrooke;
based regions of interest. Neuroimage 31:968–980. p. 276. PhD thesis.
Drakesmith M, Caeyenberghs K, Dutt A, Lewis G, David AS, Rheault F, De Benedictis A, Daducci A, Maffei C, Tax CMW,
Jones DK, et al. 2015. Overcoming the effects of false posi- Romascano D, et al. 2020a. Tractostorm: the what, why,
tives and threshold bias in graph theoretical analyses of neu- and how of tractography dissection reproducibility. Hum
roimaging data. Neuroimage 118:313–333. Brain Mapp 41:1859–1874.
Garyfallidis E, Brett M, Correia MM, Williams GB, Nimmo- Rheault F, Poulin P, Caron AV, St-Onge E, Descoteaux M.
Smith I. 2012. QuickBundles, a method for tractography sim- 2020b. Common misconceptions, hidden biases and modern
plification. Front Neurosci 6:175. challenges of dMRI tractography. J Neural Eng 17:011001.
Garyfallidis E, Côté M-A, Rheault F, Sidhu J, Hau J, Petit L, Schiavi S, Ocampo-Pineda M, Barakovic M, Petit L, Desco-
et al. 2018. Recognition of white matter bundles using teaux M, Thiran JP, Daducci A. 2020. A new method for ac-
local and global streamline-based registration and clustering. curate in vivo mapping of human brain connections using
Neuroimage 170:283–295. microstructural and anatomical information. Sci Adv 6:
Garyfallidis E, Ocegueda O, Wassermann D, Descoteaux M. eaba8245.
2015. Robust and efficient linear registration of white- Schilling KG, Nath V, Hansen C, Parvathaneni P, Blaber J, Gao Y,
matter fascicles in the space of streamlines. Neuroimage et al. 2019. Limits to anatomical accuracy of diffusion tractog-
117:124–140. raphy using modern approaches. Neuroimage 185:1–11.
Girard G, Caminiti R, Battaglia-Mayer A, St-Onge E, Ambrosen Siless V, Chang K, Fischl B, Yendiki A. 2018. AnatomiCuts: hi-
KS, Eskildsen SF, et al. 2020. On the cortical connectivity in erarchical clustering of tractography streamlines based on an-
the macaque brain: a comparison of diffusion tractography atomical similarity. Neuroimage 166:32–45.
and histological tracing data. Neuroimage 221:117201. Smith RE, Tournier J-D, Calamante F, Connelly A. 2012.
Glasser MF, Sotiropoulos SN, Wilson JA, Coalson TS, Fischl B, Anatomically-constrained tractography: improved diffusion
Andersson JL, et al. 2013. The minimal preprocessing pipelines MRI streamlines tractography through effective use of ana-
for the Human Connectome Project. Neuroimage 80:105–124. tomical information. Neuroimage 62:1924–1938.
Griffa A, Baumann PS, Thiran J-P, Hagmann P. 2013. Structural Smith RE, Tournier J-D, Calamante F, Connelly A. 2013. SIFT:
connectomics in brain diseases. Neuroimage 80:515–526. spherical-deconvolution informed filtering of tractograms.
Hagmann P. 2005. From Diffusion MRI to Brain Connectomics. Neuroimage 67:298–312.
Lausanne, Switzerland: EPFL; p. 141. Smith RE, Tournier J-D, Calamante F, Connelly A. 2015.
Iglesias JE, Leemput KV, Bhatt P, Casillas C, Dutt S, Schuff N, SIFT2: enabling dense quantitative assessment of brain
et al. 2015. Bayesian segmentation of brainstem structures in white matter connectivity using streamlines tractography.
MRI. Neuroimage 113:184–195. Neuroimage 119:338–351.
14 OCAMPO-PINEDA ET AL.

Sporns O, Tononi G, Kötter R. 2005. The human connectome: a Wang H, Leng C. 2008. A note on adaptive group lasso. Comput
structural description of the human brain. PLoS Comput Biol Stat Data Analysis 52:5277–86.
1:e42. Yeh C-H, Jones DK, Liang X, Descoteaux M, Connelly A. 2020.
Thomas C, Ye FQ, Irfanoglu MO, Modi P, Saleem KS, Leopold Mapping structural connectivity using diffusion MRI: chal-
DA, Pierpaoli C. 2014. Anatomical accuracy of brain connec- lenges and opportunities. J Magn Reson Imag [Epub ahead
tions derived from diffusion MRI tractography is inherently of print]; DOI: https://doi.org/10.1002/jmri.27188.
limited. Proc Natl Acad Sci USA 111:16574–16579. Zalesky A, Fornito A, Cocchi L, Gollo LL, van den Heuvel
Tournier J-D, Calamante F, Connelly A. 2007. Robust determi- MP, Breakspear M. 2016. Connectome sensitivity or spec-
nation of the fibre orientation distribution in diffusion MRI: ificity: which is more important? Neuroimage 142:407–
non-negativity constrained super-resolved spherical decon- 420.
volution. Neuroimage 35:1459–1472. Zhang Y, Brady M, Smith S. 2001. Segmentation of brain MR
Tournier J-D, Calamante F, Connelly A. 2010. Improved probabi- images through a hidden Markov random field model and
listic streamlines tractography by 2nd order integration over the expectation-maximization algorithm. IEEE Trans Med
fibre orientation distributions. In: Proc Intl Soc Mag Reson Imag 20:45–57.
Med 18 (2010), 1–7 May 2010, Stockholm, Sweden, 1670. Zhao P, Rocha G, Yu B. 2009. The composite absolute penalties
Tournier J-D, Calamante F, Connelly A. 2012. Mrtrix: diffusion family for grouped and hierarchical variable selection. Ann
tractography in crossing fiber regions. Int J Imag Syst Tech- Stat 37:3468–3497.
Downloaded by Ecole Polytechnique Federale (epfl) from www.liebertpub.com at 03/12/21. For personal use only.

nol 22:53–66.
Tournier J-D, Smith R, Raffelt D, Tabbara R, Dhollander T,
Pietsch M, et al. 2019. MRtrix3: a fast, flexible and open soft- Address correspondence to:
ware framework for medical image processing and visualisa- Alessandro Daducci
tion. Neuroimage 202:116137. Department of Computer Science
Udin SB, Fawcett J.W. 1988. Formation of topographic maps. University of Verona
Annu Rev Neurosci 11:289–327. Strada le Grazie 15
Van Essen DC, Smith SM, Barch DM, Behrens TEJ, Yacoub E, Verona 37134
Ugurbil K, WU-Minn HCP Consortium. 2013. The Italy
WU-Minn Human Connectome Project: an overview. Neuro-
image 80:62–79. E-mail: alessandro.daducci@univr.it

Appendix

Appendix A1. RecobundlesX from different subjects, with different tractography algo-
rithms, or segmented by different experts, to cover more var-
To study and evaluate tractography reconstructions, a
iability in the definition of the bundles. It also allows us to use
common practice is to divide them into bundles that repre-
different configurations of the segmentation parameters, for
sent white matter fascicles. This is a complicated task, called
example, clustering threshold, number of iterations for SLR,
virtual dissection, that requires great knowledge of neuro-
and type of transformation and pruning, to cover more vari-
anatomy and is not an exact procedure, there is variability
ability in the segmentation procedure. RecobundlesX com-
among segmentations performed by experts (Rheault et al.,
bines the results of the multiatlas and multiparameter
2020a), and up to now, there is no ground truth for in vivo
segmentation using a voting system that merges the multiple
tractography to validate the reconstructions.
segmentation performed for each bundle definition.
RecobundlesX (Rheault, 2020) uses the method Recobun-
dles (Garyfallidis et al., 2018) that is an algorithm that uses True-Positive Bundle Models
bundle models as shape priors for detecting and segments
similar streamlines in a tractogram, which is computationally Five subjects from the Open Access Data from the Human
demanding for data sets of millions of streamlines. To reduce Connectome Project (Van Essen et al., 2013) were used.
the dimension of the problem of comparing all the stream- Tractography reconstruction was performed and 37 major
lines in the models (hundreds) with all the streamlines in a bundles were manually segmented. Then, these bundles
tractogram (millions) to select the streamlines, Recobundles were smoothed and refined to obtain well-defined bundle
uses the algorithm QuickBundles (Garyfallidis et al., 2012) models (Rheault, 2020).
to cluster the streamlines and uses the Streamline-based Lin-
ear Registration (SLR; Garyfallidis et al., 2015) to performs False-Positive Bundle Models
the comparison among centroids at the global and local level. The submitted tractograms to the ISMRM 2015 Tractogra-
This procedure has a big variability in the results, generated phy Challenge were used. In the study performed by Maier-
by the clustering configurations used, in addition to the reg- Hein et al. (2017) about the challenge, several bundles from
istration of the models and the tractogram. the submitted tractograms were labeled as false positives be-
To reduce this variability, RecobundlesX (Rheault, 2020) cause they were not in the ground-truth tractogram. A quality
takes into account multiatlas models, multiparameter cluster- control was performed on these bundles to select those with
ing, and a voting scheme that generates more stable solutions. the most anatomical implausible trajectory. From these bun-
The segmentation method supports using multiple models of dles, 44 were selected and refined to obtain smooth and well-
the same bundle as input. These models can be generated defined bundle models (Rheault, 2020).

You might also like