Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

Cement and Concrete Composites 108 (2020) 103551

Contents lists available at ScienceDirect

Cement and Concrete Composites


journal homepage: http://www.elsevier.com/locate/cemconcomp

Semantic segmentation of the micro-structure of strain-hardening


cement-based composites (SHCC) by applying deep learning on
micro-computed tomography scans
Renata Lorenzoni a, *, Iurie Curosu b, Sidnei Paciornik a, Viktor Mechtcherine b,
Martin Oppermann c, Flavio Silva d
a
Department of Chemical and Materials Engineering, Pontifícia Universidade Cat� olica do Rio de Janeiro (PUC-Rio), Rio de Janeiro, Brazil
b
Institute of Construction Materials, Technische Universit€
at Dresden, Dresden, Germany
c
Institute of Electronic Packing Technology and Center of Microtechnical Manufacturing, Technische Universit€at Dresden, Dresden, Germany
d
Department of Civil and Environmental Engineering, Pontifícia Universidade Cat� olica do Rio de Janeiro (PUC-Rio), Rio de Janeiro, Brazil

A R T I C L E I N F O A B S T R A C T

Keywords: Considering the multi-phase constitutive nature of strain-hardening cement-based composites (SHCC) and the
Segmentation decided influence of their micromechanics on overall material behavior, appropriate analytical methods are
Reconstruction necessary for the representation of their microstructure and micro-kinematics. In this respect, micro-computed
Microstructure
tomography (microCT) is an efficient, nondestructive technique, which can couple experimental testing with
Deep learning
X ray computed tomography
scale-linking numerical simulations. However, for a detailed analysis of microstructure, appropriate segmenta­
Strain-hardening cement-based composites tion techniques must be applied which can accurately differentiate and represent the individual material phases
(SHCC) and other features of interest. Given the small scale of analysis, the typical resolution of common computed
tomography, and the small differences among the material constituents in terms of density and x ray absorption
as well, the application of common segmentation techniques to SHCC is ineffective. In this work, a Deep Learning
technique was applied to the microCT images of two different SHCC. The Deep Learning network parameters
were analyzed and optimized on a high-strength SHCC and applied to the automatic segmentation of a typical
normal-strength SHCC. The results obtained are highly promising and quantitatively in accordance with the
composition of the samples analyzed. It was possible to segment the polymer fibers and the air voids from the
cementitious matrices accurately, while the accuracy of the quartz-sand particles’ segmentation imposed addi­
tional challenges and proved dependent on the properties of the surrounding hydrated phase.

1. Introduction microfibers [6–8].


The micromechanical “fine tuning” of SHCC compositions results in a
Strain-hardening cement-based composites (SHCC) represent a high dependence of their mechanical behavior on various loading and
distinct type of fiber-reinforced concretes which yield controlled mul­ environmental factors [4,8–10]. To understand and tailor the material
tiple cracking when subjected to increasing tensile loading [1]. The response to various actions, appropriate micromechanical investigations
multiple cracking in the strain-hardening phase results in remarkable such as single-fiber pullout and tension tests, are indispensable [4,7,11,
tensile ductility before failure localization (softening) occurs. Further­ 12]. Besides the information delivered on the mechanics of SHCC at the
more, it ensures several positive features in terms of the mechanical constituent level, the micromechanical parameters obtained can be
performance and durability of elements made of or strengthened with assembled in analytical [6,7,12] and/or numerical [13–15] models for
SHCC [2–5]. Such superior properties are achieved by purposeful scaling up and predicting the material behavior at the composite and
adjustment of the material composition, which targets a micro­ structural scales.
mechanical balance between the cracking behavior of the fine-grained However, the micromechanical tests on separate constitutive phases
cementitious matrix and the crack-bridging behavior of the polymer do not reproduce all the microstructural interactions in the composites.

* Corresponding author.
E-mail address: renata.lorenzoni@aluno.puc-rio.br (R. Lorenzoni).

https://doi.org/10.1016/j.cemconcomp.2020.103551
Received 31 May 2019; Received in revised form 18 December 2019; Accepted 29 January 2020
Available online 1 February 2020
0958-9465/© 2020 Elsevier Ltd. All rights reserved.
R. Lorenzoni et al. Cement and Concrete Composites 108 (2020) 103551

Furthermore, scaling down and reproducing thermal, dynamic and long- high potential of this technique for describing the 3D micro-morphology
term loading conditions in micromechanical experiments is challenging of complex, multi-phase cementitious composites, such as SHCC.
and involves high levels of uncertainty. The active micromechanical
mechanisms and damage processes in the composites can be assessed in 2. Deep learning technique and segmentation parameters
dedicated testing configurations involving in addition non-destructive
monitoring techniques such as Acoustic Emission [16,17] or The Convolutional Neural Network (CNN) technique involves
micro-computed tomography (microCT). The latter also enables an machine-learning which has performed excellently at tasks such as
explicit representation of the decisive constitutive phases of SHCC, such hand-written zip code digit classification [34] and face detection [35].
as fibers, binder matrix, aggregates, and air voids, which can be coupled In recent years, several works have shown that they can be also applied
with detailed numerical modelling techniques [14,15,18–22]. to more challenging visual classification tasks [36], such as in materials
MicroCT represents a powerful tool for coupled experimental- with complex microstructures [31,37–42]. These applications make
numerical analyses at the micro- and meso-levels since it can generate increasing use of a class of techniques called Deep Learning (DL).
a 3D-representation of the material’s microstructure [23,24]. With re­ In DL multiple levels of representation are obtained by composing
gard to cementitious composites, this technique was used to describe non-linear modules that transform the representation at one level into a
and quantify the internal damage mechanisms occurring under various representation at a higher, slightly more abstract level. For classification
actions at the fiber-level, for example, mechanical [25] or thermal [26]. tasks, higher layers of representation amplify aspects of the input that
Moreover, in situ microCT analyses make possible observation of the are important for discrimination and suppress irrelevant variations [43].
development of damage and deformations over time [27,28], while the The networks require as input a training set defined by the user upon the
quantification of the corresponding kinematics, either global or local, images. The network is trained until its outputs match the desired object
can be done in the framework of Digital Volume Correlation (DVC) [29]. classes within a certain error criterion. The trained network can be
For the detailed reconstruction of the microstructure of fiber- checked for satisfactory accuracy on a set of reference images and is then
reinforced composites, the specific material’s constitutive phases must ready to be applied to other images.
be differentiated and segmented based on objective criteria. The seg­ For purposes of this work, CNN were developed within the Dragonfly
mentation of steel fibers and air voids in cementitious matrices is rela­ software platform, which uses the popular DL TensorFlow engine in a
tively straightforward and is usually done based on the gray-values of user-friendly image processing environment. TensorFlow is a machine-
the corresponding voxels in the microCT images [25]. This is facilitated learning system that operates on large scale and in heterogeneous en­
by the high density of the steel fibers as compared to the surrounding vironments such as image classification [44]. In Dragonfly, TensorFlow
cementitious matrix and the resulting different x ray absorptions, thus was adopted along with Keras-format, Python-encoded CNN [45]. It
giving rise to distinct bright areas. Conversely, the air voids result in applies CNN in providing the users with an interface for connecting
darker areas when compared to the matrix. In the case of low density inputs and outputs, tuning parameters, iterating training, and inferring
fibers can also be resolved based on the grayscale of the image, such as final results from new inputs [46].
polymer fibers [30]. Although these fibers have dark tones as well as air There are several architectures for Deep Learning networks. The
voids, both can be differentiated by a shape criterion later. differences among them lie in the combination of convolution and
In the case of SHCC, however, several challenges arise. First, the pooling made from the input image. In this study the U-NET architecture
polymer microfibers and the fine aggregates in the cementitious was employed [47]. This network has been shown to be efficient in
matrices require high resolution for their detection and accurate segmenting biomedical images, in which very few annotated images
morphologic representation. Usually this implies a compromise between were required for training.
the resolution of the scans and the size of the scanned specimen. Sec­ The network takes the pixel intensities as input and the number of
ondly, the low density of the polymer fibers does not allow their outputs is given by the number of phases to be segmented; additionally,
distinction from the air voids based on the gray values only. Similarly, there is an extra phase representing all the remaining image pixels not
the gray-value-based segmentation of the fine aggregates from the specified for training. In this project three phases of the material were
binder matrix is not possible due to their similar densities. Thus, more segmented: fibers, sand particles and air voids.
sophisticated segmentation techniques must be applied. A training set is prepared by manually marking objects of the
Manual segmentation by human operators is inefficient and involves different classes. Normally, for a typical 3D image with 1000–2000
significant uncertainties [31]. On the other hand, machine learning is a layers, reasonable results can be achieved by training with just 10 to 20
method that uses algorithms which iteratively learn from data, allowing training layers.
computers to formulate hidden insights without being explicitly pro­ The training requires the optimizing of some parameters for better
grammed in respect of where to search [32]. In other words, this tech­ performance of the network. In the Dragonfly platform six parameters
nology uses a system to discover from raw data the representations are required: patch size, stride-to-input ratio, number of epochs, batch
needed to feature detection or classification automatically. size, optimization algorithm, and loss function.
In this work a machine-learning-based segmentation method was The input images are divided into windows, sequentially scanned,
applied to two different types of SHCC made of different fibers and and provided to the network. The patch size is expressed by the size of
cementitious matrices. The first composition studied consisted of a high- this window. The stride-to-input ratio is the displacement step of the
strength matrix and 6 mm-long, ultra-high molecular weight poly­ analysis windows. The input pixel values go through a sequence of
ethylene (UHMWPE) fibers in a volume ratio of 2% [9]. The other convolution and pooling operations until a final output is calculated.
composition was a normal-strength SHCC made with 2% volume frac­ The result is then propagated backwards through the network and an
tion of 12 mm-long polyvinyl alcohol (PVA) fibers [4,33]. These mate­ error is calculated.
rials exhibited different morphologies at the micro-scale, resulting in An epoch corresponds to one forward and backward propagation
distinct features of the microCT images. through the network. In each pass the error is reduced by adjusting the
To demonstrate the efficiency and potential of the Deep Learning internal network weights using an optimization algorithm. As the
(DL) segmentation technique, the high-strength SHCC was adopted as number of parameters that must be optimized in an epoch is many times
reference material for machine training. The segmented constituent too big to feed to the computer GPU, it is divided into several smaller
phases were the air pores, fibers, and quartz sand particles. With the aim batches. The batch size is the number of training samples in one forward
of showing that the same training can be applied to similar images, the and one backward pass. The loss function is a method for evaluating how
trained network was directly applied to segment the normal-strength well an algorithm models the given data. The loss function results in a
SHCC. Thereby it would be possible to confirm the suitability and large number if the predictions deviate too much from reality. However,

2
R. Lorenzoni et al. Cement and Concrete Composites 108 (2020) 103551

in the learning process the loss function reduces the error in prediction. 4. Specimen preparation and 3D-image acquisition
After a suitable number of epochs, the error reaches a predefined min­
imum value and the training stops. In the context of numerical modelling of SHCC with discrete fiber
representation [49], dumbbell-shaped specimens were produced with a
3. SHCC compositions small thickness in the gauge length, see Fig. 1. The small thickness of
approximately 3.5 mm was intended to facilitate a proper experimental
The SHCCs analyzed in the current work represent typical compo­ basis for 2D simulations, in which specific constraints regarding fiber
sitions for their strength classes and have been comprehensively inves­ orientation and distribution were encountered [49].
tigated by the authors in previous works [4,33,48]. The SHCC mixtures The small thickness of the specimens was achieved by pressing a
were named according to the corresponding combinations of matrix and horizontal plate into a prismatic mold filled with SHCC until the spacers
fibers, in which the normal-strength and the high-strength matrices were arrested further displacement, see Fig. 2. The applied pressure squeezed
given the indices M1 and M2, respectively. the fresh SHCC outward toward the open ends of the molds, which
The high-strength SHCC matrix (M2) was specifically designed for an formed the thick end blocks for specimen fixation in the testing setup.
effective composite action with hydrophobic microfibers made of ultra- The displacement of the fresh SHCC toward the end of the mold led to a
high molecular weight polyethylene (UHMWPE), produced under the longitudinal orientation of the fibers, which was a desired aspect both
brand name Dyneema SK62 by DSM (the Netherlands). These fibers, with regard to the numerical simulations and microCT scanning. Note
which will be abbreviated as PE in this paper, have an average diameter here that the fiber orientation generally depends on the extent of the
of 20 μm, a cut length of 6 mm and a density of 970 kg/m3. Their volume induced flow and the rheological properties of fresh SHCC.
ratio in M2-PE is 2%. The dumbbell-shaped specimens were demolded after 24 h of sealed
To ensure proper anchoring of the short, hydrophobic microfibers, curing in the molds. The mold elements were made of polyvinyl chloride
the cementitious matrix should exhibit high strength and packing den­ (PVC), which is a hydrophobic polymer. Thus, the casted specimens had
sity. For this reason, the M2 matrix has a high cement content and a low no moisture loss. After extraction from the molds, the specimens were
water-to-binder ratio of 0.18. Silica fume (SF) was added in a moderate stored in sealed plastic bags for 26 days under constant temperature (22
amount as a partial cement replacement to improve the frictional bond �
C) and relative humidity (65% RH). Given that the microCT scans
between the fiber and the matrix further; see Table 1. The micro­ require comparable dimensions of the scanned cross-section in order to
mechanical criteria for strain-hardening and multiple cracking in SHCC avoid beam hardening/attenuation effects, smaller SHCC stripes were
as well as the geometric nature of the polymer microfibers do not allow subsequently cut longitudinally from the middle of the SHCC plates as
for the use of common aggregates since they increase the toughness of shown in Fig. 1. The miniature specimens scanned in the microCT rep­
the matrix and negatively affect the distribution of the fibers [1,7]. resented thin strips of 100 mm length, 10 mm width, and 3.5 mm
However, a small amount of quartz sand was added to ensure a certain thickness. Besides the purpose of microstructure segmentation, these
stiffness and to avoid exaggerated shrinkage. specimens facilitated in situ tension tests accompanied by microCT an­
The PVA fibers used in the normal-strength SHCC (M1-PVA) are alyses, which will be the subject matter of a future study. Note that the
Kuralon REC-15 fibers produced by Kuraray, Japan. Their diameter is testing age of the specimens for numerical simulations as well as for in
40 μm; the cut length is 12 mm while their density is 1300 kg/m3. As situ microCT was 28 days, which is a standard age for determining the
opposed to the PE fibers, the PVA fibers are highly hydrophilic and as mechanical properties of cementitious materials.
such develop a strong chemical bond with the cement-based matrices. The microCT scans were performed using a Nanotom X ray computer
To limit bond strength and avoid premature fiber rupture during crack tomograph, which has an open high-power nano focus X ray tube
formation, the cementitious matrices in PVA-SHCC are to have moderate transmission with a diamond target and a target material for X ray
strength and density. This is usually achieved by replacing a high generation is wolfram (tungsten) [50], rotating sample holder and de­
portion of cement with fly ash, as shown in Table 1. Given the larger tector setup. The specimen was fixed vertically about the specimen’s
diameter of the PVA fibers in comparison to the PE fibers, and the large longitudinal axis; see Fig. 3. The area of observation in the middle of the
amount of fly ash used, a higher amount of quartz sand could be used in thin SHCC stripes was approximately 10 mm � 10 mm.
M1 without compromising its ductility. The scan parameters for the M2-PE specimen were: 100 kV voltage,
The sand particles have different mechanical properties in compar­ 100 μA current and 1441 projections. A 16 bits image reconstruction is
ison to the surrounding cementitious matrices, and their segmentation is normalized according to the attenuation coefficients of the material
interesting for micro-scale numerical simulations as well as for the phases, in which the 0 intensity of the image histograms is the least
general purpose of automatic aggregate segmentation in concretes and attenuating phase, while the highest intensity (65535) refers to the most
mortars. According to the mixture design, the volume ratio of quartz attenuating phase, that is, the densest of the specimen. After recon­
sand in M2-PE is approximately 5.3%, while in M1-PVA it is 19.5%. The struction 1333 slices were obtained and each slice had 2212 by 1276
particle size distribution of the quartz sand was measured using a laser pixels. The voxel volume was (4.0 μm)3. The scan parameters for the M1-
diffraction particle size analyzer; it will be presented in Section 5.2.1. PVA specimen were: 90 kV voltage, 100 μA current and 1441 pro­
jections. After reconstruction 1384 slices were obtained and each slice
had with 1753 by 940 pixels. The voxel volume was (4.8 μm)3.
The voxel size is determined by 1) ratio of distance between source
Table 1 and specimen to distance between specimen and detector, and 2) size of
Mixture compositions of SHCC under investigation. the volume to be scanned. The positioning of the sample between x-ray
M2-PE [kg/m3] M1-PVA [kg/m3]

CEM I 42.5 R–HS – 505


CEM I 52.5 R-SR3/NA 1460 –
Fly ash – 621
Silica fume (SF) 292 –
Quartz sand 0.06–0.2 mm 145 536
PCE superplasticizer 25 10
PVA fibers – 26
UHMWPE fibers 20 –
Water 315 338
Fig. 1. Original dog-bone specimen with a 3.5 mm thickness in the gauge
Viscosity modifier – 4.8
length from which the SHCC strips for microCT investigations were extracted.

3
R. Lorenzoni et al. Cement and Concrete Composites 108 (2020) 103551

Fig. 2. Schematic representation of a longitudinal section through the mold showing the imposed flow of fresh SHCC through applied pressure. Note that the excess
material was already removed during the production process.

Fig. 4. X ray scanned volumes from the (a) M2-PE and (b) M1-PVA specimens.

Fig. 3. SHCC specimen fixed in the sample holder in front of the x ray source.

source and detector can be adjusted to ensure a desirable geometrical


magnification of the scanned volume. Furthermore, there are several
parameters, such as power, voltage, exposure time etc., that should be
optimized in order to ensure an appropriate image quality.

5. Results and discussion

Fig. 4 shows the scanned volumes of each sample.


Although the focus of this work is the deep learning segmentation
technique, a pre-processing sequence needed to be applied in the im­
ages. Pre-processing is a typical procedure for microCT images which
mainly aims to improve image visualization and make further steps,
such as segmentation, easier. In this work, pre-processing made it easier
for the user to detect the phases for network training. It has also been
found that deep learning shows better results in preprocessed images. A Fig. 5. Image processing sequence with the corresponding software.
flow chart with the used software for each step is shown in Fig. 5 for a
better follow up of the next sections. pores and fibers in M1-PVA images.
Even though the bulk density of M2 is higher than that of M1 [4], the
dense sand particles are relatively well distinguishable in M2-PE images;
see Fig. 6. This is not the case for the M1-PVA image; see Fig. 7. Hence, 4.1. Image processing
the methodology of this work was to create a network to identify pores,
fibers, and sand in M2-PE and then use the same network to identify First, both images were carefully cropped to eliminate the external
regions. An automatic contrast expansion was applied to improve the

4
R. Lorenzoni et al. Cement and Concrete Composites 108 (2020) 103551

and the same layer after histogram matching was applied based on an
M2-PE image as reference.

4.2. Segmentation of SHCC’s constituents

A standard way of segmenting different phases of a material in an


image is to choose a cut-off on the gray-value range of the pixel intensity
histogram (threshold). However, this is only possible in cases where the
different phases have different peaks in the histogram.
The histograms of all 2D slices of the M2-PE and M1-PVA images are
shown in Fig. 8. An assessment before and after application of non-local
means was made, showing that the noise reduction filter concentrates
the peaks in a lower range of gray value. In the case of M2-PE, better
Fig. 6. Noise reduction M2-PE image: (a) before and (b) after the application of
the 2D non-local means filter. separation between the peaks for sand and matrix was observed.
The first peak in both cases can be attributed to air voids, which are
represented by the darkest pixels in the image. However, there is some
overlap between the intensity ranges of pores and fibers, and thus a
simple threshold cannot be used. Shape criteria could in principle be
used to discriminate among them. However, the fibers also share in­
tensity ranges with sand particles in M2-PE and with the matrix in M1-
PVA. Additionally, as in the case of the fibers, resolution is a limiting
factor in segmenting smaller particles, i.e. particles with diameters
comparable to the voxel size. Thus, the quantification of the phases of
interest requires the use of another technique, such as Deep Learning.

4.2.1. Deep learning training and segmentation


The training database for each present class is determined by regions
of interest (ROI’s) delineated manually from a subset of 2D slices. First,
the training database was prepared in 10 slices from the M2-PE image as
Fig. 7. Histogram matching: (a) original M1-PVA image and (b) the same layer
shown in Fig. 9, where the delineated voids, fibers and sand are shown in
after histogram matching based on an M2-PE reference image.
blue, green and red, respectively. These ROI’s are then provided as
output to train the network, and the original image (Fig. 9a) is used as
visibility of the phases. As a positive side effect, this also reduced
input. The training was subsequently performed with the parameters
contrast differences between the several image layers, which can arise
shown in Table 2. Once trained, the network can be applied to all slices
during image acquisition/reconstruction. The non-local means filter, an
and/or other images of the same type.
edge-preserving low-pass filter [51] available as a FIJI plugin [52], was
The network result applied to the M2-PE image is shown in Fig. 10.
applied to reduce noise. The result of its application with automatic
The 3D images display each segmented phase, i.e. voids in blue, fibers in
sigma estimation is exemplified by a 2D slice of M2-PE image in Fig. 6.
red and sand in green.
The edges between the phases are considerably sharper in comparison to
Initially, a segmentation of voids by threshold in M2-PE image was
the unfiltered images, thus making manual delineation for training
carried out in order to compare with the results obtained by Deep
much easier. It was also verified that noise reduction was critical for the
Learning. A threshold intensity of 27000 was used in the histogram,
DL method, especially in the identification of the sand phase.
which resulted in the segmentation of some fibers as well. To eliminate
Besides the air voids and the fibers, three material phases can be
segmented fibers, the sphericity parameter was used. Sphericity is a
distinguished in the microCT slices in Fig. 6b. The round, dark-gray
function of the volume and of the surface area of a void [26]; objects of
areas are the sand particles. These are surrounded by the light-gray
sphericity less than 0.2 were eliminated. By this method the porosity was
hydrated binder phase and by bright areas, which most probably
2.8%, while the porosity according to DL was 3.0%. These values are
represent unhydrated cement particles and clumps of SF particles. The
very similar, i.e. less than 10% difference, but visually the result of the
relatively high amount of unhydrated cement is normal for high-
DL is better since separation by shape leads to some errors.
strength cementitious matrices due to the low water-to-binder ratio.
The fiber volume fraction obtained by DL was 1.7%, slightly lower
As for the possible presence of SF clumps: the small amount of very fine
than the fraction actually used when producing the SHCC samples (2%).
aggregates does not allow for sufficient internal shear action for
A possible reason for this relates to the small fiber diameter of approx­
breaking all clumps of fines during the mixing process.
imately 20 μm which, with a voxel size of (4 μm)3, leads to an inaccurate
In M1-PVA the fibers have larger diameter and length and the air
geometrical representation of the fiber cross-section and, as a result, of
void content of the binder matrix is lower. The contrast of the image is
the fiber volume. A more accurate method involves counting the fibers
different due to the different densities of the matrices of the two types of
in the microCT slices and considering their real diameters to calculate
SHCC under investigation. It was verified that this difference in the
their surface and/or volume ratio. Using this method, the resulting
quantity and size of voids and fibers did not influence the generalization
volume fraction of fibers is 2.4%. The deviation from the design value
of the network. However, applying a network to images with different
can be related to the non-uniform fiber distribution in the plate-like
contrast ranges showed that the network was very sensitive to that
specimens produced.
feature and did not work well.
Fig. 11 compares the nominal particle size distribution of the quartz
As a solution for that, a technique called histogram matching was
sand, as measured using a laser diffraction particle size analyzer, to the
applied [53]. This technique can be used to normalize two images or
particle size distribution yielded by image analysis of the DL segmented
normalize layers of the same image based on the histogram of a refer­
objects. Note that nominal distribution characterizes the quartz sand as
ence input image. Thus, an image used as input to train the network was
bulk and not in SHCC. Due to the difficulty in determining the boundary
also used as a reference to normalize the histogram of the images to
between the sand and the surrounding hydrated phase, the segmentation
which the network was applied. Fig. 7 shows an original M1-PVA image
of the sand particles did not show sharp boundaries. Nevertheless, the

5
R. Lorenzoni et al. Cement and Concrete Composites 108 (2020) 103551

Fig. 8. Histograms for all layers of the 3D image: (a) M2-PE and (b) M1-PVA; the red curves correspond to the original image; the black filled curves correspond to
the images filtered with the non-local means filter. (For interpretation of the references to color in this figure legend, the reader is referred to the Web version of
this article.)

Fig. 9. Phase drawing for network training: (a) original M2-PE image and (b)
image with drawn samples of voids (blue), fibers (green) and sand (red). Please
refer to the digital version of the manuscript for color clarification. (For
interpretation of the references to color in this figure legend, the reader is
referred to the Web version of this article.)

Table 2
Deep Learning parameters.
Input (patch) size (pixels) 128
Stride-to-input ratio 1
Number of epochs 50
Batch size 64
Loss function Categorical cross entropy
Optimization algorithm Adam [54]

Fig. 10. 3D images of M2-PE segmented by Deep Learning: voids, sand, fibers
evaluated sand content by volume in M2-PE was close to the percentages and all phases together. Please refer to the digital version of the manuscript for
given by the mixture composition, 8.2% vs 5.3%, respectively. The color clarification. (For interpretation of the references to color in this figure
particle size distribution yielded DL is given by the Max Feret Diameter, legend, the reader is referred to the Web version of this article.)
which is the longest distance between any two points along each object
boundary at an arbitrary angle. Despite the obvious difference, the section by the surface area of the respective slice, the resulting volume
estimation can be regarded as reasonable. In future research, the authors fraction of fibers is 1.8%. Similarly, for M2-PE a higher resolution is
will considerably extend the number of samples taken from each SHCC needed for a more accurate representation of the fiber volume.
plate specimen produced, so that a representative statistical evaluation Note that a successful segmentation represents an essential step for
can be performed. In the presentation at hand, however, the authors further analytical, nondestructive investigations of the constitutive
have focused on the image processing methodology as such. structure of the materials under study. The quantification of pore size
The same network was eventually applied to the M1-PVA image and distribution, aggregate content and particle size distribution, fiber vol­
the result is shown in 3D in Fig. 12. The porosity in this case was 2.4% ume fraction, and orientation etc. with traditional techniques (such as
and the deduced fiber volume fraction was 1.4%. By counting the microscopy, mercury intrusion, etc.) involves considerably higher ef­
number of fibers crossing different slices and dividing their real cross- forts and sample destruction [55,56]. The 3D-fiber segmentation using

6
R. Lorenzoni et al. Cement and Concrete Composites 108 (2020) 103551

applied in the automatic segmentation of other similar images. This


principle was demonstrated in the current work on two different types of
SHCC. The training set was developed based on a high-strength SHCC
made with Dyneema fibers, in which polymer fibers, voids and quartz
sand particles were distinguished. The same set was applied to a normal-
strength SHCC made with PVA fibers. The automatic segmentation was
successful in the case of fibers and air voids, while quartz sand particles
could not be differentiated because of their corresponding gray-value
range being heavily overlapped with that of the surrounding hydrated
cement phase. To elucidate this issue, the morphology of M1 will be
characterized by the authors with complementary methods, such as
ESEM, EDX etc. and solutions will be proposed for a more detailed
microCT segmentation of matrices similar to M1, e.g. with contrast
enhancing agents.
The in situ experimental testing of SHCC specimens represents the
next step for a coupled experimental-numerical analysis of SHCC at the
Fig. 11. Comparison between the nominal particle size distribution of the
quartz sand and the distribution yielded by image analysis based on the DL micro-scale. Crack formation and propagation depending on the loading
segmented sand in M2-PE. mode and material morphology represent the declared goal for future
studies. In this context, the quantification of the global and local de­
formations in the framework of Digital Volume Correlation (DVC) is a
challenging but highly interesting task.

Declaration of competing interest

The authors declare that they have no conflict of interest.

Acknowledgements

The authors acknowledge with thanks the financial support by the


Brazilian agencies CNPq, CAPES and FAPERJ, as well as by the German
Academic Exchange Service (DAAD). Also, the financial support by
CAPES granted by Probral project. Furthermore, the authors gratefully
acknowledge the financial support of the German Research Foundation
(DFG) for funding the Research Training Group GRK 2250 “Mineral-
bonded composites for enhanced structural impact safety”.

References

[1] V.C. Li, On engineered cementitious composites (ECC) A review of the material and
its applications, J. Adv. Concr. Technol. 1 (2003) 215–230, https://doi.org/
10.3151/jact.1.215.
[2] G.P.A.G. Van Zijl, F.H. Wittmann, B.H. Oh, P. Kabele, R.D. Toledo Filho, E.M.
R. Fairbairn, V. Slowik, A. Ogawa, H. Hoshiro, V. Mechtcherine, F. Altmann, M.
D. Lepech, Durability of strain-hardening cement-based composites (SHCC), Mater.
Struct. 45 (2012) 1447–1463, https://doi.org/10.1617/s11527-012-9845-y.
Fig. 12. Segmented 3D voids (blue) and fibers (red) in M1-PVA image by Deep
[3] V. Mechtcherine, Novel cement-based composites for the strengthening and repair
Learning. Please refer to the digital version of the manuscript for color clari­ of concrete structures, Construct. Build. Mater. 41 (2013) 365–373, https://doi.
fication. (For interpretation of the references to color in this figure legend, the org/10.1016/j.conbuildmat.2012.11.117.
reader is referred to the Web version of this article.) [4] I. Curosu, V. Mechtcherine, O. Millon, Effect of fiber properties and matrix
composition on the tensile behavior of strain-hardening cement-based composites
(SHCCs) subject to impact loading, Cement Concr. Res. 82 (2016) 23–35, https://
Deep Learning can yield a more accurate and efficient quantification of doi.org/10.1016/j.cemconres.2015.12.008.
these parameters [57]. [5] K. Minoru, R. Keitetsu, Recent progress on HPFRCC in Japan required performance
and applications, J. Adv. Concr. Technol. 4 (2006) 19–33, https://doi.org/
10.3151/jact.4.19.
5. Conclusions and outlook [6] V.C. Li, C.K. Leung, STEADY-STATE and multiple cracking OF short random fiber
composites, J. Eng. Mech. 118 (1992) 2246–2264.
[7] E.H. Yang, V.C. Li, Strain-hardening fiber cement optimization and component
Micro-computed tomography applied to SHCC is an extremely tailoring by means of a micromechanical model, Construct. Build. Mater. 24 (2010)
valuable tool in analyzing their microstructure and potentially in 130–139, https://doi.org/10.1016/j.conbuildmat.2007.05.014.
assessing the damage developing in such materials due to various ac­ [8] E.H. Yang, V.C. Li, Strain-rate effects on the tensile behavior of strain-hardening
cementitious composites, Construct. Build. Mater. 52 (2014) 96–104, https://doi.
tions. An objective quantification of the material morphology and org/10.1016/j.conbuildmat.2013.11.013.
damage requires an accurate segmentation of the relevant constitutive [9] I. Curosu, M. Liebscher, V. Mechtcherine, C. Bellmann, S. Michel, Tensile behavior
phases and of cracks. In this context, SHCC represent a challenging class of high-strength strain-hardening cement-based composites (HS-SHCC) made with
high-performance polyethylene, aramid and PBO fibers, Cement Concr. Res. 98
of materials because of the imposed scale of observation and physical
(2017) 71–81, https://doi.org/10.1016/j.cemconres.2017.04.004.
properties of typical constituents. [10] V. Mechtcherine, F.D.A. Silva, S. Müller, P. Jun, R.D.T. Filho, Coupled strain rate
The Deep Learning technique is a novel method with a high potential and temperature effects on the tensile behavior of strain-hardening cement-based
for an accurate and efficient segmentation of complex microstructures, composites (SHCC) with PVA fibers, Cement Concr. Res. 42 (2012) 1417–1427,
https://doi.org/10.1016/j.cemconres.2012.08.011.
which cannot be performed by applying common methods such as the [11] F.A. Silva, B. Mobasher, S. Müller, V. Mechtcherine, M.E.A. Fidelis, R.D. Toledo
gray-value threshold. When a good training basis is developed, it can be Filho, Interface characteristics of jute fiber systems in a cementitious matrix,

7
R. Lorenzoni et al. Cement and Concrete Composites 108 (2020) 103551

Cement Concr. Res. 116 (2018) 252–265, https://doi.org/10.1016/j. [34] J.S. Denker, W.R. Gardner, H.P. Graf, D. Henderson, R.E. Howard, W. Hubbard, L.
cemconres.2018.12.002. D. Jackel, H.S. Baird, I. Guyon, Neural Network Recognizer For Hand-Written Zip
[12] R. Ranade, V.C. Li, M.D. Stults, T.S. Rushing, J. Roth, W.F. Heard, Micromechanics Code Digits, 1989.
of high-strength , high-ductility concrete, ACI Mater. J. 110 (2013) 375–384. [35] B.A. Golomb, D.T. Lawrence, T.J. Sejnowski, Sexnet: A Neural Network Identifies
[13] P. Kabele, Multiscale framework for modeling of fracture in high performance fiber Sex from Human Faces, 1991.
reinforced cementitious composites, Eng. Fract. Mech. 74 (2007) 194–209, https:// [36] M.D. Zeiler, R. Fergus, Visualizing and Understanding Convolutional Networks,
doi.org/10.1016/j.engfracmech.2006.01.020. 2012.
[14] G. Ye, M. Lukovi�c, E. Schlangen, H. Dong, B. Savija,
� K. van Breugel, Tailoring [37] V.H.C. de Albuquerque, A.R. de Alexandria, P.C. Cortez, J.M.R.S. Tavares,
strain-hardening cementitious composite repair systems through numerical Evaluation of multilayer perceptron and self-organizing map neural network
experimentation, Cement Concr. Compos. 53 (2014) 200–213, https://doi.org/ topologies applied on microstructure segmentation from metallographic images,
10.1016/j.cemconcomp.2014.06.017. NDT E Int. 42 (2009) 644–651, https://doi.org/10.1016/j.ndteint.2009.05.002.
[15] M. Kunieda, H. Ogura, N. Ueda, H. Nakamura, Tensile fracture process of Strain [38] V.H.C. De Albuquerque, J.M.R.S. Tavares, L.M.P. Dur~ ao, Evaluation of
Hardening Cementitious Composites by means of three-dimensional meso-scale delamination damage on composite plates using an artificial neural network for the
analysis, Cement Concr. Compos. 33 (2011) 956–965, https://doi.org/10.1016/j. radiographic image analysis, J. Compos. Mater. 44 (2010) 1139–1159, https://doi.
cemconcomp.2011.05.010. org/10.1177/0021998309351244.
[16] S.C. Paul, S. Pirskawetz, G.P.A.G. Van Zijl, W. Schmidt, Acoustic emission for [39] P.C. Collins, B. Welk, T. Searles, J. Tiley, J.C. Russ, H.L. Fraser, Development of
characterising the crack propagation in strain-hardening cement-based composites methods for the quantification of microstructural features in α þ β-processed α/β
(SHCC), Cement Concr. Res. 69 (2015) 19–24, https://doi.org/10.1016/j. titanium alloys, Mater. Sci. Eng. A. 508 (2009) 174–182, https://doi.org/10.1016/
cemconres.2014.12.003. j.msea.2008.12.038.
[17] I. Curosu, S. Pirskawetz, V. Mechtcherine, Characterizing the crack development in [40] L.A. Dobrza� nski, M. Sroka, J. Dobrza�nski, Application of neural networks to
strain-hardening cement-based composites (SHCC) by means of acoustic emission, classification of internal damages in steels working in creep service, J. Achiev.
in: 9th Int. Conf. Fract. Mech. Concr. Concr. Struct. Fram, 2016, https://doi.org/ Mater. Manuf. Eng. 20 (2007). https://core.ac.uk/download/pdf/25776962.pdf.
10.21012/fc9.207. Berkeley, California, USA. [41] V.H.C. De Albuquerque, P.C. Cortez, A.R. De Alexandria, J.M.R.S. Tavares, A new
[18] J. Kang, J.E. Bolander, Event-based lattice modeling of strain-hardening solution for automatic microstructures analysis from images based on a
cementitious composites, Int. J. Fract. 206 (2017) 245–261, https://doi.org/ backpropagation artificial neural network, Nondestr. Test. Eval. 23 (2008)
10.1007/s10704-017-0214-2. 273–283, https://doi.org/10.1080/10589750802258986.
[19] A. Karamnejad, L.J. Sluys, A dispersive multi-scale crack model for quasi-brittle [42] J.C.A.
� Iglesias, R.B.M. Santos, S. Paciornik, Deep learning discrimination of quartz
heterogeneous materials under impact loading, Comput. Methods Appl. Mech. Eng. and resin in optical microscopy images of minerals, Miner. Eng. 138 (2019) 79–85,
278 (2014) 423–444, https://doi.org/10.1016/j.cma.2014.05.020. https://doi.org/10.1016/j.mineng.2019.04.032.
[20] E. Tamsen, W. Weber, D. Balzani, First steps towards the direct micro-macro [43] Y. Lecun, Y. Bengio, G. Hinton, Deep learn. (2015), https://doi.org/10.1038/
simulation of reinforced concrete under impact loading, Proc. Appl. Math. Mech. nature14539.
18 (2018) 1–2, https://doi.org/10.1002/pamm.201800181. [44] M. Abadi, P. Barham, J. Chen, Z. Chen, A. Davis, J. Dean, M. Devin, S. Ghemawat,
[21] E.A. De Souza Neto, P.J. Blanco, P.J. S� anchez, R.A. Feij�oo, An RVE-based G. Irving, M. Isard, M. Kudlur, J. Levenberg, R. Monga, S. Moore, D.G. Murray,
multiscale theory of solids with micro-scale inertia and body force effects, Mech. B. Steiner, P. Tucker, V. Vasudevan, P. Warden, M. Wicke, Y. Yu, X. Zheng,
Mater. 80 (2015) 136–144, https://doi.org/10.1016/j.mechmat.2014.10.007. TensorFlow: a system for large-scale machine learning, in: 12th USENIX Symp.
[22] A. Trofimov, T. Mishurova, L. Lanzoni, E. Radi, G. Bruno, I. Sevostianov, Oper. Syst. Des. Implement, 2015, pp. 265–283, https://doi.org/10.1016/0076-
Microstructural analysis and mechanical properties of concrete reinforce d with 6879(83)01039-3.
polymer short fibers, Int. J. Eng. Sci. 133 (2018) 210–218, https://doi.org/ [45] F. Chollet. https://github.com/keras-team/keras (n.d).
10.1016/j.ijengsci.2018.09.009. [46] R. Makovetsky, N. Piche, M. Marsh, Dragonfly as a platform for easy image-based,
[23] M. Leibowitz, A.J. Clarke, W. Qiu, X. Lu, H. Bale, J.C.E. Mertens, S. Etchin, Deep Learn. Appl. 24 (2018) 532–533, https://doi.org/10.1017/
R. Hartwell, R.S. Bradley, D. Trapp, B. Zhang, A. Tkachuk, B. Hornberger, S143192761800315X.
K. Henderson, N.L. Cordes, B.M. Patterson, A. Merkle, P.J. Withers, In situ [47] O. Ronneberger, P. Fischer, T. Brox, U-net: convolutional networks for biomedical
laboratory-based transmission X-ray microscopy and tomography of material image segmentation, in: Proc. Int. Conf. Med. Image Comput. Comput. Interv,
deformation at the nanoscale, Exp. Mech. 56 (2016) 1585–1597, https://doi.org/ 2015, pp. 234–241, https://doi.org/10.1007/978-3-319-24574-4.
10.1007/s11340-016-0197-3. [48] S. Müller, V. Mechtcherine, Fatigue behaviour of strain-hardening cement-based
[24] M.G.D. Geers, V.G. Kouznetsova, W.A.M. Brekelmans, Multi-scale computational composites (SHCC), Cement Concr. Res. 92 (2017) 75–83, https://doi.org/
homogenization: trends and challenges, J. Comput. Appl. Math. 234 (2010) 10.1016/j.cemconres.2016.11.003.
2175–2182, https://doi.org/10.1016/j.cam.2009.08.077. [49] A. Shehni, U. H€ außler-Combe, I. Curosu, T. Gong, V. Mechtcherine, Numerical
[25] E.N. Landis, R. Kravchuk, D. Loshkov, Experimental investigations of internal simulation of HS-SHCC under quasi-static tensile loading, in: Pijaudier-Cabot Al.
energy dissipation during fracture of fiber-reinforced ultra-high-performance 10th Int. Conf. Fract. Mech. Concr. Concr. Struct. Fram, 2019.
concrete, Front. Struct. Civ. Eng. 13 (2019) 190–200, https://doi.org/10.1007/ [50] GE Sensing, Inspection Technologies GmbH, Phoenix Nanotom M, Phoenix
s11709-018-0487-1. Nanotom. http://www.ge-mcs.com/download/x-ray/phoenix-x-ray/nanotom
[26] R. Lorenzoni, S. Paciornik, F.A. Silva, Characterization by microcomputed _m_s_DE_GEIT-0113.pdf, 2013, 1-4.
tomography of class G oil well cement paste exposed to elevated temperatures, [51] X. Wang, S. Shen, G. Shi, Y. Xu, P. Zhang, Iterative non-local means filter for salt
J. Petrol. Sci. Eng. 175 (2019) 896–904, https://doi.org/10.1016/j. and pepper noise removal, J. Vis. Commun. Image Represent. 38 (2016) 440–450,
petrol.2019.01.022. https://doi.org/10.1016/j.jvcir.2016.03.024.
[27] D. Hern� andez-Cruz, C.P. Ostertag, J.F. Duncan, P.J.M. Monteiro, W. Nguyen, [52] J. Schindelin, I. Arganda-Carreras, E. Frise, V. Kaynig, M. Longair, T. Pietzsch,
K. Celik, In-situ tensile and corrosion damage characterization of fiber-reinforced S. Preibisch, C. Rueden, S. Saalfeld, B. Schmid, J.Y. Tinevez, D.J. White,
cementitious composites using X-ray micro-computed tomography, in: 9th Int. V. Hartenstein, K. Eliceiri, P. Tomancak, A. Cardona, Fiji: an open-source platform
Conf. Fract. Mech. Concr. Concr. Struct, 2016, https://doi.org/10.21012/fc9.180. for biological-image analysis, Nat. Methods 9 (2012) 676–682, https://doi.org/
[28] S. Oberpeilsteiner, T. Reiter, D. Salaberger, Coupling of in-situ-CT with virtual 10.1038/nmeth.2019.
testing by FEM of short fiber reinforced materials, Int. Conf. Ind. Comput. Tomogr. [53] C.F. Hildebolt, R.K. Walkup, G.L. Conover, N. Yokoyama-Crothers, T.Q. Bartlett, M.
(2014) 299–305. W. Vannier, M.K. Shrout, J.J. Camp, Histogram-matching and histogramflattening
[29] A. Buljac, C. Jailin, A. Mendoza, J. Neggers, T. Taillandier-Thomas, A. Bouterf, contrast correction methods: a comparison, Dentomaxillofacial Radiol. 25 (1996)
B. Smaniotto, F. Hild, S. Roux, Digital volume correlation: review of progress and 42–47, https://doi.org/10.1259/dmfr.25.1.9084285.
challenges, Exp. Mech. 58 (2018) 661–708, https://doi.org/10.1007/s11340-018- [54] D.P. Kingma, J.B. Ba, ADAM, A METHOD FOR STOCHASTIC OPTIMIZATION,
0390-7. 2017, https://doi.org/10.1063/1.4902458.
[30] A.C. Bordelon, J.R. Roesler, Spatial distribution of synthetic fibers in concrete with [55] K. Tosun-Felekoǧlu, B. Felekoǧlu, R. Ranade, B.Y. Lee, V.C. Li, The role of flaw size
X-ray computed tomography, Cement Concr. Compos. 53 (2014) 35–43, https:// and fiber distribution on tensile ductility of PVA-ECC, Compos. B Eng. 56 (2014)
doi.org/10.1016/j.cemconcomp.2014.04.007. 536–545, https://doi.org/10.1016/j.compositesb.2013.08.089.
[31] S.M. Azimi, D. Britz, M. Engstler, M. Fritz, Advanced Steel Microstructure [56] B.Y. Lee, J.K. Kim, J.S. Kim, Y.Y. Kim, Quantitative evaluation technique of
Classification by Deep Learning Methods Advanced Steel Microstructure Polyvinyl Alcohol (PVA) fiber dispersion in engineered cementitious composites,
Classification by Deep Learning Methods, 2017. Cement Concr. Compos. 31 (2009) 408–417, https://doi.org/10.1016/j.
[32] Y. Liu, T. Zhao, W. Ju, S. Shi, Materials discovery and design using machine cemconcomp.2009.04.002.
learning, J. Mater. 3 (2017) 159–177, https://doi.org/10.1016/j. [57] T. Mishurova, N. Rachmatulin, P. Fontana, T. Oesch, G. Bruno, E. Radi,
jmat.2017.08.002. I. Sevostianov, Evaluation of the Probability Density of Inhomogeneous Fiber
[33] I. Curosu, V. Mechtcherine, D. Forni, E. Cadoni, Performance of various strain- Orientations by Computed Tomography and its Application to the Calculation of
hardening cement-based composites (SHCC) subject to uniaxial impact tensile the Effective Properties of a Fiber-Reinforce D Composite, vol 122, 2018,
loading, Cement Concr. Res. 102 (2017) 16–28, https://doi.org/10.1016/j. pp. 14–29, https://doi.org/10.1016/j.ijengsci.2017.10.002.
cemconres.2017.08.008.

You might also like