2020 7th NAFOSTED Conference on Information and

Computer Science (NICS)

Comparing U-Net Convolutional Network with

Mask R-CNN in Agricultural Area Segmentation on
Satellite Images
Thinh Tran Pham Quoc
Faculty of Information Technology
VNUHCM – University of Science
Ho Chi Minh City, Viet Nam
1612659@student.hcmus.edu.vn
Tam Tran Linh
Faculty of Information Technology
VNUHCM – University of Science
Ho Chi Minh City, Viet Nam
1612589@student.hcmus.edu.vn
Thu Nguyen Tran Minh
Faculty of Information Technology
VNUHCM – University of Science
Ho Chi Minh City, Viet Nam
ntmthu@fit.hcmus.edu.vn

Abstract—Deep learning is the fastest-growing trend in
statistical analysis of remote sensing data. Deep learning models
are used for information processing of spectral steps,
identification statistics, segmentation and classification of the
objects in satellite images, etc. Image segmentation could help to
make the object statistics more accurate by separating the
objects from the background. In this paper, we propose
knowledge of Mask R-CNN and U-Net in satellite imagery
segmentation, and we also make an experiment for these models
to show the appropriateness in this field. Experimental result of
the mean average precision (mAP) on dataset of Vietnam
satellite images is 95.21% for Mask R-CNN and 92.69% for U-
Net.
Keywords—Deep learning, segmentation, Mask R-CNN, U-
Net, agricultural areas, satellite images.
I. INTRODUCTION
Satellite imagery or remote sensing imagery is usually
known as the data obtained from the satellite, civil aircraft,
dedicated aircraft, or other drones. Their purpose is to show
objects on the surface of the earth through sensors and video
cameras. Typically, satellite imagery is used for studying
measurements, gathering objective information, and studying
the surface of the Earth or different planets. The result of
those studies affect many areas of life such as weather
forecast, natural disaster forecast in meteorology; monitoring
the rate of desertification, the rate of coastal erosion in
geology; monitoring forest cover, warning and monitoring
forest fires in forestry and many other fields.
In agriculture, remote sensing is also used in
management, statistics, and farming. Its applications could be
mentioned as forecasting and managing agricultural
production, remote sensing information and geographic
information, surveying and mapping agricultural maps,
warning deforestation, monitoring normalized difference
vegetation index (NDVI), etc [1][2]. The emergence of
Agriculture 4.0 attributes to practical applications of
agricultural monitoring through satellite imagery.
Deep learning, a small branch of artificial intelligence [3],
with many works and researches after 2012, has impacted on
different aspects of life through solving many practical
problems [4] such as health care, data processing, stock
analysis, physical recognition, etc. Deep learning models are
faster and more accurate than other methods in solving
problems of artificial intelligence. The reason is that they are
built on the human neural network-an architecture that has
many advantages in information transmission and processing
[5]. The areas of science that can be well addressed by using
deep learning include automatic speech recognition, image
processing identification, natural language processing,
bioinformatics, etc.
Deep learning in agricultural satellite image processing is
one part of applying deep learning methods in identifying and
segmenting the agricultural objects on satellite images. Along
with the development of deep learning models in image
processing [6][7], this topic has been studied in many
scientific works for a long time. Some previous researches
are Land Use and Land Cover Classification [8], Forest
Classification and Structural Estimation [9], Agricultural
Land Detection in Insular Areas using improved AlexNet
network model [10], etc. These previous researches indicate
that the identification and segmentation of agricultural areas
with deep learning model have high applicability in various
fields: such as agricultural mapping, calculation of harvested
agricultural yields, and estimation of the amount of fertilizer,
etc. The experimental works mentioned are tested only on the
dataset in Western countries (The Americas or Europe),
where science and technology are developed with modern
and high-resolution machines. Their findings raise a big
question about the effectiveness of agricultural satellite
imagery in developing countries, especially in Vietnam.
Beside the fact that Vietnam's agriculture accounts for 17.4%
of its GDP in 2015, Vietnam is also the second-largest rice
exporter in the world. This means that Vietnam may represent
the agriculture of Eastern countries.
Regarding the segmentation problem of agricultural areas
on satellite imagery, there are very few experimental
researches on both Mask R-CNN and U-Net models, in which
the researchers compare their effectiveness, advantages, and
disadvantages. Mask R-CNN model [13], proposed by K. He
et al, was developed from Faster R-CNN with an additional
branch in the architecture to create a mask layer for the object
segmentation. Since then, Mask R-CNN has been
experimented on many different satellite imagery processing
problems. All of them achieve high efficiency [14][15].
Mask R-CNN surpasses the two winners of COCO Challenge
[16]: MNC [17] (2016) and FCIS [18] (2015). Moreover,
regarding the effectiveness of experiments on many problems
of satellite image segmentation [14][15], Mask R-CNN is
hoped to bring about the remarkable advances in agricultural
area segmentation on satellite imagery. Besides, U-Net [19],
the model proposed by O. Ronneberger et al with the original
purpose of serving the segmentation of biomedical objects,
has quickly been experimented in segmenting different types
of objects in various fields after showing its high efficiency

978-0-7381-0553-6/20/$31.00 ©2020 IEEE 124

 2020 7th NAFOSTED Conference on Information and
Computer Science (NICS)
[20][21][22]. In processing satellite imagery, U-Net was also
experimented with the segmentation of buildings [23], urban
areas [24], etc. These experiments are yielding high-precision
prediction; therefore, this shows that U-Net can also be a
good model for agricultural area segmentation on satellite
images. Due to these reasons, we decided to experiment and
compare the two models of Mask R-CNN and U-Net in the
agricultural areas object segmentation on satellite images.
This work will help to highlight the effectiveness of Mask R-
CNN and U-Net in supporting agricultural remote sensing. In
addition, the experiment is conducted on two datasets: one
dataset with images obtained in Vietnam, and the other with
images obtained in other regions (The Americas or Europe).
This method not only confirms the accuracy of Mask R-CNN
and U-Net on satellite imagery with high-quality images of
Western countries in previous works but also tests their
effectiveness in the case of Eastern agricultural areas
(especially in Vietnam).
In this paper, we present the results of research and
experiment on two Mask R-CNN and U-Net models in the
agricultural image segmentation. The paper includes 6 main
parts: part I-an overview of the work, part II-the current state
of deep learning application in satellite image processing in
agriculture, part III-the process of two deep learning Mask R-
CNN and U-Net models for the agricultural area
segmentation on satellite images, part IV-the detailed process
of training for two test models, part V-the predicted results of
Mask R-CNN and U-Net for real images, the accuracy of
each model and the comparison of their effectiveness in the
agricultural area segmentation on satellite images, part VI-
conclusion and future development for this work.
II. DEEP LEARNING IN AGRICULTURAL
SATELLITE IMAGE SEGMENTATION
The processing of agricultural satellite imagery consists
of problems on different levels of complexity. The first level
of image processing is object classification. In their study, P.
Helber's authors used deep learning model to classify 10 land
objects and achieved a high efficiency with more than 98%
accuracy in classification. The next level of image processing
combines object classification and object detection. The
study of T. Chang et al applied deep learning model to
classify and identify four different types of forests. With the
synthesis, statistics, and comparison of models, the author
Charou [25] has conducted research and compared various
deep learning methods in identifying agricultural area objects
on satellite images. The methods that Charou tested mostly
achieved high-result performance. However, the above works
only highlight the effectiveness when solving the problem of
recognizing objects from satellite images of some deep
learning models without mentioning the ability to segment
objects.
At the higher level when processing agricultural satellite
imagery, object segmentation is concerned by many
researchers. Object segmentation is the process of separating
objects from the background data by defining their margins.
It makes observing and analyzing objects on images more
closely and accurately. Regarding the problem of agricultural
area segmentation on satellite imagery, the study of K.M.
Masoud [11] has experimentally applied the improved FCN
model to solve problems. He reaches the conclusion that this
125
model achieves certain effectiveness in the agricultural area
segment. The drawback of this model is that its architecture
is relatively complex so it requires a large number of
convolution layers, which leads to model training and testing
in a large area with the requirement of large computer
resources (at least 16GB of RAM for wide-area training and
testing). When comparing FCN with another model (SegNet),
the experimental study by M. Yang and colleagues [12]
showed the higher efficiency level of FCN in the segment of
rice areas. However, both models have limitations with the
images of large areas, when the objects that need segmenting
get smaller. U-Net is found to be a simple yet effective model
through different studies that goes beyond the original
proposals of U-Net. With this finding, U-Net seems to be
more optimal than FCN during training and remains
competitively accurate in object segmentation. With the U-
shaped architecture of symmetric encoders and decoders, this
helps U-Net to synthesize the attributed information of
objects more accurately. U-Net model has also been used in
processing agricultural satellite imagery by experiment.
Andrei Stoian [26] utilized U-Net to segment the distribution
of many soils on satellite images and compared traditional U-
Net to fine-tune U-Net. However, due to the focus on many
types of objects (17 types), the highest accuracy in the object
segment of this work is achieved when segmenting water
areas, not agricultural areas. Mask R-CNN is a model with
the nature of solving object recognition problems like those
in Charou's research [25]. However, it is more optimal than
Charou's models due to an additional branch used in the
object segmentation. Mask R-CNN has been proved to be
effective in many object segmentation problems
[15][19][27][28], including segmentation in satellite
imagery. W. Zhang [14] applied this model in the segment of
the Arctic glaciers with mAP accuracy of 70%. Another work
of L. Chen [15] tested Mask R-CNN in the segment of urban
areas in Xiamen (China), with 90% precision and 87.18%
recall. Particularly in the segment of agricultural areas on
satellite images, the Mask R-CNN model does not seem to be
a matter of concern and does not have its own work to test the
effectiveness. Through what Mask R-CNN demonstrates in
other studies, this model showed the possibility of high
accuracy in the test of segmenting agricultural area objects on
satellite imagery. Besides, Mask R-CNN also has a high
applicability because it is possible to take advantage of object
positioning predictions (bounding box) combined with object
segmentation prediction results (mask layer). When
comparing the effectiveness of the two models Mask R-CNN
and U-Net, T. Zhao's experiment [29] put these two in the
evaluation of agricultural satellite imagery segmentation,
with the object of pomegranate canopy. This comparative test
indicates that the Mask R-CNN gives better results than U-
Net. However, the test object of the authors is low complexity
and the test dataset does not have enough noise level, so the
assessment is not highly referential in our opinion.
Through the stage of studying the current state of deep
learning in image processing, it can be seen that many models
have been used for the effectiveness test, from low-level
image processing models such as classification and object
detection, to higher-level ones such as object segmentation.
Especially, in processing satellite image segmentation, many
popular models have been tested on many types of
 2020 7th NAFOSTED Conference on Information and
Computer Science (NICS)
agricultural objects. However, among them, the effectiveness
verification and comparison of Mask R-CNN and U-Net
models in the problem of agricultural area segmentation seem
to be less studied and experimented. In our research and
experiment work, we will also conduct and compare the
effectiveness of two Mask R-CNN and U-Net models in the
agricultural satellite image segment particularly in
agricultural areas which are more general and more complex.
III. EXPERIMENTAL PROCESS
Fig. 1. Process of satellite image segmentation
The experimental process consists of 6 main steps as
shown in “Fig. 1”.
Step 1 - Data collection: Data is one of the important
factors, directly affecting the accuracy of the model.
Therefore, we had created our own dataset that was the most
suitable to the requirement of our experiment. The dataset
was collected using Google Map and Microsoft's Snipping
Tool, with a total of 2400 images for the two datasets of
agricultural areas in Vietnam and in other countries. Besides
the quantity of each sample object, the variety of categories
should be sufficient to be learned the necessary attributes.
Step 2 - Assigning data labels: In this step, VGG Image
Annotator tool [30] was used to assign location labels of the
objects on the dataset photos. Data labeling is also a very
important stage, as the model will rely on these locations to
train. If labeled incorrectly, the model would fail in learning
the object's properties, which leads to the inaccuracy in
prediction.
Step 3 - Model training: The core task of the model
training process is based on the provided data to extract the
features of labeled objects. These features are put in the
model to "remember". As a result, when testing with another
picture (not been trained yet), the model could recognize and
confirm the objects. Different models have different learning
styles, so it is important to adjust the learning parameters so
that the training process achieves the best results.
Step 4 - Model testing: Testing helps to identify whether
the model is learned properly. If not yet, the training process
needs to refine the data or adjust the learning parameters more
appropriately. Then, the models would be replayed with the
training process to achieve the best results. The identification
could be made from the predicted results in a picture or from
the learning curve graph. Because each training state reflects
a certain meaning of the model, it’s necessary to rely on
different factors such as the requirements of the problem, the
criteria of the dataset, the features of the object to choose an
optimal model that is the most suitable for solving each
separate problem.
Step 5 - Commenting and evaluating the model: Based on
the data obtained in step 4, as well as the accurate
measurement of the models, we will make comments in
comparison with the model theory. Simultaneously, the two
experimental models will be compared in terms of the quality
and effectiveness in the segmentation on the same images and
then, the results will be interpreted. Thus, the performance of
126
the two models when solving segmentation problems of
agricultural areas on satellite imagery will be evaluated.
Step 6 - Processing predicted results: In this step, we will
post-process the results of the test model to get more accurate
results. False predictions will be removed. Add missing
predictions and refine those that are not completely accurate.
The refinement makes the segmentation values more
accurate, which could be used for various purposes such as
creating new training datasets or using agricultural area
statistics. The more accurate an image is, the more reliable it
is to apply to statistics.
IV. IMPLEMENT AND TRAINING
A. Training data
In remote sensing, information collection devices play an
extremely important role because their accuracy affects the
reliability of later analysis and statistics. However, these
devices are relatively expensive. Therefore, with small and
limited experimental research scale in terms of funding, we
will use available and free satellite image data sources.
Google Map is a popular software integrated satellite view
function that we use for data collection. This is a software
with relatively wide image altitude (5m to 2000km) and
extremely flexible, which can be adjusted depending on the
characteristics of the desired vision. Our dataset is the small
self-collected from Google Map public domain. During our
data collection, selected images have at least one object in
each image. In addition, the ratio of the object needed to be
segmented (agricultural land) is usually over 50% in each
image. In the labeling process, the objects will be separated
based on the boundary of each type of land. Besides,
confusing data will also be restricted to the labeling process,
such as tree shadows, tractors, wells, ... The number of
objects in the images is in ranges from 1 to 20 depending on
the image.
The dataset we extracted includes 2400 images, which are
divided into two datasets, a satellite image of Vietnam
agricultural area (Vietnam) and a satellite image of
agricultural area of other regions (NonVietnam). The images
taken are mostly concentrated in the key agricultural areas.
The image taking on each dataset is as the rate follows: the
Vietnam dataset with the South around 75%, the North
around 20%, the Central around 5%. And the NonVietnam
dataset with America around 40%, Europe around 40%,
Africa around 15%, Asia around 5%. Compared to other
regions, Vietnam is a country with an intricate and dense
network of rivers. Therefore, the agricultural satellite images
of this area often contain many interfering objects (houses,
rivers, lakes, canals,...). In addition, the river network
characteristics also affect the planning of agricultural land.
This causes the diversity in the shape and size of agricultural
lands in Vietnam. Besides, the application of high technology
such as segmenting agricultural using commercial satellites
is limited, so having a full set of agricultural images of
different regions in Vietnam is an obstacle. Details of training
data division are shown in “TABLE I”.
TABLE I. DETAIL OF TRAINING DATA
Dataset Total Training Validation Testing
Vietnam 650 480 120 50
NonVietnam 1750 1280 320 150
 2020 7th NAFOSTED Conference on Information and
Computer Science (NICS)

B. Model training V. RESULT AND EVALUATION

A. Mask R-CNN

Fig. 2. Labeling data

After data collection, we carried out data labeling using

VGG Image Annotator software (VVG IA) [30] with multi-
point drawings to identify the agricultural areas on the image.
The difficulty in labeling is to define the right areas to Fig. 4. The Error of Mask R-CNN on the two datasets
identify, because the agricultural area on the image is an
easily confused object (with lawns, soccer fields, ponds, etc.). After the training process, we had the error curve of Mask
For this research, we define areas that are considered R-CNN as shown in “Fig. 4”. The curve indicates that after
agricultural areas, including wet rice and wheat (usually reducing to the best value, the error of the training process
green or yellow) areas, upland areas (divided crops), newly begins to increase due to the phenomenon of learning the
tilled muddy areas (usually brown), etc. After defining the features of the training dataset (over fitting). This soon
agricultural partitions, VVG IA will export a .json file that happens because the learning rate is too high while the
stores the coordinates of the objects, the training of the Mask training takes too many steps (epoch). In addition, the large
R-CNN model will then use this file to extract the partitions parameter and error function of the Mask R-CNN is so
and learn properties on them. With U-Net, this model requires complicated that it leads to a high fluctuation range when
learning data which are images corresponding to the model's assessing the error between consecutive training steps.
output value (the black-and-white image showing the mask
of an object). Therefore, taking advantage of the labels of To verify the effectiveness of the model, the early
Mask R-CNN, we took an additional step of processing the stopping was implemented, and the model was chosen at the
partitions into black and white to apply them to U-Net training step with the lowest error to perform the evaluation.
training (in “Fig. 2”). On Vietnam, we chose the model at training step 46 (loss =
1,049) and on NonVietnam at training step 78 (loss = 0.923).
In Mask R-CNN, during training, the model relies on the The Mask R-CNN evaluation was performed by the
.json file to detect the location of the object in the image, from Intersection over Union (IoU), precision, recall and mAP
which it splits into each partition and put into the network function. The obtained results are demonstrated in “TABLE
architecture [13] to extract and aggregate attributes. By III”. In particular, IoU shows the accuracy of prediction
repeatedly studying over the entire dataset, the training will through the overlap of the predicted values and the correct
produce models that have been "taught" to identify label of the object (the parameter 0.5 is interpreted as the
agricultural areas (in “Fig. 3”). predictions considered to be correct when the overlap is over
50%), Precision shows the accuracy of the projections. To
Our training of Mask R-CNN and U-Net models will
predict the model generated, Recall shows the omission of
adjust the hyper-parameters depending on each dataset, as
correct objects that the model cannot predict, and mAP is the
shown in “TABLE II”.
average parameter of the Average precision-the parameter
TABLE II. VALUE OF SUPPER PARAMETES IN TRAINING FOR that measures the model's prediction accuracy (details in
MASK R-CNN AND U-NET [31]).
Super parameters Vietnam NonVietnam “TABLE III” shows that Mask_NonVietnam has
Mask R-CNN 200 200 achieved better evaluation results. This is because the number
Epoch
U-Net 50 100
of data used in training process of NonVietnam is greater than
Batch_size 1 1
Step_per_epoch 500 1300 that of Vietnam.
Mask R-CNN 0.0001 0.0001
Learning_rate TABLE III. THE PARAMETERS EVALUATE THE ACCURACY OF
U-Net 0.001 0.001
Validation_step 150 350 MASK R-CNN MODEL
Weight_decay 0.0001 0.0001
Model IoU (0.5) Precision Recall mAP
Mask_Vietnam 0.7980 0.7521 0.5875 0.8574
Mask_NonVietnam 0.8070 0.7423 0.6352 0.9521

Fig. 3. The Mask R-CNN model to be processed during the training
B. U-Net
The error of U-Net is shown in “Fig. 5”. It is clearly that
the error of the training process tends to decrease, then with
slow speed. The model achieved the best error value on
Vietnam training in the 11th training step (loss = 0.2902), on
NonVietnam training in the 34th training step (loss = 0.1720).
Conducting the evaluation of these two models at the best
training steps by the values of IoU and Dice, we get the
results as in “TABLE IV”. Dice parameter (the Dice

127
 2020 7th NAFOSTED Conference on Information and
Computer Science (NICS)
coefficient) is a parameter to evaluate another accuracy,
which is calculated based on the overlap of the predicted
value and the correct label of object, same as IoU, but with a
different formula.
Similar to Mask R-CNN, in “TABLE IV”
U-Net_NonVietnam achieves better values when the amount
of training data is greater than that of U-Net_Vietnam.
Fig. 5. The Error of U-Net on the two datasets
TABLE IV. THE PARAMETERS EVALUATE THE ACCURACY OF U-
NET
Model IoU (0.5) Dice mAP
UNet_Vietnam 0.7284 0.8368 0.7924
UNet_NonVietnam 0.8302 0.9048 0.9269
C. Comparison and discussion
After the process of experimenting and evaluating Mask
R-CNN and U-Net models on two datasets of agricultural
areas in Vietnam and in other regions, we have highlighted
several observations and achieved high results in precision
experiments. It could be seen that the amount of data used in
training greatly affects the learning process of the models.
Apparently, the values of evaluation parameters on the
Vietnam data are always lower than on the NonVietnam data.
This is also affected by the quality of training data because
the sharpness of the Vietnam data is lower than that of the
NonVietnam data. Low resolution causes difficulty in
learning the attributes of identifiable objects on models and
easy confusion with other objects. However, the deviations in
the evaluation parameters are not high between the two
datasets when compared) in each model. It can be concluded
that deep learning models are completely consistent with
Vietnam agricultural areas and are not far less effective in
comparison with Western countries. In addition, our
experiment has shown that Mask R-CNN and U-Net can be
applied to solve agricultural area segmentation on satellite
images.
We selected the best two models during the training of
Mask R-CNN and U-Net to make a comparison of the
predicted results. As shown in “TABLE III” and “TABLE
IV”, we choose Mask_ NonVietnam at epoch 78 and U-
Net_NonVietnam at epoch 99. Different predicted images of
the models are listed in “Fig. 6, 7, 8” and “Fig. 9”.
In “Fig. 6”, the original image feature is Vietnam's
agricultural area. Mask R-CNN is more effective in
identifying and segmenting agricultural areas with similar
properties and blurred boundaries. However, the fractional
values of Mask R-CNN have not been highly accurate.
In “Fig. 7”, the original image feature is European
agricultural area (Russia). Mask R-CNN has once again
proved to be more efficient when the identification of
128
agricultural areas and zoning is relatively clear. For U-Net,
the segment values are still noise. However, the boundaries
of the objects on U-Net are proving to be more effective and
accurate than that of the Mask R-CNN.
In “Fig. 8”, the original image feature is the agricultural
area of the Americas, U-Net shows superiority in audience
segmentation, although there is still noise in a small green
area (right above). In contrast, this Mask R-CNN has shown
poor partition when the wrong partition caused many objects
and the mask value of the right object is not really accurate.
In “Fig. 9”, the characteristic of the original image shows
that there are many objects to identify, with many small
objects and relatively blurred boundaries. As a result, U-Net
and Mask R-CNN are both poor identity and partitioning. In
the U-Net model, although the model has segmented well
most areas of the fields in the image above, it has merged
several objects into one (right below) as the boundaries of the
objects are hard to recognize. However, in general, the
subjects labeled as agricultural areas are correctly identified
and segmented by U-Net. For the Mask R-CNN case, some
model agricultural area objects have not yet been identified
(left bottom) or have mistakenly identified the jamming
object (middle), and the results of the segment (mask) still
contain several mistakes. However, Mask R-CNN performs
well in partitioning the image into separate objects, without
segmenting multiple objects into one as by U-Net.
In many cases, U-Net segmentation predictions are more
accurate than these of Mask R-CNN when the boundaries of
the object are clearly defined. However, the boundary
determination of U-Net will be noisy if there are many
obstructions. For Mask R-CNN, the mask layer of Mask R-
CNN is ineffective and has no absolute accuracy in some
cases. In addition, by defining segmented objects as
individual mask layers (with different colors as above), the
predictions of Mask R-CNN will be more valuable in
practical applications than these of U-Net. In general,
agricultural area zoning on satellite imagery can be well
handled by both Mask R-CNN and U-Net models.
Fig. 6. a. Original image - b. U-Net’s prediction - c. Mask R-CNN’s
prediction - d. Mask R-CNN’s mask
Fig. 7. a. Original image - b. U-Net’s prediction - c. Mask R-CNN’s
prediction - d. Mask R-CNN’s mask
Fig. 8. a. Original image - b. U-Net’s prediction - c. Mask R-CNN’s
prediction - d. Mask R-CNN’s mask
 2020 7th NAFOSTED Conference on Information and
Computer Science (NICS)
Fig. 9. a. Original image - b. U-Net’s prediction - c. Mask R-CNN’s
prediction - d. Mask R-CNN’s mask
VI. CONCLUSION AND FUTURE WORK
In this paper, we experimented the two image
segmentation models (Mask-RCNN and U-Net) for
segmenting Vietnam's agricultural land. The experiment
using satellite image dataset which we extracted from Google
Map. It showed that the quality of the image affects the
effectiveness of the model. In the past, Unet was proposed to
use in the medical field, with high quality data. Therefore,
when training U-Net on the NonVietnam dataset whose
images are more high quality than on the Vietnam dataset, the
efficiency of U-Net is significantly improved when compare
with the Mask R-CNN's improvement. The models have
achieved high accuracy when applied to data of agricultural
areas in Vietnam and other regions of the world. This is
shown clearly through the values of the model evaluation
parameters. However, to be able to use the segment results of
the models in real-life applications, it is necessary to improve
the accuracy of the model's prediction.
In the future, we will process the predicted values of Mask
R-CNN by clearing false predictions, redefining inaccurate
predictions and adding missing ones. The combination of
model predictions and manual results will create an
absolutely accurate and reliable dataset. These data can
improve the training model, reduce the complexity of manual
data labeling and can be applied to remote sensing support
such as land area statistics, mapping, etc.
REFERENCES
[1] Satellite Imaging Corporation,
https://www.satimagingcorp.com/applications/natural-
resources/agriculture/, last accessed 2020/02/20.
[2] Planet, https://www.planet.com/markets/monitoring-for-precision-
agriculture/, last accessed 2020/02/20.
[3] Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X.,
Pietikäinen, M: Deep learning for generic object detection: A survey.
International Journal of Computer Vision vol 128, pp. 261-318.
Semanticscholar (2020).
[4] Dargan, S., Kumar, M., Ayyagari, M.R. et al: A Survey of Deep
Learning and Its Applications: A New Paradigm to Machine Learning.
Arch Computat Methods Eng (2019).
[5] Marktechpost,
https://www.marktechpost.com/2019/04/18/introduction-to-neural-
networks-advantages-and-applications/, last accessed 2020/02/20
[6] L. Jiao et al.: A Survey of Deep Learning-Based Object Detection: In
IEEE Access, vol. 7, pp. 128837-128868. IEEE (2019)
[7] Minaee, S., Boykov, Y., Porikli, F., Plaza, A., Kehtarnavaz, N.,
Terzopoulos, D., Image Segmentation Using Deep Learning: A Survey.
ArXiv, abs/2001.05566 (2020)
[8] Helber, P., Bischke, B., Dengel, A., & Borth, D.: EuroSAT: A Novel
Dataset and Deep Learning Benchmark for Land Use and Land Cover
Classification. IEEE Journal of Selected Topics in Applied Earth
Observations and Remote Sensing, vol 12, pp. 2217-2226 (2017).
[9] Chang, T., Rasmussen, B.P., Dickson, B.G., & Zachmann, L.J.:
Chimera: A Multi-Task Recurrent Convolutional Neural Network for
Forest Classification and Structural Estimation. Remote Sensing, vol
11 (7), pp.768 (2019).
129
[10] E. Charou: Deep Learning for Agricultural Land Detection in Insular
Areas. 10th International Conference on Information, Intelligence,
Systems and Applications (IISA), PATRAS, Greece, pp. 1-4. IEEE
(2019).
[11] Masoud, K.M.; Persello, C.; Tolpekin, V.A: Delineation of
Agricultural Field Boundaries from Sentinel-2 Images Using a Novel
Super-Resolution Contour Detector Based on Fully Convolutional
Networks. Remote Sens vol 12 (1), pp. 59 (2020).
[12] Yang, M.-D.; Tseng, H.-H.; Hsu, Y.-C.; Tsai, H.P: Semantic
Segmentation Using Deep Learning with Vegetation Indices for Rice
Lodging Identification in Multi-date UAV Visible Images. Remote
Sens vol 12, pp. 633 (2020).
[13] He, K., Gkioxari, G., Dollár, P., & Girshick, R.B.: Mask R-CNN. 2017
IEEE International Conference on Computer Vision (ICCV), pp. 2980-
2988 (2017).
[14] Zhang, W.; Witharana, C.; Liljedahl, A.K.; Kanevskiy, M. Deep
Convolutional Neural Networks for Automated Characterization of
Arctic Ice-Wedge Polygons in Very High Spatial Resolution Aerial
Imagery. Remote Sens, vol 10, pp. 1487 (2018)
[15] Chen, L., Xie, T., Wang, X., & Wang, C.: Identifying urban villages
from city-wide satellite imagery leveraging mask R-CNN. In: Ju Z.,
Yang L., Yang C., Gegov A., Zhou D. (eds) Advances in
Computational Intelligence Systems. UKCI 2019. Advances in
Intelligent Systems and Computing, vol 1043, pp 29. Springer, Cham
(2019).
[16] International Conf. on Computer Vision ICCV 2019,
http://cocodataset.org/workshop/coco-mapillary-iccv-2019.html, last
accessed 2020/02/20.
[17] Dai, J., He, K., & Sun, J.: Instance-Aware Semantic Segmentation via
Multi-task Network Cascades. 2016 IEEE Conference on Computer
Vision and Pattern Recognition (CVPR), pp. 3150-3158 (2015).
[18] Li, Y., Qi, H., Dai, J., Ji, X., & Wei, Y.: Fully Convolutional Instance-
Aware Semantic Segmentation. 2017 IEEE Conference on Computer
Vision and Pattern Recognition (CVPR), pp. 4438-4446 (2016).
[19] Ronneberger, O., Fischer, P., Brox, T.: U-Net: Convolutional Networks
for Biomedical Image Segmentation. In: Navab N., Hornegger J., Wells
W., Frangi A. (eds) Medical Image Computing and Computer-Assisted
Intervention – MICCAI 2015. MICCAI 2015. Lecture Notes in
Computer Science, vol 9351. Springer, Cham (2015)
[20] Fang, W., Fu, L., Zhang, M., & Li, Z.: Seismic data interpolation based
on U-Net with texture loss. ArXiv, abs/1911.04092 (2019).
[21] Chen, J., Viquerat, J., & Hachem, E.: U-Net architectures for fast
prediction of incompressible laminar flows. Semanticscholar(2019).
[22] Souza, R., Bento, M.P., Nogovitsyn, N., Chung, K., Lebel, R.M., &
Frayne, R.: Dual-domain Cascade of U-Nets for Multi-channel
Magnetic Resonance Image Reconstruction. ArXiv, abs/1911.01458
(2019).
[23] Iglovikov, V.I., & Shvets, A: TernausNet: U-Net with VGG11
Encoder Pre-Trained on ImageNet for Image Segmentation. ArXiv,
abs/1801.05746 (2018).
[24] Yi, Y., Zhang, Z., Zhang, W., Zhang, C., Li, W., Zhao, T.: Semantic
Segmentation of Urban Buildings from VHR Remote Sensing Imagery
Using a Deep Convolutional Neural Network. Remote Sen vol 11 (5),
pp. 1774 (2019).
[25] E. Charou: Deep Learning for Agricultural Land Detection in Insular
Areas: In 10th International Conference on Information, Intelligence,
Systems and Applications (IISA), pp. 1-4, PATRAS, Greece (2019).
[26] Stoian, A., Poulain, V., Inglada, J., Poughon, V., Derksen: D. Land
Cover Maps Production with High Resolution Satellite Image Time
Series and Convolutional Neural Networks: Adaptations and Limits for
Operational Systems. Remote Sens vol 11 (17), pp. 1986 (2019).
[27] Qadir, H., Shin, Y., Solhusvik, J., Bergsland, J., Aabakken, L.,
Balasingham, I.:Polyp Detection and Segmentation using Mask R-
CNN: Does a Deeper Feature Extractor CNN Always Perform Better?.
In 13th International Symposium on Medical Information and
Communication Technology (ISMICT), pp. 1-6 (2019).
[28] Minkesh, A., Worranitta, K., & Taizo, M.: Human Extraction and
Scene Transition utilizing Mask R-CNN. ArXiv, abs/1907.08884
(2019).
[29] Tiebiao Zhao; Yonghuan Yang; Haoyu Niu; Dong Wang; YangQuan
Chen: Comparing U-Net convolutional network with mask R-CNN in
the performances of pomegranate tree canopy segmentation.
Proceedings Volume 10780, Multispectral, Hyperspectral, and
Ultraspectral Remote Sensing Technology, Techniques and
Applications VII; 107801J (2018). SPIE Asia-Pacific Remote Sensing,
Honolulu, Hawaii, United States (2018).
[30] Dutta, A., Gupta, A., Zisserman, A.: VGG Image Annotator (VIA),
http://www.robots.ox.ac.uk/~vgg/software/via/, last accessed
2020/02/20.
[31] Hui, J.: mAP (mean Average Precision) for Object Detection,
https://medium.com/@jonathan_hui/map-mean-average-precision-
for-object-detection-45c121a31173, last accessed 2020/02/20.