Professional Documents
Culture Documents
Santosh Mirase Thesis
Santosh Mirase Thesis
Master of Technology
In
Computer Aided Structural Engineering
Submitted by
Santosh Gyanba Mirase
2023-2024
Declaration
i
We, hereby declare that the dissertation titled “computer vision based
structural identification for buildings” submitted herein has been carried out by us
in the Department of Civil Engineering of Wainganga College of Engineering and
Management, Nagpur. The work is original and has not been submitted earlier as a
whole or in part for the award of any degree / diploma at this or any other Institution /
University.
We also hereby assign to Wainganga College of Engineering and
Management, Nagpur all rights under copyright that may exist in and to the above
work and any revised or expanded derivatives works based on the work as mentioned.
Other work copied from references, manuals etc. are disclaimed.
SANTOSH G. MIRASE
Date:
ii
Certificate
External Examiner
III
INDEX
CHAPTER 1 – INTRODUCTION
1.1 Inspection and Monitoring for Infrastructure Assessment 4
1.2 Vision-Based Infrastructure Assessment 5
1.3 Assistive Technology 5
1.4 Objective 6
Abstract
With the increasing demand for improving the safety and resilience of
buildings in urban areas, there has been a growing interest in developing computer
vision-based approaches for structural identification of buildings. These approaches
utilize cameras or drones to capture images or videos of buildings for automated
identification of their structural properties, such as size, shape, and construction
materials. This review paper provides a comprehensive overview of the state-of-the-
art computer vision-based approaches for building structural identification. It covers
both traditional computer vision techniques and deep learning-based approaches, as
well as their applications, advantages, limitations, and challenges. The review also
includes performance evaluations of these approaches on real-world datasets. The
paper identifies several potential research directions for future development of
computer vision-based building structural identification. One of the most important is
the need to develop more accurate and robust algorithms that can handle diverse
building types, environmental conditions, and imaging modalities. Another important
direction is to integrate multi-modal data sources such as thermal imaging, LiDAR,
and acoustic sensors to enhance the accuracy and reliability of the identification
process. In addition, the paper highlights the importance of adopting explainable AI
techniques to improve the transparency and interpretability of the identification
results. Overall, the review concludes that computer vision-based approaches have a
significant potential to enhance the safety and resilience of buildings in urban areas by
providing more accurate, efficient, and cost-effective methods for identifying their
structural properties. However, further research is needed to address the challenges
and limitations of these approaches and to develop more advanced and effective
solutions.
V
LIST OF FIGURES
Figure.
Name of Figure Page No
No
Figure 1 Process of deformation monitoring 22
based on computer vision
Figure 2 Fully convolutional neural networks 23
(FCNs)
Figure 3 Framework for physics – based 24
graphics generation for automated
assessment using deep learning.
VI
LIST OF ACRONYMS
VII
CHAPTER 1
INTRODUCTION
1
1. Introduction
Bridges, tunnels, and trains are a few examples of the transportation infrastructure
systems that are crucial for national social production and growth. These
transportation infrastructures are put to the test in two main ways due to the
phenomenal growth of social productivity. In contrast, civil engineering structures,
including bridges, are subjected to a variety of external loads or disasters (such as fire
and earthquakes) during their service life, which in turn shortens the service life of the
structures. On the one hand, the tonnage and number of existing means of
transportation may exceed the design load-carrying capacity. Structural health
monitoring (SHM) has developed over the past two decades with the primary
objective of gathering the dynamic response of structures using sensors and then
reporting the data to assess the performance of the structures. The need for labor-
intensive and costly sensor network and data collecting system installation and
maintenance prevents their widespread use in actual engineering structures [1-2].
Currently, the sensors used for SHM can be broadly categorized as either contact
(such as linear variable differential transformers (LVDT), optical fibre sensors [3],
accelerometers, strain gauges, etc.) or non-contact (such as global positioning systems
(GPS) [4], laser barometers [5], total stations, and level computer vision–based
sensors). The GPS sensor is one of the available non-contact sensors that is simple to
instal, but it has a limited measurement precision (often between 5 and 10 mm) and
sample frequency (less than 20 Hz).The system composition, target tracking
algorithms, environmental influencing elements, and recent successes of computer
vision-based investigations in field environments are reviewed in this study. The
monitoring process, camera calibration techniques, feature extraction, and various
target tracking algorithms.
2
architects can obtain accurate and reliable data on a building's condition, which can
help them to identify potential safety hazards, plan maintenance and repair activities,
and optimize building performance [6]. Some of the key applications of computer
vision-based structural identification include earthquake damage assessment,
structural health monitoring, and quality control during construction. By leveraging
the power of computer vision, researchers and practitioners can unlock new insights
into the behavior and performance of buildings, leading to safer, more sustainable,
and more resilient structures.
4
This approach can significantly reduce the time and cost involved in assessing a
building's condition, particularly in hard-to-reach areas or areas with limited access.
Civil infrastructure condition assessment is a crucial process that involves the
inspection and/or monitoring of structures to ensure their safety, reliability, and
longevity. Traditional techniques for assessing the condition of civil infrastructure
often rely on visual inspection by trained inspectors, which can be time-consuming,
laborious, expensive, and dangerous. This approach can be particularly challenging in
hard-to-reach areas or areas with limited access, where inspection may be impossible
or impractical.
Assistive technology has the potential to play a significant role in improving the
accessibility and usability of these approaches for individuals with disabilities. For
instance, individuals with visual impairments may face challenges in analysing the
images or videos of buildings used in computer vision-based approaches. The use of
assistive technologies such as screen readers, tactile maps, and audio descriptions
could help to provide access to the information contained in these images or videos.
5
Screen readers can read the text in the images, while tactile maps can provide a three-
dimensional representation of the building that can be felt. Audio descriptions can
provide additional auditory information to complement the visual information in the
images or videos.
Moreover, assistive technologies such as wearable cameras or drones can be
utilized to capture images or videos of buildings from the perspective of individuals
with mobility impairments or in hard-to-reach areas, thus enhancing the availability
and diversity of data sources for computer vision-based approaches [12]. Wearable
cameras can be attached to a user's clothing or equipment to capture images or videos
from their point of view, while drones can capture images or videos from different
angles and perspectives. These additional data sources can provide more information
about the building's structural properties, which could lead to more accurate
identification and assessment of its condition.
1.4 OBJECTIVE:
Computer vision-based approaches for structural identification of buildings
use images or videos of buildings captured by cameras or drones to
automatically identify their structural properties.
The article provides a comprehensive review of the state-of-the-art computer
vision-based approaches for building structural identification, covering both
traditional computer vision techniques and deep learning-based approaches.
The review includes performance evaluations of these approaches on real-
world datasets.
The article identifies several potential research directions for future
development of computer vision-based building structural identification, such
as developing more accurate and robust algorithms, integrating multi-modal
data sources, and adopting explainable AI techniques.
6
There is a growing interest in developing computer vision-based approaches
for automated identification of the structural properties of buildings.
The objective of computer vision-based approaches is to provide more
accurate, efficient, and cost-effective methods for identifying the structural
properties of buildings.
7
CHAPTER 2
LITERATURE REVIEW
8
2.1 Literature Review
Computer vision-based structural identification for buildings is an emerging
field of research that aims to use computer vision techniques to identify the structural
properties of buildings. Several studies have proposed novel approaches for this,
including using video data and deep learning techniques to classify the structural
properties, and using convolutional neural networks to extract visual features from
images of buildings. Additionally, some studies have explored using computer vision
for damage detection and localization in buildings. These studies demonstrate the
potential of computer vision in identifying structural properties of buildings and
provide valuable insights into the challenges and future directions for this field.
The need for efficient small networks for lightweight tasks in computer vision, and a
pruning method based on feature representation was proposed as a solution by Yisu Ge
et al. [28]. The technique involved using a feature selection algorithm to identify
important features and then pruning the network based on those features. The result was
a small network that achieved similar performance to larger networks while using
significantly fewer resources.
Simulation system was needed for building structures based on BIM and computer
models. The technique used by Bao Zhu et al. [29] to integrate BIM technology and
computer models for building structure simulation. The result was a simulation system
that accurately represented the behavior of the building structure under different loads
and scenarios. The system can be used for structural design optimization and to evaluate
the safety of the building structure during construction and operation.
The need for a more efficient and accurate approach to recognizing suspicious activities
in smart cities. The technique used by Amjad Rehman et al. [31] was an internet-of-
things-based multimodal approach that combined computer vision with other sensors
and data sources. A neural network algorithm was employed to optimize positioning
and local obstacle avoidance. The results showed that the proposed approach was
16
effective in identifying and recognizing suspicious activities in real-time with high
accuracy.
Computer vision positioning and local obstacle avoidance optimization was addressed
using a neural network algorithm. The technique involved using a camera and a laser
range finder to capture real-time images addressed by Lei Yang et al. [32], and training
a neural network to recognize and avoid obstacles. The system was tested in a simulated
environment, and the results showed that it was able to accurately detect and avoid
obstacles in real-time.
The problem of identifying structural damage using noisy modal data was addressed in
the paper, and a combined modal correlation criterion was proposed. The proposed
technique involved the computation of the correlation between the identified damage-
sensitive mode shapes and the reference mode shapes suggested by Manolis
Georgioudakis, et al. [34]. The effectiveness of the proposed criterion was tested on a
simulated example of a damaged beam and an experimental example of a damaged truss
structure. The results demonstrated that the combined modal correlation criterion was
successful in identifying structural damage, even with the presence of noisy modal data.
The problem of determining the influential factors of building project cost in New
Zealand was addressed using a structural equation modelling approach. The technique
involved collecting data on various factors such as project scope, design complexity,
and construction material quality, and creating a model proposed by Linlin Zhao, et al.
[35], to determine their impact on project cost. The results showed that project scope
and design complexity were the most significant factors influencing project cost in New
Zealand.
17
The paper presented by Guofeng Ma, et al. [36], a technique for visualizing component
status information of prefabricated concrete buildings using building information
modeling (BIM) and radio frequency identification (RFID) technology. The technique
was applied in a case study in China to demonstrate its effectiveness in improving
building management and maintenance. The results showed that the integrated BIM and
RFID system was able to collect and process real-time data on the components of the
building, which can be used to optimize maintenance schedules and reduce costs. The
study demonstrated the potential of using BIM and RFID technology for improving
building management and maintenance.
The need for an automatic system for the design of assembly building components in
sustainable building projects. The technique used involved the use of Building
Information Modeling (BIM) technology proposed by Wenjing Wang et al. [37], to
generate digital models of the building components and a genetic algorithm to optimize
the design. The results showed that the proposed method was effective in generating
optimal designs for assembly building components while considering sustainability
factors. The automatic system was able to reduce design time and increase efficiency in
the design process.
The use of deep learning computer vision techniques for building load forecasting,
which is an important aspect of energy management in buildings. The technique used by
Ioannis Patsakos, et al. [38], in the study involved using deep learning algorithms, such
as convolutional neural networks (CNN) and long short-term memory (LSTM)
networks, to analyze building data and predict future load demand. The results showed
that deep learning techniques can outperform traditional methods, such as regression
analysis and time-series models, in accurately forecasting building load demand.
The prediction of supply chain costs for prefabricated building construction under
uncertainty. The technique used in the study suggested by Shaoli Wang et al. [39]
involved developing a prediction model based on the fuzzy set theory and Monte Carlo
simulation to account for the uncertainties in the supply chain. The results showed that
the proposed model was effective in predicting the supply chain costs and identifying
the factors that have the most significant impact on the costs. The study also provided
insights for the decision-makers in the construction industry to optimize the supply
chain management and reduce the costs.
18
The difficulty in selecting building flooring finishing materials due to the lack of a
systematic decision-making framework. The technique proposed by Mohamed A et al.
[40], in the study was the use of building information modeling (BIM) to integrate
various criteria, such as aesthetics, functionality, and cost, into a comprehensive
decision-making framework. The proposed framework was applied to a case study of a
residential building project, and the results showed that it was effective in providing a
systematic and efficient way to select building flooring finishing materials.
The paper discussed by Iván Garrido et al. [41] the problem of building assessment and
reviewed the applications of infrared thermography and ground-penetrating radar for
this purpose. The technique involved the use of non-destructive testing and evaluation
techniques to detect defects and anomalies in building components. The review showed
that IRT and GPR were effective in providing accurate and comprehensive information
on building conditions, allowing for early detection of defects and prevention of further
damage.
19
CHAPTER 3
METHODOLOGY
20
3.1 Methodology
The process of deformation monitoring based on computer vision methodology
involves several steps. Firstly, a camera network is set up around the structure to be
monitored, and the cameras are calibrated to ensure accurate measurement. The camera
network is typically composed of multiple cameras strategically placed around the
structure to provide full coverage. Secondly, images are captured at regular intervals
using the camera network. These images are then preprocessed to correct for distortions
and ensure that the images are properly aligned. This step is critical to ensure that
accurate measurements can be made [43]. Thirdly, computer vision techniques are used
to identify and track features on the structure, such as corners or edges. These features
are then tracked over time, and any changes in their position or shape are recorded. The
computer vision algorithms used to track the features must be accurate and robust to
ensure that accurate measurements are made. Fourthly, the data obtained from the image
analysis is processed and analyzed to determine the deformation of the structure. This
involves comparing the positions and shapes of the identified features over time to
determine any changes.
The data can be analyzed using various techniques, such as statistical analysis or
machine learning algorithms, to identify patterns and trends in the deformation [44].
Finally, the results of the deformation monitoring are presented in a clear and concise
manner, typically in the form of plots or graphs. These results can be used to inform
decisions about maintenance or repair of the structure and can help prevent catastrophic
failures.
21
Figure 1. Process of deformation monitoring based on computer vision.
22
tedious task. To address this issue, weakly supervised training has been proposed,
which can perform object detection and localization tasks without the need for pixel-
level or object-level labeling of images [46]. In this approach, a Convolutional Neural
Network (CNN) is trained using image-wise labels to identify the object category and
approximate location in the image. This method enables the CNN to learn from a
large number of images without the need for detailed labeling, thereby reducing the
burden on human annotators.
3.2 Generating synthetic labeled data using photorealistic physics based graphics
model
Physics-based graphics for automated assessment is to create a dataset of
graphics that can be used for assessing understanding of various physics concepts. To
collect the dataset, existing online resources that provide physics-based graphics can
be used. The dataset should be diverse and representative, covering a wide range of
concepts and difficulty levels [47]. Each graphic in the dataset should be labeled with
ground truth information, such as correct answers or explanations. Once the graphics
dataset has been collected, it needs to be preprocessed to prepare it for deep learning
algorithms. This may involve resizing, normalizing, and augmenting the graphics, as
well as converting them into a suitable format for deep learning algorithms. An
appropriate deep learning model for generating physics-based graphics needs to be
chosen. Depending on the specific problem statement and the type of graphics to be
generated, different models may be appropriate. For example, if diagrams need to be
generated, a convolutional neural network (CNN) may be suitable, while for
simulations or animations, a generative adversarial network (GAN) or a variational
auto encoder (VAE) may be better. D modeling, simulation, and rendering tools such
23
as Blender [48] can be used to better simulate real-world environmental effects.
Combined with deformed meshes from finite-element models, these tools can be used
to create graphics models of damaged structures. Understanding the damage condition
of a structure requires context awareness. For example, identical cracks at different
locations on the same structure could have different implications for the overall health
of a structure. Similarly, cracks in bridge columns must be treated differently than
cracks in a wall of a building. They proposed a novel framework (Fig. 24) using
physics-based models of structures to create synthetic graphics images of
representative damaged structures. The proposed framework has five main steps: 1 the
use of parameterized finite-element models to structurally model representative
structures of various shapes, sizes, and materials;2 nonlinear finite-element analysis to
identify structural hotspots on the generated models; 3 the application of material
graphic properties for realistic rendering of the generated model; 4 procedural damage
generation using hotspots from finite-element models; and 5 the training of deep
learning models for assessment using generated synthetic data [49].
The preprocessed dataset needs to be used to train the chosen deep learning model.
During training, the model learns to generate new physics-based graphics by
optimizing its parameters to minimize a loss function. The loss function measures the
difference between the generated graphics and the ground truth graphics in the
dataset. The performance of the deep learning model needs to be evaluated to assess
its performance. This can be done by generating new physics-based graphics and
comparing them to the ground truth graphics in the dataset [50]. Evaluation metrics
such as accuracy, precision, and recall can be used to measure the performance of the
model.
24
CHAPTER 4
TOOLS AND PLATFORM
25
4. Tools and platforms
4.1 OpenCV:
OpenCV provides a collection of algorithms and functions for image and video
processing. It includes various computer vision techniques, such as feature detection,
object detection, segmentation, and tracking. These techniques can be used for
structural identification of buildings by analyzing images or videos of buildings. For
example, feature detection can be used to detect key points or corners in an image that
represent the edges or corners of structural elements. Object detection can be used to
detect specific objects or elements in an image, such as windows or doors.
Segmentation can be used to separate an image into different regions based on their
properties, such as color or texture, which can help identify different materials or
components of a building.
4.2 TensorFlow:
TensorFlow is a machine learning framework that provides tools and libraries for
building and training deep learning models. It supports various neural network
architectures, such as convolutional neural networks (CNNs) and recurrent neural
networks (RNNs), which can be used for computer vision-based structural
identification of buildings. CNNs can be used for object detection and segmentation
tasks by learning to identify patterns or features in images that correspond to specific
objects or elements. RNNs can be used for time-series analysis of sensor data or video
streams to detect anomalies or changes in the behavior of a building.
4.3 MATLAB:
MATLAB provides a comprehensive set of functions and tools for image and video
processing, including computer vision and deep learning. It includes various image
enhancement, feature extraction, segmentation, and classification techniques that can
be used for structural identification of buildings. MATLAB also provides a graphical
user interface (GUI) for interactive image analysis and processing.
4.4 Pix4D:
Pix4D provides photogrammetry tools for generating 3D models of buildings from
images captured by drones or cameras. It uses photogrammetric principles, such as
triangulation and bundle adjustment, to reconstruct the 3D geometry of a building
from multiple images taken from different angles. The resulting 3D model can be
used for structural identification of buildings by analyzing its geometry and features.
26
4.5 DroneDeploy:
DroneDeploy provides a cloud-based platform for drone mapping and image
processing. It uses computer vision techniques, such as photogrammetry and structure
from motion (SfM), to generate 3D models of buildings from images captured by
drones. These models can be used for structural identification of buildings by
analyzing their geometry and features.
4.6 Autodesk ReCap:
Autodesk ReCap provides 3D scanning and photogrammetry tools for generating 3D
models of buildings. It uses laser scanning and photogrammetry techniques to capture
the geometry and texture of a building and generate a 3D model. The resulting model
can be used for structural identification of buildings by analyzing its geometry and
features.
4.7 OpenDroneMap:
OpenDroneMap is an open-source photogrammetry software that provides tools for
generating 3D models of buildings from images captured by drones. It uses similar
techniques as Pix4D and DroneDeploy to reconstruct the 3D geometry of a building
from multiple images taken from different angles. The resulting model can be used for
structural identification of buildings by analyzing its geometry and features.
27
CHAPTER 5
DESIGN AND IMPLEMENTATION
28
5. Design and implementation
5.1 Data collection:
The first step in designing a computer vision-based structural identification system for
buildings is to collect data. This typically involves capturing images or videos of the
building from multiple angles and viewpoints. There are several methods for
collecting data, including using drones, cameras, or other imaging devices. It is
important to ensure that all structural elements of the building are visible in the
images and that the data collected is of high quality.
5.4 Segmentation:
Once the features are detected, the next step is to segment the image into different
regions based on the properties of the features. This is typically done to separate the
structural elements from other objects in the image, such as trees or vehicles.
Segmentation can be done using techniques such as color-based segmentation or
texture-based segmentation. MATLAB, OpenCV, and Python libraries such as scikit-
image are popular tools for segmentation.
5.5 3D reconstruction:
29
The segmented images can then be used to reconstruct a 3D model of the building.
This step involves converting the 2D images into a 3D representation of the building.
Photogrammetry tools such as Pix4D, DroneDeploy, or Autodesk ReCap are popular
for this step. These tools use algorithms to generate a point cloud from the images,
which can then be used to create a 3D model. The 3D model provides a detailed
representation of the building's geometry and structure.
5.6 Visualization:
The final step is to visualize the results of the analysis in a user-friendly format. This
step involves creating 3D visualizations of the building and the analysis results. Tools
such as Jupyter notebook, and MATLAB's built-in visualization tools can be used to
create these visualizations. The visualization can help stakeholders understand the
structural condition of the building and make informed decisions about maintenance
and repair.
30
CHAPTER 6
RESULTS AND ANALYSIS
31
6.1 Result and Analysis
The displacement outcomes at the measurement point for all experiments. All data
sets measured by LVDT and the proposed vision-based approach have sample
rates of 30 Hz. Both the suggested vision-based approach and the raw
displacement data from the LVDT are synced and shown in each graph in a
experiments vary, it is clear that the displacement values calculated using the non-
target vision-based technique and the LVDT sensor data exhibit a strong
correlation. As demonstrated in the insets, every peak of the vibration data clearly
confirms this fact. The correlation coefficient factors are used to assess the
correlation behavior between two datasets ( ) are calculated for each experiment
squared) factor is calculated to assess how closely the two datasets correspond.
ρ=
|∑ i ( d L ( i )−μ d ) × ( dV ( i )−μ d
I II
)|
√
(1)
∑ ( d L ( i )−μ a )2 √∑ ( dV ( i )−u a )2
L V
1 1
Where dL and dv are the dynamic displacement values obtained using the proposed
vision-based technique and the LVDT sensor's raw data, respectively, after filtering
out the static component; and 𝜇𝑑𝐿 and 𝜇𝑑𝑣 are the mean values of two above datasets.
The values of vary from 0.0 to 1.0; and shows perfect correlation
whereas shows that there is no link between the two datasets.
32
2
R =1−
∑ i ( r V ( i )−r L ( i ) )
2
∑ (r V (i )−μ r ) V
I
Where rL and rv are the raw displacement values obtained by the LVDT and
proposed vision-based method, respectively; and 𝜇𝑟𝑣 is the mean value of the raw
dataset determined by the proposed method. The values of R is from 0.0 to 1.0;
and the R value of 1.0 implies the perfect similarity between two datasets.
classical sensor and a new vision-based method are described in Table 3. As seen
in Table 3, maximum and minimum static displacements of the bridge model are
consistent from Test 1 to 5 based on the responses from the same small-scale
vehicle weight (12.3 kg). However, the lighter weight vehicle (5.3 kg) being
displacement amplitudes is similar to the weight ratio. It is also seen that the
correlation coefficient
values (from 0.9987 to 0.9998) are close to 1.000, which indicate a very high
correlation and similarity between the two compared datasets. Hence, the
33
Vision-based
LVDT Error
Method
Corr. R-
Max Min Max Min Max Min
(ρ) squared
Disp.a Disp.a Disp.a Disp.a Disp.a Disp.a
CHAPTER 7
CONCLUSION AND FUTURE SCOPE
35
7.1 Conclusion
Computer vision-based structural identification is an emerging technology that
uses artificial intelligence to analyze images and videos of buildings to assess their
health and integrity. This technology has the potential to revolutionize the way we
evaluate and maintain buildings, providing valuable insights into a structure's overall
condition without the need for invasive testing. One of the main benefits of computer
vision-based structural identification is that it can be used in real-time, allowing
engineers and inspectors to quickly and accurately assess a building's condition. This
is particularly useful in emergency situations, such as earthquakes or other natural
disasters, where time is of the essence. By using computer vision algorithms to
analyze images and videos, engineers can quickly identify areas of damage and
prioritize repairs to ensure the safety of building occupants.Another advantage of
computer vision-based structural identification is that it can be used to monitor
buildings over time. By collecting and analyzing data on a structure's condition over
months or years, engineers can gain a better understanding of how the building is
aging and whether any maintenance or repairs are needed. This information can be
used to develop more effective maintenance and repair plans, helping to extend the
life of the building and ensure the safety of its occupants.
Another advantage of computer vision-based structural identification is that it
can be used to monitor buildings over time. By collecting and analyzing data on a
structure's condition over months or years, engineers can gain a better understanding
of how the building is aging and whether any maintenance or repairs are needed. This
information can be used to develop more effective maintenance and repair plans,
helping to extend the life of the building and ensure the safety of its occupants.
36
7.2 Future scope
One area of potential growth is the use of drones for building inspections.
Drones equipped with high-resolution cameras and computer vision algorithms can
quickly and accurately analyze a building's condition from all angles, including hard-
to-reach areas. This can save time and reduce the need for workers to physically
inspect the building, reducing the risk of accidents and injuries. Another area of
growth is the use of machine learning algorithms to improve the accuracy and
reliability of computer vision-based structural identification. By training the
algorithms on large datasets of images and videos of buildings, engineers can improve
the algorithms' ability to identify anomalies and detect damage. The integration of
computer vision-based structural identification with other technologies, such as
sensors and internet of things (IoT) devices, is also a promising area of growth. By
combining data from multiple sources, engineers can gain a more comprehensive
understanding of a building's condition and develop more effective maintenance and
repair plans.
Finally, the use of virtual and augmented reality technologies in building
analysis is also a promising area of growth. By creating virtual models of buildings
and overlaying them with data from computer vision-based structural identification,
engineers can gain a better understanding of a building's condition and identify
potential issues before they become more serious.
37
Reference
1. J. Chinna Babu, M. Sandeep Kumar, Prabhu Jayagopal, V. E. Sathishkumar,
Sukumar Rajendran, Sanjeev Kumar, Alagar Karthick, Akter Meem Mahseena,
"IoT-Based Intelligent System for Internal Crack Detection in Building Blocks",
Journal of Nanomaterials, vol. 2022, Article ID 3947760, 8 pages, 2022.
https://doi.org/10.1155/2022/3947760
2. Haijun Liang, Xiaofeng Guo, Tao Gao, Lingbao Wang, Xianbiao Bu,
"Performance Analysis of Single-Well Enhanced Geothermal System for Building
Heating", The Scientific World Journal, vol. 2020, Article ID 7927052, 8 pages,
2020. https://doi.org/10.1155/2020/7927052
3. Hui Liu, Qianqian Ju, Na Zhao, Hujun Li, Miroslaw J. Skibniewski, "Value
Proposition for Enabling Construction Project Innovation by Applying Building
Information Modeling", Computational Intelligence and Neuroscience, vol. 2022,
Article ID 2586307, 13 pages, 2022. https://doi.org/10.1155/2022/2586307
4. Meng Ran, Jian Dong, "A Multiobjective Optimization Algorithm for Building
Interior Design and Spatial Structure Optimization", Mobile Information Systems,
vol. 2022, Article ID 5659280, 15 pages, 2022.
https://doi.org/10.1155/2022/5659280
5. Grigore Stamatescu, Ioana Făgărăşan, Anatoly Sachenko, "Sensing and Data-
Driven Control for Smart Building and Smart City Systems", Journal of Sensors,
vol. 2019, Article ID 4528034, 3 pages, 2019.
https://doi.org/10.1155/2019/4528034
6. Yunbing Liu, "Research on Nonlinear Time Series Processing Method for
Automatic Building Construction Management", Journal of Control Science and
Engineering, vol. 2022, Article ID 7025223, 6 pages, 2022.
https://doi.org/10.1155/2022/7025223
7. Tsenguun Ganbat, Heap-Yih Chong, Pin-Chao Liao, You-Di Wu, "A Bibliometric
Review on Risk Management and Building Information Modeling for
38
International Construction", Advances in Civil Engineering, vol. 2018, Article ID
8351679, 13 pages, 2018. https://doi.org/10.1155/2018/8351679
8. Dongfang Zhang, Hui Ji, Zhennan Li, Hui Ge, "Design of Building Environment
Detection System for Architectures Based on Internet of Things", Computational
Intelligence and Neuroscience, vol. 2022, Article ID 5438305, 11 pages, 2022.
https://doi.org/10.1155/2022/5438305
9. Suhan Qin, "Hierarchical Strategies for Building Multiethnic Communities from
the Perspective of Data Mining Analysis", Mobile Information Systems, vol.
2022, Article ID 7506323, 10 pages, 2022. https://doi.org/10.1155/2022/7506323
10. Jose Daniel Cuellar Lobo, Zhen Lei, Hexu Liu, Hong Xian Li, SangHyeok Han,
"Building Information Modelling- (BIM-) Based Generative Design for Drywall
Installation Planning in Prefabricated Construction", Advances in Civil
Engineering, vol. 2021, Article ID 6638236, 16 pages, 2021.
https://doi.org/10.1155/2021/6638236
11. Xi Zhang, "Machine Learning-Based Psychology Evaluation of College Students
for Building Innovative Health Service System", Journal of Environmental and
Public Health, vol. 2022, Article ID 6302756, 7 pages, 2022.
https://doi.org/10.1155/2022/6302756
12. Lianying Li, Xi Chen, Lianchao Li, "A Method for Extracting Building
Information from Remote Sensing Images Based on Deep Learning",
Computational Intelligence and Neuroscience, vol. 2022, Article ID 9968665, 10
pages, 2022. https://doi.org/10.1155/2022/9968665
13. Quan, R., Dong, X., Wu, Y., Zhu, L., & Yang, Y. (2019). Auto-ReID: Searching
for a Part-Aware ConvNet for Person Re-Identification. 2019 IEEE/CVF
International Conference on Computer Vision (ICCV).
doi:10.1109/iccv.2019.00385
14. Xiangyang Xue, Wei Zhang, Jie Zhang, Bin Wu, Jianping Fan, & Yao Lu. (2011).
Correlative multi-label multi-instance image annotation. 2011 International
Conference on Computer Vision. doi:10.1109/iccv.2011.6126300
15. Ding, L., Elliethy, A., Freedenberg, E., Wolf-Johnson, S. A., Romphf, J.,
Christensen, P., & Sharma, G. (2016). Comparative analysis of homologous
buildings using range imaging. 2016 IEEE International Conference on Image
Processing (ICIP). doi:10.1109/icip.2016.7533187
16. Tao Liu, Yu Lei, Yibing Mao, "Computer Vision-Based Structural Displacement
Monitoring and Modal Identification with Subpixel Localization Refinement",
39
Advances in Civil Engineering, vol. 2022, Article ID 5444101, 11 pages, 2022.
https://doi.org/10.1155/2022/5444101
17. Athanasios Voulodimos, Nikolaos Doulamis, Anastasios Doulamis, Eftychios
Protopapadakis, "Deep Learning for Computer Vision: A Brief Review",
Computational Intelligence and Neuroscience, vol. 2018, Article ID 7068349, 13
pages, 2018. https://doi.org/10.1155/2018/7068349
18. Diego Lozano, Ángel Martín, Miguel A. Serrano, Carlos López-Colina, "Design
of Flexible Structural System for Building Customization", Advances in Civil
Engineering, vol. 2019, Article ID 2103830, 18 pages, 2019.
https://doi.org/10.1155/2019/2103830
19. Yizhong Zhang, "Deep Learning Distributed Architecture Design Implementation
for Computer Vision", Wireless Communications and Mobile Computing, vol.
2022, Article ID 9726286, 10 pages, 2022. https://doi.org/10.1155/2022/9726286
20. Felipe Muñoz-La Rivera, Juan Carlos Vielma, Rodrigo F. Herrera, Jorge Carvallo,
"Methodology for Building Information Modeling (BIM) Implementation in
Structural Engineering Companies (SECs)", Advances in Civil Engineering, vol.
2019, Article ID 8452461, 16 pages, 2019. https://doi.org/10.1155/2019/8452461
21. Li Zhang, Chee Peng Lim, Jungong Han, "Complex Deep Learning and
Evolutionary Computing Models in Computer Vision", Complexity, vol. 2019,
Article ID 1671340, 2 pages, 2019. https://doi.org/10.1155/2019/1671340
22. Lianchao Jin, Fuxiao Tan, Shengming Jiang, "Generative Adversarial Network
Technologies and Applications in Computer Vision", Computational Intelligence
and Neuroscience, vol. 2020, Article ID 1459107, 17 pages, 2020.
https://doi.org/10.1155/2020/1459107
23. Yingbo Ji, Zihao Zhao, Fuyi Yao, Hong Xian Li, Yanyao Li, Xiaoyun Du,
"Factors Influencing Sleeve Grouting Quality for Prefabricated Building: An
Interpretive Structural Modeling Approach", Advances in Civil Engineering, vol.
2021, Article ID 5598424, 15 pages, 2021. https://doi.org/10.1155/2021/5598424
24. Hiromichi Hagihara, Naoto Ienaga, Daiki Enomoto, Shuhei Takahata, Hiroyuki
Ishihara, Haruka Noda, Koji Tsuda, Kei Terayama, "Computer Vision-Based
Approach for Quantifying Occupational Therapists’ Qualitative Evaluations of
Postural Control", Occupational Therapy International, vol. 2020, Article ID
8542191, 9 pages, 2020. https://doi.org/10.1155/2020/8542191
25. Xudong Jian, Ye Xia, Jose A. Lozano-Galant, Limin Sun, "Traffic Sensing
Methodology Combining Influence Line Theory and Computer Vision Techniques
40
for Girder Bridges", Journal of Sensors, vol. 2019, Article ID 3409525, 15 pages,
2019. https://doi.org/10.1155/2019/3409525
26. Houyao Zhu, Zicong Chen, Jianhui Wang, Yunchang Huang, Wenli Chen, Zheng
Huang, Huaqi Zhao, "Fuzzy Adaptive Compensation Control for Uncertain
Building Structural Systems by Sliding-Mode Technology", Complexity, vol.
2018, Article ID 9801240, 6 pages, 2018. https://doi.org/10.1155/2018/9801240
27. Tatjana Vilutiene, Diana Kalibatiene, M. Reza Hosseini, Eugenio Pellicer,
Edmundas Kazimieras Zavadskas, "Building Information Modeling (BIM) for
Structural Engineering: A Bibliometric Analysis of the Literature", Advances in
Civil Engineering, vol. 2019, Article ID 5290690, 19 pages, 2019.
https://doi.org/10.1155/2019/5290690
28. Yisu Ge, Shufang Lu, Fei GAO, "Small Network for Lightweight Task in
Computer Vision: A Pruning Method Based on Feature Representation",
Computational Intelligence and Neuroscience, vol. 2021, Article ID 5531023, 12
pages, 2021. https://doi.org/10.1155/2021/5531023
29. Bao Zhu, Huan Feng, "Building Structure Simulation System Based on BIM and
Computer Model", Journal of Sensors, vol. 2021, Article ID 8244582, 10 pages,
2021. https://doi.org/10.1155/2021/8244582
30. Zuesheng Qian, Mianjie Wang, Xinyue Wang, Yihang Wang, Weihui Dai,
"Intelligent Method for Real-Time Portable EEG Artifact Annotation in
Semiconstrained Environment Based on Computer Vision", Computational
Intelligence and Neuroscience, vol. 2022, Article ID 9590411, 14 pages, 2022.
https://doi.org/10.1155/2022/9590411
31. Amjad Rehman, Tanzila Saba, Muhammad Zeeshan Khan, Robertas
Damaševičius, Saeed Ali Bahaj, "Internet-of-Things-Based Suspicious Activity
Recognition Using Multimodalities of Computer Vision for Smart City Security",
Security and Communication Networks, vol. 2022, Article ID 8383461, 12 pages,
2022. https://doi.org/10.1155/2022/8383461
32. Lei Yang, Weimin Lei, "Computer Vision Positioning and Local Obstacle
Avoidance Optimization Based on Neural Network Algorithm", Computational
Intelligence and Neuroscience, vol. 2022, Article ID 3061910, 11 pages, 2022.
https://doi.org/10.1155/2022/3061910
33. Zhiguo Wang, Wei Wang, "Application of Computer Vision and Sensor
Technology in Multivariate Assessment of Ecological Environment Carrying
41
Capacity", International Transactions on Electrical Energy Systems, vol. 2022,
Article ID 5087610, 8 pages, 2022. https://doi.org/10.1155/2022/5087610
34. Manolis Georgioudakis, Vagelis Plevris, "A Combined Modal Correlation
Criterion for Structural Damage Identification with Noisy Modal Data", Advances
in Civil Engineering, vol. 2018, Article ID 3183067, 20 pages, 2018.
https://doi.org/10.1155/2018/3183067
35. Linlin Zhao, Bill Wang, Jasper Mbachu, Zhansheng Liu, "New Zealand Building
Project Cost and Its Influential Factors: A Structural Equation Modelling
Approach", Advances in Civil Engineering, vol. 2019, Article ID 1362730, 15
pages, 2019. https://doi.org/10.1155/2019/1362730
36. Guofeng Ma, Jun Jiang, Shanshan Shang, "Visualization of Component Status
Information of Prefabricated Concrete Building Based on Building Information
Modeling and Radio Frequency Identification: A Case Study in China", Advances
in Civil Engineering, vol. 2019, Article ID 6870507, 13 pages, 2019.
https://doi.org/10.1155/2019/6870507
37. Wenjing Wang, "Automatic System Design of Assembly Building Components
for Sustainable Building Projects Based on BIM Technology", Mathematical
Problems in Engineering, vol. 2022, Article ID 4902862, 11 pages, 2022.
https://doi.org/10.1155/2022/4902862
38. Ioannis Patsakos, Eleni Vrochidou, George A. Papakostas, "A Survey on Deep
Learning for Building Load Forecasting", Mathematical Problems in Engineering,
vol. 2022, Article ID 1008491, 25 pages, 2022.
https://doi.org/10.1155/2022/1008491
39. Shaoli Wang, Yasir Mursalin, Gang Lin, Conghua Lin, "Supply Chain Cost
Prediction for Prefabricated Building Construction under Uncertainty",
Mathematical Problems in Engineering, vol. 2018, Article ID 4580651, 5 pages,
2018. https://doi.org/10.1155/2018/4580651
40. Mohamed A. Al Rahhal Al Orabi, Khalid S. Al-Gahtani, "A Framework of
Selecting Building Flooring Finishing Materials by Using Building Information
Modeling (BIM)", Advances in Civil Engineering, vol. 2022, Article ID 8556714,
22 pages, 2022. https://doi.org/10.1155/2022/8556714
41. Iván Garrido, Mercedes Solla, Susana Lagüela, Mezgeen Rasol, "Review of
InfraRed Thermography and Ground-Penetrating Radar Applications for Building
Assessment", Advances in Civil Engineering, vol. 2022, Article ID 5229911, 20
pages, 2022. https://doi.org/10.1155/2022/5229911
42
42. Zhimin Wang, Jin Liu, "A Seven-Dimensional Building Information Model for
the Improvement of Construction Efficiency", Advances in Civil Engineering, vol.
2020, Article ID 8842475, 17 pages, 2020. https://doi.org/10.1155/2020/8842475
43. Bo Wang, Wenhao Shi, Qing Wu, Xun Xi, Shangtong Yang, "Fly Ash/Silica
Fume Coral Concrete with Modified Polypropylene Fiber for Sustainable Building
Construction", Advances in Civil Engineering, vol. 2022, Article ID 4230801, 14
pages, 2022. https://doi.org/10.1155/2022/4230801
44. Lixiang Wang, "Construction of 3D Reconstruction System for Building
Construction Scenes Based on Deep Learning and IoT", Wireless
Communications and Mobile Computing, vol. 2022, Article ID 5413473, 8 pages,
2022. https://doi.org/10.1155/2022/5413473
45. Heng Wang, Wenai Shen, Hongping Zhu, Hui Luo, "Stochastic Optimization of a
Nonlinear Base Isolation System with LRB and EIMD for Building Structures",
Structural Control and Health Monitoring, vol. 2023, Article ID 8392421, 17
pages, 2023. https://doi.org/10.1155/2023/8392421
46. Gen Li, Haining Tian, "Mapping Knowledge Domain to Analyze the Building
Information Modeling on Building Energy Saving Based on Visualized Analysis
Method", Advances in Civil Engineering, vol. 2023, Article ID 5159067, 10
pages, 2023. https://doi.org/10.1155/2023/5159067
47. Roberto G. Citarella, Filippo Berto, Paulo M. S. T. de Castro, "Modelling and
Optimizing Structural Behavior of Advanced Materials for Aerospace",
International Journal of Aerospace Engineering, vol. 2018, Article ID 6296145, 2
pages, 2018. https://doi.org/10.1155/2018/6296145
48. Haiman Xu, "An Intelligent Optimization for Building Design Based on BP
Neural Network and SPEA-II Multiobjective Algorithm", Computational
Intelligence and Neuroscience, vol. 2022, Article ID 3667187, 11 pages, 2022.
https://doi.org/10.1155/2022/3667187
49. Mohammed Iqbal, Omar Said, Ola Ibrahim, Ashraf Soliman, "Visual Sequelae of
Computer Vision Syndrome: A Cross-Sectional Case-Control Study", Journal of
Ophthalmology, vol. 2021, Article ID 6630286, 16 pages, 2021.
https://doi.org/10.1155/2021/6630286
50. Xiaobo Liu, Junya Yan, Yuxin Zhang, "Research on Multitarget Detection and
Intelligent Tracking Technology Based on Computer Vision", Mobile Information
Systems, vol. 2022, Article ID 4864604, 9 pages, 2022.
https://doi.org/10.1155/2022/4864604
43
44