Alexandria Engineering Journal (2021) xxx, xxx–xxx

H O S T E D BY
Alexandria University

Alexandria Engineering Journal

www.elsevier.com/locate/aej
www.sciencedirect.com

Virtual reality scene modeling in the context of

Internet of Things
Chufeng Huang a, Wen Zhang a,*, Liang Xue a,b

a
School of Academy of Fine Arts, Guangdong University of Education, Guangzhou 510800, China
b
SInstitute of Data Science, City University of Macau, Macau

Received 23 September 2021; revised 18 October 2021; accepted 4 November 2021

KEYWORDS Abstract The Internet and the Internet of Things (IoT) connect the world inside and outside the
Internet of Things; network through online and offline communication, which forms the original single network virtual
Virtual Reality Scene; platform. The integration of IoT, virtual reality and artificial intelligence can provide intelligent
Information Sharing System; WebVR interaction for various application fields. However, we need to solve the problems of data
Data Collection; lightweight, real-time data transmission based on the IoT, and visualization of scene data on the
Business Integration Web. This paper uses the IoT and virtual reality technology to propose a virtual reality scene mod-
eling method based on the IoT platform, as well as the database dynamic loading management
method and device of the virtual reality system, which includes building the database, storing the
involved data structures for various scenes and functions in the virtual reality system. The time–
space IoT engine is connected with the integrated service sharing center. The IoT platform collects
data through the IoT sensor system and provides support for the application platform through the
integrated service sharing center. The proposed method can meet the needs of large-scale data
acquisition and modeling, shorten the loading time, improve the efficiency, and save the wasted
computing resources and memory.
Ó 2021 THE AUTHORS. Published by Elsevier BV on behalf of Faculty of Engineering, Alexandria
University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/
licenses/by-nc-nd/4.0/).

1. Introduction according to the agreed protocol, carries out information

exchange and communication, so as to realize intelligent iden-
The IoT refers to a kind of network that connects any item tification, positioning, tracking, monitoring and management
with the Internet through information sensing equipment [1]. Industry is an important application field of IoT. All kinds
of terminals with environmental awareness, computing mode
based on ubiquitous technology and mobile communication
Abbreviations: IoT, Internet of Things; VR, Virtual Reality; M2M, are continuously integrated into all aspects of industrial pro-
Machines and Machines; QoE, Quality of Experience; QoS, Quality of duction, which can greatly improve manufacturing efficiency,
Service improve product quality, reduce product cost and resource
* Corresponding author.
consumption, promote traditional industry to a new stage of
E-mail address: zhangwen@gdei.edu.cn (W. Zhang).
intelligent industry, and form a new intelligent manufacturing
Peer review under responsibility of Faculty of Engineering, Alexandria
mode system [2]. With the continuous development of IoT,
University.
https://doi.org/10.1016/j.aej.2021.11.022
1110-0168 Ó 2021 THE AUTHORS. Published by Elsevier BV on behalf of Faculty of Engineering, Alexandria University.
This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
Please cite this article in press as: C. Huang et al., Virtual reality scene modeling in the context of Internet of Things, Alexandria Eng. J. (2021), https://doi.org/
10.1016/j.aej.2021.11.022
2 C. Huang et al.
there are more and more products and services in our life to
achieve online virtualization. At the same time, with the devel-
opment of the Internet, there is its extension field of Internet of
things technology [3]. After the Internet has occupied the vir-
tual world, IoT as an extension of the virtual world has entered
the real world of our lives, thus playing a bridge role between
the virtual world and the real world [4].
At present, with the rapid development of the Internet of
things, there are also many problems, such as insufficient open
and sharing of data, not wide application fields, insufficient
development and utilization of data resources, serious disorder
abuse, etc. In the process of building a unified cloud platform,
there are a lot of equipment and equipment data information
management difficulties. Therefore, it is necessary to build a
unified platform for managing equipment and data [5]. Virtual
Reality (VR) refers to the artificial creation of a three-
dimensional environment with the help of computer system
and sensor technology. In this artificial three-dimensional envi-
ronment, every object, including the user himself, has a posi-
tion and posture relative to the system coordinate system.
The scene that the user sees is determined by the user’s position
and the direction of the head (eyes) [6]. Virtual reality creates a
new state of human–computer interaction, which brings more
real and immersive experience by mobilizing all users’ senses
(vision, hearing, touch, smell, etc.), and is widely used in
games, news media, social networking, sports events, movies,
urban planning, real estate and other fields [7]. The use of vir-
tual reality technology can realistically simulate the effect of
building planning [8,9]. By modifying the building height, the
material and color of the building facade, the speed and qual-
ity of the scheme design are accelerated, the scheme design is
improved, and a lot of funds are saved. Virtual reality technol-
ogy enables the planning department to see the planning effect
in real time and better grasp the architectural state of the plan-
ning area [10]. However, for the complex structure of the target
space, drawing point by point in the computer, the workload is
too large, it is not easy to realize the virtual reality scene
[11,12].
Based on the IoT and cloud computing theory, this paper
analyzes the design, operation and user experience of the exist-
ing network virtual scene, and discusses the layout of the vir-
tual scene information interface. Firstly, the development
and current situation of virtual scene and Internet of things
technology are analyzed, and then the specific application of
Internet of things technology in real scene operation task mod-
ule is summarized. Secondly, according to the user’s operation
model of virtual scene, the user interface information is
arranged reasonably. Finally, the interface information layout
is matched with the task module in the real scene to get
through the online and offline real-time interaction process,
so as to establish the real-time interaction experience model
of online virtual scene and offline real scene.
The specific contributions of this paper include:
(1) This paper realizes the construction of the IoT platform
in the unified cloud platform, so as to effectively manage
the virtual equipment and data through the Internet of
things platform, and through the Internet of things plat-
form, the collected data will be sent to the application
layer after fusion processing, which can provide timely
support for the application layer.
(2) This paper proposes a virtual reality information shar-
ing system based on the IoT, which can realize the safe
sharing of information and ensure the information secu-
rity. Through the permission setting, different permis-
sions are set for different users. Users with different
permissions can only share the information within the
user’s permissions, while users with ordinary permis-
sions can’t share the high-level data information, which
can realize the information sharing Information sharing
is very convenient.
(3) A new method and device for dynamic loading manage-
ment of database in virtual reality system are proposed.
(4) This paper provides a display method of virtual reality
VR scene, which solves the problem that the existing dis-
play settings can only simply interact with the VR space,
and reduce the user’s sense of experience, and the scope
of application is low.
The rest of this paper is organized as follows. Section 2 dis-
cusses related work, followed by the creation of virtual scene in
Internet of things in Section 3. The multi-virtual terminal selec-
tion based on Internet of things is discussed in Section 4. Sec-
tion 5 shows the design of virtual reality scene modeling
scheme in the environment of Internet of things, and Section 6
concludes the paper with summary and future research
directions.
2. Related work
IoT is a new and promising technology, which processes some
devices interacting through the Internet, so as to ensure that
the wearable devices, sensors, mobile phones and other intelli-
gent terminals can be connected to intelligent nodes with
mutual communication ability [13,14]. The IoT connects ‘‘ob-
jects” and realizes communication between Machines and
Machines (M2M), which means that data communication
between heterogeneous devices can be conducted without
human intervention [15,16].
In view of the latest progress of ubiquitous computing tech-
nology, there are many IoT applications in different environ-
ments, which are expected to improve and improve the daily
life quality of users, such as smart families, smart cities, intel-
ligent industry and intelligent medical treatment. These appli-
cations have different characteristics, and they also have
different time delay and data rate requirements [17,18]. How-
ever, it is precisely because of the above characteristics of
IoT services that make the current Internet of things services
and applications also face a series of challenges [19,20]. The
existing IoT applications are usually oriented to specific indus-
tries, with single and independent functions, and different
application industries have different information transmission
and processing methods, and there are problems such as
resource reuse difficulties and data inconsistency [21,22]. In
other words, most IoT applications do not have flexibility
and adaptability, and efficient data interaction is difficult to
realize between different IoT application systems, which makes
it difficult to coordinate and cooperate effectively among these
relatively independent application systems [23,24]. Therefore,
it is an important idea to build a general equipment resource
management and service platform for IoT in the future, shield
the differences between different systems, provide unified ser-
Virtual reality scene modeling in the context of Internet of Things
vice interface for application layer and support multi-level
semantic support system. With the birth of IoT applications
in many new fields, some applications have strict requirements
for network delay and reliability [25].
In view of these requirements, mobile edge computing is off
loading seems to be a feasible solution [26,27]. By deploying
edge gateway in the environment, computing tasks in terminal
are unloaded to edge gateway, which greatly reduces the pro-
cessing delay of tasks and energy consumption of Internet of
things devices, thus improving Quality of Service (QoS) of net-
work and Quality of Experience (QoE) of users [28]. In addi-
tion, because many communication devices in IoT are used
for low-power operation and require a larger communication
range, it is necessary to deploy the base station reasonably to
expand the coverage. With the continuous development of
IoT technology, related applications and services have gradu-
ally entered our lives [29]. With the development of IoT intel-
ligent service system, it has become the focus of domestic and
international research [30,31]. However, most of the IoT appli-
cations are relatively independent, with single functions, and
different application industries have different information
transmission and processing methods. There are problems of
data inconsistency and resource reuse between application sys-
tems, and lack of linkage mechanism of interconnection.
Therefore, it is very important to provide a unified IoT equip-
ment resource management platform to shield the heterogene-
ity of application subsystems.
The core technical idea of the IoT is to realize ubiquitous
intelligent services based on collaborative fusion virtual net-
work. Since the concept of IoT was put forward, the intelligent
service of Internet of things in virtual environment has gradu-
ally become the focus of research at home and abroad. It is the
key of intelligent services of IoT to describe the functions of
various devices in the environment of Internet of things, and
then use the unified service bus to provide the functions of
devices to the application layer, so as to realize the call and
interaction between heterogeneous devices.
Due to the different configuration of resources and virtual
scenes, compared with traditional web services, IoT services
have different characteristics. Industrial Internet of Things
requires high reliability of data [32]. For wireless communica-
tion in industrial environment, data is usually deterministic
and has strict time limit. For applications such as motion con-
trol, it is characterized by low delay and jitter. For monitoring
of vibration or temperature sensing, it can accept the second
level delay. Therefore, it is necessary to deploy gateways in
the virtual environment, manage a large number of terminals
in the virtual environment and control the processing, and
unload the computing tasks in the terminal to the gateway to
greatly reduce the processing delay of tasks and the energy
consumption of IoT devices, so as to improve the QoS of the
network and the QoE of users [33]. The diversity and hetero-
geneity of information collected by sensors. The information
of the physical world collected by various sensor devices is con-
verted into the corresponding discrete data, which can be the
collected temperature, image, video and other information
[34]. The types of device entities in the application environment
of the Internet of things are more extensive and diverse. It is
precisely because of the connection of various sensors that
the IoT can flexibly extend the traditional Internet to the
underlying physical environment and generate information
interaction with the corresponding device entities.
3
The purpose of the IoT is to connect various entities to a
unified network, and through the combination of various
entity functions to better meet business needs. IoT services
usually have the requirements of time and space. At the same
time, the application scenarios of different sensing devices are
also different, there are certain regional requirements, and the
service is usually limited by the device resources and other con-
ditions. Because most of the physical devices in the IoT envi-
ronment are in a resource constrained environment, they
usually have strict requirements on battery power supply,
bandwidth occupation, etc., so how to make the optimal
deployment of devices under resource constrained conditions
is an important direction of IoT applications.
3. Methods
The design of virtual scene environment plays an important
role in the visual simulation of IoT. Combined with the actual
layout of the scene, and considering the actual characteristics
of the environment, in addition to the relevant models, we also
need to create terrain, landform and so on to make the scene
more realistic. User interface includes user, interaction opera-
tion and user interface. To ensure the user experience has
become the main goal of system designers in their daily work,
three aspects need to be studied: user research, interaction
design and interface design [35]. Some studies show that in
the interaction process of two-dimensional computer scene,
the user obtains about 90% of the interactive behavior through
the graphical interface. Graphical interface plays an important
role in the scene of information transmission.
In two-dimensional computer scene, graphical interface
mainly corresponds to some metaphors represented by differ-
ent sizes of screen [36]. There are desktop metaphors like
PC, drawer metaphors of mobile phones, and the design of
smart watch round screen. However, in the 3D scene, the
degree of freedom of interaction is relaxed to the whole 3D
space, and users have a broader input channel, which requires
critical inheritance and innovation of graphical interface in the
virtual scene [37–40]. In the virtual scene, the graphical inter-
face has the following characteristics.
(1) Content space–time discontinuity and real-time feed-
back to users. The appearance of graphical interface
and component depends on the function of product
and the scene and environment of user. From the dimen-
sion of time and space, graphical interface can’t be
expressed continuously [41,42]. When different opera-
tions are implemented in the virtual scene, the graphical
interface may undertake the function of transmitting
information in the scene, mixed with the discrete interac-
tive operation of the user, and feedback the correspond-
ing expression of the input content to the user
discontinuously, so as to complete the content exchange
with the system information. Fig. 1 is the controlling
room.
(2) The diversity of display forms. In the virtual scene, the
graphical interface may be presented in two-
dimensional, three-dimensional graphical interface, or
even in combination. For example, when the menu
expressing the content options appears in the virtual
scene, the user can understand it in the form of two-
4 C. Huang et al.

Fig. 1 Controlling room. Fig. 3 Warehouse.

dimensional pictures; in the driving scene of the virtual

scene, the prompt information such as turning tends to
be organized in the form of three-dimensional imitating
the real world warning signs. The specific way of its
appearance depends on the metaphor of the scene in
the design. In essence, the design is the mapping and
expression of the real world, and the graphical interface
is only the tentacle of the system’s communication with
the world and users. Designers in the design of graphical
interface should pay attention to the combination of the
design scene, through multiple iterations, take appropri-
ate, user-friendly presentation form. Fig. 2 is the
supermarket.
(3) Unilateral interaction implicitness. The highest level of
Fig. 4 Wharf.
design is ‘‘user invisible”, which emphasizes that users
can be affected by the interface as little as possible, have
a stronger sense of immersion and focus more on the form of warning box. In this process, the user does not need
interaction task itself. In the process of interaction, to operate. After the system completes the prompt effect, it will
visual sense is the main channel for users to obtain infor- close naturally and complete an implicit interactive expression.
mation. Users have been interacting with the environ- Fig. 4 is the wharf.
ment, but it is difficult to detect the energy invested by In the process of virtual natural scene development, we
their senses. The graphical expression can meet the should not only consider the fidelity of the scene model, but
user’s habits, at the same time, it can’t interrupt the also pay attention to the optimization of the scene and model,
user’s own operation behavior, and feedback the content to ensure the authenticity, but also reduce the performance
to the user, which can complete the effective transmis- consumption and shorten the rendering time as much as possi-
sion of information. Fig. 3 shows the warehouse. ble. Therefore, it is necessary to optimize the performance of
the scene.
Graphical interaction components can be combined with
interactive means to enhance the user’s immersion in the vir- 4. Results
tual scene. For example, in some warning scenarios, the system
can pass dangerous and wrong information to the user in the 4.1. Mathematical model of multi-virtual terminal selection
problem

The multi-virtual terminal selection problem under the context

of IoT refers to the synergistic combination to be conducted by
the terminal device of multiple perception layers in support of
the business requests of the business layer. Here ‘‘synergistic”
means the ability or process of reasonably coordinating two
or more different resources or entities to achieve certain objec-
tives in a coordinated manner. In the virtual environment of
IoT, effective multi-virtual terminal coordinated aggregation
algorithm is of vital importance to realize the intelligence
and automation of IoT services.
In the networked virtual environment of IoT, IoT applica-
tion scenarios are abstracted into business layer, resource layer
Fig. 2 Supermarket.
Virtual reality scene modeling in the context of Internet of Things 5
2 3
and the corresponding terminal aggregation set to the virtual 0 1 0
6 7
business service i. Among them, resource layer is the compre- Cj ¼ 4 1 0 15 ð1Þ
hensive modeling of the networked layer and the virtual per- 0 1 0
ception layer in the overall IoT architecture. The model is
represented in the form of logic diagram, represented as 2 3
0 1 1
GSM ðPi ; Ci ; Qi Þ and GRM ðT; LÞ respectively. The research of 6 7
multi-terminal selection faced to IoT business is to study Cj ¼ 4 1 0 05 ð2Þ
how to map GSM ðPi ; Ci ; Qi Þ into GRM ðT; LÞ in order to select 1 0 0
the optimal terminal set to provide services. The IoT virtual Protocol 2: In the networked virtual environment of IoT,
business scenario diagram and abstract model is shown in multiple end terminals conduct information exchange through
Fig. 5. wired or wireless communication modes and the correspond-
As shown in Fig. 5, the second wireless chip wirelessly con- ing logic diagram can be represented as GRM ðT; LÞ, which is
nects each of the wireless handle controllers through the sec-

comprised of terminal set Tk ¼ tk;w jw ¼ 1; 2;    ; W and net-
ond protocol. The first protocol and the second protocol are
worked communication link bandwidth resource between ter-
different wireless communication protocols. The host is wire-
minals L ¼ fle je ¼ 1; 2;    ; Og. Here, represents the wth
lessly connected to the virtual reality helmet, or the host is inte-
capacity of the tk;w th terminal and le represents the bandwidth
grated into the virtual reality helmet.
resource of the eth link.
Protocol 1: Logic diagram GSM ðPi ; Ci ; Qi Þ is used to repre-
Virtual service terminal set: It represents that for each vir-
sent each virtual business iði ¼ 1; 2;    ; nÞ and it includes busi-

 tual business i, it always has corresponding multiple optional
ness set Pi ¼ pi;v jv ¼ 1; 2;    ; Vi and business relationship
Virtual service terminal sets, marked as Ci;s . Here s represents
matrix Ci ¼ Pi  Pi as well as business quality index set

 the sth virtual service terminal set corresponding to the virtual
Qi ¼ qi;v jv ¼ 1; 2;    ; Vi . Here, pi;v represents the vth sub- business Pi . Meanwhile, the corresponding virtual service ter-
business of virtual business i and in order to represent the rela- minal set to every virtual business must meet the resource abil-
tionship among the relationship, the idea of transfer matrix is ity constraint in Formulas (3) and (4), which mainly include
introduced. The value (0 or 1) of the matrix element represents the restrictions in terminal ability and link capacity. In the for-
the connection relationship between each sub-class service for mulas, w represents the ability of terminal k and e represents
the convenience of analysis and processing. Assume that a cer- which link to be occupied.
tain virtual business j corresponds to Cj , as shown by Formula X
(1) and the relationship between sub-businesses is the imple- tik;w 6 Tk;w ; 8w 2 ½1; W ð3Þ
mentation sequence of pj;1 ! pj;2 ! pj;3 . For Formula (2), the i

relationship between the sub-businesses can be analyzed as X

 lie 6 Le ; 8e 2 ½1; E ð4Þ
! pj;2
the parallel implementation order of pj;1 . q represents i
! pj;3 i;v
the quality index of the vth sub-business of virtual business i. To sum up the above concepts of virtual business model,
resource model and terminal synergistic aggregation model,

Wireless Wireless
camera camera Wireless
Protocol 2
equipment equipment handle
controller
Protocol 1
Wireless
camera Wireless
equipment handle
controller
Server connection Knowledge
Wireless
and virtual data database
camera
transmission management
equipment
module module

Micro-controller

Virtual reality helmet

Host machine

Fig. 5 Multi-virtual terminal selection in Internet of things environment.

6 C. Huang et al.

it can be learned that the multi-terminal selection problem bhmax

06 6 3:5 ð10Þ
faced to IoT business lies on the mapping algorithm from Pro- h_ S  FhSH  1s
tocol 1 to Protocol 2 in resource aggregation management
layer, which is responsible to provide the optimal terminal
combination and distribution plan for multiple virtual busi-
nesses in the application layer in order to improve the service (3) When the virtual dynamic movement platform moves to
efficiency of IoT virtual resources. a certain position and then returns to the neural posi-
tion, in order to improve the fidelity of movement simu-
4.2. Parameter optimization and its constraint conditions of lation, it needs to do the return movement without the
model user’s notice. Therefore, during the process of no trans-
lation state of the movement platform jack, the angular
speed and the linear acceleration need to be lower than
Model optimization is a typical non deterministic polynomial
the maximum angular speed and linear acceleration that
time problem. The computational complexity of these prob-
can be perceived by humans. On the other hand, the
lems increases sharply with the increase of the number of sta-
platform shall be returned to the neural position as soon
tions, so it is difficult to improve the deployment efficiency of
as possible, which is to make sure that the platform can
base stations. In addition, if the base station density is too
proceed with next movement in time. So the angular
small, it will cause low coverage, poor signal quality and low
speed and linear acceleration have a minimum value
data rate. If the base station density is too large, it will cause
which are supposed to be bigger than the minimum.
too much overlapping coverage, serious interference, low
resource utilization and high cost. Therefore, in order to pro- Here, aXH ¼ a  F XSH and bhH ¼ h_ S  F hSH . In combination
vide greater coverage and system capacity, improve network of the hardware performance of the platform and the
QoS and user satisfaction QoE, it is necessary to study the base range of angular speed and linear acceleration to be per-
station deployment planning. Constraint conditions are deter- ceived by humans, amin ¼ 0:14m=s2 , h_ min ¼ 0:040rad=s,
mined based on the performance of virtual business and they amax ¼ 0:17m=s2 and h_ max ¼ 0:0524rad=s,
meet the return time, speed range and travel range of the vir-
tual businesses and take into consideration of the extremes
human can sense the movement signals. (
0:14 6 a  FXSH 6 0:17
ð11Þ
(1) The displacements d i and bj ði ¼ x; y; z; j ¼ u; h; wÞ of 0:040 6 h_ S  FhSH 6 0:0524
virtual movement platforms in different directions shall
If the coverage and capacity can be optimized at the same
be restricted within the travel range of the movement
time, the deployment cost of the system will be minimized.
platform, which are 0:1 6 d i 6 0:1 and
However, compared with power coverage planning using
0:174 6 b 6 0:174.
j
mature propagation model and field measurement, capacity
planning is more challenging, because the traffic demand dis-
As only the parameters in the longitudinal filter are filtered, tribution has inherent dynamic characteristics.
dy , dz , bw and bu are zero.
 
1 1 1 a  FXSL 5. Discussion
dx ¼ a  FXSH   ; bh ¼ h_ S  FhSH   arctan ð5Þ
s s s g
Virtual reality scene model is an engineering data model based
And
on three-dimensional digital technology, which integrates all
1 1 kinds of relevant information, and the model is constantly
0:1 6 a  FXSH   6 0:1 ð6Þ
s s deepening and changing. The IoT platform provides the basic
  capacity support of IoT, which can meet the needs of urban
1 a  FXSL
0:174 6 h_ S  FhSH   arctan 6 0:174 ð7Þ governance in the future. The IoT platform includes percep-
s g tion device management center, perception data open center
and regional event operation center. Through the management
of devices and device data, a large number of device data are
used to build regional events. Through the analysis and pro-
(2) The maximum return time of virtual dynamic movement
cessing of these regional events, valuable data information is
platform refers to the time timax ¼ 3:5s for the maximum
provided for users. Based on the overall architecture of the
length of the jack to return to the zero because
IoT cloud platform, it realizes the security sharing of informa-
tion and ensures the information security. Through the permis-
sion setting, different permissions are set for different users.
dXmax bhmax Users with different permissions can only share the informa-
tX ¼ ; th ¼ ð8Þ
a  FXSH  1s h_ S  FhSH  1s tion within the user’s permissions, while users with ordinary
permissions can’t share the high-level data information, which
And can realize the rapid sharing of information. The overall archi-
dXmax tecture of the cloud platform based on the Internet of things is
06 6 3:5 ð9Þ shown in Fig. 6.
a  FXSH  1s
Virtual reality scene modeling in the context of Internet of Things
Data entry
Get virtual
device data
Data
Data storage
processing
Merge models,
Interactive central server render
Fig. 6 Overall architecture of cloud platform based on IoT.
Cloud platform based on IoT includes virtual data input
module, central server and virtual display module; the input
module establishes communication connection with the central
server for information processing and storage, and the central
server establishes communication connection with the receiv-
ing display module for displaying information. The input mod-
ule is used for information input, and the central server
includes information acquisition module, information process-
ing module, storage module, information management mod-
ule, permission control module, information packaging
module and information release module. The information
acquisition module is connected with the information process-
ing module through one-way communication, and the infor-
mation acquisition module is used for information collection,
and then the collected information is transmitted to the server
for information unification. The information processing mod-
ule has the conversion function, which converts the collected
information of different formats into the same information
format for convenient storage. The storage module and the
information management module realize the network interac-
tive connection and information management. The module
includes information classification module, information statis-
tics module and classification encryption module. The classifi-
cation encryption module is used to encrypt some non-public
information. The information packaging module packages dif-
ferent information to be shared, so that different information
is in the same module, which facilitates users to view, and
the information is transmitted to the receiving and display
module through the information release module, and the
receiving and display module includes a mobile module.
Mobile terminal and remote terminal. The data architecture
of the IoT platform is shown in Fig. 7.
By deploying the IoT platform in the IoT engine and con-
necting the IoT platform with the regional IoT sensor system,
the proposed model realizes the construction of the IoT plat-
form in the unified cloud platform, so as to effectively manage
the equipment and equipment data through the IoT platform,
and transmit the collected data to the application layer
through the IoT platform after fusion processing, which can
be timely implemented Provide support and services for the
application layer. The network topology of the IoT platform
is shown in Fig. 8.
Data access function realizes data access, including applica-
tion programming data management function can manage
7
Virtual reality
data packaging
Generate an Virtual scene
edit scene display
data, including data capitalization function, data processing
function, data comprehensive query function; data open func-
tion can be applied to data related authority management,
including data approval, data control function, open API
function. Data visualization function can be used to manage
data display data through charts or maps, including chart
function, map function, etc. In the application architecture
of IoT, there are several application groups, which are: device
connection platform, device message management, device cen-
ter, service center, open center, regional configuration center
and portal, data visualization, perceived device management,
perceived data opening, and regional event operation. The
schematic diagram of IoT platform network interconnection
and docking is shown in Fig. 9.
The device connection platform and device message net-
work management form a module. The device center and
device metadata and firmware management form a module.
The service center, open center, authority, account, user and
message form a module; the regional configuration center
and portal, data visualization, sensing device management,
sensing data opening, and regional event operation form a
module block. There is a cloud based platform under the
IoT platform. The cloud based platform consists of relational
database service, remote dictionary server, table storage, enter-
prise distributed application service, log service and message
queue. The proposed method includes: constructing a data-
base, storing the data structure involved in each scene and
the corresponding scene respectively for various scenes in the
virtual reality system, encapsulating the data operation
involved in each scene and the data structure stored corre-
sponding to each scene as the data model of each scene. The
data model executes the data operation in the data model, calls
the data structure in the data model loaded in the memory
according to the data operation, and displays the data
resources.
6. Conclusion
This paper first introduces the structure of the IoT and its key
technologies and typical applications, and leads to the hot
issues such as the intelligent design of virtual reality terminal,
the creation of virtual scene environment, and the new applica-
tion of the IoT. Then, aiming at these typical research hot-
8 C. Huang et al.

Virtual scene application

Multi-dimensional virtual
scene server

Interactive virtual
Virtual data model
environment module
Multi-view Image
Computer POS
image control
rendering data
Scene graphics processing point data
Middleware (OSG or function
other graphics engine) components
3D Render
...
modeling Module
Position acquisition module
Underlying API

Virtual Internet of
things platform

3D display and Immersive

Interactive force acquisition module
walkthrough display

Fig. 7 Data architecture diagram of IoT platform.

Fig. 8 Network topology diagram of IoT platform.

spots, this paper describes in detail the intelligent virtual scene
design, multi-virtual terminal selection, model parameter opti-
mization and constraints, virtual reality scene modeling
scheme design, the overall architecture of IoT cloud platform,
IoT platform network interconnection docking, virtual reality
technology convergence, data architecture of IoT platform and
other core issues. The proposed scheme provides one-stop
equipment access, equipment management, monitoring opera-
tion and maintenance, security, database dynamic loading
management methods and devices and other services. As an
important part of the IoT engine, it can provide the basic abil-
ity support of the IoT.
Virtual reality scene modeling in the context of Internet of Things
Virtual device
access
Cloud
interface
LinkWAN
Human
computer
interactio
n VR processing
interface
Communica
processing module
tion
interface
processing module
Camera
switching signal
Manipulator Interactive force
control signal collection
Fig. 9 Schematic diagram of interconnection and docking of IoT platform.
As the virtual reality management platform based on the
IoT is a huge and complex system, which involves many theo-
retical and practical projects, this paper mainly discusses and
analyzes several key issues, and the future research work
mainly includes the following aspects:
(1) With the development of IoT and virtual reality technol-
ogy, more and more virtual reality devices may be
deployed in an IoT system. If each device has to authen-
ticate with the server, it may occupy too much server
resources and other system resources, resulting in the
low efficiency of the whole system. Therefore, from this
point of view, there is still a need for further research.
(2) In terms of multi virtual terminal selection, it is neces-
sary to study the time and space complexity of models
and algorithms in the future.
(3) The virtual reality scene modeling method in the IoT
environment proposed in this paper, in the specific
implementation, there are some key technologies that
can be verified only when the deployment scale reaches
a certain degree, so there are many meaningful scenar-
ios, and if conditions permit, we can study more scenar-
ios through large-scale deployment.
Declaration of Competing Interest
The authors declare that they have no known competing
financial interests or personal relationships that could have
appeared to influence the work reported in this paper.
Acknowledgement
None.
9
Action
acquisition
interaction
module
VPC-A Virtual Internet of
module things platform
VPC-B
DateX
Multi-dimensional
Video signal
Core data Internet of things virtual scene
processing intelligent vision display
LV
Speech signal
Video glasses
Video control
References
[1] S. Goudarzi, N. Kama, Mohammad Hossein Anisi, Sherali
Zeadally, Shahid Mumtaz, Data collection using unmanned
aerial vehicles for Internet of Things platforms, Comput. Electr.
Eng. 75 (2019) 1–15.
[2] M. Moaiad, J. Mahmood, L. Ara Afshin, Distribution system
reconfiguration in presence of Internet of things, IET Gener.
Transm. Distrib. 15 (8) (2021) 1290–1303.
[3] H. Doreswamy, S. Kunal, Enhanced reinforcement learning
assisted dynamic power management model for internet-of-
things centric wireless sensor network, IET Commun. 14 (21)
(2020) 3748–3760.
[4] Y. Zhang, Y. Han, J. Wen, SMER: a secure method of
exchanging resources in heterogeneous internet of things,
Front. Comput. Sci. 13 (6) (2019) 1198–1209.
[5] B. Reinhard, A. Ali, A security architecture for the internet of
things, KSII Trans. Internet Inf. Syst. 11 (12) (2017) 6092–6115.
[6] K. Aparna, T. Sudeep, T. Sudhanshu, Multimedia big data
computing and Internet of Things applications: A taxonomy
and process model, J. Netw. Comput. Appl. 124 (2018) 169–195.
[7] T. Zhang, F. Wang, TOPSIS time variant decision fusion model
evaluation for internet of public service things, Cognit. Syst.
Res. 52 (2018) 489–496.
[8] J. Kumseok, G. Samson Julien, G. Shivanshu, Thingsmigrate:
platform-independent migration of stateful javascript internet of
things applications, Software-Pract. Exp. 51 (1) (2021) 117–155.
[9] A. Usman, PROSE-Proactive resilience in internet of things:
targeted attacks and countermeasures, IEEE Sens. J. 18 (24)
(2018) 10049–10057.
[10] S. Yagmur Sabucu, P. Ali Emre, K. Gunes Karabulut,
Reputation based attacker identification policy for multi-
access edge computing in internet of things, IEEE Trans. Veh.
Technol. 69 (12) (2020) 15346–15356.
[11] M. Ying, W. Chen, P. Kang, Internet of Things applications in
public safety management: a survey, Library Hi Tech. 38 (1)
(2018) 133–144.
10
[12] A. Seetharaman, P. Nitin, A.S. Saravanan, Customer
expectation from Industrial Internet of Things (IIOT), J.
Manuf. Technol. Manage. 30 (8) (2019) 1161–1178.
[13] E. Harald, G. Peter, H. Jonathan, The Internet of Things and
economic growth in a panel of countries, Econ. Innov. New
Technol. 30 (3) (2021) 262–283.
[14] L. Camilo, A. Gonzalez Alberto, F. Contreras Antonio, Novus-
io: an internet of things platform for academic projects, KSII
Trans. Internet Inf. Syst. 12 (12) (2018) 5634–5653.
[15] L. Mendoza, C. Veronica, K. Joao Henrique, A Distributed
trust management mechanism for the internet of things using a
multi-service approach, Wireless Pers. Commun. 103 (3) (2018)
2501–2513.
[16] Y. Poonam, M. Julie, P. Tiago, Self-Synchronization in duty-
cycled internet of things (IoT) applications, IEEE Internet
Things J. 4 (6) (2017) 2058–2069.
[17] S. Andrea, F. Marco, M. Giordano, Diving into chemical
bonding: an immersive analysis of the electron charge
rearrangement through virtual reality, J. Comput. Chem. 39
(31) (2018) 2607–2617.
[18] S. Christian, M. Stephen, Virtual reality and situated
experiential education: A conceptualization and exploratory
trial, J. Comput. Assist. Learn. 34 (6) (2018) 843–852.
[19] M. Zhang, J. Montewka, T. Manderbacka, P. Kujala, S.
Hirdaris, A Big Data Analytics Method for Evaluation of
Ship-Ship Collision Risk reflecting Hydrometeorological
Conditions, Reliab. Eng. Syst. Saf. 213 (2021) 107674.
[20] K. Xiang, C. Xu, J. Wang, Understanding the relationship
between tourists’ consumption behavior and their consumption
substitution willingness under unusual environment, Psychol.
Res. Behav. Manage. 14 (2021) 483–500.
[21] Q. Yue, L. Zhang, Two-sided matching for hesitant fuzzy
numbers in smart intelligent technique transfer, Mech. Syst. Sig.
Process. 139 (2020) 106643.
[22] Y. Sun, C. Xu, G. Li, W. Xu, J. Kong, D. Jiang, B. Tao, D.
Chen, Intelligent human computer interaction based on non
redundant EMG signal, Alex. Eng. J. 59 (3) (2020) 1149–1157.
[23] C. Tan, Y. Sun, G. Li, G. Jiang, D. Chen, H. Liu, Research on
gesture recognition of smart data fusion features in the IoT,
Neural Comput. Appl. 32 (22) (2020) 16917–16929.
[24] Z. Liu, L. Lang, L. Li, Y. Zhao, L. Shi, Evolutionary game
analysis on the recycling strategy of household medical device
enterprises under government dynamic rewards and
punishments, Math. Biosci. Eng. 18 (5) (2021) 6434–6451.
[25] W. Shu, K. Cai, N. Xiong, Research on strong agile response
task scheduling optimization enhancement with optimal
resource usage in green cloud computing, Future Gener.
Comput. Syst. 124 (2021) 12–20.
[26] Z. Zhou, X. Chen, Y. Zhang, S. Mumtaz, Blockchain-
Empowered Secure Spectrum Sharing for 5G Heterogeneous
Networks, IEEE Netw. 34 (1) (2020) 24–31.
[27] M.S. Omar, S.A. Hassan, H. Pervaiz, Q. Ni, L. Musavian, S.
Mumtaz, O.A. Dobre, Multiobjective Optimization in 5G
Hybrid Networks, IEEE Internet Things J. 5 (3) (2017) 1588–
1597.
C. Huang et al.
[28] Y. Jing, H. Hu, S. Guo, X. Wang, F. Chen, Short-term
prediction of urban rail transit passenger flow in external
passenger transport hub based on LSTM-LGB-DRS, IEEE
Trans. Intell. Transp. Syst. 22 (7) (2020) 4611–4621.
[29] W. Fang, X. Yao, X. Zhao, J. Yin, N. Xiong, A stochastic
control approach to maximize profit on service provisioning for
mobile cloudlet platforms, IEEE Trans. Syst. Man Cybern.:
Syst. 48 (4) (2016) 522–534.
[30] C. Feng, K. Yu, M. Aloqaily, M. Alazab, Z. Lv, S. Mumtaz,
Attribute-Based Encryption With Parallel Outsourced
Decryption for Edge Intelligent IoV, IEEE Trans. Veh.
Technol. 69 (11) (2020) 13784–13795.
[31] T. Zhou, W. Wu, L. Peng, M. Zhang, Z. Li, Y. Xiong, Y. Bai,
Evaluation of urban bus service reliability on variable time
horizons using a hybrid deep learning method, Reliab. Eng.
Syst. Saf. 217 (2020) 108090.
[32] B. Ji, X. Zhang, S. Mumtaz, C. Han, C. Li, H. Wen, D. Wang,
Survey on the Internet of Vehicles: Network Architectures and
Applications, IEEE Commun. Stand. Mag. 4 (1) (2020) 34–41.
[33] L. Dong, W. Wu, Q. Guo, M.N. Satpute, T. Znati, D.Z. Du,
Reliability-aware offloading and allocation in multilevel edge
computing system, IEEE Trans. Reliab. 70 (1) (2021) 200–211.
[34] W. Wei, B. Zhou, D. Polap, M. Wozniak, A regional adaptive
variational PDE model for computed tomography image
reconstruction, Pattern Recogn. 92 (2019) 64–81.
[35] H. Shen, M. Zhang, H. Wang, F. Guo, W. Susilo, A cloud-aided
privacy-preserving multi-dimensional data comparison
protocol, Inf. Sci. 545 (2021) 739–752.
[36] K. Hu, F. Wang, Z. Shen, H. Liu, J. Xiong, Ternary
heterojunctions synthesis and sensing mechanism of Pd/ZnO–
SnO2 hollow nanofibers with enhanced H2 gas sensing
properties, J. Alloys Compd. 850 (2021) 156663.
[37] Z. Niu, B. Zhang, D. Li, D. Ji, Y. Liu, Y. Feng, Y. Fan, A
mechanical reliability study of 3-dB waveguide hybrid couplers
in submillimeter and terahertz bands, Front. Inf. Technol.
Electron. Eng. 22 (8) (2021) 1104–1113.
[38] R. Ye, P. Liu, K. Shi, B. Yan, State damping control: a novel
simple method of rotor UAV with high performance, IEEE
Access 8 (2020) 214346–214357.
[39] Z. Lu, L. Zhao, H. Ding, L. Chen, A dual-functional
metamaterial for integrated vibration isolation and energy
harvesting, J. Sound Vib. 509 (2021) 116251.
[40] G. Sun, Y. Cong, Q. Wang, B. Zhong, Y. Fu, Representative
task self-selection for flexible clustered lifelong learning, IEEE
Trans. Neural Netw. Learn. Syst. (2020) 1–15, https://doi.org/
10.1109/TNNLS.2020.3042500 (in press).
[41] H. Yi, Secure social internet of things based on post-quantum
blockchain, IEEE Trans. Netw. Sci. Eng (2021), https://doi.org/
10.1109/TNSE.2021.3095192 (in press).
[42] Q. Zhong, J. Yang, K. Shi, S. Zhong, Z. Li, M.A. Sotelo, Event-
triggered H1 load frequency control for multi-area nonlinear
power systems based on non-fragile proportional integral
control strategy, IEEE Trans. Intell. Transp. Syst. (2021),
https://doi.org/10.1109/TTTS2021.3110759 (in press).