2022 2nd Asia Conference on Information Engineering (ACIE)
Digital Media and VR Art Creation for Metaverse
Muzi Qu
Lu Xun Academy of Fine Arts Lu Xun Academy of Fine Arts
Dalian, Liaoning, China Dalian, Liaoning, China
Abstract—The booming of 5G, VR and XR technologies is
driving the arrival of metaverse era. Metaverse development
heavily relies on the adoption of the emerging technologies. Only
software and hardware technology can not achieve excellent
immediacy and immersion in the virtual world. The visual works
applied in the metaverse are the essential content core. Visual
artists play a very important role in creation fields of NFT
2022 2nd Asia Conference on Information Engineering (ACIE) | 978-1-6654-7973-8/22/$31.00 ©2022 IEEE | DOI: 10.1109/ACIE55485.2022.00018
artwork, smart cities, cultural museum interaction, games, film
and televisions. Exploring the art rules and creative methods of
the metaverse can improve the current digital media presentation
effect and the creative level of VR art, this will attract more
artists into the creation of the metaverse.
Keywords—metaverse, digital media, VR, encryption art,
artificial intelligence
I. INTRODUCTION
The advent of the metaverse boom in 2021 indicates that
new changes will take place in the way of human society and
communication in the future. People join the virtual world
with their digital identity. In the metaverse, they are free and
independent. People's image in the virtual world is not
necessarily the same as that in the real world. People can
create a new digital identity for themselves. The world of
metaverse pays more attention to the sense of experience,
which will bring people a better world. The development of
metaverse depends on the support of bottom and front-end
technology. In terms of underlying technology: artificial
intelligence, network and computing technology, VR
technology, 5g network, cloud computing, visualization and
digital twins are important supports. The front-end devices in
the metauniverse include VR, AR, interactive control, neural
devices and so on (Fig. 1).
Fig. 1. Metaverse ecological map
At the 2021 World VR Industry Conference, China Mobile
innovatively released the virtual VR ecosystem cooperation
system, the AR digital twin cloud platform, and the mobile
cloud VR platform. More than 20 cutting-edge technologies
were exhibited on site, covering industry, medical care,
cultural tourism, education, intelligence cities and many other
978-1-6654-7973-8/22/$31.00 ©2022 IEEE
DOI 10.1109/ACIE55485.2022.00018
Authorized licensed use limited to: Pontificia Universidad Javeriana. Downloaded on August 11,2022 at 14:47:45 UTC from IEEE Xplore. Restrictions apply.
Yuan Feng*
Yinan Sun Lu Xun Academy of Fine Arts
Dalian, Liaoning, China
e-mail: yy19830205@gmail.com
fields; China Teleom has set up five major areas, including
brand promotion area, smart home area, 5G capability area,
cloud VR experience area, and industry application area.
5G+VR /AR technology is applied to smart cultural museums,
innovative interactive methods, planning immersive tour
routes, giant screen theaters and VR games; China Unicom
brings VR spinning bikes, VR ski machines, VR shooting
battles and other 5G+XR innovative applications. The three
major operators have proved by practical actions that with the
blessing of 5G technology, VR and other XR technologies will
lead the arrival of the metaverse era. [1]
Although the commercial use of 5G communication
technology provides people with a new social style of
immediacy, low latency, and immersion [2], In order to get a
good user experience, more visual art creators are needed to
join the creation of the metaverse. Our research focuses on the
high integration of art and technology, and studies the art rules
and creative methods of paintings, digital media art,
architectural design, graphic design, IP design, clothing design,
etc. for the intelligent applications of the metaverse, so as to
improve current digital media presentation effects and VR
experience (Fig. 2).

Fig. 2. French artist Anna Zhilyaeva's VR 3D painting creation process
II. THE MATHEMATICAL FOUNDATION OF THE METAVERSE
The metaverse is the actualization of the theory of
complex numbers in a mathematical sense. With the evolution
 of human cognition of the world, human knowledge of
logarithm extends from natural numbers to integers, which are
discrete points on the one-dimensional number axis; from
integers to real numbers, one-dimensional straight lines can be
fully covered. With the introduction of imaginary numbers, the
cognition of logarithms has evolved from real numbers to
complex numbers, which has brought about an increase in
dimensionality. The one-dimensional straight line is upgraded
to a two-dimensional plane, which greatly expands human
cognition.
48
 The development of the metaverse is similar. With the
development of digitization, game spaces and digital twins are
more emphasizing the digitization and virtualization of entities.
The origin of the concept of metaverse is the full digitization
and virtualization of the physical world, rules, and culture,
which corresponds to the pure imaginary number in the plural.
With the further development of the metaverse, the virtual
world and the physical world will be fully integrated, thereby
evolving into a complex world (fig 3). The physical world has
achieved a dimensional upgrade, which will bring about
explosive growth of innovation and business opportunities.
We define the theoretical paradigm of the metaverse (complex
world) as Fig. 3:
‫ ݈݀ݎ݋ݓݔ݈݁݌݉݋ܥ‬ൌ ‫ ݈݀ݎ݋ݓ݈ܽ݁ݎ‬൅ ݀ ή ‫݈݀ݎ݋ݓ‬
㻌
Digital
5 HDO
5 HDOQ X P E HU
Digital world
,P DJ LQ DU\
㻌 㻗 㻌㻌
5 HDO
& R P S OH[ 1 X P E HU Metaverse – Complex world
Fig. 3. The mathematical model of metaverse
III. MATERIALS AND METHODS
In order to create visual art works in the metaverse, artists
should fully understand the needs and characteristics of many
aspects in the metaverse, and use digital media and VR to
create [3].
With the changes in the digital world and the complication
of social learning development, designers will face parametric
design [4], complexity design, adversarial design, and
speculative design. The digital media and VR design related to
the metaverse give new value to the art design.
Digital media relies on computer digital technology,
Internet technology and intelligent technology, and has the
characteristics of high scientific and strong knowledge
comprehensive [5]. These characteristics are exactly in line
with the characteristics of VR technology: VR refers to the
technology that is supported by sensor technology, simulation
technology, multimedia technology, and human-computer
interaction technology to form a virtual environment and bring
people an immersive experience.
In Metaverse, designers need to generate massive virtual
objects. Human labors can not afford such heavy burdens.
Hence, Artificial Intelligence technologies must be introduced
to dramatically boost productivity and hence reduce repetitive
works. Generative Adversarial Nets (GAN) is an effective
method to generate batch of images. In our solution, we
designed a stacked network architecture: the image synthesis
network (G), super resolution network (Gsr) and
principle-discriminator. The solution architecture is shown as
Fig 4.
Authorized licensed use limited to: Pontificia Universidad Javeriana. Downloaded on August 11,2022 at 14:47:45 UTC from IEEE Xplore. Restrictions apply.
Fig. 4. The solution architecture of mass-image-generator in metaverse
We add noise z into original design library images x. The
objective for generator G and discriminator D is:
௚௘௡
ࣦீ஺ே ሺ‫ܩ‬ǡ ‫ܦ‬ሻ ൌ ‹ ƒš ‫ܧ‬௫ ሾŽ‘‰ ‫ܦ‬ሺ‫ݔ‬ሻሿ ൅ ‫ܧ‬௭ ሾŽ‘‰ሺͳ
ீ ஽
െ ‫ܦ‬൫‫ܩ‬ሺ‫ݖ‬ሻ൯ሻሿ
In metaverse, we need high-reosolution images, then we
introduce a Super resolution genitor for intermedient images
Real
y.The adversarial loss function is:
Real world
௦௥
ࣦீ஺ே ሺ‫ܩ‬௦௥ ǡ ‫ܦ‬௦௥ ሻ ൌ ‹ ƒš ‫ܧ‬௬ೞೝ ሾŽ‘‰ ‫ܦ‬௦௥ ሺ‫ݕ‬௦௥ ሻሿ ൅ ‫ܧ‬௬೗ೝ ሾŽ‘‰ሺͳ
ீೞೝ ஽ೞೝ
െ ‫ܦ‬௦௥ ൫‫ܩ‬௦௥ ሺ‫ݕ‬௟௥ ሻ൯ሻሿ
Finally, the principle-discriminator is designed to score the
appearance prototypes generated by the two GAN to filter
unqualified prototypes which are not complying with design
principles.
A. The Production Technology of VR Works
1) Physical shooting method
The way of using real objects and scenes as VR production
materials is widely used in VR applications such as
transportation, tourism, architecture, film, etc. The image
collection and production process of the real world is divided
into two parts: the early stage and the later stage:
First, use a sports camera to obtain 360°HD videos and
take immersive pictures. Use a small handheld device to
capture 30fps 360°HD video. And watch from multiple
locations. Odyssey can plan all the videos taken by the camera
into 4:3 videos, and then use the Jump Assembler engine to
output H.264 MP4 files with panoramic views of 2K and 8K
videos. Finally, use Skybox Studio, The Trapcode and other
tools for VR post-production. The current technology solves
the alignment and stitching of multiple cameras, and solves
the problem of color correction. Artists need to improve the
workflow and techniques used in graphic design so that these
new techniques can be applied to panoramic spherical videos
[6].
With the increase of 3D data collection, in order to meet
the development needs of metaverse related functions, it is
necessary to have shared value and open source visual data
resources. For example, in terms of environmental architecture,
using airplanes to model cities and store a large amount of
urban building data can save a lot of manpower and material
resources and achieve good design results. In many visual
fields such as apparel design and industrial modeling, data
assets are also very important. Data mining and creation on
this basis also make VR design more efficient.
49
 2) Art creation method
In the fields of VR applications such as animation, new
media, architectural design and industrial design, it is
necessary to create artistic creations in accordance with set
themes, creativity or story content. Original artistic works are
in large demand in today’s VR application fields. Artistic
creation not only requires the artist to have superb artistic
quality and innovative thinking, but also requires the artist to
have the ability to operate related VR production technology.
In terms of the technology of VR creation, the artist must
first use 3D MAX, Maya and other software for initial
creation. Usually it is to build a space model and use an
animation engine to create a virtual reality 3D scene. Then use
Unreal, Twinmtion, Omniverse and other 3D-XR production
platforms for post production. The key to the effect lies in
important content such as light adjustment, precise docking,
and color adjustment. The next step is to import it to the cloud
streaming platform, which is a display platform suitable for
displaying 3D work development. Online demonstrations of
VR and XR can be performed on RGBcore, and 3D works can
be viewed directly on mobile phones, iPads, computers, or VR
devices. (Fig5). In addition, using Unreal's open source
platform to drag and drop based on the C language can also
complete the creation of works. The current technology allows
most designers to easily realize their design ideas. Created in
entertainment display, VR film and teaching, product design.
It is worth noting that digital art works need to be well
compatible with the Metaverse open source platform and
wearable devices. Works created in Maya, 3D max, reno, scale
up and other software should be saved in a common format. In
order to communicate with platforms such as anrrivel,
promotion, annikword. On the other hand, it realizes
versatility with VR helmets, sensing devices, and digital
media. Establish universally agreed standards. For example,
the USD format, which is now more respected, can be used
across multiple platforms and software.
 technology create digital media art at the forefront of the times.
Fig. 5. VR work creation process
B. VR Art Circulation
In the field of VR creation, architecture, games, culture,
tourism and education are all visual art fields with practical
value. In practical art, works are purchased by consumers
because of their functions. In VR art, works used solely for
appreciation and collection are endowed with the same
circulation value as art collections. They are encrypted art,
also known as blockchain art. Encrypted art have strong
circulation and value-added characteristics.
1) Scarcity of encryption Art
a) In the creation of encrypted works of art, the total
number of single works generated by the artist and the artist's
commitment to the number of works have a great impact on
the value of the works. If the artist breaks his promise, it will
50
Authorized licensed use limited to: Pontificia Universidad Javeriana. Downloaded on August 11,2022 at 14:47:45 UTC from IEEE Xplore. Restrictions apply.
lead to the decline of the scarcity of this work.
b) The speed of an artist's creation affects the overall
number of works. Therefore, it will have a greater impact on
the value of art works.
c) Works with sensory added value will be more
competitive. Works of art with higher academic or visual
innovation in creativity will be more popular [7].
2) Cultural characteristics of encryption Art
Blockchain has specific artistic and cultural characteristics.
Firstly, encrypted works of art must be original. In addition,
equal rights are also reflected in all aspects of creativity and
transaction [8].
3) Value marketing of encryption art
The art value logic of blockchain is the same as that of
ordinary art, that depends more on the artist's self marketing
ability [9]. Fans are very important to artists. The market on
the metaverse platform is very large. The author's activity on
social networking sites affects the number of followers.
If artists are favored by stars, celebrities and even the
founders of blockchain platform. Then his attention will be
very high, and its value will have more room for appreciation.
The interaction between artists and fans is also very
important. If we media is not active enough, it will affect the
attention of personal brand.
In addition, community is also important to artists. Artists
with community identity will be more popular.
In the Internet age, the value of artists should be
transformed and realized through an organization or platform.
Creators should be more active and more like social activists.
Artists need to have this close relationship with this society
and shape their personal brand by actively participating in
community co creation activities
IV. DISCUSSION
Creating digital media and VR art facing the metaverse
requires a broader way of thinking. A change in design
methodology is needed. Artists use software or new
The combination of art and science is an interdisciplinary
combination, includes biology, engineering and even physics.
Integrate science into art and explore future oriented creation.
In the era of metaverse, art takes place in a variety of forms or
unexpected forms [10].
At present, different applications and spaces share
relatively little information, but encryption and decentralized
computing begin to break some of these barriers. In the future,
creators can collaborate, edit and view the same assets in real
time across applications. It is very convenient for creative
workers,
Although blockchain is an important element in the
metaverse, we can also see some different type. For example,
in the "New Art City" [11]space project in Silicon Valley.
Designers create some of this scientific fantasy space without
gravity from the perspective of artists. In such a space, the
works are not on the blockchain. The creators believe that the
blockchain economy will not bring greater improvement to
creativity (Fig 6).
Fig 6. “newart.city” space project
The development of VR technology has provided a new
way of presenting art creation. Through VR technology, artists
"update" the creation and presentation of works of art, whether
they are previous works or new works created through VR
experiences, by reinterpreting or further interpreting them,
while increasing the viewer's sense of participation and
experience, giving the viewer a new way of encountering and
experiencing the artwork. This new sense of experiencing the
artwork is made more interesting and engaging as the viewer
and the VR device move in position and the computer then
performs calculations to send back accurate images of the 3D
world, which gives the viewer a strong sense of immersion.
The viewer is immersed in a new visual space, without
distractions, in the artistic space brought about by the artwork.
As Maria Engberg andJay David Bolter argued in their paper
that technical affordances are part of a complex process of
mediation that includes both experimentation with the
technology at hand and a reliance on earlier media forms. It is
critical to understand the creative tension between established
forms and new ones that underscore new aesthetic and
narrative experiences in VR and 360e formats [12].
For artists who have been eager to interact with viewers
visually, psychologically and emotionally, this is undoubtedly
a particularly eager way to try, combining technology and art,
integrating it throughout the creation of art, and not simply for
the display and the use of technology, it can be said that VR
technology will cause a new change in the field of art and
design [13]. This fully immersive interaction with the artwork
also mobilizes the viewer's body and mind, giving the viewer
a strong sense of reality and integration into the sense of
presence.
For traditional artworks, the use of VR technology
"activates" traditional artworks, breaks the boundaries
between virtual and physical reality, changes the way viewers
see, and most importantly, brings a different sensory
experience, opening a whole new door for viewers to feel and
understand the emphasis and demands of autonomy brought
by artworks. For artists' creations [14].
51
Authorized licensed use limited to: Pontificia Universidad Javeriana. Downloaded on August 11,2022 at 14:47:45 UTC from IEEE Xplore. Restrictions apply.
For artists, the application of VR technology is a reminder
and update of the artist's creative thinking, providing artists
with a different way of thinking about creation [15]. The VR
technology can break the above factors, break the barriers of
the above factors, which were not possible in traditional art
works, and can be used to create on top of this basis, and to
make their creative inspiration shine.
V. CONCLUSION
Metaverse is a new era of Internet development, which has
realized the overall dimension upgrading of the physical world.
It will bring infinite possibilities to relevant fields. In the
virtual world, the visual art of VR multimedia plays a vital
role. VR art creation needs more artists to participate in it,
constantly improve VR production technology, improve
creation level, cross-border and innovation. With the
development of open platform and software technology,
digital media art creation will be more and more efficient. The
combination of technology and art will make art itself have
new development, and may change the way humans watch and
think.
REFERENCES
[1] Wu Shu, Zhang Ming, Fang Zheng, Liang Li Yue, 5g spawned
yuancosmos, people's Posts and telecommunications / November 12,
2021 Version 005
[2] Feng jiezhang, Hao Zhong, Liu Tian, Hu Yuyu, Wu Xinyi, development
and design of a 5gd based VR immersive experience cloud platform,
China Science and technology information 2021, (15).
[3] Chen Weichao, Zhou Ting "Transformation and innovation of 5g + TV
media from the perspective of media integration." Journal of Hangzhou
University of Electronic Science and technology 17.5: 73-78
[4] Li Dexian, et al. "Application of BIM parameterization technology in the
design of table tennis hall of Hangzhou Asian Games." Information
technology of civil and architectural engineering # 13.3 (2021): 112-118
[5] Ra, Kevin Kyunghwan, and James J. Clark. "Decoupled Hybrid 360°
Panoramic Stereo Video." 2019 International Conference on 3D Vision
(3DV). IEEE, 2019.
[6] Andueza, Eka-Iree Tapia. "LA TRANSDICIPLINARIEDAD COMO
MEDIO PARA LA GESTIÓN AMBIENTAL PARTICIPATIVA."
Revista Palenque Universitario 01 (2020): 150-164.
[7] Andueza, Eka-Iree Tapia. "LA TRANSDICIPLINARIEDAD COMO
MEDIO PARA LA GESTIÓN AMBIENTAL PARTICIPATIVA."
Revista Palenque Universitario 01 (2020): 150-164.
[8] Qin Rui, et al. "NFT: non homogeneity pass based on blockchain and its
application." Journal of intelligent science and technology, 3.2: 234-242
[9] Lu Xiaohong "Analysis of artist self marketing." Nanjing Social
Sciences 10 (2006): 90-94
[10] Ra, Kevin Kyunghwan, and James J. Clark. "Decoupled Hybrid 360°
Panoramic Stereo Video." 2019 International Conference on 3D Vision
(3DV). IEEE, 2019.
[11] https://newart.city/
[12] Maria Engberg, Jay David Bolter. The aesthetics of reality media.
Journal of Visual Culture, 2020, 19(1): 81-95.
[13] Boyu Tang and Chunxiao Ge. Application of Computer Software
Technology in Art and Technology Creation. World Scientific Research
Journal, 2021, 7(6): 356-363.
[14] Gao Yuan, Liu Jian “Interactive aesthetic analysis of digital image art”
Literary contention, 2021 (10): 187-192
[15] Zhang Lanshan, Shi Weike “Enlightenment and challenge of the concept
of meta universe to film and television creation” China television, 2022
(02): 78-83