Download as pdf or txt
Download as pdf or txt
You are on page 1of 6

2021 1st International Conference on Computer Science and Artificial Intelligence (ICCSAI)

RTR AR PHOTO BOOTH:


THE REAL-TIME RENDERING AUGMENTED
REALITY PHOTO BOOTH
Muhamad Fajar Yogi Udjaja
Computer Science Departement Computer Science Department
School of Computer Science School of Computer Science
Bina Nusantara University Bina Nusantara University
Jakarta, Indonesia 11480 Jakarta, Indonesia 11480
muhamad.fajar@binus.edu udjaja.yogi@gmail.com
yogi.udjaja@binus.ac.id
2021 1st International Conference on Computer Science and Artificial Intelligence (ICCSAI) | 978-1-6654-4002-8/21/$31.00 ©2021 IEEE | DOI: 10.1109/ICCSAI53272.2021.9609795

Eko Setyo Purwanto Anderies


Computer Science Department Computer Science Department
School of Computer Science School of Computer Science
Bina Nusantara University Bina Nusantara University
Jakarta, Indonesia 11480 Jakarta, Indonesia 11480
eko.purwanto@binus.ac.id anderies@binus.edu

Abstract — The use of Photo Booth at several events and technology is emphasized to balance social problems
has become a means of documentation such as selfies that need to be resolved while ensuring economic
and wefies, However, in some applications, the development [4].
technology has not been utilized properly. This study On the other hand, the Future Today Institute describes
aims to describe how the application of Augmented one of the technological developments with valuable
Reality technology to be applied to the form of market potential, Augmented Reality, which includes
photography services in the form of a photo booth with various application developments in several sectors such as
real-time rendering techniques from Spark AR and the military, nursing, health, engineering, and entertainment
use of the cloud. We propose a creation schema to [5]. One form of entertainment needs for someone is
implement augmented reality in photobooths for satisfaction when sharing information and experiences
marketing purposes in exhibitions or events. The online, which can be in sharing media and photograph
implementation description will include how online [6].
augmented reality technology is used, development
methods, and references on how to use it until it is Photograph taken by non-professionals can usually be in
ready for use. The performance measurement was also the form of selfies traditionally termed on social media.
carried out using Frame Rate Per Second (FPS) on two Selfies represent a form of real-life behavior that is not
different device configurations in several experiments. contaminated by academic training [7], [8]. This type of
The results show that the proposed photobooth can run behavior has become spontaneous both in individuals and
up to more than 60 FPS or at above standard in groups. Group selfies are also commonly referred to as
performance. “selfies” or “wefies.” Most selfies are taken using front-
camera when someone monitoring their image on the
Keywords—Augmented Reality, Photo Booth, Photo Corner, preview screen like a mirror[8], [9]. One form of
Spark AR, One Drive. photography service present in Indonesia, thanks to
technological developments, is a photo booth or photo
I. INTRODUCTION corner [10]–[12].
Various daily activities have been transformed from the In line with photograph technology development,
impact of the opening of a global network known as the several research in photo booth have been designed with
Internet [1]. Reports from the survey published by the and without technology. Several studies that succeeded in
Indonesian Internet Service Providers Association in 2019, improving user experiences using physical attribute such as
Indonesia has internet users have reached 171 million users Saptodewo design and study about visual media using
with a user growth percentage of up to 10% every year [2]. physical costumes in photo booth to preserver Indonesian
Developments in the photography sector have also been culture [11] and Renzi Anita study to enhance guest
accompanied by the growth of internet users. Now experience used physical decoration in wedding
photograph has been more widely produced, consumed, celebration [10]. On the other side, several studies using
and distributed on computers, mobile phones via the virtual attribute such as augmented reality also succeed
internet and social-network sites [3]. Image digitization has improving user experiences, provide unique value and
also illustrated a change of new ways of socializing that is satisfaction experiences in [12]–[14].
more real-time, collaborative, and networked [3]. This Based on recent studies development in photo booth
form of socialization is also part of Society 5.0, which design, this study describes photo booth service design
refers to a new type of society where innovation in science

978-1-6654-4002-8/21/$31.00 ©2021 IEEE


289on April 02,2024 at 06:19:27 UTC from IEEE
Authorized licensed use limited to: Institut Teknologi Bandung. Downloaded 28 October
Xplore. 2021, Jakarta
Restrictions - Indonesia
apply.
2021 1st International Conference on Computer Science and Artificial Intelligence (ICCSAI)

using the implementation of Augmented Reality includes determining assets in the form of effects,
technology through a non-professional photography logic, and animation that will be planned to be made in
product in providing real-time, collaborative selfies or a sketch.
wefies and networking and provide unique experiences in a 2. Asset Production is the second stage in the planning
photo booth. process in making digital assets before implementing
them into the engine or creating physical assets if
II. LITERATURE REVIEW needed.
A. Augmented Reality 3. Development is the third stage in processing digital
assets that have been made to be implemented on the
Augmented Reality (AR) is a variation of the Virtual
Spark AR engine and creating some effects,
Environment (VE), VE technology. Make it seem as if the
animations, or interactions using the patch editor.
user has entered a synthetic world [15]. On the other hand,
4. Cloud Setup is a step to synchronize the capture
Augmented Reality, Augmented reality makes users feel
results that are made to be uploaded to the cloud
like virtual objects in the real world. In this case,
automatically.
Augmented Reality adds virtually anything to the real
5. Finishing Display is the final stage to complete and
world. For example, when we add light to an empty table,
adjust the development results on Spark AR, which
the light here signifies a virtual object inserted into the real
has been developed on the screen.
world [16]
6. Performance Test is carried out after the final stage
B. Spark AR Studio using FPS (Frames Per Second) as in previous
Spark AR Studio is software used to create virtual research in Augmented Reality[22]
effects and objects that can be integrated with the natural B. The Real-Time Rendering Augmented Reality Photo
world so that the thing is in the real world. Spark AR Booth
Studio can display objects through barcode or image
The proposed an augmented reality photo booth
scanning to display virtual objects on real objects, making
concept with a real-time rendering system using AR Spark.
the displayed objects appear to be real. For example, such
We are mirroring a display on a PC that displays real-time
as hats, glasses, to unique effects in a photo can make it
rendering in the Spark AR tool to the monitor to appear as
appear as if the object is used by humans in the real world
if the user is in front of a mirror. That the concept we
[13], [17].
named The Real-Time Rendering Augmented Reality
C. Cloud Photo Booth (RTR AR Photo Booth) can be seen in the
Cloud storage is a breakthrough in information Architecture in Figure 1.
technology that is expected to answer the needs of many
people to store large amounts of data and can be stored or
accessed remotely. Cloud computing makes it easy for
users to be able to carry out activities anywhere and
anytime, both in the form of sending data to large data
storage. Currently, cloud computing can be further
developed, for example, automation of cloud capturing.
Here, users take advantage of the cloud computing feature
to save an image of the screen capture (screenshot) that is
carried out into cloud storage. One example of cloud
storage widely used is Microsoft OneDrive, Dropbox, and
Google Drive. Google Drive and Microsoft OneDrive have
advantages in security in accessing data. In addition,
Google Drive and Microsoft OneDrive have features to
collaborate in real-time[18]–[20].
D. Photo Booth
A photo booth is a tool that uses a camera that is used to
take pictures of oneself that can be used by many people.
Photo booth usually has effects that can be used to make
Fig 1. The Architecture of RTR AR Photobooth
the photos more interesting. This is because photo booths
fundamentally combine objects virtually with objects in the
The following is an architectural explanation in Figure
real world (humans as real-world objects) [9], [11], [17],
1, which includes the following ways of working:
[21]. 1. First, Spark AR on the PC requests an image.
III. PROPOSED METHOD 2. Then, the Web Camera continues the request from the
PC by capturing the image.
A. The Schematic Creation Flow 3. After that, the Web Camera takes the picture in front
We proposed The Schematic Creation Flow (TSCF) of it.
for implementing The Real-Time Rendering Augmented 4. Then, the Web Camera sends the captured image to
Reality Photo Booth that consists of 6 stages such as : Spark AR on the PC.
5. PC will mirror the screen in the real-time field
1. Gathering and Planning is a data collection process
rendering Spark AR via HDMI
related to the need for photo booth content which
6. Also, the monitor will display real-time column

290on April 02,2024 at 06:19:27 UTC from IEEE


Authorized licensed use limited to: Institut Teknologi Bandung. Downloaded 28 October
Xplore. 2021, Jakarta
Restrictions - Indonesia
apply.
2021 1st International Conference on Computer Science and Artificial Intelligence (ICCSAI)

mirroring of Spark AR rendering


7. When the user comes to see itself in Monitor
mirroring, the user can request to be captured via the
admin
8. Then, the admin presses the print screen button on the
PC keyboard to capture the image in the real-time
rendering column of Spark AR
9. PC processes the capture by producing an image file
with the .jpg format
10. The file will be automatically saved in the local
Fig 3. Creating digital assets using Blender
screenshot folder on the PC
11. there are changes to the local folder with a request to
2. Asset Production is the second stage in the processing
check for new files
of asset creation, including 3D-based digital assets
12. After that, One Drive will check for changes to the
using Blender tools (See Figure 3), Video Animation
folder by checking for new files
for video space using Adobe Premiere (See Figure 4),
13. Then One Drive will know the changes to the folder
and graphic design for Image Space using Adobe
by uploading the new file to an existing folder in the
Photoshop (See Figure 5)
cloud
14. After the new file has been fully uploaded, the system
will send a notification that the file has been added to
the cloud folder on one drive.
15. PC will display the message of files that have been
successfully added to the cloud
16. Admin notifies cloud link via URL shortening or QR
Code image, which will point to a single drive link so
users can view and download the screenshot file
17. User opens a link notified by admin via smartphone
18. User Smartphone accesses the cloud link by requesting
to open the cloud folder on One Drive
Fig 4. Creating assets for video space using Adobe Premiere Pro
19. One Drive displays the user’s photo image files in the
cloud folder
20. Users view the image file and can be downloaded

IV. RESULT & DISSCUSSION


The implementation of The Real-Time Rendering
Augmented Reality Photo booth based on The Schematic
of Creation Flow are as follows:

1. Gathering and Planning, this stage begins with making


a sketch drawing containing the photo booth concept
you want to use. The depiction of the sketch concept
in Figure 2 which is explained the use of digital assets Fig 5. Creating assets for image space using Adobe Photoshop
on the hat and the image of the event where this photo
booth is implemented, then the image space on the left 3. Development, at this stage, the assets that have been
and the video space is filled with video content with created in the previous process will be implemented on
content related to events and social media promotion. Spark AR by using several additional effects provided
by Spark AR (See Figure 6), such as animation, particle
effects, texture and material

Fig 6. Development on Spark AR

Fig 2. Depiction of concepts through sketches 4. Cloud Setup is a step to synchronize the capture
results using Microsoft One Drive by turning on the
“Automatically Save Screenshots capture to One

291on April 02,2024 at 06:19:27 UTC from IEEE


Authorized licensed use limited to: Institut Teknologi Bandung. Downloaded 28 October
Xplore. 2021, Jakarta
Restrictions - Indonesia
apply.
2021 1st International Conference on Computer Science and Artificial Intelligence (ICCSAI)

Drive”.This Feature makes the print screen or capture


results from the PC integrated into the pictures folder
on OneDrive by selecting Help & Settings in One
Drive on the bar in Windows 10. If this section (See
Figure 7) has finished setting the screen button on the
keyboard when pressed, then the screenshot results
will go directly to the pictures folder directory on
OneDrive on the PC. After that, open
onedrive.live.com and log in using the same one drive
account used on the PC, then go to the directory folder
pictures to set the link settings to get the screenshot
link. You can also turn on other settings such as link Fig 10. Layout View
expiration and password (See Figure 8).

Fig 11. Display on Monitor

Fig 7. Help & Settings of OneDrive in Windows 10

Fig 12. The use of real-time photo booth rendering

Fig 8. Link Settings

5. Finishing the Display, At the final stage, open the image


space using Microsoft Paint, then open the video with the
default Windows 10 application, then make the Windows
toolbar sequence as shown in Figure 9. After that, make a
sequence layout like the concept sketch shown in Figure
10. Then, if the layout has been made, then use the
magnifier tool on windows to adjust it to the monitor size
used. If it is already displayed on the monitor, it will be
like Figure 11. Furthermore, the final result will be as in
Figure 12, the real-time photo booth rendering is ready for
the screenshot and automatically, the image will go
directly to the one drive link (See Figure 13) that has been
set before in Cloud Setup.

Fig 13. The One Drive link, when accessed by the user on a smartphone

Fig 9. Toolbar Windows 10

292on April 02,2024 at 06:19:27 UTC from IEEE


Authorized licensed use limited to: Institut Teknologi Bandung. Downloaded 28 October
Xplore. 2021, Jakarta
Restrictions - Indonesia
apply.
2021 1st International Conference on Computer Science and Artificial Intelligence (ICCSAI)

6. Performance Test, In this section, we measure FPS


on two different device configurations. The
configuration used is (i) Device 1 with Intel Core i7-
9750H, RTX2070 6GB, RAM 16GB (ii) Device 2
with Intel Core i5-10300H, GTX 1650TI 8GB,
RAM 8 GB. Then, we conducted five experiments
on each device with a time (S) of 60 seconds. Each
trial will measure the RTR AR Photo Booth
capability in several people. The first experiment
consisted of 1 people, the second experiment
consisted of 2 people, the third experiment consisted
of 3 people, the fourth experiment consisted of 4
people. The fifth experiment consisted of 5 people. Fig 17. Result of FPS Performance Average on Both Device

The results of FPS Performance on Device 1 tend to be


stable (see Figure 14), where the lowest value ranges from
55 to 71 (See Figure 16), and the average of the five
experiments is above 60 (See Figure 17). Previous research
shows that if the average is above 60, it shows a very good
performance [23]. This indicates that the RTR AR
Photobooth is running perfectly. Then similar results on
Device 2 also show results that tend to be stable (see
Figure 15). The lowest value occurred in the experiment
consisting of 5 people with 30, and the average was 40.33
(See Figure 16). However, if you look at the experimental
results in the five configurations, the average is around
Fig 14. Result of FPS Performance on Device 1 40FPS (See Figure 17), or it can also be classified as
acceptable performance because it is around 30 to 60 FPS
[22]. From the results of the two configurations, it is found
that the RTR AR Photobooth can run above standard
performance because there is no FPS value below 30 FPS
[22]. This means RTR AR Photo Booth has stable
performance in several experiments and can be
implemented as a photo booth for marketing purposes in
exhibitions or events.

V. CONCLUSION
The design and development method that has been
described is one way that can be used by industry players
in implementing photo booths using one of the
Fig 15. Result of FPS Performance on Device 2 technologies currently developing, namely Augmented
Reality. As well as the results that have been explained that
Photobooth can be implemented using existing tools. This
is also supported by several experiments showing that the
performance results can run at acceptable performance
which is able to accommodate selfies to wefies.
Furthermore, this paper can be used as a reference or guide
in implementing the use of an augmented reality-based
photo booth using real-time rendering from Spark AR and
how to share using the cloud on OneDrive. In addition, the
aim of this paper is to implement augmented reality
technology that can be used for marketing purposes in
events that can attract people.
Fig 16. Result of FPS Performance on Both Device

293on April 02,2024 at 06:19:27 UTC from IEEE


Authorized licensed use limited to: Institut Teknologi Bandung. Downloaded 28 October
Xplore. 2021, Jakarta
Restrictions - Indonesia
apply.
2021 1st International Conference on Computer Science and Artificial Intelligence (ICCSAI)

jitter on the presence of virtual entities,” ISS 2019 - Proc. 2019


ACM Int. Conf. Interact. Surfaces Spaces, pp. 5–16, 2019, doi:
REFERENCES 10.1145/3343055.3359710.
[23] S. G. Roy and U. Kanjilal, “Web-based augmented reality for
information delivery services: A performance study,”
[1] N. Limantara, I. S. Edbert, P. J. Widjaya, and M. Adina, “User DESIDOC J. Libr. Inf. Technol., vol. 41, no. 3, pp. 167–174,
acceptance analysis on intacs ERP distribution application using 2021, doi: 10.14429/djlit.41.3.16428.
technology acceptance model,” ICIC Express Lett., vol. 15, no.
4, pp. 349–355, 2021, doi: 10.24507/icicel.15.04.349.
[2] N. S. R. Rais, M. M. J. DIEN, and A. Y. DIEN, “Kemajuan
teknologi informasi berdampak pada generalisasi unsur sosial
budaya bagi generasi milenial,” J. Mozaik, vol. 10, no. 2, pp.
61–71, 2018.
[3] R. Rodríguez, F.-J. Molina-Castillo, and G. Svensson, “The
mediating role of organizational complexity between enterprise
resource planning and business model innovation,” Ind. Mark.
Manag., vol. 84, pp. 328–341, 2020.
[4] P. Ruivo, T. Oliveira, and M. Neto, “Examine ERP post-
implementation stages of use and value: Empirical evidence
from Portuguese SMEs,” Int. J. Account. Inf. Syst., vol. 15, no.
2, pp. 166–184, 2014.
[5] S. V Siar, “Harnessing the Fourth Industrial Revolution:
Creating Our Future Today,” 2019.
[6] P.-F. Hsu, “Integrating ERP and e-business: Resource
complementarity in business value creation,” Decis. Support
Syst., vol. 56, pp. 334–347, 2013.
[7] J. Cirklová, “Reaffirming Identity Through Images. The
commodification of Illusions in the Contemporary Presentation
of Self,” methaodos. Rev. ciencias Soc., vol. 8, no. 1, 2020.
[8] A. Weilenmann and T. Hillman, “Selfies in the wild: Studying
selfie photography as a local practice,” Mob. Media Commun.,
vol. 8, no. 1, pp. 42–61, 2020.
[9] B. Martínez, S. Casas, M. Vidal-González, L. Vera, and I.
García-Pereira, “TinajAR: An edutainment augmented reality
mirror for the dissemination and reinterpretation of cultural
heritage,” Multimodal Technol. Interact., vol. 2, no. 2, pp. 1–13,
2018, doi: 10.3390/mti2020033.
[10] R. Anita, R. Hidayati, and R. Juliani, “Eksistensi Diri Pengguna
Photo Booth Di Kabupaten Aceh Barat,” SOURCE J. Ilmu
Komun., vol. 5, no. 2, 2020.
[11] F. Saptodewo, “Perancangan karakter bregada keraton
Yogyakarta sebagai media visual pendukung photo booth,” J.
Desain, vol. 5, no. 02, pp. 74–85, 2018.
[12] F. Immanuel and A. P. Widodo, “Pengembangan Aplikasi
Photobooth Berbasis Augmented Reality,” J. Masy. Inform.,
vol. 11, no. 1, pp. 22–34.
[13] I. K. A. M. Putra, “PERANCANGAN FILTER INSTAGRAM
BERBASIS AUGMENTED REALITY DENGAN FACE
MASK SPARK AR PADA AKUN NEW MEDIA COLLEGE,”
J. Teknol. Inf. dan Komput., vol. 6, no. 3, 2020.
[14] I. Pachoulakis and K. Kapetanakis, “Augmented reality
platforms for virtual fitting rooms,” Int. J. Multimed. Its Appl.,
vol. 4, no. 4, p. 35, 2012.
[15] H. Anay, Ü. Özten, and M. Ünal, “A New Environment:
Augmented Reality,” in Game+ Design Education, Springer,
2021, pp. 241–253.
[16] R. Yung and C. Khoo-Lattimore, “New realities: a systematic
literature review on virtual reality and augmented reality in
tourism research,” Curr. Issues Tour., vol. 22, no. 17, pp. 2056–
2081, 2019.
[17] T. Kitamura, K. Yasui, and Y. Nakatani, “Proposal of Using
Digital Mirror Signage and AR Pictogram for Follow Me
Evacuation Guidance,” in International Conference on Human-
Computer Interaction, 2019, pp. 307–314.
[18] S. Alotaibi, H. Alomair, and M. Elhussein, “Comparing
performance of commercial cloud storage systems: The case of
dropbox and one drive,” 2019 Int. Conf. Comput. Inf. Sci. ICCIS
2019, pp. 1–5, 2019, doi: 10.1109/ICCISci.2019.8716385.
[19] N. Darmawansyah, “PENGEMBANGAN MODEL PHOTO
BOOTH BERFORMAT GAMBAR BERGERAK DENGAN
SISTEM CLOUD SHARING.” Universitas Negeri Makassar,
2021.
[20] Q. Zhang et al., “DeltaCFS: Boosting delta sync for cloud
storage services by learning from NFS,” in 2017 IEEE 37th
International Conference on Distributed Computing Systems
(ICDCS), 2017, pp. 264–275.
[21] E. M. Keen, J. Wren, É. O’Mahony, and J. Wray, “catRlog: a
photo-identification project management system based in R,”
Mamm. Biol., pp. 1–10, 2021.
[22] T. Louis, J. Troccaz, A. Rochet-Capellan, and F. Bérard, “Is it
real? Measuring the effect of resolution, latency, frame rate and

294on April 02,2024 at 06:19:27 UTC from IEEE


Authorized licensed use limited to: Institut Teknologi Bandung. Downloaded 28 October
Xplore. 2021, Jakarta
Restrictions - Indonesia
apply.

You might also like