Download as pdf or txt
Download as pdf or txt
You are on page 1of 9

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/338567379

Virtual and augmented reality: potential applications in radiology

Article in Acta Radiologica · January 2020


DOI: 10.1177/0284185119897362

CITATIONS READS

42 1,940

11 authors, including:

Mohammad Elsayed Nadja Kadom


Memorial Sloan Kettering Cancer Center Emory University
33 PUBLICATIONS 313 CITATIONS 177 PUBLICATIONS 3,236 CITATIONS

SEE PROFILE SEE PROFILE

Comeron Ghobadi Omran Al Dandan


The University of Chicago Medical Center Imam Abdul Rahman bin Faisal University
21 PUBLICATIONS 570 CITATIONS 43 PUBLICATIONS 465 CITATIONS

SEE PROFILE SEE PROFILE

All content following this page was uploaded by Mohammad Elsayed on 21 April 2021.

The user has requested enhancement of the downloaded file.


Review Article

Acta Radiologica
0(0) 1–8
Virtual and augmented reality: ! The Foundation Acta Radiologica
2020
potential applications in radiology Article reuse guidelines:
sagepub.com/journals-permissions
DOI: 10.1177/0284185119897362
journals.sagepub.com/home/acr

Mohammad Elsayed1 , Nadja Kadom1, Comeron Ghobadi2,


Benjamin Strauss2, Omran Al Dandan3 ,
Abhimanyu Aggarwal4, Yoshimi Anzai5, Brent Griffith6,
Frances Lazarow4, Christopher M Straus2 and Nabile M Safdar1

Abstract
The modern-day radiologist must be adept at image interpretation, and the one who most successfully leverages new
technologies may provide the highest value to patients, clinicians, and trainees. Applications of virtual reality (VR) and
augmented reality (AR) have the potential to revolutionize how imaging information is applied in clinical practice and
how radiologists practice. This review provides an overview of VR and AR, highlights current applications, future
developments, and limitations hindering adoption.

Keywords
Computer applications, virtual imaging, image manipulation/reconstruction, interventional, education
Date received: 7 October 2019; accepted: 2 December 2019

Introduction
(3). AR differs from VR in that the real world is not
Applications of virtual reality (VR) and augmented eliminated from the user’s view. Instead, virtual objects
reality (AR) have the potential to revolutionize how are superimposed onto the real world through a HMD
imaging information is applied in clinical practice and or other display system, so that the user is able to inter-
how radiologists practice (1,2). In this review, we per- act simultaneously with the real world as well as with
formed a targeted literature search (PubMed, Google virtual objects (3–5). Users may interact with graphics
Scholar) related to use of AR and VR in medicine, and virtual objects through the use of voice commands,
medical education, and radiology. References within hand gestures, or with a controller (3,6).
manuscripts including other manuscripts and news
media are included. Articles containing specific inter-
ventions were prioritized by study quality and publica- 1
Department of Radiology and Imaging Sciences, Emory University
tion date. This review provides an overview of VR and School of Medicine, Atlanta, GA, USA
AR, highlights current applications, future develop- 2
Department of Radiology, The University of Chicago Pritzker School of
ments, and limitations hindering adoption. Medicine, IL, USA
3
Department of Radiology, Imam Abdulrahman Bin Faisal University
College of Medicine, Dammam, Eastern Province, Saudi Arabia
Definition of VR and AR 4
Department of Radiology, Eastern Virginia Medical School, Norfolk, VA,
Both VR and AR, although distinct from each other, USA
5
Department of Radiology and Imaging Sciences, University of Utah
refer to simulations in which virtual elements are used School of Medicine, Salt Lake City, Utah, USA
to replace or supplement native sensory input. VR is an 6
Department of Radiology, Henry Ford Health System, Detroit, MI, USA
immersive simulation which creates the perception of
being present within a non-physical virtual world. Corresponding author:
Mohammad Elsayed, Department of Radiology and Imaging Sciences,
This is typically accomplished with a head-mounted Emory University School of Medicine, 1364 Clifton Road NE, Suite BG03,
display (HMD) in which a user receives sensory input Atlanta, GA 303022, USA.
from the display rather than their native surroundings Email: mohammad.elsayed@emory.edu
2 Acta Radiologica 0(0)

Technology development printed into models that can be interactively explored


(13,14). Use of 3D-printed models has improved pro-
VR and AR concepts have existed for several decades.
cedural planning (15–32), medical research, and medi-
Perhaps the earliest application of virtual reality was
cal education (26,33–37). Despite the benefits of 3D
pioneered by cinematographer Morton Heilig, who in
printing, there are several limitations which hinder its
1962 designed and patented a “sensorama,” a wide-
angled video booth in which viewers were able to widespread adoption, including cost, turnaround time,
watch a film while having their sensory systems and size constraints of printed models (14). VR and AR
engaged through the use of fans, odor-emitters, stereo- technologies provide several advantages over 3D print-
scopic sound, and motional chairs (7). An early version ing (Table 1). Reconstructions can be generated at
of the HMD, attached to large sensors and a mechan- comparatively low costs and turnaround times.
ical arm suspended from the ceiling, was later devel- Specialized software allows models to be viewed at dif-
oped by Ivan Sutherland in 1968 (8). ferent sizes and manipulated in dynamic ways that
VR and AR applications were initially costly and may improve an understanding of complex anatomy
had limited capabilities (9). However, advances in tech- (Fig. 1). The ease of use, lower cost, shorter turnaround
nology, such as decreased costs of smartphone display time, and customizability are appealing features of VR
technology, graphics processing, and motion tracking and AR that can supplement or substitute 3D printing
(3), have led to a boom of VR and AR gaming appli- in specific applications (38). While controlled data com-
cations and a renewed interest in medical imaging paring the two modalities are limited, some studies
applications. The “miniaturization” of technology has report advantages over 3D printing. For example,
resulted in the development of high-performance wire- when evaluating cerebrovascular anatomy for neurosur-
less HMDs (10). Immersive reality has been further pop- gical training, users reported greater resolution and edu-
ularized by increased web connectivity and open source cational potential with VR over 3D printing (39).
software, which has facilitated exploration, collabora-
tion, and development of VR and AR applications. Diagnosis and surgical planning
Such advances have enabled innumerable applications
VR and AR can aid in the understanding of complex
within medicine, including in medical education, proce-
anatomical relationships. For example, AR models of
dural planning, and therapeutic intervention. Total
kidneys have been generated for surgical planning and
spending in VR and AR is expected to rise dramatically,
decision-making before robotic-assisted partial nephrec-
from $11.4 billion in 2017 to nearly $215 billion in 2021,
with spending in healthcare applications projected to tomy (40). In the setting of camera-assisted surgery in
reach $5.1 billion in 2025 (11,12). which the operator is limited by the endoscope’s internal
field of view, AR applications can transpose the endo-
scopic view onto the patient, aiding the surgeon’s ability
Current and future applications to navigate (41). Successful use of this technology has
been described for nephrectomy, nephrolithotomy, adre-
Alternative to 3D printing nalectomy, brain tumor resection, cerebral aneurysm
In the last decade, physicians have increasingly utilized clipping, splenectomy, and abdominal tumor resection
3D-printing technology, in which reconstructions are (42–53). In mammography, viewing images of the breast

Table 1. Comparison between 3D printing to VR and AR.*

3D printing VR and AR

Interactivity Haptic experience Visual simulation


Render customizability (e.g. resizing, Before printing Before and in real time
coloring, morphing)
Associated costs Software Software
Access to 3D printer HMD
Printing material
Turnaround time Hours to weeks (depending on how Minutes to hours
models are printed)
Ease of use for end-user Easy Easy to difficult, depending on
complexity of the platform
Potential side effects for end-user None Cyber sickness
*Table based on the authors’ experience.
AR, augmented reality; HMD, head-mounted display; VR, virtual reality.
Elsayed et al. 3

Fig. 1. 3D-printed model and virtual reconstruction of conjoined twins for surgical planning.

in AR allows for stereoscopic depth perception, 3D (such as “road-mapping with fluoroscopy”) are limited
cursor use, and joystick navigation (54,55). Joystick nav- and will require more robust research than “proof-
igation involves the use of a handheld controller, which of-concept” demonstrations to validate clinical utility.
can be used to “fly” throughout an image to better visu-
alize target areas. These tools may ultimately improve The reading room
detection and localization of abnormal microcalcifica-
Attempts are underway to redesign the conventional
tions and tumors (54,55). VR reconstructions of the
reading room with virtual reality. Typical reading
breast have also been introduced for the assessment of
rooms require highly specialized equipment and specific
tumor response after neoadjuvant chemotherapy and for
aiding in surgical planning (55,56). lighting conditions to ensure accurate image interpre-
tation. A novel virtual reality reading room has been
introduced, where images can be interpreted using a
Interventional radiology
commercially available HMD (61). Optimal image con-
VR and AR have the potential to revolutionize image- ditions can be reconstructed in a virtual environment,
guided interventions and improve patient outcomes. precluding the need for controlled external lighting
Real-time AR reconstructions superimposed onto conditions and specialized monitors (61). In this spe-
patients for percutaneous and endovascular interven- cific application, image navigation is performed with
tions may provide benefits over conventional localiza- the use of hand gestures, which allows for dynamic
tion techniques. A pilot study showed that viewing VR visualization, such as real-time object rotation and
reconstructions of splenic artery aneurysms before tilting. Users found the platform to have sufficient
endovascular embolization improved operator confi- ease of use and interpretability without reporting any
dence (57). In one model, AR reconstructions of the discomfort (61). Use of VR reading rooms could cut
aorta and its major branches were transposed onto a equipment and maintenance costs, and by eliminating
phantom and, with the use of electromagnetic markers, effects of ambient lighting conditions could potentially
an endovascular catheter was tracked within the virtu- improve diagnostic accuracy.
ally generated vascular tree (58). This type of applica-
tion could theoretically reduce procedure time and
Relaxation/Distraction therapy
radiation exposure (58). AR also has growing promise
in percutaneous interventions, such as biopsies and Distraction or relaxation therapies aim to reduce
ablations (59). Although there are challenges associated patient pain and anxiety by using sensory stimuli in
with patient movement and image mismatch when lieu of pharmacological substances. Common distrac-
using AR, advances in image reconstruction have sig- tion methods include listening to music or viewing
nificantly improved accurate lesion localization with scenes on a standard digital screen (62–64). A distinct
AR, achieving a difference of <5 mm between virtual benefit of using VR for distraction/relaxation therapy
and real distances (60). Currently, however, studies is due to its completely immersive nature. Multiple
evaluating objective benefits of AR over conventional studies have shown that VR can help reduce the use
localization techniques in interventional radiology of sedation during MR imaging (65–67). VR has also
4 Acta Radiologica 0(0)

benefited pediatric patients aged 4–6 years by decreas- procedures, time constraints in busy clinical services
ing pain and anxiety during dental procedures (68), have made it challenging to provide standardized
intravenous line placement (69), and other procedural teaching for trainees. Trainees and faculty would
interventions (70). In adult burn victims, the use of VR favor implementation of standardized procedural train-
distraction therapy during dressing changes reduced ing during radiology residency (83), and VR lends itself
pain, anxiety, and length of hospitalization (71). to creating such curricula. Current simulations based
Reductions in pain were more notable with higher on phantoms do not provide an experience that accu-
quality headsets that covered a wider field of view, rately portrays a live situation, while VR simulations,
suggesting that more immersive VR experiences are such as for cardiopulmonary resuscitation, can provide
more effective (72). In a separate pilot study, VR relax- an extremely high fidelity and customizable experience
ation therapy was safely used during orthopedic sur- (84). VR and AR simulations may also be used to more
gery under regional anesthesia (73). Distraction accurately assess trainee performance, such as knowl-
therapy also decreased intravenous sedation and pro- edge and skill levels in neurosurgery (1).
cedure related pain during preoperative adductor canal Patients may also prefer that trainees undergo pro-
catheter placement before total knee arthroplasty (74). cedural training in a simulated environment before per-
The efficacy of VR relaxation therapy has been validat- forming procedures on patients. By using VR, trainees
ed by functional magnetic resonance imaging (fMRI) can be transported into a procedure room where they
(75). Users exposed to painful thermal stimuli during may observe and even participate in virtual procedures
fMRI scans reported less subjective pain and had sta- before performing them on patients. This allows edu-
tistically significant reductions in pain-related brain cators to provide standardized and curated educational
activity while using VR relaxation therapy (75). The training material to all trainees. In a pilot program
reported successes of using VR for distraction therapy, implemented by McCarthy et al. (10), radiology faculty
and trainees were able to watch interventional radiolo-
during invasive surgical procedures warrants adoption
gy tutorials in VR. This program allowed trainees to
in interventional radiology as well. Patients prone to
experience the process of learning with an instructor in
anxiety, claustrophobia, or high analgesic requirements
a procedure room. The majority of pilot participants
during interventional radiology procedures may find
reported that the module they watched was excellent or
this therapy especially beneficial.
good and had the potential to contribute to the future
of interventional radiology training (10). VR can also
Informed consent process fill gaps in procedural experience by providing simula-
Informed consent, generally speaking, is a process of tions of procedures that a trainee rarely encounters
communicating the purposes, risks, and benefits of pro- during their graduate medical training (85,86).
cedures between a patient and provider (76). There has Teaching challenging anatomical concepts can be
been a shift toward a more patient-centered model in made simpler with VR and AR. 3D reconstructions
which visual aids are used in an effort to overcome of images and post-processing software can be used
lower levels of patient health literacy and ultimately to generate high quality interactive VR and AR simu-
achieve a greater sense of autonomy in patients (77). lations. Such simulations will enable the user to manip-
Improving the informed consent process can result in ulate and edit objects in ways that are not possible
decreased anxiety, higher patient satisfaction, and an using other modalities, such as 3D printing (3). For
improved understanding of procedures (78–80). Part of example, virtual reality has been used to teach anatomy
the consent process is an explanation of the procedure, to medical students with “virtual dissections” (87).
which could be accomplished by using VR. For exam- Advances in HMDs and decreasing costs have
ple, patients who were primed with what to experience enabled the “VR classroom.” For example, teaching
during the recovery process also experienced lower modules recorded with specialized 360 cameras can
postoperative pain, a shorter length of stay, and less be viewed in VR, which may provide more engagement
negative affect (81,82). Based on such positive effects, than conventional teaching methods. Certain applica-
the use of VR to enhance patient education and tions also enable users to convene in a virtual location
consent for radiology procedures should be further (88). This technology can be used to enhance radiology
explored. collaboration and education, including in underserved
locations. As commercial medical virtual reality appli-
cations continue to emerge, new interactive methods to
Education and training teach radiology will be developed (3).
Advances in diagnostic and interventional radiology Overall, the advent of VR simulations in medical
have increased the scope of procedures performed by education can increase opportunities for providing
radiologists. Despite the growing breadth of radiology high-quality standardized educational simulations and
Elsayed et al. 5

assessments at scale, while minimizing the need for ded- Caution should be taken when implementing this
icated physical space, costly simulation manikins, or technology in medicine. Numerous VR and AR appli-
need for human cadavers. cations have already been cleared by the FDA using the
510(k) pathway, where safety and effectiveness are
Limitations and ethical considerations in demonstrated by showing “substantial equivalence”
to pre-existing 3D modeling software (96,97).
VR and AR
However, more research is required to ensure that the
One of the most notable side effects of immersive real- introduction of this technology in specific use-cases
ity is “cyber sickness.” In essence, this describes sensa- confers a benefit to the radiologist workflow and
tions of discomfort including nausea, headache, and patient care.
dizziness when using VR and AR applications (89– Ethical concerns have been raised regarding any
91). It is posited that cyber sickness is due to vestibular unintended consequences when VR and AR supple-
mismatch, in which there is the visual perception of ment or replace existing methods (98). For example,
motion in a simulation without matching input from inaccuracies in simulations may contribute to improper
the vestibular system (3). Multiple strategies aimed at training. An analogy to this is flight training of military
reducing cyber sickness have been explored, such as pilots, where a virtual simulation may not accurately
developing VR simulations which only shows move- replicate certain scenarios, leading to a distorted per-
ment when there is actual movement of the user’s ception of real-time flight (98). In addition, trainees
head (3). Advanced VR HMDs can track nuanced may not receive the same level of scrutiny as they
head movements to reduce vestibular mismatch (3). would during live interventions, potentially fostering
Eye strain may also contribute to discomfort with the development of flawed techniques.
VR, which can be caused by low frame-rates and As VR and AR technology evolves, thorough con-
HMDs which do not properly accommodate the sideration should be given on how it is introduced into
user’s eyes (3,91). Developers must anticipate potential medicine. Special attention should be placed on major
discomfort with VR and find ways to mitigate participants and their motivations in this arena.
unwanted side effects when creating applications. Oversight from a combination of professions including
AR must overcome several limitations to become radiologist and non-radiologist physicians, informatics
useful during image-guided procedures. For example, specialists, developers, artists, and other industry pro-
when virtually reconstructed anatomy is transposed
fessionals are required to adequately test, facilitate, and
over a patient in real time with AR HMDs, the
record changes in this field. Cautious introduction of
image location must be accurate. Inaccurate localiza-
VR and AR will ensure that it is incorporated in a safe
tion may result in a less efficient procedure or unnec-
and effective manner.
essary patient harm. Techniques are being developed to
optimize AR image reconstruction, including overcom-
ing respiratory motion and organ deformation Conclusion
(60,92–94). In addition to accurate image localization, Advances in VR and AR have enabled novel
the device must feel like a “natural extension” of the applications in education, training, and patient care
operator’s senses (95). The image must move smoothly in radiology. We are currently exploring the utility of
and accurately while the operator’s head position VR for visualization of complex anatomy and proce-
changes. The HMD must also be light, comfortable, dural training in interventional radiology. We believe
and mobile enough for the operator to use during that further exploration and thorough research is war-
potentially long image-guided interventions (95). ranted to better understand how to best utilize this
VR and AR technology are still limited with regards technology to optimize radiology training and improve
to accurately portraying reality. Creating a realistic vir-
patient care.
tual experience, while feasible using current technolo-
gy, can require significant time, financial resources, and Declaration of conflicting interests
expertise. Therefore, developing simulations that do
not require high levels of accuracy, such as those sim- The authors declared no potential conflicts of interest with
ulating the performance of simple tasks may provide respect to the research, authorship, and/or publication of this
the highest initial value (86). In addition, more high- article.
quality research is necessary to understand whether VR
and AR educational and training applications in radi- Funding
ology provide a significant advantage over convention- The authors received no financial support for the research,
al methods to justify costs. authorship, and/or publication of this article.
6 Acta Radiologica 0(0)

ORCID iDs 16. D’Urso PS, Earwaker WJ, Barker TM, et al. Custom
Mohammad Elsayed https://orcid.org/0000-0002-2353- cranioplasty using stereolithography and acrylic. Br J
5409 Plast Surg 2000;53:200–204.
Omran Al Dandan https://orcid.org/0000-0002-2472-8261 17. Faber J, Berto PM, Quaresma M. Rapid prototyping as a
tool for diagnosis and treatment planning for maxillary
canine impaction. Am J Orthod Dentofacial Orthop
References 2006;129:583–589.
1. Pelargos PE, Nagasawa DT, Lagman C, et al. Utilizing 18. Mavili ME, Canter HI, Saglam-Aydinatay B, et al. Use
virtual and augmented reality for educational and of three-dimensional medical modeling methods for pre-
clinical enhancements in neurosurgery. J Clin Neurosci cise planning of orthognathic surgery. J Craniofac Surg
2017;35:1–4. 2007;18:740–747.
2. Committee on Diagnostic Error in Health C, Board on 19. Muller A, Krishnan KG, Uhl E, et al. The application of
Health Care S, Medicine Io, et al. Technology and Tools rapid prototyping techniques in cranial reconstruction
in the Diagnostic Process. In: Balogh EP, Miller BT, Ball and preoperative planning in neurosurgery. J Craniofac
JR (eds) Improving Diagnosis in Health Care. Washington, Surg 2003;14:899–914.
DC: National Academies Press, 2015, pp.217–262. 20. Poukens J, Haex J, Riediger D. The use of rapid proto-
3. Sutherland J, Belec J, Sheikh A, et al. Applying modern typing in the preoperative planning of distraction osteo-
virtual and augmented reality technologies to medical genesis of the cranio-maxillofacial skeleton. Comput
images and models. J Digit Imaging 2019;32:38–53. Aided Surg 2003;8:146–154.
4. Moro C, Stromberga Z, Raikos A. The effectiveness of 21. Guarino J, Tennyson S, McCain G, et al. Rapid proto-
virtual and augmented reality in health sciences and med- typing technology for surgeries of the pediatric spine
ical anatomy. 2017;10:549–559. and pelvis: benefits analysis. J Pediatr Orthop
5. Plasencia DM. One step beyond virtual reality: connect- 2007;27:955–960.
ing past and future developments. XRDS 2015;22:18–23. 22. Hurson C, Tansey A, O’Donnchadha B, et al.
6. Pratt P, Ives M, Lawton G, et al. Through the HoloLens Rapid prototyping in the assessment, classification and
looking glass: augmented reality for extremity recon- preoperative planning of acetabular fractures. Injury
struction surgery using 3D vascular models with perfo- 2007;38:1158–1162.
rating vessels. Eur Radiol Exp 2018;2:2. 23. Wurm G, Tomancok B, Pogady P, et al. Cerebrovascular
7. Drummond K, Hamburger E, Houston T, et al. The Rise stereolithographic biomodeling for aneurysm surgery.
and Fall and Rise of Virtual Reality. Available at: http:// Technical note. J Neurosurg 2004;100:139–145.
theverge.com/a/virtual-reality 24. Giesel FL, Hart AR, Hahn HK, et al. 3D reconstructions
8. Sutherland IE. A head-mounted three dimensional dis- of the cerebral ventricles and volume quantification
play. In: Proceedings of the December 9–11, 1968, fall in children with brain malformations. Acad Radiol
joint computer conference, part I. New York, NY: 2009;16:610–617.
ACM, 1968:757–764. 25. Armillotta A, Bonhoeffer P, Dubini G, et al. Use of rapid
9. Schnipper M. Seeing is believing: The state of virtual prototyping models in the planning of percutaneous pul-
reality, https://www.theverge.com/a/virtual-reality (2017, monary valved stent implantation. Proc Inst Mech Eng H
accessed November 2019). 2007;221:407–416.
10. McCarthy CJ, Yu AYC, Do S, et al. Interventional 26. Kim MS, Hansgen AR, Wink O, et al. Rapid prototyp-
Radiology Training Using a Dynamic Medical ing: a new tool in understanding and treating structural
Immersive Training Environment (DynaMITE). J Am heart disease. Circulation 2008;117:2388–2394.
Coll Radiol 2018; 15: 789–793. 27. Hiramatsu H, Yamaguchi H, Nimi S, et al. [Rapid pro-
11. Worldwide Spending on Augmented and Virtual totyping of the larynx for laryngeal frame work surgery].
Reality. Available At: https://www.idc.com/getdoc.jsp? Nihon Jibiinkoka Gakkai Kaiho 2004;107:949–955.
containerId=prUS42959717 (last accessed Oct 2018). 28. D’Urso PS, Barker TM, Earwaker WJ, et al.
12. Healthcare Augmented & Virtual Reality Market Worth Stereolithographic biomodelling in cranio-maxillofacial
$5.1 Billion By 2025. 2017. Available at: https://www.grand surgery: a prospective trial. J Craniomaxillofac Surg
viewresearch.com/press-release/global-augmented-reality- 1999;27:30–37.
ar-virtual-reality-vr-in-healthcare-market (last accessed 29. Kalet IJ, Wu J, Lease M, et al. Anatomical information
Oct 2018). in radiation treatment planning. Proc AMIA Symp
13. Rengier F, Mehndiratta A, von Tengg-Kobligk H, et al. 3D 1999:291–295.
printing based on imaging data: review of medical applica- 30. Sun SP, Wu CJ. Using the full scale 3D solid anthropo-
tions. Int J Comput Assist Radiol Surg 2010;5:335–341. metric model in radiation oncology positioning and
14. McGurk M, Amis AA, Potamianos P, et al. Rapid pro- verification. Conf Proc IEEE Eng Med Biol Soc
totyping techniques for anatomical modelling in medi- 2004;5:3432–3435.
cine. Ann R Coll Surg Engl 1997;79:169–174. 31. Zemnick C, Woodhouse SA, Gewanter RM, et al. Rapid
15. Nekooei S, Sardabi M, Razavi ME, et al. Implantation of prototyping technique for creating a radiation shield.
Customized, Preshaped Implant for Orbital Fractures J Prosthet Dent 2007;97:236–241.
with the Aid of Three-dimensional Printing. Middle 32. Sulaiman A, Boussel L, Taconnet F, et al. In vitro
East Afr J Ophthalmol 2018;25:56–58. non-rigid life-size model of aortic arch aneurysm for
Elsayed et al. 7

endovascular prosthesis assessment. Eur J Cardiothorac 49. Mahvash M, Besharati Tabrizi L. A novel augmented
Surg 2008;33:53–57. reality system of image projection for image-guided neu-
33. Suzuki M, Ogawa Y, Kawano A, et al. Rapid prototyp- rosurgery. Acta Neurochir (Wien) 2013;155:943–947.
ing of temporal bone for surgical training and medical 50. Stadie AT, Kockro RA. Mono-stereo-autostereo: the
education. Acta Otolaryngol 2004;124:400–402. evolution of 3-dimensional neurosurgical planning.
34. Knox K, Kerber CW, Singel SA, et al. Rapid prototyping Neurosurgery 2013;72 Suppl 1:63–77.
to create vascular replicas from CT scan data: making 51. Konishi K, Hashizume M, Nakamoto M, et al.
tools to teach, rehearse, and choose treatment strategies. Augmented reality navigation system for endoscopic sur-
Catheter Cardiovasc Interv 2005;65:47–53. gery based on three-dimensional ultrasound and comput-
35. Bruyere F, Leroux C, Brunereau L, et al. Rapid proto- ed tomography: Application to 20 clinical cases.
typing model for percutaneous nephrolithotomy training. International Congress Series 2005;1281:537–542.
J Endourol 2008;22:91–96. 52. Ieiri S, Uemura M, Konishi K, et al. Augmented reality
36. Canstein C, Cachot P, Faust A, et al. 3D MR flow anal- navigation system for laparoscopic splenectomy in chil-
ysis in realistic rapid-prototyping model systems of the dren based on preoperative CT image using optical track-
thoracic aorta: comparison with in vivo data and compu- ing device. Pediatr Surg Int 2012;28:341–346.
tational fluid dynamics in identical vessel geometries. 53. Souzaki R, Ieiri S, Uemura M, et al. An augmented real-
Magn Reson Med 2008;59:535–546. ity navigation system for pediatric oncologic surgery
37. Sodian R, Schmauss D, Schmitz C, et al. 3-dimensional based on preoperative CT and MRI images. J Pediatr
printing of models to create custom-made devices Surg 2013;48:2479–2483.
for coil embolization of an anastomotic leak after aortic 54. Rancati A, Angrigiani C, Nava MB, et al. Augmented
arch replacement. Ann Thorac Surg 2009; 88:974–978. reality for breast imaging. Minerva Chir 2018;73:341–344.
38. Radhika Dhuru AS. 3 Ways Virtual Reality Can 55. Douglas DB, Boone JM, Petricoin E, et al. Augmented
Supplement Your Medical 3D Printing Activities (And
Reality Imaging System: 3D Viewing of a Breast Cancer.
3 Ways It Won’t). Available at: https://www.material
J Nat Sci 2016;2:e215.
ise.com/en/blog/3-ways-virtual-reality-supplements-medi
56. Douglas DB, Petricoin EF, Liotta L, et al. D3D aug-
cal-3d-printing (last accessed Nov 2019).
mented reality imaging system: proof of concept in mam-
39. Bairamian D, Liu S, Eftekhar B. Virtual reality angiogram
mography. Med Devices (Auckl) 2016;9:277–283.
vs 3-dimensional printed angiogram as an educational tool-
57. Devcic Z, Idakoji I, Kesselman A, et al. 4:03 PM
A comparative study. Neurosurgery 2019;85:E343–e349.
Abstract No. 30 Augmented virtual reality assisted treat-
40. Wake N, Bjurlin MA, Rostami P, et al. Three-dimension-
ment planning for splenic artery aneurysms: a pilot study.
al printing and augmented reality: enhanced precision for
J Vasc Intervent Radiol 2018;29:S17.
robotic assisted partial nephrectomy. Urology
58. Kuhlemann I, Kleemann M, Jauer P, et al. Towards
2018;116:227–228.
X-ray free endovascular interventions - using HoloLens
41. Nicolau S, Soler L, Mutter D, et al. Augmented reality
in laparoscopic surgical oncology. Surg Oncol for on-line holographic visualisation. Healthc Technol
2011;20:189–201. Lett 2017;4:184–187.
42. Simpfendorfer T, Gasch C, Hatiboglu G, et al. 59. Nicolau SA, Pennec X, Soler L, et al. An augmented real-
Intraoperative computed tomography imaging for navi- ity system for liver thermal ablation: Design and evalua-
gated laparoscopic renal surgery: first clinical experience. tion on clinical cases. Med Image Anal 2009;13:494–506.
J Endourol 2016;30:1105–1111. 60. Solbiati M, Passera KM, Rotilio A, et al. Augmented
43. Teber D, Guven S, Simpfendorfer T, et al. Augmented reality for interventional oncology: proof-of-concept
reality: a new tool to improve surgical accuracy during study of a novel high-end guidance system platform.
laparoscopic partial nephrectomy? Preliminary in vitro Eur Radiol Exp 2018;2:18.
and in vivo results. Eur Urol 2009;56:332–338. 61. Sousa M, Mendes D, Paulo S, et al. VRRRRoom:
44. Su L-M, Vagvolgyi BP, Agarwal R, et al. Augmented Virtual Reality for Radiologists in the Reading Room.
reality during robot-assisted laparoscopic partial In: Proceedings of the 2017 CHI Conference on Human
nephrectomy: toward real-time 3D-CT to stereoscopic Factors in Computing Systems, Denver, Colorado, May
video registration. Urology 2009;73:896–900. 6–11, 2017. New York, NY: ACM, 2017:4057–4062.
45. Ukimura O, Gill IS. Imaging-Assisted Endoscopic Surgery: 62. Lechtzin N, Busse AM, Smith MT, et al. A randomized
Cleveland Clinic Experience. J Endourol 2008;22:803–810. trial of nature scenery and sounds versus urban scenery
46. Marescaux J, Rubino F, Arenas M, et al. Augmented- and sounds to reduce pain in adults undergoing bone
reality-assisted laparoscopic adrenalectomy. JAMA marrow aspirate and biopsy. J Altern Complement
2004;292:2214–2215. Med 2010;16:965–972.
47. Baumhauer M, Feuerstein M, Meinzer H-P, et al. 63. Evans D. The effectiveness of music as an intervention
Navigation in endoscopic soft tissue surgery: perspectives for hospital patients: a systematic review. J Adv Nurs
and limitations. J Endourol 2008;22:751–766. 2002;37:8–18.
48. Besharati Tabrizi L, Mahvash M. Augmented reality- 64. Tan SY. Cognitive and cognitive-behavioral methods for
guided neurosurgery: accuracy and intraoperative appli- pain control: a selective review. Pain 1982;12:201–228.
cation of an image projection technique. J Neurosurg 65. Das DA, Grimmer KA, Sparnon AL, et al. The efficacy
2015;123:206–211. of playing a virtual reality game in modulating pain for
8 Acta Radiologica 0(0)

children with acute burn injuries: a randomized con- 83. Prater A, Rostad BS, Ebert EL, et al. Towards consen-
trolled trial [ISRCTN87413556]. BMC Pediatr 2005;5:1. sus: training in procedural skills for diagnostic radiology
66. Hoffman HG, Chambers GT, Meyer WJ, 3rd, et al. residents-current opinions of residents and faculty at a
Virtual reality as an adjunctive non-pharmacologic anal- large academic center. Curr Probl Diagn Radiol
gesic for acute burn pain during medical procedures. Ann 2018;47:387–392.
Behav Med 2011;41:183–191. 84. Murphy B. Virtual reality taking the dummies out of med-
67. Khan J, Donnelly L, Koch BL, et al. A program to ical simulation. Available at: https://www.ama-assn.org/edu
decrease the need for pediatric sedation for CT and cation/accelerating-change-medical-education/virtual-reali
MRI. Applied Radiology 2007;36:30. ty-taking-dummies-out-medical (last accessed 9 Jan 2018).
68. Asl Aminabadi N, Erfanparast L, Sohrabi A, et al. The 85. Harrison P, Raison N, Abe T, et al. The validation of a
impact of virtual reality distraction on pain and anxiety novel robot-assisted radical prostatectomy virtual reality
during dental treatment in 4-6 year-old children: a ran- module. J Surg Educ 2018;75:758–766.
domized controlled clinical trial. J Dent Res Dent Clin 86. Olasky J, Sankaranarayanan G, Seymour NE, et al.
Dent Prospects 2012;6:117–124. Identifying opportunities for virtual reality simulation
69. Gold JI, Kim SH, Kant AJ, et al. Effectiveness of virtual in surgical education: a review of the Proceedings from
reality for pediatric pain distraction during i.v. place- the Innovation, Design, and Emerging Alliances in
ment. Cyberpsychol Behav 2006;9:207–212. Surgery (IDEAS) Conference: VR Surgery. Surg Innov
70. Won AS, Bailey J, Bailenson J, et al. Immersive virtual 2015;22:514–521.
reality for pediatric pain. Children (Basel) 2017;4:E52. 87. Mitzi B. How VR is Revolutionizing the Way Future
71. Scapin S, Echevarria-Guanilo ME, Boeira Fuculo Junior Doctors are Learning About Our Bodies. Available at:
PR, et al. Virtual Reality in the treatment of burn https://www.ucsf.edu/news/2018/07/411366/musical-
patients: A systematic review. Burns 2018;44:1403–1416. improvisation-brain (last accessed Oct 2018).
72. Hoffman HG, Seibel EJ, Richards TL, et al. Virtual real- 88. Nijholt A, Zwiers J, Peciva J. Mixed reality participants in
ity helmet display quality influences the magnitude of smart meeting rooms and smart home environments.
virtual reality analgesia. J Pain 2006;7:843–850. Personal and Ubiquitous Computing 2009;13:85–94.
73. Chan PY, Scharf S. Virtual reality as an adjunctive non- 89. Rebenitsch L, Owen C. Review on cybersickness in
pharmacological sedative during orthopedic surgery applications and visual displays. Virtual Reality
under regional anesthesia: a pilot and feasibility study. 2016;20:101–125.
Anesth Analg 2017;125:1200–1202. 90. Rebenitsch L. Managing cybersickness in virtual reality.
74. Pandya PG, Kim TE. Virtual reality distraction decreases XRDS 2015;22:46–51.
routine intravenous sedation and procedure-related 91. Garzorz IT, MacNeilage PR. Visual-vestibular
pain during preoperative adductor canal catheter conflict detection depends on fixation. Curr Biol
insertion: a retrospective study. Korean J Anesthesiol 2017;27:2856–2861.e2854.
2017;70:439–445. 92. Zygomalas A, Kehagias I. Up-to-date intraoperative
75. Hoffman HG, Richards TL, Coda B, et al. Modulation computer assisted solutions for liver surgery. World J
of thermal pain-related brain activity with virtual reality: Gastrointest Surg 2019;11:1–10.
evidence from fMRI. Neuroreport 2004;15:1245–1248. 93. Cheung TT, Ma KW, She WH, et al. Pure laparoscopic
76. Baheti AD, Thakur MH, Jankharia B. Informed consent hepatectomy with augmented reality-assisted indocyanine
in diagnostic radiology practice: Where do we stand? Ind green fluorescence versus open hepatectomy for hepatocel-
J Radiol Imaging 2017;27:517–520. lular carcinoma with liver cirrhosis: A propensity analysis at
77. Satyanarayana Rao KH. Informed consent: an ethical a single center. Asian J Endosc Surg 2018;11:104–111.
obligation or legal compulsion? J Cutan Aesthet Surg 94. Kleemann M, Deichmann S, Esnaashari H, et al.
2008;1:33–35. Laparoscopic navigated liver resection: technical aspects
78. Coyne CA, Xu R, Raich P, et al. Randomized, controlled and clinical practice in benign liver tumors. Case Rep
trial of an easy-to-read informed consent statement for clin- Surg 2012;2012:265918.
ical trial participation: a study of the Eastern Cooperative 95. Khor WS, Baker B, Amin K, et al. Augmented and
Oncology Group. J Clin Oncol 2003;21:836–842. virtual reality in surgery-the digital surgical
79. Pereira SP, Hussaini SH, Wilkinson ML. Informed consent environment: applications, limitations and legal pitfalls.
for upper gastrointestinal endoscopy. Gut 1995;37:151–153. Ann Transl Med 2016;4:454–454.
80. Davis TC, Holcombe RF, Berkel HJ, et al. Informed 96. Corporation PbN. 510(k) Pemarket Notification for
consent for clinical trials: a comparative study of stan- OpenSight. Silver Spring, MD: U.S Food and Drug
dard versus simplified forms. J Natl Cancer Inst Administration, 2018.
1998;90:668–674. 97. LLC PbST. 510 (k) Premarket Notification for SuRgical
81. Powell R, Scott NW, Manyande A, et al. Psychological Planner (SRP). Silver Spring, MD: U.S Food and Drug
preparation and postoperative outcomes for adults Administration, 2018.
undergoing surgery under general anaesthesia. 98. Whalley LJ. Ethical issues in the application of virtual
Cochrane Database Syst Rev 2016;(5):CD008646. reality to medicine. Comput Biol Med 1995;25:107–114.
82. Kruzik N. Benefits of preoperative education for adult
elective surgery patients. AORN J 2009;90:381–387.

View publication stats

You might also like