Outline

• Overview of AR
• AR, VR and MR
• Architecture of AR
Systems
Chapter 5 • Challenges of AR
Augmented • Applications of AR
Reality
(AR)
What is Augmented Reality?
• Its fundamental idea is to combine, or mix or integration of
• the view of the real environment with virtual content that is presented
through computer graphics.
• achieved by ensuring that the virtual content is aligned and registered with
the real objects.
• Personal movement within the real word environment make him/her to
perceive its environment from different perspective view
Allows users to overlay computer-generated content in the real world
Typically done in real-time and in semantic context with environmental
elements.
Through augmented vision, a user can digitally interact with and adjust
information about their surrounding environment.
AASTU,ECE, 2021 2
AR, VR and MR
• By the help of computer vision and power of processor development we
have three types of reality;
 Virtual reality (VR),
 Augmented reality (AR)
 Mixed reality (MR)
• Extended reality (XR) is a universal term
inclusive all real-and-virtual combined
environments and human-machine interactions
generated by computer technology and
wearables, such as virtual reality (VR),
augmented reality (AR), and mixed reality (MR).

AASTU,ECE, 2021 3
Virtual Reality (VR)
 VR is fully immersive, which tricks your senses into thinking you’re in a
different environment or world apart from the real world
 It is called a computer-simulated reality
 Using a head-mounted display (HMD) or headset,
you’ll experience a computer-generated world of
imagery and sounds
 Computer technologies using reality headsets to
generate realistic sounds, images and other sensations
that replicate a real environment or create an
imaginary world.
 You can manipulate objects and move around using
haptic controllers while tethered to a console or PC.
AASTU,ECE, 2021 4
Virtual Reality (VR) …
• Advanced VR environment will engage all five senses (taste, sight, smell,
touch, sound), but it is not always possible
 Provide freedom of movement – users can move in a digital environment and
hear sounds.
 Special hand controllers can be used to enhance VR experiences.
Example of VR tools
 HTC Vive, Oculus Rift, gaming console
(PlayStation VR) -- connected to computer
 Google Cardboard – stand alone and work in
combination with smartphones

AASTU,ECE, 2021 5
Augmented Reality
Users can see and interact with the real world while digital content is added to it
 adds digital elements to a live view often by using the camera on a
smartphone
Direct or indirect view of a physical, real-world environment whose elements are
augmented (or supplemented) by computer-generated sensory input such as
sound, video, graphics or GPS data
Examples
Google Glass : digital
content is displayed on a
tiny screen in front of a
user’s eye.
Snapchat lenses
game Pokemon Go

AASTU,ECE, 2021 6
Mixed Reality (MR)
 Sometimes referred to as hybrid reality
 Merging of real and virtual worlds to produce new environments and
visualizations where physical & digital objects co-exist & interact in real-time
 play a virtual video game, grab your real-world water bottle, and smack an imaginary
character from the game with the bottle

Mixed reality hardware is still emerging and hasn’t quite broken into the
mainstream consumer market, most likely due to the price
AASTU,ECE, 2021 7
Mixed Reality (MR) …
The middle of AR and Augmented Virtuality (AV)
 AR-adds virtual contents to the Real Environment

 AV-adds real content to a predominantly virtual environment

• Provides the ability to have one foot (or hand) in the real world, & the other
in an imaginary place,
• Breaking down basic concepts between real & imaginary

Paul Milgram's Reality-Virtuality

AASTU,ECE, 2021 (RV) Continuum 8
AR vs VR vs MR
• Overlay digital content on top of the real-world
AR

• Fully digital
• Fully immersive
• require specialized VR headsets, noise-canceling headphones, cameras,
VR and sometimes even motion capture technology.

• Digital overlay that allows interactive virtual elements to integrate and

interact with the real-world
MR • Microsoft HoloLens and Magic Leap One : a bit expensive

AASTU,ECE, 2021 9
Architecture of AR Systems
The Infrastructure Tracker Unit Processor unit mixes
was responsible for collecting data the virtual content
from the real world, sending them to with the real content
the Processing Unit and send the result to
the Video Out module
of the Visual Unit

Visual Unit can be classified into two types of system

Video see-through : HMD for video mix and display: closed view AR Devices.pptx
Optical see-through: HMD employ optical combiner : open view
AASTU,ECE, 2021 10
AR Challenges
• HMDs are currently the dominant display technology in the AR field.
• However, they lack in several aspects, such as
• ergonomics,
• high prices and
• relatively low mobility due to their sizes and connectivity features.
• Collision: difficulty to interact with multiple points in different depths
causes collisions between interactive zones.
• Alternative approaches to developing ARS involve the use of monitors and
tablets.
• Though Collison problems still are not solved

AASTU,ECE, 2021 11
Applications of AR Systems
 AR can be applied to many different disciplines such as
 Education
 Medical
 Entertainment
 Engineering Design
 Manufacturing,
 Maintenance, and Repair
 Collaborative AR

AASTU,ECE, 2021 12
Applications of AR: Education
 It allows flexibility and attractive by extend content into the world outside
the classroom
 Affordable learning materials : low cost
 Interactive lessons: try to model
 Higher engagement : activate, improve attention
 Higher retention: use different senses
 Boost intellectual curiosity : excited and innovative

AASTU,ECE, 2021 13
Applications of AR: Education…
• Driving Simulators.
• Ship Simulators.
• Flight Simulators.
• Tank Simulators.

AASTU,ECE, 2021 14
Applications of AR: Medicine
• Enhancing medicine and healthcare towards more safety and efficiency
• Practice Performing Surgery.
• Perform surgery on a remote patient.
• Teach new skills in a safe, and controlled environment.
• Ultrasound, CT (Computed Tomography) and/or MRI (Magnetic Resonance Imaging)
scans provide the surgeon with the necessary view of the internal anatomy
• AR tools may also aid to detect the signs of depression and other mental illnesses by
reading from facial expressions, voice tones, and physical gestures

A 3D Virtual Reality Model of

Unborn Baby
AASTU,ECE, 2021 15
Applications of AR: Medicine…
 Describing symptoms: accurate diagnosis
 Nursing care: successful finding of the vein (Accuvien)
 Surgery: Three-dimensional reconstructions of organs (Agumedics)
 Diabetes Management : real-time tracking of blood sugar levels
 Navigation: the nearest hospitals

3D ultrasound scan is registered with a pregnant woman’s body- Looking into the Inner part of the body
AASTU,ECE, 2021 16
Applications of AR: Entertainment
 AR can be used in music, movies, live shows, games
 AR in games: for increasing physical activity
 AR in music : providing complete information on the track or its performer
 AR on TV: adding supplementary information
 AR in eSports : online gaming
 AR in the theater : accessibility (eg. Subtitles )

AASTU,ECE, 2021 17
Applications of AR: Entertainment
a. Games using a virtual table and
synthetic objects
b. Advertisement in a Football game
• More vivid
• Move exciting
• More attractive

AASTU,ECE, 2021 18
Applications of AR
Engineering Design
3D prototyping of Engineering Design
Design augmented with a computer-generated image
of the current design built from the CAD files
describing it
Manufacturing, Maintenance, and Repair
 The image of the equipment would be augmented with
annotations and information pertinent to the repair.
 Makes much easier than consulting a lot of repair
manuals
 Boing made an experimental system, where the technicians
are guided by the augmented display that shows the routing
of the cables on a generic frame used for all harnesses
AASTU,ECE, 2021 19
Collaborative AR
• AR addresses two major issues
with collaboration:
• seamless integration with existing
tools and practices, and
• enhancing practice by supporting
remote and co-located activities
that would otherwise be impossible
• E.g. Collaborative AR systems
using see-through displays include
both those that use see-through
handheld displays and see-through
head-worn displays.

AASTU,ECE, 2021 20
Summary
• The Rise Of Technology-Augmented Reality(AR), Virtual Reality(VR) And
Mixed Reality(MR) -Simplilearn_2.mp4
• Facebook gives a glimpse of metaverse, its planned virtual reality world.mp
4

AASTU,ECE, 2021 21
END