Seminar

SEMINAR PAPER

TELE-IMMERSION

SUBMITTED BY

AKASH KUNDU (22CS60R38)

Submitted on 7-11-2022

GUIDED BY

Dr.SOUMYA K. GHOSH
 TERM PAPER

Contents
1 ABSTRACT 2

2 INTRODUCTION 3

3 COMPONENTS OF A HOLOGRAPHIC ENVIRONMENT 5

4 GENERATING THE 3-D IMAGE 8

4.1 TELEIMMERSION AND VIRTUAL REALITY . . . . . . . . . . . . . 8

5 TELEIMMERSIVE HOLOGRAPHIC ENVIRONMENT HAVE A

NUMBER OF APPLICATIONS 9
5.1 MEDICINE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
5.2 EDUCATION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
5.3 FUTURE OFFICE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

6 Conclusion 11

1
 TERM PAPER

1 ABSTRACT
Due to the hazy visuals and distorted sounds, communication is still
difficult when work is done remotely. Tele-immersion will create an en-
vironment where computers can recognise the presence and motion of
people as well as physical and virtual objects. These can then track
and project both living and non-living entities realistically across a wide
range of geographical regions. Thus, nobody gets to mute or go to sleep
on the other end during those online meetings!

[1]

2
 TERM PAPER

2 INTRODUCTION
It is an advanced version of virtual reality that will let people from vari-
ous locations to communicate in real time within a shared virtual setting.
It will be implemented with Internet2.[1]
The foundation for completely immersive communication that transcends
time and space will be laid by recent advancements in virtual presence.
Users will experience eye contact, verbal communication, and face-to-
face meetings as if they were truly in the same room.
With 3D holographic avatars and images, offices can significantly reduce
the cost of transporting employees in one place, minimizing airspace
travel hazards on the environment.
In a teleimmersive environment, computer recognized the presence and
movements of individuals as well as physical and virtual objects. They
can then track these people and nonliving objects, and project them in
a realistic way across many geographic locations. The three steps to
constructing a holographic environment are:
1. The computer recognizes the presence and movements of people and
objects.
2. The computer tracks those images.
3. The computer projects those images on a strereoimmersive surface.
Stereo is used to perform 3D reconstruction for teleimmersion, which en-
tails taking rapid consecutive images of the same things with two or more
cameras, calculating distances continuously, and projecting the results
into the computer.Video conferencing has made it possible to communi-
cate more information in real time than ever before without physically
putting everyone into a single large room by combining cameras with
Internet telephony. These new communication technologies are still be-
ing developed by scientists today. The national teleimmersion project
(NTII), which is being worked on by a number of organisations, aims to
make this fantastic technology accessible to the general public. Consider
that you have a crucial business meeting with your partners in Chennai.
On the other hand, Japanese businessmen are arriving to sign a signifi-
cant business agreement that day.
So you enter a space you refer to as the holodeck. You use information
technology to get in touch with your business partners there in a simu-
lated environment. You can have a meeting with them virtually as if you

3
 TERM PAPER

were in Chennai. They seem to be right there, so you even shake hands
with their hologram representations. Through a simulated holographic
environment, you will be able to instantly communicate with your friend
on the opposite side of the world using teleimmersion. This new tech-
nology, which will be a part of internet2, will alter how we work, learn,
and receive medical care. We shall live differently as a result.
Potential impact of tele-immersion are in various fields for example-
• Interactive Scientific Visualization
• Molecular Engineering
• Virtual nuclear test
• Education and Training
• Virtual classroom
• Army training
• Art and Entertainment
• Virtual game
• Industrial Design
• Architectural Review and Evaluation
• Remote design collaboration

4
 TERM PAPER

3 COMPONENTS OF A HOLOGRAPHIC ENVI-

RONMENT
In the past, teleimmersive displays needed the user to wear specialised
goggles and a head gear that recorded their viewing angle.
Three additional video cameras recorded real-life patterns shown in each
room while the eight regular video cameras at the other end tracked the
humans, who were seen as 3D images, in order to determine distance.
This made it possible to reproduce depth properly on the screen. There-
fore, if a viewer turned her head to the left, she would see the image that
would appear if she were in the same room as the person on the screen.
Scientists are developing new technologies support this type of commu-
nication. Apart of these new technologies is:
• Telecubical
Communication will be done using this technology.It consists of
two stereoimmersive wall surfaces and a desk surface. These three
display surfaces join to form a virtual conference table in the centre.
As a result, teleimmersion can be realistically incorporated into the
workplace, without using any extra disc space.
• Internet2
The current internet infrastructure will be replaced by this. The US
government, business, and academia (180 universities) have formed
a collaboration to develop the internet of the future. In comparison
to the current internet, this new network will have 1000 times more
bandwidth and better speeds. To convey the significant amounts of
data that teleimmersion will generate, a network with high capacity
and speed is required.
• Bandwidth issues
Future high quality effects could require up to 1.2 gigabits per sec-
ond, according to estimates. The bandwidth of a typical home con-
nection is substantially lower than this. Depending on how compli-
cated the background is, each scene will require a different amount
of bandwidth. The consumption of megabits will decrease over time
as more sophisticated compression methods become commonplace.
Currently, an OC3 line is used as the ”final mile” of network connec-
tions for the top computer science departments in the US. This offers
a three-way chat on a basic level and can transfer 155 megabits per

5
 TERM PAPER

second. OC3 lines are 100 times faster than standard broadband,
but they also cost more.

Figure 1: Bandwidth over time – bandwidth utilization graph

[1]

The use of bandwidth-intensive applications will first be restricted to

bigger companies with higher connection speeds. Fast processing power
is also needed because of the volume of data that must be transferred
to make this telepresence work. This must be accessible via the internet
as needed. [2] The Grid, a brand-new network, might offer a solution.
Computing will be spread via the Grid. The tremendous amount of
data that will flood the internet in the future cannot be handled by the
current number of supercomputers. Their PCs will be connected to a
new network as a fix so they may share hard drive space and computing
power. They’ll be forced to operate in a grid, basically building a single
supercomputer.
Technologies needed-

• Display technologies
The scenes being sent would need to be clearly visible on stereo-
immersive displays.

6
 TERM PAPER

• Haptic sensors
Projections may be touched as if they were real thanks to haptic
sensors.
• Desktop supercomputers
The trillions of calculations required to build a holographic envi-
ronment would be completed by desktop supercomputers.
• How tele immersion works
Two partners who are 1,000 miles apart cooperate on a new engine
design in this streamlined model of how a future teleimmersion sys-
tem would operate. Teleimmersion relies on intensive data process-
ing at each end of a link, mediated by high performance network,
to follow the flow of information.
• From the sender
The scene is reinterpreted as a three-dimensional computer model
by parallel processors after receiving visual input from the cameras.
• To the receiver
As the model is received, specific renderings of distant people and
locations are created to match each user’s eye’s perspective. To
keep up with the user’s head movements, the entire procedure is
repeated several times every second.

[1]
Figure 2: 3D Process sending and Receivng

7
 TERM PAPER

4 GENERATING THE 3-D IMAGE

• Multiple cameras capture diverse angles of individuals and their
environment. Many times every second, each camera creates an
image from its point of view.
• Each collection of photos shot at a certain moment is divided into
smaller collections of overlapping trios of photos.
• A ”disparity map,” which reflects the degree of variation among
the photos at all points in the Disparity map visual field, is de-
rived from each trio of images. The variances are then examined
to determine depths that could explain the variations in what each
camera captures. A ”bas relief” depth map of the scene is created
by combining these depth values.
• A single viewpoint independent sculptural model of the scene at a
specific time is created using all of the depth data. The process of
integrating the depth maps gives the final view opportunities.

4.1 TELEIMMERSION AND VIRTUAL REALITY

Teleimmersion may resemble virtual reality, yet they differ significantly.
While you can roam around in a 3-D scene created by a computer in vir-
tual reality, only a 3D world that you can view and not interact with can
be produced using teleimmersion. In contrast, interaction By integrating
the two technologies, is made possible.

8
 TERM PAPER

5 TELEIMMERSIVE HOLOGRAPHIC ENVIRON-

MENT HAVE A NUMBER OF APPLICATIONS
Imagine playing a video game without joysticks and engaging in game-
play elements like monster combat or touchdowns. During the holidays,
you can phone your relatives and join them in a shared holographic room
rather than travelling great distances to see them. Building inspectors
might visit buildings without having to sit at a desk. The future gener-
ation of automobiles could be developed by gathering together auto de-
signers from other countries. Ballroom dancers could practise together
in separate physical locations in the entertainment sector. Business-
people might project themselves into the conference room to attend a
board meeting instead of driving to work. The educational, scientific,
and medical fields will be greatly impacted by the lengthy and diverse
list of applications.

5.1 MEDICINE
Medicine has always been thought of and done in a very hands-on man-
ner. It is impossible to diagnose a patient over the phone or provide
directions for the removal of a tumour without being present in person.
It is now possible to study 3D surgical techniques for virtual operations
thanks to teleimmersion, and the goal is to eventually be able to do ac-
tual surgery on real patients. To execute an operation, a surgeon who is
geographically separated could be teleimmersed into the operating room.
If the patient requires specialised care (a procedure or a piece of equip-
ment), which is not available in the specific site, this could potentially
save their lives. Surgeons will be able to superimpose anatomical images
on their patients while they are having surgery thanks to teleimmersion.
How trustworthy is this technology is one counterargument.

5.2 EDUCATION
Students might access data, operate a telescope from a distance, or in-
teract with students from other nations. Digital labs and libraries will
be accessible through Internet2 Teleimmersion will enable individuals to
experience things they could previously only read, see, or hear about
by bringing to their locations, tools, and experiences that were before
unavailable.

9
 TERM PAPER

5.3 FUTURE OFFICE

Business travel will become completely unnecessary since Tele immersion
will bring together two or more remote persons in a single, virtual office
environment.
Individuals will always be visible to the camera and you will be able to
monitor their workspace just by shifting your gaze around the display
screen. Internet-based video conferencing is not an ideal medium for
communication. Although the image is as close to real time as possible,
delays lead to distorted footage. A person is also no longer visible if
they leave the field of vision of a camera. With teleimmersion, however,
individuals will always be visible to the camera and you will be able to
monitor their workspace just by shifting your gaze around the display
screen. Teleimmersion elevates video conferencing, it is a dynamic idea
that will change how people communicate with one another and the rest
of the globe.

10
 TERM PAPER

6 Conclusion
Tele-immersion will certainly enable a wide range of significant appli-
cations once it becomes ubiquitous Although there are certain disad-
vantages to it too. It is very expensive,high bandwidth and high speed
internet is required.
Early users have voiced concerns that tele-immersion exposes people too
much and that tools like phones and videoconferencing make it simpler
for participants to limit their exposure by putting the phone down or
walking away from the screen. We are optimistic that with the expertise
we will find user-interface designs and norms that solve such potential
issues.

11
 TERM PAPER

Reference
• Tele-immersion by Jayanthila Devi, R. Muthukkumar [1]
• Tele-immersion: Virtually here! -By: Mauli Halan[2]
• Study on teleimmersion which is a form of virtual reality -Sravanthi
Palle[3]

12