INTELLIGENT MULTIMEDIA INTERACTION

PRASHANT NEGI
1070070124
RD2701A30
Abstract: A multimedia computer system is
Multimedia a computer system that can
communication is a part create, import, integrate, store,
of everyday life and its
appearance in computer
retrieve, edit, and delete two or
applications is increasing more types of media materials in
in frequency and digital form, such as audio,
diversity. Intelligent or image, full-motion video, and
knowledge based text information. Multimedia
computer supported
computer systems also may have
communication promises
a number of benefits the ability to analyze media
including increased materials (e.g., counting the
interaction efficiency and number of occurrences of a word
effectiveness. This article in a text file). A multimedia
defines the area of
computer system can be a single-
intelligent multimedia
interaction,role of or multiple-user system.
multiple Networked multimedia computer
languages,multimedia systems can transmit and receive
message system,difficulty digital multimedia materials over
involved with multimedia a single computer network or
database.
over any number of
interconnected computer
Intelligent Multimedia networks. As multimedia
computer systems evolve, they
interaction
may become intelligent systems
We define intelligent Multimedia by utilizing expert system
interaction as the interaction technology to assist users in
between human-human, human- selecting, retrieving, and
system, and human-information. manipulating multimedia
This includes interfaces to information.
people, interfaces to applications,
• Multimedia: physical
and interfaces to information.
means via which
information is input,
 output and/or stored (e.g.,
interactive devices such
as keyboard, mouse,
displays; storage devices
such as disk or CD-
ROM).

• Multimodal : human
perceptual processes such
as vision, audition,
taction.

• Multicodal:
representations used to
encode atomic, elements,
syntax, semantics,
pragmatics and related
data structures (e.g.,
lexicons, grammars)
associated with media and
modalities.

The majority of computational

efforts have focused on • Analyze: synchronous
multimedia human computer and asynchronous
interfaces. There exists a large multimedia or multimodal
literature and associated input (e.g., spoken and
techniques to develop learnable, written text, gesture,
usable, transparent interfaces in drawings) which might be
general. imprecise, ambiguous,
and/or partial;

• Generate: coordinated,
cohesive, and coherent
multimedia/modal
presentations; and

• Manage: the interaction

(e.g., training, error
recovery, task
completion, tailoring
interaction) by
 representing, reasoning,
Combining the arts, science,
and exploiting models of
the domain, task, user, artificial intelligence,
media/mode, discourse, computer science, and the
and environment.
humanities, intelligent
From the developer’s multimedia computing has
perspective, there is also interest
the potential to create
in decreasing the time, expense,
and level of expertise necessary significant advances in
to construct successful systems. information technologies. In

Finally, in interactions with this upper-division defines

information spaces, the area of the notion of intelligent
media content analysis, which
media and then covers
includes retrieval of text, audio,
imagery and/or combinations creative multimedia
thereof, plays an important role. techniques in virtual reality,
basic morphs, motion
pictures, animation
Interactive multimedia - a
multimedia system in which techniques and flash MX,
related items of information are artificial intelligence and
connected and can be presented
intelligent multimedia media
together.
object paradigms, basic
It refers to information/data being
intelligent multimedia
transferred over the network may
be composed of one or more of techniques, agent computing,
the following media types: mathematical foundations,

• Text intelligent visual databases

and data mines. He then
• Images
integrates the technology with
• Audio
applications, including those
• Video in business and e-commerce,

Intelligent spatial heterogeneous visual

multimedia computing, knowledge
interaction representation and predictive
 touchscreen surface via its infra-
diagram models, business
red touch sensing system for
intelligence and content various activities, e.g. type a
virtual keyboard, interact with
exploration, interfaces, multimedia contents, browse a
heterogeneous computing, picture album, etc.
agent-based structures and
implementations, abstract
planning, models and virtual
trees.

EXAMPLE OF
INTELEGENT
MULTIMEDIA
INTRECTION

Light Touch Pico Projector

Allows Multimedia Interaction
Via Touch Gesture On
Projected Screen

Light Blue Optics set a new

milestone in the unveiling of its
maiden product, Light Touch, at
the Consumer Electronics Show
in Las Vegas. Incorporating Light
Blue Optics’s proprietary
holographic laser projection
technology, Light Touch, an
interactive laser projector, can
project a holographic laser image
on any flat surface and allow
users to interact with the
projected contents using touch
gestures. This mini pocket size
projector will turn any flat
surface into a 10-inch
touchscreen with WVGA
resolution. The touchscreen will
auto focus and self-correct for
distortion and optical aberrations.
Users can interact with the
Examples of Multimedia
Information Access
Significant progress has been
made in multimedia interfaces,
integrating language, speech, and
gesture. For example, Figure 1
shows the CUBRICON system
architecture. CUBRICON
enables a user to interact using
spoken or typed natural language
and gesture, displaying results
using combinations of language,
maps, and graphics. Interaction
management is effected via
models of the user and the
ongoing discourse, which not
only influence the generated
responses but also manage
window layout, based on user management components can be
focus of attention. reused.

Of course, many language

specific phenomena remain to be
addressed. For example, in
generation of multilingual and
multimedia presentations, lexical
length affects the layout of
material both in space and in
time. For instance, in laying out a
multilingual electronic yellow
pages, space may be strictly
limited given a standard format
and so variability in linguistic
realization across languages may
pose challenges. In a multimedia
context, one might need to not
only generate language specific
expressions, but also culturally
appropriate media.

Role of Multiple
Languages in multimedia
communication interaction
Making further progress in this
As indicated above, multimodal area, researchers may take
interaction resides in the advantage of some unique
integration of multiple subfields. resources to help develop
When extending techniques and systems perform multimedia
methods to multiple languages, information access, including
we have the benefit of drawing dubbed movies, multilingual
upon previous monolingual broadcast news, that might help
techniques. For example, accelerate the development of,
language generation techniques for example, multilingual video
and components, built initially corpora.
for monolingual generation, can
often be reused across languages.
Analogously, interaction
Multimedia Message Systems
Multimedia message systems are
extensions of contemporary
electronic mail and conference
systems which include
multimedia data handling
capabilities. Multimedia message
systems can create, transmit,
receive, reply to, forward, save,
retrieve, and delete multimedia
messages. As part of the message
creation and editing processes,
multimedia message systems can
import different media materials
and integrate them. Since
multimedia message systems can
incorporate sophisticated data
handling capabilities, the
distinction between this type of
system and multimedia database
systems can sometimes appear
hazy; however, the primary
purpose of these two kinds of
systems is quite different.
Multimedia database systems are
optimized for database functions, while
multimedia message systems are
optimized for communication functions.
Examples of Multimedia Message
Systems
BBN Software Products Corp. is
marketing BBN/Slate, a of
multimedia electronic mail and
conferencing system.The system
runs on SUN workstations.
BBN/Slate messages can include
five types of information: bit-
map images, geometric graphics,
speech annotations, spreadsheets
with associated charts, and text.
An integrated media editor,
which has specialized editing
functions for each type of
information, permits the user to
easily edit messages. The system
allows users to create, store,
retrieve, send, receive, sort, reply
to, forward, and delete messages.
If the user sends a message to a
colleague whose system does not
have multimedia capability,
BBN/Slate will automatically
send the message in text-only
form. Utilizing the conferencing
capability of BBN/Slate,
geographically dispersed users
can jointly edit documents. The
system can be tailored to meet
the user's needs with a built-in
programming language called the
Slate Extension Language.
Difficulties Involved with
Multimedia Databases
The difficulty of making these
different types of multimedia
databases readily accessible to
humans is:
• The tremendous amount
bandwidth they
consume;
• Creating Globally-
accepted data-handling
platforms, such as
Joomla, and the special
considerations that these
new multimedia database
structures require.
 • Creating a Globally- • More efficient interaction:
accepted operating enabling more rapid task
completion with less
system, including
work.
applicable storage and
• More effective interaction:
resource management
doing the right thing at
programs need to the right time, tailoring
accommodate the vast the content and form of
the interaction to the
Global multimedia
context of the user, task,
information hunger. dialogue.
• Multimedia databases
• More natural interaction:
need to take into supporting spoken,
accommodate various written, and gestural
interaction, ideally as if
human interfaces to
interacting with a human
handle 3D-interactive interlocutor.
objects, in an logically-
Because of the multidimensional
perceived manner (i.e. nature of
SecondLife.com). multimediacommunication,
• Accommodating the vast interdisciplinary teams will be
necessary and new areas of
resources required to
science may need to be invented.
utilize artificial New, careful theoretical and
intelligence to it's fullest empirical investigations as well
as standards to ensure cross
potential- including
system synergy will be required
computer sight and sound to ensure the resultant systems
analysis methods. will enhance and not detract from
the cognitive ability of end users.
Conclusion

We have outlined the history, REFERENCES

developments and future of
systems and research in  www.google.com
multimedia communication. If
 www.wikipedia.com
successfully developed and
employed, these systems  www.lycos.com
promise: