Introduction to multimedia

Multi - many; much; multiple

Medium - a substance regarded as the means of transmission of a force or effect; a
channel or system of communication, information, or entertainment

Medium
– Means for distribution and presentation of information
– Classification based on perception (text, audio, video) is appropriate for
Defining multimedia
Multimedia is a combination of text, graphics, sound, animation, and video that is
delivered interactively to the user by electronic or digitally manipulated means.
Multimedia means that computer information can be represented through audio,
video, and animation in addition to traditional media (i.e., text, graphics/drawings,
images).
 Introduction
A multimedia system is characterized by computer-controlled, integrated production,
manipulation, presentation, storage, and communication of independent information, which is
encoded at least through a continuous (time-dependent) and a discrete (time-independent)
medium. A multimedia system is any system which supports more than a single kind of media.
Multimedia is the integration among more than one media such that there should be at least
two media: Continuous and Discrete with proper synchronization.
Multimedia is defined as the computer based interactive environment that incorporates text,
images, graphics, sound, audio, animation, video and virtual reality. Fundamental feature of
multimedia is interactivity. Text, pictures, animation, movies and sound - all these varied
media are seamlessly blended, resulting in simple slide shows to dazzling, interactive
presentations.
Fundamental feature of multimedia is interactivity. Interactivity is the ability of the user to
interact with an application. Examples include keyboard and mouse input, mouse rollovers,
voice activation, and touch screen.
 Multimedia Application Definition
A Multimedia Application is an application which uses a collection of multiple media
sources e.g. text, graphics, images, sound/audio, animation and/or video

A multimedia application is a software program that allows users to create, edit, and
manipulate various forms of digital media, such as text, graphics, audio, video, and animation.
These applications are used for a wide range of purposes, including entertainment, education,
marketing, and communication.

Multimedia applications can be found on a variety of platforms, including desktop computers,

laptops, smartphones, and tablets. They can be used to create and edit various types of media
content, such as movies, music, images, and interactive presentations.

Multimedia applications typically offer a wide range of tools and features for creating and
editing digital media, including text editors, graphic design tools, video and audio editing
software, animation tools, and more. Some examples of popular multimedia applications
include Adobe Photoshop, Adobe Premiere, Final Cut Pro, and PowerPoint.
What is Hypertext and Hypermedia?
Hypertext is a text which contains links to other texts. The term was invented by
Ted Nelson around 1965.
Hypertext is a way of organizing and presenting information that allows users to
access and navigate through related pieces of information by clicking on links. In
hypertext, text is linked to other text, allowing users to easily jump from one piece of
information to another without having to follow a predefined linear structure. This
non-linear approach to information organization has become a fundamental
characteristic of the Web.

Hypermedia, on the other hand, expands upon the concept of hypertext by including
other types of media, such as images, video, and audio, in addition to text.
Hypermedia allows users to interact with a variety of media formats within a single
document or presentation, providing a richer and more engaging user experience.

The World Wide Web (WWW) is the best example of a hypermedia application.
PowerPoint
Adobe Acrobat
Global structure of Multimedia
 Global structure of Multimedia
The global structure of multimedia refers to the overall architecture or organization of
multimedia applications or systems. It encompasses the different components or elements that
make up a multimedia system, as well as the relationships and interactions between these
components.
A typical multimedia system can be broken down into several components, including:
Data or content: This refers to the multimedia content itself, such as text, images, audio,
video, and animation.
User interface: This is the part of the system that allows users to interact with the content,
such as buttons, menus, and other interactive elements.
Processing and storage: This includes the hardware and software components that are used to
process and store the multimedia data, such as computers, servers, and databases.
Communication: This refers to the mechanisms and protocols that are used to transmit and
receive multimedia content, such as the Internet and various networking technologies.
The global structure of a multimedia system must take into account the various requirements
and constraints of each of these components, as well as the needs and expectations of the users.
It must also be designed to support various multimedia formats, standards, and protocols, and
provide a seamless and intuitive user experience.
 Global structure of Multimedia
Device domain:
It deals with interaction between multimedia application and multimedia devices such as AGP
Card, Sound Card etc. Basic concepts for the processing of digital audio and video data are based
on digital signal processing. Different methods for the processing of image, graphics and
animation are described. The audio techniques section includes music (MIDI) and speech
processing.
System Domain:
The interface between the device domain and the system domain is specified by the computer
technology. To utilize the device domain, several system services are needed. Basically, three
services exits. These services are mostly implemented in software. The operating system, serves
as an interface between computer hardware/system and all other software components. It
provides the user with a programming and computational environment, which should be easy to
operate. The database system allows a structured access to data and a management of large
databases. The communication system is responsible for data transmission according to the
timing and reliability requirements of the networked multimedia.
 Global structure of Multimedia
Application domain:
Provides functions to the user to develop and present multimedia projects. This
includes software tools, and multimedia projects development methodology. The
services of the system domain are offered to the application domain through proper
programming abstractions. Another topic embedded in the application domain is
document handling.
Cross domain:
It turns out that, some aspects such as synchronization aspects, are difficult to locate
in one or two components or domains. The reason is that synchronization, being the
temporal relationship among various media, relates to many components across all
domains.
 Representation Dimensions
Multimedia system is defined by computer controlled, integrated production,
manipulation, presentation, storage and communication of independent information,
which is encoded at least through a continuous and discrete media. Media are divided
into two types in respect to time in their representation space:
Time independent (discrete)
Information is expressed only in its individual value, without a time component.
E.g.: text, image, graphics, etc.
Time dependent (continuous)
Information is expressed not only it’s individual value, but also by the time of its
occurrences.
E.g.: sound and video
 Classification of Media
Medium is defined as means for distribution and presentation of information.
Examples of a medium are text, graphics, speech, and music. Media can be classified
with respect to different criteria. We classify media according to perception,
representation, presentation, storage, transmission, and information exchange.
It can be categorized as following sections:
 The perception media
 The representation Media
 The Presentation Media
 The storage media
 The transmission media
 The information Exchange media
Classification of Media
 Classification of Medium
Perception Medium: Perception media help human to sense their environment. The central
question is how human perceive information in a computer environment. The answer is
through seeing and hearing.
Seeing: For the perception of information through seeing the usual such as text, image and
video are used
Hearing: For the perception of information through hearing media such as music, noise and
speech are used.
Representation medium:
Representation media are defined by internal computer representation of information. The
central question is how the computer information is coded? The answer is that various format
are used to represent media information in computer.
 Text, character is coded in ASCII code
 Graphics are coded according to CEPT or CAPTAIN video text standard.
 Image can be coded as JPEG format
 Audio video sequence can be coded in different TV standard format (PAL, NTSC, SECAM
 and stored in the computer in MPEG format)
 Classification of Medium
Presentation medium:
Presentation media refer to the tools and devices for the input and output of the
information. The central question is, through which the information is delivered by
the computer and is introduced to the computer.
Output media: Paper, screen and speaker are the output media.
Input Media: Keyboard, mouse, camera, microphone are the input media.
Digital Media: Soft copy presentation.
Paper Media: Hard copy presentation.
Storage medium:
Storage Media refer to the data carrier which enables storage of information. The
central question is, how will information be stored? The answer is hard disk, CD-
ROM, Floppy, Micro-film, printed documents, digital storage etc.
 Classification of Medium
Transmission medium:
Transmission Media are the different information carrier that enables continuous data
transmission. The central question is, over which information will be transmitted?
Information is transmitted over network either by using wired or wireless connection.
Wired connection can be twisted pair, coaxial cable, optical fiber cable etc. Wireless
connection can be satellite connection or radio link connections etc.
Information exchange medium:
Information exchange media includes all information carrier for transmission, i.e. all
storage and transmission media. The central question is, which information carrier
will be used for information exchange between different places? The answer is
combine uses of storage and transmission media. E.g. Electronic mailing system
Information can flow through intermediate storage media, where the storage medium
is transported outside of computer networks to the destination, through direct
transmission using computer networks, or through combined usage of storage and
transmission media.
 Multimedia Systems and properties
A Multimedia System is a system capable of processing multimedia data and
applications.
A Multimedia System is characterized by the processing, storage, generation,
manipulation of Multimedia information.
Properties or characteristics that are typically associated with multimedia systems:
Integration of different media types: Multimedia systems are designed to handle
multiple types of media simultaneously, such as text, images, audio, and video. This
allows for the creation of rich and engaging multimedia experiences.
Interactivity: Multimedia systems often include interactive elements that allow users
to engage with the content in various ways, such as clicking on buttons, playing
games, or navigating through virtual environments.
Synchronization: In multimedia systems, different media types are synchronized so
that they are presented together in a coordinated way. For example, audio and video
may be synchronized so that the sound matches up with the action on the screen.
 Multimedia Systems and properties
Compression: Multimedia content can require a lot of storage space, so multimedia
systems often use compression techniques to reduce the size of the data. This allows
for more efficient storage and transmission of the content.

Delivery over networks: Multimedia systems often rely on networks, such as the
Internet, to deliver content to users. This requires specialized protocols and techniques
for transmitting and receiving multimedia content over networks.

Scalability: Multimedia systems must be able to handle large amounts of data and
support a large number of users. This requires the system to be scalable and capable
of handling high volumes of traffic.
Characteristics of a Multimedia system
Integration of multiple media types: Multimedia systems are designed to integrate
different media types, such as text, graphics, audio, and video, into a single cohesive
experience.

Interactivity: Multimedia systems often include interactive elements that allow users
to engage with the content in various ways, such as clicking on buttons, playing
games, or navigating through virtual environments.

Synchronization: In multimedia systems, different media types are synchronized so

that they are presented together in a coordinated way. For example, audio and video
may be synchronized so that the sound matches up with the action on the screen.

Compression: Multimedia content can require a lot of storage space, so multimedia

systems often use compression techniques to reduce the size of the data. This allows
for more efficient storage and transmission of the content.
Characteristics of a Multimedia system
Delivery over networks: Multimedia systems often rely on networks, such as the
Internet, to deliver content to users. This requires specialized protocols and techniques
for transmitting and receiving multimedia content over networks.

Scalability: Multimedia systems must be able to handle large amounts of data and
support a large number of users. This requires the system to be scalable and capable
of handling high volumes of traffic.

Quality of Service: Multimedia systems require a certain level of quality of service

(QoS) to ensure that the content is delivered to the user in a timely and reliable
manner. This can include factors such as bandwidth, latency, and packet loss.

User Interface: Multimedia systems require a user interface that is intuitive and easy
to use, allowing users to interact with the content in a natural and seamless way.
 Challenges of multimedia system
Data compression: Multimedia data, such as images, videos, and audio, often require
significant storage and bandwidth. Efficient compression techniques are necessary to
reduce the data size without compromising quality. However, achieving a balance
between compression ratio and visual/audio fidelity can be challenging.

Quality of service (QoS): Multimedia applications often have strict QoS

requirements, such as low latency, high throughput, and minimal packet loss.
Ensuring consistent QoS for multimedia data transmission over heterogeneous
networks is a challenge, especially when dealing with real-time applications like
video conferencing or streaming.

Synchronization: Multimedia systems involve the integration of multiple media

types, such as video, audio, and graphics. Achieving synchronization between these
different media streams can be complex, especially when considering variations in
network delays, processing times, and rendering capabilities across different devices.
 Challenges of multimedia system
Content-based retrieval: Searching and retrieving specific multimedia content from
large databases is a significant challenge. Developing efficient indexing, retrieval, and
relevance ranking algorithms for multimedia data, considering factors like content
semantics and user preferences, poses challenges due to the high dimensionality and
subjectivity of multimedia content.

Security and copyright protection: Multimedia content is susceptible to various

security threats, including unauthorized access, piracy, and copyright infringement.
Implementing robust security mechanisms, such as encryption, watermarking, and
digital rights management (DRM), to protect multimedia content throughout its
lifecycle is a continuous challenge.

User interfaces and interaction: Designing intuitive user interfaces for multimedia
systems that provide seamless interaction with diverse media types can be
challenging. Ensuring user-friendly controls, navigation, and visualization of
multimedia content across different devices and platforms requires careful
consideration of user experience and usability principles.
 Challenges of multimedia system
Scalability and interoperability: Multimedia systems often need to support a large
number of users and devices, ranging from smartphones to large-scale multimedia
servers. Ensuring scalability and interoperability across different platforms, operating
systems, and network technologies is a challenge, particularly when considering the
heterogeneity of multimedia formats, codecs, and protocols.

Multimedia content adaptation: Delivering multimedia content to a wide range of

devices with varying capabilities and network conditions requires adaptation
mechanisms. Adapting content formats, resolutions, bitrates, and delivery strategies to
match the capabilities of the target devices while maintaining acceptable quality
presents challenges due to the dynamic nature of network conditions and the diversity
of client devices.

Resource management: Multimedia systems require efficient resource management

to allocate and manage computational resources, network bandwidth, and storage
effectively. Optimizing resource allocation and scheduling to meet the real-time
requirements of multimedia applications is a challenge, especially in resource-
constrained environments.
 Component of multimedia System
A multimedia system is composed of several components that work together to enable
the creation, processing, storage, transmission, and presentation of multimedia
content. The main components of a multimedia system are:
Input Devices: These devices capture and convert various forms of analog or digital
media into a format suitable for processing and storage. Examples include cameras for
capturing images and videos, microphones for recording audio, and scanners for
digitizing documents.

Storage Devices: Multimedia systems require storage devices to store and retrieve
multimedia content. These devices can include hard disk drives, solid-state drives,
optical discs, and networked storage systems.

Processing Units: The processing units of a multimedia system handle the

computation and manipulation of multimedia data. They can include general-purpose
CPUs (Central Processing Units) and specialized processors for multimedia tasks,
such as graphics processing units (GPUs) for accelerating image and video
processing.
 Component of multimedia System
Software Applications: Software applications provide the tools and functionalities
for creating, editing, and managing multimedia content. These applications can range
from basic photo and video editors to advanced multimedia authoring and content
management systems.

Compression and Encoding Techniques: Multimedia content often needs to be

compressed and encoded to reduce file sizes and enable efficient storage and
transmission. Compression techniques, such as JPEG for images and H.264 for
videos, and encoding standards, such as MP3 for audio, are used to achieve this.

Communication Networks: Multimedia systems often rely on communication

networks to transmit multimedia data between different devices or over the internet.
These networks can include local area networks (LANs), wide area networks
(WANs), and the internet. Protocols such as TCP/IP, HTTP, and RTP are commonly
used for multimedia data transmission.
 Component of multimedia System
Transmission Media: The transmission media refer to the physical channels through
which multimedia data is transmitted. This can include wired media like Ethernet
cables and fiber optics, as well as wireless media like Wi-Fi, Bluetooth, and cellular
networks.
Output Devices: Output devices are responsible for presenting multimedia content to
users. Common output devices include displays (such as monitors and projectors) for
visual content, speakers or headphones for audio content, and printers for hard copy
output.
User Interfaces: User interfaces enable users to interact with multimedia systems.
This can include graphical user interfaces (GUIs), touchscreens, voice commands,
gesture recognition, and other input methods that allow users to control and navigate
multimedia content and applications.
Multimedia Standards: Standards define the specifications and formats for
multimedia content and data. These standards ensure compatibility and
interoperability across different systems and devices. Examples include file formats
like JPEG, MPEG, and WAV, as well as streaming protocols like RTSP and HLS.
 Multimedia building block
In the context of multimedia projects, the building blocks or elements typically refer
to the different types of media that are combined to create a multimedia experience.
These elements include:

Text: Textual information, such as captions, subtitles, titles, and written content, can
be incorporated into multimedia projects to provide context, explanations, or
narration.

Audio: Audio elements include music, sound effects, voiceovers, and any other form
of audio content that enhances the multimedia experience.

Images: Still images, such as photographs, illustrations, or graphics, are important

visual elements that can be used to convey information or create a specific
atmosphere.

Video: Video content consists of moving images that capture real-life scenes,
animations, or a sequence of images. It is a powerful medium for storytelling and
conveying information.
 Multimedia building block
Graphics and Animation: Graphics and animations encompass visual elements
created through computer-generated imagery (CGI), 2D or 3D animations, visual
effects, or graphical user interface (GUI) elements that enhance the visual appeal and
interactivity of multimedia projects.

Interactivity: Interactivity involves user engagement and interaction with multimedia

content. It can include features like clickable buttons, menus, interactive timelines,
quizzes, or games, allowing users to actively participate and navigate through the
multimedia experience.

These building blocks or elements are combined and synchronized in multimedia

projects to create a cohesive and engaging experience for the audience. The specific
combination and arrangement of these elements depend on the goals, objectives, and
nature of the multimedia project being developed.
 Scope of Multimedia
The scope of multimedia is extensive and encompasses various domains and
applications. Some of the key areas within the scope of multimedia include:

Entertainment and Media: Multimedia has a significant presence in the

entertainment industry, including movies, television shows, music videos, and video
games. It offers immersive and interactive experiences through the integration of
audio, video, graphics, and animation.

Advertising and Marketing: Multimedia plays a crucial role in advertising and

marketing campaigns. It enables the creation of visually appealing and engaging
content, such as advertisements, promotional videos, and interactive multimedia
presentations, to attract and communicate with audiences effectively.

Education and E-Learning: Multimedia is widely used in educational settings to

enhance learning experiences. It facilitates the creation of interactive educational
materials, e-learning courses, virtual simulations, and multimedia textbooks, making
learning more engaging, interactive, and accessible.
 Scope of Multimedia
Communication and Collaboration: Multimedia technologies enable effective
communication and collaboration across different platforms and devices. Video
conferencing, webinars, multimedia messaging, and virtual meetings rely on
multimedia elements to facilitate real-time communication and information sharing.

Digital Art and Design: Multimedia provides a platform for artists and designers to
express their creativity through digital art, graphic design, animation, and visual
effects. It allows for the creation of visually stunning and innovative digital content.

Information and Data Visualization: Multimedia techniques are employed to

present complex information and data in a visually appealing and easily
understandable manner. It includes data visualization, infographics, interactive charts,
and multimedia presentations for effective communication of information.
 Scope of Multimedia
Virtual and Augmented Reality: Multimedia forms the foundation for virtual reality
(VR) and augmented reality (AR) experiences. These technologies combine various
multimedia elements to create immersive, interactive, and realistic virtual
environments or enhance real-world experiences with digital overlays.

Medical and Healthcare: Multimedia finds applications in medical imaging, surgical

simulations, telemedicine, patient education, and healthcare training. It enables
visualization, analysis, and communication of medical data, fostering advancements
in diagnosis, treatment, and healthcare delivery.

Tourism and Virtual Tours: Multimedia is utilized in the tourism industry to

showcase destinations, attractions, and experiences. Virtual tours, 360-degree videos,
and interactive multimedia guides allow users to explore places virtually and make
informed travel decisions.