Introduction to

Multimedia Databases

Pert 1
 Pokok Bahasan…
Introduction.
 What is a Multimedia Database?
 Why do we need it?

Modeling Multimedia Databases.

 Core-ER diagrams.
 Multimedia Query Processing.

Multimedia database searching.

 Exact match Vs. similarity.
 Manual Indexing Techniques.
 Automatic Indexing Techniques

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 2
 Trends
Perkembangan teknologi informasi saat ini
mengakibatkan :
 Data menjadi sumber yg penting (kritis) bagi
organisasi.
Oleh karena itu efisiensi dalam mengakses
data, berbagi data (sharing data), meringkas
informasi dari data (extracting information
from the data) menjadi kebutuhan yg penting
dewasa ini.
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 3
 What is a Multimedia
Database?
A collection of multimedia data items.
 images, graphic objects, video, audio, etc.

Data-data tsb memiliki karakteristik yg

berbeda dari data text dan number, oleh
karena itu membutuhkan metode yg berbeda
pula untuk mengelola (meliputi access,
storage, indexing dan retrieval).
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 4
 Why Do We Need It?
With everyday advances in communication,
computing and storage technologies,
multimedia applications are on a high.

Most applications use multimedia data.

Querying for digitized information.

 “A picture is worth a thousand words”.

And much more...

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 5
 Some examples
Training and education.
 Online lectures, presentations etc.

Entertainment industry.
 Online Movies, clips etc.

Archival of images captured by satellites.

Medical databases containing X-rays and

MRIs.
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 6
 Some examples
Front end of Yahoo Photos Multimedia
Database.

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 7
 The problem
Data means not just numbers and small
strings but multimedia data as well.

Databases promise:
 Well structured data organization.

 Efficient storage of large amounts of data.

 Querying.

 Transactional support for concurrent users.

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 8
 The problem
If you include multimedia data, you want:
 All of the above.
 Tight integration between standard data and multimedia data
(Integrasi yg kuat antara data standard dan multimedia data)

And yet:
 multimedia data structures are completely different from
standard database structures.
 Multimedia data is large and may swamp other data (not in
1NF).
 multimedia data structures do not easily lend themselves to
content-based searching.

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 9
 Macam Struktur Database
Structured Database (Basisdata Terstruktur):
memiliki suatu struktur yg jelas (baku) seperti
 Relational Database
 Object Oriented Database
Unstructured Database (Basisdata Tak
Terstruktur) have very little structure such as :
 Multimedia Database.

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 10
 Data integration
Relational databases already integrate
various kinds of data, numbers, dates, small
text strings.

They do this by the use of domains, each

one has 2 aspects:
 A range of values which are acceptable.
 Some operations (date handling etc.).
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 11
Domain Types for Multimedia Data
DBMS typically provide three different kinds
of domain for multimedia data:
 large object domains- BLOBs & CLOBs
(unstructured sequence of bytes/ chars).
 file references- instead of holding data, hold a
pointer.
 genuine multimedia data types.

large objects at best allow you to extract

sections or to concatenate them.

file references- all data at once or none.

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 12
 Searching Multimedia
Data
A Relational DBMS permits a user to search the
database by content.
 give the name of the student with ID 0123456.

We would like to do the same with multimedia

data.
 give the pictures painted by Da Vinci.
 give me some pictures with black in the lower left
corner.
 give me some sounds files of loud and pleasant
Opera.
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 13
 Multimedia Database
Management Systems (MM-
DBMS)
MM-DBMS adalah suatu perangkat lunak
untuk mengelola multimedia database.
Multimedia data dapat mengandung data
terstruktur maupun data tak terstruktur spt :
voice, video, text dan images.
MM-DBMS mendukung untuk :
 Storing (menyimpan)
 Manipulating (memanipulasi)
 Retrieving (mengambil)
multimedia data dari multimedia database.
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 14
 MM-DBMS must support
:function
Query processing
Update processing
Transaction management
Storage management
Metadata management
Security
Integrity
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 15
 Multimedia Database
Management (MM-DBMS)

Gambar 1. Multimedia Database Management

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 16
 Multimedia Database
Management (MM-DBMS)
Pada banyak kasus, tipe data spt voice dan video
harus ada sinkronisasi ketika ditampilkan

dg dmk real-time processing juga menjadi hal utama

dalam MM-DBMS
The various types of data such as voice and video
have to be synchronized for display, therefore real-
time processing is also major issue in MM-DBMS

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 17
 Research on Developing
MM-DBMS
Some expert have proposed OODBMS for storing and managing
multimedia database.

Because OODBMS have been found to be more suitable for handling

large objects and multimedia data such as sound and video which
consume considerable storage space.

Meskipun tampaknya OODBMS cukup menjanjikan, tapi masih memiliki

problem. Misalnya : Pada banyak kasus, tipe data spt voice dan video yg
disimpan dalam bentuk object harus ada sinkronisasi ketika ditampilkan.
Padahal kemampuan sinkronisasi tidak disediakan dalam OODBMS.

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 18
 Research on Developing
MM-DBMS
Penelitian lain adalah di bidang efisiensi teknik utk
indexing.
In fact, data manipulation operations such as video
editing are still in the early stages.
Furthermore, the multimedia database need to be
integrated for many applications as they are
distributed. For example : audio data in database-1
has to be integrated with video data in database-2
and displayed to the analyst.

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 19
 Modeling multimedia
databases (chapter 3)
What information should be held in the
database.

The types of relationships held between the

data items.

Developers and users must understand how

the data is modeled in order to sufficiently
develop, maintain and query the database.
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 20
 Modeling Multimedia
Databases

Relationship between entities

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 21
 Modeling Multimedia
Databases
A dashed rectangular box surrounds any attribute
of an entity which can be considered core.

Forename Surname

Actor
The picture physically held
within the database

D_of_B Picture

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 22
 Modeling Multimedia
Databases
Methods, or valid queries, for the database
are shown in double-edged diamonds.

Inputs Output
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 23
 Multimedia Query
Processing (chapter 5)
Diperlukan perintah SQL untuk
mentranslasikan dari ER Diagram sampai
create the database.

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 24
 SQL
Create table MOVIE
(TITLE VARCHAR (30),
DIRECTOR VARCHAR (30),
YEAR INTEGER,
STUDIO VARCHAR (30),
CORE));

Declare External AppearsIn (Movie, Actor)

Returns BOOLEAN
<Function Definition>;

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 25
 Multimedia Database
Searching
Saat melakukan query pada relational database,
seorang user dapat mengharapkan data akurat
dari query sbb :
 “Give me the names of all criminals who have been
convicted of house break-ins over the last six months.”

First name Last name Age …

Avi Ben-simhon 24 …

Ronen Hoch 25 …

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 26
 Multimedia Database
Searching
However this is not the case with multimedia
databases.
 The user has a photo-fit
of a single suspect and
is required to search
the database for a match.

An exact match can only be retrieved when any of

the stored objects are actually bit for bit identical to
the search image.
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 27
MM Database Searching

A Similarity Search

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 28
 Multimedia Database
Searching
Thus when querying this type of data
approximate matching techniques are used
and the system measures the degree of
similarity between these approximate
matches.

Image Similar
Yes/No

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 29
 Multimedia Database
Searching
Similar images:

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 30
 Multimedia Database
Searching
Q: Why can’t we store a textual description of
the multimedia object, describing what they
contain? Wouldn’t that give us a close
match? (Manual Indexing Techniques).

A: There are almost infinitely different ways to

describe a picture, or a song, or a film,
depending on a users point of view.

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 31
 Multimedia Database
Searching
The image could be described differently by
different people. One person may describe the
picture as “city” while another person may
state that it is “river” another still would say it
is “landscape”.

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 32
 Multimedia Database
Searching
Automatic Indexing Techniques
 The query processor builds a color
histogram of the sample image on which to
query on.
 The histogram is now compared against
the histogram of the other images held
within the database for their similarity.
 The matches are then ranked and placed
in order of their ranking for the user.
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 33
 Multimedia Database
Searching

Query Color histogram

Rank 1 Rank 6 Rank 7

Similarity 0.87 Similarity 0.66 Similarity 0.62
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 34
 Multimedia Database Searching

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 35
 Multimedia Data Mining
Data mining is the process of forming
conclusions from premises often
previously unknown from large
quantities of data.
Multimedia Data mining adalah suatu
proses ekstraksi informasi yang
potensial dan bermanfaat dari
sekumpulan data multimedia yang amat
besar.
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 36
 Contoh Data Mining
Data mining pola skor test masuk PMB
dan keterkaitannya dengan IP Kum
lulusan.
Data mining pola pembelian barang
(barang X umumnya selalu dibeli
bersamaan dg barang lain apa?)

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 37
 Multimedia Data Mining

Gambar 2. Multimedia Data Mining

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 38
 Characteristics of an MDBMS

Corresponding Storage Media. 1

Data must be stored & managed according to their
specific characteristics of the storage media
Descriptive Search Methods. 2
Query must be descriptive & content oriented
View Specific & Simultaneous Data Access. 3
Same data can be accessed through different
queries by different applications
Management of Large Amounts of data. 4
A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 39
 Characteristics of an MDBMS

Real time Data Transfer. 5

Read / write operations must be done real time
Data transfer of real time activity gets higher priority
than other database activities
Large Transactions. 6
Large transactions must be done in a reliable
.fashion, since it take long time

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 40
 Thank You

A.M.Polina
Assaf Waizman
Tal Haviv Multimedia Databases 41