Information System Report

-progresses in CSR, EDIOS, EDMED,

EDMERP, EDMO, CDI
E. Balopoulos (HCMR), F. Nast (BSH), L. Rickards (BODC), D. Schaap (Maris)

presented by S. Iona (HCMR)

Outlines
Objectives
Structure
Maintenance
Population tools and updating mechanisms
Current status and system upgrade
Summary

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Objectives
The SeaDataNet Information System is an integrated
catalogue service, aiming at facilitating marine data
searching, location and retrieval.
The Objectives are:
Maintain and expand the national metadata-bases.
Standardize the information using common vocabularies
and reference tables.
Interconnect the national inventories in a common PanEuropean directory.

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Structure
It is composed of several thematic inventories of
different levels:
European Directory of Marine Environmental Datasets
(EDMED)
Cruise Summary Reports (CSR)
European Directory of the initial Ocean-observing
Systems (EDIOS)
European Directory of Marine Environmental Research
Projects (EDMERP)
European Directory of Marine Organizations (EDMO)
Common Data Index (CDI)
Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Structure

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Structure

High Level Directories EDMED, CSR, EDIOS

for describing collected observation datasets (by ships,
by laboratories, by continuous observing system)

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Structure

Common Reference Tables EDMERP, EDMO

hold research projects and organizations metadata
common to higher directories

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Structure

The Common Data Index (CDI)

provides access to the data, information and
products by data type and/or any other field
distributed by the TA platforms

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Maintenance
During the first development phase of the Project (V0) the inventories
are organized in centralized databases at the coordinating centres
(BSH, BODC, MARIS) based on the scheme of the past SEASEARCH
Project:
The TA data centres populate the metadata-bases by compiling,
formatting, standardizing their national data and transmitting them
to the coordinating centres.
The metadata are accessed through the common metadata-bases
that are published as part of the SeaDataNet discovery service:
http://www.seadatanet.org/services/catalogues
At V0 the catalogue page links to the SEASEARCH sites.
Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Population tools and updating mechanisms

Through on-line (like CMS forms) and off-line tools that produce XML
ISO 19115 compliant exchanges and developed by the Technical Task
Team in the joint research activities JRA1,JRA2.
Inventory

Manual
entries

Alternate
manual entry

automatic XML
entries

Documentation

CSR

On line

Java tool Mikado

(XML converter)

Local interface or
Java tool Mikado

CSR site

EDMED

Access
Database

Java tool Mikado

Local interface or
Mikado

EDMED Manual

EDIOS

EDIOS site

under development

On line

EDMO site

EDMERP

Access
Database

EDMERP site

Java tool Mikado

anne.chebohnenstengel@bsh.de

elizb@bodc.ac.uk

EDMO

CDI

Contact and Assistance

Local interface or
Java tool Mikado

maris@xs4all.nl

Sea-Search site

Need further help? Please contact HCMR/HNODC

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Population tools and updating mechanisms

NEMO a new reformatting tool to convert ascii files to
Medatlas and ODV format (two of the SeaDataNet data
exchange formats).
NEMO interacts with Mikado to produce ISO 19115 XML
metadata descriptions.
Tools for education and capacity building developed in the frame of the
SeaDataNet European project by M.Fichaut et al., IMDIS-2008 Conference.

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Current status and system upgrade

European Directory of Marine Environmental Datasets
(EDMED)
Cruise Summary Reports (CSR)
European Directory of the initial Ocean-observing
Systems (EDIOS)
European Directory of Marine
Research Projects (EDMERP)

Environmental

European Directory of Marine Organizations (EDMO)

Common Data Index (CDI)
Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

European Directory of Marine Environmental Data

(EDMED)
Currently, EDMED describes:

Over 3500 datasets

700 data holding centres
In 2007/2008, BODC received updates from 13
partners, and added 190 new datasets to the
database.

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Updated EDMEDs since 07/03/2007

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Total No. of Datasets and Data Holding Centres

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

EDMED improvements

BODC are currently developing the software tools that will be used to
ingest an EDMED XML record from a partner, containing the
metadata from one dataset, into the Master EDMED Oracle schema,
where it will be available for retrieval and viewing. Work is also being
carried out for the future ingestion of the existing EDMED records.

Software Tools

to carry out the quality control checks on the EDMED record

to ingest the record into the Master EDMED Oracle schema

to allow a partner to retrieve an EDMED record through a web

interface

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

XML validator tool/Quality Assurance

BODC, along with RNODC, have been working to:

Provide an XML validator tool accessible to all SeaDataNet partners

via a web browser.

Enable SeaDataNet partners to validate EDMED, CDI, CSR, EDIOS

and EDMERP XML documents before they are delivered to the
directory object manager for processing.

Enable the object managers to re-validate the XML files before

loading the records into the directory database.

Provide a controlled approach to the publishing of XML schemas,

and any subsequent versions, which are used to validate the XML
documents.

Ensure previous versions of the XML schema files are maintained.

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Current status and system upgrade

European Directory of Marine Environmental Datasets
(EDMED)
Cruise Summary Reports (CSR)
European Directory of the initial Ocean-observing
Systems (EDIOS)
European Directory of Marine Environmental
Research Projects (EDMERP)
European Directory of Marine Organizations (EDMO)
Common Data Index (CDI)
Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Cruise Summary Reports Directory (CSR)

Number of entries

(in an Oracle DB):

39 648

New entries since Trieste, 19/03/2007:

1263

Characteristics:
From 1873-2008, 2105 ships from 48 countries

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Cruise Summary Reports Directory (CSR)

Continuing operation and population
Heraklion/Triest we
got 1071 CSRs

Online 33 %
XML 34 %
ICES 25 %
Others 8 %

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Since Triest we got

1263 CSRs

Online 52 %
XML 44 %
ICES
4%
Others 0 %

Cruise Summary Reports Directory

(CSR)
CSR Entries since last annual meeting (23.03.2007 - 31.03.2008)
Country

Albania
Algeria
Belgium
Bulgaria
Croatia
Cyprus
Denmark
Estonia
Faroe Islands
Finland
France
Georgia
Germany
Greece
Iceland
Ireland
Israel
Italy
Latvia
Lebanon
Lithuania
Malta
Morocco
Netherlands
Norway
Poland
Portugal
Romania
Russia
Slovenia
Spain
Sweden
Tunisia
Turkey
Ukraine
United Kingdom
Total
in percent

Online

XML
updates
new

1
7
1
39

20

1
7
23
39
21
2
5
8
18
4
268
0
126
29
1
54
2
12
10
7
3
3
1
5
59
9
3
12
28
13
46
94
91
38
160
20

48

1214

22
21

2
3
8
18
4

20

247

125
29
1
54
2

12
10
7
3
3
1
3
59
9
3
12
28
13
46
94

91
38
146

14

591
49%

20

555
47%

Entries since last annual meeting

(23.03.2007 - 31.03.2008)

Total

ICES
updates
new

a big upgrade through France

through XML submission, but also
by Italy, Tunesia,Turkey, Ukraine

2007:

19 countries online submissions

19/36 = 52.78 %

Now:

4%

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

29 countries online submissions

29/36 = 80,56 %

Cruise Summary Reportsts Directory (CSR)

NEW V1 XML FORMAT AND SCHEMA
Laboratory, scientist, platform, project now defined by
common vocabularies or by SDN inventories, codes
must be used now by CSR V1.2
ISSUE
Not all existing CSRs could be harmonised to the
common vocabs
ACTION-SUGGESTION
Partners get export to update those CSRs either online
or by Mikado (V1.2)

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Current status and system upgrade

European Directory of Marine Environmental Datasets
(EDMED)
Cruise Summary Reports (CSR)
European Directory of the initial Ocean-observing
Systems (EDIOS)
European Directory of Marine
Research Projects (EDMERP)

Environmental

European Directory of Marine Organizations (EDMO)

Common Data Index (CDI)
Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

EDIOS Progress (1)

No new input has been requested over the year
Awaiting new technological developments (XML
schema and new version of Mikado)
BODC has produced an improved Oracle
(database) schema
Supported by common vocabularies, EDMO and
EDMERP
A major issue is population of revised schema with
legacy content and quality assurance against
original MIF stock

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

EDIOS Progress (2)

Within the UK
BODC has a national project, UK Directory of the Marine
Observing System (UKDMOS)
Adopted the EDIOS schema with some additions
Preparing a new UK EDIOS collection
In cooperation with MARIS
BODC has defined and prepared an exchange format of
6 csv files
Exchange format can work both ways between BODC
database and interface database at Maris
Provides basic model for tuning the XML schema later
Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

EDIOS Progress (3)

New User Interface for both UKDMOS and for
SeaDataNet - EDIOS
For UKDMOS see:
http://www.ukdmos.org/welcome.asp
For SeaDataNet EDIOS:
http://seadatanet.maris2.nl/v_edios/search.asp

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

EDIOS way forward

Two update routes:
(1) Exchange format => XML schema => MIKADO version
=> XML output to BODC for validation
=> export to MARIS for loading in Interface
(2) MARIS builds CMS on the new database model

Request partners to rebuild their EDIOS entries

Bring in some data from the older EDIOS as basis plus

view on old EDIOS details for comparison when filling in
all the Vocabularies

Exchange format in CSV (later as XML) to BODC for

loading and validating

Return to MARIS for loading in Public Interface

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Current status and system upgrade

European Directory of Marine Environmental Datasets
(EDMED)
Cruise Summary Reports (CSR)
European Directory of the initial Ocean-observing
Systems (EDIOS)
European Directory of Marine Environmental
Research Projects (EDMERP)
European Directory of Marine Organizations (EDMO)
Common Data Index (CDI)
Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

st

After 1 year SeaDataNet

After 2nd year SeaDataNet

Country
Total No. of
EDMERPs
Albania
Algeria
Belgium
Bulgaria
Croatia
Cyprus
Denmark
Estonia
Finland
France
Georgia
Germany
Greece
Iceland
Ireland
Israel
Italy (OGS +ENEA)
Latvia
Lebanon
Lithuania
Malta
Morocco
Netherlands
Norway
Poland
Portugal
Romania
Russia (SIO + RIHMI)
Slovenia
Spain
Sweden
Tunesia
Turkey
Ukraine
United Kingdom
Other countries
TOTAL

Total No. of
EDMERPs
0
3
209
32
9
20
40
11
16
93
86
18
114
16
179
12
52
31
5
28
31
5
71
3
42
26
18
84
0
91
30
0
24
62
46

2
4
128
35
7
9
41
9
14
90
102
23
117
13
160
4
48
29
12
21
30
4
67
4
35
26
16
103
4
79
15
3
28
79
236

1507

1600

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

EDMERP

Number
of
EDMERP
entries is quite stable

Partners
have
been
maintaining existing entries
and adding new entries

EDMERD developments
Recently the EDMERP system has been upgraded to Version 1 :

new V1 data format and XML schema,

it is fully supported by the Common Vocabularies,

double entries have been taken out, because projects are entered
and maintained by the country of the coordinator, who can add via
EDMO entries all related partners,

Maintenance is now done by online Content Management System (CMS)

and no longer by MS-Access software:

capability of creation of sub-accounts for institutes in the NODCs

country, while the NODC safeguards the quality by having the chief
editor role before publishing,

New Web service for retrieving EDMERP entries in XML.

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Recommendations

Partners are asked to complete the existing EDMERP records with

keywords from the Common Vocabularies and partners from EDMO
to support the content upgrading from Version 0 to Version 1

Partners are asked to keep EDMERP up-to-date, also with entries

from other institutes in their country, because EDMERP is being used
in other SeaDataNet Directories

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

New EDMERP V1 user interface

Browse list

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Additional details

EDMERP Content Management System (CMS)

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Current status and system upgrade

European Directory of Marine Environmental Datasets
(EDMED)
Cruise Summary Reports (CSR)
European Directory of the initial Ocean-observing
Systems (EDIOS)
European Directory of Marine Environmental
Research Projects (EDMERP)
European Directory of Marine Organizations (EDMO)
Common Data Index (CDI)
Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Country

After 1st year SeaDataNet

No. of EDMO
entries

Albania - PUT
Algeria
Belgium
Bulgaria
Croatia
Cyprus
Denmark
Estonia
Finland
France
Georgia
Germany
Greece
Iceland
Ireland
Israel
Italy (OGS +ENEA)
Latvia
Lebanon
Lithuania
Malta
Morocco
Netherlands
Norway
Poland
Portugal
Romania
Russia (SIO + RIHMI)
Slovenia
Spain
Sweden
Tunesia
Turkey
Ukraine
United Kingdom
Other countries
TOTAL

0
1
63
14
5
3
36
5
9
197
13
58
59
3
104
3
66
9
2
7
7
3
11
7
39
43
9
94
1
47
29
1
25
12
136
1122

After 2nd year SeaDataNet

EDMO

No. of EDMO entries

1
1
69
12
5
3
31
5
10
198
14
58
57
3
46
2
60
6
2
6
7
3
22
23
40
45
8
88
1
68
32
1
26
10
153
17
1134

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Number of EDMO entries

is quite stable

Partners
have
been
maintaining
existing
entries and adding profile
texts,
logos
and
geographic positions

As part of producing CDI

records a lot of new
organisations have been
added;
also
existing
entries have been altered
due to re-organisations,
double entries etc.

EDMO recommendation

Recommendation:
Try to keep the info up-to-date because EDMO is
being used in all other SeaDataNet Directories
(EDMED, EDMERP, CDI, CSR and EDIOS)
Still a number of entries have no logo and no
geographic position => please add
Do not keep entries inactive (red button in
Content Management System)
In case of new entries, please inform MARIS for
making the initial entry
Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

EDMO developments

Upgraded user interface

New option to keep track of no longer existing
organisations with a link to present organisations
Google maps in the Content Management
System (CMS) for improved placement of
geographic locations
Web service for retrieving EDMO entries in XML

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Upgraded EDMO user interface

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

EDMO CMS

EDMO CMS geo-locator via Google maps

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Current status and system upgrade

European Directory of Marine Environmental
Datasets (EDMED)
Cruise Summary Reports (CSR)
European Directory of the initial Ocean-observing
Systems (EDIOS)
European Directory of Marine Environmental
Research Projects (EDMERP)
European Directory of Marine Organizations (EDMO)
Common Data Index (CDI)

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

st

Country
Albania - PUT
Algeria ISMAL
Belgium MUMM
Belgium VLIZ
Bulgaria IO-BAS
Croatia IORS
Cyprus CYODC
Denmark NERI
Estonia MSI
Finland FIMR
France IFREMER
France - CLS
Georgia TSU
Germany BSH
Greece NCMR
Iceland MRI
Ireland MI
Israel IOLR
Italy - OGS
Italy ENEA
Latvia IAE-UL
Lebanon NCRS
Lithuania CMR
Malta IOI-MOC
Morocco INRH
Netherlands - NODC
Norway IMR
Poland IMGW
Portugal IHPT
Portugal - IST
Romania NIMRD
Russia RIHMI
Slovenia MBS-NIB
Spain IEO
Sweden SMHI
Tunesia INSTM
Turkey METU IMS
Ukraine MHI
United Kingdom BODC
TOTAL

After 1 year SeaDataNet

After 2nd year SeaDataNet

No. of CDI entries

No. of CDI entries

0
0
21
0
0
0
0
13676
0
0
71314
0
0
1594
10588
0
0
0
37926
0
0
0
0
0
0
5270
13546
0
0
0
0
2668
0
0
0
0
0
0
40122

0
17
21
912
606
7111
1056
17042
0
1667
74762
8
99
29295
11588
0
4727
4817
37926
5395
104
7
810
0
0
41588
14099
0
0
396
2461
12587
2709
15547
2600
1497
2477
7476
40122

195131

341499

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

CDI

All partners have been busy and the

training workshop has been very useful for
transferring expertise and instructing
partners in use of CDI format and tools
A number of partners still have no entries,
but are busy with producing test entries or
production entries on short term. These
include:
o
Albania PUT : has problems ;
needs extra instructions
o
Belgium MUMM: waits for the
CDI V1 version
o
Estonia MSI: test files almost OK
o
Iceland

MRI:
some
misunderstanding of CDI dataset definition
o
Malta IOI-MOC: test files
supplied, but some corrections required
o
Morocco INRH: test files
supplied, but some corrections required
o
Poland IMGW: first test files
supplied; almost ready for production
o
Portugal IHPT: test files supplied,
but some corrections required

Recommendations

Try to keep the info up-to-date, especially the

URLs for data access
Missing partners to undertake extra efforts
All partners to prepare for transgression from CDI
V0 to CDI V1

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

CDI developments

Small updates to the CDI V0 user interface

Focus on V1 developments
Synthesis of the technical activity State of development of the on-line system V1
by D.Schaap

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

CDI V0 User Interface

CDI V0 Search results

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

CDI V0 result

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

CDI V0 Overview map of point measurements

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

CDI V0 Overview map of point measurements around

Greece

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

CDI V0 Overview map of point measurements

in Black Sea region

Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece

Conclusions
Contents of the SeaDataNet Information System:

2006/2007
EDMED: 3.000
CSR: 38.525
EDMERP: 1.507
EDMO: 1.122
CDI: 195.131

2007/2008
EDMED: 3.500
CSR: 39.648
EDMERP: 1.600
EDMO: 1.134
CDI: 341.499

A very important increase in the CDI contents but

full coverage of their national data
Second Annual SeaDataNet Meeting, 3-4 April, 2008, Athens, Greece