WP 4

Share:

 

Work package number 4 Type of activity COORD
Work package title

Data management and harmonisation

Start month 1 End month 48
Lead partner 3

Objectives

WP4 – Data management and harmonisation

The main objective of WP4 is to improve access to marine observatory data by harmonising data management standards and workflows covering the complete life cycle of data from real time data acquisition to long-term archiving. Legal and data policy aspects are addressed aiming to identify transnational barriers towards open-access to marine observatory data. To overcome these barriers, it is intended to harmonise data policies and to provide a formal basis for data exchange between FixO3 infrastructures. Another goal is to improve standardisation, interoperability and compliance with major international initiatives. Presently, the interpretation and implementation of accepted standards has considerable incompatibilities within the observatory community, and needs to be harmonised. Further, this work package aims to harmonise data management and standardisation efforts with other European and international marine data and observatory infrastructures. To assist observatories to comply with FixO3 standards a Data Assembly Center will synchronise data management efforts. All collected data and metadata will be harmonised with EDMONET, SEADATANET, PANGAEA, EuroSITES (European contribution to JCOMMP OceanSITES programme), and MyOcean (the Marine Core Service for GMES)(COPERNICUS from 2014) infrastructures. The task also aims to foster the cooperation with the marine carbon observation community by disseminating FixO3 data via relevant international infrastructures and data centres such as the ICOS Ocean Thematic Centre. Another important objective of WP4 is to coordinate, harmonise, and optimize the implementation and integration of Service Activities provided by the different partners in WP10 and to strengthen and monitor the dissemination of knowledge. Links with WP2 and WP9 are foreseen throughout the project duration, in particular for technical metadata harmonisation aspects and synthesising data policies.

Description of work and role of partners

Description of work

 Task 4.1. Coordination of data access and archiving policies

UniHB – Robert Huber (Lead); NERC, UniHB, PLOCAN, IFREMER, INGV, HCMR, UNIABDN, CNRS, IEO, INDP, UPC,

This task aims to set a formal basis to improve transnational access to data as well as data exchange between infrastructures by harmonising their data policies and to improve long-term availability of data. A critical assessment of currently used data policies of FixO3 TNA sites as well as EMSO and JERICO will be used to identify transnational barriers towards open access to data, such as legal restrictions or obligations imposed on national infrastructures. The connection with WP9 will be useful in order to collect and synthesize current policies. In cooperation with COOPEUS, a common, ethical, open-access friendly data policy will be proposed and recommendations to resolve potential data policy conflicts will be elaborated. It will comply with INSPIRE, Directive 2003/4/EC as well as the GEOSS data sharing principles. Further, the data policy will consider ethical constraints following e.g. the principles of the Aarhus Convention, the Convention on Biodiversity and the ICSU Declaration on Science and the Use of Scientific knowledge.

To provide a better formal basis for transnational access to observatory data, this common data policy will be formulated as an MoU and submitted for signature to the participating observatory operating institutions. The MoU will build on the principle of open and free data exchange established in the EuroSITES project and will safeguard the continued contribution to OceanSITES.

Task 4.2. Definition of common standards

INGV – Fawzi Doumaz (Lead); NERC, OGS, HCMR, UniHB, PLOCAN, 52°North

This task aims to promote communication standardisation and interoperability between FixO3 observatories and to ensure compliance with international initiatives through the COOPEUS project. Standardisation workshops will be organised to agree to common standards, as are being developed in COOPEUS, ENVRI and EUDAT, and to synchronize standard interpretation and implementation efforts for oceanographic observatory metadata as well as data encoding and exchange interfaces and protocols. The usage of observatory specific standards, such as the OGC SWE standards, will be promoted to improve real time data accessibility. Within the observatory community, these standards are accepted, but their interpretation and implementation are heterogeneous and incompatible. Therefore, a common marine observatory profile for the OGC SOS standard will be proposed to overcome the current heterogeneity of SOS servers. In collaboration with WP2, the work will also build upon the results obtained in ESONET for sensor metadata harmonisation. SeaDataNet standards and ontologies will be used as appropriate and extended in cooperation with SeaDataNet.

Task 4.3. Integration with existing marine infrastructures

NERC – Maureen Pagnani (Lead); NERC, OGS, HCMR, UniHB, UiB, PLOCAN, IFREMER, INGV, UNIABDN, CNRS, IEO, INDP, UPC, 52°North, CNR

This task aims to to integrate FixO3 data and data products with related marine infrastructures and initiatives
as well as with the carbon observation community. FixO3 will engage, at the data manager level, with existing projects such as MyOcean, OCEANSITES & EuroSITES, JERICO,EMSO and ICOS(COPERNICUS from 2014). Each initiative has its own distinctive focus, yet all have a great deal of common interest. This task will identify the interests within FixO3 which would benefit from following the processing stream policies and practice already being developed or applied in sister marine infrastructures. FixO3 processes and systems will similarly be exposed in a catalogue (see Task 4.6) which will be maintained throughout the project and synchronized with the GEOSS GCI. Potential areas of joint development, such as transformational software will be identified and similarly areas of potential duplication of development effort will be identified and reduced. Development of the EMODnet pilot portals will be monitored and FixO3 observatories encouraged to engage with their particular EuroGOOS partners to ensure data is discoverable through the portals either via MyOcean/EuroGOOS for real time data and SeaDataNet for delayed mode data(COPERNICUS from 2014). To monitor the contribution of in situ datasets to key user communities such as MyOcean modelers (COPERNICUS from 2014) and meteorological offices, this task will engage with those communities. User requirements not being met will be reported to the FixO3 network.

Task 4.4 FixO3 Data Assembly Centre (DAC)

NERC -Maureen Pagnani + UniHB – Robert Huber (Leads); NERC, HCMR, IFREMER, INGV

FixO3 observatories will be required to deliver timely real-time and delayed mode data in a manner compliant with the MoU developed in Task 4.1.In the early stages of the project, some observatories will not have local resources available to comply with the developed FixO3 standards and procedures. The FixO3 DAC will efficiently process real-time data streams and, if required, delayed mode datasets to produce metadata and data in standardised format. The FixO3 DAC will demonstrate processing of data streams for these observatories and distribute best practice and skills to ensure that the processing streams continue beyond FixO3. The DAC will monitor and document data management activities by providing a joint FixO3 data catalogue and registry of FixO3 standards and data processing and transformation services. Connection to OceanSITES GDAC, MyOcean In-Situ Thematic Centre will be provided through this DAC (COPERNICUS from 2014).

Task 4.5 Service Activity management, monitoring and dissemination

AWI – Antje Boetius (Lead)

Management, evaluation, and dissemination of the Service Activities (SAs) provided in FixO3 will aim to ensure excellent quality of the services and to maximise public awareness and the use of services and hence, societal benefit. Starting with a workshop at the FixO3 kick-off meeting, harmonisation and optimisation of the services and dissemination means across FixO3 observatories will be continuously addressed. Intense exchange of information on procedures adopted for the provision of services and the chosen modalities of access will be fostered, especially among partners providing services that address similar user communities and societal needs (e.g. in terms of GEOSS areas and tasks). To foster awareness and attract new users and to maximise exploitation of the provided services, SAs will be advertised on the FixO3 website and through direct contacts with key initiatives and projects (e.g., GEOSS climate, ecosystem, ICOS, GeoBON). Outreach activities of the individual partners will be monitored and harmonised and partners will be encouraged to assess the success of their dissemination means by the implementation of Web analytics. Information on the different services and observatory capabilities will be regularly collected, added to the FixO3 website and kept updated. International experts representing different user groups and scientific communities will be invited to form a Service Activity Panel that will evaluate quality of services and outreach in month 18 and 36 during teleconferences or meetings. Recommendations will be conveyed to partners and their implementation monitored. Based on input by partners reports on SAs will be prepared in addition to periodic reporting towards the EC (internal progress updates every 9 months, separate SA reports in month 20 and 40; D4.7 & 4.8).

Person months per participant

Participant number Participant short name Person-month per participant
1 NERC 12.60
2 OGS 2.50
3 HCMR 6.00
4 UniHB 28.00
5 UiB 1.00
7 PLOCEAN 4.00
8 AWI 24.00
11 IFREMER 3.00
13 INGV 5.00
15 UNIABDN 1.00
16 CNRS 1.00
19 USTAN 1.00
20 IEO 0.50
22 INDP 2.00
23 UPC 1.00
26

52°North GmbH

3.00
27 CNR 3.00
TOTAL 95.60

List of deliverables

Deliverable Number Deliverable Title Lead beneficiary number Estimated indicative person- months Nature Dissemination level Delivery date
D4.1
Common FixO3 data policy MoU
4 6.00 O PP 18
D4.2
FixO3 standardisation workshops and status report
13 4.00 R PU 40
D4.3
Agreement to establish FixO3 data dissemination to marine infrastructures
1 6.00 O PU 43
D4.4 FixO3 standards and services registry and metadata catalogue 4 6.00 D PU 12
D4.5 Progress assessment toward sustainable processing streams from each FixO3 observatory 1 8.00 R PU 40
D4.6 Monitoring of Service Activities 8 6.00 O PU 18
D4.7 First report on Service Activities 8 6.00 R PU 30
D4.8 Final report on Service Activities 8 6.00 R PU 40
TOTAL 48.00

Description of deliverables

D4.1) Common FixO3 data policy MoU: To provide a better formal basis for transnational access to observatory data, a common data policy will be defined, formulated as an MoU and submitted for signature to the participating observatory operating institutions. [month 18]

D4.2) FixO3 standardisation workshops and status report: The report will summarize the results of Fix03 standardisation workshops and wil report on the common standardisation and technical harmonisation which has been reached during the project [month 40]

D4.3) Agreement to establish FixO3 data dissemination to marine infrastructures: The deliverable will summarize the agreements reached to establish FixO3 data dissemination to marine infrastructures and the level of integration Fixo3 has reached with these infrastructures. [month 43]

D4.4) FixO3 standards and services registry and metadata catalogue: The deliverable will be a web based registry or catalogue of FixO3 standards and services which will be maintained throughout the project and synchronized with the GEOSS GCI. [month 12]

D4.5) Progress assessment toward sustainable processing streams from each FixO3 observatory: The deliverable will assess the status of integration of FixO3 data and data products with related marine infrastructures and initiatives as well as with the carbon observation community. It will include a tabular summary of observatory links with ICOS and CDIAC and will include a tabular summary of use of data quality handbooks and progress toward update of common data management , dissemination and utilization strategies. [month 40]

D4.6) Monitoring of Service Activities: Compilation of information on the different Service activities and their implementation by partners and dissemination through the Service Activity section of the FixO3 website [month 18]

D4.7) First report on Service Activities: Interim report on procedures, developments, and dissemination of Service activities and how activities are connected to the user community [month 20]

D4.8) Final report on Service Activities: Final report on procedures, developments, and dissemination of Service activities and how activities are connected to the user community [month 40]

Schedule of relevant milestones

Milestone number Milestone name Lead beneficiary number Delivery date from Annex I
MS4

FixO3 standards and services registry and metadata catalogue ready

4 12
MS6 Common data policy accepted by General Assembly 4 14
MS15

Harmonisation of standards and data formats reached

13 36