BioEcoOcean Logo BioEcoOcean Logo BioEcoOcean Logo

Data and Information Management for EOVs

The GOOS approach to data management is aligned with open data and FAIR (Findable, Accessible, Interoperable, Reusable)1 practices. All EOV data and information is valuable, thus effective data management practices are essential to ensure it remains accessible and (re)usable for now and future generations. This document explains how to contribute EOV data to the global ocean observing system across different scenarios: an individual researcher submitting data, or an existing data centre connecting to the system.

Please follow these practices carefully, as EOV data FAIRness relies on compliance2 with the guidelines below.

Glossary

Metadata: data or information that describes data. It's information that helps others find, understand, and properly use data - i.e. the "Who, What, When, and Where". In the context of EOV monitoring, this can refer to the information about a monitoring effort (e.g. programme, project, institution, etc.) or about the data produced from that monitoring effort.

Dataset: the actual observational data dervived from a sampling event, observation, measurement or other collection process. The specific digital file containing the raw and/or processed information. Preference is to align data to a standard, e.g. Darwin Core for biological data. Dataset metadata describes its content, e.g. taxonomic coverage, specific dates, technical methods used, specific geographic location, and individuals involved in sampling.

Data Producer: the entity responsible for generating or collecting EOV information. Can be an organization, project, institution, research group, or monitoring program. Metadata about data producers describes the source of the data, e.g. program name, geographic coverage, generic sampling approaches, sampling frequency.

Two Steps to Contribute

The main steps to contribute data to the global system are:
  1. Become Discoverable: add your monitoring programme metadata to the BioEco Portal
    1. Confirm if a record of data producer (e.g., organisation, programme, project, etc.) and/or datasets are already visible in the BioEco Portal
    2. Submit metadata via the EOV Metadata Application. A GitHub account is required
  2. Publish EOV observational datasets to OBIS
    • OBIS is the recommended repository for all BioEco observation-based data. Publishing to OBIS makes data openly accessible and integrates it into a global database that enables global assessment of ocean health. Contact a regional or thematic OBIS Node or the OBIS helpdesk (helpdesk@obis.org) for help with data formatting and submission.
Making your data producer discoverable by adding your metadata to the BioEco Portal is the minimum step. Regardless of where the actual data is stored, metadata of its existence must be findable.

Please note the differentiation between the EOV datasets and the EOV data producers throughout this document (see Glossary). This distinction is made to emphasize that both the data and its source - the data producer - need to be managed and made visible.

EOV data flow to OBIS and the BioEco portal

Figure 1. High-level example of data and metadata flows to ensure A) EOV data producers and B) EOV datasets become visible in the IOC Digital Ecosystem.

1a. Become Discoverable: Confirm Visibility

Before initiating data flow, you must ensure that key metadata about the EOV data producer (i.e. the project, programme, or organisation) is up to date, verifiable, and FAIR within the BioEco Portal. Follow these steps:

  1. Check if record already exists: Search the BioEco Portal
  2. Register in IOC’s Ocean Expert (OE): Create a personal and/or organisational account in OE. OE allows you to link persistent identifiers (e.g. ORCiD or ROR), which ensure data traceability.
    • Note: Account approval takes 1-2 business days. Complete your profile once approved.
      • OE accounts are email based and thus can only be managed by the person it describes, or through an organisational email for organisations.
  3. Register your data producer: Submit or update a record using the EOV Metadata Application (see Part 2 for guidance). This automatically makes your entry visible in the BioEco Portal, but a GitHub account is required.

1b. Become Discoverable: Submit Data Producer Metadata

Detailed metadata about the data producer is essential to help others find and understand the EOV monitoring work being done around the world, assess its relevance, credit the right people, and identify collaboration opportunities. The GOOS BioEco Portal uses this information to map who is monitoring which EOVs and where, and is being developed to also display EOV datasets published to OBIS.

Minimum required metadata

Field Description
Title/Name Name of the project, programme, organisation, or other group conducting sustained EOV monitoring
Data producer identifier An identifier associated with the project, programme, institution, etc. This will be the same identifier used in the metadata for generated datasets, so the records can be linked.
Abstract or description Brief description of the data producer
Landing page URL A stable link to more information about the data producer
Contact Email A point of contact, could be an individual, general inquiries, helpdesk, etc.
EOVs Keywords The specific EOVs being monitored
Temporal coverage The start and end date of the monitoring efforts; end date is optional if efforts are ongoing
Geographic location The general location where monitoring takes place (e.g. bounding box, point location)
Sampling approach The general methodological approach used, ideally mapped to GOOS Platform types (e.g. platform family)

How to Submit

Use the EOV Metadata Application — it walks you through the required fields, generates the necessary JSON-LD file, and submissions become visible directly in BioEco Portal. No technical knowledge is required but a GitHub account is required to use the tool. You may contact helpdesk@obig.org for assistance.

If you’re technically savvy and comfortable with JSON-LD files and sitemaps, you can create the metadata files yourself. See the ODIS Book for detailed guidance.

Have an existing entry in the BioEco Portal? The BioEco Portal has recently migrated to a new submission workflow, so existing entries may need to be transferred. Please contact helpdesk@obis.org with the GitHub usernames that should have edit access, and we’ll get you set up.

Dataset metadata (as opposed to data producer metadata) should be submitted directly to the repository where the data is hosted (e.g. OBIS). Dataset metadata may include but is not limited to information about the taxonomic coverage, temporal and geographic area, sampling methods used, people involved, and the project producing the data (including identifiers to link the dataset with the data producer).

2. Prepare and Publish EOV Data

We encourage the “Publish once harvest many times” principle: publish your data to one trusted repository, and it will flow automatically to connected systems. Where you publish depends on your data type, but the repository must be interoperable with the data systems used by GOOS, IODE, and other IOC entities. OBIS is the recommended repository for all BioEco EOV observation-based data.

There are three main scenarios for BioEco observational data:

  1. Publish BioEco data directly to OBIS
  2. Connect an existing data portal to OBIS
  3. Publish non-BioEco data

2a. Publish BioEco Data to OBIS

OBIS (Ocean Biodiversity Information System) can host observation-based datasets such as those derived from field samples, acoustic surveys, satellite imaging, animal tracking, DNA sequencing, etc. (Figure 2).

Diagram showing what kind of data OBIS can host

Figure 2. Diagram indiciating what kind of observational data can be published to OBIS. Arrows indicate which Darwin Core table particular information can be stored in.

Why OBIS?

All data in OBIS follows the international Darwin Core (DwC) data standard, which ensures datasets are consistent, interoperable, and discoverable across global systems. You don't need to be familiar with the standard to get started, but we recommend using using DwC terms as column names in your data files from the outset if possible, as this will simplify the process.

Note: Data published to OBIS can also be simultaneously published to GBIF (Global Biodiversity Information Facility), so you do not need to submit separate datasets!

Dataset metadata aligns with Ecological Metadata Language (https://manual.obis.org/eml.html), however you do not need knowledge of the metadata language because the publishing tool used by OBIS, called the Integrated Publishing Toolkit (IPT), uses a form-based interface to create the necessary files for you.

Raw or original data

The raw or original data used to identify an observation (e.g. images, recordinds, DNA sequences) should be deposited in an appropriate repository according to the repository's formatting standard (e.g.NCBI, EcoTaxa, image hosting platforms, regional or national repositories, etc.), with links to these resources included in you DwC dataset. The OBIS Manual provides comprehensive guidance on how to align to DwC standards. OBIS regional and thematic nodes are also available to assist you with data formatting.

Minimum metadata required for OBIS datasets:

Field Notes
Title Descriptive name for the dataset
Abstract or description Brief description of the dataset
Citation (can be automatically generated on the IPT)
Contact point Person or team responsible
Data producer identifier An identifier associated with the project, programme, institution, etc. This should be the same identifier used in the metadata for the data producer so the records can be linked. Identifiers can be added to datasets after publication if you do not have one at the time of publication
EOV keyword(s) The EOVs covered by the dataset, use controlled vocabulary

Minimum data required for OBIS datasets:

Field Notes
Coordinates of a sampling event and/or biological observation, in decimal degrees
Date of the observation (YYYY-MM-DDTHH:mm:ss)
Taxon Name of the taxon observed, to the lowest possible rank identified (higher ranks are accepted)
Present / absent (DwC term occurrenceStatus)
observation type (e.g. human vs machine observation, DNA-based; DwC term basisOfRecord)
Unique observation identifiers for all taxonomic observations (DwC term occurrenceID)

How Darwin Core structures data

DwC organises data into linked tables. Tables are connected by shared identifiers (eventIDs and occurrenceIDs), so data from different tables can be reliably combined. See Figure 3 for an example. The tables currently implemented by OBIS are: A simplified example of the Darwin Core structure Figure 3. A simplified example of the Darwin Core structure, demonstrating how data in Sampling-Event, Occurrence, and extendedMeasurementOrFact (eMoF) tables can be linked by eventIDs and occurrenceIDs. Note the example does not show all required fields.

Getting help with OBIS

The OBIS Manual, OBIS Nodes, or the OBIS helpdesk (helpdesk@obis.org) can assist with formatting and publishing. We recommend identifying a regional or thematic Node to help you (Figure 4). If your dataset is incomplete or historical, don’t be discouraged - OBIS Nodes can also help assess what’s usable and how to handle gaps! For historical data, the Oceans Past Initiative is a thematic OBIS Node that specifically handles historical marine data.

The EOV Metadata Application is also under development to offer the option of uploading a file aligned to a user-friendly “EOV-format”, and guide you through the process of converting your data into DwC tables.

Map of the OBIS Nodes

Figure 4. Map of OBIS Node Network

Data licensing

All data published to OBIS is open-access. However datasets may select one of three Creative Commons licenses: CC0, CC BY, CC BY-NC. For details on the data policy of OBIS, see the OBIS website and the OBIS Manual.

2b. Connect Existing Data Portals with OBIS

If your institution already publishes data through its own portal or repository, it may be possible to connect that system to OBIS. To do this, the data must be structured in Darwin Core format, and the portal needs to be connected to an Integrated Publishing Toolkit (IPT) - the software OBIS uses to harvest data.

If your portal isn’t already connected, this typically involves a workflow that:

  1. Extracts the data from your institutional repository,
  2. Formats it to align with DwC, and
  3. Transfers it to an IPT, which OBIS can then harvest

For help setting this up, contact the OBIS Secretariat at (helpdesk@obis.org), or a regional/thematic OBIS Node. If you publish data from systems like NCEI or ERDDAP, becoming an OBIS Node (or partnering with one) may be the best path forward. The OBIS Secretariat can guide you through the process, or connect you with an appropriate OBIS node (Figure 4).

Already publishing to EMODnet or ICES?

EMODnet Biology is managed through EurOBIS, a regional OBIS node - which means that data in EMODnet Biology is already flowing into OBIS. No additional steps are needed.

ICES (International Council for the Exploration of the Sea) contributes data to EMODnet Biology, Physics, and Chemistry, so some biological data may already reach OBIS via EurOBIS. However, this pathway is not automatic or guaranteed for all datasets. We recommend checking whether your data is already visible in OBIS. If it isn't, publishing directly through an OBIS node is the most reliable route.

For EMODnet Physics and Chemistry data not covered by the above, a direct connection to OBIS does not currently exist. At minimum, ensure your data producer is visible in the BioEco Portal (see Section 1) so your work remains findable.

2c. Publish Non-BioEco Data

Non biological data collected must also be made FAIR. As a reminder, we encourage any non-BioEco data that was taken at the same time as BioEco data to be published together in OBIS. To do this, you can utilise the ExtendedMeasurementOrFact table. Using this approach will avoid datasets being split into several separate datasets, which are then difficult to combine again. Ensure identifiers for the associated projects, people, institutions, etc. are included in all metadata so they can be connected. Specific details on using this table are outlined in the OBIS Manual.

For guidance on data flows for physical or biochemical data not collected alongside BioEco data, please refer to the relevant EOV specification sheet.

Metadata about observing platforms should be made available through the GOOS OceanOPS. See https://www.ocean-ops.org/metadata/ for guidance.

Verify Visibility

To verify that your (meta)data are Findable (the F of FAIR), check that the name of your entry appears in the GOOS BioEco Portal.

To verify that BioEco datasets published to OBIS are accessible (the A of FAIR), search by dataset name through the OBIS Mapper (https://mapper.obis.org/) or the Homepage portal (https://obis.org/search?entity=dataset).

Help Resources

OBIS

GOOS BioEco Portal

ODIS


  1. Wilkinson et al. 2016 https://doi.org/10.1038/sdata.2016.18 

  2. In evaluations of programmes, projects, or other initiatives which claim EOV data generation, evaluators are encouraged to verify that data is discoverable and accurately represented in the GOOS BioEco Portal.