Synthetic images of corals (Desmophyllum pertusum) with object detection models
https://doi.org/10.5878/hp35-4809
Two object detection models using Darknet/YOLOv4 were trained on images of the coral Desmophyllum pertusum from the Kosterhavet National Park. In one of the models, the training image data was amplified using StyleGAN2 generative modeling.
The dataset contains 2266 synthetic images with labels and 409 original images of corals used for training the ML model. Included is also the YOLOv4 models and the StyleGAN2 network.
The still images were extracted from raw video data collected using a remotely operated underwater vehicle.
409 JPEG images from the raw video data are provided in 720x576 resolution. In certain images, coordinates visible in the OSD have been cropped.
The synthetic images are PNG files in 512x512 resolution.
The StyleGAN2 network is included as a serialized pickle file (*.pkl).
The object detection models are provided in the .weights format used by the Darknet/YOLOv4 package. Two files are included (trained on original images only, trained on original + synthetic images).
The machine learning software packages used is currently (2022) available on Github:
StyleGAN2: https://github.com/NVlabs/stylegan2
YOLOv4: https://github.com/AlexeyAB/darknet
Citation and access
Citation and access
Data access level:
Creator/Principal investigator(s):
- Sarah Al-Khateeb – MMT Sweden AB / Ocean Infinity
- Jannes Germishuys – Combine AB
Research principal:
Data contains personal data:
No
Citation:
Language:
Method and outcome
Method and outcome
Time period(s) investigated:
Data format/data structure:
Species and taxons:
Data collection - Inspelning
Data collection - Inspelning
Mode of collection:
Inspelning
Description of the mode of collection:
Videoinspelningar från 35 st forskningskryssningar i Kosterhavets nationalpark med ROV.
Time period(s) for data collection:
1999 - 2004
Data collector:
- Institutionen för marina vetenskaper, Göteborgs universitet
Öppnar nytt fönster hos ror.org.
ROR
Data collection - Transkription
Data collection - Transkription
Mode of collection:
Transkription
Description of the mode of collection:
Klassifikationen av Desmophyllum pertusum på stillbilder från videodatan har genomförts genom medborgarforskning och frivilliga deltagare via klassifikationsverktyget på webbplatsen The Koster seafloor observatory.
Time period(s) for data collection:
2020
Data collector:
- The Koster seafloor observatory
Geographic coverage
Geographic coverage
Geographic location:
Geographic description:
Kosterhavet National Park
Administrative information
Administrative information
Responsible department/unit:
Department of Marine Sciences
Funding
Funding
Funding agency:
- Forskningsrådet för miljö, areella näringar och samhällsbyggande (FORMAS)
Öppnar nytt fönster hos ror.org.
ROR
Award number:
2021-02465_Formas
Award title:
National implementation of a platform for analysis of sub-sea images (PLAN-SUBSIM)
Funding information:
Datainsamlingen finansierades av Swedish Biodiversity Data Infrastructure (VR), Ocean Data Factory (Vinnova), och PLAN-SUBSIM (FORMAS)
Funding agency:
- Vetenskapsrådet
Öppnar nytt fönster hos ror.org.
ROR
Award number:
2019-00242
Award title:
Swedish Biodiversity Data Infrastructure
Funding information:
Datainsamlingen finansierades av Swedish Biodiversity Data Infrastructure (VR), Ocean Data Factory (Vinnova), och PLAN-SUBSIM (FORMAS)
Funding agency:
Award number:
2019-02256
Award title:
Ocean Data Factory
Funding information:
Datainsamlingen finansierades av Swedish Biodiversity Data Infrastructure (VR), Ocean Data Factory (Vinnova), och PLAN-SUBSIM (FORMAS)
Topic and keywords
Topic and keywords
INSPIRE topic categories:
Relations
Relations
Publications
Publications
Citation:
Alkhateeb, Sarah, Obst, Matthias, Anton, Victor and Germishuys Jannes. (2023). A methodology to detect deepwater corals using Generative Adversarial Networks. GigaScience. [Submitted manuscript].
