Description: Marine imaging is transforming into a sensor technology applied for high throughput sampling. In the context of habitat mapping, imaging establishes thereby an important bridge technology regarding the spatial resolution and information content between physical sampling gear (e.g., box corer, multi corer) on the one end and hydro-acoustic sensors on the other end of the spectrum of sampling methods. In contrast to other scientific imaging domains, such as digital pathology, there are no protocols and reports available that guide users (often referred to as observers) in the non-trivial process of assigning semantic categories to whole images, regions, or objects of interest (OOI), which is referred to as annotation. These protocols are crucial to facilitate image analysis as a robust scientific method. In this article we will review the past observations in manual Marine Image Annotations (MIA) and provide (a) a guideline for collecting manual annotations, (b) definitions for annotation quality, and (c) a statistical framework to analyze the performance of human expert annotations and to compare those to computational approaches.

Description: Combining state-of-the art digital imaging technology with different kinds of marine exploration techniques such as modern AUV (autonomous underwater vehicle), ROV (remote operating vehicle) or other monitoring platforms enables marine imaging on new spatial and/or temporal scales. A comprehensive interpretation of such image collections requires the detection, classification and quantification of objects of interest in the images usually performed by domain experts. However, the data volume and the rich content of the images makes the support by software tools inevitable. We define some requirements for marine image annotation and present our new online tool Biigle 2.0. It is developed with a special focus on annotating benthic fauna in marine image collections with tools customized to increase efficiency and effectiveness in the manual annotation process. The software architecture of the system is described and the special features of Biigle 2.0 are illustrated with different use-cases and future developments are discussed.

Description: Marine researchers continue to create large quantities of benthic images e.g., using AUVs (Autonomous Underwater Vehicles). In order to quantify the size of sessile objects in the images, a pixel-to-centimeter ratio is required for each image, often indirectly provided through a geometric laser point (LP) pattern, projected onto the seafloor. Manual annotation of these LPs in all images is too time-consuming and thus infeasible for nowadays data volumes. Because of the technical evolution of camera rigs, the LP's geometrical layout and color features vary for different expeditions and projects. This makes the application of one algorithm, tuned to a strictly defined LP pattern, also ineffective. Here we present the web-tool DELPHI, that efficiently learns the LP layout for one image transect/collection from just a small number of hand labeled LPs and applies this layout model to the rest of the data. The efficiency in adapting to new data allows to compute the LPs and the pixel-to-centimeter ratio fully automatic and with high accuracy. DELPHI is applied to two real-world examples and shows clear improvements regarding reduction of tuning effort for new LP patterns as well as increasing detection performance.

Description: Marine image analysis faces a multitude of challenges: data set size easily reaches Terabyte-scale; the underwater visual signal is often impaired to the point where information content becomes negligible; human interpreters are scarce and can only focus on subsets of the available data due to the annotation effort involved etc. Solutions to speed-up the analysis process have been presented in the literature in the form of semi-automation with artificial intelligence methods like machine learning. But the algorithms employed to automate the analysis commonly rely on large-scale compute infrastructure. So far, such an infrastructure has only been available on-shore. Here, a mobile compute cluster is presented to bring big image data analysis capabilities out to sea. The Sea-going High-Performance Compute Cluster (SHiPCC) units are mobile, robustly designed to operate with electrically impure ship-based power supplies and based on off-the-shelf computer hardware. Each unit comprises of up to eight compute nodes with graphics processing units for efficient image analysis and an internal storage to manage the big image data sets. The first SHiPCC unit has been successfully deployed at sea. It allowed us to extract semantic and quantitative information from a Terabyte-sized image data set within 1.5 h (a relative speedup of 97 compared to a single four-core CPU computer). Enabling such compute capability out at sea allows to include image-derived information into the cruise research plan, for example by determining promising sampling locations. The SHiPCC units are envisioned to generally improve the relevance and importance of optical imagery for marine science.

Description: The abyssal seafloor in the Clarion-Clipperton Zone (CCZ) in the NE Pacific hosts the largest abundance of polymetallic nodules in the deep sea and is being targeted as an area for potential deep-sea mining. During nodule mining, seafloor sediment will be brought into suspension by mining equipment, resulting in the formation of sediment plumes, which will affect benthic and pelagic life not naturally adapted to any major sediment transport and deposition events. To improve our understanding of sediment plume dispersion and to support the development of plume dispersion models in this specific deep-sea area, we conducted a small-scale, 12-hour disturbance experiment in the German exploration contract area in the CCZ using a chain dredge. Sediment plume dispersion and deposition was monitored using an array of optical and acoustic turbidity sensors and current meters placed on platforms on the seafloor, and by visual inspection of the seafloor before and after dredge deployment. We found that seafloor imagery could be used to qualitatively visualise the redeposited sediment up to a distance of 100 m from the source, and that sensors recording optical and acoustic backscatter are sensitive and adequate tools to monitor the horizontal and vertical dispersion of the generated sediment plume. Optical backscatter signals could be converted into absolute mass concentration of suspended sediment to provide quantitative data on sediment dispersion. Vertical profiles of acoustic backscatter recorded by current profilers provided qualitative insight into the vertical extent of the sediment plume. Our monitoring setup proved to be very useful for the monitoring of this small-scale experiment and can be seen as an exemplary strategy for monitoring studies of future, upscaled mining trials. We recommend that such larger trials include the use of AUVs for repeated seafloor imaging and water column plume mapping (optical and acoustical), as well as the use of in-situ particle size sensors and/or particle cameras to better constrain the effect of suspended particle aggregation on optical and acoustic backscatter signals.