Description: BSRN is a project of the Data and Analysis Panel from the Global Energy and Water Exchange (GEWEX) and as such is aimed at detecting important changes in the Earth's radiation field at the Earth's surface which may be related to climate changes. The data are of primary importance in supporting the validation and confirmation of satellite and computer model estimates of these quantities. At a small number of stations (currently 76 in total, 51 active, 9 declared as inactive, 16 are closed) in contrasting climatic zones, covering a latitude range from 80°N to 90°S (see station maps), solar and atmospheric radiation is measured with instruments of the highest available accuracy and with high time resolution (1 to 3 minutes). This snapshot contains the data as well as quality flags for all radiation data submitted to the BSRN archive until 2023-03-31.

Description: During the largest polar expedition in history starting in September 2019, the German research icebreaker Polarstern spends a whole year drifting with the ice through the Arctic Ocean. The MOSAiC expedition takes the closest look ever at the Arctic even throughout the polar winter to gain fundamental insights and most unique on-site data for a better understanding of global climate change. Hundreds of researchers from 20 countries are involved. Scientists will use the in situ gathered data instantaneously in near-real time modus as well as long afterwards all around the globe taking climate research to a completely new level. Hence, proper data management, sampling strategies beforehand, and monitoring actual data flow as well as processing, analysis and sharing of data during and long after the MOSAiC expedition are the most essential tools for scientific gain and progress. To prepare for that challenge we adapted and integrated the research data management framework O2A “Data flow from Observations to Archives” to the needs of the MOSAiC expedition on board Polarstern as well as on land for data storage and access at the Alfred Wegener Institute Computing and Data Center in Bremerhaven, Germany. Our O2A-framework assembles a modular research infrastructure comprising a collection of tools and services. These components allow researchers to register all necessary sensor metadata beforehand linked to automatized data ingestion and to ensure and monitor data flow as well as to process, analyze, and publish data to turn the most valuable and uniquely gained arctic data into scientific outcomes. The framework further allows for the integration of data obtained with discrete sampling devices into the data flow. These requirements have led us to adapt the generic and cost-effective framework O2A to enable, control, and access the flow of sensor observations to archives in a cloud-like infrastructure on board Polarstern and later on to land based repositories for international availability. Major roadblocks of the MOSAiC-O2A data flow framework are (i) the increasing number and complexity of research platforms, devices, and sensors, (ii) the heterogeneous interdisciplinary driven requirements towards, e. g., satellite data, sensor monitoring, in situ sample collection, quality assessment and control, processing, analysis and visualization, and (iii) the demand for near real time analyses on board as well as on land with limited satellite bandwidth. The key modules of O2A's digital research infrastructure established by AWI are implementing the FAIR principles: SENSORWeb, to register sensor applications and sampling devices and capture controlled meta data before and alongside any measurements in the field Data ingest, allowing researchers to feed data into storage systems and processing pipelines in a prepared and documented way, at best in controlled near real-time data streams Dashboards allowing researchers to find and access data and share and collaborate among partners Workspace enabling researchers to access and use data with research software utilizing a cloud-based virtualized infrastructure that allows researchers to analyze massive amounts of data on the spot Archiving and publishing data via repositories and Digital Object Identifiers (DOI)

Description: During the MOSAiC expedition, the German research icebreaker Polarstern spends a full year drifting through the Arctic Ocean. Scientists from 20 countries participate in the largest polar expedition in history exploring the Arctic climate system. The experiment covers a large suite of in-situ and remote sensing observations of physical, ecological and biogeochemical parameters to describe the processes coupling the atmosphere, sea ice, and ocean. In addition to forefront instrumentation and observational techniques, proper data management is essential for large and complex projects and field programs. Key elements are agreements on consistent sampling strategies, the possibility to monitor the data flow, to facilitate near real-time processing, and analysis and sharing of data during and long after the expedition. Furthermore, data publication and documentation are crucial for such a collaborative effort and will build the legacy of the project and finally take climate science to the next level. We adapted our modular research data management framework O2A “Data flow from Observations to Archives” to meet the expedition requirements and ensure central data archival for generations to come. Researchers register all necessary sensor metadata beforehand. Essential metadata of scientific actions in the field are ingested immediately with the FloeNavi, a novel system enabling navigation on a drifting ice floe. O2A provides tools to automatize data ingestion, monitor the data flow and process, analyze and publish data. Integration of ship- and land-based components and a shared storage ensure seamless continuation of collaboration during and after the expedition laying the fundamentals for numerous data publications.

Description: This paper was initiated by a multidisciplinary Topic Workshop in the frame of the Deutsche Forschungsgemeinschaft Priority Program 1158 “Antarctic Research with Comparative Investigations in Arctic Ice Areas”, and hence it represents only the national view without claiming to be complete but is intended to provide awareness and suggestions for the current discussion on so-called big data in many scientific fields. The importance of the polar regions and their essential role for the Earth system are both undoubtedly recognized. However, dramatic changes in the climate and environment have been observed first in the Arctic and later in Antarctica over the past few decades. While important data have been collected and observation networks have been built in Antarctica and the Southern Ocean, this is a relatively data-scarce region due to the challenges of remote data acquisition, expensive labor, and harsh environmental conditions. There are many approaches crossing multiple scientific disciplines to better understand Antarctic processes; to evaluate ongoing climatic and environmental changes and their manifold ecological, physical, chemical, and geological consequences; and to make (improved) predictions. Together, these approaches generate very large, multivariate data sets, which can be broadly classified as “Antarctic big data”. For these large data sets, there is a pressing need for improved data acquisition, curation, integration, service, and application to support fundamental scientific research. Based on deficiencies in crossing disciplines and to attract further interest in big data in Antarctic sciences, this article will (i) describe and evaluate the current status of big data in various Antarctic-related scientific disciplines, (ii) identify current gaps, (iii) and provide solutions to fill these gaps. How to cite. Graiff, A., Braun, M., Driemel, A., Ebbing, J., Grossart, H.-P., Harder, T., Hoffman, J. I., Koch, B., Leese, F., Piontek, J., Scheinert, M., Quillfeldt, P., Zimmermann, J., and Karsten, U.: Big data in Antarctic sciences – current status, gaps, and future perspectives, Polarforschung, 91, 45–57, https://doi.org/10.5194/polf-91-45-2023, 2023. Received: 19 Dec 2022 – Revised: 01 Aug 2023 – Accepted: 04 Aug 2023 – Published: 04 Sep 2023

Description: Reporting for the German GCOS