Description: The Competence Center is planned as link between Geoscientific facilities and an existing archive network for earth and environmental data in Germany. KomFor generally aims at improving the overall availability and quality of data in a sustainable way. Practically from the users view the project will create a unique instance which accompanies scientific facilities, projects, and groups in all questions of data management – from the planning phase via data production, QA/QC, registration and long term storage to publication of data; the latter also including science publishers. In addition KomFor will supply systems and interfaces for accessing data comprising a data portal, services which allow downloading data for analysis and visualization tools (added value services), components for cross-referencing data and science articles as well as a broker function into superior global networks. KomFor is based on ICSU World Data Centers and Services located in Germany, which are collaborating in a national cluster since 2003 – the WDC Climate (WDC-C, DKRZ), WDC for Remote Sensing (WDC-RSAT, DLR), the German Research Centre for Geosciences (GfZ), and the Data Publisher for Earth & Environmental Science (PANGAEA, AWI/Marum). The cluster is complemented by the German National Library of Science and Technology (TIB). The consortium is well embedded into the international environment (WDS, IPCC, ESA, NASA, CEOS, GMES, GEOSS, INSPIRE, ESFRI, WMO, IODP, ICDP, IOC etc.) and is engaged since years in the development of standards as well as organizational structures and infrastructures for research data. Amongst others the consortium has implemented a registry service for scientific data which meanwhile is supported by an international association of libraries and is used worldwide (DataCite). A milestone was also the implementation of a web service for dynamically cross-referencing science articles with related data, initially used by Elsevier and now increasingly used by further publishers.

Description: Generating data catalogue pages from ISO19139, GMCD-DIF and Datacite metadata

Description: In recent years research institutions, geological surveys and funding organizations started to build infrastructures to facilitate the re-use of research data from previous work. At present, several intermeshed activities are coordinated to make data systems of the earth sciences interoperable and recorded data discoverable. Driven by governmental authorities, ISO19115/19139 emerged as metadata standards for discovery of data and services. Established metadata transport protocols like OAI-PMH and OGC-CSW are used to disseminate metadata to data portals. With the persistent identifiers like DOI and IGSN research data and corresponding physical samples can be given unambiguous names and thus become citable. In summary, these activities focus primarily on “ready to give away”-data, already stored in an institutional repository and described with appropriate metadata. Many datasets are not “born” in this state but are produced in small and federated research projects. To make access and reuse of these “small data” easier, these data should be centrally stored and version controlled from the very beginning of activities. We developed DataSync [1] as supplemental application to the panMetaDocs [2] data exchange platform as a data management tool for small science projects. DataSync is a JAVA-application that runs on a local computer and synchronizes directory trees into an eSciDoc-repository [3] by creating eSciDoc-objects via eSciDocs' REST API. DataSync can be installed on multiple computers and is in this way able to synchronize files of a research team over the internet. XML Metadata can be added as separate files that are managed together with data files as versioned eSciDoc-objects. A project-customized instance of panMetaDocs is provided to show a web-based overview of the previously uploaded file collection and to allow further annotation with metadata inside the eSciDoc-repository. PanMetaDocs is a PHP based web application to assist the creation of metadata in any XML-based metadata schema. To reduce manual entries of metadata to a minimum and make use of contextual information in a project setting, metadata fields can be populated with static or dynamic content. Access rights can be defined to control visibility and access to stored objects. Notifications about recently updated datasets are available by RSS and e-mail and the entire inventory can be harvested via OAI-PMH. panMetaDocs is optimized to be harvested by panFMP [4]. panMetaDocs is able to mint dataset DOIs though DataCite and uses eSciDocs' REST API to transfer eSciDoc-objects from a non-public “pending“-status to the published status “released“, which makes data and metadata of the published object available worldwide through the internet. The application scenario presented here shows the adoption of open source applications to data sharing and publication of data. An eSciDoc-repository is used as storage for data and metadata. DataSync serves as a file ingester and distributor, whereas panMetaDocs' main function is to annotate the dataset files with metadata to make them ready for publication and sharing with your own team, or with the scientific community.

Description: Currently a lot of work is done to stimulate the reuse of data. In joint efforts research institutions establish infrastructure to facilitate the publication of scientific datasets. To create a citable reference, these datasets must be tagged with persistent identifiers (DOIs) and described with metadata. As most data in the geosciences are derived from samples, it is crucial to be able to uniquely identify the samples from which a set of data were derived. Incomplete documentation of samples in publications, use of ambiguous sample names are major obstacles for synthesis studies and re-use of data. Access to samples for re-analysis and re-appraisal is limited due to the lack of a central catalogue that allows finding a sample's archiving location. The International Geo Sample Number (IGSN) [1] provides solutions to the questions of unique sample identification and discovery. Use of the IGSN in digital data systems allows building linkages between the digital representation of samples in sample registries, e.g. SESAR [2], and their related data in the literature and in web accessible digital data repositories. DataCite recently decided to publish their metadata store (DataCite MDS) and accompanying software online [3]. The DataCite software allows registration of handles, deposition of metadata in an XML format, it offers a search interface, and is able to disseminate metadata via OAI-PMH. Its, REST interface allows an easy integration into institutional data work flows. For our applications at GFZ Potsdam we modified the DataCite MDS software for reuse it in two different contexts: as the DOIDB web service for data publications and as the IGSN registry web service for the registration of geological samples. The DOIDB acts as a proxy service to the DataCite Metadata Store and uses its REST-Interface for registration of DataCite DOI and associated DOI metadata. Metadata can be deposited in the DataCite or NASA DIF schema. Both schemata can be disseminated via OAI-PMH. Transformation into the mandatory DataCite schema is done through XSLT stylesheet transformation. With its REST interface DOIDB integrates a number of independent automatic and semi-automatic data publishing systems at GFZ and provides a local summary of the dataset DOIs registered through GFZ as a publication agent. The web service of the IGSN registry is part of the registration structure of the IGSN e.V. Similar to the DOIDB, the IGSN registry inherits all characteristics from the DataCite software except for the metadata schema, which is completely different to the DataCite schema. Since the registry is on top of a 3 level metadata registration architecture, the IGSN Metadata Store holds only the handle, administrative data, and some metadata about the physical status of the sample. Both cases presented here introduce modifications to the DataCite MDS that enable to associate and enrich persistent identifiers of the handle system with own metadata. These metadata can be disseminated with OAI-PMH. Furthermore, the implementation as a proxy service allows to create local handle registries for institutions with a federated publishing structure which can be used to build catalogues of the registered objects and their metadata. [1] http://www.igsn.org [2] http://www.geosamples.org [3] http://github.com/datacite

Description: In the early days of thinking about cyberinfrastructure the focus was on "big science data". Today, the challenge is not anymore to store several terabytes of data, but to manage data objects in a way that facilitates their re-use. Key to re-use by a user as a data consumer is proper documentation of the data. Also, data consumers need discovery metadata to find the data they need and they need descriptive metadata to be able to use the data they retrieved. Thus, data documentation faces the challenge to extensively and completely describe these objects, hold the items easily accessible at a sustainable cost level. However, data curation and documentation do not rank high in the everyday work of a scientist as a data producer. Data producers are often frustrated by being asked to provide metadata on their data over and over again, information that seemed very obvious from the context of their work. A challenge to data archives is the wide variety of metadata schemata in use, which creates a number of maintenance and design challenges of its own. PanMetaDocs addresses these issues by allowing an uploaded files to be described by more than one metadata object. PanMetaDocs, which was developed from PanMetaWorks, is a PHP based web application that allow to describe data with any xml-based metadata schema. Its user interface is browser based and was developed to collect metadata and data in collaborative scientific projects situated at one or more institutions. The metadata fields can be filled with static or dynamic content to reduce the number of fields that require manual entries to a minimum and make use of contextual information in a project setting. In the development of PanMetaDocs the business logic of panMetaWorks is reused, except for the authentication and data management functions of PanMetaWorks, which are delegated to the eSciDoc framework. The eSciDoc repository framework is designed as a service oriented architecture that can be controlled through a REST interface to create version controlled items with metadata records in XML format. PanMetaDocs utilizes the eSciDoc items model to add multiple metadata records that describe uploaded files in different metadata schemata. While datasets are collected and described, shared to collaborate with other scientists and finally published, data objects are transferred from a shared data curation domain into a persistent data curation domain. Through an RSS interface for recent datasets PanMetaWorks allows project members to be informed about data uploaded by other project members. The implementation of the OAI-PMH interface can be used to syndicate data catalogs to research data portals, such as the panFMP data portal framework. Once data objects are uploaded to the eSciDoc infrastructure it is possible to drop the software instance that was used for collecting the data, while the compiled data and metadata are accessible for other authorized applications through the institution's eSciDoc middleware. This approach of "expendable data curation tools" allows for a significant reduction in costs for software maintenance as expensive data capture applications do not need to be maintained indefinitely to ensure long term access to the stored data.