In:
PLOS ONE, Public Library of Science (PLoS), Vol. 17, No. 4 ( 2022-4-11), p. e0266911-
Abstract:
Common data models standardize the structures and semantics of health datasets, enabling reproducibility and large-scale studies that leverage the data from multiple locations and settings. The Observational Medical Outcomes Partnership Common Data Model (OMOP CDM) is one of the leading common data models. While there is a strong incentive to convert datasets to OMOP, the conversion is time and resource-intensive, leaving the research community in need of tools for mapping data to OMOP. We propose an extract, transform, load (ETL) framework that is metadata-driven and generic across source datasets. The ETL framework uses a new data manipulation language (DML) that organizes SQL snippets in YAML. Our framework includes a compiler that converts YAML files with mapping logic into an ETL script. Access to the ETL framework is available via a web application, allowing users to upload and edit YAML files via web editor and obtain an ETL SQL script for use in development environments. The structure of the DML maximizes readability, refactoring, and maintainability, while minimizing technical debt and standardizing the writing of ETL operations for mapping to OMOP. Our framework also supports transparency of the mapping process and reuse by different institutions.
Type of Medium:
Online Resource
ISSN:
1932-6203
DOI:
10.1371/journal.pone.0266911
DOI:
10.1371/journal.pone.0266911.g001
DOI:
10.1371/journal.pone.0266911.g002
DOI:
10.1371/journal.pone.0266911.g003
DOI:
10.1371/journal.pone.0266911.g004
DOI:
10.1371/journal.pone.0266911.g005
DOI:
10.1371/journal.pone.0266911.g006
DOI:
10.1371/journal.pone.0266911.s001
DOI:
10.1371/journal.pone.0266911.s002
DOI:
10.1371/journal.pone.0266911.s003
DOI:
10.1371/journal.pone.0266911.s004
DOI:
10.1371/journal.pone.0266911.s005
DOI:
10.1371/journal.pone.0266911.s006
Language:
English
Publisher:
Public Library of Science (PLoS)
Publication Date:
2022
detail.hit.zdb_id:
2267670-3
Permalink