Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DC-2026] [archived] rdr import #1044

Open
wants to merge 4 commits into
base: develop
Choose a base branch
from
Open

[DC-2026] [archived] rdr import #1044

wants to merge 4 commits into from

Commits on Dec 8, 2021

  1. [DC-2026] add RDR csv field checks 

    * use gsutils to get the header line only from each csv file in the bucket
* compare the csv file line to the defined schema file
* fail to start the load if the file fields do not match
    @lrwb-aou
    lrwb-aou committed Dec 8, 2021
    Configuration menu
    Copy the full SHA
    a709a9b View commit details
    Browse the repository at this point in the history

  2. [DC-2026] run the check before creating a raw rdr dataset 

    * change run order of file header check and dataset creation
    @lrwb-aou
    lrwb-aou committed Dec 8, 2021
    Configuration menu
    Copy the full SHA
    f82e7ae View commit details
    Browse the repository at this point in the history

  3. [DC-2026] removing unused imports

    @lrwb-aou
    lrwb-aou committed Dec 8, 2021
    Configuration menu
    Copy the full SHA
    473a615 View commit details
    Browse the repository at this point in the history

  4. [DC-2026] linting fixes

    @lrwb-aou
    lrwb-aou committed Dec 8, 2021
    Configuration menu
    Copy the full SHA
    7c307c8 View commit details
    Browse the repository at this point in the history