Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Save cleaned up data during the cleanup step #904

Merged
merged 15 commits into from
Mar 28, 2023
Merged

Save cleaned up data during the cleanup step #904

merged 15 commits into from
Mar 28, 2023
+98 −25

Commits on Mar 28, 2023

  1. Save cleaned up data during the cleanup step

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    38dd7f5 View commit details
    Browse the repository at this point in the history

  2. Update ingestion_server/ingestion_server/cleanup.py 

    Co-authored-by: Krystle Salazar <[email protected]>
    @obulat @krysal
    obulat and krysal committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    21c9a7b View commit details
    Browse the repository at this point in the history

  3. Add .tsv files to .gitignore

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    e3bb442 View commit details
    Browse the repository at this point in the history

  4. Add some cleanable data to the first rows in sample_image.csv

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    29c15fa View commit details
    Browse the repository at this point in the history

  5. Revert changes to sample_image

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    6b7dc89 View commit details
    Browse the repository at this point in the history

  6. Refactor for readability

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    4a27af9 View commit details
    Browse the repository at this point in the history

  7. Improve TLS_CACHE

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    2cc0c68 View commit details
    Browse the repository at this point in the history

  8. Use context manager with multiprocessing pool

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    be0ce33 View commit details
    Browse the repository at this point in the history

  9. Try to get logs in CI

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    cc91d49 View commit details
    Browse the repository at this point in the history

  10. Revert changes to ci

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    35a2c2c View commit details
    Browse the repository at this point in the history

  11. Move batch_cleaned_counts computation inside pool

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    c640c84 View commit details
    Browse the repository at this point in the history

  12. Add log line

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    64641ed View commit details
    Browse the repository at this point in the history

  13. Add log line

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    6fbb196 View commit details
    Browse the repository at this point in the history

  14. Remove pool context manager

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    2b52f30 View commit details
    Browse the repository at this point in the history

  15. Clean logs

    @obulat
    obulat committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    bb277b8 View commit details
    Browse the repository at this point in the history