Skip to content
This repository has been archived by the owner on Aug 4, 2023. It is now read-only.

Add a DAG for backfilling license_url when meta_data is null #1005

Merged
merged 13 commits into from
Mar 10, 2023
Merged

Add a DAG for backfilling license_url when meta_data is null #1005

merged 13 commits into from
Mar 10, 2023

Commits on Mar 9, 2023

  1. Add a DAG for backfilling license_url 

    Signed-off-by: Olga Bulat <[email protected]>
    @obulat
    obulat committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    59cdd1a View commit details
    Browse the repository at this point in the history

  2. Add a DAG for backfilling license_url 

    Signed-off-by: Olga Bulat <[email protected]>
    @obulat
    obulat committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    cc3c031 View commit details
    Browse the repository at this point in the history

  3. Update docs 

    Signed-off-by: Olga Bulat <[email protected]>
    @obulat
    obulat committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    d07cebf View commit details
    Browse the repository at this point in the history

  4. Apply suggestions from code review 

    Co-authored-by: Madison Swain-Bowden <[email protected]>
    @obulat @AetherUnbound
    obulat and AetherUnbound committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    948bf67 View commit details
    Browse the repository at this point in the history

  5. Add changes from code review 

    Signed-off-by: Olga Bulat <[email protected]>
    @obulat
    obulat committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    19830e9 View commit details
    Browse the repository at this point in the history

  6. Use constants for task_ids 

    Signed-off-by: Olga Bulat <[email protected]>
    @obulat
    obulat committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    0216a08 View commit details
    Browse the repository at this point in the history

  7. Use constant for default_argss 

    Signed-off-by: Olga Bulat <[email protected]>
    @obulat
    obulat committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    64087a0 View commit details
    Browse the repository at this point in the history

  8. Extract common functionality 

    Signed-off-by: Olga Bulat <[email protected]>
    @obulat
    obulat committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    9f867cb View commit details
    Browse the repository at this point in the history

  9. Update dag docs 

    Signed-off-by: Olga Bulat <[email protected]>
    @obulat
    obulat committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    86779c5 View commit details
    Browse the repository at this point in the history

  10. Update openverse_catalog/dags/maintenance/add_license_url.py 

    Co-authored-by: Madison Swain-Bowden <[email protected]>
    @obulat @AetherUnbound
    obulat and AetherUnbound committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    791cee3 View commit details
    Browse the repository at this point in the history

  11. Improve counts logging 

    Signed-off-by: Olga Bulat <[email protected]>
    @obulat
    obulat committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    68716ee View commit details
    Browse the repository at this point in the history

  12. Add the timeouts and docs 

    Signed-off-by: Olga Bulat <[email protected]>
    @obulat
    obulat committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    2d15bf5 View commit details
    Browse the repository at this point in the history

  13. Update docs 

    Signed-off-by: Olga Bulat <[email protected]>
    @obulat
    obulat committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    ac7b3ff View commit details
    Browse the repository at this point in the history