Skip to content

Commit

Permalink
feat: testing perfil mensal flow
Browse files Browse the repository at this point in the history
  • Loading branch information
arthurfg committed Sep 19, 2023
1 parent 762884a commit ee5b4e0
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion pipelines/datasets/br_cvm_fi/flows.py
Original file line number Diff line number Diff line change
Expand Up @@ -385,9 +385,14 @@
default=cvm_constants.URL_PERFIL_MENSAL.value,
required=False,
)
arquivos = Parameter(
"arquivos",
default=["perfil_mensal_fi_202308.csv", "perfil_mensal_fi_202307.csv"],
required=False,
)

df = extract_links_and_dates(url)
arquivos = check_for_updates(df, upstream_tasks=[df])
# arquivos = check_for_updates(df, upstream_tasks=[df])

with case(is_empty(arquivos), True):
log_task(f"Não houveram atualizações em {url.default}!")
Expand Down

0 comments on commit ee5b4e0

Please sign in to comment.