Skip to content

Commit

Permalink
initial load in prod for aepg -> precipWeighing
Browse files Browse the repository at this point in the history
  • Loading branch information
covesturtevant committed Dec 18, 2024
1 parent 0935282 commit 58fa095
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion pipe/aepg600m/aepg600m_cron_daily_and_date_control.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ transform:
# This is because some kafka topics start with <site>dfir instead of simply <site>, which the trino loader cannot handle
LAG_DAYS_END: "2" # Default is 2. Don't go lower than 2.
START_DATE: "2014-12-24"
# END_DATE: "2024-01-06"
END_DATE: "2018-01-06"
OUT_PATH_KAFKA: /pfs/out/kafka
OUT_PATH_TRINO: /pfs/out/trino
SOURCE_TYPE_NONHEATED: "aepg600m"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ transform:
# END_DATE can be set or unset (comment or remove line to unset). If unset, end month will be last month.
OUT_PATH: /pfs/out
START_MONTH: "2015-01"
# END_MONTH: "2023-12" # Inclusive. Run the pipeline with END_MONTH set to initialize, then comment out and update pipeline (no reprocess) to let the cron take over
END_MONTH: "2017-12" # Inclusive. Run the pipeline with END_MONTH set to initialize, then comment out and update pipeline (no reprocess) to let the cron take over
stdin:
- "#!/bin/bash"
- ./cron_monthly_and_pub_control/populate_pub_months.sh
Expand Down

0 comments on commit 58fa095

Please sign in to comment.