Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Analysis updates #11

Draft
wants to merge 34 commits into
base: main
Choose a base branch
from
Draft

Analysis updates #11

wants to merge 34 commits into from

Conversation

ceblanton
Copy link
Contributor

@ceblanton ceblanton commented Aug 19, 2024 •
edited
Loading

  1. Add build and publish graph for analysis scripts that specify them; done
  2. Generate catalog before running analysis; done
  3. Remove mdtf as a standalone task; done
  4. Add build and publish task definitions; not quite working
  5. Use analysis yaml instead of the analysis/rose-app.conf

Chris Blanton and others added 20 commits July 12, 2024 17:13
Remove old and unused bin/ scripts
344183b
cylc gui can be run anywhere now
53a76b6
Removed pp.yaml updates that are now in fre-cli
7bdbeca
Remove unused and broken mdtf task. mdtf can be run as an analysis sc…
33f81f7 
…ript anyway
#147 Insist the data-catalog task succeed
38d31fc
#147 build the catalog after saving chunk-b timeseries
a8f0904
#147 Generate data catalog before running analysis scripts
693ad9b 
But only for analysis scripts that use timeseries.
#147 Build analysis script environments, cylc graph and task definit…
a7b5d98 
…ions

For now, keep the task definition in flow.cylc but it can be elsewhere.
#147 fix; add build-analysis- tasks for the every-interval and defin…
6c0fc4a 
…ed-interval analysis
#147 fix; add the data-catalog graph for the cumulative and every-in…
b83d42e 
…terval analysis
#147 .csh for csh, .fish for fish, but nothing for bourne
5eaba04
#147 add analysis publish tasks for cumulative analysis
ed27ad9
Merge remote-tracking branch 'gh/main' into 147.catalogs-before-analysis
0e524e3
#147 Added initial cycle point dependence with ^ syntax
67c2562
#147 dummy publish-analysis environment
06b8dcc
#147 Put the build tasks in R1 and put the build dependence in the a…
c015dd6 
…nalysis intervals with [^] syntax
Turn off epmt collection while epmt service is down
8fe660c
#147 Plausible updates to graph and define build and publish tasks
b797dc1
#147 Remove the draft analysis-install script from flow.cylc
f01332f
#147 Add install ray script
8b4f12d
@ceblanton
Copy link
Contributor Author

tmprcwu45qs

do analysis only option turned on

@ceblanton
Copy link
Contributor Author

tmpxqnz0v9t

do analysis only option turned off. normal graph, a bit overwhelming

3 years for both

@ilaflott ilaflott self-requested a review October 23, 2024 13:36
@ilaflott
Copy link
Member

this looks awesome

@ceblanton ceblanton mentioned this pull request Nov 1, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ilaflott ilaflott Awaiting requested review from ilaflott

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ceblanton @ilaflott