Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[batch] The Batch UI should incorporate the job group structure to more easily navigate jobs #14598

Open
daniel-goldstein opened this issue Jul 2, 2024 · 0 comments · May be fixed by #14600

Comments

@daniel-goldstein
Copy link
Contributor

daniel-goldstein commented Jul 2, 2024

What happened?

Job groups are as of writing not generally usable in the public interface, but Query on Batch now uses them to structure actions and stages of computation. For example, a Hail Query session will have one Batch with the following job group structure:

1. read_table job group
    - driver read_table job
2. execute job group
    - driver job
    - stage 1 job group
        - partition 1 job
        - partition 2 job
        …
    - stage 2 job group
        - partition 1 job
        - partition 2 job
        …

but the current batch UI just has a jobs table listing all of the jobs in order of submission. It would be a huge boon to UX for users to be get a high level view of the structure of their query and to contextualize a failed job through its action > stage > partition structure.

This should be an almost entirely front end change. It will likely involve additional HTTP endpoints but should not affect the batch data model or the way QoB engages with it.

Version

0.2.131

Relevant log output

No response

@daniel-goldstein daniel-goldstein added needs-triage A brand new issue that needs triaging. batch enhancement labels Jul 2, 2024
@daniel-goldstein daniel-goldstein linked a pull request Jul 2, 2024 that will close this issue
@daniel-goldstein daniel-goldstein removed the needs-triage A brand new issue that needs triaging. label Jul 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant