You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Batch now supports organizing jobs into a hierarchy through job groups, but this is so far only used internally by Query on Batch. Users who want to leverage this structure cannot do so through the hailtop.batch interface. All jobs created by e.g. b.new_job() are implicitly assigned to the "root" job group. We should add the following to hailtop.batch:
A JobGroup class to the public interface that shares any relevant methods that currently exist on the Batch class like new_{bash|python}_job, wait, etc.
A method on Batch to create a new job group and a method on JobGroup to create a child job group
A JobGroup should not have a run method, because there is no sound way in the lower-level batch client currently to only submit a subset of staged jobs/groups and it's unclear whether that behavior would ever be desired.
Version
0.2.132
Relevant log output
No response
The text was updated successfully, but these errors were encountered:
What happened?
Batch now supports organizing jobs into a hierarchy through job groups, but this is so far only used internally by Query on Batch. Users who want to leverage this structure cannot do so through the
hailtop.batch
interface. All jobs created by e.g.b.new_job()
are implicitly assigned to the "root" job group. We should add the following tohailtop.batch
:JobGroup
class to the public interface that shares any relevant methods that currently exist on theBatch
class likenew_{bash|python}_job
,wait
, etc.Batch
to create a new job group and a method onJobGroup
to create a child job groupJobGroup
should not have arun
method, because there is no sound way in the lower-level batch client currently to only submit a subset of staged jobs/groups and it's unclear whether that behavior would ever be desired.Version
0.2.132
Relevant log output
No response
The text was updated successfully, but these errors were encountered: