SP-4263 Implement compute quotas

[anujachaitanya]

Changes

1. Created separate helm chart for queues creation
2. Added variable for localqueue in launch files for dynamic selection
3. Localqueue selection based on user groups
4. Introduced KubectlCommandBuilder
5. Updated kueue version to 0.9.1

CC: @abhishekghoshhh

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 21.00%. Comparing base (fdd5623) to head (99c2d8d).

Additional details and impacted files

@@             Coverage Diff              @@
##               main     #719      +/-   ##
============================================
+ Coverage     18.61%   21.00%   +2.39%     
- Complexity      102      129      +27     
============================================
  Files            22       24       +2     
  Lines          1961     2061     +100     
  Branches        270      278       +8     
============================================
+ Hits            365      433      +68     
- Misses         1544     1574      +30     
- Partials         52       54       +2     

Flag	Coverage Δ
skaha-unittests-coverage	21.00% <ø> (+2.39%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[anujachaitanya]

Any updates on this @at88mph ?

[shinybrar]

@anujachaitanya @abhishekghoshhh

Can you shed light on the reason to use transfer the main Kueue Helm Chart into this repository? We can potentially use the upstream Kueue Helm Chart as a dependency in the base chart, and appropriately configure it.

[anujachaitanya]

@anujachaitanya @abhishekghoshhh

Can you shed light on the reason to use transfer the main Kueue Helm Chart into this repository? We can potentially use the upstream Kueue Helm Chart as a dependency in the base chart, and appropriately configure it.

Hello
@shinybrar, Kueue needs kueue-system as the namespace to run. We tried adding kueue as a dependency to the base helm chart but helm does not provide the functionality to configure namespaces for dependencies. Hence we could not add kueue as dependency.

[shinybrar]

@shinybrar, Kueue needs kueue-system as the namespace to run. We tried adding kueue as a dependency to the base helm chart but helm does not provide the functionality to configure namespaces for dependencies. Hence we could not add kueue as dependency.

We can require to have a separate installation command for kueue, e.g.

helm install kueue/chart/location/ --create-namespace --namespace kueue-system my-override-values.yaml

We prefer, just to have the one amended values.yaml, rather than merging the entire upstream chart to mainline, because currently, if kueue releases a new feature, we have to modify/sync the entire chart with upstream changes, rather than enable a config or feature flag in our values.yaml.

Additionally, it is not strictly required to install Kueue in a namespace named kueue-system, even though it is the default and recommended setup and all official manifests and documentation refer back to it, so we can also install it in skaha-system namespace if needed.

Also, maybe queue-config should not be a chart, but rather just sample templates under the Base Helm Chart which are created only when you detect a Kueue CRD installed. This way, base can be amended by cluster admins to reflect the respective deployments environments. I could be convinced either way, though.