[FEAT] run cluster on commit

[raunakab]

Overview

This PR extends the existing run-clusters workflow with the ability to run on any arbitrary daft-wheel that is given to it.

[codspeed-hq]

CodSpeed Performance Report

Merging #3461 will degrade performances by 33.08%

_{Comparing feat/run-cluster-on-commit (709e2da) with main (b5f60e0)}

Summary

⚡ 1 improvements
❌ 2 regressions
✅ 14 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

	Benchmark	main	feat/run-cluster-on-commit	Change
⚡	test_count[1 Small File]	4.1 ms	3.4 ms	+21.01%
❌	test_iter_rows_first_row[100 Small Files]	298.1 ms	384.3 ms	-22.44%
❌	test_show[100 Small Files]	16.6 ms	24.8 ms	-33.08%

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 77.49%. Comparing base (b5f60e0) to head (709e2da).
Report is 8 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #3461   +/-   ##
=======================================
  Coverage   77.49%   77.49%           
=======================================
  Files         687      687           
  Lines       84483    84483           
=======================================
+ Hits        65471    65473    +2     
+ Misses      19012    19010    -2     

see 2 files with indirect coverage changes