[FEAT] Add cluster profiles

[raunakab]

Overview

• When running a job on a ray-cluster using GHA, we want to be able to configure the configuration of the cluster.
  • this is achieved via "cluster profiles"
  • essentially, this is a set number of configurations (e.g., medium-x86, debug_xs-x86, etc.) that end-users can select from
  • this will take care of all of the configurations without leaking the internals of the ray-configuration story

Available Options

• medium-x86
• debug_xs-x86

I will plan on adding more in the future. For now, this should suffice.

[codspeed-hq]

CodSpeed Performance Report

Merging #3426 will improve performances by 73.35%

_{Comparing feat/cluster-profiles (cc5c5f5) with main (c012577)}

Summary

⚡ 1 improvements
✅ 16 untouched benchmarks

Benchmarks breakdown

	Benchmark	main	feat/cluster-profiles	Change
⚡	test_iter_rows_first_row[100 Small Files]	391.7 ms	225.9 ms	+73.35%

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 76.85%. Comparing base (c012577) to head (cc5c5f5).
Report is 26 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3426      +/-   ##
==========================================
- Coverage   77.35%   76.85%   -0.51%     
==========================================
  Files         684      684              
  Lines       83639    85145    +1506     
==========================================
+ Hits        64700    65435     +735     
- Misses      18939    19710     +771     

see 8 files with indirect coverage changes

[jaychia]

Seems fine, but I would probably refactor to move to doing it in Python dictionaries instead of parametrizing a YAML string. Cleaner, less prone to bugs, and at some point easier to test too.