Add tolerations for extended resources

[troychiu]

Why are the changes needed?

Provide a way to add tolerations for extended resources so that users don't have to add it by themselves.

What changes were proposed in this pull request?

Users can specify what extended resources they would like flyte to add tolerations for them.

How was this patch tested?

• unit tests
• end-to-end tested with sandbox

Setup process

Screenshots

Check all the applicable boxes

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Related PRs

Docs link

[codecov]

Codecov Report

Attention: Patch coverage is 92.85714% with 3 lines in your changes missing coverage. Please review.

Project coverage is 37.07%. Comparing base (45935e4) to head (4187dfc).

Files with missing lines	Patch %	Lines
...ns/go/tasks/pluginmachinery/flytek8s/pod_helper.go	91.89%	2 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #6033      +/-   ##
==========================================
+ Coverage   37.05%   37.07%   +0.02%     
==========================================
  Files        1316     1316              
  Lines      132115   132157      +42     
==========================================
+ Hits        48958    49003      +45     
+ Misses      78903    78899       -4     
- Partials     4254     4255       +1     

Flag	Coverage Δ
unittests-datacatalog	51.58% <ø> (ø)
unittests-flyteadmin	54.10% <ø> (+0.02%)	⬆️
unittests-flytecopilot	22.23% <ø> (ø)
unittests-flytectl	62.46% <ø> (ø)
unittests-flyteidl	7.25% <ø> (ø)
unittests-flyteplugins	53.81% <92.85%> (+0.09%)	⬆️
unittests-flytepropeller	42.63% <ø> (ø)
unittests-flytestdlib	57.54% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

---

🚨 Try these New Features:

• Flaky Tests Detection - Detect and resolve failed and flaky tests