Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐞 TFRobot [Bug]: failed to run deployments if couldn't find enough zos4 nodes #1245

Open
Eslam-Nawara opened this issue Nov 5, 2024 · 1 comment
Assignees
Labels
tfrobot type_bug Something isn't working
Milestone

Comments

@Eslam-Nawara
Copy link
Contributor

Eslam-Nawara commented Nov 5, 2024

What happened?

trying to run deployment on dev net with 5 nodes requested, the deployer didn't filter for zos3 nodes if no zos4 nodes were found and if fails immediately

I think the deployer should check for zos3 nodes if couldn't find enough zos4 nodes

which network/s did you face the problem on?

Dev

Relevant log output

10:14AM INF done validating configuration file
10:14AM INF Running deployment Node group=group_a
10:14AM INF Filter nodes Node group=group_a
10:14AM DBG error="could not find enough nodes with specified options" opts="free_mru: 75161927680, free_sru: 10737418240, total_cru: 2, region: europe, available_for: 4653, healthy: true, features: network-light, status: up"
10:14AM DBG failed to deploy error="could not find enough nodes with specified options" Node group=group_a
10:14AM INF Retrying to deploy Deployment trial=2 Node group=group_a
10:14AM INF Filter nodes Node group=group_a
10:14AM DBG error="could not find enough nodes with specified options" opts="status: up, free_mru: 75161927680, free_sru: 10737418240, total_cru: 2, region: europe, available_for: 4653, healthy: true, features: network-light"
10:14AM DBG failed to deploy error="could not find enough nodes with specified options" Node group=group_a
10:14AM INF Retrying to deploy Deployment trial=3 Node group=group_a
10:14AM INF Filter nodes Node group=group_a
10:14AM DBG error="could not find enough nodes with specified options" opts="region: europe, available_for: 4653, healthy: true, features: network-light, status: up, free_mru: 75161927680, free_sru: 10737418240, total_cru: 2"
10:14AM DBG failed to deploy error="could not find enough nodes with specified options" Node group=group_a
10:14AM INF Retrying to deploy Deployment trial=4 Node group=group_a
10:14AM INF Filter nodes Node group=group_a
10:14AM DBG error="could not find enough nodes with specified options" opts="region: europe, available_for: 4653, healthy: true, features: network-light, status: up, free_mru: 75161927680, free_sru: 10737418240, total_cru: 2"
10:14AM DBG failed to deploy error="could not find enough nodes with specified options" Node group=group_a
10:14AM INF Retrying to deploy Deployment trial=5 Node group=group_a
10:14AM INF Filter nodes Node group=group_a
10:14AM DBG error="could not find enough nodes with specified options" opts="available_for: 4653, healthy: true, features: network-light, status: up, free_mru: 75161927680, free_sru: 10737418240, total_cru: 2, region: europe"
10:14AM DBG failed to deploy error="could not find enough nodes with specified options" Node group=group_a
10:14AM INF Retrying to deploy Deployment trial=6 Node group=group_a
10:14AM INF Filter nodes Node group=group_a
10:14AM DBG error="could not find enough nodes with specified options" opts="free_sru: 10737418240, total_cru: 2, region: europe, available_for: 4653, healthy: true, features: network-light, status: up, free_mru: 75161927680"
10:14AM DBG failed to deploy error="could not find enough nodes with specified options" Node group=group_a
10:14AM INF canceling contracts project name=vm/group_a
10:14AM DBG checking url=https://graphql.dev.grid.tf/graphql
10:14AM DBG checking url=https://graphql.dev.grid.tf/graphql
10:14AM DBG checking url=https://graphql.dev.grid.tf/graphql
10:14AM DBG checking url=https://graphql.dev.grid.tf/graphql
10:14AM INF project is canceled project name=vm/group_a
ok: {}

10:14AM INF Deployment took 3.351210766s
@Eslam-Nawara Eslam-Nawara added type_bug Something isn't working tfrobot labels Nov 5, 2024
@Eslam-Nawara Eslam-Nawara self-assigned this Nov 5, 2024
@Eslam-Nawara Eslam-Nawara added this to the v0.17.x milestone Nov 5, 2024
@rawdaGastan rawdaGastan modified the milestones: v0.17.x, v0.16.x Nov 5, 2024
@rawdaGastan rawdaGastan moved this to In Progress in 3.15.x Nov 5, 2024
@Eslam-Nawara
Copy link
Contributor Author

updated tfrobot filtration to use zos3 node if it failed to find zos4 node with requested resources

  • before the updated tried to run deployments for a configuration file and got this errors

image

  • after the update tried to run deployments for the same configuration and the deployer was able to recover from the errors
    image

@Eslam-Nawara Eslam-Nawara moved this from In Progress to In Verification in 3.15.x Nov 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tfrobot type_bug Something isn't working
Projects
Status: In Verification
Development

No branches or pull requests

2 participants