Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get the 'tests' task working again #1975

Merged
merged 11 commits into from
Jul 23, 2024
Merged

Get the 'tests' task working again #1975

merged 11 commits into from
Jul 23, 2024

Conversation

zmc
Copy link
Member

@zmc zmc commented Jul 11, 2024

The 'tests' task had been broken for a very long time. It hasn't passed in years, and
had additionally been masking test failures including some regressions.

This PR:

  • Fixes masking of failures in setup/teardown methods
  • Actually runs all of our tests
  • Excludes tests that need remote nodes when they are not available
  • Improves logging and reporting
  • Adds support for running in CLI mode
  • Fixes several minor test bugs

Signed-off-by: Zack Cerza [email protected]

@zmc zmc requested a review from VallariAg July 11, 2024 16:09
@zmc zmc force-pushed the test-debug branch 2 times, most recently from b38bb95 to f6db3b7 Compare July 11, 2024 18:14
zmc added 10 commits July 11, 2024 16:48
This task has been broken for a very long time. It hasn't passed in years, and
has additionally been masking test failures including some regressions.

This commit:
* Fixes masking of failures in setup/teardown methods
* Actually runs all of our tests
* Excludes tests that need remote nodes when they are not available
* Improves logging and reporting
* Adds support for running in CLI mode

Signed-off-by: Zack Cerza <[email protected]>
Scheduled jobs are failing because they try to write to
/home/ansible.log.

Signed-off-by: Zack Cerza <[email protected]>
Partially enabled by not passing MappingProxyType to it any longer.

Signed-off-by: Zack Cerza <[email protected]>
This reflects reality and also fixes some linter errors.

Signed-off-by: Zack Cerza <[email protected]>
@zmc
Copy link
Member Author

zmc commented Jul 22, 2024

@VallariAg ping

Copy link
Member

@VallariAg VallariAg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Sorry for the late review!

def __init__(self, ctx=None, config=None):
def __init__(self, ctx, config=None):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just curious - why did we remove the default param value of "None" here?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good question! This was to fix the pyright error reportOptionalMemberAccess resulting from things like references to self.ctx.archive in teuthology.task.Ansible. The Task class was never really intended to be used without the ctx.

Copy link
Member Author

@zmc zmc Jul 23, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Error messages like 'foo' is not a known member of 'None'

Copy link
Member

@VallariAg VallariAg Jul 24, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ohh I see, thank you for the explanation! :)

teuthology/misc.py Show resolved Hide resolved
teuthology/suite/merge.py Show resolved Hide resolved
@zmc zmc merged commit a8aed60 into main Jul 23, 2024
8 checks passed
@zmc zmc deleted the test-debug branch July 23, 2024 17:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants