Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remove xs:unit testing #10207

Merged
merged 1 commit into from
Oct 4, 2024
Merged

remove xs:unit testing #10207

merged 1 commit into from
Oct 4, 2024

Conversation

turadg
Copy link
Member

@turadg turadg commented Oct 3, 2024

incidental

Description

While working on #10202 I got a CI error that "no function" for the Zoe tests. It turned out to be that ava-xs doesn't support t.snapshot. So I added it to the voluminous "exclude" value and pushed again. Later I see CI fails again because ava-xs is confused by the snapshots directory.

The test:xs-unit job is not carrying its weight. I can't recall it ever detecting an error that wasn't detected in Node. Maybe a while ago it did and it was an important line of defense. In the past year we've developed much more integration testing and I'm confident these tests are redundant.

It generally doesn't hurt to test more, but ava-xs is so different from XS that the cost of reconciliation is too great.

Security Considerations

none

Scaling Considerations

none

Documentation Considerations

none

Testing Considerations

see above

Upgrade Considerations

none

@turadg turadg requested review from mhofman and dckc October 3, 2024 14:02
@turadg turadg requested a review from a team as a code owner October 3, 2024 14:02
Copy link
Member

@dckc dckc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"The test:xs-unit job is not carrying its weight." seems like a non-trivial cost/benefit choice, not something incidental.

I defer to @LuqiPan and/or @toliaqat .

Copy link
Member

@dckc dckc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I changed my mind...

I concur with "In the past year we've developed much more integration testing and I'm confident these tests are redundant."

So this need not be socialized more widely.

@turadg turadg requested review from LuqiPan and toliaqat October 3, 2024 15:09
@dckc
Copy link
Member

dckc commented Oct 3, 2024

p.s. I think ava-xs contorts our dependency tree.

It should be in its own package. Which would mean this PR might prune that package.

Including it in the xsnap package adds otherwise irrelevant dependencies to xsnap.

IOU an issue. not confident I'll find time to collect details to file it, though.

Copy link

cloudflare-workers-and-pages bot commented Oct 3, 2024

Deploying agoric-sdk with  Cloudflare Pages  Cloudflare Pages

Latest commit: 96f737e
Status: ✅  Deploy successful!
Preview URL: https://723de6d9.agoric-sdk.pages.dev
Branch Preview URL: https://ta-no-xs-unit.agoric-sdk.pages.dev

View logs

@turadg turadg added the automerge:rebase Automatically rebase updates, then merge label Oct 3, 2024
There are few to no errors we've detected in unit tests running in XS that we didn't in Node. We now have many other tests that run XS and don't need to unit test these. It generally doesn't hurt to test more, but ava-xs is so different from XS that the cost of reconciliation is too great.
@mergify mergify bot merged commit fdbffa0 into master Oct 4, 2024
80 checks passed
@mergify mergify bot deleted the ta/no-xs-unit branch October 4, 2024 21:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
automerge:rebase Automatically rebase updates, then merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants