Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix: Add adapters for commands that are not using the snapshot evaluator #3531

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

themisvaltinos
Copy link
Contributor

@themisvaltinos themisvaltinos commented Dec 17, 2024

This fixes an omission on the latest multi-engine feature, to create the engine adapters in cases when they're not generated in the snapshot_evaluator property, ie for the commands render, table_diff and create_test

@themisvaltinos themisvaltinos requested review from sungchun12 and a team December 17, 2024 22:20
@erindru
Copy link
Collaborator

erindru commented Dec 17, 2024

No existing tests picked up this regression, are you able to add a test?

@themisvaltinos
Copy link
Contributor Author

No existing tests picked up this regression, are you able to add a test?

Yes because these commands wouldnt work only for models which had the gateway specified property. I will think of tests to add as well

@themisvaltinos themisvaltinos force-pushed the themis/engine_adapters_fix branch from 5c501f2 to 01969a8 Compare December 18, 2024 11:47
@themisvaltinos themisvaltinos force-pushed the themis/engine_adapters_fix branch from d02ffcf to a31a67d Compare December 20, 2024 11:33
@themisvaltinos themisvaltinos force-pushed the themis/engine_adapters_fix branch from 95a012c to 07d048c Compare December 22, 2024 11:15
@@ -1731,6 +1733,8 @@ def _normalize_snowflake(name: str, prefix_regex: str = "(sqlmesh__)(.*)"):
if config.model_defaults.dialect != ctx.dialect:
config.model_defaults = config.model_defaults.copy(update={"dialect": ctx.dialect})

# To enable parallelism in integration tests
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why does this impact parallelism?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To isolate the connections per test because otherwise they will encounter concurrency issues, as they will end up using the same connections. Since all the engine adapters are created upfront and this particular file's tests are using for the context the same config: https://github.com/TobikoData/sqlmesh/blob/main/tests/core/engine_adapter/integration/config.yaml

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants