Generate synthetic manifests for performance tests #1495
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
plypaul
force-pushed
the
p--short-term-perf--35
branch
from
a174eb8 to
66aa80b
Compare
plypaul
force-pushed
the
p--short-term-perf--35
branch
from
66aa80b to
ab4a8b5
Compare
plypaul
force-pushed
the
p--short-term-perf--34
branch
from
85662b2 to
7357bb9
Compare
plypaul
force-pushed
the
p--short-term-perf--35
branch
from
ab4a8b5 to
43468b2
Compare
serramatutu
reviewed
Nov 4, 2024
| * Minimize the number of parameters required. | ||
|
|
||
| Notes: | ||
| * The synthetic manifest groups semantic models into two types - ones containing measures, and others containing dimensions. |
There was a problem hiding this comment.
I suppose this still captures the relevant behavior from production models, so it's fine? Is there anything extra we'd able to test by relaxing this and creating "mixed" models?
There was a problem hiding this comment.
Same question for the other constraints: you can reach all measures via all dimensions etc.
There was a problem hiding this comment.
So those are simplifications to make it easier to generate semantic models and to make it easier to generate queries for metric. Mixed models would make it mimic production better, but I didn't think the added complexity would flesh out any performance cases that much better.
serramatutu
approved these changes
Nov 4, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds a few classes to generate a synthetic manifest. The synthetic manifest can then be used to profile performance and scaling behavior.