-
Notifications
You must be signed in to change notification settings - Fork 2.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Core: Fix loading a table in CachingCatalog with metadata table name #11738
base: main
Are you sure you want to change the base?
Conversation
This is an alternative solution to #11123 |
efe4626
to
34d69e6
Compare
// share TableOperations instance of origin table for all metadata tables, so that metadata | ||
// table instances are | ||
// also refreshed as well when origin table instance is refreshed. | ||
// Share TableOperations instance of origin table for all metadata tables, so that metadata |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we still need code below when we already cache the metadata table above?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's needed to share the underlying TableOperations between the originTable and the metadata table. We basically create another Table object for the table metadata with a different TableOperations and then update the cache with that object.
I see you have made changes previously in CachingCatalog, @rdblue @aokolnychyi @RussellSpitzer . Would you mind taking a look at this PR? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.
If a regular table had a metadata table name then CachingCatalog throws a NoSuchTableException when loading that table. Co-authored-by: Manu Zhang <[email protected]>
34d69e6
to
aedfa9e
Compare
If a regular table had a metadata table name then CachingCatalog throws a NoSuchTableException when loading that table.