-
Notifications
You must be signed in to change notification settings - Fork 3.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow fetching relation names with their types (v2) #19863
Conversation
c1eb89d
to
1007c1c
Compare
1007c1c
to
7239b11
Compare
CI #19747 |
CI #16315 |
7239b11
to
2a571f2
Compare
@losipiuk thank you for your review! I noticed there was a would-be regression for Iceberg, so I added a preparatory commit (currently first) with a test case, that later shows a regression and later improvement. @losipiuk please take another look Now this is an improvement for |
This reduces number of Glue calls when reading from `information_schema.tables` or `system.jdbc.tables`.
This reduces number of Glue calls when reading from `information_schema.tables` or `system.jdbc.tables`.
2a571f2
to
3ebbbeb
Compare
We chatted offline - and even though this is not an universal truth - it makes sense. The important point in the discussion was that HMS protocol is not suited for large deployments anyway; each call to HMS is bounded by request-timeout anyway so extra time is bounded. |
There is no `HiveGlueMetastore`, but `GlueHiveMetastore` does exist.
3ebbbeb
to
131c790
Compare
CI #19888 |
CI #19242 |
Do we need a release note for this .. something about performance improvement for Glue access in Iceberg, Delta Lake and Hive/ |
I am going to assume we dont need release notes entry. |
This reduces number of Glue calls when reading from
information_schema.tables
orsystem.jdbc.tables
.Like #19832 but avoids contentious rename (#19832 (comment)).