Document parallel metadata loading for Hive, Iceberg, and Delta

trinodb · Nov 22, 2024 · d34e358 · d34e358
1 parent dac8751
commit d34e358
Show file tree

Hide file tree

Showing 3 changed files with 12 additions and 0 deletions.
diff --git a/docs/src/main/sphinx/connector/delta-lake.md b/docs/src/main/sphinx/connector/delta-lake.md
@@ -198,6 +198,10 @@ values. Typical usage does not require you to configure them.
 * - `delta.deletion-vectors-enabled`
   - Set to `true` for enabling deletion vectors by default when creating new tables.
   - `false`
+* - `delta.metadata.parallelism`
+  - Number of threads used for retrieving metadata. Currently, only table loading 
+    is parallelized.
+  - `8`
 :::
 
 ### Catalog session properties

diff --git a/docs/src/main/sphinx/connector/hive.md b/docs/src/main/sphinx/connector/hive.md
@@ -291,6 +291,10 @@ Hive connector documentation.
   - Enables auto-commit for all writes. This can be used to disallow
     multi-statement write transactions.
   - `false`
+* - `hive.metadata.parallelism`
+  - Number of threads used for retrieving metadata. Currently, only table loading
+    is parallelized.
+  - `8`
 :::
 
 (hive-file-system-configuration)=

diff --git a/docs/src/main/sphinx/connector/iceberg.md b/docs/src/main/sphinx/connector/iceberg.md
@@ -229,6 +229,10 @@ implementation is used:
 * - `iceberg.split-manager-threads`
   -  Number of threads to use for generating splits.
   -  Double the number of processors on the coordinator node.
+* - `iceberg.metadata.parallelism`
+  - Number of threads used for retrieving metadata. Currently, only table loading 
+    is parallelized.
+  - `8`
 :::
 
 (iceberg-fte-support)=