Optimization of arctic dim table join in the Flink engine #547
Replies: 1 comment
-
There are some thinkings about it.
Enforce-reader operator has two input streams and one output stream. Step1: Right Source send a msg start-load-into-rocksdb-event to Enforce Read, and Enforce reader stop reading the data from Left Souce; |
Beta Was this translation helpful? Give feedback.
-
According to the Flink Dim performance test guide,
The left table QPS: 1w/s
the right table size: 10G, 1580w
the parallelism is: 8
The first-time join match cost 3mins, which is still too high.
We should consider reducing the cost.
Beta Was this translation helpful? Give feedback.
All reactions