Add query.parameters configuration parameter

[ITman1]

Problem

We were unable to customize automatically generated SELECT in timestamp+incrementing mode as we needed. We tried custom query, suffix and delay configuration parameters, but none satisfied our needs. We would wanted something like the reverted incrementing+timestamp mode with possibility to look behind on the timestamp column. It is very specific problem what we have, I might try to explain it in the comments if you want.

Solution

We did not want to add yet another mode or another delay / timeout configuration therefore we added the possibility to define the SELECT query parameters based on user needs. Together with already existing query configuration parameter this allows anyone to define and parametrize final SELECT fully on his own.

Does this solution apply anywhere else?

• yes
• no

Test Strategy

Testing done:

• Unit tests
• Integration tests
• System tests
• Manual tests

Release Plan

[ITman1]

Hello @ManasjyotiSharma, @anupamaggarwal, @mukkachaitanya,

may I kindly ask you for a checking and approving this PR?

Thank you.

[cla-assistant]

All committers have signed the CLA.

[baunz]

This is a very useful addition to optimize source queries. Have you heard anything from Confluent and are you using this commit in production, @ITman1 ?

[ITman1]

This is a very useful addition to optimize source queries. Have you heard anything from Confluent and are you using this commit in production, @ITman1 ?

As we did not receive any feedback from Confluent we developed custom plugin which wraps the official one. So yes, we achieved to have fully custom SELECT query on production, but not in this fancy way using only one additional parameter.

[baunz]

Okay, thanks for your quick response!