-
Notifications
You must be signed in to change notification settings - Fork 2.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Flink: port table refresh (#8555) to v1.15 and v1.16 #8616
Conversation
@@ -379,7 +379,7 @@ public void testWriteRowWithTableRefreshInterval() throws Exception { | |||
.map(CONVERTER::toInternal, FlinkCompatibilityUtil.toTypeInfo(SimpleDataUtil.ROW_TYPE)); | |||
|
|||
Configuration flinkConf = new Configuration(); | |||
flinkConf.setString(FlinkWriteOptions.TABLE_REFRSH_INTERVAL.key(), "100ms"); | |||
flinkConf.setString(FlinkWriteOptions.TABLE_REFRESH_INTERVAL.key(), "100ms"); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for fixing this!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me!
@@ -18,6 +18,8 @@ | |||
*/ | |||
package org.apache.iceberg.flink; | |||
|
|||
import java.time.Duration; | |||
import org.apache.calcite.linq4j.function.Experimental; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
looks like the wrong import is being used here
import java.util.Map; | ||
import org.apache.calcite.linq4j.function.Experimental; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
wrong import?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
if we fix this one we should also fix it for flink 1.17
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hm, apologies, I fixed these.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, but I added a comment about a (potentially) wrong import on the Experimental
usage
@bryanck: is this a clean backport? We tend to fix, change everything in 1.17 code , and then do a clean backport to 1.16, 1.15 whenever possible. If there is some change, we highlight it in comments on github. |
@pvary This is a clean backport. Two minor items were discovered on this review which were applied to all versions, I added those to the description. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks @bryanck. Also thanks to @Fokko / @amogh-jahagirdar / @pvary for reviewing
Thanks! |
This PR ports the changes from #8555 (optional table refresh) to Flink version 1.15 and 1.16.
This includes two minor updates for all versions, that were missed in the original PR:
TABLE_REFRSH_INTERVAL
->TABLE_REFRESH_INTERVAL
org.apache.calcite.linq4j.function.Experimental
->org.apache.flink.annotation.Experimental