A new implementation of an Iceberg Sink [WIP] thta will be used with …

…upcoming Flink Compaction jobs
apache · May 6, 2024 · 756bbbd · 756bbbd
1 parent 5d6821e
commit 756bbbd
Show file tree

Hide file tree

Showing 2 changed files with 5 additions and 4 deletions.
diff --git a/flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergSink.java b/flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/IcebergSink.java
@@ -105,8 +105,8 @@
  *       org.apache.iceberg.io.WriteResult}s to a single {@link
  *       org.apache.iceberg.flink.sink.DeltaManifests}
  *   <li>{@link Committer} which stores the incoming {@link
- *       org.apache.iceberg.flink.sink.DeltaManifests}s in state for recovery, and commits
- *       them to the Iceberg table
+ *       org.apache.iceberg.flink.sink.DeltaManifests}s in state for recovery, and commits them to
+ *       the Iceberg table
  *   <li>{@link WithPostCommitTopology} we could use for incremental compaction later. This is not
  *       implemented yet.
  * </ul>

diff --git a/flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/committer/SinkCommittable.java b/flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/sink/committer/SinkCommittable.java
@@ -30,8 +30,9 @@
  *   <li>WriterResult - The output files generated by the individual writers. Containing only a
  *       {@link WriteResult}
  *   <li>Committable - The aggregated results of a single checkpoint which should be committed.
- *       Containing the serialized {@link org.apache.iceberg.flink.sink.DeltaManifests} file - which contains the commit data, and
- *       the jobId, operatorId, checkpointId triplet which helps identifying the specific commit
+ *       Containing the serialized {@link org.apache.iceberg.flink.sink.DeltaManifests} file - which
+ *       contains the commit data, and the jobId, operatorId, checkpointId triplet which helps
+ *       identifying the specific commit
  * </ul>
  *
  * {@link SinkCommittableSerializer} is used for serializing the objects between the Writer and the