Skip to content

Commit

Permalink
A new implementation of an Iceberg Sink [WIP] thta will be used with …
Browse files Browse the repository at this point in the history
…upcoming Flink Compaction jobs
  • Loading branch information
rodmeneses committed May 6, 2024
1 parent 9357b8f commit 5d6821e
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -103,9 +103,9 @@
* <li>{@link WithPreCommitTopology} which we use to to place the {@link SinkAggregator} which
* merges the individual {@link org.apache.flink.api.connector.sink2.SinkWriter}'s {@link
* org.apache.iceberg.io.WriteResult}s to a single {@link
* org.apache.iceberg.flink.sink.committer.DeltaManifests}
* org.apache.iceberg.flink.sink.DeltaManifests}
* <li>{@link Committer} which stores the incoming {@link
* org.apache.iceberg.flink.sink.committer.DeltaManifests}s in state for recovery, and commits
* org.apache.iceberg.flink.sink.DeltaManifests}s in state for recovery, and commits
* them to the Iceberg table
* <li>{@link WithPostCommitTopology} we could use for incremental compaction later. This is not
* implemented yet.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@
* <li>WriterResult - The output files generated by the individual writers. Containing only a
* {@link WriteResult}
* <li>Committable - The aggregated results of a single checkpoint which should be committed.
* Containing the serialized {@link DeltaManifests} file - which contains the commit data, and
* Containing the serialized {@link org.apache.iceberg.flink.sink.DeltaManifests} file - which contains the commit data, and
* the jobId, operatorId, checkpointId triplet which helps identifying the specific commit
* </ul>
*
Expand Down

0 comments on commit 5d6821e

Please sign in to comment.