Skip to content

Commit

Permalink
Fixing map column merging for reverseResolve join.
Browse files Browse the repository at this point in the history
  • Loading branch information
piotrszul committed Dec 24, 2024
1 parent 77d2ef9 commit e117280
Showing 1 changed file with 3 additions and 4 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -408,10 +408,9 @@ private Dataset<Row> computeReverseJoin(@Nonnull final Dataset<Row> parentDatase
);

childResult.show();
final Dataset<Row> joinedDataset = parentDataset.join(childResult,
functions.col("key")
.equalTo(childResult.col(joinRoot.getChildKeyTag())),
"left_outer")
final Dataset<Row> joinedDataset = joinWithMapMerge(parentDataset, childResult,
functions.col("key")
.equalTo(childResult.col(joinRoot.getChildKeyTag())))
.drop(joinRoot.getChildKeyTag());
joinedDataset.show();
return joinedDataset;
Expand Down

0 comments on commit e117280

Please sign in to comment.