-
Notifications
You must be signed in to change notification settings - Fork 891
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Fix a corner case of list lexicographic comparator (#13701)
This fixes a bug showing up in spark-rapids (NVIDIA/spark-rapids#8702) when the lexicographic comparator encounters a corner case with an input table having: * At least two structs-of-lists columns followed by at least one more column, and * All elements of the first structs-of-lists column are all null. This bug is due to a short circuit in the lexicographic comparator that forgets to keep track of the number of processed lists columns during early exit. Authors: - Nghia Truong (https://github.com/ttnghia) Approvers: - Bradley Dice (https://github.com/bdice) - Divye Gala (https://github.com/divyegala) URL: #13701
- Loading branch information
Showing
2 changed files
with
29 additions
and
10 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters