Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix segmented_gather() for null LIST rows #9537

Merged

Commits on Oct 27, 2021

  1. Fix segmented_gather() for null list rows

    `segmented_gather()` currently assumes that null LIST rows also have
    a `0` size (as defined by the difference of adjacent offsets.)
    
    This might not hold, for example, for LIST columns that are members
    of STRUCT columns whose parent null masks are superimposed on its
    children. This would cause a non-empty list row to be marked null,
    without compaction. This leads to errors in fetching elements of a
    list row as seen in NVIDIA/spark-rapids/pull/3770.
    
    This commit adds the handling of uncompacted LIST rows in
    `segmented_gather()`.
    mythrocks committed Oct 27, 2021
    Configuration menu
    Copy the full SHA
    1462721 View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2021

  1. Configuration menu
    Copy the full SHA
    9ac5939 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2021

  1. Configuration menu
    Copy the full SHA
    1778377 View commit details
    Browse the repository at this point in the history