Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support lists to/from the GPU #1104

Merged
merged 3 commits into from
Nov 13, 2020
Merged

Conversation

revans2
Copy link
Collaborator

@revans2 revans2 commented Nov 12, 2020

This is blocked on rapidsai/cudf#6749 going in. After it is in this will support moving lists to/from the GPU., even nested lists.

There is also some refactoring of the code associated with this to try and make it cleaner/simpler to test/support.

I will likely still add in some tests for existing array operators to be sure that they are working correctly.

Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
@revans2 revans2 added this to the Nov 9 - Nov 20 milestone Nov 12, 2020
@revans2 revans2 self-assigned this Nov 12, 2020
structBuilder.endStruct()
}
builder.endList()
ret + 4
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some comments here will make it easy for newbies to follow along

Copy link
Member

@jlowe jlowe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not super comfortable with the summing of doubles to compute byte counts. Seems like we're asking to be bitten by an unfortunate truncation because the computed size is epsilon under the actual value due to floating point error.

@revans2
Copy link
Collaborator Author

revans2 commented Nov 13, 2020

build

@revans2 revans2 changed the title [WIP] Support lists to/from the GPU Support lists to/from the GPU Nov 13, 2020
@revans2
Copy link
Collaborator Author

revans2 commented Nov 13, 2020

The dependency has is now in the SNAPSHOT build for cudf so this is no longer WIP

@revans2 revans2 merged commit 3a183ad into NVIDIA:branch-0.3 Nov 13, 2020
@revans2 revans2 deleted the basic_list_support branch November 13, 2020 14:54
@sameerz sameerz added the feature request New feature or request label Nov 13, 2020
sperlingxx pushed a commit to sperlingxx/spark-rapids that referenced this pull request Nov 20, 2020
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this pull request Nov 30, 2023
…IDIA#1104)

Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants