Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[REVIEW] Support GpuFilter and GpuCoalesceBatches for decimal data #1192

Merged
merged 6 commits into from
Dec 3, 2020

Conversation

sperlingxx
Copy link
Collaborator

Since both PR to enable cudf::apply_boolean_mask for decimal and PR to enable cudf::contiguous_split for decimal are ready, we can support GpuCoalesceBatches and GpuFilter (which relied on GpuCoalesceBatches).

This PR is to enable GpuFilter for decimal type. And related tests for GpuFilter and GpuCoalesceBatches are also provided.

In this PR, isNotNull is used as predicate of decimal filter because relational operators for decimal type are still unsupported.

@sperlingxx
Copy link
Collaborator Author

build

@revans2
Copy link
Collaborator

revans2 commented Nov 24, 2020

The integration tests started to crash after this change. I am not 100% sure what happened but a lot of the tests started to get errors not being able to connect to the JVM process which makes me think that it crashed. (you could try running with TEST_PARALLEL=0 in your environment to get the tests to spit out more info about the run, but it will take longer)

@revans2
Copy link
Collaborator

revans2 commented Nov 24, 2020

You can probably also look at integration_tests/target/run_dir/target/surefire-reports/scala-test-detailed-output.log if you do run in parallel mode, but sadly that is not available from the CI runs.

@sperlingxx
Copy link
Collaborator Author

sperlingxx commented Nov 24, 2020

@revans2 I also found integration tests failure of same pattern in PR #1191. And I can run the command mvn clean verify -e -Dcuda.version=cuda10-2 -Dpytest.TEST_PARALLEL=0 successfully in local machine.

@revans2
Copy link
Collaborator

revans2 commented Nov 24, 2020

OK I am investigating it

@jlowe
Copy link
Member

jlowe commented Nov 25, 2020

build

1 similar comment
@sperlingxx
Copy link
Collaborator Author

build

@sperlingxx
Copy link
Collaborator Author

build

…cala

Co-authored-by: Jason Lowe <jlowe@nvidia.com>
@jlowe
Copy link
Member

jlowe commented Dec 1, 2020

build

@sperlingxx
Copy link
Collaborator Author

build

@sperlingxx
Copy link
Collaborator Author

build

1 similar comment
@sperlingxx
Copy link
Collaborator Author

build

@sperlingxx
Copy link
Collaborator Author

rebuild

@pxLi
Copy link
Collaborator

pxLi commented Dec 3, 2020

build

2 similar comments
@sperlingxx
Copy link
Collaborator Author

build

@GaryShen2008
Copy link
Collaborator

build

@revans2 revans2 merged commit a147ad3 into NVIDIA:branch-0.3 Dec 3, 2020
@sameerz sameerz added the feature request New feature or request label Dec 3, 2020
@sperlingxx sperlingxx deleted the dec_conti_table_test branch April 8, 2021 03:06
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Signed-off-by: sperlingxx <lovedreamf@gmail.com>

Co-authored-by: Jason Lowe <jlowe@nvidia.com>
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Signed-off-by: sperlingxx <lovedreamf@gmail.com>

Co-authored-by: Jason Lowe <jlowe@nvidia.com>
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this pull request Nov 30, 2023
…IDIA#1192)

Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants