Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Treat zstd as stable in nvcomp releases 2.3.2 and later #11226

Merged
merged 2 commits into from
Jul 11, 2022

Conversation

jbrennan333
Copy link
Contributor

Based on our testing of nvcomp zstd decompression with the spark-rapids plugin, we believe that ZSTD should be treated as stable starting with nvcomp release 2.3.2.

Specifically, one should no longer need to specify LIBCUDF_NVCOMP_POLICY=ALWAYS to use ZSTD in cuDF. Note that currently cuDF is still using nvcomp-2.3.0, which should still be treated as experimental.

@github-actions github-actions bot added the libcudf Affects libcudf (C++/CUDA) code. label Jul 8, 2022
@jbrennan333 jbrennan333 self-assigned this Jul 8, 2022
@jbrennan333 jbrennan333 added feature request New feature or request 4 - Needs cuIO Reviewer non-breaking Non-breaking change labels Jul 8, 2022
@codecov
Copy link

codecov bot commented Jul 8, 2022

Codecov Report

❗ No coverage uploaded for pull request base (branch-22.08@4d4632a). Click here to learn what that means.
The diff coverage is n/a.

@@               Coverage Diff               @@
##             branch-22.08   #11226   +/-   ##
===============================================
  Coverage                ?   86.30%           
===============================================
  Files                   ?      144           
  Lines                   ?    22698           
  Branches                ?        0           
===============================================
  Hits                    ?    19589           
  Misses                  ?     3109           
  Partials                ?        0           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4d4632a...fc8b074. Read the comment docs.

@jbrennan333 jbrennan333 marked this pull request as ready for review July 8, 2022 18:18
@jbrennan333 jbrennan333 requested a review from a team as a code owner July 8, 2022 18:18
Copy link
Member

@PointKernel PointKernel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One non-blocking suggestion. LGTM

cpp/src/io/comp/nvcomp_adapter.cpp Show resolved Hide resolved
@PointKernel
Copy link
Member

@gpucibot merge

@rapids-bot rapids-bot bot merged commit f7f8dbc into rapidsai:branch-22.08 Jul 11, 2022
@jbrennan333
Copy link
Contributor Author

Thanks for the reviews and merge!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
4 - Needs Review Waiting for reviewer to review or respond feature request New feature or request libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants