Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add shallow hash function and shallow equality comparison for column_view #9312

Merged

Conversation

karthikeyann
Copy link
Contributor

Fixes #9140
Added shallow_hash(column_view)
Added unit tests
SWIPAT approval complete

It computes hash values based on the shallow states of column_view:
type, size, data pointer, null_mask pointer, offset, and the hash value of the children.
null_count is not used since it is a cached value and it may vary based on contents of null_mask, and may be pre-computed or not.

Fixes #9139
Added is_shallow_equivalent(column_view, column_view) shallow_equal
Added unit tests

It compares two column_views based on the shallow states of column_view:
type, size, data pointer, null_mask pointer, offset, and the column_view of the children.
null_count is not used since it is a cached value and it may vary based on contents of null_mask, and may be pre-computed or not.

karthikeyann and others added 22 commits September 8, 2021 00:03
Co-authored-by: Jake Hemstad <jhemstad@nvidia.com>
Co-authored-by: Jake Hemstad <jhemstad@nvidia.com>
Co-authored-by: Jake Hemstad <jhemstad@nvidia.com>
Co-authored-by: David Wendt <45795991+davidwendt@users.noreply.github.com>
@karthikeyann karthikeyann added feature request New feature or request libcudf Affects libcudf (C++/CUDA) code. 4 - Needs Review Waiting for reviewer to review or respond non-breaking Non-breaking change labels Sep 27, 2021
@karthikeyann karthikeyann requested a review from a team as a code owner September 27, 2021 04:24
@github-actions github-actions bot added the CMake CMake build issue label Sep 27, 2021
@karthikeyann
Copy link
Contributor Author

rerun tests

@codecov
Copy link

codecov bot commented Sep 27, 2021

Codecov Report

Merging #9312 (98d4148) into branch-21.12 (ab4bfaa) will increase coverage by 0.04%.
The diff coverage is 0.00%.

❗ Current head 98d4148 differs from pull request most recent head e9db170. Consider uploading reports for the commit e9db170 to get more accurate results
Impacted file tree graph

@@               Coverage Diff                @@
##           branch-21.12    #9312      +/-   ##
================================================
+ Coverage         10.79%   10.83%   +0.04%     
================================================
  Files               116      116              
  Lines             18869    19255     +386     
================================================
+ Hits               2036     2087      +51     
- Misses            16833    17168     +335     
Impacted Files Coverage Δ
python/cudf/cudf/core/series.py 0.00% <0.00%> (ø)
python/cudf/cudf/io/orc.py 0.00% <0.00%> (ø)
python/cudf/cudf/io/hdf.py 0.00% <0.00%> (ø)
python/cudf/cudf/_version.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/abc.py 0.00% <0.00%> (ø)
python/cudf/cudf/api/types.py 0.00% <0.00%> (ø)
python/cudf/cudf/io/dlpack.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/frame.py 0.00% <0.00%> (ø)
python/cudf/cudf/core/index.py 0.00% <0.00%> (ø)
... and 50 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b4560f4...e9db170. Read the comment docs.

Copy link
Contributor

@vyasr vyasr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm assuming #9185 was reverted solely due to the need for SWIPAT approval, because AFAICT the contents of this PR are identical to that one and LGTM.

@vyasr
Copy link
Contributor

vyasr commented Sep 27, 2021

I confirmed that the contents are identical to #9185 with @karthikeyann offline. Since that PR received four approvals before it was merged I'm comfortable going ahead and merging this PR with a single review.

@vyasr
Copy link
Contributor

vyasr commented Sep 27, 2021

@gpucibot merge

@rapids-bot rapids-bot bot merged commit 0b007a5 into rapidsai:branch-21.12 Sep 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
4 - Needs Review Waiting for reviewer to review or respond CMake CMake build issue feature request New feature or request libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change
Projects
None yet
2 participants