Remove lists::drop_list_duplicates

[ttnghia]

This PR completely removes cudf::lists::drop_list_duplicates. It is replaced by the new API cudf::list::distinct which has a simpler implementation but better performance. The replacements for internal cudf usage have all been merged before thus there is no side effect or breaking for the existing APIs in this work.

Closes #11114, #11093, #11053, #11034, and closes #9257.

Depends on:

• Refactor collect_set to use cudf::distinct and cudf::lists::distinct #11228
• Implement lists::distinct and cudf::detail::stable_distinct #11149
• Use cudf::lists::distinct in Python binding #11234
• Use cudf::lists::distinct in Java binding #11233

[codecov]

Codecov Report

Merging #11236 (c1d05d9) into branch-22.08 (b2dd1bf) will increase coverage by 0.03%.
The diff coverage is n/a.

@@               Coverage Diff                @@
##           branch-22.08   #11236      +/-   ##
================================================
+ Coverage         86.34%   86.37%   +0.03%     
================================================
  Files               144      144              
  Lines             22826    22826              
================================================
+ Hits              19708    19715       +7     
+ Misses             3118     3111       -7     

Impacted Files	Coverage Δ
python/cudf/cudf/core/dataframe.py	93.57% <0.00%> (+0.04%)	⬆️
python/cudf/cudf/core/column/string.py	88.80% <0.00%> (+0.12%)	⬆️
python/cudf/cudf/core/groupby/groupby.py	91.02% <0.00%> (+0.21%)	⬆️
python/cudf/cudf/core/column/numerical.py	96.19% <0.00%> (+0.29%)	⬆️
python/cudf/cudf/core/tools/datetimes.py	84.49% <0.00%> (+0.30%)	⬆️
python/cudf/cudf/core/column/lists.py	91.70% <0.00%> (+0.97%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b2dd1bf...c1d05d9. Read the comment docs.

[robertmaynard]

CMake changes approved

[vuule]

Should the PR be named "Remove ..."? Deprecation means that the API is still available.

[bdice]

Nice. -1,741 lines of code is a great feeling.

[bdice]

@ttnghia I think this can be merged when you're ready. You're more familiar with the state of all the linked issues than I am -- please close or comment on all the related issues once this is merged.

edit: Also, I fixed the labels -- PRs removing public APIs are always breaking.

[ttnghia]

Thanks all for helping on this. I'm merging.

[ttnghia]

@gpucibot merge