Handle parquet corner case: Columns with more rows than are in the row group.

[nvdbaranec]

There is a particularly odd corner case that can be constructed where a column in a parquet file has more rows in it than the associated row group specifies. Previously we were inadvertently handling this, however this optimization broke that support:

#11252

The solution is to cap the size of any non-list-child columns to the size of the selected row groups.

Leaving this as a draft while the changes percolate through the spark tests.

[codecov]

Codecov Report

❗ No coverage uploaded for pull request base (branch-22.08@8faf2b0). Click here to learn what that means.
The diff coverage is n/a.

❗ Current head 8f234a5 differs from pull request most recent head b990524. Consider uploading reports for the commit b990524 to get more accurate results

@@               Coverage Diff               @@
##             branch-22.08   #11353   +/-   ##
===============================================
  Coverage                ?   86.43%           
===============================================
  Files                   ?      143           
  Lines                   ?    22777           
  Branches                ?        0           
===============================================
  Hits                    ?    19687           
  Misses                  ?     3090           
  Partials                ?        0           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8faf2b0...b990524. Read the comment docs.

[mythrocks]

👍

I'm not sure how we'd add a test for this case. It seems incorrect that a column have more rows than the row-group.

[ttnghia]

I'm not sure how we'd add a test for this case.

I have the same concern. We may need to have a unit test for the failed case if that is possible.

[nvdbaranec]

@gpucibot merge