Enable zstd integration tests for parquet and orc [databricks]

[jbrennan333]

Signed-off-by: Jim Brennan jimb@nvidia.com

This is a followup to #5898 and #5916.
Now that cuDF PR 11226 has been merged, we no longer need to specify LIBCUDF_NVCOMP_POLICY=ALWAYS to use zstd.

This also updates to include orc_test.py, since cuDF supports zstd for both parquet and orc.

Closes #5580

[jbrennan333]

build

[razajafri]

Should the CI include databricks?

[jbrennan333]

@razajafri not a bad idea. I will add databricks.

[jbrennan333]

build

[jbrennan333]

I'm seeing what look like a lot of unrelated failures in the pre-merge integration tests.

[2022-07-12T21:11:05.301Z] [gw0] [ 48%] FAILED ../../src/main/python/conditionals_test.py::test_case_when[Map(Short(not_null),Struct(['child0', Byte],['child1', Double]))] 
[2022-07-12T21:11:05.558Z] ../../src/main/python/conditionals_test.py::test_if_else[Short] 
[2022-07-12T21:11:05.558Z] [gw0] [ 48%] FAILED ../../src/main/python/conditionals_test.py::test_if_else[Short] 
[2022-07-12T21:11:05.558Z] ../../src/main/python/conditionals_test.py::test_if_else[Double] 
[2022-07-12T21:11:05.559Z] [gw0] [ 49%] FAILED ../../src/main/python/conditionals_test.py::test_if_else[Double] 
[2022-07-12T21:11:05.816Z] ../../src/main/python/conditionals_test.py::test_if_else[Decimal(7,3)] 
[2022-07-12T21:11:05.816Z] [gw1] [ 49%] PASSED ../../src/main/python/window_function_test.py::test_window_running[Decimal(7,3)-Long-1g][IGNORE_ORDER({'local': True})] 

[jlowe]

I'm seeing what look like a lot of unrelated failures in the pre-merge integration tests.

Known issues being worked on, see #5979

[jbrennan333]

@jlowe thanks for the confirmation. I thought it might be that.

[jbrennan333]

build

[jbrennan333]

build

[pxLi]

build

[jbrennan333]

Merged up to resolve conflicts.

[jbrennan333]

build