Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-34863][SQL] Support complex types for Parquet vectorized reader #34659

Closed
wants to merge 15 commits into from
Closed

[SPARK-34863][SQL] Support complex types for Parquet vectorized reader #34659

wants to merge 15 commits into from
+1,813 −173

Commits on Mar 31, 2022

  1. wip

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    1ac4793 View commit details
    Browse the repository at this point in the history

  2. more tests

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    1452d53 View commit details
    Browse the repository at this point in the history

  3. update golden files

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    22fdbe4 View commit details
    Browse the repository at this point in the history

  4. more fixes

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    033d129 View commit details
    Browse the repository at this point in the history

  5. address comments

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    ee50e4c View commit details
    Browse the repository at this point in the history

  6. fix logic to enable/disable batch reads

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    999df58 View commit details
    Browse the repository at this point in the history

  7. fix lint

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    4782dfb View commit details
    Browse the repository at this point in the history

  8. Address perf issue in ParquetSchemaConverter

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    8a5b5b7 View commit details
    Browse the repository at this point in the history

  9. space

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    aaad383 View commit details
    Browse the repository at this point in the history

  10. address comments

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    7e96a18 View commit details
    Browse the repository at this point in the history

  11. remove more unnecessary changes

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    8c6c2ec View commit details
    Browse the repository at this point in the history

  12. address more comments

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    71192f4 View commit details
    Browse the repository at this point in the history

  13. address more comments

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    4f6efa9 View commit details
    Browse the repository at this point in the history

  14. disable by default

    @sunchao
    sunchao committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    cd6ec99 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2022

  1. address comments and turn on config

    @sunchao
    sunchao committed Apr 1, 2022
    Configuration menu
    Copy the full SHA
    91da32d View commit details
    Browse the repository at this point in the history