Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding binary read/write as options for parquet #11160

Merged
merged 37 commits into from
Jul 29, 2022
Merged

Adding binary read/write as options for parquet #11160

merged 37 commits into from
Jul 29, 2022

Commits on Jul 21, 2022

  1. adding byte array view structure

    @hyperbolic2346
    hyperbolic2346 committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    fcc3939 View commit details
    Browse the repository at this point in the history

  2. updating from review comments on another PR

    @hyperbolic2346
    hyperbolic2346 committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    72f50c5 View commit details
    Browse the repository at this point in the history

  3. adding some nodiscards

    @hyperbolic2346
    hyperbolic2346 committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    98bc6cf View commit details
    Browse the repository at this point in the history

  4. Adding byte array statistics support for parquet

    @hyperbolic2346
    hyperbolic2346 committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    5b6dbee View commit details
    Browse the repository at this point in the history

  5. byte_array_view added and plumbed through

    @hyperbolic2346
    hyperbolic2346 committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    b99fa32 View commit details
    Browse the repository at this point in the history

  6. updating from review comments

    @hyperbolic2346
    hyperbolic2346 committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    11d9b48 View commit details
    Browse the repository at this point in the history

  7. Adding binary read/write as options for parquet

    @hyperbolic2346
    hyperbolic2346 committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    11e8a26 View commit details
    Browse the repository at this point in the history

  8. fixing java API

    @hyperbolic2346
    hyperbolic2346 committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    5c4a61f View commit details
    Browse the repository at this point in the history

  9. Co-authored-by: MithunR <mythrocks@users.noreply.github.com>

    @hyperbolic2346
    hyperbolic2346 committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    2702803 View commit details
    Browse the repository at this point in the history

  10. change wording to indicate unicode vs ascii strings

    @hyperbolic2346
    hyperbolic2346 committed Jul 21, 2022
    Configuration menu
    Copy the full SHA
    ce5bdef View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2022

  1. adding min and max and >= along with <= comparisons

    @hyperbolic2346
    hyperbolic2346 committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    2038eb0 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2022

  1. updating string writing code

    @hyperbolic2346
    hyperbolic2346 committed Jul 23, 2022
    Configuration menu
    Copy the full SHA
    0608d7b View commit details
    Browse the repository at this point in the history

  2. updating from comments

    @hyperbolic2346
    hyperbolic2346 committed Jul 23, 2022
    Configuration menu
    Copy the full SHA
    ae2a07f View commit details
    Browse the repository at this point in the history

  3. updates from changes and comments

    @hyperbolic2346
    hyperbolic2346 committed Jul 23, 2022
    Configuration menu
    Copy the full SHA
    abe1bb3 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'mwilson/byte_array_view' into mwilson/parquet_binary_st… 

    …atistics
    @hyperbolic2346
    hyperbolic2346 committed Jul 23, 2022
    Configuration menu
    Copy the full SHA
    e33a830 View commit details
    Browse the repository at this point in the history

  5. reverting back to uint8_t

    @hyperbolic2346
    hyperbolic2346 committed Jul 23, 2022
    Configuration menu
    Copy the full SHA
    ddfdeb8 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'mwilson/byte_array_view' into mwilson/parquet_binary_st… 

    …atistics
    @hyperbolic2346
    hyperbolic2346 committed Jul 23, 2022
    Configuration menu
    Copy the full SHA
    36e1bdd View commit details
    Browse the repository at this point in the history

  7. fixing some merge issues and some cleanup

    @hyperbolic2346
    hyperbolic2346 committed Jul 23, 2022
    Configuration menu
    Copy the full SHA
    f90a769 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2022

  1. Merge remote-tracking branch 'upstream/branch-22.08' into mwilson/byt… 

    …e_array_view
    @hyperbolic2346
    hyperbolic2346 committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    6b18f1b View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/branch-22.08' into mwilson/par… 

    …quet_binary_statistics
    @hyperbolic2346
    hyperbolic2346 committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    0b7ce44 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'mwilson/parquet_binary_statistics' into mwilson/parquet… 

    …_writer_binary
    @hyperbolic2346
    hyperbolic2346 committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    fd21b6e View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2022

  1. Fixing orc(which passes list_views to statistics) and a merge issue

    @hyperbolic2346
    hyperbolic2346 committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    12855bf View commit details
    Browse the repository at this point in the history

  2. moving to statistics namespace

    @hyperbolic2346
    hyperbolic2346 committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    88f6f38 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'mwilson/byte_array_view' into mwilson/parquet_binary_st… 

    …atistics
    @hyperbolic2346
    hyperbolic2346 committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    e94f487 View commit details
    Browse the repository at this point in the history

  4. updating namespace for byte_array_view

    @hyperbolic2346
    hyperbolic2346 committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    7e4b849 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'mwilson/parquet_binary_statistics' into mwilson/parquet… 

    …_writer_binary
    @hyperbolic2346
    hyperbolic2346 committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    85d9a4e View commit details
    Browse the repository at this point in the history

  6. updating from review comments

    @hyperbolic2346
    hyperbolic2346 committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    bafd3a4 View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2022

  1. removing until Raza can work on the plugin side

    @hyperbolic2346
    hyperbolic2346 committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    01818d6 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'mwilson/parquet_binary_statistics' into mwilson/parquet… 

    …_writer_binary
    @hyperbolic2346
    hyperbolic2346 committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    25ef1e2 View commit details
    Browse the repository at this point in the history

  3. small change requested in review

    @hyperbolic2346
    hyperbolic2346 committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    0024aea View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/branch-22.08' into mwilson/par… 

    …quet_writer_binary
    @hyperbolic2346
    hyperbolic2346 committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    532091c View commit details
    Browse the repository at this point in the history

  5. Update cpp/include/cudf/io/parquet.hpp 

    Co-authored-by: MithunR <mythrocks@gmail.com>
    @hyperbolic2346 @mythrocks
    hyperbolic2346 and mythrocks authored Jul 28, 2022
    Configuration menu
    Copy the full SHA
    776342e View commit details
    Browse the repository at this point in the history

  6. updates from review comments

    @hyperbolic2346
    hyperbolic2346 committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    352078c View commit details
    Browse the repository at this point in the history

  7. updating from review comments

    @hyperbolic2346
    hyperbolic2346 committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    51dc48c View commit details
    Browse the repository at this point in the history

  8. Delete row_conversion.hpp

    @hyperbolic2346
    hyperbolic2346 authored Jul 28, 2022
    Configuration menu
    Copy the full SHA
    70918c0 View commit details
    Browse the repository at this point in the history

  9. adding unicode test

    @hyperbolic2346
    hyperbolic2346 committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    449d75f View commit details
    Browse the repository at this point in the history

  10. Merge branch 'mwilson/parquet_writer_binary' of github.com:hyperbolic… 

    …2346/cudf into mwilson/parquet_writer_binary
    @hyperbolic2346
    hyperbolic2346 committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    c45b454 View commit details
    Browse the repository at this point in the history