Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change parameters for memory limit in Parquet chunked reader #10718

Merged
merged 15 commits into from
Apr 23, 2024

Commits on Apr 16, 2024

  1. Refactor Parquet reader

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    bc3003f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    563099e View commit details
    Browse the repository at this point in the history
  3. Update config

    ttnghia committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    bbd63bd View commit details
    Browse the repository at this point in the history
  4. Add back the deprecated config

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    8053382 View commit details
    Browse the repository at this point in the history
  5. Fix config

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    ff46bef View commit details
    Browse the repository at this point in the history
  6. Change message for the deprecated config

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    813b4c8 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. Rename variable

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    decf024 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. Change the logic of reading conf

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    1bdce47 View commit details
    Browse the repository at this point in the history
  2. Add example and mark conf as internal()

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    28e1afd View commit details
    Browse the repository at this point in the history
  3. Reformat code

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    702dbfc View commit details
    Browse the repository at this point in the history
  4. Update docs

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    4fb1d74 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Change configs

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    b1b6470 View commit details
    Browse the repository at this point in the history
  2. Update docs

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    6478de9 View commit details
    Browse the repository at this point in the history
  3. Change variables into functions

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    f455342 View commit details
    Browse the repository at this point in the history
  4. Change functions back into lazy val

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    ttnghia committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    e218cdf View commit details
    Browse the repository at this point in the history