Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support spark.sql.parquet.datetimeRebaseModeInWrite=LEGACY #9132

Merged
merged 16 commits into from
Sep 7, 2023
Merged

Support spark.sql.parquet.datetimeRebaseModeInWrite=LEGACY #9132

merged 16 commits into from
Sep 7, 2023

Commits on Aug 29, 2023

  1. Rewrite GpuParquetWriter

    @ttnghia
    ttnghia committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    5c8d512 View commit details
    Browse the repository at this point in the history

  2. Add sign-off 

    Signed-off-by: Nghia Truong <nghiatruong.vn@gmail.com>
    @ttnghia
    ttnghia committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    7bb8c88 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. Merge branch 'branch-23.10' into rebase_timestamp

    @ttnghia
    ttnghia committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    922830f View commit details
    Browse the repository at this point in the history

  2. Call to rebase day/timestamp 

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    @ttnghia
    ttnghia committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    e1c0459 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2023

  1. Add test 

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    @ttnghia
    ttnghia committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    e70aa9b View commit details
    Browse the repository at this point in the history

  2. Add more comprehensive tests 

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    @ttnghia
    ttnghia committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    93433bf View commit details
    Browse the repository at this point in the history

  3. Add parquet read config 

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    @ttnghia
    ttnghia committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    dd60b9c View commit details
    Browse the repository at this point in the history

  4. Only support UTC timezone 

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    @ttnghia
    ttnghia committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    156ca47 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. Use TypeChecks code to verify timezone 

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    @ttnghia
    ttnghia committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    b2161d4 View commit details
    Browse the repository at this point in the history

  2. Update tests 

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    @ttnghia
    ttnghia committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    43cab3b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-23.10' into rebase_timestamp

    @ttnghia
    ttnghia committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    e5f30b0 View commit details
    Browse the repository at this point in the history

  4. Cleanup header 

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    @ttnghia
    ttnghia committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    ad5c0ea View commit details
    Browse the repository at this point in the history

  5. Fix test input 

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    @ttnghia
    ttnghia committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    e139e55 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. Remove start parameter from data gen to avoid round-off issue 

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    @ttnghia
    ttnghia committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    6d7953a View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. Merge branch 'branch-23.10' into rebase_timestamp

    @ttnghia
    ttnghia committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    3d4843c View commit details
    Browse the repository at this point in the history

  2. Revert accidental changes 

    Signed-off-by: Nghia Truong <nghiat@nvidia.com>
    @ttnghia
    ttnghia committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    1f10ae1 View commit details
    Browse the repository at this point in the history