Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Expose row count statistics in GpuShuffleExchangeExec #1855

Merged
merged 8 commits into from
Mar 5, 2021
Merged

Expose row count statistics in GpuShuffleExchangeExec #1855

merged 8 commits into from
Mar 5, 2021

Commits on Mar 3, 2021

  1. Make row counts available in ShuffleQueryStageExec statistics 

    Signed-off-by: Andy Grove <andygrove@nvidia.com>
    @andygrove
    andygrove committed Mar 3, 2021
    Configuration menu
    Copy the full SHA
    92815db View commit details
    Browse the repository at this point in the history

  2. Add shim layer for get query stage statistics

    @andygrove
    andygrove committed Mar 3, 2021
    Configuration menu
    Copy the full SHA
    ee28ce4 View commit details
    Browse the repository at this point in the history

  3. Update shims/spark301/src/main/scala/com/nvidia/spark/rapids/shims/sp… 

    …ark301/Spark301Shims.scala

Co-authored-by: Jason Lowe <jlowe@nvidia.com>
    @andygrove @jlowe
    andygrove and jlowe authored Mar 3, 2021
    Configuration menu
    Copy the full SHA
    0688a90 View commit details
    Browse the repository at this point in the history

  4. Change signature of getQueryStageRuntimeStatistics to take QueryStage… 

    …Exec instead of SparkPlan

Signed-off-by: Andy Grove <andygrove@nvidia.com>
    @andygrove
    andygrove committed Mar 3, 2021
    Configuration menu
    Copy the full SHA
    0c5ee37 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2021

  1. Address feedback 

    Signed-off-by: Andy Grove <andygrove@nvidia.com>
    @andygrove
    andygrove committed Mar 4, 2021
    Configuration menu
    Copy the full SHA
    f9dc37b View commit details
    Browse the repository at this point in the history

  2. Expose row count in 311 shim version of GpuShuffleExchangeExec 

    Signed-off-by: Andy Grove <andygrove@nvidia.com>
    @andygrove
    andygrove committed Mar 4, 2021
    Configuration menu
    Copy the full SHA
    aa040f1 View commit details
    Browse the repository at this point in the history

  3. Update spark301db shim and address PR feedback 

    Signed-off-by: Andy Grove <andygrove@nvidia.com>
    @andygrove
    andygrove committed Mar 4, 2021
    Configuration menu
    Copy the full SHA
    e59946b View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2021

  1. Merge from branch-0.5 and fix merge conflicts 

    Signed-off-by: Andy Grove <andygrove@nvidia.com>
    @andygrove
    andygrove committed Mar 5, 2021
    Configuration menu
    Copy the full SHA
    71a62b1 View commit details
    Browse the repository at this point in the history