Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external shuffle services for merging partitions #30164

Closed
wants to merge 26 commits into from
Closed

[SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external shuffle services for merging partitions #30164

wants to merge 26 commits into from

Commits on Oct 27, 2020

  1. [SPARK-32919][CORE] Driver side changes for coordinating push based s… 

    …huffle by selecting external shuffle services for merging partitions
    @venkata91
    venkata91 committed Oct 27, 2020
    Configuration menu
    Copy the full SHA
    68fc364 View commit details
    Browse the repository at this point in the history

  2. Empty commit to add Min Shen to authors list

    @Victsm @venkata91
    Victsm authored and venkata91 committed Oct 27, 2020
    Configuration menu
    Copy the full SHA
    2688df2 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2020

  1. Addressed some of the comments both from Mridul and Thomas

    @venkata91
    venkata91 committed Nov 2, 2020
    Configuration menu
    Copy the full SHA
    0423970 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2020

  1. Address style check issues

    @venkata91
    venkata91 committed Nov 3, 2020
    Configuration menu
    Copy the full SHA
    eb93fe1 View commit details
    Browse the repository at this point in the history

  2. Address style checks and Mridul's comment

    @venkata91
    venkata91 committed Nov 3, 2020
    Configuration menu
    Copy the full SHA
    f2f61e2 View commit details
    Browse the repository at this point in the history

  3. Address Tom's comment

    @venkata91
    venkata91 committed Nov 3, 2020
    Configuration menu
    Copy the full SHA
    3a6219f View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2020

  1. Prefer active executors for merger locations

    @venkata91
    venkata91 committed Nov 5, 2020
    Configuration menu
    Copy the full SHA
    ca44d03 View commit details
    Browse the repository at this point in the history

  2. Addressed comments from ngone51 and otterc

    @venkata91
    venkata91 committed Nov 5, 2020
    Configuration menu
    Copy the full SHA
    2172f65 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2020

  1. Address ngone51 review comments

    @venkata91
    venkata91 committed Nov 6, 2020
    Configuration menu
    Copy the full SHA
    1e76824 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2020

  1. Address Mridul's review comments

    @venkata91
    venkata91 committed Nov 9, 2020
    Configuration menu
    Copy the full SHA
    3e03109 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/master' into upstream-SPARK-32919

    @venkata91
    venkata91 committed Nov 9, 2020
    Configuration menu
    Copy the full SHA
    cbb66eb View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2020

  1. Addressed review comments

    @venkata91
    venkata91 committed Nov 10, 2020
    Configuration menu
    Copy the full SHA
    a1c8831 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2020

  1. Address review comments

    @venkata91
    venkata91 committed Nov 11, 2020
    Configuration menu
    Copy the full SHA
    047ad0c View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2020

  1. Address ngone51 review comments

    @venkata91
    venkata91 committed Nov 12, 2020
    Configuration menu
    Copy the full SHA
    2d6d266 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2020

  1. pick hosts in random order and remove host from shuffle push merger if a 

    fetch failed exception happens on that host
    @venkata91
    venkata91 committed Nov 13, 2020
    Configuration menu
    Copy the full SHA
    2b0c073 View commit details
    Browse the repository at this point in the history

  2. Addressed ngone51 comments

    @venkata91
    venkata91 committed Nov 13, 2020
    Configuration menu
    Copy the full SHA
    9ba4dfb View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2020

  1. Address review comments

    @venkata91
    venkata91 committed Nov 16, 2020
    Configuration menu
    Copy the full SHA
    5127d8b View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2020

  1. Address attila comments

    @venkata91
    venkata91 committed Nov 17, 2020
    Configuration menu
    Copy the full SHA
    e320ac0 View commit details
    Browse the repository at this point in the history

  2. Addressed ngone51 review comment

    @venkata91
    venkata91 committed Nov 17, 2020
    Configuration menu
    Copy the full SHA
    a2d85ef View commit details
    Browse the repository at this point in the history

  3. Address attilapiros review comments

    @venkata91
    venkata91 committed Nov 17, 2020
    Configuration menu
    Copy the full SHA
    affa8a0 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2020

  1. Add test in UtilsSuite to check push based shuffle is enabled or not

    @venkata91
    venkata91 committed Nov 18, 2020
    Configuration menu
    Copy the full SHA
    46f5670 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'upstream-master' into upstream-SPARK-32919

    @venkata91
    venkata91 committed Nov 18, 2020
    Configuration menu
    Copy the full SHA
    2467a61 View commit details
    Browse the repository at this point in the history

  3. Address Dongjoon comments

    @venkata91
    venkata91 committed Nov 18, 2020
    Configuration menu
    Copy the full SHA
    050a5ae View commit details
    Browse the repository at this point in the history

  4. Merge branch 'upstream-master' into upstream-SPARK-32919

    @venkata91
    venkata91 committed Nov 18, 2020
    Configuration menu
    Copy the full SHA
    1714829 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2020

  1. Merge remote-tracking branch 'upstream/master' into upstream-SPARK-32919

    @venkata91
    venkata91 committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    1ba7668 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2020

  1. Merge remote-tracking branch 'upstream/master' into upstream-SPARK-32919

    @venkata91
    venkata91 committed Nov 20, 2020
    Configuration menu
    Copy the full SHA
    5ce2934 View commit details
    Browse the repository at this point in the history