Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Arbitrary function call in UDF #854

Merged
merged 2 commits into from
Oct 28, 2020

Conversation

wjxiz1992
Copy link
Collaborator

Enable arbitrary function call in UDF

Signed-off-by: Allen Xu allxu@nvidia.com

@wjxiz1992 wjxiz1992 changed the title Add test case for arbitrary function call in UDF [FEA] Arbitrary function call in UDF Sep 25, 2020
@wjxiz1992 wjxiz1992 changed the title [FEA] Arbitrary function call in UDF [WIP] Arbitrary function call in UDF Sep 25, 2020
@wjxiz1992
Copy link
Collaborator Author

wjxiz1992 commented Sep 25, 2020

@seanprime7 Added initial test case for this feature. Current exception: Unsupported instruction: 182

Issue created: #855

@firestarman
Copy link
Collaborator

firestarman commented Sep 25, 2020

It would be better to create an issue for this too. @wjxiz1992

@seanprime7 seanprime7 force-pushed the func-call-in-udf branch 13 times, most recently from 691e5b4 to ca62ffe Compare October 19, 2020 22:58
@seanprime7
Copy link
Contributor

@wjxiz1992 @nvnedelman do you guys see if there is any other method call pattern that needs to be added to the test suite?

@seanprime7 seanprime7 marked this pull request as ready for review October 19, 2020 23:30
@seanprime7 seanprime7 changed the title [WIP] Arbitrary function call in UDF Arbitrary function call in UDF Oct 19, 2020
Signed-off-by: Allen Xu <allxu@nvidia.com>
@seanprime7
Copy link
Contributor

Resolved merge conflicts.

Copy link
Collaborator

@abellina abellina left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just have a couple of nits @seanprime7. Looks good to me though.

With this change, method calls are inlined only if the method being
called
  1. consists of operations supported by the UDF compiler, and
  2. is one of the folllowing:
    * a final method, or
    * a method in a final class, or
    * a method in a final class

Signed-off-by: Sean Lee <selee@nvidia.com>
@abellina
Copy link
Collaborator

build

@abellina abellina merged commit 16e8091 into NVIDIA:branch-0.3 Oct 28, 2020
@seanprime7 seanprime7 deleted the func-call-in-udf branch October 28, 2020 03:53
sperlingxx pushed a commit to sperlingxx/spark-rapids that referenced this pull request Nov 20, 2020
* Add test case for arbitrary function call in UDF

Signed-off-by: Allen Xu <allxu@nvidia.com>

* Inline method calls when possible.

With this change, method calls are inlined only if the method being
called
  1. consists of operations supported by the UDF compiler, and
  2. is one of the folllowing:
    * a final method, or
    * a method in a final class, or
    * a method in a final class

Signed-off-by: Sean Lee <selee@nvidia.com>

Co-authored-by: Allen Xu <allxu@nvidia.com>
Co-authored-by: Sean Lee <selee@nvidia.com>
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
* Add test case for arbitrary function call in UDF

Signed-off-by: Allen Xu <allxu@nvidia.com>

* Inline method calls when possible.

With this change, method calls are inlined only if the method being
called
  1. consists of operations supported by the UDF compiler, and
  2. is one of the folllowing:
    * a final method, or
    * a method in a final class, or
    * a method in a final class

Signed-off-by: Sean Lee <selee@nvidia.com>

Co-authored-by: Allen Xu <allxu@nvidia.com>
Co-authored-by: Sean Lee <selee@nvidia.com>
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
* Add test case for arbitrary function call in UDF

Signed-off-by: Allen Xu <allxu@nvidia.com>

* Inline method calls when possible.

With this change, method calls are inlined only if the method being
called
  1. consists of operations supported by the UDF compiler, and
  2. is one of the folllowing:
    * a final method, or
    * a method in a final class, or
    * a method in a final class

Signed-off-by: Sean Lee <selee@nvidia.com>

Co-authored-by: Allen Xu <allxu@nvidia.com>
Co-authored-by: Sean Lee <selee@nvidia.com>
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this pull request Nov 30, 2023
…IDIA#854)

Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>

Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants