Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix compilation and scaladoc warnings #1186

Merged
merged 2 commits into from
Nov 23, 2020
Merged

Conversation

jlowe
Copy link
Member

@jlowe jlowe commented Nov 23, 2020

Fixes #1114, #1115, and #1149.

This cleans up compilation and scaladoc warnings in the build.

Signed-off-by: Jason Lowe <jlowe@nvidia.com>
@jlowe jlowe added the build Related to CI / CD or cleanly building label Nov 23, 2020
@jlowe jlowe added this to the Nov 23 - Dec 4 milestone Nov 23, 2020
@@ -204,8 +204,6 @@ case class GpuWindowExpression(windowFunction: Expression, windowSpec: GpuWindow
case other =>
throw new IllegalStateException(s"${other.getClass} is not a supported window aggregation")
}
// Add support for Pandas (Python) UDF
case pythonFunc: GpuPythonUDF => pythonFunc
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GpuPythonUDF derives from GpuAggregateWindowFunction which is why the compiler was complaining. This has the same code as that for the GpuAggregateWindowFunction hence it can simply be deleted.

@@ -262,7 +262,6 @@ trait GpuWindowInPandasExecBase extends UnaryExecNode with GpuExec {
function match {
case GpuAggregateExpression(_, _, _, _, _) => collect("AGGREGATE", frame, e)
case _: GpuAggregateWindowFunction => collect("AGGREGATE", frame, e)
case _: GpuPythonUDF => collect("AGGREGATE", frame, e)
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Similar situation here. GpuPythonUDF derives from GpuAggregateWindowFunction, hence the unreachable code warning. The implementation here is the same as the case that will be taken in practice, so this can simply be deleted.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Because this is in a file that is specific to the pandas operations it might be nice to put a comment by line 263 just to say that this includes GpuPythonUDF

@jlowe
Copy link
Member Author

jlowe commented Nov 23, 2020

build

revans2
revans2 previously approved these changes Nov 23, 2020
Copy link
Collaborator

@revans2 revans2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a nit about a comment

@@ -262,7 +262,6 @@ trait GpuWindowInPandasExecBase extends UnaryExecNode with GpuExec {
function match {
case GpuAggregateExpression(_, _, _, _, _) => collect("AGGREGATE", frame, e)
case _: GpuAggregateWindowFunction => collect("AGGREGATE", frame, e)
case _: GpuPythonUDF => collect("AGGREGATE", frame, e)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Because this is in a file that is specific to the pandas operations it might be nice to put a comment by line 263 just to say that this includes GpuPythonUDF

Signed-off-by: Jason Lowe <jlowe@nvidia.com>
@jlowe
Copy link
Member Author

jlowe commented Nov 23, 2020

build

@jlowe jlowe merged commit 767c998 into NVIDIA:branch-0.3 Nov 23, 2020
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
* Fix compilation and scaladoc warnings

Signed-off-by: Jason Lowe <jlowe@nvidia.com>

* Add comment about GpuPythonUDF being handled

Signed-off-by: Jason Lowe <jlowe@nvidia.com>
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
* Fix compilation and scaladoc warnings

Signed-off-by: Jason Lowe <jlowe@nvidia.com>

* Add comment about GpuPythonUDF being handled

Signed-off-by: Jason Lowe <jlowe@nvidia.com>
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this pull request Nov 30, 2023
…IDIA#1186)

Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Related to CI / CD or cleanly building
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Unreachable code warnings in GPU window code
2 participants