Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Change the explanation of why the operator will not work on GPU #4328

Merged
merged 6 commits into from
Dec 11, 2021
Merged

Change the explanation of why the operator will not work on GPU #4328

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
8d0106e
replace by
HaoYang670 Dec 8, 2021
9fd389e
Merge branch 'NVIDIA:branch-22.02' into issue4088
HaoYang670 Dec 8, 2021
302d7ea
change explanation of 'willNotWorkOnGPU'
HaoYang670 Dec 9, 2021
afeb370
Merge branch 'NVIDIA:branch-22.02' into issue4088
HaoYang670 Dec 9, 2021
ae2026a
modify corresponding test
HaoYang670 Dec 9, 2021
154496c
Add 'currently' to the log message, which tells users the operator mi…
HaoYang670 Dec 10, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions docs/get-started/getting-started-workload-qualification.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -124,7 +124,7 @@ the driver logs with `spark.rapids.sql.explain=all`.
this version:

```
!NOT_FOUND <RowDataSourceScanExec> cannot run on GPU because no GPU enabled version of operator class org.apache.spark.sql.execution.RowDataSourceScanExec could be found
!Unsupported operator: <RowDataSourceScanExec> cannot run on GPU because no GPU enabled version of operator class org.apache.spark.sql.execution.RowDataSourceScanExec could be found
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This still says "no GPU enabled version of operator class .... could be found". The original problem that triggered #4088 was that the "class not found" message led the user to believe this was a classloader/classpath issue rather than a normal situation where we know this Catalyst operation is not supported.

```

This log can show you which operators (on what data type) can not run on GPU and the reason.
Expand Down Expand Up @@ -152,7 +152,7 @@ analysis.
For example, the log lines starting with `!` is the so-called not-supported messages:
```
!Exec <GenerateExec> cannot run on GPU because not all expressions can be replaced
!NOT_FOUND <ReplicateRows> replicaterows(sum#99L, gender#76) cannot run on GPU because no GPU enabled version of expression class
!Unsupported operator: <ReplicateRows> replicaterows(sum#99L, gender#76) cannot run on GPU because no GPU enabled version of expression class
```
The indentation indicates the parent and child relationship for those expressions.
If not all of the children expressions can run on GPU, the parent can not run on GPU either.
Expand Down
2 changes: 1 addition & 1 deletion sql-plugin/src/main/scala/com/nvidia/spark/rapids/RapidsMeta.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@ trait DataFromReplacementRule {
* A version of DataFromReplacementRule that is used when no replacement rule can be found.
*/
final class NoRuleDataFromReplacementRule extends DataFromReplacementRule {
override val operationName: String = "NOT_FOUND"
override val operationName: String = "Unsupported operator: "

override def confKey = "NOT_FOUND"

Expand Down