-
Notifications
You must be signed in to change notification settings - Fork 232
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FEA] [Databricks 12.2] Support GpuMergeIntoCommand notMatchedBySourceClauses on GPU #8415
Comments
Please ignore. This was unrelated to this issue and is now resolved.
Here is the Spark code from case o if o.expressions.exists(!_.deterministic) &&
!o.isInstanceOf[Project] && !o.isInstanceOf[Filter] &&
!o.isInstanceOf[Aggregate] && !o.isInstanceOf[Window] &&
// Lateral join is checked in checkSubqueryExpression.
!o.isInstanceOf[LateralJoin] =>
// The rule above is used to check Aggregate operator.
o.failAnalysis(
errorClass = "_LEGACY_ERROR_TEMP_2439",
messageParameters = Map(
"sqlExprs" -> o.expressions.map(_.sql).mkString(","),
"operator" -> operator.simpleString(SQLConf.get.maxToStringFields))) For now, we avoid replacing the operator if |
Is your feature request related to a problem? Please describe.
PR #8282 adds basic support for Databricks 12.2 but did not add support for
notMatchedBySourceClauses
inGpuMergeIntoCommand
and instead falls back to CPU.Describe the solution you'd like
We should support
notMatchedBySourceClauses
on GPU.Describe alternatives you've considered
Additional context
See the discussion at #8282 (comment) for more details.
The text was updated successfully, but these errors were encountered: