-
Notifications
You must be signed in to change notification settings - Fork 232
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
More advanced type checking and documentation #1323
Conversation
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
752c139
to
23a860a
Compare
build |
build |
This looks OK to me. Would like to see a bit more documentation for the TypeChecks functions, but that's minor. |
@jlowe I upmerged and updated the scaladocs for the new type checking. |
build |
sql-plugin/src/main/scala/com/nvidia/spark/rapids/TypeChecks.scala
Outdated
Show resolved
Hide resolved
sql-plugin/src/main/scala/com/nvidia/spark/rapids/TypeChecks.scala
Outdated
Show resolved
Hide resolved
build |
build |
could you add a high level overview of how this is supposed to work in description. |
} | ||
|
||
/** | ||
* N/A neither spark not the plugin supports this. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit - s/not/nor/
* Both Spark and the plugin support this. | ||
* @param asterisks true if we need to include an asterisks because it is not really 100% supported. | ||
*/ | ||
class Supported(val asterisks: Boolean = false) extends SupportLevel { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
do we need note here for asterisks or do you end up seeing that elsewhere?
* A signature for types that are generally supported by the plugin. Please make sure to check | ||
* what Spark actually supports instead of blindly using this in a signature. | ||
*/ | ||
val legacySupportedTypes: TypeSig = BOOLEAN + BYTE + SHORT + INT + LONG + FLOAT + DOUBLE + DATE + |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
legacy makes me think this is old deprecated types (it might just be me though), would it be better to say something like basic types or commonSupportedTypes. Not a big deal though as I can't think of anything great either.
build |
@tgravescs and @jlowe could you take another look? |
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
…IDIA#1323) Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
I know this is a huge change, and I am happy to put in some comments in the code if needed. Please take a look.