Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Log plugin and cudf versions on startup #2132

Merged
merged 3 commits into from
Apr 15, 2021
Merged

Conversation

jlowe
Copy link
Member

@jlowe jlowe commented Apr 14, 2021

Fixes #2018

This logs the RAPIDS Accelerator plugin version and cudf versions found on the classpath during startup of the driver and executor. On the driver there is a message that looks like this:

21/04/14 18:07:57 WARN SQLExecPlugin: RAPIDS Accelerator 0.5.0-SNAPSHOT using cudf 0.19-SNAPSHOT. To disable GPU support set `spark.rapids.sql.enabled` to false

and on the executors will be a log message that looks like this:

21/04/14 13:07:59 INFO RapidsExecutorPlugin: RAPIDS Accelerator 0.5.0-SNAPSHOT using cudf 0.19-SNAPSHOT

Signed-off-by: Jason Lowe <jlowe@nvidia.com>
revans2
revans2 previously approved these changes Apr 14, 2021
@jlowe
Copy link
Member Author

jlowe commented Apr 14, 2021

build

abellina
abellina previously approved these changes Apr 14, 2021
Signed-off-by: Jason Lowe <jlowe@nvidia.com>
@jlowe jlowe dismissed stale reviews from abellina and revans2 via 3819d5c April 14, 2021 22:25
@sameerz sameerz added the feature request New feature or request label Apr 14, 2021
Copy link
Collaborator

@gerashegalov gerashegalov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jlowe
Copy link
Member Author

jlowe commented Apr 14, 2021

build

@pxLi pxLi merged commit f92ff81 into NVIDIA:branch-0.5 Apr 15, 2021
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
* Log plugin and cudf versions on startup

Signed-off-by: Jason Lowe <jlowe@nvidia.com>

* Log full build properties at INFO level

Signed-off-by: Jason Lowe <jlowe@nvidia.com>

* Fix copy-paste error
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
* Log plugin and cudf versions on startup

Signed-off-by: Jason Lowe <jlowe@nvidia.com>

* Log full build properties at INFO level

Signed-off-by: Jason Lowe <jlowe@nvidia.com>

* Fix copy-paste error
@jlowe jlowe deleted the log-version branch September 10, 2021 15:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEA] A way for user to find out the plugin version and cudf version in REPL
6 participants