-
Notifications
You must be signed in to change notification settings - Fork 232
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BUG] loading SPARK-32639 example parquet file triggers a JVM crash #1576
Labels
bug
Something isn't working
Comments
gerashegalov
added
bug
Something isn't working
? - Needs Triage
Need team to review and classify
labels
Jan 25, 2021
cudf fixed the crash in rapidsai/cudf#7229. We just need to re-enable the test when the cudf jar picks up that fix. |
nartal1
pushed a commit
to nartal1/spark-rapids
that referenced
this issue
Jun 9, 2021
Add a test documenting the scenario failing on Spark (CPU) prior to Spark 3.1.0, closes NVIDIA#1463. On GPU, executor JVM crash still NVIDIA#1576. Since xfail does not handle the process crash gracefully and fails pytest, skip is used instead. Signed-off-by: Gera Shegalov <gera@apache.org>
nartal1
pushed a commit
to nartal1/spark-rapids
that referenced
this issue
Jun 9, 2021
Add a test documenting the scenario failing on Spark (CPU) prior to Spark 3.1.0, closes NVIDIA#1463. On GPU, executor JVM crash still NVIDIA#1576. Since xfail does not handle the process crash gracefully and fails pytest, skip is used instead. Signed-off-by: Gera Shegalov <gera@apache.org>
tgravescs
pushed a commit
to tgravescs/spark-rapids
that referenced
this issue
Nov 30, 2023
… handling of multiple GPUs by Docker (NVIDIA#1576) Signed-off-by: Navin Kumar <navink@nvidia.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug
Replaying the scenario from #1463 (SPARK-32639) in GPU-enabled Scala Spark or pyspark shell results in SIGSEGV in the executor call path
Steps/Code to reproduce bug
Start (py)Spark REPL with RAPIDS plugin and GPU enabled
load the file from attached to SPARK-32639
Expected behavior
In Spark rc 3.1.1 the data loads fine on CPU and should do the same on GPU:
Environment details (please complete the following information)
The text was updated successfully, but these errors were encountered: