-
Notifications
You must be signed in to change notification settings - Fork 232
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
BooleanType test shouldn't xfail #639
Conversation
Signed-off-by: Raza Jafri <rjafri@nvidia.com>
This reverts commit 64714a5.
Signed-off-by: Raza Jafri <rjafri@nvidia.com>
@revans2 I have addressed your concern PTAL |
build |
@@ -61,7 +62,7 @@ def test_passing_gpuExpr_as_Expr(): | |||
@pytest.mark.parametrize('join_type', ['Left', 'Right', 'Inner', 'LeftSemi', 'LeftAnti'], ids=idfn) | |||
@ignore_order | |||
def test_cache_join(data_gen, join_type): | |||
if data_gen.data_type == BooleanType(): | |||
if spark_version() == "3.0.0" and data_gen.data_type == BooleanType(): | |||
pytest.xfail("https://github.com/NVIDIA/spark-rapids/issues/350") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I would point to the spark issue for all of these instead
@@ -41,3 +41,5 @@ def get_spark_i_know_what_i_am_doing(): | |||
""" | |||
return _spark | |||
|
|||
def spark_version(): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I like this, but there are a number of other places in the code that are doing a
with_spark_session(spark: spark.sparkContext.version ...
It would probably be good to update all of them to be consistent or do it the same way here too.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have reverted the change to be more like the rest to be consistent
Signed-off-by: Raza Jafri <rjafri@nvidia.com>
build |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It is consistent now, but I like your new function better.
OK. let me make the change. I thought making the PR bigger will be frowned upon. |
build |
build |
build |
* BooleanType test shouldn't xfail Signed-off-by: Raza Jafri <rjafri@nvidia.com> * Revert "BooleanType test shouldn't xfail" This reverts commit 64714a5. * xfail only for 3.0.0 Signed-off-by: Raza Jafri <rjafri@nvidia.com> * addressed review comments Signed-off-by: Raza Jafri <rjafri@nvidia.com> * removed the version method * Revert "removed the version method" This reverts commit a9d9a04. * Revert "addressed review comments" This reverts commit 6472e92. * added version checks * missed changing it in cache_test.py Signed-off-by: Raza Jafri <rjafri@nvidia.com> * removing unnecessary lambda Co-authored-by: Raza Jafri <rjafri@nvidia.com>
* BooleanType test shouldn't xfail Signed-off-by: Raza Jafri <rjafri@nvidia.com> * Revert "BooleanType test shouldn't xfail" This reverts commit 64714a5. * xfail only for 3.0.0 Signed-off-by: Raza Jafri <rjafri@nvidia.com> * addressed review comments Signed-off-by: Raza Jafri <rjafri@nvidia.com> * removed the version method * Revert "removed the version method" This reverts commit a9d9a04. * Revert "addressed review comments" This reverts commit 6472e92. * added version checks * missed changing it in cache_test.py Signed-off-by: Raza Jafri <rjafri@nvidia.com> * removing unnecessary lambda Co-authored-by: Raza Jafri <rjafri@nvidia.com>
…IDIA#639) Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com> Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
Signed-off-by: Raza Jafri rjafri@nvidia.com
Now that https://github.com/apache/spark/pull/29506/files has been merged to branch 3.0 in spark. This is no longer needed
fixes #350