Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[REVIEW] Fixed failing cache tests #840

Merged
merged 1 commit into from
Sep 25, 2020

Conversation

razajafri
Copy link
Collaborator

@razajafri razajafri commented Sep 23, 2020

Signed-off-by: Raza Jafri rjafri@nvidia.com

Fixed failing tests. There seems to be a change in 3.1.0 that is causing the Timestamp to go past or beyond the year 0 or 9999

The purpose of this test is to test GpuExpandExec which is still true. I have created a follow on issue to investigate the failure if deemed necessary #842. I think its a failure we have seen before w.r.t timestamps being represented in python

Signed-off-by: Raza Jafri <rjafri@nvidia.com>
@razajafri razajafri changed the title fixed failing tests [REVIEW] Fixed failing cache tests Sep 23, 2020
@sameerz sameerz added the bug Something isn't working label Sep 24, 2020
@razajafri
Copy link
Collaborator Author

build

@revans2
Copy link
Collaborator

revans2 commented Sep 24, 2020

It looks like there were a number of things that happened to the rebaseing code for 3.1

https://github.com/apache/spark/commits/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/RebaseDateTime.scala

From what I can see all_gen_restricting_dates does not restrict timestamps and this is where we are getting into problems.

I am also not sure what any of that has to do with the test that is doing a rollup. I am nervous on that one that we are just changing the test and end up hiding a real bug.

@razajafri
Copy link
Collaborator Author

I am OK with closing this if the CI isn't testing with 3.1.0. The sole reason for this PR is to make the build pass and triage #842 to investigate the bug?

@razajafri
Copy link
Collaborator Author

build

@razajafri razajafri merged commit b89d1d8 into NVIDIA:branch-0.3 Sep 25, 2020
sperlingxx pushed a commit to sperlingxx/spark-rapids that referenced this pull request Nov 20, 2020
Signed-off-by: Raza Jafri <rjafri@nvidia.com>

Co-authored-by: Raza Jafri <rjafri@nvidia.com>
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Signed-off-by: Raza Jafri <rjafri@nvidia.com>

Co-authored-by: Raza Jafri <rjafri@nvidia.com>
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Signed-off-by: Raza Jafri <rjafri@nvidia.com>

Co-authored-by: Raza Jafri <rjafri@nvidia.com>
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this pull request Nov 30, 2023
…IDIA#840)

Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>

Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants