Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix test_cast_string_ts_valid_format test #9889

Merged
merged 1 commit into from
Nov 30, 2023

Conversation

thirtiseven
Copy link
Collaborator

@thirtiseven thirtiseven commented Nov 29, 2023

Fixes #9708

In case of failure: StringGen('[0-9]{1,4}-[0-3][0-9]-[0-5][0-9][ |T][0-3][0-9]:[0-6][0-9]:[0-6][0-9].[0-9]{0,6}Z?')

The . here is meant to be a literal ., but it's a wildcard character in regex, so it can generate anything in this case, which also leads to many invalid timestamps.

In the failed case it generated '+': 7141-09-13 08:15:02+121024 and Spark supports this format but we do not yet.

This PR replaces the . with \. to fix the test.

Signed-off-by: Haoyang Li <haoyangl@nvidia.com>
@thirtiseven thirtiseven self-assigned this Nov 29, 2023
@thirtiseven
Copy link
Collaborator Author

build

1 similar comment
@thirtiseven
Copy link
Collaborator Author

build

@pxLi
Copy link
Collaborator

pxLi commented Nov 30, 2023

should this be targeted to 23.12 or 24.02?

@pxLi pxLi added bug Something isn't working test Only impacts tests labels Nov 30, 2023
@GaryShen2008
Copy link
Collaborator

Since it's just a test code change and doesn't block the 23.12, I think it should be ok to 24.02.

@pxLi
Copy link
Collaborator

pxLi commented Nov 30, 2023

Since it's just a test code change and doesn't block the 23.12, I think it should be ok to 24.02.

cool, also updated the corresponding issue ticket to 24.02

@thirtiseven thirtiseven merged commit 7c653bf into NVIDIA:branch-24.02 Nov 30, 2023
38 checks passed
@thirtiseven thirtiseven deleted the ts_format branch November 30, 2023 03:57
ttnghia added a commit to ttnghia/spark-rapids that referenced this pull request Dec 1, 2023
ttnghia added a commit to ttnghia/spark-rapids that referenced this pull request Dec 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working test Only impacts tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] test_cast_string_ts_valid_format fails with DATAGEN_SEED=1699978422
4 participants