Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] CSV parser does not support special case date/timestamp strings #136

Open
revans2 opened this issue Jun 9, 2020 · 1 comment
Open

[BUG] CSV parser does not support special case date/timestamp strings #136

revans2 opened this issue Jun 9, 2020 · 1 comment
Labels
bug Something isn't working P2 Not required for release SQL part of the SQL/Dataframe plugin

Comments

@revans2
Copy link
Collaborator

revans2 commented Jun 9, 2020

Describe the bug
When spark parses dates and timestamps with CSV it supports some special case strings. Things like

  • "epoch"
  • "now"
  • "today"
  • "tomorrow"
  • "yesterday"

No idea why someone wants their data in a CSV file to change each time it is read in, but spark supports it, so we should too.
@revans2 revans2 added bug Something isn't working ? - Needs Triage Need team to review and classify SQL part of the SQL/Dataframe plugin labels Jun 9, 2020
@revans2 revans2 changed the title [BUG] CSV parser does not support special case strings [BUG] CSV parser does not support special case date/timestamp strings Jun 9, 2020
@revans2
Copy link
Collaborator Author

revans2 commented Jun 9, 2020

It should be noted that for legacy mode date/timestamp parsing these values are not supported either, so it is likely a low priority to support them.

@sameerz sameerz added P2 Not required for release and removed ? - Needs Triage Need team to review and classify labels Aug 18, 2020
@revans2 revans2 mentioned this issue Apr 1, 2021
Open
38 tasks
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this issue Nov 30, 2023
@nvauto
Merge pull request NVIDIA#136 from NVIDIA/bot-auto-merge-branch-22.04
7ef5bca 
[auto-merge] bot-auto-merge-branch-22.04 to branch-22.06 [skip ci] [bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working P2 Not required for release SQL part of the SQL/Dataframe plugin
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@revans2 @sameerz