We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
to_json
Is your feature request related to a problem? Please describe. Spark supports a number of JSON data source options: https://spark.apache.org/docs/latest/sql-data-sources-json.html
We need to determine which of these are used by to_json and make sure we respect them, or fall back to CPU if we do not support them.
Describe the solution you'd like Add tests for the subset of options that are applicable to to_json and file specific issues as needed.
Describe alternatives you've considered
Additional context
The text was updated successfully, but these errors were encountered:
I have filed specific issues for the options that we need to support, so we can close this issue now:
ignoreNullFields=false
allowNumericLeadingZeros
from_json
pretty
Sorry, something went wrong.
andygrove
No branches or pull requests
Is your feature request related to a problem? Please describe.
Spark supports a number of JSON data source options:
https://spark.apache.org/docs/latest/sql-data-sources-json.html
We need to determine which of these are used by
to_json
and make sure we respect them, or fall back to CPU if we do not support them.Describe the solution you'd like
Add tests for the subset of options that are applicable to
to_json
and file specific issues as needed.Describe alternatives you've considered
Additional context
The text was updated successfully, but these errors were encountered: