You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In some scenarios, a corpus file may contain columns that are not needed during the data curation step.
We might reduce memory footprint by allowing the user to specify which columns should be loaded when invoking DocumentDataset.read_json or other similar methods.
Maybe something similar to the following snipped, where I have added the columns parameter.
miguelusque
changed the title
Allow selecting specific fields when reading json or other file types with DocumentDataset
[FEA} Allow selecting specific fields when reading json or other file types with DocumentDataset
Aug 5, 2024
miguelusque
changed the title
[FEA} Allow selecting specific fields when reading json or other file types with DocumentDataset
[FEA] Allow selecting specific fields when reading json or other file types with DocumentDataset
Aug 5, 2024
miguelusque
changed the title
[FEA] Allow selecting specific fields when reading json or other file types with DocumentDataset
[FEA] Allow specify fields when reading files with DocumentDataset.
Aug 5, 2024
In some scenarios, a corpus file may contain columns that are not needed during the data curation step.
We might reduce memory footprint by allowing the user to specify which columns should be loaded when invoking
DocumentDataset.read_json
or other similar methods.Maybe something similar to the following snipped, where I have added the
columns
parameter.Hope it helps!
Miguel
The text was updated successfully, but these errors were encountered: