Skip to content
This repository has been archived by the owner on Dec 16, 2022. It is now read-only.

Dataset remix #5372

Merged
merged 39 commits into from
Aug 25, 2021
Merged

Dataset remix #5372

merged 39 commits into from
Aug 25, 2021

Commits on Aug 7, 2021

  1. Adds a dataset that can be read and written lazily 

    This does not work yet. I'm still working on supporting classes.
    @dirkgr
    dirkgr committed Aug 7, 2021
    Configuration menu
    Copy the full SHA
    10c5479 View commit details
    Browse the repository at this point in the history

  2. This approach might work better.

    @dirkgr
    dirkgr committed Aug 7, 2021
    Configuration menu
    Copy the full SHA
    36f9b67 View commit details
    Browse the repository at this point in the history

  3. Make ShuffledSequence take indices

    @dirkgr
    dirkgr committed Aug 7, 2021
    Configuration menu
    Copy the full SHA
    e74540d View commit details
    Browse the repository at this point in the history

  4. Formatting

    @dirkgr
    dirkgr committed Aug 7, 2021
    Configuration menu
    Copy the full SHA
    0eb53bf View commit details
    Browse the repository at this point in the history

  5. Adds failing test

    @dirkgr
    dirkgr committed Aug 7, 2021
    Configuration menu
    Copy the full SHA
    dcedfd5 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2021

  1. Merge remote-tracking branch 'origin/main' into TangoBigData

    @dirkgr
    dirkgr committed Aug 11, 2021
    Configuration menu
    Copy the full SHA
    36948ce View commit details
    Browse the repository at this point in the history

  2. Fix sparse sequence tests

    @dirkgr
    dirkgr committed Aug 11, 2021
    Configuration menu
    Copy the full SHA
    44eccf9 View commit details
    Browse the repository at this point in the history

  3. Fixes the Sqlite format

    @dirkgr
    dirkgr committed Aug 11, 2021
    Configuration menu
    Copy the full SHA
    f305de7 View commit details
    Browse the repository at this point in the history

  4. Quality-of-life hack

    @dirkgr
    dirkgr committed Aug 11, 2021
    Configuration menu
    Copy the full SHA
    61f8810 View commit details
    Browse the repository at this point in the history

  5. Makes an internal string less alarming

    @dirkgr
    dirkgr committed Aug 11, 2021
    Configuration menu
    Copy the full SHA
    989f15c View commit details
    Browse the repository at this point in the history

  6. Save the files to the right place

    @dirkgr
    dirkgr committed Aug 11, 2021
    Configuration menu
    Copy the full SHA
    9c461b7 View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2021

  1. Merge remote-tracking branch 'origin/main' into TangoBigData

    @dirkgr
    dirkgr committed Aug 18, 2021
    Configuration menu
    Copy the full SHA
    15e0be4 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2021

  1. Formatting

    @dirkgr
    dirkgr committed Aug 19, 2021
    Configuration menu
    Copy the full SHA
    ca26abe View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into TangoBigData

    @dirkgr
    dirkgr committed Aug 19, 2021
    Configuration menu
    Copy the full SHA
    f2f0a34 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2021

  1. Fix for SqliteDatasetFormat

    @dirkgr
    dirkgr committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    bb572b3 View commit details
    Browse the repository at this point in the history

  2. Performance improvement for SqliteSparseSequence

    @dirkgr
    dirkgr committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    6953d7d View commit details
    Browse the repository at this point in the history

  3. Changelog

    @dirkgr
    dirkgr committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    3f99be7 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into TangoBigData

    @dirkgr
    dirkgr authored Aug 20, 2021
    Configuration menu
    Copy the full SHA
    d69ea38 View commit details
    Browse the repository at this point in the history

  5. Global imports

    @dirkgr
    dirkgr committed Aug 20, 2021
    Configuration menu
    Copy the full SHA
    d58a52f View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2021

  1. More Sequence classes

    @dirkgr
    dirkgr committed Aug 21, 2021
    Configuration menu
    Copy the full SHA
    104777d View commit details
    Browse the repository at this point in the history

  2. Say DatasetDict when we mean DatasetDict

    @dirkgr
    dirkgr committed Aug 21, 2021
    Configuration menu
    Copy the full SHA
    b6b5f05 View commit details
    Browse the repository at this point in the history

  3. Test for the sequences

    @dirkgr
    dirkgr committed Aug 21, 2021
    Configuration menu
    Copy the full SHA
    05c4dd6 View commit details
    Browse the repository at this point in the history

  4. Use the step name correctly in the error message

    @dirkgr
    dirkgr committed Aug 21, 2021
    Configuration menu
    Copy the full SHA
    4304a93 View commit details
    Browse the repository at this point in the history

  5. Use and consume step_name correctly in Step.from_params()

    @dirkgr
    dirkgr committed Aug 21, 2021
    Configuration menu
    Copy the full SHA
    d6cb8ab View commit details
    Browse the repository at this point in the history

  6. Uncacheable steps don't get cached even if they have a name

    @dirkgr
    dirkgr committed Aug 21, 2021
    Configuration menu
    Copy the full SHA
    fd305a6 View commit details
    Browse the repository at this point in the history

  7. Adds a step that can remix a dataset

    @dirkgr
    dirkgr committed Aug 21, 2021
    Configuration menu
    Copy the full SHA
    3ae61eb View commit details
    Browse the repository at this point in the history

  8. Improve log message

    @dirkgr
    dirkgr committed Aug 21, 2021
    Configuration menu
    Copy the full SHA
    2004fd2 View commit details
    Browse the repository at this point in the history

  9. Fix relative import

    @dirkgr
    dirkgr committed Aug 21, 2021
    Configuration menu
    Copy the full SHA
    b0c3626 View commit details
    Browse the repository at this point in the history

  10. Changelog

    @dirkgr
    dirkgr committed Aug 21, 2021
    Configuration menu
    Copy the full SHA
    fcf651f View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2021

  1. Merge branch 'main' into DatasetRemix

    @dirkgr
    dirkgr authored Aug 23, 2021
    Configuration menu
    Copy the full SHA
    aa82e3d View commit details
    Browse the repository at this point in the history

  2. Adds documentation

    @dirkgr
    dirkgr committed Aug 23, 2021
    Configuration menu
    Copy the full SHA
    ca5cad3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'DatasetRemix' of https://github.com/allenai/allennlp in… 

    …to DatasetRemix
    @dirkgr
    dirkgr committed Aug 23, 2021
    Configuration menu
    Copy the full SHA
    d5f11f4 View commit details
    Browse the repository at this point in the history

  4. Give the option of changing a det_hash simply()

    @dirkgr
    dirkgr committed Aug 23, 2021
    Configuration menu
    Copy the full SHA
    c52b050 View commit details
    Browse the repository at this point in the history

  5. Tix fypo

    @dirkgr
    dirkgr committed Aug 23, 2021
    Configuration menu
    Copy the full SHA
    a32c7f2 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2021

  1. Adds ability to shuffle datasets

    @dirkgr
    dirkgr committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    6cccd64 View commit details
    Browse the repository at this point in the history

  2. Test for det_hash

    @dirkgr
    dirkgr committed Aug 24, 2021
    Configuration menu
    Copy the full SHA
    765575d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into DatasetRemix

    @dirkgr
    dirkgr authored Aug 24, 2021
    Configuration menu
    Copy the full SHA
    c69df7e View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2021

  1. We don't use relative imports

    @dirkgr
    dirkgr committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    451e4ee View commit details
    Browse the repository at this point in the history

  2. Merge branch 'DatasetRemix' of https://github.com/allenai/allennlp in… 

    …to DatasetRemix
    @dirkgr
    dirkgr committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    1d71b69 View commit details
    Browse the repository at this point in the history