Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Image feature #3163

Merged
merged 69 commits into from
Dec 6, 2021
Merged

Add Image feature #3163

merged 69 commits into from
Dec 6, 2021

Commits on Oct 23, 2021

  1. Initial commit

    @mariosasko
    mariosasko committed Oct 23, 2021
    Configuration menu
    Copy the full SHA
    42956f1 View commit details
    Browse the repository at this point in the history

  2. Add basic decoding

    @mariosasko
    mariosasko committed Oct 23, 2021
    Configuration menu
    Copy the full SHA
    93440cb View commit details
    Browse the repository at this point in the history

  3. Replace features.Audio with Audio

    @mariosasko
    mariosasko committed Oct 23, 2021
    Configuration menu
    Copy the full SHA
    4baaae7 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2021

  1. Add Image to package reference

    @mariosasko
    mariosasko committed Oct 24, 2021
    Configuration menu
    Copy the full SHA
    be25e24 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2021

  1. Use np.array

    @mariosasko
    mariosasko committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    4660ce8 View commit details
    Browse the repository at this point in the history

  2. Update error msg

    @mariosasko
    mariosasko committed Oct 25, 2021
    Configuration menu
    Copy the full SHA
    b80633a View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2021

  1. Add mode and channel decoding

    @mariosasko
    mariosasko committed Oct 26, 2021
    Configuration menu
    Copy the full SHA
    ac25393 View commit details
    Browse the repository at this point in the history

  2. Fix return value

    @mariosasko
    mariosasko committed Oct 26, 2021
    Configuration menu
    Copy the full SHA
    9946969 View commit details
    Browse the repository at this point in the history

  3. Finish decoding

    @mariosasko
    mariosasko committed Oct 26, 2021
    Configuration menu
    Copy the full SHA
    ff53e94 View commit details
    Browse the repository at this point in the history

  4. Make CI happy

    @mariosasko
    mariosasko committed Oct 26, 2021
    Configuration menu
    Copy the full SHA
    d1a91af View commit details
    Browse the repository at this point in the history

  5. Some more fixes

    @mariosasko
    mariosasko committed Oct 26, 2021
    Configuration menu
    Copy the full SHA
    e628c9c View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2021

  1. Minor doc fix

    @mariosasko
    mariosasko committed Oct 27, 2021
    Configuration menu
    Copy the full SHA
    bec851f View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2021

  1. Remove animated option

    @mariosasko
    mariosasko committed Oct 28, 2021
    Configuration menu
    Copy the full SHA
    fab6e0f View commit details
    Browse the repository at this point in the history

  2. Pin version

    @mariosasko
    mariosasko committed Oct 28, 2021
    Configuration menu
    Copy the full SHA
    539ffb5 View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2021

  1. Remove unused imports in setup.py

    @mariosasko
    mariosasko committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    924f94b View commit details
    Browse the repository at this point in the history

  2. Add vision requirements to setup.py

    @mariosasko
    mariosasko committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    69eb82c View commit details
    Browse the repository at this point in the history

  3. Add initial tests

    @mariosasko
    mariosasko committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    9a1a8ff View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2021

  1. Delete other formats

    @mariosasko
    mariosasko committed Nov 3, 2021
    Configuration menu
    Copy the full SHA
    9d29246 View commit details
    Browse the repository at this point in the history

  2. Make Image feature hashable

    @mariosasko
    mariosasko committed Nov 3, 2021
    Configuration menu
    Copy the full SHA
    69b2f90 View commit details
    Browse the repository at this point in the history

  3. Add more tests

    @mariosasko
    mariosasko committed Nov 3, 2021
    Configuration menu
    Copy the full SHA
    50bee0a View commit details
    Browse the repository at this point in the history

  4. Support numpy array in alter data check in TypedSequence

    @mariosasko
    mariosasko committed Nov 3, 2021
    Configuration menu
    Copy the full SHA
    4533c51 View commit details
    Browse the repository at this point in the history

  5. Fix TypedSequence converion

    @mariosasko
    mariosasko committed Nov 3, 2021
    Configuration menu
    Copy the full SHA
    1eec068 View commit details
    Browse the repository at this point in the history

  6. Finish tests

    @mariosasko
    mariosasko committed Nov 3, 2021
    Configuration menu
    Copy the full SHA
    3323d41 View commit details
    Browse the repository at this point in the history

  7. Merge conflicts

    @mariosasko
    mariosasko committed Nov 3, 2021
    Configuration menu
    Copy the full SHA
    bcc4ed4 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2021

  1. Update Image - add ImageExtensionType and supporting functions

    @mariosasko
    mariosasko committed Nov 10, 2021
    Configuration menu
    Copy the full SHA
    db9a3eb View commit details
    Browse the repository at this point in the history

  2. Update encoding functions

    @mariosasko
    mariosasko committed Nov 10, 2021
    Configuration menu
    Copy the full SHA
    d8e3ace View commit details
    Browse the repository at this point in the history

  3. Add support in TypedSequence for ImageExtensionType

    @mariosasko
    mariosasko committed Nov 10, 2021
    Configuration menu
    Copy the full SHA
    f252dcb View commit details
    Browse the repository at this point in the history

  4. Add tests

    @mariosasko
    mariosasko committed Nov 10, 2021
    Configuration menu
    Copy the full SHA
    c7b905d View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' of https://github.com/huggingface/datasets into… 

    … add-image-feature
    @mariosasko
    mariosasko committed Nov 10, 2021
    Configuration menu
    Copy the full SHA
    d61e334 View commit details
    Browse the repository at this point in the history

  6. Remove unused import

    @mariosasko
    mariosasko committed Nov 10, 2021
    Configuration menu
    Copy the full SHA
    d4d413a View commit details
    Browse the repository at this point in the history

  7. Fix doc and style

    @mariosasko
    mariosasko committed Nov 10, 2021
    Configuration menu
    Copy the full SHA
    c095040 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2021

  1. Fix doc indentation

    @mariosasko
    mariosasko committed Nov 11, 2021
    Configuration menu
    Copy the full SHA
    a5c3d8e View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2021

  1. Improve comment

    @mariosasko
    mariosasko committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    eab101a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/huggingface/datasets into… 

    … add-image-feature
    @mariosasko
    mariosasko committed Nov 12, 2021
    Configuration menu
    Copy the full SHA
    8a5449a View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2021

  1. Merge branch 'master' of https://github.com/huggingface/datasets into… 

    … add-image-feature
    @mariosasko
    mariosasko committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    87b2504 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2021

  1. Return single image instead of dict

    @mariosasko
    mariosasko committed Nov 17, 2021
    Configuration menu
    Copy the full SHA
    2d63808 View commit details
    Browse the repository at this point in the history

  2. Fix merge conflict

    @mariosasko
    mariosasko committed Nov 17, 2021
    Configuration menu
    Copy the full SHA
    2be6d1f View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2021

  1. Return PIL Image and not dict

    @mariosasko
    mariosasko committed Nov 19, 2021
    Configuration menu
    Copy the full SHA
    c21efa2 View commit details
    Browse the repository at this point in the history

  2. Encode dict

    @mariosasko
    mariosasko committed Nov 19, 2021
    Configuration menu
    Copy the full SHA
    856d2bc View commit details
    Browse the repository at this point in the history

  3. Update tests

    @mariosasko
    mariosasko committed Nov 19, 2021
    Configuration menu
    Copy the full SHA
    0fa8a6f View commit details
    Browse the repository at this point in the history

  4. Style

    @mariosasko
    mariosasko committed Nov 19, 2021
    Configuration menu
    Copy the full SHA
    462210f View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2021

  1. np.ndarray encoding/decoding

    @mariosasko
    mariosasko committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    6391d3c View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2021

  1. Minor improvements

    @mariosasko
    mariosasko committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    ce82bff View commit details
    Browse the repository at this point in the history

  2. PIL Image support in cast_to_python_objects

    @mariosasko
    mariosasko committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    95828bf View commit details
    Browse the repository at this point in the history

  3. Test cast

    @mariosasko
    mariosasko committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    64382a2 View commit details
    Browse the repository at this point in the history

  4. Doc fix

    @mariosasko
    mariosasko committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    0152aab View commit details
    Browse the repository at this point in the history

  5. Extension type fixes

    @mariosasko
    mariosasko committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    de91d49 View commit details
    Browse the repository at this point in the history

  6. Style

    @mariosasko
    mariosasko committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    f488d06 View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2021

  1. Use types_mapper in Dataset.to_pandas

    @mariosasko
    mariosasko committed Nov 24, 2021
    Configuration menu
    Copy the full SHA
    efe96e9 View commit details
    Browse the repository at this point in the history

  2. Add pandas extension array for image type

    @mariosasko
    mariosasko committed Nov 24, 2021
    Configuration menu
    Copy the full SHA
    8c0f364 View commit details
    Browse the repository at this point in the history

  3. Update tests

    @mariosasko
    mariosasko committed Nov 24, 2021
    Configuration menu
    Copy the full SHA
    30f0eb7 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' of https://github.com/huggingface/datasets into… 

    … add-image-feature
    @mariosasko
    mariosasko committed Nov 24, 2021
    Configuration menu
    Copy the full SHA
    5c059d9 View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2021

  1. image type inference

    @lhoestq
    lhoestq committed Nov 26, 2021
    1 Configuration menu
    Copy the full SHA
    8df9479 View commit details
    Browse the repository at this point in the history

  2. Remvoe cast_to_python test after Quentin's change

    @mariosasko
    mariosasko committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    78436d2 View commit details
    Browse the repository at this point in the history

  3. Improve tests

    @mariosasko
    mariosasko committed Nov 26, 2021
    Configuration menu
    Copy the full SHA
    db5ec0d View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2021

  1. Add storage type

    @mariosasko
    mariosasko committed Nov 29, 2021
    Configuration menu
    Copy the full SHA
    c737af7 View commit details
    Browse the repository at this point in the history

  2. Improve tests

    @mariosasko
    mariosasko committed Nov 29, 2021
    Configuration menu
    Copy the full SHA
    b0425ba View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of https://github.com/huggingface/datasets into… 

    … add-image-feature
    @mariosasko
    mariosasko committed Nov 29, 2021
    Configuration menu
    Copy the full SHA
    768b9f1 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2021

  1. Test map that returns np.ndarray

    @mariosasko
    mariosasko committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    544b093 View commit details
    Browse the repository at this point in the history

  2. Rename functions

    @mariosasko
    mariosasko committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    606215d View commit details
    Browse the repository at this point in the history

  3. Add streaming test

    @mariosasko
    mariosasko committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    d7b204c View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2021

  1. Use image struct in all situations

    @mariosasko
    mariosasko committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    31f02ad View commit details
    Browse the repository at this point in the history

  2. Update src/datasets/features/image.py - encode_example type hint 

    Co-authored-by: Quentin Lhoest <42851186+lhoestq@users.noreply.github.com>
    @mariosasko @lhoestq
    mariosasko and lhoestq committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    6ee758e View commit details
    Browse the repository at this point in the history

  3. Update src/datasets/features/image.py -list_image_compression_formats… 

    … type hint

Co-authored-by: Quentin Lhoest <42851186+lhoestq@users.noreply.github.com>
    @mariosasko @lhoestq
    mariosasko and lhoestq committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    f294e5b View commit details
    Browse the repository at this point in the history

Commits on Dec 2, 2021

  1. Merge branch 'master' of https://github.com/huggingface/datasets into… 

    … add-image-feature
    @mariosasko
    mariosasko committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    dff7b46 View commit details
    Browse the repository at this point in the history

  2. Support str in encode_objects_to_image_dicts

    @mariosasko
    mariosasko committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    25d8902 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'add-image-feature' of github.com:mariosasko/datasets-1 … 

    …into add-image-feature
    @mariosasko
    mariosasko committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    a940a8f View commit details
    Browse the repository at this point in the history

  4. Update src/datasets/features/image.py - objects_to_list_of_image_dict… 

    …s type hint

Co-authored-by: Quentin Lhoest <42851186+lhoestq@users.noreply.github.com>
    @mariosasko @lhoestq
    mariosasko and lhoestq committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    1109699 View commit details
    Browse the repository at this point in the history

  5. Style

    @mariosasko
    mariosasko committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    79c87f8 View commit details
    Browse the repository at this point in the history