Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement annif upload and annif download commands for Hugging Face Hub integration #762

Merged
merged 39 commits into from
Apr 23, 2024
Merged

Implement annif upload and annif download commands for Hugging Face Hub integration #762

merged 39 commits into from
Apr 23, 2024

Commits on Feb 1, 2024

  1. Initial functionality for HF Hub upload

    @juhoinkinen
    juhoinkinen committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    f6d2b7d View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2024

  1. Use tempfile module and file-like objects for uploads

    @juhoinkinen
    juhoinkinen committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    ab5e4bf View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. Separate files for each project, vocab and config

    @juhoinkinen
    juhoinkinen committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    d3dd888 View commit details
    Browse the repository at this point in the history

  2. Catch also HFValidationError in HFH uploads

    @juhoinkinen
    juhoinkinen committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    9d030c6 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. Initial functionality for HF Hub download

    @juhoinkinen
    juhoinkinen committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    3135114 View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. Upgrade to huggingface-hub 0.21.*

    @juhoinkinen
    juhoinkinen committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    038d86d View commit details
    Browse the repository at this point in the history

  2. Drop -projects part from upload/download CLI commands

    @juhoinkinen
    juhoinkinen committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    5afb251 View commit details
    Browse the repository at this point in the history

  3. Speed up CLI startup by moving imports in functions

    @juhoinkinen
    juhoinkinen committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    13191fc View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2024

  1. Add --force option to allow overwrite local contents on download

    @juhoinkinen
    juhoinkinen committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    7666de8 View commit details
    Browse the repository at this point in the history

  2. Resolve CodeQL complaint about imports

    @juhoinkinen
    juhoinkinen committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    301d787 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2024

  1. Restore datafile timestamps after unzipping

    @juhoinkinen
    juhoinkinen committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    d5b4abe View commit details
    Browse the repository at this point in the history

  2. Add comment to zip file with used Annif version

    @juhoinkinen
    juhoinkinen committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    a1e7605 View commit details
    Browse the repository at this point in the history

  3. Catch HFH Errors in listing files in repo

    @juhoinkinen
    juhoinkinen committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    25a46dc View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2024

  1. Unzip archive contents to used DATADIR

    @juhoinkinen
    juhoinkinen committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    86714d8 View commit details
    Browse the repository at this point in the history

  2. Add tests

    @juhoinkinen
    juhoinkinen committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    6ba1e08 View commit details
    Browse the repository at this point in the history

  3. Create /.cache/huggingface/ with full access rights in Dockerimage

    @juhoinkinen
    juhoinkinen committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    4d06be6 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. Merge branch 'update-dependencies-v1.1' into issue760-hugging-face-hu… 

    …b-integration
    @juhoinkinen
    juhoinkinen committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    a4f0f6f View commit details
    Browse the repository at this point in the history

  2. Fix and improve tests and increase coverage

    @juhoinkinen
    juhoinkinen committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    7575fff View commit details
    Browse the repository at this point in the history

  3. Remove todos

    @juhoinkinen
    juhoinkinen committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    16bacfb View commit details
    Browse the repository at this point in the history

  4. Create /Annif/projects.d/ for tests in Dockerfile

    @juhoinkinen
    juhoinkinen committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    2952f64 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. Refactor to address quality complains; improve names

    @juhoinkinen
    juhoinkinen committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    ed3cf2c View commit details
    Browse the repository at this point in the history

  2. Add docstrings

    @juhoinkinen
    juhoinkinen committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    5b16952 View commit details
    Browse the repository at this point in the history

  3. Add type hints

    @juhoinkinen
    juhoinkinen committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    c87675c View commit details
    Browse the repository at this point in the history

  4. Update RTD CLI commands page

    @juhoinkinen
    juhoinkinen committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    2fe5b73 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. Remove --revision option of download command

    @juhoinkinen
    juhoinkinen committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    d7be137 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. Upgrade to huggingface-hub 0.22.*

    @juhoinkinen
    juhoinkinen committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    47f7ee4 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2024

  1. Revert "Remove --revision option of download command" 

    This reverts commit d7be137.
    @juhoinkinen
    juhoinkinen committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    a488d07 View commit details
    Browse the repository at this point in the history

  2. Preupload lfs files

    @juhoinkinen
    juhoinkinen committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    0c57bf2 View commit details
    Browse the repository at this point in the history

  3. Fix HF Hub caching in Dockerfile

    @juhoinkinen
    juhoinkinen committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    df105a3 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. Refactor to address quality complains

    @juhoinkinen
    juhoinkinen committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    d14ff30 View commit details
    Browse the repository at this point in the history

  2. Again: Refactor & simplify to address quality complains

    @juhoinkinen
    juhoinkinen committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    cc0c989 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. Fix typo in mocked filenames in repo

    @juhoinkinen
    juhoinkinen committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    9443c8f View commit details
    Browse the repository at this point in the history

  2. Detect projects present in repo by .cfg files, not .zip files

    @juhoinkinen
    juhoinkinen committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    156bbf5 View commit details
    Browse the repository at this point in the history

  3. Add --revision option to upload command

    @juhoinkinen
    juhoinkinen committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    3f60456 View commit details
    Browse the repository at this point in the history

  4. Enable completion of project_id argument in upload command

    @juhoinkinen
    juhoinkinen committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    2dd359d View commit details
    Browse the repository at this point in the history

  5. Adapt test for adding revision option to upload command

    @juhoinkinen
    juhoinkinen committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    63076cd View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Move functions for HuggingFaceHub interactions to own file

    @juhoinkinen
    juhoinkinen committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    a0a3850 View commit details
    Browse the repository at this point in the history

  2. Move unit tests for HuggingFaceHub util fns to own file

    @juhoinkinen
    juhoinkinen committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    638aa07 View commit details
    Browse the repository at this point in the history

  3. Make io import conditional to TYPE_CHECKING

    @juhoinkinen
    juhoinkinen committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    6f35fff View commit details
    Browse the repository at this point in the history