Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for bitsandbytes #15622

Merged
merged 18 commits into from
Apr 19, 2022
Merged

Add support for bitsandbytes #15622

merged 18 commits into from
Apr 19, 2022

Commits on Feb 3, 2022

  1. Add initial BNB integration

    @manuelciosici
    manuelciosici committed Feb 3, 2022
    Configuration menu
    Copy the full SHA
    3696f64 View commit details
    Browse the repository at this point in the history

  2. fixup! Add initial BNB integration

    @manuelciosici
    manuelciosici committed Feb 3, 2022
    Configuration menu
    Copy the full SHA
    ba8790c View commit details
    Browse the repository at this point in the history

  3. Add bnb test decorator

    @manuelciosici
    manuelciosici committed Feb 3, 2022
    Configuration menu
    Copy the full SHA
    16df6c8 View commit details
    Browse the repository at this point in the history

  4. Update Adamw8bit option name

    @manuelciosici
    manuelciosici committed Feb 3, 2022
    Configuration menu
    Copy the full SHA
    97bd33b View commit details
    Browse the repository at this point in the history

Commits on Feb 11, 2022

  1. Use the full bnb package name

    @manuelciosici
    manuelciosici committed Feb 11, 2022
    Configuration menu
    Copy the full SHA
    22abb9c View commit details
    Browse the repository at this point in the history

  2. Overide bnb for all embedding layers

    @manuelciosici
    manuelciosici committed Feb 11, 2022
    Configuration menu
    Copy the full SHA
    226b3dd View commit details
    Browse the repository at this point in the history

  3. Fix package name

    @manuelciosici
    manuelciosici committed Feb 11, 2022
    Configuration menu
    Copy the full SHA
    1d03d49 View commit details
    Browse the repository at this point in the history

  4. Formatting

    @manuelciosici
    manuelciosici committed Feb 11, 2022
    Configuration menu
    Copy the full SHA
    22d7112 View commit details
    Browse the repository at this point in the history

  5. Remove unnecessary import

    @manuelciosici
    manuelciosici committed Feb 11, 2022
    Configuration menu
    Copy the full SHA
    b048a34 View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2022

  1. Update src/transformers/trainer.py 

    Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
    @manuelciosici @stas00
    manuelciosici and stas00 authored Mar 30, 2022
    Configuration menu
    Copy the full SHA
    2c04486 View commit details
    Browse the repository at this point in the history

  2. Rename AdamwBNB optimizer option

    @manuelciosici
    manuelciosici committed Mar 30, 2022
    Configuration menu
    Copy the full SHA
    b7a1c0c View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2022

  1. Add training test checking that bnb memory utilization is lower

    @manuelciosici
    manuelciosici committed Apr 8, 2022
    Configuration menu
    Copy the full SHA
    8cb259b View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2022

  1. Merge remote-tracking branch 'origin/main' into 14819-integrate-bnb

    @stas00
    stas00 committed Apr 15, 2022
    Configuration menu
    Copy the full SHA
    7a1c7b7 View commit details
    Browse the repository at this point in the history

  2. fix merge

    @stas00
    stas00 committed Apr 15, 2022
    Configuration menu
    Copy the full SHA
    e8bf8d0 View commit details
    Browse the repository at this point in the history

  3. fix merge; fix + extend new test

    @stas00
    stas00 committed Apr 15, 2022
    Configuration menu
    Copy the full SHA
    37044b5 View commit details
    Browse the repository at this point in the history

  4. cleanup

    @stas00
    stas00 committed Apr 15, 2022
    Configuration menu
    Copy the full SHA
    2e36019 View commit details
    Browse the repository at this point in the history

  5. expand bnb

    @stas00
    stas00 committed Apr 15, 2022
    Configuration menu
    Copy the full SHA
    dbdaf25 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2022

  1. move all require_* candidates to testing_utils.py

    @stas00
    stas00 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    ce2c550 View commit details
    Browse the repository at this point in the history