Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bugfix] Fix weight loading for Chameleon when TP>1 #7410

Merged
merged 9 commits into from
Aug 13, 2024
Merged

[Bugfix] Fix weight loading for Chameleon when TP>1 #7410

merged 9 commits into from
Aug 13, 2024

Commits on Aug 12, 2024

  1. Fix weight loading when TP>1

    @DarkLight1337
    DarkLight1337 committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    347e07e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'upstream' into fix-chameleon-tp

    @DarkLight1337
    DarkLight1337 committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    774f6b0 View commit details
    Browse the repository at this point in the history

  3. Fix improper handling of logits=None

    @DarkLight1337
    DarkLight1337 committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    df48bb0 View commit details
    Browse the repository at this point in the history

  4. Update type annotations in other models

    @DarkLight1337
    DarkLight1337 committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    4f64144 View commit details
    Browse the repository at this point in the history

  5. Set up vLLM vs HF test for Chameleon

    @DarkLight1337
    DarkLight1337 committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    eba4f52 View commit details
    Browse the repository at this point in the history

  6. Auto-convert dtype

    @DarkLight1337
    DarkLight1337 committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    eab6bee View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2024

  1. Apply suggestion

    @DarkLight1337
    DarkLight1337 committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    2f25b30 View commit details
    Browse the repository at this point in the history

  2. Handle _logits=None in Medusa model

    @DarkLight1337
    DarkLight1337 committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    4f5425c View commit details
    Browse the repository at this point in the history

  3. Merge branch 'upstream' into fix-chameleon-tp

    @DarkLight1337
    DarkLight1337 committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    0878b0c View commit details
    Browse the repository at this point in the history