Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test Llama, rebalancing, throughput eval, and all CLI scripts #452

Merged
merged 32 commits into from
Aug 8, 2023
Merged

Test Llama, rebalancing, throughput eval, and all CLI scripts #452

merged 32 commits into from
Aug 8, 2023

Commits on Aug 8, 2023

  1. Show argparse defaults, fix docstring

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    69abacc View commit details
    Browse the repository at this point in the history

  2. Test petals.cli.run_dht

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    ca2850e View commit details
    Browse the repository at this point in the history

  3. Increase mean_block_selection_delay

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    816401e View commit details
    Browse the repository at this point in the history

  4. Test rebalancing

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    7330653 View commit details
    Browse the repository at this point in the history

  5. Add help to benchmark argparse

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    a00e79d View commit details
    Browse the repository at this point in the history

  6. Use less RAM

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    5b3d4c4 View commit details
    Browse the repository at this point in the history

  7. Don't set default model in benchmarks

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    2b765b9 View commit details
    Browse the repository at this point in the history

  8. Fix sleep time

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    fae58d9 View commit details
    Browse the repository at this point in the history

  9. Test --throughput eval

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    856f53f View commit details
    Browse the repository at this point in the history

  10. Fix flapping test

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    05dc383 View commit details
    Browse the repository at this point in the history

  11. Use AutoDistributed{Config,Model} in tests

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    18e5b00 View commit details
    Browse the repository at this point in the history

  12. Add Maykeye/TinyLLama-v0 to tests

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    168e478 View commit details
    Browse the repository at this point in the history

  13. Test using includes only

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    5760b15 View commit details
    Browse the repository at this point in the history

  14. Adjust --num_blocks and --block_indices for 8-layer TinyLlama-v0

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    015238a View commit details
    Browse the repository at this point in the history

  15. Refactor matrix

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    17cae64 View commit details
    Browse the repository at this point in the history

  16. Fix commands

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    b7b7464 View commit details
    Browse the repository at this point in the history

  17. Skip TP tests for llama

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    c907990 View commit details
    Browse the repository at this point in the history

  18. Fix test_greedy_generation() for llama

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    0040539 View commit details
    Browse the repository at this point in the history

  19. Fix commands

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    a5a95c4 View commit details
    Browse the repository at this point in the history

  20. Fix test_server_info()

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    c3e7638 View commit details
    Browse the repository at this point in the history

  21. Fix server layout

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    b622a14 View commit details
    Browse the repository at this point in the history

  22. Try reducing RAM usage

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    8a379aa View commit details
    Browse the repository at this point in the history

  23. Check if benchmarks work

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    ecd7d3f View commit details
    Browse the repository at this point in the history

  24. Watch free RAM (common issue in CI)

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    6ffbc28 View commit details
    Browse the repository at this point in the history

  25. Reduce RAM further

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    033a3ca View commit details
    Browse the repository at this point in the history

  26. Tune constants to save RAM

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    f06cebd View commit details
    Browse the repository at this point in the history

  27. Speed benchmark tests

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    47d2d53 View commit details
    Browse the repository at this point in the history

  28. Fix flapping test

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    d8e08e6 View commit details
    Browse the repository at this point in the history

  29. Try --no_relay

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    315c5c6 View commit details
    Browse the repository at this point in the history

  30. Increase swap space

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    5cbb33b View commit details
    Browse the repository at this point in the history

  31. Fix flapping test

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    54cd213 View commit details
    Browse the repository at this point in the history

  32. Fix flapping test

    @borzunov
    borzunov committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    1e34dfd View commit details
    Browse the repository at this point in the history