Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Miscellaneous fixes to automatic tests #35

Merged
merged 12 commits into from
Jul 22, 2022
Merged

Miscellaneous fixes to automatic tests #35

Changes from 1 commit
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
c322865
Fix branch name in CI
justheuristic Jul 22, 2022
39dd3d9
wait for the first server to initialize DHT
justheuristic Jul 22, 2022
375f5ad
[WIP]
justheuristic Jul 22, 2022
6583763
remove debugprint
justheuristic Jul 22, 2022
aee295f
de-flappify: give servers more time to download the model
justheuristic Jul 22, 2022
dfe57eb
set dtype='auto'
justheuristic Jul 22, 2022
05fed96
remove torch_dtype on converted model
justheuristic Jul 22, 2022
3f048e5
undo half
justheuristic Jul 22, 2022
996104a
[WIP] disable conversion
justheuristic Jul 22, 2022
dc277b3
minimize peak CPU memory usage
justheuristic Jul 22, 2022
84532ee
revert debug changes
justheuristic Jul 22, 2022
abd3da6
Update .github/workflows/run-tests.yaml
dbaranchuk Jul 22, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
remove debugprint
  • Loading branch information
@justheuristic
justheuristic authored Jul 22, 2022
commit 6583763ed97022497eb3b84d9494a8b7767421d4
8 changes: 3 additions & 5 deletions .github/workflows/run-tests.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,14 +28,12 @@ jobs:
pip install -r requirements.txt
- name: Delete previous model, if exists
run: |
echo $(env)
exit 255
export HF_TAG=$(python -c "import os; print(os.environ.get('GITHUB_REF_NAME') or os.environ.get('GITHUB_BASE_REF') or 'main')")
export HF_TAG=$(python -c "import os; print(os.environ.get('GITHUB_HEAD_REF') or os.environ.get('GITHUB_REF_NAME'))")
python -c "from huggingface_hub import delete_repo; delete_repo(token='$BLOOM_TESTING_WRITE_TOKEN', \
name='test-bloomd-350m-$HF_TAG', organization='bloom-testing')" || true
- name: Convert model and push to hub
run: |
export HF_TAG=$(python -c "import os; print(os.environ.get('GITHUB_BASE_REF') or os.environ.get('GITHUB_REF_NAME'))")
export HF_TAG=$(python -c "import os; print(os.environ.get('GITHUB_HEAD_REF') or os.environ.get('GITHUB_REF_NAME'))")
python -m cli.convert_model --model bigscience/bloom-350m --output_path ./converted_model \
--output_repo bloom-testing/test-bloomd-350m-$HF_TAG --use_auth_token $BLOOM_TESTING_WRITE_TOKEN

Expand Down Expand Up @@ -66,7 +64,7 @@ jobs:
pip install -r requirements-dev.txt
- name: Test
run: |
export HF_TAG=$(python -c "import os; print(os.environ.get('GITHUB_REF_NAME') or os.environ.get('GITHUB_BASE_REF') or 'main')")
export HF_TAG=$(python -c "import os; print(os.environ.get('GITHUB_HEAD_REF') or os.environ.get('GITHUB_REF_NAME'))")
export MODEL_NAME=bloom-testing/test-bloomd-350m-$HF_TAG
export REF_NAME=bigscience/bloom-350m

Expand Down