Skip to content

Commit

Permalink
Update tpu examples for new folder structure
Browse files Browse the repository at this point in the history
  • Loading branch information
Bihan Rana authored and Bihan Rana committed Aug 27, 2024
2 parents d2c0f01 + 61331f6 commit 44c0da0
Show file tree
Hide file tree
Showing 5 changed files with 7 additions and 6 deletions.
2 changes: 1 addition & 1 deletion examples/fine-tuning/optimum-tpu/gemma/.dstack.yml
Original file line number Diff line number Diff line change
Expand Up @@ -26,4 +26,4 @@ ide: vscode
spot_policy: auto

resources:
gpu: tpu-v5litepod-8
gpu: v5litepod-8
2 changes: 1 addition & 1 deletion examples/fine-tuning/optimum-tpu/gemma/train.dstack.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,4 +21,4 @@ ports:
- 6006

resources:
gpu: tpu-v5litepod-8
gpu: v5litepod-8
5 changes: 2 additions & 3 deletions examples/fine-tuning/optimum-tpu/llama31/.dstack.yml
Original file line number Diff line number Diff line change
Expand Up @@ -19,14 +19,13 @@ env:
# - cp examples/fine-tuning/optimum-tpu/llama31/config.yaml optimum-tpu/examples/custom/config.yaml
# - cd optimum-tpu
# - pip install -e . -f https://storage.googleapis.com/libtpu-releases/index.html
# - pip install trl peft
# - pip install datasets evaluate
# - pip install accelerate>=0.21.0
# - pip install accelerate -U

ide: vscode

# Use either spot or on-demand instances
spot_policy: auto

resources:
gpu: tpu-v5litepod-8
gpu: v5litepod-8
2 changes: 1 addition & 1 deletion examples/fine-tuning/optimum-tpu/llama31/train.dstack.yml
Original file line number Diff line number Diff line change
Expand Up @@ -23,4 +23,4 @@ ports:
- 6006

resources:
gpu: tpu-v5litepod-8
gpu: v5litepod-8
2 changes: 2 additions & 0 deletions mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -224,13 +224,15 @@ nav:
- Python API: docs/reference/api/python/index.md
- REST API: docs/reference/api/rest/index.md
- Examples:
<<<<<<< HEAD
- examples.md
- Fine-tuning:
- Axolotl: examples/fine-tuning/axolotl/index.md
- Alignment Handbook: examples/fine-tuning/alignment-handbook/index.md
- TRL: examples/fine-tuning/trl/index.md
- Accelerators:
- AMD: examples/accelerators/amd/index.md
- TPU: docs/examples/accelerators/tpu/index.md
- LLMs:
- Llama 3.1: examples/llms/llama31/index.md
- Blog:
Expand Down

0 comments on commit 44c0da0

Please sign in to comment.