Skip to content

Commit

Permalink
Add disk tier to vicuna example for better performance (skypilot-org#…
Browse files Browse the repository at this point in the history
…1874)

* Add disk tier to vicuna example for better performance

* Add note
  • Loading branch information
Michaelvll committed Apr 22, 2023
1 parent ab2ca66 commit 493cba2
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 0 deletions.
3 changes: 3 additions & 0 deletions llm/vicuna/serve.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,9 @@
resources:
accelerators: A100:1
disk_size: 1024
# Note: The disk_tier option is not offered in skypilot<=0.2.5, we need
# to install SkyPilot from source.
disk_tier: high

setup: |
conda activate chatbot
Expand Down
3 changes: 3 additions & 0 deletions llm/vicuna/train.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,9 @@ resources:
accelerators: A100-80GB:8
disk_size: 1000
use_spot: true
# Note: The disk_tier option is not offered in skypilot<=0.2.5, we need
# to install SkyPilot from source.
disk_tier: high

num_nodes: 1

Expand Down

0 comments on commit 493cba2

Please sign in to comment.