On-prem AMD GPU support
dstack now supports SSH fleets with AMD GPUs. Hosts should be pre-installed with Docker and AMDGPU-DKMS kernel driver (e.g. via native package manager or AMDGPU installer).
Elastic Fabric Adapter support
dstack now automatically enables AWS EFA if it is supported by the instance type, no extra configuration needed. The following EFA-enabled instance types are supported: p5.48xlarge, p4d.24xlarge, g4dn.12xlarge, g4dn.16xlarge, g4dn.8xlarge, g4dn.metal, g5.12xlarge, g5.16xlarge, g5.24xlarge, g5.48xlarge, g5.8xlarge, g6.12xlarge, g6.16xlarge, g6.24xlarge, g6.48xlarge, g6.8xlarge, gr6.8xlarge.
Improved apply plan
Previously, dstack apply showed a plan only for run configurations. Now it shows a plan for all configuration types including fleets, volumes, and gateways. Here's a fleet plan showing configuration parameters and the offers that will be tried for provisioning:
✗ dstack apply -f .dstack/confs/fleet.yaml
Project main
User admin
Configuration .dstack/confs/fleet.yaml
Type fleet
Fleet type cloud
Nodes 2
Placement cluster
Backends aws
Resources 2..xCPU, 8GB.., 100GB.. (disk)
Spot policy on-demand
# BACKEND REGION INSTANCE RESOURCES SPOT PRICE
1 aws eu-west-1 m5.large 2xCPU, 8GB, 100.0GB (disk) no $0.107
2 aws eu-central-1 m5.large 2xCPU, 8GB, 100.0GB (disk) no $0.115
3 aws eu-west-1 c5.xlarge 4xCPU, 8GB, 100.0GB (disk) no $0.192
...
Shown 3 of 82 offers, $40.9447 max
Fleet my-cluster-fleet does not exist yet.
Create the fleet? [y/n]:
Volumes UI
Server administrators and regular users can now see volumes in the UI.
What's Changed
- Dstack version on UI by @olgenn in #1742
- Fix restarting gateway connections by @jvstme in #1746
- Fix Handle KeyboardInterrupt in CLI when getting run plan #1626 by @IshuSinghSE in #1756
- Add AMD support on on-prem fleets by @un-def in #1754
- Implement fleet apply plan by @r4victor in #1765
- chore: update provisioning.py by @eltociear in #1768
- Fix use all available runpod regions by default by @IshuSinghSE in #1757
- Implement apply plan for gateways and volumes by @r4victor in #1774
- Fix connection to ssh instance on non-standard ssh port by @un-def in #1766
- Fix docker SSH commands by @un-def in #1771
- Add Llama3.2 Vision Model Example by @Bihan in #1770
- Disable backend autoconfig via default creds by @r4victor in #1778
- Set backends requests timeouts by @r4victor in #1793
- Add UI for volumes #1683 by @olgenn in #1785
- UI for volumes 1683 by @olgenn in #1795
- [Docs] Add AMD GPU info to ssh fleets section by @un-def in #1779
- [shim] Use DockerRootDir to detect free disk space by @un-def in #1802
- Add AWS EFA support by @un-def in #1801
New Contributors
- @IshuSinghSE made their first contribution in #1756
- @eltociear made their first contribution in #1768
Full Changelog: 0.18.16...0.18.17
