CLI
For VM-based backends as well as SSH fleets, the CLI now shows Docker image pull progress in the format <extracted>/<downloaded>/<total>.
Offers
This update reduces the time required to fetch backend offers and initialize backends, making both dstack offer and dstack apply faster:
- runpod — 0.66s => 0.03s (22x)
- amddevcloud — 2.26s => 0.85s (2.7x)
- cudo — 2.48s => 1.02s (2.4x)
- verda — 3.27s => 1.74s (1.9x)
- lambda — 3.24s => 1.89s (1.7x)
- vastai — 3.27s => 1.77s (1.8x)
- gcp — 3.74s => 2.54s (1.5x)
- azure — 5.83s => 3.11s (1.9x)
- aws — 6.58s => 3.56s (1.8x)
Secrets
The Manager project role can now manage secrets if the allow_managers_manage_secrets property is enabled in the server’s default_permissions config:
default_permissions:
allow_managers_manage_secrets: truePreviously, only the Admin role was allowed to manage secrets.
GPUs
This update adds support for GeForce RTX 2, 3, 4, and 5 series GPUs, which were previously not detected properly across both backend and SSH fleets.
GCP
The gcp backend now requires the compute.projects.get permission. Make sure this permission is granted to any custom IAM roles used by dstack.
What's changed
- Optimize GCP offers by @r4victor in #3793
- Optimize InstanceOffer construction by @r4victor in #3794
- Speed up GCP validate_credentials by @r4victor in #3795
- Support secrets management by Manager role by @r4victor in #3801
- Fix
update_default_project()crash on server without TTY by @un-def in #3797 - Kubernetes: fix
is_hard_taintcheck by @un-def in #3803 - Fix deleting idle instance from fleet with runs by @jvstme in #3807
- [Docs] Update examples by @peterschmidt85 in #3798
- Display image pull progress in CLI by @jvstme in #3805
- [Docs] Add an inline
kubeconfigexample to thekubernetesbackend documentation by @peterschmidt85 in #3813 - Avoid Verda instance termination warnings by @jvstme in #3810
- [Internal] Improve warning message in
ServerConfigManager.apply_config()by @un-def in #3804 - Add missing join to volumes query in JobSubmittedWorker by @un-def in #3816
- Add CLI deprecation warnings about gateway routers by @jvstme in #3814
- Bump
gpuhunt, add support for all GeForce RTX 2..5 series by @un-def in #3818 - Add misssing
compute.projects.getGCP permission by @un-def in #3820
Full changelog: 0.20.17...0.20.18