Skip to content

Show offers in dstack apply for elastic container fleets#3754

Open
peterschmidt85 wants to merge 1 commit intomasterfrom
fix/fleet-elastic-container-offers
Open

Show offers in dstack apply for elastic container fleets#3754
peterschmidt85 wants to merge 1 commit intomasterfrom
fix/fleet-elastic-container-offers

Conversation

@peterschmidt85
Copy link
Copy Markdown
Contributor

@peterschmidt85 peterschmidt85 commented Apr 7, 2026

Steps to reproduce

type: fleet
name: my-fleet

# Elastic/template fleet (provision on demand)
nodes: 0..1

backends: [runpod]
spot_policy: auto
idle_duration: 10m
dstack apply -f fleet.dstack.yml
Project        main
User           admin
Configuration  fleet.dstack.yml
Type           fleet
Fleet type     cloud
Nodes          min=0 target=0 max=1
Backends       runpod
Resources      cpu=2.. mem=8GB.. disk=100GB.. gpu=0..
Spot policy    auto

No matching instance offers available. Possible reasons:
https://dstack.ai/docs/guides/troubleshooting/#no-offers

Expected

dstack apply should show matching offers for elastic container-based fleets, since runs are provisioned on demand from those offers.

This is important not only for offer visibility/convenience, but also for consistency: VM-based elastic fleets already show offers during apply, and container-based elastic fleets should behave the same way.

Actual

No offers were shown for elastic container-based fleets during apply, even when offers existed.

Solution

In fleet plan generation:

  • For elastic cloud fleets (nodes.min == 0 and nodes.target == 0), use run-capable offer lookup (get_offers_by_requirements).
  • For non-elastic cloud fleets, keep existing create-instance offer lookup (get_create_instance_offers).

This keeps non-elastic behavior unchanged and fixes offer preview UX for elastic container backends.

AI Assistance

This PR was prepared with AI assistance (Codex).

Use run-capable offer lookup for cloud fleets with nodes.min=0 and nodes.target=0, while keeping create-instance filtering for non-elastic fleets.\n\nAdds router tests for elastic container backend offers and preserves no-offers behavior for non-elastic container fleets.
@peterschmidt85 peterschmidt85 requested a review from r4victor April 7, 2026 19:46
@peterschmidt85 peterschmidt85 changed the title Show offers for elastic container fleets Show offers in dstack apply for elastic container fleets Apr 7, 2026
Comment on lines +446 to +463
if _is_elastic_cloud_fleet_spec(effective_spec):
offers_with_backends = await offers_services.get_offers_by_requirements(
project=project,
profile=effective_spec.merged_profile,
requirements=requirements,
multinode=(
effective_spec.configuration.placement == InstanceGroupPlacement.CLUSTER
),
blocks=effective_spec.configuration.blocks,
)
else:
offers_with_backends = await get_create_instance_offers(
project=project,
profile=effective_spec.merged_profile,
requirements=requirements,
fleet_spec=effective_spec,
blocks=effective_spec.configuration.blocks,
)
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Having two branches with get_offers_by_requirements and get_create_instance_offers seems too verbose here. I think it can be replaced with a get_create_instance_offers param that would enable/disable BACKENDS_WITH_CREATE_INSTANCE_SUPPORT filtering.

return plan


def _is_elastic_cloud_fleet_spec(fleet_spec: FleetSpec) -> bool:
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This function name is a misnomer since it does not really check that the fleet is elastic (nodes is a range) but that nodes.target == 0. And since target cannot be less than min, that's all we need to check for.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants