The Fleet Is the New Cluster: The Infrastructure Shift Platform Engineers Can't Ignore
Carolyn King

TL;DR
Platform engineering was built around the cluster. That model worked when infrastructure meant a handful of clusters. It doesn't anymore.
Five key drivers — AI/GPU infrastructure, multi-cloud proliferation, dedicated SaaS environments, edge deployment, and regulated industries — are pushing platform teams to operate at fleet scale.
The toolstack has evolved in waves: deployment has matured, promotion is maturing, and fleet-scale promotion is the new frontier.
Fleet promotion requires a different set of building blocks than single-cluster promotion: failure thresholds, rollback as a first-class operation, aggregate observability, per-team RBAC, and the ability to treat the fleet as a unit.
Platform teams that build fleet promotion as a first-class capability now will have infrastructure that scales with the business. Those that defer it will feel the gap on every release.
Platform engineering was built around the cluster — deploying into it, monitoring it, recovering it. GitOps, and Argo CD in particular — created by the team behind Akuity — established the foundation: keeping clusters in sync with desired state, reliably and at scale. That model worked when infrastructure meant a handful of clusters. That's no longer the world platform engineers are operating in.
The infrastructure reality facing platform teams today isn't one cluster or ten clusters. It's hundreds or even thousands. The advances driving this: GPU infrastructure at neocloud scale, multi-cloud proliferation, tightening data residency rules, the push to the edge. Each is redrawing what production infrastructure looks like, and in each case the answer involves more clusters, more environments, and more operational surface than the tools were designed for.
Why fleet-scale infrastructure is becoming the new normal
The shift to fleet-scale infrastructure isn't happening in isolation. We see several drivers behind this change, and these are the ones hitting platform engineering teams hardest:

AI and GPU infrastructure. Neoclouds like CoreWeave operate Kubernetes-native GPU infrastructure spanning 250,000+ GPUs. Each node carries drivers, firmware, and CUDA versions on a release cadence set by NVIDIA — not the platform team. The update surface is massive, the schedule is externally dictated, and drift across nodes has direct performance consequences. The platform engineering challenge here isn't just scale; it's that scale arrived almost overnight, at a density never seen before.
Multi-region and multi-cloud proliferation. Sovereignty rules, latency requirements, and resilience architecture mean the same workload now runs across many regions and providers simultaneously. Mercedes-Benz scaled from 200 to roughly 1,000 clusters. Cluster counts didn't grow linearly with the business; they multiplied.
Dedicated SaaS environments. The deployment target isn't a shared platform; it's a customer's isolated environment. Veeva Systems, which serves more than 1,500 life sciences customers, runs software where every customer environment carries its own validation requirements, compliance obligations, and release cycle. One product, never one version everywhere. Every tenant is its own promotion target with its own gates.
Edge and retail locations. Latency requirements and data-residency rules are pushing workloads closer to users, and platform engineers are being asked to make that happen at scale. Chick-fil-A runs edge Kubernetes clusters in each of its approximately 2,800 restaurants, enabling business-critical workloads to run without internet dependency. Rollouts have to account for connectivity constraints, local hardware variance, and the operational reality that you can't SSH into a store.
Regulated industries. Capital One has been building on a hardened, compliance-first Kubernetes platform since the early days. The platform is purpose-built to carry security controls, audit requirements, and governance policies across every environment. In financial services, healthcare, and government, each environment carries its own compliance classification and change control gate.
From cluster-level deployment to fleet: how the platform engineering toolstack is evolving

The first wave of platform tooling focused on deployment. Argo CD and Flux, the GitOps tools that became the industry standard, addressed it directly: reconciling desired state at the cluster level, continuously and reliably. Today, cluster-level deployment is the most mature part of the modern software delivery pipeline.
The second wave addressed promotion: how does a release move through environments — dev, staging, production — with gates, verification, and consistency? This is the problem Kargo was built to address. Where Argo CD handles deployment, Kargo handles what happens before that: deciding what gets promoted, to where, and under what conditions. Declarative pipelines, native release gates, and freight as a first-class release unit give platform teams a shared promotion model that scales across services and teams.
The third wave has arrived: fleet-scale promotion. Operating a release across a fleet requires a different model entirely — and platform teams are feeling that gap. The questions change: not just did this promote successfully, but how many clusters are on the new version, where did it fail, and what happens next.
What platform engineers need to get fleet promotion right
Fleet promotion isn't single-cluster promotion at larger scale; it's a different set of building blocks entirely:
Failure thresholds, not binary outcomes. The question isn't whether any cluster failed, it's whether the failure rate crossed a threshold that warrants stopping the rollout.
Ordered rollout across deliberate waves. Pilot, then canary, then general population, sequenced by risk.
Rollback as a first-class operation. As deliberate and observable as rolling forward.
Aggregate observability. One view across the fleet, not N individual cluster dashboards.
Per-team RBAC. Scoped control for teams that own subsets of the fleet.
The fleet as a unit. The ability to stop, roll back, and investigate across the whole fleet at once, not cluster by cluster.

How platform teams are getting ahead of this
Across the organizations we work with, a few common patterns keep showing up:
Define the fleet before the rollout. A fleet is a logical grouping with shared ownership and promotion policy, not just "all clusters." Defining those boundaries early, along with aggregate visibility, is what makes scoped RBAC and observability possible before the fleet scales into the hundreds.
Treat promotion policy as code. Failure thresholds, soak times, approval gates, and rollback conditions belong in declared configuration, not decided at runtime by whoever's on call.
Design for partial failure. A rollout that stops at the first failure is often worse than one that continues with visibility, build explicit failure handling and notification into the model.
Separate fleet promotion from application deployment. The team managing fleet promotion shouldn't need to understand the application, and the application team shouldn't need to understand fleet topology.
What platform engineers should be building for now
The forces driving fleet-scale adoption are accelerating. GPU infrastructure is hitting new heights every week. Multi-cloud architecture is now the standard. SaaS isolation and edge deployment are becoming table stakes for enterprise software. Regulatory requirements are tightening and showing no signs of reversing.
Platform engineers who build fleet promotion as a first-class capability now — declarative, policy-driven, observable — will have infrastructure that scales with the business. Those who defer it will find themselves operating at fleet scale with single-cluster tooling and feeling the gap on every release.
This is something our team has been thinking about for a long time. When we built Argo CD, we could already see the shape of the problem that would come next — and Kargo was the answer to that. After building Kargo as the promotion layer for Kubernetes, VMs, Terraform and beyond, Fleet Promotion Management is the next logical step. Learn more at akuity.io.
Want to see continuous promotion in practice?
Get hands-on with Kargo in about 20 minutes. Try the Quickstart.

