AWS (EKS)
AWS (EKS)
ACM certificates terminate at the load balancer, so they cover Ingress hosts but
not the layer-4 endpoints a central control
plane publishes — TLS terminates in those
pods and ACM does not export private keys. Use cert-manager or your own PKI
there, with
service.beta.kubernetes.io/aws-load-balancer-type: nlb and
aws-load-balancer-scheme: internal for private callers.Azure (AKS)
Azure (AKS)
An internal load balancer is
service.beta.kubernetes.io/azure-load-balancer-internal: "true".GCP (GKE)
GCP (GKE)
--num-nodes 1 in a regional cluster gives one node per zone, so three in total.For GKE Ingress set
global.platform: gcp,
global.ingress.gcp.staticIpName, and managedCertificates. Google-managed
certificates reject wildcards, so if you rely on the chart’s wildcard hosts
(*.llm.<domain> / *.mcp.<domain>) use cert-manager, or set
agentgateway.config.autoWildcardHosts: false and list exact hosts.A plain LoadBalancer Service already gives a layer-4 passthrough load balancer;
its private form is networking.gke.io/load-balancer-type: "Internal".Conformant Kubernetes
Conformant Kubernetes
For clusters without a dedicated guide. Confirm the capabilities first:You need a default StorageClass (or
global.storageClass), an Ingress or Gateway
implementation, DNS for global.domain, and TLS from cert-manager or
pre-created Secrets.