This guide walks you end-to-end through a hybrid deployment on any Kubernetes 1.24+ cluster — on-prem, bare metal, k3s, RKE2, Civo, DigitalOcean, IBM IKS, OKE, and so on. The Data Plane, TrustGate, and Firewall run in your cluster; the Control Plane UI, API, and Scheduler run on NeuralTrust SaaS. If you’re on EKS / AKS / GKE / OpenShift, prefer the dedicated guide for richer integrations. For the full-stack alternative, see Vanilla Kubernetes self-hosted.Documentation Index
Fetch the complete documentation index at: https://docs.neuraltrust.ai/llms.txt
Use this file to discover all available pages before exploring further.
What you’ll end up with
| Component | Location | Replicas |
|---|---|---|
| Data Plane API, worker, Kafka Connect | Your cluster | 2, 1, 1 |
| TrustGate admin / gateway / actions | Your cluster | 2 each |
| Firewall gateway + 5 workers | Your cluster | 2 + 5 |
| ClickHouse, Kafka, PostgreSQL, Redis | Your cluster (or external) | 1 each |
| Control Plane API, UI, Scheduler | NeuralTrust SaaS | — |
Prerequisites
| Resource | Recommended |
|---|---|
| Kubernetes version | 1.24+ |
| CPU pool | ≥ 4 × (8 vCPU / 32 GiB) for HA. Drop to 3 if Firewall workers run on GPU nodes. |
| GPU pool (optional, for GPU Firewall) | 4 vCPU / 16 GiB + 1 × NVIDIA GPU per node — 5 nodes (one per default Firewall worker) |
| Storage | Default StorageClass with ReadWriteOnce PVs |
| Ingress | NGINX, Traefik, HAProxy, or any conformant controller |
| TLS | cert-manager with Let’s Encrypt or internal CA |
| DNS | A control over a base domain (e.g. platform.example.com) |
| Image pull | gcr-keys.json from NeuralTrust |
| NeuralTrust tenant | A SaaS Control Plane tenant — request from [email protected] |
Step 1 — Cluster prep
Install:- An ingress controller (NGINX, Traefik, HAProxy — see Vanilla Kubernetes overview › Required cluster setup).
- cert-manager (for automated TLS).
- A storage class with
ReadWriteOncesupport (local-path, Longhorn, Rook/Ceph, NFS CSI, etc.). - (Bare metal only) MetalLB or an external LB to give the ingress controller an IP.
Step 2 — Namespace and image pull secret
Step 3 — Write your values overlay
Save asmy-values.yaml:
Using external infrastructure
For ClickHouse Cloud, see the native-port caveat. For external Kafka with SASL/SCRAM/PLAIN/IAM, see Authentication for external Kafka. Pre-create the
neuraltrust and trustgate databases/users on Postgres — see Required databases & users.Step 4 — Install
Step 5 — DNS
Get the ingress controller’s external IP / hostname:| Host | Component |
|---|---|
data-plane-api.platform.example.com | Data Plane API |
admin.platform.example.com | TrustGate admin |
gateway.platform.example.com | TrustGate proxy |
actions.platform.example.com | TrustGate actions |
Step 6 — Enroll the Data Plane with NeuralTrust SaaS
Connect the Data Plane
Team Settings → Advanced → Connect Data Plane. Provide the Data Plane API URL (
https://data-plane-api.platform.example.com), the JWT secret, and the region. See Platform › Advanced.Step 7 — Send traffic through TrustGate
Point your AI applications athttps://gateway.platform.example.com. See TrustGate › Getting started for plugin and route configuration.
Verification
Upgrading
Migration to self-hosted
app.platform.example.com, api.platform.example.com, scheduler.platform.example.com. See Self-hosted on vanilla Kubernetes for the full picture.
Troubleshooting
| Symptom | Likely cause | Fix |
|---|---|---|
| Portal says “Data Plane unreachable” | DNS not propagated, cert pending, or firewall blocks the SaaS Control Plane | curl https://data-plane-api.<domain>/health from outside your network |
| cert-manager challenge stuck | DNS not resolving, or ingress can’t reach the world for HTTP-01 | kubectl describe challenge -n neuraltrust |
PVC stuck Pending | No default storage class | Mark one default and re-apply |
| Pods OOMKilled | Under-sized nodes | Scale node spec or reduce replica counts in values |
| TrustGate can’t reach Firewall | Service name mismatch | Default is http://firewall:80 |
Related guides
- Self-hosted deployment on vanilla Kubernetes — Control Plane in your cluster
- Vanilla Kubernetes overview — cluster prerequisites
- Deployment models — hybrid vs self-hosted comparison
- Image catalog — what runs in hybrid mode
- Secrets management — auto-generation, External Secrets Operator
- Firewall deployment — GPU workers