Rerank - NeuralTrust Docs | TrustGate, TrustGuard, TrustTest

/v1/rerank speaks the Cohere v2 rerank shape — a query, a list of documents, a rerank model — and is the one path on the LLM plane that is not OpenAI-shaped.

import requests

requests.post(
    "https://<llm-host>/<application-slug>/v1/rerank",
    headers={"X-AG-API-Key": "<application key>"},
    json={
        "model": "rerank-english-v3.0",
        "query": "What is TrustGate?",
        "documents": ["TrustGate is an LLM gateway", "Unrelated text"],
    },
).json()

const res = await fetch("https://<llm-host>/<application-slug>/v1/rerank", {
  method: "POST",
  headers: { "X-AG-API-Key": "<application key>", "Content-Type": "application/json" },
  body: JSON.stringify({
    model: "rerank-english-v3.0",
    query: "What is TrustGate?",
    documents: ["TrustGate is an LLM gateway", "Unrelated text"],
  }),
})
await res.json()

curl -X POST "https://<llm-host>/<application-slug>/v1/rerank" \
  -H "X-AG-API-Key: <application key>" \
  -H "Content-Type: application/json" \
  -d '{"model": "rerank-english-v3.0", "query": "What is TrustGate?", "documents": ["TrustGate is an LLM gateway", "Unrelated text"]}'

Cohere’s own SDK posts to /v2/rerank, which the gateway does not serve, so this path is called with a plain HTTP client.

Which registries can serve it

Cohere, and nothing else. Every other provider is excluded from the pool automatically, so an application that reranks needs a Cohere registry attached — alongside whatever serves its chat, which is fine.

How it routes

The pool narrows to Cohere registries; routing runs on what is left. With one Cohere registry that is trivially one target. Pinning anything else is a 400, no Cohere registry is a 503.