Skip to main content
Clients send the same JSON they would send to Cohere /v2/rerank. Auth and the consumer slug are the same as chat.
On a Private data plane, add X-AG-Gateway-Slug as in the chat snippets. The gateway speaks the Cohere v2 rerank shape on this path. It is not an OpenAI Chat Completions route.

Providers

OpenAI, Azure, Anthropic, Gemini / Vertex, Bedrock, Groq, Mistral, OpenRouter, and other chat-only providers do not expose rerank. They are left out of the candidate pool. The model field is allowlisted as usual and can pin with @provider/model.

Routing

  1. The consumer’s registries are filtered to those that advertise rerank.
  2. Model resolution and load balancing run on that pool.
  3. Pinning a registry that cannot rerank is a 400, not a failover.
  4. An empty capable pool is a 503.
Attach at least one Cohere registry to the consumer. A mixed chat + rerank pool is fine: chat still uses every chat-capable member; rerank skips the rest.