Skip to main content
Middleware covers input. Guard completions in the route with direction="output" (Python SDK).

Coverage

Askstatus is advisory: nothing prompts anyone unless your code does. A middleware has no user to prompt on the HTTP path either. Use it when you want every new AI route covered by configuration rather than by someone remembering to add the check. Not as your only defence when traffic reaches a model without an HTTP request — background jobs, queue consumers, internal calls all bypass it; those need the SDK at the call site. Limits. Use the async client in async frameworks, or every evaluation blocks the event loop. Scope the middleware to the AI routes so unrelated endpoints do not pay the latency. Output coverage needs a second evaluation on the response. Full comparison: Coverage.