TrustTest is designed to be completely agnostic to the LLM you want to test. This flexibility allows you to evaluate any LLM model, regardless of its underlying implementation or hosting environment.
Currently, only LLM models that expose a REST API endpoint are supported to run tests through the web UI.
TrustTest is optimized to evaluate LLM models that are not running in the same process. For best performance and reliability, we recommend:
The following sections will guide you through the process of connecting your LLM to TrustTest and configuring it for optimal testing.