Concepts

TrustTest evaluates a target by generating or loading test cases, scoring them with evaluators, and grouping that work into an evaluation scenario you can rerun.

Object	Role
Test case	One interaction: prompt, response, and the context used to score it.
Probe	Generates a set of test cases (jailbreak suite, dataset, RAG-derived, custom).
Evaluator	Pass / fail for a test case — heuristic or LLM-as-judge.
Evaluation scenario	Binds a probe run to an evaluator suite and its failure criteria.
Knowledge base	Documents used as context when generating tests.
Target	The model, agent, or HTTP endpoint under test.
Client	Where scenarios and results are stored — local files or NeuralTrust.

You do not have to use every object on the first run. A quickstart is a target, a built-in probe, and a client.

Test cases

How an interaction is represented and scored.

Evaluation scenarios

Bind probes to evaluators and rerun the same plan.

Connect a target

HTTP, LLM providers, and custom targets.

Choose evaluators

Heuristics and LLM-as-judge.

Start here

Connect

Red teaming

Functional tests

Knowledge bases

Evaluate

Concepts

Test cases

Evaluation scenarios

Connect a target

Choose evaluators