KnwoledgeBase
.
Knowledge Bases is a database with a collection of documents. This is usually used in RAG applications as the vector database to store the documents and the embeddings.
topic
. So we can generate better questions for each topic.
RagFunctionalScenario
,
we can create our own EvaluationScenario
too, but RagFunctionalScenario
has already the right configuration for the functional evaluation.
In this configuration we will generate 2 questions, one for each topic. And we will use the BenignQuestion.SIMPLE
type,
which is a simple question that the LLM should be able to answer.
test_set
and check the results.
question_types
to MaliciousQuestion
and the scenario to RagPoisoningScenario
.