QuestionAnswerGenerationPipeline - Multiple Answers

[demongolem-biz2]

For the ExtractiveQAPipeline, I can do:

    pipe = ExtractiveQAPipeline(reader, retriever)
    
    prediction = pipe.run(
        query=query_string, params={"Retriever": {"top_k": 10}, "Reader": {"top_k": 5}}
    )

and I get 5 answers return when the pipeline is run.

When I do

    qag_pipeline = QuestionAnswerGenerationPipeline(question_generator, reader)
    result = qag_pipeline.run(documents=[document], params={"Reader": {"top_k": 5}})

I am only getting back 1 answer.

Does seeing the top_k parameter for the QuestionAnswerGenerationPipeline still make sense? I really am looking for the top scoring answers and would like to produce multiple answers per document.

[demongolem-biz2]

Actually I take that back it seems to be a mixed bag. Quite often I get 1 answer back, but sometimes I do get multiple answers back up to 5. Let me modify my question then to is there a threshold level that can be set or any other way to say always return k answers? Do I have my understanding correct that it is up to k?

So based upon 12 documents, I have this distribution of returned answers:

1
1
2
1
4
4
2
1
2
2
5
5