A request for guidance on a comparative experiment

[SimonHeye]

Thank you for your outstanding contributions to the community!
I would like to ask whether, when compared with other works, the same prompt was directly used to re-experiment on open-source models from other works, or whether the results from other works' papers were directly used? (Because I have seen that many other works only conduct experiments targeting a specific tool, rather than this multi-tool selection and invocation.)😎

[Zhuofeng-Li]

Hi, thanks for your kind words!

Since different baselines use different settings, please refer to the corresponding papers for more details.

[SimonHeye]

Hi, thanks for your kind words!嗨，感谢您的美言！

Since different baselines use different settings, please refer to the corresponding papers for more details.由于不同的基线使用了不同的设置，请参考相应的论文以获取更多详细信息。

Thank you for your reply. That is to say, agentflow is directly compared with other specialized models that only call one tool, rather than having other models like search-r1 also perform multi-tool selection and calling. The prompts for other models are set according to their papers, while agentflow seems to have an additional step of tool selection capability, is that correct?

[Zhuofeng-Li]

Not exactly — some baselines invoke multiple tools (e.g., Autogen). Please refer to the specific implementations in the original papers.

[SimonHeye]

Not exactly — some baselines invoke multiple tools (e.g., Autogen). Please refer to the specific implementations in the original papers.

For ToRL, which only calls one tool, is it set up using the prompt in their paper?