Skip to content

support tool wait in benchmark - #8107

Merged
qingqing01 merged 1 commit into
PaddlePaddle:developfrom
BingooYang:support_tool_real_time
Aug 12, 2026
Merged

support tool wait in benchmark#8107
qingqing01 merged 1 commit into
PaddlePaddle:developfrom
BingooYang:support_tool_real_time

Conversation

@BingooYang

Copy link
Copy Markdown
Contributor

Motivation

benchmark增加tool工具时间等待(需要配合带tool时间数据集使用,对之前功能不影响),解决:

  1. 静态多轮和RL真实场景调度 gap 比较大
  2. 动态多轮(真实调用工具)测试不稳定

Modifications

读取多轮数据集中 tool 在 RL 场景真实的等待时长,在发请求时 wait,模拟真实场景

Usage or Command

默认开启,如果需要关闭,请使用 export DISABLE_ENV_TOOL_WAIT=off

Accuracy Tests

Checklist

  • Add at least a tag in the PR title.
    • Tag list: [[FDConfig],[APIServer],[Engine], [Scheduler], [PD Disaggregation], [Executor], [Graph Optimization], [Speculative Decoding], [RL], [Models], [Quantization], [Loader], [OP], [KVCache], [DataProcessor], [BugFix], [Docs], [CI], [Optimization], [Feature], [Benchmark], [Others], [XPU], [HPU], [GCU], [DCU], [Iluvatar], [Metax]]
    • You can add new tags based on the PR content, but the semantics must be clear.
  • Format your code, run pre-commit before commit.
  • Add unit tests. Please write the reason in this PR if no unit tests.
  • Provide accuracy results.
  • If the current PR is submitting to the release branch, make sure the PR has been submitted to the develop branch, then cherry-pick it to the release branch with the [Cherry-Pick] PR tag.

@qingqing01
qingqing01 merged commit df4d552 into PaddlePaddle:develop Aug 12, 2026
42 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants