Skip to content

Commit 8aa3c72

Browse files
ruodilcodego7250
authored andcommitted
[https://nvbugs/5582091][test] increase warmup times in testing for multi-gpu cases (NVIDIA#9578)
Signed-off-by: Ruodi Lu <ruodil@users.noreply.github.com> Co-authored-by: Ruodi Lu <ruodil@users.noreply.github.com>
1 parent d5b4c59 commit 8aa3c72

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

tests/integration/defs/perf/test_perf.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1732,6 +1732,8 @@ def get_trtllm_bench_command(self, engine_dir):
17321732
benchmark_cmd += [f"--pp={self._config.pp_size}"]
17331733
if self._config.streaming == "streaming":
17341734
benchmark_cmd += [f"--streaming"]
1735+
if self._config.num_gpus > 1:
1736+
benchmark_cmd += [f"--warmup={2 * self._config.num_gpus}"]
17351737

17361738
#Add extra-llm-api-config.yml for pytorch backend and tensorrt backend with extra flag
17371739
if self._config.backend == "pytorch" or (self._config.backend == ""

0 commit comments

Comments
 (0)