Skip to content

Commit e6010a7

Browse files
authored
feat: set the default value of micro_batch_num to 1. (#337)
1 parent 26c17c8 commit e6010a7

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

xllm/core/common/global_flags.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -349,7 +349,7 @@ DEFINE_bool(
349349
"and two micro batches in prefill stage.");
350350

351351
DEFINE_int32(micro_batch_num,
352-
2,
352+
1,
353353
"Default use two micro batches for multi-stream parallel.");
354354

355355
// --- dit config ---

0 commit comments

Comments
 (0)