Skip to content

Commit 5498223

Browse files
committed
Ruff format
Signed-off-by: Kunjan Patel <kunjanp@google.com>
1 parent be62d37 commit 5498223

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

src/maxdiffusion/configs/base14.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -50,6 +50,8 @@ jit_initializers: True
5050
from_pt: False
5151
split_head_dim: True
5252
attention: 'dot_product' # Supported attention: dot_product, flash
53+
mask_padding_tokens: True # Whether to mask padding tokens in attention computation.
54+
attention_sharding_uniform: True # same sequence sharding rules applied for q in both (self and cross attention)
5355
flash_block_sizes: {}
5456
# GroupNorm groups
5557
norm_num_groups: 32

0 commit comments

Comments
 (0)