Skip to content

accelerate_config_zero3_14B num_frames=81 #1157

@lwh0630

Description

@lwh0630

When I use the following deepspeed configuration (accelerate_config_zero3_14B

accelerate_config_zero3_14B.yaml

), training with num_frames=81 results in the following error:

train_log_dit_14B_81.txt

However, there is no problem with snum_frames=49.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions