Draft: anymodel activation scoring#989
Draft: anymodel activation scoring#989danielkorzekwa wants to merge 5 commits intodkorzekwa/anymodel_corefrom
Conversation
Signed-off-by: Daniel Korzekwa <dkorzekwa@nvidia.com>
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. 🗂️ Base branches to auto review (3)
Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
| mprint("Starting pruning activation scoring...") | ||
|
|
||
| # The checkpoint manager inside validate_model handles all progress tracking | ||
| validate_model(args=cfg.pruning, pipeline_parallel=True) |
There was a problem hiding this comment.
Why this is removed?
| ) -> None: | ||
| incompatible_keys.missing_keys.clear() | ||
| incompatible_keys.unexpected_keys.clear() | ||
| class DeciLMDummyBlock(DummyModule): |
There was a problem hiding this comment.
Are these dummy decilm blocks still used?
2 participants
What does this PR do?
Merging
anymodel acivation scoringintoanymodel core- this MR is only for reviewing. Ultimatelyanymodel acivation scoringshould be merged intofeature/puzzletrononceanymodel coreis merged there.