Commit 75c79e9
committed
Document Eagle3 auxiliary layer default selection in Llama
Add documentation explaining that get_eagle3_aux_hidden_state_layers()
provides default layer selection and that the GPU model runner can
override this with values from speculative config for dynamic
configuration.
Signed-off-by: rahul-tuli <rtuli@redhat.com>1 parent 4d812bb commit 75c79e9
1 file changed
+5
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
578 | 578 | | |
579 | 579 | | |
580 | 580 | | |
| 581 | + | |
| 582 | + | |
| 583 | + | |
| 584 | + | |
| 585 | + | |
581 | 586 | | |
582 | 587 | | |
583 | 588 | | |
| |||
0 commit comments