Skip to content

Restore instructions from transcript#156

Open
finnvoor wants to merge 1 commit intohuggingface:mainfrom
finnvoor:restore-instructions-from-transcript
Open

Restore instructions from transcript#156
finnvoor wants to merge 1 commit intohuggingface:mainfrom
finnvoor:restore-instructions-from-transcript

Conversation

@finnvoor
Copy link
Copy Markdown

@finnvoor finnvoor commented Apr 26, 2026

in order to 100% restore a session from a transcript (necessary to maintain cache for some models), the system instructions should be loaded from the transcript. Right now they are nil when using the transcript init of LangaugeModelSession.

  • Restore session-level instructions when constructing a LanguageModelSession from a transcript with a leading instructions entry
  • Recover the instruction text directly from the single text segment emitted by LanguageModelSession, preserving it byte-for-byte
  • Add one focused regression test for transcript-based instruction restoration

@finnvoor finnvoor marked this pull request as draft April 26, 2026 13:47
@finnvoor finnvoor force-pushed the restore-instructions-from-transcript branch 2 times, most recently from ba7395f to 3892da1 Compare April 26, 2026 13:49
@finnvoor finnvoor force-pushed the restore-instructions-from-transcript branch from 3892da1 to deab898 Compare April 26, 2026 13:56
@finnvoor finnvoor changed the title Restore session instructions from transcripts Restore instructions from transcript Apr 26, 2026
@finnvoor finnvoor marked this pull request as ready for review April 26, 2026 14:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant