Skip to content

Preserve non-streaming disconnect errors - #4894

Open
medisean wants to merge 1 commit into
InternLM:mainfrom
medisean:codex/preserve-generate-disconnect-error
Open

Preserve non-streaming disconnect errors#4894
medisean wants to merge 1 commit into
InternLM:mainfrom
medisean:codex/preserve-generate-disconnect-error

Conversation

@medisean

Copy link
Copy Markdown

Closes #4781\n\nSummary:\n- Keep the disconnect response available after leaving the streaming cleanup context.\n- Return the captured error response for non-streaming requests.\n\nTests:\n- Python syntax compilation passed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] legacy /generate's non-streaming disconnect branch discards its 400 response, returns 200 null instead

1 participant