Skip to content

Add Streaming Capabiity Tutorial#19274

Open
igordayen wants to merge 2 commits into
eugenp:masterfrom
igordayen:streaming-with-reasoning
Open

Add Streaming Capabiity Tutorial#19274
igordayen wants to merge 2 commits into
eugenp:masterfrom
igordayen:streaming-with-reasoning

Conversation

@igordayen

@igordayen igordayen commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Summary

Integration tests for Embabel Agent streaming with OpenAI and Anthropic, covering structured
object streaming, text-instructed thinking, and tool-loop reasoning.

OpenAI (StreamingWithThinkingIntegrationTest)

  • whenStreaming_thenReceivesParkingRecommendation — basic structured streaming, single object received via reactive pipeline
  • whenStreamingWithInstructedThinking_thenReceivesReasoningBlocks — text-instructed thinking via <think> format; reasoning events emitted per line, tags present or stripped depending on chunking
  • whenStreamingMultipleScenarios_thenReceivesRecommendationPerScenario — collection streaming, one object per
    scenario streamed incrementally

Anthropic (StreamingWithThinkingAndToolingIntegrationTest)

  • whenStreamingWithThinking_thenReceivesReasoningAndRecommendation — thinking with token budget (< max_tokens=8192), no tools; multiple reasoning events emitted one per output line
  • whenStreamingWithThinkingAndTooling_thenReceivesRecommendationAndReasoning — tool-loop streaming with three parking tools; reasoning surfaced only from the final LLM iteration after all tool calls complete

Notes

  • Anthropic budget_tokens must be strictly less than max_tokens (8192 for claude-sonnet-4-5)
  • Intermediate reasoning between tool calls is not surfaced to the subscriber as per Spring AI Streaming infra
  • PR is work-in-progress; need to move common data structures to common module
  • switched to 1.0.0 (stable release)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant