[LEADS-415] Responses streaming support

[xmican10]

Description

Followup PR with supporting responses stream=True parameter

Type of change

• Refactor
• New feature
• Bug fix
• CVE fix
• Optimization
• Documentation Update
• Configuration Update
• Bump-up service version
• Bump-up dependent library
• Bump-up library or tool used for development (does not change the final image)
• CI configuration change
• Unit tests improvement

Tools used to create PR

Identify any AI code assistants used in this PR (for transparency and review context)

• Assisted-by: (e.g., Claude, CodeRabbit, Ollama, etc., N/A if not used)
• Generated by: (e.g., tool name and version; N/A if not used)

Related Tickets & Documents

• Related Issue #
• Closes #

Checklist before requesting a review

• I have performed a self-review of my code.
• PR has passed all pre-merge test jobs.
• If it is a core feature, I have added thorough tests.

Testing

• Please provide detailed steps to perform tests related to this code change.
• How were the fix/results from this change verified? Please provide relevant screenshots or results.

[coderabbitai]

Warning

Review limit reached

@xmican10, we couldn't start this review because you've reached your PR review rate limit.

More reviews will be available in 2 minutes and 8 seconds. Learn how PR review limits work.

Your organization has run out of usage credits. Purchase more credits in the billing tab to continue.

⌛ How to resolve this issue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans include higher PR review limits than trial, open-source, and free plans. In all cases, reviews become available again over time. During sustained high-volume PR review activity, CodeRabbit may temporarily slow when the next review becomes available.

Please see our Fair Usage Limits Policy for further information.

ℹ️ Review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: ed788f0e-58d1-404b-8cce-b207433d29e1

📥 Commits

Reviewing files that changed from the base of the PR and between 454d871 and 5bb24c3.

📒 Files selected for processing (19)

• config/system.yaml
• examples/01_getting_started/basic_setup/README.md
• examples/02_metrics/context_quality/README.md
• examples/02_metrics/conversation_quality/README.md
• examples/02_metrics/keywords_evaluation/README.md
• examples/02_metrics/nlp_metrics/README.md
• examples/02_metrics/response_quality/README.md
• examples/02_metrics/tool_evaluation/README.md
• examples/03_endpoints/responses/README.md
• examples/03_endpoints/responses/eval_data.yaml
• examples/03_endpoints/responses/system.yaml
• src/lightspeed_evaluation/core/api/client.py
• src/lightspeed_evaluation/core/api/streaming_parser.py
• src/lightspeed_evaluation/core/constants.py
• src/lightspeed_evaluation/core/metrics/custom/tool_eval.py
• tests/unit/core/api/conftest.py
• tests/unit/core/api/test_client_responses.py
• tests/unit/core/api/test_streaming_parser.py
• tests/unit/core/metrics/custom/test_tool_eval.py

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}