Add doc for reading experiment results locally #1361
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
github-actions
bot
added
langsmith
Contributor
|
Mintlify preview ID generated: preview-locale-1762795591-e17c51c |
jacoblee93
reviewed
Nov 11, 2025
|
|
||
| ## Iterate over evaluation results | ||
|
|
||
| The @[`evaluate()`][Client.evaluate] function returns an iterator when called with `blocking=False`. This allows you to process results as they're produced: |
Contributor
There was a problem hiding this comment.
I would explain a little bit about what blocking does?
I think blocking=True returns an iterator too?
Contributor
Author
There was a problem hiding this comment.
@jacoblee93 Yes! It is, good point. I've added in detail on both blocking=True / False and changed up one of the latter examples.
katmayb
force-pushed
the
local-experiment-results
branch
from
d5fc2ff to
d5e633d
Compare
Contributor
|
Mintlify preview ID generated: preview-locale-1762973887-039afea |
lnhsingh
reviewed
Nov 13, 2025
| - `result["example"].inputs`: The input values. | ||
| - `result["example"].outputs`: The reference outputs (if any). | ||
|
|
||
| ## Example: Implement a quality gate |
Collaborator
There was a problem hiding this comment.
nit/suggestion: move the example titles to H3, i.e., ## Example and ### Implement a quality gate
lnhsingh
approved these changes
Nov 13, 2025
Contributor
|
Mintlify preview ID generated: preview-locale-1763060172-dcaced8 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixes DOC-354
Add a page for reading local experiment results from evaluate response.
Also included further link refs for SDK in link_map.py.
Preview
https://langchain-5e9cc07a-preview-locale-1762795591-e17c51c.mintlify.app/langsmith/read-local-experiment-results