You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: src/oss/langchain/middleware/built-in.mdx
+2Lines changed: 2 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1069,6 +1069,8 @@ Use an LLM to intelligently select relevant tools before calling the main model.
1069
1069
- Reducing token usage by filtering irrelevant tools.
1070
1070
- Improving model focus and accuracy.
1071
1071
1072
+
This middleware uses structured output to ask an LLM which tools are most relevant for the current query. The structured output schema defines the available tool names and descriptions. Model providers often add this structured output information to the system prompt behind the scenes.
0 commit comments