You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When requesting a structured output from a reasoning LLM using the code below, only the json is returned by the LLM. We would like to have access to the reasoning of the LLM (generally encapsuled in between tags).
Generally speaking there is no reasoning -- Ollama, OpenAI, Gemin, etc. hide structured outputs as tool calls within their API
LLM classes that do not support function calling use json prompting, but tbh exposing this will kind of complicate this API design or even break usage for other users 🤔 I'll think a bit more about this
Feature Description
When requesting a structured output from a reasoning LLM using the code below, only the json is returned by the LLM. We would like to have access to the reasoning of the LLM (generally encapsuled in between tags).
Thanks for your work !
Reason
No response
Value of Feature
No response
The text was updated successfully, but these errors were encountered: