-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Open
Labels
Description
Proposal summary
Context:
It's common to use structured outputs with LLMs as it provides a consistent way to generated JSON structures for example.
Feature:
Add support for structured outputs in the playground, users should be able to pass in a JSON schema and have this used to generate the output.
Implementation considerations:
Not every providers supports structured outputs, this option in the settings will need to be configured only for the supported providers
Note: This feature will require some FE and BE work, might not be suitable for first time contributors. If you aren't sure, feel free to reach out
Motivation
No response