Skip to content

[FR]: Add support for structured outputs in the playground #3444

@jverre

Description

@jverre

Proposal summary

Context:
It's common to use structured outputs with LLMs as it provides a consistent way to generated JSON structures for example.

Feature:
Add support for structured outputs in the playground, users should be able to pass in a JSON schema and have this used to generate the output.

Implementation considerations:
Not every providers supports structured outputs, this option in the settings will need to be configured only for the supported providers

Note: This feature will require some FE and BE work, might not be suitable for first time contributors. If you aren't sure, feel free to reach out

Motivation

No response

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions