Skip to content

LMStudio: Add tool calling support #30004

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
notpeter opened this issue May 6, 2025 · 2 comments · Fixed by #30589
Closed

LMStudio: Add tool calling support #30004

notpeter opened this issue May 6, 2025 · 2 comments · Fixed by #30589
Labels
ai Improvement related to Assistant, Copilot, or other AI features

Comments

@notpeter
Copy link
Member

notpeter commented May 6, 2025

Summary

Add tool calling support to Zed LMStudio integration

Description

Blocked by:

See also:
@notpeter notpeter added ai Improvement related to Assistant, Copilot, or other AI features agent labels May 6, 2025
@imumesh18

This comment has been minimized.

Sign in to view
@notpeter

This comment has been minimized.

Sign in to view
@imumesh18 imumesh18 mentioned this issue May 6, 2025
Closed
4 tasks
@NexVeridian NexVeridian mentioned this issue May 9, 2025
Closed
@gyzerok gyzerok mentioned this issue May 12, 2025
Merged
Daquisu pushed a commit to Daquisu/zed that referenced this issue May 26, 2025
@gyzerok @benbrandt @Daquisu
language_models: Add support for tool use to LM Studio provider (zed-…
1cc365e 
…industries#30589)

Closes zed-industries#30004

**Quick demo:**


https://github.com/user-attachments/assets/0ac93851-81d7-4128-a34b-1f3ae4bcff6d

**Additional notes:**

I've tried to stick to existing code in OpenAI provider as much as
possible without changing much to keep the diff small.

This PR is done in collaboration with @yagil from LM Studio. We agreed
upon the format in which LM Studio will return information about tool
use support for the model in the upcoming version. As of current stable
version nothing is going to change for the users, but once they update
to a newer LM Studio tool use gets automatically enabled for them. I
think this is much better UX then defaulting to true right now.


Release Notes:

- Added support for tool calls to LM Studio provider

---------

Co-authored-by: Ben Brandt <benjamin.j.brandt@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
ai Improvement related to Assistant, Copilot, or other AI features
Projects
None yet
Milestone
No milestone
2 participants
@notpeter @imumesh18