Skip to content

[FEAT]: Integrate Docker Model Runner as a Local Inferencing provide #4391

@ericcurtin

Description

@ericcurtin

What would you like to see?

I remember seeing:

https://www.linkedin.com/posts/docker_docker-genai-llm-activity-7318272558909304832-aBJi?utm_source=share&utm_medium=member_desktop&rcm=ACoAAAZRsnUBW5iL5v_Xf22wBZVUAoKR30FOY_w

and saying cool, hopefully we should see Docker Model Runner + AnythingLLM integrated soon. Installed AnythingLLM today intending on using it as a Docker Model Runner UI and noticed Docker Model Runner isn't an option for a provider. Can we make it an option?

Tagging @kiview @doringeman for awareness

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions