Replies: 1 comment
-
Hey @IsmailCSV it looks like the Llama.CPP integration with Haystack only supports the ChatGenerator currently. I'd recommend opening an issue in this repo https://github.com/deepset-ai/haystack-core-integrations requesting support for embedding models hosted through Llama.cpp! |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello, I had previously created a pipeline using a local embedder that I just downloaded through Huggingface now I am trying to use an embedder that is hosted on a server through Llamacpp. I've done tons of research and have tried to utilize ChatGPT, but I cannot find an answer. I am hoping there is anyone here that could help or guide me in the right direction on how to achieve this.
Beta Was this translation helpful? Give feedback.
All reactions