Build an API service using haystack

[frankShih]

I have a chatbot web app (frontend + backend + DB).
Frontend server gets user query prompt and sends it to backend server API.
In backend server (using flask), I implement RAG-like workflow. Pre-process user prompt, get documents from DB and perform embedding search ... etc. In the end, return a generator function to meets streaming API response format.

Now, I try to use haystack to re-construct my RAG-like workflow, which is a bit messy (I want to make the code clean & reusable). However, I notice that haystack (or even langchain) module is more like a pipeline(workflow) design tool. I can barely find the resources about how to turn these pipeline into an API service for frontend server.

Any suggestions?

[julian-risch]

Hi @frankShih you can have a look at Hayhooks if you want to serve pipelines through a web app. Here is the docs page: https://docs.haystack.deepset.ai/docs/hayhooks and the repository: https://github.com/deepset-ai/hayhooks

[frankShih]

Thank you for your suggestion.

Regarding the Hayhooks you mentioned, I have seen it, but I found that the project seems to be in a very early stage. I am not sure if it is suitable to use it in the PROD environment.

Also, I have a question:
Is it appropriate to design a pipeline using tools like haystack or langchain, and then wrap it into an API service? Or are there other better ways to simply organize my self-implemented pipeline into a structure that is readable, scalable, and reusable?

[mrm1001]

Hi @frankShih would you mind giving us feedback about hayhooks? What do you think we should improve or add to the project to make it more suitable for your use case?