Session based chat message store #9328
mariosconsta
started this conversation in
Ideas
Replies: 1 comment
-
Hello... We will probably work on improving memory management in the future. Could you please add your request to this discussion (deepset-ai/haystack-experimental#75) so we can keep track of it? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello all!
I have a RAG system using Haystack with Milvus and Docling.
Everything is connected together using Open WebUI's Pipeline functionality for the front-end part.
After reading this tutorial, I've added the functionality to insert the conversation history into the LLMs context, which works wonderfully.
My only issue that, if the user creates a new chat, the conversation from the last chat will get loaded as well.
For example
chat_001
chat_002
From Open WebUI we can get session_IDs, so it would be nice if we could control the InMemoryChatMessageStore with different session_ids, and load those instead of just saving chat messages.
Or at least have a way to clear the InMemoryChatMessageStore and load only the chat messages which are provided by Open WebUI as a dictionary.
Beta Was this translation helpful? Give feedback.
All reactions