Semantic Search Engine - Multi Language #5298
sureshvytla
started this conversation in
General
Replies: 1 comment 3 replies
-
Hello @sureshvytla, Are you encountering any problems? To deal with documents of different languages, you can take a look at multilingual models, which you can use in the |
Beta Was this translation helpful? Give feedback.
3 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Dear Team,
We are working to fulfill the search use case using Haystack. Please review and guide us on the correct path.
Use Case
We have conversations and would like to search for conversations based on natural language queries.
Approach
sentence-transformers/multi-qa-mpnet-base-dot-v1
(also looked into DensePassageRetriever)For scalability, we have split the pipelines
Index Pipeline
Consume messages from messaging bus and add documents, update embeddings
Search Pipeline
API takes a query and returns the results
Please review the pipeline and suggest the right set of nodes and models to improve the search results. Also, looking to support other than the English language.
Thanks,
Suresh
Beta Was this translation helpful? Give feedback.
All reactions