Wich document store for smart reseach in closed-domain

[sinaayyy]

Hello, I am working on an intelligent research project with a view to commercialization. I plan to use two retriever models bm25 and DPR type with a reader model type Roberta.
I've read about the different possible document stores (open source and free). However I can't decide which one would be the most adapted to be open source and free. Could someone help me?
Thanks

[bogdankostic]

Hi @sinaayyy! As you plan to use both BM25 and dense embeddings, I'd suggest using a document store that inherently support both methods. The document stores that support BM25 and allow customizing vector search in various ways are OpenSearchDocumentStore and WeaviateDocumentStore. Both of them are open source and can be used for free.

[sinaayyy]

Okay thanks a lot. I would like to know what are the advantages and disadvantages between weaviate and opensearch? Because I saw that weaviate was rather a vector database while opensearch is rather a search engine

[bogdankostic]

I don't know all the details about OpenSearch and Weaviate and also don't know the details about your requirements, so I can't tell you precisely what would be the best option for you. I'd suggest to use the database you're already most familiar with.

[sinaayyy]

Okay thanks