Skip to content

Add a direct IO option to rescore_vector for bbq_hnsw #130893

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 6 commits into
base: lucene_snapshot
Choose a base branch
from
Open

Add a direct IO option to rescore_vector for bbq_hnsw #130893

wants to merge 6 commits into from

Conversation

thecoop
Copy link
Member

@thecoop thecoop commented Jul 9, 2025 •
edited
Loading

Change the JVM option to an index option

@thecoop thecoop requested review from benwtrent and ChrisHegarty July 9, 2025 09:54
@thecoop thecoop force-pushed the direct-io-index-option branch from 7fec052 to 73e3cc0 Compare July 9, 2025 14:23
@thecoop
Copy link
Member Author

thecoop commented Jul 14, 2025 •
edited
Loading

I've added it as a separate option - but the name needs some work. use_direct_io is an implementation-specific term that users wont understand without context. It's used in low-memory scenarios, so maybe something like low_memory_io? low_memory_mode?

I went with disable_offheap_cache_rescoring

@thecoop thecoop requested a review from benwtrent July 14, 2025 13:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ChrisHegarty ChrisHegarty Awaiting requested review from ChrisHegarty

@benwtrent benwtrent Awaiting requested review from benwtrent

Assignees
No one assigned
Labels
>feature :Search Relevance/Vectors Vector search WIP
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@thecoop @benwtrent