Skip to content

πŸš€ Feature Request: Manual Search QPS ControlΒ #566

@akhilpathivada

Description

@akhilpathivada

Problem

Streaming tests only measure maximum QPS by running searches as fast as possible. No option exists to test performance under controlled, specific QPS loads.

Current vs Proposed

  1. Current: insert_rate controllable, search rate runs at maximum speed
  2. Proposed: Add optional search_qps parameter for controlled search rates

Use Cases

  1. SLA Testing: "Can DB maintain 95% accuracy at 1000 QPS?"
  2. Resource Planning: "What's latency at target 500 QPS?"
  3. Load Comparison: "DB A vs B performance at same controlled load"
  4. Bottleneck Analysis: "At what QPS does performance degrade?"

Expected Behavior

  1. When search_qps not specified β†’ existing max QPS measurement (backward compatible)
  2. When search_qps specified β†’ test performance at that specific rate
  3. Results show both target QPS and achieved metrics

Questions

  1. Does this feature align with project roadmap?
  2. Any preferred approach or naming conventions?
  3. Should this extend to other test types beyond streaming?

Next Steps

I'm planning to contribute this feature to VectorDBBench. Should I go ahead with the implementation?
Any guidance on preferred approach or design considerations would be appreciated before I start working on it.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions