Skip to content

Additional minimal changes for VDB modular backend support @https://github.com/mlcommons/storage/pull/316#379

Open
idevasena wants to merge 5 commits into
mainfrom
pr316
Open

Additional minimal changes for VDB modular backend support @https://github.com/mlcommons/storage/pull/316#379
idevasena wants to merge 5 commits into
mainfrom
pr316

Conversation

@idevasena
Copy link
Copy Markdown
Contributor

Summary

This PR documents the new modular backend-agnostic VectorDB benchmark runner as a standalone preview and adds the supporting fixes/tests needed to validate it independently from the existing mlpstorage vectordb path.

The modular runner is available through:

python -m vdbbench.benchmark

or

uv run python -m vdbbench.benchmark

Scope of this PR

This PR includes the following minimal changes:

Documentation

  1. Updates vdb_benchmark/README.md to describe the modular runner as a standalone preview.
  2. Documents how to invoke the modular runner directly.
  3. Documents backend dependency requirements.
  4. Documents backend connection environment variables.
  5. Clearly states that multi-node and multi-client VDB benchmark execution is not implemented yet.
  6. Clarifies that ./mlpstorage vectordb continues to use the Milvus-oriented runner.
  7. Adds tests for different backend support

@idevasena idevasena requested a review from a team May 19, 2026 15:59
@github-actions
Copy link
Copy Markdown

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants