Skip to content

Conversation

@b41sh
Copy link
Member

@b41sh b41sh commented Nov 12, 2025

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

This PR significantly optimizes the vector index quantization score calculation by replacing the standard scalar computation with a SIMD-accelerated implementation. This change leads to substantial reductions in query latencies for vector search operations.

Performance Improvements: Comprehensive benchmark tests have been conducted to validate the impact of this optimization. The results demonstrate significant improvements in query QPS and latencies:

  • QPS: Increased from 84.58 to 86.15 (a ~1.8% improvement).
  • Serial_latency_p99: Reduced from 87.6ms to 45.3ms (a ~48.3% improvement).
  • Serial_latency_p95: Reduced from 78.7ms to 42.9ms (a ~45.5% improvement).

fixes: #[Link the issue here]

Tests

  • Unit Test
  • Logic Test
  • Benchmark Test
  • No Test - Explain why

Type of change

  • Bug Fix (non-breaking change which fixes an issue)
  • New Feature (non-breaking change which adds functionality)
  • Breaking Change (fix or feature that could cause existing functionality not to work as expected)
  • Documentation Update
  • Refactoring
  • Performance Improvement
  • Other (please describe):

This change is Reviewable

@github-actions github-actions bot added the pr-chore this PR only has small changes that no need to record, like coding styles. label Nov 12, 2025
@b41sh b41sh force-pushed the chore-hnsw-quantization-simd branch from 9dc2366 to e72e701 Compare November 12, 2025 07:33
@b41sh b41sh marked this pull request as ready for review November 14, 2025 09:27
Copy link

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

@b41sh b41sh merged commit 0c96b9b into databendlabs:main Nov 20, 2025
87 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-chore this PR only has small changes that no need to record, like coding styles.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants