Skip to content

feat(tools): support turbo quantizer in core tool set - #684

Open
richyreachy wants to merge 23 commits into
alibaba:mainfrom
richyreachy:feat/tools_turbo_quantizer
Open

feat(tools): support turbo quantizer in core tool set#684
richyreachy wants to merge 23 commits into
alibaba:mainfrom
richyreachy:feat/tools_turbo_quantizer

Conversation

@richyreachy

Copy link
Copy Markdown
Collaborator

Adds end-to-end turbo quantizer support to the offline tooling pipeline, so an index can be built from quantized vectors with core tool and searched correctly through index flow with query-side quantization.

Comment thread src/core/framework/index_flow.cc
@richyreachy
richyreachy requested a review from zhourrr as a code owner August 18, 2026 09:30
Comment thread tools/core/local_builder.cc Outdated
Comment thread src/core/framework/index_flow.cc
if (ailego_unlikely(!metric_->is_matched(meta_, new_qmeta))) {
return IndexError_Mismatch;
}
error_code = searcher_->search_impl(

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

query_quantizer_->distance() 怎么在searcher起作用?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

在index searcher里增加了一个init,传递quantizer,

//! Initialize the streamer with a quantizer for distance computation
  virtual int init(
      const IndexMeta & /*meta*/, const ailego::Params & /*params*/,
      const std::shared_ptr<zvec::turbo::Quantizer> & /*quantizer*/) {
    return IndexError_NotImplemented;
  }

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

子类有override吗?好像没看到?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants