Skip to content

MB-62182: fast merge of vector indexes#47

Draft
Thejas-bhat wants to merge 10 commits intoblevefrom
merge_from
Draft

MB-62182: fast merge of vector indexes#47
Thejas-bhat wants to merge 10 commits intoblevefrom
merge_from

Conversation

@Thejas-bhat
Copy link
Member

@Thejas-bhat Thejas-bhat commented Mar 5, 2025

  • The existing merge_from API can be utilized to merge 2 IVF indexes provided they have identical centroid layout.
  • To avoid re-training in a segment architecture, a template index can be first created out of a random sample from the data when its size is known and fixed.
  • This template can be copied between segments and the inverted lists can be merged without affecting the learned context of the data distribution. This would also involve the merging of the direct map as well which stores the exact location of a key (vector) within the inverted lists.

@Thejas-bhat Thejas-bhat changed the title Draft: making a IndexIVF's merge_from API a little more flexible MB-62182: fast merge of vector indexes Jan 29, 2026
@Thejas-bhat Thejas-bhat moved this from Todo to In Progress in Fast Merge Jan 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: In Progress

Development

Successfully merging this pull request may close these issues.

1 participant