Skip to content

Add support for Lucene 10.2–10.5 - #2702

Draft
imotov wants to merge 17 commits into
NVIDIA:mainfrom
imotov:issue-2410-support-multiple-lucene-versions
Draft

imotov wants to merge 17 commits into
NVIDIA:mainfrom
imotov:issue-2410-support-multiple-lucene-versions

Conversation

@imotov

@imotov imotov commented Sep 30, 2026

Copy link
Copy Markdown
Contributor

Build a separate jar for each Lucene minor release from 10.2 to 10.5, since Lucene changes its codec APIs between minor releases. All modules compile the same shared sources. Codecs built on an older Lucene release's default codec stay registered so existing indexes can still be read, but they can no longer write.

Fixes #2410

@copy-pr-bot

copy-pr-bot Bot commented Sep 30, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@imotov imotov added improvement Improves an existing functionality Lucene labels Sep 30, 2026
Build a separate jar for each Lucene minor release from 10.2 to 10.5, since Lucene changes its codec
APIs between minor releases. All modules compile the same shared sources. Codecs built on an older Lucene release's default codec stay registered so existing indexes can still be read, but they can no longer write.

Fixes NVIDIA#2410
@imotov
imotov force-pushed the issue-2410-support-multiple-lucene-versions branch from 75b3caf to ee335be Compare September 30, 2026 02:46
@imotov

imotov commented Sep 30, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test ee335be

@imotov

imotov commented Oct 1, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test b10ab96

@imotov

imotov commented Oct 1, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 71b6640

imotov added 11 commits October 2, 2026 06:16
Lucene 10.4+ sizes the merged graph from the M recorded in a source segment's metadata. If that M falls below maxConn, which happens for small segments where cuVS truncates the graph degree, CPU merges of such segments fail. Always record an M of at least maxConn, as Lucene's own HNSW writer does.
It will only make the same query to run twice.
@imotov

imotov commented Oct 2, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test f2db35d

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

improvement Improves an existing functionality Lucene non-breaking Introduces a non-breaking change

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

[FEA] Support Lucene 10.2, 10.3, 10.4, 10.5 simultaneously

1 participant