Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hardcoded NUM_MERGE_THREADS #2533

Open
Barre opened this issue Nov 4, 2024 · 2 comments
Open

Hardcoded NUM_MERGE_THREADS #2533

Barre opened this issue Nov 4, 2024 · 2 comments

Comments

@Barre
Copy link

Barre commented Nov 4, 2024

Hello,

I am trying to index a few billions documents.
In my usecase, the bottleneck seems to be the number of merging threads which seems to be hardcoded here: https://github.com/quickwit-oss/tantivy/blob/main/src/indexer/segment_updater.rs#L28

Would you be open to a PR that makes this configurable?

@Barre Barre changed the title Hardcoded MERGING_THREADS Hardcoded NUM_MERGE_THREADS Nov 4, 2024
@PSeitz
Copy link
Contributor

PSeitz commented Nov 5, 2024

Yes, that could be configurable

@fulmicoton
Copy link
Collaborator

agreed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants