Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Split segments / Export Segments / Import Segments #2507

Open
fhilgers opened this issue Oct 6, 2024 · 0 comments
Open

Split segments / Export Segments / Import Segments #2507

fhilgers opened this issue Oct 6, 2024 · 0 comments

Comments

@fhilgers
Copy link

fhilgers commented Oct 6, 2024

Is there a way to extract specific documents from a segment to its own segment?

Is there a way to export segments from one Index to another?

Is there a way to import segments from another index?

Motivating usecase:

I want to create a sort of "cloud storage" over s3. Each user can specify their own bucket and each user has their own personal tantivy index for their files. Each user adds the documents to their own index prior to uploading them to s3.

Sharing files on s3 to other users will be done via acls.

I would like to be able to export the just the result of indexing these files to be shared to the user user, so that they can just import the index, and do not have to download the file and reindex it themselves.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant