New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEATURE]Enhancement of nested field query by avoiding copying of parent filter to int array #2217

Open

heemin32 opened this issue Oct 16, 2024 · 1 comment

Labels

enhancement Roadmap:Vector Database/GenAI

Collaborator

heemin32 commented Oct 16, 2024

For nested field, OpenSearch convert parent filter bitset to int array before passing it to JNI layer. https://github.com/opensearch-project/k-NN/blob/main/src/main/java/org/opensearch/knn/index/query/KNNWeight.java#L190C19-L190C36

We might be able to use the bitset directly from faiss engine without converting its format. This could save the both cpu and memory usage.

heemin32 added untriaged enhancement and removed untriaged labels

github-actions bot added the untriaged label

heemin32 added Roadmap:Vector Database/GenAI and removed untriaged labels

heemin32 added this to Vector Search RoadMap

github-project-automation bot moved this to Backlog in Vector Search RoadMap

Collaborator

luyuncheng commented Oct 21, 2024

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment