Vector store support: Ingest anything

[amotl]

About

ingest-anything is a Python package aimed at providing a smooth solution to ingest non-PDF files into vector databases, given that most ingestion pipelines are focused on PDF/markdown files. Leveraging chonkie, PdfItDown, Llamaindex, Sentence Transformers embeddings and Qdrant, ingest-anything gives you a fully-automated pipeline for document ingestion within few lines of code.

References

• https://github.com/AstraBert/ingest-anything
• https://pdfitdown.eu/built-with-pdfitdown/ingest-anything

[amotl]

Import PDF

• https://github.com/brencon/pdf-to-markdown

[amotl]

Access binary files

• https://github.com/wader/fq