Skip to content

Vector search and embeddings API #58

@samuelcolvin

Description

@samuelcolvin

Currently we don't have anything, and the RAG example just uses OpenAI's plain API to generate embeddings.

It seems simple enough to add a dedicated API to models to generate embeddings, would wouldn't provide much on top of what the OpenAI SDK already offers, but would help a lot with Gemini where there's currently not interface in what we have.

I suspect that the vector search part is harder to provide an API for: anything beyond toy examples will require full control of the database being searched, and we're not (yet) building an ORM.

Am I wrong or missing something?

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions