Feat Request: Different OpenAI API Support

[egelhaus]

Support for different kind of APIs because there are multiple Providers which support the OpenAI API, so just be able to change the API URL in the env.
I can't raise an PR.

[cchance27]

Seems like this would be a quick change, just gotta update the 3 files that reference the OpenAI module... to add the

const openai = new OpenAI({
apiKey: process.env.OPENAI_API_KEY || 'sk-proj-',
baseURL: process.env.OPENAI_BASE_URL || 'https://api.openai.com/v1',
});

would do it but not home at moment, would also allow you to point it to local ollama and other instances

[egelhaus]

Yeah @cchance27 , but we would also need to configure the model, since it won't be compatible with local Instances.

[cchance27]

Ah True True, Not to mention system messages might want to be different for the various prompts, might want to expose or move those to a config or conf in the db to be adjustable, i tend to find ENV variables are great for the base_url, key, model name, but if it ends up being that things like the system messages etc should be adjustable maybe its best to have those manageable from the admin section perhaps?

[egelhaus]

Yeah, that would be good