Tenant Isolation at Provider level

[Jaimish00]

Currently, the biggest limitation for us using Bifrost is it not having Tenant Isolation for Providers and API Keys.

This is important thing for our product to adopt Bifrost, because without Tenant isolation, all the tenant might share the same base_url for Providers. Which is not possible in case of self-hosted LLMs.

Workaround for us was to create custom provider for each tenant, but that also is very limited because we are limited to only 6 Provider Types. I found an option issue discussing this, but there is no progress.

Does anyone have any suggestions or ideas for this? Should it be a feature? I think this can be gamechanger.