[Feature] Support local LLMs

[GhostDog98]

I would suggest the Ollama api as that is well documented and supports many llms.

[moval0x1]

Thanks for your suggestion! I will take a look at it.